Jun 09 15:11:38.549647 ip-10-0-130-232 systemd[1]: kubelet.service: Failed to load environment files: No such file or directory Jun 09 15:11:38.549659 ip-10-0-130-232 systemd[1]: kubelet.service: Failed to run 'start-pre' task: No such file or directory Jun 09 15:11:38.549669 ip-10-0-130-232 systemd[1]: kubelet.service: Failed with result 'resources'. Jun 09 15:11:38.549901 ip-10-0-130-232 systemd[1]: Failed to start Kubernetes Kubelet. Jun 09 15:11:48.572078 ip-10-0-130-232 systemd[1]: kubelet.service: Failed to schedule restart job: Unit crio.service not found. Jun 09 15:11:48.572100 ip-10-0-130-232 systemd[1]: kubelet.service: Failed with result 'resources'. -- Boot d7e86a326a144dd9ae94e055f7724940 -- Jun 09 15:14:20.213144 ip-10-0-130-232 systemd[1]: Starting Kubernetes Kubelet... Jun 09 15:14:20.539116 ip-10-0-130-232 kubenswrapper[2575]: Flag --container-runtime-endpoint has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Jun 09 15:14:20.539116 ip-10-0-130-232 kubenswrapper[2575]: Flag --minimum-container-ttl-duration has been deprecated, Use --eviction-hard or --eviction-soft instead. Will be removed in a future version. Jun 09 15:14:20.539116 ip-10-0-130-232 kubenswrapper[2575]: Flag --volume-plugin-dir has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Jun 09 15:14:20.539116 ip-10-0-130-232 kubenswrapper[2575]: Flag --pod-infra-container-image has been deprecated, will be removed in 1.35. Image garbage collector will get sandbox image information from CRI. Jun 09 15:14:20.539116 ip-10-0-130-232 kubenswrapper[2575]: Flag --system-reserved has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Jun 09 15:14:20.539796 ip-10-0-130-232 kubenswrapper[2575]: I0609 15:14:20.539717 2575 server.go:213] "--pod-infra-container-image will not be pruned by the image garbage collector in kubelet and should also be set in the remote runtime" Jun 09 15:14:20.543115 ip-10-0-130-232 kubenswrapper[2575]: W0609 15:14:20.543099 2575 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jun 09 15:14:20.543115 ip-10-0-130-232 kubenswrapper[2575]: W0609 15:14:20.543114 2575 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jun 09 15:14:20.543184 ip-10-0-130-232 kubenswrapper[2575]: W0609 15:14:20.543118 2575 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jun 09 15:14:20.543184 ip-10-0-130-232 kubenswrapper[2575]: W0609 15:14:20.543121 2575 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jun 09 15:14:20.543184 ip-10-0-130-232 kubenswrapper[2575]: W0609 15:14:20.543125 2575 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jun 09 15:14:20.543184 ip-10-0-130-232 kubenswrapper[2575]: W0609 15:14:20.543127 2575 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jun 09 15:14:20.543184 ip-10-0-130-232 kubenswrapper[2575]: W0609 15:14:20.543130 2575 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jun 09 15:14:20.543184 ip-10-0-130-232 kubenswrapper[2575]: W0609 15:14:20.543132 2575 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jun 09 15:14:20.543184 ip-10-0-130-232 kubenswrapper[2575]: W0609 15:14:20.543136 2575 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jun 09 15:14:20.543184 ip-10-0-130-232 kubenswrapper[2575]: W0609 15:14:20.543140 2575 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jun 09 15:14:20.543184 ip-10-0-130-232 kubenswrapper[2575]: W0609 15:14:20.543143 2575 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jun 09 15:14:20.543184 ip-10-0-130-232 kubenswrapper[2575]: W0609 15:14:20.543145 2575 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jun 09 15:14:20.543184 ip-10-0-130-232 kubenswrapper[2575]: W0609 15:14:20.543148 2575 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jun 09 15:14:20.543184 ip-10-0-130-232 kubenswrapper[2575]: W0609 15:14:20.543152 2575 feature_gate.go:328] unrecognized feature gate: DualReplica Jun 09 15:14:20.543184 ip-10-0-130-232 kubenswrapper[2575]: W0609 15:14:20.543155 2575 feature_gate.go:328] unrecognized feature gate: Example2 Jun 09 15:14:20.543184 ip-10-0-130-232 kubenswrapper[2575]: W0609 15:14:20.543157 2575 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jun 09 15:14:20.543184 ip-10-0-130-232 kubenswrapper[2575]: W0609 15:14:20.543159 2575 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jun 09 15:14:20.543184 ip-10-0-130-232 kubenswrapper[2575]: W0609 15:14:20.543162 2575 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jun 09 15:14:20.543184 ip-10-0-130-232 kubenswrapper[2575]: W0609 15:14:20.543164 2575 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jun 09 15:14:20.543184 ip-10-0-130-232 kubenswrapper[2575]: W0609 15:14:20.543167 2575 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jun 09 15:14:20.543184 ip-10-0-130-232 kubenswrapper[2575]: W0609 15:14:20.543169 2575 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jun 09 15:14:20.543184 ip-10-0-130-232 kubenswrapper[2575]: W0609 15:14:20.543171 2575 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jun 09 15:14:20.543715 ip-10-0-130-232 kubenswrapper[2575]: W0609 15:14:20.543174 2575 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jun 09 15:14:20.543715 ip-10-0-130-232 kubenswrapper[2575]: W0609 15:14:20.543176 2575 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jun 09 15:14:20.543715 ip-10-0-130-232 kubenswrapper[2575]: W0609 15:14:20.543179 2575 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jun 09 15:14:20.543715 ip-10-0-130-232 kubenswrapper[2575]: W0609 15:14:20.543181 2575 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jun 09 15:14:20.543715 ip-10-0-130-232 kubenswrapper[2575]: W0609 15:14:20.543183 2575 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jun 09 15:14:20.543715 ip-10-0-130-232 kubenswrapper[2575]: W0609 15:14:20.543186 2575 feature_gate.go:328] unrecognized feature gate: Example Jun 09 15:14:20.543715 ip-10-0-130-232 kubenswrapper[2575]: W0609 15:14:20.543189 2575 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jun 09 15:14:20.543715 ip-10-0-130-232 kubenswrapper[2575]: W0609 15:14:20.543191 2575 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jun 09 15:14:20.543715 ip-10-0-130-232 kubenswrapper[2575]: W0609 15:14:20.543194 2575 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jun 09 15:14:20.543715 ip-10-0-130-232 kubenswrapper[2575]: W0609 15:14:20.543197 2575 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jun 09 15:14:20.543715 ip-10-0-130-232 kubenswrapper[2575]: W0609 15:14:20.543200 2575 feature_gate.go:328] unrecognized feature gate: NewOLM Jun 09 15:14:20.543715 ip-10-0-130-232 kubenswrapper[2575]: W0609 15:14:20.543202 2575 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jun 09 15:14:20.543715 ip-10-0-130-232 kubenswrapper[2575]: W0609 15:14:20.543205 2575 feature_gate.go:328] unrecognized feature gate: EventTTL Jun 09 15:14:20.543715 ip-10-0-130-232 kubenswrapper[2575]: W0609 15:14:20.543207 2575 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jun 09 15:14:20.543715 ip-10-0-130-232 kubenswrapper[2575]: W0609 15:14:20.543210 2575 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jun 09 15:14:20.543715 ip-10-0-130-232 kubenswrapper[2575]: W0609 15:14:20.543213 2575 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jun 09 15:14:20.543715 ip-10-0-130-232 kubenswrapper[2575]: W0609 15:14:20.543215 2575 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jun 09 15:14:20.543715 ip-10-0-130-232 kubenswrapper[2575]: W0609 15:14:20.543217 2575 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jun 09 15:14:20.543715 ip-10-0-130-232 kubenswrapper[2575]: W0609 15:14:20.543220 2575 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jun 09 15:14:20.543715 ip-10-0-130-232 kubenswrapper[2575]: W0609 15:14:20.543222 2575 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jun 09 15:14:20.544483 ip-10-0-130-232 kubenswrapper[2575]: W0609 15:14:20.543225 2575 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jun 09 15:14:20.544483 ip-10-0-130-232 kubenswrapper[2575]: W0609 15:14:20.543227 2575 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jun 09 15:14:20.544483 ip-10-0-130-232 kubenswrapper[2575]: W0609 15:14:20.543229 2575 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jun 09 15:14:20.544483 ip-10-0-130-232 kubenswrapper[2575]: W0609 15:14:20.543232 2575 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jun 09 15:14:20.544483 ip-10-0-130-232 kubenswrapper[2575]: W0609 15:14:20.543235 2575 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jun 09 15:14:20.544483 ip-10-0-130-232 kubenswrapper[2575]: W0609 15:14:20.543237 2575 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jun 09 15:14:20.544483 ip-10-0-130-232 kubenswrapper[2575]: W0609 15:14:20.543239 2575 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jun 09 15:14:20.544483 ip-10-0-130-232 kubenswrapper[2575]: W0609 15:14:20.543242 2575 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jun 09 15:14:20.544483 ip-10-0-130-232 kubenswrapper[2575]: W0609 15:14:20.543244 2575 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jun 09 15:14:20.544483 ip-10-0-130-232 kubenswrapper[2575]: W0609 15:14:20.543246 2575 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jun 09 15:14:20.544483 ip-10-0-130-232 kubenswrapper[2575]: W0609 15:14:20.543249 2575 feature_gate.go:328] unrecognized feature gate: SignatureStores Jun 09 15:14:20.544483 ip-10-0-130-232 kubenswrapper[2575]: W0609 15:14:20.543252 2575 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jun 09 15:14:20.544483 ip-10-0-130-232 kubenswrapper[2575]: W0609 15:14:20.543256 2575 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jun 09 15:14:20.544483 ip-10-0-130-232 kubenswrapper[2575]: W0609 15:14:20.543260 2575 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jun 09 15:14:20.544483 ip-10-0-130-232 kubenswrapper[2575]: W0609 15:14:20.543264 2575 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jun 09 15:14:20.544483 ip-10-0-130-232 kubenswrapper[2575]: W0609 15:14:20.543266 2575 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jun 09 15:14:20.544483 ip-10-0-130-232 kubenswrapper[2575]: W0609 15:14:20.543269 2575 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jun 09 15:14:20.544483 ip-10-0-130-232 kubenswrapper[2575]: W0609 15:14:20.543272 2575 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jun 09 15:14:20.544483 ip-10-0-130-232 kubenswrapper[2575]: W0609 15:14:20.543274 2575 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jun 09 15:14:20.545010 ip-10-0-130-232 kubenswrapper[2575]: W0609 15:14:20.543277 2575 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jun 09 15:14:20.545010 ip-10-0-130-232 kubenswrapper[2575]: W0609 15:14:20.543280 2575 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jun 09 15:14:20.545010 ip-10-0-130-232 kubenswrapper[2575]: W0609 15:14:20.543282 2575 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jun 09 15:14:20.545010 ip-10-0-130-232 kubenswrapper[2575]: W0609 15:14:20.543284 2575 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jun 09 15:14:20.545010 ip-10-0-130-232 kubenswrapper[2575]: W0609 15:14:20.543287 2575 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jun 09 15:14:20.545010 ip-10-0-130-232 kubenswrapper[2575]: W0609 15:14:20.543289 2575 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jun 09 15:14:20.545010 ip-10-0-130-232 kubenswrapper[2575]: W0609 15:14:20.543291 2575 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jun 09 15:14:20.545010 ip-10-0-130-232 kubenswrapper[2575]: W0609 15:14:20.543294 2575 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jun 09 15:14:20.545010 ip-10-0-130-232 kubenswrapper[2575]: W0609 15:14:20.543296 2575 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jun 09 15:14:20.545010 ip-10-0-130-232 kubenswrapper[2575]: W0609 15:14:20.543298 2575 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jun 09 15:14:20.545010 ip-10-0-130-232 kubenswrapper[2575]: W0609 15:14:20.543301 2575 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jun 09 15:14:20.545010 ip-10-0-130-232 kubenswrapper[2575]: W0609 15:14:20.543303 2575 feature_gate.go:328] unrecognized feature gate: OVNObservability Jun 09 15:14:20.545010 ip-10-0-130-232 kubenswrapper[2575]: W0609 15:14:20.543306 2575 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jun 09 15:14:20.545010 ip-10-0-130-232 kubenswrapper[2575]: W0609 15:14:20.543308 2575 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jun 09 15:14:20.545010 ip-10-0-130-232 kubenswrapper[2575]: W0609 15:14:20.543310 2575 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jun 09 15:14:20.545010 ip-10-0-130-232 kubenswrapper[2575]: W0609 15:14:20.543313 2575 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jun 09 15:14:20.545010 ip-10-0-130-232 kubenswrapper[2575]: W0609 15:14:20.543317 2575 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jun 09 15:14:20.545010 ip-10-0-130-232 kubenswrapper[2575]: W0609 15:14:20.543320 2575 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jun 09 15:14:20.545010 ip-10-0-130-232 kubenswrapper[2575]: W0609 15:14:20.543323 2575 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jun 09 15:14:20.545462 ip-10-0-130-232 kubenswrapper[2575]: W0609 15:14:20.543326 2575 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jun 09 15:14:20.545462 ip-10-0-130-232 kubenswrapper[2575]: W0609 15:14:20.543329 2575 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jun 09 15:14:20.545462 ip-10-0-130-232 kubenswrapper[2575]: W0609 15:14:20.543332 2575 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jun 09 15:14:20.545462 ip-10-0-130-232 kubenswrapper[2575]: W0609 15:14:20.543334 2575 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jun 09 15:14:20.545462 ip-10-0-130-232 kubenswrapper[2575]: W0609 15:14:20.543338 2575 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jun 09 15:14:20.545462 ip-10-0-130-232 kubenswrapper[2575]: W0609 15:14:20.543340 2575 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jun 09 15:14:20.545462 ip-10-0-130-232 kubenswrapper[2575]: W0609 15:14:20.543342 2575 feature_gate.go:328] unrecognized feature gate: PinnedImages Jun 09 15:14:20.545462 ip-10-0-130-232 kubenswrapper[2575]: W0609 15:14:20.543346 2575 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jun 09 15:14:20.545462 ip-10-0-130-232 kubenswrapper[2575]: W0609 15:14:20.543349 2575 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jun 09 15:14:20.545462 ip-10-0-130-232 kubenswrapper[2575]: W0609 15:14:20.543351 2575 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jun 09 15:14:20.545462 ip-10-0-130-232 kubenswrapper[2575]: W0609 15:14:20.543354 2575 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jun 09 15:14:20.545462 ip-10-0-130-232 kubenswrapper[2575]: W0609 15:14:20.543356 2575 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jun 09 15:14:20.545462 ip-10-0-130-232 kubenswrapper[2575]: W0609 15:14:20.543359 2575 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jun 09 15:14:20.545462 ip-10-0-130-232 kubenswrapper[2575]: W0609 15:14:20.543361 2575 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jun 09 15:14:20.545462 ip-10-0-130-232 kubenswrapper[2575]: W0609 15:14:20.543364 2575 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jun 09 15:14:20.545462 ip-10-0-130-232 kubenswrapper[2575]: W0609 15:14:20.543366 2575 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jun 09 15:14:20.545462 ip-10-0-130-232 kubenswrapper[2575]: W0609 15:14:20.543368 2575 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jun 09 15:14:20.545462 ip-10-0-130-232 kubenswrapper[2575]: W0609 15:14:20.543371 2575 feature_gate.go:328] unrecognized feature gate: OSStreams Jun 09 15:14:20.545462 ip-10-0-130-232 kubenswrapper[2575]: W0609 15:14:20.543373 2575 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jun 09 15:14:20.545967 ip-10-0-130-232 kubenswrapper[2575]: W0609 15:14:20.545950 2575 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jun 09 15:14:20.545967 ip-10-0-130-232 kubenswrapper[2575]: W0609 15:14:20.545962 2575 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jun 09 15:14:20.545967 ip-10-0-130-232 kubenswrapper[2575]: W0609 15:14:20.545965 2575 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jun 09 15:14:20.545967 ip-10-0-130-232 kubenswrapper[2575]: W0609 15:14:20.545968 2575 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jun 09 15:14:20.546066 ip-10-0-130-232 kubenswrapper[2575]: W0609 15:14:20.545971 2575 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jun 09 15:14:20.546066 ip-10-0-130-232 kubenswrapper[2575]: W0609 15:14:20.545974 2575 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jun 09 15:14:20.546066 ip-10-0-130-232 kubenswrapper[2575]: W0609 15:14:20.545976 2575 feature_gate.go:328] unrecognized feature gate: DualReplica Jun 09 15:14:20.546066 ip-10-0-130-232 kubenswrapper[2575]: W0609 15:14:20.545979 2575 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jun 09 15:14:20.546066 ip-10-0-130-232 kubenswrapper[2575]: W0609 15:14:20.545982 2575 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jun 09 15:14:20.546066 ip-10-0-130-232 kubenswrapper[2575]: W0609 15:14:20.545984 2575 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jun 09 15:14:20.546066 ip-10-0-130-232 kubenswrapper[2575]: W0609 15:14:20.545987 2575 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jun 09 15:14:20.546066 ip-10-0-130-232 kubenswrapper[2575]: W0609 15:14:20.545989 2575 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jun 09 15:14:20.546066 ip-10-0-130-232 kubenswrapper[2575]: W0609 15:14:20.545992 2575 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jun 09 15:14:20.546066 ip-10-0-130-232 kubenswrapper[2575]: W0609 15:14:20.545994 2575 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jun 09 15:14:20.546066 ip-10-0-130-232 kubenswrapper[2575]: W0609 15:14:20.545997 2575 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jun 09 15:14:20.546066 ip-10-0-130-232 kubenswrapper[2575]: W0609 15:14:20.546002 2575 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jun 09 15:14:20.546066 ip-10-0-130-232 kubenswrapper[2575]: W0609 15:14:20.546005 2575 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jun 09 15:14:20.546066 ip-10-0-130-232 kubenswrapper[2575]: W0609 15:14:20.546008 2575 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jun 09 15:14:20.546066 ip-10-0-130-232 kubenswrapper[2575]: W0609 15:14:20.546011 2575 feature_gate.go:328] unrecognized feature gate: PinnedImages Jun 09 15:14:20.546066 ip-10-0-130-232 kubenswrapper[2575]: W0609 15:14:20.546014 2575 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jun 09 15:14:20.546066 ip-10-0-130-232 kubenswrapper[2575]: W0609 15:14:20.546017 2575 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jun 09 15:14:20.546066 ip-10-0-130-232 kubenswrapper[2575]: W0609 15:14:20.546019 2575 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jun 09 15:14:20.546066 ip-10-0-130-232 kubenswrapper[2575]: W0609 15:14:20.546022 2575 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jun 09 15:14:20.546066 ip-10-0-130-232 kubenswrapper[2575]: W0609 15:14:20.546025 2575 feature_gate.go:328] unrecognized feature gate: SignatureStores Jun 09 15:14:20.546553 ip-10-0-130-232 kubenswrapper[2575]: W0609 15:14:20.546031 2575 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jun 09 15:14:20.546553 ip-10-0-130-232 kubenswrapper[2575]: W0609 15:14:20.546033 2575 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jun 09 15:14:20.546553 ip-10-0-130-232 kubenswrapper[2575]: W0609 15:14:20.546036 2575 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jun 09 15:14:20.546553 ip-10-0-130-232 kubenswrapper[2575]: W0609 15:14:20.546039 2575 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jun 09 15:14:20.546553 ip-10-0-130-232 kubenswrapper[2575]: W0609 15:14:20.546041 2575 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jun 09 15:14:20.546553 ip-10-0-130-232 kubenswrapper[2575]: W0609 15:14:20.546044 2575 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jun 09 15:14:20.546553 ip-10-0-130-232 kubenswrapper[2575]: W0609 15:14:20.546046 2575 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jun 09 15:14:20.546553 ip-10-0-130-232 kubenswrapper[2575]: W0609 15:14:20.546049 2575 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jun 09 15:14:20.546553 ip-10-0-130-232 kubenswrapper[2575]: W0609 15:14:20.546052 2575 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jun 09 15:14:20.546553 ip-10-0-130-232 kubenswrapper[2575]: W0609 15:14:20.546055 2575 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jun 09 15:14:20.546553 ip-10-0-130-232 kubenswrapper[2575]: W0609 15:14:20.546058 2575 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jun 09 15:14:20.546553 ip-10-0-130-232 kubenswrapper[2575]: W0609 15:14:20.546060 2575 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jun 09 15:14:20.546553 ip-10-0-130-232 kubenswrapper[2575]: W0609 15:14:20.546063 2575 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jun 09 15:14:20.546553 ip-10-0-130-232 kubenswrapper[2575]: W0609 15:14:20.546066 2575 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jun 09 15:14:20.546553 ip-10-0-130-232 kubenswrapper[2575]: W0609 15:14:20.546068 2575 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jun 09 15:14:20.546553 ip-10-0-130-232 kubenswrapper[2575]: W0609 15:14:20.546071 2575 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jun 09 15:14:20.546553 ip-10-0-130-232 kubenswrapper[2575]: W0609 15:14:20.546074 2575 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jun 09 15:14:20.546553 ip-10-0-130-232 kubenswrapper[2575]: W0609 15:14:20.546077 2575 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jun 09 15:14:20.546553 ip-10-0-130-232 kubenswrapper[2575]: W0609 15:14:20.546079 2575 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jun 09 15:14:20.546553 ip-10-0-130-232 kubenswrapper[2575]: W0609 15:14:20.546082 2575 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jun 09 15:14:20.547053 ip-10-0-130-232 kubenswrapper[2575]: W0609 15:14:20.546084 2575 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jun 09 15:14:20.547053 ip-10-0-130-232 kubenswrapper[2575]: W0609 15:14:20.546087 2575 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jun 09 15:14:20.547053 ip-10-0-130-232 kubenswrapper[2575]: W0609 15:14:20.546089 2575 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jun 09 15:14:20.547053 ip-10-0-130-232 kubenswrapper[2575]: W0609 15:14:20.546092 2575 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jun 09 15:14:20.547053 ip-10-0-130-232 kubenswrapper[2575]: W0609 15:14:20.546094 2575 feature_gate.go:328] unrecognized feature gate: EventTTL Jun 09 15:14:20.547053 ip-10-0-130-232 kubenswrapper[2575]: W0609 15:14:20.546097 2575 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jun 09 15:14:20.547053 ip-10-0-130-232 kubenswrapper[2575]: W0609 15:14:20.546099 2575 feature_gate.go:328] unrecognized feature gate: OVNObservability Jun 09 15:14:20.547053 ip-10-0-130-232 kubenswrapper[2575]: W0609 15:14:20.546102 2575 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jun 09 15:14:20.547053 ip-10-0-130-232 kubenswrapper[2575]: W0609 15:14:20.546104 2575 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jun 09 15:14:20.547053 ip-10-0-130-232 kubenswrapper[2575]: W0609 15:14:20.546107 2575 feature_gate.go:328] unrecognized feature gate: OSStreams Jun 09 15:14:20.547053 ip-10-0-130-232 kubenswrapper[2575]: W0609 15:14:20.546110 2575 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jun 09 15:14:20.547053 ip-10-0-130-232 kubenswrapper[2575]: W0609 15:14:20.546113 2575 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jun 09 15:14:20.547053 ip-10-0-130-232 kubenswrapper[2575]: W0609 15:14:20.546115 2575 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jun 09 15:14:20.547053 ip-10-0-130-232 kubenswrapper[2575]: W0609 15:14:20.546118 2575 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jun 09 15:14:20.547053 ip-10-0-130-232 kubenswrapper[2575]: W0609 15:14:20.546120 2575 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jun 09 15:14:20.547053 ip-10-0-130-232 kubenswrapper[2575]: W0609 15:14:20.546123 2575 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jun 09 15:14:20.547053 ip-10-0-130-232 kubenswrapper[2575]: W0609 15:14:20.546125 2575 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jun 09 15:14:20.547053 ip-10-0-130-232 kubenswrapper[2575]: W0609 15:14:20.546129 2575 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jun 09 15:14:20.547053 ip-10-0-130-232 kubenswrapper[2575]: W0609 15:14:20.546133 2575 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jun 09 15:14:20.547053 ip-10-0-130-232 kubenswrapper[2575]: W0609 15:14:20.546136 2575 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jun 09 15:14:20.547531 ip-10-0-130-232 kubenswrapper[2575]: W0609 15:14:20.546139 2575 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jun 09 15:14:20.547531 ip-10-0-130-232 kubenswrapper[2575]: W0609 15:14:20.546142 2575 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jun 09 15:14:20.547531 ip-10-0-130-232 kubenswrapper[2575]: W0609 15:14:20.546144 2575 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jun 09 15:14:20.547531 ip-10-0-130-232 kubenswrapper[2575]: W0609 15:14:20.546147 2575 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jun 09 15:14:20.547531 ip-10-0-130-232 kubenswrapper[2575]: W0609 15:14:20.546150 2575 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jun 09 15:14:20.547531 ip-10-0-130-232 kubenswrapper[2575]: W0609 15:14:20.546152 2575 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jun 09 15:14:20.547531 ip-10-0-130-232 kubenswrapper[2575]: W0609 15:14:20.546155 2575 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jun 09 15:14:20.547531 ip-10-0-130-232 kubenswrapper[2575]: W0609 15:14:20.546157 2575 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jun 09 15:14:20.547531 ip-10-0-130-232 kubenswrapper[2575]: W0609 15:14:20.546160 2575 feature_gate.go:328] unrecognized feature gate: Example2 Jun 09 15:14:20.547531 ip-10-0-130-232 kubenswrapper[2575]: W0609 15:14:20.546162 2575 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jun 09 15:14:20.547531 ip-10-0-130-232 kubenswrapper[2575]: W0609 15:14:20.546164 2575 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jun 09 15:14:20.547531 ip-10-0-130-232 kubenswrapper[2575]: W0609 15:14:20.546167 2575 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jun 09 15:14:20.547531 ip-10-0-130-232 kubenswrapper[2575]: W0609 15:14:20.546169 2575 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jun 09 15:14:20.547531 ip-10-0-130-232 kubenswrapper[2575]: W0609 15:14:20.546172 2575 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jun 09 15:14:20.547531 ip-10-0-130-232 kubenswrapper[2575]: W0609 15:14:20.546174 2575 feature_gate.go:328] unrecognized feature gate: NewOLM Jun 09 15:14:20.547531 ip-10-0-130-232 kubenswrapper[2575]: W0609 15:14:20.546177 2575 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jun 09 15:14:20.547531 ip-10-0-130-232 kubenswrapper[2575]: W0609 15:14:20.546181 2575 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jun 09 15:14:20.547531 ip-10-0-130-232 kubenswrapper[2575]: W0609 15:14:20.546185 2575 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jun 09 15:14:20.547531 ip-10-0-130-232 kubenswrapper[2575]: W0609 15:14:20.546188 2575 feature_gate.go:328] unrecognized feature gate: Example Jun 09 15:14:20.547531 ip-10-0-130-232 kubenswrapper[2575]: W0609 15:14:20.546192 2575 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jun 09 15:14:20.548030 ip-10-0-130-232 kubenswrapper[2575]: W0609 15:14:20.546195 2575 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jun 09 15:14:20.548030 ip-10-0-130-232 kubenswrapper[2575]: W0609 15:14:20.546198 2575 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jun 09 15:14:20.548030 ip-10-0-130-232 kubenswrapper[2575]: W0609 15:14:20.546201 2575 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jun 09 15:14:20.548030 ip-10-0-130-232 kubenswrapper[2575]: W0609 15:14:20.546203 2575 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jun 09 15:14:20.548030 ip-10-0-130-232 kubenswrapper[2575]: W0609 15:14:20.546206 2575 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jun 09 15:14:20.548030 ip-10-0-130-232 kubenswrapper[2575]: W0609 15:14:20.546208 2575 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jun 09 15:14:20.548030 ip-10-0-130-232 kubenswrapper[2575]: W0609 15:14:20.546211 2575 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jun 09 15:14:20.548030 ip-10-0-130-232 kubenswrapper[2575]: W0609 15:14:20.546214 2575 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jun 09 15:14:20.548030 ip-10-0-130-232 kubenswrapper[2575]: W0609 15:14:20.546216 2575 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jun 09 15:14:20.548030 ip-10-0-130-232 kubenswrapper[2575]: W0609 15:14:20.546219 2575 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jun 09 15:14:20.548030 ip-10-0-130-232 kubenswrapper[2575]: W0609 15:14:20.546221 2575 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jun 09 15:14:20.548030 ip-10-0-130-232 kubenswrapper[2575]: W0609 15:14:20.546224 2575 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jun 09 15:14:20.548030 ip-10-0-130-232 kubenswrapper[2575]: W0609 15:14:20.546227 2575 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jun 09 15:14:20.548030 ip-10-0-130-232 kubenswrapper[2575]: W0609 15:14:20.546230 2575 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jun 09 15:14:20.548030 ip-10-0-130-232 kubenswrapper[2575]: W0609 15:14:20.546232 2575 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jun 09 15:14:20.548030 ip-10-0-130-232 kubenswrapper[2575]: W0609 15:14:20.546627 2575 feature_gate.go:328] unrecognized feature gate: OSStreams Jun 09 15:14:20.548030 ip-10-0-130-232 kubenswrapper[2575]: W0609 15:14:20.546632 2575 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jun 09 15:14:20.548030 ip-10-0-130-232 kubenswrapper[2575]: W0609 15:14:20.546636 2575 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jun 09 15:14:20.548030 ip-10-0-130-232 kubenswrapper[2575]: W0609 15:14:20.546639 2575 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jun 09 15:14:20.548030 ip-10-0-130-232 kubenswrapper[2575]: W0609 15:14:20.546642 2575 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jun 09 15:14:20.548509 ip-10-0-130-232 kubenswrapper[2575]: W0609 15:14:20.546645 2575 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jun 09 15:14:20.548509 ip-10-0-130-232 kubenswrapper[2575]: W0609 15:14:20.546647 2575 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jun 09 15:14:20.548509 ip-10-0-130-232 kubenswrapper[2575]: W0609 15:14:20.546650 2575 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jun 09 15:14:20.548509 ip-10-0-130-232 kubenswrapper[2575]: W0609 15:14:20.546652 2575 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jun 09 15:14:20.548509 ip-10-0-130-232 kubenswrapper[2575]: W0609 15:14:20.546655 2575 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jun 09 15:14:20.548509 ip-10-0-130-232 kubenswrapper[2575]: W0609 15:14:20.546658 2575 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jun 09 15:14:20.548509 ip-10-0-130-232 kubenswrapper[2575]: W0609 15:14:20.546660 2575 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jun 09 15:14:20.548509 ip-10-0-130-232 kubenswrapper[2575]: W0609 15:14:20.546663 2575 feature_gate.go:328] unrecognized feature gate: Example2 Jun 09 15:14:20.548509 ip-10-0-130-232 kubenswrapper[2575]: W0609 15:14:20.546665 2575 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jun 09 15:14:20.548509 ip-10-0-130-232 kubenswrapper[2575]: W0609 15:14:20.546668 2575 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jun 09 15:14:20.548509 ip-10-0-130-232 kubenswrapper[2575]: W0609 15:14:20.546670 2575 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jun 09 15:14:20.548509 ip-10-0-130-232 kubenswrapper[2575]: W0609 15:14:20.546674 2575 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jun 09 15:14:20.548509 ip-10-0-130-232 kubenswrapper[2575]: W0609 15:14:20.546677 2575 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jun 09 15:14:20.548509 ip-10-0-130-232 kubenswrapper[2575]: W0609 15:14:20.546679 2575 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jun 09 15:14:20.548509 ip-10-0-130-232 kubenswrapper[2575]: W0609 15:14:20.546682 2575 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jun 09 15:14:20.548509 ip-10-0-130-232 kubenswrapper[2575]: W0609 15:14:20.546685 2575 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jun 09 15:14:20.548509 ip-10-0-130-232 kubenswrapper[2575]: W0609 15:14:20.546687 2575 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jun 09 15:14:20.548509 ip-10-0-130-232 kubenswrapper[2575]: W0609 15:14:20.546689 2575 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jun 09 15:14:20.548509 ip-10-0-130-232 kubenswrapper[2575]: W0609 15:14:20.546692 2575 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jun 09 15:14:20.548509 ip-10-0-130-232 kubenswrapper[2575]: W0609 15:14:20.546694 2575 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jun 09 15:14:20.548993 ip-10-0-130-232 kubenswrapper[2575]: W0609 15:14:20.546696 2575 feature_gate.go:328] unrecognized feature gate: NewOLM Jun 09 15:14:20.548993 ip-10-0-130-232 kubenswrapper[2575]: W0609 15:14:20.546700 2575 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jun 09 15:14:20.548993 ip-10-0-130-232 kubenswrapper[2575]: W0609 15:14:20.546702 2575 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jun 09 15:14:20.548993 ip-10-0-130-232 kubenswrapper[2575]: W0609 15:14:20.546705 2575 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jun 09 15:14:20.548993 ip-10-0-130-232 kubenswrapper[2575]: W0609 15:14:20.546708 2575 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jun 09 15:14:20.548993 ip-10-0-130-232 kubenswrapper[2575]: W0609 15:14:20.546710 2575 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jun 09 15:14:20.548993 ip-10-0-130-232 kubenswrapper[2575]: W0609 15:14:20.546713 2575 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jun 09 15:14:20.548993 ip-10-0-130-232 kubenswrapper[2575]: W0609 15:14:20.546716 2575 feature_gate.go:328] unrecognized feature gate: Example Jun 09 15:14:20.548993 ip-10-0-130-232 kubenswrapper[2575]: W0609 15:14:20.546719 2575 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jun 09 15:14:20.548993 ip-10-0-130-232 kubenswrapper[2575]: W0609 15:14:20.546723 2575 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jun 09 15:14:20.548993 ip-10-0-130-232 kubenswrapper[2575]: W0609 15:14:20.546726 2575 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jun 09 15:14:20.548993 ip-10-0-130-232 kubenswrapper[2575]: W0609 15:14:20.546729 2575 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jun 09 15:14:20.548993 ip-10-0-130-232 kubenswrapper[2575]: W0609 15:14:20.546732 2575 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jun 09 15:14:20.548993 ip-10-0-130-232 kubenswrapper[2575]: W0609 15:14:20.546734 2575 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jun 09 15:14:20.548993 ip-10-0-130-232 kubenswrapper[2575]: W0609 15:14:20.546736 2575 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jun 09 15:14:20.548993 ip-10-0-130-232 kubenswrapper[2575]: W0609 15:14:20.546739 2575 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jun 09 15:14:20.548993 ip-10-0-130-232 kubenswrapper[2575]: W0609 15:14:20.546741 2575 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jun 09 15:14:20.548993 ip-10-0-130-232 kubenswrapper[2575]: W0609 15:14:20.546743 2575 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jun 09 15:14:20.548993 ip-10-0-130-232 kubenswrapper[2575]: W0609 15:14:20.546746 2575 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jun 09 15:14:20.549449 ip-10-0-130-232 kubenswrapper[2575]: W0609 15:14:20.546748 2575 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jun 09 15:14:20.549449 ip-10-0-130-232 kubenswrapper[2575]: W0609 15:14:20.546752 2575 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jun 09 15:14:20.549449 ip-10-0-130-232 kubenswrapper[2575]: W0609 15:14:20.546756 2575 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jun 09 15:14:20.549449 ip-10-0-130-232 kubenswrapper[2575]: W0609 15:14:20.546759 2575 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jun 09 15:14:20.549449 ip-10-0-130-232 kubenswrapper[2575]: W0609 15:14:20.546762 2575 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jun 09 15:14:20.549449 ip-10-0-130-232 kubenswrapper[2575]: W0609 15:14:20.546765 2575 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jun 09 15:14:20.549449 ip-10-0-130-232 kubenswrapper[2575]: W0609 15:14:20.546768 2575 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jun 09 15:14:20.549449 ip-10-0-130-232 kubenswrapper[2575]: W0609 15:14:20.546770 2575 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jun 09 15:14:20.549449 ip-10-0-130-232 kubenswrapper[2575]: W0609 15:14:20.546773 2575 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jun 09 15:14:20.549449 ip-10-0-130-232 kubenswrapper[2575]: W0609 15:14:20.546775 2575 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jun 09 15:14:20.549449 ip-10-0-130-232 kubenswrapper[2575]: W0609 15:14:20.546778 2575 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jun 09 15:14:20.549449 ip-10-0-130-232 kubenswrapper[2575]: W0609 15:14:20.546780 2575 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jun 09 15:14:20.549449 ip-10-0-130-232 kubenswrapper[2575]: W0609 15:14:20.546783 2575 feature_gate.go:328] unrecognized feature gate: DualReplica Jun 09 15:14:20.549449 ip-10-0-130-232 kubenswrapper[2575]: W0609 15:14:20.546785 2575 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jun 09 15:14:20.549449 ip-10-0-130-232 kubenswrapper[2575]: W0609 15:14:20.546788 2575 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jun 09 15:14:20.549449 ip-10-0-130-232 kubenswrapper[2575]: W0609 15:14:20.546791 2575 feature_gate.go:328] unrecognized feature gate: EventTTL Jun 09 15:14:20.549449 ip-10-0-130-232 kubenswrapper[2575]: W0609 15:14:20.546793 2575 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jun 09 15:14:20.549449 ip-10-0-130-232 kubenswrapper[2575]: W0609 15:14:20.546796 2575 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jun 09 15:14:20.549449 ip-10-0-130-232 kubenswrapper[2575]: W0609 15:14:20.546799 2575 feature_gate.go:328] unrecognized feature gate: OVNObservability Jun 09 15:14:20.549449 ip-10-0-130-232 kubenswrapper[2575]: W0609 15:14:20.546802 2575 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jun 09 15:14:20.549955 ip-10-0-130-232 kubenswrapper[2575]: W0609 15:14:20.546805 2575 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jun 09 15:14:20.549955 ip-10-0-130-232 kubenswrapper[2575]: W0609 15:14:20.546808 2575 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jun 09 15:14:20.549955 ip-10-0-130-232 kubenswrapper[2575]: W0609 15:14:20.546810 2575 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jun 09 15:14:20.549955 ip-10-0-130-232 kubenswrapper[2575]: W0609 15:14:20.546813 2575 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jun 09 15:14:20.549955 ip-10-0-130-232 kubenswrapper[2575]: W0609 15:14:20.546815 2575 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jun 09 15:14:20.549955 ip-10-0-130-232 kubenswrapper[2575]: W0609 15:14:20.546817 2575 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jun 09 15:14:20.549955 ip-10-0-130-232 kubenswrapper[2575]: W0609 15:14:20.546820 2575 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jun 09 15:14:20.549955 ip-10-0-130-232 kubenswrapper[2575]: W0609 15:14:20.546822 2575 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jun 09 15:14:20.549955 ip-10-0-130-232 kubenswrapper[2575]: W0609 15:14:20.546825 2575 feature_gate.go:328] unrecognized feature gate: PinnedImages Jun 09 15:14:20.549955 ip-10-0-130-232 kubenswrapper[2575]: W0609 15:14:20.546827 2575 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jun 09 15:14:20.549955 ip-10-0-130-232 kubenswrapper[2575]: W0609 15:14:20.546829 2575 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jun 09 15:14:20.549955 ip-10-0-130-232 kubenswrapper[2575]: W0609 15:14:20.546832 2575 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jun 09 15:14:20.549955 ip-10-0-130-232 kubenswrapper[2575]: W0609 15:14:20.546834 2575 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jun 09 15:14:20.549955 ip-10-0-130-232 kubenswrapper[2575]: W0609 15:14:20.546836 2575 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jun 09 15:14:20.549955 ip-10-0-130-232 kubenswrapper[2575]: W0609 15:14:20.546839 2575 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jun 09 15:14:20.549955 ip-10-0-130-232 kubenswrapper[2575]: W0609 15:14:20.546856 2575 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jun 09 15:14:20.549955 ip-10-0-130-232 kubenswrapper[2575]: W0609 15:14:20.546859 2575 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jun 09 15:14:20.549955 ip-10-0-130-232 kubenswrapper[2575]: W0609 15:14:20.546861 2575 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jun 09 15:14:20.549955 ip-10-0-130-232 kubenswrapper[2575]: W0609 15:14:20.546864 2575 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jun 09 15:14:20.549955 ip-10-0-130-232 kubenswrapper[2575]: W0609 15:14:20.546867 2575 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jun 09 15:14:20.550438 ip-10-0-130-232 kubenswrapper[2575]: W0609 15:14:20.546869 2575 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jun 09 15:14:20.550438 ip-10-0-130-232 kubenswrapper[2575]: W0609 15:14:20.546871 2575 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jun 09 15:14:20.550438 ip-10-0-130-232 kubenswrapper[2575]: W0609 15:14:20.546874 2575 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jun 09 15:14:20.550438 ip-10-0-130-232 kubenswrapper[2575]: W0609 15:14:20.546876 2575 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jun 09 15:14:20.550438 ip-10-0-130-232 kubenswrapper[2575]: W0609 15:14:20.546879 2575 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jun 09 15:14:20.550438 ip-10-0-130-232 kubenswrapper[2575]: W0609 15:14:20.546881 2575 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jun 09 15:14:20.550438 ip-10-0-130-232 kubenswrapper[2575]: W0609 15:14:20.546884 2575 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jun 09 15:14:20.550438 ip-10-0-130-232 kubenswrapper[2575]: W0609 15:14:20.546886 2575 feature_gate.go:328] unrecognized feature gate: SignatureStores Jun 09 15:14:20.550438 ip-10-0-130-232 kubenswrapper[2575]: W0609 15:14:20.546888 2575 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jun 09 15:14:20.550438 ip-10-0-130-232 kubenswrapper[2575]: W0609 15:14:20.546891 2575 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jun 09 15:14:20.550438 ip-10-0-130-232 kubenswrapper[2575]: W0609 15:14:20.546894 2575 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jun 09 15:14:20.550438 ip-10-0-130-232 kubenswrapper[2575]: W0609 15:14:20.546897 2575 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jun 09 15:14:20.550438 ip-10-0-130-232 kubenswrapper[2575]: W0609 15:14:20.546899 2575 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jun 09 15:14:20.550438 ip-10-0-130-232 kubenswrapper[2575]: W0609 15:14:20.546903 2575 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jun 09 15:14:20.550438 ip-10-0-130-232 kubenswrapper[2575]: W0609 15:14:20.546907 2575 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jun 09 15:14:20.550438 ip-10-0-130-232 kubenswrapper[2575]: I0609 15:14:20.546975 2575 flags.go:64] FLAG: --address="0.0.0.0" Jun 09 15:14:20.550438 ip-10-0-130-232 kubenswrapper[2575]: I0609 15:14:20.546981 2575 flags.go:64] FLAG: --allowed-unsafe-sysctls="[]" Jun 09 15:14:20.550438 ip-10-0-130-232 kubenswrapper[2575]: I0609 15:14:20.546987 2575 flags.go:64] FLAG: --anonymous-auth="true" Jun 09 15:14:20.550438 ip-10-0-130-232 kubenswrapper[2575]: I0609 15:14:20.546991 2575 flags.go:64] FLAG: --application-metrics-count-limit="100" Jun 09 15:14:20.550438 ip-10-0-130-232 kubenswrapper[2575]: I0609 15:14:20.546994 2575 flags.go:64] FLAG: --authentication-token-webhook="false" Jun 09 15:14:20.550438 ip-10-0-130-232 kubenswrapper[2575]: I0609 15:14:20.546997 2575 flags.go:64] FLAG: --authentication-token-webhook-cache-ttl="2m0s" Jun 09 15:14:20.550968 ip-10-0-130-232 kubenswrapper[2575]: I0609 15:14:20.547002 2575 flags.go:64] FLAG: --authorization-mode="AlwaysAllow" Jun 09 15:14:20.550968 ip-10-0-130-232 kubenswrapper[2575]: I0609 15:14:20.547014 2575 flags.go:64] FLAG: --authorization-webhook-cache-authorized-ttl="5m0s" Jun 09 15:14:20.550968 ip-10-0-130-232 kubenswrapper[2575]: I0609 15:14:20.547017 2575 flags.go:64] FLAG: --authorization-webhook-cache-unauthorized-ttl="30s" Jun 09 15:14:20.550968 ip-10-0-130-232 kubenswrapper[2575]: I0609 15:14:20.547019 2575 flags.go:64] FLAG: --boot-id-file="/proc/sys/kernel/random/boot_id" Jun 09 15:14:20.550968 ip-10-0-130-232 kubenswrapper[2575]: I0609 15:14:20.547023 2575 flags.go:64] FLAG: --bootstrap-kubeconfig="/etc/kubernetes/kubeconfig" Jun 09 15:14:20.550968 ip-10-0-130-232 kubenswrapper[2575]: I0609 15:14:20.547026 2575 flags.go:64] FLAG: --cert-dir="/var/lib/kubelet/pki" Jun 09 15:14:20.550968 ip-10-0-130-232 kubenswrapper[2575]: I0609 15:14:20.547029 2575 flags.go:64] FLAG: --cgroup-driver="cgroupfs" Jun 09 15:14:20.550968 ip-10-0-130-232 kubenswrapper[2575]: I0609 15:14:20.547031 2575 flags.go:64] FLAG: --cgroup-root="" Jun 09 15:14:20.550968 ip-10-0-130-232 kubenswrapper[2575]: I0609 15:14:20.547034 2575 flags.go:64] FLAG: --cgroups-per-qos="true" Jun 09 15:14:20.550968 ip-10-0-130-232 kubenswrapper[2575]: I0609 15:14:20.547037 2575 flags.go:64] FLAG: --client-ca-file="" Jun 09 15:14:20.550968 ip-10-0-130-232 kubenswrapper[2575]: I0609 15:14:20.547040 2575 flags.go:64] FLAG: --cloud-provider="external" Jun 09 15:14:20.550968 ip-10-0-130-232 kubenswrapper[2575]: I0609 15:14:20.547043 2575 flags.go:64] FLAG: --cluster-dns="[]" Jun 09 15:14:20.550968 ip-10-0-130-232 kubenswrapper[2575]: I0609 15:14:20.547047 2575 flags.go:64] FLAG: --cluster-domain="" Jun 09 15:14:20.550968 ip-10-0-130-232 kubenswrapper[2575]: I0609 15:14:20.547049 2575 flags.go:64] FLAG: --config="/etc/kubernetes/kubelet.conf" Jun 09 15:14:20.550968 ip-10-0-130-232 kubenswrapper[2575]: I0609 15:14:20.547052 2575 flags.go:64] FLAG: --config-dir="/etc/openshift/kubelet.conf.d" Jun 09 15:14:20.550968 ip-10-0-130-232 kubenswrapper[2575]: I0609 15:14:20.547055 2575 flags.go:64] FLAG: --container-hints="/etc/cadvisor/container_hints.json" Jun 09 15:14:20.550968 ip-10-0-130-232 kubenswrapper[2575]: I0609 15:14:20.547058 2575 flags.go:64] FLAG: --container-log-max-files="5" Jun 09 15:14:20.550968 ip-10-0-130-232 kubenswrapper[2575]: I0609 15:14:20.547062 2575 flags.go:64] FLAG: --container-log-max-size="10Mi" Jun 09 15:14:20.550968 ip-10-0-130-232 kubenswrapper[2575]: I0609 15:14:20.547065 2575 flags.go:64] FLAG: --container-runtime-endpoint="/var/run/crio/crio.sock" Jun 09 15:14:20.550968 ip-10-0-130-232 kubenswrapper[2575]: I0609 15:14:20.547068 2575 flags.go:64] FLAG: --containerd="/run/containerd/containerd.sock" Jun 09 15:14:20.550968 ip-10-0-130-232 kubenswrapper[2575]: I0609 15:14:20.547071 2575 flags.go:64] FLAG: --containerd-namespace="k8s.io" Jun 09 15:14:20.550968 ip-10-0-130-232 kubenswrapper[2575]: I0609 15:14:20.547074 2575 flags.go:64] FLAG: --contention-profiling="false" Jun 09 15:14:20.550968 ip-10-0-130-232 kubenswrapper[2575]: I0609 15:14:20.547077 2575 flags.go:64] FLAG: --cpu-cfs-quota="true" Jun 09 15:14:20.550968 ip-10-0-130-232 kubenswrapper[2575]: I0609 15:14:20.547080 2575 flags.go:64] FLAG: --cpu-cfs-quota-period="100ms" Jun 09 15:14:20.551528 ip-10-0-130-232 kubenswrapper[2575]: I0609 15:14:20.547083 2575 flags.go:64] FLAG: --cpu-manager-policy="none" Jun 09 15:14:20.551528 ip-10-0-130-232 kubenswrapper[2575]: I0609 15:14:20.547086 2575 flags.go:64] FLAG: --cpu-manager-policy-options="" Jun 09 15:14:20.551528 ip-10-0-130-232 kubenswrapper[2575]: I0609 15:14:20.547090 2575 flags.go:64] FLAG: --cpu-manager-reconcile-period="10s" Jun 09 15:14:20.551528 ip-10-0-130-232 kubenswrapper[2575]: I0609 15:14:20.547093 2575 flags.go:64] FLAG: --enable-controller-attach-detach="true" Jun 09 15:14:20.551528 ip-10-0-130-232 kubenswrapper[2575]: I0609 15:14:20.547096 2575 flags.go:64] FLAG: --enable-debugging-handlers="true" Jun 09 15:14:20.551528 ip-10-0-130-232 kubenswrapper[2575]: I0609 15:14:20.547098 2575 flags.go:64] FLAG: --enable-load-reader="false" Jun 09 15:14:20.551528 ip-10-0-130-232 kubenswrapper[2575]: I0609 15:14:20.547101 2575 flags.go:64] FLAG: --enable-server="true" Jun 09 15:14:20.551528 ip-10-0-130-232 kubenswrapper[2575]: I0609 15:14:20.547104 2575 flags.go:64] FLAG: --enforce-node-allocatable="[pods]" Jun 09 15:14:20.551528 ip-10-0-130-232 kubenswrapper[2575]: I0609 15:14:20.547108 2575 flags.go:64] FLAG: --event-burst="100" Jun 09 15:14:20.551528 ip-10-0-130-232 kubenswrapper[2575]: I0609 15:14:20.547111 2575 flags.go:64] FLAG: --event-qps="50" Jun 09 15:14:20.551528 ip-10-0-130-232 kubenswrapper[2575]: I0609 15:14:20.547114 2575 flags.go:64] FLAG: --event-storage-age-limit="default=0" Jun 09 15:14:20.551528 ip-10-0-130-232 kubenswrapper[2575]: I0609 15:14:20.547116 2575 flags.go:64] FLAG: --event-storage-event-limit="default=0" Jun 09 15:14:20.551528 ip-10-0-130-232 kubenswrapper[2575]: I0609 15:14:20.547119 2575 flags.go:64] FLAG: --eviction-hard="" Jun 09 15:14:20.551528 ip-10-0-130-232 kubenswrapper[2575]: I0609 15:14:20.547123 2575 flags.go:64] FLAG: --eviction-max-pod-grace-period="0" Jun 09 15:14:20.551528 ip-10-0-130-232 kubenswrapper[2575]: I0609 15:14:20.547126 2575 flags.go:64] FLAG: --eviction-minimum-reclaim="" Jun 09 15:14:20.551528 ip-10-0-130-232 kubenswrapper[2575]: I0609 15:14:20.547129 2575 flags.go:64] FLAG: --eviction-pressure-transition-period="5m0s" Jun 09 15:14:20.551528 ip-10-0-130-232 kubenswrapper[2575]: I0609 15:14:20.547132 2575 flags.go:64] FLAG: --eviction-soft="" Jun 09 15:14:20.551528 ip-10-0-130-232 kubenswrapper[2575]: I0609 15:14:20.547135 2575 flags.go:64] FLAG: --eviction-soft-grace-period="" Jun 09 15:14:20.551528 ip-10-0-130-232 kubenswrapper[2575]: I0609 15:14:20.547138 2575 flags.go:64] FLAG: --exit-on-lock-contention="false" Jun 09 15:14:20.551528 ip-10-0-130-232 kubenswrapper[2575]: I0609 15:14:20.547141 2575 flags.go:64] FLAG: --experimental-allocatable-ignore-eviction="false" Jun 09 15:14:20.551528 ip-10-0-130-232 kubenswrapper[2575]: I0609 15:14:20.547144 2575 flags.go:64] FLAG: --experimental-mounter-path="" Jun 09 15:14:20.551528 ip-10-0-130-232 kubenswrapper[2575]: I0609 15:14:20.547147 2575 flags.go:64] FLAG: --fail-cgroupv1="false" Jun 09 15:14:20.551528 ip-10-0-130-232 kubenswrapper[2575]: I0609 15:14:20.547150 2575 flags.go:64] FLAG: --fail-swap-on="true" Jun 09 15:14:20.551528 ip-10-0-130-232 kubenswrapper[2575]: I0609 15:14:20.547152 2575 flags.go:64] FLAG: --feature-gates="" Jun 09 15:14:20.551528 ip-10-0-130-232 kubenswrapper[2575]: I0609 15:14:20.547159 2575 flags.go:64] FLAG: --file-check-frequency="20s" Jun 09 15:14:20.552735 ip-10-0-130-232 kubenswrapper[2575]: I0609 15:14:20.547164 2575 flags.go:64] FLAG: --global-housekeeping-interval="1m0s" Jun 09 15:14:20.552735 ip-10-0-130-232 kubenswrapper[2575]: I0609 15:14:20.547167 2575 flags.go:64] FLAG: --hairpin-mode="promiscuous-bridge" Jun 09 15:14:20.552735 ip-10-0-130-232 kubenswrapper[2575]: I0609 15:14:20.547170 2575 flags.go:64] FLAG: --healthz-bind-address="127.0.0.1" Jun 09 15:14:20.552735 ip-10-0-130-232 kubenswrapper[2575]: I0609 15:14:20.547173 2575 flags.go:64] FLAG: --healthz-port="10248" Jun 09 15:14:20.552735 ip-10-0-130-232 kubenswrapper[2575]: I0609 15:14:20.547176 2575 flags.go:64] FLAG: --help="false" Jun 09 15:14:20.552735 ip-10-0-130-232 kubenswrapper[2575]: I0609 15:14:20.547179 2575 flags.go:64] FLAG: --hostname-override="ip-10-0-130-232.ec2.internal" Jun 09 15:14:20.552735 ip-10-0-130-232 kubenswrapper[2575]: I0609 15:14:20.547182 2575 flags.go:64] FLAG: --housekeeping-interval="10s" Jun 09 15:14:20.552735 ip-10-0-130-232 kubenswrapper[2575]: I0609 15:14:20.547185 2575 flags.go:64] FLAG: --http-check-frequency="20s" Jun 09 15:14:20.552735 ip-10-0-130-232 kubenswrapper[2575]: I0609 15:14:20.547187 2575 flags.go:64] FLAG: --image-credential-provider-bin-dir="/usr/libexec/kubelet-image-credential-provider-plugins" Jun 09 15:14:20.552735 ip-10-0-130-232 kubenswrapper[2575]: I0609 15:14:20.547190 2575 flags.go:64] FLAG: --image-credential-provider-config="/etc/kubernetes/credential-providers/ecr-credential-provider.yaml" Jun 09 15:14:20.552735 ip-10-0-130-232 kubenswrapper[2575]: I0609 15:14:20.547193 2575 flags.go:64] FLAG: --image-gc-high-threshold="85" Jun 09 15:14:20.552735 ip-10-0-130-232 kubenswrapper[2575]: I0609 15:14:20.547196 2575 flags.go:64] FLAG: --image-gc-low-threshold="80" Jun 09 15:14:20.552735 ip-10-0-130-232 kubenswrapper[2575]: I0609 15:14:20.547199 2575 flags.go:64] FLAG: --image-service-endpoint="" Jun 09 15:14:20.552735 ip-10-0-130-232 kubenswrapper[2575]: I0609 15:14:20.547202 2575 flags.go:64] FLAG: --kernel-memcg-notification="false" Jun 09 15:14:20.552735 ip-10-0-130-232 kubenswrapper[2575]: I0609 15:14:20.547204 2575 flags.go:64] FLAG: --kube-api-burst="100" Jun 09 15:14:20.552735 ip-10-0-130-232 kubenswrapper[2575]: I0609 15:14:20.547207 2575 flags.go:64] FLAG: --kube-api-content-type="application/vnd.kubernetes.protobuf" Jun 09 15:14:20.552735 ip-10-0-130-232 kubenswrapper[2575]: I0609 15:14:20.547210 2575 flags.go:64] FLAG: --kube-api-qps="50" Jun 09 15:14:20.552735 ip-10-0-130-232 kubenswrapper[2575]: I0609 15:14:20.547213 2575 flags.go:64] FLAG: --kube-reserved="" Jun 09 15:14:20.552735 ip-10-0-130-232 kubenswrapper[2575]: I0609 15:14:20.547215 2575 flags.go:64] FLAG: --kube-reserved-cgroup="" Jun 09 15:14:20.552735 ip-10-0-130-232 kubenswrapper[2575]: I0609 15:14:20.547218 2575 flags.go:64] FLAG: --kubeconfig="/var/lib/kubelet/kubeconfig" Jun 09 15:14:20.552735 ip-10-0-130-232 kubenswrapper[2575]: I0609 15:14:20.547220 2575 flags.go:64] FLAG: --kubelet-cgroups="" Jun 09 15:14:20.552735 ip-10-0-130-232 kubenswrapper[2575]: I0609 15:14:20.547223 2575 flags.go:64] FLAG: --local-storage-capacity-isolation="true" Jun 09 15:14:20.552735 ip-10-0-130-232 kubenswrapper[2575]: I0609 15:14:20.547226 2575 flags.go:64] FLAG: --lock-file="" Jun 09 15:14:20.552735 ip-10-0-130-232 kubenswrapper[2575]: I0609 15:14:20.547228 2575 flags.go:64] FLAG: --log-cadvisor-usage="false" Jun 09 15:14:20.553349 ip-10-0-130-232 kubenswrapper[2575]: I0609 15:14:20.547231 2575 flags.go:64] FLAG: --log-flush-frequency="5s" Jun 09 15:14:20.553349 ip-10-0-130-232 kubenswrapper[2575]: I0609 15:14:20.547234 2575 flags.go:64] FLAG: --log-json-info-buffer-size="0" Jun 09 15:14:20.553349 ip-10-0-130-232 kubenswrapper[2575]: I0609 15:14:20.547239 2575 flags.go:64] FLAG: --log-json-split-stream="false" Jun 09 15:14:20.553349 ip-10-0-130-232 kubenswrapper[2575]: I0609 15:14:20.547242 2575 flags.go:64] FLAG: --log-text-info-buffer-size="0" Jun 09 15:14:20.553349 ip-10-0-130-232 kubenswrapper[2575]: I0609 15:14:20.547244 2575 flags.go:64] FLAG: --log-text-split-stream="false" Jun 09 15:14:20.553349 ip-10-0-130-232 kubenswrapper[2575]: I0609 15:14:20.547247 2575 flags.go:64] FLAG: --logging-format="text" Jun 09 15:14:20.553349 ip-10-0-130-232 kubenswrapper[2575]: I0609 15:14:20.547249 2575 flags.go:64] FLAG: --machine-id-file="/etc/machine-id,/var/lib/dbus/machine-id" Jun 09 15:14:20.553349 ip-10-0-130-232 kubenswrapper[2575]: I0609 15:14:20.547252 2575 flags.go:64] FLAG: --make-iptables-util-chains="true" Jun 09 15:14:20.553349 ip-10-0-130-232 kubenswrapper[2575]: I0609 15:14:20.547260 2575 flags.go:64] FLAG: --manifest-url="" Jun 09 15:14:20.553349 ip-10-0-130-232 kubenswrapper[2575]: I0609 15:14:20.547262 2575 flags.go:64] FLAG: --manifest-url-header="" Jun 09 15:14:20.553349 ip-10-0-130-232 kubenswrapper[2575]: I0609 15:14:20.547266 2575 flags.go:64] FLAG: --max-housekeeping-interval="15s" Jun 09 15:14:20.553349 ip-10-0-130-232 kubenswrapper[2575]: I0609 15:14:20.547269 2575 flags.go:64] FLAG: --max-open-files="1000000" Jun 09 15:14:20.553349 ip-10-0-130-232 kubenswrapper[2575]: I0609 15:14:20.547273 2575 flags.go:64] FLAG: --max-pods="110" Jun 09 15:14:20.553349 ip-10-0-130-232 kubenswrapper[2575]: I0609 15:14:20.547276 2575 flags.go:64] FLAG: --maximum-dead-containers="-1" Jun 09 15:14:20.553349 ip-10-0-130-232 kubenswrapper[2575]: I0609 15:14:20.547279 2575 flags.go:64] FLAG: --maximum-dead-containers-per-container="1" Jun 09 15:14:20.553349 ip-10-0-130-232 kubenswrapper[2575]: I0609 15:14:20.547281 2575 flags.go:64] FLAG: --memory-manager-policy="None" Jun 09 15:14:20.553349 ip-10-0-130-232 kubenswrapper[2575]: I0609 15:14:20.547284 2575 flags.go:64] FLAG: --minimum-container-ttl-duration="6m0s" Jun 09 15:14:20.553349 ip-10-0-130-232 kubenswrapper[2575]: I0609 15:14:20.547287 2575 flags.go:64] FLAG: --minimum-image-ttl-duration="2m0s" Jun 09 15:14:20.553349 ip-10-0-130-232 kubenswrapper[2575]: I0609 15:14:20.547290 2575 flags.go:64] FLAG: --node-ip="0.0.0.0" Jun 09 15:14:20.553349 ip-10-0-130-232 kubenswrapper[2575]: I0609 15:14:20.547292 2575 flags.go:64] FLAG: --node-labels="node-role.kubernetes.io/worker=,node.openshift.io/os_id=rhel" Jun 09 15:14:20.553349 ip-10-0-130-232 kubenswrapper[2575]: I0609 15:14:20.547299 2575 flags.go:64] FLAG: --node-status-max-images="50" Jun 09 15:14:20.553349 ip-10-0-130-232 kubenswrapper[2575]: I0609 15:14:20.547302 2575 flags.go:64] FLAG: --node-status-update-frequency="10s" Jun 09 15:14:20.553349 ip-10-0-130-232 kubenswrapper[2575]: I0609 15:14:20.547305 2575 flags.go:64] FLAG: --oom-score-adj="-999" Jun 09 15:14:20.553349 ip-10-0-130-232 kubenswrapper[2575]: I0609 15:14:20.547308 2575 flags.go:64] FLAG: --pod-cidr="" Jun 09 15:14:20.554171 ip-10-0-130-232 kubenswrapper[2575]: I0609 15:14:20.547310 2575 flags.go:64] FLAG: --pod-infra-container-image="quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:746976bfb3a92b93dacc79c151b98fd4c932eef19c3e2c1516b14eebcac9184d" Jun 09 15:14:20.554171 ip-10-0-130-232 kubenswrapper[2575]: I0609 15:14:20.547316 2575 flags.go:64] FLAG: --pod-manifest-path="" Jun 09 15:14:20.554171 ip-10-0-130-232 kubenswrapper[2575]: I0609 15:14:20.547318 2575 flags.go:64] FLAG: --pod-max-pids="-1" Jun 09 15:14:20.554171 ip-10-0-130-232 kubenswrapper[2575]: I0609 15:14:20.547321 2575 flags.go:64] FLAG: --pods-per-core="0" Jun 09 15:14:20.554171 ip-10-0-130-232 kubenswrapper[2575]: I0609 15:14:20.547324 2575 flags.go:64] FLAG: --port="10250" Jun 09 15:14:20.554171 ip-10-0-130-232 kubenswrapper[2575]: I0609 15:14:20.547327 2575 flags.go:64] FLAG: --protect-kernel-defaults="false" Jun 09 15:14:20.554171 ip-10-0-130-232 kubenswrapper[2575]: I0609 15:14:20.547329 2575 flags.go:64] FLAG: --provider-id="aws:///us-east-1a/i-0edfa5f5ef4c39081" Jun 09 15:14:20.554171 ip-10-0-130-232 kubenswrapper[2575]: I0609 15:14:20.547335 2575 flags.go:64] FLAG: --qos-reserved="" Jun 09 15:14:20.554171 ip-10-0-130-232 kubenswrapper[2575]: I0609 15:14:20.547338 2575 flags.go:64] FLAG: --read-only-port="10255" Jun 09 15:14:20.554171 ip-10-0-130-232 kubenswrapper[2575]: I0609 15:14:20.547341 2575 flags.go:64] FLAG: --register-node="true" Jun 09 15:14:20.554171 ip-10-0-130-232 kubenswrapper[2575]: I0609 15:14:20.547344 2575 flags.go:64] FLAG: --register-with-taints="" Jun 09 15:14:20.554171 ip-10-0-130-232 kubenswrapper[2575]: I0609 15:14:20.547347 2575 flags.go:64] FLAG: --registry-burst="10" Jun 09 15:14:20.554171 ip-10-0-130-232 kubenswrapper[2575]: I0609 15:14:20.547351 2575 flags.go:64] FLAG: --registry-qps="5" Jun 09 15:14:20.554171 ip-10-0-130-232 kubenswrapper[2575]: I0609 15:14:20.547354 2575 flags.go:64] FLAG: --reserved-cpus="" Jun 09 15:14:20.554171 ip-10-0-130-232 kubenswrapper[2575]: I0609 15:14:20.547356 2575 flags.go:64] FLAG: --reserved-memory="" Jun 09 15:14:20.554171 ip-10-0-130-232 kubenswrapper[2575]: I0609 15:14:20.547360 2575 flags.go:64] FLAG: --resolv-conf="/etc/resolv.conf" Jun 09 15:14:20.554171 ip-10-0-130-232 kubenswrapper[2575]: I0609 15:14:20.547364 2575 flags.go:64] FLAG: --root-dir="/var/lib/kubelet" Jun 09 15:14:20.554171 ip-10-0-130-232 kubenswrapper[2575]: I0609 15:14:20.547367 2575 flags.go:64] FLAG: --rotate-certificates="false" Jun 09 15:14:20.554171 ip-10-0-130-232 kubenswrapper[2575]: I0609 15:14:20.547370 2575 flags.go:64] FLAG: --rotate-server-certificates="false" Jun 09 15:14:20.554171 ip-10-0-130-232 kubenswrapper[2575]: I0609 15:14:20.547372 2575 flags.go:64] FLAG: --runonce="false" Jun 09 15:14:20.554171 ip-10-0-130-232 kubenswrapper[2575]: I0609 15:14:20.547375 2575 flags.go:64] FLAG: --runtime-cgroups="/system.slice/crio.service" Jun 09 15:14:20.554171 ip-10-0-130-232 kubenswrapper[2575]: I0609 15:14:20.547378 2575 flags.go:64] FLAG: --runtime-request-timeout="2m0s" Jun 09 15:14:20.554171 ip-10-0-130-232 kubenswrapper[2575]: I0609 15:14:20.547382 2575 flags.go:64] FLAG: --seccomp-default="false" Jun 09 15:14:20.554171 ip-10-0-130-232 kubenswrapper[2575]: I0609 15:14:20.547384 2575 flags.go:64] FLAG: --serialize-image-pulls="true" Jun 09 15:14:20.554171 ip-10-0-130-232 kubenswrapper[2575]: I0609 15:14:20.547387 2575 flags.go:64] FLAG: --storage-driver-buffer-duration="1m0s" Jun 09 15:14:20.555272 ip-10-0-130-232 kubenswrapper[2575]: I0609 15:14:20.547390 2575 flags.go:64] FLAG: --storage-driver-db="cadvisor" Jun 09 15:14:20.555272 ip-10-0-130-232 kubenswrapper[2575]: I0609 15:14:20.547393 2575 flags.go:64] FLAG: --storage-driver-host="localhost:8086" Jun 09 15:14:20.555272 ip-10-0-130-232 kubenswrapper[2575]: I0609 15:14:20.547395 2575 flags.go:64] FLAG: --storage-driver-password="root" Jun 09 15:14:20.555272 ip-10-0-130-232 kubenswrapper[2575]: I0609 15:14:20.547398 2575 flags.go:64] FLAG: --storage-driver-secure="false" Jun 09 15:14:20.555272 ip-10-0-130-232 kubenswrapper[2575]: I0609 15:14:20.547401 2575 flags.go:64] FLAG: --storage-driver-table="stats" Jun 09 15:14:20.555272 ip-10-0-130-232 kubenswrapper[2575]: I0609 15:14:20.547404 2575 flags.go:64] FLAG: --storage-driver-user="root" Jun 09 15:14:20.555272 ip-10-0-130-232 kubenswrapper[2575]: I0609 15:14:20.547406 2575 flags.go:64] FLAG: --streaming-connection-idle-timeout="4h0m0s" Jun 09 15:14:20.555272 ip-10-0-130-232 kubenswrapper[2575]: I0609 15:14:20.547409 2575 flags.go:64] FLAG: --sync-frequency="1m0s" Jun 09 15:14:20.555272 ip-10-0-130-232 kubenswrapper[2575]: I0609 15:14:20.547412 2575 flags.go:64] FLAG: --system-cgroups="" Jun 09 15:14:20.555272 ip-10-0-130-232 kubenswrapper[2575]: I0609 15:14:20.547415 2575 flags.go:64] FLAG: --system-reserved="cpu=500m,ephemeral-storage=1Gi,memory=1Gi" Jun 09 15:14:20.555272 ip-10-0-130-232 kubenswrapper[2575]: I0609 15:14:20.547420 2575 flags.go:64] FLAG: --system-reserved-cgroup="" Jun 09 15:14:20.555272 ip-10-0-130-232 kubenswrapper[2575]: I0609 15:14:20.547422 2575 flags.go:64] FLAG: --tls-cert-file="" Jun 09 15:14:20.555272 ip-10-0-130-232 kubenswrapper[2575]: I0609 15:14:20.547425 2575 flags.go:64] FLAG: --tls-cipher-suites="[]" Jun 09 15:14:20.555272 ip-10-0-130-232 kubenswrapper[2575]: I0609 15:14:20.547429 2575 flags.go:64] FLAG: --tls-min-version="" Jun 09 15:14:20.555272 ip-10-0-130-232 kubenswrapper[2575]: I0609 15:14:20.547433 2575 flags.go:64] FLAG: --tls-private-key-file="" Jun 09 15:14:20.555272 ip-10-0-130-232 kubenswrapper[2575]: I0609 15:14:20.547436 2575 flags.go:64] FLAG: --topology-manager-policy="none" Jun 09 15:14:20.555272 ip-10-0-130-232 kubenswrapper[2575]: I0609 15:14:20.547438 2575 flags.go:64] FLAG: --topology-manager-policy-options="" Jun 09 15:14:20.555272 ip-10-0-130-232 kubenswrapper[2575]: I0609 15:14:20.547441 2575 flags.go:64] FLAG: --topology-manager-scope="container" Jun 09 15:14:20.555272 ip-10-0-130-232 kubenswrapper[2575]: I0609 15:14:20.547444 2575 flags.go:64] FLAG: --v="2" Jun 09 15:14:20.555272 ip-10-0-130-232 kubenswrapper[2575]: I0609 15:14:20.547448 2575 flags.go:64] FLAG: --version="false" Jun 09 15:14:20.555272 ip-10-0-130-232 kubenswrapper[2575]: I0609 15:14:20.547452 2575 flags.go:64] FLAG: --vmodule="" Jun 09 15:14:20.555272 ip-10-0-130-232 kubenswrapper[2575]: I0609 15:14:20.547455 2575 flags.go:64] FLAG: --volume-plugin-dir="/etc/kubernetes/kubelet-plugins/volume/exec" Jun 09 15:14:20.555272 ip-10-0-130-232 kubenswrapper[2575]: I0609 15:14:20.547458 2575 flags.go:64] FLAG: --volume-stats-agg-period="1m0s" Jun 09 15:14:20.555272 ip-10-0-130-232 kubenswrapper[2575]: W0609 15:14:20.547574 2575 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jun 09 15:14:20.555272 ip-10-0-130-232 kubenswrapper[2575]: W0609 15:14:20.547578 2575 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jun 09 15:14:20.556388 ip-10-0-130-232 kubenswrapper[2575]: W0609 15:14:20.547581 2575 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jun 09 15:14:20.556388 ip-10-0-130-232 kubenswrapper[2575]: W0609 15:14:20.547583 2575 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jun 09 15:14:20.556388 ip-10-0-130-232 kubenswrapper[2575]: W0609 15:14:20.547586 2575 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jun 09 15:14:20.556388 ip-10-0-130-232 kubenswrapper[2575]: W0609 15:14:20.547589 2575 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jun 09 15:14:20.556388 ip-10-0-130-232 kubenswrapper[2575]: W0609 15:14:20.547592 2575 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jun 09 15:14:20.556388 ip-10-0-130-232 kubenswrapper[2575]: W0609 15:14:20.547595 2575 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jun 09 15:14:20.556388 ip-10-0-130-232 kubenswrapper[2575]: W0609 15:14:20.547598 2575 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jun 09 15:14:20.556388 ip-10-0-130-232 kubenswrapper[2575]: W0609 15:14:20.547601 2575 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jun 09 15:14:20.556388 ip-10-0-130-232 kubenswrapper[2575]: W0609 15:14:20.547603 2575 feature_gate.go:328] unrecognized feature gate: NewOLM Jun 09 15:14:20.556388 ip-10-0-130-232 kubenswrapper[2575]: W0609 15:14:20.547606 2575 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jun 09 15:14:20.556388 ip-10-0-130-232 kubenswrapper[2575]: W0609 15:14:20.547608 2575 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jun 09 15:14:20.556388 ip-10-0-130-232 kubenswrapper[2575]: W0609 15:14:20.547611 2575 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jun 09 15:14:20.556388 ip-10-0-130-232 kubenswrapper[2575]: W0609 15:14:20.547613 2575 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jun 09 15:14:20.556388 ip-10-0-130-232 kubenswrapper[2575]: W0609 15:14:20.547616 2575 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jun 09 15:14:20.556388 ip-10-0-130-232 kubenswrapper[2575]: W0609 15:14:20.547618 2575 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jun 09 15:14:20.556388 ip-10-0-130-232 kubenswrapper[2575]: W0609 15:14:20.547621 2575 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jun 09 15:14:20.556388 ip-10-0-130-232 kubenswrapper[2575]: W0609 15:14:20.547623 2575 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jun 09 15:14:20.556388 ip-10-0-130-232 kubenswrapper[2575]: W0609 15:14:20.547625 2575 feature_gate.go:328] unrecognized feature gate: SignatureStores Jun 09 15:14:20.556388 ip-10-0-130-232 kubenswrapper[2575]: W0609 15:14:20.547628 2575 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jun 09 15:14:20.556388 ip-10-0-130-232 kubenswrapper[2575]: W0609 15:14:20.547630 2575 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jun 09 15:14:20.557279 ip-10-0-130-232 kubenswrapper[2575]: W0609 15:14:20.547632 2575 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jun 09 15:14:20.557279 ip-10-0-130-232 kubenswrapper[2575]: W0609 15:14:20.547636 2575 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jun 09 15:14:20.557279 ip-10-0-130-232 kubenswrapper[2575]: W0609 15:14:20.547639 2575 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jun 09 15:14:20.557279 ip-10-0-130-232 kubenswrapper[2575]: W0609 15:14:20.547641 2575 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jun 09 15:14:20.557279 ip-10-0-130-232 kubenswrapper[2575]: W0609 15:14:20.547644 2575 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jun 09 15:14:20.557279 ip-10-0-130-232 kubenswrapper[2575]: W0609 15:14:20.547646 2575 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jun 09 15:14:20.557279 ip-10-0-130-232 kubenswrapper[2575]: W0609 15:14:20.547649 2575 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jun 09 15:14:20.557279 ip-10-0-130-232 kubenswrapper[2575]: W0609 15:14:20.547651 2575 feature_gate.go:328] unrecognized feature gate: OVNObservability Jun 09 15:14:20.557279 ip-10-0-130-232 kubenswrapper[2575]: W0609 15:14:20.547654 2575 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jun 09 15:14:20.557279 ip-10-0-130-232 kubenswrapper[2575]: W0609 15:14:20.547657 2575 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jun 09 15:14:20.557279 ip-10-0-130-232 kubenswrapper[2575]: W0609 15:14:20.547660 2575 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jun 09 15:14:20.557279 ip-10-0-130-232 kubenswrapper[2575]: W0609 15:14:20.547663 2575 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jun 09 15:14:20.557279 ip-10-0-130-232 kubenswrapper[2575]: W0609 15:14:20.547666 2575 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jun 09 15:14:20.557279 ip-10-0-130-232 kubenswrapper[2575]: W0609 15:14:20.547668 2575 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jun 09 15:14:20.557279 ip-10-0-130-232 kubenswrapper[2575]: W0609 15:14:20.547671 2575 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jun 09 15:14:20.557279 ip-10-0-130-232 kubenswrapper[2575]: W0609 15:14:20.547673 2575 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jun 09 15:14:20.557279 ip-10-0-130-232 kubenswrapper[2575]: W0609 15:14:20.547676 2575 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jun 09 15:14:20.557279 ip-10-0-130-232 kubenswrapper[2575]: W0609 15:14:20.547678 2575 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jun 09 15:14:20.557279 ip-10-0-130-232 kubenswrapper[2575]: W0609 15:14:20.547681 2575 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jun 09 15:14:20.557279 ip-10-0-130-232 kubenswrapper[2575]: W0609 15:14:20.547683 2575 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jun 09 15:14:20.557946 ip-10-0-130-232 kubenswrapper[2575]: W0609 15:14:20.547685 2575 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jun 09 15:14:20.557946 ip-10-0-130-232 kubenswrapper[2575]: W0609 15:14:20.547689 2575 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jun 09 15:14:20.557946 ip-10-0-130-232 kubenswrapper[2575]: W0609 15:14:20.547693 2575 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jun 09 15:14:20.557946 ip-10-0-130-232 kubenswrapper[2575]: W0609 15:14:20.547695 2575 feature_gate.go:328] unrecognized feature gate: Example2 Jun 09 15:14:20.557946 ip-10-0-130-232 kubenswrapper[2575]: W0609 15:14:20.547698 2575 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jun 09 15:14:20.557946 ip-10-0-130-232 kubenswrapper[2575]: W0609 15:14:20.547700 2575 feature_gate.go:328] unrecognized feature gate: EventTTL Jun 09 15:14:20.557946 ip-10-0-130-232 kubenswrapper[2575]: W0609 15:14:20.547702 2575 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jun 09 15:14:20.557946 ip-10-0-130-232 kubenswrapper[2575]: W0609 15:14:20.547705 2575 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jun 09 15:14:20.557946 ip-10-0-130-232 kubenswrapper[2575]: W0609 15:14:20.547709 2575 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jun 09 15:14:20.557946 ip-10-0-130-232 kubenswrapper[2575]: W0609 15:14:20.547712 2575 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jun 09 15:14:20.557946 ip-10-0-130-232 kubenswrapper[2575]: W0609 15:14:20.547715 2575 feature_gate.go:328] unrecognized feature gate: PinnedImages Jun 09 15:14:20.557946 ip-10-0-130-232 kubenswrapper[2575]: W0609 15:14:20.547717 2575 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jun 09 15:14:20.557946 ip-10-0-130-232 kubenswrapper[2575]: W0609 15:14:20.547720 2575 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jun 09 15:14:20.557946 ip-10-0-130-232 kubenswrapper[2575]: W0609 15:14:20.547724 2575 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jun 09 15:14:20.557946 ip-10-0-130-232 kubenswrapper[2575]: W0609 15:14:20.547726 2575 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jun 09 15:14:20.557946 ip-10-0-130-232 kubenswrapper[2575]: W0609 15:14:20.547729 2575 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jun 09 15:14:20.557946 ip-10-0-130-232 kubenswrapper[2575]: W0609 15:14:20.547731 2575 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jun 09 15:14:20.557946 ip-10-0-130-232 kubenswrapper[2575]: W0609 15:14:20.547734 2575 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jun 09 15:14:20.557946 ip-10-0-130-232 kubenswrapper[2575]: W0609 15:14:20.547736 2575 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jun 09 15:14:20.557946 ip-10-0-130-232 kubenswrapper[2575]: W0609 15:14:20.547739 2575 feature_gate.go:328] unrecognized feature gate: Example Jun 09 15:14:20.558676 ip-10-0-130-232 kubenswrapper[2575]: W0609 15:14:20.547741 2575 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jun 09 15:14:20.558676 ip-10-0-130-232 kubenswrapper[2575]: W0609 15:14:20.547744 2575 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jun 09 15:14:20.558676 ip-10-0-130-232 kubenswrapper[2575]: W0609 15:14:20.547748 2575 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jun 09 15:14:20.558676 ip-10-0-130-232 kubenswrapper[2575]: W0609 15:14:20.547750 2575 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jun 09 15:14:20.558676 ip-10-0-130-232 kubenswrapper[2575]: W0609 15:14:20.547752 2575 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jun 09 15:14:20.558676 ip-10-0-130-232 kubenswrapper[2575]: W0609 15:14:20.547755 2575 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jun 09 15:14:20.558676 ip-10-0-130-232 kubenswrapper[2575]: W0609 15:14:20.547757 2575 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jun 09 15:14:20.558676 ip-10-0-130-232 kubenswrapper[2575]: W0609 15:14:20.547759 2575 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jun 09 15:14:20.558676 ip-10-0-130-232 kubenswrapper[2575]: W0609 15:14:20.547762 2575 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jun 09 15:14:20.558676 ip-10-0-130-232 kubenswrapper[2575]: W0609 15:14:20.547764 2575 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jun 09 15:14:20.558676 ip-10-0-130-232 kubenswrapper[2575]: W0609 15:14:20.547767 2575 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jun 09 15:14:20.558676 ip-10-0-130-232 kubenswrapper[2575]: W0609 15:14:20.547769 2575 feature_gate.go:328] unrecognized feature gate: OSStreams Jun 09 15:14:20.558676 ip-10-0-130-232 kubenswrapper[2575]: W0609 15:14:20.547772 2575 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jun 09 15:14:20.558676 ip-10-0-130-232 kubenswrapper[2575]: W0609 15:14:20.547774 2575 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jun 09 15:14:20.558676 ip-10-0-130-232 kubenswrapper[2575]: W0609 15:14:20.547777 2575 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jun 09 15:14:20.558676 ip-10-0-130-232 kubenswrapper[2575]: W0609 15:14:20.547779 2575 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jun 09 15:14:20.558676 ip-10-0-130-232 kubenswrapper[2575]: W0609 15:14:20.547781 2575 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jun 09 15:14:20.558676 ip-10-0-130-232 kubenswrapper[2575]: W0609 15:14:20.547784 2575 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jun 09 15:14:20.558676 ip-10-0-130-232 kubenswrapper[2575]: W0609 15:14:20.547787 2575 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jun 09 15:14:20.559490 ip-10-0-130-232 kubenswrapper[2575]: W0609 15:14:20.547789 2575 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jun 09 15:14:20.559490 ip-10-0-130-232 kubenswrapper[2575]: W0609 15:14:20.547791 2575 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jun 09 15:14:20.559490 ip-10-0-130-232 kubenswrapper[2575]: W0609 15:14:20.547794 2575 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jun 09 15:14:20.559490 ip-10-0-130-232 kubenswrapper[2575]: W0609 15:14:20.547796 2575 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jun 09 15:14:20.559490 ip-10-0-130-232 kubenswrapper[2575]: W0609 15:14:20.547799 2575 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jun 09 15:14:20.559490 ip-10-0-130-232 kubenswrapper[2575]: W0609 15:14:20.547801 2575 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jun 09 15:14:20.559490 ip-10-0-130-232 kubenswrapper[2575]: W0609 15:14:20.547805 2575 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jun 09 15:14:20.559490 ip-10-0-130-232 kubenswrapper[2575]: W0609 15:14:20.547808 2575 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jun 09 15:14:20.559490 ip-10-0-130-232 kubenswrapper[2575]: W0609 15:14:20.547811 2575 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jun 09 15:14:20.559490 ip-10-0-130-232 kubenswrapper[2575]: W0609 15:14:20.547813 2575 feature_gate.go:328] unrecognized feature gate: DualReplica Jun 09 15:14:20.559490 ip-10-0-130-232 kubenswrapper[2575]: W0609 15:14:20.547817 2575 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jun 09 15:14:20.559490 ip-10-0-130-232 kubenswrapper[2575]: W0609 15:14:20.547820 2575 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jun 09 15:14:20.559490 ip-10-0-130-232 kubenswrapper[2575]: W0609 15:14:20.547823 2575 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jun 09 15:14:20.559490 ip-10-0-130-232 kubenswrapper[2575]: W0609 15:14:20.547826 2575 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jun 09 15:14:20.559490 ip-10-0-130-232 kubenswrapper[2575]: W0609 15:14:20.547828 2575 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jun 09 15:14:20.559490 ip-10-0-130-232 kubenswrapper[2575]: W0609 15:14:20.547833 2575 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jun 09 15:14:20.559490 ip-10-0-130-232 kubenswrapper[2575]: W0609 15:14:20.547835 2575 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jun 09 15:14:20.559490 ip-10-0-130-232 kubenswrapper[2575]: W0609 15:14:20.547837 2575 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jun 09 15:14:20.560014 ip-10-0-130-232 kubenswrapper[2575]: I0609 15:14:20.548604 2575 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]} Jun 09 15:14:20.560014 ip-10-0-130-232 kubenswrapper[2575]: I0609 15:14:20.556101 2575 server.go:529] "Kubelet version" kubeletVersion="v1.34.8" Jun 09 15:14:20.560014 ip-10-0-130-232 kubenswrapper[2575]: I0609 15:14:20.556119 2575 server.go:531] "Golang settings" GOGC="" GOMAXPROCS="" GOTRACEBACK="" Jun 09 15:14:20.560014 ip-10-0-130-232 kubenswrapper[2575]: I0609 15:14:20.556144 2575 watchdog_linux.go:95] "Systemd watchdog is not enabled" Jun 09 15:14:20.560014 ip-10-0-130-232 kubenswrapper[2575]: I0609 15:14:20.556159 2575 watchdog_linux.go:137] "Systemd watchdog is not enabled or the interval is invalid, so health checking will not be started." Jun 09 15:14:20.560014 ip-10-0-130-232 kubenswrapper[2575]: W0609 15:14:20.556240 2575 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jun 09 15:14:20.560014 ip-10-0-130-232 kubenswrapper[2575]: W0609 15:14:20.556249 2575 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jun 09 15:14:20.560014 ip-10-0-130-232 kubenswrapper[2575]: W0609 15:14:20.556255 2575 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jun 09 15:14:20.560014 ip-10-0-130-232 kubenswrapper[2575]: W0609 15:14:20.556260 2575 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jun 09 15:14:20.560014 ip-10-0-130-232 kubenswrapper[2575]: W0609 15:14:20.556265 2575 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jun 09 15:14:20.560014 ip-10-0-130-232 kubenswrapper[2575]: W0609 15:14:20.556269 2575 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jun 09 15:14:20.560014 ip-10-0-130-232 kubenswrapper[2575]: W0609 15:14:20.556274 2575 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jun 09 15:14:20.560014 ip-10-0-130-232 kubenswrapper[2575]: W0609 15:14:20.556279 2575 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jun 09 15:14:20.560014 ip-10-0-130-232 kubenswrapper[2575]: W0609 15:14:20.556283 2575 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jun 09 15:14:20.560014 ip-10-0-130-232 kubenswrapper[2575]: W0609 15:14:20.556287 2575 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jun 09 15:14:20.560500 ip-10-0-130-232 kubenswrapper[2575]: W0609 15:14:20.556292 2575 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jun 09 15:14:20.560500 ip-10-0-130-232 kubenswrapper[2575]: W0609 15:14:20.556296 2575 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jun 09 15:14:20.560500 ip-10-0-130-232 kubenswrapper[2575]: W0609 15:14:20.556300 2575 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jun 09 15:14:20.560500 ip-10-0-130-232 kubenswrapper[2575]: W0609 15:14:20.556304 2575 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jun 09 15:14:20.560500 ip-10-0-130-232 kubenswrapper[2575]: W0609 15:14:20.556308 2575 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jun 09 15:14:20.560500 ip-10-0-130-232 kubenswrapper[2575]: W0609 15:14:20.556312 2575 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jun 09 15:14:20.560500 ip-10-0-130-232 kubenswrapper[2575]: W0609 15:14:20.556317 2575 feature_gate.go:328] unrecognized feature gate: Example Jun 09 15:14:20.560500 ip-10-0-130-232 kubenswrapper[2575]: W0609 15:14:20.556321 2575 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jun 09 15:14:20.560500 ip-10-0-130-232 kubenswrapper[2575]: W0609 15:14:20.556325 2575 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jun 09 15:14:20.560500 ip-10-0-130-232 kubenswrapper[2575]: W0609 15:14:20.556330 2575 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jun 09 15:14:20.560500 ip-10-0-130-232 kubenswrapper[2575]: W0609 15:14:20.556334 2575 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jun 09 15:14:20.560500 ip-10-0-130-232 kubenswrapper[2575]: W0609 15:14:20.556338 2575 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jun 09 15:14:20.560500 ip-10-0-130-232 kubenswrapper[2575]: W0609 15:14:20.556342 2575 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jun 09 15:14:20.560500 ip-10-0-130-232 kubenswrapper[2575]: W0609 15:14:20.556346 2575 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jun 09 15:14:20.560500 ip-10-0-130-232 kubenswrapper[2575]: W0609 15:14:20.556351 2575 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jun 09 15:14:20.560500 ip-10-0-130-232 kubenswrapper[2575]: W0609 15:14:20.556355 2575 feature_gate.go:328] unrecognized feature gate: DualReplica Jun 09 15:14:20.560500 ip-10-0-130-232 kubenswrapper[2575]: W0609 15:14:20.556360 2575 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jun 09 15:14:20.560500 ip-10-0-130-232 kubenswrapper[2575]: W0609 15:14:20.556364 2575 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jun 09 15:14:20.560500 ip-10-0-130-232 kubenswrapper[2575]: W0609 15:14:20.556368 2575 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jun 09 15:14:20.560500 ip-10-0-130-232 kubenswrapper[2575]: W0609 15:14:20.556374 2575 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jun 09 15:14:20.561095 ip-10-0-130-232 kubenswrapper[2575]: W0609 15:14:20.556379 2575 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jun 09 15:14:20.561095 ip-10-0-130-232 kubenswrapper[2575]: W0609 15:14:20.556383 2575 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jun 09 15:14:20.561095 ip-10-0-130-232 kubenswrapper[2575]: W0609 15:14:20.556387 2575 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jun 09 15:14:20.561095 ip-10-0-130-232 kubenswrapper[2575]: W0609 15:14:20.556391 2575 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jun 09 15:14:20.561095 ip-10-0-130-232 kubenswrapper[2575]: W0609 15:14:20.556397 2575 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jun 09 15:14:20.561095 ip-10-0-130-232 kubenswrapper[2575]: W0609 15:14:20.556403 2575 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jun 09 15:14:20.561095 ip-10-0-130-232 kubenswrapper[2575]: W0609 15:14:20.556407 2575 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jun 09 15:14:20.561095 ip-10-0-130-232 kubenswrapper[2575]: W0609 15:14:20.556412 2575 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jun 09 15:14:20.561095 ip-10-0-130-232 kubenswrapper[2575]: W0609 15:14:20.556416 2575 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jun 09 15:14:20.561095 ip-10-0-130-232 kubenswrapper[2575]: W0609 15:14:20.556420 2575 feature_gate.go:328] unrecognized feature gate: SignatureStores Jun 09 15:14:20.561095 ip-10-0-130-232 kubenswrapper[2575]: W0609 15:14:20.556424 2575 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jun 09 15:14:20.561095 ip-10-0-130-232 kubenswrapper[2575]: W0609 15:14:20.556429 2575 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jun 09 15:14:20.561095 ip-10-0-130-232 kubenswrapper[2575]: W0609 15:14:20.556433 2575 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jun 09 15:14:20.561095 ip-10-0-130-232 kubenswrapper[2575]: W0609 15:14:20.556438 2575 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jun 09 15:14:20.561095 ip-10-0-130-232 kubenswrapper[2575]: W0609 15:14:20.556442 2575 feature_gate.go:328] unrecognized feature gate: PinnedImages Jun 09 15:14:20.561095 ip-10-0-130-232 kubenswrapper[2575]: W0609 15:14:20.556446 2575 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jun 09 15:14:20.561095 ip-10-0-130-232 kubenswrapper[2575]: W0609 15:14:20.556452 2575 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jun 09 15:14:20.561095 ip-10-0-130-232 kubenswrapper[2575]: W0609 15:14:20.556458 2575 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jun 09 15:14:20.561596 ip-10-0-130-232 kubenswrapper[2575]: W0609 15:14:20.556463 2575 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jun 09 15:14:20.561596 ip-10-0-130-232 kubenswrapper[2575]: W0609 15:14:20.556467 2575 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jun 09 15:14:20.561596 ip-10-0-130-232 kubenswrapper[2575]: W0609 15:14:20.556471 2575 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jun 09 15:14:20.561596 ip-10-0-130-232 kubenswrapper[2575]: W0609 15:14:20.556476 2575 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jun 09 15:14:20.561596 ip-10-0-130-232 kubenswrapper[2575]: W0609 15:14:20.556480 2575 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jun 09 15:14:20.561596 ip-10-0-130-232 kubenswrapper[2575]: W0609 15:14:20.556484 2575 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jun 09 15:14:20.561596 ip-10-0-130-232 kubenswrapper[2575]: W0609 15:14:20.556488 2575 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jun 09 15:14:20.561596 ip-10-0-130-232 kubenswrapper[2575]: W0609 15:14:20.556492 2575 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jun 09 15:14:20.561596 ip-10-0-130-232 kubenswrapper[2575]: W0609 15:14:20.556496 2575 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jun 09 15:14:20.561596 ip-10-0-130-232 kubenswrapper[2575]: W0609 15:14:20.556501 2575 feature_gate.go:328] unrecognized feature gate: OSStreams Jun 09 15:14:20.561596 ip-10-0-130-232 kubenswrapper[2575]: W0609 15:14:20.556506 2575 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jun 09 15:14:20.561596 ip-10-0-130-232 kubenswrapper[2575]: W0609 15:14:20.556510 2575 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jun 09 15:14:20.561596 ip-10-0-130-232 kubenswrapper[2575]: W0609 15:14:20.556514 2575 feature_gate.go:328] unrecognized feature gate: EventTTL Jun 09 15:14:20.561596 ip-10-0-130-232 kubenswrapper[2575]: W0609 15:14:20.556519 2575 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jun 09 15:14:20.561596 ip-10-0-130-232 kubenswrapper[2575]: W0609 15:14:20.556524 2575 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jun 09 15:14:20.561596 ip-10-0-130-232 kubenswrapper[2575]: W0609 15:14:20.556528 2575 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jun 09 15:14:20.561596 ip-10-0-130-232 kubenswrapper[2575]: W0609 15:14:20.556532 2575 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jun 09 15:14:20.561596 ip-10-0-130-232 kubenswrapper[2575]: W0609 15:14:20.556536 2575 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jun 09 15:14:20.561596 ip-10-0-130-232 kubenswrapper[2575]: W0609 15:14:20.556540 2575 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jun 09 15:14:20.561596 ip-10-0-130-232 kubenswrapper[2575]: W0609 15:14:20.556545 2575 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jun 09 15:14:20.562294 ip-10-0-130-232 kubenswrapper[2575]: W0609 15:14:20.556549 2575 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jun 09 15:14:20.562294 ip-10-0-130-232 kubenswrapper[2575]: W0609 15:14:20.556553 2575 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jun 09 15:14:20.562294 ip-10-0-130-232 kubenswrapper[2575]: W0609 15:14:20.556557 2575 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jun 09 15:14:20.562294 ip-10-0-130-232 kubenswrapper[2575]: W0609 15:14:20.556561 2575 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jun 09 15:14:20.562294 ip-10-0-130-232 kubenswrapper[2575]: W0609 15:14:20.556565 2575 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jun 09 15:14:20.562294 ip-10-0-130-232 kubenswrapper[2575]: W0609 15:14:20.556570 2575 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jun 09 15:14:20.562294 ip-10-0-130-232 kubenswrapper[2575]: W0609 15:14:20.556574 2575 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jun 09 15:14:20.562294 ip-10-0-130-232 kubenswrapper[2575]: W0609 15:14:20.556578 2575 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jun 09 15:14:20.562294 ip-10-0-130-232 kubenswrapper[2575]: W0609 15:14:20.556582 2575 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jun 09 15:14:20.562294 ip-10-0-130-232 kubenswrapper[2575]: W0609 15:14:20.556586 2575 feature_gate.go:328] unrecognized feature gate: OVNObservability Jun 09 15:14:20.562294 ip-10-0-130-232 kubenswrapper[2575]: W0609 15:14:20.556590 2575 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jun 09 15:14:20.562294 ip-10-0-130-232 kubenswrapper[2575]: W0609 15:14:20.556595 2575 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jun 09 15:14:20.562294 ip-10-0-130-232 kubenswrapper[2575]: W0609 15:14:20.556599 2575 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jun 09 15:14:20.562294 ip-10-0-130-232 kubenswrapper[2575]: W0609 15:14:20.556603 2575 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jun 09 15:14:20.562294 ip-10-0-130-232 kubenswrapper[2575]: W0609 15:14:20.556607 2575 feature_gate.go:328] unrecognized feature gate: NewOLM Jun 09 15:14:20.562294 ip-10-0-130-232 kubenswrapper[2575]: W0609 15:14:20.556611 2575 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jun 09 15:14:20.562294 ip-10-0-130-232 kubenswrapper[2575]: W0609 15:14:20.556615 2575 feature_gate.go:328] unrecognized feature gate: Example2 Jun 09 15:14:20.562294 ip-10-0-130-232 kubenswrapper[2575]: W0609 15:14:20.556622 2575 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jun 09 15:14:20.562294 ip-10-0-130-232 kubenswrapper[2575]: W0609 15:14:20.556627 2575 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jun 09 15:14:20.562294 ip-10-0-130-232 kubenswrapper[2575]: W0609 15:14:20.556631 2575 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jun 09 15:14:20.562792 ip-10-0-130-232 kubenswrapper[2575]: W0609 15:14:20.556637 2575 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jun 09 15:14:20.562792 ip-10-0-130-232 kubenswrapper[2575]: W0609 15:14:20.556642 2575 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jun 09 15:14:20.562792 ip-10-0-130-232 kubenswrapper[2575]: W0609 15:14:20.556647 2575 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jun 09 15:14:20.562792 ip-10-0-130-232 kubenswrapper[2575]: W0609 15:14:20.556651 2575 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jun 09 15:14:20.562792 ip-10-0-130-232 kubenswrapper[2575]: W0609 15:14:20.556656 2575 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jun 09 15:14:20.562792 ip-10-0-130-232 kubenswrapper[2575]: W0609 15:14:20.556660 2575 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jun 09 15:14:20.562792 ip-10-0-130-232 kubenswrapper[2575]: W0609 15:14:20.556665 2575 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jun 09 15:14:20.562792 ip-10-0-130-232 kubenswrapper[2575]: W0609 15:14:20.556670 2575 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jun 09 15:14:20.562792 ip-10-0-130-232 kubenswrapper[2575]: W0609 15:14:20.556675 2575 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jun 09 15:14:20.562792 ip-10-0-130-232 kubenswrapper[2575]: W0609 15:14:20.556679 2575 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jun 09 15:14:20.562792 ip-10-0-130-232 kubenswrapper[2575]: W0609 15:14:20.556683 2575 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jun 09 15:14:20.562792 ip-10-0-130-232 kubenswrapper[2575]: I0609 15:14:20.556692 2575 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]} Jun 09 15:14:20.562792 ip-10-0-130-232 kubenswrapper[2575]: W0609 15:14:20.556888 2575 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jun 09 15:14:20.562792 ip-10-0-130-232 kubenswrapper[2575]: W0609 15:14:20.556898 2575 feature_gate.go:328] unrecognized feature gate: NewOLM Jun 09 15:14:20.562792 ip-10-0-130-232 kubenswrapper[2575]: W0609 15:14:20.556903 2575 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jun 09 15:14:20.563216 ip-10-0-130-232 kubenswrapper[2575]: W0609 15:14:20.556908 2575 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jun 09 15:14:20.563216 ip-10-0-130-232 kubenswrapper[2575]: W0609 15:14:20.556913 2575 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jun 09 15:14:20.563216 ip-10-0-130-232 kubenswrapper[2575]: W0609 15:14:20.556917 2575 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jun 09 15:14:20.563216 ip-10-0-130-232 kubenswrapper[2575]: W0609 15:14:20.556922 2575 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jun 09 15:14:20.563216 ip-10-0-130-232 kubenswrapper[2575]: W0609 15:14:20.556926 2575 feature_gate.go:328] unrecognized feature gate: OSStreams Jun 09 15:14:20.563216 ip-10-0-130-232 kubenswrapper[2575]: W0609 15:14:20.556930 2575 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jun 09 15:14:20.563216 ip-10-0-130-232 kubenswrapper[2575]: W0609 15:14:20.556934 2575 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jun 09 15:14:20.563216 ip-10-0-130-232 kubenswrapper[2575]: W0609 15:14:20.556938 2575 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jun 09 15:14:20.563216 ip-10-0-130-232 kubenswrapper[2575]: W0609 15:14:20.556943 2575 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jun 09 15:14:20.563216 ip-10-0-130-232 kubenswrapper[2575]: W0609 15:14:20.556947 2575 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jun 09 15:14:20.563216 ip-10-0-130-232 kubenswrapper[2575]: W0609 15:14:20.556951 2575 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jun 09 15:14:20.563216 ip-10-0-130-232 kubenswrapper[2575]: W0609 15:14:20.556956 2575 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jun 09 15:14:20.563216 ip-10-0-130-232 kubenswrapper[2575]: W0609 15:14:20.556960 2575 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jun 09 15:14:20.563216 ip-10-0-130-232 kubenswrapper[2575]: W0609 15:14:20.556964 2575 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jun 09 15:14:20.563216 ip-10-0-130-232 kubenswrapper[2575]: W0609 15:14:20.556969 2575 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jun 09 15:14:20.563216 ip-10-0-130-232 kubenswrapper[2575]: W0609 15:14:20.556973 2575 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jun 09 15:14:20.563216 ip-10-0-130-232 kubenswrapper[2575]: W0609 15:14:20.556977 2575 feature_gate.go:328] unrecognized feature gate: PinnedImages Jun 09 15:14:20.563216 ip-10-0-130-232 kubenswrapper[2575]: W0609 15:14:20.556981 2575 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jun 09 15:14:20.563216 ip-10-0-130-232 kubenswrapper[2575]: W0609 15:14:20.556985 2575 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jun 09 15:14:20.563216 ip-10-0-130-232 kubenswrapper[2575]: W0609 15:14:20.556991 2575 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jun 09 15:14:20.563959 ip-10-0-130-232 kubenswrapper[2575]: W0609 15:14:20.556995 2575 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jun 09 15:14:20.563959 ip-10-0-130-232 kubenswrapper[2575]: W0609 15:14:20.556999 2575 feature_gate.go:328] unrecognized feature gate: EventTTL Jun 09 15:14:20.563959 ip-10-0-130-232 kubenswrapper[2575]: W0609 15:14:20.557004 2575 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jun 09 15:14:20.563959 ip-10-0-130-232 kubenswrapper[2575]: W0609 15:14:20.557008 2575 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jun 09 15:14:20.563959 ip-10-0-130-232 kubenswrapper[2575]: W0609 15:14:20.557012 2575 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jun 09 15:14:20.563959 ip-10-0-130-232 kubenswrapper[2575]: W0609 15:14:20.557017 2575 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jun 09 15:14:20.563959 ip-10-0-130-232 kubenswrapper[2575]: W0609 15:14:20.557023 2575 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jun 09 15:14:20.563959 ip-10-0-130-232 kubenswrapper[2575]: W0609 15:14:20.557029 2575 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jun 09 15:14:20.563959 ip-10-0-130-232 kubenswrapper[2575]: W0609 15:14:20.557035 2575 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jun 09 15:14:20.563959 ip-10-0-130-232 kubenswrapper[2575]: W0609 15:14:20.557039 2575 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jun 09 15:14:20.563959 ip-10-0-130-232 kubenswrapper[2575]: W0609 15:14:20.557044 2575 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jun 09 15:14:20.563959 ip-10-0-130-232 kubenswrapper[2575]: W0609 15:14:20.557048 2575 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jun 09 15:14:20.563959 ip-10-0-130-232 kubenswrapper[2575]: W0609 15:14:20.557053 2575 feature_gate.go:328] unrecognized feature gate: Example2 Jun 09 15:14:20.563959 ip-10-0-130-232 kubenswrapper[2575]: W0609 15:14:20.557057 2575 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jun 09 15:14:20.563959 ip-10-0-130-232 kubenswrapper[2575]: W0609 15:14:20.557061 2575 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jun 09 15:14:20.563959 ip-10-0-130-232 kubenswrapper[2575]: W0609 15:14:20.557066 2575 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jun 09 15:14:20.563959 ip-10-0-130-232 kubenswrapper[2575]: W0609 15:14:20.557070 2575 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jun 09 15:14:20.563959 ip-10-0-130-232 kubenswrapper[2575]: W0609 15:14:20.557075 2575 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jun 09 15:14:20.563959 ip-10-0-130-232 kubenswrapper[2575]: W0609 15:14:20.557079 2575 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jun 09 15:14:20.564646 ip-10-0-130-232 kubenswrapper[2575]: W0609 15:14:20.557083 2575 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jun 09 15:14:20.564646 ip-10-0-130-232 kubenswrapper[2575]: W0609 15:14:20.557087 2575 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jun 09 15:14:20.564646 ip-10-0-130-232 kubenswrapper[2575]: W0609 15:14:20.557091 2575 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jun 09 15:14:20.564646 ip-10-0-130-232 kubenswrapper[2575]: W0609 15:14:20.557095 2575 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jun 09 15:14:20.564646 ip-10-0-130-232 kubenswrapper[2575]: W0609 15:14:20.557099 2575 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jun 09 15:14:20.564646 ip-10-0-130-232 kubenswrapper[2575]: W0609 15:14:20.557103 2575 feature_gate.go:328] unrecognized feature gate: OVNObservability Jun 09 15:14:20.564646 ip-10-0-130-232 kubenswrapper[2575]: W0609 15:14:20.557107 2575 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jun 09 15:14:20.564646 ip-10-0-130-232 kubenswrapper[2575]: W0609 15:14:20.557111 2575 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jun 09 15:14:20.564646 ip-10-0-130-232 kubenswrapper[2575]: W0609 15:14:20.557116 2575 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jun 09 15:14:20.564646 ip-10-0-130-232 kubenswrapper[2575]: W0609 15:14:20.557120 2575 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jun 09 15:14:20.564646 ip-10-0-130-232 kubenswrapper[2575]: W0609 15:14:20.557126 2575 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jun 09 15:14:20.564646 ip-10-0-130-232 kubenswrapper[2575]: W0609 15:14:20.557132 2575 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jun 09 15:14:20.564646 ip-10-0-130-232 kubenswrapper[2575]: W0609 15:14:20.557136 2575 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jun 09 15:14:20.564646 ip-10-0-130-232 kubenswrapper[2575]: W0609 15:14:20.557141 2575 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jun 09 15:14:20.564646 ip-10-0-130-232 kubenswrapper[2575]: W0609 15:14:20.557145 2575 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jun 09 15:14:20.564646 ip-10-0-130-232 kubenswrapper[2575]: W0609 15:14:20.557149 2575 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jun 09 15:14:20.564646 ip-10-0-130-232 kubenswrapper[2575]: W0609 15:14:20.557153 2575 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jun 09 15:14:20.564646 ip-10-0-130-232 kubenswrapper[2575]: W0609 15:14:20.557158 2575 feature_gate.go:328] unrecognized feature gate: Example Jun 09 15:14:20.564646 ip-10-0-130-232 kubenswrapper[2575]: W0609 15:14:20.557162 2575 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jun 09 15:14:20.564646 ip-10-0-130-232 kubenswrapper[2575]: W0609 15:14:20.557171 2575 feature_gate.go:328] unrecognized feature gate: SignatureStores Jun 09 15:14:20.565160 ip-10-0-130-232 kubenswrapper[2575]: W0609 15:14:20.557175 2575 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jun 09 15:14:20.565160 ip-10-0-130-232 kubenswrapper[2575]: W0609 15:14:20.557180 2575 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jun 09 15:14:20.565160 ip-10-0-130-232 kubenswrapper[2575]: W0609 15:14:20.557186 2575 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jun 09 15:14:20.565160 ip-10-0-130-232 kubenswrapper[2575]: W0609 15:14:20.557191 2575 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jun 09 15:14:20.565160 ip-10-0-130-232 kubenswrapper[2575]: W0609 15:14:20.557195 2575 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jun 09 15:14:20.565160 ip-10-0-130-232 kubenswrapper[2575]: W0609 15:14:20.557200 2575 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jun 09 15:14:20.565160 ip-10-0-130-232 kubenswrapper[2575]: W0609 15:14:20.557204 2575 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jun 09 15:14:20.565160 ip-10-0-130-232 kubenswrapper[2575]: W0609 15:14:20.557208 2575 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jun 09 15:14:20.565160 ip-10-0-130-232 kubenswrapper[2575]: W0609 15:14:20.557212 2575 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jun 09 15:14:20.565160 ip-10-0-130-232 kubenswrapper[2575]: W0609 15:14:20.557217 2575 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jun 09 15:14:20.565160 ip-10-0-130-232 kubenswrapper[2575]: W0609 15:14:20.557221 2575 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jun 09 15:14:20.565160 ip-10-0-130-232 kubenswrapper[2575]: W0609 15:14:20.557225 2575 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jun 09 15:14:20.565160 ip-10-0-130-232 kubenswrapper[2575]: W0609 15:14:20.557229 2575 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jun 09 15:14:20.565160 ip-10-0-130-232 kubenswrapper[2575]: W0609 15:14:20.557232 2575 feature_gate.go:328] unrecognized feature gate: DualReplica Jun 09 15:14:20.565160 ip-10-0-130-232 kubenswrapper[2575]: W0609 15:14:20.557236 2575 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jun 09 15:14:20.565160 ip-10-0-130-232 kubenswrapper[2575]: W0609 15:14:20.557240 2575 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jun 09 15:14:20.565160 ip-10-0-130-232 kubenswrapper[2575]: W0609 15:14:20.557244 2575 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jun 09 15:14:20.565160 ip-10-0-130-232 kubenswrapper[2575]: W0609 15:14:20.557249 2575 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jun 09 15:14:20.565160 ip-10-0-130-232 kubenswrapper[2575]: W0609 15:14:20.557253 2575 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jun 09 15:14:20.565636 ip-10-0-130-232 kubenswrapper[2575]: W0609 15:14:20.557257 2575 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jun 09 15:14:20.565636 ip-10-0-130-232 kubenswrapper[2575]: W0609 15:14:20.557261 2575 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jun 09 15:14:20.565636 ip-10-0-130-232 kubenswrapper[2575]: W0609 15:14:20.557265 2575 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jun 09 15:14:20.565636 ip-10-0-130-232 kubenswrapper[2575]: W0609 15:14:20.557269 2575 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jun 09 15:14:20.565636 ip-10-0-130-232 kubenswrapper[2575]: W0609 15:14:20.557273 2575 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jun 09 15:14:20.565636 ip-10-0-130-232 kubenswrapper[2575]: W0609 15:14:20.557277 2575 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jun 09 15:14:20.565636 ip-10-0-130-232 kubenswrapper[2575]: W0609 15:14:20.557281 2575 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jun 09 15:14:20.565636 ip-10-0-130-232 kubenswrapper[2575]: W0609 15:14:20.557285 2575 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jun 09 15:14:20.565636 ip-10-0-130-232 kubenswrapper[2575]: W0609 15:14:20.557289 2575 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jun 09 15:14:20.565636 ip-10-0-130-232 kubenswrapper[2575]: W0609 15:14:20.557292 2575 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jun 09 15:14:20.565636 ip-10-0-130-232 kubenswrapper[2575]: W0609 15:14:20.557296 2575 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jun 09 15:14:20.565636 ip-10-0-130-232 kubenswrapper[2575]: W0609 15:14:20.557300 2575 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jun 09 15:14:20.565636 ip-10-0-130-232 kubenswrapper[2575]: W0609 15:14:20.557304 2575 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jun 09 15:14:20.565636 ip-10-0-130-232 kubenswrapper[2575]: W0609 15:14:20.557308 2575 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jun 09 15:14:20.565636 ip-10-0-130-232 kubenswrapper[2575]: W0609 15:14:20.557313 2575 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jun 09 15:14:20.565636 ip-10-0-130-232 kubenswrapper[2575]: W0609 15:14:20.557317 2575 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jun 09 15:14:20.565636 ip-10-0-130-232 kubenswrapper[2575]: W0609 15:14:20.557321 2575 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jun 09 15:14:20.565636 ip-10-0-130-232 kubenswrapper[2575]: W0609 15:14:20.557325 2575 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jun 09 15:14:20.566113 ip-10-0-130-232 kubenswrapper[2575]: I0609 15:14:20.557333 2575 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]} Jun 09 15:14:20.566113 ip-10-0-130-232 kubenswrapper[2575]: I0609 15:14:20.557477 2575 server.go:962] "Client rotation is on, will bootstrap in background" Jun 09 15:14:20.566113 ip-10-0-130-232 kubenswrapper[2575]: I0609 15:14:20.560123 2575 bootstrap.go:101] "Use the bootstrap credentials to request a cert, and set kubeconfig to point to the certificate dir" Jun 09 15:14:20.566113 ip-10-0-130-232 kubenswrapper[2575]: I0609 15:14:20.561352 2575 server.go:1019] "Starting client certificate rotation" Jun 09 15:14:20.566113 ip-10-0-130-232 kubenswrapper[2575]: I0609 15:14:20.561450 2575 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kube-apiserver-client-kubelet" Jun 09 15:14:20.566113 ip-10-0-130-232 kubenswrapper[2575]: I0609 15:14:20.562063 2575 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kube-apiserver-client-kubelet" Jun 09 15:14:20.566113 ip-10-0-130-232 kubenswrapper[2575]: I0609 15:14:20.564088 2575 dynamic_cafile_content.go:123] "Loaded a new CA Bundle and Verifier" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt" Jun 09 15:14:20.568541 ip-10-0-130-232 kubenswrapper[2575]: I0609 15:14:20.568519 2575 dynamic_cafile_content.go:161] "Starting controller" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt" Jun 09 15:14:20.578410 ip-10-0-130-232 kubenswrapper[2575]: I0609 15:14:20.578393 2575 log.go:25] "Validated CRI v1 runtime API" Jun 09 15:14:20.581380 ip-10-0-130-232 kubenswrapper[2575]: I0609 15:14:20.581362 2575 log.go:25] "Validated CRI v1 image API" Jun 09 15:14:20.582169 ip-10-0-130-232 kubenswrapper[2575]: I0609 15:14:20.582155 2575 server.go:1429] "Using cgroup driver setting received from the CRI runtime" cgroupDriver="systemd" Jun 09 15:14:20.584331 ip-10-0-130-232 kubenswrapper[2575]: I0609 15:14:20.584309 2575 fs.go:135] Filesystem UUIDs: map[7B77-95E7:/dev/nvme0n1p2 c93e1559-f651-4789-8245-2de806d1eccf:/dev/nvme0n1p3 fc0712ee-ba96-4505-9206-59ee2a5a5931:/dev/nvme0n1p4] Jun 09 15:14:20.584415 ip-10-0-130-232 kubenswrapper[2575]: I0609 15:14:20.584330 2575 fs.go:136] Filesystem partitions: map[/dev/nvme0n1p3:{mountpoint:/boot major:259 minor:3 fsType:ext4 blockSize:0} /dev/nvme0n1p4:{mountpoint:/var major:259 minor:4 fsType:xfs blockSize:0} /dev/shm:{mountpoint:/dev/shm major:0 minor:22 fsType:tmpfs blockSize:0} /run:{mountpoint:/run major:0 minor:24 fsType:tmpfs blockSize:0} /tmp:{mountpoint:/tmp major:0 minor:31 fsType:tmpfs blockSize:0} composefs_0-33:{mountpoint:/ major:0 minor:33 fsType:overlay blockSize:0}] Jun 09 15:14:20.588013 ip-10-0-130-232 kubenswrapper[2575]: I0609 15:14:20.587990 2575 reflector.go:439] "Caches populated" logger="kubernetes.io/kube-apiserver-client-kubelet" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162" Jun 09 15:14:20.589280 ip-10-0-130-232 kubenswrapper[2575]: I0609 15:14:20.589178 2575 manager.go:216] Machine: {Timestamp:2026-06-09 15:14:20.5879602 +0000 UTC m=+0.275965663 CPUVendorID:GenuineIntel NumCores:8 NumPhysicalCores:4 NumSockets:1 CpuFrequency:3098503 MemoryCapacity:32812179456 SwapCapacity:0 MemoryByType:map[] NVMInfo:{MemoryModeCapacity:0 AppDirectModeCapacity:0 AvgPowerBudget:0} HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] MachineID:ec2b15ce8c69a4afc66b412cbb63a251 SystemUUID:ec2b15ce-8c69-a4af-c66b-412cbb63a251 BootID:d7e86a32-6a14-4dd9-ae94-e055f7724940 Filesystems:[{Device:/dev/shm DeviceMajor:0 DeviceMinor:22 Capacity:16406089728 Type:vfs Inodes:4005393 HasInodes:true} {Device:/run DeviceMajor:0 DeviceMinor:24 Capacity:6562439168 Type:vfs Inodes:819200 HasInodes:true} {Device:/dev/nvme0n1p4 DeviceMajor:259 DeviceMinor:4 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:composefs_0-33 DeviceMajor:0 DeviceMinor:33 Capacity:6107136 Type:vfs Inodes:18446744073709551615 HasInodes:true} {Device:/tmp DeviceMajor:0 DeviceMinor:31 Capacity:16406089728 Type:vfs Inodes:1048576 HasInodes:true} {Device:/dev/nvme0n1p3 DeviceMajor:259 DeviceMinor:3 Capacity:366869504 Type:vfs Inodes:98304 HasInodes:true}] DiskMap:map[259:0:{Name:nvme0n1 Major:259 Minor:0 Size:128849018880 Scheduler:none}] NetworkDevices:[{Name:br-ex MacAddress:02:57:e6:82:57:f7 Speed:0 Mtu:9001} {Name:ens5 MacAddress:02:57:e6:82:57:f7 Speed:0 Mtu:9001} {Name:ovs-system MacAddress:66:c4:82:24:5b:72 Speed:0 Mtu:1500}] Topology:[{Id:0 Memory:32812179456 HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] Cores:[{Id:0 Threads:[0 4] Caches:[{Id:0 Size:32768 Type:Data Level:1} {Id:0 Size:32768 Type:Instruction Level:1} {Id:0 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:1 Threads:[1 5] Caches:[{Id:1 Size:32768 Type:Data Level:1} {Id:1 Size:32768 Type:Instruction Level:1} {Id:1 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:2 Threads:[2 6] Caches:[{Id:2 Size:32768 Type:Data Level:1} {Id:2 Size:32768 Type:Instruction Level:1} {Id:2 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:3 Threads:[3 7] Caches:[{Id:3 Size:32768 Type:Data Level:1} {Id:3 Size:32768 Type:Instruction Level:1} {Id:3 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:}] Caches:[{Id:0 Size:34603008 Type:Unified Level:3}] Distances:[10]}] CloudProvider:Unknown InstanceType:Unknown InstanceID:None} Jun 09 15:14:20.589280 ip-10-0-130-232 kubenswrapper[2575]: I0609 15:14:20.589276 2575 manager_no_libpfm.go:29] cAdvisor is build without cgo and/or libpfm support. Perf event counters are not available. Jun 09 15:14:20.589417 ip-10-0-130-232 kubenswrapper[2575]: I0609 15:14:20.589372 2575 manager.go:232] Version: {KernelVersion:5.14.0-570.118.1.el9_6.x86_64 ContainerOsVersion:Red Hat Enterprise Linux CoreOS 9.6.20260602-0 (Plow) DockerVersion: DockerAPIVersion: CadvisorVersion: CadvisorRevision:} Jun 09 15:14:20.592030 ip-10-0-130-232 kubenswrapper[2575]: I0609 15:14:20.592004 2575 container_manager_linux.go:273] "Container manager verified user specified cgroup-root exists" cgroupRoot=[] Jun 09 15:14:20.592189 ip-10-0-130-232 kubenswrapper[2575]: I0609 15:14:20.592033 2575 container_manager_linux.go:278] "Creating Container Manager object based on Node Config" nodeConfig={"NodeName":"ip-10-0-130-232.ec2.internal","RuntimeCgroupsName":"/system.slice/crio.service","SystemCgroupsName":"/system.slice","KubeletCgroupsName":"","KubeletOOMScoreAdj":-999,"ContainerRuntime":"","CgroupsPerQOS":true,"CgroupRoot":"/","CgroupDriver":"systemd","KubeletRootDir":"/var/lib/kubelet","ProtectKernelDefaults":true,"KubeReservedCgroupName":"","SystemReservedCgroupName":"","ReservedSystemCPUs":{},"EnforceNodeAllocatable":{"pods":{}},"KubeReserved":null,"SystemReserved":{"cpu":"500m","ephemeral-storage":"1Gi","memory":"1Gi"},"HardEvictionThresholds":[{"Signal":"imagefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.15},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"memory.available","Operator":"LessThan","Value":{"Quantity":"100Mi","Percentage":0},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.1},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null}],"QOSReserved":{},"CPUManagerPolicy":"none","CPUManagerPolicyOptions":null,"TopologyManagerScope":"container","CPUManagerReconcilePeriod":10000000000,"MemoryManagerPolicy":"None","MemoryManagerReservedMemory":null,"PodPidsLimit":4096,"EnforceCPULimits":true,"CPUCFSQuotaPeriod":100000000,"TopologyManagerPolicy":"none","TopologyManagerPolicyOptions":null,"CgroupVersion":2} Jun 09 15:14:20.593216 ip-10-0-130-232 kubenswrapper[2575]: I0609 15:14:20.593203 2575 topology_manager.go:138] "Creating topology manager with none policy" Jun 09 15:14:20.593285 ip-10-0-130-232 kubenswrapper[2575]: I0609 15:14:20.593221 2575 container_manager_linux.go:309] "Creating device plugin manager" Jun 09 15:14:20.593285 ip-10-0-130-232 kubenswrapper[2575]: I0609 15:14:20.593238 2575 manager.go:141] "Creating Device Plugin manager" path="/var/lib/kubelet/device-plugins/kubelet.sock" Jun 09 15:14:20.593785 ip-10-0-130-232 kubenswrapper[2575]: I0609 15:14:20.593774 2575 server.go:74] "Creating device plugin registration server" version="v1beta1" socket="/var/lib/kubelet/device-plugins/kubelet.sock" Jun 09 15:14:20.594723 ip-10-0-130-232 kubenswrapper[2575]: I0609 15:14:20.594711 2575 container_manager_linux.go:318] "Creating Dynamic Resource Allocation (DRA) manager" Jun 09 15:14:20.597468 ip-10-0-130-232 kubenswrapper[2575]: I0609 15:14:20.597454 2575 state_mem.go:36] "Initialized new in-memory state store" Jun 09 15:14:20.597588 ip-10-0-130-232 kubenswrapper[2575]: I0609 15:14:20.597577 2575 server.go:1240] "Using root directory" path="/var/lib/kubelet" Jun 09 15:14:20.597653 ip-10-0-130-232 kubenswrapper[2575]: I0609 15:14:20.597616 2575 kubelet.go:486] "Attempting to sync node with API server" Jun 09 15:14:20.597653 ip-10-0-130-232 kubenswrapper[2575]: I0609 15:14:20.597638 2575 kubelet.go:387] "Adding static pod path" path="/etc/kubernetes/manifests" Jun 09 15:14:20.597736 ip-10-0-130-232 kubenswrapper[2575]: I0609 15:14:20.597656 2575 file.go:69] "Watching path" path="/etc/kubernetes/manifests" Jun 09 15:14:20.597736 ip-10-0-130-232 kubenswrapper[2575]: I0609 15:14:20.597670 2575 kubelet.go:398] "Adding apiserver pod source" Jun 09 15:14:20.597736 ip-10-0-130-232 kubenswrapper[2575]: I0609 15:14:20.597683 2575 apiserver.go:42] "Waiting for node sync before watching apiserver pods" Jun 09 15:14:20.598045 ip-10-0-130-232 kubenswrapper[2575]: I0609 15:14:20.598031 2575 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking" Jun 09 15:14:20.598107 ip-10-0-130-232 kubenswrapper[2575]: I0609 15:14:20.598056 2575 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking" Jun 09 15:14:20.600225 ip-10-0-130-232 kubenswrapper[2575]: I0609 15:14:20.600207 2575 kuberuntime_manager.go:301] "Container runtime initialized" containerRuntime="cri-o" version="1.34.8-3.rhaos4.21.git91b4b0b.el9" apiVersion="v1" Jun 09 15:14:20.601855 ip-10-0-130-232 kubenswrapper[2575]: I0609 15:14:20.601829 2575 kubelet.go:960] "Not starting ClusterTrustBundle informer because we are in static kubelet mode or the ClusterTrustBundleProjection featuregate is disabled" Jun 09 15:14:20.601912 ip-10-0-130-232 kubenswrapper[2575]: I0609 15:14:20.601877 2575 kubelet.go:984] "Not starting PodCertificateRequest manager because we are in static kubelet mode or the PodCertificateProjection feature gate is disabled" Jun 09 15:14:20.602883 ip-10-0-130-232 kubenswrapper[2575]: I0609 15:14:20.602869 2575 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/portworx-volume" Jun 09 15:14:20.602927 ip-10-0-130-232 kubenswrapper[2575]: I0609 15:14:20.602892 2575 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/empty-dir" Jun 09 15:14:20.602927 ip-10-0-130-232 kubenswrapper[2575]: I0609 15:14:20.602900 2575 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/git-repo" Jun 09 15:14:20.602927 ip-10-0-130-232 kubenswrapper[2575]: I0609 15:14:20.602909 2575 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/host-path" Jun 09 15:14:20.602927 ip-10-0-130-232 kubenswrapper[2575]: I0609 15:14:20.602922 2575 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/nfs" Jun 09 15:14:20.603033 ip-10-0-130-232 kubenswrapper[2575]: I0609 15:14:20.602930 2575 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/secret" Jun 09 15:14:20.603033 ip-10-0-130-232 kubenswrapper[2575]: I0609 15:14:20.602941 2575 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/iscsi" Jun 09 15:14:20.603033 ip-10-0-130-232 kubenswrapper[2575]: I0609 15:14:20.602950 2575 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/downward-api" Jun 09 15:14:20.603033 ip-10-0-130-232 kubenswrapper[2575]: I0609 15:14:20.602960 2575 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/fc" Jun 09 15:14:20.603033 ip-10-0-130-232 kubenswrapper[2575]: I0609 15:14:20.602968 2575 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/configmap" Jun 09 15:14:20.603033 ip-10-0-130-232 kubenswrapper[2575]: I0609 15:14:20.602989 2575 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/projected" Jun 09 15:14:20.603033 ip-10-0-130-232 kubenswrapper[2575]: I0609 15:14:20.602998 2575 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/local-volume" Jun 09 15:14:20.603631 ip-10-0-130-232 kubenswrapper[2575]: I0609 15:14:20.603620 2575 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/csi" Jun 09 15:14:20.603665 ip-10-0-130-232 kubenswrapper[2575]: I0609 15:14:20.603631 2575 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/image" Jun 09 15:14:20.607005 ip-10-0-130-232 kubenswrapper[2575]: I0609 15:14:20.606981 2575 server.go:1268] "Started kubelet" Jun 09 15:14:20.607115 ip-10-0-130-232 kubenswrapper[2575]: I0609 15:14:20.607055 2575 server.go:180] "Starting to listen" address="0.0.0.0" port=10250 Jun 09 15:14:20.607825 ip-10-0-130-232 systemd[1]: Started Kubernetes Kubelet. Jun 09 15:14:20.608212 ip-10-0-130-232 kubenswrapper[2575]: I0609 15:14:20.607810 2575 ratelimit.go:56] "Setting rate limiting for endpoint" service="podresources" qps=100 burstTokens=10 Jun 09 15:14:20.608212 ip-10-0-130-232 kubenswrapper[2575]: I0609 15:14:20.607915 2575 server_v1.go:49] "podresources" method="list" useActivePods=true Jun 09 15:14:20.608212 ip-10-0-130-232 kubenswrapper[2575]: I0609 15:14:20.608101 2575 csi_plugin.go:990] Failed to contact API server when waiting for CSINode publishing: csinodes.storage.k8s.io "ip-10-0-130-232.ec2.internal" is forbidden: User "system:anonymous" cannot get resource "csinodes" in API group "storage.k8s.io" at the cluster scope Jun 09 15:14:20.612132 ip-10-0-130-232 kubenswrapper[2575]: E0609 15:14:20.612089 2575 reflector.go:205] "Failed to watch" err="failed to list *v1.Node: nodes \"ip-10-0-130-232.ec2.internal\" is forbidden: User \"system:anonymous\" cannot list resource \"nodes\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Node" Jun 09 15:14:20.612132 ip-10-0-130-232 kubenswrapper[2575]: I0609 15:14:20.612107 2575 server.go:249] "Starting to serve the podresources API" endpoint="unix:/var/lib/kubelet/pod-resources/kubelet.sock" Jun 09 15:14:20.612450 ip-10-0-130-232 kubenswrapper[2575]: E0609 15:14:20.612425 2575 reflector.go:205] "Failed to watch" err="failed to list *v1.Service: services is forbidden: User \"system:anonymous\" cannot list resource \"services\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Service" Jun 09 15:14:20.612775 ip-10-0-130-232 kubenswrapper[2575]: I0609 15:14:20.612733 2575 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-q2lps" Jun 09 15:14:20.612884 ip-10-0-130-232 kubenswrapper[2575]: I0609 15:14:20.612869 2575 server.go:310] "Adding debug handlers to kubelet server" Jun 09 15:14:20.614521 ip-10-0-130-232 kubenswrapper[2575]: E0609 15:14:20.614501 2575 kubelet.go:1638] "Image garbage collection failed once. Stats initialization may not have completed yet" err="failed to get imageFs info: unable to find data in memory cache" Jun 09 15:14:20.617665 ip-10-0-130-232 kubenswrapper[2575]: I0609 15:14:20.617651 2575 fs_resource_analyzer.go:67] "Starting FS ResourceAnalyzer" Jun 09 15:14:20.617746 ip-10-0-130-232 kubenswrapper[2575]: I0609 15:14:20.617666 2575 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kubelet-serving" Jun 09 15:14:20.617746 ip-10-0-130-232 kubenswrapper[2575]: E0609 15:14:20.617718 2575 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-130-232.ec2.internal\" not found" Jun 09 15:14:20.618176 ip-10-0-130-232 kubenswrapper[2575]: I0609 15:14:20.618154 2575 desired_state_of_world_populator.go:146] "Desired state populator starts to run" Jun 09 15:14:20.618260 ip-10-0-130-232 kubenswrapper[2575]: I0609 15:14:20.618156 2575 volume_manager.go:311] "The desired_state_of_world populator starts" Jun 09 15:14:20.618260 ip-10-0-130-232 kubenswrapper[2575]: I0609 15:14:20.618202 2575 volume_manager.go:313] "Starting Kubelet Volume Manager" Jun 09 15:14:20.618350 ip-10-0-130-232 kubenswrapper[2575]: I0609 15:14:20.618166 2575 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-q2lps" Jun 09 15:14:20.618350 ip-10-0-130-232 kubenswrapper[2575]: E0609 15:14:20.617389 2575 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-130-232.ec2.internal.18b7727d69074fe0 default 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-130-232.ec2.internal,UID:ip-10-0-130-232.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:Starting,Message:Starting kubelet.,Source:EventSource{Component:kubelet,Host:ip-10-0-130-232.ec2.internal,},FirstTimestamp:2026-06-09 15:14:20.606885856 +0000 UTC m=+0.294891300,LastTimestamp:2026-06-09 15:14:20.606885856 +0000 UTC m=+0.294891300,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-130-232.ec2.internal,}" Jun 09 15:14:20.618445 ip-10-0-130-232 kubenswrapper[2575]: I0609 15:14:20.618372 2575 reconstruct.go:97] "Volume reconstruction finished" Jun 09 15:14:20.618445 ip-10-0-130-232 kubenswrapper[2575]: I0609 15:14:20.618381 2575 reconciler.go:29] "Reconciler: start to sync state" Jun 09 15:14:20.618445 ip-10-0-130-232 kubenswrapper[2575]: I0609 15:14:20.618418 2575 factory.go:55] Registering systemd factory Jun 09 15:14:20.618445 ip-10-0-130-232 kubenswrapper[2575]: I0609 15:14:20.618434 2575 factory.go:223] Registration of the systemd container factory successfully Jun 09 15:14:20.618770 ip-10-0-130-232 kubenswrapper[2575]: I0609 15:14:20.618756 2575 factory.go:153] Registering CRI-O factory Jun 09 15:14:20.618770 ip-10-0-130-232 kubenswrapper[2575]: I0609 15:14:20.618772 2575 factory.go:223] Registration of the crio container factory successfully Jun 09 15:14:20.618895 ip-10-0-130-232 kubenswrapper[2575]: I0609 15:14:20.618821 2575 factory.go:221] Registration of the containerd container factory failed: unable to create containerd client: containerd: cannot unix dial containerd api service: dial unix /run/containerd/containerd.sock: connect: no such file or directory Jun 09 15:14:20.618895 ip-10-0-130-232 kubenswrapper[2575]: I0609 15:14:20.618862 2575 factory.go:103] Registering Raw factory Jun 09 15:14:20.618969 ip-10-0-130-232 kubenswrapper[2575]: I0609 15:14:20.618897 2575 manager.go:1196] Started watching for new ooms in manager Jun 09 15:14:20.619445 ip-10-0-130-232 kubenswrapper[2575]: I0609 15:14:20.619431 2575 manager.go:349] Starting recovery of all containers Jun 09 15:14:20.621300 ip-10-0-130-232 kubenswrapper[2575]: E0609 15:14:20.621246 2575 controller.go:145] "Failed to ensure lease exists, will retry" err="leases.coordination.k8s.io \"ip-10-0-130-232.ec2.internal\" is forbidden: User \"system:anonymous\" cannot get resource \"leases\" in API group \"coordination.k8s.io\" in the namespace \"kube-node-lease\"" interval="200ms" Jun 09 15:14:20.621386 ip-10-0-130-232 kubenswrapper[2575]: E0609 15:14:20.621320 2575 reflector.go:205] "Failed to watch" err="failed to list *v1.CSIDriver: csidrivers.storage.k8s.io is forbidden: User \"system:anonymous\" cannot list resource \"csidrivers\" in API group \"storage.k8s.io\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.CSIDriver" Jun 09 15:14:20.630558 ip-10-0-130-232 kubenswrapper[2575]: I0609 15:14:20.630407 2575 manager.go:354] Recovery completed Jun 09 15:14:20.634625 ip-10-0-130-232 kubenswrapper[2575]: I0609 15:14:20.634611 2575 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jun 09 15:14:20.636271 ip-10-0-130-232 kubenswrapper[2575]: I0609 15:14:20.636258 2575 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-130-232.ec2.internal" event="NodeHasSufficientMemory" Jun 09 15:14:20.636323 ip-10-0-130-232 kubenswrapper[2575]: I0609 15:14:20.636287 2575 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-130-232.ec2.internal" event="NodeHasNoDiskPressure" Jun 09 15:14:20.636323 ip-10-0-130-232 kubenswrapper[2575]: I0609 15:14:20.636301 2575 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-130-232.ec2.internal" event="NodeHasSufficientPID" Jun 09 15:14:20.636916 ip-10-0-130-232 kubenswrapper[2575]: I0609 15:14:20.636900 2575 cpu_manager.go:222] "Starting CPU manager" policy="none" Jun 09 15:14:20.636916 ip-10-0-130-232 kubenswrapper[2575]: I0609 15:14:20.636913 2575 cpu_manager.go:223] "Reconciling" reconcilePeriod="10s" Jun 09 15:14:20.637024 ip-10-0-130-232 kubenswrapper[2575]: I0609 15:14:20.636929 2575 state_mem.go:36] "Initialized new in-memory state store" Jun 09 15:14:20.637024 ip-10-0-130-232 kubenswrapper[2575]: I0609 15:14:20.636939 2575 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jun 09 15:14:20.637617 ip-10-0-130-232 kubenswrapper[2575]: I0609 15:14:20.637603 2575 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-130-232.ec2.internal" event="NodeHasSufficientMemory" Jun 09 15:14:20.637693 ip-10-0-130-232 kubenswrapper[2575]: I0609 15:14:20.637633 2575 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-130-232.ec2.internal" event="NodeHasNoDiskPressure" Jun 09 15:14:20.637693 ip-10-0-130-232 kubenswrapper[2575]: I0609 15:14:20.637647 2575 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-130-232.ec2.internal" event="NodeHasSufficientPID" Jun 09 15:14:20.637909 ip-10-0-130-232 kubenswrapper[2575]: I0609 15:14:20.637894 2575 policy_none.go:49] "None policy: Start" Jun 09 15:14:20.637909 ip-10-0-130-232 kubenswrapper[2575]: I0609 15:14:20.637911 2575 memory_manager.go:187] "Starting memorymanager" policy="None" Jun 09 15:14:20.638013 ip-10-0-130-232 kubenswrapper[2575]: I0609 15:14:20.637922 2575 state_mem.go:36] "Initializing new in-memory state store" logger="Memory Manager state checkpoint" Jun 09 15:14:20.638829 ip-10-0-130-232 kubenswrapper[2575]: I0609 15:14:20.638819 2575 policy_none.go:47] "Start" Jun 09 15:14:20.679497 ip-10-0-130-232 kubenswrapper[2575]: I0609 15:14:20.679481 2575 manager.go:337] "Starting Device Plugin manager" Jun 09 15:14:20.686327 ip-10-0-130-232 kubenswrapper[2575]: E0609 15:14:20.679537 2575 manager.go:513] "Failed to read data from checkpoint" err="checkpoint is not found" checkpoint="kubelet_internal_checkpoint" Jun 09 15:14:20.686327 ip-10-0-130-232 kubenswrapper[2575]: I0609 15:14:20.679549 2575 server.go:87] "Starting device plugin registration server" Jun 09 15:14:20.686327 ip-10-0-130-232 kubenswrapper[2575]: I0609 15:14:20.679750 2575 eviction_manager.go:189] "Eviction manager: starting control loop" Jun 09 15:14:20.686327 ip-10-0-130-232 kubenswrapper[2575]: I0609 15:14:20.679759 2575 container_log_manager.go:146] "Initializing container log rotate workers" workers=1 monitorPeriod="10s" Jun 09 15:14:20.686327 ip-10-0-130-232 kubenswrapper[2575]: I0609 15:14:20.679888 2575 plugin_watcher.go:51] "Plugin Watcher Start" path="/var/lib/kubelet/plugins_registry" Jun 09 15:14:20.686327 ip-10-0-130-232 kubenswrapper[2575]: I0609 15:14:20.679978 2575 plugin_manager.go:116] "The desired_state_of_world populator (plugin watcher) starts" Jun 09 15:14:20.686327 ip-10-0-130-232 kubenswrapper[2575]: I0609 15:14:20.679989 2575 plugin_manager.go:118] "Starting Kubelet Plugin Manager" Jun 09 15:14:20.686327 ip-10-0-130-232 kubenswrapper[2575]: E0609 15:14:20.680569 2575 eviction_manager.go:267] "eviction manager: failed to check if we have separate container filesystem. Ignoring." err="non-existent label \"crio-containers\"" Jun 09 15:14:20.686327 ip-10-0-130-232 kubenswrapper[2575]: E0609 15:14:20.680607 2575 eviction_manager.go:292] "Eviction manager: failed to get summary stats" err="failed to get node info: node \"ip-10-0-130-232.ec2.internal\" not found" Jun 09 15:14:20.688274 ip-10-0-130-232 kubenswrapper[2575]: I0609 15:14:20.688254 2575 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv4" Jun 09 15:14:20.689514 ip-10-0-130-232 kubenswrapper[2575]: I0609 15:14:20.689497 2575 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv6" Jun 09 15:14:20.689561 ip-10-0-130-232 kubenswrapper[2575]: I0609 15:14:20.689545 2575 status_manager.go:244] "Starting to sync pod status with apiserver" Jun 09 15:14:20.689593 ip-10-0-130-232 kubenswrapper[2575]: I0609 15:14:20.689566 2575 kubelet.go:2448] "Starting kubelet main sync loop" Jun 09 15:14:20.689641 ip-10-0-130-232 kubenswrapper[2575]: E0609 15:14:20.689602 2575 kubelet.go:2472] "Skipping pod synchronization" err="PLEG is not healthy: pleg has yet to be successful" Jun 09 15:14:20.691611 ip-10-0-130-232 kubenswrapper[2575]: I0609 15:14:20.691589 2575 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160" Jun 09 15:14:20.780810 ip-10-0-130-232 kubenswrapper[2575]: I0609 15:14:20.780770 2575 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jun 09 15:14:20.781886 ip-10-0-130-232 kubenswrapper[2575]: I0609 15:14:20.781871 2575 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-130-232.ec2.internal" event="NodeHasSufficientMemory" Jun 09 15:14:20.781973 ip-10-0-130-232 kubenswrapper[2575]: I0609 15:14:20.781904 2575 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-130-232.ec2.internal" event="NodeHasNoDiskPressure" Jun 09 15:14:20.781973 ip-10-0-130-232 kubenswrapper[2575]: I0609 15:14:20.781919 2575 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-130-232.ec2.internal" event="NodeHasSufficientPID" Jun 09 15:14:20.781973 ip-10-0-130-232 kubenswrapper[2575]: I0609 15:14:20.781951 2575 kubelet_node_status.go:78] "Attempting to register node" node="ip-10-0-130-232.ec2.internal" Jun 09 15:14:20.789763 ip-10-0-130-232 kubenswrapper[2575]: I0609 15:14:20.789718 2575 kubelet.go:2535] "SyncLoop ADD" source="file" pods=["openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-130-232.ec2.internal","kube-system/kube-apiserver-proxy-ip-10-0-130-232.ec2.internal"] Jun 09 15:14:20.789823 ip-10-0-130-232 kubenswrapper[2575]: I0609 15:14:20.789778 2575 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jun 09 15:14:20.790560 ip-10-0-130-232 kubenswrapper[2575]: I0609 15:14:20.790544 2575 kubelet_node_status.go:81] "Successfully registered node" node="ip-10-0-130-232.ec2.internal" Jun 09 15:14:20.790616 ip-10-0-130-232 kubenswrapper[2575]: E0609 15:14:20.790564 2575 kubelet_node_status.go:536] "Error updating node status, will retry" err="error getting node \"ip-10-0-130-232.ec2.internal\": node \"ip-10-0-130-232.ec2.internal\" not found" Jun 09 15:14:20.791052 ip-10-0-130-232 kubenswrapper[2575]: I0609 15:14:20.791033 2575 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-130-232.ec2.internal" event="NodeHasSufficientMemory" Jun 09 15:14:20.791130 ip-10-0-130-232 kubenswrapper[2575]: I0609 15:14:20.791064 2575 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-130-232.ec2.internal" event="NodeHasNoDiskPressure" Jun 09 15:14:20.791130 ip-10-0-130-232 kubenswrapper[2575]: I0609 15:14:20.791078 2575 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-130-232.ec2.internal" event="NodeHasSufficientPID" Jun 09 15:14:20.792185 ip-10-0-130-232 kubenswrapper[2575]: I0609 15:14:20.792171 2575 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jun 09 15:14:20.792322 ip-10-0-130-232 kubenswrapper[2575]: I0609 15:14:20.792308 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-130-232.ec2.internal" Jun 09 15:14:20.792368 ip-10-0-130-232 kubenswrapper[2575]: I0609 15:14:20.792337 2575 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jun 09 15:14:20.792858 ip-10-0-130-232 kubenswrapper[2575]: I0609 15:14:20.792820 2575 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-130-232.ec2.internal" event="NodeHasSufficientMemory" Jun 09 15:14:20.792858 ip-10-0-130-232 kubenswrapper[2575]: I0609 15:14:20.792832 2575 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-130-232.ec2.internal" event="NodeHasSufficientMemory" Jun 09 15:14:20.792976 ip-10-0-130-232 kubenswrapper[2575]: I0609 15:14:20.792866 2575 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-130-232.ec2.internal" event="NodeHasNoDiskPressure" Jun 09 15:14:20.792976 ip-10-0-130-232 kubenswrapper[2575]: I0609 15:14:20.792868 2575 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-130-232.ec2.internal" event="NodeHasNoDiskPressure" Jun 09 15:14:20.792976 ip-10-0-130-232 kubenswrapper[2575]: I0609 15:14:20.792879 2575 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-130-232.ec2.internal" event="NodeHasSufficientPID" Jun 09 15:14:20.792976 ip-10-0-130-232 kubenswrapper[2575]: I0609 15:14:20.792886 2575 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-130-232.ec2.internal" event="NodeHasSufficientPID" Jun 09 15:14:20.793904 ip-10-0-130-232 kubenswrapper[2575]: I0609 15:14:20.793888 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-130-232.ec2.internal" Jun 09 15:14:20.793969 ip-10-0-130-232 kubenswrapper[2575]: I0609 15:14:20.793916 2575 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jun 09 15:14:20.794572 ip-10-0-130-232 kubenswrapper[2575]: I0609 15:14:20.794556 2575 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-130-232.ec2.internal" event="NodeHasSufficientMemory" Jun 09 15:14:20.794641 ip-10-0-130-232 kubenswrapper[2575]: I0609 15:14:20.794588 2575 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-130-232.ec2.internal" event="NodeHasNoDiskPressure" Jun 09 15:14:20.794641 ip-10-0-130-232 kubenswrapper[2575]: I0609 15:14:20.794602 2575 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-130-232.ec2.internal" event="NodeHasSufficientPID" Jun 09 15:14:20.803547 ip-10-0-130-232 kubenswrapper[2575]: E0609 15:14:20.803531 2575 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-130-232.ec2.internal\" not found" Jun 09 15:14:20.823460 ip-10-0-130-232 kubenswrapper[2575]: E0609 15:14:20.823445 2575 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-130-232.ec2.internal\" not found" node="ip-10-0-130-232.ec2.internal" Jun 09 15:14:20.827766 ip-10-0-130-232 kubenswrapper[2575]: E0609 15:14:20.827750 2575 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-130-232.ec2.internal\" not found" node="ip-10-0-130-232.ec2.internal" Jun 09 15:14:20.903860 ip-10-0-130-232 kubenswrapper[2575]: E0609 15:14:20.903819 2575 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-130-232.ec2.internal\" not found" Jun 09 15:14:20.919423 ip-10-0-130-232 kubenswrapper[2575]: I0609 15:14:20.919401 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/117955a7b02385bc89d5ad20cc7019ff-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-130-232.ec2.internal\" (UID: \"117955a7b02385bc89d5ad20cc7019ff\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-130-232.ec2.internal" Jun 09 15:14:20.919503 ip-10-0-130-232 kubenswrapper[2575]: I0609 15:14:20.919431 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/117955a7b02385bc89d5ad20cc7019ff-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-130-232.ec2.internal\" (UID: \"117955a7b02385bc89d5ad20cc7019ff\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-130-232.ec2.internal" Jun 09 15:14:20.919503 ip-10-0-130-232 kubenswrapper[2575]: I0609 15:14:20.919457 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/70d7652af04ab9bbf001d2e976e7ace2-config\") pod \"kube-apiserver-proxy-ip-10-0-130-232.ec2.internal\" (UID: \"70d7652af04ab9bbf001d2e976e7ace2\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-130-232.ec2.internal" Jun 09 15:14:21.004207 ip-10-0-130-232 kubenswrapper[2575]: E0609 15:14:21.004186 2575 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-130-232.ec2.internal\" not found" Jun 09 15:14:21.020529 ip-10-0-130-232 kubenswrapper[2575]: I0609 15:14:21.020505 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/117955a7b02385bc89d5ad20cc7019ff-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-130-232.ec2.internal\" (UID: \"117955a7b02385bc89d5ad20cc7019ff\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-130-232.ec2.internal" Jun 09 15:14:21.020598 ip-10-0-130-232 kubenswrapper[2575]: I0609 15:14:21.020523 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/117955a7b02385bc89d5ad20cc7019ff-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-130-232.ec2.internal\" (UID: \"117955a7b02385bc89d5ad20cc7019ff\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-130-232.ec2.internal" Jun 09 15:14:21.020598 ip-10-0-130-232 kubenswrapper[2575]: I0609 15:14:21.020552 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/117955a7b02385bc89d5ad20cc7019ff-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-130-232.ec2.internal\" (UID: \"117955a7b02385bc89d5ad20cc7019ff\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-130-232.ec2.internal" Jun 09 15:14:21.020598 ip-10-0-130-232 kubenswrapper[2575]: I0609 15:14:21.020573 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/70d7652af04ab9bbf001d2e976e7ace2-config\") pod \"kube-apiserver-proxy-ip-10-0-130-232.ec2.internal\" (UID: \"70d7652af04ab9bbf001d2e976e7ace2\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-130-232.ec2.internal" Jun 09 15:14:21.020707 ip-10-0-130-232 kubenswrapper[2575]: I0609 15:14:21.020608 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/host-path/70d7652af04ab9bbf001d2e976e7ace2-config\") pod \"kube-apiserver-proxy-ip-10-0-130-232.ec2.internal\" (UID: \"70d7652af04ab9bbf001d2e976e7ace2\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-130-232.ec2.internal" Jun 09 15:14:21.020707 ip-10-0-130-232 kubenswrapper[2575]: I0609 15:14:21.020636 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/117955a7b02385bc89d5ad20cc7019ff-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-130-232.ec2.internal\" (UID: \"117955a7b02385bc89d5ad20cc7019ff\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-130-232.ec2.internal" Jun 09 15:14:21.104976 ip-10-0-130-232 kubenswrapper[2575]: E0609 15:14:21.104906 2575 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-130-232.ec2.internal\" not found" Jun 09 15:14:21.127414 ip-10-0-130-232 kubenswrapper[2575]: I0609 15:14:21.127395 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-130-232.ec2.internal" Jun 09 15:14:21.135177 ip-10-0-130-232 kubenswrapper[2575]: I0609 15:14:21.135155 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-130-232.ec2.internal" Jun 09 15:14:21.205272 ip-10-0-130-232 kubenswrapper[2575]: E0609 15:14:21.205236 2575 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-130-232.ec2.internal\" not found" Jun 09 15:14:21.305729 ip-10-0-130-232 kubenswrapper[2575]: E0609 15:14:21.305703 2575 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-130-232.ec2.internal\" not found" Jun 09 15:14:21.406248 ip-10-0-130-232 kubenswrapper[2575]: E0609 15:14:21.406179 2575 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-130-232.ec2.internal\" not found" Jun 09 15:14:21.506774 ip-10-0-130-232 kubenswrapper[2575]: E0609 15:14:21.506750 2575 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-130-232.ec2.internal\" not found" Jun 09 15:14:21.561267 ip-10-0-130-232 kubenswrapper[2575]: I0609 15:14:21.561244 2575 transport.go:147] "Certificate rotation detected, shutting down client connections to start using new credentials" Jun 09 15:14:21.561737 ip-10-0-130-232 kubenswrapper[2575]: I0609 15:14:21.561421 2575 reflector.go:571] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.RuntimeClass" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received" Jun 09 15:14:21.607699 ip-10-0-130-232 kubenswrapper[2575]: E0609 15:14:21.607672 2575 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-130-232.ec2.internal\" not found" Jun 09 15:14:21.620632 ip-10-0-130-232 kubenswrapper[2575]: I0609 15:14:21.620592 2575 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kube-apiserver-client-kubelet" expiration="2028-06-08 15:09:20 +0000 UTC" deadline="2028-01-14 07:53:04.748511485 +0000 UTC" Jun 09 15:14:21.620632 ip-10-0-130-232 kubenswrapper[2575]: I0609 15:14:21.620622 2575 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kube-apiserver-client-kubelet" sleep="14008h38m43.12789442s" Jun 09 15:14:21.674127 ip-10-0-130-232 kubenswrapper[2575]: W0609 15:14:21.674100 2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod117955a7b02385bc89d5ad20cc7019ff.slice/crio-09e427558d1e82ca35ba3fe444d6e94baa6e67a94be89959facbbe20cfbc486a WatchSource:0}: Error finding container 09e427558d1e82ca35ba3fe444d6e94baa6e67a94be89959facbbe20cfbc486a: Status 404 returned error can't find the container with id 09e427558d1e82ca35ba3fe444d6e94baa6e67a94be89959facbbe20cfbc486a Jun 09 15:14:21.674376 ip-10-0-130-232 kubenswrapper[2575]: W0609 15:14:21.674358 2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod70d7652af04ab9bbf001d2e976e7ace2.slice/crio-6a88d3871d86f03ceb3909a907e1e0a3d921a2d79d821baac2fb6582100143e3 WatchSource:0}: Error finding container 6a88d3871d86f03ceb3909a907e1e0a3d921a2d79d821baac2fb6582100143e3: Status 404 returned error can't find the container with id 6a88d3871d86f03ceb3909a907e1e0a3d921a2d79d821baac2fb6582100143e3 Jun 09 15:14:21.678925 ip-10-0-130-232 kubenswrapper[2575]: I0609 15:14:21.678910 2575 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jun 09 15:14:21.692725 ip-10-0-130-232 kubenswrapper[2575]: I0609 15:14:21.692642 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-130-232.ec2.internal" event={"ID":"117955a7b02385bc89d5ad20cc7019ff","Type":"ContainerStarted","Data":"09e427558d1e82ca35ba3fe444d6e94baa6e67a94be89959facbbe20cfbc486a"} Jun 09 15:14:21.693811 ip-10-0-130-232 kubenswrapper[2575]: I0609 15:14:21.693784 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-130-232.ec2.internal" event={"ID":"70d7652af04ab9bbf001d2e976e7ace2","Type":"ContainerStarted","Data":"6a88d3871d86f03ceb3909a907e1e0a3d921a2d79d821baac2fb6582100143e3"} Jun 09 15:14:21.707988 ip-10-0-130-232 kubenswrapper[2575]: E0609 15:14:21.707954 2575 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-130-232.ec2.internal\" not found" Jun 09 15:14:21.754252 ip-10-0-130-232 kubenswrapper[2575]: I0609 15:14:21.754230 2575 reflector.go:439] "Caches populated" type="*v1.Service" reflector="k8s.io/client-go/informers/factory.go:160" Jun 09 15:14:21.808790 ip-10-0-130-232 kubenswrapper[2575]: E0609 15:14:21.808771 2575 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-130-232.ec2.internal\" not found" Jun 09 15:14:21.869337 ip-10-0-130-232 kubenswrapper[2575]: I0609 15:14:21.869318 2575 reflector.go:439] "Caches populated" type="*v1.Node" reflector="k8s.io/client-go/informers/factory.go:160" Jun 09 15:14:21.917812 ip-10-0-130-232 kubenswrapper[2575]: I0609 15:14:21.917755 2575 kubelet.go:3248] "Creating a mirror pod for static pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-130-232.ec2.internal" Jun 09 15:14:21.925940 ip-10-0-130-232 kubenswrapper[2575]: I0609 15:14:21.925924 2575 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]" Jun 09 15:14:21.927095 ip-10-0-130-232 kubenswrapper[2575]: I0609 15:14:21.927083 2575 kubelet.go:3248] "Creating a mirror pod for static pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-130-232.ec2.internal" Jun 09 15:14:21.936835 ip-10-0-130-232 kubenswrapper[2575]: I0609 15:14:21.936815 2575 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]" Jun 09 15:14:22.096269 ip-10-0-130-232 kubenswrapper[2575]: I0609 15:14:22.096240 2575 reflector.go:439] "Caches populated" type="*v1.CSIDriver" reflector="k8s.io/client-go/informers/factory.go:160" Jun 09 15:14:22.599299 ip-10-0-130-232 kubenswrapper[2575]: I0609 15:14:22.599266 2575 apiserver.go:52] "Watching apiserver" Jun 09 15:14:22.606731 ip-10-0-130-232 kubenswrapper[2575]: I0609 15:14:22.606625 2575 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160" Jun 09 15:14:22.607859 ip-10-0-130-232 kubenswrapper[2575]: I0609 15:14:22.607819 2575 reflector.go:439] "Caches populated" type="*v1.Pod" reflector="pkg/kubelet/config/apiserver.go:66" Jun 09 15:14:22.610337 ip-10-0-130-232 kubenswrapper[2575]: I0609 15:14:22.610310 2575 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kube-system/konnectivity-agent-2bkzp","kube-system/kube-apiserver-proxy-ip-10-0-130-232.ec2.internal","openshift-cluster-node-tuning-operator/tuned-p4lk5","openshift-image-registry/node-ca-9shqx","openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-130-232.ec2.internal","openshift-multus/multus-additional-cni-plugins-knt8p","openshift-multus/network-metrics-daemon-5bg45","openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-w7xqz","openshift-dns/node-resolver-s44r8","openshift-multus/multus-cxbrv","openshift-network-diagnostics/network-check-target-bbf2c","openshift-network-operator/iptables-alerter-b6rmr","openshift-ovn-kubernetes/ovnkube-node-lb2zn","kube-system/global-pull-secret-syncer-2k4nl"] Jun 09 15:14:22.613411 ip-10-0-130-232 kubenswrapper[2575]: I0609 15:14:22.613392 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-5bg45" Jun 09 15:14:22.613501 ip-10-0-130-232 kubenswrapper[2575]: E0609 15:14:22.613470 2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-5bg45" podUID="8eda6a9f-b4cc-403f-a284-8a9cd10e8f15" Jun 09 15:14:22.615217 ip-10-0-130-232 kubenswrapper[2575]: I0609 15:14:22.615195 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-bbf2c" Jun 09 15:14:22.615303 ip-10-0-130-232 kubenswrapper[2575]: E0609 15:14:22.615269 2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-bbf2c" podUID="e519f3d3-552b-482d-88b5-74b1d17e3bce" Jun 09 15:14:22.617291 ip-10-0-130-232 kubenswrapper[2575]: I0609 15:14:22.617271 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-p4lk5" Jun 09 15:14:22.618747 ip-10-0-130-232 kubenswrapper[2575]: I0609 15:14:22.618727 2575 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kubelet-serving" Jun 09 15:14:22.619096 ip-10-0-130-232 kubenswrapper[2575]: I0609 15:14:22.619073 2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"openshift-service-ca.crt\"" Jun 09 15:14:22.619319 ip-10-0-130-232 kubenswrapper[2575]: I0609 15:14:22.619303 2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"kube-root-ca.crt\"" Jun 09 15:14:22.619401 ip-10-0-130-232 kubenswrapper[2575]: I0609 15:14:22.619305 2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"tuned-dockercfg-8vzb4\"" Jun 09 15:14:22.619462 ip-10-0-130-232 kubenswrapper[2575]: I0609 15:14:22.619453 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-9shqx" Jun 09 15:14:22.621374 ip-10-0-130-232 kubenswrapper[2575]: I0609 15:14:22.621011 2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"node-ca-dockercfg-b9cb6\"" Jun 09 15:14:22.621374 ip-10-0-130-232 kubenswrapper[2575]: I0609 15:14:22.621232 2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"image-registry-certificates\"" Jun 09 15:14:22.621374 ip-10-0-130-232 kubenswrapper[2575]: I0609 15:14:22.621262 2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"kube-root-ca.crt\"" Jun 09 15:14:22.621374 ip-10-0-130-232 kubenswrapper[2575]: I0609 15:14:22.621302 2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"openshift-service-ca.crt\"" Jun 09 15:14:22.621896 ip-10-0-130-232 kubenswrapper[2575]: I0609 15:14:22.621766 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-2k4nl" Jun 09 15:14:22.621896 ip-10-0-130-232 kubenswrapper[2575]: E0609 15:14:22.621834 2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-2k4nl" podUID="0ee786d7-9e46-4cf0-add7-db4ff254d57b" Jun 09 15:14:22.625399 ip-10-0-130-232 kubenswrapper[2575]: I0609 15:14:22.625380 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-knt8p" Jun 09 15:14:22.627623 ip-10-0-130-232 kubenswrapper[2575]: I0609 15:14:22.627119 2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"openshift-service-ca.crt\"" Jun 09 15:14:22.627623 ip-10-0-130-232 kubenswrapper[2575]: I0609 15:14:22.627144 2575 reflector.go:439] "Caches populated" logger="kubernetes.io/kubelet-serving" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162" Jun 09 15:14:22.627623 ip-10-0-130-232 kubenswrapper[2575]: I0609 15:14:22.627221 2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"multus-ancillary-tools-dockercfg-x6nb5\"" Jun 09 15:14:22.627623 ip-10-0-130-232 kubenswrapper[2575]: I0609 15:14:22.627369 2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"default-cni-sysctl-allowlist\"" Jun 09 15:14:22.627623 ip-10-0-130-232 kubenswrapper[2575]: I0609 15:14:22.627390 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-s44r8" Jun 09 15:14:22.627623 ip-10-0-130-232 kubenswrapper[2575]: I0609 15:14:22.627482 2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"whereabouts-flatfile-config\"" Jun 09 15:14:22.627623 ip-10-0-130-232 kubenswrapper[2575]: I0609 15:14:22.627523 2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"kube-root-ca.crt\"" Jun 09 15:14:22.628037 ip-10-0-130-232 kubenswrapper[2575]: I0609 15:14:22.627706 2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"cni-copy-resources\"" Jun 09 15:14:22.629031 ip-10-0-130-232 kubenswrapper[2575]: I0609 15:14:22.629013 2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"node-resolver-dockercfg-kcft2\"" Jun 09 15:14:22.629268 ip-10-0-130-232 kubenswrapper[2575]: I0609 15:14:22.629162 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/f466d0e4-e80c-4930-a9ef-1c709b262d2b-lib-modules\") pod \"tuned-p4lk5\" (UID: \"f466d0e4-e80c-4930-a9ef-1c709b262d2b\") " pod="openshift-cluster-node-tuning-operator/tuned-p4lk5" Jun 09 15:14:22.629268 ip-10-0-130-232 kubenswrapper[2575]: I0609 15:14:22.629217 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/f466d0e4-e80c-4930-a9ef-1c709b262d2b-var-lib-kubelet\") pod \"tuned-p4lk5\" (UID: \"f466d0e4-e80c-4930-a9ef-1c709b262d2b\") " pod="openshift-cluster-node-tuning-operator/tuned-p4lk5" Jun 09 15:14:22.629430 ip-10-0-130-232 kubenswrapper[2575]: I0609 15:14:22.629279 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-bdtvp\" (UniqueName: \"kubernetes.io/projected/f466d0e4-e80c-4930-a9ef-1c709b262d2b-kube-api-access-bdtvp\") pod \"tuned-p4lk5\" (UID: \"f466d0e4-e80c-4930-a9ef-1c709b262d2b\") " pod="openshift-cluster-node-tuning-operator/tuned-p4lk5" Jun 09 15:14:22.629430 ip-10-0-130-232 kubenswrapper[2575]: I0609 15:14:22.629344 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-lb2zn" Jun 09 15:14:22.629563 ip-10-0-130-232 kubenswrapper[2575]: I0609 15:14:22.629339 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/146ee641-079b-4c92-8b48-7449e59f82b3-host\") pod \"node-ca-9shqx\" (UID: \"146ee641-079b-4c92-8b48-7449e59f82b3\") " pod="openshift-image-registry/node-ca-9shqx" Jun 09 15:14:22.629658 ip-10-0-130-232 kubenswrapper[2575]: I0609 15:14:22.629592 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-p5bjt\" (UniqueName: \"kubernetes.io/projected/146ee641-079b-4c92-8b48-7449e59f82b3-kube-api-access-p5bjt\") pod \"node-ca-9shqx\" (UID: \"146ee641-079b-4c92-8b48-7449e59f82b3\") " pod="openshift-image-registry/node-ca-9shqx" Jun 09 15:14:22.629658 ip-10-0-130-232 kubenswrapper[2575]: I0609 15:14:22.629622 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/f466d0e4-e80c-4930-a9ef-1c709b262d2b-run\") pod \"tuned-p4lk5\" (UID: \"f466d0e4-e80c-4930-a9ef-1c709b262d2b\") " pod="openshift-cluster-node-tuning-operator/tuned-p4lk5" Jun 09 15:14:22.629658 ip-10-0-130-232 kubenswrapper[2575]: I0609 15:14:22.629649 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-dmj2n\" (UniqueName: \"kubernetes.io/projected/e519f3d3-552b-482d-88b5-74b1d17e3bce-kube-api-access-dmj2n\") pod \"network-check-target-bbf2c\" (UID: \"e519f3d3-552b-482d-88b5-74b1d17e3bce\") " pod="openshift-network-diagnostics/network-check-target-bbf2c" Jun 09 15:14:22.629807 ip-10-0-130-232 kubenswrapper[2575]: I0609 15:14:22.629675 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/f466d0e4-e80c-4930-a9ef-1c709b262d2b-etc-modprobe-d\") pod \"tuned-p4lk5\" (UID: \"f466d0e4-e80c-4930-a9ef-1c709b262d2b\") " pod="openshift-cluster-node-tuning-operator/tuned-p4lk5" Jun 09 15:14:22.629807 ip-10-0-130-232 kubenswrapper[2575]: I0609 15:14:22.629697 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/f466d0e4-e80c-4930-a9ef-1c709b262d2b-etc-sysconfig\") pod \"tuned-p4lk5\" (UID: \"f466d0e4-e80c-4930-a9ef-1c709b262d2b\") " pod="openshift-cluster-node-tuning-operator/tuned-p4lk5" Jun 09 15:14:22.629807 ip-10-0-130-232 kubenswrapper[2575]: I0609 15:14:22.629718 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/f466d0e4-e80c-4930-a9ef-1c709b262d2b-tmp\") pod \"tuned-p4lk5\" (UID: \"f466d0e4-e80c-4930-a9ef-1c709b262d2b\") " pod="openshift-cluster-node-tuning-operator/tuned-p4lk5" Jun 09 15:14:22.629807 ip-10-0-130-232 kubenswrapper[2575]: I0609 15:14:22.629757 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mv4jg\" (UniqueName: \"kubernetes.io/projected/8eda6a9f-b4cc-403f-a284-8a9cd10e8f15-kube-api-access-mv4jg\") pod \"network-metrics-daemon-5bg45\" (UID: \"8eda6a9f-b4cc-403f-a284-8a9cd10e8f15\") " pod="openshift-multus/network-metrics-daemon-5bg45" Jun 09 15:14:22.629807 ip-10-0-130-232 kubenswrapper[2575]: I0609 15:14:22.629780 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/f466d0e4-e80c-4930-a9ef-1c709b262d2b-etc-systemd\") pod \"tuned-p4lk5\" (UID: \"f466d0e4-e80c-4930-a9ef-1c709b262d2b\") " pod="openshift-cluster-node-tuning-operator/tuned-p4lk5" Jun 09 15:14:22.630067 ip-10-0-130-232 kubenswrapper[2575]: I0609 15:14:22.629816 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/f466d0e4-e80c-4930-a9ef-1c709b262d2b-etc-tuned\") pod \"tuned-p4lk5\" (UID: \"f466d0e4-e80c-4930-a9ef-1c709b262d2b\") " pod="openshift-cluster-node-tuning-operator/tuned-p4lk5" Jun 09 15:14:22.630067 ip-10-0-130-232 kubenswrapper[2575]: I0609 15:14:22.629837 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/146ee641-079b-4c92-8b48-7449e59f82b3-serviceca\") pod \"node-ca-9shqx\" (UID: \"146ee641-079b-4c92-8b48-7449e59f82b3\") " pod="openshift-image-registry/node-ca-9shqx" Jun 09 15:14:22.630067 ip-10-0-130-232 kubenswrapper[2575]: I0609 15:14:22.629886 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/f466d0e4-e80c-4930-a9ef-1c709b262d2b-sys\") pod \"tuned-p4lk5\" (UID: \"f466d0e4-e80c-4930-a9ef-1c709b262d2b\") " pod="openshift-cluster-node-tuning-operator/tuned-p4lk5" Jun 09 15:14:22.630067 ip-10-0-130-232 kubenswrapper[2575]: I0609 15:14:22.629938 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/8eda6a9f-b4cc-403f-a284-8a9cd10e8f15-metrics-certs\") pod \"network-metrics-daemon-5bg45\" (UID: \"8eda6a9f-b4cc-403f-a284-8a9cd10e8f15\") " pod="openshift-multus/network-metrics-daemon-5bg45" Jun 09 15:14:22.630067 ip-10-0-130-232 kubenswrapper[2575]: I0609 15:14:22.630002 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/f466d0e4-e80c-4930-a9ef-1c709b262d2b-etc-kubernetes\") pod \"tuned-p4lk5\" (UID: \"f466d0e4-e80c-4930-a9ef-1c709b262d2b\") " pod="openshift-cluster-node-tuning-operator/tuned-p4lk5" Jun 09 15:14:22.630067 ip-10-0-130-232 kubenswrapper[2575]: I0609 15:14:22.630036 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/f466d0e4-e80c-4930-a9ef-1c709b262d2b-etc-sysctl-d\") pod \"tuned-p4lk5\" (UID: \"f466d0e4-e80c-4930-a9ef-1c709b262d2b\") " pod="openshift-cluster-node-tuning-operator/tuned-p4lk5" Jun 09 15:14:22.630067 ip-10-0-130-232 kubenswrapper[2575]: I0609 15:14:22.630063 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/f466d0e4-e80c-4930-a9ef-1c709b262d2b-etc-sysctl-conf\") pod \"tuned-p4lk5\" (UID: \"f466d0e4-e80c-4930-a9ef-1c709b262d2b\") " pod="openshift-cluster-node-tuning-operator/tuned-p4lk5" Jun 09 15:14:22.630322 ip-10-0-130-232 kubenswrapper[2575]: I0609 15:14:22.630085 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/f466d0e4-e80c-4930-a9ef-1c709b262d2b-host\") pod \"tuned-p4lk5\" (UID: \"f466d0e4-e80c-4930-a9ef-1c709b262d2b\") " pod="openshift-cluster-node-tuning-operator/tuned-p4lk5" Jun 09 15:14:22.630546 ip-10-0-130-232 kubenswrapper[2575]: I0609 15:14:22.630528 2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"kube-root-ca.crt\"" Jun 09 15:14:22.630624 ip-10-0-130-232 kubenswrapper[2575]: I0609 15:14:22.630594 2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"openshift-service-ca.crt\"" Jun 09 15:14:22.631384 ip-10-0-130-232 kubenswrapper[2575]: I0609 15:14:22.631231 2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"env-overrides\"" Jun 09 15:14:22.631384 ip-10-0-130-232 kubenswrapper[2575]: I0609 15:14:22.631266 2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"openshift-service-ca.crt\"" Jun 09 15:14:22.631384 ip-10-0-130-232 kubenswrapper[2575]: I0609 15:14:22.631290 2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-config\"" Jun 09 15:14:22.631598 ip-10-0-130-232 kubenswrapper[2575]: I0609 15:14:22.631473 2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-node-metrics-cert\"" Jun 09 15:14:22.631882 ip-10-0-130-232 kubenswrapper[2575]: I0609 15:14:22.631862 2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"kube-root-ca.crt\"" Jun 09 15:14:22.632715 ip-10-0-130-232 kubenswrapper[2575]: I0609 15:14:22.632281 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-w7xqz" Jun 09 15:14:22.632715 ip-10-0-130-232 kubenswrapper[2575]: I0609 15:14:22.632399 2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-script-lib\"" Jun 09 15:14:22.634908 ip-10-0-130-232 kubenswrapper[2575]: I0609 15:14:22.633309 2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-kubernetes-node-dockercfg-5wwwr\"" Jun 09 15:14:22.634908 ip-10-0-130-232 kubenswrapper[2575]: I0609 15:14:22.634698 2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"kube-root-ca.crt\"" Jun 09 15:14:22.634908 ip-10-0-130-232 kubenswrapper[2575]: I0609 15:14:22.634822 2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"openshift-service-ca.crt\"" Jun 09 15:14:22.635173 ip-10-0-130-232 kubenswrapper[2575]: I0609 15:14:22.635158 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-cxbrv" Jun 09 15:14:22.636296 ip-10-0-130-232 kubenswrapper[2575]: I0609 15:14:22.635244 2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-metrics-serving-cert\"" Jun 09 15:14:22.636296 ip-10-0-130-232 kubenswrapper[2575]: I0609 15:14:22.635550 2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-sa-dockercfg-9gszz\"" Jun 09 15:14:22.637212 ip-10-0-130-232 kubenswrapper[2575]: I0609 15:14:22.637191 2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"multus-daemon-config\"" Jun 09 15:14:22.637580 ip-10-0-130-232 kubenswrapper[2575]: I0609 15:14:22.637561 2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"default-dockercfg-wh5nc\"" Jun 09 15:14:22.639539 ip-10-0-130-232 kubenswrapper[2575]: I0609 15:14:22.638987 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-2bkzp" Jun 09 15:14:22.641119 ip-10-0-130-232 kubenswrapper[2575]: I0609 15:14:22.640702 2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kube-system\"/\"konnectivity-ca-bundle\"" Jun 09 15:14:22.641119 ip-10-0-130-232 kubenswrapper[2575]: I0609 15:14:22.640805 2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"default-dockercfg-btlcm\"" Jun 09 15:14:22.641119 ip-10-0-130-232 kubenswrapper[2575]: I0609 15:14:22.640992 2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"konnectivity-agent\"" Jun 09 15:14:22.641313 ip-10-0-130-232 kubenswrapper[2575]: I0609 15:14:22.641148 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-b6rmr" Jun 09 15:14:22.643008 ip-10-0-130-232 kubenswrapper[2575]: I0609 15:14:22.642984 2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-script\"" Jun 09 15:14:22.643266 ip-10-0-130-232 kubenswrapper[2575]: I0609 15:14:22.643251 2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"openshift-service-ca.crt\"" Jun 09 15:14:22.643457 ip-10-0-130-232 kubenswrapper[2575]: I0609 15:14:22.643443 2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"kube-root-ca.crt\"" Jun 09 15:14:22.643673 ip-10-0-130-232 kubenswrapper[2575]: I0609 15:14:22.643655 2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-dockercfg-vlm9p\"" Jun 09 15:14:22.649124 ip-10-0-130-232 kubenswrapper[2575]: I0609 15:14:22.648308 2575 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kubelet-serving" csr="csr-6f9sz" Jun 09 15:14:22.656594 ip-10-0-130-232 kubenswrapper[2575]: I0609 15:14:22.656305 2575 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kubelet-serving" csr="csr-6f9sz" Jun 09 15:14:22.719380 ip-10-0-130-232 kubenswrapper[2575]: I0609 15:14:22.719352 2575 desired_state_of_world_populator.go:154] "Finished populating initial desired state of world" Jun 09 15:14:22.730688 ip-10-0-130-232 kubenswrapper[2575]: I0609 15:14:22.730657 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/7e7b605f-1171-42e1-87cf-4bd1c06eb53e-run-systemd\") pod \"ovnkube-node-lb2zn\" (UID: \"7e7b605f-1171-42e1-87cf-4bd1c06eb53e\") " pod="openshift-ovn-kubernetes/ovnkube-node-lb2zn" Jun 09 15:14:22.730820 ip-10-0-130-232 kubenswrapper[2575]: I0609 15:14:22.730694 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/7e7b605f-1171-42e1-87cf-4bd1c06eb53e-ovnkube-script-lib\") pod \"ovnkube-node-lb2zn\" (UID: \"7e7b605f-1171-42e1-87cf-4bd1c06eb53e\") " pod="openshift-ovn-kubernetes/ovnkube-node-lb2zn" Jun 09 15:14:22.730820 ip-10-0-130-232 kubenswrapper[2575]: I0609 15:14:22.730712 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/b3301a95-a57b-4095-a43b-2594d8876877-kubelet-dir\") pod \"aws-ebs-csi-driver-node-w7xqz\" (UID: \"b3301a95-a57b-4095-a43b-2594d8876877\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-w7xqz" Jun 09 15:14:22.730820 ip-10-0-130-232 kubenswrapper[2575]: I0609 15:14:22.730727 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/1982d388-abfa-4d4b-a126-34c01f86521d-cni-binary-copy\") pod \"multus-additional-cni-plugins-knt8p\" (UID: \"1982d388-abfa-4d4b-a126-34c01f86521d\") " pod="openshift-multus/multus-additional-cni-plugins-knt8p" Jun 09 15:14:22.730820 ip-10-0-130-232 kubenswrapper[2575]: I0609 15:14:22.730762 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/a687cfa5-1e89-4fbf-b17d-11f2778c632f-hosts-file\") pod \"node-resolver-s44r8\" (UID: \"a687cfa5-1e89-4fbf-b17d-11f2778c632f\") " pod="openshift-dns/node-resolver-s44r8" Jun 09 15:14:22.730820 ip-10-0-130-232 kubenswrapper[2575]: I0609 15:14:22.730788 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/7e7b605f-1171-42e1-87cf-4bd1c06eb53e-run-openvswitch\") pod \"ovnkube-node-lb2zn\" (UID: \"7e7b605f-1171-42e1-87cf-4bd1c06eb53e\") " pod="openshift-ovn-kubernetes/ovnkube-node-lb2zn" Jun 09 15:14:22.730820 ip-10-0-130-232 kubenswrapper[2575]: I0609 15:14:22.730811 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-dz2t6\" (UniqueName: \"kubernetes.io/projected/ce41d797-9a61-40d2-b9af-9389dfa485e0-kube-api-access-dz2t6\") pod \"iptables-alerter-b6rmr\" (UID: \"ce41d797-9a61-40d2-b9af-9389dfa485e0\") " pod="openshift-network-operator/iptables-alerter-b6rmr" Jun 09 15:14:22.731135 ip-10-0-130-232 kubenswrapper[2575]: I0609 15:14:22.730827 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/b3301a95-a57b-4095-a43b-2594d8876877-socket-dir\") pod \"aws-ebs-csi-driver-node-w7xqz\" (UID: \"b3301a95-a57b-4095-a43b-2594d8876877\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-w7xqz" Jun 09 15:14:22.731135 ip-10-0-130-232 kubenswrapper[2575]: I0609 15:14:22.730876 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/06bde064-62c0-4d6e-bc37-d0fe1e36a621-hostroot\") pod \"multus-cxbrv\" (UID: \"06bde064-62c0-4d6e-bc37-d0fe1e36a621\") " pod="openshift-multus/multus-cxbrv" Jun 09 15:14:22.731135 ip-10-0-130-232 kubenswrapper[2575]: I0609 15:14:22.730917 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/f466d0e4-e80c-4930-a9ef-1c709b262d2b-run\") pod \"tuned-p4lk5\" (UID: \"f466d0e4-e80c-4930-a9ef-1c709b262d2b\") " pod="openshift-cluster-node-tuning-operator/tuned-p4lk5" Jun 09 15:14:22.731135 ip-10-0-130-232 kubenswrapper[2575]: I0609 15:14:22.730952 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/f466d0e4-e80c-4930-a9ef-1c709b262d2b-etc-modprobe-d\") pod \"tuned-p4lk5\" (UID: \"f466d0e4-e80c-4930-a9ef-1c709b262d2b\") " pod="openshift-cluster-node-tuning-operator/tuned-p4lk5" Jun 09 15:14:22.731135 ip-10-0-130-232 kubenswrapper[2575]: I0609 15:14:22.731001 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run\" (UniqueName: \"kubernetes.io/host-path/f466d0e4-e80c-4930-a9ef-1c709b262d2b-run\") pod \"tuned-p4lk5\" (UID: \"f466d0e4-e80c-4930-a9ef-1c709b262d2b\") " pod="openshift-cluster-node-tuning-operator/tuned-p4lk5" Jun 09 15:14:22.731135 ip-10-0-130-232 kubenswrapper[2575]: I0609 15:14:22.731063 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/1982d388-abfa-4d4b-a126-34c01f86521d-system-cni-dir\") pod \"multus-additional-cni-plugins-knt8p\" (UID: \"1982d388-abfa-4d4b-a126-34c01f86521d\") " pod="openshift-multus/multus-additional-cni-plugins-knt8p" Jun 09 15:14:22.731135 ip-10-0-130-232 kubenswrapper[2575]: I0609 15:14:22.731099 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/1982d388-abfa-4d4b-a126-34c01f86521d-tuning-conf-dir\") pod \"multus-additional-cni-plugins-knt8p\" (UID: \"1982d388-abfa-4d4b-a126-34c01f86521d\") " pod="openshift-multus/multus-additional-cni-plugins-knt8p" Jun 09 15:14:22.731135 ip-10-0-130-232 kubenswrapper[2575]: I0609 15:14:22.731123 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/7e7b605f-1171-42e1-87cf-4bd1c06eb53e-var-lib-openvswitch\") pod \"ovnkube-node-lb2zn\" (UID: \"7e7b605f-1171-42e1-87cf-4bd1c06eb53e\") " pod="openshift-ovn-kubernetes/ovnkube-node-lb2zn" Jun 09 15:14:22.731401 ip-10-0-130-232 kubenswrapper[2575]: I0609 15:14:22.731146 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/f466d0e4-e80c-4930-a9ef-1c709b262d2b-etc-modprobe-d\") pod \"tuned-p4lk5\" (UID: \"f466d0e4-e80c-4930-a9ef-1c709b262d2b\") " pod="openshift-cluster-node-tuning-operator/tuned-p4lk5" Jun 09 15:14:22.731594 ip-10-0-130-232 kubenswrapper[2575]: I0609 15:14:22.731572 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/7e7b605f-1171-42e1-87cf-4bd1c06eb53e-host-run-ovn-kubernetes\") pod \"ovnkube-node-lb2zn\" (UID: \"7e7b605f-1171-42e1-87cf-4bd1c06eb53e\") " pod="openshift-ovn-kubernetes/ovnkube-node-lb2zn" Jun 09 15:14:22.731629 ip-10-0-130-232 kubenswrapper[2575]: I0609 15:14:22.731603 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/06bde064-62c0-4d6e-bc37-d0fe1e36a621-multus-conf-dir\") pod \"multus-cxbrv\" (UID: \"06bde064-62c0-4d6e-bc37-d0fe1e36a621\") " pod="openshift-multus/multus-cxbrv" Jun 09 15:14:22.731664 ip-10-0-130-232 kubenswrapper[2575]: I0609 15:14:22.731647 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/7e7b605f-1171-42e1-87cf-4bd1c06eb53e-host-run-netns\") pod \"ovnkube-node-lb2zn\" (UID: \"7e7b605f-1171-42e1-87cf-4bd1c06eb53e\") " pod="openshift-ovn-kubernetes/ovnkube-node-lb2zn" Jun 09 15:14:22.731701 ip-10-0-130-232 kubenswrapper[2575]: I0609 15:14:22.731680 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/7e7b605f-1171-42e1-87cf-4bd1c06eb53e-etc-openvswitch\") pod \"ovnkube-node-lb2zn\" (UID: \"7e7b605f-1171-42e1-87cf-4bd1c06eb53e\") " pod="openshift-ovn-kubernetes/ovnkube-node-lb2zn" Jun 09 15:14:22.731796 ip-10-0-130-232 kubenswrapper[2575]: I0609 15:14:22.731706 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/7e7b605f-1171-42e1-87cf-4bd1c06eb53e-run-ovn\") pod \"ovnkube-node-lb2zn\" (UID: \"7e7b605f-1171-42e1-87cf-4bd1c06eb53e\") " pod="openshift-ovn-kubernetes/ovnkube-node-lb2zn" Jun 09 15:14:22.731796 ip-10-0-130-232 kubenswrapper[2575]: I0609 15:14:22.731731 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/41532b1e-300d-4a9e-a64f-da302213062c-konnectivity-ca\") pod \"konnectivity-agent-2bkzp\" (UID: \"41532b1e-300d-4a9e-a64f-da302213062c\") " pod="kube-system/konnectivity-agent-2bkzp" Jun 09 15:14:22.731796 ip-10-0-130-232 kubenswrapper[2575]: I0609 15:14:22.731777 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/06bde064-62c0-4d6e-bc37-d0fe1e36a621-multus-socket-dir-parent\") pod \"multus-cxbrv\" (UID: \"06bde064-62c0-4d6e-bc37-d0fe1e36a621\") " pod="openshift-multus/multus-cxbrv" Jun 09 15:14:22.731941 ip-10-0-130-232 kubenswrapper[2575]: I0609 15:14:22.731808 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/f466d0e4-e80c-4930-a9ef-1c709b262d2b-etc-sysctl-d\") pod \"tuned-p4lk5\" (UID: \"f466d0e4-e80c-4930-a9ef-1c709b262d2b\") " pod="openshift-cluster-node-tuning-operator/tuned-p4lk5" Jun 09 15:14:22.731941 ip-10-0-130-232 kubenswrapper[2575]: I0609 15:14:22.731831 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/f466d0e4-e80c-4930-a9ef-1c709b262d2b-host\") pod \"tuned-p4lk5\" (UID: \"f466d0e4-e80c-4930-a9ef-1c709b262d2b\") " pod="openshift-cluster-node-tuning-operator/tuned-p4lk5" Jun 09 15:14:22.731941 ip-10-0-130-232 kubenswrapper[2575]: I0609 15:14:22.731873 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/7e7b605f-1171-42e1-87cf-4bd1c06eb53e-env-overrides\") pod \"ovnkube-node-lb2zn\" (UID: \"7e7b605f-1171-42e1-87cf-4bd1c06eb53e\") " pod="openshift-ovn-kubernetes/ovnkube-node-lb2zn" Jun 09 15:14:22.731941 ip-10-0-130-232 kubenswrapper[2575]: I0609 15:14:22.731897 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/b3301a95-a57b-4095-a43b-2594d8876877-registration-dir\") pod \"aws-ebs-csi-driver-node-w7xqz\" (UID: \"b3301a95-a57b-4095-a43b-2594d8876877\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-w7xqz" Jun 09 15:14:22.731941 ip-10-0-130-232 kubenswrapper[2575]: I0609 15:14:22.731918 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/06bde064-62c0-4d6e-bc37-d0fe1e36a621-os-release\") pod \"multus-cxbrv\" (UID: \"06bde064-62c0-4d6e-bc37-d0fe1e36a621\") " pod="openshift-multus/multus-cxbrv" Jun 09 15:14:22.732154 ip-10-0-130-232 kubenswrapper[2575]: I0609 15:14:22.731938 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/06bde064-62c0-4d6e-bc37-d0fe1e36a621-cni-binary-copy\") pod \"multus-cxbrv\" (UID: \"06bde064-62c0-4d6e-bc37-d0fe1e36a621\") " pod="openshift-multus/multus-cxbrv" Jun 09 15:14:22.732154 ip-10-0-130-232 kubenswrapper[2575]: I0609 15:14:22.731981 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/f466d0e4-e80c-4930-a9ef-1c709b262d2b-etc-sysctl-d\") pod \"tuned-p4lk5\" (UID: \"f466d0e4-e80c-4930-a9ef-1c709b262d2b\") " pod="openshift-cluster-node-tuning-operator/tuned-p4lk5" Jun 09 15:14:22.732154 ip-10-0-130-232 kubenswrapper[2575]: I0609 15:14:22.732008 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/06bde064-62c0-4d6e-bc37-d0fe1e36a621-host-var-lib-cni-bin\") pod \"multus-cxbrv\" (UID: \"06bde064-62c0-4d6e-bc37-d0fe1e36a621\") " pod="openshift-multus/multus-cxbrv" Jun 09 15:14:22.732154 ip-10-0-130-232 kubenswrapper[2575]: I0609 15:14:22.732034 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/06bde064-62c0-4d6e-bc37-d0fe1e36a621-host-run-multus-certs\") pod \"multus-cxbrv\" (UID: \"06bde064-62c0-4d6e-bc37-d0fe1e36a621\") " pod="openshift-multus/multus-cxbrv" Jun 09 15:14:22.732154 ip-10-0-130-232 kubenswrapper[2575]: I0609 15:14:22.732011 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/f466d0e4-e80c-4930-a9ef-1c709b262d2b-host\") pod \"tuned-p4lk5\" (UID: \"f466d0e4-e80c-4930-a9ef-1c709b262d2b\") " pod="openshift-cluster-node-tuning-operator/tuned-p4lk5" Jun 09 15:14:22.732154 ip-10-0-130-232 kubenswrapper[2575]: I0609 15:14:22.732052 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/1982d388-abfa-4d4b-a126-34c01f86521d-os-release\") pod \"multus-additional-cni-plugins-knt8p\" (UID: \"1982d388-abfa-4d4b-a126-34c01f86521d\") " pod="openshift-multus/multus-additional-cni-plugins-knt8p" Jun 09 15:14:22.732154 ip-10-0-130-232 kubenswrapper[2575]: I0609 15:14:22.732097 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/7e7b605f-1171-42e1-87cf-4bd1c06eb53e-log-socket\") pod \"ovnkube-node-lb2zn\" (UID: \"7e7b605f-1171-42e1-87cf-4bd1c06eb53e\") " pod="openshift-ovn-kubernetes/ovnkube-node-lb2zn" Jun 09 15:14:22.732154 ip-10-0-130-232 kubenswrapper[2575]: I0609 15:14:22.732126 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/06bde064-62c0-4d6e-bc37-d0fe1e36a621-etc-kubernetes\") pod \"multus-cxbrv\" (UID: \"06bde064-62c0-4d6e-bc37-d0fe1e36a621\") " pod="openshift-multus/multus-cxbrv" Jun 09 15:14:22.732154 ip-10-0-130-232 kubenswrapper[2575]: I0609 15:14:22.732154 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-dmj2n\" (UniqueName: \"kubernetes.io/projected/e519f3d3-552b-482d-88b5-74b1d17e3bce-kube-api-access-dmj2n\") pod \"network-check-target-bbf2c\" (UID: \"e519f3d3-552b-482d-88b5-74b1d17e3bce\") " pod="openshift-network-diagnostics/network-check-target-bbf2c" Jun 09 15:14:22.732509 ip-10-0-130-232 kubenswrapper[2575]: I0609 15:14:22.732180 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/1982d388-abfa-4d4b-a126-34c01f86521d-cnibin\") pod \"multus-additional-cni-plugins-knt8p\" (UID: \"1982d388-abfa-4d4b-a126-34c01f86521d\") " pod="openshift-multus/multus-additional-cni-plugins-knt8p" Jun 09 15:14:22.732509 ip-10-0-130-232 kubenswrapper[2575]: I0609 15:14:22.732206 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/7e7b605f-1171-42e1-87cf-4bd1c06eb53e-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-lb2zn\" (UID: \"7e7b605f-1171-42e1-87cf-4bd1c06eb53e\") " pod="openshift-ovn-kubernetes/ovnkube-node-lb2zn" Jun 09 15:14:22.732509 ip-10-0-130-232 kubenswrapper[2575]: I0609 15:14:22.732232 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/b3301a95-a57b-4095-a43b-2594d8876877-device-dir\") pod \"aws-ebs-csi-driver-node-w7xqz\" (UID: \"b3301a95-a57b-4095-a43b-2594d8876877\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-w7xqz" Jun 09 15:14:22.732509 ip-10-0-130-232 kubenswrapper[2575]: I0609 15:14:22.732255 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/b3301a95-a57b-4095-a43b-2594d8876877-etc-selinux\") pod \"aws-ebs-csi-driver-node-w7xqz\" (UID: \"b3301a95-a57b-4095-a43b-2594d8876877\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-w7xqz" Jun 09 15:14:22.732509 ip-10-0-130-232 kubenswrapper[2575]: I0609 15:14:22.732281 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mv4jg\" (UniqueName: \"kubernetes.io/projected/8eda6a9f-b4cc-403f-a284-8a9cd10e8f15-kube-api-access-mv4jg\") pod \"network-metrics-daemon-5bg45\" (UID: \"8eda6a9f-b4cc-403f-a284-8a9cd10e8f15\") " pod="openshift-multus/network-metrics-daemon-5bg45" Jun 09 15:14:22.732509 ip-10-0-130-232 kubenswrapper[2575]: I0609 15:14:22.732303 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/f466d0e4-e80c-4930-a9ef-1c709b262d2b-etc-systemd\") pod \"tuned-p4lk5\" (UID: \"f466d0e4-e80c-4930-a9ef-1c709b262d2b\") " pod="openshift-cluster-node-tuning-operator/tuned-p4lk5" Jun 09 15:14:22.732509 ip-10-0-130-232 kubenswrapper[2575]: I0609 15:14:22.732344 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/146ee641-079b-4c92-8b48-7449e59f82b3-serviceca\") pod \"node-ca-9shqx\" (UID: \"146ee641-079b-4c92-8b48-7449e59f82b3\") " pod="openshift-image-registry/node-ca-9shqx" Jun 09 15:14:22.732509 ip-10-0-130-232 kubenswrapper[2575]: I0609 15:14:22.732367 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/a687cfa5-1e89-4fbf-b17d-11f2778c632f-tmp-dir\") pod \"node-resolver-s44r8\" (UID: \"a687cfa5-1e89-4fbf-b17d-11f2778c632f\") " pod="openshift-dns/node-resolver-s44r8" Jun 09 15:14:22.732509 ip-10-0-130-232 kubenswrapper[2575]: I0609 15:14:22.732389 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/7e7b605f-1171-42e1-87cf-4bd1c06eb53e-ovnkube-config\") pod \"ovnkube-node-lb2zn\" (UID: \"7e7b605f-1171-42e1-87cf-4bd1c06eb53e\") " pod="openshift-ovn-kubernetes/ovnkube-node-lb2zn" Jun 09 15:14:22.732509 ip-10-0-130-232 kubenswrapper[2575]: I0609 15:14:22.732396 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/f466d0e4-e80c-4930-a9ef-1c709b262d2b-etc-systemd\") pod \"tuned-p4lk5\" (UID: \"f466d0e4-e80c-4930-a9ef-1c709b262d2b\") " pod="openshift-cluster-node-tuning-operator/tuned-p4lk5" Jun 09 15:14:22.732509 ip-10-0-130-232 kubenswrapper[2575]: I0609 15:14:22.732412 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/f466d0e4-e80c-4930-a9ef-1c709b262d2b-etc-sysctl-conf\") pod \"tuned-p4lk5\" (UID: \"f466d0e4-e80c-4930-a9ef-1c709b262d2b\") " pod="openshift-cluster-node-tuning-operator/tuned-p4lk5" Jun 09 15:14:22.732953 ip-10-0-130-232 kubenswrapper[2575]: I0609 15:14:22.732518 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-txksn\" (UniqueName: \"kubernetes.io/projected/b3301a95-a57b-4095-a43b-2594d8876877-kube-api-access-txksn\") pod \"aws-ebs-csi-driver-node-w7xqz\" (UID: \"b3301a95-a57b-4095-a43b-2594d8876877\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-w7xqz" Jun 09 15:14:22.732953 ip-10-0-130-232 kubenswrapper[2575]: I0609 15:14:22.732547 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-s7d6d\" (UniqueName: \"kubernetes.io/projected/06bde064-62c0-4d6e-bc37-d0fe1e36a621-kube-api-access-s7d6d\") pod \"multus-cxbrv\" (UID: \"06bde064-62c0-4d6e-bc37-d0fe1e36a621\") " pod="openshift-multus/multus-cxbrv" Jun 09 15:14:22.732953 ip-10-0-130-232 kubenswrapper[2575]: I0609 15:14:22.732562 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/f466d0e4-e80c-4930-a9ef-1c709b262d2b-etc-sysctl-conf\") pod \"tuned-p4lk5\" (UID: \"f466d0e4-e80c-4930-a9ef-1c709b262d2b\") " pod="openshift-cluster-node-tuning-operator/tuned-p4lk5" Jun 09 15:14:22.732953 ip-10-0-130-232 kubenswrapper[2575]: I0609 15:14:22.732579 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/f466d0e4-e80c-4930-a9ef-1c709b262d2b-var-lib-kubelet\") pod \"tuned-p4lk5\" (UID: \"f466d0e4-e80c-4930-a9ef-1c709b262d2b\") " pod="openshift-cluster-node-tuning-operator/tuned-p4lk5" Jun 09 15:14:22.732953 ip-10-0-130-232 kubenswrapper[2575]: I0609 15:14:22.732601 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/146ee641-079b-4c92-8b48-7449e59f82b3-host\") pod \"node-ca-9shqx\" (UID: \"146ee641-079b-4c92-8b48-7449e59f82b3\") " pod="openshift-image-registry/node-ca-9shqx" Jun 09 15:14:22.732953 ip-10-0-130-232 kubenswrapper[2575]: I0609 15:14:22.732618 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/0ee786d7-9e46-4cf0-add7-db4ff254d57b-dbus\") pod \"global-pull-secret-syncer-2k4nl\" (UID: \"0ee786d7-9e46-4cf0-add7-db4ff254d57b\") " pod="kube-system/global-pull-secret-syncer-2k4nl" Jun 09 15:14:22.732953 ip-10-0-130-232 kubenswrapper[2575]: I0609 15:14:22.732634 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/0ee786d7-9e46-4cf0-add7-db4ff254d57b-original-pull-secret\") pod \"global-pull-secret-syncer-2k4nl\" (UID: \"0ee786d7-9e46-4cf0-add7-db4ff254d57b\") " pod="kube-system/global-pull-secret-syncer-2k4nl" Jun 09 15:14:22.732953 ip-10-0-130-232 kubenswrapper[2575]: I0609 15:14:22.732650 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/06bde064-62c0-4d6e-bc37-d0fe1e36a621-host-var-lib-kubelet\") pod \"multus-cxbrv\" (UID: \"06bde064-62c0-4d6e-bc37-d0fe1e36a621\") " pod="openshift-multus/multus-cxbrv" Jun 09 15:14:22.732953 ip-10-0-130-232 kubenswrapper[2575]: I0609 15:14:22.732655 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/146ee641-079b-4c92-8b48-7449e59f82b3-host\") pod \"node-ca-9shqx\" (UID: \"146ee641-079b-4c92-8b48-7449e59f82b3\") " pod="openshift-image-registry/node-ca-9shqx" Jun 09 15:14:22.732953 ip-10-0-130-232 kubenswrapper[2575]: I0609 15:14:22.732672 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/f466d0e4-e80c-4930-a9ef-1c709b262d2b-etc-sysconfig\") pod \"tuned-p4lk5\" (UID: \"f466d0e4-e80c-4930-a9ef-1c709b262d2b\") " pod="openshift-cluster-node-tuning-operator/tuned-p4lk5" Jun 09 15:14:22.732953 ip-10-0-130-232 kubenswrapper[2575]: I0609 15:14:22.732632 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/f466d0e4-e80c-4930-a9ef-1c709b262d2b-var-lib-kubelet\") pod \"tuned-p4lk5\" (UID: \"f466d0e4-e80c-4930-a9ef-1c709b262d2b\") " pod="openshift-cluster-node-tuning-operator/tuned-p4lk5" Jun 09 15:14:22.732953 ip-10-0-130-232 kubenswrapper[2575]: I0609 15:14:22.732691 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/7e7b605f-1171-42e1-87cf-4bd1c06eb53e-ovn-node-metrics-cert\") pod \"ovnkube-node-lb2zn\" (UID: \"7e7b605f-1171-42e1-87cf-4bd1c06eb53e\") " pod="openshift-ovn-kubernetes/ovnkube-node-lb2zn" Jun 09 15:14:22.732953 ip-10-0-130-232 kubenswrapper[2575]: I0609 15:14:22.732745 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/f466d0e4-e80c-4930-a9ef-1c709b262d2b-etc-sysconfig\") pod \"tuned-p4lk5\" (UID: \"f466d0e4-e80c-4930-a9ef-1c709b262d2b\") " pod="openshift-cluster-node-tuning-operator/tuned-p4lk5" Jun 09 15:14:22.732953 ip-10-0-130-232 kubenswrapper[2575]: I0609 15:14:22.732771 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/ce41d797-9a61-40d2-b9af-9389dfa485e0-host-slash\") pod \"iptables-alerter-b6rmr\" (UID: \"ce41d797-9a61-40d2-b9af-9389dfa485e0\") " pod="openshift-network-operator/iptables-alerter-b6rmr" Jun 09 15:14:22.732953 ip-10-0-130-232 kubenswrapper[2575]: I0609 15:14:22.732788 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/06bde064-62c0-4d6e-bc37-d0fe1e36a621-host-run-netns\") pod \"multus-cxbrv\" (UID: \"06bde064-62c0-4d6e-bc37-d0fe1e36a621\") " pod="openshift-multus/multus-cxbrv" Jun 09 15:14:22.732953 ip-10-0-130-232 kubenswrapper[2575]: I0609 15:14:22.732804 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/f466d0e4-e80c-4930-a9ef-1c709b262d2b-etc-tuned\") pod \"tuned-p4lk5\" (UID: \"f466d0e4-e80c-4930-a9ef-1c709b262d2b\") " pod="openshift-cluster-node-tuning-operator/tuned-p4lk5" Jun 09 15:14:22.732953 ip-10-0-130-232 kubenswrapper[2575]: I0609 15:14:22.732822 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/7e7b605f-1171-42e1-87cf-4bd1c06eb53e-host-slash\") pod \"ovnkube-node-lb2zn\" (UID: \"7e7b605f-1171-42e1-87cf-4bd1c06eb53e\") " pod="openshift-ovn-kubernetes/ovnkube-node-lb2zn" Jun 09 15:14:22.733677 ip-10-0-130-232 kubenswrapper[2575]: I0609 15:14:22.732839 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/146ee641-079b-4c92-8b48-7449e59f82b3-serviceca\") pod \"node-ca-9shqx\" (UID: \"146ee641-079b-4c92-8b48-7449e59f82b3\") " pod="openshift-image-registry/node-ca-9shqx" Jun 09 15:14:22.733677 ip-10-0-130-232 kubenswrapper[2575]: I0609 15:14:22.732931 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/7e7b605f-1171-42e1-87cf-4bd1c06eb53e-node-log\") pod \"ovnkube-node-lb2zn\" (UID: \"7e7b605f-1171-42e1-87cf-4bd1c06eb53e\") " pod="openshift-ovn-kubernetes/ovnkube-node-lb2zn" Jun 09 15:14:22.733677 ip-10-0-130-232 kubenswrapper[2575]: I0609 15:14:22.732970 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/0ee786d7-9e46-4cf0-add7-db4ff254d57b-kubelet-config\") pod \"global-pull-secret-syncer-2k4nl\" (UID: \"0ee786d7-9e46-4cf0-add7-db4ff254d57b\") " pod="kube-system/global-pull-secret-syncer-2k4nl" Jun 09 15:14:22.733677 ip-10-0-130-232 kubenswrapper[2575]: I0609 15:14:22.733013 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/f466d0e4-e80c-4930-a9ef-1c709b262d2b-sys\") pod \"tuned-p4lk5\" (UID: \"f466d0e4-e80c-4930-a9ef-1c709b262d2b\") " pod="openshift-cluster-node-tuning-operator/tuned-p4lk5" Jun 09 15:14:22.733677 ip-10-0-130-232 kubenswrapper[2575]: I0609 15:14:22.733040 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-66zm7\" (UniqueName: \"kubernetes.io/projected/a687cfa5-1e89-4fbf-b17d-11f2778c632f-kube-api-access-66zm7\") pod \"node-resolver-s44r8\" (UID: \"a687cfa5-1e89-4fbf-b17d-11f2778c632f\") " pod="openshift-dns/node-resolver-s44r8" Jun 09 15:14:22.733677 ip-10-0-130-232 kubenswrapper[2575]: I0609 15:14:22.733064 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/f466d0e4-e80c-4930-a9ef-1c709b262d2b-sys\") pod \"tuned-p4lk5\" (UID: \"f466d0e4-e80c-4930-a9ef-1c709b262d2b\") " pod="openshift-cluster-node-tuning-operator/tuned-p4lk5" Jun 09 15:14:22.733677 ip-10-0-130-232 kubenswrapper[2575]: I0609 15:14:22.733120 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-scpvt\" (UniqueName: \"kubernetes.io/projected/7e7b605f-1171-42e1-87cf-4bd1c06eb53e-kube-api-access-scpvt\") pod \"ovnkube-node-lb2zn\" (UID: \"7e7b605f-1171-42e1-87cf-4bd1c06eb53e\") " pod="openshift-ovn-kubernetes/ovnkube-node-lb2zn" Jun 09 15:14:22.733677 ip-10-0-130-232 kubenswrapper[2575]: I0609 15:14:22.733124 2575 swap_util.go:74] "error creating dir to test if tmpfs noswap is enabled. Assuming not supported" mount path="" error="stat /var/lib/kubelet/plugins/kubernetes.io/empty-dir: no such file or directory" Jun 09 15:14:22.733677 ip-10-0-130-232 kubenswrapper[2575]: I0609 15:14:22.733158 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/06bde064-62c0-4d6e-bc37-d0fe1e36a621-host-run-k8s-cni-cncf-io\") pod \"multus-cxbrv\" (UID: \"06bde064-62c0-4d6e-bc37-d0fe1e36a621\") " pod="openshift-multus/multus-cxbrv" Jun 09 15:14:22.733677 ip-10-0-130-232 kubenswrapper[2575]: I0609 15:14:22.733188 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/f466d0e4-e80c-4930-a9ef-1c709b262d2b-lib-modules\") pod \"tuned-p4lk5\" (UID: \"f466d0e4-e80c-4930-a9ef-1c709b262d2b\") " pod="openshift-cluster-node-tuning-operator/tuned-p4lk5" Jun 09 15:14:22.733677 ip-10-0-130-232 kubenswrapper[2575]: I0609 15:14:22.733212 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-bdtvp\" (UniqueName: \"kubernetes.io/projected/f466d0e4-e80c-4930-a9ef-1c709b262d2b-kube-api-access-bdtvp\") pod \"tuned-p4lk5\" (UID: \"f466d0e4-e80c-4930-a9ef-1c709b262d2b\") " pod="openshift-cluster-node-tuning-operator/tuned-p4lk5" Jun 09 15:14:22.733677 ip-10-0-130-232 kubenswrapper[2575]: I0609 15:14:22.733235 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-p5bjt\" (UniqueName: \"kubernetes.io/projected/146ee641-079b-4c92-8b48-7449e59f82b3-kube-api-access-p5bjt\") pod \"node-ca-9shqx\" (UID: \"146ee641-079b-4c92-8b48-7449e59f82b3\") " pod="openshift-image-registry/node-ca-9shqx" Jun 09 15:14:22.733677 ip-10-0-130-232 kubenswrapper[2575]: I0609 15:14:22.733258 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/1982d388-abfa-4d4b-a126-34c01f86521d-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-knt8p\" (UID: \"1982d388-abfa-4d4b-a126-34c01f86521d\") " pod="openshift-multus/multus-additional-cni-plugins-knt8p" Jun 09 15:14:22.733677 ip-10-0-130-232 kubenswrapper[2575]: I0609 15:14:22.733281 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/7e7b605f-1171-42e1-87cf-4bd1c06eb53e-systemd-units\") pod \"ovnkube-node-lb2zn\" (UID: \"7e7b605f-1171-42e1-87cf-4bd1c06eb53e\") " pod="openshift-ovn-kubernetes/ovnkube-node-lb2zn" Jun 09 15:14:22.733677 ip-10-0-130-232 kubenswrapper[2575]: I0609 15:14:22.733323 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/f466d0e4-e80c-4930-a9ef-1c709b262d2b-lib-modules\") pod \"tuned-p4lk5\" (UID: \"f466d0e4-e80c-4930-a9ef-1c709b262d2b\") " pod="openshift-cluster-node-tuning-operator/tuned-p4lk5" Jun 09 15:14:22.733677 ip-10-0-130-232 kubenswrapper[2575]: I0609 15:14:22.733434 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/ce41d797-9a61-40d2-b9af-9389dfa485e0-iptables-alerter-script\") pod \"iptables-alerter-b6rmr\" (UID: \"ce41d797-9a61-40d2-b9af-9389dfa485e0\") " pod="openshift-network-operator/iptables-alerter-b6rmr" Jun 09 15:14:22.733677 ip-10-0-130-232 kubenswrapper[2575]: I0609 15:14:22.733463 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/b3301a95-a57b-4095-a43b-2594d8876877-sys-fs\") pod \"aws-ebs-csi-driver-node-w7xqz\" (UID: \"b3301a95-a57b-4095-a43b-2594d8876877\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-w7xqz" Jun 09 15:14:22.734355 ip-10-0-130-232 kubenswrapper[2575]: I0609 15:14:22.733488 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/f466d0e4-e80c-4930-a9ef-1c709b262d2b-tmp\") pod \"tuned-p4lk5\" (UID: \"f466d0e4-e80c-4930-a9ef-1c709b262d2b\") " pod="openshift-cluster-node-tuning-operator/tuned-p4lk5" Jun 09 15:14:22.734355 ip-10-0-130-232 kubenswrapper[2575]: I0609 15:14:22.733520 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/7e7b605f-1171-42e1-87cf-4bd1c06eb53e-host-kubelet\") pod \"ovnkube-node-lb2zn\" (UID: \"7e7b605f-1171-42e1-87cf-4bd1c06eb53e\") " pod="openshift-ovn-kubernetes/ovnkube-node-lb2zn" Jun 09 15:14:22.734355 ip-10-0-130-232 kubenswrapper[2575]: I0609 15:14:22.733543 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/7e7b605f-1171-42e1-87cf-4bd1c06eb53e-host-cni-bin\") pod \"ovnkube-node-lb2zn\" (UID: \"7e7b605f-1171-42e1-87cf-4bd1c06eb53e\") " pod="openshift-ovn-kubernetes/ovnkube-node-lb2zn" Jun 09 15:14:22.734355 ip-10-0-130-232 kubenswrapper[2575]: I0609 15:14:22.733567 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/41532b1e-300d-4a9e-a64f-da302213062c-agent-certs\") pod \"konnectivity-agent-2bkzp\" (UID: \"41532b1e-300d-4a9e-a64f-da302213062c\") " pod="kube-system/konnectivity-agent-2bkzp" Jun 09 15:14:22.734355 ip-10-0-130-232 kubenswrapper[2575]: I0609 15:14:22.733590 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/06bde064-62c0-4d6e-bc37-d0fe1e36a621-system-cni-dir\") pod \"multus-cxbrv\" (UID: \"06bde064-62c0-4d6e-bc37-d0fe1e36a621\") " pod="openshift-multus/multus-cxbrv" Jun 09 15:14:22.734355 ip-10-0-130-232 kubenswrapper[2575]: I0609 15:14:22.733611 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/06bde064-62c0-4d6e-bc37-d0fe1e36a621-multus-cni-dir\") pod \"multus-cxbrv\" (UID: \"06bde064-62c0-4d6e-bc37-d0fe1e36a621\") " pod="openshift-multus/multus-cxbrv" Jun 09 15:14:22.734355 ip-10-0-130-232 kubenswrapper[2575]: I0609 15:14:22.733659 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/06bde064-62c0-4d6e-bc37-d0fe1e36a621-host-var-lib-cni-multus\") pod \"multus-cxbrv\" (UID: \"06bde064-62c0-4d6e-bc37-d0fe1e36a621\") " pod="openshift-multus/multus-cxbrv" Jun 09 15:14:22.734355 ip-10-0-130-232 kubenswrapper[2575]: I0609 15:14:22.733680 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/06bde064-62c0-4d6e-bc37-d0fe1e36a621-multus-daemon-config\") pod \"multus-cxbrv\" (UID: \"06bde064-62c0-4d6e-bc37-d0fe1e36a621\") " pod="openshift-multus/multus-cxbrv" Jun 09 15:14:22.734355 ip-10-0-130-232 kubenswrapper[2575]: I0609 15:14:22.733700 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/1982d388-abfa-4d4b-a126-34c01f86521d-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-knt8p\" (UID: \"1982d388-abfa-4d4b-a126-34c01f86521d\") " pod="openshift-multus/multus-additional-cni-plugins-knt8p" Jun 09 15:14:22.734355 ip-10-0-130-232 kubenswrapper[2575]: I0609 15:14:22.733721 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/7e7b605f-1171-42e1-87cf-4bd1c06eb53e-host-cni-netd\") pod \"ovnkube-node-lb2zn\" (UID: \"7e7b605f-1171-42e1-87cf-4bd1c06eb53e\") " pod="openshift-ovn-kubernetes/ovnkube-node-lb2zn" Jun 09 15:14:22.734355 ip-10-0-130-232 kubenswrapper[2575]: I0609 15:14:22.733740 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/06bde064-62c0-4d6e-bc37-d0fe1e36a621-cnibin\") pod \"multus-cxbrv\" (UID: \"06bde064-62c0-4d6e-bc37-d0fe1e36a621\") " pod="openshift-multus/multus-cxbrv" Jun 09 15:14:22.734355 ip-10-0-130-232 kubenswrapper[2575]: I0609 15:14:22.733761 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/8eda6a9f-b4cc-403f-a284-8a9cd10e8f15-metrics-certs\") pod \"network-metrics-daemon-5bg45\" (UID: \"8eda6a9f-b4cc-403f-a284-8a9cd10e8f15\") " pod="openshift-multus/network-metrics-daemon-5bg45" Jun 09 15:14:22.734355 ip-10-0-130-232 kubenswrapper[2575]: I0609 15:14:22.733779 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/f466d0e4-e80c-4930-a9ef-1c709b262d2b-etc-kubernetes\") pod \"tuned-p4lk5\" (UID: \"f466d0e4-e80c-4930-a9ef-1c709b262d2b\") " pod="openshift-cluster-node-tuning-operator/tuned-p4lk5" Jun 09 15:14:22.734355 ip-10-0-130-232 kubenswrapper[2575]: I0609 15:14:22.733797 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ddwb5\" (UniqueName: \"kubernetes.io/projected/1982d388-abfa-4d4b-a126-34c01f86521d-kube-api-access-ddwb5\") pod \"multus-additional-cni-plugins-knt8p\" (UID: \"1982d388-abfa-4d4b-a126-34c01f86521d\") " pod="openshift-multus/multus-additional-cni-plugins-knt8p" Jun 09 15:14:22.734355 ip-10-0-130-232 kubenswrapper[2575]: E0609 15:14:22.733867 2575 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jun 09 15:14:22.734355 ip-10-0-130-232 kubenswrapper[2575]: I0609 15:14:22.733896 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/f466d0e4-e80c-4930-a9ef-1c709b262d2b-etc-kubernetes\") pod \"tuned-p4lk5\" (UID: \"f466d0e4-e80c-4930-a9ef-1c709b262d2b\") " pod="openshift-cluster-node-tuning-operator/tuned-p4lk5" Jun 09 15:14:22.734974 ip-10-0-130-232 kubenswrapper[2575]: E0609 15:14:22.733944 2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/8eda6a9f-b4cc-403f-a284-8a9cd10e8f15-metrics-certs podName:8eda6a9f-b4cc-403f-a284-8a9cd10e8f15 nodeName:}" failed. No retries permitted until 2026-06-09 15:14:23.233916433 +0000 UTC m=+2.921921863 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/8eda6a9f-b4cc-403f-a284-8a9cd10e8f15-metrics-certs") pod "network-metrics-daemon-5bg45" (UID: "8eda6a9f-b4cc-403f-a284-8a9cd10e8f15") : object "openshift-multus"/"metrics-daemon-secret" not registered Jun 09 15:14:22.736429 ip-10-0-130-232 kubenswrapper[2575]: I0609 15:14:22.736411 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/f466d0e4-e80c-4930-a9ef-1c709b262d2b-tmp\") pod \"tuned-p4lk5\" (UID: \"f466d0e4-e80c-4930-a9ef-1c709b262d2b\") " pod="openshift-cluster-node-tuning-operator/tuned-p4lk5" Jun 09 15:14:22.736527 ip-10-0-130-232 kubenswrapper[2575]: I0609 15:14:22.736473 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/f466d0e4-e80c-4930-a9ef-1c709b262d2b-etc-tuned\") pod \"tuned-p4lk5\" (UID: \"f466d0e4-e80c-4930-a9ef-1c709b262d2b\") " pod="openshift-cluster-node-tuning-operator/tuned-p4lk5" Jun 09 15:14:22.737098 ip-10-0-130-232 kubenswrapper[2575]: E0609 15:14:22.737078 2575 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jun 09 15:14:22.737098 ip-10-0-130-232 kubenswrapper[2575]: E0609 15:14:22.737096 2575 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jun 09 15:14:22.737253 ip-10-0-130-232 kubenswrapper[2575]: E0609 15:14:22.737106 2575 projected.go:196] Error preparing data for projected volume kube-api-access-dmj2n for pod openshift-network-diagnostics/network-check-target-bbf2c: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 09 15:14:22.737253 ip-10-0-130-232 kubenswrapper[2575]: E0609 15:14:22.737154 2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/e519f3d3-552b-482d-88b5-74b1d17e3bce-kube-api-access-dmj2n podName:e519f3d3-552b-482d-88b5-74b1d17e3bce nodeName:}" failed. No retries permitted until 2026-06-09 15:14:23.237139598 +0000 UTC m=+2.925145030 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-api-access-dmj2n" (UniqueName: "kubernetes.io/projected/e519f3d3-552b-482d-88b5-74b1d17e3bce-kube-api-access-dmj2n") pod "network-check-target-bbf2c" (UID: "e519f3d3-552b-482d-88b5-74b1d17e3bce") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 09 15:14:22.739897 ip-10-0-130-232 kubenswrapper[2575]: I0609 15:14:22.739874 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-mv4jg\" (UniqueName: \"kubernetes.io/projected/8eda6a9f-b4cc-403f-a284-8a9cd10e8f15-kube-api-access-mv4jg\") pod \"network-metrics-daemon-5bg45\" (UID: \"8eda6a9f-b4cc-403f-a284-8a9cd10e8f15\") " pod="openshift-multus/network-metrics-daemon-5bg45" Jun 09 15:14:22.740390 ip-10-0-130-232 kubenswrapper[2575]: I0609 15:14:22.740366 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-p5bjt\" (UniqueName: \"kubernetes.io/projected/146ee641-079b-4c92-8b48-7449e59f82b3-kube-api-access-p5bjt\") pod \"node-ca-9shqx\" (UID: \"146ee641-079b-4c92-8b48-7449e59f82b3\") " pod="openshift-image-registry/node-ca-9shqx" Jun 09 15:14:22.741033 ip-10-0-130-232 kubenswrapper[2575]: I0609 15:14:22.741014 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-bdtvp\" (UniqueName: \"kubernetes.io/projected/f466d0e4-e80c-4930-a9ef-1c709b262d2b-kube-api-access-bdtvp\") pod \"tuned-p4lk5\" (UID: \"f466d0e4-e80c-4930-a9ef-1c709b262d2b\") " pod="openshift-cluster-node-tuning-operator/tuned-p4lk5" Jun 09 15:14:22.834810 ip-10-0-130-232 kubenswrapper[2575]: I0609 15:14:22.834778 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ddwb5\" (UniqueName: \"kubernetes.io/projected/1982d388-abfa-4d4b-a126-34c01f86521d-kube-api-access-ddwb5\") pod \"multus-additional-cni-plugins-knt8p\" (UID: \"1982d388-abfa-4d4b-a126-34c01f86521d\") " pod="openshift-multus/multus-additional-cni-plugins-knt8p" Jun 09 15:14:22.834810 ip-10-0-130-232 kubenswrapper[2575]: I0609 15:14:22.834813 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/7e7b605f-1171-42e1-87cf-4bd1c06eb53e-run-systemd\") pod \"ovnkube-node-lb2zn\" (UID: \"7e7b605f-1171-42e1-87cf-4bd1c06eb53e\") " pod="openshift-ovn-kubernetes/ovnkube-node-lb2zn" Jun 09 15:14:22.835024 ip-10-0-130-232 kubenswrapper[2575]: I0609 15:14:22.834831 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/7e7b605f-1171-42e1-87cf-4bd1c06eb53e-ovnkube-script-lib\") pod \"ovnkube-node-lb2zn\" (UID: \"7e7b605f-1171-42e1-87cf-4bd1c06eb53e\") " pod="openshift-ovn-kubernetes/ovnkube-node-lb2zn" Jun 09 15:14:22.835024 ip-10-0-130-232 kubenswrapper[2575]: I0609 15:14:22.834906 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/7e7b605f-1171-42e1-87cf-4bd1c06eb53e-run-systemd\") pod \"ovnkube-node-lb2zn\" (UID: \"7e7b605f-1171-42e1-87cf-4bd1c06eb53e\") " pod="openshift-ovn-kubernetes/ovnkube-node-lb2zn" Jun 09 15:14:22.835094 ip-10-0-130-232 kubenswrapper[2575]: I0609 15:14:22.835023 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/b3301a95-a57b-4095-a43b-2594d8876877-kubelet-dir\") pod \"aws-ebs-csi-driver-node-w7xqz\" (UID: \"b3301a95-a57b-4095-a43b-2594d8876877\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-w7xqz" Jun 09 15:14:22.835094 ip-10-0-130-232 kubenswrapper[2575]: I0609 15:14:22.835053 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/1982d388-abfa-4d4b-a126-34c01f86521d-cni-binary-copy\") pod \"multus-additional-cni-plugins-knt8p\" (UID: \"1982d388-abfa-4d4b-a126-34c01f86521d\") " pod="openshift-multus/multus-additional-cni-plugins-knt8p" Jun 09 15:14:22.835094 ip-10-0-130-232 kubenswrapper[2575]: I0609 15:14:22.835077 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/a687cfa5-1e89-4fbf-b17d-11f2778c632f-hosts-file\") pod \"node-resolver-s44r8\" (UID: \"a687cfa5-1e89-4fbf-b17d-11f2778c632f\") " pod="openshift-dns/node-resolver-s44r8" Jun 09 15:14:22.835216 ip-10-0-130-232 kubenswrapper[2575]: I0609 15:14:22.835100 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/7e7b605f-1171-42e1-87cf-4bd1c06eb53e-run-openvswitch\") pod \"ovnkube-node-lb2zn\" (UID: \"7e7b605f-1171-42e1-87cf-4bd1c06eb53e\") " pod="openshift-ovn-kubernetes/ovnkube-node-lb2zn" Jun 09 15:14:22.835216 ip-10-0-130-232 kubenswrapper[2575]: I0609 15:14:22.835111 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/b3301a95-a57b-4095-a43b-2594d8876877-kubelet-dir\") pod \"aws-ebs-csi-driver-node-w7xqz\" (UID: \"b3301a95-a57b-4095-a43b-2594d8876877\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-w7xqz" Jun 09 15:14:22.835216 ip-10-0-130-232 kubenswrapper[2575]: I0609 15:14:22.835124 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-dz2t6\" (UniqueName: \"kubernetes.io/projected/ce41d797-9a61-40d2-b9af-9389dfa485e0-kube-api-access-dz2t6\") pod \"iptables-alerter-b6rmr\" (UID: \"ce41d797-9a61-40d2-b9af-9389dfa485e0\") " pod="openshift-network-operator/iptables-alerter-b6rmr" Jun 09 15:14:22.835216 ip-10-0-130-232 kubenswrapper[2575]: I0609 15:14:22.835148 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/b3301a95-a57b-4095-a43b-2594d8876877-socket-dir\") pod \"aws-ebs-csi-driver-node-w7xqz\" (UID: \"b3301a95-a57b-4095-a43b-2594d8876877\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-w7xqz" Jun 09 15:14:22.835216 ip-10-0-130-232 kubenswrapper[2575]: I0609 15:14:22.835155 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/7e7b605f-1171-42e1-87cf-4bd1c06eb53e-run-openvswitch\") pod \"ovnkube-node-lb2zn\" (UID: \"7e7b605f-1171-42e1-87cf-4bd1c06eb53e\") " pod="openshift-ovn-kubernetes/ovnkube-node-lb2zn" Jun 09 15:14:22.835216 ip-10-0-130-232 kubenswrapper[2575]: I0609 15:14:22.835173 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/06bde064-62c0-4d6e-bc37-d0fe1e36a621-hostroot\") pod \"multus-cxbrv\" (UID: \"06bde064-62c0-4d6e-bc37-d0fe1e36a621\") " pod="openshift-multus/multus-cxbrv" Jun 09 15:14:22.835216 ip-10-0-130-232 kubenswrapper[2575]: I0609 15:14:22.835200 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/1982d388-abfa-4d4b-a126-34c01f86521d-system-cni-dir\") pod \"multus-additional-cni-plugins-knt8p\" (UID: \"1982d388-abfa-4d4b-a126-34c01f86521d\") " pod="openshift-multus/multus-additional-cni-plugins-knt8p" Jun 09 15:14:22.835531 ip-10-0-130-232 kubenswrapper[2575]: I0609 15:14:22.835229 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/a687cfa5-1e89-4fbf-b17d-11f2778c632f-hosts-file\") pod \"node-resolver-s44r8\" (UID: \"a687cfa5-1e89-4fbf-b17d-11f2778c632f\") " pod="openshift-dns/node-resolver-s44r8" Jun 09 15:14:22.835531 ip-10-0-130-232 kubenswrapper[2575]: I0609 15:14:22.835240 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/1982d388-abfa-4d4b-a126-34c01f86521d-system-cni-dir\") pod \"multus-additional-cni-plugins-knt8p\" (UID: \"1982d388-abfa-4d4b-a126-34c01f86521d\") " pod="openshift-multus/multus-additional-cni-plugins-knt8p" Jun 09 15:14:22.835531 ip-10-0-130-232 kubenswrapper[2575]: I0609 15:14:22.835251 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/06bde064-62c0-4d6e-bc37-d0fe1e36a621-hostroot\") pod \"multus-cxbrv\" (UID: \"06bde064-62c0-4d6e-bc37-d0fe1e36a621\") " pod="openshift-multus/multus-cxbrv" Jun 09 15:14:22.835531 ip-10-0-130-232 kubenswrapper[2575]: I0609 15:14:22.835263 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/b3301a95-a57b-4095-a43b-2594d8876877-socket-dir\") pod \"aws-ebs-csi-driver-node-w7xqz\" (UID: \"b3301a95-a57b-4095-a43b-2594d8876877\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-w7xqz" Jun 09 15:14:22.835531 ip-10-0-130-232 kubenswrapper[2575]: I0609 15:14:22.835283 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/1982d388-abfa-4d4b-a126-34c01f86521d-tuning-conf-dir\") pod \"multus-additional-cni-plugins-knt8p\" (UID: \"1982d388-abfa-4d4b-a126-34c01f86521d\") " pod="openshift-multus/multus-additional-cni-plugins-knt8p" Jun 09 15:14:22.835531 ip-10-0-130-232 kubenswrapper[2575]: I0609 15:14:22.835316 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/7e7b605f-1171-42e1-87cf-4bd1c06eb53e-var-lib-openvswitch\") pod \"ovnkube-node-lb2zn\" (UID: \"7e7b605f-1171-42e1-87cf-4bd1c06eb53e\") " pod="openshift-ovn-kubernetes/ovnkube-node-lb2zn" Jun 09 15:14:22.835531 ip-10-0-130-232 kubenswrapper[2575]: I0609 15:14:22.835341 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/7e7b605f-1171-42e1-87cf-4bd1c06eb53e-host-run-ovn-kubernetes\") pod \"ovnkube-node-lb2zn\" (UID: \"7e7b605f-1171-42e1-87cf-4bd1c06eb53e\") " pod="openshift-ovn-kubernetes/ovnkube-node-lb2zn" Jun 09 15:14:22.835531 ip-10-0-130-232 kubenswrapper[2575]: I0609 15:14:22.835377 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/7e7b605f-1171-42e1-87cf-4bd1c06eb53e-var-lib-openvswitch\") pod \"ovnkube-node-lb2zn\" (UID: \"7e7b605f-1171-42e1-87cf-4bd1c06eb53e\") " pod="openshift-ovn-kubernetes/ovnkube-node-lb2zn" Jun 09 15:14:22.835531 ip-10-0-130-232 kubenswrapper[2575]: I0609 15:14:22.835384 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/7e7b605f-1171-42e1-87cf-4bd1c06eb53e-host-run-ovn-kubernetes\") pod \"ovnkube-node-lb2zn\" (UID: \"7e7b605f-1171-42e1-87cf-4bd1c06eb53e\") " pod="openshift-ovn-kubernetes/ovnkube-node-lb2zn" Jun 09 15:14:22.835531 ip-10-0-130-232 kubenswrapper[2575]: I0609 15:14:22.835406 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/06bde064-62c0-4d6e-bc37-d0fe1e36a621-multus-conf-dir\") pod \"multus-cxbrv\" (UID: \"06bde064-62c0-4d6e-bc37-d0fe1e36a621\") " pod="openshift-multus/multus-cxbrv" Jun 09 15:14:22.835531 ip-10-0-130-232 kubenswrapper[2575]: I0609 15:14:22.835433 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/7e7b605f-1171-42e1-87cf-4bd1c06eb53e-host-run-netns\") pod \"ovnkube-node-lb2zn\" (UID: \"7e7b605f-1171-42e1-87cf-4bd1c06eb53e\") " pod="openshift-ovn-kubernetes/ovnkube-node-lb2zn" Jun 09 15:14:22.835531 ip-10-0-130-232 kubenswrapper[2575]: I0609 15:14:22.835456 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/7e7b605f-1171-42e1-87cf-4bd1c06eb53e-etc-openvswitch\") pod \"ovnkube-node-lb2zn\" (UID: \"7e7b605f-1171-42e1-87cf-4bd1c06eb53e\") " pod="openshift-ovn-kubernetes/ovnkube-node-lb2zn" Jun 09 15:14:22.835531 ip-10-0-130-232 kubenswrapper[2575]: I0609 15:14:22.835463 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/06bde064-62c0-4d6e-bc37-d0fe1e36a621-multus-conf-dir\") pod \"multus-cxbrv\" (UID: \"06bde064-62c0-4d6e-bc37-d0fe1e36a621\") " pod="openshift-multus/multus-cxbrv" Jun 09 15:14:22.835531 ip-10-0-130-232 kubenswrapper[2575]: I0609 15:14:22.835433 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/1982d388-abfa-4d4b-a126-34c01f86521d-tuning-conf-dir\") pod \"multus-additional-cni-plugins-knt8p\" (UID: \"1982d388-abfa-4d4b-a126-34c01f86521d\") " pod="openshift-multus/multus-additional-cni-plugins-knt8p" Jun 09 15:14:22.835531 ip-10-0-130-232 kubenswrapper[2575]: I0609 15:14:22.835479 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/7e7b605f-1171-42e1-87cf-4bd1c06eb53e-run-ovn\") pod \"ovnkube-node-lb2zn\" (UID: \"7e7b605f-1171-42e1-87cf-4bd1c06eb53e\") " pod="openshift-ovn-kubernetes/ovnkube-node-lb2zn" Jun 09 15:14:22.835531 ip-10-0-130-232 kubenswrapper[2575]: I0609 15:14:22.835504 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/41532b1e-300d-4a9e-a64f-da302213062c-konnectivity-ca\") pod \"konnectivity-agent-2bkzp\" (UID: \"41532b1e-300d-4a9e-a64f-da302213062c\") " pod="kube-system/konnectivity-agent-2bkzp" Jun 09 15:14:22.835531 ip-10-0-130-232 kubenswrapper[2575]: I0609 15:14:22.835528 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/06bde064-62c0-4d6e-bc37-d0fe1e36a621-multus-socket-dir-parent\") pod \"multus-cxbrv\" (UID: \"06bde064-62c0-4d6e-bc37-d0fe1e36a621\") " pod="openshift-multus/multus-cxbrv" Jun 09 15:14:22.836307 ip-10-0-130-232 kubenswrapper[2575]: I0609 15:14:22.835528 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/7e7b605f-1171-42e1-87cf-4bd1c06eb53e-etc-openvswitch\") pod \"ovnkube-node-lb2zn\" (UID: \"7e7b605f-1171-42e1-87cf-4bd1c06eb53e\") " pod="openshift-ovn-kubernetes/ovnkube-node-lb2zn" Jun 09 15:14:22.836307 ip-10-0-130-232 kubenswrapper[2575]: I0609 15:14:22.835553 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/7e7b605f-1171-42e1-87cf-4bd1c06eb53e-env-overrides\") pod \"ovnkube-node-lb2zn\" (UID: \"7e7b605f-1171-42e1-87cf-4bd1c06eb53e\") " pod="openshift-ovn-kubernetes/ovnkube-node-lb2zn" Jun 09 15:14:22.836307 ip-10-0-130-232 kubenswrapper[2575]: I0609 15:14:22.835563 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/7e7b605f-1171-42e1-87cf-4bd1c06eb53e-ovnkube-script-lib\") pod \"ovnkube-node-lb2zn\" (UID: \"7e7b605f-1171-42e1-87cf-4bd1c06eb53e\") " pod="openshift-ovn-kubernetes/ovnkube-node-lb2zn" Jun 09 15:14:22.836307 ip-10-0-130-232 kubenswrapper[2575]: I0609 15:14:22.835577 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/b3301a95-a57b-4095-a43b-2594d8876877-registration-dir\") pod \"aws-ebs-csi-driver-node-w7xqz\" (UID: \"b3301a95-a57b-4095-a43b-2594d8876877\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-w7xqz" Jun 09 15:14:22.836307 ip-10-0-130-232 kubenswrapper[2575]: I0609 15:14:22.835596 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/7e7b605f-1171-42e1-87cf-4bd1c06eb53e-host-run-netns\") pod \"ovnkube-node-lb2zn\" (UID: \"7e7b605f-1171-42e1-87cf-4bd1c06eb53e\") " pod="openshift-ovn-kubernetes/ovnkube-node-lb2zn" Jun 09 15:14:22.836307 ip-10-0-130-232 kubenswrapper[2575]: I0609 15:14:22.835536 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/7e7b605f-1171-42e1-87cf-4bd1c06eb53e-run-ovn\") pod \"ovnkube-node-lb2zn\" (UID: \"7e7b605f-1171-42e1-87cf-4bd1c06eb53e\") " pod="openshift-ovn-kubernetes/ovnkube-node-lb2zn" Jun 09 15:14:22.836307 ip-10-0-130-232 kubenswrapper[2575]: I0609 15:14:22.835611 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/06bde064-62c0-4d6e-bc37-d0fe1e36a621-os-release\") pod \"multus-cxbrv\" (UID: \"06bde064-62c0-4d6e-bc37-d0fe1e36a621\") " pod="openshift-multus/multus-cxbrv" Jun 09 15:14:22.836307 ip-10-0-130-232 kubenswrapper[2575]: I0609 15:14:22.835610 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/1982d388-abfa-4d4b-a126-34c01f86521d-cni-binary-copy\") pod \"multus-additional-cni-plugins-knt8p\" (UID: \"1982d388-abfa-4d4b-a126-34c01f86521d\") " pod="openshift-multus/multus-additional-cni-plugins-knt8p" Jun 09 15:14:22.836307 ip-10-0-130-232 kubenswrapper[2575]: I0609 15:14:22.835623 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/06bde064-62c0-4d6e-bc37-d0fe1e36a621-multus-socket-dir-parent\") pod \"multus-cxbrv\" (UID: \"06bde064-62c0-4d6e-bc37-d0fe1e36a621\") " pod="openshift-multus/multus-cxbrv" Jun 09 15:14:22.836307 ip-10-0-130-232 kubenswrapper[2575]: I0609 15:14:22.835657 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/06bde064-62c0-4d6e-bc37-d0fe1e36a621-cni-binary-copy\") pod \"multus-cxbrv\" (UID: \"06bde064-62c0-4d6e-bc37-d0fe1e36a621\") " pod="openshift-multus/multus-cxbrv" Jun 09 15:14:22.836307 ip-10-0-130-232 kubenswrapper[2575]: I0609 15:14:22.835687 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/06bde064-62c0-4d6e-bc37-d0fe1e36a621-host-var-lib-cni-bin\") pod \"multus-cxbrv\" (UID: \"06bde064-62c0-4d6e-bc37-d0fe1e36a621\") " pod="openshift-multus/multus-cxbrv" Jun 09 15:14:22.836307 ip-10-0-130-232 kubenswrapper[2575]: I0609 15:14:22.835712 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/06bde064-62c0-4d6e-bc37-d0fe1e36a621-host-run-multus-certs\") pod \"multus-cxbrv\" (UID: \"06bde064-62c0-4d6e-bc37-d0fe1e36a621\") " pod="openshift-multus/multus-cxbrv" Jun 09 15:14:22.836307 ip-10-0-130-232 kubenswrapper[2575]: I0609 15:14:22.835739 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/1982d388-abfa-4d4b-a126-34c01f86521d-os-release\") pod \"multus-additional-cni-plugins-knt8p\" (UID: \"1982d388-abfa-4d4b-a126-34c01f86521d\") " pod="openshift-multus/multus-additional-cni-plugins-knt8p" Jun 09 15:14:22.836307 ip-10-0-130-232 kubenswrapper[2575]: I0609 15:14:22.835762 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/7e7b605f-1171-42e1-87cf-4bd1c06eb53e-log-socket\") pod \"ovnkube-node-lb2zn\" (UID: \"7e7b605f-1171-42e1-87cf-4bd1c06eb53e\") " pod="openshift-ovn-kubernetes/ovnkube-node-lb2zn" Jun 09 15:14:22.836307 ip-10-0-130-232 kubenswrapper[2575]: I0609 15:14:22.835786 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/06bde064-62c0-4d6e-bc37-d0fe1e36a621-etc-kubernetes\") pod \"multus-cxbrv\" (UID: \"06bde064-62c0-4d6e-bc37-d0fe1e36a621\") " pod="openshift-multus/multus-cxbrv" Jun 09 15:14:22.836307 ip-10-0-130-232 kubenswrapper[2575]: I0609 15:14:22.835799 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/06bde064-62c0-4d6e-bc37-d0fe1e36a621-os-release\") pod \"multus-cxbrv\" (UID: \"06bde064-62c0-4d6e-bc37-d0fe1e36a621\") " pod="openshift-multus/multus-cxbrv" Jun 09 15:14:22.836307 ip-10-0-130-232 kubenswrapper[2575]: I0609 15:14:22.835822 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/1982d388-abfa-4d4b-a126-34c01f86521d-cnibin\") pod \"multus-additional-cni-plugins-knt8p\" (UID: \"1982d388-abfa-4d4b-a126-34c01f86521d\") " pod="openshift-multus/multus-additional-cni-plugins-knt8p" Jun 09 15:14:22.837060 ip-10-0-130-232 kubenswrapper[2575]: I0609 15:14:22.835867 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/7e7b605f-1171-42e1-87cf-4bd1c06eb53e-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-lb2zn\" (UID: \"7e7b605f-1171-42e1-87cf-4bd1c06eb53e\") " pod="openshift-ovn-kubernetes/ovnkube-node-lb2zn" Jun 09 15:14:22.837060 ip-10-0-130-232 kubenswrapper[2575]: I0609 15:14:22.835878 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/1982d388-abfa-4d4b-a126-34c01f86521d-os-release\") pod \"multus-additional-cni-plugins-knt8p\" (UID: \"1982d388-abfa-4d4b-a126-34c01f86521d\") " pod="openshift-multus/multus-additional-cni-plugins-knt8p" Jun 09 15:14:22.837060 ip-10-0-130-232 kubenswrapper[2575]: I0609 15:14:22.835893 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/b3301a95-a57b-4095-a43b-2594d8876877-device-dir\") pod \"aws-ebs-csi-driver-node-w7xqz\" (UID: \"b3301a95-a57b-4095-a43b-2594d8876877\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-w7xqz" Jun 09 15:14:22.837060 ip-10-0-130-232 kubenswrapper[2575]: I0609 15:14:22.835917 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/b3301a95-a57b-4095-a43b-2594d8876877-etc-selinux\") pod \"aws-ebs-csi-driver-node-w7xqz\" (UID: \"b3301a95-a57b-4095-a43b-2594d8876877\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-w7xqz" Jun 09 15:14:22.837060 ip-10-0-130-232 kubenswrapper[2575]: I0609 15:14:22.835947 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/a687cfa5-1e89-4fbf-b17d-11f2778c632f-tmp-dir\") pod \"node-resolver-s44r8\" (UID: \"a687cfa5-1e89-4fbf-b17d-11f2778c632f\") " pod="openshift-dns/node-resolver-s44r8" Jun 09 15:14:22.837060 ip-10-0-130-232 kubenswrapper[2575]: I0609 15:14:22.835952 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/06bde064-62c0-4d6e-bc37-d0fe1e36a621-etc-kubernetes\") pod \"multus-cxbrv\" (UID: \"06bde064-62c0-4d6e-bc37-d0fe1e36a621\") " pod="openshift-multus/multus-cxbrv" Jun 09 15:14:22.837060 ip-10-0-130-232 kubenswrapper[2575]: I0609 15:14:22.835740 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/b3301a95-a57b-4095-a43b-2594d8876877-registration-dir\") pod \"aws-ebs-csi-driver-node-w7xqz\" (UID: \"b3301a95-a57b-4095-a43b-2594d8876877\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-w7xqz" Jun 09 15:14:22.837060 ip-10-0-130-232 kubenswrapper[2575]: I0609 15:14:22.835956 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/06bde064-62c0-4d6e-bc37-d0fe1e36a621-host-run-multus-certs\") pod \"multus-cxbrv\" (UID: \"06bde064-62c0-4d6e-bc37-d0fe1e36a621\") " pod="openshift-multus/multus-cxbrv" Jun 09 15:14:22.837060 ip-10-0-130-232 kubenswrapper[2575]: I0609 15:14:22.835975 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/7e7b605f-1171-42e1-87cf-4bd1c06eb53e-ovnkube-config\") pod \"ovnkube-node-lb2zn\" (UID: \"7e7b605f-1171-42e1-87cf-4bd1c06eb53e\") " pod="openshift-ovn-kubernetes/ovnkube-node-lb2zn" Jun 09 15:14:22.837060 ip-10-0-130-232 kubenswrapper[2575]: I0609 15:14:22.835998 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/7e7b605f-1171-42e1-87cf-4bd1c06eb53e-log-socket\") pod \"ovnkube-node-lb2zn\" (UID: \"7e7b605f-1171-42e1-87cf-4bd1c06eb53e\") " pod="openshift-ovn-kubernetes/ovnkube-node-lb2zn" Jun 09 15:14:22.837060 ip-10-0-130-232 kubenswrapper[2575]: I0609 15:14:22.836001 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/7e7b605f-1171-42e1-87cf-4bd1c06eb53e-env-overrides\") pod \"ovnkube-node-lb2zn\" (UID: \"7e7b605f-1171-42e1-87cf-4bd1c06eb53e\") " pod="openshift-ovn-kubernetes/ovnkube-node-lb2zn" Jun 09 15:14:22.837060 ip-10-0-130-232 kubenswrapper[2575]: I0609 15:14:22.836012 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-txksn\" (UniqueName: \"kubernetes.io/projected/b3301a95-a57b-4095-a43b-2594d8876877-kube-api-access-txksn\") pod \"aws-ebs-csi-driver-node-w7xqz\" (UID: \"b3301a95-a57b-4095-a43b-2594d8876877\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-w7xqz" Jun 09 15:14:22.837060 ip-10-0-130-232 kubenswrapper[2575]: I0609 15:14:22.836041 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-s7d6d\" (UniqueName: \"kubernetes.io/projected/06bde064-62c0-4d6e-bc37-d0fe1e36a621-kube-api-access-s7d6d\") pod \"multus-cxbrv\" (UID: \"06bde064-62c0-4d6e-bc37-d0fe1e36a621\") " pod="openshift-multus/multus-cxbrv" Jun 09 15:14:22.837060 ip-10-0-130-232 kubenswrapper[2575]: I0609 15:14:22.836053 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/1982d388-abfa-4d4b-a126-34c01f86521d-cnibin\") pod \"multus-additional-cni-plugins-knt8p\" (UID: \"1982d388-abfa-4d4b-a126-34c01f86521d\") " pod="openshift-multus/multus-additional-cni-plugins-knt8p" Jun 09 15:14:22.837060 ip-10-0-130-232 kubenswrapper[2575]: I0609 15:14:22.836062 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/41532b1e-300d-4a9e-a64f-da302213062c-konnectivity-ca\") pod \"konnectivity-agent-2bkzp\" (UID: \"41532b1e-300d-4a9e-a64f-da302213062c\") " pod="kube-system/konnectivity-agent-2bkzp" Jun 09 15:14:22.837060 ip-10-0-130-232 kubenswrapper[2575]: I0609 15:14:22.836072 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/0ee786d7-9e46-4cf0-add7-db4ff254d57b-dbus\") pod \"global-pull-secret-syncer-2k4nl\" (UID: \"0ee786d7-9e46-4cf0-add7-db4ff254d57b\") " pod="kube-system/global-pull-secret-syncer-2k4nl" Jun 09 15:14:22.837060 ip-10-0-130-232 kubenswrapper[2575]: I0609 15:14:22.836101 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/b3301a95-a57b-4095-a43b-2594d8876877-device-dir\") pod \"aws-ebs-csi-driver-node-w7xqz\" (UID: \"b3301a95-a57b-4095-a43b-2594d8876877\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-w7xqz" Jun 09 15:14:22.838041 ip-10-0-130-232 kubenswrapper[2575]: I0609 15:14:22.836106 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/0ee786d7-9e46-4cf0-add7-db4ff254d57b-original-pull-secret\") pod \"global-pull-secret-syncer-2k4nl\" (UID: \"0ee786d7-9e46-4cf0-add7-db4ff254d57b\") " pod="kube-system/global-pull-secret-syncer-2k4nl" Jun 09 15:14:22.838041 ip-10-0-130-232 kubenswrapper[2575]: I0609 15:14:22.836134 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/06bde064-62c0-4d6e-bc37-d0fe1e36a621-host-var-lib-kubelet\") pod \"multus-cxbrv\" (UID: \"06bde064-62c0-4d6e-bc37-d0fe1e36a621\") " pod="openshift-multus/multus-cxbrv" Jun 09 15:14:22.838041 ip-10-0-130-232 kubenswrapper[2575]: I0609 15:14:22.836136 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/7e7b605f-1171-42e1-87cf-4bd1c06eb53e-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-lb2zn\" (UID: \"7e7b605f-1171-42e1-87cf-4bd1c06eb53e\") " pod="openshift-ovn-kubernetes/ovnkube-node-lb2zn" Jun 09 15:14:22.838041 ip-10-0-130-232 kubenswrapper[2575]: I0609 15:14:22.836101 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/b3301a95-a57b-4095-a43b-2594d8876877-etc-selinux\") pod \"aws-ebs-csi-driver-node-w7xqz\" (UID: \"b3301a95-a57b-4095-a43b-2594d8876877\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-w7xqz" Jun 09 15:14:22.838041 ip-10-0-130-232 kubenswrapper[2575]: I0609 15:14:22.836162 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/7e7b605f-1171-42e1-87cf-4bd1c06eb53e-ovn-node-metrics-cert\") pod \"ovnkube-node-lb2zn\" (UID: \"7e7b605f-1171-42e1-87cf-4bd1c06eb53e\") " pod="openshift-ovn-kubernetes/ovnkube-node-lb2zn" Jun 09 15:14:22.838041 ip-10-0-130-232 kubenswrapper[2575]: I0609 15:14:22.836191 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/0ee786d7-9e46-4cf0-add7-db4ff254d57b-dbus\") pod \"global-pull-secret-syncer-2k4nl\" (UID: \"0ee786d7-9e46-4cf0-add7-db4ff254d57b\") " pod="kube-system/global-pull-secret-syncer-2k4nl" Jun 09 15:14:22.838041 ip-10-0-130-232 kubenswrapper[2575]: I0609 15:14:22.836195 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/ce41d797-9a61-40d2-b9af-9389dfa485e0-host-slash\") pod \"iptables-alerter-b6rmr\" (UID: \"ce41d797-9a61-40d2-b9af-9389dfa485e0\") " pod="openshift-network-operator/iptables-alerter-b6rmr" Jun 09 15:14:22.838041 ip-10-0-130-232 kubenswrapper[2575]: I0609 15:14:22.836227 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/06bde064-62c0-4d6e-bc37-d0fe1e36a621-host-run-netns\") pod \"multus-cxbrv\" (UID: \"06bde064-62c0-4d6e-bc37-d0fe1e36a621\") " pod="openshift-multus/multus-cxbrv" Jun 09 15:14:22.838041 ip-10-0-130-232 kubenswrapper[2575]: I0609 15:14:22.836235 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/ce41d797-9a61-40d2-b9af-9389dfa485e0-host-slash\") pod \"iptables-alerter-b6rmr\" (UID: \"ce41d797-9a61-40d2-b9af-9389dfa485e0\") " pod="openshift-network-operator/iptables-alerter-b6rmr" Jun 09 15:14:22.838041 ip-10-0-130-232 kubenswrapper[2575]: I0609 15:14:22.836248 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/06bde064-62c0-4d6e-bc37-d0fe1e36a621-cni-binary-copy\") pod \"multus-cxbrv\" (UID: \"06bde064-62c0-4d6e-bc37-d0fe1e36a621\") " pod="openshift-multus/multus-cxbrv" Jun 09 15:14:22.838041 ip-10-0-130-232 kubenswrapper[2575]: I0609 15:14:22.836256 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/7e7b605f-1171-42e1-87cf-4bd1c06eb53e-host-slash\") pod \"ovnkube-node-lb2zn\" (UID: \"7e7b605f-1171-42e1-87cf-4bd1c06eb53e\") " pod="openshift-ovn-kubernetes/ovnkube-node-lb2zn" Jun 09 15:14:22.838041 ip-10-0-130-232 kubenswrapper[2575]: I0609 15:14:22.836281 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/7e7b605f-1171-42e1-87cf-4bd1c06eb53e-node-log\") pod \"ovnkube-node-lb2zn\" (UID: \"7e7b605f-1171-42e1-87cf-4bd1c06eb53e\") " pod="openshift-ovn-kubernetes/ovnkube-node-lb2zn" Jun 09 15:14:22.838041 ip-10-0-130-232 kubenswrapper[2575]: I0609 15:14:22.836307 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/0ee786d7-9e46-4cf0-add7-db4ff254d57b-kubelet-config\") pod \"global-pull-secret-syncer-2k4nl\" (UID: \"0ee786d7-9e46-4cf0-add7-db4ff254d57b\") " pod="kube-system/global-pull-secret-syncer-2k4nl" Jun 09 15:14:22.838041 ip-10-0-130-232 kubenswrapper[2575]: I0609 15:14:22.836309 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/06bde064-62c0-4d6e-bc37-d0fe1e36a621-host-var-lib-kubelet\") pod \"multus-cxbrv\" (UID: \"06bde064-62c0-4d6e-bc37-d0fe1e36a621\") " pod="openshift-multus/multus-cxbrv" Jun 09 15:14:22.838041 ip-10-0-130-232 kubenswrapper[2575]: E0609 15:14:22.836317 2575 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jun 09 15:14:22.838041 ip-10-0-130-232 kubenswrapper[2575]: I0609 15:14:22.836332 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-66zm7\" (UniqueName: \"kubernetes.io/projected/a687cfa5-1e89-4fbf-b17d-11f2778c632f-kube-api-access-66zm7\") pod \"node-resolver-s44r8\" (UID: \"a687cfa5-1e89-4fbf-b17d-11f2778c632f\") " pod="openshift-dns/node-resolver-s44r8" Jun 09 15:14:22.838041 ip-10-0-130-232 kubenswrapper[2575]: I0609 15:14:22.835917 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/06bde064-62c0-4d6e-bc37-d0fe1e36a621-host-var-lib-cni-bin\") pod \"multus-cxbrv\" (UID: \"06bde064-62c0-4d6e-bc37-d0fe1e36a621\") " pod="openshift-multus/multus-cxbrv" Jun 09 15:14:22.838041 ip-10-0-130-232 kubenswrapper[2575]: I0609 15:14:22.836360 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-scpvt\" (UniqueName: \"kubernetes.io/projected/7e7b605f-1171-42e1-87cf-4bd1c06eb53e-kube-api-access-scpvt\") pod \"ovnkube-node-lb2zn\" (UID: \"7e7b605f-1171-42e1-87cf-4bd1c06eb53e\") " pod="openshift-ovn-kubernetes/ovnkube-node-lb2zn" Jun 09 15:14:22.838908 ip-10-0-130-232 kubenswrapper[2575]: I0609 15:14:22.836362 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/7e7b605f-1171-42e1-87cf-4bd1c06eb53e-host-slash\") pod \"ovnkube-node-lb2zn\" (UID: \"7e7b605f-1171-42e1-87cf-4bd1c06eb53e\") " pod="openshift-ovn-kubernetes/ovnkube-node-lb2zn" Jun 09 15:14:22.838908 ip-10-0-130-232 kubenswrapper[2575]: E0609 15:14:22.836378 2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/0ee786d7-9e46-4cf0-add7-db4ff254d57b-original-pull-secret podName:0ee786d7-9e46-4cf0-add7-db4ff254d57b nodeName:}" failed. No retries permitted until 2026-06-09 15:14:23.336352368 +0000 UTC m=+3.024357801 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/0ee786d7-9e46-4cf0-add7-db4ff254d57b-original-pull-secret") pod "global-pull-secret-syncer-2k4nl" (UID: "0ee786d7-9e46-4cf0-add7-db4ff254d57b") : object "kube-system"/"original-pull-secret" not registered Jun 09 15:14:22.838908 ip-10-0-130-232 kubenswrapper[2575]: I0609 15:14:22.836385 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/06bde064-62c0-4d6e-bc37-d0fe1e36a621-host-run-netns\") pod \"multus-cxbrv\" (UID: \"06bde064-62c0-4d6e-bc37-d0fe1e36a621\") " pod="openshift-multus/multus-cxbrv" Jun 09 15:14:22.838908 ip-10-0-130-232 kubenswrapper[2575]: I0609 15:14:22.836407 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/7e7b605f-1171-42e1-87cf-4bd1c06eb53e-ovnkube-config\") pod \"ovnkube-node-lb2zn\" (UID: \"7e7b605f-1171-42e1-87cf-4bd1c06eb53e\") " pod="openshift-ovn-kubernetes/ovnkube-node-lb2zn" Jun 09 15:14:22.838908 ip-10-0-130-232 kubenswrapper[2575]: I0609 15:14:22.836419 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/06bde064-62c0-4d6e-bc37-d0fe1e36a621-host-run-k8s-cni-cncf-io\") pod \"multus-cxbrv\" (UID: \"06bde064-62c0-4d6e-bc37-d0fe1e36a621\") " pod="openshift-multus/multus-cxbrv" Jun 09 15:14:22.838908 ip-10-0-130-232 kubenswrapper[2575]: I0609 15:14:22.836438 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/0ee786d7-9e46-4cf0-add7-db4ff254d57b-kubelet-config\") pod \"global-pull-secret-syncer-2k4nl\" (UID: \"0ee786d7-9e46-4cf0-add7-db4ff254d57b\") " pod="kube-system/global-pull-secret-syncer-2k4nl" Jun 09 15:14:22.838908 ip-10-0-130-232 kubenswrapper[2575]: I0609 15:14:22.836461 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/06bde064-62c0-4d6e-bc37-d0fe1e36a621-host-run-k8s-cni-cncf-io\") pod \"multus-cxbrv\" (UID: \"06bde064-62c0-4d6e-bc37-d0fe1e36a621\") " pod="openshift-multus/multus-cxbrv" Jun 09 15:14:22.838908 ip-10-0-130-232 kubenswrapper[2575]: I0609 15:14:22.836478 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/7e7b605f-1171-42e1-87cf-4bd1c06eb53e-node-log\") pod \"ovnkube-node-lb2zn\" (UID: \"7e7b605f-1171-42e1-87cf-4bd1c06eb53e\") " pod="openshift-ovn-kubernetes/ovnkube-node-lb2zn" Jun 09 15:14:22.838908 ip-10-0-130-232 kubenswrapper[2575]: I0609 15:14:22.836499 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/a687cfa5-1e89-4fbf-b17d-11f2778c632f-tmp-dir\") pod \"node-resolver-s44r8\" (UID: \"a687cfa5-1e89-4fbf-b17d-11f2778c632f\") " pod="openshift-dns/node-resolver-s44r8" Jun 09 15:14:22.838908 ip-10-0-130-232 kubenswrapper[2575]: I0609 15:14:22.836514 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/1982d388-abfa-4d4b-a126-34c01f86521d-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-knt8p\" (UID: \"1982d388-abfa-4d4b-a126-34c01f86521d\") " pod="openshift-multus/multus-additional-cni-plugins-knt8p" Jun 09 15:14:22.838908 ip-10-0-130-232 kubenswrapper[2575]: I0609 15:14:22.836568 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/7e7b605f-1171-42e1-87cf-4bd1c06eb53e-systemd-units\") pod \"ovnkube-node-lb2zn\" (UID: \"7e7b605f-1171-42e1-87cf-4bd1c06eb53e\") " pod="openshift-ovn-kubernetes/ovnkube-node-lb2zn" Jun 09 15:14:22.838908 ip-10-0-130-232 kubenswrapper[2575]: I0609 15:14:22.836601 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/ce41d797-9a61-40d2-b9af-9389dfa485e0-iptables-alerter-script\") pod \"iptables-alerter-b6rmr\" (UID: \"ce41d797-9a61-40d2-b9af-9389dfa485e0\") " pod="openshift-network-operator/iptables-alerter-b6rmr" Jun 09 15:14:22.838908 ip-10-0-130-232 kubenswrapper[2575]: I0609 15:14:22.836623 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/7e7b605f-1171-42e1-87cf-4bd1c06eb53e-systemd-units\") pod \"ovnkube-node-lb2zn\" (UID: \"7e7b605f-1171-42e1-87cf-4bd1c06eb53e\") " pod="openshift-ovn-kubernetes/ovnkube-node-lb2zn" Jun 09 15:14:22.838908 ip-10-0-130-232 kubenswrapper[2575]: I0609 15:14:22.836627 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/b3301a95-a57b-4095-a43b-2594d8876877-sys-fs\") pod \"aws-ebs-csi-driver-node-w7xqz\" (UID: \"b3301a95-a57b-4095-a43b-2594d8876877\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-w7xqz" Jun 09 15:14:22.838908 ip-10-0-130-232 kubenswrapper[2575]: I0609 15:14:22.836657 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/7e7b605f-1171-42e1-87cf-4bd1c06eb53e-host-kubelet\") pod \"ovnkube-node-lb2zn\" (UID: \"7e7b605f-1171-42e1-87cf-4bd1c06eb53e\") " pod="openshift-ovn-kubernetes/ovnkube-node-lb2zn" Jun 09 15:14:22.838908 ip-10-0-130-232 kubenswrapper[2575]: I0609 15:14:22.836669 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/b3301a95-a57b-4095-a43b-2594d8876877-sys-fs\") pod \"aws-ebs-csi-driver-node-w7xqz\" (UID: \"b3301a95-a57b-4095-a43b-2594d8876877\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-w7xqz" Jun 09 15:14:22.838908 ip-10-0-130-232 kubenswrapper[2575]: I0609 15:14:22.836680 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/7e7b605f-1171-42e1-87cf-4bd1c06eb53e-host-cni-bin\") pod \"ovnkube-node-lb2zn\" (UID: \"7e7b605f-1171-42e1-87cf-4bd1c06eb53e\") " pod="openshift-ovn-kubernetes/ovnkube-node-lb2zn" Jun 09 15:14:22.839469 ip-10-0-130-232 kubenswrapper[2575]: I0609 15:14:22.836703 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/41532b1e-300d-4a9e-a64f-da302213062c-agent-certs\") pod \"konnectivity-agent-2bkzp\" (UID: \"41532b1e-300d-4a9e-a64f-da302213062c\") " pod="kube-system/konnectivity-agent-2bkzp" Jun 09 15:14:22.839469 ip-10-0-130-232 kubenswrapper[2575]: I0609 15:14:22.836708 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/7e7b605f-1171-42e1-87cf-4bd1c06eb53e-host-kubelet\") pod \"ovnkube-node-lb2zn\" (UID: \"7e7b605f-1171-42e1-87cf-4bd1c06eb53e\") " pod="openshift-ovn-kubernetes/ovnkube-node-lb2zn" Jun 09 15:14:22.839469 ip-10-0-130-232 kubenswrapper[2575]: I0609 15:14:22.836755 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/7e7b605f-1171-42e1-87cf-4bd1c06eb53e-host-cni-bin\") pod \"ovnkube-node-lb2zn\" (UID: \"7e7b605f-1171-42e1-87cf-4bd1c06eb53e\") " pod="openshift-ovn-kubernetes/ovnkube-node-lb2zn" Jun 09 15:14:22.839469 ip-10-0-130-232 kubenswrapper[2575]: I0609 15:14:22.836790 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/06bde064-62c0-4d6e-bc37-d0fe1e36a621-system-cni-dir\") pod \"multus-cxbrv\" (UID: \"06bde064-62c0-4d6e-bc37-d0fe1e36a621\") " pod="openshift-multus/multus-cxbrv" Jun 09 15:14:22.839469 ip-10-0-130-232 kubenswrapper[2575]: I0609 15:14:22.836818 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/06bde064-62c0-4d6e-bc37-d0fe1e36a621-multus-cni-dir\") pod \"multus-cxbrv\" (UID: \"06bde064-62c0-4d6e-bc37-d0fe1e36a621\") " pod="openshift-multus/multus-cxbrv" Jun 09 15:14:22.839469 ip-10-0-130-232 kubenswrapper[2575]: I0609 15:14:22.836862 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/06bde064-62c0-4d6e-bc37-d0fe1e36a621-host-var-lib-cni-multus\") pod \"multus-cxbrv\" (UID: \"06bde064-62c0-4d6e-bc37-d0fe1e36a621\") " pod="openshift-multus/multus-cxbrv" Jun 09 15:14:22.839469 ip-10-0-130-232 kubenswrapper[2575]: I0609 15:14:22.836883 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/06bde064-62c0-4d6e-bc37-d0fe1e36a621-multus-daemon-config\") pod \"multus-cxbrv\" (UID: \"06bde064-62c0-4d6e-bc37-d0fe1e36a621\") " pod="openshift-multus/multus-cxbrv" Jun 09 15:14:22.839469 ip-10-0-130-232 kubenswrapper[2575]: I0609 15:14:22.836907 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/1982d388-abfa-4d4b-a126-34c01f86521d-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-knt8p\" (UID: \"1982d388-abfa-4d4b-a126-34c01f86521d\") " pod="openshift-multus/multus-additional-cni-plugins-knt8p" Jun 09 15:14:22.839469 ip-10-0-130-232 kubenswrapper[2575]: I0609 15:14:22.836908 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/06bde064-62c0-4d6e-bc37-d0fe1e36a621-system-cni-dir\") pod \"multus-cxbrv\" (UID: \"06bde064-62c0-4d6e-bc37-d0fe1e36a621\") " pod="openshift-multus/multus-cxbrv" Jun 09 15:14:22.839469 ip-10-0-130-232 kubenswrapper[2575]: I0609 15:14:22.836928 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/06bde064-62c0-4d6e-bc37-d0fe1e36a621-multus-cni-dir\") pod \"multus-cxbrv\" (UID: \"06bde064-62c0-4d6e-bc37-d0fe1e36a621\") " pod="openshift-multus/multus-cxbrv" Jun 09 15:14:22.839469 ip-10-0-130-232 kubenswrapper[2575]: I0609 15:14:22.836948 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/06bde064-62c0-4d6e-bc37-d0fe1e36a621-host-var-lib-cni-multus\") pod \"multus-cxbrv\" (UID: \"06bde064-62c0-4d6e-bc37-d0fe1e36a621\") " pod="openshift-multus/multus-cxbrv" Jun 09 15:14:22.839469 ip-10-0-130-232 kubenswrapper[2575]: I0609 15:14:22.836970 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/1982d388-abfa-4d4b-a126-34c01f86521d-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-knt8p\" (UID: \"1982d388-abfa-4d4b-a126-34c01f86521d\") " pod="openshift-multus/multus-additional-cni-plugins-knt8p" Jun 09 15:14:22.839469 ip-10-0-130-232 kubenswrapper[2575]: I0609 15:14:22.836983 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/7e7b605f-1171-42e1-87cf-4bd1c06eb53e-host-cni-netd\") pod \"ovnkube-node-lb2zn\" (UID: \"7e7b605f-1171-42e1-87cf-4bd1c06eb53e\") " pod="openshift-ovn-kubernetes/ovnkube-node-lb2zn" Jun 09 15:14:22.839469 ip-10-0-130-232 kubenswrapper[2575]: I0609 15:14:22.837019 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/06bde064-62c0-4d6e-bc37-d0fe1e36a621-cnibin\") pod \"multus-cxbrv\" (UID: \"06bde064-62c0-4d6e-bc37-d0fe1e36a621\") " pod="openshift-multus/multus-cxbrv" Jun 09 15:14:22.839469 ip-10-0-130-232 kubenswrapper[2575]: I0609 15:14:22.837084 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/7e7b605f-1171-42e1-87cf-4bd1c06eb53e-host-cni-netd\") pod \"ovnkube-node-lb2zn\" (UID: \"7e7b605f-1171-42e1-87cf-4bd1c06eb53e\") " pod="openshift-ovn-kubernetes/ovnkube-node-lb2zn" Jun 09 15:14:22.839469 ip-10-0-130-232 kubenswrapper[2575]: I0609 15:14:22.837104 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/06bde064-62c0-4d6e-bc37-d0fe1e36a621-cnibin\") pod \"multus-cxbrv\" (UID: \"06bde064-62c0-4d6e-bc37-d0fe1e36a621\") " pod="openshift-multus/multus-cxbrv" Jun 09 15:14:22.839469 ip-10-0-130-232 kubenswrapper[2575]: I0609 15:14:22.837271 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/06bde064-62c0-4d6e-bc37-d0fe1e36a621-multus-daemon-config\") pod \"multus-cxbrv\" (UID: \"06bde064-62c0-4d6e-bc37-d0fe1e36a621\") " pod="openshift-multus/multus-cxbrv" Jun 09 15:14:22.839469 ip-10-0-130-232 kubenswrapper[2575]: I0609 15:14:22.837380 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/1982d388-abfa-4d4b-a126-34c01f86521d-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-knt8p\" (UID: \"1982d388-abfa-4d4b-a126-34c01f86521d\") " pod="openshift-multus/multus-additional-cni-plugins-knt8p" Jun 09 15:14:22.839987 ip-10-0-130-232 kubenswrapper[2575]: I0609 15:14:22.837881 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/ce41d797-9a61-40d2-b9af-9389dfa485e0-iptables-alerter-script\") pod \"iptables-alerter-b6rmr\" (UID: \"ce41d797-9a61-40d2-b9af-9389dfa485e0\") " pod="openshift-network-operator/iptables-alerter-b6rmr" Jun 09 15:14:22.839987 ip-10-0-130-232 kubenswrapper[2575]: I0609 15:14:22.838997 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/7e7b605f-1171-42e1-87cf-4bd1c06eb53e-ovn-node-metrics-cert\") pod \"ovnkube-node-lb2zn\" (UID: \"7e7b605f-1171-42e1-87cf-4bd1c06eb53e\") " pod="openshift-ovn-kubernetes/ovnkube-node-lb2zn" Jun 09 15:14:22.839987 ip-10-0-130-232 kubenswrapper[2575]: I0609 15:14:22.839384 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/41532b1e-300d-4a9e-a64f-da302213062c-agent-certs\") pod \"konnectivity-agent-2bkzp\" (UID: \"41532b1e-300d-4a9e-a64f-da302213062c\") " pod="kube-system/konnectivity-agent-2bkzp" Jun 09 15:14:22.845371 ip-10-0-130-232 kubenswrapper[2575]: I0609 15:14:22.845058 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-dz2t6\" (UniqueName: \"kubernetes.io/projected/ce41d797-9a61-40d2-b9af-9389dfa485e0-kube-api-access-dz2t6\") pod \"iptables-alerter-b6rmr\" (UID: \"ce41d797-9a61-40d2-b9af-9389dfa485e0\") " pod="openshift-network-operator/iptables-alerter-b6rmr" Jun 09 15:14:22.847377 ip-10-0-130-232 kubenswrapper[2575]: I0609 15:14:22.847055 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-scpvt\" (UniqueName: \"kubernetes.io/projected/7e7b605f-1171-42e1-87cf-4bd1c06eb53e-kube-api-access-scpvt\") pod \"ovnkube-node-lb2zn\" (UID: \"7e7b605f-1171-42e1-87cf-4bd1c06eb53e\") " pod="openshift-ovn-kubernetes/ovnkube-node-lb2zn" Jun 09 15:14:22.847377 ip-10-0-130-232 kubenswrapper[2575]: I0609 15:14:22.847209 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-ddwb5\" (UniqueName: \"kubernetes.io/projected/1982d388-abfa-4d4b-a126-34c01f86521d-kube-api-access-ddwb5\") pod \"multus-additional-cni-plugins-knt8p\" (UID: \"1982d388-abfa-4d4b-a126-34c01f86521d\") " pod="openshift-multus/multus-additional-cni-plugins-knt8p" Jun 09 15:14:22.847377 ip-10-0-130-232 kubenswrapper[2575]: I0609 15:14:22.847335 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-s7d6d\" (UniqueName: \"kubernetes.io/projected/06bde064-62c0-4d6e-bc37-d0fe1e36a621-kube-api-access-s7d6d\") pod \"multus-cxbrv\" (UID: \"06bde064-62c0-4d6e-bc37-d0fe1e36a621\") " pod="openshift-multus/multus-cxbrv" Jun 09 15:14:22.847601 ip-10-0-130-232 kubenswrapper[2575]: I0609 15:14:22.847586 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-66zm7\" (UniqueName: \"kubernetes.io/projected/a687cfa5-1e89-4fbf-b17d-11f2778c632f-kube-api-access-66zm7\") pod \"node-resolver-s44r8\" (UID: \"a687cfa5-1e89-4fbf-b17d-11f2778c632f\") " pod="openshift-dns/node-resolver-s44r8" Jun 09 15:14:22.847945 ip-10-0-130-232 kubenswrapper[2575]: I0609 15:14:22.847924 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-txksn\" (UniqueName: \"kubernetes.io/projected/b3301a95-a57b-4095-a43b-2594d8876877-kube-api-access-txksn\") pod \"aws-ebs-csi-driver-node-w7xqz\" (UID: \"b3301a95-a57b-4095-a43b-2594d8876877\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-w7xqz" Jun 09 15:14:22.931817 ip-10-0-130-232 kubenswrapper[2575]: I0609 15:14:22.931750 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-p4lk5" Jun 09 15:14:22.944823 ip-10-0-130-232 kubenswrapper[2575]: I0609 15:14:22.944803 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-9shqx" Jun 09 15:14:22.954490 ip-10-0-130-232 kubenswrapper[2575]: I0609 15:14:22.954472 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-knt8p" Jun 09 15:14:22.960046 ip-10-0-130-232 kubenswrapper[2575]: I0609 15:14:22.960028 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-s44r8" Jun 09 15:14:22.969634 ip-10-0-130-232 kubenswrapper[2575]: I0609 15:14:22.969616 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-lb2zn" Jun 09 15:14:22.975161 ip-10-0-130-232 kubenswrapper[2575]: I0609 15:14:22.975143 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-w7xqz" Jun 09 15:14:22.981726 ip-10-0-130-232 kubenswrapper[2575]: I0609 15:14:22.981707 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-cxbrv" Jun 09 15:14:22.988170 ip-10-0-130-232 kubenswrapper[2575]: I0609 15:14:22.988151 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-2bkzp" Jun 09 15:14:22.993630 ip-10-0-130-232 kubenswrapper[2575]: I0609 15:14:22.993613 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-b6rmr" Jun 09 15:14:23.239497 ip-10-0-130-232 kubenswrapper[2575]: I0609 15:14:23.239436 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-dmj2n\" (UniqueName: \"kubernetes.io/projected/e519f3d3-552b-482d-88b5-74b1d17e3bce-kube-api-access-dmj2n\") pod \"network-check-target-bbf2c\" (UID: \"e519f3d3-552b-482d-88b5-74b1d17e3bce\") " pod="openshift-network-diagnostics/network-check-target-bbf2c" Jun 09 15:14:23.239497 ip-10-0-130-232 kubenswrapper[2575]: I0609 15:14:23.239493 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/8eda6a9f-b4cc-403f-a284-8a9cd10e8f15-metrics-certs\") pod \"network-metrics-daemon-5bg45\" (UID: \"8eda6a9f-b4cc-403f-a284-8a9cd10e8f15\") " pod="openshift-multus/network-metrics-daemon-5bg45" Jun 09 15:14:23.239671 ip-10-0-130-232 kubenswrapper[2575]: E0609 15:14:23.239588 2575 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jun 09 15:14:23.239671 ip-10-0-130-232 kubenswrapper[2575]: E0609 15:14:23.239591 2575 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jun 09 15:14:23.239671 ip-10-0-130-232 kubenswrapper[2575]: E0609 15:14:23.239613 2575 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jun 09 15:14:23.239671 ip-10-0-130-232 kubenswrapper[2575]: E0609 15:14:23.239622 2575 projected.go:196] Error preparing data for projected volume kube-api-access-dmj2n for pod openshift-network-diagnostics/network-check-target-bbf2c: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 09 15:14:23.239671 ip-10-0-130-232 kubenswrapper[2575]: E0609 15:14:23.239653 2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/8eda6a9f-b4cc-403f-a284-8a9cd10e8f15-metrics-certs podName:8eda6a9f-b4cc-403f-a284-8a9cd10e8f15 nodeName:}" failed. No retries permitted until 2026-06-09 15:14:24.239633081 +0000 UTC m=+3.927638527 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/8eda6a9f-b4cc-403f-a284-8a9cd10e8f15-metrics-certs") pod "network-metrics-daemon-5bg45" (UID: "8eda6a9f-b4cc-403f-a284-8a9cd10e8f15") : object "openshift-multus"/"metrics-daemon-secret" not registered Jun 09 15:14:23.239817 ip-10-0-130-232 kubenswrapper[2575]: E0609 15:14:23.239706 2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/e519f3d3-552b-482d-88b5-74b1d17e3bce-kube-api-access-dmj2n podName:e519f3d3-552b-482d-88b5-74b1d17e3bce nodeName:}" failed. No retries permitted until 2026-06-09 15:14:24.23967863 +0000 UTC m=+3.927684061 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-api-access-dmj2n" (UniqueName: "kubernetes.io/projected/e519f3d3-552b-482d-88b5-74b1d17e3bce-kube-api-access-dmj2n") pod "network-check-target-bbf2c" (UID: "e519f3d3-552b-482d-88b5-74b1d17e3bce") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 09 15:14:23.340409 ip-10-0-130-232 kubenswrapper[2575]: I0609 15:14:23.340376 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/0ee786d7-9e46-4cf0-add7-db4ff254d57b-original-pull-secret\") pod \"global-pull-secret-syncer-2k4nl\" (UID: \"0ee786d7-9e46-4cf0-add7-db4ff254d57b\") " pod="kube-system/global-pull-secret-syncer-2k4nl" Jun 09 15:14:23.340577 ip-10-0-130-232 kubenswrapper[2575]: E0609 15:14:23.340526 2575 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jun 09 15:14:23.340651 ip-10-0-130-232 kubenswrapper[2575]: E0609 15:14:23.340581 2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/0ee786d7-9e46-4cf0-add7-db4ff254d57b-original-pull-secret podName:0ee786d7-9e46-4cf0-add7-db4ff254d57b nodeName:}" failed. No retries permitted until 2026-06-09 15:14:24.340565492 +0000 UTC m=+4.028570935 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/0ee786d7-9e46-4cf0-add7-db4ff254d57b-original-pull-secret") pod "global-pull-secret-syncer-2k4nl" (UID: "0ee786d7-9e46-4cf0-add7-db4ff254d57b") : object "kube-system"/"original-pull-secret" not registered Jun 09 15:14:23.535721 ip-10-0-130-232 kubenswrapper[2575]: W0609 15:14:23.535604 2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb3301a95_a57b_4095_a43b_2594d8876877.slice/crio-86d0858f9e4eee7d7710c901448314cbdf759bf427791967aeca3d6727b2c42d WatchSource:0}: Error finding container 86d0858f9e4eee7d7710c901448314cbdf759bf427791967aeca3d6727b2c42d: Status 404 returned error can't find the container with id 86d0858f9e4eee7d7710c901448314cbdf759bf427791967aeca3d6727b2c42d Jun 09 15:14:23.538399 ip-10-0-130-232 kubenswrapper[2575]: W0609 15:14:23.538373 2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1982d388_abfa_4d4b_a126_34c01f86521d.slice/crio-216162a02abd275184bcdaf1462c9a9d2a49276e496ef0a888acd5a4235e48f5 WatchSource:0}: Error finding container 216162a02abd275184bcdaf1462c9a9d2a49276e496ef0a888acd5a4235e48f5: Status 404 returned error can't find the container with id 216162a02abd275184bcdaf1462c9a9d2a49276e496ef0a888acd5a4235e48f5 Jun 09 15:14:23.541177 ip-10-0-130-232 kubenswrapper[2575]: W0609 15:14:23.541154 2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod41532b1e_300d_4a9e_a64f_da302213062c.slice/crio-443fab764216c74fa9c5f47fb3368c42bf034acd6ca3255d752defbbea836432 WatchSource:0}: Error finding container 443fab764216c74fa9c5f47fb3368c42bf034acd6ca3255d752defbbea836432: Status 404 returned error can't find the container with id 443fab764216c74fa9c5f47fb3368c42bf034acd6ca3255d752defbbea836432 Jun 09 15:14:23.545031 ip-10-0-130-232 kubenswrapper[2575]: W0609 15:14:23.544971 2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podce41d797_9a61_40d2_b9af_9389dfa485e0.slice/crio-7cae730b82a775bc023201a236a898cfe75cd53b17f9c94bdd7c26768726e8a9 WatchSource:0}: Error finding container 7cae730b82a775bc023201a236a898cfe75cd53b17f9c94bdd7c26768726e8a9: Status 404 returned error can't find the container with id 7cae730b82a775bc023201a236a898cfe75cd53b17f9c94bdd7c26768726e8a9 Jun 09 15:14:23.545832 ip-10-0-130-232 kubenswrapper[2575]: W0609 15:14:23.545808 2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7e7b605f_1171_42e1_87cf_4bd1c06eb53e.slice/crio-88e65a7a0a46a1d706241a488df8f85e6f27d07f9e6ecf873271dd3d5de7629b WatchSource:0}: Error finding container 88e65a7a0a46a1d706241a488df8f85e6f27d07f9e6ecf873271dd3d5de7629b: Status 404 returned error can't find the container with id 88e65a7a0a46a1d706241a488df8f85e6f27d07f9e6ecf873271dd3d5de7629b Jun 09 15:14:23.567301 ip-10-0-130-232 kubenswrapper[2575]: W0609 15:14:23.567281 2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod06bde064_62c0_4d6e_bc37_d0fe1e36a621.slice/crio-1f0ce17294ec406d7aee85899ceca5dc1eae4e7e5cc75841d42018ee2b7e6d1b WatchSource:0}: Error finding container 1f0ce17294ec406d7aee85899ceca5dc1eae4e7e5cc75841d42018ee2b7e6d1b: Status 404 returned error can't find the container with id 1f0ce17294ec406d7aee85899ceca5dc1eae4e7e5cc75841d42018ee2b7e6d1b Jun 09 15:14:23.568221 ip-10-0-130-232 kubenswrapper[2575]: W0609 15:14:23.568198 2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf466d0e4_e80c_4930_a9ef_1c709b262d2b.slice/crio-7dde75f4a3418a02cf81c612e83c47145000103eb09f9f95d0291608fe0555fa WatchSource:0}: Error finding container 7dde75f4a3418a02cf81c612e83c47145000103eb09f9f95d0291608fe0555fa: Status 404 returned error can't find the container with id 7dde75f4a3418a02cf81c612e83c47145000103eb09f9f95d0291608fe0555fa Jun 09 15:14:23.568947 ip-10-0-130-232 kubenswrapper[2575]: W0609 15:14:23.568762 2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod146ee641_079b_4c92_8b48_7449e59f82b3.slice/crio-705918f9a5fd999380c7e16bffccd65928bee53fd4eeb044596cff39c8de603b WatchSource:0}: Error finding container 705918f9a5fd999380c7e16bffccd65928bee53fd4eeb044596cff39c8de603b: Status 404 returned error can't find the container with id 705918f9a5fd999380c7e16bffccd65928bee53fd4eeb044596cff39c8de603b Jun 09 15:14:23.659548 ip-10-0-130-232 kubenswrapper[2575]: I0609 15:14:23.659370 2575 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-06-08 15:09:22 +0000 UTC" deadline="2027-11-26 07:55:41.202960195 +0000 UTC" Jun 09 15:14:23.659919 ip-10-0-130-232 kubenswrapper[2575]: I0609 15:14:23.659552 2575 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="12832h41m17.54341463s" Jun 09 15:14:23.699794 ip-10-0-130-232 kubenswrapper[2575]: I0609 15:14:23.699760 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-p4lk5" event={"ID":"f466d0e4-e80c-4930-a9ef-1c709b262d2b","Type":"ContainerStarted","Data":"7dde75f4a3418a02cf81c612e83c47145000103eb09f9f95d0291608fe0555fa"} Jun 09 15:14:23.700804 ip-10-0-130-232 kubenswrapper[2575]: I0609 15:14:23.700780 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-lb2zn" event={"ID":"7e7b605f-1171-42e1-87cf-4bd1c06eb53e","Type":"ContainerStarted","Data":"88e65a7a0a46a1d706241a488df8f85e6f27d07f9e6ecf873271dd3d5de7629b"} Jun 09 15:14:23.704704 ip-10-0-130-232 kubenswrapper[2575]: I0609 15:14:23.704679 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-b6rmr" event={"ID":"ce41d797-9a61-40d2-b9af-9389dfa485e0","Type":"ContainerStarted","Data":"7cae730b82a775bc023201a236a898cfe75cd53b17f9c94bdd7c26768726e8a9"} Jun 09 15:14:23.705674 ip-10-0-130-232 kubenswrapper[2575]: I0609 15:14:23.705654 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-2bkzp" event={"ID":"41532b1e-300d-4a9e-a64f-da302213062c","Type":"ContainerStarted","Data":"443fab764216c74fa9c5f47fb3368c42bf034acd6ca3255d752defbbea836432"} Jun 09 15:14:23.706663 ip-10-0-130-232 kubenswrapper[2575]: I0609 15:14:23.706639 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-knt8p" event={"ID":"1982d388-abfa-4d4b-a126-34c01f86521d","Type":"ContainerStarted","Data":"216162a02abd275184bcdaf1462c9a9d2a49276e496ef0a888acd5a4235e48f5"} Jun 09 15:14:23.707617 ip-10-0-130-232 kubenswrapper[2575]: I0609 15:14:23.707597 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-w7xqz" event={"ID":"b3301a95-a57b-4095-a43b-2594d8876877","Type":"ContainerStarted","Data":"86d0858f9e4eee7d7710c901448314cbdf759bf427791967aeca3d6727b2c42d"} Jun 09 15:14:23.709015 ip-10-0-130-232 kubenswrapper[2575]: I0609 15:14:23.708994 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-s44r8" event={"ID":"a687cfa5-1e89-4fbf-b17d-11f2778c632f","Type":"ContainerStarted","Data":"7b26b825fbb63d35b6b1a3f950e74ef7ba6285bf3691d9eb6d83ba16e755628e"} Jun 09 15:14:23.712167 ip-10-0-130-232 kubenswrapper[2575]: I0609 15:14:23.712140 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-cxbrv" event={"ID":"06bde064-62c0-4d6e-bc37-d0fe1e36a621","Type":"ContainerStarted","Data":"1f0ce17294ec406d7aee85899ceca5dc1eae4e7e5cc75841d42018ee2b7e6d1b"} Jun 09 15:14:23.714802 ip-10-0-130-232 kubenswrapper[2575]: I0609 15:14:23.714780 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-130-232.ec2.internal" event={"ID":"70d7652af04ab9bbf001d2e976e7ace2","Type":"ContainerStarted","Data":"21477287043e0c9e118f30f34b88974adec207ac130803e0e9f954ddfb29441a"} Jun 09 15:14:23.715937 ip-10-0-130-232 kubenswrapper[2575]: I0609 15:14:23.715919 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-9shqx" event={"ID":"146ee641-079b-4c92-8b48-7449e59f82b3","Type":"ContainerStarted","Data":"705918f9a5fd999380c7e16bffccd65928bee53fd4eeb044596cff39c8de603b"} Jun 09 15:14:23.727298 ip-10-0-130-232 kubenswrapper[2575]: I0609 15:14:23.727224 2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/kube-apiserver-proxy-ip-10-0-130-232.ec2.internal" podStartSLOduration=2.727208256 podStartE2EDuration="2.727208256s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-09 15:14:21 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-09 15:14:23.726472762 +0000 UTC m=+3.414478215" watchObservedRunningTime="2026-06-09 15:14:23.727208256 +0000 UTC m=+3.415213710" Jun 09 15:14:24.247081 ip-10-0-130-232 kubenswrapper[2575]: I0609 15:14:24.247041 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/8eda6a9f-b4cc-403f-a284-8a9cd10e8f15-metrics-certs\") pod \"network-metrics-daemon-5bg45\" (UID: \"8eda6a9f-b4cc-403f-a284-8a9cd10e8f15\") " pod="openshift-multus/network-metrics-daemon-5bg45" Jun 09 15:14:24.247258 ip-10-0-130-232 kubenswrapper[2575]: I0609 15:14:24.247110 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-dmj2n\" (UniqueName: \"kubernetes.io/projected/e519f3d3-552b-482d-88b5-74b1d17e3bce-kube-api-access-dmj2n\") pod \"network-check-target-bbf2c\" (UID: \"e519f3d3-552b-482d-88b5-74b1d17e3bce\") " pod="openshift-network-diagnostics/network-check-target-bbf2c" Jun 09 15:14:24.247315 ip-10-0-130-232 kubenswrapper[2575]: E0609 15:14:24.247256 2575 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jun 09 15:14:24.247315 ip-10-0-130-232 kubenswrapper[2575]: E0609 15:14:24.247272 2575 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jun 09 15:14:24.247315 ip-10-0-130-232 kubenswrapper[2575]: E0609 15:14:24.247284 2575 projected.go:196] Error preparing data for projected volume kube-api-access-dmj2n for pod openshift-network-diagnostics/network-check-target-bbf2c: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 09 15:14:24.247478 ip-10-0-130-232 kubenswrapper[2575]: E0609 15:14:24.247341 2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/e519f3d3-552b-482d-88b5-74b1d17e3bce-kube-api-access-dmj2n podName:e519f3d3-552b-482d-88b5-74b1d17e3bce nodeName:}" failed. No retries permitted until 2026-06-09 15:14:26.247323645 +0000 UTC m=+5.935329096 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-api-access-dmj2n" (UniqueName: "kubernetes.io/projected/e519f3d3-552b-482d-88b5-74b1d17e3bce-kube-api-access-dmj2n") pod "network-check-target-bbf2c" (UID: "e519f3d3-552b-482d-88b5-74b1d17e3bce") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 09 15:14:24.247478 ip-10-0-130-232 kubenswrapper[2575]: E0609 15:14:24.247407 2575 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jun 09 15:14:24.247478 ip-10-0-130-232 kubenswrapper[2575]: E0609 15:14:24.247437 2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/8eda6a9f-b4cc-403f-a284-8a9cd10e8f15-metrics-certs podName:8eda6a9f-b4cc-403f-a284-8a9cd10e8f15 nodeName:}" failed. No retries permitted until 2026-06-09 15:14:26.247426522 +0000 UTC m=+5.935431959 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/8eda6a9f-b4cc-403f-a284-8a9cd10e8f15-metrics-certs") pod "network-metrics-daemon-5bg45" (UID: "8eda6a9f-b4cc-403f-a284-8a9cd10e8f15") : object "openshift-multus"/"metrics-daemon-secret" not registered Jun 09 15:14:24.348154 ip-10-0-130-232 kubenswrapper[2575]: I0609 15:14:24.348110 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/0ee786d7-9e46-4cf0-add7-db4ff254d57b-original-pull-secret\") pod \"global-pull-secret-syncer-2k4nl\" (UID: \"0ee786d7-9e46-4cf0-add7-db4ff254d57b\") " pod="kube-system/global-pull-secret-syncer-2k4nl" Jun 09 15:14:24.348315 ip-10-0-130-232 kubenswrapper[2575]: E0609 15:14:24.348256 2575 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jun 09 15:14:24.348374 ip-10-0-130-232 kubenswrapper[2575]: E0609 15:14:24.348319 2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/0ee786d7-9e46-4cf0-add7-db4ff254d57b-original-pull-secret podName:0ee786d7-9e46-4cf0-add7-db4ff254d57b nodeName:}" failed. No retries permitted until 2026-06-09 15:14:26.348301435 +0000 UTC m=+6.036306869 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/0ee786d7-9e46-4cf0-add7-db4ff254d57b-original-pull-secret") pod "global-pull-secret-syncer-2k4nl" (UID: "0ee786d7-9e46-4cf0-add7-db4ff254d57b") : object "kube-system"/"original-pull-secret" not registered Jun 09 15:14:24.659833 ip-10-0-130-232 kubenswrapper[2575]: I0609 15:14:24.659691 2575 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-06-08 15:09:22 +0000 UTC" deadline="2028-01-31 06:39:00.698552656 +0000 UTC" Jun 09 15:14:24.659833 ip-10-0-130-232 kubenswrapper[2575]: I0609 15:14:24.659757 2575 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="14415h24m36.038800038s" Jun 09 15:14:24.691419 ip-10-0-130-232 kubenswrapper[2575]: I0609 15:14:24.690961 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-bbf2c" Jun 09 15:14:24.691419 ip-10-0-130-232 kubenswrapper[2575]: I0609 15:14:24.690974 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-2k4nl" Jun 09 15:14:24.691419 ip-10-0-130-232 kubenswrapper[2575]: E0609 15:14:24.691092 2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-bbf2c" podUID="e519f3d3-552b-482d-88b5-74b1d17e3bce" Jun 09 15:14:24.691419 ip-10-0-130-232 kubenswrapper[2575]: E0609 15:14:24.691156 2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-2k4nl" podUID="0ee786d7-9e46-4cf0-add7-db4ff254d57b" Jun 09 15:14:24.691419 ip-10-0-130-232 kubenswrapper[2575]: I0609 15:14:24.691228 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-5bg45" Jun 09 15:14:24.691419 ip-10-0-130-232 kubenswrapper[2575]: E0609 15:14:24.691362 2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-5bg45" podUID="8eda6a9f-b4cc-403f-a284-8a9cd10e8f15" Jun 09 15:14:24.723484 ip-10-0-130-232 kubenswrapper[2575]: I0609 15:14:24.723452 2575 generic.go:356] "Generic (PLEG): container finished" podID="117955a7b02385bc89d5ad20cc7019ff" containerID="d14473c2002dd0e5cd4aaf6c3fd93de11e0f4efde638c3e50b40aa58a0117f2b" exitCode=0 Jun 09 15:14:24.724343 ip-10-0-130-232 kubenswrapper[2575]: I0609 15:14:24.724317 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-130-232.ec2.internal" event={"ID":"117955a7b02385bc89d5ad20cc7019ff","Type":"ContainerDied","Data":"d14473c2002dd0e5cd4aaf6c3fd93de11e0f4efde638c3e50b40aa58a0117f2b"} Jun 09 15:14:25.744745 ip-10-0-130-232 kubenswrapper[2575]: I0609 15:14:25.744710 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-130-232.ec2.internal" event={"ID":"117955a7b02385bc89d5ad20cc7019ff","Type":"ContainerStarted","Data":"873509d8e3842089a1c1d2978f686a1c3cb7d0a8589264f624971ec707398f9e"} Jun 09 15:14:26.265187 ip-10-0-130-232 kubenswrapper[2575]: I0609 15:14:26.265148 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-dmj2n\" (UniqueName: \"kubernetes.io/projected/e519f3d3-552b-482d-88b5-74b1d17e3bce-kube-api-access-dmj2n\") pod \"network-check-target-bbf2c\" (UID: \"e519f3d3-552b-482d-88b5-74b1d17e3bce\") " pod="openshift-network-diagnostics/network-check-target-bbf2c" Jun 09 15:14:26.265342 ip-10-0-130-232 kubenswrapper[2575]: I0609 15:14:26.265241 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/8eda6a9f-b4cc-403f-a284-8a9cd10e8f15-metrics-certs\") pod \"network-metrics-daemon-5bg45\" (UID: \"8eda6a9f-b4cc-403f-a284-8a9cd10e8f15\") " pod="openshift-multus/network-metrics-daemon-5bg45" Jun 09 15:14:26.265415 ip-10-0-130-232 kubenswrapper[2575]: E0609 15:14:26.265367 2575 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jun 09 15:14:26.265468 ip-10-0-130-232 kubenswrapper[2575]: E0609 15:14:26.265423 2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/8eda6a9f-b4cc-403f-a284-8a9cd10e8f15-metrics-certs podName:8eda6a9f-b4cc-403f-a284-8a9cd10e8f15 nodeName:}" failed. No retries permitted until 2026-06-09 15:14:30.265404421 +0000 UTC m=+9.953409858 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/8eda6a9f-b4cc-403f-a284-8a9cd10e8f15-metrics-certs") pod "network-metrics-daemon-5bg45" (UID: "8eda6a9f-b4cc-403f-a284-8a9cd10e8f15") : object "openshift-multus"/"metrics-daemon-secret" not registered Jun 09 15:14:26.265930 ip-10-0-130-232 kubenswrapper[2575]: E0609 15:14:26.265864 2575 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jun 09 15:14:26.265930 ip-10-0-130-232 kubenswrapper[2575]: E0609 15:14:26.265890 2575 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jun 09 15:14:26.265930 ip-10-0-130-232 kubenswrapper[2575]: E0609 15:14:26.265904 2575 projected.go:196] Error preparing data for projected volume kube-api-access-dmj2n for pod openshift-network-diagnostics/network-check-target-bbf2c: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 09 15:14:26.266170 ip-10-0-130-232 kubenswrapper[2575]: E0609 15:14:26.265980 2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/e519f3d3-552b-482d-88b5-74b1d17e3bce-kube-api-access-dmj2n podName:e519f3d3-552b-482d-88b5-74b1d17e3bce nodeName:}" failed. No retries permitted until 2026-06-09 15:14:30.265963235 +0000 UTC m=+9.953968680 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-api-access-dmj2n" (UniqueName: "kubernetes.io/projected/e519f3d3-552b-482d-88b5-74b1d17e3bce-kube-api-access-dmj2n") pod "network-check-target-bbf2c" (UID: "e519f3d3-552b-482d-88b5-74b1d17e3bce") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 09 15:14:26.366553 ip-10-0-130-232 kubenswrapper[2575]: I0609 15:14:26.366468 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/0ee786d7-9e46-4cf0-add7-db4ff254d57b-original-pull-secret\") pod \"global-pull-secret-syncer-2k4nl\" (UID: \"0ee786d7-9e46-4cf0-add7-db4ff254d57b\") " pod="kube-system/global-pull-secret-syncer-2k4nl" Jun 09 15:14:26.366717 ip-10-0-130-232 kubenswrapper[2575]: E0609 15:14:26.366625 2575 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jun 09 15:14:26.366717 ip-10-0-130-232 kubenswrapper[2575]: E0609 15:14:26.366687 2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/0ee786d7-9e46-4cf0-add7-db4ff254d57b-original-pull-secret podName:0ee786d7-9e46-4cf0-add7-db4ff254d57b nodeName:}" failed. No retries permitted until 2026-06-09 15:14:30.366670525 +0000 UTC m=+10.054675976 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/0ee786d7-9e46-4cf0-add7-db4ff254d57b-original-pull-secret") pod "global-pull-secret-syncer-2k4nl" (UID: "0ee786d7-9e46-4cf0-add7-db4ff254d57b") : object "kube-system"/"original-pull-secret" not registered Jun 09 15:14:26.692535 ip-10-0-130-232 kubenswrapper[2575]: I0609 15:14:26.692458 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-bbf2c" Jun 09 15:14:26.692682 ip-10-0-130-232 kubenswrapper[2575]: E0609 15:14:26.692562 2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-bbf2c" podUID="e519f3d3-552b-482d-88b5-74b1d17e3bce" Jun 09 15:14:26.693205 ip-10-0-130-232 kubenswrapper[2575]: I0609 15:14:26.692885 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-2k4nl" Jun 09 15:14:26.693205 ip-10-0-130-232 kubenswrapper[2575]: E0609 15:14:26.692980 2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-2k4nl" podUID="0ee786d7-9e46-4cf0-add7-db4ff254d57b" Jun 09 15:14:26.693205 ip-10-0-130-232 kubenswrapper[2575]: I0609 15:14:26.693028 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-5bg45" Jun 09 15:14:26.693205 ip-10-0-130-232 kubenswrapper[2575]: E0609 15:14:26.693112 2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-5bg45" podUID="8eda6a9f-b4cc-403f-a284-8a9cd10e8f15" Jun 09 15:14:28.692060 ip-10-0-130-232 kubenswrapper[2575]: I0609 15:14:28.692026 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-bbf2c" Jun 09 15:14:28.692517 ip-10-0-130-232 kubenswrapper[2575]: E0609 15:14:28.692140 2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-bbf2c" podUID="e519f3d3-552b-482d-88b5-74b1d17e3bce" Jun 09 15:14:28.692582 ip-10-0-130-232 kubenswrapper[2575]: I0609 15:14:28.692547 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-2k4nl" Jun 09 15:14:28.692679 ip-10-0-130-232 kubenswrapper[2575]: E0609 15:14:28.692646 2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-2k4nl" podUID="0ee786d7-9e46-4cf0-add7-db4ff254d57b" Jun 09 15:14:28.692802 ip-10-0-130-232 kubenswrapper[2575]: I0609 15:14:28.692712 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-5bg45" Jun 09 15:14:28.692802 ip-10-0-130-232 kubenswrapper[2575]: E0609 15:14:28.692778 2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-5bg45" podUID="8eda6a9f-b4cc-403f-a284-8a9cd10e8f15" Jun 09 15:14:30.294666 ip-10-0-130-232 kubenswrapper[2575]: I0609 15:14:30.294633 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/8eda6a9f-b4cc-403f-a284-8a9cd10e8f15-metrics-certs\") pod \"network-metrics-daemon-5bg45\" (UID: \"8eda6a9f-b4cc-403f-a284-8a9cd10e8f15\") " pod="openshift-multus/network-metrics-daemon-5bg45" Jun 09 15:14:30.295078 ip-10-0-130-232 kubenswrapper[2575]: I0609 15:14:30.294683 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-dmj2n\" (UniqueName: \"kubernetes.io/projected/e519f3d3-552b-482d-88b5-74b1d17e3bce-kube-api-access-dmj2n\") pod \"network-check-target-bbf2c\" (UID: \"e519f3d3-552b-482d-88b5-74b1d17e3bce\") " pod="openshift-network-diagnostics/network-check-target-bbf2c" Jun 09 15:14:30.295078 ip-10-0-130-232 kubenswrapper[2575]: E0609 15:14:30.294808 2575 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jun 09 15:14:30.295078 ip-10-0-130-232 kubenswrapper[2575]: E0609 15:14:30.294835 2575 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jun 09 15:14:30.295078 ip-10-0-130-232 kubenswrapper[2575]: E0609 15:14:30.294871 2575 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jun 09 15:14:30.295078 ip-10-0-130-232 kubenswrapper[2575]: E0609 15:14:30.294884 2575 projected.go:196] Error preparing data for projected volume kube-api-access-dmj2n for pod openshift-network-diagnostics/network-check-target-bbf2c: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 09 15:14:30.295078 ip-10-0-130-232 kubenswrapper[2575]: E0609 15:14:30.294899 2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/8eda6a9f-b4cc-403f-a284-8a9cd10e8f15-metrics-certs podName:8eda6a9f-b4cc-403f-a284-8a9cd10e8f15 nodeName:}" failed. No retries permitted until 2026-06-09 15:14:38.294878188 +0000 UTC m=+17.982883642 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/8eda6a9f-b4cc-403f-a284-8a9cd10e8f15-metrics-certs") pod "network-metrics-daemon-5bg45" (UID: "8eda6a9f-b4cc-403f-a284-8a9cd10e8f15") : object "openshift-multus"/"metrics-daemon-secret" not registered Jun 09 15:14:30.295078 ip-10-0-130-232 kubenswrapper[2575]: E0609 15:14:30.294926 2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/e519f3d3-552b-482d-88b5-74b1d17e3bce-kube-api-access-dmj2n podName:e519f3d3-552b-482d-88b5-74b1d17e3bce nodeName:}" failed. No retries permitted until 2026-06-09 15:14:38.29491423 +0000 UTC m=+17.982919680 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-api-access-dmj2n" (UniqueName: "kubernetes.io/projected/e519f3d3-552b-482d-88b5-74b1d17e3bce-kube-api-access-dmj2n") pod "network-check-target-bbf2c" (UID: "e519f3d3-552b-482d-88b5-74b1d17e3bce") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 09 15:14:30.395786 ip-10-0-130-232 kubenswrapper[2575]: I0609 15:14:30.395749 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/0ee786d7-9e46-4cf0-add7-db4ff254d57b-original-pull-secret\") pod \"global-pull-secret-syncer-2k4nl\" (UID: \"0ee786d7-9e46-4cf0-add7-db4ff254d57b\") " pod="kube-system/global-pull-secret-syncer-2k4nl" Jun 09 15:14:30.395958 ip-10-0-130-232 kubenswrapper[2575]: E0609 15:14:30.395929 2575 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jun 09 15:14:30.396014 ip-10-0-130-232 kubenswrapper[2575]: E0609 15:14:30.395994 2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/0ee786d7-9e46-4cf0-add7-db4ff254d57b-original-pull-secret podName:0ee786d7-9e46-4cf0-add7-db4ff254d57b nodeName:}" failed. No retries permitted until 2026-06-09 15:14:38.395977385 +0000 UTC m=+18.083982816 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/0ee786d7-9e46-4cf0-add7-db4ff254d57b-original-pull-secret") pod "global-pull-secret-syncer-2k4nl" (UID: "0ee786d7-9e46-4cf0-add7-db4ff254d57b") : object "kube-system"/"original-pull-secret" not registered Jun 09 15:14:30.692338 ip-10-0-130-232 kubenswrapper[2575]: I0609 15:14:30.691804 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-bbf2c" Jun 09 15:14:30.692338 ip-10-0-130-232 kubenswrapper[2575]: E0609 15:14:30.691933 2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-bbf2c" podUID="e519f3d3-552b-482d-88b5-74b1d17e3bce" Jun 09 15:14:30.692338 ip-10-0-130-232 kubenswrapper[2575]: I0609 15:14:30.692258 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-2k4nl" Jun 09 15:14:30.692614 ip-10-0-130-232 kubenswrapper[2575]: E0609 15:14:30.692352 2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-2k4nl" podUID="0ee786d7-9e46-4cf0-add7-db4ff254d57b" Jun 09 15:14:30.692614 ip-10-0-130-232 kubenswrapper[2575]: I0609 15:14:30.692385 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-5bg45" Jun 09 15:14:30.692614 ip-10-0-130-232 kubenswrapper[2575]: E0609 15:14:30.692502 2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-5bg45" podUID="8eda6a9f-b4cc-403f-a284-8a9cd10e8f15" Jun 09 15:14:32.690277 ip-10-0-130-232 kubenswrapper[2575]: I0609 15:14:32.690244 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-5bg45" Jun 09 15:14:32.690741 ip-10-0-130-232 kubenswrapper[2575]: I0609 15:14:32.690250 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-2k4nl" Jun 09 15:14:32.690741 ip-10-0-130-232 kubenswrapper[2575]: E0609 15:14:32.690371 2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-5bg45" podUID="8eda6a9f-b4cc-403f-a284-8a9cd10e8f15" Jun 09 15:14:32.690741 ip-10-0-130-232 kubenswrapper[2575]: I0609 15:14:32.690251 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-bbf2c" Jun 09 15:14:32.690741 ip-10-0-130-232 kubenswrapper[2575]: E0609 15:14:32.690450 2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-2k4nl" podUID="0ee786d7-9e46-4cf0-add7-db4ff254d57b" Jun 09 15:14:32.690741 ip-10-0-130-232 kubenswrapper[2575]: E0609 15:14:32.690517 2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-bbf2c" podUID="e519f3d3-552b-482d-88b5-74b1d17e3bce" Jun 09 15:14:33.765201 ip-10-0-130-232 kubenswrapper[2575]: I0609 15:14:33.764947 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-s44r8" event={"ID":"a687cfa5-1e89-4fbf-b17d-11f2778c632f","Type":"ContainerStarted","Data":"4c8408f20cf94812188f44b51ea31f8a5481f6db00cfed309f02e7f86813ca64"} Jun 09 15:14:33.768392 ip-10-0-130-232 kubenswrapper[2575]: I0609 15:14:33.767987 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-9shqx" event={"ID":"146ee641-079b-4c92-8b48-7449e59f82b3","Type":"ContainerStarted","Data":"26cde32d6b19a6f498eb96eb816b3a4fd25b258d3cbf8cf72c848bc4a8a20595"} Jun 09 15:14:33.770418 ip-10-0-130-232 kubenswrapper[2575]: I0609 15:14:33.770394 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-p4lk5" event={"ID":"f466d0e4-e80c-4930-a9ef-1c709b262d2b","Type":"ContainerStarted","Data":"ad05e529b419cd44c9aae8ad13eae2b7cc6b3f9ce630eb6ff360162b69943371"} Jun 09 15:14:33.773163 ip-10-0-130-232 kubenswrapper[2575]: I0609 15:14:33.773136 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-2bkzp" event={"ID":"41532b1e-300d-4a9e-a64f-da302213062c","Type":"ContainerStarted","Data":"fd315413eb0aca4abb95a94cdbf71f386be4177a9f07d4d03aeeb60e698f3627"} Jun 09 15:14:33.776176 ip-10-0-130-232 kubenswrapper[2575]: I0609 15:14:33.776146 2575 generic.go:356] "Generic (PLEG): container finished" podID="1982d388-abfa-4d4b-a126-34c01f86521d" containerID="c4daaee083e6b2ba96825e5f40dcb8b4ea794c5eb421587948c73631c3531c4b" exitCode=0 Jun 09 15:14:33.776270 ip-10-0-130-232 kubenswrapper[2575]: I0609 15:14:33.776233 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-knt8p" event={"ID":"1982d388-abfa-4d4b-a126-34c01f86521d","Type":"ContainerDied","Data":"c4daaee083e6b2ba96825e5f40dcb8b4ea794c5eb421587948c73631c3531c4b"} Jun 09 15:14:33.778535 ip-10-0-130-232 kubenswrapper[2575]: I0609 15:14:33.778512 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-w7xqz" event={"ID":"b3301a95-a57b-4095-a43b-2594d8876877","Type":"ContainerStarted","Data":"3167f330419ea998de4a2d20298f6d97b296c6c3befcd0f3391f540cfe34f8c7"} Jun 09 15:14:33.779828 ip-10-0-130-232 kubenswrapper[2575]: I0609 15:14:33.779373 2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-130-232.ec2.internal" podStartSLOduration=12.779361269 podStartE2EDuration="12.779361269s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-09 15:14:21 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-09 15:14:25.760631805 +0000 UTC m=+5.448637260" watchObservedRunningTime="2026-06-09 15:14:33.779361269 +0000 UTC m=+13.467366733" Jun 09 15:14:33.791750 ip-10-0-130-232 kubenswrapper[2575]: I0609 15:14:33.791716 2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/node-resolver-s44r8" podStartSLOduration=4.217053796 podStartE2EDuration="13.791704085s" totalImagesPullingTime="9.574650289s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-09 15:14:20 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-09 15:14:33.778867978 +0000 UTC m=+13.466873426" watchObservedRunningTime="2026-06-09 15:14:33.791704085 +0000 UTC m=+13.479709546" Jun 09 15:14:33.806682 ip-10-0-130-232 kubenswrapper[2575]: I0609 15:14:33.806621 2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-node-tuning-operator/tuned-p4lk5" podStartSLOduration=4.213194132 podStartE2EDuration="13.806605493s" totalImagesPullingTime="9.593411361s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-09 15:14:20 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-09 15:14:33.806407056 +0000 UTC m=+13.494412510" watchObservedRunningTime="2026-06-09 15:14:33.806605493 +0000 UTC m=+13.494610947" Jun 09 15:14:33.806819 ip-10-0-130-232 kubenswrapper[2575]: I0609 15:14:33.806760 2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/node-ca-9shqx" podStartSLOduration=4.232618539 podStartE2EDuration="13.806753856s" totalImagesPullingTime="9.574135317s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-09 15:14:20 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-09 15:14:33.792336423 +0000 UTC m=+13.480341878" watchObservedRunningTime="2026-06-09 15:14:33.806753856 +0000 UTC m=+13.494759310" Jun 09 15:14:33.841684 ip-10-0-130-232 kubenswrapper[2575]: I0609 15:14:33.841630 2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/konnectivity-agent-2bkzp" podStartSLOduration=4.237677404 podStartE2EDuration="13.841609648s" totalImagesPullingTime="9.603932244s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-09 15:14:20 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-09 15:14:33.841213202 +0000 UTC m=+13.529218655" watchObservedRunningTime="2026-06-09 15:14:33.841609648 +0000 UTC m=+13.529615102" Jun 09 15:14:34.304810 ip-10-0-130-232 kubenswrapper[2575]: I0609 15:14:34.304782 2575 plugin_watcher.go:194] "Adding socket path or updating timestamp to desired state cache" path="/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock" Jun 09 15:14:34.685119 ip-10-0-130-232 kubenswrapper[2575]: I0609 15:14:34.685006 2575 reconciler.go:161] "OperationExecutor.RegisterPlugin started" plugin={"SocketPath":"/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock","Timestamp":"2026-06-09T15:14:34.304806489Z","UUID":"ec059eaf-53a0-4e7d-a544-8a6fc55e38f0","Handler":null,"Name":"","Endpoint":""} Jun 09 15:14:34.688024 ip-10-0-130-232 kubenswrapper[2575]: I0609 15:14:34.688001 2575 csi_plugin.go:106] kubernetes.io/csi: Trying to validate a new CSI Driver with name: ebs.csi.aws.com endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock versions: 1.0.0 Jun 09 15:14:34.688185 ip-10-0-130-232 kubenswrapper[2575]: I0609 15:14:34.688037 2575 csi_plugin.go:119] kubernetes.io/csi: Register new plugin with name: ebs.csi.aws.com at endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock Jun 09 15:14:34.690114 ip-10-0-130-232 kubenswrapper[2575]: I0609 15:14:34.690076 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-bbf2c" Jun 09 15:14:34.690213 ip-10-0-130-232 kubenswrapper[2575]: E0609 15:14:34.690172 2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-bbf2c" podUID="e519f3d3-552b-482d-88b5-74b1d17e3bce" Jun 09 15:14:34.691038 ip-10-0-130-232 kubenswrapper[2575]: I0609 15:14:34.690514 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-5bg45" Jun 09 15:14:34.691038 ip-10-0-130-232 kubenswrapper[2575]: E0609 15:14:34.690619 2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-5bg45" podUID="8eda6a9f-b4cc-403f-a284-8a9cd10e8f15" Jun 09 15:14:34.691217 ip-10-0-130-232 kubenswrapper[2575]: I0609 15:14:34.691077 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-2k4nl" Jun 09 15:14:34.691217 ip-10-0-130-232 kubenswrapper[2575]: E0609 15:14:34.691178 2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-2k4nl" podUID="0ee786d7-9e46-4cf0-add7-db4ff254d57b" Jun 09 15:14:34.783837 ip-10-0-130-232 kubenswrapper[2575]: I0609 15:14:34.783793 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-b6rmr" event={"ID":"ce41d797-9a61-40d2-b9af-9389dfa485e0","Type":"ContainerStarted","Data":"e4830e16c10dd1d5f73ae79264ee5d39d216a6082165b6a455dc87eedc371a9f"} Jun 09 15:14:34.787469 ip-10-0-130-232 kubenswrapper[2575]: I0609 15:14:34.787331 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-w7xqz" event={"ID":"b3301a95-a57b-4095-a43b-2594d8876877","Type":"ContainerStarted","Data":"f4235aff6a2728540dca01b516115b27cf865769c40117f4f4769bcbf65b26ce"} Jun 09 15:14:35.051622 ip-10-0-130-232 kubenswrapper[2575]: I0609 15:14:35.051582 2575 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="kube-system/konnectivity-agent-2bkzp" Jun 09 15:14:35.052694 ip-10-0-130-232 kubenswrapper[2575]: I0609 15:14:35.052525 2575 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="kube-system/konnectivity-agent-2bkzp" Jun 09 15:14:35.066817 ip-10-0-130-232 kubenswrapper[2575]: I0609 15:14:35.066762 2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-operator/iptables-alerter-b6rmr" podStartSLOduration=5.479333139 podStartE2EDuration="15.066743194s" totalImagesPullingTime="9.587410055s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-09 15:14:20 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-09 15:14:34.798036807 +0000 UTC m=+14.486042261" watchObservedRunningTime="2026-06-09 15:14:35.066743194 +0000 UTC m=+14.754748670" Jun 09 15:14:35.791785 ip-10-0-130-232 kubenswrapper[2575]: I0609 15:14:35.791749 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-w7xqz" event={"ID":"b3301a95-a57b-4095-a43b-2594d8876877","Type":"ContainerStarted","Data":"c011498fd2c7b8c31c15fa2128e224f54335242d959f3799c9dc47c20693f874"} Jun 09 15:14:35.807190 ip-10-0-130-232 kubenswrapper[2575]: I0609 15:14:35.807141 2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-w7xqz" podStartSLOduration=4.45981763 podStartE2EDuration="15.807124678s" totalImagesPullingTime="11.347307048s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-09 15:14:20 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-09 15:14:35.806698291 +0000 UTC m=+15.494703746" watchObservedRunningTime="2026-06-09 15:14:35.807124678 +0000 UTC m=+15.495130134" Jun 09 15:14:36.690238 ip-10-0-130-232 kubenswrapper[2575]: I0609 15:14:36.690206 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-5bg45" Jun 09 15:14:36.690398 ip-10-0-130-232 kubenswrapper[2575]: I0609 15:14:36.690245 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-2k4nl" Jun 09 15:14:36.690398 ip-10-0-130-232 kubenswrapper[2575]: I0609 15:14:36.690211 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-bbf2c" Jun 09 15:14:36.690398 ip-10-0-130-232 kubenswrapper[2575]: E0609 15:14:36.690349 2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-5bg45" podUID="8eda6a9f-b4cc-403f-a284-8a9cd10e8f15" Jun 09 15:14:36.690533 ip-10-0-130-232 kubenswrapper[2575]: E0609 15:14:36.690425 2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-2k4nl" podUID="0ee786d7-9e46-4cf0-add7-db4ff254d57b" Jun 09 15:14:36.690533 ip-10-0-130-232 kubenswrapper[2575]: E0609 15:14:36.690497 2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-bbf2c" podUID="e519f3d3-552b-482d-88b5-74b1d17e3bce" Jun 09 15:14:36.793983 ip-10-0-130-232 kubenswrapper[2575]: I0609 15:14:36.793960 2575 prober_manager.go:312] "Failed to trigger a manual run" probe="Readiness" Jun 09 15:14:38.358913 ip-10-0-130-232 kubenswrapper[2575]: I0609 15:14:38.358878 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-dmj2n\" (UniqueName: \"kubernetes.io/projected/e519f3d3-552b-482d-88b5-74b1d17e3bce-kube-api-access-dmj2n\") pod \"network-check-target-bbf2c\" (UID: \"e519f3d3-552b-482d-88b5-74b1d17e3bce\") " pod="openshift-network-diagnostics/network-check-target-bbf2c" Jun 09 15:14:38.359404 ip-10-0-130-232 kubenswrapper[2575]: I0609 15:14:38.358954 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/8eda6a9f-b4cc-403f-a284-8a9cd10e8f15-metrics-certs\") pod \"network-metrics-daemon-5bg45\" (UID: \"8eda6a9f-b4cc-403f-a284-8a9cd10e8f15\") " pod="openshift-multus/network-metrics-daemon-5bg45" Jun 09 15:14:38.359404 ip-10-0-130-232 kubenswrapper[2575]: E0609 15:14:38.359040 2575 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jun 09 15:14:38.359404 ip-10-0-130-232 kubenswrapper[2575]: E0609 15:14:38.359057 2575 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jun 09 15:14:38.359404 ip-10-0-130-232 kubenswrapper[2575]: E0609 15:14:38.359085 2575 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jun 09 15:14:38.359404 ip-10-0-130-232 kubenswrapper[2575]: E0609 15:14:38.359097 2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/8eda6a9f-b4cc-403f-a284-8a9cd10e8f15-metrics-certs podName:8eda6a9f-b4cc-403f-a284-8a9cd10e8f15 nodeName:}" failed. No retries permitted until 2026-06-09 15:14:54.359079299 +0000 UTC m=+34.047084736 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/8eda6a9f-b4cc-403f-a284-8a9cd10e8f15-metrics-certs") pod "network-metrics-daemon-5bg45" (UID: "8eda6a9f-b4cc-403f-a284-8a9cd10e8f15") : object "openshift-multus"/"metrics-daemon-secret" not registered Jun 09 15:14:38.359404 ip-10-0-130-232 kubenswrapper[2575]: E0609 15:14:38.359099 2575 projected.go:196] Error preparing data for projected volume kube-api-access-dmj2n for pod openshift-network-diagnostics/network-check-target-bbf2c: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 09 15:14:38.359404 ip-10-0-130-232 kubenswrapper[2575]: E0609 15:14:38.359147 2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/e519f3d3-552b-482d-88b5-74b1d17e3bce-kube-api-access-dmj2n podName:e519f3d3-552b-482d-88b5-74b1d17e3bce nodeName:}" failed. No retries permitted until 2026-06-09 15:14:54.359133396 +0000 UTC m=+34.047138827 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "kube-api-access-dmj2n" (UniqueName: "kubernetes.io/projected/e519f3d3-552b-482d-88b5-74b1d17e3bce-kube-api-access-dmj2n") pod "network-check-target-bbf2c" (UID: "e519f3d3-552b-482d-88b5-74b1d17e3bce") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 09 15:14:38.459859 ip-10-0-130-232 kubenswrapper[2575]: I0609 15:14:38.459820 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/0ee786d7-9e46-4cf0-add7-db4ff254d57b-original-pull-secret\") pod \"global-pull-secret-syncer-2k4nl\" (UID: \"0ee786d7-9e46-4cf0-add7-db4ff254d57b\") " pod="kube-system/global-pull-secret-syncer-2k4nl" Jun 09 15:14:38.460033 ip-10-0-130-232 kubenswrapper[2575]: E0609 15:14:38.459960 2575 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jun 09 15:14:38.460033 ip-10-0-130-232 kubenswrapper[2575]: E0609 15:14:38.460022 2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/0ee786d7-9e46-4cf0-add7-db4ff254d57b-original-pull-secret podName:0ee786d7-9e46-4cf0-add7-db4ff254d57b nodeName:}" failed. No retries permitted until 2026-06-09 15:14:54.460003409 +0000 UTC m=+34.148008855 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/0ee786d7-9e46-4cf0-add7-db4ff254d57b-original-pull-secret") pod "global-pull-secret-syncer-2k4nl" (UID: "0ee786d7-9e46-4cf0-add7-db4ff254d57b") : object "kube-system"/"original-pull-secret" not registered Jun 09 15:14:38.690910 ip-10-0-130-232 kubenswrapper[2575]: I0609 15:14:38.690814 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-2k4nl" Jun 09 15:14:38.691067 ip-10-0-130-232 kubenswrapper[2575]: I0609 15:14:38.690814 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-5bg45" Jun 09 15:14:38.691067 ip-10-0-130-232 kubenswrapper[2575]: E0609 15:14:38.690943 2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-2k4nl" podUID="0ee786d7-9e46-4cf0-add7-db4ff254d57b" Jun 09 15:14:38.691067 ip-10-0-130-232 kubenswrapper[2575]: I0609 15:14:38.690979 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-bbf2c" Jun 09 15:14:38.691174 ip-10-0-130-232 kubenswrapper[2575]: E0609 15:14:38.691090 2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-5bg45" podUID="8eda6a9f-b4cc-403f-a284-8a9cd10e8f15" Jun 09 15:14:38.691174 ip-10-0-130-232 kubenswrapper[2575]: E0609 15:14:38.691144 2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-bbf2c" podUID="e519f3d3-552b-482d-88b5-74b1d17e3bce" Jun 09 15:14:40.046433 ip-10-0-130-232 kubenswrapper[2575]: I0609 15:14:40.046189 2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kube-system/konnectivity-agent-2bkzp" Jun 09 15:14:40.046922 ip-10-0-130-232 kubenswrapper[2575]: I0609 15:14:40.046520 2575 prober_manager.go:312] "Failed to trigger a manual run" probe="Readiness" Jun 09 15:14:40.047015 ip-10-0-130-232 kubenswrapper[2575]: I0609 15:14:40.046994 2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kube-system/konnectivity-agent-2bkzp" Jun 09 15:14:40.691197 ip-10-0-130-232 kubenswrapper[2575]: I0609 15:14:40.691171 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-5bg45" Jun 09 15:14:40.691350 ip-10-0-130-232 kubenswrapper[2575]: E0609 15:14:40.691273 2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-5bg45" podUID="8eda6a9f-b4cc-403f-a284-8a9cd10e8f15" Jun 09 15:14:40.691350 ip-10-0-130-232 kubenswrapper[2575]: I0609 15:14:40.691345 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-2k4nl" Jun 09 15:14:40.691443 ip-10-0-130-232 kubenswrapper[2575]: E0609 15:14:40.691429 2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-2k4nl" podUID="0ee786d7-9e46-4cf0-add7-db4ff254d57b" Jun 09 15:14:40.691480 ip-10-0-130-232 kubenswrapper[2575]: I0609 15:14:40.691433 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-bbf2c" Jun 09 15:14:40.691516 ip-10-0-130-232 kubenswrapper[2575]: E0609 15:14:40.691503 2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-bbf2c" podUID="e519f3d3-552b-482d-88b5-74b1d17e3bce" Jun 09 15:14:42.692436 ip-10-0-130-232 kubenswrapper[2575]: I0609 15:14:42.692406 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-2k4nl" Jun 09 15:14:42.692804 ip-10-0-130-232 kubenswrapper[2575]: I0609 15:14:42.692493 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-5bg45" Jun 09 15:14:42.692804 ip-10-0-130-232 kubenswrapper[2575]: E0609 15:14:42.692503 2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-2k4nl" podUID="0ee786d7-9e46-4cf0-add7-db4ff254d57b" Jun 09 15:14:42.692804 ip-10-0-130-232 kubenswrapper[2575]: I0609 15:14:42.692519 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-bbf2c" Jun 09 15:14:42.692804 ip-10-0-130-232 kubenswrapper[2575]: E0609 15:14:42.692592 2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-5bg45" podUID="8eda6a9f-b4cc-403f-a284-8a9cd10e8f15" Jun 09 15:14:42.692804 ip-10-0-130-232 kubenswrapper[2575]: E0609 15:14:42.692640 2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-bbf2c" podUID="e519f3d3-552b-482d-88b5-74b1d17e3bce" Jun 09 15:14:43.809990 ip-10-0-130-232 kubenswrapper[2575]: I0609 15:14:43.809803 2575 generic.go:356] "Generic (PLEG): container finished" podID="1982d388-abfa-4d4b-a126-34c01f86521d" containerID="e33e40bd5c532e33f69f17367c242de5a2c8baecf28818363e5e53bf67650066" exitCode=0 Jun 09 15:14:43.810420 ip-10-0-130-232 kubenswrapper[2575]: I0609 15:14:43.809876 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-knt8p" event={"ID":"1982d388-abfa-4d4b-a126-34c01f86521d","Type":"ContainerDied","Data":"e33e40bd5c532e33f69f17367c242de5a2c8baecf28818363e5e53bf67650066"} Jun 09 15:14:43.813144 ip-10-0-130-232 kubenswrapper[2575]: I0609 15:14:43.813120 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-lb2zn" event={"ID":"7e7b605f-1171-42e1-87cf-4bd1c06eb53e","Type":"ContainerStarted","Data":"0b57869ca8cb36399db93818160265e06ec1809106d3ae5bfd021b4df5da1ee7"} Jun 09 15:14:43.813270 ip-10-0-130-232 kubenswrapper[2575]: I0609 15:14:43.813197 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-lb2zn" event={"ID":"7e7b605f-1171-42e1-87cf-4bd1c06eb53e","Type":"ContainerStarted","Data":"287acb89f86e8c061273d9d23188c77cfb965f3b711608e8f2d2b0be1fe01bb3"} Jun 09 15:14:43.813270 ip-10-0-130-232 kubenswrapper[2575]: I0609 15:14:43.813247 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-lb2zn" event={"ID":"7e7b605f-1171-42e1-87cf-4bd1c06eb53e","Type":"ContainerStarted","Data":"3dd92f454d72d619c44728ade9e7aa5606cffaed919bcb39d7a59364b5f1a30c"} Jun 09 15:14:43.813381 ip-10-0-130-232 kubenswrapper[2575]: I0609 15:14:43.813293 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-lb2zn" event={"ID":"7e7b605f-1171-42e1-87cf-4bd1c06eb53e","Type":"ContainerStarted","Data":"da22dffdeb9ab05a0c0bee0c946af7274283abc088f505618008bf6122013e03"} Jun 09 15:14:43.813381 ip-10-0-130-232 kubenswrapper[2575]: I0609 15:14:43.813342 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-lb2zn" event={"ID":"7e7b605f-1171-42e1-87cf-4bd1c06eb53e","Type":"ContainerStarted","Data":"6923a6c699ddf9e1ecb73a342580aed719c7865edd844ccec604142cf2c09a6d"} Jun 09 15:14:43.813467 ip-10-0-130-232 kubenswrapper[2575]: I0609 15:14:43.813391 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-lb2zn" event={"ID":"7e7b605f-1171-42e1-87cf-4bd1c06eb53e","Type":"ContainerStarted","Data":"33ee55e27e65b555626779f4fa3d9cb5937ae679a2ff82ba032dfb54fe227732"} Jun 09 15:14:44.690691 ip-10-0-130-232 kubenswrapper[2575]: I0609 15:14:44.690263 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-2k4nl" Jun 09 15:14:44.690691 ip-10-0-130-232 kubenswrapper[2575]: I0609 15:14:44.690263 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-bbf2c" Jun 09 15:14:44.690691 ip-10-0-130-232 kubenswrapper[2575]: E0609 15:14:44.690378 2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-2k4nl" podUID="0ee786d7-9e46-4cf0-add7-db4ff254d57b" Jun 09 15:14:44.690691 ip-10-0-130-232 kubenswrapper[2575]: I0609 15:14:44.690273 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-5bg45" Jun 09 15:14:44.690691 ip-10-0-130-232 kubenswrapper[2575]: E0609 15:14:44.690465 2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-bbf2c" podUID="e519f3d3-552b-482d-88b5-74b1d17e3bce" Jun 09 15:14:44.690691 ip-10-0-130-232 kubenswrapper[2575]: E0609 15:14:44.690565 2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-5bg45" podUID="8eda6a9f-b4cc-403f-a284-8a9cd10e8f15" Jun 09 15:14:46.690001 ip-10-0-130-232 kubenswrapper[2575]: I0609 15:14:46.689963 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-bbf2c" Jun 09 15:14:46.690434 ip-10-0-130-232 kubenswrapper[2575]: I0609 15:14:46.689971 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-2k4nl" Jun 09 15:14:46.690434 ip-10-0-130-232 kubenswrapper[2575]: E0609 15:14:46.690085 2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-bbf2c" podUID="e519f3d3-552b-482d-88b5-74b1d17e3bce" Jun 09 15:14:46.690434 ip-10-0-130-232 kubenswrapper[2575]: I0609 15:14:46.689973 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-5bg45" Jun 09 15:14:46.690434 ip-10-0-130-232 kubenswrapper[2575]: E0609 15:14:46.690138 2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-2k4nl" podUID="0ee786d7-9e46-4cf0-add7-db4ff254d57b" Jun 09 15:14:46.690434 ip-10-0-130-232 kubenswrapper[2575]: E0609 15:14:46.690244 2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-5bg45" podUID="8eda6a9f-b4cc-403f-a284-8a9cd10e8f15" Jun 09 15:14:48.690209 ip-10-0-130-232 kubenswrapper[2575]: I0609 15:14:48.690181 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-5bg45" Jun 09 15:14:48.690693 ip-10-0-130-232 kubenswrapper[2575]: I0609 15:14:48.690218 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-2k4nl" Jun 09 15:14:48.690693 ip-10-0-130-232 kubenswrapper[2575]: I0609 15:14:48.690287 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-bbf2c" Jun 09 15:14:48.690693 ip-10-0-130-232 kubenswrapper[2575]: E0609 15:14:48.690417 2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-5bg45" podUID="8eda6a9f-b4cc-403f-a284-8a9cd10e8f15" Jun 09 15:14:48.690693 ip-10-0-130-232 kubenswrapper[2575]: E0609 15:14:48.690523 2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-bbf2c" podUID="e519f3d3-552b-482d-88b5-74b1d17e3bce" Jun 09 15:14:48.690693 ip-10-0-130-232 kubenswrapper[2575]: E0609 15:14:48.690594 2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-2k4nl" podUID="0ee786d7-9e46-4cf0-add7-db4ff254d57b" Jun 09 15:14:48.828154 ip-10-0-130-232 kubenswrapper[2575]: I0609 15:14:48.828114 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-lb2zn" event={"ID":"7e7b605f-1171-42e1-87cf-4bd1c06eb53e","Type":"ContainerStarted","Data":"f892287ed4533decea38978789e7ab1dc3228dda38a336d760851fbed5570195"} Jun 09 15:14:48.833310 ip-10-0-130-232 kubenswrapper[2575]: I0609 15:14:48.833280 2575 generic.go:356] "Generic (PLEG): container finished" podID="1982d388-abfa-4d4b-a126-34c01f86521d" containerID="ceb7bc7c32de38184b0b57b9bfbdf33a7117276b95fa826a3aadd7babd5f0110" exitCode=0 Jun 09 15:14:48.833426 ip-10-0-130-232 kubenswrapper[2575]: I0609 15:14:48.833356 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-knt8p" event={"ID":"1982d388-abfa-4d4b-a126-34c01f86521d","Type":"ContainerDied","Data":"ceb7bc7c32de38184b0b57b9bfbdf33a7117276b95fa826a3aadd7babd5f0110"} Jun 09 15:14:48.834823 ip-10-0-130-232 kubenswrapper[2575]: I0609 15:14:48.834778 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-cxbrv" event={"ID":"06bde064-62c0-4d6e-bc37-d0fe1e36a621","Type":"ContainerStarted","Data":"7bcee81c9d4f428d746cc5e9a6abfd3b3042b3344b221c58ceca5cc92a49ef34"} Jun 09 15:14:48.865681 ip-10-0-130-232 kubenswrapper[2575]: I0609 15:14:48.865643 2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-cxbrv" podStartSLOduration=3.862515397 podStartE2EDuration="28.865631402s" totalImagesPullingTime="25.003116005s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-09 15:14:20 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-09 15:14:48.865395947 +0000 UTC m=+28.553401401" watchObservedRunningTime="2026-06-09 15:14:48.865631402 +0000 UTC m=+28.553636854" Jun 09 15:14:48.966835 ip-10-0-130-232 kubenswrapper[2575]: I0609 15:14:48.966811 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2bkzp_41532b1e-300d-4a9e-a64f-da302213062c/konnectivity-agent/0.log" limit=1024 Jun 09 15:14:49.045874 ip-10-0-130-232 kubenswrapper[2575]: I0609 15:14:49.045806 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2bkzp_41532b1e-300d-4a9e-a64f-da302213062c/konnectivity-agent/0.log" limit=1024 Jun 09 15:14:49.839448 ip-10-0-130-232 kubenswrapper[2575]: I0609 15:14:49.839414 2575 generic.go:356] "Generic (PLEG): container finished" podID="1982d388-abfa-4d4b-a126-34c01f86521d" containerID="7103d9fb08e8254b79b4c3f8ba8950ed764312280dc81cde3df861109326b8de" exitCode=0 Jun 09 15:14:49.839929 ip-10-0-130-232 kubenswrapper[2575]: I0609 15:14:49.839493 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-knt8p" event={"ID":"1982d388-abfa-4d4b-a126-34c01f86521d","Type":"ContainerDied","Data":"7103d9fb08e8254b79b4c3f8ba8950ed764312280dc81cde3df861109326b8de"} Jun 09 15:14:50.690557 ip-10-0-130-232 kubenswrapper[2575]: I0609 15:14:50.690387 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-5bg45" Jun 09 15:14:50.690771 ip-10-0-130-232 kubenswrapper[2575]: E0609 15:14:50.690626 2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-5bg45" podUID="8eda6a9f-b4cc-403f-a284-8a9cd10e8f15" Jun 09 15:14:50.690771 ip-10-0-130-232 kubenswrapper[2575]: I0609 15:14:50.690487 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-2k4nl" Jun 09 15:14:50.690771 ip-10-0-130-232 kubenswrapper[2575]: I0609 15:14:50.690462 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-bbf2c" Jun 09 15:14:50.690771 ip-10-0-130-232 kubenswrapper[2575]: E0609 15:14:50.690709 2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-2k4nl" podUID="0ee786d7-9e46-4cf0-add7-db4ff254d57b" Jun 09 15:14:50.691009 ip-10-0-130-232 kubenswrapper[2575]: E0609 15:14:50.690802 2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-bbf2c" podUID="e519f3d3-552b-482d-88b5-74b1d17e3bce" Jun 09 15:14:50.845603 ip-10-0-130-232 kubenswrapper[2575]: I0609 15:14:50.845570 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-lb2zn" event={"ID":"7e7b605f-1171-42e1-87cf-4bd1c06eb53e","Type":"ContainerStarted","Data":"f4e48440f62efbddc7eea1392042bdb27c02365cfb89cc7f5cbfdab66f0b8be0"} Jun 09 15:14:50.846144 ip-10-0-130-232 kubenswrapper[2575]: I0609 15:14:50.845911 2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-lb2zn" Jun 09 15:14:50.863167 ip-10-0-130-232 kubenswrapper[2575]: I0609 15:14:50.863146 2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-lb2zn" Jun 09 15:14:50.868688 ip-10-0-130-232 kubenswrapper[2575]: I0609 15:14:50.868651 2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ovn-kubernetes/ovnkube-node-lb2zn" podStartSLOduration=11.680263579 podStartE2EDuration="30.868639076s" totalImagesPullingTime="19.188375497s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-09 15:14:20 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-09 15:14:50.867784598 +0000 UTC m=+30.555790063" watchObservedRunningTime="2026-06-09 15:14:50.868639076 +0000 UTC m=+30.556644528" Jun 09 15:14:50.963424 ip-10-0-130-232 kubenswrapper[2575]: I0609 15:14:50.963348 2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-lb2zn" Jun 09 15:14:51.848630 ip-10-0-130-232 kubenswrapper[2575]: I0609 15:14:51.848607 2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-lb2zn" Jun 09 15:14:51.864757 ip-10-0-130-232 kubenswrapper[2575]: I0609 15:14:51.864737 2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-lb2zn" Jun 09 15:14:51.876910 ip-10-0-130-232 kubenswrapper[2575]: I0609 15:14:51.876888 2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-2k4nl"] Jun 09 15:14:51.877040 ip-10-0-130-232 kubenswrapper[2575]: I0609 15:14:51.876985 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-2k4nl" Jun 09 15:14:51.877093 ip-10-0-130-232 kubenswrapper[2575]: E0609 15:14:51.877075 2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-2k4nl" podUID="0ee786d7-9e46-4cf0-add7-db4ff254d57b" Jun 09 15:14:51.880561 ip-10-0-130-232 kubenswrapper[2575]: I0609 15:14:51.880327 2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-bbf2c"] Jun 09 15:14:51.880561 ip-10-0-130-232 kubenswrapper[2575]: I0609 15:14:51.880428 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-bbf2c" Jun 09 15:14:51.880561 ip-10-0-130-232 kubenswrapper[2575]: E0609 15:14:51.880510 2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-bbf2c" podUID="e519f3d3-552b-482d-88b5-74b1d17e3bce" Jun 09 15:14:51.881517 ip-10-0-130-232 kubenswrapper[2575]: I0609 15:14:51.881101 2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-5bg45"] Jun 09 15:14:51.881517 ip-10-0-130-232 kubenswrapper[2575]: I0609 15:14:51.881185 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-5bg45" Jun 09 15:14:51.881517 ip-10-0-130-232 kubenswrapper[2575]: E0609 15:14:51.881265 2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-5bg45" podUID="8eda6a9f-b4cc-403f-a284-8a9cd10e8f15" Jun 09 15:14:53.690169 ip-10-0-130-232 kubenswrapper[2575]: I0609 15:14:53.690138 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-bbf2c" Jun 09 15:14:53.690536 ip-10-0-130-232 kubenswrapper[2575]: I0609 15:14:53.690191 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-2k4nl" Jun 09 15:14:53.690536 ip-10-0-130-232 kubenswrapper[2575]: I0609 15:14:53.690284 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-5bg45" Jun 09 15:14:53.690536 ip-10-0-130-232 kubenswrapper[2575]: E0609 15:14:53.690301 2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-bbf2c" podUID="e519f3d3-552b-482d-88b5-74b1d17e3bce" Jun 09 15:14:53.690536 ip-10-0-130-232 kubenswrapper[2575]: E0609 15:14:53.690376 2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-5bg45" podUID="8eda6a9f-b4cc-403f-a284-8a9cd10e8f15" Jun 09 15:14:53.690536 ip-10-0-130-232 kubenswrapper[2575]: E0609 15:14:53.690451 2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-2k4nl" podUID="0ee786d7-9e46-4cf0-add7-db4ff254d57b" Jun 09 15:14:54.374205 ip-10-0-130-232 kubenswrapper[2575]: I0609 15:14:54.374167 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-dmj2n\" (UniqueName: \"kubernetes.io/projected/e519f3d3-552b-482d-88b5-74b1d17e3bce-kube-api-access-dmj2n\") pod \"network-check-target-bbf2c\" (UID: \"e519f3d3-552b-482d-88b5-74b1d17e3bce\") " pod="openshift-network-diagnostics/network-check-target-bbf2c" Jun 09 15:14:54.374491 ip-10-0-130-232 kubenswrapper[2575]: I0609 15:14:54.374256 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/8eda6a9f-b4cc-403f-a284-8a9cd10e8f15-metrics-certs\") pod \"network-metrics-daemon-5bg45\" (UID: \"8eda6a9f-b4cc-403f-a284-8a9cd10e8f15\") " pod="openshift-multus/network-metrics-daemon-5bg45" Jun 09 15:14:54.374491 ip-10-0-130-232 kubenswrapper[2575]: E0609 15:14:54.374362 2575 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jun 09 15:14:54.374491 ip-10-0-130-232 kubenswrapper[2575]: E0609 15:14:54.374445 2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/8eda6a9f-b4cc-403f-a284-8a9cd10e8f15-metrics-certs podName:8eda6a9f-b4cc-403f-a284-8a9cd10e8f15 nodeName:}" failed. No retries permitted until 2026-06-09 15:15:26.3744253 +0000 UTC m=+66.062430746 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/8eda6a9f-b4cc-403f-a284-8a9cd10e8f15-metrics-certs") pod "network-metrics-daemon-5bg45" (UID: "8eda6a9f-b4cc-403f-a284-8a9cd10e8f15") : object "openshift-multus"/"metrics-daemon-secret" not registered Jun 09 15:14:54.374491 ip-10-0-130-232 kubenswrapper[2575]: E0609 15:14:54.374364 2575 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jun 09 15:14:54.374491 ip-10-0-130-232 kubenswrapper[2575]: E0609 15:14:54.374495 2575 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jun 09 15:14:54.374753 ip-10-0-130-232 kubenswrapper[2575]: E0609 15:14:54.374509 2575 projected.go:196] Error preparing data for projected volume kube-api-access-dmj2n for pod openshift-network-diagnostics/network-check-target-bbf2c: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 09 15:14:54.374753 ip-10-0-130-232 kubenswrapper[2575]: E0609 15:14:54.374565 2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/e519f3d3-552b-482d-88b5-74b1d17e3bce-kube-api-access-dmj2n podName:e519f3d3-552b-482d-88b5-74b1d17e3bce nodeName:}" failed. No retries permitted until 2026-06-09 15:15:26.374547004 +0000 UTC m=+66.062552434 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "kube-api-access-dmj2n" (UniqueName: "kubernetes.io/projected/e519f3d3-552b-482d-88b5-74b1d17e3bce-kube-api-access-dmj2n") pod "network-check-target-bbf2c" (UID: "e519f3d3-552b-482d-88b5-74b1d17e3bce") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 09 15:14:54.475649 ip-10-0-130-232 kubenswrapper[2575]: I0609 15:14:54.475615 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/0ee786d7-9e46-4cf0-add7-db4ff254d57b-original-pull-secret\") pod \"global-pull-secret-syncer-2k4nl\" (UID: \"0ee786d7-9e46-4cf0-add7-db4ff254d57b\") " pod="kube-system/global-pull-secret-syncer-2k4nl" Jun 09 15:14:54.475808 ip-10-0-130-232 kubenswrapper[2575]: E0609 15:14:54.475727 2575 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jun 09 15:14:54.475808 ip-10-0-130-232 kubenswrapper[2575]: E0609 15:14:54.475778 2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/0ee786d7-9e46-4cf0-add7-db4ff254d57b-original-pull-secret podName:0ee786d7-9e46-4cf0-add7-db4ff254d57b nodeName:}" failed. No retries permitted until 2026-06-09 15:15:26.475765547 +0000 UTC m=+66.163770977 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/0ee786d7-9e46-4cf0-add7-db4ff254d57b-original-pull-secret") pod "global-pull-secret-syncer-2k4nl" (UID: "0ee786d7-9e46-4cf0-add7-db4ff254d57b") : object "kube-system"/"original-pull-secret" not registered Jun 09 15:14:54.585544 ip-10-0-130-232 kubenswrapper[2575]: I0609 15:14:54.585511 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2bkzp_41532b1e-300d-4a9e-a64f-da302213062c/konnectivity-agent/0.log" limit=1024 Jun 09 15:14:55.124244 ip-10-0-130-232 kubenswrapper[2575]: I0609 15:14:55.124219 2575 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-130-232.ec2.internal" event="NodeReady" Jun 09 15:14:55.124728 ip-10-0-130-232 kubenswrapper[2575]: I0609 15:14:55.124371 2575 kubelet_node_status.go:489] "Fast updating node status as it just became ready" Jun 09 15:14:55.165854 ip-10-0-130-232 kubenswrapper[2575]: I0609 15:14:55.165826 2575 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-dns/dns-default-rmhjs"] Jun 09 15:14:55.200132 ip-10-0-130-232 kubenswrapper[2575]: I0609 15:14:55.200053 2575 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress-canary/ingress-canary-w28rj"] Jun 09 15:14:55.200287 ip-10-0-130-232 kubenswrapper[2575]: I0609 15:14:55.200203 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-rmhjs" Jun 09 15:14:55.202231 ip-10-0-130-232 kubenswrapper[2575]: I0609 15:14:55.202206 2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-dfk2j\"" Jun 09 15:14:55.202371 ip-10-0-130-232 kubenswrapper[2575]: I0609 15:14:55.202359 2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-default-metrics-tls\"" Jun 09 15:14:55.202469 ip-10-0-130-232 kubenswrapper[2575]: I0609 15:14:55.202452 2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"dns-default\"" Jun 09 15:14:55.218609 ip-10-0-130-232 kubenswrapper[2575]: I0609 15:14:55.218407 2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-rmhjs"] Jun 09 15:14:55.218733 ip-10-0-130-232 kubenswrapper[2575]: I0609 15:14:55.218645 2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-w28rj"] Jun 09 15:14:55.218733 ip-10-0-130-232 kubenswrapper[2575]: I0609 15:14:55.218519 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-w28rj" Jun 09 15:14:55.220561 ip-10-0-130-232 kubenswrapper[2575]: I0609 15:14:55.220542 2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"openshift-service-ca.crt\"" Jun 09 15:14:55.221043 ip-10-0-130-232 kubenswrapper[2575]: I0609 15:14:55.221026 2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"default-dockercfg-wh9pq\"" Jun 09 15:14:55.221139 ip-10-0-130-232 kubenswrapper[2575]: I0609 15:14:55.221040 2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"canary-serving-cert\"" Jun 09 15:14:55.221139 ip-10-0-130-232 kubenswrapper[2575]: I0609 15:14:55.221047 2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"kube-root-ca.crt\"" Jun 09 15:14:55.281726 ip-10-0-130-232 kubenswrapper[2575]: I0609 15:14:55.281693 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/12bfe226-e002-44c4-aaeb-0905603ccd18-tmp-dir\") pod \"dns-default-rmhjs\" (UID: \"12bfe226-e002-44c4-aaeb-0905603ccd18\") " pod="openshift-dns/dns-default-rmhjs" Jun 09 15:14:55.281913 ip-10-0-130-232 kubenswrapper[2575]: I0609 15:14:55.281755 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xdjps\" (UniqueName: \"kubernetes.io/projected/12bfe226-e002-44c4-aaeb-0905603ccd18-kube-api-access-xdjps\") pod \"dns-default-rmhjs\" (UID: \"12bfe226-e002-44c4-aaeb-0905603ccd18\") " pod="openshift-dns/dns-default-rmhjs" Jun 09 15:14:55.281913 ip-10-0-130-232 kubenswrapper[2575]: I0609 15:14:55.281787 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/12bfe226-e002-44c4-aaeb-0905603ccd18-config-volume\") pod \"dns-default-rmhjs\" (UID: \"12bfe226-e002-44c4-aaeb-0905603ccd18\") " pod="openshift-dns/dns-default-rmhjs" Jun 09 15:14:55.281913 ip-10-0-130-232 kubenswrapper[2575]: I0609 15:14:55.281879 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/12bfe226-e002-44c4-aaeb-0905603ccd18-metrics-tls\") pod \"dns-default-rmhjs\" (UID: \"12bfe226-e002-44c4-aaeb-0905603ccd18\") " pod="openshift-dns/dns-default-rmhjs" Jun 09 15:14:55.383106 ip-10-0-130-232 kubenswrapper[2575]: I0609 15:14:55.383068 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/12bfe226-e002-44c4-aaeb-0905603ccd18-metrics-tls\") pod \"dns-default-rmhjs\" (UID: \"12bfe226-e002-44c4-aaeb-0905603ccd18\") " pod="openshift-dns/dns-default-rmhjs" Jun 09 15:14:55.383280 ip-10-0-130-232 kubenswrapper[2575]: I0609 15:14:55.383158 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/12bfe226-e002-44c4-aaeb-0905603ccd18-tmp-dir\") pod \"dns-default-rmhjs\" (UID: \"12bfe226-e002-44c4-aaeb-0905603ccd18\") " pod="openshift-dns/dns-default-rmhjs" Jun 09 15:14:55.383280 ip-10-0-130-232 kubenswrapper[2575]: E0609 15:14:55.383195 2575 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jun 09 15:14:55.383280 ip-10-0-130-232 kubenswrapper[2575]: E0609 15:14:55.383257 2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/12bfe226-e002-44c4-aaeb-0905603ccd18-metrics-tls podName:12bfe226-e002-44c4-aaeb-0905603ccd18 nodeName:}" failed. No retries permitted until 2026-06-09 15:14:55.883239025 +0000 UTC m=+35.571244460 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/12bfe226-e002-44c4-aaeb-0905603ccd18-metrics-tls") pod "dns-default-rmhjs" (UID: "12bfe226-e002-44c4-aaeb-0905603ccd18") : secret "dns-default-metrics-tls" not found Jun 09 15:14:55.383450 ip-10-0-130-232 kubenswrapper[2575]: I0609 15:14:55.383194 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xdjps\" (UniqueName: \"kubernetes.io/projected/12bfe226-e002-44c4-aaeb-0905603ccd18-kube-api-access-xdjps\") pod \"dns-default-rmhjs\" (UID: \"12bfe226-e002-44c4-aaeb-0905603ccd18\") " pod="openshift-dns/dns-default-rmhjs" Jun 09 15:14:55.383450 ip-10-0-130-232 kubenswrapper[2575]: I0609 15:14:55.383386 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/12bfe226-e002-44c4-aaeb-0905603ccd18-config-volume\") pod \"dns-default-rmhjs\" (UID: \"12bfe226-e002-44c4-aaeb-0905603ccd18\") " pod="openshift-dns/dns-default-rmhjs" Jun 09 15:14:55.383450 ip-10-0-130-232 kubenswrapper[2575]: I0609 15:14:55.383418 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/2e334ed6-e1c8-4008-9e24-dc9f3079be0a-cert\") pod \"ingress-canary-w28rj\" (UID: \"2e334ed6-e1c8-4008-9e24-dc9f3079be0a\") " pod="openshift-ingress-canary/ingress-canary-w28rj" Jun 09 15:14:55.383450 ip-10-0-130-232 kubenswrapper[2575]: I0609 15:14:55.383445 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-swx6f\" (UniqueName: \"kubernetes.io/projected/2e334ed6-e1c8-4008-9e24-dc9f3079be0a-kube-api-access-swx6f\") pod \"ingress-canary-w28rj\" (UID: \"2e334ed6-e1c8-4008-9e24-dc9f3079be0a\") " pod="openshift-ingress-canary/ingress-canary-w28rj" Jun 09 15:14:55.383634 ip-10-0-130-232 kubenswrapper[2575]: I0609 15:14:55.383540 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/12bfe226-e002-44c4-aaeb-0905603ccd18-tmp-dir\") pod \"dns-default-rmhjs\" (UID: \"12bfe226-e002-44c4-aaeb-0905603ccd18\") " pod="openshift-dns/dns-default-rmhjs" Jun 09 15:14:55.384014 ip-10-0-130-232 kubenswrapper[2575]: I0609 15:14:55.383993 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/12bfe226-e002-44c4-aaeb-0905603ccd18-config-volume\") pod \"dns-default-rmhjs\" (UID: \"12bfe226-e002-44c4-aaeb-0905603ccd18\") " pod="openshift-dns/dns-default-rmhjs" Jun 09 15:14:55.394406 ip-10-0-130-232 kubenswrapper[2575]: I0609 15:14:55.394377 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-xdjps\" (UniqueName: \"kubernetes.io/projected/12bfe226-e002-44c4-aaeb-0905603ccd18-kube-api-access-xdjps\") pod \"dns-default-rmhjs\" (UID: \"12bfe226-e002-44c4-aaeb-0905603ccd18\") " pod="openshift-dns/dns-default-rmhjs" Jun 09 15:14:55.484527 ip-10-0-130-232 kubenswrapper[2575]: I0609 15:14:55.484492 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/2e334ed6-e1c8-4008-9e24-dc9f3079be0a-cert\") pod \"ingress-canary-w28rj\" (UID: \"2e334ed6-e1c8-4008-9e24-dc9f3079be0a\") " pod="openshift-ingress-canary/ingress-canary-w28rj" Jun 09 15:14:55.484527 ip-10-0-130-232 kubenswrapper[2575]: I0609 15:14:55.484531 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-swx6f\" (UniqueName: \"kubernetes.io/projected/2e334ed6-e1c8-4008-9e24-dc9f3079be0a-kube-api-access-swx6f\") pod \"ingress-canary-w28rj\" (UID: \"2e334ed6-e1c8-4008-9e24-dc9f3079be0a\") " pod="openshift-ingress-canary/ingress-canary-w28rj" Jun 09 15:14:55.487606 ip-10-0-130-232 kubenswrapper[2575]: I0609 15:14:55.487583 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/2e334ed6-e1c8-4008-9e24-dc9f3079be0a-cert\") pod \"ingress-canary-w28rj\" (UID: \"2e334ed6-e1c8-4008-9e24-dc9f3079be0a\") " pod="openshift-ingress-canary/ingress-canary-w28rj" Jun 09 15:14:55.492672 ip-10-0-130-232 kubenswrapper[2575]: I0609 15:14:55.492649 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-swx6f\" (UniqueName: \"kubernetes.io/projected/2e334ed6-e1c8-4008-9e24-dc9f3079be0a-kube-api-access-swx6f\") pod \"ingress-canary-w28rj\" (UID: \"2e334ed6-e1c8-4008-9e24-dc9f3079be0a\") " pod="openshift-ingress-canary/ingress-canary-w28rj" Jun 09 15:14:55.528649 ip-10-0-130-232 kubenswrapper[2575]: I0609 15:14:55.528626 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-w28rj" Jun 09 15:14:55.690655 ip-10-0-130-232 kubenswrapper[2575]: I0609 15:14:55.690087 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-2k4nl" Jun 09 15:14:55.690655 ip-10-0-130-232 kubenswrapper[2575]: I0609 15:14:55.690093 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-5bg45" Jun 09 15:14:55.690655 ip-10-0-130-232 kubenswrapper[2575]: I0609 15:14:55.690228 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-bbf2c" Jun 09 15:14:55.693102 ip-10-0-130-232 kubenswrapper[2575]: I0609 15:14:55.693032 2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\"" Jun 09 15:14:55.693102 ip-10-0-130-232 kubenswrapper[2575]: I0609 15:14:55.693045 2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\"" Jun 09 15:14:55.693102 ip-10-0-130-232 kubenswrapper[2575]: I0609 15:14:55.693089 2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\"" Jun 09 15:14:55.693337 ip-10-0-130-232 kubenswrapper[2575]: I0609 15:14:55.693147 2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\"" Jun 09 15:14:55.693337 ip-10-0-130-232 kubenswrapper[2575]: I0609 15:14:55.693036 2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-p4lvv\"" Jun 09 15:14:55.693337 ip-10-0-130-232 kubenswrapper[2575]: I0609 15:14:55.693034 2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-zqn65\"" Jun 09 15:14:55.738008 ip-10-0-130-232 kubenswrapper[2575]: I0609 15:14:55.737945 2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-w28rj"] Jun 09 15:14:55.741216 ip-10-0-130-232 kubenswrapper[2575]: W0609 15:14:55.741190 2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2e334ed6_e1c8_4008_9e24_dc9f3079be0a.slice/crio-e6a11e8662d48de0c50f22be96b39434f93f9fcc9f112c2f4d6303e2dd7ad83a WatchSource:0}: Error finding container e6a11e8662d48de0c50f22be96b39434f93f9fcc9f112c2f4d6303e2dd7ad83a: Status 404 returned error can't find the container with id e6a11e8662d48de0c50f22be96b39434f93f9fcc9f112c2f4d6303e2dd7ad83a Jun 09 15:14:55.858297 ip-10-0-130-232 kubenswrapper[2575]: I0609 15:14:55.858258 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-w28rj" event={"ID":"2e334ed6-e1c8-4008-9e24-dc9f3079be0a","Type":"ContainerStarted","Data":"e6a11e8662d48de0c50f22be96b39434f93f9fcc9f112c2f4d6303e2dd7ad83a"} Jun 09 15:14:55.887650 ip-10-0-130-232 kubenswrapper[2575]: I0609 15:14:55.887616 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/12bfe226-e002-44c4-aaeb-0905603ccd18-metrics-tls\") pod \"dns-default-rmhjs\" (UID: \"12bfe226-e002-44c4-aaeb-0905603ccd18\") " pod="openshift-dns/dns-default-rmhjs" Jun 09 15:14:55.887784 ip-10-0-130-232 kubenswrapper[2575]: E0609 15:14:55.887758 2575 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jun 09 15:14:55.887838 ip-10-0-130-232 kubenswrapper[2575]: E0609 15:14:55.887833 2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/12bfe226-e002-44c4-aaeb-0905603ccd18-metrics-tls podName:12bfe226-e002-44c4-aaeb-0905603ccd18 nodeName:}" failed. No retries permitted until 2026-06-09 15:14:56.887817759 +0000 UTC m=+36.575823194 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/12bfe226-e002-44c4-aaeb-0905603ccd18-metrics-tls") pod "dns-default-rmhjs" (UID: "12bfe226-e002-44c4-aaeb-0905603ccd18") : secret "dns-default-metrics-tls" not found Jun 09 15:14:56.259180 ip-10-0-130-232 kubenswrapper[2575]: I0609 15:14:56.259146 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2bkzp_41532b1e-300d-4a9e-a64f-da302213062c/konnectivity-agent/0.log" limit=1024 Jun 09 15:14:56.316741 ip-10-0-130-232 kubenswrapper[2575]: I0609 15:14:56.316476 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2bkzp_41532b1e-300d-4a9e-a64f-da302213062c/konnectivity-agent/0.log" limit=1024 Jun 09 15:14:56.864140 ip-10-0-130-232 kubenswrapper[2575]: I0609 15:14:56.864111 2575 generic.go:356] "Generic (PLEG): container finished" podID="1982d388-abfa-4d4b-a126-34c01f86521d" containerID="cffdd9502cd44ca0fdf553f68ebede9e7be815dcf7d41b8014473076d4058048" exitCode=0 Jun 09 15:14:56.864326 ip-10-0-130-232 kubenswrapper[2575]: I0609 15:14:56.864178 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-knt8p" event={"ID":"1982d388-abfa-4d4b-a126-34c01f86521d","Type":"ContainerDied","Data":"cffdd9502cd44ca0fdf553f68ebede9e7be815dcf7d41b8014473076d4058048"} Jun 09 15:14:56.894483 ip-10-0-130-232 kubenswrapper[2575]: I0609 15:14:56.894459 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/12bfe226-e002-44c4-aaeb-0905603ccd18-metrics-tls\") pod \"dns-default-rmhjs\" (UID: \"12bfe226-e002-44c4-aaeb-0905603ccd18\") " pod="openshift-dns/dns-default-rmhjs" Jun 09 15:14:56.894612 ip-10-0-130-232 kubenswrapper[2575]: E0609 15:14:56.894596 2575 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jun 09 15:14:56.894686 ip-10-0-130-232 kubenswrapper[2575]: E0609 15:14:56.894676 2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/12bfe226-e002-44c4-aaeb-0905603ccd18-metrics-tls podName:12bfe226-e002-44c4-aaeb-0905603ccd18 nodeName:}" failed. No retries permitted until 2026-06-09 15:14:58.894657995 +0000 UTC m=+38.582663447 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/12bfe226-e002-44c4-aaeb-0905603ccd18-metrics-tls") pod "dns-default-rmhjs" (UID: "12bfe226-e002-44c4-aaeb-0905603ccd18") : secret "dns-default-metrics-tls" not found Jun 09 15:14:57.869495 ip-10-0-130-232 kubenswrapper[2575]: I0609 15:14:57.869464 2575 generic.go:356] "Generic (PLEG): container finished" podID="1982d388-abfa-4d4b-a126-34c01f86521d" containerID="9bc021e136d03dde9b18d8635a1c6473cb8e0487d105c249c85369fee3820e4f" exitCode=0 Jun 09 15:14:57.869871 ip-10-0-130-232 kubenswrapper[2575]: I0609 15:14:57.869505 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-knt8p" event={"ID":"1982d388-abfa-4d4b-a126-34c01f86521d","Type":"ContainerDied","Data":"9bc021e136d03dde9b18d8635a1c6473cb8e0487d105c249c85369fee3820e4f"} Jun 09 15:14:58.874945 ip-10-0-130-232 kubenswrapper[2575]: I0609 15:14:58.874909 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-knt8p" event={"ID":"1982d388-abfa-4d4b-a126-34c01f86521d","Type":"ContainerStarted","Data":"e5922e354fafc9f3e8f917f6be3920fd484957b59325a823ba2b723feea685c2"} Jun 09 15:14:58.876194 ip-10-0-130-232 kubenswrapper[2575]: I0609 15:14:58.876167 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-w28rj" event={"ID":"2e334ed6-e1c8-4008-9e24-dc9f3079be0a","Type":"ContainerStarted","Data":"38242593bdc28c15fd8180bc1f0570bca9c009d08a51acd17e8b8080a9234ee5"} Jun 09 15:14:58.895464 ip-10-0-130-232 kubenswrapper[2575]: I0609 15:14:58.895411 2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-additional-cni-plugins-knt8p" podStartSLOduration=8.882476313 podStartE2EDuration="38.89539814s" totalImagesPullingTime="30.012921827s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-09 15:14:20 +0000 UTC" imagePullSessionsCount=5 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-09 15:14:58.89427009 +0000 UTC m=+38.582275543" watchObservedRunningTime="2026-06-09 15:14:58.89539814 +0000 UTC m=+38.583403593" Jun 09 15:14:58.908022 ip-10-0-130-232 kubenswrapper[2575]: I0609 15:14:58.907974 2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress-canary/ingress-canary-w28rj" podStartSLOduration=1.37010724 podStartE2EDuration="3.90796275s" totalImagesPullingTime="2.53785551s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-09 15:14:55 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-09 15:14:58.90758027 +0000 UTC m=+38.595585722" watchObservedRunningTime="2026-06-09 15:14:58.90796275 +0000 UTC m=+38.595968203" Jun 09 15:14:58.911800 ip-10-0-130-232 kubenswrapper[2575]: I0609 15:14:58.911779 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/12bfe226-e002-44c4-aaeb-0905603ccd18-metrics-tls\") pod \"dns-default-rmhjs\" (UID: \"12bfe226-e002-44c4-aaeb-0905603ccd18\") " pod="openshift-dns/dns-default-rmhjs" Jun 09 15:14:58.911924 ip-10-0-130-232 kubenswrapper[2575]: E0609 15:14:58.911911 2575 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jun 09 15:14:58.911970 ip-10-0-130-232 kubenswrapper[2575]: E0609 15:14:58.911962 2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/12bfe226-e002-44c4-aaeb-0905603ccd18-metrics-tls podName:12bfe226-e002-44c4-aaeb-0905603ccd18 nodeName:}" failed. No retries permitted until 2026-06-09 15:15:02.911949863 +0000 UTC m=+42.599955294 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/12bfe226-e002-44c4-aaeb-0905603ccd18-metrics-tls") pod "dns-default-rmhjs" (UID: "12bfe226-e002-44c4-aaeb-0905603ccd18") : secret "dns-default-metrics-tls" not found Jun 09 15:14:59.124402 ip-10-0-130-232 kubenswrapper[2575]: I0609 15:14:59.124366 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2bkzp_41532b1e-300d-4a9e-a64f-da302213062c/konnectivity-agent/0.log" limit=1024 Jun 09 15:14:59.184222 ip-10-0-130-232 kubenswrapper[2575]: I0609 15:14:59.184150 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2bkzp_41532b1e-300d-4a9e-a64f-da302213062c/konnectivity-agent/0.log" limit=1024 Jun 09 15:15:00.919242 ip-10-0-130-232 kubenswrapper[2575]: I0609 15:15:00.919209 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2bkzp_41532b1e-300d-4a9e-a64f-da302213062c/konnectivity-agent/0.log" limit=1024 Jun 09 15:15:00.970776 ip-10-0-130-232 kubenswrapper[2575]: I0609 15:15:00.970742 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2bkzp_41532b1e-300d-4a9e-a64f-da302213062c/konnectivity-agent/0.log" limit=1024 Jun 09 15:15:01.963133 ip-10-0-130-232 kubenswrapper[2575]: I0609 15:15:01.963052 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2bkzp_41532b1e-300d-4a9e-a64f-da302213062c/konnectivity-agent/0.log" limit=1024 Jun 09 15:15:02.014715 ip-10-0-130-232 kubenswrapper[2575]: I0609 15:15:02.014684 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2bkzp_41532b1e-300d-4a9e-a64f-da302213062c/konnectivity-agent/0.log" limit=1024 Jun 09 15:15:02.937480 ip-10-0-130-232 kubenswrapper[2575]: I0609 15:15:02.937445 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/12bfe226-e002-44c4-aaeb-0905603ccd18-metrics-tls\") pod \"dns-default-rmhjs\" (UID: \"12bfe226-e002-44c4-aaeb-0905603ccd18\") " pod="openshift-dns/dns-default-rmhjs" Jun 09 15:15:02.937656 ip-10-0-130-232 kubenswrapper[2575]: E0609 15:15:02.937579 2575 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jun 09 15:15:02.937701 ip-10-0-130-232 kubenswrapper[2575]: E0609 15:15:02.937658 2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/12bfe226-e002-44c4-aaeb-0905603ccd18-metrics-tls podName:12bfe226-e002-44c4-aaeb-0905603ccd18 nodeName:}" failed. No retries permitted until 2026-06-09 15:15:10.937641628 +0000 UTC m=+50.625647060 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/12bfe226-e002-44c4-aaeb-0905603ccd18-metrics-tls") pod "dns-default-rmhjs" (UID: "12bfe226-e002-44c4-aaeb-0905603ccd18") : secret "dns-default-metrics-tls" not found Jun 09 15:15:05.881973 ip-10-0-130-232 kubenswrapper[2575]: I0609 15:15:05.881941 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2bkzp_41532b1e-300d-4a9e-a64f-da302213062c/konnectivity-agent/0.log" limit=1024 Jun 09 15:15:07.137054 ip-10-0-130-232 kubenswrapper[2575]: I0609 15:15:07.137026 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2bkzp_41532b1e-300d-4a9e-a64f-da302213062c/konnectivity-agent/0.log" limit=1024 Jun 09 15:15:07.189405 ip-10-0-130-232 kubenswrapper[2575]: I0609 15:15:07.189374 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2bkzp_41532b1e-300d-4a9e-a64f-da302213062c/konnectivity-agent/0.log" limit=1024 Jun 09 15:15:09.057861 ip-10-0-130-232 kubenswrapper[2575]: I0609 15:15:09.057818 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2bkzp_41532b1e-300d-4a9e-a64f-da302213062c/konnectivity-agent/0.log" limit=1024 Jun 09 15:15:09.116318 ip-10-0-130-232 kubenswrapper[2575]: I0609 15:15:09.116286 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2bkzp_41532b1e-300d-4a9e-a64f-da302213062c/konnectivity-agent/0.log" limit=1024 Jun 09 15:15:10.999898 ip-10-0-130-232 kubenswrapper[2575]: I0609 15:15:10.999867 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/12bfe226-e002-44c4-aaeb-0905603ccd18-metrics-tls\") pod \"dns-default-rmhjs\" (UID: \"12bfe226-e002-44c4-aaeb-0905603ccd18\") " pod="openshift-dns/dns-default-rmhjs" Jun 09 15:15:11.000409 ip-10-0-130-232 kubenswrapper[2575]: E0609 15:15:11.000001 2575 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jun 09 15:15:11.000409 ip-10-0-130-232 kubenswrapper[2575]: E0609 15:15:11.000073 2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/12bfe226-e002-44c4-aaeb-0905603ccd18-metrics-tls podName:12bfe226-e002-44c4-aaeb-0905603ccd18 nodeName:}" failed. No retries permitted until 2026-06-09 15:15:27.000054611 +0000 UTC m=+66.688060072 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/12bfe226-e002-44c4-aaeb-0905603ccd18-metrics-tls") pod "dns-default-rmhjs" (UID: "12bfe226-e002-44c4-aaeb-0905603ccd18") : secret "dns-default-metrics-tls" not found Jun 09 15:15:13.125952 ip-10-0-130-232 kubenswrapper[2575]: I0609 15:15:13.125920 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2bkzp_41532b1e-300d-4a9e-a64f-da302213062c/konnectivity-agent/0.log" limit=1024 Jun 09 15:15:13.179829 ip-10-0-130-232 kubenswrapper[2575]: I0609 15:15:13.179800 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2bkzp_41532b1e-300d-4a9e-a64f-da302213062c/konnectivity-agent/0.log" limit=1024 Jun 09 15:15:16.993719 ip-10-0-130-232 kubenswrapper[2575]: I0609 15:15:16.993679 2575 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["open-cluster-management-agent-addon/cluster-proxy-proxy-agent-78c9f9fbb-mwpt8"] Jun 09 15:15:17.028402 ip-10-0-130-232 kubenswrapper[2575]: I0609 15:15:17.028345 2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/cluster-proxy-proxy-agent-78c9f9fbb-mwpt8"] Jun 09 15:15:17.028533 ip-10-0-130-232 kubenswrapper[2575]: I0609 15:15:17.028470 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-78c9f9fbb-mwpt8" Jun 09 15:15:17.030733 ip-10-0-130-232 kubenswrapper[2575]: I0609 15:15:17.030706 2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"cluster-proxy-ca\"" Jun 09 15:15:17.030932 ip-10-0-130-232 kubenswrapper[2575]: I0609 15:15:17.030787 2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"open-cluster-management-agent-addon\"/\"openshift-service-ca.crt\"" Jun 09 15:15:17.030932 ip-10-0-130-232 kubenswrapper[2575]: I0609 15:15:17.030816 2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"cluster-proxy-open-cluster-management.io-proxy-agent-signer-client-cert\"" Jun 09 15:15:17.030932 ip-10-0-130-232 kubenswrapper[2575]: I0609 15:15:17.030861 2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"cluster-proxy-hub-kubeconfig\"" Jun 09 15:15:17.031145 ip-10-0-130-232 kubenswrapper[2575]: I0609 15:15:17.031045 2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"open-cluster-management-image-pull-credentials\"" Jun 09 15:15:17.031145 ip-10-0-130-232 kubenswrapper[2575]: I0609 15:15:17.031124 2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"cluster-proxy-service-proxy-server-certificates\"" Jun 09 15:15:17.031248 ip-10-0-130-232 kubenswrapper[2575]: I0609 15:15:17.031206 2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"open-cluster-management-agent-addon\"/\"kube-root-ca.crt\"" Jun 09 15:15:17.038000 ip-10-0-130-232 kubenswrapper[2575]: I0609 15:15:17.037675 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ca\" (UniqueName: \"kubernetes.io/secret/ac1d9517-d30b-461a-866c-6d4639ae663c-ca\") pod \"cluster-proxy-proxy-agent-78c9f9fbb-mwpt8\" (UID: \"ac1d9517-d30b-461a-866c-6d4639ae663c\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-78c9f9fbb-mwpt8" Jun 09 15:15:17.038000 ip-10-0-130-232 kubenswrapper[2575]: I0609 15:15:17.037741 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hub\" (UniqueName: \"kubernetes.io/secret/ac1d9517-d30b-461a-866c-6d4639ae663c-hub\") pod \"cluster-proxy-proxy-agent-78c9f9fbb-mwpt8\" (UID: \"ac1d9517-d30b-461a-866c-6d4639ae663c\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-78c9f9fbb-mwpt8" Jun 09 15:15:17.038000 ip-10-0-130-232 kubenswrapper[2575]: I0609 15:15:17.037765 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"additional-service-ca\" (UniqueName: \"kubernetes.io/configmap/ac1d9517-d30b-461a-866c-6d4639ae663c-additional-service-ca\") pod \"cluster-proxy-proxy-agent-78c9f9fbb-mwpt8\" (UID: \"ac1d9517-d30b-461a-866c-6d4639ae663c\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-78c9f9fbb-mwpt8" Jun 09 15:15:17.038000 ip-10-0-130-232 kubenswrapper[2575]: I0609 15:15:17.037789 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-f5h8j\" (UniqueName: \"kubernetes.io/projected/ac1d9517-d30b-461a-866c-6d4639ae663c-kube-api-access-f5h8j\") pod \"cluster-proxy-proxy-agent-78c9f9fbb-mwpt8\" (UID: \"ac1d9517-d30b-461a-866c-6d4639ae663c\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-78c9f9fbb-mwpt8" Jun 09 15:15:17.038000 ip-10-0-130-232 kubenswrapper[2575]: I0609 15:15:17.037872 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-proxy-server-cert\" (UniqueName: \"kubernetes.io/secret/ac1d9517-d30b-461a-866c-6d4639ae663c-service-proxy-server-cert\") pod \"cluster-proxy-proxy-agent-78c9f9fbb-mwpt8\" (UID: \"ac1d9517-d30b-461a-866c-6d4639ae663c\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-78c9f9fbb-mwpt8" Jun 09 15:15:17.038000 ip-10-0-130-232 kubenswrapper[2575]: I0609 15:15:17.037901 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/ac1d9517-d30b-461a-866c-6d4639ae663c-hub-kubeconfig\") pod \"cluster-proxy-proxy-agent-78c9f9fbb-mwpt8\" (UID: \"ac1d9517-d30b-461a-866c-6d4639ae663c\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-78c9f9fbb-mwpt8" Jun 09 15:15:17.138319 ip-10-0-130-232 kubenswrapper[2575]: I0609 15:15:17.138278 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ca\" (UniqueName: \"kubernetes.io/secret/ac1d9517-d30b-461a-866c-6d4639ae663c-ca\") pod \"cluster-proxy-proxy-agent-78c9f9fbb-mwpt8\" (UID: \"ac1d9517-d30b-461a-866c-6d4639ae663c\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-78c9f9fbb-mwpt8" Jun 09 15:15:17.138469 ip-10-0-130-232 kubenswrapper[2575]: I0609 15:15:17.138354 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hub\" (UniqueName: \"kubernetes.io/secret/ac1d9517-d30b-461a-866c-6d4639ae663c-hub\") pod \"cluster-proxy-proxy-agent-78c9f9fbb-mwpt8\" (UID: \"ac1d9517-d30b-461a-866c-6d4639ae663c\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-78c9f9fbb-mwpt8" Jun 09 15:15:17.138469 ip-10-0-130-232 kubenswrapper[2575]: I0609 15:15:17.138383 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"additional-service-ca\" (UniqueName: \"kubernetes.io/configmap/ac1d9517-d30b-461a-866c-6d4639ae663c-additional-service-ca\") pod \"cluster-proxy-proxy-agent-78c9f9fbb-mwpt8\" (UID: \"ac1d9517-d30b-461a-866c-6d4639ae663c\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-78c9f9fbb-mwpt8" Jun 09 15:15:17.138469 ip-10-0-130-232 kubenswrapper[2575]: I0609 15:15:17.138407 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-f5h8j\" (UniqueName: \"kubernetes.io/projected/ac1d9517-d30b-461a-866c-6d4639ae663c-kube-api-access-f5h8j\") pod \"cluster-proxy-proxy-agent-78c9f9fbb-mwpt8\" (UID: \"ac1d9517-d30b-461a-866c-6d4639ae663c\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-78c9f9fbb-mwpt8" Jun 09 15:15:17.138590 ip-10-0-130-232 kubenswrapper[2575]: I0609 15:15:17.138554 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-proxy-server-cert\" (UniqueName: \"kubernetes.io/secret/ac1d9517-d30b-461a-866c-6d4639ae663c-service-proxy-server-cert\") pod \"cluster-proxy-proxy-agent-78c9f9fbb-mwpt8\" (UID: \"ac1d9517-d30b-461a-866c-6d4639ae663c\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-78c9f9fbb-mwpt8" Jun 09 15:15:17.138642 ip-10-0-130-232 kubenswrapper[2575]: I0609 15:15:17.138595 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/ac1d9517-d30b-461a-866c-6d4639ae663c-hub-kubeconfig\") pod \"cluster-proxy-proxy-agent-78c9f9fbb-mwpt8\" (UID: \"ac1d9517-d30b-461a-866c-6d4639ae663c\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-78c9f9fbb-mwpt8" Jun 09 15:15:17.139260 ip-10-0-130-232 kubenswrapper[2575]: I0609 15:15:17.139231 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"additional-service-ca\" (UniqueName: \"kubernetes.io/configmap/ac1d9517-d30b-461a-866c-6d4639ae663c-additional-service-ca\") pod \"cluster-proxy-proxy-agent-78c9f9fbb-mwpt8\" (UID: \"ac1d9517-d30b-461a-866c-6d4639ae663c\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-78c9f9fbb-mwpt8" Jun 09 15:15:17.142308 ip-10-0-130-232 kubenswrapper[2575]: I0609 15:15:17.142284 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ca\" (UniqueName: \"kubernetes.io/secret/ac1d9517-d30b-461a-866c-6d4639ae663c-ca\") pod \"cluster-proxy-proxy-agent-78c9f9fbb-mwpt8\" (UID: \"ac1d9517-d30b-461a-866c-6d4639ae663c\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-78c9f9fbb-mwpt8" Jun 09 15:15:17.142419 ip-10-0-130-232 kubenswrapper[2575]: I0609 15:15:17.142355 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-proxy-server-cert\" (UniqueName: \"kubernetes.io/secret/ac1d9517-d30b-461a-866c-6d4639ae663c-service-proxy-server-cert\") pod \"cluster-proxy-proxy-agent-78c9f9fbb-mwpt8\" (UID: \"ac1d9517-d30b-461a-866c-6d4639ae663c\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-78c9f9fbb-mwpt8" Jun 09 15:15:17.142419 ip-10-0-130-232 kubenswrapper[2575]: I0609 15:15:17.142368 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/ac1d9517-d30b-461a-866c-6d4639ae663c-hub-kubeconfig\") pod \"cluster-proxy-proxy-agent-78c9f9fbb-mwpt8\" (UID: \"ac1d9517-d30b-461a-866c-6d4639ae663c\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-78c9f9fbb-mwpt8" Jun 09 15:15:17.142492 ip-10-0-130-232 kubenswrapper[2575]: I0609 15:15:17.142464 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"hub\" (UniqueName: \"kubernetes.io/secret/ac1d9517-d30b-461a-866c-6d4639ae663c-hub\") pod \"cluster-proxy-proxy-agent-78c9f9fbb-mwpt8\" (UID: \"ac1d9517-d30b-461a-866c-6d4639ae663c\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-78c9f9fbb-mwpt8" Jun 09 15:15:17.145180 ip-10-0-130-232 kubenswrapper[2575]: I0609 15:15:17.145157 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-f5h8j\" (UniqueName: \"kubernetes.io/projected/ac1d9517-d30b-461a-866c-6d4639ae663c-kube-api-access-f5h8j\") pod \"cluster-proxy-proxy-agent-78c9f9fbb-mwpt8\" (UID: \"ac1d9517-d30b-461a-866c-6d4639ae663c\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-78c9f9fbb-mwpt8" Jun 09 15:15:17.360090 ip-10-0-130-232 kubenswrapper[2575]: I0609 15:15:17.360019 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-78c9f9fbb-mwpt8" Jun 09 15:15:17.498163 ip-10-0-130-232 kubenswrapper[2575]: I0609 15:15:17.498122 2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/cluster-proxy-proxy-agent-78c9f9fbb-mwpt8"] Jun 09 15:15:17.501104 ip-10-0-130-232 kubenswrapper[2575]: W0609 15:15:17.501072 2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podac1d9517_d30b_461a_866c_6d4639ae663c.slice/crio-c77c90be22aa9fd73110ac5fcb041885a4996f4e842204dc8c0617a33984dedb WatchSource:0}: Error finding container c77c90be22aa9fd73110ac5fcb041885a4996f4e842204dc8c0617a33984dedb: Status 404 returned error can't find the container with id c77c90be22aa9fd73110ac5fcb041885a4996f4e842204dc8c0617a33984dedb Jun 09 15:15:17.923223 ip-10-0-130-232 kubenswrapper[2575]: I0609 15:15:17.923184 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-78c9f9fbb-mwpt8" event={"ID":"ac1d9517-d30b-461a-866c-6d4639ae663c","Type":"ContainerStarted","Data":"c77c90be22aa9fd73110ac5fcb041885a4996f4e842204dc8c0617a33984dedb"} Jun 09 15:15:18.689183 ip-10-0-130-232 kubenswrapper[2575]: I0609 15:15:18.689149 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2bkzp_41532b1e-300d-4a9e-a64f-da302213062c/konnectivity-agent/0.log" limit=1024 Jun 09 15:15:19.027504 ip-10-0-130-232 kubenswrapper[2575]: I0609 15:15:19.027450 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2bkzp_41532b1e-300d-4a9e-a64f-da302213062c/konnectivity-agent/0.log" limit=1024 Jun 09 15:15:19.126170 ip-10-0-130-232 kubenswrapper[2575]: I0609 15:15:19.126134 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2bkzp_41532b1e-300d-4a9e-a64f-da302213062c/konnectivity-agent/0.log" limit=1024 Jun 09 15:15:21.935417 ip-10-0-130-232 kubenswrapper[2575]: I0609 15:15:21.935332 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-78c9f9fbb-mwpt8" event={"ID":"ac1d9517-d30b-461a-866c-6d4639ae663c","Type":"ContainerStarted","Data":"769a3da91a99a2250789ee17667ac7436fa4d5372ca916aa8d6ac59536e1141f"} Jun 09 15:15:21.935417 ip-10-0-130-232 kubenswrapper[2575]: I0609 15:15:21.935373 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-78c9f9fbb-mwpt8" event={"ID":"ac1d9517-d30b-461a-866c-6d4639ae663c","Type":"ContainerStarted","Data":"2ca58a91b200cfe5ff77872a68c3c0b8b5355f956e54df46a118dd2c30fab7af"} Jun 09 15:15:21.935417 ip-10-0-130-232 kubenswrapper[2575]: I0609 15:15:21.935385 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-78c9f9fbb-mwpt8" event={"ID":"ac1d9517-d30b-461a-866c-6d4639ae663c","Type":"ContainerStarted","Data":"ada42ebb06c85f41b1fc9f598b5fc1b0fb111d384b71321759ddff35233acbb1"} Jun 09 15:15:21.952501 ip-10-0-130-232 kubenswrapper[2575]: I0609 15:15:21.952454 2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-78c9f9fbb-mwpt8" podStartSLOduration=1.933133734 podStartE2EDuration="5.95244036s" totalImagesPullingTime="4.019306626s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-09 15:15:16 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-09 15:15:21.95197978 +0000 UTC m=+61.639985233" watchObservedRunningTime="2026-06-09 15:15:21.95244036 +0000 UTC m=+61.640445812" Jun 09 15:15:23.863895 ip-10-0-130-232 kubenswrapper[2575]: I0609 15:15:23.863867 2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-lb2zn" Jun 09 15:15:24.011615 ip-10-0-130-232 kubenswrapper[2575]: I0609 15:15:24.011576 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2bkzp_41532b1e-300d-4a9e-a64f-da302213062c/konnectivity-agent/0.log" limit=1024 Jun 09 15:15:24.061997 ip-10-0-130-232 kubenswrapper[2575]: I0609 15:15:24.061964 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2bkzp_41532b1e-300d-4a9e-a64f-da302213062c/konnectivity-agent/0.log" limit=1024 Jun 09 15:15:26.408450 ip-10-0-130-232 kubenswrapper[2575]: I0609 15:15:26.408403 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/8eda6a9f-b4cc-403f-a284-8a9cd10e8f15-metrics-certs\") pod \"network-metrics-daemon-5bg45\" (UID: \"8eda6a9f-b4cc-403f-a284-8a9cd10e8f15\") " pod="openshift-multus/network-metrics-daemon-5bg45" Jun 09 15:15:26.408450 ip-10-0-130-232 kubenswrapper[2575]: I0609 15:15:26.408462 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-dmj2n\" (UniqueName: \"kubernetes.io/projected/e519f3d3-552b-482d-88b5-74b1d17e3bce-kube-api-access-dmj2n\") pod \"network-check-target-bbf2c\" (UID: \"e519f3d3-552b-482d-88b5-74b1d17e3bce\") " pod="openshift-network-diagnostics/network-check-target-bbf2c" Jun 09 15:15:26.410352 ip-10-0-130-232 kubenswrapper[2575]: I0609 15:15:26.410332 2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\"" Jun 09 15:15:26.410475 ip-10-0-130-232 kubenswrapper[2575]: I0609 15:15:26.410458 2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\"" Jun 09 15:15:26.418810 ip-10-0-130-232 kubenswrapper[2575]: E0609 15:15:26.418794 2575 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: secret "metrics-daemon-secret" not found Jun 09 15:15:26.418901 ip-10-0-130-232 kubenswrapper[2575]: E0609 15:15:26.418887 2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/8eda6a9f-b4cc-403f-a284-8a9cd10e8f15-metrics-certs podName:8eda6a9f-b4cc-403f-a284-8a9cd10e8f15 nodeName:}" failed. No retries permitted until 2026-06-09 15:16:30.418863473 +0000 UTC m=+130.106868922 (durationBeforeRetry 1m4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/8eda6a9f-b4cc-403f-a284-8a9cd10e8f15-metrics-certs") pod "network-metrics-daemon-5bg45" (UID: "8eda6a9f-b4cc-403f-a284-8a9cd10e8f15") : secret "metrics-daemon-secret" not found Jun 09 15:15:26.420260 ip-10-0-130-232 kubenswrapper[2575]: I0609 15:15:26.420244 2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\"" Jun 09 15:15:26.431962 ip-10-0-130-232 kubenswrapper[2575]: I0609 15:15:26.431936 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-dmj2n\" (UniqueName: \"kubernetes.io/projected/e519f3d3-552b-482d-88b5-74b1d17e3bce-kube-api-access-dmj2n\") pod \"network-check-target-bbf2c\" (UID: \"e519f3d3-552b-482d-88b5-74b1d17e3bce\") " pod="openshift-network-diagnostics/network-check-target-bbf2c" Jun 09 15:15:26.509058 ip-10-0-130-232 kubenswrapper[2575]: I0609 15:15:26.509021 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/0ee786d7-9e46-4cf0-add7-db4ff254d57b-original-pull-secret\") pod \"global-pull-secret-syncer-2k4nl\" (UID: \"0ee786d7-9e46-4cf0-add7-db4ff254d57b\") " pod="kube-system/global-pull-secret-syncer-2k4nl" Jun 09 15:15:26.510814 ip-10-0-130-232 kubenswrapper[2575]: I0609 15:15:26.510797 2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\"" Jun 09 15:15:26.522230 ip-10-0-130-232 kubenswrapper[2575]: I0609 15:15:26.522210 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/0ee786d7-9e46-4cf0-add7-db4ff254d57b-original-pull-secret\") pod \"global-pull-secret-syncer-2k4nl\" (UID: \"0ee786d7-9e46-4cf0-add7-db4ff254d57b\") " pod="kube-system/global-pull-secret-syncer-2k4nl" Jun 09 15:15:26.602736 ip-10-0-130-232 kubenswrapper[2575]: I0609 15:15:26.602701 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-2k4nl" Jun 09 15:15:26.616517 ip-10-0-130-232 kubenswrapper[2575]: I0609 15:15:26.616495 2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-zqn65\"" Jun 09 15:15:26.625065 ip-10-0-130-232 kubenswrapper[2575]: I0609 15:15:26.625047 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-bbf2c" Jun 09 15:15:26.731814 ip-10-0-130-232 kubenswrapper[2575]: I0609 15:15:26.731784 2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-2k4nl"] Jun 09 15:15:26.734981 ip-10-0-130-232 kubenswrapper[2575]: W0609 15:15:26.734957 2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0ee786d7_9e46_4cf0_add7_db4ff254d57b.slice/crio-00c373dc3a0dcc7ebd09abbcca94226f8f9556de2243ac72d4730ed327a89db1 WatchSource:0}: Error finding container 00c373dc3a0dcc7ebd09abbcca94226f8f9556de2243ac72d4730ed327a89db1: Status 404 returned error can't find the container with id 00c373dc3a0dcc7ebd09abbcca94226f8f9556de2243ac72d4730ed327a89db1 Jun 09 15:15:26.747934 ip-10-0-130-232 kubenswrapper[2575]: I0609 15:15:26.747905 2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-bbf2c"] Jun 09 15:15:26.750973 ip-10-0-130-232 kubenswrapper[2575]: W0609 15:15:26.750951 2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode519f3d3_552b_482d_88b5_74b1d17e3bce.slice/crio-1629f5a38070df3a0a1207a88d20a35002eb89def62efc290e0f141c821f1ddd WatchSource:0}: Error finding container 1629f5a38070df3a0a1207a88d20a35002eb89def62efc290e0f141c821f1ddd: Status 404 returned error can't find the container with id 1629f5a38070df3a0a1207a88d20a35002eb89def62efc290e0f141c821f1ddd Jun 09 15:15:26.948208 ip-10-0-130-232 kubenswrapper[2575]: I0609 15:15:26.948126 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-2k4nl" event={"ID":"0ee786d7-9e46-4cf0-add7-db4ff254d57b","Type":"ContainerStarted","Data":"00c373dc3a0dcc7ebd09abbcca94226f8f9556de2243ac72d4730ed327a89db1"} Jun 09 15:15:26.949179 ip-10-0-130-232 kubenswrapper[2575]: I0609 15:15:26.949155 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-bbf2c" event={"ID":"e519f3d3-552b-482d-88b5-74b1d17e3bce","Type":"ContainerStarted","Data":"1629f5a38070df3a0a1207a88d20a35002eb89def62efc290e0f141c821f1ddd"} Jun 09 15:15:27.012988 ip-10-0-130-232 kubenswrapper[2575]: I0609 15:15:27.012957 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/12bfe226-e002-44c4-aaeb-0905603ccd18-metrics-tls\") pod \"dns-default-rmhjs\" (UID: \"12bfe226-e002-44c4-aaeb-0905603ccd18\") " pod="openshift-dns/dns-default-rmhjs" Jun 09 15:15:27.013126 ip-10-0-130-232 kubenswrapper[2575]: E0609 15:15:27.013056 2575 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jun 09 15:15:27.013126 ip-10-0-130-232 kubenswrapper[2575]: E0609 15:15:27.013117 2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/12bfe226-e002-44c4-aaeb-0905603ccd18-metrics-tls podName:12bfe226-e002-44c4-aaeb-0905603ccd18 nodeName:}" failed. No retries permitted until 2026-06-09 15:15:59.013102979 +0000 UTC m=+98.701108410 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/12bfe226-e002-44c4-aaeb-0905603ccd18-metrics-tls") pod "dns-default-rmhjs" (UID: "12bfe226-e002-44c4-aaeb-0905603ccd18") : secret "dns-default-metrics-tls" not found Jun 09 15:15:31.965150 ip-10-0-130-232 kubenswrapper[2575]: I0609 15:15:31.965111 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-2k4nl" event={"ID":"0ee786d7-9e46-4cf0-add7-db4ff254d57b","Type":"ContainerStarted","Data":"5e4873ea338d68d5a7a86cd69f27f045f7b0174f63fd16314889a0f7384dd1bf"} Jun 09 15:15:31.966673 ip-10-0-130-232 kubenswrapper[2575]: I0609 15:15:31.966646 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-bbf2c" event={"ID":"e519f3d3-552b-482d-88b5-74b1d17e3bce","Type":"ContainerStarted","Data":"1070aa4b55defc31d1758c66a82fe32234e144248f633e611a35370756a8b784"} Jun 09 15:15:31.966797 ip-10-0-130-232 kubenswrapper[2575]: I0609 15:15:31.966780 2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-network-diagnostics/network-check-target-bbf2c" Jun 09 15:15:31.982372 ip-10-0-130-232 kubenswrapper[2575]: I0609 15:15:31.982324 2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/global-pull-secret-syncer-2k4nl" podStartSLOduration=66.915292515 podStartE2EDuration="1m11.982310229s" totalImagesPullingTime="5.067017714s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-09 15:14:20 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-09 15:15:31.982223432 +0000 UTC m=+71.670228899" watchObservedRunningTime="2026-06-09 15:15:31.982310229 +0000 UTC m=+71.670315682" Jun 09 15:15:31.997382 ip-10-0-130-232 kubenswrapper[2575]: I0609 15:15:31.997334 2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-diagnostics/network-check-target-bbf2c" podStartSLOduration=67.254703301 podStartE2EDuration="1m11.997321397s" totalImagesPullingTime="4.742618096s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-09 15:14:20 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-09 15:15:31.997283271 +0000 UTC m=+71.685288725" watchObservedRunningTime="2026-06-09 15:15:31.997321397 +0000 UTC m=+71.685326850" Jun 09 15:15:39.995960 ip-10-0-130-232 kubenswrapper[2575]: I0609 15:15:39.995826 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2bkzp_41532b1e-300d-4a9e-a64f-da302213062c/konnectivity-agent/0.log" limit=1024 Jun 09 15:15:40.053226 ip-10-0-130-232 kubenswrapper[2575]: I0609 15:15:40.053171 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2bkzp_41532b1e-300d-4a9e-a64f-da302213062c/konnectivity-agent/0.log" limit=1024 Jun 09 15:15:59.030524 ip-10-0-130-232 kubenswrapper[2575]: I0609 15:15:59.030474 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/12bfe226-e002-44c4-aaeb-0905603ccd18-metrics-tls\") pod \"dns-default-rmhjs\" (UID: \"12bfe226-e002-44c4-aaeb-0905603ccd18\") " pod="openshift-dns/dns-default-rmhjs" Jun 09 15:15:59.031021 ip-10-0-130-232 kubenswrapper[2575]: E0609 15:15:59.030621 2575 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jun 09 15:15:59.031021 ip-10-0-130-232 kubenswrapper[2575]: E0609 15:15:59.030707 2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/12bfe226-e002-44c4-aaeb-0905603ccd18-metrics-tls podName:12bfe226-e002-44c4-aaeb-0905603ccd18 nodeName:}" failed. No retries permitted until 2026-06-09 15:17:03.030688889 +0000 UTC m=+162.718694320 (durationBeforeRetry 1m4s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/12bfe226-e002-44c4-aaeb-0905603ccd18-metrics-tls") pod "dns-default-rmhjs" (UID: "12bfe226-e002-44c4-aaeb-0905603ccd18") : secret "dns-default-metrics-tls" not found Jun 09 15:16:02.974215 ip-10-0-130-232 kubenswrapper[2575]: I0609 15:16:02.974187 2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-network-diagnostics/network-check-target-bbf2c" Jun 09 15:16:30.434181 ip-10-0-130-232 kubenswrapper[2575]: I0609 15:16:30.434146 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/8eda6a9f-b4cc-403f-a284-8a9cd10e8f15-metrics-certs\") pod \"network-metrics-daemon-5bg45\" (UID: \"8eda6a9f-b4cc-403f-a284-8a9cd10e8f15\") " pod="openshift-multus/network-metrics-daemon-5bg45" Jun 09 15:16:30.434623 ip-10-0-130-232 kubenswrapper[2575]: E0609 15:16:30.434243 2575 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: secret "metrics-daemon-secret" not found Jun 09 15:16:30.434623 ip-10-0-130-232 kubenswrapper[2575]: E0609 15:16:30.434306 2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/8eda6a9f-b4cc-403f-a284-8a9cd10e8f15-metrics-certs podName:8eda6a9f-b4cc-403f-a284-8a9cd10e8f15 nodeName:}" failed. No retries permitted until 2026-06-09 15:18:32.434293013 +0000 UTC m=+252.122298446 (durationBeforeRetry 2m2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/8eda6a9f-b4cc-403f-a284-8a9cd10e8f15-metrics-certs") pod "network-metrics-daemon-5bg45" (UID: "8eda6a9f-b4cc-403f-a284-8a9cd10e8f15") : secret "metrics-daemon-secret" not found Jun 09 15:16:58.212358 ip-10-0-130-232 kubenswrapper[2575]: E0609 15:16:58.212319 2575 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[metrics-tls], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-dns/dns-default-rmhjs" podUID="12bfe226-e002-44c4-aaeb-0905603ccd18" Jun 09 15:16:58.708924 ip-10-0-130-232 kubenswrapper[2575]: E0609 15:16:58.708885 2575 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[metrics-certs], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-multus/network-metrics-daemon-5bg45" podUID="8eda6a9f-b4cc-403f-a284-8a9cd10e8f15" Jun 09 15:16:59.207625 ip-10-0-130-232 kubenswrapper[2575]: I0609 15:16:59.207592 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-rmhjs" Jun 09 15:17:03.057510 ip-10-0-130-232 kubenswrapper[2575]: I0609 15:17:03.057477 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/12bfe226-e002-44c4-aaeb-0905603ccd18-metrics-tls\") pod \"dns-default-rmhjs\" (UID: \"12bfe226-e002-44c4-aaeb-0905603ccd18\") " pod="openshift-dns/dns-default-rmhjs" Jun 09 15:17:03.057982 ip-10-0-130-232 kubenswrapper[2575]: E0609 15:17:03.057605 2575 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jun 09 15:17:03.057982 ip-10-0-130-232 kubenswrapper[2575]: E0609 15:17:03.057657 2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/12bfe226-e002-44c4-aaeb-0905603ccd18-metrics-tls podName:12bfe226-e002-44c4-aaeb-0905603ccd18 nodeName:}" failed. No retries permitted until 2026-06-09 15:19:05.057643087 +0000 UTC m=+284.745648518 (durationBeforeRetry 2m2s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/12bfe226-e002-44c4-aaeb-0905603ccd18-metrics-tls") pod "dns-default-rmhjs" (UID: "12bfe226-e002-44c4-aaeb-0905603ccd18") : secret "dns-default-metrics-tls" not found Jun 09 15:17:11.690335 ip-10-0-130-232 kubenswrapper[2575]: I0609 15:17:11.690240 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-5bg45" Jun 09 15:17:32.230562 ip-10-0-130-232 kubenswrapper[2575]: I0609 15:17:32.230525 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2bkzp_41532b1e-300d-4a9e-a64f-da302213062c/konnectivity-agent/0.log" limit=1024 Jun 09 15:17:34.395664 ip-10-0-130-232 kubenswrapper[2575]: I0609 15:17:34.395634 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2bkzp_41532b1e-300d-4a9e-a64f-da302213062c/konnectivity-agent/0.log" limit=1024 Jun 09 15:18:02.937586 ip-10-0-130-232 kubenswrapper[2575]: I0609 15:18:02.937552 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2bkzp_41532b1e-300d-4a9e-a64f-da302213062c/konnectivity-agent/0.log" limit=1024 Jun 09 15:18:02.976454 ip-10-0-130-232 kubenswrapper[2575]: I0609 15:18:02.976426 2575 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-cluster-storage-operator/volume-data-source-validator-78dd696465-stx2f"] Jun 09 15:18:02.979175 ip-10-0-130-232 kubenswrapper[2575]: I0609 15:18:02.979159 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-storage-operator/volume-data-source-validator-78dd696465-stx2f" Jun 09 15:18:02.981392 ip-10-0-130-232 kubenswrapper[2575]: I0609 15:18:02.981368 2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-storage-operator\"/\"kube-root-ca.crt\"" Jun 09 15:18:02.982002 ip-10-0-130-232 kubenswrapper[2575]: I0609 15:18:02.981973 2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-storage-operator\"/\"volume-data-source-validator-dockercfg-c2whl\"" Jun 09 15:18:02.982002 ip-10-0-130-232 kubenswrapper[2575]: I0609 15:18:02.981996 2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-storage-operator\"/\"openshift-service-ca.crt\"" Jun 09 15:18:02.987408 ip-10-0-130-232 kubenswrapper[2575]: I0609 15:18:02.987389 2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-cluster-storage-operator/volume-data-source-validator-78dd696465-stx2f"] Jun 09 15:18:03.037073 ip-10-0-130-232 kubenswrapper[2575]: I0609 15:18:03.037035 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2bkzp_41532b1e-300d-4a9e-a64f-da302213062c/konnectivity-agent/0.log" limit=1024 Jun 09 15:18:03.084835 ip-10-0-130-232 kubenswrapper[2575]: I0609 15:18:03.084795 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4kv2z\" (UniqueName: \"kubernetes.io/projected/043d1104-213e-4a54-900c-95a4bc6e10be-kube-api-access-4kv2z\") pod \"volume-data-source-validator-78dd696465-stx2f\" (UID: \"043d1104-213e-4a54-900c-95a4bc6e10be\") " pod="openshift-cluster-storage-operator/volume-data-source-validator-78dd696465-stx2f" Jun 09 15:18:03.140155 ip-10-0-130-232 kubenswrapper[2575]: I0609 15:18:03.140121 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2bkzp_41532b1e-300d-4a9e-a64f-da302213062c/konnectivity-agent/0.log" limit=1024 Jun 09 15:18:03.185178 ip-10-0-130-232 kubenswrapper[2575]: I0609 15:18:03.185148 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4kv2z\" (UniqueName: \"kubernetes.io/projected/043d1104-213e-4a54-900c-95a4bc6e10be-kube-api-access-4kv2z\") pod \"volume-data-source-validator-78dd696465-stx2f\" (UID: \"043d1104-213e-4a54-900c-95a4bc6e10be\") " pod="openshift-cluster-storage-operator/volume-data-source-validator-78dd696465-stx2f" Jun 09 15:18:03.193940 ip-10-0-130-232 kubenswrapper[2575]: I0609 15:18:03.193868 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-4kv2z\" (UniqueName: \"kubernetes.io/projected/043d1104-213e-4a54-900c-95a4bc6e10be-kube-api-access-4kv2z\") pod \"volume-data-source-validator-78dd696465-stx2f\" (UID: \"043d1104-213e-4a54-900c-95a4bc6e10be\") " pod="openshift-cluster-storage-operator/volume-data-source-validator-78dd696465-stx2f" Jun 09 15:18:03.287332 ip-10-0-130-232 kubenswrapper[2575]: I0609 15:18:03.287287 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-storage-operator/volume-data-source-validator-78dd696465-stx2f" Jun 09 15:18:03.415082 ip-10-0-130-232 kubenswrapper[2575]: I0609 15:18:03.415053 2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-cluster-storage-operator/volume-data-source-validator-78dd696465-stx2f"] Jun 09 15:18:03.418214 ip-10-0-130-232 kubenswrapper[2575]: W0609 15:18:03.418189 2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod043d1104_213e_4a54_900c_95a4bc6e10be.slice/crio-9c81de5e8e3e645c0f95acdc73f576f130c1c92d960bddd99b87cfc0d2a9ff2b WatchSource:0}: Error finding container 9c81de5e8e3e645c0f95acdc73f576f130c1c92d960bddd99b87cfc0d2a9ff2b: Status 404 returned error can't find the container with id 9c81de5e8e3e645c0f95acdc73f576f130c1c92d960bddd99b87cfc0d2a9ff2b Jun 09 15:18:04.380349 ip-10-0-130-232 kubenswrapper[2575]: I0609 15:18:04.380310 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-storage-operator/volume-data-source-validator-78dd696465-stx2f" event={"ID":"043d1104-213e-4a54-900c-95a4bc6e10be","Type":"ContainerStarted","Data":"9c81de5e8e3e645c0f95acdc73f576f130c1c92d960bddd99b87cfc0d2a9ff2b"} Jun 09 15:18:05.384578 ip-10-0-130-232 kubenswrapper[2575]: I0609 15:18:05.384487 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-storage-operator/volume-data-source-validator-78dd696465-stx2f" event={"ID":"043d1104-213e-4a54-900c-95a4bc6e10be","Type":"ContainerStarted","Data":"897b04667fe4050c84fa1e43ada9be561da9ee972044bfe09a7cf7d58a3784f0"} Jun 09 15:18:05.400953 ip-10-0-130-232 kubenswrapper[2575]: I0609 15:18:05.400912 2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-storage-operator/volume-data-source-validator-78dd696465-stx2f" podStartSLOduration=1.725360193 podStartE2EDuration="3.400898003s" totalImagesPullingTime="1.67553781s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-09 15:18:02 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-09 15:18:05.399979188 +0000 UTC m=+225.087984644" watchObservedRunningTime="2026-06-09 15:18:05.400898003 +0000 UTC m=+225.088903455" Jun 09 15:18:05.488828 ip-10-0-130-232 kubenswrapper[2575]: I0609 15:18:05.488747 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2bkzp_41532b1e-300d-4a9e-a64f-da302213062c/konnectivity-agent/0.log" limit=1024 Jun 09 15:18:06.791345 ip-10-0-130-232 kubenswrapper[2575]: I0609 15:18:06.791294 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2bkzp_41532b1e-300d-4a9e-a64f-da302213062c/konnectivity-agent/0.log" limit=1024 Jun 09 15:18:06.860441 ip-10-0-130-232 kubenswrapper[2575]: I0609 15:18:06.860406 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2bkzp_41532b1e-300d-4a9e-a64f-da302213062c/konnectivity-agent/0.log" limit=1024 Jun 09 15:18:08.445068 ip-10-0-130-232 kubenswrapper[2575]: I0609 15:18:08.445038 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2bkzp_41532b1e-300d-4a9e-a64f-da302213062c/konnectivity-agent/0.log" limit=1024 Jun 09 15:18:08.558955 ip-10-0-130-232 kubenswrapper[2575]: I0609 15:18:08.558926 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2bkzp_41532b1e-300d-4a9e-a64f-da302213062c/konnectivity-agent/0.log" limit=1024 Jun 09 15:18:08.637445 ip-10-0-130-232 kubenswrapper[2575]: I0609 15:18:08.637416 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2bkzp_41532b1e-300d-4a9e-a64f-da302213062c/konnectivity-agent/0.log" limit=1024 Jun 09 15:18:08.702055 ip-10-0-130-232 kubenswrapper[2575]: I0609 15:18:08.701992 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-s44r8_a687cfa5-1e89-4fbf-b17d-11f2778c632f/dns-node-resolver/0.log" Jun 09 15:18:08.909581 ip-10-0-130-232 kubenswrapper[2575]: I0609 15:18:08.909533 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2bkzp_41532b1e-300d-4a9e-a64f-da302213062c/konnectivity-agent/0.log" limit=1024 Jun 09 15:18:09.010344 ip-10-0-130-232 kubenswrapper[2575]: I0609 15:18:09.010310 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2bkzp_41532b1e-300d-4a9e-a64f-da302213062c/konnectivity-agent/0.log" limit=1024 Jun 09 15:18:09.203256 ip-10-0-130-232 kubenswrapper[2575]: I0609 15:18:09.203228 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2bkzp_41532b1e-300d-4a9e-a64f-da302213062c/konnectivity-agent/0.log" limit=1024 Jun 09 15:18:09.294595 ip-10-0-130-232 kubenswrapper[2575]: I0609 15:18:09.294529 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2bkzp_41532b1e-300d-4a9e-a64f-da302213062c/konnectivity-agent/0.log" limit=1024 Jun 09 15:18:09.494644 ip-10-0-130-232 kubenswrapper[2575]: I0609 15:18:09.494619 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-9shqx_146ee641-079b-4c92-8b48-7449e59f82b3/node-ca/0.log" Jun 09 15:18:10.693676 ip-10-0-130-232 kubenswrapper[2575]: I0609 15:18:10.693652 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-w28rj_2e334ed6-e1c8-4008-9e24-dc9f3079be0a/serve-healthcheck-canary/0.log" Jun 09 15:18:10.818025 ip-10-0-130-232 kubenswrapper[2575]: I0609 15:18:10.817995 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2bkzp_41532b1e-300d-4a9e-a64f-da302213062c/konnectivity-agent/0.log" limit=1024 Jun 09 15:18:12.115991 ip-10-0-130-232 kubenswrapper[2575]: I0609 15:18:12.115961 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2bkzp_41532b1e-300d-4a9e-a64f-da302213062c/konnectivity-agent/0.log" limit=1024 Jun 09 15:18:14.505725 ip-10-0-130-232 kubenswrapper[2575]: I0609 15:18:14.505697 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2bkzp_41532b1e-300d-4a9e-a64f-da302213062c/konnectivity-agent/0.log" limit=1024 Jun 09 15:18:14.582898 ip-10-0-130-232 kubenswrapper[2575]: I0609 15:18:14.582865 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2bkzp_41532b1e-300d-4a9e-a64f-da302213062c/konnectivity-agent/0.log" limit=1024 Jun 09 15:18:14.684471 ip-10-0-130-232 kubenswrapper[2575]: I0609 15:18:14.684443 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2bkzp_41532b1e-300d-4a9e-a64f-da302213062c/konnectivity-agent/0.log" limit=1024 Jun 09 15:18:14.785466 ip-10-0-130-232 kubenswrapper[2575]: I0609 15:18:14.785392 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2bkzp_41532b1e-300d-4a9e-a64f-da302213062c/konnectivity-agent/0.log" limit=1024 Jun 09 15:18:14.915233 ip-10-0-130-232 kubenswrapper[2575]: I0609 15:18:14.915203 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2bkzp_41532b1e-300d-4a9e-a64f-da302213062c/konnectivity-agent/0.log" limit=1024 Jun 09 15:18:15.036985 ip-10-0-130-232 kubenswrapper[2575]: I0609 15:18:15.036916 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2bkzp_41532b1e-300d-4a9e-a64f-da302213062c/konnectivity-agent/0.log" limit=1024 Jun 09 15:18:15.200667 ip-10-0-130-232 kubenswrapper[2575]: I0609 15:18:15.200640 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2bkzp_41532b1e-300d-4a9e-a64f-da302213062c/konnectivity-agent/0.log" limit=1024 Jun 09 15:18:16.198408 ip-10-0-130-232 kubenswrapper[2575]: I0609 15:18:16.198363 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2bkzp_41532b1e-300d-4a9e-a64f-da302213062c/konnectivity-agent/0.log" limit=1024 Jun 09 15:18:16.316896 ip-10-0-130-232 kubenswrapper[2575]: I0609 15:18:16.316865 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2bkzp_41532b1e-300d-4a9e-a64f-da302213062c/konnectivity-agent/0.log" limit=1024 Jun 09 15:18:16.590940 ip-10-0-130-232 kubenswrapper[2575]: I0609 15:18:16.590911 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2bkzp_41532b1e-300d-4a9e-a64f-da302213062c/konnectivity-agent/0.log" limit=1024 Jun 09 15:18:16.786443 ip-10-0-130-232 kubenswrapper[2575]: I0609 15:18:16.786407 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2bkzp_41532b1e-300d-4a9e-a64f-da302213062c/konnectivity-agent/0.log" limit=1024 Jun 09 15:18:16.992358 ip-10-0-130-232 kubenswrapper[2575]: I0609 15:18:16.992331 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2bkzp_41532b1e-300d-4a9e-a64f-da302213062c/konnectivity-agent/0.log" limit=1024 Jun 09 15:18:17.402668 ip-10-0-130-232 kubenswrapper[2575]: I0609 15:18:17.402577 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2bkzp_41532b1e-300d-4a9e-a64f-da302213062c/konnectivity-agent/0.log" limit=1024 Jun 09 15:18:17.998258 ip-10-0-130-232 kubenswrapper[2575]: I0609 15:18:17.998228 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2bkzp_41532b1e-300d-4a9e-a64f-da302213062c/konnectivity-agent/0.log" limit=1024 Jun 09 15:18:18.080410 ip-10-0-130-232 kubenswrapper[2575]: I0609 15:18:18.080381 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2bkzp_41532b1e-300d-4a9e-a64f-da302213062c/konnectivity-agent/0.log" limit=1024 Jun 09 15:18:18.382803 ip-10-0-130-232 kubenswrapper[2575]: I0609 15:18:18.382714 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2bkzp_41532b1e-300d-4a9e-a64f-da302213062c/konnectivity-agent/0.log" limit=1024 Jun 09 15:18:18.448610 ip-10-0-130-232 kubenswrapper[2575]: I0609 15:18:18.448577 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2bkzp_41532b1e-300d-4a9e-a64f-da302213062c/konnectivity-agent/0.log" limit=1024 Jun 09 15:18:18.595336 ip-10-0-130-232 kubenswrapper[2575]: I0609 15:18:18.595305 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2bkzp_41532b1e-300d-4a9e-a64f-da302213062c/konnectivity-agent/0.log" limit=1024 Jun 09 15:18:18.989806 ip-10-0-130-232 kubenswrapper[2575]: I0609 15:18:18.989761 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2bkzp_41532b1e-300d-4a9e-a64f-da302213062c/konnectivity-agent/0.log" limit=1024 Jun 09 15:18:19.385868 ip-10-0-130-232 kubenswrapper[2575]: I0609 15:18:19.385749 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2bkzp_41532b1e-300d-4a9e-a64f-da302213062c/konnectivity-agent/0.log" limit=1024 Jun 09 15:18:19.815474 ip-10-0-130-232 kubenswrapper[2575]: I0609 15:18:19.815440 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2bkzp_41532b1e-300d-4a9e-a64f-da302213062c/konnectivity-agent/0.log" limit=1024 Jun 09 15:18:19.988127 ip-10-0-130-232 kubenswrapper[2575]: I0609 15:18:19.988100 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2bkzp_41532b1e-300d-4a9e-a64f-da302213062c/konnectivity-agent/0.log" limit=1024 Jun 09 15:18:20.392785 ip-10-0-130-232 kubenswrapper[2575]: I0609 15:18:20.392755 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2bkzp_41532b1e-300d-4a9e-a64f-da302213062c/konnectivity-agent/0.log" limit=1024 Jun 09 15:18:20.610047 ip-10-0-130-232 kubenswrapper[2575]: I0609 15:18:20.610018 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2bkzp_41532b1e-300d-4a9e-a64f-da302213062c/konnectivity-agent/0.log" limit=1024 Jun 09 15:18:20.997302 ip-10-0-130-232 kubenswrapper[2575]: I0609 15:18:20.997271 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2bkzp_41532b1e-300d-4a9e-a64f-da302213062c/konnectivity-agent/0.log" limit=1024 Jun 09 15:18:21.097344 ip-10-0-130-232 kubenswrapper[2575]: I0609 15:18:21.097312 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2bkzp_41532b1e-300d-4a9e-a64f-da302213062c/konnectivity-agent/0.log" limit=1024 Jun 09 15:18:21.679295 ip-10-0-130-232 kubenswrapper[2575]: I0609 15:18:21.679259 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2bkzp_41532b1e-300d-4a9e-a64f-da302213062c/konnectivity-agent/0.log" limit=1024 Jun 09 15:18:22.188218 ip-10-0-130-232 kubenswrapper[2575]: I0609 15:18:22.188187 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2bkzp_41532b1e-300d-4a9e-a64f-da302213062c/konnectivity-agent/0.log" limit=1024 Jun 09 15:18:22.392906 ip-10-0-130-232 kubenswrapper[2575]: I0609 15:18:22.392871 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2bkzp_41532b1e-300d-4a9e-a64f-da302213062c/konnectivity-agent/0.log" limit=1024 Jun 09 15:18:22.786540 ip-10-0-130-232 kubenswrapper[2575]: I0609 15:18:22.786501 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2bkzp_41532b1e-300d-4a9e-a64f-da302213062c/konnectivity-agent/0.log" limit=1024 Jun 09 15:18:22.987858 ip-10-0-130-232 kubenswrapper[2575]: I0609 15:18:22.987813 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2bkzp_41532b1e-300d-4a9e-a64f-da302213062c/konnectivity-agent/0.log" limit=1024 Jun 09 15:18:23.587925 ip-10-0-130-232 kubenswrapper[2575]: I0609 15:18:23.587891 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2bkzp_41532b1e-300d-4a9e-a64f-da302213062c/konnectivity-agent/0.log" limit=1024 Jun 09 15:18:24.022485 ip-10-0-130-232 kubenswrapper[2575]: I0609 15:18:24.022453 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2bkzp_41532b1e-300d-4a9e-a64f-da302213062c/konnectivity-agent/0.log" limit=1024 Jun 09 15:18:24.091452 ip-10-0-130-232 kubenswrapper[2575]: I0609 15:18:24.091420 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2bkzp_41532b1e-300d-4a9e-a64f-da302213062c/konnectivity-agent/0.log" limit=1024 Jun 09 15:18:24.421381 ip-10-0-130-232 kubenswrapper[2575]: I0609 15:18:24.421302 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2bkzp_41532b1e-300d-4a9e-a64f-da302213062c/konnectivity-agent/0.log" limit=1024 Jun 09 15:18:24.803771 ip-10-0-130-232 kubenswrapper[2575]: I0609 15:18:24.803740 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2bkzp_41532b1e-300d-4a9e-a64f-da302213062c/konnectivity-agent/0.log" limit=1024 Jun 09 15:18:25.028284 ip-10-0-130-232 kubenswrapper[2575]: I0609 15:18:25.028251 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2bkzp_41532b1e-300d-4a9e-a64f-da302213062c/konnectivity-agent/0.log" limit=1024 Jun 09 15:18:25.225576 ip-10-0-130-232 kubenswrapper[2575]: I0609 15:18:25.225552 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2bkzp_41532b1e-300d-4a9e-a64f-da302213062c/konnectivity-agent/0.log" limit=1024 Jun 09 15:18:25.865641 ip-10-0-130-232 kubenswrapper[2575]: I0609 15:18:25.865608 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2bkzp_41532b1e-300d-4a9e-a64f-da302213062c/konnectivity-agent/0.log" limit=1024 Jun 09 15:18:25.934602 ip-10-0-130-232 kubenswrapper[2575]: I0609 15:18:25.934573 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2bkzp_41532b1e-300d-4a9e-a64f-da302213062c/konnectivity-agent/0.log" limit=1024 Jun 09 15:18:28.604245 ip-10-0-130-232 kubenswrapper[2575]: I0609 15:18:28.604213 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2bkzp_41532b1e-300d-4a9e-a64f-da302213062c/konnectivity-agent/0.log" limit=1024 Jun 09 15:18:28.705334 ip-10-0-130-232 kubenswrapper[2575]: I0609 15:18:28.705304 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2bkzp_41532b1e-300d-4a9e-a64f-da302213062c/konnectivity-agent/0.log" limit=1024 Jun 09 15:18:28.771869 ip-10-0-130-232 kubenswrapper[2575]: I0609 15:18:28.771813 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2bkzp_41532b1e-300d-4a9e-a64f-da302213062c/konnectivity-agent/0.log" limit=1024 Jun 09 15:18:28.896410 ip-10-0-130-232 kubenswrapper[2575]: I0609 15:18:28.896331 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2bkzp_41532b1e-300d-4a9e-a64f-da302213062c/konnectivity-agent/0.log" limit=1024 Jun 09 15:18:29.296250 ip-10-0-130-232 kubenswrapper[2575]: I0609 15:18:29.296218 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2bkzp_41532b1e-300d-4a9e-a64f-da302213062c/konnectivity-agent/0.log" limit=1024 Jun 09 15:18:29.372729 ip-10-0-130-232 kubenswrapper[2575]: I0609 15:18:29.372704 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2bkzp_41532b1e-300d-4a9e-a64f-da302213062c/konnectivity-agent/0.log" limit=1024 Jun 09 15:18:30.488783 ip-10-0-130-232 kubenswrapper[2575]: I0609 15:18:30.488756 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2bkzp_41532b1e-300d-4a9e-a64f-da302213062c/konnectivity-agent/0.log" limit=1024 Jun 09 15:18:30.694156 ip-10-0-130-232 kubenswrapper[2575]: I0609 15:18:30.694123 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2bkzp_41532b1e-300d-4a9e-a64f-da302213062c/konnectivity-agent/0.log" limit=1024 Jun 09 15:18:31.111489 ip-10-0-130-232 kubenswrapper[2575]: I0609 15:18:31.111456 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2bkzp_41532b1e-300d-4a9e-a64f-da302213062c/konnectivity-agent/0.log" limit=1024 Jun 09 15:18:31.187277 ip-10-0-130-232 kubenswrapper[2575]: I0609 15:18:31.187248 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2bkzp_41532b1e-300d-4a9e-a64f-da302213062c/konnectivity-agent/0.log" limit=1024 Jun 09 15:18:31.305539 ip-10-0-130-232 kubenswrapper[2575]: I0609 15:18:31.305506 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2bkzp_41532b1e-300d-4a9e-a64f-da302213062c/konnectivity-agent/0.log" limit=1024 Jun 09 15:18:32.493600 ip-10-0-130-232 kubenswrapper[2575]: I0609 15:18:32.493566 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/8eda6a9f-b4cc-403f-a284-8a9cd10e8f15-metrics-certs\") pod \"network-metrics-daemon-5bg45\" (UID: \"8eda6a9f-b4cc-403f-a284-8a9cd10e8f15\") " pod="openshift-multus/network-metrics-daemon-5bg45" Jun 09 15:18:32.495990 ip-10-0-130-232 kubenswrapper[2575]: I0609 15:18:32.495970 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/8eda6a9f-b4cc-403f-a284-8a9cd10e8f15-metrics-certs\") pod \"network-metrics-daemon-5bg45\" (UID: \"8eda6a9f-b4cc-403f-a284-8a9cd10e8f15\") " pod="openshift-multus/network-metrics-daemon-5bg45" Jun 09 15:18:32.693027 ip-10-0-130-232 kubenswrapper[2575]: I0609 15:18:32.692994 2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-p4lvv\"" Jun 09 15:18:32.701702 ip-10-0-130-232 kubenswrapper[2575]: I0609 15:18:32.701682 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-5bg45" Jun 09 15:18:32.831913 ip-10-0-130-232 kubenswrapper[2575]: I0609 15:18:32.831884 2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-5bg45"] Jun 09 15:18:32.834648 ip-10-0-130-232 kubenswrapper[2575]: W0609 15:18:32.834619 2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8eda6a9f_b4cc_403f_a284_8a9cd10e8f15.slice/crio-eba6a8af76bfa7f45f8c121c4871eefa7ac4d7eb1d5aedef0c4399acc5c69839 WatchSource:0}: Error finding container eba6a8af76bfa7f45f8c121c4871eefa7ac4d7eb1d5aedef0c4399acc5c69839: Status 404 returned error can't find the container with id eba6a8af76bfa7f45f8c121c4871eefa7ac4d7eb1d5aedef0c4399acc5c69839 Jun 09 15:18:33.056717 ip-10-0-130-232 kubenswrapper[2575]: I0609 15:18:33.056636 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2bkzp_41532b1e-300d-4a9e-a64f-da302213062c/konnectivity-agent/0.log" limit=1024 Jun 09 15:18:33.083736 ip-10-0-130-232 kubenswrapper[2575]: I0609 15:18:33.083669 2575 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-image-registry/image-registry-75f6d98cf6-grg9x"] Jun 09 15:18:33.088398 ip-10-0-130-232 kubenswrapper[2575]: I0609 15:18:33.088384 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-75f6d98cf6-grg9x" Jun 09 15:18:33.092265 ip-10-0-130-232 kubenswrapper[2575]: I0609 15:18:33.092245 2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"registry-dockercfg-mbhxv\"" Jun 09 15:18:33.092387 ip-10-0-130-232 kubenswrapper[2575]: I0609 15:18:33.092371 2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"installation-pull-secrets\"" Jun 09 15:18:33.092441 ip-10-0-130-232 kubenswrapper[2575]: I0609 15:18:33.092403 2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-private-configuration\"" Jun 09 15:18:33.093277 ip-10-0-130-232 kubenswrapper[2575]: I0609 15:18:33.093260 2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-tls\"" Jun 09 15:18:33.101964 ip-10-0-130-232 kubenswrapper[2575]: I0609 15:18:33.101944 2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"trusted-ca\"" Jun 09 15:18:33.112880 ip-10-0-130-232 kubenswrapper[2575]: I0609 15:18:33.112834 2575 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-insights/insights-runtime-extractor-nngvb"] Jun 09 15:18:33.116380 ip-10-0-130-232 kubenswrapper[2575]: I0609 15:18:33.116359 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-nngvb" Jun 09 15:18:33.117950 ip-10-0-130-232 kubenswrapper[2575]: I0609 15:18:33.117929 2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-75f6d98cf6-grg9x"] Jun 09 15:18:33.118917 ip-10-0-130-232 kubenswrapper[2575]: I0609 15:18:33.118896 2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-sa-dockercfg-dlqlf\"" Jun 09 15:18:33.119022 ip-10-0-130-232 kubenswrapper[2575]: I0609 15:18:33.119010 2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"openshift-service-ca.crt\"" Jun 09 15:18:33.119089 ip-10-0-130-232 kubenswrapper[2575]: I0609 15:18:33.119029 2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-root-ca.crt\"" Jun 09 15:18:33.119089 ip-10-0-130-232 kubenswrapper[2575]: I0609 15:18:33.119049 2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-tls\"" Jun 09 15:18:33.122236 ip-10-0-130-232 kubenswrapper[2575]: I0609 15:18:33.122210 2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-rbac-proxy\"" Jun 09 15:18:33.138378 ip-10-0-130-232 kubenswrapper[2575]: I0609 15:18:33.138355 2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-nngvb"] Jun 09 15:18:33.165498 ip-10-0-130-232 kubenswrapper[2575]: I0609 15:18:33.165467 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2bkzp_41532b1e-300d-4a9e-a64f-da302213062c/konnectivity-agent/0.log" limit=1024 Jun 09 15:18:33.197716 ip-10-0-130-232 kubenswrapper[2575]: I0609 15:18:33.197689 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/3ffe15f5-8e1c-43c6-a5e0-482410e1be5c-bound-sa-token\") pod \"image-registry-75f6d98cf6-grg9x\" (UID: \"3ffe15f5-8e1c-43c6-a5e0-482410e1be5c\") " pod="openshift-image-registry/image-registry-75f6d98cf6-grg9x" Jun 09 15:18:33.197839 ip-10-0-130-232 kubenswrapper[2575]: I0609 15:18:33.197749 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/3ffe15f5-8e1c-43c6-a5e0-482410e1be5c-trusted-ca\") pod \"image-registry-75f6d98cf6-grg9x\" (UID: \"3ffe15f5-8e1c-43c6-a5e0-482410e1be5c\") " pod="openshift-image-registry/image-registry-75f6d98cf6-grg9x" Jun 09 15:18:33.197839 ip-10-0-130-232 kubenswrapper[2575]: I0609 15:18:33.197767 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jhq2b\" (UniqueName: \"kubernetes.io/projected/3ffe15f5-8e1c-43c6-a5e0-482410e1be5c-kube-api-access-jhq2b\") pod \"image-registry-75f6d98cf6-grg9x\" (UID: \"3ffe15f5-8e1c-43c6-a5e0-482410e1be5c\") " pod="openshift-image-registry/image-registry-75f6d98cf6-grg9x" Jun 09 15:18:33.197839 ip-10-0-130-232 kubenswrapper[2575]: I0609 15:18:33.197827 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/3ffe15f5-8e1c-43c6-a5e0-482410e1be5c-registry-certificates\") pod \"image-registry-75f6d98cf6-grg9x\" (UID: \"3ffe15f5-8e1c-43c6-a5e0-482410e1be5c\") " pod="openshift-image-registry/image-registry-75f6d98cf6-grg9x" Jun 09 15:18:33.197965 ip-10-0-130-232 kubenswrapper[2575]: I0609 15:18:33.197873 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/3ffe15f5-8e1c-43c6-a5e0-482410e1be5c-image-registry-private-configuration\") pod \"image-registry-75f6d98cf6-grg9x\" (UID: \"3ffe15f5-8e1c-43c6-a5e0-482410e1be5c\") " pod="openshift-image-registry/image-registry-75f6d98cf6-grg9x" Jun 09 15:18:33.197965 ip-10-0-130-232 kubenswrapper[2575]: I0609 15:18:33.197891 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/3ffe15f5-8e1c-43c6-a5e0-482410e1be5c-installation-pull-secrets\") pod \"image-registry-75f6d98cf6-grg9x\" (UID: \"3ffe15f5-8e1c-43c6-a5e0-482410e1be5c\") " pod="openshift-image-registry/image-registry-75f6d98cf6-grg9x" Jun 09 15:18:33.197965 ip-10-0-130-232 kubenswrapper[2575]: I0609 15:18:33.197940 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/3ffe15f5-8e1c-43c6-a5e0-482410e1be5c-registry-tls\") pod \"image-registry-75f6d98cf6-grg9x\" (UID: \"3ffe15f5-8e1c-43c6-a5e0-482410e1be5c\") " pod="openshift-image-registry/image-registry-75f6d98cf6-grg9x" Jun 09 15:18:33.198053 ip-10-0-130-232 kubenswrapper[2575]: I0609 15:18:33.197969 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/3ffe15f5-8e1c-43c6-a5e0-482410e1be5c-ca-trust-extracted\") pod \"image-registry-75f6d98cf6-grg9x\" (UID: \"3ffe15f5-8e1c-43c6-a5e0-482410e1be5c\") " pod="openshift-image-registry/image-registry-75f6d98cf6-grg9x" Jun 09 15:18:33.298545 ip-10-0-130-232 kubenswrapper[2575]: I0609 15:18:33.298503 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jhq2b\" (UniqueName: \"kubernetes.io/projected/3ffe15f5-8e1c-43c6-a5e0-482410e1be5c-kube-api-access-jhq2b\") pod \"image-registry-75f6d98cf6-grg9x\" (UID: \"3ffe15f5-8e1c-43c6-a5e0-482410e1be5c\") " pod="openshift-image-registry/image-registry-75f6d98cf6-grg9x" Jun 09 15:18:33.298545 ip-10-0-130-232 kubenswrapper[2575]: I0609 15:18:33.298545 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/6b02ab8f-5fb2-4eb7-a5b5-25ac09cbe55a-crio-socket\") pod \"insights-runtime-extractor-nngvb\" (UID: \"6b02ab8f-5fb2-4eb7-a5b5-25ac09cbe55a\") " pod="openshift-insights/insights-runtime-extractor-nngvb" Jun 09 15:18:33.298545 ip-10-0-130-232 kubenswrapper[2575]: I0609 15:18:33.298567 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/3ffe15f5-8e1c-43c6-a5e0-482410e1be5c-registry-certificates\") pod \"image-registry-75f6d98cf6-grg9x\" (UID: \"3ffe15f5-8e1c-43c6-a5e0-482410e1be5c\") " pod="openshift-image-registry/image-registry-75f6d98cf6-grg9x" Jun 09 15:18:33.298891 ip-10-0-130-232 kubenswrapper[2575]: I0609 15:18:33.298583 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/6b02ab8f-5fb2-4eb7-a5b5-25ac09cbe55a-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-nngvb\" (UID: \"6b02ab8f-5fb2-4eb7-a5b5-25ac09cbe55a\") " pod="openshift-insights/insights-runtime-extractor-nngvb" Jun 09 15:18:33.298891 ip-10-0-130-232 kubenswrapper[2575]: I0609 15:18:33.298610 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/3ffe15f5-8e1c-43c6-a5e0-482410e1be5c-image-registry-private-configuration\") pod \"image-registry-75f6d98cf6-grg9x\" (UID: \"3ffe15f5-8e1c-43c6-a5e0-482410e1be5c\") " pod="openshift-image-registry/image-registry-75f6d98cf6-grg9x" Jun 09 15:18:33.298891 ip-10-0-130-232 kubenswrapper[2575]: I0609 15:18:33.298645 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/3ffe15f5-8e1c-43c6-a5e0-482410e1be5c-installation-pull-secrets\") pod \"image-registry-75f6d98cf6-grg9x\" (UID: \"3ffe15f5-8e1c-43c6-a5e0-482410e1be5c\") " pod="openshift-image-registry/image-registry-75f6d98cf6-grg9x" Jun 09 15:18:33.298891 ip-10-0-130-232 kubenswrapper[2575]: I0609 15:18:33.298675 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/3ffe15f5-8e1c-43c6-a5e0-482410e1be5c-registry-tls\") pod \"image-registry-75f6d98cf6-grg9x\" (UID: \"3ffe15f5-8e1c-43c6-a5e0-482410e1be5c\") " pod="openshift-image-registry/image-registry-75f6d98cf6-grg9x" Jun 09 15:18:33.298891 ip-10-0-130-232 kubenswrapper[2575]: I0609 15:18:33.298701 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-t4zts\" (UniqueName: \"kubernetes.io/projected/6b02ab8f-5fb2-4eb7-a5b5-25ac09cbe55a-kube-api-access-t4zts\") pod \"insights-runtime-extractor-nngvb\" (UID: \"6b02ab8f-5fb2-4eb7-a5b5-25ac09cbe55a\") " pod="openshift-insights/insights-runtime-extractor-nngvb" Jun 09 15:18:33.298891 ip-10-0-130-232 kubenswrapper[2575]: I0609 15:18:33.298732 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/3ffe15f5-8e1c-43c6-a5e0-482410e1be5c-ca-trust-extracted\") pod \"image-registry-75f6d98cf6-grg9x\" (UID: \"3ffe15f5-8e1c-43c6-a5e0-482410e1be5c\") " pod="openshift-image-registry/image-registry-75f6d98cf6-grg9x" Jun 09 15:18:33.298891 ip-10-0-130-232 kubenswrapper[2575]: I0609 15:18:33.298775 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/3ffe15f5-8e1c-43c6-a5e0-482410e1be5c-bound-sa-token\") pod \"image-registry-75f6d98cf6-grg9x\" (UID: \"3ffe15f5-8e1c-43c6-a5e0-482410e1be5c\") " pod="openshift-image-registry/image-registry-75f6d98cf6-grg9x" Jun 09 15:18:33.298891 ip-10-0-130-232 kubenswrapper[2575]: I0609 15:18:33.298809 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/6b02ab8f-5fb2-4eb7-a5b5-25ac09cbe55a-data-volume\") pod \"insights-runtime-extractor-nngvb\" (UID: \"6b02ab8f-5fb2-4eb7-a5b5-25ac09cbe55a\") " pod="openshift-insights/insights-runtime-extractor-nngvb" Jun 09 15:18:33.298891 ip-10-0-130-232 kubenswrapper[2575]: I0609 15:18:33.298832 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/6b02ab8f-5fb2-4eb7-a5b5-25ac09cbe55a-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-nngvb\" (UID: \"6b02ab8f-5fb2-4eb7-a5b5-25ac09cbe55a\") " pod="openshift-insights/insights-runtime-extractor-nngvb" Jun 09 15:18:33.299345 ip-10-0-130-232 kubenswrapper[2575]: I0609 15:18:33.298901 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/3ffe15f5-8e1c-43c6-a5e0-482410e1be5c-trusted-ca\") pod \"image-registry-75f6d98cf6-grg9x\" (UID: \"3ffe15f5-8e1c-43c6-a5e0-482410e1be5c\") " pod="openshift-image-registry/image-registry-75f6d98cf6-grg9x" Jun 09 15:18:33.299398 ip-10-0-130-232 kubenswrapper[2575]: I0609 15:18:33.299344 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/3ffe15f5-8e1c-43c6-a5e0-482410e1be5c-ca-trust-extracted\") pod \"image-registry-75f6d98cf6-grg9x\" (UID: \"3ffe15f5-8e1c-43c6-a5e0-482410e1be5c\") " pod="openshift-image-registry/image-registry-75f6d98cf6-grg9x" Jun 09 15:18:33.299530 ip-10-0-130-232 kubenswrapper[2575]: I0609 15:18:33.299505 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/3ffe15f5-8e1c-43c6-a5e0-482410e1be5c-registry-certificates\") pod \"image-registry-75f6d98cf6-grg9x\" (UID: \"3ffe15f5-8e1c-43c6-a5e0-482410e1be5c\") " pod="openshift-image-registry/image-registry-75f6d98cf6-grg9x" Jun 09 15:18:33.300249 ip-10-0-130-232 kubenswrapper[2575]: I0609 15:18:33.300205 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/3ffe15f5-8e1c-43c6-a5e0-482410e1be5c-trusted-ca\") pod \"image-registry-75f6d98cf6-grg9x\" (UID: \"3ffe15f5-8e1c-43c6-a5e0-482410e1be5c\") " pod="openshift-image-registry/image-registry-75f6d98cf6-grg9x" Jun 09 15:18:33.301696 ip-10-0-130-232 kubenswrapper[2575]: I0609 15:18:33.301674 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/3ffe15f5-8e1c-43c6-a5e0-482410e1be5c-image-registry-private-configuration\") pod \"image-registry-75f6d98cf6-grg9x\" (UID: \"3ffe15f5-8e1c-43c6-a5e0-482410e1be5c\") " pod="openshift-image-registry/image-registry-75f6d98cf6-grg9x" Jun 09 15:18:33.302010 ip-10-0-130-232 kubenswrapper[2575]: I0609 15:18:33.301773 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/3ffe15f5-8e1c-43c6-a5e0-482410e1be5c-installation-pull-secrets\") pod \"image-registry-75f6d98cf6-grg9x\" (UID: \"3ffe15f5-8e1c-43c6-a5e0-482410e1be5c\") " pod="openshift-image-registry/image-registry-75f6d98cf6-grg9x" Jun 09 15:18:33.302143 ip-10-0-130-232 kubenswrapper[2575]: I0609 15:18:33.302127 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/3ffe15f5-8e1c-43c6-a5e0-482410e1be5c-registry-tls\") pod \"image-registry-75f6d98cf6-grg9x\" (UID: \"3ffe15f5-8e1c-43c6-a5e0-482410e1be5c\") " pod="openshift-image-registry/image-registry-75f6d98cf6-grg9x" Jun 09 15:18:33.309216 ip-10-0-130-232 kubenswrapper[2575]: I0609 15:18:33.309163 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/3ffe15f5-8e1c-43c6-a5e0-482410e1be5c-bound-sa-token\") pod \"image-registry-75f6d98cf6-grg9x\" (UID: \"3ffe15f5-8e1c-43c6-a5e0-482410e1be5c\") " pod="openshift-image-registry/image-registry-75f6d98cf6-grg9x" Jun 09 15:18:33.309460 ip-10-0-130-232 kubenswrapper[2575]: I0609 15:18:33.309418 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-jhq2b\" (UniqueName: \"kubernetes.io/projected/3ffe15f5-8e1c-43c6-a5e0-482410e1be5c-kube-api-access-jhq2b\") pod \"image-registry-75f6d98cf6-grg9x\" (UID: \"3ffe15f5-8e1c-43c6-a5e0-482410e1be5c\") " pod="openshift-image-registry/image-registry-75f6d98cf6-grg9x" Jun 09 15:18:33.397543 ip-10-0-130-232 kubenswrapper[2575]: I0609 15:18:33.397506 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-75f6d98cf6-grg9x" Jun 09 15:18:33.399742 ip-10-0-130-232 kubenswrapper[2575]: I0609 15:18:33.399714 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/6b02ab8f-5fb2-4eb7-a5b5-25ac09cbe55a-data-volume\") pod \"insights-runtime-extractor-nngvb\" (UID: \"6b02ab8f-5fb2-4eb7-a5b5-25ac09cbe55a\") " pod="openshift-insights/insights-runtime-extractor-nngvb" Jun 09 15:18:33.399903 ip-10-0-130-232 kubenswrapper[2575]: I0609 15:18:33.399756 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/6b02ab8f-5fb2-4eb7-a5b5-25ac09cbe55a-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-nngvb\" (UID: \"6b02ab8f-5fb2-4eb7-a5b5-25ac09cbe55a\") " pod="openshift-insights/insights-runtime-extractor-nngvb" Jun 09 15:18:33.399903 ip-10-0-130-232 kubenswrapper[2575]: I0609 15:18:33.399820 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/6b02ab8f-5fb2-4eb7-a5b5-25ac09cbe55a-crio-socket\") pod \"insights-runtime-extractor-nngvb\" (UID: \"6b02ab8f-5fb2-4eb7-a5b5-25ac09cbe55a\") " pod="openshift-insights/insights-runtime-extractor-nngvb" Jun 09 15:18:33.399903 ip-10-0-130-232 kubenswrapper[2575]: I0609 15:18:33.399865 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/6b02ab8f-5fb2-4eb7-a5b5-25ac09cbe55a-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-nngvb\" (UID: \"6b02ab8f-5fb2-4eb7-a5b5-25ac09cbe55a\") " pod="openshift-insights/insights-runtime-extractor-nngvb" Jun 09 15:18:33.400064 ip-10-0-130-232 kubenswrapper[2575]: I0609 15:18:33.399908 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-t4zts\" (UniqueName: \"kubernetes.io/projected/6b02ab8f-5fb2-4eb7-a5b5-25ac09cbe55a-kube-api-access-t4zts\") pod \"insights-runtime-extractor-nngvb\" (UID: \"6b02ab8f-5fb2-4eb7-a5b5-25ac09cbe55a\") " pod="openshift-insights/insights-runtime-extractor-nngvb" Jun 09 15:18:33.400064 ip-10-0-130-232 kubenswrapper[2575]: I0609 15:18:33.399951 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/6b02ab8f-5fb2-4eb7-a5b5-25ac09cbe55a-crio-socket\") pod \"insights-runtime-extractor-nngvb\" (UID: \"6b02ab8f-5fb2-4eb7-a5b5-25ac09cbe55a\") " pod="openshift-insights/insights-runtime-extractor-nngvb" Jun 09 15:18:33.400209 ip-10-0-130-232 kubenswrapper[2575]: I0609 15:18:33.400104 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/6b02ab8f-5fb2-4eb7-a5b5-25ac09cbe55a-data-volume\") pod \"insights-runtime-extractor-nngvb\" (UID: \"6b02ab8f-5fb2-4eb7-a5b5-25ac09cbe55a\") " pod="openshift-insights/insights-runtime-extractor-nngvb" Jun 09 15:18:33.400538 ip-10-0-130-232 kubenswrapper[2575]: I0609 15:18:33.400511 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/6b02ab8f-5fb2-4eb7-a5b5-25ac09cbe55a-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-nngvb\" (UID: \"6b02ab8f-5fb2-4eb7-a5b5-25ac09cbe55a\") " pod="openshift-insights/insights-runtime-extractor-nngvb" Jun 09 15:18:33.402587 ip-10-0-130-232 kubenswrapper[2575]: I0609 15:18:33.402564 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/6b02ab8f-5fb2-4eb7-a5b5-25ac09cbe55a-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-nngvb\" (UID: \"6b02ab8f-5fb2-4eb7-a5b5-25ac09cbe55a\") " pod="openshift-insights/insights-runtime-extractor-nngvb" Jun 09 15:18:33.410484 ip-10-0-130-232 kubenswrapper[2575]: I0609 15:18:33.410459 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-t4zts\" (UniqueName: \"kubernetes.io/projected/6b02ab8f-5fb2-4eb7-a5b5-25ac09cbe55a-kube-api-access-t4zts\") pod \"insights-runtime-extractor-nngvb\" (UID: \"6b02ab8f-5fb2-4eb7-a5b5-25ac09cbe55a\") " pod="openshift-insights/insights-runtime-extractor-nngvb" Jun 09 15:18:33.425511 ip-10-0-130-232 kubenswrapper[2575]: I0609 15:18:33.425484 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-nngvb" Jun 09 15:18:33.466633 ip-10-0-130-232 kubenswrapper[2575]: I0609 15:18:33.466566 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-5bg45" event={"ID":"8eda6a9f-b4cc-403f-a284-8a9cd10e8f15","Type":"ContainerStarted","Data":"eba6a8af76bfa7f45f8c121c4871eefa7ac4d7eb1d5aedef0c4399acc5c69839"} Jun 09 15:18:33.552470 ip-10-0-130-232 kubenswrapper[2575]: I0609 15:18:33.552402 2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-75f6d98cf6-grg9x"] Jun 09 15:18:33.559348 ip-10-0-130-232 kubenswrapper[2575]: W0609 15:18:33.559227 2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3ffe15f5_8e1c_43c6_a5e0_482410e1be5c.slice/crio-898567f9b1c56307245f52675c8370b91b1c51045fdeb47c3af6ea75693b73de WatchSource:0}: Error finding container 898567f9b1c56307245f52675c8370b91b1c51045fdeb47c3af6ea75693b73de: Status 404 returned error can't find the container with id 898567f9b1c56307245f52675c8370b91b1c51045fdeb47c3af6ea75693b73de Jun 09 15:18:33.578977 ip-10-0-130-232 kubenswrapper[2575]: I0609 15:18:33.578955 2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-nngvb"] Jun 09 15:18:33.785974 ip-10-0-130-232 kubenswrapper[2575]: W0609 15:18:33.785940 2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6b02ab8f_5fb2_4eb7_a5b5_25ac09cbe55a.slice/crio-5104f7980b65c6783bd27e352d8186425f971ba484bfb5fd174b0517c5127cd8 WatchSource:0}: Error finding container 5104f7980b65c6783bd27e352d8186425f971ba484bfb5fd174b0517c5127cd8: Status 404 returned error can't find the container with id 5104f7980b65c6783bd27e352d8186425f971ba484bfb5fd174b0517c5127cd8 Jun 09 15:18:34.472603 ip-10-0-130-232 kubenswrapper[2575]: I0609 15:18:34.472571 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-75f6d98cf6-grg9x" event={"ID":"3ffe15f5-8e1c-43c6-a5e0-482410e1be5c","Type":"ContainerStarted","Data":"aa769e333358e7624c0aa9beab01730ef750332b1a89c696fb7ba17b4e6e6129"} Jun 09 15:18:34.472723 ip-10-0-130-232 kubenswrapper[2575]: I0609 15:18:34.472673 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-75f6d98cf6-grg9x" event={"ID":"3ffe15f5-8e1c-43c6-a5e0-482410e1be5c","Type":"ContainerStarted","Data":"898567f9b1c56307245f52675c8370b91b1c51045fdeb47c3af6ea75693b73de"} Jun 09 15:18:34.472723 ip-10-0-130-232 kubenswrapper[2575]: I0609 15:18:34.472706 2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-image-registry/image-registry-75f6d98cf6-grg9x" Jun 09 15:18:34.474373 ip-10-0-130-232 kubenswrapper[2575]: I0609 15:18:34.474345 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-5bg45" event={"ID":"8eda6a9f-b4cc-403f-a284-8a9cd10e8f15","Type":"ContainerStarted","Data":"227424b03bc849239281348e87dae26be286cc55d097a359f51c36192293911f"} Jun 09 15:18:34.474475 ip-10-0-130-232 kubenswrapper[2575]: I0609 15:18:34.474397 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-5bg45" event={"ID":"8eda6a9f-b4cc-403f-a284-8a9cd10e8f15","Type":"ContainerStarted","Data":"0a4c2edded5d85f0d73a001cbadb8065e7e8d0756ae2c8dc7b6dd77fb34d747e"} Jun 09 15:18:34.475675 ip-10-0-130-232 kubenswrapper[2575]: I0609 15:18:34.475657 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-nngvb" event={"ID":"6b02ab8f-5fb2-4eb7-a5b5-25ac09cbe55a","Type":"ContainerStarted","Data":"ca947eabb34596ccf2d8cfc923f01f39fe4a0c7bfc0a809e35d950190abc57e3"} Jun 09 15:18:34.475751 ip-10-0-130-232 kubenswrapper[2575]: I0609 15:18:34.475695 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-nngvb" event={"ID":"6b02ab8f-5fb2-4eb7-a5b5-25ac09cbe55a","Type":"ContainerStarted","Data":"5104f7980b65c6783bd27e352d8186425f971ba484bfb5fd174b0517c5127cd8"} Jun 09 15:18:34.499391 ip-10-0-130-232 kubenswrapper[2575]: I0609 15:18:34.499343 2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/image-registry-75f6d98cf6-grg9x" podStartSLOduration=1.49932924 podStartE2EDuration="1.49932924s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-09 15:18:33 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-09 15:18:34.497950683 +0000 UTC m=+254.185956135" watchObservedRunningTime="2026-06-09 15:18:34.49932924 +0000 UTC m=+254.187334693" Jun 09 15:18:34.513962 ip-10-0-130-232 kubenswrapper[2575]: I0609 15:18:34.513923 2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/network-metrics-daemon-5bg45" podStartSLOduration=253.514513431 podStartE2EDuration="4m14.513911909s" totalImagesPullingTime="999.398478ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-09 15:14:20 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-09 15:18:34.512752713 +0000 UTC m=+254.200758178" watchObservedRunningTime="2026-06-09 15:18:34.513911909 +0000 UTC m=+254.201917361" Jun 09 15:18:34.624105 ip-10-0-130-232 kubenswrapper[2575]: I0609 15:18:34.624076 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2bkzp_41532b1e-300d-4a9e-a64f-da302213062c/konnectivity-agent/0.log" limit=1024 Jun 09 15:18:34.724313 ip-10-0-130-232 kubenswrapper[2575]: I0609 15:18:34.724287 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2bkzp_41532b1e-300d-4a9e-a64f-da302213062c/konnectivity-agent/0.log" limit=1024 Jun 09 15:18:35.484648 ip-10-0-130-232 kubenswrapper[2575]: I0609 15:18:35.484599 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-nngvb" event={"ID":"6b02ab8f-5fb2-4eb7-a5b5-25ac09cbe55a","Type":"ContainerStarted","Data":"26c906ca9467f10e7642a542e0c0d3d14a6514ed970aae12d3ee47261848cc9a"} Jun 09 15:18:36.489461 ip-10-0-130-232 kubenswrapper[2575]: I0609 15:18:36.489432 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-nngvb" event={"ID":"6b02ab8f-5fb2-4eb7-a5b5-25ac09cbe55a","Type":"ContainerStarted","Data":"d45e221597a8e4e7db7c2176986748105d4d95967744f06b665e1addfa605795"} Jun 09 15:18:36.513065 ip-10-0-130-232 kubenswrapper[2575]: I0609 15:18:36.512558 2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-insights/insights-runtime-extractor-nngvb" podStartSLOduration=1.319066638 podStartE2EDuration="3.512540102s" totalImagesPullingTime="2.193473464s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-09 15:18:33 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-09 15:18:36.512449607 +0000 UTC m=+256.200455074" watchObservedRunningTime="2026-06-09 15:18:36.512540102 +0000 UTC m=+256.200545559" Jun 09 15:18:37.350973 ip-10-0-130-232 kubenswrapper[2575]: I0609 15:18:37.350929 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2bkzp_41532b1e-300d-4a9e-a64f-da302213062c/konnectivity-agent/0.log" limit=1024 Jun 09 15:18:37.453689 ip-10-0-130-232 kubenswrapper[2575]: I0609 15:18:37.453653 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2bkzp_41532b1e-300d-4a9e-a64f-da302213062c/konnectivity-agent/0.log" limit=1024 Jun 09 15:18:37.522243 ip-10-0-130-232 kubenswrapper[2575]: I0609 15:18:37.522212 2575 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/prometheus-operator-admission-webhook-5b6b8f594-fgzc7"] Jun 09 15:18:37.525096 ip-10-0-130-232 kubenswrapper[2575]: I0609 15:18:37.525081 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-admission-webhook-5b6b8f594-fgzc7" Jun 09 15:18:37.527409 ip-10-0-130-232 kubenswrapper[2575]: I0609 15:18:37.527377 2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-admission-webhook-tls\"" Jun 09 15:18:37.527788 ip-10-0-130-232 kubenswrapper[2575]: I0609 15:18:37.527774 2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-admission-webhook-dockercfg-zbrs7\"" Jun 09 15:18:37.535037 ip-10-0-130-232 kubenswrapper[2575]: I0609 15:18:37.535017 2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-admission-webhook-5b6b8f594-fgzc7"] Jun 09 15:18:37.536370 ip-10-0-130-232 kubenswrapper[2575]: I0609 15:18:37.536348 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certificates\" (UniqueName: \"kubernetes.io/secret/f40a1b5c-5d14-4eb2-afd2-f74461ada01c-tls-certificates\") pod \"prometheus-operator-admission-webhook-5b6b8f594-fgzc7\" (UID: \"f40a1b5c-5d14-4eb2-afd2-f74461ada01c\") " pod="openshift-monitoring/prometheus-operator-admission-webhook-5b6b8f594-fgzc7" Jun 09 15:18:37.542326 ip-10-0-130-232 kubenswrapper[2575]: I0609 15:18:37.542308 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2bkzp_41532b1e-300d-4a9e-a64f-da302213062c/konnectivity-agent/0.log" limit=1024 Jun 09 15:18:37.637673 ip-10-0-130-232 kubenswrapper[2575]: I0609 15:18:37.637590 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certificates\" (UniqueName: \"kubernetes.io/secret/f40a1b5c-5d14-4eb2-afd2-f74461ada01c-tls-certificates\") pod \"prometheus-operator-admission-webhook-5b6b8f594-fgzc7\" (UID: \"f40a1b5c-5d14-4eb2-afd2-f74461ada01c\") " pod="openshift-monitoring/prometheus-operator-admission-webhook-5b6b8f594-fgzc7" Jun 09 15:18:37.637827 ip-10-0-130-232 kubenswrapper[2575]: E0609 15:18:37.637726 2575 secret.go:189] Couldn't get secret openshift-monitoring/prometheus-operator-admission-webhook-tls: secret "prometheus-operator-admission-webhook-tls" not found Jun 09 15:18:37.637827 ip-10-0-130-232 kubenswrapper[2575]: E0609 15:18:37.637802 2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/f40a1b5c-5d14-4eb2-afd2-f74461ada01c-tls-certificates podName:f40a1b5c-5d14-4eb2-afd2-f74461ada01c nodeName:}" failed. No retries permitted until 2026-06-09 15:18:38.137779311 +0000 UTC m=+257.825784745 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "tls-certificates" (UniqueName: "kubernetes.io/secret/f40a1b5c-5d14-4eb2-afd2-f74461ada01c-tls-certificates") pod "prometheus-operator-admission-webhook-5b6b8f594-fgzc7" (UID: "f40a1b5c-5d14-4eb2-afd2-f74461ada01c") : secret "prometheus-operator-admission-webhook-tls" not found Jun 09 15:18:37.691437 ip-10-0-130-232 kubenswrapper[2575]: I0609 15:18:37.691407 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2bkzp_41532b1e-300d-4a9e-a64f-da302213062c/konnectivity-agent/0.log" limit=1024 Jun 09 15:18:37.757756 ip-10-0-130-232 kubenswrapper[2575]: I0609 15:18:37.757731 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2bkzp_41532b1e-300d-4a9e-a64f-da302213062c/konnectivity-agent/0.log" limit=1024 Jun 09 15:18:37.973215 ip-10-0-130-232 kubenswrapper[2575]: I0609 15:18:37.973186 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2bkzp_41532b1e-300d-4a9e-a64f-da302213062c/konnectivity-agent/0.log" limit=1024 Jun 09 15:18:38.140533 ip-10-0-130-232 kubenswrapper[2575]: I0609 15:18:38.140494 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certificates\" (UniqueName: \"kubernetes.io/secret/f40a1b5c-5d14-4eb2-afd2-f74461ada01c-tls-certificates\") pod \"prometheus-operator-admission-webhook-5b6b8f594-fgzc7\" (UID: \"f40a1b5c-5d14-4eb2-afd2-f74461ada01c\") " pod="openshift-monitoring/prometheus-operator-admission-webhook-5b6b8f594-fgzc7" Jun 09 15:18:38.143084 ip-10-0-130-232 kubenswrapper[2575]: I0609 15:18:38.143066 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certificates\" (UniqueName: \"kubernetes.io/secret/f40a1b5c-5d14-4eb2-afd2-f74461ada01c-tls-certificates\") pod \"prometheus-operator-admission-webhook-5b6b8f594-fgzc7\" (UID: \"f40a1b5c-5d14-4eb2-afd2-f74461ada01c\") " pod="openshift-monitoring/prometheus-operator-admission-webhook-5b6b8f594-fgzc7" Jun 09 15:18:38.433732 ip-10-0-130-232 kubenswrapper[2575]: I0609 15:18:38.433646 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-admission-webhook-5b6b8f594-fgzc7" Jun 09 15:18:38.557307 ip-10-0-130-232 kubenswrapper[2575]: I0609 15:18:38.557285 2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-admission-webhook-5b6b8f594-fgzc7"] Jun 09 15:18:38.559837 ip-10-0-130-232 kubenswrapper[2575]: W0609 15:18:38.559806 2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf40a1b5c_5d14_4eb2_afd2_f74461ada01c.slice/crio-9a7f73c532579bb9abba36e437da57828a93070c641fbdfad853fb7eef939dd5 WatchSource:0}: Error finding container 9a7f73c532579bb9abba36e437da57828a93070c641fbdfad853fb7eef939dd5: Status 404 returned error can't find the container with id 9a7f73c532579bb9abba36e437da57828a93070c641fbdfad853fb7eef939dd5 Jun 09 15:18:39.500472 ip-10-0-130-232 kubenswrapper[2575]: I0609 15:18:39.500426 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-admission-webhook-5b6b8f594-fgzc7" event={"ID":"f40a1b5c-5d14-4eb2-afd2-f74461ada01c","Type":"ContainerStarted","Data":"9a7f73c532579bb9abba36e437da57828a93070c641fbdfad853fb7eef939dd5"} Jun 09 15:18:40.505003 ip-10-0-130-232 kubenswrapper[2575]: I0609 15:18:40.504968 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-admission-webhook-5b6b8f594-fgzc7" event={"ID":"f40a1b5c-5d14-4eb2-afd2-f74461ada01c","Type":"ContainerStarted","Data":"d03f98e2cc1b09f11d0fd8f6b29c519b9c90fa406634016d04221f08c2b46f21"} Jun 09 15:18:40.505433 ip-10-0-130-232 kubenswrapper[2575]: I0609 15:18:40.505267 2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/prometheus-operator-admission-webhook-5b6b8f594-fgzc7" Jun 09 15:18:40.509728 ip-10-0-130-232 kubenswrapper[2575]: I0609 15:18:40.509707 2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/prometheus-operator-admission-webhook-5b6b8f594-fgzc7" Jun 09 15:18:40.523919 ip-10-0-130-232 kubenswrapper[2575]: I0609 15:18:40.523868 2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/prometheus-operator-admission-webhook-5b6b8f594-fgzc7" podStartSLOduration=2.490659852 podStartE2EDuration="3.523830433s" totalImagesPullingTime="1.033170581s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-09 15:18:37 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-09 15:18:40.52353821 +0000 UTC m=+260.211543688" watchObservedRunningTime="2026-06-09 15:18:40.523830433 +0000 UTC m=+260.211835887" Jun 09 15:18:41.558875 ip-10-0-130-232 kubenswrapper[2575]: I0609 15:18:41.558824 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2bkzp_41532b1e-300d-4a9e-a64f-da302213062c/konnectivity-agent/0.log" limit=1024 Jun 09 15:18:41.647384 ip-10-0-130-232 kubenswrapper[2575]: I0609 15:18:41.647352 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2bkzp_41532b1e-300d-4a9e-a64f-da302213062c/konnectivity-agent/0.log" limit=1024 Jun 09 15:18:41.870638 ip-10-0-130-232 kubenswrapper[2575]: I0609 15:18:41.870553 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2bkzp_41532b1e-300d-4a9e-a64f-da302213062c/konnectivity-agent/0.log" limit=1024 Jun 09 15:18:44.219407 ip-10-0-130-232 kubenswrapper[2575]: I0609 15:18:44.219372 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2bkzp_41532b1e-300d-4a9e-a64f-da302213062c/konnectivity-agent/0.log" limit=1024 Jun 09 15:18:45.757819 ip-10-0-130-232 kubenswrapper[2575]: I0609 15:18:45.757786 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2bkzp_41532b1e-300d-4a9e-a64f-da302213062c/konnectivity-agent/0.log" limit=1024 Jun 09 15:18:45.969536 ip-10-0-130-232 kubenswrapper[2575]: I0609 15:18:45.969497 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2bkzp_41532b1e-300d-4a9e-a64f-da302213062c/konnectivity-agent/0.log" limit=1024 Jun 09 15:18:46.081244 ip-10-0-130-232 kubenswrapper[2575]: I0609 15:18:46.081165 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2bkzp_41532b1e-300d-4a9e-a64f-da302213062c/konnectivity-agent/0.log" limit=1024 Jun 09 15:18:46.098615 ip-10-0-130-232 kubenswrapper[2575]: I0609 15:18:46.098587 2575 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/openshift-state-metrics-65f78d5c66-zpj7b"] Jun 09 15:18:46.101874 ip-10-0-130-232 kubenswrapper[2575]: I0609 15:18:46.101834 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/openshift-state-metrics-65f78d5c66-zpj7b" Jun 09 15:18:46.107143 ip-10-0-130-232 kubenswrapper[2575]: I0609 15:18:46.107118 2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"openshift-state-metrics-kube-rbac-proxy-config\"" Jun 09 15:18:46.107369 ip-10-0-130-232 kubenswrapper[2575]: I0609 15:18:46.107351 2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"openshift-state-metrics-tls\"" Jun 09 15:18:46.107470 ip-10-0-130-232 kubenswrapper[2575]: I0609 15:18:46.107372 2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"metrics-client-ca\"" Jun 09 15:18:46.107470 ip-10-0-130-232 kubenswrapper[2575]: I0609 15:18:46.107354 2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kube-root-ca.crt\"" Jun 09 15:18:46.107655 ip-10-0-130-232 kubenswrapper[2575]: I0609 15:18:46.107639 2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"openshift-state-metrics-dockercfg-qlmmv\"" Jun 09 15:18:46.109923 ip-10-0-130-232 kubenswrapper[2575]: I0609 15:18:46.109908 2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"openshift-service-ca.crt\"" Jun 09 15:18:46.118472 ip-10-0-130-232 kubenswrapper[2575]: I0609 15:18:46.118454 2575 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/node-exporter-7mmxf"] Jun 09 15:18:46.121329 ip-10-0-130-232 kubenswrapper[2575]: I0609 15:18:46.121314 2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/openshift-state-metrics-65f78d5c66-zpj7b"] Jun 09 15:18:46.121409 ip-10-0-130-232 kubenswrapper[2575]: I0609 15:18:46.121399 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-7mmxf" Jun 09 15:18:46.125115 ip-10-0-130-232 kubenswrapper[2575]: I0609 15:18:46.125096 2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-tls\"" Jun 09 15:18:46.125211 ip-10-0-130-232 kubenswrapper[2575]: I0609 15:18:46.125173 2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-dockercfg-zzjz7\"" Jun 09 15:18:46.125273 ip-10-0-130-232 kubenswrapper[2575]: I0609 15:18:46.125179 2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-kube-rbac-proxy-config\"" Jun 09 15:18:46.125371 ip-10-0-130-232 kubenswrapper[2575]: I0609 15:18:46.125347 2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"node-exporter-accelerators-collector-config\"" Jun 09 15:18:46.194792 ip-10-0-130-232 kubenswrapper[2575]: I0609 15:18:46.194754 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/5aa1422c-2775-4e8c-8350-91b878aec45a-openshift-state-metrics-tls\") pod \"openshift-state-metrics-65f78d5c66-zpj7b\" (UID: \"5aa1422c-2775-4e8c-8350-91b878aec45a\") " pod="openshift-monitoring/openshift-state-metrics-65f78d5c66-zpj7b" Jun 09 15:18:46.194792 ip-10-0-130-232 kubenswrapper[2575]: I0609 15:18:46.194794 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/5aa1422c-2775-4e8c-8350-91b878aec45a-openshift-state-metrics-kube-rbac-proxy-config\") pod \"openshift-state-metrics-65f78d5c66-zpj7b\" (UID: \"5aa1422c-2775-4e8c-8350-91b878aec45a\") " pod="openshift-monitoring/openshift-state-metrics-65f78d5c66-zpj7b" Jun 09 15:18:46.195052 ip-10-0-130-232 kubenswrapper[2575]: I0609 15:18:46.194822 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/7bfe71bf-a543-4ec0-a2e9-b7efe4c8a65a-sys\") pod \"node-exporter-7mmxf\" (UID: \"7bfe71bf-a543-4ec0-a2e9-b7efe4c8a65a\") " pod="openshift-monitoring/node-exporter-7mmxf" Jun 09 15:18:46.195052 ip-10-0-130-232 kubenswrapper[2575]: I0609 15:18:46.194862 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/7bfe71bf-a543-4ec0-a2e9-b7efe4c8a65a-metrics-client-ca\") pod \"node-exporter-7mmxf\" (UID: \"7bfe71bf-a543-4ec0-a2e9-b7efe4c8a65a\") " pod="openshift-monitoring/node-exporter-7mmxf" Jun 09 15:18:46.195052 ip-10-0-130-232 kubenswrapper[2575]: I0609 15:18:46.194893 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/7bfe71bf-a543-4ec0-a2e9-b7efe4c8a65a-node-exporter-accelerators-collector-config\") pod \"node-exporter-7mmxf\" (UID: \"7bfe71bf-a543-4ec0-a2e9-b7efe4c8a65a\") " pod="openshift-monitoring/node-exporter-7mmxf" Jun 09 15:18:46.195052 ip-10-0-130-232 kubenswrapper[2575]: I0609 15:18:46.194922 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/7bfe71bf-a543-4ec0-a2e9-b7efe4c8a65a-root\") pod \"node-exporter-7mmxf\" (UID: \"7bfe71bf-a543-4ec0-a2e9-b7efe4c8a65a\") " pod="openshift-monitoring/node-exporter-7mmxf" Jun 09 15:18:46.195052 ip-10-0-130-232 kubenswrapper[2575]: I0609 15:18:46.194943 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-g9zzm\" (UniqueName: \"kubernetes.io/projected/5aa1422c-2775-4e8c-8350-91b878aec45a-kube-api-access-g9zzm\") pod \"openshift-state-metrics-65f78d5c66-zpj7b\" (UID: \"5aa1422c-2775-4e8c-8350-91b878aec45a\") " pod="openshift-monitoring/openshift-state-metrics-65f78d5c66-zpj7b" Jun 09 15:18:46.195052 ip-10-0-130-232 kubenswrapper[2575]: I0609 15:18:46.194967 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/7bfe71bf-a543-4ec0-a2e9-b7efe4c8a65a-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-7mmxf\" (UID: \"7bfe71bf-a543-4ec0-a2e9-b7efe4c8a65a\") " pod="openshift-monitoring/node-exporter-7mmxf" Jun 09 15:18:46.195052 ip-10-0-130-232 kubenswrapper[2575]: I0609 15:18:46.195015 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/5aa1422c-2775-4e8c-8350-91b878aec45a-metrics-client-ca\") pod \"openshift-state-metrics-65f78d5c66-zpj7b\" (UID: \"5aa1422c-2775-4e8c-8350-91b878aec45a\") " pod="openshift-monitoring/openshift-state-metrics-65f78d5c66-zpj7b" Jun 09 15:18:46.195052 ip-10-0-130-232 kubenswrapper[2575]: I0609 15:18:46.195040 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/7bfe71bf-a543-4ec0-a2e9-b7efe4c8a65a-node-exporter-tls\") pod \"node-exporter-7mmxf\" (UID: \"7bfe71bf-a543-4ec0-a2e9-b7efe4c8a65a\") " pod="openshift-monitoring/node-exporter-7mmxf" Jun 09 15:18:46.195289 ip-10-0-130-232 kubenswrapper[2575]: I0609 15:18:46.195061 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/7bfe71bf-a543-4ec0-a2e9-b7efe4c8a65a-node-exporter-wtmp\") pod \"node-exporter-7mmxf\" (UID: \"7bfe71bf-a543-4ec0-a2e9-b7efe4c8a65a\") " pod="openshift-monitoring/node-exporter-7mmxf" Jun 09 15:18:46.195289 ip-10-0-130-232 kubenswrapper[2575]: I0609 15:18:46.195082 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2v26n\" (UniqueName: \"kubernetes.io/projected/7bfe71bf-a543-4ec0-a2e9-b7efe4c8a65a-kube-api-access-2v26n\") pod \"node-exporter-7mmxf\" (UID: \"7bfe71bf-a543-4ec0-a2e9-b7efe4c8a65a\") " pod="openshift-monitoring/node-exporter-7mmxf" Jun 09 15:18:46.195289 ip-10-0-130-232 kubenswrapper[2575]: I0609 15:18:46.195120 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/7bfe71bf-a543-4ec0-a2e9-b7efe4c8a65a-node-exporter-textfile\") pod \"node-exporter-7mmxf\" (UID: \"7bfe71bf-a543-4ec0-a2e9-b7efe4c8a65a\") " pod="openshift-monitoring/node-exporter-7mmxf" Jun 09 15:18:46.238353 ip-10-0-130-232 kubenswrapper[2575]: I0609 15:18:46.238292 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2bkzp_41532b1e-300d-4a9e-a64f-da302213062c/konnectivity-agent/0.log" limit=1024 Jun 09 15:18:46.295592 ip-10-0-130-232 kubenswrapper[2575]: I0609 15:18:46.295533 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2v26n\" (UniqueName: \"kubernetes.io/projected/7bfe71bf-a543-4ec0-a2e9-b7efe4c8a65a-kube-api-access-2v26n\") pod \"node-exporter-7mmxf\" (UID: \"7bfe71bf-a543-4ec0-a2e9-b7efe4c8a65a\") " pod="openshift-monitoring/node-exporter-7mmxf" Jun 09 15:18:46.295761 ip-10-0-130-232 kubenswrapper[2575]: I0609 15:18:46.295634 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/7bfe71bf-a543-4ec0-a2e9-b7efe4c8a65a-node-exporter-textfile\") pod \"node-exporter-7mmxf\" (UID: \"7bfe71bf-a543-4ec0-a2e9-b7efe4c8a65a\") " pod="openshift-monitoring/node-exporter-7mmxf" Jun 09 15:18:46.295761 ip-10-0-130-232 kubenswrapper[2575]: I0609 15:18:46.295667 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/5aa1422c-2775-4e8c-8350-91b878aec45a-openshift-state-metrics-tls\") pod \"openshift-state-metrics-65f78d5c66-zpj7b\" (UID: \"5aa1422c-2775-4e8c-8350-91b878aec45a\") " pod="openshift-monitoring/openshift-state-metrics-65f78d5c66-zpj7b" Jun 09 15:18:46.295761 ip-10-0-130-232 kubenswrapper[2575]: I0609 15:18:46.295706 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/5aa1422c-2775-4e8c-8350-91b878aec45a-openshift-state-metrics-kube-rbac-proxy-config\") pod \"openshift-state-metrics-65f78d5c66-zpj7b\" (UID: \"5aa1422c-2775-4e8c-8350-91b878aec45a\") " pod="openshift-monitoring/openshift-state-metrics-65f78d5c66-zpj7b" Jun 09 15:18:46.295761 ip-10-0-130-232 kubenswrapper[2575]: I0609 15:18:46.295731 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/7bfe71bf-a543-4ec0-a2e9-b7efe4c8a65a-sys\") pod \"node-exporter-7mmxf\" (UID: \"7bfe71bf-a543-4ec0-a2e9-b7efe4c8a65a\") " pod="openshift-monitoring/node-exporter-7mmxf" Jun 09 15:18:46.295761 ip-10-0-130-232 kubenswrapper[2575]: I0609 15:18:46.295754 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/7bfe71bf-a543-4ec0-a2e9-b7efe4c8a65a-metrics-client-ca\") pod \"node-exporter-7mmxf\" (UID: \"7bfe71bf-a543-4ec0-a2e9-b7efe4c8a65a\") " pod="openshift-monitoring/node-exporter-7mmxf" Jun 09 15:18:46.296042 ip-10-0-130-232 kubenswrapper[2575]: I0609 15:18:46.295790 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/7bfe71bf-a543-4ec0-a2e9-b7efe4c8a65a-node-exporter-accelerators-collector-config\") pod \"node-exporter-7mmxf\" (UID: \"7bfe71bf-a543-4ec0-a2e9-b7efe4c8a65a\") " pod="openshift-monitoring/node-exporter-7mmxf" Jun 09 15:18:46.296042 ip-10-0-130-232 kubenswrapper[2575]: I0609 15:18:46.295821 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/7bfe71bf-a543-4ec0-a2e9-b7efe4c8a65a-root\") pod \"node-exporter-7mmxf\" (UID: \"7bfe71bf-a543-4ec0-a2e9-b7efe4c8a65a\") " pod="openshift-monitoring/node-exporter-7mmxf" Jun 09 15:18:46.296042 ip-10-0-130-232 kubenswrapper[2575]: I0609 15:18:46.295838 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/7bfe71bf-a543-4ec0-a2e9-b7efe4c8a65a-sys\") pod \"node-exporter-7mmxf\" (UID: \"7bfe71bf-a543-4ec0-a2e9-b7efe4c8a65a\") " pod="openshift-monitoring/node-exporter-7mmxf" Jun 09 15:18:46.296042 ip-10-0-130-232 kubenswrapper[2575]: I0609 15:18:46.295868 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-g9zzm\" (UniqueName: \"kubernetes.io/projected/5aa1422c-2775-4e8c-8350-91b878aec45a-kube-api-access-g9zzm\") pod \"openshift-state-metrics-65f78d5c66-zpj7b\" (UID: \"5aa1422c-2775-4e8c-8350-91b878aec45a\") " pod="openshift-monitoring/openshift-state-metrics-65f78d5c66-zpj7b" Jun 09 15:18:46.296042 ip-10-0-130-232 kubenswrapper[2575]: I0609 15:18:46.295929 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/7bfe71bf-a543-4ec0-a2e9-b7efe4c8a65a-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-7mmxf\" (UID: \"7bfe71bf-a543-4ec0-a2e9-b7efe4c8a65a\") " pod="openshift-monitoring/node-exporter-7mmxf" Jun 09 15:18:46.296042 ip-10-0-130-232 kubenswrapper[2575]: I0609 15:18:46.295976 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/5aa1422c-2775-4e8c-8350-91b878aec45a-metrics-client-ca\") pod \"openshift-state-metrics-65f78d5c66-zpj7b\" (UID: \"5aa1422c-2775-4e8c-8350-91b878aec45a\") " pod="openshift-monitoring/openshift-state-metrics-65f78d5c66-zpj7b" Jun 09 15:18:46.296042 ip-10-0-130-232 kubenswrapper[2575]: I0609 15:18:46.295986 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"root\" (UniqueName: \"kubernetes.io/host-path/7bfe71bf-a543-4ec0-a2e9-b7efe4c8a65a-root\") pod \"node-exporter-7mmxf\" (UID: \"7bfe71bf-a543-4ec0-a2e9-b7efe4c8a65a\") " pod="openshift-monitoring/node-exporter-7mmxf" Jun 09 15:18:46.296042 ip-10-0-130-232 kubenswrapper[2575]: I0609 15:18:46.296000 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/7bfe71bf-a543-4ec0-a2e9-b7efe4c8a65a-node-exporter-tls\") pod \"node-exporter-7mmxf\" (UID: \"7bfe71bf-a543-4ec0-a2e9-b7efe4c8a65a\") " pod="openshift-monitoring/node-exporter-7mmxf" Jun 09 15:18:46.296042 ip-10-0-130-232 kubenswrapper[2575]: I0609 15:18:46.296025 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/7bfe71bf-a543-4ec0-a2e9-b7efe4c8a65a-node-exporter-wtmp\") pod \"node-exporter-7mmxf\" (UID: \"7bfe71bf-a543-4ec0-a2e9-b7efe4c8a65a\") " pod="openshift-monitoring/node-exporter-7mmxf" Jun 09 15:18:46.296512 ip-10-0-130-232 kubenswrapper[2575]: I0609 15:18:46.296066 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/7bfe71bf-a543-4ec0-a2e9-b7efe4c8a65a-node-exporter-textfile\") pod \"node-exporter-7mmxf\" (UID: \"7bfe71bf-a543-4ec0-a2e9-b7efe4c8a65a\") " pod="openshift-monitoring/node-exporter-7mmxf" Jun 09 15:18:46.296512 ip-10-0-130-232 kubenswrapper[2575]: I0609 15:18:46.296177 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/7bfe71bf-a543-4ec0-a2e9-b7efe4c8a65a-node-exporter-wtmp\") pod \"node-exporter-7mmxf\" (UID: \"7bfe71bf-a543-4ec0-a2e9-b7efe4c8a65a\") " pod="openshift-monitoring/node-exporter-7mmxf" Jun 09 15:18:46.296512 ip-10-0-130-232 kubenswrapper[2575]: I0609 15:18:46.296451 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/7bfe71bf-a543-4ec0-a2e9-b7efe4c8a65a-node-exporter-accelerators-collector-config\") pod \"node-exporter-7mmxf\" (UID: \"7bfe71bf-a543-4ec0-a2e9-b7efe4c8a65a\") " pod="openshift-monitoring/node-exporter-7mmxf" Jun 09 15:18:46.296824 ip-10-0-130-232 kubenswrapper[2575]: I0609 15:18:46.296589 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/7bfe71bf-a543-4ec0-a2e9-b7efe4c8a65a-metrics-client-ca\") pod \"node-exporter-7mmxf\" (UID: \"7bfe71bf-a543-4ec0-a2e9-b7efe4c8a65a\") " pod="openshift-monitoring/node-exporter-7mmxf" Jun 09 15:18:46.296990 ip-10-0-130-232 kubenswrapper[2575]: I0609 15:18:46.296967 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/5aa1422c-2775-4e8c-8350-91b878aec45a-metrics-client-ca\") pod \"openshift-state-metrics-65f78d5c66-zpj7b\" (UID: \"5aa1422c-2775-4e8c-8350-91b878aec45a\") " pod="openshift-monitoring/openshift-state-metrics-65f78d5c66-zpj7b" Jun 09 15:18:46.298478 ip-10-0-130-232 kubenswrapper[2575]: I0609 15:18:46.298453 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/7bfe71bf-a543-4ec0-a2e9-b7efe4c8a65a-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-7mmxf\" (UID: \"7bfe71bf-a543-4ec0-a2e9-b7efe4c8a65a\") " pod="openshift-monitoring/node-exporter-7mmxf" Jun 09 15:18:46.298582 ip-10-0-130-232 kubenswrapper[2575]: I0609 15:18:46.298519 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"openshift-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/5aa1422c-2775-4e8c-8350-91b878aec45a-openshift-state-metrics-kube-rbac-proxy-config\") pod \"openshift-state-metrics-65f78d5c66-zpj7b\" (UID: \"5aa1422c-2775-4e8c-8350-91b878aec45a\") " pod="openshift-monitoring/openshift-state-metrics-65f78d5c66-zpj7b" Jun 09 15:18:46.298888 ip-10-0-130-232 kubenswrapper[2575]: I0609 15:18:46.298869 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/7bfe71bf-a543-4ec0-a2e9-b7efe4c8a65a-node-exporter-tls\") pod \"node-exporter-7mmxf\" (UID: \"7bfe71bf-a543-4ec0-a2e9-b7efe4c8a65a\") " pod="openshift-monitoring/node-exporter-7mmxf" Jun 09 15:18:46.299044 ip-10-0-130-232 kubenswrapper[2575]: I0609 15:18:46.299025 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"openshift-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/5aa1422c-2775-4e8c-8350-91b878aec45a-openshift-state-metrics-tls\") pod \"openshift-state-metrics-65f78d5c66-zpj7b\" (UID: \"5aa1422c-2775-4e8c-8350-91b878aec45a\") " pod="openshift-monitoring/openshift-state-metrics-65f78d5c66-zpj7b" Jun 09 15:18:46.312355 ip-10-0-130-232 kubenswrapper[2575]: I0609 15:18:46.312327 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-g9zzm\" (UniqueName: \"kubernetes.io/projected/5aa1422c-2775-4e8c-8350-91b878aec45a-kube-api-access-g9zzm\") pod \"openshift-state-metrics-65f78d5c66-zpj7b\" (UID: \"5aa1422c-2775-4e8c-8350-91b878aec45a\") " pod="openshift-monitoring/openshift-state-metrics-65f78d5c66-zpj7b" Jun 09 15:18:46.312541 ip-10-0-130-232 kubenswrapper[2575]: I0609 15:18:46.312525 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-2v26n\" (UniqueName: \"kubernetes.io/projected/7bfe71bf-a543-4ec0-a2e9-b7efe4c8a65a-kube-api-access-2v26n\") pod \"node-exporter-7mmxf\" (UID: \"7bfe71bf-a543-4ec0-a2e9-b7efe4c8a65a\") " pod="openshift-monitoring/node-exporter-7mmxf" Jun 09 15:18:46.363901 ip-10-0-130-232 kubenswrapper[2575]: I0609 15:18:46.363805 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2bkzp_41532b1e-300d-4a9e-a64f-da302213062c/konnectivity-agent/0.log" limit=1024 Jun 09 15:18:46.411107 ip-10-0-130-232 kubenswrapper[2575]: I0609 15:18:46.411072 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/openshift-state-metrics-65f78d5c66-zpj7b" Jun 09 15:18:46.430496 ip-10-0-130-232 kubenswrapper[2575]: I0609 15:18:46.430472 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-7mmxf" Jun 09 15:18:46.441908 ip-10-0-130-232 kubenswrapper[2575]: W0609 15:18:46.441884 2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7bfe71bf_a543_4ec0_a2e9_b7efe4c8a65a.slice/crio-a95b8340377e725de1905bcb79d28bc774c006cf86a733f8c736b2714a084822 WatchSource:0}: Error finding container a95b8340377e725de1905bcb79d28bc774c006cf86a733f8c736b2714a084822: Status 404 returned error can't find the container with id a95b8340377e725de1905bcb79d28bc774c006cf86a733f8c736b2714a084822 Jun 09 15:18:46.478463 ip-10-0-130-232 kubenswrapper[2575]: I0609 15:18:46.478433 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2bkzp_41532b1e-300d-4a9e-a64f-da302213062c/konnectivity-agent/0.log" limit=1024 Jun 09 15:18:46.524829 ip-10-0-130-232 kubenswrapper[2575]: I0609 15:18:46.524786 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-7mmxf" event={"ID":"7bfe71bf-a543-4ec0-a2e9-b7efe4c8a65a","Type":"ContainerStarted","Data":"a95b8340377e725de1905bcb79d28bc774c006cf86a733f8c736b2714a084822"} Jun 09 15:18:46.563013 ip-10-0-130-232 kubenswrapper[2575]: I0609 15:18:46.562986 2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/openshift-state-metrics-65f78d5c66-zpj7b"] Jun 09 15:18:46.565754 ip-10-0-130-232 kubenswrapper[2575]: W0609 15:18:46.565733 2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5aa1422c_2775_4e8c_8350_91b878aec45a.slice/crio-00496f8f414b138b387ddf4982ddb140088a024c73f0ae0f86fbd0b7493c63b4 WatchSource:0}: Error finding container 00496f8f414b138b387ddf4982ddb140088a024c73f0ae0f86fbd0b7493c63b4: Status 404 returned error can't find the container with id 00496f8f414b138b387ddf4982ddb140088a024c73f0ae0f86fbd0b7493c63b4 Jun 09 15:18:46.686921 ip-10-0-130-232 kubenswrapper[2575]: I0609 15:18:46.686882 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2bkzp_41532b1e-300d-4a9e-a64f-da302213062c/konnectivity-agent/0.log" limit=1024 Jun 09 15:18:46.786437 ip-10-0-130-232 kubenswrapper[2575]: I0609 15:18:46.786408 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2bkzp_41532b1e-300d-4a9e-a64f-da302213062c/konnectivity-agent/0.log" limit=1024 Jun 09 15:18:47.037889 ip-10-0-130-232 kubenswrapper[2575]: I0609 15:18:47.037858 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2bkzp_41532b1e-300d-4a9e-a64f-da302213062c/konnectivity-agent/0.log" limit=1024 Jun 09 15:18:47.139760 ip-10-0-130-232 kubenswrapper[2575]: I0609 15:18:47.139724 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2bkzp_41532b1e-300d-4a9e-a64f-da302213062c/konnectivity-agent/0.log" limit=1024 Jun 09 15:18:47.148656 ip-10-0-130-232 kubenswrapper[2575]: I0609 15:18:47.148549 2575 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Jun 09 15:18:47.152581 ip-10-0-130-232 kubenswrapper[2575]: I0609 15:18:47.152556 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0" Jun 09 15:18:47.156055 ip-10-0-130-232 kubenswrapper[2575]: I0609 15:18:47.155629 2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-generated\"" Jun 09 15:18:47.156055 ip-10-0-130-232 kubenswrapper[2575]: I0609 15:18:47.155764 2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-web-config\"" Jun 09 15:18:47.156055 ip-10-0-130-232 kubenswrapper[2575]: I0609 15:18:47.155629 2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy\"" Jun 09 15:18:47.156055 ip-10-0-130-232 kubenswrapper[2575]: I0609 15:18:47.156017 2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-dockercfg-f59l6\"" Jun 09 15:18:47.157485 ip-10-0-130-232 kubenswrapper[2575]: I0609 15:18:47.156516 2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"alertmanager-trusted-ca-bundle\"" Jun 09 15:18:47.157485 ip-10-0-130-232 kubenswrapper[2575]: I0609 15:18:47.156706 2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-tls\"" Jun 09 15:18:47.157485 ip-10-0-130-232 kubenswrapper[2575]: I0609 15:18:47.156929 2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-tls-assets-0\"" Jun 09 15:18:47.157485 ip-10-0-130-232 kubenswrapper[2575]: I0609 15:18:47.157121 2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy-web\"" Jun 09 15:18:47.157485 ip-10-0-130-232 kubenswrapper[2575]: I0609 15:18:47.157307 2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-cluster-tls-config\"" Jun 09 15:18:47.157485 ip-10-0-130-232 kubenswrapper[2575]: I0609 15:18:47.157393 2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy-metric\"" Jun 09 15:18:47.181695 ip-10-0-130-232 kubenswrapper[2575]: I0609 15:18:47.181662 2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Jun 09 15:18:47.204408 ip-10-0-130-232 kubenswrapper[2575]: I0609 15:18:47.204320 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/e88ffeea-65a9-4fe0-a4e5-b298a11a8e5d-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"e88ffeea-65a9-4fe0-a4e5-b298a11a8e5d\") " pod="openshift-monitoring/alertmanager-main-0" Jun 09 15:18:47.204408 ip-10-0-130-232 kubenswrapper[2575]: I0609 15:18:47.204368 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/e88ffeea-65a9-4fe0-a4e5-b298a11a8e5d-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"e88ffeea-65a9-4fe0-a4e5-b298a11a8e5d\") " pod="openshift-monitoring/alertmanager-main-0" Jun 09 15:18:47.204632 ip-10-0-130-232 kubenswrapper[2575]: I0609 15:18:47.204442 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/e88ffeea-65a9-4fe0-a4e5-b298a11a8e5d-web-config\") pod \"alertmanager-main-0\" (UID: \"e88ffeea-65a9-4fe0-a4e5-b298a11a8e5d\") " pod="openshift-monitoring/alertmanager-main-0" Jun 09 15:18:47.204632 ip-10-0-130-232 kubenswrapper[2575]: I0609 15:18:47.204481 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/e88ffeea-65a9-4fe0-a4e5-b298a11a8e5d-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"e88ffeea-65a9-4fe0-a4e5-b298a11a8e5d\") " pod="openshift-monitoring/alertmanager-main-0" Jun 09 15:18:47.204632 ip-10-0-130-232 kubenswrapper[2575]: I0609 15:18:47.204548 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/e88ffeea-65a9-4fe0-a4e5-b298a11a8e5d-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"e88ffeea-65a9-4fe0-a4e5-b298a11a8e5d\") " pod="openshift-monitoring/alertmanager-main-0" Jun 09 15:18:47.204632 ip-10-0-130-232 kubenswrapper[2575]: I0609 15:18:47.204576 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/e88ffeea-65a9-4fe0-a4e5-b298a11a8e5d-config-out\") pod \"alertmanager-main-0\" (UID: \"e88ffeea-65a9-4fe0-a4e5-b298a11a8e5d\") " pod="openshift-monitoring/alertmanager-main-0" Jun 09 15:18:47.204632 ip-10-0-130-232 kubenswrapper[2575]: I0609 15:18:47.204602 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/e88ffeea-65a9-4fe0-a4e5-b298a11a8e5d-config-volume\") pod \"alertmanager-main-0\" (UID: \"e88ffeea-65a9-4fe0-a4e5-b298a11a8e5d\") " pod="openshift-monitoring/alertmanager-main-0" Jun 09 15:18:47.204632 ip-10-0-130-232 kubenswrapper[2575]: I0609 15:18:47.204624 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/e88ffeea-65a9-4fe0-a4e5-b298a11a8e5d-tls-assets\") pod \"alertmanager-main-0\" (UID: \"e88ffeea-65a9-4fe0-a4e5-b298a11a8e5d\") " pod="openshift-monitoring/alertmanager-main-0" Jun 09 15:18:47.204963 ip-10-0-130-232 kubenswrapper[2575]: I0609 15:18:47.204669 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/e88ffeea-65a9-4fe0-a4e5-b298a11a8e5d-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"e88ffeea-65a9-4fe0-a4e5-b298a11a8e5d\") " pod="openshift-monitoring/alertmanager-main-0" Jun 09 15:18:47.204963 ip-10-0-130-232 kubenswrapper[2575]: I0609 15:18:47.204709 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9ctgr\" (UniqueName: \"kubernetes.io/projected/e88ffeea-65a9-4fe0-a4e5-b298a11a8e5d-kube-api-access-9ctgr\") pod \"alertmanager-main-0\" (UID: \"e88ffeea-65a9-4fe0-a4e5-b298a11a8e5d\") " pod="openshift-monitoring/alertmanager-main-0" Jun 09 15:18:47.204963 ip-10-0-130-232 kubenswrapper[2575]: I0609 15:18:47.204741 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/e88ffeea-65a9-4fe0-a4e5-b298a11a8e5d-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"e88ffeea-65a9-4fe0-a4e5-b298a11a8e5d\") " pod="openshift-monitoring/alertmanager-main-0" Jun 09 15:18:47.204963 ip-10-0-130-232 kubenswrapper[2575]: I0609 15:18:47.204766 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/e88ffeea-65a9-4fe0-a4e5-b298a11a8e5d-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"e88ffeea-65a9-4fe0-a4e5-b298a11a8e5d\") " pod="openshift-monitoring/alertmanager-main-0" Jun 09 15:18:47.204963 ip-10-0-130-232 kubenswrapper[2575]: I0609 15:18:47.204792 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/e88ffeea-65a9-4fe0-a4e5-b298a11a8e5d-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"e88ffeea-65a9-4fe0-a4e5-b298a11a8e5d\") " pod="openshift-monitoring/alertmanager-main-0" Jun 09 15:18:47.305528 ip-10-0-130-232 kubenswrapper[2575]: I0609 15:18:47.305371 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/e88ffeea-65a9-4fe0-a4e5-b298a11a8e5d-config-out\") pod \"alertmanager-main-0\" (UID: \"e88ffeea-65a9-4fe0-a4e5-b298a11a8e5d\") " pod="openshift-monitoring/alertmanager-main-0" Jun 09 15:18:47.305528 ip-10-0-130-232 kubenswrapper[2575]: I0609 15:18:47.305417 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/e88ffeea-65a9-4fe0-a4e5-b298a11a8e5d-config-volume\") pod \"alertmanager-main-0\" (UID: \"e88ffeea-65a9-4fe0-a4e5-b298a11a8e5d\") " pod="openshift-monitoring/alertmanager-main-0" Jun 09 15:18:47.305528 ip-10-0-130-232 kubenswrapper[2575]: I0609 15:18:47.305442 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/e88ffeea-65a9-4fe0-a4e5-b298a11a8e5d-tls-assets\") pod \"alertmanager-main-0\" (UID: \"e88ffeea-65a9-4fe0-a4e5-b298a11a8e5d\") " pod="openshift-monitoring/alertmanager-main-0" Jun 09 15:18:47.305528 ip-10-0-130-232 kubenswrapper[2575]: I0609 15:18:47.305471 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/e88ffeea-65a9-4fe0-a4e5-b298a11a8e5d-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"e88ffeea-65a9-4fe0-a4e5-b298a11a8e5d\") " pod="openshift-monitoring/alertmanager-main-0" Jun 09 15:18:47.305799 ip-10-0-130-232 kubenswrapper[2575]: I0609 15:18:47.305613 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9ctgr\" (UniqueName: \"kubernetes.io/projected/e88ffeea-65a9-4fe0-a4e5-b298a11a8e5d-kube-api-access-9ctgr\") pod \"alertmanager-main-0\" (UID: \"e88ffeea-65a9-4fe0-a4e5-b298a11a8e5d\") " pod="openshift-monitoring/alertmanager-main-0" Jun 09 15:18:47.305799 ip-10-0-130-232 kubenswrapper[2575]: I0609 15:18:47.305657 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/e88ffeea-65a9-4fe0-a4e5-b298a11a8e5d-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"e88ffeea-65a9-4fe0-a4e5-b298a11a8e5d\") " pod="openshift-monitoring/alertmanager-main-0" Jun 09 15:18:47.305799 ip-10-0-130-232 kubenswrapper[2575]: I0609 15:18:47.305769 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/e88ffeea-65a9-4fe0-a4e5-b298a11a8e5d-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"e88ffeea-65a9-4fe0-a4e5-b298a11a8e5d\") " pod="openshift-monitoring/alertmanager-main-0" Jun 09 15:18:47.305799 ip-10-0-130-232 kubenswrapper[2575]: I0609 15:18:47.305799 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/e88ffeea-65a9-4fe0-a4e5-b298a11a8e5d-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"e88ffeea-65a9-4fe0-a4e5-b298a11a8e5d\") " pod="openshift-monitoring/alertmanager-main-0" Jun 09 15:18:47.306017 ip-10-0-130-232 kubenswrapper[2575]: I0609 15:18:47.305836 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/e88ffeea-65a9-4fe0-a4e5-b298a11a8e5d-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"e88ffeea-65a9-4fe0-a4e5-b298a11a8e5d\") " pod="openshift-monitoring/alertmanager-main-0" Jun 09 15:18:47.306017 ip-10-0-130-232 kubenswrapper[2575]: I0609 15:18:47.305966 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/e88ffeea-65a9-4fe0-a4e5-b298a11a8e5d-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"e88ffeea-65a9-4fe0-a4e5-b298a11a8e5d\") " pod="openshift-monitoring/alertmanager-main-0" Jun 09 15:18:47.306119 ip-10-0-130-232 kubenswrapper[2575]: I0609 15:18:47.306014 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/e88ffeea-65a9-4fe0-a4e5-b298a11a8e5d-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"e88ffeea-65a9-4fe0-a4e5-b298a11a8e5d\") " pod="openshift-monitoring/alertmanager-main-0" Jun 09 15:18:47.306119 ip-10-0-130-232 kubenswrapper[2575]: E0609 15:18:47.306032 2575 secret.go:189] Couldn't get secret openshift-monitoring/alertmanager-main-tls: secret "alertmanager-main-tls" not found Jun 09 15:18:47.306119 ip-10-0-130-232 kubenswrapper[2575]: I0609 15:18:47.306047 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/e88ffeea-65a9-4fe0-a4e5-b298a11a8e5d-web-config\") pod \"alertmanager-main-0\" (UID: \"e88ffeea-65a9-4fe0-a4e5-b298a11a8e5d\") " pod="openshift-monitoring/alertmanager-main-0" Jun 09 15:18:47.306119 ip-10-0-130-232 kubenswrapper[2575]: E0609 15:18:47.306090 2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e88ffeea-65a9-4fe0-a4e5-b298a11a8e5d-secret-alertmanager-main-tls podName:e88ffeea-65a9-4fe0-a4e5-b298a11a8e5d nodeName:}" failed. No retries permitted until 2026-06-09 15:18:47.806068989 +0000 UTC m=+267.494074433 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "secret-alertmanager-main-tls" (UniqueName: "kubernetes.io/secret/e88ffeea-65a9-4fe0-a4e5-b298a11a8e5d-secret-alertmanager-main-tls") pod "alertmanager-main-0" (UID: "e88ffeea-65a9-4fe0-a4e5-b298a11a8e5d") : secret "alertmanager-main-tls" not found Jun 09 15:18:47.306119 ip-10-0-130-232 kubenswrapper[2575]: I0609 15:18:47.306110 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/e88ffeea-65a9-4fe0-a4e5-b298a11a8e5d-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"e88ffeea-65a9-4fe0-a4e5-b298a11a8e5d\") " pod="openshift-monitoring/alertmanager-main-0" Jun 09 15:18:47.306363 ip-10-0-130-232 kubenswrapper[2575]: I0609 15:18:47.306173 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/e88ffeea-65a9-4fe0-a4e5-b298a11a8e5d-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"e88ffeea-65a9-4fe0-a4e5-b298a11a8e5d\") " pod="openshift-monitoring/alertmanager-main-0" Jun 09 15:18:47.308232 ip-10-0-130-232 kubenswrapper[2575]: I0609 15:18:47.308010 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/e88ffeea-65a9-4fe0-a4e5-b298a11a8e5d-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"e88ffeea-65a9-4fe0-a4e5-b298a11a8e5d\") " pod="openshift-monitoring/alertmanager-main-0" Jun 09 15:18:47.308232 ip-10-0-130-232 kubenswrapper[2575]: I0609 15:18:47.308094 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/e88ffeea-65a9-4fe0-a4e5-b298a11a8e5d-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"e88ffeea-65a9-4fe0-a4e5-b298a11a8e5d\") " pod="openshift-monitoring/alertmanager-main-0" Jun 09 15:18:47.309464 ip-10-0-130-232 kubenswrapper[2575]: I0609 15:18:47.309422 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/e88ffeea-65a9-4fe0-a4e5-b298a11a8e5d-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"e88ffeea-65a9-4fe0-a4e5-b298a11a8e5d\") " pod="openshift-monitoring/alertmanager-main-0" Jun 09 15:18:47.309648 ip-10-0-130-232 kubenswrapper[2575]: I0609 15:18:47.309606 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/e88ffeea-65a9-4fe0-a4e5-b298a11a8e5d-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"e88ffeea-65a9-4fe0-a4e5-b298a11a8e5d\") " pod="openshift-monitoring/alertmanager-main-0" Jun 09 15:18:47.309967 ip-10-0-130-232 kubenswrapper[2575]: I0609 15:18:47.309891 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/e88ffeea-65a9-4fe0-a4e5-b298a11a8e5d-config-volume\") pod \"alertmanager-main-0\" (UID: \"e88ffeea-65a9-4fe0-a4e5-b298a11a8e5d\") " pod="openshift-monitoring/alertmanager-main-0" Jun 09 15:18:47.310621 ip-10-0-130-232 kubenswrapper[2575]: I0609 15:18:47.310528 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/e88ffeea-65a9-4fe0-a4e5-b298a11a8e5d-config-out\") pod \"alertmanager-main-0\" (UID: \"e88ffeea-65a9-4fe0-a4e5-b298a11a8e5d\") " pod="openshift-monitoring/alertmanager-main-0" Jun 09 15:18:47.311629 ip-10-0-130-232 kubenswrapper[2575]: I0609 15:18:47.311611 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/e88ffeea-65a9-4fe0-a4e5-b298a11a8e5d-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"e88ffeea-65a9-4fe0-a4e5-b298a11a8e5d\") " pod="openshift-monitoring/alertmanager-main-0" Jun 09 15:18:47.312163 ip-10-0-130-232 kubenswrapper[2575]: I0609 15:18:47.312123 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/e88ffeea-65a9-4fe0-a4e5-b298a11a8e5d-web-config\") pod \"alertmanager-main-0\" (UID: \"e88ffeea-65a9-4fe0-a4e5-b298a11a8e5d\") " pod="openshift-monitoring/alertmanager-main-0" Jun 09 15:18:47.312282 ip-10-0-130-232 kubenswrapper[2575]: I0609 15:18:47.312177 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/e88ffeea-65a9-4fe0-a4e5-b298a11a8e5d-tls-assets\") pod \"alertmanager-main-0\" (UID: \"e88ffeea-65a9-4fe0-a4e5-b298a11a8e5d\") " pod="openshift-monitoring/alertmanager-main-0" Jun 09 15:18:47.313895 ip-10-0-130-232 kubenswrapper[2575]: I0609 15:18:47.313827 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/e88ffeea-65a9-4fe0-a4e5-b298a11a8e5d-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"e88ffeea-65a9-4fe0-a4e5-b298a11a8e5d\") " pod="openshift-monitoring/alertmanager-main-0" Jun 09 15:18:47.317656 ip-10-0-130-232 kubenswrapper[2575]: I0609 15:18:47.317634 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-9ctgr\" (UniqueName: \"kubernetes.io/projected/e88ffeea-65a9-4fe0-a4e5-b298a11a8e5d-kube-api-access-9ctgr\") pod \"alertmanager-main-0\" (UID: \"e88ffeea-65a9-4fe0-a4e5-b298a11a8e5d\") " pod="openshift-monitoring/alertmanager-main-0" Jun 09 15:18:47.532538 ip-10-0-130-232 kubenswrapper[2575]: I0609 15:18:47.532495 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-65f78d5c66-zpj7b" event={"ID":"5aa1422c-2775-4e8c-8350-91b878aec45a","Type":"ContainerStarted","Data":"0bed80caba9e26d3724cca18ba2711f7ad0dbaf5ad1fd2157b297a11368f6e91"} Jun 09 15:18:47.532720 ip-10-0-130-232 kubenswrapper[2575]: I0609 15:18:47.532612 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-65f78d5c66-zpj7b" event={"ID":"5aa1422c-2775-4e8c-8350-91b878aec45a","Type":"ContainerStarted","Data":"022d65381b3283f4a69fa4774a9c3927789642885d0380c5137cc43d5b43b06e"} Jun 09 15:18:47.532889 ip-10-0-130-232 kubenswrapper[2575]: I0609 15:18:47.532704 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-65f78d5c66-zpj7b" event={"ID":"5aa1422c-2775-4e8c-8350-91b878aec45a","Type":"ContainerStarted","Data":"00496f8f414b138b387ddf4982ddb140088a024c73f0ae0f86fbd0b7493c63b4"} Jun 09 15:18:47.534636 ip-10-0-130-232 kubenswrapper[2575]: I0609 15:18:47.534611 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-7mmxf" event={"ID":"7bfe71bf-a543-4ec0-a2e9-b7efe4c8a65a","Type":"ContainerStarted","Data":"f26cb9bb45c3f7b739c612a9830a61d55aa2cdea0ad2ea3b4b3cfa69a53ea741"} Jun 09 15:18:47.608522 ip-10-0-130-232 kubenswrapper[2575]: I0609 15:18:47.608495 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2bkzp_41532b1e-300d-4a9e-a64f-da302213062c/konnectivity-agent/0.log" limit=1024 Jun 09 15:18:47.809899 ip-10-0-130-232 kubenswrapper[2575]: I0609 15:18:47.809835 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/e88ffeea-65a9-4fe0-a4e5-b298a11a8e5d-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"e88ffeea-65a9-4fe0-a4e5-b298a11a8e5d\") " pod="openshift-monitoring/alertmanager-main-0" Jun 09 15:18:47.812341 ip-10-0-130-232 kubenswrapper[2575]: I0609 15:18:47.812318 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/e88ffeea-65a9-4fe0-a4e5-b298a11a8e5d-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"e88ffeea-65a9-4fe0-a4e5-b298a11a8e5d\") " pod="openshift-monitoring/alertmanager-main-0" Jun 09 15:18:47.948372 ip-10-0-130-232 kubenswrapper[2575]: I0609 15:18:47.948287 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2bkzp_41532b1e-300d-4a9e-a64f-da302213062c/konnectivity-agent/0.log" limit=1024 Jun 09 15:18:48.046540 ip-10-0-130-232 kubenswrapper[2575]: I0609 15:18:48.046493 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2bkzp_41532b1e-300d-4a9e-a64f-da302213062c/konnectivity-agent/0.log" limit=1024 Jun 09 15:18:48.064551 ip-10-0-130-232 kubenswrapper[2575]: I0609 15:18:48.064532 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0" Jun 09 15:18:48.203195 ip-10-0-130-232 kubenswrapper[2575]: I0609 15:18:48.203170 2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Jun 09 15:18:48.205617 ip-10-0-130-232 kubenswrapper[2575]: W0609 15:18:48.205594 2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode88ffeea_65a9_4fe0_a4e5_b298a11a8e5d.slice/crio-7c5a849b0c66cda67fd2d06ba861988e7777efd2f4e9eaf08a56dc607f49e137 WatchSource:0}: Error finding container 7c5a849b0c66cda67fd2d06ba861988e7777efd2f4e9eaf08a56dc607f49e137: Status 404 returned error can't find the container with id 7c5a849b0c66cda67fd2d06ba861988e7777efd2f4e9eaf08a56dc607f49e137 Jun 09 15:18:48.539242 ip-10-0-130-232 kubenswrapper[2575]: I0609 15:18:48.539209 2575 generic.go:356] "Generic (PLEG): container finished" podID="7bfe71bf-a543-4ec0-a2e9-b7efe4c8a65a" containerID="f26cb9bb45c3f7b739c612a9830a61d55aa2cdea0ad2ea3b4b3cfa69a53ea741" exitCode=0 Jun 09 15:18:48.539416 ip-10-0-130-232 kubenswrapper[2575]: I0609 15:18:48.539282 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-7mmxf" event={"ID":"7bfe71bf-a543-4ec0-a2e9-b7efe4c8a65a","Type":"ContainerDied","Data":"f26cb9bb45c3f7b739c612a9830a61d55aa2cdea0ad2ea3b4b3cfa69a53ea741"} Jun 09 15:18:48.541360 ip-10-0-130-232 kubenswrapper[2575]: I0609 15:18:48.541336 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-65f78d5c66-zpj7b" event={"ID":"5aa1422c-2775-4e8c-8350-91b878aec45a","Type":"ContainerStarted","Data":"16b68bb780d8c489b8451fba43ad092b976f4564e29a9a3a551513b0016192ce"} Jun 09 15:18:48.542513 ip-10-0-130-232 kubenswrapper[2575]: I0609 15:18:48.542490 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"e88ffeea-65a9-4fe0-a4e5-b298a11a8e5d","Type":"ContainerStarted","Data":"7c5a849b0c66cda67fd2d06ba861988e7777efd2f4e9eaf08a56dc607f49e137"} Jun 09 15:18:48.631292 ip-10-0-130-232 kubenswrapper[2575]: I0609 15:18:48.631248 2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/openshift-state-metrics-65f78d5c66-zpj7b" podStartSLOduration=1.68750444 podStartE2EDuration="2.631233378s" totalImagesPullingTime="943.728938ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-09 15:18:46 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-09 15:18:48.629707102 +0000 UTC m=+268.317712831" watchObservedRunningTime="2026-06-09 15:18:48.631233378 +0000 UTC m=+268.319238831" Jun 09 15:18:49.138400 ip-10-0-130-232 kubenswrapper[2575]: I0609 15:18:49.138367 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2bkzp_41532b1e-300d-4a9e-a64f-da302213062c/konnectivity-agent/0.log" limit=1024 Jun 09 15:18:49.244259 ip-10-0-130-232 kubenswrapper[2575]: I0609 15:18:49.244220 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2bkzp_41532b1e-300d-4a9e-a64f-da302213062c/konnectivity-agent/0.log" limit=1024 Jun 09 15:18:49.548098 ip-10-0-130-232 kubenswrapper[2575]: I0609 15:18:49.548061 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-7mmxf" event={"ID":"7bfe71bf-a543-4ec0-a2e9-b7efe4c8a65a","Type":"ContainerStarted","Data":"de2452710d47cc058d43355867e36a69b66f487133cf2e7da6696406dff7aad5"} Jun 09 15:18:49.548284 ip-10-0-130-232 kubenswrapper[2575]: I0609 15:18:49.548127 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-7mmxf" event={"ID":"7bfe71bf-a543-4ec0-a2e9-b7efe4c8a65a","Type":"ContainerStarted","Data":"950caaf6c064961d4b9373bdd6074e168efce2b104987ac9b4bc85773183c79f"} Jun 09 15:18:49.549644 ip-10-0-130-232 kubenswrapper[2575]: I0609 15:18:49.549617 2575 generic.go:356] "Generic (PLEG): container finished" podID="e88ffeea-65a9-4fe0-a4e5-b298a11a8e5d" containerID="7053987059c4cc51eb818d6c3c2d8eae44cca2bc062d582ff7a0c786b87f558e" exitCode=0 Jun 09 15:18:49.549734 ip-10-0-130-232 kubenswrapper[2575]: I0609 15:18:49.549705 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"e88ffeea-65a9-4fe0-a4e5-b298a11a8e5d","Type":"ContainerDied","Data":"7053987059c4cc51eb818d6c3c2d8eae44cca2bc062d582ff7a0c786b87f558e"} Jun 09 15:18:49.569754 ip-10-0-130-232 kubenswrapper[2575]: I0609 15:18:49.569675 2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/node-exporter-7mmxf" podStartSLOduration=2.6426327069999997 podStartE2EDuration="3.569658077s" totalImagesPullingTime="847.986301ms" totalInitContainerRuntime="79.039069ms" isStatefulPod=true podCreationTimestamp="2026-06-09 15:18:46 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-09 15:18:49.5687493 +0000 UTC m=+269.256754752" watchObservedRunningTime="2026-06-09 15:18:49.569658077 +0000 UTC m=+269.257663531" Jun 09 15:18:49.614055 ip-10-0-130-232 kubenswrapper[2575]: I0609 15:18:49.614022 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2bkzp_41532b1e-300d-4a9e-a64f-da302213062c/konnectivity-agent/0.log" limit=1024 Jun 09 15:18:49.720167 ip-10-0-130-232 kubenswrapper[2575]: I0609 15:18:49.720129 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2bkzp_41532b1e-300d-4a9e-a64f-da302213062c/konnectivity-agent/0.log" limit=1024 Jun 09 15:18:50.548037 ip-10-0-130-232 kubenswrapper[2575]: I0609 15:18:50.548001 2575 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/metrics-server-f54699df-2pff4"] Jun 09 15:18:50.551152 ip-10-0-130-232 kubenswrapper[2575]: I0609 15:18:50.551121 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/metrics-server-f54699df-2pff4" Jun 09 15:18:50.555278 ip-10-0-130-232 kubenswrapper[2575]: I0609 15:18:50.555259 2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-client-certs\"" Jun 09 15:18:50.555435 ip-10-0-130-232 kubenswrapper[2575]: I0609 15:18:50.555323 2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kubelet-serving-ca-bundle\"" Jun 09 15:18:50.555514 ip-10-0-130-232 kubenswrapper[2575]: I0609 15:18:50.555446 2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-dockercfg-rxlls\"" Jun 09 15:18:50.556018 ip-10-0-130-232 kubenswrapper[2575]: I0609 15:18:50.556001 2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"metrics-server-audit-profiles\"" Jun 09 15:18:50.556124 ip-10-0-130-232 kubenswrapper[2575]: I0609 15:18:50.556022 2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-r1gv6c6tc2bj\"" Jun 09 15:18:50.556124 ip-10-0-130-232 kubenswrapper[2575]: I0609 15:18:50.556006 2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-tls\"" Jun 09 15:18:50.579706 ip-10-0-130-232 kubenswrapper[2575]: I0609 15:18:50.579680 2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/metrics-server-f54699df-2pff4"] Jun 09 15:18:50.643433 ip-10-0-130-232 kubenswrapper[2575]: I0609 15:18:50.643389 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/49d5083d-d705-47e9-ba36-652a6686cb13-configmap-kubelet-serving-ca-bundle\") pod \"metrics-server-f54699df-2pff4\" (UID: \"49d5083d-d705-47e9-ba36-652a6686cb13\") " pod="openshift-monitoring/metrics-server-f54699df-2pff4" Jun 09 15:18:50.643433 ip-10-0-130-232 kubenswrapper[2575]: I0609 15:18:50.643425 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-metrics-server-tls\" (UniqueName: \"kubernetes.io/secret/49d5083d-d705-47e9-ba36-652a6686cb13-secret-metrics-server-tls\") pod \"metrics-server-f54699df-2pff4\" (UID: \"49d5083d-d705-47e9-ba36-652a6686cb13\") " pod="openshift-monitoring/metrics-server-f54699df-2pff4" Jun 09 15:18:50.643685 ip-10-0-130-232 kubenswrapper[2575]: I0609 15:18:50.643467 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-metrics-server-client-certs\" (UniqueName: \"kubernetes.io/secret/49d5083d-d705-47e9-ba36-652a6686cb13-secret-metrics-server-client-certs\") pod \"metrics-server-f54699df-2pff4\" (UID: \"49d5083d-d705-47e9-ba36-652a6686cb13\") " pod="openshift-monitoring/metrics-server-f54699df-2pff4" Jun 09 15:18:50.643685 ip-10-0-130-232 kubenswrapper[2575]: I0609 15:18:50.643591 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"audit-log\" (UniqueName: \"kubernetes.io/empty-dir/49d5083d-d705-47e9-ba36-652a6686cb13-audit-log\") pod \"metrics-server-f54699df-2pff4\" (UID: \"49d5083d-d705-47e9-ba36-652a6686cb13\") " pod="openshift-monitoring/metrics-server-f54699df-2pff4" Jun 09 15:18:50.643685 ip-10-0-130-232 kubenswrapper[2575]: I0609 15:18:50.643655 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"client-ca-bundle\" (UniqueName: \"kubernetes.io/secret/49d5083d-d705-47e9-ba36-652a6686cb13-client-ca-bundle\") pod \"metrics-server-f54699df-2pff4\" (UID: \"49d5083d-d705-47e9-ba36-652a6686cb13\") " pod="openshift-monitoring/metrics-server-f54699df-2pff4" Jun 09 15:18:50.643829 ip-10-0-130-232 kubenswrapper[2575]: I0609 15:18:50.643771 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-server-audit-profiles\" (UniqueName: \"kubernetes.io/configmap/49d5083d-d705-47e9-ba36-652a6686cb13-metrics-server-audit-profiles\") pod \"metrics-server-f54699df-2pff4\" (UID: \"49d5083d-d705-47e9-ba36-652a6686cb13\") " pod="openshift-monitoring/metrics-server-f54699df-2pff4" Jun 09 15:18:50.643917 ip-10-0-130-232 kubenswrapper[2575]: I0609 15:18:50.643901 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8wthv\" (UniqueName: \"kubernetes.io/projected/49d5083d-d705-47e9-ba36-652a6686cb13-kube-api-access-8wthv\") pod \"metrics-server-f54699df-2pff4\" (UID: \"49d5083d-d705-47e9-ba36-652a6686cb13\") " pod="openshift-monitoring/metrics-server-f54699df-2pff4" Jun 09 15:18:50.744717 ip-10-0-130-232 kubenswrapper[2575]: I0609 15:18:50.744682 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-server-audit-profiles\" (UniqueName: \"kubernetes.io/configmap/49d5083d-d705-47e9-ba36-652a6686cb13-metrics-server-audit-profiles\") pod \"metrics-server-f54699df-2pff4\" (UID: \"49d5083d-d705-47e9-ba36-652a6686cb13\") " pod="openshift-monitoring/metrics-server-f54699df-2pff4" Jun 09 15:18:50.744717 ip-10-0-130-232 kubenswrapper[2575]: I0609 15:18:50.744719 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8wthv\" (UniqueName: \"kubernetes.io/projected/49d5083d-d705-47e9-ba36-652a6686cb13-kube-api-access-8wthv\") pod \"metrics-server-f54699df-2pff4\" (UID: \"49d5083d-d705-47e9-ba36-652a6686cb13\") " pod="openshift-monitoring/metrics-server-f54699df-2pff4" Jun 09 15:18:50.744981 ip-10-0-130-232 kubenswrapper[2575]: I0609 15:18:50.744775 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/49d5083d-d705-47e9-ba36-652a6686cb13-configmap-kubelet-serving-ca-bundle\") pod \"metrics-server-f54699df-2pff4\" (UID: \"49d5083d-d705-47e9-ba36-652a6686cb13\") " pod="openshift-monitoring/metrics-server-f54699df-2pff4" Jun 09 15:18:50.744981 ip-10-0-130-232 kubenswrapper[2575]: I0609 15:18:50.744796 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-metrics-server-tls\" (UniqueName: \"kubernetes.io/secret/49d5083d-d705-47e9-ba36-652a6686cb13-secret-metrics-server-tls\") pod \"metrics-server-f54699df-2pff4\" (UID: \"49d5083d-d705-47e9-ba36-652a6686cb13\") " pod="openshift-monitoring/metrics-server-f54699df-2pff4" Jun 09 15:18:50.744981 ip-10-0-130-232 kubenswrapper[2575]: I0609 15:18:50.744817 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-metrics-server-client-certs\" (UniqueName: \"kubernetes.io/secret/49d5083d-d705-47e9-ba36-652a6686cb13-secret-metrics-server-client-certs\") pod \"metrics-server-f54699df-2pff4\" (UID: \"49d5083d-d705-47e9-ba36-652a6686cb13\") " pod="openshift-monitoring/metrics-server-f54699df-2pff4" Jun 09 15:18:50.744981 ip-10-0-130-232 kubenswrapper[2575]: I0609 15:18:50.744881 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"audit-log\" (UniqueName: \"kubernetes.io/empty-dir/49d5083d-d705-47e9-ba36-652a6686cb13-audit-log\") pod \"metrics-server-f54699df-2pff4\" (UID: \"49d5083d-d705-47e9-ba36-652a6686cb13\") " pod="openshift-monitoring/metrics-server-f54699df-2pff4" Jun 09 15:18:50.745526 ip-10-0-130-232 kubenswrapper[2575]: I0609 15:18:50.745473 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"audit-log\" (UniqueName: \"kubernetes.io/empty-dir/49d5083d-d705-47e9-ba36-652a6686cb13-audit-log\") pod \"metrics-server-f54699df-2pff4\" (UID: \"49d5083d-d705-47e9-ba36-652a6686cb13\") " pod="openshift-monitoring/metrics-server-f54699df-2pff4" Jun 09 15:18:50.746053 ip-10-0-130-232 kubenswrapper[2575]: I0609 15:18:50.745939 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-server-audit-profiles\" (UniqueName: \"kubernetes.io/configmap/49d5083d-d705-47e9-ba36-652a6686cb13-metrics-server-audit-profiles\") pod \"metrics-server-f54699df-2pff4\" (UID: \"49d5083d-d705-47e9-ba36-652a6686cb13\") " pod="openshift-monitoring/metrics-server-f54699df-2pff4" Jun 09 15:18:50.746053 ip-10-0-130-232 kubenswrapper[2575]: I0609 15:18:50.745954 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/49d5083d-d705-47e9-ba36-652a6686cb13-configmap-kubelet-serving-ca-bundle\") pod \"metrics-server-f54699df-2pff4\" (UID: \"49d5083d-d705-47e9-ba36-652a6686cb13\") " pod="openshift-monitoring/metrics-server-f54699df-2pff4" Jun 09 15:18:50.746053 ip-10-0-130-232 kubenswrapper[2575]: I0609 15:18:50.745963 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"client-ca-bundle\" (UniqueName: \"kubernetes.io/secret/49d5083d-d705-47e9-ba36-652a6686cb13-client-ca-bundle\") pod \"metrics-server-f54699df-2pff4\" (UID: \"49d5083d-d705-47e9-ba36-652a6686cb13\") " pod="openshift-monitoring/metrics-server-f54699df-2pff4" Jun 09 15:18:50.748338 ip-10-0-130-232 kubenswrapper[2575]: I0609 15:18:50.748311 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-metrics-server-client-certs\" (UniqueName: \"kubernetes.io/secret/49d5083d-d705-47e9-ba36-652a6686cb13-secret-metrics-server-client-certs\") pod \"metrics-server-f54699df-2pff4\" (UID: \"49d5083d-d705-47e9-ba36-652a6686cb13\") " pod="openshift-monitoring/metrics-server-f54699df-2pff4" Jun 09 15:18:50.748498 ip-10-0-130-232 kubenswrapper[2575]: I0609 15:18:50.748477 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-metrics-server-tls\" (UniqueName: \"kubernetes.io/secret/49d5083d-d705-47e9-ba36-652a6686cb13-secret-metrics-server-tls\") pod \"metrics-server-f54699df-2pff4\" (UID: \"49d5083d-d705-47e9-ba36-652a6686cb13\") " pod="openshift-monitoring/metrics-server-f54699df-2pff4" Jun 09 15:18:50.748715 ip-10-0-130-232 kubenswrapper[2575]: I0609 15:18:50.748694 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"client-ca-bundle\" (UniqueName: \"kubernetes.io/secret/49d5083d-d705-47e9-ba36-652a6686cb13-client-ca-bundle\") pod \"metrics-server-f54699df-2pff4\" (UID: \"49d5083d-d705-47e9-ba36-652a6686cb13\") " pod="openshift-monitoring/metrics-server-f54699df-2pff4" Jun 09 15:18:50.755450 ip-10-0-130-232 kubenswrapper[2575]: I0609 15:18:50.755427 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-8wthv\" (UniqueName: \"kubernetes.io/projected/49d5083d-d705-47e9-ba36-652a6686cb13-kube-api-access-8wthv\") pod \"metrics-server-f54699df-2pff4\" (UID: \"49d5083d-d705-47e9-ba36-652a6686cb13\") " pod="openshift-monitoring/metrics-server-f54699df-2pff4" Jun 09 15:18:50.860184 ip-10-0-130-232 kubenswrapper[2575]: I0609 15:18:50.860103 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/metrics-server-f54699df-2pff4" Jun 09 15:18:50.877294 ip-10-0-130-232 kubenswrapper[2575]: I0609 15:18:50.877252 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2bkzp_41532b1e-300d-4a9e-a64f-da302213062c/konnectivity-agent/0.log" limit=1024 Jun 09 15:18:51.006498 ip-10-0-130-232 kubenswrapper[2575]: I0609 15:18:51.006461 2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/metrics-server-f54699df-2pff4"] Jun 09 15:18:51.007246 ip-10-0-130-232 kubenswrapper[2575]: I0609 15:18:51.007161 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2bkzp_41532b1e-300d-4a9e-a64f-da302213062c/konnectivity-agent/0.log" limit=1024 Jun 09 15:18:51.010459 ip-10-0-130-232 kubenswrapper[2575]: W0609 15:18:51.010424 2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod49d5083d_d705_47e9_ba36_652a6686cb13.slice/crio-6d85c34f4eea5e38e59296d14d1ae9e215c16319f5a01301a9a3cf5d42b4b6e4 WatchSource:0}: Error finding container 6d85c34f4eea5e38e59296d14d1ae9e215c16319f5a01301a9a3cf5d42b4b6e4: Status 404 returned error can't find the container with id 6d85c34f4eea5e38e59296d14d1ae9e215c16319f5a01301a9a3cf5d42b4b6e4 Jun 09 15:18:51.198029 ip-10-0-130-232 kubenswrapper[2575]: I0609 15:18:51.197944 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2bkzp_41532b1e-300d-4a9e-a64f-da302213062c/konnectivity-agent/0.log" limit=1024 Jun 09 15:18:51.267025 ip-10-0-130-232 kubenswrapper[2575]: I0609 15:18:51.266990 2575 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/telemeter-client-9587844d5-7fqbh"] Jun 09 15:18:51.271362 ip-10-0-130-232 kubenswrapper[2575]: I0609 15:18:51.271339 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/telemeter-client-9587844d5-7fqbh" Jun 09 15:18:51.274275 ip-10-0-130-232 kubenswrapper[2575]: I0609 15:18:51.274247 2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client\"" Jun 09 15:18:51.274383 ip-10-0-130-232 kubenswrapper[2575]: I0609 15:18:51.274251 2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"federate-client-certs\"" Jun 09 15:18:51.274383 ip-10-0-130-232 kubenswrapper[2575]: I0609 15:18:51.274323 2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"telemeter-client-serving-certs-ca-bundle\"" Jun 09 15:18:51.274383 ip-10-0-130-232 kubenswrapper[2575]: I0609 15:18:51.274345 2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client-dockercfg-vnf6j\"" Jun 09 15:18:51.274694 ip-10-0-130-232 kubenswrapper[2575]: I0609 15:18:51.274676 2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client-kube-rbac-proxy-config\"" Jun 09 15:18:51.274770 ip-10-0-130-232 kubenswrapper[2575]: I0609 15:18:51.274731 2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client-tls\"" Jun 09 15:18:51.281414 ip-10-0-130-232 kubenswrapper[2575]: I0609 15:18:51.281389 2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"telemeter-trusted-ca-bundle-8i12ta5c71j38\"" Jun 09 15:18:51.291731 ip-10-0-130-232 kubenswrapper[2575]: I0609 15:18:51.291708 2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/telemeter-client-9587844d5-7fqbh"] Jun 09 15:18:51.350204 ip-10-0-130-232 kubenswrapper[2575]: I0609 15:18:51.350173 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/cb0a290b-455b-4081-aa34-43f3c7c66c55-metrics-client-ca\") pod \"telemeter-client-9587844d5-7fqbh\" (UID: \"cb0a290b-455b-4081-aa34-43f3c7c66c55\") " pod="openshift-monitoring/telemeter-client-9587844d5-7fqbh" Jun 09 15:18:51.350452 ip-10-0-130-232 kubenswrapper[2575]: I0609 15:18:51.350230 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"federate-client-tls\" (UniqueName: \"kubernetes.io/secret/cb0a290b-455b-4081-aa34-43f3c7c66c55-federate-client-tls\") pod \"telemeter-client-9587844d5-7fqbh\" (UID: \"cb0a290b-455b-4081-aa34-43f3c7c66c55\") " pod="openshift-monitoring/telemeter-client-9587844d5-7fqbh" Jun 09 15:18:51.350452 ip-10-0-130-232 kubenswrapper[2575]: I0609 15:18:51.350259 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-telemeter-client-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/cb0a290b-455b-4081-aa34-43f3c7c66c55-secret-telemeter-client-kube-rbac-proxy-config\") pod \"telemeter-client-9587844d5-7fqbh\" (UID: \"cb0a290b-455b-4081-aa34-43f3c7c66c55\") " pod="openshift-monitoring/telemeter-client-9587844d5-7fqbh" Jun 09 15:18:51.350452 ip-10-0-130-232 kubenswrapper[2575]: I0609 15:18:51.350288 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"telemeter-client-tls\" (UniqueName: \"kubernetes.io/secret/cb0a290b-455b-4081-aa34-43f3c7c66c55-telemeter-client-tls\") pod \"telemeter-client-9587844d5-7fqbh\" (UID: \"cb0a290b-455b-4081-aa34-43f3c7c66c55\") " pod="openshift-monitoring/telemeter-client-9587844d5-7fqbh" Jun 09 15:18:51.350452 ip-10-0-130-232 kubenswrapper[2575]: I0609 15:18:51.350312 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/cb0a290b-455b-4081-aa34-43f3c7c66c55-serving-certs-ca-bundle\") pod \"telemeter-client-9587844d5-7fqbh\" (UID: \"cb0a290b-455b-4081-aa34-43f3c7c66c55\") " pod="openshift-monitoring/telemeter-client-9587844d5-7fqbh" Jun 09 15:18:51.350452 ip-10-0-130-232 kubenswrapper[2575]: I0609 15:18:51.350349 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-b7zkt\" (UniqueName: \"kubernetes.io/projected/cb0a290b-455b-4081-aa34-43f3c7c66c55-kube-api-access-b7zkt\") pod \"telemeter-client-9587844d5-7fqbh\" (UID: \"cb0a290b-455b-4081-aa34-43f3c7c66c55\") " pod="openshift-monitoring/telemeter-client-9587844d5-7fqbh" Jun 09 15:18:51.350452 ip-10-0-130-232 kubenswrapper[2575]: I0609 15:18:51.350418 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-telemeter-client\" (UniqueName: \"kubernetes.io/secret/cb0a290b-455b-4081-aa34-43f3c7c66c55-secret-telemeter-client\") pod \"telemeter-client-9587844d5-7fqbh\" (UID: \"cb0a290b-455b-4081-aa34-43f3c7c66c55\") " pod="openshift-monitoring/telemeter-client-9587844d5-7fqbh" Jun 09 15:18:51.350691 ip-10-0-130-232 kubenswrapper[2575]: I0609 15:18:51.350468 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"telemeter-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/cb0a290b-455b-4081-aa34-43f3c7c66c55-telemeter-trusted-ca-bundle\") pod \"telemeter-client-9587844d5-7fqbh\" (UID: \"cb0a290b-455b-4081-aa34-43f3c7c66c55\") " pod="openshift-monitoring/telemeter-client-9587844d5-7fqbh" Jun 09 15:18:51.451107 ip-10-0-130-232 kubenswrapper[2575]: I0609 15:18:51.451028 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-telemeter-client\" (UniqueName: \"kubernetes.io/secret/cb0a290b-455b-4081-aa34-43f3c7c66c55-secret-telemeter-client\") pod \"telemeter-client-9587844d5-7fqbh\" (UID: \"cb0a290b-455b-4081-aa34-43f3c7c66c55\") " pod="openshift-monitoring/telemeter-client-9587844d5-7fqbh" Jun 09 15:18:51.451107 ip-10-0-130-232 kubenswrapper[2575]: I0609 15:18:51.451072 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"telemeter-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/cb0a290b-455b-4081-aa34-43f3c7c66c55-telemeter-trusted-ca-bundle\") pod \"telemeter-client-9587844d5-7fqbh\" (UID: \"cb0a290b-455b-4081-aa34-43f3c7c66c55\") " pod="openshift-monitoring/telemeter-client-9587844d5-7fqbh" Jun 09 15:18:51.451333 ip-10-0-130-232 kubenswrapper[2575]: I0609 15:18:51.451113 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/cb0a290b-455b-4081-aa34-43f3c7c66c55-metrics-client-ca\") pod \"telemeter-client-9587844d5-7fqbh\" (UID: \"cb0a290b-455b-4081-aa34-43f3c7c66c55\") " pod="openshift-monitoring/telemeter-client-9587844d5-7fqbh" Jun 09 15:18:51.451333 ip-10-0-130-232 kubenswrapper[2575]: I0609 15:18:51.451140 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"federate-client-tls\" (UniqueName: \"kubernetes.io/secret/cb0a290b-455b-4081-aa34-43f3c7c66c55-federate-client-tls\") pod \"telemeter-client-9587844d5-7fqbh\" (UID: \"cb0a290b-455b-4081-aa34-43f3c7c66c55\") " pod="openshift-monitoring/telemeter-client-9587844d5-7fqbh" Jun 09 15:18:51.451333 ip-10-0-130-232 kubenswrapper[2575]: I0609 15:18:51.451157 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-telemeter-client-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/cb0a290b-455b-4081-aa34-43f3c7c66c55-secret-telemeter-client-kube-rbac-proxy-config\") pod \"telemeter-client-9587844d5-7fqbh\" (UID: \"cb0a290b-455b-4081-aa34-43f3c7c66c55\") " pod="openshift-monitoring/telemeter-client-9587844d5-7fqbh" Jun 09 15:18:51.451333 ip-10-0-130-232 kubenswrapper[2575]: I0609 15:18:51.451178 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"telemeter-client-tls\" (UniqueName: \"kubernetes.io/secret/cb0a290b-455b-4081-aa34-43f3c7c66c55-telemeter-client-tls\") pod \"telemeter-client-9587844d5-7fqbh\" (UID: \"cb0a290b-455b-4081-aa34-43f3c7c66c55\") " pod="openshift-monitoring/telemeter-client-9587844d5-7fqbh" Jun 09 15:18:51.451333 ip-10-0-130-232 kubenswrapper[2575]: I0609 15:18:51.451207 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/cb0a290b-455b-4081-aa34-43f3c7c66c55-serving-certs-ca-bundle\") pod \"telemeter-client-9587844d5-7fqbh\" (UID: \"cb0a290b-455b-4081-aa34-43f3c7c66c55\") " pod="openshift-monitoring/telemeter-client-9587844d5-7fqbh" Jun 09 15:18:51.451333 ip-10-0-130-232 kubenswrapper[2575]: I0609 15:18:51.451246 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-b7zkt\" (UniqueName: \"kubernetes.io/projected/cb0a290b-455b-4081-aa34-43f3c7c66c55-kube-api-access-b7zkt\") pod \"telemeter-client-9587844d5-7fqbh\" (UID: \"cb0a290b-455b-4081-aa34-43f3c7c66c55\") " pod="openshift-monitoring/telemeter-client-9587844d5-7fqbh" Jun 09 15:18:51.452160 ip-10-0-130-232 kubenswrapper[2575]: I0609 15:18:51.452112 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/cb0a290b-455b-4081-aa34-43f3c7c66c55-metrics-client-ca\") pod \"telemeter-client-9587844d5-7fqbh\" (UID: \"cb0a290b-455b-4081-aa34-43f3c7c66c55\") " pod="openshift-monitoring/telemeter-client-9587844d5-7fqbh" Jun 09 15:18:51.452160 ip-10-0-130-232 kubenswrapper[2575]: I0609 15:18:51.452131 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"telemeter-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/cb0a290b-455b-4081-aa34-43f3c7c66c55-telemeter-trusted-ca-bundle\") pod \"telemeter-client-9587844d5-7fqbh\" (UID: \"cb0a290b-455b-4081-aa34-43f3c7c66c55\") " pod="openshift-monitoring/telemeter-client-9587844d5-7fqbh" Jun 09 15:18:51.452356 ip-10-0-130-232 kubenswrapper[2575]: I0609 15:18:51.452331 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/cb0a290b-455b-4081-aa34-43f3c7c66c55-serving-certs-ca-bundle\") pod \"telemeter-client-9587844d5-7fqbh\" (UID: \"cb0a290b-455b-4081-aa34-43f3c7c66c55\") " pod="openshift-monitoring/telemeter-client-9587844d5-7fqbh" Jun 09 15:18:51.454457 ip-10-0-130-232 kubenswrapper[2575]: I0609 15:18:51.454426 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"federate-client-tls\" (UniqueName: \"kubernetes.io/secret/cb0a290b-455b-4081-aa34-43f3c7c66c55-federate-client-tls\") pod \"telemeter-client-9587844d5-7fqbh\" (UID: \"cb0a290b-455b-4081-aa34-43f3c7c66c55\") " pod="openshift-monitoring/telemeter-client-9587844d5-7fqbh" Jun 09 15:18:51.454560 ip-10-0-130-232 kubenswrapper[2575]: I0609 15:18:51.454489 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-telemeter-client\" (UniqueName: \"kubernetes.io/secret/cb0a290b-455b-4081-aa34-43f3c7c66c55-secret-telemeter-client\") pod \"telemeter-client-9587844d5-7fqbh\" (UID: \"cb0a290b-455b-4081-aa34-43f3c7c66c55\") " pod="openshift-monitoring/telemeter-client-9587844d5-7fqbh" Jun 09 15:18:51.454560 ip-10-0-130-232 kubenswrapper[2575]: I0609 15:18:51.454514 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"telemeter-client-tls\" (UniqueName: \"kubernetes.io/secret/cb0a290b-455b-4081-aa34-43f3c7c66c55-telemeter-client-tls\") pod \"telemeter-client-9587844d5-7fqbh\" (UID: \"cb0a290b-455b-4081-aa34-43f3c7c66c55\") " pod="openshift-monitoring/telemeter-client-9587844d5-7fqbh" Jun 09 15:18:51.454742 ip-10-0-130-232 kubenswrapper[2575]: I0609 15:18:51.454721 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-telemeter-client-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/cb0a290b-455b-4081-aa34-43f3c7c66c55-secret-telemeter-client-kube-rbac-proxy-config\") pod \"telemeter-client-9587844d5-7fqbh\" (UID: \"cb0a290b-455b-4081-aa34-43f3c7c66c55\") " pod="openshift-monitoring/telemeter-client-9587844d5-7fqbh" Jun 09 15:18:51.460772 ip-10-0-130-232 kubenswrapper[2575]: I0609 15:18:51.460748 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-b7zkt\" (UniqueName: \"kubernetes.io/projected/cb0a290b-455b-4081-aa34-43f3c7c66c55-kube-api-access-b7zkt\") pod \"telemeter-client-9587844d5-7fqbh\" (UID: \"cb0a290b-455b-4081-aa34-43f3c7c66c55\") " pod="openshift-monitoring/telemeter-client-9587844d5-7fqbh" Jun 09 15:18:51.557105 ip-10-0-130-232 kubenswrapper[2575]: I0609 15:18:51.557077 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/metrics-server-f54699df-2pff4" event={"ID":"49d5083d-d705-47e9-ba36-652a6686cb13","Type":"ContainerStarted","Data":"6d85c34f4eea5e38e59296d14d1ae9e215c16319f5a01301a9a3cf5d42b4b6e4"} Jun 09 15:18:51.584371 ip-10-0-130-232 kubenswrapper[2575]: I0609 15:18:51.584350 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/telemeter-client-9587844d5-7fqbh" Jun 09 15:18:51.751839 ip-10-0-130-232 kubenswrapper[2575]: I0609 15:18:51.750739 2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/telemeter-client-9587844d5-7fqbh"] Jun 09 15:18:51.756445 ip-10-0-130-232 kubenswrapper[2575]: W0609 15:18:51.756390 2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podcb0a290b_455b_4081_aa34_43f3c7c66c55.slice/crio-dbb9688875134c29cd2d6324aaf5225e0e1623a681bfa1b5bbf362825cfff704 WatchSource:0}: Error finding container dbb9688875134c29cd2d6324aaf5225e0e1623a681bfa1b5bbf362825cfff704: Status 404 returned error can't find the container with id dbb9688875134c29cd2d6324aaf5225e0e1623a681bfa1b5bbf362825cfff704 Jun 09 15:18:52.563164 ip-10-0-130-232 kubenswrapper[2575]: I0609 15:18:52.563119 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-9587844d5-7fqbh" event={"ID":"cb0a290b-455b-4081-aa34-43f3c7c66c55","Type":"ContainerStarted","Data":"dbb9688875134c29cd2d6324aaf5225e0e1623a681bfa1b5bbf362825cfff704"} Jun 09 15:18:52.566899 ip-10-0-130-232 kubenswrapper[2575]: I0609 15:18:52.566864 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"e88ffeea-65a9-4fe0-a4e5-b298a11a8e5d","Type":"ContainerStarted","Data":"7b9bf2348d05c53a9420dbbdffd4ec72ce0bcc2fdf8c787873caecdeb3280bb9"} Jun 09 15:18:52.567014 ip-10-0-130-232 kubenswrapper[2575]: I0609 15:18:52.566942 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"e88ffeea-65a9-4fe0-a4e5-b298a11a8e5d","Type":"ContainerStarted","Data":"64a7669ce8c90fd186858c8a2f2bee2bb7f0fbc7aabf7522e6b60b056b62800e"} Jun 09 15:18:52.567014 ip-10-0-130-232 kubenswrapper[2575]: I0609 15:18:52.566981 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"e88ffeea-65a9-4fe0-a4e5-b298a11a8e5d","Type":"ContainerStarted","Data":"d4e5f103504844a5352bb18f64e25e726759f54c1fb3124b0e32107855949425"} Jun 09 15:18:52.567128 ip-10-0-130-232 kubenswrapper[2575]: I0609 15:18:52.567023 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"e88ffeea-65a9-4fe0-a4e5-b298a11a8e5d","Type":"ContainerStarted","Data":"904a72a14a58b76e68d13f80bdf8e468b564aec4c29938f79ebe6453d73263e9"} Jun 09 15:18:52.567128 ip-10-0-130-232 kubenswrapper[2575]: I0609 15:18:52.567062 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"e88ffeea-65a9-4fe0-a4e5-b298a11a8e5d","Type":"ContainerStarted","Data":"07022fd4be2beba64678175f28b27ece044be7351a63498f20f0ccad56580038"} Jun 09 15:18:52.606465 ip-10-0-130-232 kubenswrapper[2575]: I0609 15:18:52.606427 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2bkzp_41532b1e-300d-4a9e-a64f-da302213062c/konnectivity-agent/0.log" limit=1024 Jun 09 15:18:53.403502 ip-10-0-130-232 kubenswrapper[2575]: I0609 15:18:53.403457 2575 patch_prober.go:28] interesting pod/image-registry-75f6d98cf6-grg9x container/registry namespace/openshift-image-registry: Liveness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body={"errors":[{"code":"UNAVAILABLE","message":"service unavailable","detail":"health check failed: please see /debug/health"}]} Jun 09 15:18:53.403683 ip-10-0-130-232 kubenswrapper[2575]: I0609 15:18:53.403512 2575 prober.go:120] "Probe failed" probeType="Liveness" pod="openshift-image-registry/image-registry-75f6d98cf6-grg9x" podUID="3ffe15f5-8e1c-43c6-a5e0-482410e1be5c" containerName="registry" probeResult="failure" output="HTTP probe failed with statuscode: 503" Jun 09 15:18:53.572322 ip-10-0-130-232 kubenswrapper[2575]: I0609 15:18:53.572283 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/metrics-server-f54699df-2pff4" event={"ID":"49d5083d-d705-47e9-ba36-652a6686cb13","Type":"ContainerStarted","Data":"92f7d022ac8aa4106086f9ba57ae1d378f26af717aa4b5176832af60ae8e5f74"} Jun 09 15:18:53.575615 ip-10-0-130-232 kubenswrapper[2575]: I0609 15:18:53.575586 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"e88ffeea-65a9-4fe0-a4e5-b298a11a8e5d","Type":"ContainerStarted","Data":"8354d893a3bbbf7d41efe96223a0f4a09a77283e2cdc807230dbf3f07f9c5cb5"} Jun 09 15:18:53.598029 ip-10-0-130-232 kubenswrapper[2575]: I0609 15:18:53.597976 2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/metrics-server-f54699df-2pff4" podStartSLOduration=1.810544094 podStartE2EDuration="3.597956942s" totalImagesPullingTime="1.787412848s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-09 15:18:50 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-09 15:18:53.595983725 +0000 UTC m=+273.283989178" watchObservedRunningTime="2026-06-09 15:18:53.597956942 +0000 UTC m=+273.285962398" Jun 09 15:18:53.640622 ip-10-0-130-232 kubenswrapper[2575]: I0609 15:18:53.640561 2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/alertmanager-main-0" podStartSLOduration=2.676798331 podStartE2EDuration="6.640536185s" totalImagesPullingTime="3.947523759s" totalInitContainerRuntime="16.214095ms" isStatefulPod=false podCreationTimestamp="2026-06-09 15:18:47 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-09 15:18:53.639422381 +0000 UTC m=+273.327427834" watchObservedRunningTime="2026-06-09 15:18:53.640536185 +0000 UTC m=+273.328541639" Jun 09 15:18:54.581323 ip-10-0-130-232 kubenswrapper[2575]: I0609 15:18:54.581282 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-9587844d5-7fqbh" event={"ID":"cb0a290b-455b-4081-aa34-43f3c7c66c55","Type":"ContainerStarted","Data":"cb73d53e688de43a4c6dfe2e7982cae7a959f0310e499155e15a9d19e61c188c"} Jun 09 15:18:54.581738 ip-10-0-130-232 kubenswrapper[2575]: I0609 15:18:54.581351 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-9587844d5-7fqbh" event={"ID":"cb0a290b-455b-4081-aa34-43f3c7c66c55","Type":"ContainerStarted","Data":"5ecfa96a37eef9a507cf3e250502ce9b561bf7cb7130f543175f10583e8df96d"} Jun 09 15:18:54.581738 ip-10-0-130-232 kubenswrapper[2575]: I0609 15:18:54.581384 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-9587844d5-7fqbh" event={"ID":"cb0a290b-455b-4081-aa34-43f3c7c66c55","Type":"ContainerStarted","Data":"608756e517fbba9d6be087623281b6e730764c4f37bddb094252317bbcdcd455"} Jun 09 15:18:54.611030 ip-10-0-130-232 kubenswrapper[2575]: I0609 15:18:54.610977 2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/telemeter-client-9587844d5-7fqbh" podStartSLOduration=1.240716151 podStartE2EDuration="3.610957953s" totalImagesPullingTime="2.370241802s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-09 15:18:51 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-09 15:18:54.610578715 +0000 UTC m=+274.298584179" watchObservedRunningTime="2026-06-09 15:18:54.610957953 +0000 UTC m=+274.298963407" Jun 09 15:18:54.829583 ip-10-0-130-232 kubenswrapper[2575]: I0609 15:18:54.829544 2575 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-648b46694f-fjpfp"] Jun 09 15:18:54.832893 ip-10-0-130-232 kubenswrapper[2575]: I0609 15:18:54.832819 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-648b46694f-fjpfp" Jun 09 15:18:54.836284 ip-10-0-130-232 kubenswrapper[2575]: I0609 15:18:54.836257 2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"service-ca\"" Jun 09 15:18:54.836389 ip-10-0-130-232 kubenswrapper[2575]: I0609 15:18:54.836372 2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"oauth-serving-cert\"" Jun 09 15:18:54.836464 ip-10-0-130-232 kubenswrapper[2575]: I0609 15:18:54.836451 2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-oauth-config\"" Jun 09 15:18:54.836747 ip-10-0-130-232 kubenswrapper[2575]: I0609 15:18:54.836729 2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"openshift-service-ca.crt\"" Jun 09 15:18:54.837053 ip-10-0-130-232 kubenswrapper[2575]: I0609 15:18:54.837037 2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"console-config\"" Jun 09 15:18:54.837165 ip-10-0-130-232 kubenswrapper[2575]: I0609 15:18:54.837038 2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-dockercfg-9g5w9\"" Jun 09 15:18:54.837165 ip-10-0-130-232 kubenswrapper[2575]: I0609 15:18:54.837119 2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"kube-root-ca.crt\"" Jun 09 15:18:54.838996 ip-10-0-130-232 kubenswrapper[2575]: I0609 15:18:54.838979 2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-serving-cert\"" Jun 09 15:18:54.843316 ip-10-0-130-232 kubenswrapper[2575]: I0609 15:18:54.843301 2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"trusted-ca-bundle\"" Jun 09 15:18:54.854368 ip-10-0-130-232 kubenswrapper[2575]: I0609 15:18:54.854347 2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-648b46694f-fjpfp"] Jun 09 15:18:54.883490 ip-10-0-130-232 kubenswrapper[2575]: I0609 15:18:54.883468 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/2d40fe33-a48c-4b4a-a224-6cb8dceaaff7-oauth-serving-cert\") pod \"console-648b46694f-fjpfp\" (UID: \"2d40fe33-a48c-4b4a-a224-6cb8dceaaff7\") " pod="openshift-console/console-648b46694f-fjpfp" Jun 09 15:18:54.883600 ip-10-0-130-232 kubenswrapper[2575]: I0609 15:18:54.883502 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/2d40fe33-a48c-4b4a-a224-6cb8dceaaff7-trusted-ca-bundle\") pod \"console-648b46694f-fjpfp\" (UID: \"2d40fe33-a48c-4b4a-a224-6cb8dceaaff7\") " pod="openshift-console/console-648b46694f-fjpfp" Jun 09 15:18:54.883600 ip-10-0-130-232 kubenswrapper[2575]: I0609 15:18:54.883531 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-k5hg5\" (UniqueName: \"kubernetes.io/projected/2d40fe33-a48c-4b4a-a224-6cb8dceaaff7-kube-api-access-k5hg5\") pod \"console-648b46694f-fjpfp\" (UID: \"2d40fe33-a48c-4b4a-a224-6cb8dceaaff7\") " pod="openshift-console/console-648b46694f-fjpfp" Jun 09 15:18:54.883600 ip-10-0-130-232 kubenswrapper[2575]: I0609 15:18:54.883552 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/2d40fe33-a48c-4b4a-a224-6cb8dceaaff7-console-oauth-config\") pod \"console-648b46694f-fjpfp\" (UID: \"2d40fe33-a48c-4b4a-a224-6cb8dceaaff7\") " pod="openshift-console/console-648b46694f-fjpfp" Jun 09 15:18:54.883719 ip-10-0-130-232 kubenswrapper[2575]: I0609 15:18:54.883608 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/2d40fe33-a48c-4b4a-a224-6cb8dceaaff7-console-serving-cert\") pod \"console-648b46694f-fjpfp\" (UID: \"2d40fe33-a48c-4b4a-a224-6cb8dceaaff7\") " pod="openshift-console/console-648b46694f-fjpfp" Jun 09 15:18:54.883719 ip-10-0-130-232 kubenswrapper[2575]: I0609 15:18:54.883659 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/2d40fe33-a48c-4b4a-a224-6cb8dceaaff7-console-config\") pod \"console-648b46694f-fjpfp\" (UID: \"2d40fe33-a48c-4b4a-a224-6cb8dceaaff7\") " pod="openshift-console/console-648b46694f-fjpfp" Jun 09 15:18:54.883719 ip-10-0-130-232 kubenswrapper[2575]: I0609 15:18:54.883690 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/2d40fe33-a48c-4b4a-a224-6cb8dceaaff7-service-ca\") pod \"console-648b46694f-fjpfp\" (UID: \"2d40fe33-a48c-4b4a-a224-6cb8dceaaff7\") " pod="openshift-console/console-648b46694f-fjpfp" Jun 09 15:18:54.984494 ip-10-0-130-232 kubenswrapper[2575]: I0609 15:18:54.984457 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/2d40fe33-a48c-4b4a-a224-6cb8dceaaff7-oauth-serving-cert\") pod \"console-648b46694f-fjpfp\" (UID: \"2d40fe33-a48c-4b4a-a224-6cb8dceaaff7\") " pod="openshift-console/console-648b46694f-fjpfp" Jun 09 15:18:54.984494 ip-10-0-130-232 kubenswrapper[2575]: I0609 15:18:54.984494 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/2d40fe33-a48c-4b4a-a224-6cb8dceaaff7-trusted-ca-bundle\") pod \"console-648b46694f-fjpfp\" (UID: \"2d40fe33-a48c-4b4a-a224-6cb8dceaaff7\") " pod="openshift-console/console-648b46694f-fjpfp" Jun 09 15:18:54.984733 ip-10-0-130-232 kubenswrapper[2575]: I0609 15:18:54.984513 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-k5hg5\" (UniqueName: \"kubernetes.io/projected/2d40fe33-a48c-4b4a-a224-6cb8dceaaff7-kube-api-access-k5hg5\") pod \"console-648b46694f-fjpfp\" (UID: \"2d40fe33-a48c-4b4a-a224-6cb8dceaaff7\") " pod="openshift-console/console-648b46694f-fjpfp" Jun 09 15:18:54.984733 ip-10-0-130-232 kubenswrapper[2575]: I0609 15:18:54.984533 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/2d40fe33-a48c-4b4a-a224-6cb8dceaaff7-console-oauth-config\") pod \"console-648b46694f-fjpfp\" (UID: \"2d40fe33-a48c-4b4a-a224-6cb8dceaaff7\") " pod="openshift-console/console-648b46694f-fjpfp" Jun 09 15:18:54.984733 ip-10-0-130-232 kubenswrapper[2575]: I0609 15:18:54.984608 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/2d40fe33-a48c-4b4a-a224-6cb8dceaaff7-console-serving-cert\") pod \"console-648b46694f-fjpfp\" (UID: \"2d40fe33-a48c-4b4a-a224-6cb8dceaaff7\") " pod="openshift-console/console-648b46694f-fjpfp" Jun 09 15:18:54.984903 ip-10-0-130-232 kubenswrapper[2575]: I0609 15:18:54.984752 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/2d40fe33-a48c-4b4a-a224-6cb8dceaaff7-console-config\") pod \"console-648b46694f-fjpfp\" (UID: \"2d40fe33-a48c-4b4a-a224-6cb8dceaaff7\") " pod="openshift-console/console-648b46694f-fjpfp" Jun 09 15:18:54.984903 ip-10-0-130-232 kubenswrapper[2575]: I0609 15:18:54.984797 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/2d40fe33-a48c-4b4a-a224-6cb8dceaaff7-service-ca\") pod \"console-648b46694f-fjpfp\" (UID: \"2d40fe33-a48c-4b4a-a224-6cb8dceaaff7\") " pod="openshift-console/console-648b46694f-fjpfp" Jun 09 15:18:54.985491 ip-10-0-130-232 kubenswrapper[2575]: I0609 15:18:54.985421 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/2d40fe33-a48c-4b4a-a224-6cb8dceaaff7-trusted-ca-bundle\") pod \"console-648b46694f-fjpfp\" (UID: \"2d40fe33-a48c-4b4a-a224-6cb8dceaaff7\") " pod="openshift-console/console-648b46694f-fjpfp" Jun 09 15:18:54.985598 ip-10-0-130-232 kubenswrapper[2575]: I0609 15:18:54.985503 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/2d40fe33-a48c-4b4a-a224-6cb8dceaaff7-service-ca\") pod \"console-648b46694f-fjpfp\" (UID: \"2d40fe33-a48c-4b4a-a224-6cb8dceaaff7\") " pod="openshift-console/console-648b46694f-fjpfp" Jun 09 15:18:54.985598 ip-10-0-130-232 kubenswrapper[2575]: I0609 15:18:54.985503 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/2d40fe33-a48c-4b4a-a224-6cb8dceaaff7-console-config\") pod \"console-648b46694f-fjpfp\" (UID: \"2d40fe33-a48c-4b4a-a224-6cb8dceaaff7\") " pod="openshift-console/console-648b46694f-fjpfp" Jun 09 15:18:54.985704 ip-10-0-130-232 kubenswrapper[2575]: I0609 15:18:54.985641 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/2d40fe33-a48c-4b4a-a224-6cb8dceaaff7-oauth-serving-cert\") pod \"console-648b46694f-fjpfp\" (UID: \"2d40fe33-a48c-4b4a-a224-6cb8dceaaff7\") " pod="openshift-console/console-648b46694f-fjpfp" Jun 09 15:18:54.987193 ip-10-0-130-232 kubenswrapper[2575]: I0609 15:18:54.987166 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/2d40fe33-a48c-4b4a-a224-6cb8dceaaff7-console-oauth-config\") pod \"console-648b46694f-fjpfp\" (UID: \"2d40fe33-a48c-4b4a-a224-6cb8dceaaff7\") " pod="openshift-console/console-648b46694f-fjpfp" Jun 09 15:18:54.987281 ip-10-0-130-232 kubenswrapper[2575]: I0609 15:18:54.987254 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/2d40fe33-a48c-4b4a-a224-6cb8dceaaff7-console-serving-cert\") pod \"console-648b46694f-fjpfp\" (UID: \"2d40fe33-a48c-4b4a-a224-6cb8dceaaff7\") " pod="openshift-console/console-648b46694f-fjpfp" Jun 09 15:18:54.996085 ip-10-0-130-232 kubenswrapper[2575]: I0609 15:18:54.996066 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-k5hg5\" (UniqueName: \"kubernetes.io/projected/2d40fe33-a48c-4b4a-a224-6cb8dceaaff7-kube-api-access-k5hg5\") pod \"console-648b46694f-fjpfp\" (UID: \"2d40fe33-a48c-4b4a-a224-6cb8dceaaff7\") " pod="openshift-console/console-648b46694f-fjpfp" Jun 09 15:18:55.142837 ip-10-0-130-232 kubenswrapper[2575]: I0609 15:18:55.142753 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-648b46694f-fjpfp" Jun 09 15:18:55.277872 ip-10-0-130-232 kubenswrapper[2575]: I0609 15:18:55.277825 2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-648b46694f-fjpfp"] Jun 09 15:18:55.280581 ip-10-0-130-232 kubenswrapper[2575]: W0609 15:18:55.280556 2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2d40fe33_a48c_4b4a_a224_6cb8dceaaff7.slice/crio-1d785c9c0ee30544d6ccd018c96f2d8383ee18b4adb44790ddfb8f4504f34863 WatchSource:0}: Error finding container 1d785c9c0ee30544d6ccd018c96f2d8383ee18b4adb44790ddfb8f4504f34863: Status 404 returned error can't find the container with id 1d785c9c0ee30544d6ccd018c96f2d8383ee18b4adb44790ddfb8f4504f34863 Jun 09 15:18:55.489670 ip-10-0-130-232 kubenswrapper[2575]: I0609 15:18:55.489636 2575 patch_prober.go:28] interesting pod/image-registry-75f6d98cf6-grg9x container/registry namespace/openshift-image-registry: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body={"errors":[{"code":"UNAVAILABLE","message":"service unavailable","detail":"health check failed: please see /debug/health"}]} Jun 09 15:18:55.489861 ip-10-0-130-232 kubenswrapper[2575]: I0609 15:18:55.489694 2575 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-image-registry/image-registry-75f6d98cf6-grg9x" podUID="3ffe15f5-8e1c-43c6-a5e0-482410e1be5c" containerName="registry" probeResult="failure" output="HTTP probe failed with statuscode: 503" Jun 09 15:18:55.586228 ip-10-0-130-232 kubenswrapper[2575]: I0609 15:18:55.586195 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-648b46694f-fjpfp" event={"ID":"2d40fe33-a48c-4b4a-a224-6cb8dceaaff7","Type":"ContainerStarted","Data":"1d785c9c0ee30544d6ccd018c96f2d8383ee18b4adb44790ddfb8f4504f34863"} Jun 09 15:18:55.919103 ip-10-0-130-232 kubenswrapper[2575]: I0609 15:18:55.919011 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2bkzp_41532b1e-300d-4a9e-a64f-da302213062c/konnectivity-agent/0.log" limit=1024 Jun 09 15:18:56.017408 ip-10-0-130-232 kubenswrapper[2575]: I0609 15:18:56.017363 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2bkzp_41532b1e-300d-4a9e-a64f-da302213062c/konnectivity-agent/0.log" limit=1024 Jun 09 15:18:57.361114 ip-10-0-130-232 kubenswrapper[2575]: I0609 15:18:57.361061 2575 prober.go:120] "Probe failed" probeType="Liveness" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-78c9f9fbb-mwpt8" podUID="ac1d9517-d30b-461a-866c-6d4639ae663c" containerName="service-proxy" probeResult="failure" output="HTTP probe failed with statuscode: 500" Jun 09 15:18:57.851753 ip-10-0-130-232 kubenswrapper[2575]: I0609 15:18:57.851723 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2bkzp_41532b1e-300d-4a9e-a64f-da302213062c/konnectivity-agent/0.log" limit=1024 Jun 09 15:18:57.945169 ip-10-0-130-232 kubenswrapper[2575]: I0609 15:18:57.945135 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2bkzp_41532b1e-300d-4a9e-a64f-da302213062c/konnectivity-agent/0.log" limit=1024 Jun 09 15:18:58.382289 ip-10-0-130-232 kubenswrapper[2575]: I0609 15:18:58.382257 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2bkzp_41532b1e-300d-4a9e-a64f-da302213062c/konnectivity-agent/0.log" limit=1024 Jun 09 15:18:58.480629 ip-10-0-130-232 kubenswrapper[2575]: I0609 15:18:58.480594 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2bkzp_41532b1e-300d-4a9e-a64f-da302213062c/konnectivity-agent/0.log" limit=1024 Jun 09 15:18:58.600707 ip-10-0-130-232 kubenswrapper[2575]: I0609 15:18:58.600673 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-648b46694f-fjpfp" event={"ID":"2d40fe33-a48c-4b4a-a224-6cb8dceaaff7","Type":"ContainerStarted","Data":"12e9c33a1e432db503c5910f612d410ace9d7d41f08c37bddae967c4176424ba"} Jun 09 15:18:58.663229 ip-10-0-130-232 kubenswrapper[2575]: I0609 15:18:58.663129 2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-648b46694f-fjpfp" podStartSLOduration=2.114423181 podStartE2EDuration="4.663111193s" totalImagesPullingTime="2.548688012s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-09 15:18:54 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-09 15:18:58.662750772 +0000 UTC m=+278.350756207" watchObservedRunningTime="2026-06-09 15:18:58.663111193 +0000 UTC m=+278.351116645" Jun 09 15:19:02.208552 ip-10-0-130-232 kubenswrapper[2575]: E0609 15:19:02.208519 2575 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[metrics-tls], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-dns/dns-default-rmhjs" podUID="12bfe226-e002-44c4-aaeb-0905603ccd18" Jun 09 15:19:02.615182 ip-10-0-130-232 kubenswrapper[2575]: I0609 15:19:02.615149 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-rmhjs" Jun 09 15:19:03.402399 ip-10-0-130-232 kubenswrapper[2575]: I0609 15:19:03.402367 2575 patch_prober.go:28] interesting pod/image-registry-75f6d98cf6-grg9x container/registry namespace/openshift-image-registry: Liveness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body={"errors":[{"code":"UNAVAILABLE","message":"service unavailable","detail":"health check failed: please see /debug/health"}]} Jun 09 15:19:03.402781 ip-10-0-130-232 kubenswrapper[2575]: I0609 15:19:03.402417 2575 prober.go:120] "Probe failed" probeType="Liveness" pod="openshift-image-registry/image-registry-75f6d98cf6-grg9x" podUID="3ffe15f5-8e1c-43c6-a5e0-482410e1be5c" containerName="registry" probeResult="failure" output="HTTP probe failed with statuscode: 503" Jun 09 15:19:05.076824 ip-10-0-130-232 kubenswrapper[2575]: I0609 15:19:05.076781 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/12bfe226-e002-44c4-aaeb-0905603ccd18-metrics-tls\") pod \"dns-default-rmhjs\" (UID: \"12bfe226-e002-44c4-aaeb-0905603ccd18\") " pod="openshift-dns/dns-default-rmhjs" Jun 09 15:19:05.079265 ip-10-0-130-232 kubenswrapper[2575]: I0609 15:19:05.079246 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/12bfe226-e002-44c4-aaeb-0905603ccd18-metrics-tls\") pod \"dns-default-rmhjs\" (UID: \"12bfe226-e002-44c4-aaeb-0905603ccd18\") " pod="openshift-dns/dns-default-rmhjs" Jun 09 15:19:05.143794 ip-10-0-130-232 kubenswrapper[2575]: I0609 15:19:05.143754 2575 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-648b46694f-fjpfp" Jun 09 15:19:05.143956 ip-10-0-130-232 kubenswrapper[2575]: I0609 15:19:05.143868 2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-648b46694f-fjpfp" Jun 09 15:19:05.145203 ip-10-0-130-232 kubenswrapper[2575]: I0609 15:19:05.145179 2575 patch_prober.go:28] interesting pod/console-648b46694f-fjpfp container/console namespace/openshift-console: Startup probe status=failure output="Get \"https://10.133.0.17:8443/health\": dial tcp 10.133.0.17:8443: connect: connection refused" start-of-body= Jun 09 15:19:05.145294 ip-10-0-130-232 kubenswrapper[2575]: I0609 15:19:05.145241 2575 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-console/console-648b46694f-fjpfp" podUID="2d40fe33-a48c-4b4a-a224-6cb8dceaaff7" containerName="console" probeResult="failure" output="Get \"https://10.133.0.17:8443/health\": dial tcp 10.133.0.17:8443: connect: connection refused" Jun 09 15:19:05.318238 ip-10-0-130-232 kubenswrapper[2575]: I0609 15:19:05.318211 2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-dfk2j\"" Jun 09 15:19:05.326331 ip-10-0-130-232 kubenswrapper[2575]: I0609 15:19:05.326302 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-rmhjs" Jun 09 15:19:05.467876 ip-10-0-130-232 kubenswrapper[2575]: I0609 15:19:05.467834 2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-rmhjs"] Jun 09 15:19:05.470606 ip-10-0-130-232 kubenswrapper[2575]: W0609 15:19:05.470574 2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod12bfe226_e002_44c4_aaeb_0905603ccd18.slice/crio-c1f14e40f68fc14cbc86adf56dc561ed4aea9e82279a825feb770d0c9cbc0c28 WatchSource:0}: Error finding container c1f14e40f68fc14cbc86adf56dc561ed4aea9e82279a825feb770d0c9cbc0c28: Status 404 returned error can't find the container with id c1f14e40f68fc14cbc86adf56dc561ed4aea9e82279a825feb770d0c9cbc0c28 Jun 09 15:19:05.489618 ip-10-0-130-232 kubenswrapper[2575]: I0609 15:19:05.489593 2575 patch_prober.go:28] interesting pod/image-registry-75f6d98cf6-grg9x container/registry namespace/openshift-image-registry: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body={"errors":[{"code":"UNAVAILABLE","message":"service unavailable","detail":"health check failed: please see /debug/health"}]} Jun 09 15:19:05.489728 ip-10-0-130-232 kubenswrapper[2575]: I0609 15:19:05.489636 2575 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-image-registry/image-registry-75f6d98cf6-grg9x" podUID="3ffe15f5-8e1c-43c6-a5e0-482410e1be5c" containerName="registry" probeResult="failure" output="HTTP probe failed with statuscode: 503" Jun 09 15:19:05.626722 ip-10-0-130-232 kubenswrapper[2575]: I0609 15:19:05.626638 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-rmhjs" event={"ID":"12bfe226-e002-44c4-aaeb-0905603ccd18","Type":"ContainerStarted","Data":"c1f14e40f68fc14cbc86adf56dc561ed4aea9e82279a825feb770d0c9cbc0c28"} Jun 09 15:19:06.216912 ip-10-0-130-232 kubenswrapper[2575]: I0609 15:19:06.216878 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2bkzp_41532b1e-300d-4a9e-a64f-da302213062c/konnectivity-agent/0.log" limit=1024 Jun 09 15:19:06.333738 ip-10-0-130-232 kubenswrapper[2575]: I0609 15:19:06.333692 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2bkzp_41532b1e-300d-4a9e-a64f-da302213062c/konnectivity-agent/0.log" limit=1024 Jun 09 15:19:07.361083 ip-10-0-130-232 kubenswrapper[2575]: I0609 15:19:07.361044 2575 prober.go:120] "Probe failed" probeType="Liveness" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-78c9f9fbb-mwpt8" podUID="ac1d9517-d30b-461a-866c-6d4639ae663c" containerName="service-proxy" probeResult="failure" output="HTTP probe failed with statuscode: 500" Jun 09 15:19:07.637363 ip-10-0-130-232 kubenswrapper[2575]: I0609 15:19:07.637282 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-rmhjs" event={"ID":"12bfe226-e002-44c4-aaeb-0905603ccd18","Type":"ContainerStarted","Data":"2576230535af6e31e328f073756c4ea09e68d3ca69c744a004bcd56d3ef7d754"} Jun 09 15:19:07.637363 ip-10-0-130-232 kubenswrapper[2575]: I0609 15:19:07.637336 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-rmhjs" event={"ID":"12bfe226-e002-44c4-aaeb-0905603ccd18","Type":"ContainerStarted","Data":"656b36ace92e5b2e98d265f2f9a4bcade27743f0374cf6e8bccfc19339b93991"} Jun 09 15:19:07.637551 ip-10-0-130-232 kubenswrapper[2575]: I0609 15:19:07.637382 2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-dns/dns-default-rmhjs" Jun 09 15:19:07.657400 ip-10-0-130-232 kubenswrapper[2575]: I0609 15:19:07.657350 2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/dns-default-rmhjs" podStartSLOduration=250.899351363 podStartE2EDuration="4m12.657333791s" totalImagesPullingTime="1.757982428s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-09 15:14:55 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-09 15:19:07.655682798 +0000 UTC m=+287.343688248" watchObservedRunningTime="2026-06-09 15:19:07.657333791 +0000 UTC m=+287.345339245" Jun 09 15:19:07.998443 ip-10-0-130-232 kubenswrapper[2575]: I0609 15:19:07.998405 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2bkzp_41532b1e-300d-4a9e-a64f-da302213062c/konnectivity-agent/0.log" limit=1024 Jun 09 15:19:09.282073 ip-10-0-130-232 kubenswrapper[2575]: I0609 15:19:09.282034 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2bkzp_41532b1e-300d-4a9e-a64f-da302213062c/konnectivity-agent/0.log" limit=1024 Jun 09 15:19:10.860771 ip-10-0-130-232 kubenswrapper[2575]: I0609 15:19:10.860743 2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/metrics-server-f54699df-2pff4" Jun 09 15:19:10.861249 ip-10-0-130-232 kubenswrapper[2575]: I0609 15:19:10.860825 2575 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-monitoring/metrics-server-f54699df-2pff4" Jun 09 15:19:13.402141 ip-10-0-130-232 kubenswrapper[2575]: I0609 15:19:13.402054 2575 patch_prober.go:28] interesting pod/image-registry-75f6d98cf6-grg9x container/registry namespace/openshift-image-registry: Liveness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body={"errors":[{"code":"UNAVAILABLE","message":"service unavailable","detail":"health check failed: please see /debug/health"}]} Jun 09 15:19:13.402141 ip-10-0-130-232 kubenswrapper[2575]: I0609 15:19:13.402114 2575 prober.go:120] "Probe failed" probeType="Liveness" pod="openshift-image-registry/image-registry-75f6d98cf6-grg9x" podUID="3ffe15f5-8e1c-43c6-a5e0-482410e1be5c" containerName="registry" probeResult="failure" output="HTTP probe failed with statuscode: 503" Jun 09 15:19:13.402604 ip-10-0-130-232 kubenswrapper[2575]: I0609 15:19:13.402160 2575 kubelet.go:2654] "SyncLoop (probe)" probe="liveness" status="unhealthy" pod="openshift-image-registry/image-registry-75f6d98cf6-grg9x" Jun 09 15:19:13.402604 ip-10-0-130-232 kubenswrapper[2575]: I0609 15:19:13.402578 2575 kuberuntime_manager.go:1192] "Message for Container of pod" containerName="registry" containerStatusID={"Type":"cri-o","ID":"aa769e333358e7624c0aa9beab01730ef750332b1a89c696fb7ba17b4e6e6129"} pod="openshift-image-registry/image-registry-75f6d98cf6-grg9x" containerMessage="Container registry failed liveness probe, will be restarted" Jun 09 15:19:13.406136 ip-10-0-130-232 kubenswrapper[2575]: I0609 15:19:13.406112 2575 patch_prober.go:28] interesting pod/image-registry-75f6d98cf6-grg9x container/registry namespace/openshift-image-registry: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body={"errors":[{"code":"UNAVAILABLE","message":"service unavailable","detail":"health check failed: please see /debug/health"}]} Jun 09 15:19:13.406260 ip-10-0-130-232 kubenswrapper[2575]: I0609 15:19:13.406154 2575 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-image-registry/image-registry-75f6d98cf6-grg9x" podUID="3ffe15f5-8e1c-43c6-a5e0-482410e1be5c" containerName="registry" probeResult="failure" output="HTTP probe failed with statuscode: 503" Jun 09 15:19:15.147467 ip-10-0-130-232 kubenswrapper[2575]: I0609 15:19:15.147438 2575 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-648b46694f-fjpfp" Jun 09 15:19:15.151199 ip-10-0-130-232 kubenswrapper[2575]: I0609 15:19:15.151177 2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-648b46694f-fjpfp" Jun 09 15:19:15.401266 ip-10-0-130-232 kubenswrapper[2575]: I0609 15:19:15.401187 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2bkzp_41532b1e-300d-4a9e-a64f-da302213062c/konnectivity-agent/0.log" limit=1024 Jun 09 15:19:15.503308 ip-10-0-130-232 kubenswrapper[2575]: I0609 15:19:15.503279 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2bkzp_41532b1e-300d-4a9e-a64f-da302213062c/konnectivity-agent/0.log" limit=1024 Jun 09 15:19:15.707328 ip-10-0-130-232 kubenswrapper[2575]: I0609 15:19:15.707241 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2bkzp_41532b1e-300d-4a9e-a64f-da302213062c/konnectivity-agent/0.log" limit=1024 Jun 09 15:19:15.814337 ip-10-0-130-232 kubenswrapper[2575]: I0609 15:19:15.814304 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2bkzp_41532b1e-300d-4a9e-a64f-da302213062c/konnectivity-agent/0.log" limit=1024 Jun 09 15:19:15.907919 ip-10-0-130-232 kubenswrapper[2575]: I0609 15:19:15.907886 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2bkzp_41532b1e-300d-4a9e-a64f-da302213062c/konnectivity-agent/0.log" limit=1024 Jun 09 15:19:17.361219 ip-10-0-130-232 kubenswrapper[2575]: I0609 15:19:17.361183 2575 prober.go:120] "Probe failed" probeType="Liveness" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-78c9f9fbb-mwpt8" podUID="ac1d9517-d30b-461a-866c-6d4639ae663c" containerName="service-proxy" probeResult="failure" output="HTTP probe failed with statuscode: 500" Jun 09 15:19:17.361580 ip-10-0-130-232 kubenswrapper[2575]: I0609 15:19:17.361254 2575 kubelet.go:2654] "SyncLoop (probe)" probe="liveness" status="unhealthy" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-78c9f9fbb-mwpt8" Jun 09 15:19:17.361732 ip-10-0-130-232 kubenswrapper[2575]: I0609 15:19:17.361710 2575 kuberuntime_manager.go:1192] "Message for Container of pod" containerName="service-proxy" containerStatusID={"Type":"cri-o","ID":"769a3da91a99a2250789ee17667ac7436fa4d5372ca916aa8d6ac59536e1141f"} pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-78c9f9fbb-mwpt8" containerMessage="Container service-proxy failed liveness probe, will be restarted" Jun 09 15:19:17.361770 ip-10-0-130-232 kubenswrapper[2575]: I0609 15:19:17.361754 2575 kuberuntime_container.go:872] "Killing container with a grace period" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-78c9f9fbb-mwpt8" podUID="ac1d9517-d30b-461a-866c-6d4639ae663c" containerName="service-proxy" containerID="cri-o://769a3da91a99a2250789ee17667ac7436fa4d5372ca916aa8d6ac59536e1141f" gracePeriod=30 Jun 09 15:19:17.645256 ip-10-0-130-232 kubenswrapper[2575]: I0609 15:19:17.645183 2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-dns/dns-default-rmhjs" Jun 09 15:19:17.677251 ip-10-0-130-232 kubenswrapper[2575]: I0609 15:19:17.677222 2575 generic.go:356] "Generic (PLEG): container finished" podID="ac1d9517-d30b-461a-866c-6d4639ae663c" containerID="769a3da91a99a2250789ee17667ac7436fa4d5372ca916aa8d6ac59536e1141f" exitCode=2 Jun 09 15:19:17.677396 ip-10-0-130-232 kubenswrapper[2575]: I0609 15:19:17.677279 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-78c9f9fbb-mwpt8" event={"ID":"ac1d9517-d30b-461a-866c-6d4639ae663c","Type":"ContainerDied","Data":"769a3da91a99a2250789ee17667ac7436fa4d5372ca916aa8d6ac59536e1141f"} Jun 09 15:19:17.677396 ip-10-0-130-232 kubenswrapper[2575]: I0609 15:19:17.677318 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-78c9f9fbb-mwpt8" event={"ID":"ac1d9517-d30b-461a-866c-6d4639ae663c","Type":"ContainerStarted","Data":"0b96b07f83040f2d2999e8a153be0b1f53ca450a92997d5bbe1afc8fb42004b2"} Jun 09 15:19:18.206561 ip-10-0-130-232 kubenswrapper[2575]: I0609 15:19:18.206523 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2bkzp_41532b1e-300d-4a9e-a64f-da302213062c/konnectivity-agent/0.log" limit=1024 Jun 09 15:19:18.308241 ip-10-0-130-232 kubenswrapper[2575]: I0609 15:19:18.308208 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2bkzp_41532b1e-300d-4a9e-a64f-da302213062c/konnectivity-agent/0.log" limit=1024 Jun 09 15:19:20.647640 ip-10-0-130-232 kubenswrapper[2575]: I0609 15:19:20.647613 2575 kubelet.go:1648] "Image garbage collection succeeded" Jun 09 15:19:23.406525 ip-10-0-130-232 kubenswrapper[2575]: I0609 15:19:23.406486 2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-image-registry/image-registry-75f6d98cf6-grg9x" Jun 09 15:19:23.594094 ip-10-0-130-232 kubenswrapper[2575]: I0609 15:19:23.594066 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2bkzp_41532b1e-300d-4a9e-a64f-da302213062c/konnectivity-agent/0.log" limit=1024 Jun 09 15:19:23.664492 ip-10-0-130-232 kubenswrapper[2575]: I0609 15:19:23.664409 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2bkzp_41532b1e-300d-4a9e-a64f-da302213062c/konnectivity-agent/0.log" limit=1024 Jun 09 15:19:23.738261 ip-10-0-130-232 kubenswrapper[2575]: I0609 15:19:23.738225 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2bkzp_41532b1e-300d-4a9e-a64f-da302213062c/konnectivity-agent/0.log" limit=1024 Jun 09 15:19:24.780191 ip-10-0-130-232 kubenswrapper[2575]: I0609 15:19:24.780160 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2bkzp_41532b1e-300d-4a9e-a64f-da302213062c/konnectivity-agent/0.log" limit=1024 Jun 09 15:19:24.846355 ip-10-0-130-232 kubenswrapper[2575]: I0609 15:19:24.846325 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2bkzp_41532b1e-300d-4a9e-a64f-da302213062c/konnectivity-agent/0.log" limit=1024 Jun 09 15:19:25.896344 ip-10-0-130-232 kubenswrapper[2575]: I0609 15:19:25.896301 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2bkzp_41532b1e-300d-4a9e-a64f-da302213062c/konnectivity-agent/0.log" limit=1024 Jun 09 15:19:25.974722 ip-10-0-130-232 kubenswrapper[2575]: I0609 15:19:25.974684 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2bkzp_41532b1e-300d-4a9e-a64f-da302213062c/konnectivity-agent/0.log" limit=1024 Jun 09 15:19:26.963272 ip-10-0-130-232 kubenswrapper[2575]: I0609 15:19:26.963238 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2bkzp_41532b1e-300d-4a9e-a64f-da302213062c/konnectivity-agent/0.log" limit=1024 Jun 09 15:19:27.954076 ip-10-0-130-232 kubenswrapper[2575]: I0609 15:19:27.954052 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-w28rj_2e334ed6-e1c8-4008-9e24-dc9f3079be0a/serve-healthcheck-canary/0.log" Jun 09 15:19:30.866168 ip-10-0-130-232 kubenswrapper[2575]: I0609 15:19:30.866136 2575 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-monitoring/metrics-server-f54699df-2pff4" Jun 09 15:19:30.869837 ip-10-0-130-232 kubenswrapper[2575]: I0609 15:19:30.869813 2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/metrics-server-f54699df-2pff4" Jun 09 15:19:33.859956 ip-10-0-130-232 kubenswrapper[2575]: I0609 15:19:33.859917 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2bkzp_41532b1e-300d-4a9e-a64f-da302213062c/konnectivity-agent/0.log" limit=1024 Jun 09 15:19:33.981268 ip-10-0-130-232 kubenswrapper[2575]: I0609 15:19:33.981229 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2bkzp_41532b1e-300d-4a9e-a64f-da302213062c/konnectivity-agent/0.log" limit=1024 Jun 09 15:19:38.421824 ip-10-0-130-232 kubenswrapper[2575]: I0609 15:19:38.421770 2575 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-image-registry/image-registry-75f6d98cf6-grg9x" podUID="3ffe15f5-8e1c-43c6-a5e0-482410e1be5c" containerName="registry" containerID="cri-o://aa769e333358e7624c0aa9beab01730ef750332b1a89c696fb7ba17b4e6e6129" gracePeriod=30 Jun 09 15:19:39.768693 ip-10-0-130-232 kubenswrapper[2575]: I0609 15:19:39.768648 2575 generic.go:356] "Generic (PLEG): container finished" podID="3ffe15f5-8e1c-43c6-a5e0-482410e1be5c" containerID="aa769e333358e7624c0aa9beab01730ef750332b1a89c696fb7ba17b4e6e6129" exitCode=0 Jun 09 15:19:39.769266 ip-10-0-130-232 kubenswrapper[2575]: I0609 15:19:39.768765 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-75f6d98cf6-grg9x" event={"ID":"3ffe15f5-8e1c-43c6-a5e0-482410e1be5c","Type":"ContainerDied","Data":"aa769e333358e7624c0aa9beab01730ef750332b1a89c696fb7ba17b4e6e6129"} Jun 09 15:19:39.769266 ip-10-0-130-232 kubenswrapper[2575]: I0609 15:19:39.768814 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-75f6d98cf6-grg9x" event={"ID":"3ffe15f5-8e1c-43c6-a5e0-482410e1be5c","Type":"ContainerStarted","Data":"a69c01ef5b71e9497af9590019c5fb858d0b0e52c7025f3a2a13a2b3c16fa3b7"} Jun 09 15:19:39.769739 ip-10-0-130-232 kubenswrapper[2575]: I0609 15:19:39.769710 2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-image-registry/image-registry-75f6d98cf6-grg9x" Jun 09 15:19:40.056076 ip-10-0-130-232 kubenswrapper[2575]: I0609 15:19:40.055962 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2bkzp_41532b1e-300d-4a9e-a64f-da302213062c/konnectivity-agent/0.log" limit=1024 Jun 09 15:19:40.121236 ip-10-0-130-232 kubenswrapper[2575]: I0609 15:19:40.121165 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2bkzp_41532b1e-300d-4a9e-a64f-da302213062c/konnectivity-agent/0.log" limit=1024 Jun 09 15:19:40.876198 ip-10-0-130-232 kubenswrapper[2575]: I0609 15:19:40.876165 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2bkzp_41532b1e-300d-4a9e-a64f-da302213062c/konnectivity-agent/0.log" limit=1024 Jun 09 15:19:40.953130 ip-10-0-130-232 kubenswrapper[2575]: I0609 15:19:40.953101 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2bkzp_41532b1e-300d-4a9e-a64f-da302213062c/konnectivity-agent/0.log" limit=1024 Jun 09 15:19:45.874121 ip-10-0-130-232 kubenswrapper[2575]: I0609 15:19:45.874088 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2bkzp_41532b1e-300d-4a9e-a64f-da302213062c/konnectivity-agent/0.log" limit=1024 Jun 09 15:19:45.938458 ip-10-0-130-232 kubenswrapper[2575]: I0609 15:19:45.938427 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2bkzp_41532b1e-300d-4a9e-a64f-da302213062c/konnectivity-agent/0.log" limit=1024 Jun 09 15:19:48.896553 ip-10-0-130-232 kubenswrapper[2575]: I0609 15:19:48.896518 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2bkzp_41532b1e-300d-4a9e-a64f-da302213062c/konnectivity-agent/0.log" limit=1024 Jun 09 15:19:49.003860 ip-10-0-130-232 kubenswrapper[2575]: I0609 15:19:49.003810 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2bkzp_41532b1e-300d-4a9e-a64f-da302213062c/konnectivity-agent/0.log" limit=1024 Jun 09 15:19:49.098454 ip-10-0-130-232 kubenswrapper[2575]: I0609 15:19:49.098403 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2bkzp_41532b1e-300d-4a9e-a64f-da302213062c/konnectivity-agent/0.log" limit=1024 Jun 09 15:19:55.871717 ip-10-0-130-232 kubenswrapper[2575]: I0609 15:19:55.871683 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2bkzp_41532b1e-300d-4a9e-a64f-da302213062c/konnectivity-agent/0.log" limit=1024 Jun 09 15:19:55.931108 ip-10-0-130-232 kubenswrapper[2575]: I0609 15:19:55.931068 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2bkzp_41532b1e-300d-4a9e-a64f-da302213062c/konnectivity-agent/0.log" limit=1024 Jun 09 15:20:01.781441 ip-10-0-130-232 kubenswrapper[2575]: I0609 15:20:01.781413 2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-image-registry/image-registry-75f6d98cf6-grg9x" Jun 09 15:20:01.976671 ip-10-0-130-232 kubenswrapper[2575]: I0609 15:20:01.976595 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2bkzp_41532b1e-300d-4a9e-a64f-da302213062c/konnectivity-agent/0.log" limit=1024 Jun 09 15:20:02.037801 ip-10-0-130-232 kubenswrapper[2575]: I0609 15:20:02.037705 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2bkzp_41532b1e-300d-4a9e-a64f-da302213062c/konnectivity-agent/0.log" limit=1024 Jun 09 15:20:02.309933 ip-10-0-130-232 kubenswrapper[2575]: I0609 15:20:02.309791 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2bkzp_41532b1e-300d-4a9e-a64f-da302213062c/konnectivity-agent/0.log" limit=1024 Jun 09 15:20:02.371979 ip-10-0-130-232 kubenswrapper[2575]: I0609 15:20:02.371946 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2bkzp_41532b1e-300d-4a9e-a64f-da302213062c/konnectivity-agent/0.log" limit=1024 Jun 09 15:20:06.556548 ip-10-0-130-232 kubenswrapper[2575]: I0609 15:20:06.556512 2575 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Jun 09 15:20:06.557045 ip-10-0-130-232 kubenswrapper[2575]: I0609 15:20:06.556779 2575 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="e88ffeea-65a9-4fe0-a4e5-b298a11a8e5d" containerName="alertmanager" containerID="cri-o://07022fd4be2beba64678175f28b27ece044be7351a63498f20f0ccad56580038" gracePeriod=120 Jun 09 15:20:06.557045 ip-10-0-130-232 kubenswrapper[2575]: I0609 15:20:06.556860 2575 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="e88ffeea-65a9-4fe0-a4e5-b298a11a8e5d" containerName="kube-rbac-proxy-metric" containerID="cri-o://7b9bf2348d05c53a9420dbbdffd4ec72ce0bcc2fdf8c787873caecdeb3280bb9" gracePeriod=120 Jun 09 15:20:06.557045 ip-10-0-130-232 kubenswrapper[2575]: I0609 15:20:06.556897 2575 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="e88ffeea-65a9-4fe0-a4e5-b298a11a8e5d" containerName="kube-rbac-proxy-web" containerID="cri-o://d4e5f103504844a5352bb18f64e25e726759f54c1fb3124b0e32107855949425" gracePeriod=120 Jun 09 15:20:06.557045 ip-10-0-130-232 kubenswrapper[2575]: I0609 15:20:06.556928 2575 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="e88ffeea-65a9-4fe0-a4e5-b298a11a8e5d" containerName="prom-label-proxy" containerID="cri-o://8354d893a3bbbf7d41efe96223a0f4a09a77283e2cdc807230dbf3f07f9c5cb5" gracePeriod=120 Jun 09 15:20:06.557045 ip-10-0-130-232 kubenswrapper[2575]: I0609 15:20:06.556928 2575 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="e88ffeea-65a9-4fe0-a4e5-b298a11a8e5d" containerName="config-reloader" containerID="cri-o://904a72a14a58b76e68d13f80bdf8e468b564aec4c29938f79ebe6453d73263e9" gracePeriod=120 Jun 09 15:20:06.557045 ip-10-0-130-232 kubenswrapper[2575]: I0609 15:20:06.556903 2575 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="e88ffeea-65a9-4fe0-a4e5-b298a11a8e5d" containerName="kube-rbac-proxy" containerID="cri-o://64a7669ce8c90fd186858c8a2f2bee2bb7f0fbc7aabf7522e6b60b056b62800e" gracePeriod=120 Jun 09 15:20:06.871867 ip-10-0-130-232 kubenswrapper[2575]: I0609 15:20:06.871768 2575 generic.go:356] "Generic (PLEG): container finished" podID="e88ffeea-65a9-4fe0-a4e5-b298a11a8e5d" containerID="8354d893a3bbbf7d41efe96223a0f4a09a77283e2cdc807230dbf3f07f9c5cb5" exitCode=0 Jun 09 15:20:06.871867 ip-10-0-130-232 kubenswrapper[2575]: I0609 15:20:06.871795 2575 generic.go:356] "Generic (PLEG): container finished" podID="e88ffeea-65a9-4fe0-a4e5-b298a11a8e5d" containerID="64a7669ce8c90fd186858c8a2f2bee2bb7f0fbc7aabf7522e6b60b056b62800e" exitCode=0 Jun 09 15:20:06.871867 ip-10-0-130-232 kubenswrapper[2575]: I0609 15:20:06.871802 2575 generic.go:356] "Generic (PLEG): container finished" podID="e88ffeea-65a9-4fe0-a4e5-b298a11a8e5d" containerID="904a72a14a58b76e68d13f80bdf8e468b564aec4c29938f79ebe6453d73263e9" exitCode=0 Jun 09 15:20:06.871867 ip-10-0-130-232 kubenswrapper[2575]: I0609 15:20:06.871808 2575 generic.go:356] "Generic (PLEG): container finished" podID="e88ffeea-65a9-4fe0-a4e5-b298a11a8e5d" containerID="07022fd4be2beba64678175f28b27ece044be7351a63498f20f0ccad56580038" exitCode=0 Jun 09 15:20:06.871867 ip-10-0-130-232 kubenswrapper[2575]: I0609 15:20:06.871855 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"e88ffeea-65a9-4fe0-a4e5-b298a11a8e5d","Type":"ContainerDied","Data":"8354d893a3bbbf7d41efe96223a0f4a09a77283e2cdc807230dbf3f07f9c5cb5"} Jun 09 15:20:06.872125 ip-10-0-130-232 kubenswrapper[2575]: I0609 15:20:06.871925 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"e88ffeea-65a9-4fe0-a4e5-b298a11a8e5d","Type":"ContainerDied","Data":"64a7669ce8c90fd186858c8a2f2bee2bb7f0fbc7aabf7522e6b60b056b62800e"} Jun 09 15:20:06.872125 ip-10-0-130-232 kubenswrapper[2575]: I0609 15:20:06.871952 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"e88ffeea-65a9-4fe0-a4e5-b298a11a8e5d","Type":"ContainerDied","Data":"904a72a14a58b76e68d13f80bdf8e468b564aec4c29938f79ebe6453d73263e9"} Jun 09 15:20:06.872125 ip-10-0-130-232 kubenswrapper[2575]: I0609 15:20:06.871975 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"e88ffeea-65a9-4fe0-a4e5-b298a11a8e5d","Type":"ContainerDied","Data":"07022fd4be2beba64678175f28b27ece044be7351a63498f20f0ccad56580038"} Jun 09 15:20:07.804267 ip-10-0-130-232 kubenswrapper[2575]: I0609 15:20:07.804245 2575 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0" Jun 09 15:20:07.878982 ip-10-0-130-232 kubenswrapper[2575]: I0609 15:20:07.878876 2575 generic.go:356] "Generic (PLEG): container finished" podID="e88ffeea-65a9-4fe0-a4e5-b298a11a8e5d" containerID="7b9bf2348d05c53a9420dbbdffd4ec72ce0bcc2fdf8c787873caecdeb3280bb9" exitCode=0 Jun 09 15:20:07.878982 ip-10-0-130-232 kubenswrapper[2575]: I0609 15:20:07.878910 2575 generic.go:356] "Generic (PLEG): container finished" podID="e88ffeea-65a9-4fe0-a4e5-b298a11a8e5d" containerID="d4e5f103504844a5352bb18f64e25e726759f54c1fb3124b0e32107855949425" exitCode=0 Jun 09 15:20:07.878982 ip-10-0-130-232 kubenswrapper[2575]: I0609 15:20:07.878963 2575 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0" Jun 09 15:20:07.879242 ip-10-0-130-232 kubenswrapper[2575]: I0609 15:20:07.878960 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"e88ffeea-65a9-4fe0-a4e5-b298a11a8e5d","Type":"ContainerDied","Data":"7b9bf2348d05c53a9420dbbdffd4ec72ce0bcc2fdf8c787873caecdeb3280bb9"} Jun 09 15:20:07.879242 ip-10-0-130-232 kubenswrapper[2575]: I0609 15:20:07.879091 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"e88ffeea-65a9-4fe0-a4e5-b298a11a8e5d","Type":"ContainerDied","Data":"d4e5f103504844a5352bb18f64e25e726759f54c1fb3124b0e32107855949425"} Jun 09 15:20:07.879242 ip-10-0-130-232 kubenswrapper[2575]: I0609 15:20:07.879120 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"e88ffeea-65a9-4fe0-a4e5-b298a11a8e5d","Type":"ContainerDied","Data":"7c5a849b0c66cda67fd2d06ba861988e7777efd2f4e9eaf08a56dc607f49e137"} Jun 09 15:20:07.879242 ip-10-0-130-232 kubenswrapper[2575]: I0609 15:20:07.879149 2575 scope.go:117] "RemoveContainer" containerID="8354d893a3bbbf7d41efe96223a0f4a09a77283e2cdc807230dbf3f07f9c5cb5" Jun 09 15:20:07.888132 ip-10-0-130-232 kubenswrapper[2575]: I0609 15:20:07.888112 2575 scope.go:117] "RemoveContainer" containerID="7b9bf2348d05c53a9420dbbdffd4ec72ce0bcc2fdf8c787873caecdeb3280bb9" Jun 09 15:20:07.895311 ip-10-0-130-232 kubenswrapper[2575]: I0609 15:20:07.895295 2575 scope.go:117] "RemoveContainer" containerID="64a7669ce8c90fd186858c8a2f2bee2bb7f0fbc7aabf7522e6b60b056b62800e" Jun 09 15:20:07.902275 ip-10-0-130-232 kubenswrapper[2575]: I0609 15:20:07.902255 2575 scope.go:117] "RemoveContainer" containerID="d4e5f103504844a5352bb18f64e25e726759f54c1fb3124b0e32107855949425" Jun 09 15:20:07.908652 ip-10-0-130-232 kubenswrapper[2575]: I0609 15:20:07.908636 2575 scope.go:117] "RemoveContainer" containerID="904a72a14a58b76e68d13f80bdf8e468b564aec4c29938f79ebe6453d73263e9" Jun 09 15:20:07.909159 ip-10-0-130-232 kubenswrapper[2575]: I0609 15:20:07.909142 2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-9ctgr\" (UniqueName: \"kubernetes.io/projected/e88ffeea-65a9-4fe0-a4e5-b298a11a8e5d-kube-api-access-9ctgr\") pod \"e88ffeea-65a9-4fe0-a4e5-b298a11a8e5d\" (UID: \"e88ffeea-65a9-4fe0-a4e5-b298a11a8e5d\") " Jun 09 15:20:07.909228 ip-10-0-130-232 kubenswrapper[2575]: I0609 15:20:07.909170 2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/e88ffeea-65a9-4fe0-a4e5-b298a11a8e5d-secret-alertmanager-kube-rbac-proxy-web\") pod \"e88ffeea-65a9-4fe0-a4e5-b298a11a8e5d\" (UID: \"e88ffeea-65a9-4fe0-a4e5-b298a11a8e5d\") " Jun 09 15:20:07.909228 ip-10-0-130-232 kubenswrapper[2575]: I0609 15:20:07.909190 2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/e88ffeea-65a9-4fe0-a4e5-b298a11a8e5d-config-out\") pod \"e88ffeea-65a9-4fe0-a4e5-b298a11a8e5d\" (UID: \"e88ffeea-65a9-4fe0-a4e5-b298a11a8e5d\") " Jun 09 15:20:07.909327 ip-10-0-130-232 kubenswrapper[2575]: I0609 15:20:07.909295 2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/e88ffeea-65a9-4fe0-a4e5-b298a11a8e5d-secret-alertmanager-kube-rbac-proxy\") pod \"e88ffeea-65a9-4fe0-a4e5-b298a11a8e5d\" (UID: \"e88ffeea-65a9-4fe0-a4e5-b298a11a8e5d\") " Jun 09 15:20:07.909386 ip-10-0-130-232 kubenswrapper[2575]: I0609 15:20:07.909327 2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/e88ffeea-65a9-4fe0-a4e5-b298a11a8e5d-metrics-client-ca\") pod \"e88ffeea-65a9-4fe0-a4e5-b298a11a8e5d\" (UID: \"e88ffeea-65a9-4fe0-a4e5-b298a11a8e5d\") " Jun 09 15:20:07.909386 ip-10-0-130-232 kubenswrapper[2575]: I0609 15:20:07.909367 2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/e88ffeea-65a9-4fe0-a4e5-b298a11a8e5d-alertmanager-main-db\") pod \"e88ffeea-65a9-4fe0-a4e5-b298a11a8e5d\" (UID: \"e88ffeea-65a9-4fe0-a4e5-b298a11a8e5d\") " Jun 09 15:20:07.909487 ip-10-0-130-232 kubenswrapper[2575]: I0609 15:20:07.909395 2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/e88ffeea-65a9-4fe0-a4e5-b298a11a8e5d-config-volume\") pod \"e88ffeea-65a9-4fe0-a4e5-b298a11a8e5d\" (UID: \"e88ffeea-65a9-4fe0-a4e5-b298a11a8e5d\") " Jun 09 15:20:07.909487 ip-10-0-130-232 kubenswrapper[2575]: I0609 15:20:07.909430 2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/e88ffeea-65a9-4fe0-a4e5-b298a11a8e5d-cluster-tls-config\") pod \"e88ffeea-65a9-4fe0-a4e5-b298a11a8e5d\" (UID: \"e88ffeea-65a9-4fe0-a4e5-b298a11a8e5d\") " Jun 09 15:20:07.910081 ip-10-0-130-232 kubenswrapper[2575]: I0609 15:20:07.909752 2575 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/e88ffeea-65a9-4fe0-a4e5-b298a11a8e5d-alertmanager-main-db" (OuterVolumeSpecName: "alertmanager-main-db") pod "e88ffeea-65a9-4fe0-a4e5-b298a11a8e5d" (UID: "e88ffeea-65a9-4fe0-a4e5-b298a11a8e5d"). InnerVolumeSpecName "alertmanager-main-db". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 09 15:20:07.910081 ip-10-0-130-232 kubenswrapper[2575]: I0609 15:20:07.909901 2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/e88ffeea-65a9-4fe0-a4e5-b298a11a8e5d-secret-alertmanager-kube-rbac-proxy-metric\") pod \"e88ffeea-65a9-4fe0-a4e5-b298a11a8e5d\" (UID: \"e88ffeea-65a9-4fe0-a4e5-b298a11a8e5d\") " Jun 09 15:20:07.910081 ip-10-0-130-232 kubenswrapper[2575]: I0609 15:20:07.909957 2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/e88ffeea-65a9-4fe0-a4e5-b298a11a8e5d-alertmanager-trusted-ca-bundle\") pod \"e88ffeea-65a9-4fe0-a4e5-b298a11a8e5d\" (UID: \"e88ffeea-65a9-4fe0-a4e5-b298a11a8e5d\") " Jun 09 15:20:07.910254 ip-10-0-130-232 kubenswrapper[2575]: I0609 15:20:07.910146 2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/e88ffeea-65a9-4fe0-a4e5-b298a11a8e5d-secret-alertmanager-main-tls\") pod \"e88ffeea-65a9-4fe0-a4e5-b298a11a8e5d\" (UID: \"e88ffeea-65a9-4fe0-a4e5-b298a11a8e5d\") " Jun 09 15:20:07.910254 ip-10-0-130-232 kubenswrapper[2575]: I0609 15:20:07.910197 2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/e88ffeea-65a9-4fe0-a4e5-b298a11a8e5d-web-config\") pod \"e88ffeea-65a9-4fe0-a4e5-b298a11a8e5d\" (UID: \"e88ffeea-65a9-4fe0-a4e5-b298a11a8e5d\") " Jun 09 15:20:07.910254 ip-10-0-130-232 kubenswrapper[2575]: I0609 15:20:07.910229 2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/e88ffeea-65a9-4fe0-a4e5-b298a11a8e5d-tls-assets\") pod \"e88ffeea-65a9-4fe0-a4e5-b298a11a8e5d\" (UID: \"e88ffeea-65a9-4fe0-a4e5-b298a11a8e5d\") " Jun 09 15:20:07.910781 ip-10-0-130-232 kubenswrapper[2575]: I0609 15:20:07.910749 2575 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/e88ffeea-65a9-4fe0-a4e5-b298a11a8e5d-alertmanager-trusted-ca-bundle" (OuterVolumeSpecName: "alertmanager-trusted-ca-bundle") pod "e88ffeea-65a9-4fe0-a4e5-b298a11a8e5d" (UID: "e88ffeea-65a9-4fe0-a4e5-b298a11a8e5d"). InnerVolumeSpecName "alertmanager-trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 09 15:20:07.910886 ip-10-0-130-232 kubenswrapper[2575]: I0609 15:20:07.910865 2575 reconciler_common.go:299] "Volume detached for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/e88ffeea-65a9-4fe0-a4e5-b298a11a8e5d-alertmanager-main-db\") on node \"ip-10-0-130-232.ec2.internal\" DevicePath \"\"" Jun 09 15:20:07.910953 ip-10-0-130-232 kubenswrapper[2575]: I0609 15:20:07.910888 2575 reconciler_common.go:299] "Volume detached for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/e88ffeea-65a9-4fe0-a4e5-b298a11a8e5d-alertmanager-trusted-ca-bundle\") on node \"ip-10-0-130-232.ec2.internal\" DevicePath \"\"" Jun 09 15:20:07.911420 ip-10-0-130-232 kubenswrapper[2575]: I0609 15:20:07.911292 2575 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/e88ffeea-65a9-4fe0-a4e5-b298a11a8e5d-metrics-client-ca" (OuterVolumeSpecName: "metrics-client-ca") pod "e88ffeea-65a9-4fe0-a4e5-b298a11a8e5d" (UID: "e88ffeea-65a9-4fe0-a4e5-b298a11a8e5d"). InnerVolumeSpecName "metrics-client-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 09 15:20:07.913299 ip-10-0-130-232 kubenswrapper[2575]: I0609 15:20:07.913246 2575 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/e88ffeea-65a9-4fe0-a4e5-b298a11a8e5d-config-volume" (OuterVolumeSpecName: "config-volume") pod "e88ffeea-65a9-4fe0-a4e5-b298a11a8e5d" (UID: "e88ffeea-65a9-4fe0-a4e5-b298a11a8e5d"). InnerVolumeSpecName "config-volume". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 09 15:20:07.913299 ip-10-0-130-232 kubenswrapper[2575]: I0609 15:20:07.913260 2575 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/e88ffeea-65a9-4fe0-a4e5-b298a11a8e5d-config-out" (OuterVolumeSpecName: "config-out") pod "e88ffeea-65a9-4fe0-a4e5-b298a11a8e5d" (UID: "e88ffeea-65a9-4fe0-a4e5-b298a11a8e5d"). InnerVolumeSpecName "config-out". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 09 15:20:07.913451 ip-10-0-130-232 kubenswrapper[2575]: I0609 15:20:07.913306 2575 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/e88ffeea-65a9-4fe0-a4e5-b298a11a8e5d-secret-alertmanager-kube-rbac-proxy-web" (OuterVolumeSpecName: "secret-alertmanager-kube-rbac-proxy-web") pod "e88ffeea-65a9-4fe0-a4e5-b298a11a8e5d" (UID: "e88ffeea-65a9-4fe0-a4e5-b298a11a8e5d"). InnerVolumeSpecName "secret-alertmanager-kube-rbac-proxy-web". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 09 15:20:07.913451 ip-10-0-130-232 kubenswrapper[2575]: I0609 15:20:07.913424 2575 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/e88ffeea-65a9-4fe0-a4e5-b298a11a8e5d-secret-alertmanager-kube-rbac-proxy" (OuterVolumeSpecName: "secret-alertmanager-kube-rbac-proxy") pod "e88ffeea-65a9-4fe0-a4e5-b298a11a8e5d" (UID: "e88ffeea-65a9-4fe0-a4e5-b298a11a8e5d"). InnerVolumeSpecName "secret-alertmanager-kube-rbac-proxy". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 09 15:20:07.913598 ip-10-0-130-232 kubenswrapper[2575]: I0609 15:20:07.913573 2575 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/e88ffeea-65a9-4fe0-a4e5-b298a11a8e5d-secret-alertmanager-main-tls" (OuterVolumeSpecName: "secret-alertmanager-main-tls") pod "e88ffeea-65a9-4fe0-a4e5-b298a11a8e5d" (UID: "e88ffeea-65a9-4fe0-a4e5-b298a11a8e5d"). InnerVolumeSpecName "secret-alertmanager-main-tls". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 09 15:20:07.913899 ip-10-0-130-232 kubenswrapper[2575]: I0609 15:20:07.913866 2575 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/e88ffeea-65a9-4fe0-a4e5-b298a11a8e5d-kube-api-access-9ctgr" (OuterVolumeSpecName: "kube-api-access-9ctgr") pod "e88ffeea-65a9-4fe0-a4e5-b298a11a8e5d" (UID: "e88ffeea-65a9-4fe0-a4e5-b298a11a8e5d"). InnerVolumeSpecName "kube-api-access-9ctgr". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 09 15:20:07.914334 ip-10-0-130-232 kubenswrapper[2575]: I0609 15:20:07.914305 2575 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/e88ffeea-65a9-4fe0-a4e5-b298a11a8e5d-tls-assets" (OuterVolumeSpecName: "tls-assets") pod "e88ffeea-65a9-4fe0-a4e5-b298a11a8e5d" (UID: "e88ffeea-65a9-4fe0-a4e5-b298a11a8e5d"). InnerVolumeSpecName "tls-assets". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 09 15:20:07.914334 ip-10-0-130-232 kubenswrapper[2575]: I0609 15:20:07.914313 2575 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/e88ffeea-65a9-4fe0-a4e5-b298a11a8e5d-secret-alertmanager-kube-rbac-proxy-metric" (OuterVolumeSpecName: "secret-alertmanager-kube-rbac-proxy-metric") pod "e88ffeea-65a9-4fe0-a4e5-b298a11a8e5d" (UID: "e88ffeea-65a9-4fe0-a4e5-b298a11a8e5d"). InnerVolumeSpecName "secret-alertmanager-kube-rbac-proxy-metric". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 09 15:20:07.917324 ip-10-0-130-232 kubenswrapper[2575]: I0609 15:20:07.917304 2575 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/e88ffeea-65a9-4fe0-a4e5-b298a11a8e5d-cluster-tls-config" (OuterVolumeSpecName: "cluster-tls-config") pod "e88ffeea-65a9-4fe0-a4e5-b298a11a8e5d" (UID: "e88ffeea-65a9-4fe0-a4e5-b298a11a8e5d"). InnerVolumeSpecName "cluster-tls-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 09 15:20:07.924145 ip-10-0-130-232 kubenswrapper[2575]: I0609 15:20:07.924125 2575 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/e88ffeea-65a9-4fe0-a4e5-b298a11a8e5d-web-config" (OuterVolumeSpecName: "web-config") pod "e88ffeea-65a9-4fe0-a4e5-b298a11a8e5d" (UID: "e88ffeea-65a9-4fe0-a4e5-b298a11a8e5d"). InnerVolumeSpecName "web-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 09 15:20:07.924198 ip-10-0-130-232 kubenswrapper[2575]: I0609 15:20:07.924178 2575 scope.go:117] "RemoveContainer" containerID="07022fd4be2beba64678175f28b27ece044be7351a63498f20f0ccad56580038" Jun 09 15:20:07.930997 ip-10-0-130-232 kubenswrapper[2575]: I0609 15:20:07.930980 2575 scope.go:117] "RemoveContainer" containerID="7053987059c4cc51eb818d6c3c2d8eae44cca2bc062d582ff7a0c786b87f558e" Jun 09 15:20:07.939179 ip-10-0-130-232 kubenswrapper[2575]: I0609 15:20:07.939163 2575 scope.go:117] "RemoveContainer" containerID="8354d893a3bbbf7d41efe96223a0f4a09a77283e2cdc807230dbf3f07f9c5cb5" Jun 09 15:20:07.939477 ip-10-0-130-232 kubenswrapper[2575]: E0609 15:20:07.939442 2575 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"8354d893a3bbbf7d41efe96223a0f4a09a77283e2cdc807230dbf3f07f9c5cb5\": container with ID starting with 8354d893a3bbbf7d41efe96223a0f4a09a77283e2cdc807230dbf3f07f9c5cb5 not found: ID does not exist" containerID="8354d893a3bbbf7d41efe96223a0f4a09a77283e2cdc807230dbf3f07f9c5cb5" Jun 09 15:20:07.939522 ip-10-0-130-232 kubenswrapper[2575]: I0609 15:20:07.939483 2575 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"8354d893a3bbbf7d41efe96223a0f4a09a77283e2cdc807230dbf3f07f9c5cb5"} err="failed to get container status \"8354d893a3bbbf7d41efe96223a0f4a09a77283e2cdc807230dbf3f07f9c5cb5\": rpc error: code = NotFound desc = could not find container \"8354d893a3bbbf7d41efe96223a0f4a09a77283e2cdc807230dbf3f07f9c5cb5\": container with ID starting with 8354d893a3bbbf7d41efe96223a0f4a09a77283e2cdc807230dbf3f07f9c5cb5 not found: ID does not exist" Jun 09 15:20:07.939522 ip-10-0-130-232 kubenswrapper[2575]: I0609 15:20:07.939499 2575 scope.go:117] "RemoveContainer" containerID="7b9bf2348d05c53a9420dbbdffd4ec72ce0bcc2fdf8c787873caecdeb3280bb9" Jun 09 15:20:07.939744 ip-10-0-130-232 kubenswrapper[2575]: E0609 15:20:07.939726 2575 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"7b9bf2348d05c53a9420dbbdffd4ec72ce0bcc2fdf8c787873caecdeb3280bb9\": container with ID starting with 7b9bf2348d05c53a9420dbbdffd4ec72ce0bcc2fdf8c787873caecdeb3280bb9 not found: ID does not exist" containerID="7b9bf2348d05c53a9420dbbdffd4ec72ce0bcc2fdf8c787873caecdeb3280bb9" Jun 09 15:20:07.939792 ip-10-0-130-232 kubenswrapper[2575]: I0609 15:20:07.939749 2575 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"7b9bf2348d05c53a9420dbbdffd4ec72ce0bcc2fdf8c787873caecdeb3280bb9"} err="failed to get container status \"7b9bf2348d05c53a9420dbbdffd4ec72ce0bcc2fdf8c787873caecdeb3280bb9\": rpc error: code = NotFound desc = could not find container \"7b9bf2348d05c53a9420dbbdffd4ec72ce0bcc2fdf8c787873caecdeb3280bb9\": container with ID starting with 7b9bf2348d05c53a9420dbbdffd4ec72ce0bcc2fdf8c787873caecdeb3280bb9 not found: ID does not exist" Jun 09 15:20:07.939792 ip-10-0-130-232 kubenswrapper[2575]: I0609 15:20:07.939767 2575 scope.go:117] "RemoveContainer" containerID="64a7669ce8c90fd186858c8a2f2bee2bb7f0fbc7aabf7522e6b60b056b62800e" Jun 09 15:20:07.940020 ip-10-0-130-232 kubenswrapper[2575]: E0609 15:20:07.940003 2575 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"64a7669ce8c90fd186858c8a2f2bee2bb7f0fbc7aabf7522e6b60b056b62800e\": container with ID starting with 64a7669ce8c90fd186858c8a2f2bee2bb7f0fbc7aabf7522e6b60b056b62800e not found: ID does not exist" containerID="64a7669ce8c90fd186858c8a2f2bee2bb7f0fbc7aabf7522e6b60b056b62800e" Jun 09 15:20:07.940056 ip-10-0-130-232 kubenswrapper[2575]: I0609 15:20:07.940024 2575 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"64a7669ce8c90fd186858c8a2f2bee2bb7f0fbc7aabf7522e6b60b056b62800e"} err="failed to get container status \"64a7669ce8c90fd186858c8a2f2bee2bb7f0fbc7aabf7522e6b60b056b62800e\": rpc error: code = NotFound desc = could not find container \"64a7669ce8c90fd186858c8a2f2bee2bb7f0fbc7aabf7522e6b60b056b62800e\": container with ID starting with 64a7669ce8c90fd186858c8a2f2bee2bb7f0fbc7aabf7522e6b60b056b62800e not found: ID does not exist" Jun 09 15:20:07.940056 ip-10-0-130-232 kubenswrapper[2575]: I0609 15:20:07.940037 2575 scope.go:117] "RemoveContainer" containerID="d4e5f103504844a5352bb18f64e25e726759f54c1fb3124b0e32107855949425" Jun 09 15:20:07.940238 ip-10-0-130-232 kubenswrapper[2575]: E0609 15:20:07.940223 2575 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"d4e5f103504844a5352bb18f64e25e726759f54c1fb3124b0e32107855949425\": container with ID starting with d4e5f103504844a5352bb18f64e25e726759f54c1fb3124b0e32107855949425 not found: ID does not exist" containerID="d4e5f103504844a5352bb18f64e25e726759f54c1fb3124b0e32107855949425" Jun 09 15:20:07.940276 ip-10-0-130-232 kubenswrapper[2575]: I0609 15:20:07.940241 2575 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"d4e5f103504844a5352bb18f64e25e726759f54c1fb3124b0e32107855949425"} err="failed to get container status \"d4e5f103504844a5352bb18f64e25e726759f54c1fb3124b0e32107855949425\": rpc error: code = NotFound desc = could not find container \"d4e5f103504844a5352bb18f64e25e726759f54c1fb3124b0e32107855949425\": container with ID starting with d4e5f103504844a5352bb18f64e25e726759f54c1fb3124b0e32107855949425 not found: ID does not exist" Jun 09 15:20:07.940276 ip-10-0-130-232 kubenswrapper[2575]: I0609 15:20:07.940254 2575 scope.go:117] "RemoveContainer" containerID="904a72a14a58b76e68d13f80bdf8e468b564aec4c29938f79ebe6453d73263e9" Jun 09 15:20:07.940453 ip-10-0-130-232 kubenswrapper[2575]: E0609 15:20:07.940438 2575 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"904a72a14a58b76e68d13f80bdf8e468b564aec4c29938f79ebe6453d73263e9\": container with ID starting with 904a72a14a58b76e68d13f80bdf8e468b564aec4c29938f79ebe6453d73263e9 not found: ID does not exist" containerID="904a72a14a58b76e68d13f80bdf8e468b564aec4c29938f79ebe6453d73263e9" Jun 09 15:20:07.940493 ip-10-0-130-232 kubenswrapper[2575]: I0609 15:20:07.940455 2575 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"904a72a14a58b76e68d13f80bdf8e468b564aec4c29938f79ebe6453d73263e9"} err="failed to get container status \"904a72a14a58b76e68d13f80bdf8e468b564aec4c29938f79ebe6453d73263e9\": rpc error: code = NotFound desc = could not find container \"904a72a14a58b76e68d13f80bdf8e468b564aec4c29938f79ebe6453d73263e9\": container with ID starting with 904a72a14a58b76e68d13f80bdf8e468b564aec4c29938f79ebe6453d73263e9 not found: ID does not exist" Jun 09 15:20:07.940493 ip-10-0-130-232 kubenswrapper[2575]: I0609 15:20:07.940466 2575 scope.go:117] "RemoveContainer" containerID="07022fd4be2beba64678175f28b27ece044be7351a63498f20f0ccad56580038" Jun 09 15:20:07.940647 ip-10-0-130-232 kubenswrapper[2575]: E0609 15:20:07.940634 2575 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"07022fd4be2beba64678175f28b27ece044be7351a63498f20f0ccad56580038\": container with ID starting with 07022fd4be2beba64678175f28b27ece044be7351a63498f20f0ccad56580038 not found: ID does not exist" containerID="07022fd4be2beba64678175f28b27ece044be7351a63498f20f0ccad56580038" Jun 09 15:20:07.940685 ip-10-0-130-232 kubenswrapper[2575]: I0609 15:20:07.940649 2575 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"07022fd4be2beba64678175f28b27ece044be7351a63498f20f0ccad56580038"} err="failed to get container status \"07022fd4be2beba64678175f28b27ece044be7351a63498f20f0ccad56580038\": rpc error: code = NotFound desc = could not find container \"07022fd4be2beba64678175f28b27ece044be7351a63498f20f0ccad56580038\": container with ID starting with 07022fd4be2beba64678175f28b27ece044be7351a63498f20f0ccad56580038 not found: ID does not exist" Jun 09 15:20:07.940685 ip-10-0-130-232 kubenswrapper[2575]: I0609 15:20:07.940659 2575 scope.go:117] "RemoveContainer" containerID="7053987059c4cc51eb818d6c3c2d8eae44cca2bc062d582ff7a0c786b87f558e" Jun 09 15:20:07.940868 ip-10-0-130-232 kubenswrapper[2575]: E0609 15:20:07.940831 2575 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"7053987059c4cc51eb818d6c3c2d8eae44cca2bc062d582ff7a0c786b87f558e\": container with ID starting with 7053987059c4cc51eb818d6c3c2d8eae44cca2bc062d582ff7a0c786b87f558e not found: ID does not exist" containerID="7053987059c4cc51eb818d6c3c2d8eae44cca2bc062d582ff7a0c786b87f558e" Jun 09 15:20:07.940868 ip-10-0-130-232 kubenswrapper[2575]: I0609 15:20:07.940861 2575 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"7053987059c4cc51eb818d6c3c2d8eae44cca2bc062d582ff7a0c786b87f558e"} err="failed to get container status \"7053987059c4cc51eb818d6c3c2d8eae44cca2bc062d582ff7a0c786b87f558e\": rpc error: code = NotFound desc = could not find container \"7053987059c4cc51eb818d6c3c2d8eae44cca2bc062d582ff7a0c786b87f558e\": container with ID starting with 7053987059c4cc51eb818d6c3c2d8eae44cca2bc062d582ff7a0c786b87f558e not found: ID does not exist" Jun 09 15:20:07.940973 ip-10-0-130-232 kubenswrapper[2575]: I0609 15:20:07.940872 2575 scope.go:117] "RemoveContainer" containerID="8354d893a3bbbf7d41efe96223a0f4a09a77283e2cdc807230dbf3f07f9c5cb5" Jun 09 15:20:07.941070 ip-10-0-130-232 kubenswrapper[2575]: I0609 15:20:07.941053 2575 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"8354d893a3bbbf7d41efe96223a0f4a09a77283e2cdc807230dbf3f07f9c5cb5"} err="failed to get container status \"8354d893a3bbbf7d41efe96223a0f4a09a77283e2cdc807230dbf3f07f9c5cb5\": rpc error: code = NotFound desc = could not find container \"8354d893a3bbbf7d41efe96223a0f4a09a77283e2cdc807230dbf3f07f9c5cb5\": container with ID starting with 8354d893a3bbbf7d41efe96223a0f4a09a77283e2cdc807230dbf3f07f9c5cb5 not found: ID does not exist" Jun 09 15:20:07.941110 ip-10-0-130-232 kubenswrapper[2575]: I0609 15:20:07.941072 2575 scope.go:117] "RemoveContainer" containerID="7b9bf2348d05c53a9420dbbdffd4ec72ce0bcc2fdf8c787873caecdeb3280bb9" Jun 09 15:20:07.941273 ip-10-0-130-232 kubenswrapper[2575]: I0609 15:20:07.941257 2575 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"7b9bf2348d05c53a9420dbbdffd4ec72ce0bcc2fdf8c787873caecdeb3280bb9"} err="failed to get container status \"7b9bf2348d05c53a9420dbbdffd4ec72ce0bcc2fdf8c787873caecdeb3280bb9\": rpc error: code = NotFound desc = could not find container \"7b9bf2348d05c53a9420dbbdffd4ec72ce0bcc2fdf8c787873caecdeb3280bb9\": container with ID starting with 7b9bf2348d05c53a9420dbbdffd4ec72ce0bcc2fdf8c787873caecdeb3280bb9 not found: ID does not exist" Jun 09 15:20:07.941329 ip-10-0-130-232 kubenswrapper[2575]: I0609 15:20:07.941273 2575 scope.go:117] "RemoveContainer" containerID="64a7669ce8c90fd186858c8a2f2bee2bb7f0fbc7aabf7522e6b60b056b62800e" Jun 09 15:20:07.941443 ip-10-0-130-232 kubenswrapper[2575]: I0609 15:20:07.941428 2575 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"64a7669ce8c90fd186858c8a2f2bee2bb7f0fbc7aabf7522e6b60b056b62800e"} err="failed to get container status \"64a7669ce8c90fd186858c8a2f2bee2bb7f0fbc7aabf7522e6b60b056b62800e\": rpc error: code = NotFound desc = could not find container \"64a7669ce8c90fd186858c8a2f2bee2bb7f0fbc7aabf7522e6b60b056b62800e\": container with ID starting with 64a7669ce8c90fd186858c8a2f2bee2bb7f0fbc7aabf7522e6b60b056b62800e not found: ID does not exist" Jun 09 15:20:07.941480 ip-10-0-130-232 kubenswrapper[2575]: I0609 15:20:07.941444 2575 scope.go:117] "RemoveContainer" containerID="d4e5f103504844a5352bb18f64e25e726759f54c1fb3124b0e32107855949425" Jun 09 15:20:07.941670 ip-10-0-130-232 kubenswrapper[2575]: I0609 15:20:07.941647 2575 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"d4e5f103504844a5352bb18f64e25e726759f54c1fb3124b0e32107855949425"} err="failed to get container status \"d4e5f103504844a5352bb18f64e25e726759f54c1fb3124b0e32107855949425\": rpc error: code = NotFound desc = could not find container \"d4e5f103504844a5352bb18f64e25e726759f54c1fb3124b0e32107855949425\": container with ID starting with d4e5f103504844a5352bb18f64e25e726759f54c1fb3124b0e32107855949425 not found: ID does not exist" Jun 09 15:20:07.941670 ip-10-0-130-232 kubenswrapper[2575]: I0609 15:20:07.941669 2575 scope.go:117] "RemoveContainer" containerID="904a72a14a58b76e68d13f80bdf8e468b564aec4c29938f79ebe6453d73263e9" Jun 09 15:20:07.941928 ip-10-0-130-232 kubenswrapper[2575]: I0609 15:20:07.941908 2575 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"904a72a14a58b76e68d13f80bdf8e468b564aec4c29938f79ebe6453d73263e9"} err="failed to get container status \"904a72a14a58b76e68d13f80bdf8e468b564aec4c29938f79ebe6453d73263e9\": rpc error: code = NotFound desc = could not find container \"904a72a14a58b76e68d13f80bdf8e468b564aec4c29938f79ebe6453d73263e9\": container with ID starting with 904a72a14a58b76e68d13f80bdf8e468b564aec4c29938f79ebe6453d73263e9 not found: ID does not exist" Jun 09 15:20:07.941983 ip-10-0-130-232 kubenswrapper[2575]: I0609 15:20:07.941930 2575 scope.go:117] "RemoveContainer" containerID="07022fd4be2beba64678175f28b27ece044be7351a63498f20f0ccad56580038" Jun 09 15:20:07.942159 ip-10-0-130-232 kubenswrapper[2575]: I0609 15:20:07.942140 2575 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"07022fd4be2beba64678175f28b27ece044be7351a63498f20f0ccad56580038"} err="failed to get container status \"07022fd4be2beba64678175f28b27ece044be7351a63498f20f0ccad56580038\": rpc error: code = NotFound desc = could not find container \"07022fd4be2beba64678175f28b27ece044be7351a63498f20f0ccad56580038\": container with ID starting with 07022fd4be2beba64678175f28b27ece044be7351a63498f20f0ccad56580038 not found: ID does not exist" Jun 09 15:20:07.942231 ip-10-0-130-232 kubenswrapper[2575]: I0609 15:20:07.942161 2575 scope.go:117] "RemoveContainer" containerID="7053987059c4cc51eb818d6c3c2d8eae44cca2bc062d582ff7a0c786b87f558e" Jun 09 15:20:07.942365 ip-10-0-130-232 kubenswrapper[2575]: I0609 15:20:07.942349 2575 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"7053987059c4cc51eb818d6c3c2d8eae44cca2bc062d582ff7a0c786b87f558e"} err="failed to get container status \"7053987059c4cc51eb818d6c3c2d8eae44cca2bc062d582ff7a0c786b87f558e\": rpc error: code = NotFound desc = could not find container \"7053987059c4cc51eb818d6c3c2d8eae44cca2bc062d582ff7a0c786b87f558e\": container with ID starting with 7053987059c4cc51eb818d6c3c2d8eae44cca2bc062d582ff7a0c786b87f558e not found: ID does not exist" Jun 09 15:20:08.012267 ip-10-0-130-232 kubenswrapper[2575]: I0609 15:20:08.012234 2575 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-9ctgr\" (UniqueName: \"kubernetes.io/projected/e88ffeea-65a9-4fe0-a4e5-b298a11a8e5d-kube-api-access-9ctgr\") on node \"ip-10-0-130-232.ec2.internal\" DevicePath \"\"" Jun 09 15:20:08.012267 ip-10-0-130-232 kubenswrapper[2575]: I0609 15:20:08.012263 2575 reconciler_common.go:299] "Volume detached for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/e88ffeea-65a9-4fe0-a4e5-b298a11a8e5d-secret-alertmanager-kube-rbac-proxy-web\") on node \"ip-10-0-130-232.ec2.internal\" DevicePath \"\"" Jun 09 15:20:08.012453 ip-10-0-130-232 kubenswrapper[2575]: I0609 15:20:08.012278 2575 reconciler_common.go:299] "Volume detached for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/e88ffeea-65a9-4fe0-a4e5-b298a11a8e5d-config-out\") on node \"ip-10-0-130-232.ec2.internal\" DevicePath \"\"" Jun 09 15:20:08.012453 ip-10-0-130-232 kubenswrapper[2575]: I0609 15:20:08.012292 2575 reconciler_common.go:299] "Volume detached for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/e88ffeea-65a9-4fe0-a4e5-b298a11a8e5d-secret-alertmanager-kube-rbac-proxy\") on node \"ip-10-0-130-232.ec2.internal\" DevicePath \"\"" Jun 09 15:20:08.012453 ip-10-0-130-232 kubenswrapper[2575]: I0609 15:20:08.012307 2575 reconciler_common.go:299] "Volume detached for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/e88ffeea-65a9-4fe0-a4e5-b298a11a8e5d-metrics-client-ca\") on node \"ip-10-0-130-232.ec2.internal\" DevicePath \"\"" Jun 09 15:20:08.012453 ip-10-0-130-232 kubenswrapper[2575]: I0609 15:20:08.012321 2575 reconciler_common.go:299] "Volume detached for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/e88ffeea-65a9-4fe0-a4e5-b298a11a8e5d-config-volume\") on node \"ip-10-0-130-232.ec2.internal\" DevicePath \"\"" Jun 09 15:20:08.012453 ip-10-0-130-232 kubenswrapper[2575]: I0609 15:20:08.012333 2575 reconciler_common.go:299] "Volume detached for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/e88ffeea-65a9-4fe0-a4e5-b298a11a8e5d-cluster-tls-config\") on node \"ip-10-0-130-232.ec2.internal\" DevicePath \"\"" Jun 09 15:20:08.012453 ip-10-0-130-232 kubenswrapper[2575]: I0609 15:20:08.012346 2575 reconciler_common.go:299] "Volume detached for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/e88ffeea-65a9-4fe0-a4e5-b298a11a8e5d-secret-alertmanager-kube-rbac-proxy-metric\") on node \"ip-10-0-130-232.ec2.internal\" DevicePath \"\"" Jun 09 15:20:08.012453 ip-10-0-130-232 kubenswrapper[2575]: I0609 15:20:08.012361 2575 reconciler_common.go:299] "Volume detached for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/e88ffeea-65a9-4fe0-a4e5-b298a11a8e5d-secret-alertmanager-main-tls\") on node \"ip-10-0-130-232.ec2.internal\" DevicePath \"\"" Jun 09 15:20:08.012453 ip-10-0-130-232 kubenswrapper[2575]: I0609 15:20:08.012374 2575 reconciler_common.go:299] "Volume detached for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/e88ffeea-65a9-4fe0-a4e5-b298a11a8e5d-web-config\") on node \"ip-10-0-130-232.ec2.internal\" DevicePath \"\"" Jun 09 15:20:08.012453 ip-10-0-130-232 kubenswrapper[2575]: I0609 15:20:08.012386 2575 reconciler_common.go:299] "Volume detached for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/e88ffeea-65a9-4fe0-a4e5-b298a11a8e5d-tls-assets\") on node \"ip-10-0-130-232.ec2.internal\" DevicePath \"\"" Jun 09 15:20:08.205762 ip-10-0-130-232 kubenswrapper[2575]: I0609 15:20:08.205730 2575 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Jun 09 15:20:08.212426 ip-10-0-130-232 kubenswrapper[2575]: I0609 15:20:08.212405 2575 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Jun 09 15:20:08.242441 ip-10-0-130-232 kubenswrapper[2575]: I0609 15:20:08.242418 2575 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Jun 09 15:20:08.242668 ip-10-0-130-232 kubenswrapper[2575]: I0609 15:20:08.242656 2575 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="e88ffeea-65a9-4fe0-a4e5-b298a11a8e5d" containerName="kube-rbac-proxy" Jun 09 15:20:08.242731 ip-10-0-130-232 kubenswrapper[2575]: I0609 15:20:08.242670 2575 state_mem.go:107] "Deleted CPUSet assignment" podUID="e88ffeea-65a9-4fe0-a4e5-b298a11a8e5d" containerName="kube-rbac-proxy" Jun 09 15:20:08.242731 ip-10-0-130-232 kubenswrapper[2575]: I0609 15:20:08.242682 2575 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="e88ffeea-65a9-4fe0-a4e5-b298a11a8e5d" containerName="alertmanager" Jun 09 15:20:08.242731 ip-10-0-130-232 kubenswrapper[2575]: I0609 15:20:08.242695 2575 state_mem.go:107] "Deleted CPUSet assignment" podUID="e88ffeea-65a9-4fe0-a4e5-b298a11a8e5d" containerName="alertmanager" Jun 09 15:20:08.242731 ip-10-0-130-232 kubenswrapper[2575]: I0609 15:20:08.242703 2575 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="e88ffeea-65a9-4fe0-a4e5-b298a11a8e5d" containerName="kube-rbac-proxy-web" Jun 09 15:20:08.242731 ip-10-0-130-232 kubenswrapper[2575]: I0609 15:20:08.242709 2575 state_mem.go:107] "Deleted CPUSet assignment" podUID="e88ffeea-65a9-4fe0-a4e5-b298a11a8e5d" containerName="kube-rbac-proxy-web" Jun 09 15:20:08.242731 ip-10-0-130-232 kubenswrapper[2575]: I0609 15:20:08.242717 2575 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="e88ffeea-65a9-4fe0-a4e5-b298a11a8e5d" containerName="prom-label-proxy" Jun 09 15:20:08.242731 ip-10-0-130-232 kubenswrapper[2575]: I0609 15:20:08.242722 2575 state_mem.go:107] "Deleted CPUSet assignment" podUID="e88ffeea-65a9-4fe0-a4e5-b298a11a8e5d" containerName="prom-label-proxy" Jun 09 15:20:08.242731 ip-10-0-130-232 kubenswrapper[2575]: I0609 15:20:08.242728 2575 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="e88ffeea-65a9-4fe0-a4e5-b298a11a8e5d" containerName="init-config-reloader" Jun 09 15:20:08.242731 ip-10-0-130-232 kubenswrapper[2575]: I0609 15:20:08.242733 2575 state_mem.go:107] "Deleted CPUSet assignment" podUID="e88ffeea-65a9-4fe0-a4e5-b298a11a8e5d" containerName="init-config-reloader" Jun 09 15:20:08.243006 ip-10-0-130-232 kubenswrapper[2575]: I0609 15:20:08.242740 2575 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="e88ffeea-65a9-4fe0-a4e5-b298a11a8e5d" containerName="kube-rbac-proxy-metric" Jun 09 15:20:08.243006 ip-10-0-130-232 kubenswrapper[2575]: I0609 15:20:08.242745 2575 state_mem.go:107] "Deleted CPUSet assignment" podUID="e88ffeea-65a9-4fe0-a4e5-b298a11a8e5d" containerName="kube-rbac-proxy-metric" Jun 09 15:20:08.243006 ip-10-0-130-232 kubenswrapper[2575]: I0609 15:20:08.242759 2575 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="e88ffeea-65a9-4fe0-a4e5-b298a11a8e5d" containerName="config-reloader" Jun 09 15:20:08.243006 ip-10-0-130-232 kubenswrapper[2575]: I0609 15:20:08.242764 2575 state_mem.go:107] "Deleted CPUSet assignment" podUID="e88ffeea-65a9-4fe0-a4e5-b298a11a8e5d" containerName="config-reloader" Jun 09 15:20:08.243006 ip-10-0-130-232 kubenswrapper[2575]: I0609 15:20:08.242802 2575 memory_manager.go:368] "RemoveStaleState removing state" podUID="e88ffeea-65a9-4fe0-a4e5-b298a11a8e5d" containerName="kube-rbac-proxy-metric" Jun 09 15:20:08.243006 ip-10-0-130-232 kubenswrapper[2575]: I0609 15:20:08.242810 2575 memory_manager.go:368] "RemoveStaleState removing state" podUID="e88ffeea-65a9-4fe0-a4e5-b298a11a8e5d" containerName="kube-rbac-proxy-web" Jun 09 15:20:08.243006 ip-10-0-130-232 kubenswrapper[2575]: I0609 15:20:08.242816 2575 memory_manager.go:368] "RemoveStaleState removing state" podUID="e88ffeea-65a9-4fe0-a4e5-b298a11a8e5d" containerName="kube-rbac-proxy" Jun 09 15:20:08.243006 ip-10-0-130-232 kubenswrapper[2575]: I0609 15:20:08.242820 2575 memory_manager.go:368] "RemoveStaleState removing state" podUID="e88ffeea-65a9-4fe0-a4e5-b298a11a8e5d" containerName="prom-label-proxy" Jun 09 15:20:08.243006 ip-10-0-130-232 kubenswrapper[2575]: I0609 15:20:08.242826 2575 memory_manager.go:368] "RemoveStaleState removing state" podUID="e88ffeea-65a9-4fe0-a4e5-b298a11a8e5d" containerName="alertmanager" Jun 09 15:20:08.243006 ip-10-0-130-232 kubenswrapper[2575]: I0609 15:20:08.242831 2575 memory_manager.go:368] "RemoveStaleState removing state" podUID="e88ffeea-65a9-4fe0-a4e5-b298a11a8e5d" containerName="config-reloader" Jun 09 15:20:08.247834 ip-10-0-130-232 kubenswrapper[2575]: I0609 15:20:08.247819 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0" Jun 09 15:20:08.253031 ip-10-0-130-232 kubenswrapper[2575]: I0609 15:20:08.253012 2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-web-config\"" Jun 09 15:20:08.253125 ip-10-0-130-232 kubenswrapper[2575]: I0609 15:20:08.253031 2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-cluster-tls-config\"" Jun 09 15:20:08.253408 ip-10-0-130-232 kubenswrapper[2575]: I0609 15:20:08.253372 2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-tls-assets-0\"" Jun 09 15:20:08.253408 ip-10-0-130-232 kubenswrapper[2575]: I0609 15:20:08.253387 2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-generated\"" Jun 09 15:20:08.253555 ip-10-0-130-232 kubenswrapper[2575]: I0609 15:20:08.253496 2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy\"" Jun 09 15:20:08.253894 ip-10-0-130-232 kubenswrapper[2575]: I0609 15:20:08.253863 2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-dockercfg-f59l6\"" Jun 09 15:20:08.254159 ip-10-0-130-232 kubenswrapper[2575]: I0609 15:20:08.254054 2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-tls\"" Jun 09 15:20:08.254159 ip-10-0-130-232 kubenswrapper[2575]: I0609 15:20:08.254111 2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy-metric\"" Jun 09 15:20:08.254490 ip-10-0-130-232 kubenswrapper[2575]: I0609 15:20:08.254474 2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy-web\"" Jun 09 15:20:08.259895 ip-10-0-130-232 kubenswrapper[2575]: I0609 15:20:08.259877 2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"alertmanager-trusted-ca-bundle\"" Jun 09 15:20:08.264547 ip-10-0-130-232 kubenswrapper[2575]: I0609 15:20:08.264526 2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Jun 09 15:20:08.414812 ip-10-0-130-232 kubenswrapper[2575]: I0609 15:20:08.414778 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/d4e2d518-b0e2-443a-9e10-d6ae693e7320-web-config\") pod \"alertmanager-main-0\" (UID: \"d4e2d518-b0e2-443a-9e10-d6ae693e7320\") " pod="openshift-monitoring/alertmanager-main-0" Jun 09 15:20:08.414972 ip-10-0-130-232 kubenswrapper[2575]: I0609 15:20:08.414821 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/d4e2d518-b0e2-443a-9e10-d6ae693e7320-config-out\") pod \"alertmanager-main-0\" (UID: \"d4e2d518-b0e2-443a-9e10-d6ae693e7320\") " pod="openshift-monitoring/alertmanager-main-0" Jun 09 15:20:08.414972 ip-10-0-130-232 kubenswrapper[2575]: I0609 15:20:08.414871 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/d4e2d518-b0e2-443a-9e10-d6ae693e7320-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"d4e2d518-b0e2-443a-9e10-d6ae693e7320\") " pod="openshift-monitoring/alertmanager-main-0" Jun 09 15:20:08.414972 ip-10-0-130-232 kubenswrapper[2575]: I0609 15:20:08.414898 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/d4e2d518-b0e2-443a-9e10-d6ae693e7320-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"d4e2d518-b0e2-443a-9e10-d6ae693e7320\") " pod="openshift-monitoring/alertmanager-main-0" Jun 09 15:20:08.414972 ip-10-0-130-232 kubenswrapper[2575]: I0609 15:20:08.414936 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/d4e2d518-b0e2-443a-9e10-d6ae693e7320-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"d4e2d518-b0e2-443a-9e10-d6ae693e7320\") " pod="openshift-monitoring/alertmanager-main-0" Jun 09 15:20:08.414972 ip-10-0-130-232 kubenswrapper[2575]: I0609 15:20:08.414954 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/d4e2d518-b0e2-443a-9e10-d6ae693e7320-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"d4e2d518-b0e2-443a-9e10-d6ae693e7320\") " pod="openshift-monitoring/alertmanager-main-0" Jun 09 15:20:08.414972 ip-10-0-130-232 kubenswrapper[2575]: I0609 15:20:08.414972 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/d4e2d518-b0e2-443a-9e10-d6ae693e7320-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"d4e2d518-b0e2-443a-9e10-d6ae693e7320\") " pod="openshift-monitoring/alertmanager-main-0" Jun 09 15:20:08.415167 ip-10-0-130-232 kubenswrapper[2575]: I0609 15:20:08.415002 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-h45c6\" (UniqueName: \"kubernetes.io/projected/d4e2d518-b0e2-443a-9e10-d6ae693e7320-kube-api-access-h45c6\") pod \"alertmanager-main-0\" (UID: \"d4e2d518-b0e2-443a-9e10-d6ae693e7320\") " pod="openshift-monitoring/alertmanager-main-0" Jun 09 15:20:08.415167 ip-10-0-130-232 kubenswrapper[2575]: I0609 15:20:08.415018 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/d4e2d518-b0e2-443a-9e10-d6ae693e7320-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"d4e2d518-b0e2-443a-9e10-d6ae693e7320\") " pod="openshift-monitoring/alertmanager-main-0" Jun 09 15:20:08.415167 ip-10-0-130-232 kubenswrapper[2575]: I0609 15:20:08.415032 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/d4e2d518-b0e2-443a-9e10-d6ae693e7320-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"d4e2d518-b0e2-443a-9e10-d6ae693e7320\") " pod="openshift-monitoring/alertmanager-main-0" Jun 09 15:20:08.415167 ip-10-0-130-232 kubenswrapper[2575]: I0609 15:20:08.415048 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/d4e2d518-b0e2-443a-9e10-d6ae693e7320-config-volume\") pod \"alertmanager-main-0\" (UID: \"d4e2d518-b0e2-443a-9e10-d6ae693e7320\") " pod="openshift-monitoring/alertmanager-main-0" Jun 09 15:20:08.415167 ip-10-0-130-232 kubenswrapper[2575]: I0609 15:20:08.415105 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/d4e2d518-b0e2-443a-9e10-d6ae693e7320-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"d4e2d518-b0e2-443a-9e10-d6ae693e7320\") " pod="openshift-monitoring/alertmanager-main-0" Jun 09 15:20:08.415167 ip-10-0-130-232 kubenswrapper[2575]: I0609 15:20:08.415143 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/d4e2d518-b0e2-443a-9e10-d6ae693e7320-tls-assets\") pod \"alertmanager-main-0\" (UID: \"d4e2d518-b0e2-443a-9e10-d6ae693e7320\") " pod="openshift-monitoring/alertmanager-main-0" Jun 09 15:20:08.515887 ip-10-0-130-232 kubenswrapper[2575]: I0609 15:20:08.515781 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/d4e2d518-b0e2-443a-9e10-d6ae693e7320-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"d4e2d518-b0e2-443a-9e10-d6ae693e7320\") " pod="openshift-monitoring/alertmanager-main-0" Jun 09 15:20:08.515887 ip-10-0-130-232 kubenswrapper[2575]: I0609 15:20:08.515827 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/d4e2d518-b0e2-443a-9e10-d6ae693e7320-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"d4e2d518-b0e2-443a-9e10-d6ae693e7320\") " pod="openshift-monitoring/alertmanager-main-0" Jun 09 15:20:08.515887 ip-10-0-130-232 kubenswrapper[2575]: I0609 15:20:08.515872 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/d4e2d518-b0e2-443a-9e10-d6ae693e7320-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"d4e2d518-b0e2-443a-9e10-d6ae693e7320\") " pod="openshift-monitoring/alertmanager-main-0" Jun 09 15:20:08.516157 ip-10-0-130-232 kubenswrapper[2575]: I0609 15:20:08.515892 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/d4e2d518-b0e2-443a-9e10-d6ae693e7320-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"d4e2d518-b0e2-443a-9e10-d6ae693e7320\") " pod="openshift-monitoring/alertmanager-main-0" Jun 09 15:20:08.516157 ip-10-0-130-232 kubenswrapper[2575]: I0609 15:20:08.515915 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/d4e2d518-b0e2-443a-9e10-d6ae693e7320-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"d4e2d518-b0e2-443a-9e10-d6ae693e7320\") " pod="openshift-monitoring/alertmanager-main-0" Jun 09 15:20:08.516157 ip-10-0-130-232 kubenswrapper[2575]: I0609 15:20:08.515941 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-h45c6\" (UniqueName: \"kubernetes.io/projected/d4e2d518-b0e2-443a-9e10-d6ae693e7320-kube-api-access-h45c6\") pod \"alertmanager-main-0\" (UID: \"d4e2d518-b0e2-443a-9e10-d6ae693e7320\") " pod="openshift-monitoring/alertmanager-main-0" Jun 09 15:20:08.516157 ip-10-0-130-232 kubenswrapper[2575]: I0609 15:20:08.515966 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/d4e2d518-b0e2-443a-9e10-d6ae693e7320-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"d4e2d518-b0e2-443a-9e10-d6ae693e7320\") " pod="openshift-monitoring/alertmanager-main-0" Jun 09 15:20:08.516157 ip-10-0-130-232 kubenswrapper[2575]: I0609 15:20:08.515988 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/d4e2d518-b0e2-443a-9e10-d6ae693e7320-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"d4e2d518-b0e2-443a-9e10-d6ae693e7320\") " pod="openshift-monitoring/alertmanager-main-0" Jun 09 15:20:08.516157 ip-10-0-130-232 kubenswrapper[2575]: I0609 15:20:08.516014 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/d4e2d518-b0e2-443a-9e10-d6ae693e7320-config-volume\") pod \"alertmanager-main-0\" (UID: \"d4e2d518-b0e2-443a-9e10-d6ae693e7320\") " pod="openshift-monitoring/alertmanager-main-0" Jun 09 15:20:08.516157 ip-10-0-130-232 kubenswrapper[2575]: I0609 15:20:08.516046 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/d4e2d518-b0e2-443a-9e10-d6ae693e7320-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"d4e2d518-b0e2-443a-9e10-d6ae693e7320\") " pod="openshift-monitoring/alertmanager-main-0" Jun 09 15:20:08.516157 ip-10-0-130-232 kubenswrapper[2575]: I0609 15:20:08.516087 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/d4e2d518-b0e2-443a-9e10-d6ae693e7320-tls-assets\") pod \"alertmanager-main-0\" (UID: \"d4e2d518-b0e2-443a-9e10-d6ae693e7320\") " pod="openshift-monitoring/alertmanager-main-0" Jun 09 15:20:08.516157 ip-10-0-130-232 kubenswrapper[2575]: I0609 15:20:08.516111 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/d4e2d518-b0e2-443a-9e10-d6ae693e7320-web-config\") pod \"alertmanager-main-0\" (UID: \"d4e2d518-b0e2-443a-9e10-d6ae693e7320\") " pod="openshift-monitoring/alertmanager-main-0" Jun 09 15:20:08.516470 ip-10-0-130-232 kubenswrapper[2575]: I0609 15:20:08.516161 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/d4e2d518-b0e2-443a-9e10-d6ae693e7320-config-out\") pod \"alertmanager-main-0\" (UID: \"d4e2d518-b0e2-443a-9e10-d6ae693e7320\") " pod="openshift-monitoring/alertmanager-main-0" Jun 09 15:20:08.516580 ip-10-0-130-232 kubenswrapper[2575]: I0609 15:20:08.516533 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/d4e2d518-b0e2-443a-9e10-d6ae693e7320-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"d4e2d518-b0e2-443a-9e10-d6ae693e7320\") " pod="openshift-monitoring/alertmanager-main-0" Jun 09 15:20:08.516694 ip-10-0-130-232 kubenswrapper[2575]: I0609 15:20:08.516609 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/d4e2d518-b0e2-443a-9e10-d6ae693e7320-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"d4e2d518-b0e2-443a-9e10-d6ae693e7320\") " pod="openshift-monitoring/alertmanager-main-0" Jun 09 15:20:08.516754 ip-10-0-130-232 kubenswrapper[2575]: I0609 15:20:08.516730 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/d4e2d518-b0e2-443a-9e10-d6ae693e7320-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"d4e2d518-b0e2-443a-9e10-d6ae693e7320\") " pod="openshift-monitoring/alertmanager-main-0" Jun 09 15:20:08.519323 ip-10-0-130-232 kubenswrapper[2575]: I0609 15:20:08.519288 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/d4e2d518-b0e2-443a-9e10-d6ae693e7320-config-out\") pod \"alertmanager-main-0\" (UID: \"d4e2d518-b0e2-443a-9e10-d6ae693e7320\") " pod="openshift-monitoring/alertmanager-main-0" Jun 09 15:20:08.519724 ip-10-0-130-232 kubenswrapper[2575]: I0609 15:20:08.519524 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/d4e2d518-b0e2-443a-9e10-d6ae693e7320-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"d4e2d518-b0e2-443a-9e10-d6ae693e7320\") " pod="openshift-monitoring/alertmanager-main-0" Jun 09 15:20:08.519724 ip-10-0-130-232 kubenswrapper[2575]: I0609 15:20:08.519621 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/d4e2d518-b0e2-443a-9e10-d6ae693e7320-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"d4e2d518-b0e2-443a-9e10-d6ae693e7320\") " pod="openshift-monitoring/alertmanager-main-0" Jun 09 15:20:08.519724 ip-10-0-130-232 kubenswrapper[2575]: I0609 15:20:08.519708 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/d4e2d518-b0e2-443a-9e10-d6ae693e7320-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"d4e2d518-b0e2-443a-9e10-d6ae693e7320\") " pod="openshift-monitoring/alertmanager-main-0" Jun 09 15:20:08.519724 ip-10-0-130-232 kubenswrapper[2575]: I0609 15:20:08.519725 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/d4e2d518-b0e2-443a-9e10-d6ae693e7320-web-config\") pod \"alertmanager-main-0\" (UID: \"d4e2d518-b0e2-443a-9e10-d6ae693e7320\") " pod="openshift-monitoring/alertmanager-main-0" Jun 09 15:20:08.519996 ip-10-0-130-232 kubenswrapper[2575]: I0609 15:20:08.519715 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/d4e2d518-b0e2-443a-9e10-d6ae693e7320-config-volume\") pod \"alertmanager-main-0\" (UID: \"d4e2d518-b0e2-443a-9e10-d6ae693e7320\") " pod="openshift-monitoring/alertmanager-main-0" Jun 09 15:20:08.519996 ip-10-0-130-232 kubenswrapper[2575]: I0609 15:20:08.519913 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/d4e2d518-b0e2-443a-9e10-d6ae693e7320-tls-assets\") pod \"alertmanager-main-0\" (UID: \"d4e2d518-b0e2-443a-9e10-d6ae693e7320\") " pod="openshift-monitoring/alertmanager-main-0" Jun 09 15:20:08.519996 ip-10-0-130-232 kubenswrapper[2575]: I0609 15:20:08.519932 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/d4e2d518-b0e2-443a-9e10-d6ae693e7320-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"d4e2d518-b0e2-443a-9e10-d6ae693e7320\") " pod="openshift-monitoring/alertmanager-main-0" Jun 09 15:20:08.521407 ip-10-0-130-232 kubenswrapper[2575]: I0609 15:20:08.521391 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/d4e2d518-b0e2-443a-9e10-d6ae693e7320-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"d4e2d518-b0e2-443a-9e10-d6ae693e7320\") " pod="openshift-monitoring/alertmanager-main-0" Jun 09 15:20:08.526919 ip-10-0-130-232 kubenswrapper[2575]: I0609 15:20:08.526902 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-h45c6\" (UniqueName: \"kubernetes.io/projected/d4e2d518-b0e2-443a-9e10-d6ae693e7320-kube-api-access-h45c6\") pod \"alertmanager-main-0\" (UID: \"d4e2d518-b0e2-443a-9e10-d6ae693e7320\") " pod="openshift-monitoring/alertmanager-main-0" Jun 09 15:20:08.556817 ip-10-0-130-232 kubenswrapper[2575]: I0609 15:20:08.556780 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0" Jun 09 15:20:08.694584 ip-10-0-130-232 kubenswrapper[2575]: I0609 15:20:08.694550 2575 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="e88ffeea-65a9-4fe0-a4e5-b298a11a8e5d" path="/var/lib/kubelet/pods/e88ffeea-65a9-4fe0-a4e5-b298a11a8e5d/volumes" Jun 09 15:20:08.697944 ip-10-0-130-232 kubenswrapper[2575]: I0609 15:20:08.697923 2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Jun 09 15:20:08.699511 ip-10-0-130-232 kubenswrapper[2575]: W0609 15:20:08.699484 2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd4e2d518_b0e2_443a_9e10_d6ae693e7320.slice/crio-86dbc239ca3f9579c2e6eb99cb7be1e3cae9a6090aae3077a786839f361ecb19 WatchSource:0}: Error finding container 86dbc239ca3f9579c2e6eb99cb7be1e3cae9a6090aae3077a786839f361ecb19: Status 404 returned error can't find the container with id 86dbc239ca3f9579c2e6eb99cb7be1e3cae9a6090aae3077a786839f361ecb19 Jun 09 15:20:08.884706 ip-10-0-130-232 kubenswrapper[2575]: I0609 15:20:08.884675 2575 generic.go:356] "Generic (PLEG): container finished" podID="d4e2d518-b0e2-443a-9e10-d6ae693e7320" containerID="5819293a25db157c93993a0dc156278a84e6afcf63c0620b0bc9bd4a29b87e38" exitCode=0 Jun 09 15:20:08.885071 ip-10-0-130-232 kubenswrapper[2575]: I0609 15:20:08.884712 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"d4e2d518-b0e2-443a-9e10-d6ae693e7320","Type":"ContainerDied","Data":"5819293a25db157c93993a0dc156278a84e6afcf63c0620b0bc9bd4a29b87e38"} Jun 09 15:20:08.885071 ip-10-0-130-232 kubenswrapper[2575]: I0609 15:20:08.884790 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"d4e2d518-b0e2-443a-9e10-d6ae693e7320","Type":"ContainerStarted","Data":"86dbc239ca3f9579c2e6eb99cb7be1e3cae9a6090aae3077a786839f361ecb19"} Jun 09 15:20:09.644091 ip-10-0-130-232 kubenswrapper[2575]: I0609 15:20:09.644065 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2bkzp_41532b1e-300d-4a9e-a64f-da302213062c/konnectivity-agent/0.log" limit=1024 Jun 09 15:20:09.732711 ip-10-0-130-232 kubenswrapper[2575]: I0609 15:20:09.732681 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2bkzp_41532b1e-300d-4a9e-a64f-da302213062c/konnectivity-agent/0.log" limit=1024 Jun 09 15:20:09.892137 ip-10-0-130-232 kubenswrapper[2575]: I0609 15:20:09.892059 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"d4e2d518-b0e2-443a-9e10-d6ae693e7320","Type":"ContainerStarted","Data":"d7251a511567b2ed9da4ac7293ce75da578aa45761043e83e191d2a1d07d79ce"} Jun 09 15:20:09.892137 ip-10-0-130-232 kubenswrapper[2575]: I0609 15:20:09.892121 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"d4e2d518-b0e2-443a-9e10-d6ae693e7320","Type":"ContainerStarted","Data":"3723f874462e8b30bb94523cc474cd2e5a10124ca9c5c777daa8088671361d1b"} Jun 09 15:20:09.892521 ip-10-0-130-232 kubenswrapper[2575]: I0609 15:20:09.892147 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"d4e2d518-b0e2-443a-9e10-d6ae693e7320","Type":"ContainerStarted","Data":"6d5c0bf14f605e82a5baecbfaf394269b4a504649244ab8fbde2696b811cee7c"} Jun 09 15:20:09.892521 ip-10-0-130-232 kubenswrapper[2575]: I0609 15:20:09.892173 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"d4e2d518-b0e2-443a-9e10-d6ae693e7320","Type":"ContainerStarted","Data":"47048b6f4c93ea0a461a30ac2dc538ad9cd6c09bfcec706f6137d4bfb53df462"} Jun 09 15:20:09.892521 ip-10-0-130-232 kubenswrapper[2575]: I0609 15:20:09.892198 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"d4e2d518-b0e2-443a-9e10-d6ae693e7320","Type":"ContainerStarted","Data":"98c998dd9d5966f0fca304bad88108c624f801dc68c9aa31cf5a380f467ac136"} Jun 09 15:20:09.892521 ip-10-0-130-232 kubenswrapper[2575]: I0609 15:20:09.892224 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"d4e2d518-b0e2-443a-9e10-d6ae693e7320","Type":"ContainerStarted","Data":"9a6d05a5e137c327dc2da5464c3414452d03a7936f99b540cd8410c58e003067"} Jun 09 15:20:09.921523 ip-10-0-130-232 kubenswrapper[2575]: I0609 15:20:09.921470 2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/alertmanager-main-0" podStartSLOduration=1.9064107959999999 podStartE2EDuration="1.921455505s" totalImagesPullingTime="0s" totalInitContainerRuntime="15.044709ms" isStatefulPod=false podCreationTimestamp="2026-06-09 15:20:08 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-09 15:20:09.920754225 +0000 UTC m=+349.608759691" watchObservedRunningTime="2026-06-09 15:20:09.921455505 +0000 UTC m=+349.609460958" Jun 09 15:20:22.128242 ip-10-0-130-232 kubenswrapper[2575]: I0609 15:20:22.128197 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2bkzp_41532b1e-300d-4a9e-a64f-da302213062c/konnectivity-agent/0.log" limit=1024 Jun 09 15:20:22.197046 ip-10-0-130-232 kubenswrapper[2575]: I0609 15:20:22.197011 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2bkzp_41532b1e-300d-4a9e-a64f-da302213062c/konnectivity-agent/0.log" limit=1024 Jun 09 15:20:25.878991 ip-10-0-130-232 kubenswrapper[2575]: I0609 15:20:25.878955 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2bkzp_41532b1e-300d-4a9e-a64f-da302213062c/konnectivity-agent/0.log" limit=1024 Jun 09 15:20:25.980029 ip-10-0-130-232 kubenswrapper[2575]: I0609 15:20:25.979976 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2bkzp_41532b1e-300d-4a9e-a64f-da302213062c/konnectivity-agent/0.log" limit=1024 Jun 09 15:20:28.856123 ip-10-0-130-232 kubenswrapper[2575]: I0609 15:20:28.856086 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2bkzp_41532b1e-300d-4a9e-a64f-da302213062c/konnectivity-agent/0.log" limit=1024 Jun 09 15:20:28.916924 ip-10-0-130-232 kubenswrapper[2575]: I0609 15:20:28.916894 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2bkzp_41532b1e-300d-4a9e-a64f-da302213062c/konnectivity-agent/0.log" limit=1024 Jun 09 15:20:40.067107 ip-10-0-130-232 kubenswrapper[2575]: I0609 15:20:40.067063 2575 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-648b46694f-fjpfp"] Jun 09 15:20:40.207548 ip-10-0-130-232 kubenswrapper[2575]: I0609 15:20:40.207514 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2bkzp_41532b1e-300d-4a9e-a64f-da302213062c/konnectivity-agent/0.log" limit=1024 Jun 09 15:20:40.318357 ip-10-0-130-232 kubenswrapper[2575]: I0609 15:20:40.318273 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2bkzp_41532b1e-300d-4a9e-a64f-da302213062c/konnectivity-agent/0.log" limit=1024 Jun 09 15:20:40.438941 ip-10-0-130-232 kubenswrapper[2575]: I0609 15:20:40.438905 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2bkzp_41532b1e-300d-4a9e-a64f-da302213062c/konnectivity-agent/0.log" limit=1024 Jun 09 15:20:42.328303 ip-10-0-130-232 kubenswrapper[2575]: I0609 15:20:42.328272 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2bkzp_41532b1e-300d-4a9e-a64f-da302213062c/konnectivity-agent/0.log" limit=1024 Jun 09 15:20:57.729917 ip-10-0-130-232 kubenswrapper[2575]: I0609 15:20:57.729875 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2bkzp_41532b1e-300d-4a9e-a64f-da302213062c/konnectivity-agent/0.log" limit=1024 Jun 09 15:20:57.803410 ip-10-0-130-232 kubenswrapper[2575]: I0609 15:20:57.803385 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2bkzp_41532b1e-300d-4a9e-a64f-da302213062c/konnectivity-agent/0.log" limit=1024 Jun 09 15:21:05.087453 ip-10-0-130-232 kubenswrapper[2575]: I0609 15:21:05.087404 2575 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-console/console-648b46694f-fjpfp" podUID="2d40fe33-a48c-4b4a-a224-6cb8dceaaff7" containerName="console" containerID="cri-o://12e9c33a1e432db503c5910f612d410ace9d7d41f08c37bddae967c4176424ba" gracePeriod=15 Jun 09 15:21:05.148600 ip-10-0-130-232 kubenswrapper[2575]: I0609 15:21:05.148563 2575 patch_prober.go:28] interesting pod/console-648b46694f-fjpfp container/console namespace/openshift-console: Readiness probe status=failure output="Get \"https://10.133.0.17:8443/health\": dial tcp 10.133.0.17:8443: connect: connection refused" start-of-body= Jun 09 15:21:05.148759 ip-10-0-130-232 kubenswrapper[2575]: I0609 15:21:05.148621 2575 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-console/console-648b46694f-fjpfp" podUID="2d40fe33-a48c-4b4a-a224-6cb8dceaaff7" containerName="console" probeResult="failure" output="Get \"https://10.133.0.17:8443/health\": dial tcp 10.133.0.17:8443: connect: connection refused" Jun 09 15:21:05.327161 ip-10-0-130-232 kubenswrapper[2575]: I0609 15:21:05.327133 2575 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-648b46694f-fjpfp" Jun 09 15:21:05.473864 ip-10-0-130-232 kubenswrapper[2575]: I0609 15:21:05.473809 2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/2d40fe33-a48c-4b4a-a224-6cb8dceaaff7-oauth-serving-cert\") pod \"2d40fe33-a48c-4b4a-a224-6cb8dceaaff7\" (UID: \"2d40fe33-a48c-4b4a-a224-6cb8dceaaff7\") " Jun 09 15:21:05.474046 ip-10-0-130-232 kubenswrapper[2575]: I0609 15:21:05.473885 2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/2d40fe33-a48c-4b4a-a224-6cb8dceaaff7-console-config\") pod \"2d40fe33-a48c-4b4a-a224-6cb8dceaaff7\" (UID: \"2d40fe33-a48c-4b4a-a224-6cb8dceaaff7\") " Jun 09 15:21:05.474046 ip-10-0-130-232 kubenswrapper[2575]: I0609 15:21:05.473934 2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/2d40fe33-a48c-4b4a-a224-6cb8dceaaff7-trusted-ca-bundle\") pod \"2d40fe33-a48c-4b4a-a224-6cb8dceaaff7\" (UID: \"2d40fe33-a48c-4b4a-a224-6cb8dceaaff7\") " Jun 09 15:21:05.474046 ip-10-0-130-232 kubenswrapper[2575]: I0609 15:21:05.473976 2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/2d40fe33-a48c-4b4a-a224-6cb8dceaaff7-service-ca\") pod \"2d40fe33-a48c-4b4a-a224-6cb8dceaaff7\" (UID: \"2d40fe33-a48c-4b4a-a224-6cb8dceaaff7\") " Jun 09 15:21:05.474046 ip-10-0-130-232 kubenswrapper[2575]: I0609 15:21:05.474000 2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/2d40fe33-a48c-4b4a-a224-6cb8dceaaff7-console-serving-cert\") pod \"2d40fe33-a48c-4b4a-a224-6cb8dceaaff7\" (UID: \"2d40fe33-a48c-4b4a-a224-6cb8dceaaff7\") " Jun 09 15:21:05.474046 ip-10-0-130-232 kubenswrapper[2575]: I0609 15:21:05.474035 2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-k5hg5\" (UniqueName: \"kubernetes.io/projected/2d40fe33-a48c-4b4a-a224-6cb8dceaaff7-kube-api-access-k5hg5\") pod \"2d40fe33-a48c-4b4a-a224-6cb8dceaaff7\" (UID: \"2d40fe33-a48c-4b4a-a224-6cb8dceaaff7\") " Jun 09 15:21:05.474311 ip-10-0-130-232 kubenswrapper[2575]: I0609 15:21:05.474062 2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/2d40fe33-a48c-4b4a-a224-6cb8dceaaff7-console-oauth-config\") pod \"2d40fe33-a48c-4b4a-a224-6cb8dceaaff7\" (UID: \"2d40fe33-a48c-4b4a-a224-6cb8dceaaff7\") " Jun 09 15:21:05.474404 ip-10-0-130-232 kubenswrapper[2575]: I0609 15:21:05.474353 2575 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/2d40fe33-a48c-4b4a-a224-6cb8dceaaff7-console-config" (OuterVolumeSpecName: "console-config") pod "2d40fe33-a48c-4b4a-a224-6cb8dceaaff7" (UID: "2d40fe33-a48c-4b4a-a224-6cb8dceaaff7"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 09 15:21:05.474404 ip-10-0-130-232 kubenswrapper[2575]: I0609 15:21:05.474399 2575 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/2d40fe33-a48c-4b4a-a224-6cb8dceaaff7-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "2d40fe33-a48c-4b4a-a224-6cb8dceaaff7" (UID: "2d40fe33-a48c-4b4a-a224-6cb8dceaaff7"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 09 15:21:05.474584 ip-10-0-130-232 kubenswrapper[2575]: I0609 15:21:05.474513 2575 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/2d40fe33-a48c-4b4a-a224-6cb8dceaaff7-trusted-ca-bundle" (OuterVolumeSpecName: "trusted-ca-bundle") pod "2d40fe33-a48c-4b4a-a224-6cb8dceaaff7" (UID: "2d40fe33-a48c-4b4a-a224-6cb8dceaaff7"). InnerVolumeSpecName "trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 09 15:21:05.474584 ip-10-0-130-232 kubenswrapper[2575]: I0609 15:21:05.474512 2575 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/2d40fe33-a48c-4b4a-a224-6cb8dceaaff7-service-ca" (OuterVolumeSpecName: "service-ca") pod "2d40fe33-a48c-4b4a-a224-6cb8dceaaff7" (UID: "2d40fe33-a48c-4b4a-a224-6cb8dceaaff7"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 09 15:21:05.476425 ip-10-0-130-232 kubenswrapper[2575]: I0609 15:21:05.476404 2575 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/2d40fe33-a48c-4b4a-a224-6cb8dceaaff7-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "2d40fe33-a48c-4b4a-a224-6cb8dceaaff7" (UID: "2d40fe33-a48c-4b4a-a224-6cb8dceaaff7"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 09 15:21:05.476520 ip-10-0-130-232 kubenswrapper[2575]: I0609 15:21:05.476445 2575 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/2d40fe33-a48c-4b4a-a224-6cb8dceaaff7-kube-api-access-k5hg5" (OuterVolumeSpecName: "kube-api-access-k5hg5") pod "2d40fe33-a48c-4b4a-a224-6cb8dceaaff7" (UID: "2d40fe33-a48c-4b4a-a224-6cb8dceaaff7"). InnerVolumeSpecName "kube-api-access-k5hg5". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 09 15:21:05.476520 ip-10-0-130-232 kubenswrapper[2575]: I0609 15:21:05.476504 2575 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/2d40fe33-a48c-4b4a-a224-6cb8dceaaff7-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "2d40fe33-a48c-4b4a-a224-6cb8dceaaff7" (UID: "2d40fe33-a48c-4b4a-a224-6cb8dceaaff7"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 09 15:21:05.575558 ip-10-0-130-232 kubenswrapper[2575]: I0609 15:21:05.575517 2575 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-k5hg5\" (UniqueName: \"kubernetes.io/projected/2d40fe33-a48c-4b4a-a224-6cb8dceaaff7-kube-api-access-k5hg5\") on node \"ip-10-0-130-232.ec2.internal\" DevicePath \"\"" Jun 09 15:21:05.575558 ip-10-0-130-232 kubenswrapper[2575]: I0609 15:21:05.575556 2575 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/2d40fe33-a48c-4b4a-a224-6cb8dceaaff7-console-oauth-config\") on node \"ip-10-0-130-232.ec2.internal\" DevicePath \"\"" Jun 09 15:21:05.575558 ip-10-0-130-232 kubenswrapper[2575]: I0609 15:21:05.575568 2575 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/2d40fe33-a48c-4b4a-a224-6cb8dceaaff7-oauth-serving-cert\") on node \"ip-10-0-130-232.ec2.internal\" DevicePath \"\"" Jun 09 15:21:05.575807 ip-10-0-130-232 kubenswrapper[2575]: I0609 15:21:05.575581 2575 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/2d40fe33-a48c-4b4a-a224-6cb8dceaaff7-console-config\") on node \"ip-10-0-130-232.ec2.internal\" DevicePath \"\"" Jun 09 15:21:05.575807 ip-10-0-130-232 kubenswrapper[2575]: I0609 15:21:05.575593 2575 reconciler_common.go:299] "Volume detached for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/2d40fe33-a48c-4b4a-a224-6cb8dceaaff7-trusted-ca-bundle\") on node \"ip-10-0-130-232.ec2.internal\" DevicePath \"\"" Jun 09 15:21:05.575807 ip-10-0-130-232 kubenswrapper[2575]: I0609 15:21:05.575604 2575 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/2d40fe33-a48c-4b4a-a224-6cb8dceaaff7-service-ca\") on node \"ip-10-0-130-232.ec2.internal\" DevicePath \"\"" Jun 09 15:21:05.575807 ip-10-0-130-232 kubenswrapper[2575]: I0609 15:21:05.575616 2575 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/2d40fe33-a48c-4b4a-a224-6cb8dceaaff7-console-serving-cert\") on node \"ip-10-0-130-232.ec2.internal\" DevicePath \"\"" Jun 09 15:21:06.100202 ip-10-0-130-232 kubenswrapper[2575]: I0609 15:21:06.100169 2575 generic.go:356] "Generic (PLEG): container finished" podID="2d40fe33-a48c-4b4a-a224-6cb8dceaaff7" containerID="12e9c33a1e432db503c5910f612d410ace9d7d41f08c37bddae967c4176424ba" exitCode=0 Jun 09 15:21:06.100617 ip-10-0-130-232 kubenswrapper[2575]: I0609 15:21:06.100211 2575 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-648b46694f-fjpfp" Jun 09 15:21:06.100617 ip-10-0-130-232 kubenswrapper[2575]: I0609 15:21:06.100244 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-648b46694f-fjpfp" event={"ID":"2d40fe33-a48c-4b4a-a224-6cb8dceaaff7","Type":"ContainerDied","Data":"12e9c33a1e432db503c5910f612d410ace9d7d41f08c37bddae967c4176424ba"} Jun 09 15:21:06.100617 ip-10-0-130-232 kubenswrapper[2575]: I0609 15:21:06.100280 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-648b46694f-fjpfp" event={"ID":"2d40fe33-a48c-4b4a-a224-6cb8dceaaff7","Type":"ContainerDied","Data":"1d785c9c0ee30544d6ccd018c96f2d8383ee18b4adb44790ddfb8f4504f34863"} Jun 09 15:21:06.100617 ip-10-0-130-232 kubenswrapper[2575]: I0609 15:21:06.100299 2575 scope.go:117] "RemoveContainer" containerID="12e9c33a1e432db503c5910f612d410ace9d7d41f08c37bddae967c4176424ba" Jun 09 15:21:06.108781 ip-10-0-130-232 kubenswrapper[2575]: I0609 15:21:06.108763 2575 scope.go:117] "RemoveContainer" containerID="12e9c33a1e432db503c5910f612d410ace9d7d41f08c37bddae967c4176424ba" Jun 09 15:21:06.109049 ip-10-0-130-232 kubenswrapper[2575]: E0609 15:21:06.109029 2575 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"12e9c33a1e432db503c5910f612d410ace9d7d41f08c37bddae967c4176424ba\": container with ID starting with 12e9c33a1e432db503c5910f612d410ace9d7d41f08c37bddae967c4176424ba not found: ID does not exist" containerID="12e9c33a1e432db503c5910f612d410ace9d7d41f08c37bddae967c4176424ba" Jun 09 15:21:06.109107 ip-10-0-130-232 kubenswrapper[2575]: I0609 15:21:06.109056 2575 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"12e9c33a1e432db503c5910f612d410ace9d7d41f08c37bddae967c4176424ba"} err="failed to get container status \"12e9c33a1e432db503c5910f612d410ace9d7d41f08c37bddae967c4176424ba\": rpc error: code = NotFound desc = could not find container \"12e9c33a1e432db503c5910f612d410ace9d7d41f08c37bddae967c4176424ba\": container with ID starting with 12e9c33a1e432db503c5910f612d410ace9d7d41f08c37bddae967c4176424ba not found: ID does not exist" Jun 09 15:21:06.121831 ip-10-0-130-232 kubenswrapper[2575]: I0609 15:21:06.121809 2575 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-648b46694f-fjpfp"] Jun 09 15:21:06.127573 ip-10-0-130-232 kubenswrapper[2575]: I0609 15:21:06.127552 2575 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-648b46694f-fjpfp"] Jun 09 15:21:06.695198 ip-10-0-130-232 kubenswrapper[2575]: I0609 15:21:06.695153 2575 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="2d40fe33-a48c-4b4a-a224-6cb8dceaaff7" path="/var/lib/kubelet/pods/2d40fe33-a48c-4b4a-a224-6cb8dceaaff7/volumes" Jun 09 15:21:33.277833 ip-10-0-130-232 kubenswrapper[2575]: I0609 15:21:33.277798 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2bkzp_41532b1e-300d-4a9e-a64f-da302213062c/konnectivity-agent/0.log" limit=1024 Jun 09 15:21:33.383830 ip-10-0-130-232 kubenswrapper[2575]: I0609 15:21:33.383782 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2bkzp_41532b1e-300d-4a9e-a64f-da302213062c/konnectivity-agent/0.log" limit=1024 Jun 09 15:22:12.233040 ip-10-0-130-232 kubenswrapper[2575]: I0609 15:22:12.232960 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2bkzp_41532b1e-300d-4a9e-a64f-da302213062c/konnectivity-agent/0.log" limit=1024 Jun 09 15:22:12.329367 ip-10-0-130-232 kubenswrapper[2575]: I0609 15:22:12.329337 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2bkzp_41532b1e-300d-4a9e-a64f-da302213062c/konnectivity-agent/0.log" limit=1024 Jun 09 15:22:39.070170 ip-10-0-130-232 kubenswrapper[2575]: I0609 15:22:39.070141 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2bkzp_41532b1e-300d-4a9e-a64f-da302213062c/konnectivity-agent/0.log" limit=1024 Jun 09 15:22:40.009796 ip-10-0-130-232 kubenswrapper[2575]: I0609 15:22:40.009762 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2bkzp_41532b1e-300d-4a9e-a64f-da302213062c/konnectivity-agent/0.log" limit=1024 Jun 09 15:22:42.870062 ip-10-0-130-232 kubenswrapper[2575]: I0609 15:22:42.870031 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2bkzp_41532b1e-300d-4a9e-a64f-da302213062c/konnectivity-agent/0.log" limit=1024 Jun 09 15:22:42.929223 ip-10-0-130-232 kubenswrapper[2575]: I0609 15:22:42.929198 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2bkzp_41532b1e-300d-4a9e-a64f-da302213062c/konnectivity-agent/0.log" limit=1024 Jun 09 15:22:44.990183 ip-10-0-130-232 kubenswrapper[2575]: I0609 15:22:44.990150 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2bkzp_41532b1e-300d-4a9e-a64f-da302213062c/konnectivity-agent/0.log" limit=1024 Jun 09 15:22:45.128091 ip-10-0-130-232 kubenswrapper[2575]: I0609 15:22:45.128054 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2bkzp_41532b1e-300d-4a9e-a64f-da302213062c/konnectivity-agent/0.log" limit=1024 Jun 09 15:22:46.221385 ip-10-0-130-232 kubenswrapper[2575]: I0609 15:22:46.221355 2575 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["cert-manager/cert-manager-webhook-7dc76cbb94-swxks"] Jun 09 15:22:46.221749 ip-10-0-130-232 kubenswrapper[2575]: I0609 15:22:46.221626 2575 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="2d40fe33-a48c-4b4a-a224-6cb8dceaaff7" containerName="console" Jun 09 15:22:46.221749 ip-10-0-130-232 kubenswrapper[2575]: I0609 15:22:46.221636 2575 state_mem.go:107] "Deleted CPUSet assignment" podUID="2d40fe33-a48c-4b4a-a224-6cb8dceaaff7" containerName="console" Jun 09 15:22:46.221749 ip-10-0-130-232 kubenswrapper[2575]: I0609 15:22:46.221683 2575 memory_manager.go:368] "RemoveStaleState removing state" podUID="2d40fe33-a48c-4b4a-a224-6cb8dceaaff7" containerName="console" Jun 09 15:22:46.224387 ip-10-0-130-232 kubenswrapper[2575]: I0609 15:22:46.224371 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-webhook-7dc76cbb94-swxks" Jun 09 15:22:46.229794 ip-10-0-130-232 kubenswrapper[2575]: I0609 15:22:46.229762 2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager\"/\"openshift-service-ca.crt\"" Jun 09 15:22:46.229961 ip-10-0-130-232 kubenswrapper[2575]: I0609 15:22:46.229927 2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager\"/\"kube-root-ca.crt\"" Jun 09 15:22:46.237212 ip-10-0-130-232 kubenswrapper[2575]: I0609 15:22:46.237183 2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-webhook-7dc76cbb94-swxks"] Jun 09 15:22:46.354151 ip-10-0-130-232 kubenswrapper[2575]: I0609 15:22:46.354111 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8vrgx\" (UniqueName: \"kubernetes.io/projected/ee1b6f51-0644-44e7-bf8e-1473be87b643-kube-api-access-8vrgx\") pod \"cert-manager-webhook-7dc76cbb94-swxks\" (UID: \"ee1b6f51-0644-44e7-bf8e-1473be87b643\") " pod="cert-manager/cert-manager-webhook-7dc76cbb94-swxks" Jun 09 15:22:46.354306 ip-10-0-130-232 kubenswrapper[2575]: I0609 15:22:46.354229 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/ee1b6f51-0644-44e7-bf8e-1473be87b643-bound-sa-token\") pod \"cert-manager-webhook-7dc76cbb94-swxks\" (UID: \"ee1b6f51-0644-44e7-bf8e-1473be87b643\") " pod="cert-manager/cert-manager-webhook-7dc76cbb94-swxks" Jun 09 15:22:46.455003 ip-10-0-130-232 kubenswrapper[2575]: I0609 15:22:46.454966 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/ee1b6f51-0644-44e7-bf8e-1473be87b643-bound-sa-token\") pod \"cert-manager-webhook-7dc76cbb94-swxks\" (UID: \"ee1b6f51-0644-44e7-bf8e-1473be87b643\") " pod="cert-manager/cert-manager-webhook-7dc76cbb94-swxks" Jun 09 15:22:46.455183 ip-10-0-130-232 kubenswrapper[2575]: I0609 15:22:46.455035 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8vrgx\" (UniqueName: \"kubernetes.io/projected/ee1b6f51-0644-44e7-bf8e-1473be87b643-kube-api-access-8vrgx\") pod \"cert-manager-webhook-7dc76cbb94-swxks\" (UID: \"ee1b6f51-0644-44e7-bf8e-1473be87b643\") " pod="cert-manager/cert-manager-webhook-7dc76cbb94-swxks" Jun 09 15:22:46.464458 ip-10-0-130-232 kubenswrapper[2575]: I0609 15:22:46.464432 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-8vrgx\" (UniqueName: \"kubernetes.io/projected/ee1b6f51-0644-44e7-bf8e-1473be87b643-kube-api-access-8vrgx\") pod \"cert-manager-webhook-7dc76cbb94-swxks\" (UID: \"ee1b6f51-0644-44e7-bf8e-1473be87b643\") " pod="cert-manager/cert-manager-webhook-7dc76cbb94-swxks" Jun 09 15:22:46.464458 ip-10-0-130-232 kubenswrapper[2575]: I0609 15:22:46.464446 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/ee1b6f51-0644-44e7-bf8e-1473be87b643-bound-sa-token\") pod \"cert-manager-webhook-7dc76cbb94-swxks\" (UID: \"ee1b6f51-0644-44e7-bf8e-1473be87b643\") " pod="cert-manager/cert-manager-webhook-7dc76cbb94-swxks" Jun 09 15:22:46.533461 ip-10-0-130-232 kubenswrapper[2575]: I0609 15:22:46.533379 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-webhook-7dc76cbb94-swxks" Jun 09 15:22:46.664561 ip-10-0-130-232 kubenswrapper[2575]: I0609 15:22:46.664535 2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-webhook-7dc76cbb94-swxks"] Jun 09 15:22:46.667336 ip-10-0-130-232 kubenswrapper[2575]: W0609 15:22:46.667312 2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podee1b6f51_0644_44e7_bf8e_1473be87b643.slice/crio-2eb0d28afec1ceb56e90136a16940a2bc95857ae405fd798f01c62050535c215 WatchSource:0}: Error finding container 2eb0d28afec1ceb56e90136a16940a2bc95857ae405fd798f01c62050535c215: Status 404 returned error can't find the container with id 2eb0d28afec1ceb56e90136a16940a2bc95857ae405fd798f01c62050535c215 Jun 09 15:22:46.669524 ip-10-0-130-232 kubenswrapper[2575]: I0609 15:22:46.669509 2575 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jun 09 15:22:47.462745 ip-10-0-130-232 kubenswrapper[2575]: I0609 15:22:47.462708 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-webhook-7dc76cbb94-swxks" event={"ID":"ee1b6f51-0644-44e7-bf8e-1473be87b643","Type":"ContainerStarted","Data":"2eb0d28afec1ceb56e90136a16940a2bc95857ae405fd798f01c62050535c215"} Jun 09 15:22:48.419608 ip-10-0-130-232 kubenswrapper[2575]: I0609 15:22:48.419569 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2bkzp_41532b1e-300d-4a9e-a64f-da302213062c/konnectivity-agent/0.log" limit=1024 Jun 09 15:22:48.603395 ip-10-0-130-232 kubenswrapper[2575]: I0609 15:22:48.603356 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2bkzp_41532b1e-300d-4a9e-a64f-da302213062c/konnectivity-agent/0.log" limit=1024 Jun 09 15:22:49.870513 ip-10-0-130-232 kubenswrapper[2575]: I0609 15:22:49.870478 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2bkzp_41532b1e-300d-4a9e-a64f-da302213062c/konnectivity-agent/0.log" limit=1024 Jun 09 15:22:49.970415 ip-10-0-130-232 kubenswrapper[2575]: I0609 15:22:49.970385 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2bkzp_41532b1e-300d-4a9e-a64f-da302213062c/konnectivity-agent/0.log" limit=1024 Jun 09 15:22:50.476686 ip-10-0-130-232 kubenswrapper[2575]: I0609 15:22:50.476651 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-webhook-7dc76cbb94-swxks" event={"ID":"ee1b6f51-0644-44e7-bf8e-1473be87b643","Type":"ContainerStarted","Data":"ca49b5990bac966b295538050122f42bb57732b67aa12e3ceca222d113f63826"} Jun 09 15:22:50.476902 ip-10-0-130-232 kubenswrapper[2575]: I0609 15:22:50.476722 2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="cert-manager/cert-manager-webhook-7dc76cbb94-swxks" Jun 09 15:22:50.515252 ip-10-0-130-232 kubenswrapper[2575]: I0609 15:22:50.515207 2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="cert-manager/cert-manager-webhook-7dc76cbb94-swxks" podStartSLOduration=1.220803782 podStartE2EDuration="4.515191561s" totalImagesPullingTime="3.294387779s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-09 15:22:46 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-09 15:22:50.51326083 +0000 UTC m=+510.201266274" watchObservedRunningTime="2026-06-09 15:22:50.515191561 +0000 UTC m=+510.203197014" Jun 09 15:22:54.246026 ip-10-0-130-232 kubenswrapper[2575]: I0609 15:22:54.245992 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2bkzp_41532b1e-300d-4a9e-a64f-da302213062c/konnectivity-agent/0.log" limit=1024 Jun 09 15:22:55.835944 ip-10-0-130-232 kubenswrapper[2575]: I0609 15:22:55.835904 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2bkzp_41532b1e-300d-4a9e-a64f-da302213062c/konnectivity-agent/0.log" limit=1024 Jun 09 15:22:56.483545 ip-10-0-130-232 kubenswrapper[2575]: I0609 15:22:56.483517 2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="cert-manager/cert-manager-webhook-7dc76cbb94-swxks" Jun 09 15:22:57.411419 ip-10-0-130-232 kubenswrapper[2575]: I0609 15:22:57.411383 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2bkzp_41532b1e-300d-4a9e-a64f-da302213062c/konnectivity-agent/0.log" limit=1024 Jun 09 15:22:57.563254 ip-10-0-130-232 kubenswrapper[2575]: I0609 15:22:57.563225 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2bkzp_41532b1e-300d-4a9e-a64f-da302213062c/konnectivity-agent/0.log" limit=1024 Jun 09 15:22:59.492272 ip-10-0-130-232 kubenswrapper[2575]: I0609 15:22:59.492238 2575 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["cert-manager/cert-manager-59c77684cc-fs6cp"] Jun 09 15:22:59.495519 ip-10-0-130-232 kubenswrapper[2575]: I0609 15:22:59.495503 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-59c77684cc-fs6cp" Jun 09 15:22:59.497360 ip-10-0-130-232 kubenswrapper[2575]: I0609 15:22:59.497337 2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"cert-manager\"/\"cert-manager-dockercfg-7lh28\"" Jun 09 15:22:59.503549 ip-10-0-130-232 kubenswrapper[2575]: I0609 15:22:59.503524 2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-59c77684cc-fs6cp"] Jun 09 15:22:59.559452 ip-10-0-130-232 kubenswrapper[2575]: I0609 15:22:59.559420 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/0c7f7a7b-00b1-4f3b-8e69-a5555a4c05ab-bound-sa-token\") pod \"cert-manager-59c77684cc-fs6cp\" (UID: \"0c7f7a7b-00b1-4f3b-8e69-a5555a4c05ab\") " pod="cert-manager/cert-manager-59c77684cc-fs6cp" Jun 09 15:22:59.559590 ip-10-0-130-232 kubenswrapper[2575]: I0609 15:22:59.559467 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-msr99\" (UniqueName: \"kubernetes.io/projected/0c7f7a7b-00b1-4f3b-8e69-a5555a4c05ab-kube-api-access-msr99\") pod \"cert-manager-59c77684cc-fs6cp\" (UID: \"0c7f7a7b-00b1-4f3b-8e69-a5555a4c05ab\") " pod="cert-manager/cert-manager-59c77684cc-fs6cp" Jun 09 15:22:59.659993 ip-10-0-130-232 kubenswrapper[2575]: I0609 15:22:59.659962 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/0c7f7a7b-00b1-4f3b-8e69-a5555a4c05ab-bound-sa-token\") pod \"cert-manager-59c77684cc-fs6cp\" (UID: \"0c7f7a7b-00b1-4f3b-8e69-a5555a4c05ab\") " pod="cert-manager/cert-manager-59c77684cc-fs6cp" Jun 09 15:22:59.660119 ip-10-0-130-232 kubenswrapper[2575]: I0609 15:22:59.660002 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-msr99\" (UniqueName: \"kubernetes.io/projected/0c7f7a7b-00b1-4f3b-8e69-a5555a4c05ab-kube-api-access-msr99\") pod \"cert-manager-59c77684cc-fs6cp\" (UID: \"0c7f7a7b-00b1-4f3b-8e69-a5555a4c05ab\") " pod="cert-manager/cert-manager-59c77684cc-fs6cp" Jun 09 15:22:59.668214 ip-10-0-130-232 kubenswrapper[2575]: I0609 15:22:59.668188 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/0c7f7a7b-00b1-4f3b-8e69-a5555a4c05ab-bound-sa-token\") pod \"cert-manager-59c77684cc-fs6cp\" (UID: \"0c7f7a7b-00b1-4f3b-8e69-a5555a4c05ab\") " pod="cert-manager/cert-manager-59c77684cc-fs6cp" Jun 09 15:22:59.668511 ip-10-0-130-232 kubenswrapper[2575]: I0609 15:22:59.668493 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-msr99\" (UniqueName: \"kubernetes.io/projected/0c7f7a7b-00b1-4f3b-8e69-a5555a4c05ab-kube-api-access-msr99\") pod \"cert-manager-59c77684cc-fs6cp\" (UID: \"0c7f7a7b-00b1-4f3b-8e69-a5555a4c05ab\") " pod="cert-manager/cert-manager-59c77684cc-fs6cp" Jun 09 15:22:59.805305 ip-10-0-130-232 kubenswrapper[2575]: I0609 15:22:59.805227 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-59c77684cc-fs6cp" Jun 09 15:22:59.928972 ip-10-0-130-232 kubenswrapper[2575]: I0609 15:22:59.928949 2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-59c77684cc-fs6cp"] Jun 09 15:22:59.931390 ip-10-0-130-232 kubenswrapper[2575]: W0609 15:22:59.931364 2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod0c7f7a7b_00b1_4f3b_8e69_a5555a4c05ab.slice/crio-d1094bbd85a0577ae085d1d0fae8016d55f271d5d886a3af47edb32c024959a6 WatchSource:0}: Error finding container d1094bbd85a0577ae085d1d0fae8016d55f271d5d886a3af47edb32c024959a6: Status 404 returned error can't find the container with id d1094bbd85a0577ae085d1d0fae8016d55f271d5d886a3af47edb32c024959a6 Jun 09 15:23:00.521149 ip-10-0-130-232 kubenswrapper[2575]: I0609 15:23:00.521119 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-59c77684cc-fs6cp" event={"ID":"0c7f7a7b-00b1-4f3b-8e69-a5555a4c05ab","Type":"ContainerStarted","Data":"aa570e969b1c9ebc9ab0b1e82dac330674fe089fa9e99abafb8d7f99580a0518"} Jun 09 15:23:00.521149 ip-10-0-130-232 kubenswrapper[2575]: I0609 15:23:00.521155 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-59c77684cc-fs6cp" event={"ID":"0c7f7a7b-00b1-4f3b-8e69-a5555a4c05ab","Type":"ContainerStarted","Data":"d1094bbd85a0577ae085d1d0fae8016d55f271d5d886a3af47edb32c024959a6"} Jun 09 15:23:00.537189 ip-10-0-130-232 kubenswrapper[2575]: I0609 15:23:00.537138 2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="cert-manager/cert-manager-59c77684cc-fs6cp" podStartSLOduration=1.537124419 podStartE2EDuration="1.537124419s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-09 15:22:59 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-09 15:23:00.53588803 +0000 UTC m=+520.223893480" watchObservedRunningTime="2026-06-09 15:23:00.537124419 +0000 UTC m=+520.225129872" Jun 09 15:23:03.342794 ip-10-0-130-232 kubenswrapper[2575]: I0609 15:23:03.342760 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2bkzp_41532b1e-300d-4a9e-a64f-da302213062c/konnectivity-agent/0.log" limit=1024 Jun 09 15:23:03.443175 ip-10-0-130-232 kubenswrapper[2575]: I0609 15:23:03.443140 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2bkzp_41532b1e-300d-4a9e-a64f-da302213062c/konnectivity-agent/0.log" limit=1024 Jun 09 15:23:05.463060 ip-10-0-130-232 kubenswrapper[2575]: I0609 15:23:05.463024 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2bkzp_41532b1e-300d-4a9e-a64f-da302213062c/konnectivity-agent/0.log" limit=1024 Jun 09 15:23:05.654295 ip-10-0-130-232 kubenswrapper[2575]: I0609 15:23:05.654254 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2bkzp_41532b1e-300d-4a9e-a64f-da302213062c/konnectivity-agent/0.log" limit=1024 Jun 09 15:23:05.706417 ip-10-0-130-232 kubenswrapper[2575]: I0609 15:23:05.706385 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2bkzp_41532b1e-300d-4a9e-a64f-da302213062c/konnectivity-agent/0.log" limit=1024 Jun 09 15:23:07.798658 ip-10-0-130-232 kubenswrapper[2575]: I0609 15:23:07.798620 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2bkzp_41532b1e-300d-4a9e-a64f-da302213062c/konnectivity-agent/0.log" limit=1024 Jun 09 15:23:07.899807 ip-10-0-130-232 kubenswrapper[2575]: I0609 15:23:07.899773 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2bkzp_41532b1e-300d-4a9e-a64f-da302213062c/konnectivity-agent/0.log" limit=1024 Jun 09 15:23:19.715674 ip-10-0-130-232 kubenswrapper[2575]: I0609 15:23:19.715641 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2bkzp_41532b1e-300d-4a9e-a64f-da302213062c/konnectivity-agent/0.log" limit=1024 Jun 09 15:23:19.812541 ip-10-0-130-232 kubenswrapper[2575]: I0609 15:23:19.812509 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2bkzp_41532b1e-300d-4a9e-a64f-da302213062c/konnectivity-agent/0.log" limit=1024 Jun 09 15:23:20.754948 ip-10-0-130-232 kubenswrapper[2575]: I0609 15:23:20.754917 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2bkzp_41532b1e-300d-4a9e-a64f-da302213062c/konnectivity-agent/0.log" limit=1024 Jun 09 15:23:20.851386 ip-10-0-130-232 kubenswrapper[2575]: I0609 15:23:20.851350 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2bkzp_41532b1e-300d-4a9e-a64f-da302213062c/konnectivity-agent/0.log" limit=1024 Jun 09 15:23:21.512815 ip-10-0-130-232 kubenswrapper[2575]: I0609 15:23:21.512784 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2bkzp_41532b1e-300d-4a9e-a64f-da302213062c/konnectivity-agent/0.log" limit=1024 Jun 09 15:23:21.769601 ip-10-0-130-232 kubenswrapper[2575]: I0609 15:23:21.769526 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2bkzp_41532b1e-300d-4a9e-a64f-da302213062c/konnectivity-agent/0.log" limit=1024 Jun 09 15:23:21.867329 ip-10-0-130-232 kubenswrapper[2575]: I0609 15:23:21.867301 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2bkzp_41532b1e-300d-4a9e-a64f-da302213062c/konnectivity-agent/0.log" limit=1024 Jun 09 15:23:21.927678 ip-10-0-130-232 kubenswrapper[2575]: I0609 15:23:21.927649 2575 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-f5f495f5c-dvnkh"] Jun 09 15:23:21.931068 ip-10-0-130-232 kubenswrapper[2575]: I0609 15:23:21.931047 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-f5f495f5c-dvnkh" Jun 09 15:23:21.933294 ip-10-0-130-232 kubenswrapper[2575]: I0609 15:23:21.933274 2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-webhook-cert\"" Jun 09 15:23:21.933392 ip-10-0-130-232 kubenswrapper[2575]: I0609 15:23:21.933276 2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-service-cert\"" Jun 09 15:23:21.934008 ip-10-0-130-232 kubenswrapper[2575]: I0609 15:23:21.933987 2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-dockercfg-d92l8\"" Jun 09 15:23:21.934134 ip-10-0-130-232 kubenswrapper[2575]: I0609 15:23:21.934118 2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"kube-root-ca.crt\"" Jun 09 15:23:21.939104 ip-10-0-130-232 kubenswrapper[2575]: I0609 15:23:21.939084 2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"openshift-service-ca.crt\"" Jun 09 15:23:21.944243 ip-10-0-130-232 kubenswrapper[2575]: I0609 15:23:21.944226 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/ecfa9e10-2268-4ead-89d6-88b39352b5fe-apiservice-cert\") pod \"opendatahub-operator-controller-manager-f5f495f5c-dvnkh\" (UID: \"ecfa9e10-2268-4ead-89d6-88b39352b5fe\") " pod="opendatahub/opendatahub-operator-controller-manager-f5f495f5c-dvnkh" Jun 09 15:23:21.944309 ip-10-0-130-232 kubenswrapper[2575]: I0609 15:23:21.944268 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/ecfa9e10-2268-4ead-89d6-88b39352b5fe-tmp\") pod \"opendatahub-operator-controller-manager-f5f495f5c-dvnkh\" (UID: \"ecfa9e10-2268-4ead-89d6-88b39352b5fe\") " pod="opendatahub/opendatahub-operator-controller-manager-f5f495f5c-dvnkh" Jun 09 15:23:21.944309 ip-10-0-130-232 kubenswrapper[2575]: I0609 15:23:21.944300 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/ecfa9e10-2268-4ead-89d6-88b39352b5fe-webhook-cert\") pod \"opendatahub-operator-controller-manager-f5f495f5c-dvnkh\" (UID: \"ecfa9e10-2268-4ead-89d6-88b39352b5fe\") " pod="opendatahub/opendatahub-operator-controller-manager-f5f495f5c-dvnkh" Jun 09 15:23:21.944391 ip-10-0-130-232 kubenswrapper[2575]: I0609 15:23:21.944338 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qlp6h\" (UniqueName: \"kubernetes.io/projected/ecfa9e10-2268-4ead-89d6-88b39352b5fe-kube-api-access-qlp6h\") pod \"opendatahub-operator-controller-manager-f5f495f5c-dvnkh\" (UID: \"ecfa9e10-2268-4ead-89d6-88b39352b5fe\") " pod="opendatahub/opendatahub-operator-controller-manager-f5f495f5c-dvnkh" Jun 09 15:23:21.944391 ip-10-0-130-232 kubenswrapper[2575]: I0609 15:23:21.944372 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/ecfa9e10-2268-4ead-89d6-88b39352b5fe-manifests\") pod \"opendatahub-operator-controller-manager-f5f495f5c-dvnkh\" (UID: \"ecfa9e10-2268-4ead-89d6-88b39352b5fe\") " pod="opendatahub/opendatahub-operator-controller-manager-f5f495f5c-dvnkh" Jun 09 15:23:21.964148 ip-10-0-130-232 kubenswrapper[2575]: I0609 15:23:21.964124 2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-f5f495f5c-dvnkh"] Jun 09 15:23:22.044786 ip-10-0-130-232 kubenswrapper[2575]: I0609 15:23:22.044697 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/ecfa9e10-2268-4ead-89d6-88b39352b5fe-tmp\") pod \"opendatahub-operator-controller-manager-f5f495f5c-dvnkh\" (UID: \"ecfa9e10-2268-4ead-89d6-88b39352b5fe\") " pod="opendatahub/opendatahub-operator-controller-manager-f5f495f5c-dvnkh" Jun 09 15:23:22.044786 ip-10-0-130-232 kubenswrapper[2575]: I0609 15:23:22.044749 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/ecfa9e10-2268-4ead-89d6-88b39352b5fe-webhook-cert\") pod \"opendatahub-operator-controller-manager-f5f495f5c-dvnkh\" (UID: \"ecfa9e10-2268-4ead-89d6-88b39352b5fe\") " pod="opendatahub/opendatahub-operator-controller-manager-f5f495f5c-dvnkh" Jun 09 15:23:22.044786 ip-10-0-130-232 kubenswrapper[2575]: I0609 15:23:22.044770 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qlp6h\" (UniqueName: \"kubernetes.io/projected/ecfa9e10-2268-4ead-89d6-88b39352b5fe-kube-api-access-qlp6h\") pod \"opendatahub-operator-controller-manager-f5f495f5c-dvnkh\" (UID: \"ecfa9e10-2268-4ead-89d6-88b39352b5fe\") " pod="opendatahub/opendatahub-operator-controller-manager-f5f495f5c-dvnkh" Jun 09 15:23:22.045078 ip-10-0-130-232 kubenswrapper[2575]: I0609 15:23:22.044793 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/ecfa9e10-2268-4ead-89d6-88b39352b5fe-manifests\") pod \"opendatahub-operator-controller-manager-f5f495f5c-dvnkh\" (UID: \"ecfa9e10-2268-4ead-89d6-88b39352b5fe\") " pod="opendatahub/opendatahub-operator-controller-manager-f5f495f5c-dvnkh" Jun 09 15:23:22.045078 ip-10-0-130-232 kubenswrapper[2575]: I0609 15:23:22.044815 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/ecfa9e10-2268-4ead-89d6-88b39352b5fe-apiservice-cert\") pod \"opendatahub-operator-controller-manager-f5f495f5c-dvnkh\" (UID: \"ecfa9e10-2268-4ead-89d6-88b39352b5fe\") " pod="opendatahub/opendatahub-operator-controller-manager-f5f495f5c-dvnkh" Jun 09 15:23:22.045299 ip-10-0-130-232 kubenswrapper[2575]: I0609 15:23:22.045267 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/ecfa9e10-2268-4ead-89d6-88b39352b5fe-manifests\") pod \"opendatahub-operator-controller-manager-f5f495f5c-dvnkh\" (UID: \"ecfa9e10-2268-4ead-89d6-88b39352b5fe\") " pod="opendatahub/opendatahub-operator-controller-manager-f5f495f5c-dvnkh" Jun 09 15:23:22.047126 ip-10-0-130-232 kubenswrapper[2575]: I0609 15:23:22.047103 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/ecfa9e10-2268-4ead-89d6-88b39352b5fe-tmp\") pod \"opendatahub-operator-controller-manager-f5f495f5c-dvnkh\" (UID: \"ecfa9e10-2268-4ead-89d6-88b39352b5fe\") " pod="opendatahub/opendatahub-operator-controller-manager-f5f495f5c-dvnkh" Jun 09 15:23:22.047344 ip-10-0-130-232 kubenswrapper[2575]: I0609 15:23:22.047327 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/ecfa9e10-2268-4ead-89d6-88b39352b5fe-webhook-cert\") pod \"opendatahub-operator-controller-manager-f5f495f5c-dvnkh\" (UID: \"ecfa9e10-2268-4ead-89d6-88b39352b5fe\") " pod="opendatahub/opendatahub-operator-controller-manager-f5f495f5c-dvnkh" Jun 09 15:23:22.047525 ip-10-0-130-232 kubenswrapper[2575]: I0609 15:23:22.047506 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/ecfa9e10-2268-4ead-89d6-88b39352b5fe-apiservice-cert\") pod \"opendatahub-operator-controller-manager-f5f495f5c-dvnkh\" (UID: \"ecfa9e10-2268-4ead-89d6-88b39352b5fe\") " pod="opendatahub/opendatahub-operator-controller-manager-f5f495f5c-dvnkh" Jun 09 15:23:22.050950 ip-10-0-130-232 kubenswrapper[2575]: I0609 15:23:22.050929 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2bkzp_41532b1e-300d-4a9e-a64f-da302213062c/konnectivity-agent/0.log" limit=1024 Jun 09 15:23:22.053915 ip-10-0-130-232 kubenswrapper[2575]: I0609 15:23:22.053894 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-qlp6h\" (UniqueName: \"kubernetes.io/projected/ecfa9e10-2268-4ead-89d6-88b39352b5fe-kube-api-access-qlp6h\") pod \"opendatahub-operator-controller-manager-f5f495f5c-dvnkh\" (UID: \"ecfa9e10-2268-4ead-89d6-88b39352b5fe\") " pod="opendatahub/opendatahub-operator-controller-manager-f5f495f5c-dvnkh" Jun 09 15:23:22.152281 ip-10-0-130-232 kubenswrapper[2575]: I0609 15:23:22.152245 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2bkzp_41532b1e-300d-4a9e-a64f-da302213062c/konnectivity-agent/0.log" limit=1024 Jun 09 15:23:22.241853 ip-10-0-130-232 kubenswrapper[2575]: I0609 15:23:22.241827 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-f5f495f5c-dvnkh" Jun 09 15:23:22.248703 ip-10-0-130-232 kubenswrapper[2575]: I0609 15:23:22.248671 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2bkzp_41532b1e-300d-4a9e-a64f-da302213062c/konnectivity-agent/0.log" limit=1024 Jun 09 15:23:22.357267 ip-10-0-130-232 kubenswrapper[2575]: I0609 15:23:22.357241 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2bkzp_41532b1e-300d-4a9e-a64f-da302213062c/konnectivity-agent/0.log" limit=1024 Jun 09 15:23:22.399880 ip-10-0-130-232 kubenswrapper[2575]: I0609 15:23:22.399814 2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-f5f495f5c-dvnkh"] Jun 09 15:23:22.403909 ip-10-0-130-232 kubenswrapper[2575]: W0609 15:23:22.403882 2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podecfa9e10_2268_4ead_89d6_88b39352b5fe.slice/crio-e749a7a2935c5cd4786ef88d643fa622cb35270e7d9d7003cd878fdb9a23eb74 WatchSource:0}: Error finding container e749a7a2935c5cd4786ef88d643fa622cb35270e7d9d7003cd878fdb9a23eb74: Status 404 returned error can't find the container with id e749a7a2935c5cd4786ef88d643fa622cb35270e7d9d7003cd878fdb9a23eb74 Jun 09 15:23:22.454035 ip-10-0-130-232 kubenswrapper[2575]: I0609 15:23:22.454009 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2bkzp_41532b1e-300d-4a9e-a64f-da302213062c/konnectivity-agent/0.log" limit=1024 Jun 09 15:23:22.605706 ip-10-0-130-232 kubenswrapper[2575]: I0609 15:23:22.605628 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-f5f495f5c-dvnkh" event={"ID":"ecfa9e10-2268-4ead-89d6-88b39352b5fe","Type":"ContainerStarted","Data":"e749a7a2935c5cd4786ef88d643fa622cb35270e7d9d7003cd878fdb9a23eb74"} Jun 09 15:23:25.630324 ip-10-0-130-232 kubenswrapper[2575]: I0609 15:23:25.630239 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-f5f495f5c-dvnkh" event={"ID":"ecfa9e10-2268-4ead-89d6-88b39352b5fe","Type":"ContainerStarted","Data":"ba86749683f9280e9b84da5eb454350f17691de38b6979c1a18e380f5067a982"} Jun 09 15:23:26.635651 ip-10-0-130-232 kubenswrapper[2575]: I0609 15:23:26.635566 2575 generic.go:356] "Generic (PLEG): container finished" podID="ecfa9e10-2268-4ead-89d6-88b39352b5fe" containerID="ba86749683f9280e9b84da5eb454350f17691de38b6979c1a18e380f5067a982" exitCode=0 Jun 09 15:23:26.635651 ip-10-0-130-232 kubenswrapper[2575]: I0609 15:23:26.635603 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-f5f495f5c-dvnkh" event={"ID":"ecfa9e10-2268-4ead-89d6-88b39352b5fe","Type":"ContainerDied","Data":"ba86749683f9280e9b84da5eb454350f17691de38b6979c1a18e380f5067a982"} Jun 09 15:23:27.641626 ip-10-0-130-232 kubenswrapper[2575]: I0609 15:23:27.641592 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-f5f495f5c-dvnkh" event={"ID":"ecfa9e10-2268-4ead-89d6-88b39352b5fe","Type":"ContainerStarted","Data":"be1fc89083ea4cc32aa677726f40dc10c7f8148815a22069ac64c84f248d62ca"} Jun 09 15:23:27.642070 ip-10-0-130-232 kubenswrapper[2575]: I0609 15:23:27.641686 2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/opendatahub-operator-controller-manager-f5f495f5c-dvnkh" Jun 09 15:23:27.664549 ip-10-0-130-232 kubenswrapper[2575]: I0609 15:23:27.664501 2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/opendatahub-operator-controller-manager-f5f495f5c-dvnkh" podStartSLOduration=2.366522654 podStartE2EDuration="6.664488568s" totalImagesPullingTime="3.321291267s" totalInitContainerRuntime="976.674647ms" isStatefulPod=false podCreationTimestamp="2026-06-09 15:23:21 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-09 15:23:27.662077538 +0000 UTC m=+547.350082991" watchObservedRunningTime="2026-06-09 15:23:27.664488568 +0000 UTC m=+547.352494020" Jun 09 15:23:27.741488 ip-10-0-130-232 kubenswrapper[2575]: I0609 15:23:27.741450 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2bkzp_41532b1e-300d-4a9e-a64f-da302213062c/konnectivity-agent/0.log" limit=1024 Jun 09 15:23:27.842415 ip-10-0-130-232 kubenswrapper[2575]: I0609 15:23:27.842391 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2bkzp_41532b1e-300d-4a9e-a64f-da302213062c/konnectivity-agent/0.log" limit=1024 Jun 09 15:23:38.648755 ip-10-0-130-232 kubenswrapper[2575]: I0609 15:23:38.648729 2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/opendatahub-operator-controller-manager-f5f495f5c-dvnkh" Jun 09 15:23:40.302875 ip-10-0-130-232 kubenswrapper[2575]: I0609 15:23:40.302815 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2bkzp_41532b1e-300d-4a9e-a64f-da302213062c/konnectivity-agent/0.log" limit=1024 Jun 09 15:23:40.419225 ip-10-0-130-232 kubenswrapper[2575]: I0609 15:23:40.419190 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2bkzp_41532b1e-300d-4a9e-a64f-da302213062c/konnectivity-agent/0.log" limit=1024 Jun 09 15:23:40.938488 ip-10-0-130-232 kubenswrapper[2575]: I0609 15:23:40.938454 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2bkzp_41532b1e-300d-4a9e-a64f-da302213062c/konnectivity-agent/0.log" limit=1024 Jun 09 15:23:40.992898 ip-10-0-130-232 kubenswrapper[2575]: I0609 15:23:40.992868 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2bkzp_41532b1e-300d-4a9e-a64f-da302213062c/konnectivity-agent/0.log" limit=1024 Jun 09 15:23:41.263440 ip-10-0-130-232 kubenswrapper[2575]: I0609 15:23:41.263411 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2bkzp_41532b1e-300d-4a9e-a64f-da302213062c/konnectivity-agent/0.log" limit=1024 Jun 09 15:23:41.489126 ip-10-0-130-232 kubenswrapper[2575]: I0609 15:23:41.489092 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2bkzp_41532b1e-300d-4a9e-a64f-da302213062c/konnectivity-agent/0.log" limit=1024 Jun 09 15:23:41.722907 ip-10-0-130-232 kubenswrapper[2575]: I0609 15:23:41.722868 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2bkzp_41532b1e-300d-4a9e-a64f-da302213062c/konnectivity-agent/0.log" limit=1024 Jun 09 15:23:45.973410 ip-10-0-130-232 kubenswrapper[2575]: I0609 15:23:45.973376 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2bkzp_41532b1e-300d-4a9e-a64f-da302213062c/konnectivity-agent/0.log" limit=1024 Jun 09 15:23:46.068447 ip-10-0-130-232 kubenswrapper[2575]: I0609 15:23:46.068411 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2bkzp_41532b1e-300d-4a9e-a64f-da302213062c/konnectivity-agent/0.log" limit=1024 Jun 09 15:23:46.087364 ip-10-0-130-232 kubenswrapper[2575]: I0609 15:23:46.087338 2575 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/kube-auth-proxy-5dcd85bb64-jm6pc"] Jun 09 15:23:46.096520 ip-10-0-130-232 kubenswrapper[2575]: I0609 15:23:46.096500 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/kube-auth-proxy-5dcd85bb64-jm6pc" Jun 09 15:23:46.098787 ip-10-0-130-232 kubenswrapper[2575]: I0609 15:23:46.098759 2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-service-ca.crt\"" Jun 09 15:23:46.099422 ip-10-0-130-232 kubenswrapper[2575]: I0609 15:23:46.099403 2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"kube-root-ca.crt\"" Jun 09 15:23:46.099764 ip-10-0-130-232 kubenswrapper[2575]: I0609 15:23:46.099748 2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-creds\"" Jun 09 15:23:46.100000 ip-10-0-130-232 kubenswrapper[2575]: I0609 15:23:46.099976 2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-dockercfg-jj9gt\"" Jun 09 15:23:46.100906 ip-10-0-130-232 kubenswrapper[2575]: I0609 15:23:46.100884 2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-tls\"" Jun 09 15:23:46.101154 ip-10-0-130-232 kubenswrapper[2575]: I0609 15:23:46.101135 2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/kube-auth-proxy-5dcd85bb64-jm6pc"] Jun 09 15:23:46.155884 ip-10-0-130-232 kubenswrapper[2575]: I0609 15:23:46.155831 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2bkzp_41532b1e-300d-4a9e-a64f-da302213062c/konnectivity-agent/0.log" limit=1024 Jun 09 15:23:46.253049 ip-10-0-130-232 kubenswrapper[2575]: I0609 15:23:46.252970 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/8ca64b52-2b1a-4c2c-8b9f-d66961c48a05-tls-certs\") pod \"kube-auth-proxy-5dcd85bb64-jm6pc\" (UID: \"8ca64b52-2b1a-4c2c-8b9f-d66961c48a05\") " pod="openshift-ingress/kube-auth-proxy-5dcd85bb64-jm6pc" Jun 09 15:23:46.253049 ip-10-0-130-232 kubenswrapper[2575]: I0609 15:23:46.253017 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/8ca64b52-2b1a-4c2c-8b9f-d66961c48a05-tmp\") pod \"kube-auth-proxy-5dcd85bb64-jm6pc\" (UID: \"8ca64b52-2b1a-4c2c-8b9f-d66961c48a05\") " pod="openshift-ingress/kube-auth-proxy-5dcd85bb64-jm6pc" Jun 09 15:23:46.253207 ip-10-0-130-232 kubenswrapper[2575]: I0609 15:23:46.253069 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-stv45\" (UniqueName: \"kubernetes.io/projected/8ca64b52-2b1a-4c2c-8b9f-d66961c48a05-kube-api-access-stv45\") pod \"kube-auth-proxy-5dcd85bb64-jm6pc\" (UID: \"8ca64b52-2b1a-4c2c-8b9f-d66961c48a05\") " pod="openshift-ingress/kube-auth-proxy-5dcd85bb64-jm6pc" Jun 09 15:23:46.258646 ip-10-0-130-232 kubenswrapper[2575]: I0609 15:23:46.258597 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2bkzp_41532b1e-300d-4a9e-a64f-da302213062c/konnectivity-agent/0.log" limit=1024 Jun 09 15:23:46.353623 ip-10-0-130-232 kubenswrapper[2575]: I0609 15:23:46.353597 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/8ca64b52-2b1a-4c2c-8b9f-d66961c48a05-tmp\") pod \"kube-auth-proxy-5dcd85bb64-jm6pc\" (UID: \"8ca64b52-2b1a-4c2c-8b9f-d66961c48a05\") " pod="openshift-ingress/kube-auth-proxy-5dcd85bb64-jm6pc" Jun 09 15:23:46.353790 ip-10-0-130-232 kubenswrapper[2575]: I0609 15:23:46.353635 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-stv45\" (UniqueName: \"kubernetes.io/projected/8ca64b52-2b1a-4c2c-8b9f-d66961c48a05-kube-api-access-stv45\") pod \"kube-auth-proxy-5dcd85bb64-jm6pc\" (UID: \"8ca64b52-2b1a-4c2c-8b9f-d66961c48a05\") " pod="openshift-ingress/kube-auth-proxy-5dcd85bb64-jm6pc" Jun 09 15:23:46.353790 ip-10-0-130-232 kubenswrapper[2575]: I0609 15:23:46.353703 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/8ca64b52-2b1a-4c2c-8b9f-d66961c48a05-tls-certs\") pod \"kube-auth-proxy-5dcd85bb64-jm6pc\" (UID: \"8ca64b52-2b1a-4c2c-8b9f-d66961c48a05\") " pod="openshift-ingress/kube-auth-proxy-5dcd85bb64-jm6pc" Jun 09 15:23:46.356105 ip-10-0-130-232 kubenswrapper[2575]: I0609 15:23:46.356082 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/8ca64b52-2b1a-4c2c-8b9f-d66961c48a05-tmp\") pod \"kube-auth-proxy-5dcd85bb64-jm6pc\" (UID: \"8ca64b52-2b1a-4c2c-8b9f-d66961c48a05\") " pod="openshift-ingress/kube-auth-proxy-5dcd85bb64-jm6pc" Jun 09 15:23:46.356227 ip-10-0-130-232 kubenswrapper[2575]: I0609 15:23:46.356203 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/8ca64b52-2b1a-4c2c-8b9f-d66961c48a05-tls-certs\") pod \"kube-auth-proxy-5dcd85bb64-jm6pc\" (UID: \"8ca64b52-2b1a-4c2c-8b9f-d66961c48a05\") " pod="openshift-ingress/kube-auth-proxy-5dcd85bb64-jm6pc" Jun 09 15:23:46.361639 ip-10-0-130-232 kubenswrapper[2575]: I0609 15:23:46.361614 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-stv45\" (UniqueName: \"kubernetes.io/projected/8ca64b52-2b1a-4c2c-8b9f-d66961c48a05-kube-api-access-stv45\") pod \"kube-auth-proxy-5dcd85bb64-jm6pc\" (UID: \"8ca64b52-2b1a-4c2c-8b9f-d66961c48a05\") " pod="openshift-ingress/kube-auth-proxy-5dcd85bb64-jm6pc" Jun 09 15:23:46.407627 ip-10-0-130-232 kubenswrapper[2575]: I0609 15:23:46.407600 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/kube-auth-proxy-5dcd85bb64-jm6pc" Jun 09 15:23:46.539747 ip-10-0-130-232 kubenswrapper[2575]: I0609 15:23:46.539721 2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/kube-auth-proxy-5dcd85bb64-jm6pc"] Jun 09 15:23:46.542457 ip-10-0-130-232 kubenswrapper[2575]: W0609 15:23:46.542431 2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8ca64b52_2b1a_4c2c_8b9f_d66961c48a05.slice/crio-a03ca37c44b24e9776992e4096dcf783905305c303e224fa9e9ff30c9d882866 WatchSource:0}: Error finding container a03ca37c44b24e9776992e4096dcf783905305c303e224fa9e9ff30c9d882866: Status 404 returned error can't find the container with id a03ca37c44b24e9776992e4096dcf783905305c303e224fa9e9ff30c9d882866 Jun 09 15:23:46.723983 ip-10-0-130-232 kubenswrapper[2575]: I0609 15:23:46.723952 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/kube-auth-proxy-5dcd85bb64-jm6pc" event={"ID":"8ca64b52-2b1a-4c2c-8b9f-d66961c48a05","Type":"ContainerStarted","Data":"a03ca37c44b24e9776992e4096dcf783905305c303e224fa9e9ff30c9d882866"} Jun 09 15:23:50.339753 ip-10-0-130-232 kubenswrapper[2575]: I0609 15:23:50.339706 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2bkzp_41532b1e-300d-4a9e-a64f-da302213062c/konnectivity-agent/0.log" limit=1024 Jun 09 15:23:50.393549 ip-10-0-130-232 kubenswrapper[2575]: I0609 15:23:50.393521 2575 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/kserve-controller-manager-69fc866d76-47qf2"] Jun 09 15:23:50.396797 ip-10-0-130-232 kubenswrapper[2575]: I0609 15:23:50.396781 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/kserve-controller-manager-69fc866d76-47qf2" Jun 09 15:23:50.399867 ip-10-0-130-232 kubenswrapper[2575]: I0609 15:23:50.399832 2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"kserve-controller-manager-dockercfg-fw6vh\"" Jun 09 15:23:50.400115 ip-10-0-130-232 kubenswrapper[2575]: I0609 15:23:50.400098 2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"kserve-webhook-server-cert\"" Jun 09 15:23:50.408208 ip-10-0-130-232 kubenswrapper[2575]: I0609 15:23:50.408178 2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/kserve-controller-manager-69fc866d76-47qf2"] Jun 09 15:23:50.411981 ip-10-0-130-232 kubenswrapper[2575]: I0609 15:23:50.411959 2575 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/llmisvc-controller-manager-864bfd7bc9-9wjl9"] Jun 09 15:23:50.415625 ip-10-0-130-232 kubenswrapper[2575]: I0609 15:23:50.415607 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/llmisvc-controller-manager-864bfd7bc9-9wjl9" Jun 09 15:23:50.420288 ip-10-0-130-232 kubenswrapper[2575]: I0609 15:23:50.420267 2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"llmisvc-controller-manager-dockercfg-c2dwz\"" Jun 09 15:23:50.420681 ip-10-0-130-232 kubenswrapper[2575]: I0609 15:23:50.420663 2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"llmisvc-webhook-server-cert\"" Jun 09 15:23:50.428893 ip-10-0-130-232 kubenswrapper[2575]: I0609 15:23:50.428871 2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/llmisvc-controller-manager-864bfd7bc9-9wjl9"] Jun 09 15:23:50.448506 ip-10-0-130-232 kubenswrapper[2575]: I0609 15:23:50.448474 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2bkzp_41532b1e-300d-4a9e-a64f-da302213062c/konnectivity-agent/0.log" limit=1024 Jun 09 15:23:50.491611 ip-10-0-130-232 kubenswrapper[2575]: I0609 15:23:50.491575 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-kcprc\" (UniqueName: \"kubernetes.io/projected/c9ff96d5-f8c6-4eaf-a73b-b72b72908bf4-kube-api-access-kcprc\") pod \"llmisvc-controller-manager-864bfd7bc9-9wjl9\" (UID: \"c9ff96d5-f8c6-4eaf-a73b-b72b72908bf4\") " pod="opendatahub/llmisvc-controller-manager-864bfd7bc9-9wjl9" Jun 09 15:23:50.491748 ip-10-0-130-232 kubenswrapper[2575]: I0609 15:23:50.491624 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/c9ff96d5-f8c6-4eaf-a73b-b72b72908bf4-cert\") pod \"llmisvc-controller-manager-864bfd7bc9-9wjl9\" (UID: \"c9ff96d5-f8c6-4eaf-a73b-b72b72908bf4\") " pod="opendatahub/llmisvc-controller-manager-864bfd7bc9-9wjl9" Jun 09 15:23:50.491748 ip-10-0-130-232 kubenswrapper[2575]: I0609 15:23:50.491689 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-lcwdh\" (UniqueName: \"kubernetes.io/projected/67c921a6-a58e-4f6f-8947-b5dc8d5d6bf6-kube-api-access-lcwdh\") pod \"kserve-controller-manager-69fc866d76-47qf2\" (UID: \"67c921a6-a58e-4f6f-8947-b5dc8d5d6bf6\") " pod="opendatahub/kserve-controller-manager-69fc866d76-47qf2" Jun 09 15:23:50.491748 ip-10-0-130-232 kubenswrapper[2575]: I0609 15:23:50.491734 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/67c921a6-a58e-4f6f-8947-b5dc8d5d6bf6-cert\") pod \"kserve-controller-manager-69fc866d76-47qf2\" (UID: \"67c921a6-a58e-4f6f-8947-b5dc8d5d6bf6\") " pod="opendatahub/kserve-controller-manager-69fc866d76-47qf2" Jun 09 15:23:50.592917 ip-10-0-130-232 kubenswrapper[2575]: I0609 15:23:50.592801 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-kcprc\" (UniqueName: \"kubernetes.io/projected/c9ff96d5-f8c6-4eaf-a73b-b72b72908bf4-kube-api-access-kcprc\") pod \"llmisvc-controller-manager-864bfd7bc9-9wjl9\" (UID: \"c9ff96d5-f8c6-4eaf-a73b-b72b72908bf4\") " pod="opendatahub/llmisvc-controller-manager-864bfd7bc9-9wjl9" Jun 09 15:23:50.592917 ip-10-0-130-232 kubenswrapper[2575]: I0609 15:23:50.592884 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/c9ff96d5-f8c6-4eaf-a73b-b72b72908bf4-cert\") pod \"llmisvc-controller-manager-864bfd7bc9-9wjl9\" (UID: \"c9ff96d5-f8c6-4eaf-a73b-b72b72908bf4\") " pod="opendatahub/llmisvc-controller-manager-864bfd7bc9-9wjl9" Jun 09 15:23:50.593092 ip-10-0-130-232 kubenswrapper[2575]: I0609 15:23:50.592933 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-lcwdh\" (UniqueName: \"kubernetes.io/projected/67c921a6-a58e-4f6f-8947-b5dc8d5d6bf6-kube-api-access-lcwdh\") pod \"kserve-controller-manager-69fc866d76-47qf2\" (UID: \"67c921a6-a58e-4f6f-8947-b5dc8d5d6bf6\") " pod="opendatahub/kserve-controller-manager-69fc866d76-47qf2" Jun 09 15:23:50.593092 ip-10-0-130-232 kubenswrapper[2575]: E0609 15:23:50.593037 2575 secret.go:189] Couldn't get secret opendatahub/llmisvc-webhook-server-cert: secret "llmisvc-webhook-server-cert" not found Jun 09 15:23:50.593092 ip-10-0-130-232 kubenswrapper[2575]: I0609 15:23:50.593062 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/67c921a6-a58e-4f6f-8947-b5dc8d5d6bf6-cert\") pod \"kserve-controller-manager-69fc866d76-47qf2\" (UID: \"67c921a6-a58e-4f6f-8947-b5dc8d5d6bf6\") " pod="opendatahub/kserve-controller-manager-69fc866d76-47qf2" Jun 09 15:23:50.593193 ip-10-0-130-232 kubenswrapper[2575]: E0609 15:23:50.593123 2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c9ff96d5-f8c6-4eaf-a73b-b72b72908bf4-cert podName:c9ff96d5-f8c6-4eaf-a73b-b72b72908bf4 nodeName:}" failed. No retries permitted until 2026-06-09 15:23:51.093101259 +0000 UTC m=+570.781106691 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/c9ff96d5-f8c6-4eaf-a73b-b72b72908bf4-cert") pod "llmisvc-controller-manager-864bfd7bc9-9wjl9" (UID: "c9ff96d5-f8c6-4eaf-a73b-b72b72908bf4") : secret "llmisvc-webhook-server-cert" not found Jun 09 15:23:50.593193 ip-10-0-130-232 kubenswrapper[2575]: E0609 15:23:50.593169 2575 secret.go:189] Couldn't get secret opendatahub/kserve-webhook-server-cert: secret "kserve-webhook-server-cert" not found Jun 09 15:23:50.593261 ip-10-0-130-232 kubenswrapper[2575]: E0609 15:23:50.593227 2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/67c921a6-a58e-4f6f-8947-b5dc8d5d6bf6-cert podName:67c921a6-a58e-4f6f-8947-b5dc8d5d6bf6 nodeName:}" failed. No retries permitted until 2026-06-09 15:23:51.09320985 +0000 UTC m=+570.781215282 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/67c921a6-a58e-4f6f-8947-b5dc8d5d6bf6-cert") pod "kserve-controller-manager-69fc866d76-47qf2" (UID: "67c921a6-a58e-4f6f-8947-b5dc8d5d6bf6") : secret "kserve-webhook-server-cert" not found Jun 09 15:23:50.605156 ip-10-0-130-232 kubenswrapper[2575]: I0609 15:23:50.605124 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-lcwdh\" (UniqueName: \"kubernetes.io/projected/67c921a6-a58e-4f6f-8947-b5dc8d5d6bf6-kube-api-access-lcwdh\") pod \"kserve-controller-manager-69fc866d76-47qf2\" (UID: \"67c921a6-a58e-4f6f-8947-b5dc8d5d6bf6\") " pod="opendatahub/kserve-controller-manager-69fc866d76-47qf2" Jun 09 15:23:50.605274 ip-10-0-130-232 kubenswrapper[2575]: I0609 15:23:50.605124 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-kcprc\" (UniqueName: \"kubernetes.io/projected/c9ff96d5-f8c6-4eaf-a73b-b72b72908bf4-kube-api-access-kcprc\") pod \"llmisvc-controller-manager-864bfd7bc9-9wjl9\" (UID: \"c9ff96d5-f8c6-4eaf-a73b-b72b72908bf4\") " pod="opendatahub/llmisvc-controller-manager-864bfd7bc9-9wjl9" Jun 09 15:23:50.692724 ip-10-0-130-232 kubenswrapper[2575]: I0609 15:23:50.692685 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2bkzp_41532b1e-300d-4a9e-a64f-da302213062c/konnectivity-agent/0.log" limit=1024 Jun 09 15:23:50.743083 ip-10-0-130-232 kubenswrapper[2575]: I0609 15:23:50.743038 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/kube-auth-proxy-5dcd85bb64-jm6pc" event={"ID":"8ca64b52-2b1a-4c2c-8b9f-d66961c48a05","Type":"ContainerStarted","Data":"590176b78f04baf4fc5140a841d0b70087b845b89cfcd1c80491f17fa93aec9a"} Jun 09 15:23:50.978142 ip-10-0-130-232 kubenswrapper[2575]: I0609 15:23:50.978101 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2bkzp_41532b1e-300d-4a9e-a64f-da302213062c/konnectivity-agent/0.log" limit=1024 Jun 09 15:23:51.097945 ip-10-0-130-232 kubenswrapper[2575]: I0609 15:23:51.097908 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/c9ff96d5-f8c6-4eaf-a73b-b72b72908bf4-cert\") pod \"llmisvc-controller-manager-864bfd7bc9-9wjl9\" (UID: \"c9ff96d5-f8c6-4eaf-a73b-b72b72908bf4\") " pod="opendatahub/llmisvc-controller-manager-864bfd7bc9-9wjl9" Jun 09 15:23:51.098145 ip-10-0-130-232 kubenswrapper[2575]: I0609 15:23:51.097961 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/67c921a6-a58e-4f6f-8947-b5dc8d5d6bf6-cert\") pod \"kserve-controller-manager-69fc866d76-47qf2\" (UID: \"67c921a6-a58e-4f6f-8947-b5dc8d5d6bf6\") " pod="opendatahub/kserve-controller-manager-69fc866d76-47qf2" Jun 09 15:23:51.100601 ip-10-0-130-232 kubenswrapper[2575]: I0609 15:23:51.100570 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/67c921a6-a58e-4f6f-8947-b5dc8d5d6bf6-cert\") pod \"kserve-controller-manager-69fc866d76-47qf2\" (UID: \"67c921a6-a58e-4f6f-8947-b5dc8d5d6bf6\") " pod="opendatahub/kserve-controller-manager-69fc866d76-47qf2" Jun 09 15:23:51.100704 ip-10-0-130-232 kubenswrapper[2575]: I0609 15:23:51.100641 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/c9ff96d5-f8c6-4eaf-a73b-b72b72908bf4-cert\") pod \"llmisvc-controller-manager-864bfd7bc9-9wjl9\" (UID: \"c9ff96d5-f8c6-4eaf-a73b-b72b72908bf4\") " pod="opendatahub/llmisvc-controller-manager-864bfd7bc9-9wjl9" Jun 09 15:23:51.307163 ip-10-0-130-232 kubenswrapper[2575]: I0609 15:23:51.307074 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/kserve-controller-manager-69fc866d76-47qf2" Jun 09 15:23:51.325341 ip-10-0-130-232 kubenswrapper[2575]: I0609 15:23:51.325313 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/llmisvc-controller-manager-864bfd7bc9-9wjl9" Jun 09 15:23:51.446902 ip-10-0-130-232 kubenswrapper[2575]: I0609 15:23:51.446797 2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/kube-auth-proxy-5dcd85bb64-jm6pc" podStartSLOduration=2.217208196 podStartE2EDuration="5.446776194s" totalImagesPullingTime="3.229567998s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-09 15:23:46 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-09 15:23:50.760017097 +0000 UTC m=+570.448022550" watchObservedRunningTime="2026-06-09 15:23:51.446776194 +0000 UTC m=+571.134781669" Jun 09 15:23:51.447936 ip-10-0-130-232 kubenswrapper[2575]: I0609 15:23:51.447908 2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/kserve-controller-manager-69fc866d76-47qf2"] Jun 09 15:23:51.451339 ip-10-0-130-232 kubenswrapper[2575]: W0609 15:23:51.451312 2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod67c921a6_a58e_4f6f_8947_b5dc8d5d6bf6.slice/crio-4ade7d85e670edba38dd3457953e8584211e98ada9f0a4317bd9a92ab7f0d2bd WatchSource:0}: Error finding container 4ade7d85e670edba38dd3457953e8584211e98ada9f0a4317bd9a92ab7f0d2bd: Status 404 returned error can't find the container with id 4ade7d85e670edba38dd3457953e8584211e98ada9f0a4317bd9a92ab7f0d2bd Jun 09 15:23:51.471027 ip-10-0-130-232 kubenswrapper[2575]: I0609 15:23:51.471008 2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/llmisvc-controller-manager-864bfd7bc9-9wjl9"] Jun 09 15:23:51.472761 ip-10-0-130-232 kubenswrapper[2575]: W0609 15:23:51.472738 2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-podc9ff96d5_f8c6_4eaf_a73b_b72b72908bf4.slice/crio-ce63065ccff86ca2272d959a5ef87d76a458641fe1861233ef742754f68127e8 WatchSource:0}: Error finding container ce63065ccff86ca2272d959a5ef87d76a458641fe1861233ef742754f68127e8: Status 404 returned error can't find the container with id ce63065ccff86ca2272d959a5ef87d76a458641fe1861233ef742754f68127e8 Jun 09 15:23:51.616693 ip-10-0-130-232 kubenswrapper[2575]: I0609 15:23:51.616606 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2bkzp_41532b1e-300d-4a9e-a64f-da302213062c/konnectivity-agent/0.log" limit=1024 Jun 09 15:23:51.715031 ip-10-0-130-232 kubenswrapper[2575]: I0609 15:23:51.715005 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2bkzp_41532b1e-300d-4a9e-a64f-da302213062c/konnectivity-agent/0.log" limit=1024 Jun 09 15:23:51.749251 ip-10-0-130-232 kubenswrapper[2575]: I0609 15:23:51.749219 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/llmisvc-controller-manager-864bfd7bc9-9wjl9" event={"ID":"c9ff96d5-f8c6-4eaf-a73b-b72b72908bf4","Type":"ContainerStarted","Data":"ce63065ccff86ca2272d959a5ef87d76a458641fe1861233ef742754f68127e8"} Jun 09 15:23:51.750371 ip-10-0-130-232 kubenswrapper[2575]: I0609 15:23:51.750347 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/kserve-controller-manager-69fc866d76-47qf2" event={"ID":"67c921a6-a58e-4f6f-8947-b5dc8d5d6bf6","Type":"ContainerStarted","Data":"4ade7d85e670edba38dd3457953e8584211e98ada9f0a4317bd9a92ab7f0d2bd"} Jun 09 15:23:51.776037 ip-10-0-130-232 kubenswrapper[2575]: I0609 15:23:51.776010 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2bkzp_41532b1e-300d-4a9e-a64f-da302213062c/konnectivity-agent/0.log" limit=1024 Jun 09 15:23:55.772901 ip-10-0-130-232 kubenswrapper[2575]: I0609 15:23:55.772862 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/llmisvc-controller-manager-864bfd7bc9-9wjl9" event={"ID":"c9ff96d5-f8c6-4eaf-a73b-b72b72908bf4","Type":"ContainerStarted","Data":"bdf19871562bad965b8cb6fdfcaf605e8a08a327d5ea9d26ebed1e76ac8d3a48"} Jun 09 15:23:55.773359 ip-10-0-130-232 kubenswrapper[2575]: I0609 15:23:55.772966 2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/llmisvc-controller-manager-864bfd7bc9-9wjl9" Jun 09 15:23:55.774519 ip-10-0-130-232 kubenswrapper[2575]: I0609 15:23:55.774490 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/kserve-controller-manager-69fc866d76-47qf2" event={"ID":"67c921a6-a58e-4f6f-8947-b5dc8d5d6bf6","Type":"ContainerStarted","Data":"c6117c1dccdcaec3b7c0310c676a89a12120f5041f2f78e296e56e723577124a"} Jun 09 15:23:55.774649 ip-10-0-130-232 kubenswrapper[2575]: I0609 15:23:55.774547 2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/kserve-controller-manager-69fc866d76-47qf2" Jun 09 15:23:55.790403 ip-10-0-130-232 kubenswrapper[2575]: I0609 15:23:55.790350 2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/llmisvc-controller-manager-864bfd7bc9-9wjl9" podStartSLOduration=2.297393935 podStartE2EDuration="5.790332786s" totalImagesPullingTime="3.492938851s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-09 15:23:50 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-09 15:23:55.788907356 +0000 UTC m=+575.476912810" watchObservedRunningTime="2026-06-09 15:23:55.790332786 +0000 UTC m=+575.478338239" Jun 09 15:23:55.806469 ip-10-0-130-232 kubenswrapper[2575]: I0609 15:23:55.806420 2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/kserve-controller-manager-69fc866d76-47qf2" podStartSLOduration=2.296120134 podStartE2EDuration="5.806405089s" totalImagesPullingTime="3.510284955s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-09 15:23:50 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-09 15:23:55.804934848 +0000 UTC m=+575.492940335" watchObservedRunningTime="2026-06-09 15:23:55.806405089 +0000 UTC m=+575.494410542" Jun 09 15:23:59.473134 ip-10-0-130-232 kubenswrapper[2575]: I0609 15:23:59.473100 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2bkzp_41532b1e-300d-4a9e-a64f-da302213062c/konnectivity-agent/0.log" limit=1024 Jun 09 15:23:59.568222 ip-10-0-130-232 kubenswrapper[2575]: I0609 15:23:59.568182 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2bkzp_41532b1e-300d-4a9e-a64f-da302213062c/konnectivity-agent/0.log" limit=1024 Jun 09 15:24:00.547894 ip-10-0-130-232 kubenswrapper[2575]: I0609 15:24:00.547815 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2bkzp_41532b1e-300d-4a9e-a64f-da302213062c/konnectivity-agent/0.log" limit=1024 Jun 09 15:24:00.634644 ip-10-0-130-232 kubenswrapper[2575]: I0609 15:24:00.634612 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2bkzp_41532b1e-300d-4a9e-a64f-da302213062c/konnectivity-agent/0.log" limit=1024 Jun 09 15:24:01.154151 ip-10-0-130-232 kubenswrapper[2575]: I0609 15:24:01.154117 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2bkzp_41532b1e-300d-4a9e-a64f-da302213062c/konnectivity-agent/0.log" limit=1024 Jun 09 15:24:01.251389 ip-10-0-130-232 kubenswrapper[2575]: I0609 15:24:01.251362 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2bkzp_41532b1e-300d-4a9e-a64f-da302213062c/konnectivity-agent/0.log" limit=1024 Jun 09 15:24:01.780548 ip-10-0-130-232 kubenswrapper[2575]: I0609 15:24:01.780511 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2bkzp_41532b1e-300d-4a9e-a64f-da302213062c/konnectivity-agent/0.log" limit=1024 Jun 09 15:24:01.896023 ip-10-0-130-232 kubenswrapper[2575]: I0609 15:24:01.895992 2575 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-operators/servicemesh-operator3-57f65f65fb-gpn2m"] Jun 09 15:24:01.902609 ip-10-0-130-232 kubenswrapper[2575]: I0609 15:24:01.902592 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-operators/servicemesh-operator3-57f65f65fb-gpn2m" Jun 09 15:24:01.905411 ip-10-0-130-232 kubenswrapper[2575]: I0609 15:24:01.905395 2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-operators\"/\"kube-root-ca.crt\"" Jun 09 15:24:01.905494 ip-10-0-130-232 kubenswrapper[2575]: I0609 15:24:01.905409 2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-operators\"/\"servicemesh-operator3-dockercfg-nnjbp\"" Jun 09 15:24:01.905536 ip-10-0-130-232 kubenswrapper[2575]: I0609 15:24:01.905514 2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-operators\"/\"openshift-service-ca.crt\"" Jun 09 15:24:01.911069 ip-10-0-130-232 kubenswrapper[2575]: I0609 15:24:01.911044 2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-operators/servicemesh-operator3-57f65f65fb-gpn2m"] Jun 09 15:24:02.001831 ip-10-0-130-232 kubenswrapper[2575]: I0609 15:24:02.001794 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"operator-config\" (UniqueName: \"kubernetes.io/downward-api/005e285f-a485-413b-984c-f76c991dcd99-operator-config\") pod \"servicemesh-operator3-57f65f65fb-gpn2m\" (UID: \"005e285f-a485-413b-984c-f76c991dcd99\") " pod="openshift-operators/servicemesh-operator3-57f65f65fb-gpn2m" Jun 09 15:24:02.001831 ip-10-0-130-232 kubenswrapper[2575]: I0609 15:24:02.001826 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8gmrj\" (UniqueName: \"kubernetes.io/projected/005e285f-a485-413b-984c-f76c991dcd99-kube-api-access-8gmrj\") pod \"servicemesh-operator3-57f65f65fb-gpn2m\" (UID: \"005e285f-a485-413b-984c-f76c991dcd99\") " pod="openshift-operators/servicemesh-operator3-57f65f65fb-gpn2m" Jun 09 15:24:02.103017 ip-10-0-130-232 kubenswrapper[2575]: I0609 15:24:02.102927 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"operator-config\" (UniqueName: \"kubernetes.io/downward-api/005e285f-a485-413b-984c-f76c991dcd99-operator-config\") pod \"servicemesh-operator3-57f65f65fb-gpn2m\" (UID: \"005e285f-a485-413b-984c-f76c991dcd99\") " pod="openshift-operators/servicemesh-operator3-57f65f65fb-gpn2m" Jun 09 15:24:02.103017 ip-10-0-130-232 kubenswrapper[2575]: I0609 15:24:02.102963 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8gmrj\" (UniqueName: \"kubernetes.io/projected/005e285f-a485-413b-984c-f76c991dcd99-kube-api-access-8gmrj\") pod \"servicemesh-operator3-57f65f65fb-gpn2m\" (UID: \"005e285f-a485-413b-984c-f76c991dcd99\") " pod="openshift-operators/servicemesh-operator3-57f65f65fb-gpn2m" Jun 09 15:24:02.105556 ip-10-0-130-232 kubenswrapper[2575]: I0609 15:24:02.105527 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"operator-config\" (UniqueName: \"kubernetes.io/downward-api/005e285f-a485-413b-984c-f76c991dcd99-operator-config\") pod \"servicemesh-operator3-57f65f65fb-gpn2m\" (UID: \"005e285f-a485-413b-984c-f76c991dcd99\") " pod="openshift-operators/servicemesh-operator3-57f65f65fb-gpn2m" Jun 09 15:24:02.110731 ip-10-0-130-232 kubenswrapper[2575]: I0609 15:24:02.110695 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-8gmrj\" (UniqueName: \"kubernetes.io/projected/005e285f-a485-413b-984c-f76c991dcd99-kube-api-access-8gmrj\") pod \"servicemesh-operator3-57f65f65fb-gpn2m\" (UID: \"005e285f-a485-413b-984c-f76c991dcd99\") " pod="openshift-operators/servicemesh-operator3-57f65f65fb-gpn2m" Jun 09 15:24:02.212927 ip-10-0-130-232 kubenswrapper[2575]: I0609 15:24:02.212896 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-operators/servicemesh-operator3-57f65f65fb-gpn2m" Jun 09 15:24:02.351251 ip-10-0-130-232 kubenswrapper[2575]: I0609 15:24:02.351223 2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-operators/servicemesh-operator3-57f65f65fb-gpn2m"] Jun 09 15:24:02.354305 ip-10-0-130-232 kubenswrapper[2575]: W0609 15:24:02.354230 2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod005e285f_a485_413b_984c_f76c991dcd99.slice/crio-77aa9b64e4c61f71f4b1af2d831e34e203f7ae38810d556e88f35de990ad969b WatchSource:0}: Error finding container 77aa9b64e4c61f71f4b1af2d831e34e203f7ae38810d556e88f35de990ad969b: Status 404 returned error can't find the container with id 77aa9b64e4c61f71f4b1af2d831e34e203f7ae38810d556e88f35de990ad969b Jun 09 15:24:02.586717 ip-10-0-130-232 kubenswrapper[2575]: I0609 15:24:02.586675 2575 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/dashboard-redirect-6dc9d488bd-dlm9n"] Jun 09 15:24:02.591437 ip-10-0-130-232 kubenswrapper[2575]: I0609 15:24:02.591416 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/dashboard-redirect-6dc9d488bd-dlm9n" Jun 09 15:24:02.593649 ip-10-0-130-232 kubenswrapper[2575]: I0609 15:24:02.593628 2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"dashboard-redirect-config\"" Jun 09 15:24:02.593769 ip-10-0-130-232 kubenswrapper[2575]: I0609 15:24:02.593664 2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"default-dockercfg-qvvtf\"" Jun 09 15:24:02.601647 ip-10-0-130-232 kubenswrapper[2575]: I0609 15:24:02.601622 2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/dashboard-redirect-6dc9d488bd-dlm9n"] Jun 09 15:24:02.607249 ip-10-0-130-232 kubenswrapper[2575]: I0609 15:24:02.607184 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vdpz4\" (UniqueName: \"kubernetes.io/projected/f236fbb3-be5f-4068-beab-dcf4843d0ab8-kube-api-access-vdpz4\") pod \"dashboard-redirect-6dc9d488bd-dlm9n\" (UID: \"f236fbb3-be5f-4068-beab-dcf4843d0ab8\") " pod="opendatahub/dashboard-redirect-6dc9d488bd-dlm9n" Jun 09 15:24:02.607249 ip-10-0-130-232 kubenswrapper[2575]: I0609 15:24:02.607223 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"redirect-config\" (UniqueName: \"kubernetes.io/configmap/f236fbb3-be5f-4068-beab-dcf4843d0ab8-redirect-config\") pod \"dashboard-redirect-6dc9d488bd-dlm9n\" (UID: \"f236fbb3-be5f-4068-beab-dcf4843d0ab8\") " pod="opendatahub/dashboard-redirect-6dc9d488bd-dlm9n" Jun 09 15:24:02.634869 ip-10-0-130-232 kubenswrapper[2575]: I0609 15:24:02.634820 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2bkzp_41532b1e-300d-4a9e-a64f-da302213062c/konnectivity-agent/0.log" limit=1024 Jun 09 15:24:02.707781 ip-10-0-130-232 kubenswrapper[2575]: I0609 15:24:02.707737 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vdpz4\" (UniqueName: \"kubernetes.io/projected/f236fbb3-be5f-4068-beab-dcf4843d0ab8-kube-api-access-vdpz4\") pod \"dashboard-redirect-6dc9d488bd-dlm9n\" (UID: \"f236fbb3-be5f-4068-beab-dcf4843d0ab8\") " pod="opendatahub/dashboard-redirect-6dc9d488bd-dlm9n" Jun 09 15:24:02.707781 ip-10-0-130-232 kubenswrapper[2575]: I0609 15:24:02.707781 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"redirect-config\" (UniqueName: \"kubernetes.io/configmap/f236fbb3-be5f-4068-beab-dcf4843d0ab8-redirect-config\") pod \"dashboard-redirect-6dc9d488bd-dlm9n\" (UID: \"f236fbb3-be5f-4068-beab-dcf4843d0ab8\") " pod="opendatahub/dashboard-redirect-6dc9d488bd-dlm9n" Jun 09 15:24:02.708518 ip-10-0-130-232 kubenswrapper[2575]: I0609 15:24:02.708495 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"redirect-config\" (UniqueName: \"kubernetes.io/configmap/f236fbb3-be5f-4068-beab-dcf4843d0ab8-redirect-config\") pod \"dashboard-redirect-6dc9d488bd-dlm9n\" (UID: \"f236fbb3-be5f-4068-beab-dcf4843d0ab8\") " pod="opendatahub/dashboard-redirect-6dc9d488bd-dlm9n" Jun 09 15:24:02.721019 ip-10-0-130-232 kubenswrapper[2575]: I0609 15:24:02.720995 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-vdpz4\" (UniqueName: \"kubernetes.io/projected/f236fbb3-be5f-4068-beab-dcf4843d0ab8-kube-api-access-vdpz4\") pod \"dashboard-redirect-6dc9d488bd-dlm9n\" (UID: \"f236fbb3-be5f-4068-beab-dcf4843d0ab8\") " pod="opendatahub/dashboard-redirect-6dc9d488bd-dlm9n" Jun 09 15:24:02.807430 ip-10-0-130-232 kubenswrapper[2575]: I0609 15:24:02.807386 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-operators/servicemesh-operator3-57f65f65fb-gpn2m" event={"ID":"005e285f-a485-413b-984c-f76c991dcd99","Type":"ContainerStarted","Data":"77aa9b64e4c61f71f4b1af2d831e34e203f7ae38810d556e88f35de990ad969b"} Jun 09 15:24:02.903935 ip-10-0-130-232 kubenswrapper[2575]: I0609 15:24:02.903830 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/dashboard-redirect-6dc9d488bd-dlm9n" Jun 09 15:24:03.054171 ip-10-0-130-232 kubenswrapper[2575]: I0609 15:24:03.054137 2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/dashboard-redirect-6dc9d488bd-dlm9n"] Jun 09 15:24:03.055944 ip-10-0-130-232 kubenswrapper[2575]: W0609 15:24:03.055917 2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf236fbb3_be5f_4068_beab_dcf4843d0ab8.slice/crio-438ab94c0ca5586e6dad60a6c612b464a3a834e3a5cef3dae368da72798625a4 WatchSource:0}: Error finding container 438ab94c0ca5586e6dad60a6c612b464a3a834e3a5cef3dae368da72798625a4: Status 404 returned error can't find the container with id 438ab94c0ca5586e6dad60a6c612b464a3a834e3a5cef3dae368da72798625a4 Jun 09 15:24:03.815528 ip-10-0-130-232 kubenswrapper[2575]: I0609 15:24:03.815452 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/dashboard-redirect-6dc9d488bd-dlm9n" event={"ID":"f236fbb3-be5f-4068-beab-dcf4843d0ab8","Type":"ContainerStarted","Data":"438ab94c0ca5586e6dad60a6c612b464a3a834e3a5cef3dae368da72798625a4"} Jun 09 15:24:04.045376 ip-10-0-130-232 kubenswrapper[2575]: I0609 15:24:04.045342 2575 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-67f5557876-pw9x9"] Jun 09 15:24:04.051794 ip-10-0-130-232 kubenswrapper[2575]: I0609 15:24:04.051772 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-67f5557876-pw9x9" Jun 09 15:24:04.055141 ip-10-0-130-232 kubenswrapper[2575]: I0609 15:24:04.055117 2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-oauth-config\"" Jun 09 15:24:04.055406 ip-10-0-130-232 kubenswrapper[2575]: I0609 15:24:04.055391 2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"console-config\"" Jun 09 15:24:04.056052 ip-10-0-130-232 kubenswrapper[2575]: I0609 15:24:04.056009 2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"kube-root-ca.crt\"" Jun 09 15:24:04.056284 ip-10-0-130-232 kubenswrapper[2575]: I0609 15:24:04.056264 2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"service-ca\"" Jun 09 15:24:04.056377 ip-10-0-130-232 kubenswrapper[2575]: I0609 15:24:04.056268 2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-serving-cert\"" Jun 09 15:24:04.056377 ip-10-0-130-232 kubenswrapper[2575]: I0609 15:24:04.056350 2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-dockercfg-9g5w9\"" Jun 09 15:24:04.056377 ip-10-0-130-232 kubenswrapper[2575]: I0609 15:24:04.056372 2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"oauth-serving-cert\"" Jun 09 15:24:04.056513 ip-10-0-130-232 kubenswrapper[2575]: I0609 15:24:04.056381 2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"openshift-service-ca.crt\"" Jun 09 15:24:04.073378 ip-10-0-130-232 kubenswrapper[2575]: I0609 15:24:04.073326 2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-67f5557876-pw9x9"] Jun 09 15:24:04.076517 ip-10-0-130-232 kubenswrapper[2575]: I0609 15:24:04.076494 2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"trusted-ca-bundle\"" Jun 09 15:24:04.115953 ip-10-0-130-232 kubenswrapper[2575]: I0609 15:24:04.115927 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9c55c\" (UniqueName: \"kubernetes.io/projected/f32cf6f1-f22b-452a-aa42-972aa676a6c8-kube-api-access-9c55c\") pod \"console-67f5557876-pw9x9\" (UID: \"f32cf6f1-f22b-452a-aa42-972aa676a6c8\") " pod="openshift-console/console-67f5557876-pw9x9" Jun 09 15:24:04.116092 ip-10-0-130-232 kubenswrapper[2575]: I0609 15:24:04.115970 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/f32cf6f1-f22b-452a-aa42-972aa676a6c8-console-oauth-config\") pod \"console-67f5557876-pw9x9\" (UID: \"f32cf6f1-f22b-452a-aa42-972aa676a6c8\") " pod="openshift-console/console-67f5557876-pw9x9" Jun 09 15:24:04.116092 ip-10-0-130-232 kubenswrapper[2575]: I0609 15:24:04.116017 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/f32cf6f1-f22b-452a-aa42-972aa676a6c8-console-serving-cert\") pod \"console-67f5557876-pw9x9\" (UID: \"f32cf6f1-f22b-452a-aa42-972aa676a6c8\") " pod="openshift-console/console-67f5557876-pw9x9" Jun 09 15:24:04.116092 ip-10-0-130-232 kubenswrapper[2575]: I0609 15:24:04.116049 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/f32cf6f1-f22b-452a-aa42-972aa676a6c8-trusted-ca-bundle\") pod \"console-67f5557876-pw9x9\" (UID: \"f32cf6f1-f22b-452a-aa42-972aa676a6c8\") " pod="openshift-console/console-67f5557876-pw9x9" Jun 09 15:24:04.116195 ip-10-0-130-232 kubenswrapper[2575]: I0609 15:24:04.116102 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/f32cf6f1-f22b-452a-aa42-972aa676a6c8-oauth-serving-cert\") pod \"console-67f5557876-pw9x9\" (UID: \"f32cf6f1-f22b-452a-aa42-972aa676a6c8\") " pod="openshift-console/console-67f5557876-pw9x9" Jun 09 15:24:04.116195 ip-10-0-130-232 kubenswrapper[2575]: I0609 15:24:04.116142 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/f32cf6f1-f22b-452a-aa42-972aa676a6c8-service-ca\") pod \"console-67f5557876-pw9x9\" (UID: \"f32cf6f1-f22b-452a-aa42-972aa676a6c8\") " pod="openshift-console/console-67f5557876-pw9x9" Jun 09 15:24:04.116195 ip-10-0-130-232 kubenswrapper[2575]: I0609 15:24:04.116175 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/f32cf6f1-f22b-452a-aa42-972aa676a6c8-console-config\") pod \"console-67f5557876-pw9x9\" (UID: \"f32cf6f1-f22b-452a-aa42-972aa676a6c8\") " pod="openshift-console/console-67f5557876-pw9x9" Jun 09 15:24:04.149278 ip-10-0-130-232 kubenswrapper[2575]: I0609 15:24:04.149219 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2bkzp_41532b1e-300d-4a9e-a64f-da302213062c/konnectivity-agent/0.log" limit=1024 Jun 09 15:24:04.216998 ip-10-0-130-232 kubenswrapper[2575]: I0609 15:24:04.216958 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9c55c\" (UniqueName: \"kubernetes.io/projected/f32cf6f1-f22b-452a-aa42-972aa676a6c8-kube-api-access-9c55c\") pod \"console-67f5557876-pw9x9\" (UID: \"f32cf6f1-f22b-452a-aa42-972aa676a6c8\") " pod="openshift-console/console-67f5557876-pw9x9" Jun 09 15:24:04.217191 ip-10-0-130-232 kubenswrapper[2575]: I0609 15:24:04.217035 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/f32cf6f1-f22b-452a-aa42-972aa676a6c8-console-oauth-config\") pod \"console-67f5557876-pw9x9\" (UID: \"f32cf6f1-f22b-452a-aa42-972aa676a6c8\") " pod="openshift-console/console-67f5557876-pw9x9" Jun 09 15:24:04.217191 ip-10-0-130-232 kubenswrapper[2575]: I0609 15:24:04.217066 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/f32cf6f1-f22b-452a-aa42-972aa676a6c8-console-serving-cert\") pod \"console-67f5557876-pw9x9\" (UID: \"f32cf6f1-f22b-452a-aa42-972aa676a6c8\") " pod="openshift-console/console-67f5557876-pw9x9" Jun 09 15:24:04.217191 ip-10-0-130-232 kubenswrapper[2575]: I0609 15:24:04.217092 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/f32cf6f1-f22b-452a-aa42-972aa676a6c8-trusted-ca-bundle\") pod \"console-67f5557876-pw9x9\" (UID: \"f32cf6f1-f22b-452a-aa42-972aa676a6c8\") " pod="openshift-console/console-67f5557876-pw9x9" Jun 09 15:24:04.217191 ip-10-0-130-232 kubenswrapper[2575]: I0609 15:24:04.217121 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/f32cf6f1-f22b-452a-aa42-972aa676a6c8-oauth-serving-cert\") pod \"console-67f5557876-pw9x9\" (UID: \"f32cf6f1-f22b-452a-aa42-972aa676a6c8\") " pod="openshift-console/console-67f5557876-pw9x9" Jun 09 15:24:04.217191 ip-10-0-130-232 kubenswrapper[2575]: I0609 15:24:04.217181 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/f32cf6f1-f22b-452a-aa42-972aa676a6c8-service-ca\") pod \"console-67f5557876-pw9x9\" (UID: \"f32cf6f1-f22b-452a-aa42-972aa676a6c8\") " pod="openshift-console/console-67f5557876-pw9x9" Jun 09 15:24:04.217494 ip-10-0-130-232 kubenswrapper[2575]: I0609 15:24:04.217209 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/f32cf6f1-f22b-452a-aa42-972aa676a6c8-console-config\") pod \"console-67f5557876-pw9x9\" (UID: \"f32cf6f1-f22b-452a-aa42-972aa676a6c8\") " pod="openshift-console/console-67f5557876-pw9x9" Jun 09 15:24:04.218029 ip-10-0-130-232 kubenswrapper[2575]: I0609 15:24:04.218002 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/f32cf6f1-f22b-452a-aa42-972aa676a6c8-oauth-serving-cert\") pod \"console-67f5557876-pw9x9\" (UID: \"f32cf6f1-f22b-452a-aa42-972aa676a6c8\") " pod="openshift-console/console-67f5557876-pw9x9" Jun 09 15:24:04.218186 ip-10-0-130-232 kubenswrapper[2575]: I0609 15:24:04.218002 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/f32cf6f1-f22b-452a-aa42-972aa676a6c8-console-config\") pod \"console-67f5557876-pw9x9\" (UID: \"f32cf6f1-f22b-452a-aa42-972aa676a6c8\") " pod="openshift-console/console-67f5557876-pw9x9" Jun 09 15:24:04.218186 ip-10-0-130-232 kubenswrapper[2575]: I0609 15:24:04.218146 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/f32cf6f1-f22b-452a-aa42-972aa676a6c8-service-ca\") pod \"console-67f5557876-pw9x9\" (UID: \"f32cf6f1-f22b-452a-aa42-972aa676a6c8\") " pod="openshift-console/console-67f5557876-pw9x9" Jun 09 15:24:04.218548 ip-10-0-130-232 kubenswrapper[2575]: I0609 15:24:04.218500 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/f32cf6f1-f22b-452a-aa42-972aa676a6c8-trusted-ca-bundle\") pod \"console-67f5557876-pw9x9\" (UID: \"f32cf6f1-f22b-452a-aa42-972aa676a6c8\") " pod="openshift-console/console-67f5557876-pw9x9" Jun 09 15:24:04.220252 ip-10-0-130-232 kubenswrapper[2575]: I0609 15:24:04.220222 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/f32cf6f1-f22b-452a-aa42-972aa676a6c8-console-serving-cert\") pod \"console-67f5557876-pw9x9\" (UID: \"f32cf6f1-f22b-452a-aa42-972aa676a6c8\") " pod="openshift-console/console-67f5557876-pw9x9" Jun 09 15:24:04.220374 ip-10-0-130-232 kubenswrapper[2575]: I0609 15:24:04.220279 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/f32cf6f1-f22b-452a-aa42-972aa676a6c8-console-oauth-config\") pod \"console-67f5557876-pw9x9\" (UID: \"f32cf6f1-f22b-452a-aa42-972aa676a6c8\") " pod="openshift-console/console-67f5557876-pw9x9" Jun 09 15:24:04.225640 ip-10-0-130-232 kubenswrapper[2575]: I0609 15:24:04.225616 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-9c55c\" (UniqueName: \"kubernetes.io/projected/f32cf6f1-f22b-452a-aa42-972aa676a6c8-kube-api-access-9c55c\") pod \"console-67f5557876-pw9x9\" (UID: \"f32cf6f1-f22b-452a-aa42-972aa676a6c8\") " pod="openshift-console/console-67f5557876-pw9x9" Jun 09 15:24:04.250305 ip-10-0-130-232 kubenswrapper[2575]: I0609 15:24:04.250278 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2bkzp_41532b1e-300d-4a9e-a64f-da302213062c/konnectivity-agent/0.log" limit=1024 Jun 09 15:24:04.349294 ip-10-0-130-232 kubenswrapper[2575]: I0609 15:24:04.349208 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2bkzp_41532b1e-300d-4a9e-a64f-da302213062c/konnectivity-agent/0.log" limit=1024 Jun 09 15:24:04.364119 ip-10-0-130-232 kubenswrapper[2575]: I0609 15:24:04.364087 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-67f5557876-pw9x9" Jun 09 15:24:04.827788 ip-10-0-130-232 kubenswrapper[2575]: I0609 15:24:04.827743 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2bkzp_41532b1e-300d-4a9e-a64f-da302213062c/konnectivity-agent/0.log" limit=1024 Jun 09 15:24:04.932935 ip-10-0-130-232 kubenswrapper[2575]: I0609 15:24:04.932903 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2bkzp_41532b1e-300d-4a9e-a64f-da302213062c/konnectivity-agent/0.log" limit=1024 Jun 09 15:24:05.211183 ip-10-0-130-232 kubenswrapper[2575]: I0609 15:24:05.211062 2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-67f5557876-pw9x9"] Jun 09 15:24:05.214412 ip-10-0-130-232 kubenswrapper[2575]: W0609 15:24:05.214383 2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf32cf6f1_f22b_452a_aa42_972aa676a6c8.slice/crio-3f4b5a2eeb347a1d540e81436846b8e397b08197370db679034705aa19c7ee13 WatchSource:0}: Error finding container 3f4b5a2eeb347a1d540e81436846b8e397b08197370db679034705aa19c7ee13: Status 404 returned error can't find the container with id 3f4b5a2eeb347a1d540e81436846b8e397b08197370db679034705aa19c7ee13 Jun 09 15:24:05.831099 ip-10-0-130-232 kubenswrapper[2575]: I0609 15:24:05.831057 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-operators/servicemesh-operator3-57f65f65fb-gpn2m" event={"ID":"005e285f-a485-413b-984c-f76c991dcd99","Type":"ContainerStarted","Data":"e31c83cb87014d1a3fa2b54e65e76cda19fba4203fb2234357782306bd9072ee"} Jun 09 15:24:05.831554 ip-10-0-130-232 kubenswrapper[2575]: I0609 15:24:05.831215 2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-operators/servicemesh-operator3-57f65f65fb-gpn2m" Jun 09 15:24:05.833577 ip-10-0-130-232 kubenswrapper[2575]: I0609 15:24:05.833549 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-67f5557876-pw9x9" event={"ID":"f32cf6f1-f22b-452a-aa42-972aa676a6c8","Type":"ContainerStarted","Data":"1fc7207e0bb5d463150579ad761db28675e4529c241603f543151fcdcf4ef960"} Jun 09 15:24:05.833718 ip-10-0-130-232 kubenswrapper[2575]: I0609 15:24:05.833604 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-67f5557876-pw9x9" event={"ID":"f32cf6f1-f22b-452a-aa42-972aa676a6c8","Type":"ContainerStarted","Data":"3f4b5a2eeb347a1d540e81436846b8e397b08197370db679034705aa19c7ee13"} Jun 09 15:24:05.853450 ip-10-0-130-232 kubenswrapper[2575]: I0609 15:24:05.853384 2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-operators/servicemesh-operator3-57f65f65fb-gpn2m" podStartSLOduration=2.081942735 podStartE2EDuration="4.853360661s" totalImagesPullingTime="2.771417926s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-09 15:24:01 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-09 15:24:05.850480606 +0000 UTC m=+585.538486083" watchObservedRunningTime="2026-06-09 15:24:05.853360661 +0000 UTC m=+585.541366115" Jun 09 15:24:05.870236 ip-10-0-130-232 kubenswrapper[2575]: I0609 15:24:05.869689 2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-67f5557876-pw9x9" podStartSLOduration=1.86966342 podStartE2EDuration="1.86966342s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-09 15:24:04 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-09 15:24:05.867319429 +0000 UTC m=+585.555324883" watchObservedRunningTime="2026-06-09 15:24:05.86966342 +0000 UTC m=+585.557668874" Jun 09 15:24:06.840573 ip-10-0-130-232 kubenswrapper[2575]: I0609 15:24:06.840490 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/dashboard-redirect-6dc9d488bd-dlm9n" event={"ID":"f236fbb3-be5f-4068-beab-dcf4843d0ab8","Type":"ContainerStarted","Data":"3e909e3dcfc456dd9b8a19db686f28c1eca402dff5dcb4552f5e1c3ed5ec3129"} Jun 09 15:24:06.861532 ip-10-0-130-232 kubenswrapper[2575]: I0609 15:24:06.861484 2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/dashboard-redirect-6dc9d488bd-dlm9n" podStartSLOduration=1.369320036 podStartE2EDuration="4.861470474s" totalImagesPullingTime="3.492150438s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-09 15:24:02 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-09 15:24:06.859905425 +0000 UTC m=+586.547910878" watchObservedRunningTime="2026-06-09 15:24:06.861470474 +0000 UTC m=+586.549475926" Jun 09 15:24:12.092483 ip-10-0-130-232 kubenswrapper[2575]: I0609 15:24:12.092447 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2bkzp_41532b1e-300d-4a9e-a64f-da302213062c/konnectivity-agent/0.log" limit=1024 Jun 09 15:24:13.220026 ip-10-0-130-232 kubenswrapper[2575]: I0609 15:24:13.219991 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2bkzp_41532b1e-300d-4a9e-a64f-da302213062c/konnectivity-agent/0.log" limit=1024 Jun 09 15:24:14.364748 ip-10-0-130-232 kubenswrapper[2575]: I0609 15:24:14.364714 2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-67f5557876-pw9x9" Jun 09 15:24:14.365128 ip-10-0-130-232 kubenswrapper[2575]: I0609 15:24:14.364787 2575 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-67f5557876-pw9x9" Jun 09 15:24:14.369510 ip-10-0-130-232 kubenswrapper[2575]: I0609 15:24:14.369490 2575 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-67f5557876-pw9x9" Jun 09 15:24:14.880306 ip-10-0-130-232 kubenswrapper[2575]: I0609 15:24:14.880277 2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-67f5557876-pw9x9" Jun 09 15:24:15.032135 ip-10-0-130-232 kubenswrapper[2575]: I0609 15:24:15.032104 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2bkzp_41532b1e-300d-4a9e-a64f-da302213062c/konnectivity-agent/0.log" limit=1024 Jun 09 15:24:15.126082 ip-10-0-130-232 kubenswrapper[2575]: I0609 15:24:15.126050 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2bkzp_41532b1e-300d-4a9e-a64f-da302213062c/konnectivity-agent/0.log" limit=1024 Jun 09 15:24:15.226562 ip-10-0-130-232 kubenswrapper[2575]: I0609 15:24:15.226531 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2bkzp_41532b1e-300d-4a9e-a64f-da302213062c/konnectivity-agent/0.log" limit=1024 Jun 09 15:24:15.398819 ip-10-0-130-232 kubenswrapper[2575]: I0609 15:24:15.398791 2575 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/istiod-openshift-gateway-75c67f8887-rwsxh"] Jun 09 15:24:15.402294 ip-10-0-130-232 kubenswrapper[2575]: I0609 15:24:15.402274 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/istiod-openshift-gateway-75c67f8887-rwsxh" Jun 09 15:24:15.402686 ip-10-0-130-232 kubenswrapper[2575]: I0609 15:24:15.402558 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2bkzp_41532b1e-300d-4a9e-a64f-da302213062c/konnectivity-agent/0.log" limit=1024 Jun 09 15:24:15.404263 ip-10-0-130-232 kubenswrapper[2575]: I0609 15:24:15.404229 2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-gw-ca-root-cert\"" Jun 09 15:24:15.404453 ip-10-0-130-232 kubenswrapper[2575]: I0609 15:24:15.404434 2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"istio-kubeconfig\"" Jun 09 15:24:15.404581 ip-10-0-130-232 kubenswrapper[2575]: I0609 15:24:15.404496 2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"istiod-openshift-gateway-dockercfg-7fzjv\"" Jun 09 15:24:15.404581 ip-10-0-130-232 kubenswrapper[2575]: I0609 15:24:15.404520 2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"cacerts\"" Jun 09 15:24:15.404692 ip-10-0-130-232 kubenswrapper[2575]: I0609 15:24:15.404636 2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"istiod-tls\"" Jun 09 15:24:15.413208 ip-10-0-130-232 kubenswrapper[2575]: I0609 15:24:15.413189 2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-75c67f8887-rwsxh"] Jun 09 15:24:15.501428 ip-10-0-130-232 kubenswrapper[2575]: I0609 15:24:15.501351 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2bkzp_41532b1e-300d-4a9e-a64f-da302213062c/konnectivity-agent/0.log" limit=1024 Jun 09 15:24:15.517001 ip-10-0-130-232 kubenswrapper[2575]: I0609 15:24:15.516978 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/6850508b-e6e7-40f7-93bb-dc898dabcf14-istio-token\") pod \"istiod-openshift-gateway-75c67f8887-rwsxh\" (UID: \"6850508b-e6e7-40f7-93bb-dc898dabcf14\") " pod="openshift-ingress/istiod-openshift-gateway-75c67f8887-rwsxh" Jun 09 15:24:15.517076 ip-10-0-130-232 kubenswrapper[2575]: I0609 15:24:15.517005 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/6850508b-e6e7-40f7-93bb-dc898dabcf14-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-75c67f8887-rwsxh\" (UID: \"6850508b-e6e7-40f7-93bb-dc898dabcf14\") " pod="openshift-ingress/istiod-openshift-gateway-75c67f8887-rwsxh" Jun 09 15:24:15.517076 ip-10-0-130-232 kubenswrapper[2575]: I0609 15:24:15.517033 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/6850508b-e6e7-40f7-93bb-dc898dabcf14-istio-kubeconfig\") pod \"istiod-openshift-gateway-75c67f8887-rwsxh\" (UID: \"6850508b-e6e7-40f7-93bb-dc898dabcf14\") " pod="openshift-ingress/istiod-openshift-gateway-75c67f8887-rwsxh" Jun 09 15:24:15.517076 ip-10-0-130-232 kubenswrapper[2575]: I0609 15:24:15.517057 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qs28h\" (UniqueName: \"kubernetes.io/projected/6850508b-e6e7-40f7-93bb-dc898dabcf14-kube-api-access-qs28h\") pod \"istiod-openshift-gateway-75c67f8887-rwsxh\" (UID: \"6850508b-e6e7-40f7-93bb-dc898dabcf14\") " pod="openshift-ingress/istiod-openshift-gateway-75c67f8887-rwsxh" Jun 09 15:24:15.517176 ip-10-0-130-232 kubenswrapper[2575]: I0609 15:24:15.517119 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/6850508b-e6e7-40f7-93bb-dc898dabcf14-local-certs\") pod \"istiod-openshift-gateway-75c67f8887-rwsxh\" (UID: \"6850508b-e6e7-40f7-93bb-dc898dabcf14\") " pod="openshift-ingress/istiod-openshift-gateway-75c67f8887-rwsxh" Jun 09 15:24:15.517176 ip-10-0-130-232 kubenswrapper[2575]: I0609 15:24:15.517149 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/6850508b-e6e7-40f7-93bb-dc898dabcf14-cacerts\") pod \"istiod-openshift-gateway-75c67f8887-rwsxh\" (UID: \"6850508b-e6e7-40f7-93bb-dc898dabcf14\") " pod="openshift-ingress/istiod-openshift-gateway-75c67f8887-rwsxh" Jun 09 15:24:15.517236 ip-10-0-130-232 kubenswrapper[2575]: I0609 15:24:15.517192 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/6850508b-e6e7-40f7-93bb-dc898dabcf14-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-75c67f8887-rwsxh\" (UID: \"6850508b-e6e7-40f7-93bb-dc898dabcf14\") " pod="openshift-ingress/istiod-openshift-gateway-75c67f8887-rwsxh" Jun 09 15:24:15.617716 ip-10-0-130-232 kubenswrapper[2575]: I0609 15:24:15.617677 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/6850508b-e6e7-40f7-93bb-dc898dabcf14-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-75c67f8887-rwsxh\" (UID: \"6850508b-e6e7-40f7-93bb-dc898dabcf14\") " pod="openshift-ingress/istiod-openshift-gateway-75c67f8887-rwsxh" Jun 09 15:24:15.617927 ip-10-0-130-232 kubenswrapper[2575]: I0609 15:24:15.617725 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/6850508b-e6e7-40f7-93bb-dc898dabcf14-istio-token\") pod \"istiod-openshift-gateway-75c67f8887-rwsxh\" (UID: \"6850508b-e6e7-40f7-93bb-dc898dabcf14\") " pod="openshift-ingress/istiod-openshift-gateway-75c67f8887-rwsxh" Jun 09 15:24:15.617927 ip-10-0-130-232 kubenswrapper[2575]: I0609 15:24:15.617753 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/6850508b-e6e7-40f7-93bb-dc898dabcf14-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-75c67f8887-rwsxh\" (UID: \"6850508b-e6e7-40f7-93bb-dc898dabcf14\") " pod="openshift-ingress/istiod-openshift-gateway-75c67f8887-rwsxh" Jun 09 15:24:15.617927 ip-10-0-130-232 kubenswrapper[2575]: I0609 15:24:15.617792 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/6850508b-e6e7-40f7-93bb-dc898dabcf14-istio-kubeconfig\") pod \"istiod-openshift-gateway-75c67f8887-rwsxh\" (UID: \"6850508b-e6e7-40f7-93bb-dc898dabcf14\") " pod="openshift-ingress/istiod-openshift-gateway-75c67f8887-rwsxh" Jun 09 15:24:15.617927 ip-10-0-130-232 kubenswrapper[2575]: I0609 15:24:15.617831 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qs28h\" (UniqueName: \"kubernetes.io/projected/6850508b-e6e7-40f7-93bb-dc898dabcf14-kube-api-access-qs28h\") pod \"istiod-openshift-gateway-75c67f8887-rwsxh\" (UID: \"6850508b-e6e7-40f7-93bb-dc898dabcf14\") " pod="openshift-ingress/istiod-openshift-gateway-75c67f8887-rwsxh" Jun 09 15:24:15.617927 ip-10-0-130-232 kubenswrapper[2575]: I0609 15:24:15.617898 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/6850508b-e6e7-40f7-93bb-dc898dabcf14-local-certs\") pod \"istiod-openshift-gateway-75c67f8887-rwsxh\" (UID: \"6850508b-e6e7-40f7-93bb-dc898dabcf14\") " pod="openshift-ingress/istiod-openshift-gateway-75c67f8887-rwsxh" Jun 09 15:24:15.617927 ip-10-0-130-232 kubenswrapper[2575]: I0609 15:24:15.617925 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/6850508b-e6e7-40f7-93bb-dc898dabcf14-cacerts\") pod \"istiod-openshift-gateway-75c67f8887-rwsxh\" (UID: \"6850508b-e6e7-40f7-93bb-dc898dabcf14\") " pod="openshift-ingress/istiod-openshift-gateway-75c67f8887-rwsxh" Jun 09 15:24:15.618429 ip-10-0-130-232 kubenswrapper[2575]: I0609 15:24:15.618401 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/6850508b-e6e7-40f7-93bb-dc898dabcf14-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-75c67f8887-rwsxh\" (UID: \"6850508b-e6e7-40f7-93bb-dc898dabcf14\") " pod="openshift-ingress/istiod-openshift-gateway-75c67f8887-rwsxh" Jun 09 15:24:15.620475 ip-10-0-130-232 kubenswrapper[2575]: I0609 15:24:15.620444 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/6850508b-e6e7-40f7-93bb-dc898dabcf14-local-certs\") pod \"istiod-openshift-gateway-75c67f8887-rwsxh\" (UID: \"6850508b-e6e7-40f7-93bb-dc898dabcf14\") " pod="openshift-ingress/istiod-openshift-gateway-75c67f8887-rwsxh" Jun 09 15:24:15.620718 ip-10-0-130-232 kubenswrapper[2575]: I0609 15:24:15.620698 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/6850508b-e6e7-40f7-93bb-dc898dabcf14-istio-kubeconfig\") pod \"istiod-openshift-gateway-75c67f8887-rwsxh\" (UID: \"6850508b-e6e7-40f7-93bb-dc898dabcf14\") " pod="openshift-ingress/istiod-openshift-gateway-75c67f8887-rwsxh" Jun 09 15:24:15.620914 ip-10-0-130-232 kubenswrapper[2575]: I0609 15:24:15.620892 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/6850508b-e6e7-40f7-93bb-dc898dabcf14-cacerts\") pod \"istiod-openshift-gateway-75c67f8887-rwsxh\" (UID: \"6850508b-e6e7-40f7-93bb-dc898dabcf14\") " pod="openshift-ingress/istiod-openshift-gateway-75c67f8887-rwsxh" Jun 09 15:24:15.620987 ip-10-0-130-232 kubenswrapper[2575]: I0609 15:24:15.620892 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/6850508b-e6e7-40f7-93bb-dc898dabcf14-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-75c67f8887-rwsxh\" (UID: \"6850508b-e6e7-40f7-93bb-dc898dabcf14\") " pod="openshift-ingress/istiod-openshift-gateway-75c67f8887-rwsxh" Jun 09 15:24:15.625388 ip-10-0-130-232 kubenswrapper[2575]: I0609 15:24:15.625367 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/6850508b-e6e7-40f7-93bb-dc898dabcf14-istio-token\") pod \"istiod-openshift-gateway-75c67f8887-rwsxh\" (UID: \"6850508b-e6e7-40f7-93bb-dc898dabcf14\") " pod="openshift-ingress/istiod-openshift-gateway-75c67f8887-rwsxh" Jun 09 15:24:15.625735 ip-10-0-130-232 kubenswrapper[2575]: I0609 15:24:15.625713 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-qs28h\" (UniqueName: \"kubernetes.io/projected/6850508b-e6e7-40f7-93bb-dc898dabcf14-kube-api-access-qs28h\") pod \"istiod-openshift-gateway-75c67f8887-rwsxh\" (UID: \"6850508b-e6e7-40f7-93bb-dc898dabcf14\") " pod="openshift-ingress/istiod-openshift-gateway-75c67f8887-rwsxh" Jun 09 15:24:15.712521 ip-10-0-130-232 kubenswrapper[2575]: I0609 15:24:15.712493 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/istiod-openshift-gateway-75c67f8887-rwsxh" Jun 09 15:24:15.848990 ip-10-0-130-232 kubenswrapper[2575]: I0609 15:24:15.848962 2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-75c67f8887-rwsxh"] Jun 09 15:24:15.850717 ip-10-0-130-232 kubenswrapper[2575]: W0609 15:24:15.850679 2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6850508b_e6e7_40f7_93bb_dc898dabcf14.slice/crio-1e1939fa78e0fb3f4368c627e9fdbabdaa10df7a856a7f7757d0717283c19183 WatchSource:0}: Error finding container 1e1939fa78e0fb3f4368c627e9fdbabdaa10df7a856a7f7757d0717283c19183: Status 404 returned error can't find the container with id 1e1939fa78e0fb3f4368c627e9fdbabdaa10df7a856a7f7757d0717283c19183 Jun 09 15:24:15.882208 ip-10-0-130-232 kubenswrapper[2575]: I0609 15:24:15.882177 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/istiod-openshift-gateway-75c67f8887-rwsxh" event={"ID":"6850508b-e6e7-40f7-93bb-dc898dabcf14","Type":"ContainerStarted","Data":"1e1939fa78e0fb3f4368c627e9fdbabdaa10df7a856a7f7757d0717283c19183"} Jun 09 15:24:15.962281 ip-10-0-130-232 kubenswrapper[2575]: I0609 15:24:15.962244 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2bkzp_41532b1e-300d-4a9e-a64f-da302213062c/konnectivity-agent/0.log" limit=1024 Jun 09 15:24:16.844464 ip-10-0-130-232 kubenswrapper[2575]: I0609 15:24:16.844429 2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-operators/servicemesh-operator3-57f65f65fb-gpn2m" Jun 09 15:24:18.741667 ip-10-0-130-232 kubenswrapper[2575]: I0609 15:24:18.741633 2575 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892168Ki","pods":"250"} Jun 09 15:24:18.741933 ip-10-0-130-232 kubenswrapper[2575]: I0609 15:24:18.741701 2575 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892168Ki","pods":"250"} Jun 09 15:24:18.899826 ip-10-0-130-232 kubenswrapper[2575]: I0609 15:24:18.899794 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/istiod-openshift-gateway-75c67f8887-rwsxh" event={"ID":"6850508b-e6e7-40f7-93bb-dc898dabcf14","Type":"ContainerStarted","Data":"1629ee58a5ca569c95c5f8210f5c9723d0b6a7ab35fc611fd4efbd7eeb2faeed"} Jun 09 15:24:18.900008 ip-10-0-130-232 kubenswrapper[2575]: I0609 15:24:18.899968 2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/istiod-openshift-gateway-75c67f8887-rwsxh" Jun 09 15:24:18.920338 ip-10-0-130-232 kubenswrapper[2575]: I0609 15:24:18.920290 2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/istiod-openshift-gateway-75c67f8887-rwsxh" podStartSLOduration=1.031570315 podStartE2EDuration="3.920275741s" totalImagesPullingTime="2.888705426s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-09 15:24:15 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-09 15:24:18.918199991 +0000 UTC m=+598.606205467" watchObservedRunningTime="2026-06-09 15:24:18.920275741 +0000 UTC m=+598.608281194" Jun 09 15:24:19.602202 ip-10-0-130-232 kubenswrapper[2575]: I0609 15:24:19.602167 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2bkzp_41532b1e-300d-4a9e-a64f-da302213062c/konnectivity-agent/0.log" limit=1024 Jun 09 15:24:19.711112 ip-10-0-130-232 kubenswrapper[2575]: I0609 15:24:19.711065 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2bkzp_41532b1e-300d-4a9e-a64f-da302213062c/konnectivity-agent/0.log" limit=1024 Jun 09 15:24:19.905935 ip-10-0-130-232 kubenswrapper[2575]: I0609 15:24:19.905834 2575 patch_prober.go:28] interesting pod/istiod-openshift-gateway-75c67f8887-rwsxh container/discovery namespace/openshift-ingress: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body= Jun 09 15:24:19.906348 ip-10-0-130-232 kubenswrapper[2575]: I0609 15:24:19.905937 2575 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/istiod-openshift-gateway-75c67f8887-rwsxh" podUID="6850508b-e6e7-40f7-93bb-dc898dabcf14" containerName="discovery" probeResult="failure" output="HTTP probe failed with statuscode: 503" Jun 09 15:24:19.963790 ip-10-0-130-232 kubenswrapper[2575]: I0609 15:24:19.963760 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2bkzp_41532b1e-300d-4a9e-a64f-da302213062c/konnectivity-agent/0.log" limit=1024 Jun 09 15:24:20.157339 ip-10-0-130-232 kubenswrapper[2575]: I0609 15:24:20.157244 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2bkzp_41532b1e-300d-4a9e-a64f-da302213062c/konnectivity-agent/0.log" limit=1024 Jun 09 15:24:20.603423 ip-10-0-130-232 kubenswrapper[2575]: I0609 15:24:20.603345 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2bkzp_41532b1e-300d-4a9e-a64f-da302213062c/konnectivity-agent/0.log" limit=1024 Jun 09 15:24:22.905690 ip-10-0-130-232 kubenswrapper[2575]: I0609 15:24:22.905659 2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/istiod-openshift-gateway-75c67f8887-rwsxh" Jun 09 15:24:24.275373 ip-10-0-130-232 kubenswrapper[2575]: I0609 15:24:24.275311 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2bkzp_41532b1e-300d-4a9e-a64f-da302213062c/konnectivity-agent/0.log" limit=1024 Jun 09 15:24:26.781948 ip-10-0-130-232 kubenswrapper[2575]: I0609 15:24:26.781922 2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/llmisvc-controller-manager-864bfd7bc9-9wjl9" Jun 09 15:24:26.784956 ip-10-0-130-232 kubenswrapper[2575]: I0609 15:24:26.784927 2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/kserve-controller-manager-69fc866d76-47qf2" Jun 09 15:24:41.937744 ip-10-0-130-232 kubenswrapper[2575]: I0609 15:24:41.937662 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2bkzp_41532b1e-300d-4a9e-a64f-da302213062c/konnectivity-agent/0.log" limit=1024 Jun 09 15:24:41.991759 ip-10-0-130-232 kubenswrapper[2575]: I0609 15:24:41.991731 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2bkzp_41532b1e-300d-4a9e-a64f-da302213062c/konnectivity-agent/0.log" limit=1024 Jun 09 15:24:42.110713 ip-10-0-130-232 kubenswrapper[2575]: I0609 15:24:42.110668 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2bkzp_41532b1e-300d-4a9e-a64f-da302213062c/konnectivity-agent/0.log" limit=1024 Jun 09 15:25:11.260762 ip-10-0-130-232 kubenswrapper[2575]: I0609 15:25:11.260726 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2bkzp_41532b1e-300d-4a9e-a64f-da302213062c/konnectivity-agent/0.log" limit=1024 Jun 09 15:25:14.706200 ip-10-0-130-232 kubenswrapper[2575]: I0609 15:25:14.706158 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2bkzp_41532b1e-300d-4a9e-a64f-da302213062c/konnectivity-agent/0.log" limit=1024 Jun 09 15:25:16.257075 ip-10-0-130-232 kubenswrapper[2575]: I0609 15:25:16.257043 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2bkzp_41532b1e-300d-4a9e-a64f-da302213062c/konnectivity-agent/0.log" limit=1024 Jun 09 15:25:16.661884 ip-10-0-130-232 kubenswrapper[2575]: I0609 15:25:16.661779 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2bkzp_41532b1e-300d-4a9e-a64f-da302213062c/konnectivity-agent/0.log" limit=1024 Jun 09 15:25:17.708065 ip-10-0-130-232 kubenswrapper[2575]: I0609 15:25:17.708025 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2bkzp_41532b1e-300d-4a9e-a64f-da302213062c/konnectivity-agent/0.log" limit=1024 Jun 09 15:25:19.269437 ip-10-0-130-232 kubenswrapper[2575]: I0609 15:25:19.269400 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2bkzp_41532b1e-300d-4a9e-a64f-da302213062c/konnectivity-agent/0.log" limit=1024 Jun 09 15:25:20.325667 ip-10-0-130-232 kubenswrapper[2575]: I0609 15:25:20.325635 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2bkzp_41532b1e-300d-4a9e-a64f-da302213062c/konnectivity-agent/0.log" limit=1024 Jun 09 15:25:20.677563 ip-10-0-130-232 kubenswrapper[2575]: I0609 15:25:20.677472 2575 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-whrnh"] Jun 09 15:25:20.681408 ip-10-0-130-232 kubenswrapper[2575]: I0609 15:25:20.681375 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-whrnh" Jun 09 15:25:20.684194 ip-10-0-130-232 kubenswrapper[2575]: I0609 15:25:20.684172 2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"kube-root-ca.crt\"" Jun 09 15:25:20.684924 ip-10-0-130-232 kubenswrapper[2575]: I0609 15:25:20.684902 2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"openshift-service-ca.crt\"" Jun 09 15:25:20.685006 ip-10-0-130-232 kubenswrapper[2575]: I0609 15:25:20.684913 2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"limitador-operator-controller-manager-dockercfg-sgftk\"" Jun 09 15:25:20.690195 ip-10-0-130-232 kubenswrapper[2575]: I0609 15:25:20.690170 2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-whrnh"] Jun 09 15:25:20.774048 ip-10-0-130-232 kubenswrapper[2575]: I0609 15:25:20.774019 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hzh6q\" (UniqueName: \"kubernetes.io/projected/b18f6336-55a0-4455-8404-0e53c1fc387a-kube-api-access-hzh6q\") pod \"limitador-operator-controller-manager-859d7b78bd-whrnh\" (UID: \"b18f6336-55a0-4455-8404-0e53c1fc387a\") " pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-whrnh" Jun 09 15:25:20.874594 ip-10-0-130-232 kubenswrapper[2575]: I0609 15:25:20.874564 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hzh6q\" (UniqueName: \"kubernetes.io/projected/b18f6336-55a0-4455-8404-0e53c1fc387a-kube-api-access-hzh6q\") pod \"limitador-operator-controller-manager-859d7b78bd-whrnh\" (UID: \"b18f6336-55a0-4455-8404-0e53c1fc387a\") " pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-whrnh" Jun 09 15:25:20.886943 ip-10-0-130-232 kubenswrapper[2575]: I0609 15:25:20.886923 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-hzh6q\" (UniqueName: \"kubernetes.io/projected/b18f6336-55a0-4455-8404-0e53c1fc387a-kube-api-access-hzh6q\") pod \"limitador-operator-controller-manager-859d7b78bd-whrnh\" (UID: \"b18f6336-55a0-4455-8404-0e53c1fc387a\") " pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-whrnh" Jun 09 15:25:20.992973 ip-10-0-130-232 kubenswrapper[2575]: I0609 15:25:20.992950 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-whrnh" Jun 09 15:25:21.122586 ip-10-0-130-232 kubenswrapper[2575]: I0609 15:25:21.122562 2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-whrnh"] Jun 09 15:25:21.125016 ip-10-0-130-232 kubenswrapper[2575]: W0609 15:25:21.124986 2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb18f6336_55a0_4455_8404_0e53c1fc387a.slice/crio-b604e57c8db2c678325f5d5268fa4720e987197bc6ff3de079b9eb65923b9104 WatchSource:0}: Error finding container b604e57c8db2c678325f5d5268fa4720e987197bc6ff3de079b9eb65923b9104: Status 404 returned error can't find the container with id b604e57c8db2c678325f5d5268fa4720e987197bc6ff3de079b9eb65923b9104 Jun 09 15:25:21.182133 ip-10-0-130-232 kubenswrapper[2575]: I0609 15:25:21.182103 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-whrnh" event={"ID":"b18f6336-55a0-4455-8404-0e53c1fc387a","Type":"ContainerStarted","Data":"b604e57c8db2c678325f5d5268fa4720e987197bc6ff3de079b9eb65923b9104"} Jun 09 15:25:21.668213 ip-10-0-130-232 kubenswrapper[2575]: I0609 15:25:21.668160 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2bkzp_41532b1e-300d-4a9e-a64f-da302213062c/konnectivity-agent/0.log" limit=1024 Jun 09 15:25:22.900940 ip-10-0-130-232 kubenswrapper[2575]: I0609 15:25:22.900909 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2bkzp_41532b1e-300d-4a9e-a64f-da302213062c/konnectivity-agent/0.log" limit=1024 Jun 09 15:25:24.198347 ip-10-0-130-232 kubenswrapper[2575]: I0609 15:25:24.198257 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-whrnh" event={"ID":"b18f6336-55a0-4455-8404-0e53c1fc387a","Type":"ContainerStarted","Data":"e3570f02ae030cd5ee0246b97539c68bef0356be2bccfc9e4a236b43798543df"} Jun 09 15:25:24.198820 ip-10-0-130-232 kubenswrapper[2575]: I0609 15:25:24.198401 2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-whrnh" Jun 09 15:25:24.217543 ip-10-0-130-232 kubenswrapper[2575]: I0609 15:25:24.217491 2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-whrnh" podStartSLOduration=1.513128547 podStartE2EDuration="4.217475649s" totalImagesPullingTime="2.704347102s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-09 15:25:20 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-09 15:25:24.216235548 +0000 UTC m=+663.904241002" watchObservedRunningTime="2026-06-09 15:25:24.217475649 +0000 UTC m=+663.905481172" Jun 09 15:25:25.480776 ip-10-0-130-232 kubenswrapper[2575]: I0609 15:25:25.480729 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2bkzp_41532b1e-300d-4a9e-a64f-da302213062c/konnectivity-agent/0.log" limit=1024 Jun 09 15:25:25.579000 ip-10-0-130-232 kubenswrapper[2575]: I0609 15:25:25.578967 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2bkzp_41532b1e-300d-4a9e-a64f-da302213062c/konnectivity-agent/0.log" limit=1024 Jun 09 15:25:26.928700 ip-10-0-130-232 kubenswrapper[2575]: I0609 15:25:26.928665 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2bkzp_41532b1e-300d-4a9e-a64f-da302213062c/konnectivity-agent/0.log" limit=1024 Jun 09 15:25:27.037784 ip-10-0-130-232 kubenswrapper[2575]: I0609 15:25:27.037748 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2bkzp_41532b1e-300d-4a9e-a64f-da302213062c/konnectivity-agent/0.log" limit=1024 Jun 09 15:25:28.589819 ip-10-0-130-232 kubenswrapper[2575]: I0609 15:25:28.589783 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2bkzp_41532b1e-300d-4a9e-a64f-da302213062c/konnectivity-agent/0.log" limit=1024 Jun 09 15:25:30.206084 ip-10-0-130-232 kubenswrapper[2575]: I0609 15:25:30.206053 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2bkzp_41532b1e-300d-4a9e-a64f-da302213062c/konnectivity-agent/0.log" limit=1024 Jun 09 15:25:30.305582 ip-10-0-130-232 kubenswrapper[2575]: I0609 15:25:30.305547 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2bkzp_41532b1e-300d-4a9e-a64f-da302213062c/konnectivity-agent/0.log" limit=1024 Jun 09 15:25:35.206243 ip-10-0-130-232 kubenswrapper[2575]: I0609 15:25:35.206214 2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-whrnh" Jun 09 15:25:35.502966 ip-10-0-130-232 kubenswrapper[2575]: I0609 15:25:35.502908 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2bkzp_41532b1e-300d-4a9e-a64f-da302213062c/konnectivity-agent/0.log" limit=1024 Jun 09 15:25:35.629087 ip-10-0-130-232 kubenswrapper[2575]: I0609 15:25:35.629053 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2bkzp_41532b1e-300d-4a9e-a64f-da302213062c/konnectivity-agent/0.log" limit=1024 Jun 09 15:25:35.798475 ip-10-0-130-232 kubenswrapper[2575]: I0609 15:25:35.798375 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2bkzp_41532b1e-300d-4a9e-a64f-da302213062c/konnectivity-agent/0.log" limit=1024 Jun 09 15:25:37.130997 ip-10-0-130-232 kubenswrapper[2575]: I0609 15:25:37.130966 2575 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-whrnh"] Jun 09 15:25:37.131356 ip-10-0-130-232 kubenswrapper[2575]: I0609 15:25:37.131185 2575 kuberuntime_container.go:872] "Killing container with a grace period" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-whrnh" podUID="b18f6336-55a0-4455-8404-0e53c1fc387a" containerName="manager" containerID="cri-o://e3570f02ae030cd5ee0246b97539c68bef0356be2bccfc9e4a236b43798543df" gracePeriod=2 Jun 09 15:25:37.136290 ip-10-0-130-232 kubenswrapper[2575]: I0609 15:25:37.136268 2575 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-whrnh"] Jun 09 15:25:37.164401 ip-10-0-130-232 kubenswrapper[2575]: I0609 15:25:37.164375 2575 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-4dj6z"] Jun 09 15:25:37.164720 ip-10-0-130-232 kubenswrapper[2575]: I0609 15:25:37.164706 2575 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="b18f6336-55a0-4455-8404-0e53c1fc387a" containerName="manager" Jun 09 15:25:37.164720 ip-10-0-130-232 kubenswrapper[2575]: I0609 15:25:37.164720 2575 state_mem.go:107] "Deleted CPUSet assignment" podUID="b18f6336-55a0-4455-8404-0e53c1fc387a" containerName="manager" Jun 09 15:25:37.164878 ip-10-0-130-232 kubenswrapper[2575]: I0609 15:25:37.164786 2575 memory_manager.go:368] "RemoveStaleState removing state" podUID="b18f6336-55a0-4455-8404-0e53c1fc387a" containerName="manager" Jun 09 15:25:37.167756 ip-10-0-130-232 kubenswrapper[2575]: I0609 15:25:37.167734 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-4dj6z" Jun 09 15:25:37.170011 ip-10-0-130-232 kubenswrapper[2575]: E0609 15:25:37.169976 2575 status_manager.go:1018] "Failed to get status for pod" err="pods \"limitador-operator-controller-manager-859d7b78bd-whrnh\" is forbidden: User \"system:node:ip-10-0-130-232.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-130-232.ec2.internal' and this object" podUID="b18f6336-55a0-4455-8404-0e53c1fc387a" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-whrnh" Jun 09 15:25:37.180004 ip-10-0-130-232 kubenswrapper[2575]: I0609 15:25:37.179977 2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-4dj6z"] Jun 09 15:25:37.260786 ip-10-0-130-232 kubenswrapper[2575]: I0609 15:25:37.260751 2575 generic.go:356] "Generic (PLEG): container finished" podID="b18f6336-55a0-4455-8404-0e53c1fc387a" containerID="e3570f02ae030cd5ee0246b97539c68bef0356be2bccfc9e4a236b43798543df" exitCode=0 Jun 09 15:25:37.329267 ip-10-0-130-232 kubenswrapper[2575]: I0609 15:25:37.329073 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jz2b7\" (UniqueName: \"kubernetes.io/projected/dd0ef42e-8035-4dfc-b246-583ddd584847-kube-api-access-jz2b7\") pod \"limitador-operator-controller-manager-859d7b78bd-4dj6z\" (UID: \"dd0ef42e-8035-4dfc-b246-583ddd584847\") " pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-4dj6z" Jun 09 15:25:37.383291 ip-10-0-130-232 kubenswrapper[2575]: I0609 15:25:37.383238 2575 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-whrnh" Jun 09 15:25:37.385076 ip-10-0-130-232 kubenswrapper[2575]: E0609 15:25:37.385052 2575 status_manager.go:1018] "Failed to get status for pod" err="pods \"limitador-operator-controller-manager-859d7b78bd-whrnh\" is forbidden: User \"system:node:ip-10-0-130-232.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-130-232.ec2.internal' and this object" podUID="b18f6336-55a0-4455-8404-0e53c1fc387a" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-whrnh" Jun 09 15:25:37.430498 ip-10-0-130-232 kubenswrapper[2575]: I0609 15:25:37.430466 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jz2b7\" (UniqueName: \"kubernetes.io/projected/dd0ef42e-8035-4dfc-b246-583ddd584847-kube-api-access-jz2b7\") pod \"limitador-operator-controller-manager-859d7b78bd-4dj6z\" (UID: \"dd0ef42e-8035-4dfc-b246-583ddd584847\") " pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-4dj6z" Jun 09 15:25:37.440159 ip-10-0-130-232 kubenswrapper[2575]: I0609 15:25:37.440135 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-jz2b7\" (UniqueName: \"kubernetes.io/projected/dd0ef42e-8035-4dfc-b246-583ddd584847-kube-api-access-jz2b7\") pod \"limitador-operator-controller-manager-859d7b78bd-4dj6z\" (UID: \"dd0ef42e-8035-4dfc-b246-583ddd584847\") " pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-4dj6z" Jun 09 15:25:37.503007 ip-10-0-130-232 kubenswrapper[2575]: I0609 15:25:37.502976 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-4dj6z" Jun 09 15:25:37.531472 ip-10-0-130-232 kubenswrapper[2575]: I0609 15:25:37.531450 2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-hzh6q\" (UniqueName: \"kubernetes.io/projected/b18f6336-55a0-4455-8404-0e53c1fc387a-kube-api-access-hzh6q\") pod \"b18f6336-55a0-4455-8404-0e53c1fc387a\" (UID: \"b18f6336-55a0-4455-8404-0e53c1fc387a\") " Jun 09 15:25:37.533564 ip-10-0-130-232 kubenswrapper[2575]: I0609 15:25:37.533536 2575 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/b18f6336-55a0-4455-8404-0e53c1fc387a-kube-api-access-hzh6q" (OuterVolumeSpecName: "kube-api-access-hzh6q") pod "b18f6336-55a0-4455-8404-0e53c1fc387a" (UID: "b18f6336-55a0-4455-8404-0e53c1fc387a"). InnerVolumeSpecName "kube-api-access-hzh6q". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 09 15:25:37.632700 ip-10-0-130-232 kubenswrapper[2575]: I0609 15:25:37.632645 2575 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-hzh6q\" (UniqueName: \"kubernetes.io/projected/b18f6336-55a0-4455-8404-0e53c1fc387a-kube-api-access-hzh6q\") on node \"ip-10-0-130-232.ec2.internal\" DevicePath \"\"" Jun 09 15:25:37.635323 ip-10-0-130-232 kubenswrapper[2575]: I0609 15:25:37.635262 2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-4dj6z"] Jun 09 15:25:37.637871 ip-10-0-130-232 kubenswrapper[2575]: W0609 15:25:37.637829 2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poddd0ef42e_8035_4dfc_b246_583ddd584847.slice/crio-c38fda91028801d5f0a7e3e576d147df254a97a9a0925a5c6f2a7797aa93b739 WatchSource:0}: Error finding container c38fda91028801d5f0a7e3e576d147df254a97a9a0925a5c6f2a7797aa93b739: Status 404 returned error can't find the container with id c38fda91028801d5f0a7e3e576d147df254a97a9a0925a5c6f2a7797aa93b739 Jun 09 15:25:38.273308 ip-10-0-130-232 kubenswrapper[2575]: I0609 15:25:38.273271 2575 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-whrnh" Jun 09 15:25:38.273760 ip-10-0-130-232 kubenswrapper[2575]: I0609 15:25:38.273294 2575 scope.go:117] "RemoveContainer" containerID="e3570f02ae030cd5ee0246b97539c68bef0356be2bccfc9e4a236b43798543df" Jun 09 15:25:38.275115 ip-10-0-130-232 kubenswrapper[2575]: I0609 15:25:38.275077 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-4dj6z" event={"ID":"dd0ef42e-8035-4dfc-b246-583ddd584847","Type":"ContainerStarted","Data":"6b9653a821c86aee433713f7061880479b26cd6a377448c91eb5a6baa0651e31"} Jun 09 15:25:38.275226 ip-10-0-130-232 kubenswrapper[2575]: I0609 15:25:38.275157 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-4dj6z" event={"ID":"dd0ef42e-8035-4dfc-b246-583ddd584847","Type":"ContainerStarted","Data":"c38fda91028801d5f0a7e3e576d147df254a97a9a0925a5c6f2a7797aa93b739"} Jun 09 15:25:38.275226 ip-10-0-130-232 kubenswrapper[2575]: I0609 15:25:38.275187 2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-4dj6z" Jun 09 15:25:38.275443 ip-10-0-130-232 kubenswrapper[2575]: E0609 15:25:38.275421 2575 status_manager.go:1018] "Failed to get status for pod" err="pods \"limitador-operator-controller-manager-859d7b78bd-whrnh\" is forbidden: User \"system:node:ip-10-0-130-232.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-130-232.ec2.internal' and this object" podUID="b18f6336-55a0-4455-8404-0e53c1fc387a" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-whrnh" Jun 09 15:25:38.276926 ip-10-0-130-232 kubenswrapper[2575]: E0609 15:25:38.276907 2575 status_manager.go:1018] "Failed to get status for pod" err="pods \"limitador-operator-controller-manager-859d7b78bd-whrnh\" is forbidden: User \"system:node:ip-10-0-130-232.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-130-232.ec2.internal' and this object" podUID="b18f6336-55a0-4455-8404-0e53c1fc387a" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-whrnh" Jun 09 15:25:38.303698 ip-10-0-130-232 kubenswrapper[2575]: I0609 15:25:38.303645 2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-4dj6z" podStartSLOduration=1.303629094 podStartE2EDuration="1.303629094s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-09 15:25:37 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-09 15:25:38.303094307 +0000 UTC m=+677.991099777" watchObservedRunningTime="2026-06-09 15:25:38.303629094 +0000 UTC m=+677.991634550" Jun 09 15:25:38.304771 ip-10-0-130-232 kubenswrapper[2575]: E0609 15:25:38.304745 2575 status_manager.go:1018] "Failed to get status for pod" err="pods \"limitador-operator-controller-manager-859d7b78bd-whrnh\" is forbidden: User \"system:node:ip-10-0-130-232.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-130-232.ec2.internal' and this object" podUID="b18f6336-55a0-4455-8404-0e53c1fc387a" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-whrnh" Jun 09 15:25:38.509911 ip-10-0-130-232 kubenswrapper[2575]: I0609 15:25:38.509881 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2bkzp_41532b1e-300d-4a9e-a64f-da302213062c/konnectivity-agent/0.log" limit=1024 Jun 09 15:25:38.659911 ip-10-0-130-232 kubenswrapper[2575]: I0609 15:25:38.659861 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2bkzp_41532b1e-300d-4a9e-a64f-da302213062c/konnectivity-agent/0.log" limit=1024 Jun 09 15:25:38.695951 ip-10-0-130-232 kubenswrapper[2575]: I0609 15:25:38.695928 2575 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="b18f6336-55a0-4455-8404-0e53c1fc387a" path="/var/lib/kubelet/pods/b18f6336-55a0-4455-8404-0e53c1fc387a/volumes" Jun 09 15:25:40.948011 ip-10-0-130-232 kubenswrapper[2575]: I0609 15:25:40.947961 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2bkzp_41532b1e-300d-4a9e-a64f-da302213062c/konnectivity-agent/0.log" limit=1024 Jun 09 15:25:41.054425 ip-10-0-130-232 kubenswrapper[2575]: I0609 15:25:41.054392 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2bkzp_41532b1e-300d-4a9e-a64f-da302213062c/konnectivity-agent/0.log" limit=1024 Jun 09 15:25:45.608739 ip-10-0-130-232 kubenswrapper[2575]: I0609 15:25:45.608706 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2bkzp_41532b1e-300d-4a9e-a64f-da302213062c/konnectivity-agent/0.log" limit=1024 Jun 09 15:25:45.710859 ip-10-0-130-232 kubenswrapper[2575]: I0609 15:25:45.710818 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2bkzp_41532b1e-300d-4a9e-a64f-da302213062c/konnectivity-agent/0.log" limit=1024 Jun 09 15:25:46.683992 ip-10-0-130-232 kubenswrapper[2575]: I0609 15:25:46.683946 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2bkzp_41532b1e-300d-4a9e-a64f-da302213062c/konnectivity-agent/0.log" limit=1024 Jun 09 15:25:46.746294 ip-10-0-130-232 kubenswrapper[2575]: I0609 15:25:46.746260 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2bkzp_41532b1e-300d-4a9e-a64f-da302213062c/konnectivity-agent/0.log" limit=1024 Jun 09 15:25:48.349947 ip-10-0-130-232 kubenswrapper[2575]: I0609 15:25:48.349905 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2bkzp_41532b1e-300d-4a9e-a64f-da302213062c/konnectivity-agent/0.log" limit=1024 Jun 09 15:25:49.283989 ip-10-0-130-232 kubenswrapper[2575]: I0609 15:25:49.283954 2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-4dj6z" Jun 09 15:25:52.372373 ip-10-0-130-232 kubenswrapper[2575]: I0609 15:25:52.372330 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2bkzp_41532b1e-300d-4a9e-a64f-da302213062c/konnectivity-agent/0.log" limit=1024 Jun 09 15:25:56.867799 ip-10-0-130-232 kubenswrapper[2575]: I0609 15:25:56.867763 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2bkzp_41532b1e-300d-4a9e-a64f-da302213062c/konnectivity-agent/0.log" limit=1024 Jun 09 15:25:56.922673 ip-10-0-130-232 kubenswrapper[2575]: I0609 15:25:56.922640 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2bkzp_41532b1e-300d-4a9e-a64f-da302213062c/konnectivity-agent/0.log" limit=1024 Jun 09 15:25:57.088834 ip-10-0-130-232 kubenswrapper[2575]: I0609 15:25:57.088793 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2bkzp_41532b1e-300d-4a9e-a64f-da302213062c/konnectivity-agent/0.log" limit=1024 Jun 09 15:25:57.175572 ip-10-0-130-232 kubenswrapper[2575]: I0609 15:25:57.175465 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2bkzp_41532b1e-300d-4a9e-a64f-da302213062c/konnectivity-agent/0.log" limit=1024 Jun 09 15:25:58.891069 ip-10-0-130-232 kubenswrapper[2575]: I0609 15:25:58.891036 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2bkzp_41532b1e-300d-4a9e-a64f-da302213062c/konnectivity-agent/0.log" limit=1024 Jun 09 15:25:58.990170 ip-10-0-130-232 kubenswrapper[2575]: I0609 15:25:58.990139 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2bkzp_41532b1e-300d-4a9e-a64f-da302213062c/konnectivity-agent/0.log" limit=1024 Jun 09 15:26:01.330994 ip-10-0-130-232 kubenswrapper[2575]: I0609 15:26:01.330964 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2bkzp_41532b1e-300d-4a9e-a64f-da302213062c/konnectivity-agent/0.log" limit=1024 Jun 09 15:26:01.440676 ip-10-0-130-232 kubenswrapper[2575]: I0609 15:26:01.440646 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2bkzp_41532b1e-300d-4a9e-a64f-da302213062c/konnectivity-agent/0.log" limit=1024 Jun 09 15:26:07.718058 ip-10-0-130-232 kubenswrapper[2575]: I0609 15:26:07.718022 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2bkzp_41532b1e-300d-4a9e-a64f-da302213062c/konnectivity-agent/0.log" limit=1024 Jun 09 15:26:08.110971 ip-10-0-130-232 kubenswrapper[2575]: I0609 15:26:08.110938 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2bkzp_41532b1e-300d-4a9e-a64f-da302213062c/konnectivity-agent/0.log" limit=1024 Jun 09 15:26:09.466504 ip-10-0-130-232 kubenswrapper[2575]: I0609 15:26:09.466416 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2bkzp_41532b1e-300d-4a9e-a64f-da302213062c/konnectivity-agent/0.log" limit=1024 Jun 09 15:26:09.567715 ip-10-0-130-232 kubenswrapper[2575]: I0609 15:26:09.567681 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2bkzp_41532b1e-300d-4a9e-a64f-da302213062c/konnectivity-agent/0.log" limit=1024 Jun 09 15:26:09.642645 ip-10-0-130-232 kubenswrapper[2575]: I0609 15:26:09.642591 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2bkzp_41532b1e-300d-4a9e-a64f-da302213062c/konnectivity-agent/0.log" limit=1024 Jun 09 15:26:09.772412 ip-10-0-130-232 kubenswrapper[2575]: I0609 15:26:09.772378 2575 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-hfd4x"] Jun 09 15:26:09.777890 ip-10-0-130-232 kubenswrapper[2575]: I0609 15:26:09.777838 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-54d6d988d5-hfd4x" Jun 09 15:26:09.780201 ip-10-0-130-232 kubenswrapper[2575]: I0609 15:26:09.780173 2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"limitador-limits-config-limitador\"" Jun 09 15:26:09.780299 ip-10-0-130-232 kubenswrapper[2575]: I0609 15:26:09.780184 2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"default-dockercfg-j788r\"" Jun 09 15:26:09.787096 ip-10-0-130-232 kubenswrapper[2575]: I0609 15:26:09.787066 2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-hfd4x"] Jun 09 15:26:09.812858 ip-10-0-130-232 kubenswrapper[2575]: I0609 15:26:09.812818 2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-hfd4x"] Jun 09 15:26:09.915643 ip-10-0-130-232 kubenswrapper[2575]: I0609 15:26:09.915616 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/2041f19f-b861-4b21-8838-420feecddfd8-config-file\") pod \"limitador-limitador-54d6d988d5-hfd4x\" (UID: \"2041f19f-b861-4b21-8838-420feecddfd8\") " pod="kuadrant-system/limitador-limitador-54d6d988d5-hfd4x" Jun 09 15:26:09.915755 ip-10-0-130-232 kubenswrapper[2575]: I0609 15:26:09.915648 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7lgcb\" (UniqueName: \"kubernetes.io/projected/2041f19f-b861-4b21-8838-420feecddfd8-kube-api-access-7lgcb\") pod \"limitador-limitador-54d6d988d5-hfd4x\" (UID: \"2041f19f-b861-4b21-8838-420feecddfd8\") " pod="kuadrant-system/limitador-limitador-54d6d988d5-hfd4x" Jun 09 15:26:10.016679 ip-10-0-130-232 kubenswrapper[2575]: I0609 15:26:10.016648 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7lgcb\" (UniqueName: \"kubernetes.io/projected/2041f19f-b861-4b21-8838-420feecddfd8-kube-api-access-7lgcb\") pod \"limitador-limitador-54d6d988d5-hfd4x\" (UID: \"2041f19f-b861-4b21-8838-420feecddfd8\") " pod="kuadrant-system/limitador-limitador-54d6d988d5-hfd4x" Jun 09 15:26:10.016809 ip-10-0-130-232 kubenswrapper[2575]: I0609 15:26:10.016788 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/2041f19f-b861-4b21-8838-420feecddfd8-config-file\") pod \"limitador-limitador-54d6d988d5-hfd4x\" (UID: \"2041f19f-b861-4b21-8838-420feecddfd8\") " pod="kuadrant-system/limitador-limitador-54d6d988d5-hfd4x" Jun 09 15:26:10.017396 ip-10-0-130-232 kubenswrapper[2575]: I0609 15:26:10.017377 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/2041f19f-b861-4b21-8838-420feecddfd8-config-file\") pod \"limitador-limitador-54d6d988d5-hfd4x\" (UID: \"2041f19f-b861-4b21-8838-420feecddfd8\") " pod="kuadrant-system/limitador-limitador-54d6d988d5-hfd4x" Jun 09 15:26:10.025835 ip-10-0-130-232 kubenswrapper[2575]: I0609 15:26:10.025788 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-7lgcb\" (UniqueName: \"kubernetes.io/projected/2041f19f-b861-4b21-8838-420feecddfd8-kube-api-access-7lgcb\") pod \"limitador-limitador-54d6d988d5-hfd4x\" (UID: \"2041f19f-b861-4b21-8838-420feecddfd8\") " pod="kuadrant-system/limitador-limitador-54d6d988d5-hfd4x" Jun 09 15:26:10.089473 ip-10-0-130-232 kubenswrapper[2575]: I0609 15:26:10.089445 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-54d6d988d5-hfd4x" Jun 09 15:26:10.226814 ip-10-0-130-232 kubenswrapper[2575]: I0609 15:26:10.226789 2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-hfd4x"] Jun 09 15:26:10.228680 ip-10-0-130-232 kubenswrapper[2575]: W0609 15:26:10.228651 2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2041f19f_b861_4b21_8838_420feecddfd8.slice/crio-5cf1f53e418225ed5f818820add67c1ed7043d367c3cac9df3859988e573970e WatchSource:0}: Error finding container 5cf1f53e418225ed5f818820add67c1ed7043d367c3cac9df3859988e573970e: Status 404 returned error can't find the container with id 5cf1f53e418225ed5f818820add67c1ed7043d367c3cac9df3859988e573970e Jun 09 15:26:10.302649 ip-10-0-130-232 kubenswrapper[2575]: I0609 15:26:10.302571 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2bkzp_41532b1e-300d-4a9e-a64f-da302213062c/konnectivity-agent/0.log" limit=1024 Jun 09 15:26:10.370132 ip-10-0-130-232 kubenswrapper[2575]: I0609 15:26:10.370085 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2bkzp_41532b1e-300d-4a9e-a64f-da302213062c/konnectivity-agent/0.log" limit=1024 Jun 09 15:26:10.426234 ip-10-0-130-232 kubenswrapper[2575]: I0609 15:26:10.426206 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-54d6d988d5-hfd4x" event={"ID":"2041f19f-b861-4b21-8838-420feecddfd8","Type":"ContainerStarted","Data":"5cf1f53e418225ed5f818820add67c1ed7043d367c3cac9df3859988e573970e"} Jun 09 15:26:13.443168 ip-10-0-130-232 kubenswrapper[2575]: I0609 15:26:13.443080 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-54d6d988d5-hfd4x" event={"ID":"2041f19f-b861-4b21-8838-420feecddfd8","Type":"ContainerStarted","Data":"34952c3436ccf88b9d1bd68e26a00b594626f257a8cbb1849d6a7b807dcc6dc0"} Jun 09 15:26:13.443500 ip-10-0-130-232 kubenswrapper[2575]: I0609 15:26:13.443181 2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/limitador-limitador-54d6d988d5-hfd4x" Jun 09 15:26:13.459548 ip-10-0-130-232 kubenswrapper[2575]: I0609 15:26:13.459504 2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/limitador-limitador-54d6d988d5-hfd4x" podStartSLOduration=1.9773733999999998 podStartE2EDuration="4.459489703s" totalImagesPullingTime="2.482116303s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-09 15:26:09 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-09 15:26:13.45715112 +0000 UTC m=+713.145156573" watchObservedRunningTime="2026-06-09 15:26:13.459489703 +0000 UTC m=+713.147495157" Jun 09 15:26:24.449352 ip-10-0-130-232 kubenswrapper[2575]: I0609 15:26:24.449319 2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/limitador-limitador-54d6d988d5-hfd4x" Jun 09 15:26:25.696542 ip-10-0-130-232 kubenswrapper[2575]: I0609 15:26:25.696494 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2bkzp_41532b1e-300d-4a9e-a64f-da302213062c/konnectivity-agent/0.log" limit=1024 Jun 09 15:26:37.967584 ip-10-0-130-232 kubenswrapper[2575]: I0609 15:26:37.967555 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2bkzp_41532b1e-300d-4a9e-a64f-da302213062c/konnectivity-agent/0.log" limit=1024 Jun 09 15:26:38.065412 ip-10-0-130-232 kubenswrapper[2575]: I0609 15:26:38.065381 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2bkzp_41532b1e-300d-4a9e-a64f-da302213062c/konnectivity-agent/0.log" limit=1024 Jun 09 15:26:38.241591 ip-10-0-130-232 kubenswrapper[2575]: I0609 15:26:38.241558 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2bkzp_41532b1e-300d-4a9e-a64f-da302213062c/konnectivity-agent/0.log" limit=1024 Jun 09 15:27:02.857500 ip-10-0-130-232 kubenswrapper[2575]: I0609 15:27:02.857468 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2bkzp_41532b1e-300d-4a9e-a64f-da302213062c/konnectivity-agent/0.log" limit=1024 Jun 09 15:27:08.140490 ip-10-0-130-232 kubenswrapper[2575]: I0609 15:27:08.140449 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2bkzp_41532b1e-300d-4a9e-a64f-da302213062c/konnectivity-agent/0.log" limit=1024 Jun 09 15:27:08.322521 ip-10-0-130-232 kubenswrapper[2575]: I0609 15:27:08.322487 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2bkzp_41532b1e-300d-4a9e-a64f-da302213062c/konnectivity-agent/0.log" limit=1024 Jun 09 15:27:39.650550 ip-10-0-130-232 kubenswrapper[2575]: I0609 15:27:39.650454 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2bkzp_41532b1e-300d-4a9e-a64f-da302213062c/konnectivity-agent/0.log" limit=1024 Jun 09 15:27:40.059211 ip-10-0-130-232 kubenswrapper[2575]: I0609 15:27:40.059175 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2bkzp_41532b1e-300d-4a9e-a64f-da302213062c/konnectivity-agent/0.log" limit=1024 Jun 09 15:27:46.061620 ip-10-0-130-232 kubenswrapper[2575]: I0609 15:27:46.061594 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2bkzp_41532b1e-300d-4a9e-a64f-da302213062c/konnectivity-agent/0.log" limit=1024 Jun 09 15:27:46.173364 ip-10-0-130-232 kubenswrapper[2575]: I0609 15:27:46.173317 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2bkzp_41532b1e-300d-4a9e-a64f-da302213062c/konnectivity-agent/0.log" limit=1024 Jun 09 15:27:46.281568 ip-10-0-130-232 kubenswrapper[2575]: I0609 15:27:46.281535 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2bkzp_41532b1e-300d-4a9e-a64f-da302213062c/konnectivity-agent/0.log" limit=1024 Jun 09 15:27:49.589507 ip-10-0-130-232 kubenswrapper[2575]: I0609 15:27:49.589447 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2bkzp_41532b1e-300d-4a9e-a64f-da302213062c/konnectivity-agent/0.log" limit=1024 Jun 09 15:27:49.705184 ip-10-0-130-232 kubenswrapper[2575]: I0609 15:27:49.705152 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2bkzp_41532b1e-300d-4a9e-a64f-da302213062c/konnectivity-agent/0.log" limit=1024 Jun 09 15:28:20.637631 ip-10-0-130-232 kubenswrapper[2575]: I0609 15:28:20.637595 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2bkzp_41532b1e-300d-4a9e-a64f-da302213062c/konnectivity-agent/0.log" limit=1024 Jun 09 15:28:21.066101 ip-10-0-130-232 kubenswrapper[2575]: I0609 15:28:21.066070 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2bkzp_41532b1e-300d-4a9e-a64f-da302213062c/konnectivity-agent/0.log" limit=1024 Jun 09 15:28:21.174249 ip-10-0-130-232 kubenswrapper[2575]: I0609 15:28:21.174214 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2bkzp_41532b1e-300d-4a9e-a64f-da302213062c/konnectivity-agent/0.log" limit=1024 Jun 09 15:28:21.310413 ip-10-0-130-232 kubenswrapper[2575]: I0609 15:28:21.310382 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2bkzp_41532b1e-300d-4a9e-a64f-da302213062c/konnectivity-agent/0.log" limit=1024 Jun 09 15:28:21.339142 ip-10-0-130-232 kubenswrapper[2575]: I0609 15:28:21.339075 2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-hfd4x"] Jun 09 15:28:59.140880 ip-10-0-130-232 kubenswrapper[2575]: I0609 15:28:59.140828 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2bkzp_41532b1e-300d-4a9e-a64f-da302213062c/konnectivity-agent/0.log" limit=1024 Jun 09 15:29:12.437421 ip-10-0-130-232 kubenswrapper[2575]: I0609 15:29:12.437345 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2bkzp_41532b1e-300d-4a9e-a64f-da302213062c/konnectivity-agent/0.log" limit=1024 Jun 09 15:29:12.517106 ip-10-0-130-232 kubenswrapper[2575]: I0609 15:29:12.517073 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2bkzp_41532b1e-300d-4a9e-a64f-da302213062c/konnectivity-agent/0.log" limit=1024 Jun 09 15:29:19.870617 ip-10-0-130-232 kubenswrapper[2575]: I0609 15:29:19.870587 2575 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/e2e-distinct-2-simulated-kserve-f5c55bdc-jzdgr"] Jun 09 15:29:19.874076 ip-10-0-130-232 kubenswrapper[2575]: I0609 15:29:19.874056 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-distinct-2-simulated-kserve-f5c55bdc-jzdgr" Jun 09 15:29:19.876557 ip-10-0-130-232 kubenswrapper[2575]: I0609 15:29:19.876475 2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"default-dockercfg-245xv\"" Jun 09 15:29:19.877228 ip-10-0-130-232 kubenswrapper[2575]: I0609 15:29:19.877164 2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"llm\"/\"kube-root-ca.crt\"" Jun 09 15:29:19.877371 ip-10-0-130-232 kubenswrapper[2575]: I0609 15:29:19.877351 2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"llm\"/\"openshift-service-ca.crt\"" Jun 09 15:29:19.877442 ip-10-0-130-232 kubenswrapper[2575]: I0609 15:29:19.877394 2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"e2e-distinct-2-simulated-kserve-self-signed-certs\"" Jun 09 15:29:19.902038 ip-10-0-130-232 kubenswrapper[2575]: I0609 15:29:19.902015 2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-distinct-2-simulated-kserve-f5c55bdc-jzdgr"] Jun 09 15:29:19.922119 ip-10-0-130-232 kubenswrapper[2575]: I0609 15:29:19.922094 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2bkzp_41532b1e-300d-4a9e-a64f-da302213062c/konnectivity-agent/0.log" limit=1024 Jun 09 15:29:19.964017 ip-10-0-130-232 kubenswrapper[2575]: I0609 15:29:19.963996 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/8b4b6a2c-6f65-4076-9d54-5d06eb16e6a2-home\") pod \"e2e-distinct-2-simulated-kserve-f5c55bdc-jzdgr\" (UID: \"8b4b6a2c-6f65-4076-9d54-5d06eb16e6a2\") " pod="llm/e2e-distinct-2-simulated-kserve-f5c55bdc-jzdgr" Jun 09 15:29:19.964139 ip-10-0-130-232 kubenswrapper[2575]: I0609 15:29:19.964021 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/8b4b6a2c-6f65-4076-9d54-5d06eb16e6a2-kserve-provision-location\") pod \"e2e-distinct-2-simulated-kserve-f5c55bdc-jzdgr\" (UID: \"8b4b6a2c-6f65-4076-9d54-5d06eb16e6a2\") " pod="llm/e2e-distinct-2-simulated-kserve-f5c55bdc-jzdgr" Jun 09 15:29:19.964139 ip-10-0-130-232 kubenswrapper[2575]: I0609 15:29:19.964130 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-sq6sh\" (UniqueName: \"kubernetes.io/projected/8b4b6a2c-6f65-4076-9d54-5d06eb16e6a2-kube-api-access-sq6sh\") pod \"e2e-distinct-2-simulated-kserve-f5c55bdc-jzdgr\" (UID: \"8b4b6a2c-6f65-4076-9d54-5d06eb16e6a2\") " pod="llm/e2e-distinct-2-simulated-kserve-f5c55bdc-jzdgr" Jun 09 15:29:19.964221 ip-10-0-130-232 kubenswrapper[2575]: I0609 15:29:19.964159 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/8b4b6a2c-6f65-4076-9d54-5d06eb16e6a2-dshm\") pod \"e2e-distinct-2-simulated-kserve-f5c55bdc-jzdgr\" (UID: \"8b4b6a2c-6f65-4076-9d54-5d06eb16e6a2\") " pod="llm/e2e-distinct-2-simulated-kserve-f5c55bdc-jzdgr" Jun 09 15:29:19.964221 ip-10-0-130-232 kubenswrapper[2575]: I0609 15:29:19.964176 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/8b4b6a2c-6f65-4076-9d54-5d06eb16e6a2-tls-certs\") pod \"e2e-distinct-2-simulated-kserve-f5c55bdc-jzdgr\" (UID: \"8b4b6a2c-6f65-4076-9d54-5d06eb16e6a2\") " pod="llm/e2e-distinct-2-simulated-kserve-f5c55bdc-jzdgr" Jun 09 15:29:19.964221 ip-10-0-130-232 kubenswrapper[2575]: I0609 15:29:19.964200 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/8b4b6a2c-6f65-4076-9d54-5d06eb16e6a2-model-cache\") pod \"e2e-distinct-2-simulated-kserve-f5c55bdc-jzdgr\" (UID: \"8b4b6a2c-6f65-4076-9d54-5d06eb16e6a2\") " pod="llm/e2e-distinct-2-simulated-kserve-f5c55bdc-jzdgr" Jun 09 15:29:20.065405 ip-10-0-130-232 kubenswrapper[2575]: I0609 15:29:20.065371 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-sq6sh\" (UniqueName: \"kubernetes.io/projected/8b4b6a2c-6f65-4076-9d54-5d06eb16e6a2-kube-api-access-sq6sh\") pod \"e2e-distinct-2-simulated-kserve-f5c55bdc-jzdgr\" (UID: \"8b4b6a2c-6f65-4076-9d54-5d06eb16e6a2\") " pod="llm/e2e-distinct-2-simulated-kserve-f5c55bdc-jzdgr" Jun 09 15:29:20.065405 ip-10-0-130-232 kubenswrapper[2575]: I0609 15:29:20.065407 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/8b4b6a2c-6f65-4076-9d54-5d06eb16e6a2-dshm\") pod \"e2e-distinct-2-simulated-kserve-f5c55bdc-jzdgr\" (UID: \"8b4b6a2c-6f65-4076-9d54-5d06eb16e6a2\") " pod="llm/e2e-distinct-2-simulated-kserve-f5c55bdc-jzdgr" Jun 09 15:29:20.065629 ip-10-0-130-232 kubenswrapper[2575]: I0609 15:29:20.065424 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/8b4b6a2c-6f65-4076-9d54-5d06eb16e6a2-tls-certs\") pod \"e2e-distinct-2-simulated-kserve-f5c55bdc-jzdgr\" (UID: \"8b4b6a2c-6f65-4076-9d54-5d06eb16e6a2\") " pod="llm/e2e-distinct-2-simulated-kserve-f5c55bdc-jzdgr" Jun 09 15:29:20.065629 ip-10-0-130-232 kubenswrapper[2575]: I0609 15:29:20.065444 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/8b4b6a2c-6f65-4076-9d54-5d06eb16e6a2-model-cache\") pod \"e2e-distinct-2-simulated-kserve-f5c55bdc-jzdgr\" (UID: \"8b4b6a2c-6f65-4076-9d54-5d06eb16e6a2\") " pod="llm/e2e-distinct-2-simulated-kserve-f5c55bdc-jzdgr" Jun 09 15:29:20.065629 ip-10-0-130-232 kubenswrapper[2575]: I0609 15:29:20.065475 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/8b4b6a2c-6f65-4076-9d54-5d06eb16e6a2-home\") pod \"e2e-distinct-2-simulated-kserve-f5c55bdc-jzdgr\" (UID: \"8b4b6a2c-6f65-4076-9d54-5d06eb16e6a2\") " pod="llm/e2e-distinct-2-simulated-kserve-f5c55bdc-jzdgr" Jun 09 15:29:20.065629 ip-10-0-130-232 kubenswrapper[2575]: I0609 15:29:20.065489 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/8b4b6a2c-6f65-4076-9d54-5d06eb16e6a2-kserve-provision-location\") pod \"e2e-distinct-2-simulated-kserve-f5c55bdc-jzdgr\" (UID: \"8b4b6a2c-6f65-4076-9d54-5d06eb16e6a2\") " pod="llm/e2e-distinct-2-simulated-kserve-f5c55bdc-jzdgr" Jun 09 15:29:20.065890 ip-10-0-130-232 kubenswrapper[2575]: I0609 15:29:20.065838 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/8b4b6a2c-6f65-4076-9d54-5d06eb16e6a2-model-cache\") pod \"e2e-distinct-2-simulated-kserve-f5c55bdc-jzdgr\" (UID: \"8b4b6a2c-6f65-4076-9d54-5d06eb16e6a2\") " pod="llm/e2e-distinct-2-simulated-kserve-f5c55bdc-jzdgr" Jun 09 15:29:20.065997 ip-10-0-130-232 kubenswrapper[2575]: I0609 15:29:20.065938 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/8b4b6a2c-6f65-4076-9d54-5d06eb16e6a2-home\") pod \"e2e-distinct-2-simulated-kserve-f5c55bdc-jzdgr\" (UID: \"8b4b6a2c-6f65-4076-9d54-5d06eb16e6a2\") " pod="llm/e2e-distinct-2-simulated-kserve-f5c55bdc-jzdgr" Jun 09 15:29:20.065997 ip-10-0-130-232 kubenswrapper[2575]: I0609 15:29:20.065974 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/8b4b6a2c-6f65-4076-9d54-5d06eb16e6a2-kserve-provision-location\") pod \"e2e-distinct-2-simulated-kserve-f5c55bdc-jzdgr\" (UID: \"8b4b6a2c-6f65-4076-9d54-5d06eb16e6a2\") " pod="llm/e2e-distinct-2-simulated-kserve-f5c55bdc-jzdgr" Jun 09 15:29:20.067946 ip-10-0-130-232 kubenswrapper[2575]: I0609 15:29:20.067922 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/8b4b6a2c-6f65-4076-9d54-5d06eb16e6a2-dshm\") pod \"e2e-distinct-2-simulated-kserve-f5c55bdc-jzdgr\" (UID: \"8b4b6a2c-6f65-4076-9d54-5d06eb16e6a2\") " pod="llm/e2e-distinct-2-simulated-kserve-f5c55bdc-jzdgr" Jun 09 15:29:20.068088 ip-10-0-130-232 kubenswrapper[2575]: I0609 15:29:20.068073 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/8b4b6a2c-6f65-4076-9d54-5d06eb16e6a2-tls-certs\") pod \"e2e-distinct-2-simulated-kserve-f5c55bdc-jzdgr\" (UID: \"8b4b6a2c-6f65-4076-9d54-5d06eb16e6a2\") " pod="llm/e2e-distinct-2-simulated-kserve-f5c55bdc-jzdgr" Jun 09 15:29:20.073904 ip-10-0-130-232 kubenswrapper[2575]: I0609 15:29:20.073885 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-sq6sh\" (UniqueName: \"kubernetes.io/projected/8b4b6a2c-6f65-4076-9d54-5d06eb16e6a2-kube-api-access-sq6sh\") pod \"e2e-distinct-2-simulated-kserve-f5c55bdc-jzdgr\" (UID: \"8b4b6a2c-6f65-4076-9d54-5d06eb16e6a2\") " pod="llm/e2e-distinct-2-simulated-kserve-f5c55bdc-jzdgr" Jun 09 15:29:20.186057 ip-10-0-130-232 kubenswrapper[2575]: I0609 15:29:20.185975 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-distinct-2-simulated-kserve-f5c55bdc-jzdgr" Jun 09 15:29:20.324295 ip-10-0-130-232 kubenswrapper[2575]: I0609 15:29:20.324259 2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-distinct-2-simulated-kserve-f5c55bdc-jzdgr"] Jun 09 15:29:20.331256 ip-10-0-130-232 kubenswrapper[2575]: W0609 15:29:20.331227 2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8b4b6a2c_6f65_4076_9d54_5d06eb16e6a2.slice/crio-925a3aff23f67d7b103b01965d8ae34ef8d934864f0000c4e8b87da84a408e7a WatchSource:0}: Error finding container 925a3aff23f67d7b103b01965d8ae34ef8d934864f0000c4e8b87da84a408e7a: Status 404 returned error can't find the container with id 925a3aff23f67d7b103b01965d8ae34ef8d934864f0000c4e8b87da84a408e7a Jun 09 15:29:20.333304 ip-10-0-130-232 kubenswrapper[2575]: I0609 15:29:20.333289 2575 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jun 09 15:29:20.372611 ip-10-0-130-232 kubenswrapper[2575]: I0609 15:29:20.372576 2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-hfd4x"] Jun 09 15:29:21.325709 ip-10-0-130-232 kubenswrapper[2575]: I0609 15:29:21.325673 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-2-simulated-kserve-f5c55bdc-jzdgr" event={"ID":"8b4b6a2c-6f65-4076-9d54-5d06eb16e6a2","Type":"ContainerStarted","Data":"925a3aff23f67d7b103b01965d8ae34ef8d934864f0000c4e8b87da84a408e7a"} Jun 09 15:29:25.346676 ip-10-0-130-232 kubenswrapper[2575]: I0609 15:29:25.346637 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-2-simulated-kserve-f5c55bdc-jzdgr" event={"ID":"8b4b6a2c-6f65-4076-9d54-5d06eb16e6a2","Type":"ContainerStarted","Data":"0a715ddb4a79e4b76cb7cd20e4585f7fcbf2c0b4327954ad569e5dfd401950b3"} Jun 09 15:29:28.067172 ip-10-0-130-232 kubenswrapper[2575]: I0609 15:29:28.067120 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2bkzp_41532b1e-300d-4a9e-a64f-da302213062c/konnectivity-agent/0.log" limit=1024 Jun 09 15:29:28.595242 ip-10-0-130-232 kubenswrapper[2575]: I0609 15:29:28.595200 2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-hfd4x"] Jun 09 15:29:38.689354 ip-10-0-130-232 kubenswrapper[2575]: I0609 15:29:38.689321 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2bkzp_41532b1e-300d-4a9e-a64f-da302213062c/konnectivity-agent/0.log" limit=1024 Jun 09 15:29:39.384801 ip-10-0-130-232 kubenswrapper[2575]: I0609 15:29:39.384769 2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-hfd4x"] Jun 09 15:29:44.519963 ip-10-0-130-232 kubenswrapper[2575]: I0609 15:29:44.519928 2575 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477cjvlj5"] Jun 09 15:29:44.523959 ip-10-0-130-232 kubenswrapper[2575]: I0609 15:29:44.523940 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477cjvlj5" Jun 09 15:29:44.525916 ip-10-0-130-232 kubenswrapper[2575]: I0609 15:29:44.525898 2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"e2e-unab60ef4d3a239b5143b412cab04acac3-kserve-self-signed-certs\"" Jun 09 15:29:44.535149 ip-10-0-130-232 kubenswrapper[2575]: I0609 15:29:44.535123 2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477cjvlj5"] Jun 09 15:29:44.544122 ip-10-0-130-232 kubenswrapper[2575]: I0609 15:29:44.544100 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2bkzp_41532b1e-300d-4a9e-a64f-da302213062c/konnectivity-agent/0.log" limit=1024 Jun 09 15:29:44.575892 ip-10-0-130-232 kubenswrapper[2575]: I0609 15:29:44.575859 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/5f1f436a-f908-4efc-8b98-a9180848956f-dshm\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477cjvlj5\" (UID: \"5f1f436a-f908-4efc-8b98-a9180848956f\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477cjvlj5" Jun 09 15:29:44.576015 ip-10-0-130-232 kubenswrapper[2575]: I0609 15:29:44.575918 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/5f1f436a-f908-4efc-8b98-a9180848956f-model-cache\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477cjvlj5\" (UID: \"5f1f436a-f908-4efc-8b98-a9180848956f\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477cjvlj5" Jun 09 15:29:44.576015 ip-10-0-130-232 kubenswrapper[2575]: I0609 15:29:44.575938 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/5f1f436a-f908-4efc-8b98-a9180848956f-kserve-provision-location\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477cjvlj5\" (UID: \"5f1f436a-f908-4efc-8b98-a9180848956f\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477cjvlj5" Jun 09 15:29:44.576136 ip-10-0-130-232 kubenswrapper[2575]: I0609 15:29:44.576034 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/5f1f436a-f908-4efc-8b98-a9180848956f-home\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477cjvlj5\" (UID: \"5f1f436a-f908-4efc-8b98-a9180848956f\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477cjvlj5" Jun 09 15:29:44.576136 ip-10-0-130-232 kubenswrapper[2575]: I0609 15:29:44.576075 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-lxptv\" (UniqueName: \"kubernetes.io/projected/5f1f436a-f908-4efc-8b98-a9180848956f-kube-api-access-lxptv\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477cjvlj5\" (UID: \"5f1f436a-f908-4efc-8b98-a9180848956f\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477cjvlj5" Jun 09 15:29:44.576213 ip-10-0-130-232 kubenswrapper[2575]: I0609 15:29:44.576149 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/5f1f436a-f908-4efc-8b98-a9180848956f-tls-certs\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477cjvlj5\" (UID: \"5f1f436a-f908-4efc-8b98-a9180848956f\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477cjvlj5" Jun 09 15:29:44.677161 ip-10-0-130-232 kubenswrapper[2575]: I0609 15:29:44.677125 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/5f1f436a-f908-4efc-8b98-a9180848956f-dshm\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477cjvlj5\" (UID: \"5f1f436a-f908-4efc-8b98-a9180848956f\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477cjvlj5" Jun 09 15:29:44.677333 ip-10-0-130-232 kubenswrapper[2575]: I0609 15:29:44.677209 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/5f1f436a-f908-4efc-8b98-a9180848956f-model-cache\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477cjvlj5\" (UID: \"5f1f436a-f908-4efc-8b98-a9180848956f\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477cjvlj5" Jun 09 15:29:44.677333 ip-10-0-130-232 kubenswrapper[2575]: I0609 15:29:44.677238 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/5f1f436a-f908-4efc-8b98-a9180848956f-kserve-provision-location\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477cjvlj5\" (UID: \"5f1f436a-f908-4efc-8b98-a9180848956f\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477cjvlj5" Jun 09 15:29:44.677333 ip-10-0-130-232 kubenswrapper[2575]: I0609 15:29:44.677296 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/5f1f436a-f908-4efc-8b98-a9180848956f-home\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477cjvlj5\" (UID: \"5f1f436a-f908-4efc-8b98-a9180848956f\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477cjvlj5" Jun 09 15:29:44.677333 ip-10-0-130-232 kubenswrapper[2575]: I0609 15:29:44.677323 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-lxptv\" (UniqueName: \"kubernetes.io/projected/5f1f436a-f908-4efc-8b98-a9180848956f-kube-api-access-lxptv\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477cjvlj5\" (UID: \"5f1f436a-f908-4efc-8b98-a9180848956f\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477cjvlj5" Jun 09 15:29:44.677550 ip-10-0-130-232 kubenswrapper[2575]: I0609 15:29:44.677362 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/5f1f436a-f908-4efc-8b98-a9180848956f-tls-certs\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477cjvlj5\" (UID: \"5f1f436a-f908-4efc-8b98-a9180848956f\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477cjvlj5" Jun 09 15:29:44.677651 ip-10-0-130-232 kubenswrapper[2575]: I0609 15:29:44.677627 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/5f1f436a-f908-4efc-8b98-a9180848956f-model-cache\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477cjvlj5\" (UID: \"5f1f436a-f908-4efc-8b98-a9180848956f\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477cjvlj5" Jun 09 15:29:44.677713 ip-10-0-130-232 kubenswrapper[2575]: I0609 15:29:44.677675 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/5f1f436a-f908-4efc-8b98-a9180848956f-home\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477cjvlj5\" (UID: \"5f1f436a-f908-4efc-8b98-a9180848956f\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477cjvlj5" Jun 09 15:29:44.677754 ip-10-0-130-232 kubenswrapper[2575]: I0609 15:29:44.677736 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/5f1f436a-f908-4efc-8b98-a9180848956f-kserve-provision-location\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477cjvlj5\" (UID: \"5f1f436a-f908-4efc-8b98-a9180848956f\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477cjvlj5" Jun 09 15:29:44.679498 ip-10-0-130-232 kubenswrapper[2575]: I0609 15:29:44.679473 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/5f1f436a-f908-4efc-8b98-a9180848956f-dshm\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477cjvlj5\" (UID: \"5f1f436a-f908-4efc-8b98-a9180848956f\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477cjvlj5" Jun 09 15:29:44.679864 ip-10-0-130-232 kubenswrapper[2575]: I0609 15:29:44.679830 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/5f1f436a-f908-4efc-8b98-a9180848956f-tls-certs\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477cjvlj5\" (UID: \"5f1f436a-f908-4efc-8b98-a9180848956f\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477cjvlj5" Jun 09 15:29:44.686568 ip-10-0-130-232 kubenswrapper[2575]: I0609 15:29:44.686547 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-lxptv\" (UniqueName: \"kubernetes.io/projected/5f1f436a-f908-4efc-8b98-a9180848956f-kube-api-access-lxptv\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477cjvlj5\" (UID: \"5f1f436a-f908-4efc-8b98-a9180848956f\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477cjvlj5" Jun 09 15:29:44.833912 ip-10-0-130-232 kubenswrapper[2575]: I0609 15:29:44.833798 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477cjvlj5" Jun 09 15:29:44.972196 ip-10-0-130-232 kubenswrapper[2575]: I0609 15:29:44.972171 2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477cjvlj5"] Jun 09 15:29:44.974132 ip-10-0-130-232 kubenswrapper[2575]: W0609 15:29:44.974095 2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5f1f436a_f908_4efc_8b98_a9180848956f.slice/crio-1f9e1a4f3ad574c5c5bfc49b4dbfb2e04ae8ccd6c546bbfff48b1925d50ebf92 WatchSource:0}: Error finding container 1f9e1a4f3ad574c5c5bfc49b4dbfb2e04ae8ccd6c546bbfff48b1925d50ebf92: Status 404 returned error can't find the container with id 1f9e1a4f3ad574c5c5bfc49b4dbfb2e04ae8ccd6c546bbfff48b1925d50ebf92 Jun 09 15:29:45.269402 ip-10-0-130-232 kubenswrapper[2575]: I0609 15:29:45.269368 2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-hfd4x"] Jun 09 15:29:45.442209 ip-10-0-130-232 kubenswrapper[2575]: I0609 15:29:45.442174 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477cjvlj5" event={"ID":"5f1f436a-f908-4efc-8b98-a9180848956f","Type":"ContainerStarted","Data":"2537c351e64c7a589ea65c735f852855a49d1a4507672c811e420370cb03face"} Jun 09 15:29:45.442369 ip-10-0-130-232 kubenswrapper[2575]: I0609 15:29:45.442229 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477cjvlj5" event={"ID":"5f1f436a-f908-4efc-8b98-a9180848956f","Type":"ContainerStarted","Data":"1f9e1a4f3ad574c5c5bfc49b4dbfb2e04ae8ccd6c546bbfff48b1925d50ebf92"} Jun 09 15:29:48.458912 ip-10-0-130-232 kubenswrapper[2575]: I0609 15:29:48.458879 2575 generic.go:356] "Generic (PLEG): container finished" podID="5f1f436a-f908-4efc-8b98-a9180848956f" containerID="2537c351e64c7a589ea65c735f852855a49d1a4507672c811e420370cb03face" exitCode=0 Jun 09 15:29:48.459275 ip-10-0-130-232 kubenswrapper[2575]: I0609 15:29:48.458955 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477cjvlj5" event={"ID":"5f1f436a-f908-4efc-8b98-a9180848956f","Type":"ContainerDied","Data":"2537c351e64c7a589ea65c735f852855a49d1a4507672c811e420370cb03face"} Jun 09 15:29:48.962960 ip-10-0-130-232 kubenswrapper[2575]: I0609 15:29:48.962923 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2bkzp_41532b1e-300d-4a9e-a64f-da302213062c/konnectivity-agent/0.log" limit=1024 Jun 09 15:29:49.872067 ip-10-0-130-232 kubenswrapper[2575]: I0609 15:29:49.872027 2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-hfd4x"] Jun 09 15:29:50.473496 ip-10-0-130-232 kubenswrapper[2575]: I0609 15:29:50.473462 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477cjvlj5" event={"ID":"5f1f436a-f908-4efc-8b98-a9180848956f","Type":"ContainerStarted","Data":"0b02ac32bdd2af4757b2b1b8ddfcbb6a2bbf9654062f6b445d1c985d2d428520"} Jun 09 15:29:50.493736 ip-10-0-130-232 kubenswrapper[2575]: I0609 15:29:50.493688 2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477cjvlj5" podStartSLOduration=1.835343177 podStartE2EDuration="6.493674174s" totalImagesPullingTime="1.863668043s" totalInitContainerRuntime="2.794662954s" isStatefulPod=false podCreationTimestamp="2026-06-09 15:29:44 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-09 15:29:50.491181058 +0000 UTC m=+930.179186510" watchObservedRunningTime="2026-06-09 15:29:50.493674174 +0000 UTC m=+930.181679627" Jun 09 15:29:54.834121 ip-10-0-130-232 kubenswrapper[2575]: I0609 15:29:54.834088 2575 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477cjvlj5" Jun 09 15:29:54.834532 ip-10-0-130-232 kubenswrapper[2575]: I0609 15:29:54.834179 2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477cjvlj5" Jun 09 15:29:54.846425 ip-10-0-130-232 kubenswrapper[2575]: I0609 15:29:54.846404 2575 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477cjvlj5" Jun 09 15:29:55.508751 ip-10-0-130-232 kubenswrapper[2575]: I0609 15:29:55.508725 2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477cjvlj5" Jun 09 15:30:05.271222 ip-10-0-130-232 kubenswrapper[2575]: I0609 15:30:05.271192 2575 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/premium-simulated-simulated-premium-kserve-66967c79b-sbw7k"] Jun 09 15:30:05.291067 ip-10-0-130-232 kubenswrapper[2575]: I0609 15:30:05.291041 2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/premium-simulated-simulated-premium-kserve-66967c79b-sbw7k"] Jun 09 15:30:05.291215 ip-10-0-130-232 kubenswrapper[2575]: I0609 15:30:05.291134 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/premium-simulated-simulated-premium-kserve-66967c79b-sbw7k" Jun 09 15:30:05.294291 ip-10-0-130-232 kubenswrapper[2575]: I0609 15:30:05.294262 2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"premium-simulated-simulated-premium-kserve-self-signed-certs\"" Jun 09 15:30:05.301661 ip-10-0-130-232 kubenswrapper[2575]: I0609 15:30:05.301635 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2bkzp_41532b1e-300d-4a9e-a64f-da302213062c/konnectivity-agent/0.log" limit=1024 Jun 09 15:30:05.359166 ip-10-0-130-232 kubenswrapper[2575]: I0609 15:30:05.359135 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/09ff5519-0cdf-4c56-ae05-fa7f5a82acab-kserve-provision-location\") pod \"premium-simulated-simulated-premium-kserve-66967c79b-sbw7k\" (UID: \"09ff5519-0cdf-4c56-ae05-fa7f5a82acab\") " pod="llm/premium-simulated-simulated-premium-kserve-66967c79b-sbw7k" Jun 09 15:30:05.359305 ip-10-0-130-232 kubenswrapper[2575]: I0609 15:30:05.359193 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/09ff5519-0cdf-4c56-ae05-fa7f5a82acab-model-cache\") pod \"premium-simulated-simulated-premium-kserve-66967c79b-sbw7k\" (UID: \"09ff5519-0cdf-4c56-ae05-fa7f5a82acab\") " pod="llm/premium-simulated-simulated-premium-kserve-66967c79b-sbw7k" Jun 09 15:30:05.359305 ip-10-0-130-232 kubenswrapper[2575]: I0609 15:30:05.359252 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/09ff5519-0cdf-4c56-ae05-fa7f5a82acab-home\") pod \"premium-simulated-simulated-premium-kserve-66967c79b-sbw7k\" (UID: \"09ff5519-0cdf-4c56-ae05-fa7f5a82acab\") " pod="llm/premium-simulated-simulated-premium-kserve-66967c79b-sbw7k" Jun 09 15:30:05.359305 ip-10-0-130-232 kubenswrapper[2575]: I0609 15:30:05.359295 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/09ff5519-0cdf-4c56-ae05-fa7f5a82acab-dshm\") pod \"premium-simulated-simulated-premium-kserve-66967c79b-sbw7k\" (UID: \"09ff5519-0cdf-4c56-ae05-fa7f5a82acab\") " pod="llm/premium-simulated-simulated-premium-kserve-66967c79b-sbw7k" Jun 09 15:30:05.359418 ip-10-0-130-232 kubenswrapper[2575]: I0609 15:30:05.359312 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/09ff5519-0cdf-4c56-ae05-fa7f5a82acab-tls-certs\") pod \"premium-simulated-simulated-premium-kserve-66967c79b-sbw7k\" (UID: \"09ff5519-0cdf-4c56-ae05-fa7f5a82acab\") " pod="llm/premium-simulated-simulated-premium-kserve-66967c79b-sbw7k" Jun 09 15:30:05.359418 ip-10-0-130-232 kubenswrapper[2575]: I0609 15:30:05.359329 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-v8g4m\" (UniqueName: \"kubernetes.io/projected/09ff5519-0cdf-4c56-ae05-fa7f5a82acab-kube-api-access-v8g4m\") pod \"premium-simulated-simulated-premium-kserve-66967c79b-sbw7k\" (UID: \"09ff5519-0cdf-4c56-ae05-fa7f5a82acab\") " pod="llm/premium-simulated-simulated-premium-kserve-66967c79b-sbw7k" Jun 09 15:30:05.460765 ip-10-0-130-232 kubenswrapper[2575]: I0609 15:30:05.460728 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/09ff5519-0cdf-4c56-ae05-fa7f5a82acab-model-cache\") pod \"premium-simulated-simulated-premium-kserve-66967c79b-sbw7k\" (UID: \"09ff5519-0cdf-4c56-ae05-fa7f5a82acab\") " pod="llm/premium-simulated-simulated-premium-kserve-66967c79b-sbw7k" Jun 09 15:30:05.460955 ip-10-0-130-232 kubenswrapper[2575]: I0609 15:30:05.460780 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/09ff5519-0cdf-4c56-ae05-fa7f5a82acab-home\") pod \"premium-simulated-simulated-premium-kserve-66967c79b-sbw7k\" (UID: \"09ff5519-0cdf-4c56-ae05-fa7f5a82acab\") " pod="llm/premium-simulated-simulated-premium-kserve-66967c79b-sbw7k" Jun 09 15:30:05.460955 ip-10-0-130-232 kubenswrapper[2575]: I0609 15:30:05.460907 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/09ff5519-0cdf-4c56-ae05-fa7f5a82acab-dshm\") pod \"premium-simulated-simulated-premium-kserve-66967c79b-sbw7k\" (UID: \"09ff5519-0cdf-4c56-ae05-fa7f5a82acab\") " pod="llm/premium-simulated-simulated-premium-kserve-66967c79b-sbw7k" Jun 09 15:30:05.460955 ip-10-0-130-232 kubenswrapper[2575]: I0609 15:30:05.460947 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/09ff5519-0cdf-4c56-ae05-fa7f5a82acab-tls-certs\") pod \"premium-simulated-simulated-premium-kserve-66967c79b-sbw7k\" (UID: \"09ff5519-0cdf-4c56-ae05-fa7f5a82acab\") " pod="llm/premium-simulated-simulated-premium-kserve-66967c79b-sbw7k" Jun 09 15:30:05.461070 ip-10-0-130-232 kubenswrapper[2575]: I0609 15:30:05.460971 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-v8g4m\" (UniqueName: \"kubernetes.io/projected/09ff5519-0cdf-4c56-ae05-fa7f5a82acab-kube-api-access-v8g4m\") pod \"premium-simulated-simulated-premium-kserve-66967c79b-sbw7k\" (UID: \"09ff5519-0cdf-4c56-ae05-fa7f5a82acab\") " pod="llm/premium-simulated-simulated-premium-kserve-66967c79b-sbw7k" Jun 09 15:30:05.461070 ip-10-0-130-232 kubenswrapper[2575]: I0609 15:30:05.461030 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/09ff5519-0cdf-4c56-ae05-fa7f5a82acab-kserve-provision-location\") pod \"premium-simulated-simulated-premium-kserve-66967c79b-sbw7k\" (UID: \"09ff5519-0cdf-4c56-ae05-fa7f5a82acab\") " pod="llm/premium-simulated-simulated-premium-kserve-66967c79b-sbw7k" Jun 09 15:30:05.461215 ip-10-0-130-232 kubenswrapper[2575]: I0609 15:30:05.461193 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/09ff5519-0cdf-4c56-ae05-fa7f5a82acab-home\") pod \"premium-simulated-simulated-premium-kserve-66967c79b-sbw7k\" (UID: \"09ff5519-0cdf-4c56-ae05-fa7f5a82acab\") " pod="llm/premium-simulated-simulated-premium-kserve-66967c79b-sbw7k" Jun 09 15:30:05.461271 ip-10-0-130-232 kubenswrapper[2575]: I0609 15:30:05.461241 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/09ff5519-0cdf-4c56-ae05-fa7f5a82acab-model-cache\") pod \"premium-simulated-simulated-premium-kserve-66967c79b-sbw7k\" (UID: \"09ff5519-0cdf-4c56-ae05-fa7f5a82acab\") " pod="llm/premium-simulated-simulated-premium-kserve-66967c79b-sbw7k" Jun 09 15:30:05.461321 ip-10-0-130-232 kubenswrapper[2575]: I0609 15:30:05.461313 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/09ff5519-0cdf-4c56-ae05-fa7f5a82acab-kserve-provision-location\") pod \"premium-simulated-simulated-premium-kserve-66967c79b-sbw7k\" (UID: \"09ff5519-0cdf-4c56-ae05-fa7f5a82acab\") " pod="llm/premium-simulated-simulated-premium-kserve-66967c79b-sbw7k" Jun 09 15:30:05.463216 ip-10-0-130-232 kubenswrapper[2575]: I0609 15:30:05.463195 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/09ff5519-0cdf-4c56-ae05-fa7f5a82acab-dshm\") pod \"premium-simulated-simulated-premium-kserve-66967c79b-sbw7k\" (UID: \"09ff5519-0cdf-4c56-ae05-fa7f5a82acab\") " pod="llm/premium-simulated-simulated-premium-kserve-66967c79b-sbw7k" Jun 09 15:30:05.463607 ip-10-0-130-232 kubenswrapper[2575]: I0609 15:30:05.463588 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/09ff5519-0cdf-4c56-ae05-fa7f5a82acab-tls-certs\") pod \"premium-simulated-simulated-premium-kserve-66967c79b-sbw7k\" (UID: \"09ff5519-0cdf-4c56-ae05-fa7f5a82acab\") " pod="llm/premium-simulated-simulated-premium-kserve-66967c79b-sbw7k" Jun 09 15:30:05.473244 ip-10-0-130-232 kubenswrapper[2575]: I0609 15:30:05.473219 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-v8g4m\" (UniqueName: \"kubernetes.io/projected/09ff5519-0cdf-4c56-ae05-fa7f5a82acab-kube-api-access-v8g4m\") pod \"premium-simulated-simulated-premium-kserve-66967c79b-sbw7k\" (UID: \"09ff5519-0cdf-4c56-ae05-fa7f5a82acab\") " pod="llm/premium-simulated-simulated-premium-kserve-66967c79b-sbw7k" Jun 09 15:30:05.601352 ip-10-0-130-232 kubenswrapper[2575]: I0609 15:30:05.601258 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/premium-simulated-simulated-premium-kserve-66967c79b-sbw7k" Jun 09 15:30:05.744946 ip-10-0-130-232 kubenswrapper[2575]: I0609 15:30:05.744825 2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/premium-simulated-simulated-premium-kserve-66967c79b-sbw7k"] Jun 09 15:30:05.747677 ip-10-0-130-232 kubenswrapper[2575]: W0609 15:30:05.747654 2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod09ff5519_0cdf_4c56_ae05_fa7f5a82acab.slice/crio-15dbac0cf3d7874a8696edf6a17d433b9336f25db5adac0c2b2b4e6c21ac7c6b WatchSource:0}: Error finding container 15dbac0cf3d7874a8696edf6a17d433b9336f25db5adac0c2b2b4e6c21ac7c6b: Status 404 returned error can't find the container with id 15dbac0cf3d7874a8696edf6a17d433b9336f25db5adac0c2b2b4e6c21ac7c6b Jun 09 15:30:06.549008 ip-10-0-130-232 kubenswrapper[2575]: I0609 15:30:06.548976 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/premium-simulated-simulated-premium-kserve-66967c79b-sbw7k" event={"ID":"09ff5519-0cdf-4c56-ae05-fa7f5a82acab","Type":"ContainerStarted","Data":"11a50b707ebb4381467f69ee6df434ad7ddc60992a611788eb333da33b9e61e7"} Jun 09 15:30:06.549382 ip-10-0-130-232 kubenswrapper[2575]: I0609 15:30:06.549022 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/premium-simulated-simulated-premium-kserve-66967c79b-sbw7k" event={"ID":"09ff5519-0cdf-4c56-ae05-fa7f5a82acab","Type":"ContainerStarted","Data":"15dbac0cf3d7874a8696edf6a17d433b9336f25db5adac0c2b2b4e6c21ac7c6b"} Jun 09 15:30:06.775306 ip-10-0-130-232 kubenswrapper[2575]: I0609 15:30:06.775265 2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-hfd4x"] Jun 09 15:30:18.610963 ip-10-0-130-232 kubenswrapper[2575]: I0609 15:30:18.610927 2575 generic.go:356] "Generic (PLEG): container finished" podID="8b4b6a2c-6f65-4076-9d54-5d06eb16e6a2" containerID="0a715ddb4a79e4b76cb7cd20e4585f7fcbf2c0b4327954ad569e5dfd401950b3" exitCode=0 Jun 09 15:30:18.611364 ip-10-0-130-232 kubenswrapper[2575]: I0609 15:30:18.610972 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-2-simulated-kserve-f5c55bdc-jzdgr" event={"ID":"8b4b6a2c-6f65-4076-9d54-5d06eb16e6a2","Type":"ContainerDied","Data":"0a715ddb4a79e4b76cb7cd20e4585f7fcbf2c0b4327954ad569e5dfd401950b3"} Jun 09 15:30:19.617612 ip-10-0-130-232 kubenswrapper[2575]: I0609 15:30:19.617578 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-2-simulated-kserve-f5c55bdc-jzdgr" event={"ID":"8b4b6a2c-6f65-4076-9d54-5d06eb16e6a2","Type":"ContainerStarted","Data":"31654e8f749c6c1bd71d4d1cd63d3fc464c197982e5e40cc701fdb45aa617553"} Jun 09 15:30:19.636555 ip-10-0-130-232 kubenswrapper[2575]: I0609 15:30:19.636500 2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/e2e-distinct-2-simulated-kserve-f5c55bdc-jzdgr" podStartSLOduration=2.853896339 podStartE2EDuration="1m0.636482135s" totalImagesPullingTime="5.204471328s" totalInitContainerRuntime="52.578114468s" isStatefulPod=false podCreationTimestamp="2026-06-09 15:29:19 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-09 15:30:19.635420975 +0000 UTC m=+959.323426440" watchObservedRunningTime="2026-06-09 15:30:19.636482135 +0000 UTC m=+959.324487593" Jun 09 15:30:20.186341 ip-10-0-130-232 kubenswrapper[2575]: I0609 15:30:20.186308 2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/e2e-distinct-2-simulated-kserve-f5c55bdc-jzdgr" Jun 09 15:30:20.186519 ip-10-0-130-232 kubenswrapper[2575]: I0609 15:30:20.186386 2575 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/e2e-distinct-2-simulated-kserve-f5c55bdc-jzdgr" Jun 09 15:30:20.198935 ip-10-0-130-232 kubenswrapper[2575]: I0609 15:30:20.198907 2575 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/e2e-distinct-2-simulated-kserve-f5c55bdc-jzdgr" Jun 09 15:30:20.633590 ip-10-0-130-232 kubenswrapper[2575]: I0609 15:30:20.633563 2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/e2e-distinct-2-simulated-kserve-f5c55bdc-jzdgr" Jun 09 15:31:19.795472 ip-10-0-130-232 kubenswrapper[2575]: I0609 15:31:19.795437 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2bkzp_41532b1e-300d-4a9e-a64f-da302213062c/konnectivity-agent/0.log" limit=1024 Jun 09 15:31:19.893546 ip-10-0-130-232 kubenswrapper[2575]: I0609 15:31:19.893515 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2bkzp_41532b1e-300d-4a9e-a64f-da302213062c/konnectivity-agent/0.log" limit=1024 Jun 09 15:31:54.130484 ip-10-0-130-232 kubenswrapper[2575]: I0609 15:31:54.130451 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2bkzp_41532b1e-300d-4a9e-a64f-da302213062c/konnectivity-agent/0.log" limit=1024 Jun 09 15:31:54.193460 ip-10-0-130-232 kubenswrapper[2575]: I0609 15:31:54.193425 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2bkzp_41532b1e-300d-4a9e-a64f-da302213062c/konnectivity-agent/0.log" limit=1024 Jun 09 15:32:34.463715 ip-10-0-130-232 kubenswrapper[2575]: I0609 15:32:34.463681 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2bkzp_41532b1e-300d-4a9e-a64f-da302213062c/konnectivity-agent/0.log" limit=1024 Jun 09 15:32:34.565282 ip-10-0-130-232 kubenswrapper[2575]: I0609 15:32:34.565250 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2bkzp_41532b1e-300d-4a9e-a64f-da302213062c/konnectivity-agent/0.log" limit=1024 Jun 09 15:32:42.307475 ip-10-0-130-232 kubenswrapper[2575]: I0609 15:32:42.307444 2575 generic.go:356] "Generic (PLEG): container finished" podID="09ff5519-0cdf-4c56-ae05-fa7f5a82acab" containerID="11a50b707ebb4381467f69ee6df434ad7ddc60992a611788eb333da33b9e61e7" exitCode=0 Jun 09 15:32:42.307831 ip-10-0-130-232 kubenswrapper[2575]: I0609 15:32:42.307517 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/premium-simulated-simulated-premium-kserve-66967c79b-sbw7k" event={"ID":"09ff5519-0cdf-4c56-ae05-fa7f5a82acab","Type":"ContainerDied","Data":"11a50b707ebb4381467f69ee6df434ad7ddc60992a611788eb333da33b9e61e7"} Jun 09 15:32:43.315586 ip-10-0-130-232 kubenswrapper[2575]: I0609 15:32:43.315549 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/premium-simulated-simulated-premium-kserve-66967c79b-sbw7k" event={"ID":"09ff5519-0cdf-4c56-ae05-fa7f5a82acab","Type":"ContainerStarted","Data":"2c6797331ee081e68703e88e07588511cfd5984ae4a229e3f90fdc4361785021"} Jun 09 15:32:43.333170 ip-10-0-130-232 kubenswrapper[2575]: I0609 15:32:43.333116 2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/premium-simulated-simulated-premium-kserve-66967c79b-sbw7k" podStartSLOduration=2.130016725 podStartE2EDuration="2m38.333097834s" totalImagesPullingTime="279.447852ms" totalInitContainerRuntime="2m35.923633257s" isStatefulPod=false podCreationTimestamp="2026-06-09 15:30:05 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-09 15:32:43.332389448 +0000 UTC m=+1103.020394903" watchObservedRunningTime="2026-06-09 15:32:43.333097834 +0000 UTC m=+1103.021103292" Jun 09 15:32:45.602065 ip-10-0-130-232 kubenswrapper[2575]: I0609 15:32:45.602027 2575 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/premium-simulated-simulated-premium-kserve-66967c79b-sbw7k" Jun 09 15:32:45.602515 ip-10-0-130-232 kubenswrapper[2575]: I0609 15:32:45.602326 2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/premium-simulated-simulated-premium-kserve-66967c79b-sbw7k" Jun 09 15:32:45.614268 ip-10-0-130-232 kubenswrapper[2575]: I0609 15:32:45.614243 2575 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/premium-simulated-simulated-premium-kserve-66967c79b-sbw7k" Jun 09 15:32:46.340282 ip-10-0-130-232 kubenswrapper[2575]: I0609 15:32:46.340250 2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/premium-simulated-simulated-premium-kserve-66967c79b-sbw7k" Jun 09 15:32:48.172568 ip-10-0-130-232 kubenswrapper[2575]: I0609 15:32:48.172537 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2bkzp_41532b1e-300d-4a9e-a64f-da302213062c/konnectivity-agent/0.log" limit=1024 Jun 09 15:32:48.272915 ip-10-0-130-232 kubenswrapper[2575]: I0609 15:32:48.272881 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2bkzp_41532b1e-300d-4a9e-a64f-da302213062c/konnectivity-agent/0.log" limit=1024 Jun 09 15:32:49.302323 ip-10-0-130-232 kubenswrapper[2575]: I0609 15:32:49.302289 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2bkzp_41532b1e-300d-4a9e-a64f-da302213062c/konnectivity-agent/0.log" limit=1024 Jun 09 15:32:49.399885 ip-10-0-130-232 kubenswrapper[2575]: I0609 15:32:49.399839 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2bkzp_41532b1e-300d-4a9e-a64f-da302213062c/konnectivity-agent/0.log" limit=1024 Jun 09 15:33:23.187240 ip-10-0-130-232 kubenswrapper[2575]: I0609 15:33:23.187200 2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-hfd4x"] Jun 09 15:33:33.072637 ip-10-0-130-232 kubenswrapper[2575]: I0609 15:33:33.072600 2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-hfd4x"] Jun 09 15:33:42.469939 ip-10-0-130-232 kubenswrapper[2575]: I0609 15:33:42.469833 2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-hfd4x"] Jun 09 15:33:53.067754 ip-10-0-130-232 kubenswrapper[2575]: I0609 15:33:53.067718 2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-hfd4x"] Jun 09 15:34:01.666611 ip-10-0-130-232 kubenswrapper[2575]: I0609 15:34:01.666571 2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-hfd4x"] Jun 09 15:34:12.183872 ip-10-0-130-232 kubenswrapper[2575]: I0609 15:34:12.183828 2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-hfd4x"] Jun 09 15:34:19.992319 ip-10-0-130-232 kubenswrapper[2575]: I0609 15:34:19.992282 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2bkzp_41532b1e-300d-4a9e-a64f-da302213062c/konnectivity-agent/0.log" limit=1024 Jun 09 15:34:21.793012 ip-10-0-130-232 kubenswrapper[2575]: I0609 15:34:21.792973 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2bkzp_41532b1e-300d-4a9e-a64f-da302213062c/konnectivity-agent/0.log" limit=1024 Jun 09 15:34:41.641261 ip-10-0-130-232 kubenswrapper[2575]: I0609 15:34:41.641227 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2bkzp_41532b1e-300d-4a9e-a64f-da302213062c/konnectivity-agent/0.log" limit=1024 Jun 09 15:34:54.180383 ip-10-0-130-232 kubenswrapper[2575]: I0609 15:34:54.180343 2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-hfd4x"] Jun 09 15:35:10.056347 ip-10-0-130-232 kubenswrapper[2575]: I0609 15:35:10.056270 2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-hfd4x"] Jun 09 15:35:16.999868 ip-10-0-130-232 kubenswrapper[2575]: I0609 15:35:16.999796 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2bkzp_41532b1e-300d-4a9e-a64f-da302213062c/konnectivity-agent/0.log" limit=1024 Jun 09 15:35:17.099977 ip-10-0-130-232 kubenswrapper[2575]: I0609 15:35:17.099937 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2bkzp_41532b1e-300d-4a9e-a64f-da302213062c/konnectivity-agent/0.log" limit=1024 Jun 09 15:35:38.200600 ip-10-0-130-232 kubenswrapper[2575]: I0609 15:35:38.200564 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2bkzp_41532b1e-300d-4a9e-a64f-da302213062c/konnectivity-agent/0.log" limit=1024 Jun 09 15:35:40.935749 ip-10-0-130-232 kubenswrapper[2575]: I0609 15:35:40.935710 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2bkzp_41532b1e-300d-4a9e-a64f-da302213062c/konnectivity-agent/0.log" limit=1024 Jun 09 15:35:46.963567 ip-10-0-130-232 kubenswrapper[2575]: I0609 15:35:46.963525 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2bkzp_41532b1e-300d-4a9e-a64f-da302213062c/konnectivity-agent/0.log" limit=1024 Jun 09 15:35:47.078714 ip-10-0-130-232 kubenswrapper[2575]: I0609 15:35:47.078680 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2bkzp_41532b1e-300d-4a9e-a64f-da302213062c/konnectivity-agent/0.log" limit=1024 Jun 09 15:35:47.190715 ip-10-0-130-232 kubenswrapper[2575]: I0609 15:35:47.190679 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2bkzp_41532b1e-300d-4a9e-a64f-da302213062c/konnectivity-agent/0.log" limit=1024 Jun 09 15:35:47.419427 ip-10-0-130-232 kubenswrapper[2575]: I0609 15:35:47.419377 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2bkzp_41532b1e-300d-4a9e-a64f-da302213062c/konnectivity-agent/0.log" limit=1024 Jun 09 15:35:47.552774 ip-10-0-130-232 kubenswrapper[2575]: I0609 15:35:47.552736 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2bkzp_41532b1e-300d-4a9e-a64f-da302213062c/konnectivity-agent/0.log" limit=1024 Jun 09 15:35:48.669731 ip-10-0-130-232 kubenswrapper[2575]: I0609 15:35:48.669691 2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-hfd4x"] Jun 09 15:36:03.950195 ip-10-0-130-232 kubenswrapper[2575]: I0609 15:36:03.950159 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2bkzp_41532b1e-300d-4a9e-a64f-da302213062c/konnectivity-agent/0.log" limit=1024 Jun 09 15:36:04.053739 ip-10-0-130-232 kubenswrapper[2575]: I0609 15:36:04.053697 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2bkzp_41532b1e-300d-4a9e-a64f-da302213062c/konnectivity-agent/0.log" limit=1024 Jun 09 15:36:04.164712 ip-10-0-130-232 kubenswrapper[2575]: I0609 15:36:04.164640 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2bkzp_41532b1e-300d-4a9e-a64f-da302213062c/konnectivity-agent/0.log" limit=1024 Jun 09 15:36:05.464341 ip-10-0-130-232 kubenswrapper[2575]: I0609 15:36:05.464308 2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-hfd4x"] Jun 09 15:36:09.873749 ip-10-0-130-232 kubenswrapper[2575]: I0609 15:36:09.873709 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2bkzp_41532b1e-300d-4a9e-a64f-da302213062c/konnectivity-agent/0.log" limit=1024 Jun 09 15:36:09.933602 ip-10-0-130-232 kubenswrapper[2575]: I0609 15:36:09.933567 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2bkzp_41532b1e-300d-4a9e-a64f-da302213062c/konnectivity-agent/0.log" limit=1024 Jun 09 15:36:18.015225 ip-10-0-130-232 kubenswrapper[2575]: I0609 15:36:18.015161 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2bkzp_41532b1e-300d-4a9e-a64f-da302213062c/konnectivity-agent/0.log" limit=1024 Jun 09 15:36:18.114925 ip-10-0-130-232 kubenswrapper[2575]: I0609 15:36:18.114887 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2bkzp_41532b1e-300d-4a9e-a64f-da302213062c/konnectivity-agent/0.log" limit=1024 Jun 09 15:36:18.215026 ip-10-0-130-232 kubenswrapper[2575]: I0609 15:36:18.214994 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2bkzp_41532b1e-300d-4a9e-a64f-da302213062c/konnectivity-agent/0.log" limit=1024 Jun 09 15:36:18.314451 ip-10-0-130-232 kubenswrapper[2575]: I0609 15:36:18.314363 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2bkzp_41532b1e-300d-4a9e-a64f-da302213062c/konnectivity-agent/0.log" limit=1024 Jun 09 15:36:19.567066 ip-10-0-130-232 kubenswrapper[2575]: I0609 15:36:19.567035 2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-hfd4x"] Jun 09 15:36:34.733900 ip-10-0-130-232 kubenswrapper[2575]: I0609 15:36:34.733823 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2bkzp_41532b1e-300d-4a9e-a64f-da302213062c/konnectivity-agent/0.log" limit=1024 Jun 09 15:36:34.831829 ip-10-0-130-232 kubenswrapper[2575]: I0609 15:36:34.831799 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2bkzp_41532b1e-300d-4a9e-a64f-da302213062c/konnectivity-agent/0.log" limit=1024 Jun 09 15:36:34.931661 ip-10-0-130-232 kubenswrapper[2575]: I0609 15:36:34.931623 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2bkzp_41532b1e-300d-4a9e-a64f-da302213062c/konnectivity-agent/0.log" limit=1024 Jun 09 15:36:35.971698 ip-10-0-130-232 kubenswrapper[2575]: I0609 15:36:35.971666 2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-hfd4x"] Jun 09 15:36:40.649229 ip-10-0-130-232 kubenswrapper[2575]: I0609 15:36:40.649146 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2bkzp_41532b1e-300d-4a9e-a64f-da302213062c/konnectivity-agent/0.log" limit=1024 Jun 09 15:36:40.720044 ip-10-0-130-232 kubenswrapper[2575]: I0609 15:36:40.720005 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2bkzp_41532b1e-300d-4a9e-a64f-da302213062c/konnectivity-agent/0.log" limit=1024 Jun 09 15:36:57.178860 ip-10-0-130-232 kubenswrapper[2575]: I0609 15:36:57.178812 2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-hfd4x"] Jun 09 15:36:59.039589 ip-10-0-130-232 kubenswrapper[2575]: I0609 15:36:59.039547 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2bkzp_41532b1e-300d-4a9e-a64f-da302213062c/konnectivity-agent/0.log" limit=1024 Jun 09 15:36:59.172974 ip-10-0-130-232 kubenswrapper[2575]: I0609 15:36:59.172939 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2bkzp_41532b1e-300d-4a9e-a64f-da302213062c/konnectivity-agent/0.log" limit=1024 Jun 09 15:36:59.283208 ip-10-0-130-232 kubenswrapper[2575]: I0609 15:36:59.283175 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2bkzp_41532b1e-300d-4a9e-a64f-da302213062c/konnectivity-agent/0.log" limit=1024 Jun 09 15:37:01.965293 ip-10-0-130-232 kubenswrapper[2575]: I0609 15:37:01.965259 2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-hfd4x"] Jun 09 15:37:05.067558 ip-10-0-130-232 kubenswrapper[2575]: I0609 15:37:05.067521 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2bkzp_41532b1e-300d-4a9e-a64f-da302213062c/konnectivity-agent/0.log" limit=1024 Jun 09 15:37:05.133560 ip-10-0-130-232 kubenswrapper[2575]: I0609 15:37:05.133523 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2bkzp_41532b1e-300d-4a9e-a64f-da302213062c/konnectivity-agent/0.log" limit=1024 Jun 09 15:37:05.235155 ip-10-0-130-232 kubenswrapper[2575]: I0609 15:37:05.235121 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2bkzp_41532b1e-300d-4a9e-a64f-da302213062c/konnectivity-agent/0.log" limit=1024 Jun 09 15:37:05.330077 ip-10-0-130-232 kubenswrapper[2575]: I0609 15:37:05.330000 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2bkzp_41532b1e-300d-4a9e-a64f-da302213062c/konnectivity-agent/0.log" limit=1024 Jun 09 15:37:05.450490 ip-10-0-130-232 kubenswrapper[2575]: I0609 15:37:05.450460 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2bkzp_41532b1e-300d-4a9e-a64f-da302213062c/konnectivity-agent/0.log" limit=1024 Jun 09 15:37:11.110572 ip-10-0-130-232 kubenswrapper[2575]: I0609 15:37:11.110536 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2bkzp_41532b1e-300d-4a9e-a64f-da302213062c/konnectivity-agent/0.log" limit=1024 Jun 09 15:37:11.166222 ip-10-0-130-232 kubenswrapper[2575]: I0609 15:37:11.166191 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2bkzp_41532b1e-300d-4a9e-a64f-da302213062c/konnectivity-agent/0.log" limit=1024 Jun 09 15:37:16.022052 ip-10-0-130-232 kubenswrapper[2575]: I0609 15:37:16.022022 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_dashboard-redirect-6dc9d488bd-dlm9n_f236fbb3-be5f-4068-beab-dcf4843d0ab8/nginx/0.log" Jun 09 15:37:16.259717 ip-10-0-130-232 kubenswrapper[2575]: I0609 15:37:16.259686 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_kserve-controller-manager-69fc866d76-47qf2_67c921a6-a58e-4f6f-8947-b5dc8d5d6bf6/manager/0.log" Jun 09 15:37:16.386970 ip-10-0-130-232 kubenswrapper[2575]: I0609 15:37:16.386885 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_llmisvc-controller-manager-864bfd7bc9-9wjl9_c9ff96d5-f8c6-4eaf-a73b-b72b72908bf4/manager/0.log" Jun 09 15:37:17.099595 ip-10-0-130-232 kubenswrapper[2575]: I0609 15:37:17.099566 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-f5f495f5c-dvnkh_ecfa9e10-2268-4ead-89d6-88b39352b5fe/manager/0.log" Jun 09 15:37:17.107470 ip-10-0-130-232 kubenswrapper[2575]: I0609 15:37:17.107450 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-f5f495f5c-dvnkh_ecfa9e10-2268-4ead-89d6-88b39352b5fe/copy-manifests/0.log" Jun 09 15:37:19.384668 ip-10-0-130-232 kubenswrapper[2575]: I0609 15:37:19.384645 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_limitador-limitador-54d6d988d5-hfd4x_2041f19f-b861-4b21-8838-420feecddfd8/limitador/0.log" Jun 09 15:37:19.502804 ip-10-0-130-232 kubenswrapper[2575]: I0609 15:37:19.502771 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_limitador-operator-controller-manager-859d7b78bd-4dj6z_dd0ef42e-8035-4dfc-b246-583ddd584847/manager/0.log" Jun 09 15:37:19.968066 ip-10-0-130-232 kubenswrapper[2575]: I0609 15:37:19.968039 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_istiod-openshift-gateway-75c67f8887-rwsxh_6850508b-e6e7-40f7-93bb-dc898dabcf14/discovery/0.log" Jun 09 15:37:20.076047 ip-10-0-130-232 kubenswrapper[2575]: I0609 15:37:20.076018 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-5dcd85bb64-jm6pc_8ca64b52-2b1a-4c2c-8b9f-d66961c48a05/kube-auth-proxy/0.log" Jun 09 15:37:20.970341 ip-10-0-130-232 kubenswrapper[2575]: I0609 15:37:20.970308 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-distinct-2-simulated-kserve-f5c55bdc-jzdgr_8b4b6a2c-6f65-4076-9d54-5d06eb16e6a2/storage-initializer/0.log" Jun 09 15:37:20.977612 ip-10-0-130-232 kubenswrapper[2575]: I0609 15:37:20.977586 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-distinct-2-simulated-kserve-f5c55bdc-jzdgr_8b4b6a2c-6f65-4076-9d54-5d06eb16e6a2/main/0.log" Jun 09 15:37:21.365022 ip-10-0-130-232 kubenswrapper[2575]: I0609 15:37:21.364939 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477cjvlj5_5f1f436a-f908-4efc-8b98-a9180848956f/storage-initializer/0.log" Jun 09 15:37:21.375685 ip-10-0-130-232 kubenswrapper[2575]: I0609 15:37:21.375660 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477cjvlj5_5f1f436a-f908-4efc-8b98-a9180848956f/main/0.log" Jun 09 15:37:21.613025 ip-10-0-130-232 kubenswrapper[2575]: I0609 15:37:21.612987 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_premium-simulated-simulated-premium-kserve-66967c79b-sbw7k_09ff5519-0cdf-4c56-ae05-fa7f5a82acab/main/0.log" Jun 09 15:37:21.621035 ip-10-0-130-232 kubenswrapper[2575]: I0609 15:37:21.620958 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_premium-simulated-simulated-premium-kserve-66967c79b-sbw7k_09ff5519-0cdf-4c56-ae05-fa7f5a82acab/storage-initializer/0.log" Jun 09 15:37:25.372236 ip-10-0-130-232 kubenswrapper[2575]: I0609 15:37:25.372204 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2bkzp_41532b1e-300d-4a9e-a64f-da302213062c/konnectivity-agent/0.log" limit=1024 Jun 09 15:37:25.472408 ip-10-0-130-232 kubenswrapper[2575]: I0609 15:37:25.472372 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2bkzp_41532b1e-300d-4a9e-a64f-da302213062c/konnectivity-agent/0.log" limit=1024 Jun 09 15:37:28.199126 ip-10-0-130-232 kubenswrapper[2575]: I0609 15:37:28.199093 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_global-pull-secret-syncer-2k4nl_0ee786d7-9e46-4cf0-add7-db4ff254d57b/global-pull-secret-syncer/0.log" Jun 09 15:37:28.288365 ip-10-0-130-232 kubenswrapper[2575]: I0609 15:37:28.288340 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_konnectivity-agent-2bkzp_41532b1e-300d-4a9e-a64f-da302213062c/konnectivity-agent/0.log" Jun 09 15:37:28.395196 ip-10-0-130-232 kubenswrapper[2575]: I0609 15:37:28.395169 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_kube-apiserver-proxy-ip-10-0-130-232.ec2.internal_70d7652af04ab9bbf001d2e976e7ace2/haproxy/0.log" Jun 09 15:37:31.449361 ip-10-0-130-232 kubenswrapper[2575]: I0609 15:37:31.449325 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-operators_servicemesh-operator3-57f65f65fb-gpn2m_005e285f-a485-413b-984c-f76c991dcd99/sail-operator/0.log" Jun 09 15:37:33.585643 ip-10-0-130-232 kubenswrapper[2575]: I0609 15:37:33.585614 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_limitador-limitador-54d6d988d5-hfd4x_2041f19f-b861-4b21-8838-420feecddfd8/limitador/0.log" Jun 09 15:37:33.632605 ip-10-0-130-232 kubenswrapper[2575]: I0609 15:37:33.632572 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_limitador-operator-controller-manager-859d7b78bd-4dj6z_dd0ef42e-8035-4dfc-b246-583ddd584847/manager/0.log" Jun 09 15:37:35.294044 ip-10-0-130-232 kubenswrapper[2575]: I0609 15:37:35.294016 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_d4e2d518-b0e2-443a-9e10-d6ae693e7320/alertmanager/0.log" Jun 09 15:37:35.319283 ip-10-0-130-232 kubenswrapper[2575]: I0609 15:37:35.319262 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_d4e2d518-b0e2-443a-9e10-d6ae693e7320/config-reloader/0.log" Jun 09 15:37:35.336126 ip-10-0-130-232 kubenswrapper[2575]: I0609 15:37:35.336101 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_d4e2d518-b0e2-443a-9e10-d6ae693e7320/kube-rbac-proxy-web/0.log" Jun 09 15:37:35.356921 ip-10-0-130-232 kubenswrapper[2575]: I0609 15:37:35.356896 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_d4e2d518-b0e2-443a-9e10-d6ae693e7320/kube-rbac-proxy/0.log" Jun 09 15:37:35.380207 ip-10-0-130-232 kubenswrapper[2575]: I0609 15:37:35.380185 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_d4e2d518-b0e2-443a-9e10-d6ae693e7320/kube-rbac-proxy-metric/0.log" Jun 09 15:37:35.399701 ip-10-0-130-232 kubenswrapper[2575]: I0609 15:37:35.399680 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_d4e2d518-b0e2-443a-9e10-d6ae693e7320/prom-label-proxy/0.log" Jun 09 15:37:35.421051 ip-10-0-130-232 kubenswrapper[2575]: I0609 15:37:35.421032 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_d4e2d518-b0e2-443a-9e10-d6ae693e7320/init-config-reloader/0.log" Jun 09 15:37:35.566861 ip-10-0-130-232 kubenswrapper[2575]: I0609 15:37:35.566752 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_metrics-server-f54699df-2pff4_49d5083d-d705-47e9-ba36-652a6686cb13/metrics-server/0.log" Jun 09 15:37:35.621917 ip-10-0-130-232 kubenswrapper[2575]: I0609 15:37:35.621888 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-7mmxf_7bfe71bf-a543-4ec0-a2e9-b7efe4c8a65a/node-exporter/0.log" Jun 09 15:37:35.641936 ip-10-0-130-232 kubenswrapper[2575]: I0609 15:37:35.641912 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-7mmxf_7bfe71bf-a543-4ec0-a2e9-b7efe4c8a65a/kube-rbac-proxy/0.log" Jun 09 15:37:35.662153 ip-10-0-130-232 kubenswrapper[2575]: I0609 15:37:35.662131 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-7mmxf_7bfe71bf-a543-4ec0-a2e9-b7efe4c8a65a/init-textfile/0.log" Jun 09 15:37:35.853327 ip-10-0-130-232 kubenswrapper[2575]: I0609 15:37:35.853250 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_openshift-state-metrics-65f78d5c66-zpj7b_5aa1422c-2775-4e8c-8350-91b878aec45a/kube-rbac-proxy-main/0.log" Jun 09 15:37:35.873627 ip-10-0-130-232 kubenswrapper[2575]: I0609 15:37:35.873599 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_openshift-state-metrics-65f78d5c66-zpj7b_5aa1422c-2775-4e8c-8350-91b878aec45a/kube-rbac-proxy-self/0.log" Jun 09 15:37:35.895340 ip-10-0-130-232 kubenswrapper[2575]: I0609 15:37:35.895312 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_openshift-state-metrics-65f78d5c66-zpj7b_5aa1422c-2775-4e8c-8350-91b878aec45a/openshift-state-metrics/0.log" Jun 09 15:37:36.182632 ip-10-0-130-232 kubenswrapper[2575]: I0609 15:37:36.182563 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-operator-admission-webhook-5b6b8f594-fgzc7_f40a1b5c-5d14-4eb2-afd2-f74461ada01c/prometheus-operator-admission-webhook/0.log" Jun 09 15:37:36.233584 ip-10-0-130-232 kubenswrapper[2575]: I0609 15:37:36.233553 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_telemeter-client-9587844d5-7fqbh_cb0a290b-455b-4081-aa34-43f3c7c66c55/telemeter-client/0.log" Jun 09 15:37:36.259903 ip-10-0-130-232 kubenswrapper[2575]: I0609 15:37:36.259875 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_telemeter-client-9587844d5-7fqbh_cb0a290b-455b-4081-aa34-43f3c7c66c55/reload/0.log" Jun 09 15:37:36.308748 ip-10-0-130-232 kubenswrapper[2575]: I0609 15:37:36.308713 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_telemeter-client-9587844d5-7fqbh_cb0a290b-455b-4081-aa34-43f3c7c66c55/kube-rbac-proxy/0.log" Jun 09 15:37:39.240703 ip-10-0-130-232 kubenswrapper[2575]: I0609 15:37:39.240673 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console_console-67f5557876-pw9x9_f32cf6f1-f22b-452a-aa42-972aa676a6c8/console/0.log" Jun 09 15:37:39.766827 ip-10-0-130-232 kubenswrapper[2575]: I0609 15:37:39.766795 2575 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-must-gather-4nbsh/perf-node-gather-daemonset-cxnvp"] Jun 09 15:37:39.770364 ip-10-0-130-232 kubenswrapper[2575]: I0609 15:37:39.770343 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-4nbsh/perf-node-gather-daemonset-cxnvp" Jun 09 15:37:39.772463 ip-10-0-130-232 kubenswrapper[2575]: I0609 15:37:39.772446 2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-4nbsh\"/\"openshift-service-ca.crt\"" Jun 09 15:37:39.772619 ip-10-0-130-232 kubenswrapper[2575]: I0609 15:37:39.772604 2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-4nbsh\"/\"kube-root-ca.crt\"" Jun 09 15:37:39.773047 ip-10-0-130-232 kubenswrapper[2575]: I0609 15:37:39.773035 2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-must-gather-4nbsh\"/\"default-dockercfg-5v85w\"" Jun 09 15:37:39.780096 ip-10-0-130-232 kubenswrapper[2575]: I0609 15:37:39.780074 2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-4nbsh/perf-node-gather-daemonset-cxnvp"] Jun 09 15:37:39.887412 ip-10-0-130-232 kubenswrapper[2575]: I0609 15:37:39.887377 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/59a6a925-0304-445f-9a15-0c5ed7ae0c58-sys\") pod \"perf-node-gather-daemonset-cxnvp\" (UID: \"59a6a925-0304-445f-9a15-0c5ed7ae0c58\") " pod="openshift-must-gather-4nbsh/perf-node-gather-daemonset-cxnvp" Jun 09 15:37:39.887412 ip-10-0-130-232 kubenswrapper[2575]: I0609 15:37:39.887413 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2rw65\" (UniqueName: \"kubernetes.io/projected/59a6a925-0304-445f-9a15-0c5ed7ae0c58-kube-api-access-2rw65\") pod \"perf-node-gather-daemonset-cxnvp\" (UID: \"59a6a925-0304-445f-9a15-0c5ed7ae0c58\") " pod="openshift-must-gather-4nbsh/perf-node-gather-daemonset-cxnvp" Jun 09 15:37:39.887637 ip-10-0-130-232 kubenswrapper[2575]: I0609 15:37:39.887449 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/59a6a925-0304-445f-9a15-0c5ed7ae0c58-lib-modules\") pod \"perf-node-gather-daemonset-cxnvp\" (UID: \"59a6a925-0304-445f-9a15-0c5ed7ae0c58\") " pod="openshift-must-gather-4nbsh/perf-node-gather-daemonset-cxnvp" Jun 09 15:37:39.887637 ip-10-0-130-232 kubenswrapper[2575]: I0609 15:37:39.887562 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/59a6a925-0304-445f-9a15-0c5ed7ae0c58-proc\") pod \"perf-node-gather-daemonset-cxnvp\" (UID: \"59a6a925-0304-445f-9a15-0c5ed7ae0c58\") " pod="openshift-must-gather-4nbsh/perf-node-gather-daemonset-cxnvp" Jun 09 15:37:39.887637 ip-10-0-130-232 kubenswrapper[2575]: I0609 15:37:39.887591 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/59a6a925-0304-445f-9a15-0c5ed7ae0c58-podres\") pod \"perf-node-gather-daemonset-cxnvp\" (UID: \"59a6a925-0304-445f-9a15-0c5ed7ae0c58\") " pod="openshift-must-gather-4nbsh/perf-node-gather-daemonset-cxnvp" Jun 09 15:37:39.988658 ip-10-0-130-232 kubenswrapper[2575]: I0609 15:37:39.988624 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/59a6a925-0304-445f-9a15-0c5ed7ae0c58-sys\") pod \"perf-node-gather-daemonset-cxnvp\" (UID: \"59a6a925-0304-445f-9a15-0c5ed7ae0c58\") " pod="openshift-must-gather-4nbsh/perf-node-gather-daemonset-cxnvp" Jun 09 15:37:39.988658 ip-10-0-130-232 kubenswrapper[2575]: I0609 15:37:39.988660 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2rw65\" (UniqueName: \"kubernetes.io/projected/59a6a925-0304-445f-9a15-0c5ed7ae0c58-kube-api-access-2rw65\") pod \"perf-node-gather-daemonset-cxnvp\" (UID: \"59a6a925-0304-445f-9a15-0c5ed7ae0c58\") " pod="openshift-must-gather-4nbsh/perf-node-gather-daemonset-cxnvp" Jun 09 15:37:39.988900 ip-10-0-130-232 kubenswrapper[2575]: I0609 15:37:39.988695 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/59a6a925-0304-445f-9a15-0c5ed7ae0c58-lib-modules\") pod \"perf-node-gather-daemonset-cxnvp\" (UID: \"59a6a925-0304-445f-9a15-0c5ed7ae0c58\") " pod="openshift-must-gather-4nbsh/perf-node-gather-daemonset-cxnvp" Jun 09 15:37:39.988900 ip-10-0-130-232 kubenswrapper[2575]: I0609 15:37:39.988748 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/59a6a925-0304-445f-9a15-0c5ed7ae0c58-proc\") pod \"perf-node-gather-daemonset-cxnvp\" (UID: \"59a6a925-0304-445f-9a15-0c5ed7ae0c58\") " pod="openshift-must-gather-4nbsh/perf-node-gather-daemonset-cxnvp" Jun 09 15:37:39.988900 ip-10-0-130-232 kubenswrapper[2575]: I0609 15:37:39.988766 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/59a6a925-0304-445f-9a15-0c5ed7ae0c58-podres\") pod \"perf-node-gather-daemonset-cxnvp\" (UID: \"59a6a925-0304-445f-9a15-0c5ed7ae0c58\") " pod="openshift-must-gather-4nbsh/perf-node-gather-daemonset-cxnvp" Jun 09 15:37:39.988900 ip-10-0-130-232 kubenswrapper[2575]: I0609 15:37:39.988762 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/59a6a925-0304-445f-9a15-0c5ed7ae0c58-sys\") pod \"perf-node-gather-daemonset-cxnvp\" (UID: \"59a6a925-0304-445f-9a15-0c5ed7ae0c58\") " pod="openshift-must-gather-4nbsh/perf-node-gather-daemonset-cxnvp" Jun 09 15:37:39.988900 ip-10-0-130-232 kubenswrapper[2575]: I0609 15:37:39.988859 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/59a6a925-0304-445f-9a15-0c5ed7ae0c58-proc\") pod \"perf-node-gather-daemonset-cxnvp\" (UID: \"59a6a925-0304-445f-9a15-0c5ed7ae0c58\") " pod="openshift-must-gather-4nbsh/perf-node-gather-daemonset-cxnvp" Jun 09 15:37:39.989088 ip-10-0-130-232 kubenswrapper[2575]: I0609 15:37:39.988900 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/59a6a925-0304-445f-9a15-0c5ed7ae0c58-lib-modules\") pod \"perf-node-gather-daemonset-cxnvp\" (UID: \"59a6a925-0304-445f-9a15-0c5ed7ae0c58\") " pod="openshift-must-gather-4nbsh/perf-node-gather-daemonset-cxnvp" Jun 09 15:37:39.989088 ip-10-0-130-232 kubenswrapper[2575]: I0609 15:37:39.988950 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/59a6a925-0304-445f-9a15-0c5ed7ae0c58-podres\") pod \"perf-node-gather-daemonset-cxnvp\" (UID: \"59a6a925-0304-445f-9a15-0c5ed7ae0c58\") " pod="openshift-must-gather-4nbsh/perf-node-gather-daemonset-cxnvp" Jun 09 15:37:39.995979 ip-10-0-130-232 kubenswrapper[2575]: I0609 15:37:39.995957 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-2rw65\" (UniqueName: \"kubernetes.io/projected/59a6a925-0304-445f-9a15-0c5ed7ae0c58-kube-api-access-2rw65\") pod \"perf-node-gather-daemonset-cxnvp\" (UID: \"59a6a925-0304-445f-9a15-0c5ed7ae0c58\") " pod="openshift-must-gather-4nbsh/perf-node-gather-daemonset-cxnvp" Jun 09 15:37:40.044531 ip-10-0-130-232 kubenswrapper[2575]: I0609 15:37:40.044454 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-cluster-storage-operator_volume-data-source-validator-78dd696465-stx2f_043d1104-213e-4a54-900c-95a4bc6e10be/volume-data-source-validator/0.log" Jun 09 15:37:40.080611 ip-10-0-130-232 kubenswrapper[2575]: I0609 15:37:40.080584 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-4nbsh/perf-node-gather-daemonset-cxnvp" Jun 09 15:37:40.212282 ip-10-0-130-232 kubenswrapper[2575]: I0609 15:37:40.212259 2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-4nbsh/perf-node-gather-daemonset-cxnvp"] Jun 09 15:37:40.214679 ip-10-0-130-232 kubenswrapper[2575]: W0609 15:37:40.214651 2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-pod59a6a925_0304_445f_9a15_0c5ed7ae0c58.slice/crio-7a001de314bd3d191ba90f038c021d37f80aae2c9a5cb372a8236242afccdef5 WatchSource:0}: Error finding container 7a001de314bd3d191ba90f038c021d37f80aae2c9a5cb372a8236242afccdef5: Status 404 returned error can't find the container with id 7a001de314bd3d191ba90f038c021d37f80aae2c9a5cb372a8236242afccdef5 Jun 09 15:37:40.768207 ip-10-0-130-232 kubenswrapper[2575]: I0609 15:37:40.768173 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-4nbsh/perf-node-gather-daemonset-cxnvp" event={"ID":"59a6a925-0304-445f-9a15-0c5ed7ae0c58","Type":"ContainerStarted","Data":"4402b02c77978403977dc47da5a206ebda4c5676f0953cc74c26306e7421db83"} Jun 09 15:37:40.768588 ip-10-0-130-232 kubenswrapper[2575]: I0609 15:37:40.768222 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-4nbsh/perf-node-gather-daemonset-cxnvp" event={"ID":"59a6a925-0304-445f-9a15-0c5ed7ae0c58","Type":"ContainerStarted","Data":"7a001de314bd3d191ba90f038c021d37f80aae2c9a5cb372a8236242afccdef5"} Jun 09 15:37:40.768588 ip-10-0-130-232 kubenswrapper[2575]: I0609 15:37:40.768307 2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-must-gather-4nbsh/perf-node-gather-daemonset-cxnvp" Jun 09 15:37:40.784303 ip-10-0-130-232 kubenswrapper[2575]: I0609 15:37:40.784250 2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-must-gather-4nbsh/perf-node-gather-daemonset-cxnvp" podStartSLOduration=1.78423184 podStartE2EDuration="1.78423184s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-09 15:37:39 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-09 15:37:40.783946758 +0000 UTC m=+1400.471952211" watchObservedRunningTime="2026-06-09 15:37:40.78423184 +0000 UTC m=+1400.472237294" Jun 09 15:37:41.281893 ip-10-0-130-232 kubenswrapper[2575]: I0609 15:37:41.281866 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-rmhjs_12bfe226-e002-44c4-aaeb-0905603ccd18/dns/0.log" Jun 09 15:37:41.300362 ip-10-0-130-232 kubenswrapper[2575]: I0609 15:37:41.300340 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-rmhjs_12bfe226-e002-44c4-aaeb-0905603ccd18/kube-rbac-proxy/0.log" Jun 09 15:37:41.346569 ip-10-0-130-232 kubenswrapper[2575]: I0609 15:37:41.346545 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-s44r8_a687cfa5-1e89-4fbf-b17d-11f2778c632f/dns-node-resolver/0.log" Jun 09 15:37:41.904796 ip-10-0-130-232 kubenswrapper[2575]: I0609 15:37:41.904762 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_image-registry-75f6d98cf6-grg9x_3ffe15f5-8e1c-43c6-a5e0-482410e1be5c/registry/0.log" Jun 09 15:37:41.912272 ip-10-0-130-232 kubenswrapper[2575]: I0609 15:37:41.912249 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_image-registry-75f6d98cf6-grg9x_3ffe15f5-8e1c-43c6-a5e0-482410e1be5c/registry/1.log" Jun 09 15:37:41.945672 ip-10-0-130-232 kubenswrapper[2575]: I0609 15:37:41.945654 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-9shqx_146ee641-079b-4c92-8b48-7449e59f82b3/node-ca/0.log" Jun 09 15:37:43.101921 ip-10-0-130-232 kubenswrapper[2575]: I0609 15:37:43.101890 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_istiod-openshift-gateway-75c67f8887-rwsxh_6850508b-e6e7-40f7-93bb-dc898dabcf14/discovery/0.log" Jun 09 15:37:43.120829 ip-10-0-130-232 kubenswrapper[2575]: I0609 15:37:43.120797 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-5dcd85bb64-jm6pc_8ca64b52-2b1a-4c2c-8b9f-d66961c48a05/kube-auth-proxy/0.log" Jun 09 15:37:43.937463 ip-10-0-130-232 kubenswrapper[2575]: I0609 15:37:43.937427 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-w28rj_2e334ed6-e1c8-4008-9e24-dc9f3079be0a/serve-healthcheck-canary/0.log" Jun 09 15:37:44.534176 ip-10-0-130-232 kubenswrapper[2575]: I0609 15:37:44.534145 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-nngvb_6b02ab8f-5fb2-4eb7-a5b5-25ac09cbe55a/kube-rbac-proxy/0.log" Jun 09 15:37:44.556002 ip-10-0-130-232 kubenswrapper[2575]: I0609 15:37:44.555973 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-nngvb_6b02ab8f-5fb2-4eb7-a5b5-25ac09cbe55a/exporter/0.log" Jun 09 15:37:44.579148 ip-10-0-130-232 kubenswrapper[2575]: I0609 15:37:44.579127 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-nngvb_6b02ab8f-5fb2-4eb7-a5b5-25ac09cbe55a/extractor/0.log" Jun 09 15:37:46.783747 ip-10-0-130-232 kubenswrapper[2575]: I0609 15:37:46.783719 2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-must-gather-4nbsh/perf-node-gather-daemonset-cxnvp" Jun 09 15:37:46.856794 ip-10-0-130-232 kubenswrapper[2575]: I0609 15:37:46.856766 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_dashboard-redirect-6dc9d488bd-dlm9n_f236fbb3-be5f-4068-beab-dcf4843d0ab8/nginx/0.log" Jun 09 15:37:46.906438 ip-10-0-130-232 kubenswrapper[2575]: I0609 15:37:46.906412 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_kserve-controller-manager-69fc866d76-47qf2_67c921a6-a58e-4f6f-8947-b5dc8d5d6bf6/manager/0.log" Jun 09 15:37:46.972618 ip-10-0-130-232 kubenswrapper[2575]: I0609 15:37:46.972588 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_llmisvc-controller-manager-864bfd7bc9-9wjl9_c9ff96d5-f8c6-4eaf-a73b-b72b72908bf4/manager/0.log" Jun 09 15:37:47.240299 ip-10-0-130-232 kubenswrapper[2575]: I0609 15:37:47.240269 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-f5f495f5c-dvnkh_ecfa9e10-2268-4ead-89d6-88b39352b5fe/manager/0.log" Jun 09 15:37:47.257271 ip-10-0-130-232 kubenswrapper[2575]: I0609 15:37:47.257252 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-f5f495f5c-dvnkh_ecfa9e10-2268-4ead-89d6-88b39352b5fe/copy-manifests/0.log" Jun 09 15:37:54.044282 ip-10-0-130-232 kubenswrapper[2575]: I0609 15:37:54.044240 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_istiod-openshift-gateway-75c67f8887-rwsxh_6850508b-e6e7-40f7-93bb-dc898dabcf14/discovery/0.log" Jun 09 15:37:54.055384 ip-10-0-130-232 kubenswrapper[2575]: I0609 15:37:54.055347 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-5dcd85bb64-jm6pc_8ca64b52-2b1a-4c2c-8b9f-d66961c48a05/kube-auth-proxy/0.log" Jun 09 15:37:55.329308 ip-10-0-130-232 kubenswrapper[2575]: I0609 15:37:55.329263 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_istiod-openshift-gateway-75c67f8887-rwsxh_6850508b-e6e7-40f7-93bb-dc898dabcf14/discovery/0.log" Jun 09 15:37:55.340513 ip-10-0-130-232 kubenswrapper[2575]: I0609 15:37:55.340489 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-5dcd85bb64-jm6pc_8ca64b52-2b1a-4c2c-8b9f-d66961c48a05/kube-auth-proxy/0.log" Jun 09 15:37:56.334537 ip-10-0-130-232 kubenswrapper[2575]: I0609 15:37:56.334501 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-knt8p_1982d388-abfa-4d4b-a126-34c01f86521d/kube-multus-additional-cni-plugins/0.log" Jun 09 15:37:56.356927 ip-10-0-130-232 kubenswrapper[2575]: I0609 15:37:56.356903 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-knt8p_1982d388-abfa-4d4b-a126-34c01f86521d/egress-router-binary-copy/0.log" Jun 09 15:37:56.375709 ip-10-0-130-232 kubenswrapper[2575]: I0609 15:37:56.375678 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-knt8p_1982d388-abfa-4d4b-a126-34c01f86521d/cni-plugins/0.log" Jun 09 15:37:56.395088 ip-10-0-130-232 kubenswrapper[2575]: I0609 15:37:56.395069 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-knt8p_1982d388-abfa-4d4b-a126-34c01f86521d/bond-cni-plugin/0.log" Jun 09 15:37:56.414087 ip-10-0-130-232 kubenswrapper[2575]: I0609 15:37:56.414058 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-knt8p_1982d388-abfa-4d4b-a126-34c01f86521d/routeoverride-cni/0.log" Jun 09 15:37:56.433720 ip-10-0-130-232 kubenswrapper[2575]: I0609 15:37:56.433689 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-knt8p_1982d388-abfa-4d4b-a126-34c01f86521d/whereabouts-cni-bincopy/0.log" Jun 09 15:37:56.453238 ip-10-0-130-232 kubenswrapper[2575]: I0609 15:37:56.453218 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-knt8p_1982d388-abfa-4d4b-a126-34c01f86521d/whereabouts-cni/0.log" Jun 09 15:37:56.643232 ip-10-0-130-232 kubenswrapper[2575]: I0609 15:37:56.643138 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-cxbrv_06bde064-62c0-4d6e-bc37-d0fe1e36a621/kube-multus/0.log" Jun 09 15:37:56.730596 ip-10-0-130-232 kubenswrapper[2575]: I0609 15:37:56.730567 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_network-metrics-daemon-5bg45_8eda6a9f-b4cc-403f-a284-8a9cd10e8f15/network-metrics-daemon/0.log" Jun 09 15:37:56.748867 ip-10-0-130-232 kubenswrapper[2575]: I0609 15:37:56.748818 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_network-metrics-daemon-5bg45_8eda6a9f-b4cc-403f-a284-8a9cd10e8f15/kube-rbac-proxy/0.log" Jun 09 15:37:57.069168 ip-10-0-130-232 kubenswrapper[2575]: I0609 15:37:57.069137 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_istiod-openshift-gateway-75c67f8887-rwsxh_6850508b-e6e7-40f7-93bb-dc898dabcf14/discovery/0.log" Jun 09 15:37:57.088441 ip-10-0-130-232 kubenswrapper[2575]: I0609 15:37:57.088417 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-5dcd85bb64-jm6pc_8ca64b52-2b1a-4c2c-8b9f-d66961c48a05/kube-auth-proxy/0.log"