Jun 12 22:18:15.926631 ip-10-0-128-134 systemd[1]: kubelet.service: Failed to load environment files: No such file or directory Jun 12 22:18:15.926648 ip-10-0-128-134 systemd[1]: kubelet.service: Failed to run 'start-pre' task: No such file or directory Jun 12 22:18:15.926658 ip-10-0-128-134 systemd[1]: kubelet.service: Failed with result 'resources'. Jun 12 22:18:15.927026 ip-10-0-128-134 systemd[1]: Failed to start Kubernetes Kubelet. Jun 12 22:18:25.947311 ip-10-0-128-134 systemd[1]: kubelet.service: Failed to schedule restart job: Unit crio.service not found. Jun 12 22:18:25.947333 ip-10-0-128-134 systemd[1]: kubelet.service: Failed with result 'resources'. -- Boot e5f45aca9dd4435cbe61928ea9576d67 -- Jun 12 22:20:57.834798 ip-10-0-128-134 systemd[1]: Starting Kubernetes Kubelet... Jun 12 22:20:58.237263 ip-10-0-128-134 kubenswrapper[2559]: Flag --container-runtime-endpoint has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Jun 12 22:20:58.237263 ip-10-0-128-134 kubenswrapper[2559]: Flag --minimum-container-ttl-duration has been deprecated, Use --eviction-hard or --eviction-soft instead. Will be removed in a future version. Jun 12 22:20:58.237263 ip-10-0-128-134 kubenswrapper[2559]: Flag --volume-plugin-dir has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Jun 12 22:20:58.237263 ip-10-0-128-134 kubenswrapper[2559]: Flag --pod-infra-container-image has been deprecated, will be removed in 1.35. Image garbage collector will get sandbox image information from CRI. Jun 12 22:20:58.237263 ip-10-0-128-134 kubenswrapper[2559]: Flag --system-reserved has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Jun 12 22:20:58.238969 ip-10-0-128-134 kubenswrapper[2559]: I0612 22:20:58.238848 2559 server.go:213] "--pod-infra-container-image will not be pruned by the image garbage collector in kubelet and should also be set in the remote runtime" Jun 12 22:20:58.243176 ip-10-0-128-134 kubenswrapper[2559]: W0612 22:20:58.243150 2559 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jun 12 22:20:58.243176 ip-10-0-128-134 kubenswrapper[2559]: W0612 22:20:58.243173 2559 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jun 12 22:20:58.243176 ip-10-0-128-134 kubenswrapper[2559]: W0612 22:20:58.243177 2559 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jun 12 22:20:58.243176 ip-10-0-128-134 kubenswrapper[2559]: W0612 22:20:58.243180 2559 feature_gate.go:328] unrecognized feature gate: PinnedImages Jun 12 22:20:58.243176 ip-10-0-128-134 kubenswrapper[2559]: W0612 22:20:58.243183 2559 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jun 12 22:20:58.243395 ip-10-0-128-134 kubenswrapper[2559]: W0612 22:20:58.243190 2559 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jun 12 22:20:58.243395 ip-10-0-128-134 kubenswrapper[2559]: W0612 22:20:58.243194 2559 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jun 12 22:20:58.243395 ip-10-0-128-134 kubenswrapper[2559]: W0612 22:20:58.243197 2559 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jun 12 22:20:58.243395 ip-10-0-128-134 kubenswrapper[2559]: W0612 22:20:58.243200 2559 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jun 12 22:20:58.243395 ip-10-0-128-134 kubenswrapper[2559]: W0612 22:20:58.243203 2559 feature_gate.go:328] unrecognized feature gate: Example2 Jun 12 22:20:58.243395 ip-10-0-128-134 kubenswrapper[2559]: W0612 22:20:58.243207 2559 feature_gate.go:328] unrecognized feature gate: Example Jun 12 22:20:58.243395 ip-10-0-128-134 kubenswrapper[2559]: W0612 22:20:58.243210 2559 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jun 12 22:20:58.243395 ip-10-0-128-134 kubenswrapper[2559]: W0612 22:20:58.243228 2559 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jun 12 22:20:58.243395 ip-10-0-128-134 kubenswrapper[2559]: W0612 22:20:58.243336 2559 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jun 12 22:20:58.243395 ip-10-0-128-134 kubenswrapper[2559]: W0612 22:20:58.243340 2559 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jun 12 22:20:58.243395 ip-10-0-128-134 kubenswrapper[2559]: W0612 22:20:58.243343 2559 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jun 12 22:20:58.243395 ip-10-0-128-134 kubenswrapper[2559]: W0612 22:20:58.243345 2559 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jun 12 22:20:58.243395 ip-10-0-128-134 kubenswrapper[2559]: W0612 22:20:58.243348 2559 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jun 12 22:20:58.243395 ip-10-0-128-134 kubenswrapper[2559]: W0612 22:20:58.243350 2559 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jun 12 22:20:58.243395 ip-10-0-128-134 kubenswrapper[2559]: W0612 22:20:58.243353 2559 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jun 12 22:20:58.243395 ip-10-0-128-134 kubenswrapper[2559]: W0612 22:20:58.243355 2559 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jun 12 22:20:58.243395 ip-10-0-128-134 kubenswrapper[2559]: W0612 22:20:58.243358 2559 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jun 12 22:20:58.243395 ip-10-0-128-134 kubenswrapper[2559]: W0612 22:20:58.243361 2559 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jun 12 22:20:58.243395 ip-10-0-128-134 kubenswrapper[2559]: W0612 22:20:58.243363 2559 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jun 12 22:20:58.243861 ip-10-0-128-134 kubenswrapper[2559]: W0612 22:20:58.243366 2559 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jun 12 22:20:58.243861 ip-10-0-128-134 kubenswrapper[2559]: W0612 22:20:58.243368 2559 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jun 12 22:20:58.243861 ip-10-0-128-134 kubenswrapper[2559]: W0612 22:20:58.243371 2559 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jun 12 22:20:58.243861 ip-10-0-128-134 kubenswrapper[2559]: W0612 22:20:58.243374 2559 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jun 12 22:20:58.243861 ip-10-0-128-134 kubenswrapper[2559]: W0612 22:20:58.243376 2559 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jun 12 22:20:58.243861 ip-10-0-128-134 kubenswrapper[2559]: W0612 22:20:58.243381 2559 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jun 12 22:20:58.243861 ip-10-0-128-134 kubenswrapper[2559]: W0612 22:20:58.243386 2559 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jun 12 22:20:58.243861 ip-10-0-128-134 kubenswrapper[2559]: W0612 22:20:58.243391 2559 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jun 12 22:20:58.243861 ip-10-0-128-134 kubenswrapper[2559]: W0612 22:20:58.243394 2559 feature_gate.go:328] unrecognized feature gate: SignatureStores Jun 12 22:20:58.243861 ip-10-0-128-134 kubenswrapper[2559]: W0612 22:20:58.243397 2559 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jun 12 22:20:58.243861 ip-10-0-128-134 kubenswrapper[2559]: W0612 22:20:58.243400 2559 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jun 12 22:20:58.243861 ip-10-0-128-134 kubenswrapper[2559]: W0612 22:20:58.243403 2559 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jun 12 22:20:58.243861 ip-10-0-128-134 kubenswrapper[2559]: W0612 22:20:58.243407 2559 feature_gate.go:328] unrecognized feature gate: EventTTL Jun 12 22:20:58.243861 ip-10-0-128-134 kubenswrapper[2559]: W0612 22:20:58.243409 2559 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jun 12 22:20:58.243861 ip-10-0-128-134 kubenswrapper[2559]: W0612 22:20:58.243412 2559 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jun 12 22:20:58.243861 ip-10-0-128-134 kubenswrapper[2559]: W0612 22:20:58.243415 2559 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jun 12 22:20:58.243861 ip-10-0-128-134 kubenswrapper[2559]: W0612 22:20:58.243417 2559 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jun 12 22:20:58.243861 ip-10-0-128-134 kubenswrapper[2559]: W0612 22:20:58.243420 2559 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jun 12 22:20:58.243861 ip-10-0-128-134 kubenswrapper[2559]: W0612 22:20:58.243423 2559 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jun 12 22:20:58.244334 ip-10-0-128-134 kubenswrapper[2559]: W0612 22:20:58.243429 2559 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jun 12 22:20:58.244334 ip-10-0-128-134 kubenswrapper[2559]: W0612 22:20:58.243432 2559 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jun 12 22:20:58.244334 ip-10-0-128-134 kubenswrapper[2559]: W0612 22:20:58.243435 2559 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jun 12 22:20:58.244334 ip-10-0-128-134 kubenswrapper[2559]: W0612 22:20:58.243437 2559 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jun 12 22:20:58.244334 ip-10-0-128-134 kubenswrapper[2559]: W0612 22:20:58.243454 2559 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jun 12 22:20:58.244334 ip-10-0-128-134 kubenswrapper[2559]: W0612 22:20:58.243457 2559 feature_gate.go:328] unrecognized feature gate: OSStreams Jun 12 22:20:58.244334 ip-10-0-128-134 kubenswrapper[2559]: W0612 22:20:58.243460 2559 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jun 12 22:20:58.244334 ip-10-0-128-134 kubenswrapper[2559]: W0612 22:20:58.243464 2559 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jun 12 22:20:58.244334 ip-10-0-128-134 kubenswrapper[2559]: W0612 22:20:58.243466 2559 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jun 12 22:20:58.244334 ip-10-0-128-134 kubenswrapper[2559]: W0612 22:20:58.243469 2559 feature_gate.go:328] unrecognized feature gate: DualReplica Jun 12 22:20:58.244334 ip-10-0-128-134 kubenswrapper[2559]: W0612 22:20:58.243471 2559 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jun 12 22:20:58.244334 ip-10-0-128-134 kubenswrapper[2559]: W0612 22:20:58.243476 2559 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jun 12 22:20:58.244334 ip-10-0-128-134 kubenswrapper[2559]: W0612 22:20:58.243479 2559 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jun 12 22:20:58.244334 ip-10-0-128-134 kubenswrapper[2559]: W0612 22:20:58.243483 2559 feature_gate.go:328] unrecognized feature gate: NewOLM Jun 12 22:20:58.244334 ip-10-0-128-134 kubenswrapper[2559]: W0612 22:20:58.243486 2559 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jun 12 22:20:58.244334 ip-10-0-128-134 kubenswrapper[2559]: W0612 22:20:58.243489 2559 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jun 12 22:20:58.244334 ip-10-0-128-134 kubenswrapper[2559]: W0612 22:20:58.243491 2559 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jun 12 22:20:58.244334 ip-10-0-128-134 kubenswrapper[2559]: W0612 22:20:58.243494 2559 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jun 12 22:20:58.244334 ip-10-0-128-134 kubenswrapper[2559]: W0612 22:20:58.243496 2559 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jun 12 22:20:58.244334 ip-10-0-128-134 kubenswrapper[2559]: W0612 22:20:58.243499 2559 feature_gate.go:328] unrecognized feature gate: OVNObservability Jun 12 22:20:58.244861 ip-10-0-128-134 kubenswrapper[2559]: W0612 22:20:58.243502 2559 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jun 12 22:20:58.244861 ip-10-0-128-134 kubenswrapper[2559]: W0612 22:20:58.243505 2559 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jun 12 22:20:58.244861 ip-10-0-128-134 kubenswrapper[2559]: W0612 22:20:58.243507 2559 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jun 12 22:20:58.244861 ip-10-0-128-134 kubenswrapper[2559]: W0612 22:20:58.243510 2559 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jun 12 22:20:58.244861 ip-10-0-128-134 kubenswrapper[2559]: W0612 22:20:58.243512 2559 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jun 12 22:20:58.244861 ip-10-0-128-134 kubenswrapper[2559]: W0612 22:20:58.243515 2559 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jun 12 22:20:58.244861 ip-10-0-128-134 kubenswrapper[2559]: W0612 22:20:58.243517 2559 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jun 12 22:20:58.244861 ip-10-0-128-134 kubenswrapper[2559]: W0612 22:20:58.243520 2559 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jun 12 22:20:58.244861 ip-10-0-128-134 kubenswrapper[2559]: W0612 22:20:58.243522 2559 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jun 12 22:20:58.244861 ip-10-0-128-134 kubenswrapper[2559]: W0612 22:20:58.243525 2559 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jun 12 22:20:58.244861 ip-10-0-128-134 kubenswrapper[2559]: W0612 22:20:58.243527 2559 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jun 12 22:20:58.244861 ip-10-0-128-134 kubenswrapper[2559]: W0612 22:20:58.243530 2559 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jun 12 22:20:58.244861 ip-10-0-128-134 kubenswrapper[2559]: W0612 22:20:58.243532 2559 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jun 12 22:20:58.244861 ip-10-0-128-134 kubenswrapper[2559]: W0612 22:20:58.243535 2559 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jun 12 22:20:58.244861 ip-10-0-128-134 kubenswrapper[2559]: W0612 22:20:58.243538 2559 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jun 12 22:20:58.244861 ip-10-0-128-134 kubenswrapper[2559]: W0612 22:20:58.243540 2559 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jun 12 22:20:58.244861 ip-10-0-128-134 kubenswrapper[2559]: W0612 22:20:58.243543 2559 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jun 12 22:20:58.244861 ip-10-0-128-134 kubenswrapper[2559]: W0612 22:20:58.243547 2559 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jun 12 22:20:58.244861 ip-10-0-128-134 kubenswrapper[2559]: W0612 22:20:58.243549 2559 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jun 12 22:20:58.245310 ip-10-0-128-134 kubenswrapper[2559]: W0612 22:20:58.243554 2559 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jun 12 22:20:58.245310 ip-10-0-128-134 kubenswrapper[2559]: W0612 22:20:58.243558 2559 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jun 12 22:20:58.245310 ip-10-0-128-134 kubenswrapper[2559]: W0612 22:20:58.243561 2559 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jun 12 22:20:58.245310 ip-10-0-128-134 kubenswrapper[2559]: W0612 22:20:58.243564 2559 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jun 12 22:20:58.245310 ip-10-0-128-134 kubenswrapper[2559]: W0612 22:20:58.243567 2559 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jun 12 22:20:58.245310 ip-10-0-128-134 kubenswrapper[2559]: W0612 22:20:58.243570 2559 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jun 12 22:20:58.245310 ip-10-0-128-134 kubenswrapper[2559]: W0612 22:20:58.243573 2559 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jun 12 22:20:58.245310 ip-10-0-128-134 kubenswrapper[2559]: W0612 22:20:58.243576 2559 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jun 12 22:20:58.245310 ip-10-0-128-134 kubenswrapper[2559]: W0612 22:20:58.243579 2559 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jun 12 22:20:58.245310 ip-10-0-128-134 kubenswrapper[2559]: W0612 22:20:58.243582 2559 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jun 12 22:20:58.245310 ip-10-0-128-134 kubenswrapper[2559]: W0612 22:20:58.243584 2559 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jun 12 22:20:58.245310 ip-10-0-128-134 kubenswrapper[2559]: W0612 22:20:58.243587 2559 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jun 12 22:20:58.245310 ip-10-0-128-134 kubenswrapper[2559]: W0612 22:20:58.243590 2559 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jun 12 22:20:58.245310 ip-10-0-128-134 kubenswrapper[2559]: W0612 22:20:58.243593 2559 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jun 12 22:20:58.245310 ip-10-0-128-134 kubenswrapper[2559]: W0612 22:20:58.243595 2559 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jun 12 22:20:58.245310 ip-10-0-128-134 kubenswrapper[2559]: W0612 22:20:58.243598 2559 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jun 12 22:20:58.245310 ip-10-0-128-134 kubenswrapper[2559]: W0612 22:20:58.243600 2559 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jun 12 22:20:58.245310 ip-10-0-128-134 kubenswrapper[2559]: W0612 22:20:58.244341 2559 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jun 12 22:20:58.245310 ip-10-0-128-134 kubenswrapper[2559]: W0612 22:20:58.244348 2559 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jun 12 22:20:58.245310 ip-10-0-128-134 kubenswrapper[2559]: W0612 22:20:58.244350 2559 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jun 12 22:20:58.245801 ip-10-0-128-134 kubenswrapper[2559]: W0612 22:20:58.244353 2559 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jun 12 22:20:58.245801 ip-10-0-128-134 kubenswrapper[2559]: W0612 22:20:58.244356 2559 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jun 12 22:20:58.245801 ip-10-0-128-134 kubenswrapper[2559]: W0612 22:20:58.244358 2559 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jun 12 22:20:58.245801 ip-10-0-128-134 kubenswrapper[2559]: W0612 22:20:58.244361 2559 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jun 12 22:20:58.245801 ip-10-0-128-134 kubenswrapper[2559]: W0612 22:20:58.244364 2559 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jun 12 22:20:58.245801 ip-10-0-128-134 kubenswrapper[2559]: W0612 22:20:58.244367 2559 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jun 12 22:20:58.245801 ip-10-0-128-134 kubenswrapper[2559]: W0612 22:20:58.244369 2559 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jun 12 22:20:58.245801 ip-10-0-128-134 kubenswrapper[2559]: W0612 22:20:58.244372 2559 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jun 12 22:20:58.245801 ip-10-0-128-134 kubenswrapper[2559]: W0612 22:20:58.244375 2559 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jun 12 22:20:58.245801 ip-10-0-128-134 kubenswrapper[2559]: W0612 22:20:58.244378 2559 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jun 12 22:20:58.245801 ip-10-0-128-134 kubenswrapper[2559]: W0612 22:20:58.244380 2559 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jun 12 22:20:58.245801 ip-10-0-128-134 kubenswrapper[2559]: W0612 22:20:58.244383 2559 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jun 12 22:20:58.245801 ip-10-0-128-134 kubenswrapper[2559]: W0612 22:20:58.244385 2559 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jun 12 22:20:58.245801 ip-10-0-128-134 kubenswrapper[2559]: W0612 22:20:58.244388 2559 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jun 12 22:20:58.245801 ip-10-0-128-134 kubenswrapper[2559]: W0612 22:20:58.244391 2559 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jun 12 22:20:58.245801 ip-10-0-128-134 kubenswrapper[2559]: W0612 22:20:58.244394 2559 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jun 12 22:20:58.245801 ip-10-0-128-134 kubenswrapper[2559]: W0612 22:20:58.244396 2559 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jun 12 22:20:58.245801 ip-10-0-128-134 kubenswrapper[2559]: W0612 22:20:58.244399 2559 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jun 12 22:20:58.245801 ip-10-0-128-134 kubenswrapper[2559]: W0612 22:20:58.244401 2559 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jun 12 22:20:58.245801 ip-10-0-128-134 kubenswrapper[2559]: W0612 22:20:58.244404 2559 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jun 12 22:20:58.246326 ip-10-0-128-134 kubenswrapper[2559]: W0612 22:20:58.244406 2559 feature_gate.go:328] unrecognized feature gate: OSStreams Jun 12 22:20:58.246326 ip-10-0-128-134 kubenswrapper[2559]: W0612 22:20:58.244409 2559 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jun 12 22:20:58.246326 ip-10-0-128-134 kubenswrapper[2559]: W0612 22:20:58.244412 2559 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jun 12 22:20:58.246326 ip-10-0-128-134 kubenswrapper[2559]: W0612 22:20:58.244414 2559 feature_gate.go:328] unrecognized feature gate: PinnedImages Jun 12 22:20:58.246326 ip-10-0-128-134 kubenswrapper[2559]: W0612 22:20:58.244416 2559 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jun 12 22:20:58.246326 ip-10-0-128-134 kubenswrapper[2559]: W0612 22:20:58.244419 2559 feature_gate.go:328] unrecognized feature gate: EventTTL Jun 12 22:20:58.246326 ip-10-0-128-134 kubenswrapper[2559]: W0612 22:20:58.244422 2559 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jun 12 22:20:58.246326 ip-10-0-128-134 kubenswrapper[2559]: W0612 22:20:58.244424 2559 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jun 12 22:20:58.246326 ip-10-0-128-134 kubenswrapper[2559]: W0612 22:20:58.244428 2559 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jun 12 22:20:58.246326 ip-10-0-128-134 kubenswrapper[2559]: W0612 22:20:58.244432 2559 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jun 12 22:20:58.246326 ip-10-0-128-134 kubenswrapper[2559]: W0612 22:20:58.244436 2559 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jun 12 22:20:58.246326 ip-10-0-128-134 kubenswrapper[2559]: W0612 22:20:58.244439 2559 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jun 12 22:20:58.246326 ip-10-0-128-134 kubenswrapper[2559]: W0612 22:20:58.244461 2559 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jun 12 22:20:58.246326 ip-10-0-128-134 kubenswrapper[2559]: W0612 22:20:58.244464 2559 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jun 12 22:20:58.246326 ip-10-0-128-134 kubenswrapper[2559]: W0612 22:20:58.244467 2559 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jun 12 22:20:58.246326 ip-10-0-128-134 kubenswrapper[2559]: W0612 22:20:58.244469 2559 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jun 12 22:20:58.246326 ip-10-0-128-134 kubenswrapper[2559]: W0612 22:20:58.244472 2559 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jun 12 22:20:58.246326 ip-10-0-128-134 kubenswrapper[2559]: W0612 22:20:58.244475 2559 feature_gate.go:328] unrecognized feature gate: Example Jun 12 22:20:58.246326 ip-10-0-128-134 kubenswrapper[2559]: W0612 22:20:58.244477 2559 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jun 12 22:20:58.246326 ip-10-0-128-134 kubenswrapper[2559]: W0612 22:20:58.244480 2559 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jun 12 22:20:58.246827 ip-10-0-128-134 kubenswrapper[2559]: W0612 22:20:58.244482 2559 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jun 12 22:20:58.246827 ip-10-0-128-134 kubenswrapper[2559]: W0612 22:20:58.244485 2559 feature_gate.go:328] unrecognized feature gate: Example2 Jun 12 22:20:58.246827 ip-10-0-128-134 kubenswrapper[2559]: W0612 22:20:58.244488 2559 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jun 12 22:20:58.246827 ip-10-0-128-134 kubenswrapper[2559]: W0612 22:20:58.244490 2559 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jun 12 22:20:58.246827 ip-10-0-128-134 kubenswrapper[2559]: W0612 22:20:58.244493 2559 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jun 12 22:20:58.246827 ip-10-0-128-134 kubenswrapper[2559]: W0612 22:20:58.244495 2559 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jun 12 22:20:58.246827 ip-10-0-128-134 kubenswrapper[2559]: W0612 22:20:58.244498 2559 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jun 12 22:20:58.246827 ip-10-0-128-134 kubenswrapper[2559]: W0612 22:20:58.244501 2559 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jun 12 22:20:58.246827 ip-10-0-128-134 kubenswrapper[2559]: W0612 22:20:58.244503 2559 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jun 12 22:20:58.246827 ip-10-0-128-134 kubenswrapper[2559]: W0612 22:20:58.244506 2559 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jun 12 22:20:58.246827 ip-10-0-128-134 kubenswrapper[2559]: W0612 22:20:58.244509 2559 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jun 12 22:20:58.246827 ip-10-0-128-134 kubenswrapper[2559]: W0612 22:20:58.244512 2559 feature_gate.go:328] unrecognized feature gate: SignatureStores Jun 12 22:20:58.246827 ip-10-0-128-134 kubenswrapper[2559]: W0612 22:20:58.244515 2559 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jun 12 22:20:58.246827 ip-10-0-128-134 kubenswrapper[2559]: W0612 22:20:58.244518 2559 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jun 12 22:20:58.246827 ip-10-0-128-134 kubenswrapper[2559]: W0612 22:20:58.244520 2559 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jun 12 22:20:58.246827 ip-10-0-128-134 kubenswrapper[2559]: W0612 22:20:58.244523 2559 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jun 12 22:20:58.246827 ip-10-0-128-134 kubenswrapper[2559]: W0612 22:20:58.244525 2559 feature_gate.go:328] unrecognized feature gate: OVNObservability Jun 12 22:20:58.246827 ip-10-0-128-134 kubenswrapper[2559]: W0612 22:20:58.244528 2559 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jun 12 22:20:58.246827 ip-10-0-128-134 kubenswrapper[2559]: W0612 22:20:58.244530 2559 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jun 12 22:20:58.247313 ip-10-0-128-134 kubenswrapper[2559]: W0612 22:20:58.244532 2559 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jun 12 22:20:58.247313 ip-10-0-128-134 kubenswrapper[2559]: W0612 22:20:58.244535 2559 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jun 12 22:20:58.247313 ip-10-0-128-134 kubenswrapper[2559]: W0612 22:20:58.244538 2559 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jun 12 22:20:58.247313 ip-10-0-128-134 kubenswrapper[2559]: W0612 22:20:58.244540 2559 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jun 12 22:20:58.247313 ip-10-0-128-134 kubenswrapper[2559]: W0612 22:20:58.244542 2559 feature_gate.go:328] unrecognized feature gate: NewOLM Jun 12 22:20:58.247313 ip-10-0-128-134 kubenswrapper[2559]: W0612 22:20:58.244546 2559 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jun 12 22:20:58.247313 ip-10-0-128-134 kubenswrapper[2559]: W0612 22:20:58.244548 2559 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jun 12 22:20:58.247313 ip-10-0-128-134 kubenswrapper[2559]: W0612 22:20:58.244551 2559 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jun 12 22:20:58.247313 ip-10-0-128-134 kubenswrapper[2559]: W0612 22:20:58.244553 2559 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jun 12 22:20:58.247313 ip-10-0-128-134 kubenswrapper[2559]: W0612 22:20:58.244556 2559 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jun 12 22:20:58.247313 ip-10-0-128-134 kubenswrapper[2559]: W0612 22:20:58.244558 2559 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jun 12 22:20:58.247313 ip-10-0-128-134 kubenswrapper[2559]: W0612 22:20:58.244561 2559 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jun 12 22:20:58.247313 ip-10-0-128-134 kubenswrapper[2559]: W0612 22:20:58.244563 2559 feature_gate.go:328] unrecognized feature gate: DualReplica Jun 12 22:20:58.247313 ip-10-0-128-134 kubenswrapper[2559]: W0612 22:20:58.244569 2559 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jun 12 22:20:58.247313 ip-10-0-128-134 kubenswrapper[2559]: W0612 22:20:58.244572 2559 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jun 12 22:20:58.247313 ip-10-0-128-134 kubenswrapper[2559]: W0612 22:20:58.244574 2559 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jun 12 22:20:58.247313 ip-10-0-128-134 kubenswrapper[2559]: W0612 22:20:58.244577 2559 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jun 12 22:20:58.247313 ip-10-0-128-134 kubenswrapper[2559]: W0612 22:20:58.244579 2559 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jun 12 22:20:58.247313 ip-10-0-128-134 kubenswrapper[2559]: W0612 22:20:58.244584 2559 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jun 12 22:20:58.247795 ip-10-0-128-134 kubenswrapper[2559]: W0612 22:20:58.244587 2559 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jun 12 22:20:58.247795 ip-10-0-128-134 kubenswrapper[2559]: W0612 22:20:58.244590 2559 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jun 12 22:20:58.247795 ip-10-0-128-134 kubenswrapper[2559]: W0612 22:20:58.244593 2559 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jun 12 22:20:58.247795 ip-10-0-128-134 kubenswrapper[2559]: W0612 22:20:58.244596 2559 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jun 12 22:20:58.247795 ip-10-0-128-134 kubenswrapper[2559]: W0612 22:20:58.244599 2559 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jun 12 22:20:58.247795 ip-10-0-128-134 kubenswrapper[2559]: W0612 22:20:58.244602 2559 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jun 12 22:20:58.247795 ip-10-0-128-134 kubenswrapper[2559]: W0612 22:20:58.244605 2559 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jun 12 22:20:58.247795 ip-10-0-128-134 kubenswrapper[2559]: W0612 22:20:58.244608 2559 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jun 12 22:20:58.247795 ip-10-0-128-134 kubenswrapper[2559]: W0612 22:20:58.244611 2559 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jun 12 22:20:58.247795 ip-10-0-128-134 kubenswrapper[2559]: W0612 22:20:58.244614 2559 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jun 12 22:20:58.247795 ip-10-0-128-134 kubenswrapper[2559]: W0612 22:20:58.244617 2559 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jun 12 22:20:58.247795 ip-10-0-128-134 kubenswrapper[2559]: W0612 22:20:58.244619 2559 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jun 12 22:20:58.247795 ip-10-0-128-134 kubenswrapper[2559]: W0612 22:20:58.244622 2559 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jun 12 22:20:58.247795 ip-10-0-128-134 kubenswrapper[2559]: W0612 22:20:58.244624 2559 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jun 12 22:20:58.247795 ip-10-0-128-134 kubenswrapper[2559]: W0612 22:20:58.244627 2559 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jun 12 22:20:58.247795 ip-10-0-128-134 kubenswrapper[2559]: W0612 22:20:58.244630 2559 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jun 12 22:20:58.247795 ip-10-0-128-134 kubenswrapper[2559]: W0612 22:20:58.244632 2559 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jun 12 22:20:58.247795 ip-10-0-128-134 kubenswrapper[2559]: W0612 22:20:58.244635 2559 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jun 12 22:20:58.247795 ip-10-0-128-134 kubenswrapper[2559]: W0612 22:20:58.245019 2559 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jun 12 22:20:58.247795 ip-10-0-128-134 kubenswrapper[2559]: W0612 22:20:58.245024 2559 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jun 12 22:20:58.248282 ip-10-0-128-134 kubenswrapper[2559]: W0612 22:20:58.245027 2559 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jun 12 22:20:58.248282 ip-10-0-128-134 kubenswrapper[2559]: W0612 22:20:58.245030 2559 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jun 12 22:20:58.248282 ip-10-0-128-134 kubenswrapper[2559]: W0612 22:20:58.245032 2559 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jun 12 22:20:58.248282 ip-10-0-128-134 kubenswrapper[2559]: W0612 22:20:58.245035 2559 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jun 12 22:20:58.248282 ip-10-0-128-134 kubenswrapper[2559]: W0612 22:20:58.245037 2559 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jun 12 22:20:58.248282 ip-10-0-128-134 kubenswrapper[2559]: W0612 22:20:58.245040 2559 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jun 12 22:20:58.248282 ip-10-0-128-134 kubenswrapper[2559]: W0612 22:20:58.245044 2559 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jun 12 22:20:58.248282 ip-10-0-128-134 kubenswrapper[2559]: W0612 22:20:58.245046 2559 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jun 12 22:20:58.248282 ip-10-0-128-134 kubenswrapper[2559]: W0612 22:20:58.245049 2559 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jun 12 22:20:58.248282 ip-10-0-128-134 kubenswrapper[2559]: W0612 22:20:58.245051 2559 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jun 12 22:20:58.248282 ip-10-0-128-134 kubenswrapper[2559]: W0612 22:20:58.245054 2559 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jun 12 22:20:58.248282 ip-10-0-128-134 kubenswrapper[2559]: W0612 22:20:58.245057 2559 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jun 12 22:20:58.248282 ip-10-0-128-134 kubenswrapper[2559]: W0612 22:20:58.245059 2559 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jun 12 22:20:58.248282 ip-10-0-128-134 kubenswrapper[2559]: W0612 22:20:58.245061 2559 feature_gate.go:328] unrecognized feature gate: SignatureStores Jun 12 22:20:58.248282 ip-10-0-128-134 kubenswrapper[2559]: W0612 22:20:58.245064 2559 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jun 12 22:20:58.248282 ip-10-0-128-134 kubenswrapper[2559]: W0612 22:20:58.245067 2559 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jun 12 22:20:58.248282 ip-10-0-128-134 kubenswrapper[2559]: W0612 22:20:58.245070 2559 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jun 12 22:20:58.248282 ip-10-0-128-134 kubenswrapper[2559]: W0612 22:20:58.245073 2559 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jun 12 22:20:58.248282 ip-10-0-128-134 kubenswrapper[2559]: W0612 22:20:58.245075 2559 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jun 12 22:20:58.248282 ip-10-0-128-134 kubenswrapper[2559]: W0612 22:20:58.245078 2559 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jun 12 22:20:58.248810 ip-10-0-128-134 kubenswrapper[2559]: W0612 22:20:58.245081 2559 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jun 12 22:20:58.248810 ip-10-0-128-134 kubenswrapper[2559]: W0612 22:20:58.245083 2559 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jun 12 22:20:58.248810 ip-10-0-128-134 kubenswrapper[2559]: W0612 22:20:58.245086 2559 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jun 12 22:20:58.248810 ip-10-0-128-134 kubenswrapper[2559]: W0612 22:20:58.245088 2559 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jun 12 22:20:58.248810 ip-10-0-128-134 kubenswrapper[2559]: W0612 22:20:58.245090 2559 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jun 12 22:20:58.248810 ip-10-0-128-134 kubenswrapper[2559]: W0612 22:20:58.245093 2559 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jun 12 22:20:58.248810 ip-10-0-128-134 kubenswrapper[2559]: W0612 22:20:58.245095 2559 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jun 12 22:20:58.248810 ip-10-0-128-134 kubenswrapper[2559]: W0612 22:20:58.245098 2559 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jun 12 22:20:58.248810 ip-10-0-128-134 kubenswrapper[2559]: W0612 22:20:58.245100 2559 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jun 12 22:20:58.248810 ip-10-0-128-134 kubenswrapper[2559]: W0612 22:20:58.245103 2559 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jun 12 22:20:58.248810 ip-10-0-128-134 kubenswrapper[2559]: W0612 22:20:58.245105 2559 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jun 12 22:20:58.248810 ip-10-0-128-134 kubenswrapper[2559]: W0612 22:20:58.245108 2559 feature_gate.go:328] unrecognized feature gate: Example2 Jun 12 22:20:58.248810 ip-10-0-128-134 kubenswrapper[2559]: W0612 22:20:58.245110 2559 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jun 12 22:20:58.248810 ip-10-0-128-134 kubenswrapper[2559]: W0612 22:20:58.245113 2559 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jun 12 22:20:58.248810 ip-10-0-128-134 kubenswrapper[2559]: W0612 22:20:58.245115 2559 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jun 12 22:20:58.248810 ip-10-0-128-134 kubenswrapper[2559]: W0612 22:20:58.245118 2559 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jun 12 22:20:58.248810 ip-10-0-128-134 kubenswrapper[2559]: W0612 22:20:58.245122 2559 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jun 12 22:20:58.248810 ip-10-0-128-134 kubenswrapper[2559]: W0612 22:20:58.245125 2559 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jun 12 22:20:58.248810 ip-10-0-128-134 kubenswrapper[2559]: W0612 22:20:58.245129 2559 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jun 12 22:20:58.249284 ip-10-0-128-134 kubenswrapper[2559]: W0612 22:20:58.245132 2559 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jun 12 22:20:58.249284 ip-10-0-128-134 kubenswrapper[2559]: W0612 22:20:58.245135 2559 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jun 12 22:20:58.249284 ip-10-0-128-134 kubenswrapper[2559]: W0612 22:20:58.245138 2559 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jun 12 22:20:58.249284 ip-10-0-128-134 kubenswrapper[2559]: W0612 22:20:58.245140 2559 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jun 12 22:20:58.249284 ip-10-0-128-134 kubenswrapper[2559]: W0612 22:20:58.245143 2559 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jun 12 22:20:58.249284 ip-10-0-128-134 kubenswrapper[2559]: W0612 22:20:58.245145 2559 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jun 12 22:20:58.249284 ip-10-0-128-134 kubenswrapper[2559]: W0612 22:20:58.245148 2559 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jun 12 22:20:58.249284 ip-10-0-128-134 kubenswrapper[2559]: W0612 22:20:58.245150 2559 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jun 12 22:20:58.249284 ip-10-0-128-134 kubenswrapper[2559]: W0612 22:20:58.245154 2559 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jun 12 22:20:58.249284 ip-10-0-128-134 kubenswrapper[2559]: W0612 22:20:58.245157 2559 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jun 12 22:20:58.249284 ip-10-0-128-134 kubenswrapper[2559]: W0612 22:20:58.245160 2559 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jun 12 22:20:58.249284 ip-10-0-128-134 kubenswrapper[2559]: W0612 22:20:58.245162 2559 feature_gate.go:328] unrecognized feature gate: NewOLM Jun 12 22:20:58.249284 ip-10-0-128-134 kubenswrapper[2559]: W0612 22:20:58.245165 2559 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jun 12 22:20:58.249284 ip-10-0-128-134 kubenswrapper[2559]: W0612 22:20:58.245167 2559 feature_gate.go:328] unrecognized feature gate: PinnedImages Jun 12 22:20:58.249284 ip-10-0-128-134 kubenswrapper[2559]: W0612 22:20:58.245170 2559 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jun 12 22:20:58.249284 ip-10-0-128-134 kubenswrapper[2559]: W0612 22:20:58.245172 2559 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jun 12 22:20:58.249284 ip-10-0-128-134 kubenswrapper[2559]: W0612 22:20:58.245175 2559 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jun 12 22:20:58.249284 ip-10-0-128-134 kubenswrapper[2559]: W0612 22:20:58.245177 2559 feature_gate.go:328] unrecognized feature gate: Example Jun 12 22:20:58.249284 ip-10-0-128-134 kubenswrapper[2559]: W0612 22:20:58.245179 2559 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jun 12 22:20:58.249284 ip-10-0-128-134 kubenswrapper[2559]: W0612 22:20:58.245182 2559 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jun 12 22:20:58.249793 ip-10-0-128-134 kubenswrapper[2559]: W0612 22:20:58.245184 2559 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jun 12 22:20:58.249793 ip-10-0-128-134 kubenswrapper[2559]: W0612 22:20:58.245187 2559 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jun 12 22:20:58.249793 ip-10-0-128-134 kubenswrapper[2559]: W0612 22:20:58.245189 2559 feature_gate.go:328] unrecognized feature gate: DualReplica Jun 12 22:20:58.249793 ip-10-0-128-134 kubenswrapper[2559]: W0612 22:20:58.245192 2559 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jun 12 22:20:58.249793 ip-10-0-128-134 kubenswrapper[2559]: W0612 22:20:58.245194 2559 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jun 12 22:20:58.249793 ip-10-0-128-134 kubenswrapper[2559]: W0612 22:20:58.245197 2559 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jun 12 22:20:58.249793 ip-10-0-128-134 kubenswrapper[2559]: W0612 22:20:58.245199 2559 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jun 12 22:20:58.249793 ip-10-0-128-134 kubenswrapper[2559]: W0612 22:20:58.245201 2559 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jun 12 22:20:58.249793 ip-10-0-128-134 kubenswrapper[2559]: W0612 22:20:58.245204 2559 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jun 12 22:20:58.249793 ip-10-0-128-134 kubenswrapper[2559]: W0612 22:20:58.245206 2559 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jun 12 22:20:58.249793 ip-10-0-128-134 kubenswrapper[2559]: W0612 22:20:58.245210 2559 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jun 12 22:20:58.249793 ip-10-0-128-134 kubenswrapper[2559]: W0612 22:20:58.245216 2559 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jun 12 22:20:58.249793 ip-10-0-128-134 kubenswrapper[2559]: W0612 22:20:58.245219 2559 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jun 12 22:20:58.249793 ip-10-0-128-134 kubenswrapper[2559]: W0612 22:20:58.245222 2559 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jun 12 22:20:58.249793 ip-10-0-128-134 kubenswrapper[2559]: W0612 22:20:58.245227 2559 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jun 12 22:20:58.249793 ip-10-0-128-134 kubenswrapper[2559]: W0612 22:20:58.245230 2559 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jun 12 22:20:58.249793 ip-10-0-128-134 kubenswrapper[2559]: W0612 22:20:58.245234 2559 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jun 12 22:20:58.249793 ip-10-0-128-134 kubenswrapper[2559]: W0612 22:20:58.245236 2559 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jun 12 22:20:58.249793 ip-10-0-128-134 kubenswrapper[2559]: W0612 22:20:58.245239 2559 feature_gate.go:328] unrecognized feature gate: OSStreams Jun 12 22:20:58.250261 ip-10-0-128-134 kubenswrapper[2559]: W0612 22:20:58.245242 2559 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jun 12 22:20:58.250261 ip-10-0-128-134 kubenswrapper[2559]: W0612 22:20:58.245244 2559 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jun 12 22:20:58.250261 ip-10-0-128-134 kubenswrapper[2559]: W0612 22:20:58.245247 2559 feature_gate.go:328] unrecognized feature gate: OVNObservability Jun 12 22:20:58.250261 ip-10-0-128-134 kubenswrapper[2559]: W0612 22:20:58.245250 2559 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jun 12 22:20:58.250261 ip-10-0-128-134 kubenswrapper[2559]: W0612 22:20:58.245252 2559 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jun 12 22:20:58.250261 ip-10-0-128-134 kubenswrapper[2559]: W0612 22:20:58.245255 2559 feature_gate.go:328] unrecognized feature gate: EventTTL Jun 12 22:20:58.250261 ip-10-0-128-134 kubenswrapper[2559]: W0612 22:20:58.245257 2559 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jun 12 22:20:58.250261 ip-10-0-128-134 kubenswrapper[2559]: W0612 22:20:58.245259 2559 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jun 12 22:20:58.250261 ip-10-0-128-134 kubenswrapper[2559]: W0612 22:20:58.245262 2559 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jun 12 22:20:58.250261 ip-10-0-128-134 kubenswrapper[2559]: W0612 22:20:58.245264 2559 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jun 12 22:20:58.250261 ip-10-0-128-134 kubenswrapper[2559]: W0612 22:20:58.245267 2559 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jun 12 22:20:58.250261 ip-10-0-128-134 kubenswrapper[2559]: W0612 22:20:58.245269 2559 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jun 12 22:20:58.250261 ip-10-0-128-134 kubenswrapper[2559]: W0612 22:20:58.245272 2559 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jun 12 22:20:58.250261 ip-10-0-128-134 kubenswrapper[2559]: W0612 22:20:58.245274 2559 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jun 12 22:20:58.250261 ip-10-0-128-134 kubenswrapper[2559]: W0612 22:20:58.245277 2559 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jun 12 22:20:58.250261 ip-10-0-128-134 kubenswrapper[2559]: W0612 22:20:58.245279 2559 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jun 12 22:20:58.250261 ip-10-0-128-134 kubenswrapper[2559]: W0612 22:20:58.245282 2559 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jun 12 22:20:58.250261 ip-10-0-128-134 kubenswrapper[2559]: W0612 22:20:58.245284 2559 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jun 12 22:20:58.250261 ip-10-0-128-134 kubenswrapper[2559]: W0612 22:20:58.245286 2559 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jun 12 22:20:58.250261 ip-10-0-128-134 kubenswrapper[2559]: I0612 22:20:58.245354 2559 flags.go:64] FLAG: --address="0.0.0.0" Jun 12 22:20:58.250841 ip-10-0-128-134 kubenswrapper[2559]: I0612 22:20:58.245362 2559 flags.go:64] FLAG: --allowed-unsafe-sysctls="[]" Jun 12 22:20:58.250841 ip-10-0-128-134 kubenswrapper[2559]: I0612 22:20:58.245368 2559 flags.go:64] FLAG: --anonymous-auth="true" Jun 12 22:20:58.250841 ip-10-0-128-134 kubenswrapper[2559]: I0612 22:20:58.245372 2559 flags.go:64] FLAG: --application-metrics-count-limit="100" Jun 12 22:20:58.250841 ip-10-0-128-134 kubenswrapper[2559]: I0612 22:20:58.245376 2559 flags.go:64] FLAG: --authentication-token-webhook="false" Jun 12 22:20:58.250841 ip-10-0-128-134 kubenswrapper[2559]: I0612 22:20:58.245382 2559 flags.go:64] FLAG: --authentication-token-webhook-cache-ttl="2m0s" Jun 12 22:20:58.250841 ip-10-0-128-134 kubenswrapper[2559]: I0612 22:20:58.245385 2559 flags.go:64] FLAG: --authorization-mode="AlwaysAllow" Jun 12 22:20:58.250841 ip-10-0-128-134 kubenswrapper[2559]: I0612 22:20:58.245390 2559 flags.go:64] FLAG: --authorization-webhook-cache-authorized-ttl="5m0s" Jun 12 22:20:58.250841 ip-10-0-128-134 kubenswrapper[2559]: I0612 22:20:58.245397 2559 flags.go:64] FLAG: --authorization-webhook-cache-unauthorized-ttl="30s" Jun 12 22:20:58.250841 ip-10-0-128-134 kubenswrapper[2559]: I0612 22:20:58.245400 2559 flags.go:64] FLAG: --boot-id-file="/proc/sys/kernel/random/boot_id" Jun 12 22:20:58.250841 ip-10-0-128-134 kubenswrapper[2559]: I0612 22:20:58.245404 2559 flags.go:64] FLAG: --bootstrap-kubeconfig="/etc/kubernetes/kubeconfig" Jun 12 22:20:58.250841 ip-10-0-128-134 kubenswrapper[2559]: I0612 22:20:58.245407 2559 flags.go:64] FLAG: --cert-dir="/var/lib/kubelet/pki" Jun 12 22:20:58.250841 ip-10-0-128-134 kubenswrapper[2559]: I0612 22:20:58.245410 2559 flags.go:64] FLAG: --cgroup-driver="cgroupfs" Jun 12 22:20:58.250841 ip-10-0-128-134 kubenswrapper[2559]: I0612 22:20:58.245413 2559 flags.go:64] FLAG: --cgroup-root="" Jun 12 22:20:58.250841 ip-10-0-128-134 kubenswrapper[2559]: I0612 22:20:58.245415 2559 flags.go:64] FLAG: --cgroups-per-qos="true" Jun 12 22:20:58.250841 ip-10-0-128-134 kubenswrapper[2559]: I0612 22:20:58.245418 2559 flags.go:64] FLAG: --client-ca-file="" Jun 12 22:20:58.250841 ip-10-0-128-134 kubenswrapper[2559]: I0612 22:20:58.245421 2559 flags.go:64] FLAG: --cloud-provider="external" Jun 12 22:20:58.250841 ip-10-0-128-134 kubenswrapper[2559]: I0612 22:20:58.245424 2559 flags.go:64] FLAG: --cluster-dns="[]" Jun 12 22:20:58.250841 ip-10-0-128-134 kubenswrapper[2559]: I0612 22:20:58.245428 2559 flags.go:64] FLAG: --cluster-domain="" Jun 12 22:20:58.250841 ip-10-0-128-134 kubenswrapper[2559]: I0612 22:20:58.245431 2559 flags.go:64] FLAG: --config="/etc/kubernetes/kubelet.conf" Jun 12 22:20:58.250841 ip-10-0-128-134 kubenswrapper[2559]: I0612 22:20:58.245434 2559 flags.go:64] FLAG: --config-dir="/etc/openshift/kubelet.conf.d" Jun 12 22:20:58.250841 ip-10-0-128-134 kubenswrapper[2559]: I0612 22:20:58.245437 2559 flags.go:64] FLAG: --container-hints="/etc/cadvisor/container_hints.json" Jun 12 22:20:58.250841 ip-10-0-128-134 kubenswrapper[2559]: I0612 22:20:58.245440 2559 flags.go:64] FLAG: --container-log-max-files="5" Jun 12 22:20:58.250841 ip-10-0-128-134 kubenswrapper[2559]: I0612 22:20:58.245457 2559 flags.go:64] FLAG: --container-log-max-size="10Mi" Jun 12 22:20:58.250841 ip-10-0-128-134 kubenswrapper[2559]: I0612 22:20:58.245460 2559 flags.go:64] FLAG: --container-runtime-endpoint="/var/run/crio/crio.sock" Jun 12 22:20:58.251418 ip-10-0-128-134 kubenswrapper[2559]: I0612 22:20:58.245463 2559 flags.go:64] FLAG: --containerd="/run/containerd/containerd.sock" Jun 12 22:20:58.251418 ip-10-0-128-134 kubenswrapper[2559]: I0612 22:20:58.245466 2559 flags.go:64] FLAG: --containerd-namespace="k8s.io" Jun 12 22:20:58.251418 ip-10-0-128-134 kubenswrapper[2559]: I0612 22:20:58.245469 2559 flags.go:64] FLAG: --contention-profiling="false" Jun 12 22:20:58.251418 ip-10-0-128-134 kubenswrapper[2559]: I0612 22:20:58.245472 2559 flags.go:64] FLAG: --cpu-cfs-quota="true" Jun 12 22:20:58.251418 ip-10-0-128-134 kubenswrapper[2559]: I0612 22:20:58.245475 2559 flags.go:64] FLAG: --cpu-cfs-quota-period="100ms" Jun 12 22:20:58.251418 ip-10-0-128-134 kubenswrapper[2559]: I0612 22:20:58.245478 2559 flags.go:64] FLAG: --cpu-manager-policy="none" Jun 12 22:20:58.251418 ip-10-0-128-134 kubenswrapper[2559]: I0612 22:20:58.245481 2559 flags.go:64] FLAG: --cpu-manager-policy-options="" Jun 12 22:20:58.251418 ip-10-0-128-134 kubenswrapper[2559]: I0612 22:20:58.245485 2559 flags.go:64] FLAG: --cpu-manager-reconcile-period="10s" Jun 12 22:20:58.251418 ip-10-0-128-134 kubenswrapper[2559]: I0612 22:20:58.245488 2559 flags.go:64] FLAG: --enable-controller-attach-detach="true" Jun 12 22:20:58.251418 ip-10-0-128-134 kubenswrapper[2559]: I0612 22:20:58.245491 2559 flags.go:64] FLAG: --enable-debugging-handlers="true" Jun 12 22:20:58.251418 ip-10-0-128-134 kubenswrapper[2559]: I0612 22:20:58.245494 2559 flags.go:64] FLAG: --enable-load-reader="false" Jun 12 22:20:58.251418 ip-10-0-128-134 kubenswrapper[2559]: I0612 22:20:58.245497 2559 flags.go:64] FLAG: --enable-server="true" Jun 12 22:20:58.251418 ip-10-0-128-134 kubenswrapper[2559]: I0612 22:20:58.245501 2559 flags.go:64] FLAG: --enforce-node-allocatable="[pods]" Jun 12 22:20:58.251418 ip-10-0-128-134 kubenswrapper[2559]: I0612 22:20:58.245505 2559 flags.go:64] FLAG: --event-burst="100" Jun 12 22:20:58.251418 ip-10-0-128-134 kubenswrapper[2559]: I0612 22:20:58.245508 2559 flags.go:64] FLAG: --event-qps="50" Jun 12 22:20:58.251418 ip-10-0-128-134 kubenswrapper[2559]: I0612 22:20:58.245512 2559 flags.go:64] FLAG: --event-storage-age-limit="default=0" Jun 12 22:20:58.251418 ip-10-0-128-134 kubenswrapper[2559]: I0612 22:20:58.245515 2559 flags.go:64] FLAG: --event-storage-event-limit="default=0" Jun 12 22:20:58.251418 ip-10-0-128-134 kubenswrapper[2559]: I0612 22:20:58.245518 2559 flags.go:64] FLAG: --eviction-hard="" Jun 12 22:20:58.251418 ip-10-0-128-134 kubenswrapper[2559]: I0612 22:20:58.245521 2559 flags.go:64] FLAG: --eviction-max-pod-grace-period="0" Jun 12 22:20:58.251418 ip-10-0-128-134 kubenswrapper[2559]: I0612 22:20:58.245524 2559 flags.go:64] FLAG: --eviction-minimum-reclaim="" Jun 12 22:20:58.251418 ip-10-0-128-134 kubenswrapper[2559]: I0612 22:20:58.245527 2559 flags.go:64] FLAG: --eviction-pressure-transition-period="5m0s" Jun 12 22:20:58.251418 ip-10-0-128-134 kubenswrapper[2559]: I0612 22:20:58.245530 2559 flags.go:64] FLAG: --eviction-soft="" Jun 12 22:20:58.251418 ip-10-0-128-134 kubenswrapper[2559]: I0612 22:20:58.245533 2559 flags.go:64] FLAG: --eviction-soft-grace-period="" Jun 12 22:20:58.251418 ip-10-0-128-134 kubenswrapper[2559]: I0612 22:20:58.245536 2559 flags.go:64] FLAG: --exit-on-lock-contention="false" Jun 12 22:20:58.251418 ip-10-0-128-134 kubenswrapper[2559]: I0612 22:20:58.245539 2559 flags.go:64] FLAG: --experimental-allocatable-ignore-eviction="false" Jun 12 22:20:58.252056 ip-10-0-128-134 kubenswrapper[2559]: I0612 22:20:58.245542 2559 flags.go:64] FLAG: --experimental-mounter-path="" Jun 12 22:20:58.252056 ip-10-0-128-134 kubenswrapper[2559]: I0612 22:20:58.245544 2559 flags.go:64] FLAG: --fail-cgroupv1="false" Jun 12 22:20:58.252056 ip-10-0-128-134 kubenswrapper[2559]: I0612 22:20:58.245547 2559 flags.go:64] FLAG: --fail-swap-on="true" Jun 12 22:20:58.252056 ip-10-0-128-134 kubenswrapper[2559]: I0612 22:20:58.245550 2559 flags.go:64] FLAG: --feature-gates="" Jun 12 22:20:58.252056 ip-10-0-128-134 kubenswrapper[2559]: I0612 22:20:58.245553 2559 flags.go:64] FLAG: --file-check-frequency="20s" Jun 12 22:20:58.252056 ip-10-0-128-134 kubenswrapper[2559]: I0612 22:20:58.245556 2559 flags.go:64] FLAG: --global-housekeeping-interval="1m0s" Jun 12 22:20:58.252056 ip-10-0-128-134 kubenswrapper[2559]: I0612 22:20:58.245559 2559 flags.go:64] FLAG: --hairpin-mode="promiscuous-bridge" Jun 12 22:20:58.252056 ip-10-0-128-134 kubenswrapper[2559]: I0612 22:20:58.245562 2559 flags.go:64] FLAG: --healthz-bind-address="127.0.0.1" Jun 12 22:20:58.252056 ip-10-0-128-134 kubenswrapper[2559]: I0612 22:20:58.245564 2559 flags.go:64] FLAG: --healthz-port="10248" Jun 12 22:20:58.252056 ip-10-0-128-134 kubenswrapper[2559]: I0612 22:20:58.245567 2559 flags.go:64] FLAG: --help="false" Jun 12 22:20:58.252056 ip-10-0-128-134 kubenswrapper[2559]: I0612 22:20:58.245570 2559 flags.go:64] FLAG: --hostname-override="ip-10-0-128-134.ec2.internal" Jun 12 22:20:58.252056 ip-10-0-128-134 kubenswrapper[2559]: I0612 22:20:58.245573 2559 flags.go:64] FLAG: --housekeeping-interval="10s" Jun 12 22:20:58.252056 ip-10-0-128-134 kubenswrapper[2559]: I0612 22:20:58.245575 2559 flags.go:64] FLAG: --http-check-frequency="20s" Jun 12 22:20:58.252056 ip-10-0-128-134 kubenswrapper[2559]: I0612 22:20:58.245578 2559 flags.go:64] FLAG: --image-credential-provider-bin-dir="/usr/libexec/kubelet-image-credential-provider-plugins" Jun 12 22:20:58.252056 ip-10-0-128-134 kubenswrapper[2559]: I0612 22:20:58.245581 2559 flags.go:64] FLAG: --image-credential-provider-config="/etc/kubernetes/credential-providers/ecr-credential-provider.yaml" Jun 12 22:20:58.252056 ip-10-0-128-134 kubenswrapper[2559]: I0612 22:20:58.245584 2559 flags.go:64] FLAG: --image-gc-high-threshold="85" Jun 12 22:20:58.252056 ip-10-0-128-134 kubenswrapper[2559]: I0612 22:20:58.245587 2559 flags.go:64] FLAG: --image-gc-low-threshold="80" Jun 12 22:20:58.252056 ip-10-0-128-134 kubenswrapper[2559]: I0612 22:20:58.245590 2559 flags.go:64] FLAG: --image-service-endpoint="" Jun 12 22:20:58.252056 ip-10-0-128-134 kubenswrapper[2559]: I0612 22:20:58.245592 2559 flags.go:64] FLAG: --kernel-memcg-notification="false" Jun 12 22:20:58.252056 ip-10-0-128-134 kubenswrapper[2559]: I0612 22:20:58.245596 2559 flags.go:64] FLAG: --kube-api-burst="100" Jun 12 22:20:58.252056 ip-10-0-128-134 kubenswrapper[2559]: I0612 22:20:58.245599 2559 flags.go:64] FLAG: --kube-api-content-type="application/vnd.kubernetes.protobuf" Jun 12 22:20:58.252056 ip-10-0-128-134 kubenswrapper[2559]: I0612 22:20:58.245603 2559 flags.go:64] FLAG: --kube-api-qps="50" Jun 12 22:20:58.252056 ip-10-0-128-134 kubenswrapper[2559]: I0612 22:20:58.245606 2559 flags.go:64] FLAG: --kube-reserved="" Jun 12 22:20:58.252056 ip-10-0-128-134 kubenswrapper[2559]: I0612 22:20:58.245609 2559 flags.go:64] FLAG: --kube-reserved-cgroup="" Jun 12 22:20:58.252905 ip-10-0-128-134 kubenswrapper[2559]: I0612 22:20:58.245612 2559 flags.go:64] FLAG: --kubeconfig="/var/lib/kubelet/kubeconfig" Jun 12 22:20:58.252905 ip-10-0-128-134 kubenswrapper[2559]: I0612 22:20:58.245615 2559 flags.go:64] FLAG: --kubelet-cgroups="" Jun 12 22:20:58.252905 ip-10-0-128-134 kubenswrapper[2559]: I0612 22:20:58.245617 2559 flags.go:64] FLAG: --local-storage-capacity-isolation="true" Jun 12 22:20:58.252905 ip-10-0-128-134 kubenswrapper[2559]: I0612 22:20:58.245620 2559 flags.go:64] FLAG: --lock-file="" Jun 12 22:20:58.252905 ip-10-0-128-134 kubenswrapper[2559]: I0612 22:20:58.245623 2559 flags.go:64] FLAG: --log-cadvisor-usage="false" Jun 12 22:20:58.252905 ip-10-0-128-134 kubenswrapper[2559]: I0612 22:20:58.245625 2559 flags.go:64] FLAG: --log-flush-frequency="5s" Jun 12 22:20:58.252905 ip-10-0-128-134 kubenswrapper[2559]: I0612 22:20:58.245628 2559 flags.go:64] FLAG: --log-json-info-buffer-size="0" Jun 12 22:20:58.252905 ip-10-0-128-134 kubenswrapper[2559]: I0612 22:20:58.245633 2559 flags.go:64] FLAG: --log-json-split-stream="false" Jun 12 22:20:58.252905 ip-10-0-128-134 kubenswrapper[2559]: I0612 22:20:58.245636 2559 flags.go:64] FLAG: --log-text-info-buffer-size="0" Jun 12 22:20:58.252905 ip-10-0-128-134 kubenswrapper[2559]: I0612 22:20:58.245639 2559 flags.go:64] FLAG: --log-text-split-stream="false" Jun 12 22:20:58.252905 ip-10-0-128-134 kubenswrapper[2559]: I0612 22:20:58.245642 2559 flags.go:64] FLAG: --logging-format="text" Jun 12 22:20:58.252905 ip-10-0-128-134 kubenswrapper[2559]: I0612 22:20:58.245645 2559 flags.go:64] FLAG: --machine-id-file="/etc/machine-id,/var/lib/dbus/machine-id" Jun 12 22:20:58.252905 ip-10-0-128-134 kubenswrapper[2559]: I0612 22:20:58.245648 2559 flags.go:64] FLAG: --make-iptables-util-chains="true" Jun 12 22:20:58.252905 ip-10-0-128-134 kubenswrapper[2559]: I0612 22:20:58.245651 2559 flags.go:64] FLAG: --manifest-url="" Jun 12 22:20:58.252905 ip-10-0-128-134 kubenswrapper[2559]: I0612 22:20:58.245654 2559 flags.go:64] FLAG: --manifest-url-header="" Jun 12 22:20:58.252905 ip-10-0-128-134 kubenswrapper[2559]: I0612 22:20:58.245657 2559 flags.go:64] FLAG: --max-housekeeping-interval="15s" Jun 12 22:20:58.252905 ip-10-0-128-134 kubenswrapper[2559]: I0612 22:20:58.245660 2559 flags.go:64] FLAG: --max-open-files="1000000" Jun 12 22:20:58.252905 ip-10-0-128-134 kubenswrapper[2559]: I0612 22:20:58.245664 2559 flags.go:64] FLAG: --max-pods="110" Jun 12 22:20:58.252905 ip-10-0-128-134 kubenswrapper[2559]: I0612 22:20:58.245667 2559 flags.go:64] FLAG: --maximum-dead-containers="-1" Jun 12 22:20:58.252905 ip-10-0-128-134 kubenswrapper[2559]: I0612 22:20:58.245670 2559 flags.go:64] FLAG: --maximum-dead-containers-per-container="1" Jun 12 22:20:58.252905 ip-10-0-128-134 kubenswrapper[2559]: I0612 22:20:58.245672 2559 flags.go:64] FLAG: --memory-manager-policy="None" Jun 12 22:20:58.252905 ip-10-0-128-134 kubenswrapper[2559]: I0612 22:20:58.245675 2559 flags.go:64] FLAG: --minimum-container-ttl-duration="6m0s" Jun 12 22:20:58.252905 ip-10-0-128-134 kubenswrapper[2559]: I0612 22:20:58.245678 2559 flags.go:64] FLAG: --minimum-image-ttl-duration="2m0s" Jun 12 22:20:58.252905 ip-10-0-128-134 kubenswrapper[2559]: I0612 22:20:58.245680 2559 flags.go:64] FLAG: --node-ip="0.0.0.0" Jun 12 22:20:58.252905 ip-10-0-128-134 kubenswrapper[2559]: I0612 22:20:58.245683 2559 flags.go:64] FLAG: --node-labels="node-role.kubernetes.io/worker=,node.openshift.io/os_id=rhel" Jun 12 22:20:58.253983 ip-10-0-128-134 kubenswrapper[2559]: I0612 22:20:58.245690 2559 flags.go:64] FLAG: --node-status-max-images="50" Jun 12 22:20:58.253983 ip-10-0-128-134 kubenswrapper[2559]: I0612 22:20:58.245693 2559 flags.go:64] FLAG: --node-status-update-frequency="10s" Jun 12 22:20:58.253983 ip-10-0-128-134 kubenswrapper[2559]: I0612 22:20:58.245697 2559 flags.go:64] FLAG: --oom-score-adj="-999" Jun 12 22:20:58.253983 ip-10-0-128-134 kubenswrapper[2559]: I0612 22:20:58.245700 2559 flags.go:64] FLAG: --pod-cidr="" Jun 12 22:20:58.253983 ip-10-0-128-134 kubenswrapper[2559]: I0612 22:20:58.245703 2559 flags.go:64] FLAG: --pod-infra-container-image="quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:4a2e90c8ef7d783e4d635e24fb09435f5e1f6e954583512c0944f9e57bc77b52" Jun 12 22:20:58.253983 ip-10-0-128-134 kubenswrapper[2559]: I0612 22:20:58.245709 2559 flags.go:64] FLAG: --pod-manifest-path="" Jun 12 22:20:58.253983 ip-10-0-128-134 kubenswrapper[2559]: I0612 22:20:58.245712 2559 flags.go:64] FLAG: --pod-max-pids="-1" Jun 12 22:20:58.253983 ip-10-0-128-134 kubenswrapper[2559]: I0612 22:20:58.245715 2559 flags.go:64] FLAG: --pods-per-core="0" Jun 12 22:20:58.253983 ip-10-0-128-134 kubenswrapper[2559]: I0612 22:20:58.245718 2559 flags.go:64] FLAG: --port="10250" Jun 12 22:20:58.253983 ip-10-0-128-134 kubenswrapper[2559]: I0612 22:20:58.245720 2559 flags.go:64] FLAG: --protect-kernel-defaults="false" Jun 12 22:20:58.253983 ip-10-0-128-134 kubenswrapper[2559]: I0612 22:20:58.245723 2559 flags.go:64] FLAG: --provider-id="aws:///us-east-1a/i-0239018fbadadb0a0" Jun 12 22:20:58.253983 ip-10-0-128-134 kubenswrapper[2559]: I0612 22:20:58.245726 2559 flags.go:64] FLAG: --qos-reserved="" Jun 12 22:20:58.253983 ip-10-0-128-134 kubenswrapper[2559]: I0612 22:20:58.245729 2559 flags.go:64] FLAG: --read-only-port="10255" Jun 12 22:20:58.253983 ip-10-0-128-134 kubenswrapper[2559]: I0612 22:20:58.245732 2559 flags.go:64] FLAG: --register-node="true" Jun 12 22:20:58.253983 ip-10-0-128-134 kubenswrapper[2559]: I0612 22:20:58.245735 2559 flags.go:64] FLAG: --register-with-taints="" Jun 12 22:20:58.253983 ip-10-0-128-134 kubenswrapper[2559]: I0612 22:20:58.245738 2559 flags.go:64] FLAG: --registry-burst="10" Jun 12 22:20:58.253983 ip-10-0-128-134 kubenswrapper[2559]: I0612 22:20:58.245741 2559 flags.go:64] FLAG: --registry-qps="5" Jun 12 22:20:58.253983 ip-10-0-128-134 kubenswrapper[2559]: I0612 22:20:58.245744 2559 flags.go:64] FLAG: --reserved-cpus="" Jun 12 22:20:58.253983 ip-10-0-128-134 kubenswrapper[2559]: I0612 22:20:58.245747 2559 flags.go:64] FLAG: --reserved-memory="" Jun 12 22:20:58.253983 ip-10-0-128-134 kubenswrapper[2559]: I0612 22:20:58.245750 2559 flags.go:64] FLAG: --resolv-conf="/etc/resolv.conf" Jun 12 22:20:58.253983 ip-10-0-128-134 kubenswrapper[2559]: I0612 22:20:58.245753 2559 flags.go:64] FLAG: --root-dir="/var/lib/kubelet" Jun 12 22:20:58.253983 ip-10-0-128-134 kubenswrapper[2559]: I0612 22:20:58.245756 2559 flags.go:64] FLAG: --rotate-certificates="false" Jun 12 22:20:58.253983 ip-10-0-128-134 kubenswrapper[2559]: I0612 22:20:58.245759 2559 flags.go:64] FLAG: --rotate-server-certificates="false" Jun 12 22:20:58.253983 ip-10-0-128-134 kubenswrapper[2559]: I0612 22:20:58.245761 2559 flags.go:64] FLAG: --runonce="false" Jun 12 22:20:58.253983 ip-10-0-128-134 kubenswrapper[2559]: I0612 22:20:58.245764 2559 flags.go:64] FLAG: --runtime-cgroups="/system.slice/crio.service" Jun 12 22:20:58.255045 ip-10-0-128-134 kubenswrapper[2559]: I0612 22:20:58.245767 2559 flags.go:64] FLAG: --runtime-request-timeout="2m0s" Jun 12 22:20:58.255045 ip-10-0-128-134 kubenswrapper[2559]: I0612 22:20:58.245770 2559 flags.go:64] FLAG: --seccomp-default="false" Jun 12 22:20:58.255045 ip-10-0-128-134 kubenswrapper[2559]: I0612 22:20:58.245772 2559 flags.go:64] FLAG: --serialize-image-pulls="true" Jun 12 22:20:58.255045 ip-10-0-128-134 kubenswrapper[2559]: I0612 22:20:58.245775 2559 flags.go:64] FLAG: --storage-driver-buffer-duration="1m0s" Jun 12 22:20:58.255045 ip-10-0-128-134 kubenswrapper[2559]: I0612 22:20:58.245778 2559 flags.go:64] FLAG: --storage-driver-db="cadvisor" Jun 12 22:20:58.255045 ip-10-0-128-134 kubenswrapper[2559]: I0612 22:20:58.245780 2559 flags.go:64] FLAG: --storage-driver-host="localhost:8086" Jun 12 22:20:58.255045 ip-10-0-128-134 kubenswrapper[2559]: I0612 22:20:58.245783 2559 flags.go:64] FLAG: --storage-driver-password="root" Jun 12 22:20:58.255045 ip-10-0-128-134 kubenswrapper[2559]: I0612 22:20:58.245786 2559 flags.go:64] FLAG: --storage-driver-secure="false" Jun 12 22:20:58.255045 ip-10-0-128-134 kubenswrapper[2559]: I0612 22:20:58.245789 2559 flags.go:64] FLAG: --storage-driver-table="stats" Jun 12 22:20:58.255045 ip-10-0-128-134 kubenswrapper[2559]: I0612 22:20:58.245791 2559 flags.go:64] FLAG: --storage-driver-user="root" Jun 12 22:20:58.255045 ip-10-0-128-134 kubenswrapper[2559]: I0612 22:20:58.245795 2559 flags.go:64] FLAG: --streaming-connection-idle-timeout="4h0m0s" Jun 12 22:20:58.255045 ip-10-0-128-134 kubenswrapper[2559]: I0612 22:20:58.245798 2559 flags.go:64] FLAG: --sync-frequency="1m0s" Jun 12 22:20:58.255045 ip-10-0-128-134 kubenswrapper[2559]: I0612 22:20:58.245802 2559 flags.go:64] FLAG: --system-cgroups="" Jun 12 22:20:58.255045 ip-10-0-128-134 kubenswrapper[2559]: I0612 22:20:58.245805 2559 flags.go:64] FLAG: --system-reserved="cpu=500m,ephemeral-storage=1Gi,memory=1Gi" Jun 12 22:20:58.255045 ip-10-0-128-134 kubenswrapper[2559]: I0612 22:20:58.245810 2559 flags.go:64] FLAG: --system-reserved-cgroup="" Jun 12 22:20:58.255045 ip-10-0-128-134 kubenswrapper[2559]: I0612 22:20:58.245813 2559 flags.go:64] FLAG: --tls-cert-file="" Jun 12 22:20:58.255045 ip-10-0-128-134 kubenswrapper[2559]: I0612 22:20:58.245815 2559 flags.go:64] FLAG: --tls-cipher-suites="[]" Jun 12 22:20:58.255045 ip-10-0-128-134 kubenswrapper[2559]: I0612 22:20:58.245820 2559 flags.go:64] FLAG: --tls-min-version="" Jun 12 22:20:58.255045 ip-10-0-128-134 kubenswrapper[2559]: I0612 22:20:58.245822 2559 flags.go:64] FLAG: --tls-private-key-file="" Jun 12 22:20:58.255045 ip-10-0-128-134 kubenswrapper[2559]: I0612 22:20:58.245825 2559 flags.go:64] FLAG: --topology-manager-policy="none" Jun 12 22:20:58.255045 ip-10-0-128-134 kubenswrapper[2559]: I0612 22:20:58.245828 2559 flags.go:64] FLAG: --topology-manager-policy-options="" Jun 12 22:20:58.255045 ip-10-0-128-134 kubenswrapper[2559]: I0612 22:20:58.245830 2559 flags.go:64] FLAG: --topology-manager-scope="container" Jun 12 22:20:58.255045 ip-10-0-128-134 kubenswrapper[2559]: I0612 22:20:58.245833 2559 flags.go:64] FLAG: --v="2" Jun 12 22:20:58.255045 ip-10-0-128-134 kubenswrapper[2559]: I0612 22:20:58.245837 2559 flags.go:64] FLAG: --version="false" Jun 12 22:20:58.255045 ip-10-0-128-134 kubenswrapper[2559]: I0612 22:20:58.245841 2559 flags.go:64] FLAG: --vmodule="" Jun 12 22:20:58.256165 ip-10-0-128-134 kubenswrapper[2559]: I0612 22:20:58.245845 2559 flags.go:64] FLAG: --volume-plugin-dir="/etc/kubernetes/kubelet-plugins/volume/exec" Jun 12 22:20:58.256165 ip-10-0-128-134 kubenswrapper[2559]: I0612 22:20:58.245848 2559 flags.go:64] FLAG: --volume-stats-agg-period="1m0s" Jun 12 22:20:58.256165 ip-10-0-128-134 kubenswrapper[2559]: W0612 22:20:58.245956 2559 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jun 12 22:20:58.256165 ip-10-0-128-134 kubenswrapper[2559]: W0612 22:20:58.245960 2559 feature_gate.go:328] unrecognized feature gate: Example Jun 12 22:20:58.256165 ip-10-0-128-134 kubenswrapper[2559]: W0612 22:20:58.245963 2559 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jun 12 22:20:58.256165 ip-10-0-128-134 kubenswrapper[2559]: W0612 22:20:58.245966 2559 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jun 12 22:20:58.256165 ip-10-0-128-134 kubenswrapper[2559]: W0612 22:20:58.245968 2559 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jun 12 22:20:58.256165 ip-10-0-128-134 kubenswrapper[2559]: W0612 22:20:58.245971 2559 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jun 12 22:20:58.256165 ip-10-0-128-134 kubenswrapper[2559]: W0612 22:20:58.245973 2559 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jun 12 22:20:58.256165 ip-10-0-128-134 kubenswrapper[2559]: W0612 22:20:58.245976 2559 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jun 12 22:20:58.256165 ip-10-0-128-134 kubenswrapper[2559]: W0612 22:20:58.245978 2559 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jun 12 22:20:58.256165 ip-10-0-128-134 kubenswrapper[2559]: W0612 22:20:58.245981 2559 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jun 12 22:20:58.256165 ip-10-0-128-134 kubenswrapper[2559]: W0612 22:20:58.245984 2559 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jun 12 22:20:58.256165 ip-10-0-128-134 kubenswrapper[2559]: W0612 22:20:58.245986 2559 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jun 12 22:20:58.256165 ip-10-0-128-134 kubenswrapper[2559]: W0612 22:20:58.245989 2559 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jun 12 22:20:58.256165 ip-10-0-128-134 kubenswrapper[2559]: W0612 22:20:58.245991 2559 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jun 12 22:20:58.256165 ip-10-0-128-134 kubenswrapper[2559]: W0612 22:20:58.245994 2559 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jun 12 22:20:58.256165 ip-10-0-128-134 kubenswrapper[2559]: W0612 22:20:58.245997 2559 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jun 12 22:20:58.256165 ip-10-0-128-134 kubenswrapper[2559]: W0612 22:20:58.246000 2559 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jun 12 22:20:58.256165 ip-10-0-128-134 kubenswrapper[2559]: W0612 22:20:58.246003 2559 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jun 12 22:20:58.256939 ip-10-0-128-134 kubenswrapper[2559]: W0612 22:20:58.246006 2559 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jun 12 22:20:58.256939 ip-10-0-128-134 kubenswrapper[2559]: W0612 22:20:58.246009 2559 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jun 12 22:20:58.256939 ip-10-0-128-134 kubenswrapper[2559]: W0612 22:20:58.246013 2559 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jun 12 22:20:58.256939 ip-10-0-128-134 kubenswrapper[2559]: W0612 22:20:58.246015 2559 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jun 12 22:20:58.256939 ip-10-0-128-134 kubenswrapper[2559]: W0612 22:20:58.246018 2559 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jun 12 22:20:58.256939 ip-10-0-128-134 kubenswrapper[2559]: W0612 22:20:58.246020 2559 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jun 12 22:20:58.256939 ip-10-0-128-134 kubenswrapper[2559]: W0612 22:20:58.246023 2559 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jun 12 22:20:58.256939 ip-10-0-128-134 kubenswrapper[2559]: W0612 22:20:58.246025 2559 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jun 12 22:20:58.256939 ip-10-0-128-134 kubenswrapper[2559]: W0612 22:20:58.246028 2559 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jun 12 22:20:58.256939 ip-10-0-128-134 kubenswrapper[2559]: W0612 22:20:58.246030 2559 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jun 12 22:20:58.256939 ip-10-0-128-134 kubenswrapper[2559]: W0612 22:20:58.246032 2559 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jun 12 22:20:58.256939 ip-10-0-128-134 kubenswrapper[2559]: W0612 22:20:58.246035 2559 feature_gate.go:328] unrecognized feature gate: Example2 Jun 12 22:20:58.256939 ip-10-0-128-134 kubenswrapper[2559]: W0612 22:20:58.246037 2559 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jun 12 22:20:58.256939 ip-10-0-128-134 kubenswrapper[2559]: W0612 22:20:58.246040 2559 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jun 12 22:20:58.256939 ip-10-0-128-134 kubenswrapper[2559]: W0612 22:20:58.246043 2559 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jun 12 22:20:58.256939 ip-10-0-128-134 kubenswrapper[2559]: W0612 22:20:58.246045 2559 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jun 12 22:20:58.256939 ip-10-0-128-134 kubenswrapper[2559]: W0612 22:20:58.246047 2559 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jun 12 22:20:58.256939 ip-10-0-128-134 kubenswrapper[2559]: W0612 22:20:58.246050 2559 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jun 12 22:20:58.256939 ip-10-0-128-134 kubenswrapper[2559]: W0612 22:20:58.246052 2559 feature_gate.go:328] unrecognized feature gate: PinnedImages Jun 12 22:20:58.256939 ip-10-0-128-134 kubenswrapper[2559]: W0612 22:20:58.246054 2559 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jun 12 22:20:58.257796 ip-10-0-128-134 kubenswrapper[2559]: W0612 22:20:58.246057 2559 feature_gate.go:328] unrecognized feature gate: SignatureStores Jun 12 22:20:58.257796 ip-10-0-128-134 kubenswrapper[2559]: W0612 22:20:58.246059 2559 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jun 12 22:20:58.257796 ip-10-0-128-134 kubenswrapper[2559]: W0612 22:20:58.246062 2559 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jun 12 22:20:58.257796 ip-10-0-128-134 kubenswrapper[2559]: W0612 22:20:58.246064 2559 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jun 12 22:20:58.257796 ip-10-0-128-134 kubenswrapper[2559]: W0612 22:20:58.246067 2559 feature_gate.go:328] unrecognized feature gate: NewOLM Jun 12 22:20:58.257796 ip-10-0-128-134 kubenswrapper[2559]: W0612 22:20:58.246069 2559 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jun 12 22:20:58.257796 ip-10-0-128-134 kubenswrapper[2559]: W0612 22:20:58.246071 2559 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jun 12 22:20:58.257796 ip-10-0-128-134 kubenswrapper[2559]: W0612 22:20:58.246073 2559 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jun 12 22:20:58.257796 ip-10-0-128-134 kubenswrapper[2559]: W0612 22:20:58.246076 2559 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jun 12 22:20:58.257796 ip-10-0-128-134 kubenswrapper[2559]: W0612 22:20:58.246078 2559 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jun 12 22:20:58.257796 ip-10-0-128-134 kubenswrapper[2559]: W0612 22:20:58.246080 2559 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jun 12 22:20:58.257796 ip-10-0-128-134 kubenswrapper[2559]: W0612 22:20:58.246083 2559 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jun 12 22:20:58.257796 ip-10-0-128-134 kubenswrapper[2559]: W0612 22:20:58.246085 2559 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jun 12 22:20:58.257796 ip-10-0-128-134 kubenswrapper[2559]: W0612 22:20:58.246088 2559 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jun 12 22:20:58.257796 ip-10-0-128-134 kubenswrapper[2559]: W0612 22:20:58.246090 2559 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jun 12 22:20:58.257796 ip-10-0-128-134 kubenswrapper[2559]: W0612 22:20:58.246093 2559 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jun 12 22:20:58.257796 ip-10-0-128-134 kubenswrapper[2559]: W0612 22:20:58.246095 2559 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jun 12 22:20:58.257796 ip-10-0-128-134 kubenswrapper[2559]: W0612 22:20:58.246098 2559 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jun 12 22:20:58.257796 ip-10-0-128-134 kubenswrapper[2559]: W0612 22:20:58.246100 2559 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jun 12 22:20:58.257796 ip-10-0-128-134 kubenswrapper[2559]: W0612 22:20:58.246102 2559 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jun 12 22:20:58.258577 ip-10-0-128-134 kubenswrapper[2559]: W0612 22:20:58.246105 2559 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jun 12 22:20:58.258577 ip-10-0-128-134 kubenswrapper[2559]: W0612 22:20:58.246109 2559 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jun 12 22:20:58.258577 ip-10-0-128-134 kubenswrapper[2559]: W0612 22:20:58.246112 2559 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jun 12 22:20:58.258577 ip-10-0-128-134 kubenswrapper[2559]: W0612 22:20:58.246115 2559 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jun 12 22:20:58.258577 ip-10-0-128-134 kubenswrapper[2559]: W0612 22:20:58.246119 2559 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jun 12 22:20:58.258577 ip-10-0-128-134 kubenswrapper[2559]: W0612 22:20:58.246122 2559 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jun 12 22:20:58.258577 ip-10-0-128-134 kubenswrapper[2559]: W0612 22:20:58.246125 2559 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jun 12 22:20:58.258577 ip-10-0-128-134 kubenswrapper[2559]: W0612 22:20:58.246128 2559 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jun 12 22:20:58.258577 ip-10-0-128-134 kubenswrapper[2559]: W0612 22:20:58.246131 2559 feature_gate.go:328] unrecognized feature gate: OSStreams Jun 12 22:20:58.258577 ip-10-0-128-134 kubenswrapper[2559]: W0612 22:20:58.246133 2559 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jun 12 22:20:58.258577 ip-10-0-128-134 kubenswrapper[2559]: W0612 22:20:58.246136 2559 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jun 12 22:20:58.258577 ip-10-0-128-134 kubenswrapper[2559]: W0612 22:20:58.246138 2559 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jun 12 22:20:58.258577 ip-10-0-128-134 kubenswrapper[2559]: W0612 22:20:58.246141 2559 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jun 12 22:20:58.258577 ip-10-0-128-134 kubenswrapper[2559]: W0612 22:20:58.246143 2559 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jun 12 22:20:58.258577 ip-10-0-128-134 kubenswrapper[2559]: W0612 22:20:58.246146 2559 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jun 12 22:20:58.258577 ip-10-0-128-134 kubenswrapper[2559]: W0612 22:20:58.246148 2559 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jun 12 22:20:58.258577 ip-10-0-128-134 kubenswrapper[2559]: W0612 22:20:58.246150 2559 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jun 12 22:20:58.258577 ip-10-0-128-134 kubenswrapper[2559]: W0612 22:20:58.246153 2559 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jun 12 22:20:58.259142 ip-10-0-128-134 kubenswrapper[2559]: W0612 22:20:58.246155 2559 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jun 12 22:20:58.259142 ip-10-0-128-134 kubenswrapper[2559]: W0612 22:20:58.246158 2559 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jun 12 22:20:58.259142 ip-10-0-128-134 kubenswrapper[2559]: W0612 22:20:58.246160 2559 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jun 12 22:20:58.259142 ip-10-0-128-134 kubenswrapper[2559]: W0612 22:20:58.246162 2559 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jun 12 22:20:58.259142 ip-10-0-128-134 kubenswrapper[2559]: W0612 22:20:58.246165 2559 feature_gate.go:328] unrecognized feature gate: EventTTL Jun 12 22:20:58.259142 ip-10-0-128-134 kubenswrapper[2559]: W0612 22:20:58.246167 2559 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jun 12 22:20:58.259142 ip-10-0-128-134 kubenswrapper[2559]: W0612 22:20:58.246170 2559 feature_gate.go:328] unrecognized feature gate: OVNObservability Jun 12 22:20:58.259142 ip-10-0-128-134 kubenswrapper[2559]: W0612 22:20:58.246172 2559 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jun 12 22:20:58.259142 ip-10-0-128-134 kubenswrapper[2559]: W0612 22:20:58.246175 2559 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jun 12 22:20:58.259142 ip-10-0-128-134 kubenswrapper[2559]: W0612 22:20:58.246177 2559 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jun 12 22:20:58.259142 ip-10-0-128-134 kubenswrapper[2559]: W0612 22:20:58.246179 2559 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jun 12 22:20:58.259142 ip-10-0-128-134 kubenswrapper[2559]: W0612 22:20:58.246182 2559 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jun 12 22:20:58.259142 ip-10-0-128-134 kubenswrapper[2559]: W0612 22:20:58.246184 2559 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jun 12 22:20:58.259142 ip-10-0-128-134 kubenswrapper[2559]: W0612 22:20:58.246186 2559 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jun 12 22:20:58.259142 ip-10-0-128-134 kubenswrapper[2559]: W0612 22:20:58.246189 2559 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jun 12 22:20:58.259142 ip-10-0-128-134 kubenswrapper[2559]: W0612 22:20:58.246191 2559 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jun 12 22:20:58.259142 ip-10-0-128-134 kubenswrapper[2559]: W0612 22:20:58.246194 2559 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jun 12 22:20:58.259142 ip-10-0-128-134 kubenswrapper[2559]: W0612 22:20:58.246197 2559 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jun 12 22:20:58.259142 ip-10-0-128-134 kubenswrapper[2559]: W0612 22:20:58.246199 2559 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jun 12 22:20:58.259142 ip-10-0-128-134 kubenswrapper[2559]: W0612 22:20:58.246202 2559 feature_gate.go:328] unrecognized feature gate: DualReplica Jun 12 22:20:58.259734 ip-10-0-128-134 kubenswrapper[2559]: W0612 22:20:58.246205 2559 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jun 12 22:20:58.259734 ip-10-0-128-134 kubenswrapper[2559]: W0612 22:20:58.246207 2559 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jun 12 22:20:58.259734 ip-10-0-128-134 kubenswrapper[2559]: W0612 22:20:58.246210 2559 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jun 12 22:20:58.259734 ip-10-0-128-134 kubenswrapper[2559]: I0612 22:20:58.247053 2559 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]} Jun 12 22:20:58.259734 ip-10-0-128-134 kubenswrapper[2559]: I0612 22:20:58.254861 2559 server.go:529] "Kubelet version" kubeletVersion="v1.34.8" Jun 12 22:20:58.259734 ip-10-0-128-134 kubenswrapper[2559]: I0612 22:20:58.254879 2559 server.go:531] "Golang settings" GOGC="" GOMAXPROCS="" GOTRACEBACK="" Jun 12 22:20:58.259734 ip-10-0-128-134 kubenswrapper[2559]: I0612 22:20:58.254904 2559 watchdog_linux.go:95] "Systemd watchdog is not enabled" Jun 12 22:20:58.259734 ip-10-0-128-134 kubenswrapper[2559]: I0612 22:20:58.254913 2559 watchdog_linux.go:137] "Systemd watchdog is not enabled or the interval is invalid, so health checking will not be started." Jun 12 22:20:58.259734 ip-10-0-128-134 kubenswrapper[2559]: W0612 22:20:58.255006 2559 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jun 12 22:20:58.259734 ip-10-0-128-134 kubenswrapper[2559]: W0612 22:20:58.255014 2559 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jun 12 22:20:58.259734 ip-10-0-128-134 kubenswrapper[2559]: W0612 22:20:58.255019 2559 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jun 12 22:20:58.259734 ip-10-0-128-134 kubenswrapper[2559]: W0612 22:20:58.255023 2559 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jun 12 22:20:58.259734 ip-10-0-128-134 kubenswrapper[2559]: W0612 22:20:58.255029 2559 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jun 12 22:20:58.259734 ip-10-0-128-134 kubenswrapper[2559]: W0612 22:20:58.255034 2559 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jun 12 22:20:58.259734 ip-10-0-128-134 kubenswrapper[2559]: W0612 22:20:58.255038 2559 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jun 12 22:20:58.260109 ip-10-0-128-134 kubenswrapper[2559]: W0612 22:20:58.255043 2559 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jun 12 22:20:58.260109 ip-10-0-128-134 kubenswrapper[2559]: W0612 22:20:58.255047 2559 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jun 12 22:20:58.260109 ip-10-0-128-134 kubenswrapper[2559]: W0612 22:20:58.255051 2559 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jun 12 22:20:58.260109 ip-10-0-128-134 kubenswrapper[2559]: W0612 22:20:58.255055 2559 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jun 12 22:20:58.260109 ip-10-0-128-134 kubenswrapper[2559]: W0612 22:20:58.255060 2559 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jun 12 22:20:58.260109 ip-10-0-128-134 kubenswrapper[2559]: W0612 22:20:58.255063 2559 feature_gate.go:328] unrecognized feature gate: Example Jun 12 22:20:58.260109 ip-10-0-128-134 kubenswrapper[2559]: W0612 22:20:58.255067 2559 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jun 12 22:20:58.260109 ip-10-0-128-134 kubenswrapper[2559]: W0612 22:20:58.255071 2559 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jun 12 22:20:58.260109 ip-10-0-128-134 kubenswrapper[2559]: W0612 22:20:58.255075 2559 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jun 12 22:20:58.260109 ip-10-0-128-134 kubenswrapper[2559]: W0612 22:20:58.255079 2559 feature_gate.go:328] unrecognized feature gate: SignatureStores Jun 12 22:20:58.260109 ip-10-0-128-134 kubenswrapper[2559]: W0612 22:20:58.255083 2559 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jun 12 22:20:58.260109 ip-10-0-128-134 kubenswrapper[2559]: W0612 22:20:58.255087 2559 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jun 12 22:20:58.260109 ip-10-0-128-134 kubenswrapper[2559]: W0612 22:20:58.255093 2559 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jun 12 22:20:58.260109 ip-10-0-128-134 kubenswrapper[2559]: W0612 22:20:58.255100 2559 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jun 12 22:20:58.260109 ip-10-0-128-134 kubenswrapper[2559]: W0612 22:20:58.255104 2559 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jun 12 22:20:58.260109 ip-10-0-128-134 kubenswrapper[2559]: W0612 22:20:58.255109 2559 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jun 12 22:20:58.260109 ip-10-0-128-134 kubenswrapper[2559]: W0612 22:20:58.255113 2559 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jun 12 22:20:58.260109 ip-10-0-128-134 kubenswrapper[2559]: W0612 22:20:58.255119 2559 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jun 12 22:20:58.260109 ip-10-0-128-134 kubenswrapper[2559]: W0612 22:20:58.255123 2559 feature_gate.go:328] unrecognized feature gate: OSStreams Jun 12 22:20:58.260109 ip-10-0-128-134 kubenswrapper[2559]: W0612 22:20:58.255127 2559 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jun 12 22:20:58.260680 ip-10-0-128-134 kubenswrapper[2559]: W0612 22:20:58.255131 2559 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jun 12 22:20:58.260680 ip-10-0-128-134 kubenswrapper[2559]: W0612 22:20:58.255136 2559 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jun 12 22:20:58.260680 ip-10-0-128-134 kubenswrapper[2559]: W0612 22:20:58.255142 2559 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jun 12 22:20:58.260680 ip-10-0-128-134 kubenswrapper[2559]: W0612 22:20:58.255146 2559 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jun 12 22:20:58.260680 ip-10-0-128-134 kubenswrapper[2559]: W0612 22:20:58.255150 2559 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jun 12 22:20:58.260680 ip-10-0-128-134 kubenswrapper[2559]: W0612 22:20:58.255154 2559 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jun 12 22:20:58.260680 ip-10-0-128-134 kubenswrapper[2559]: W0612 22:20:58.255158 2559 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jun 12 22:20:58.260680 ip-10-0-128-134 kubenswrapper[2559]: W0612 22:20:58.255162 2559 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jun 12 22:20:58.260680 ip-10-0-128-134 kubenswrapper[2559]: W0612 22:20:58.255166 2559 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jun 12 22:20:58.260680 ip-10-0-128-134 kubenswrapper[2559]: W0612 22:20:58.255171 2559 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jun 12 22:20:58.260680 ip-10-0-128-134 kubenswrapper[2559]: W0612 22:20:58.255176 2559 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jun 12 22:20:58.260680 ip-10-0-128-134 kubenswrapper[2559]: W0612 22:20:58.255181 2559 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jun 12 22:20:58.260680 ip-10-0-128-134 kubenswrapper[2559]: W0612 22:20:58.255186 2559 feature_gate.go:328] unrecognized feature gate: Example2 Jun 12 22:20:58.260680 ip-10-0-128-134 kubenswrapper[2559]: W0612 22:20:58.255190 2559 feature_gate.go:328] unrecognized feature gate: OVNObservability Jun 12 22:20:58.260680 ip-10-0-128-134 kubenswrapper[2559]: W0612 22:20:58.255194 2559 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jun 12 22:20:58.260680 ip-10-0-128-134 kubenswrapper[2559]: W0612 22:20:58.255198 2559 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jun 12 22:20:58.260680 ip-10-0-128-134 kubenswrapper[2559]: W0612 22:20:58.255202 2559 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jun 12 22:20:58.260680 ip-10-0-128-134 kubenswrapper[2559]: W0612 22:20:58.255206 2559 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jun 12 22:20:58.260680 ip-10-0-128-134 kubenswrapper[2559]: W0612 22:20:58.255210 2559 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jun 12 22:20:58.261178 ip-10-0-128-134 kubenswrapper[2559]: W0612 22:20:58.255214 2559 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jun 12 22:20:58.261178 ip-10-0-128-134 kubenswrapper[2559]: W0612 22:20:58.255218 2559 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jun 12 22:20:58.261178 ip-10-0-128-134 kubenswrapper[2559]: W0612 22:20:58.255222 2559 feature_gate.go:328] unrecognized feature gate: DualReplica Jun 12 22:20:58.261178 ip-10-0-128-134 kubenswrapper[2559]: W0612 22:20:58.255227 2559 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jun 12 22:20:58.261178 ip-10-0-128-134 kubenswrapper[2559]: W0612 22:20:58.255231 2559 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jun 12 22:20:58.261178 ip-10-0-128-134 kubenswrapper[2559]: W0612 22:20:58.255235 2559 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jun 12 22:20:58.261178 ip-10-0-128-134 kubenswrapper[2559]: W0612 22:20:58.255239 2559 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jun 12 22:20:58.261178 ip-10-0-128-134 kubenswrapper[2559]: W0612 22:20:58.255243 2559 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jun 12 22:20:58.261178 ip-10-0-128-134 kubenswrapper[2559]: W0612 22:20:58.255247 2559 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jun 12 22:20:58.261178 ip-10-0-128-134 kubenswrapper[2559]: W0612 22:20:58.255251 2559 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jun 12 22:20:58.261178 ip-10-0-128-134 kubenswrapper[2559]: W0612 22:20:58.255255 2559 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jun 12 22:20:58.261178 ip-10-0-128-134 kubenswrapper[2559]: W0612 22:20:58.255260 2559 feature_gate.go:328] unrecognized feature gate: PinnedImages Jun 12 22:20:58.261178 ip-10-0-128-134 kubenswrapper[2559]: W0612 22:20:58.255264 2559 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jun 12 22:20:58.261178 ip-10-0-128-134 kubenswrapper[2559]: W0612 22:20:58.255268 2559 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jun 12 22:20:58.261178 ip-10-0-128-134 kubenswrapper[2559]: W0612 22:20:58.255272 2559 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jun 12 22:20:58.261178 ip-10-0-128-134 kubenswrapper[2559]: W0612 22:20:58.255277 2559 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jun 12 22:20:58.261178 ip-10-0-128-134 kubenswrapper[2559]: W0612 22:20:58.255281 2559 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jun 12 22:20:58.261178 ip-10-0-128-134 kubenswrapper[2559]: W0612 22:20:58.255285 2559 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jun 12 22:20:58.261178 ip-10-0-128-134 kubenswrapper[2559]: W0612 22:20:58.255289 2559 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jun 12 22:20:58.261785 ip-10-0-128-134 kubenswrapper[2559]: W0612 22:20:58.255296 2559 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jun 12 22:20:58.261785 ip-10-0-128-134 kubenswrapper[2559]: W0612 22:20:58.255301 2559 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jun 12 22:20:58.261785 ip-10-0-128-134 kubenswrapper[2559]: W0612 22:20:58.255306 2559 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jun 12 22:20:58.261785 ip-10-0-128-134 kubenswrapper[2559]: W0612 22:20:58.255311 2559 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jun 12 22:20:58.261785 ip-10-0-128-134 kubenswrapper[2559]: W0612 22:20:58.255316 2559 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jun 12 22:20:58.261785 ip-10-0-128-134 kubenswrapper[2559]: W0612 22:20:58.255320 2559 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jun 12 22:20:58.261785 ip-10-0-128-134 kubenswrapper[2559]: W0612 22:20:58.255325 2559 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jun 12 22:20:58.261785 ip-10-0-128-134 kubenswrapper[2559]: W0612 22:20:58.255329 2559 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jun 12 22:20:58.261785 ip-10-0-128-134 kubenswrapper[2559]: W0612 22:20:58.255333 2559 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jun 12 22:20:58.261785 ip-10-0-128-134 kubenswrapper[2559]: W0612 22:20:58.255337 2559 feature_gate.go:328] unrecognized feature gate: EventTTL Jun 12 22:20:58.261785 ip-10-0-128-134 kubenswrapper[2559]: W0612 22:20:58.255342 2559 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jun 12 22:20:58.261785 ip-10-0-128-134 kubenswrapper[2559]: W0612 22:20:58.255346 2559 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jun 12 22:20:58.261785 ip-10-0-128-134 kubenswrapper[2559]: W0612 22:20:58.255350 2559 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jun 12 22:20:58.261785 ip-10-0-128-134 kubenswrapper[2559]: W0612 22:20:58.255354 2559 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jun 12 22:20:58.261785 ip-10-0-128-134 kubenswrapper[2559]: W0612 22:20:58.255358 2559 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jun 12 22:20:58.261785 ip-10-0-128-134 kubenswrapper[2559]: W0612 22:20:58.255362 2559 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jun 12 22:20:58.261785 ip-10-0-128-134 kubenswrapper[2559]: W0612 22:20:58.255367 2559 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jun 12 22:20:58.261785 ip-10-0-128-134 kubenswrapper[2559]: W0612 22:20:58.255370 2559 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jun 12 22:20:58.261785 ip-10-0-128-134 kubenswrapper[2559]: W0612 22:20:58.255374 2559 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jun 12 22:20:58.262252 ip-10-0-128-134 kubenswrapper[2559]: W0612 22:20:58.255378 2559 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jun 12 22:20:58.262252 ip-10-0-128-134 kubenswrapper[2559]: W0612 22:20:58.255385 2559 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jun 12 22:20:58.262252 ip-10-0-128-134 kubenswrapper[2559]: W0612 22:20:58.255390 2559 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jun 12 22:20:58.262252 ip-10-0-128-134 kubenswrapper[2559]: W0612 22:20:58.255396 2559 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jun 12 22:20:58.262252 ip-10-0-128-134 kubenswrapper[2559]: W0612 22:20:58.255400 2559 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jun 12 22:20:58.262252 ip-10-0-128-134 kubenswrapper[2559]: W0612 22:20:58.255405 2559 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jun 12 22:20:58.262252 ip-10-0-128-134 kubenswrapper[2559]: W0612 22:20:58.255411 2559 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jun 12 22:20:58.262252 ip-10-0-128-134 kubenswrapper[2559]: W0612 22:20:58.255415 2559 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jun 12 22:20:58.262252 ip-10-0-128-134 kubenswrapper[2559]: W0612 22:20:58.255419 2559 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jun 12 22:20:58.262252 ip-10-0-128-134 kubenswrapper[2559]: W0612 22:20:58.255424 2559 feature_gate.go:328] unrecognized feature gate: NewOLM Jun 12 22:20:58.262252 ip-10-0-128-134 kubenswrapper[2559]: W0612 22:20:58.255429 2559 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jun 12 22:20:58.262252 ip-10-0-128-134 kubenswrapper[2559]: W0612 22:20:58.255433 2559 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jun 12 22:20:58.262252 ip-10-0-128-134 kubenswrapper[2559]: W0612 22:20:58.255438 2559 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jun 12 22:20:58.262252 ip-10-0-128-134 kubenswrapper[2559]: W0612 22:20:58.255462 2559 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jun 12 22:20:58.262252 ip-10-0-128-134 kubenswrapper[2559]: W0612 22:20:58.255467 2559 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jun 12 22:20:58.262713 ip-10-0-128-134 kubenswrapper[2559]: I0612 22:20:58.255475 2559 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]} Jun 12 22:20:58.262713 ip-10-0-128-134 kubenswrapper[2559]: W0612 22:20:58.255690 2559 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jun 12 22:20:58.262713 ip-10-0-128-134 kubenswrapper[2559]: W0612 22:20:58.255698 2559 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jun 12 22:20:58.262713 ip-10-0-128-134 kubenswrapper[2559]: W0612 22:20:58.255703 2559 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jun 12 22:20:58.262713 ip-10-0-128-134 kubenswrapper[2559]: W0612 22:20:58.255708 2559 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jun 12 22:20:58.262713 ip-10-0-128-134 kubenswrapper[2559]: W0612 22:20:58.255713 2559 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jun 12 22:20:58.262713 ip-10-0-128-134 kubenswrapper[2559]: W0612 22:20:58.255717 2559 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jun 12 22:20:58.262713 ip-10-0-128-134 kubenswrapper[2559]: W0612 22:20:58.255721 2559 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jun 12 22:20:58.262713 ip-10-0-128-134 kubenswrapper[2559]: W0612 22:20:58.255726 2559 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jun 12 22:20:58.262713 ip-10-0-128-134 kubenswrapper[2559]: W0612 22:20:58.255730 2559 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jun 12 22:20:58.262713 ip-10-0-128-134 kubenswrapper[2559]: W0612 22:20:58.255734 2559 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jun 12 22:20:58.262713 ip-10-0-128-134 kubenswrapper[2559]: W0612 22:20:58.255738 2559 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jun 12 22:20:58.262713 ip-10-0-128-134 kubenswrapper[2559]: W0612 22:20:58.255742 2559 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jun 12 22:20:58.262713 ip-10-0-128-134 kubenswrapper[2559]: W0612 22:20:58.255746 2559 feature_gate.go:328] unrecognized feature gate: OVNObservability Jun 12 22:20:58.262713 ip-10-0-128-134 kubenswrapper[2559]: W0612 22:20:58.255751 2559 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jun 12 22:20:58.263264 ip-10-0-128-134 kubenswrapper[2559]: W0612 22:20:58.255754 2559 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jun 12 22:20:58.263264 ip-10-0-128-134 kubenswrapper[2559]: W0612 22:20:58.255759 2559 feature_gate.go:328] unrecognized feature gate: OSStreams Jun 12 22:20:58.263264 ip-10-0-128-134 kubenswrapper[2559]: W0612 22:20:58.255763 2559 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jun 12 22:20:58.263264 ip-10-0-128-134 kubenswrapper[2559]: W0612 22:20:58.255767 2559 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jun 12 22:20:58.263264 ip-10-0-128-134 kubenswrapper[2559]: W0612 22:20:58.255771 2559 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jun 12 22:20:58.263264 ip-10-0-128-134 kubenswrapper[2559]: W0612 22:20:58.255776 2559 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jun 12 22:20:58.263264 ip-10-0-128-134 kubenswrapper[2559]: W0612 22:20:58.255780 2559 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jun 12 22:20:58.263264 ip-10-0-128-134 kubenswrapper[2559]: W0612 22:20:58.255784 2559 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jun 12 22:20:58.263264 ip-10-0-128-134 kubenswrapper[2559]: W0612 22:20:58.255788 2559 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jun 12 22:20:58.263264 ip-10-0-128-134 kubenswrapper[2559]: W0612 22:20:58.255793 2559 feature_gate.go:328] unrecognized feature gate: PinnedImages Jun 12 22:20:58.263264 ip-10-0-128-134 kubenswrapper[2559]: W0612 22:20:58.255798 2559 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jun 12 22:20:58.263264 ip-10-0-128-134 kubenswrapper[2559]: W0612 22:20:58.255802 2559 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jun 12 22:20:58.263264 ip-10-0-128-134 kubenswrapper[2559]: W0612 22:20:58.255806 2559 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jun 12 22:20:58.263264 ip-10-0-128-134 kubenswrapper[2559]: W0612 22:20:58.255810 2559 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jun 12 22:20:58.263264 ip-10-0-128-134 kubenswrapper[2559]: W0612 22:20:58.255815 2559 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jun 12 22:20:58.263264 ip-10-0-128-134 kubenswrapper[2559]: W0612 22:20:58.255819 2559 feature_gate.go:328] unrecognized feature gate: DualReplica Jun 12 22:20:58.263264 ip-10-0-128-134 kubenswrapper[2559]: W0612 22:20:58.255824 2559 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jun 12 22:20:58.263264 ip-10-0-128-134 kubenswrapper[2559]: W0612 22:20:58.255832 2559 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jun 12 22:20:58.263264 ip-10-0-128-134 kubenswrapper[2559]: W0612 22:20:58.255836 2559 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jun 12 22:20:58.263264 ip-10-0-128-134 kubenswrapper[2559]: W0612 22:20:58.255841 2559 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jun 12 22:20:58.264103 ip-10-0-128-134 kubenswrapper[2559]: W0612 22:20:58.255845 2559 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jun 12 22:20:58.264103 ip-10-0-128-134 kubenswrapper[2559]: W0612 22:20:58.255849 2559 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jun 12 22:20:58.264103 ip-10-0-128-134 kubenswrapper[2559]: W0612 22:20:58.255853 2559 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jun 12 22:20:58.264103 ip-10-0-128-134 kubenswrapper[2559]: W0612 22:20:58.255857 2559 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jun 12 22:20:58.264103 ip-10-0-128-134 kubenswrapper[2559]: W0612 22:20:58.255861 2559 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jun 12 22:20:58.264103 ip-10-0-128-134 kubenswrapper[2559]: W0612 22:20:58.255865 2559 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jun 12 22:20:58.264103 ip-10-0-128-134 kubenswrapper[2559]: W0612 22:20:58.255870 2559 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jun 12 22:20:58.264103 ip-10-0-128-134 kubenswrapper[2559]: W0612 22:20:58.255874 2559 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jun 12 22:20:58.264103 ip-10-0-128-134 kubenswrapper[2559]: W0612 22:20:58.255878 2559 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jun 12 22:20:58.264103 ip-10-0-128-134 kubenswrapper[2559]: W0612 22:20:58.255882 2559 feature_gate.go:328] unrecognized feature gate: SignatureStores Jun 12 22:20:58.264103 ip-10-0-128-134 kubenswrapper[2559]: W0612 22:20:58.255886 2559 feature_gate.go:328] unrecognized feature gate: NewOLM Jun 12 22:20:58.264103 ip-10-0-128-134 kubenswrapper[2559]: W0612 22:20:58.255891 2559 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jun 12 22:20:58.264103 ip-10-0-128-134 kubenswrapper[2559]: W0612 22:20:58.255895 2559 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jun 12 22:20:58.264103 ip-10-0-128-134 kubenswrapper[2559]: W0612 22:20:58.255899 2559 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jun 12 22:20:58.264103 ip-10-0-128-134 kubenswrapper[2559]: W0612 22:20:58.255903 2559 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jun 12 22:20:58.264103 ip-10-0-128-134 kubenswrapper[2559]: W0612 22:20:58.255909 2559 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jun 12 22:20:58.264103 ip-10-0-128-134 kubenswrapper[2559]: W0612 22:20:58.255914 2559 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jun 12 22:20:58.264103 ip-10-0-128-134 kubenswrapper[2559]: W0612 22:20:58.255918 2559 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jun 12 22:20:58.264103 ip-10-0-128-134 kubenswrapper[2559]: W0612 22:20:58.255923 2559 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jun 12 22:20:58.264103 ip-10-0-128-134 kubenswrapper[2559]: W0612 22:20:58.255927 2559 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jun 12 22:20:58.264966 ip-10-0-128-134 kubenswrapper[2559]: W0612 22:20:58.255931 2559 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jun 12 22:20:58.264966 ip-10-0-128-134 kubenswrapper[2559]: W0612 22:20:58.255935 2559 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jun 12 22:20:58.264966 ip-10-0-128-134 kubenswrapper[2559]: W0612 22:20:58.255940 2559 feature_gate.go:328] unrecognized feature gate: Example2 Jun 12 22:20:58.264966 ip-10-0-128-134 kubenswrapper[2559]: W0612 22:20:58.255945 2559 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jun 12 22:20:58.264966 ip-10-0-128-134 kubenswrapper[2559]: W0612 22:20:58.255949 2559 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jun 12 22:20:58.264966 ip-10-0-128-134 kubenswrapper[2559]: W0612 22:20:58.255953 2559 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jun 12 22:20:58.264966 ip-10-0-128-134 kubenswrapper[2559]: W0612 22:20:58.255957 2559 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jun 12 22:20:58.264966 ip-10-0-128-134 kubenswrapper[2559]: W0612 22:20:58.255961 2559 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jun 12 22:20:58.264966 ip-10-0-128-134 kubenswrapper[2559]: W0612 22:20:58.255965 2559 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jun 12 22:20:58.264966 ip-10-0-128-134 kubenswrapper[2559]: W0612 22:20:58.255970 2559 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jun 12 22:20:58.264966 ip-10-0-128-134 kubenswrapper[2559]: W0612 22:20:58.255974 2559 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jun 12 22:20:58.264966 ip-10-0-128-134 kubenswrapper[2559]: W0612 22:20:58.255978 2559 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jun 12 22:20:58.264966 ip-10-0-128-134 kubenswrapper[2559]: W0612 22:20:58.255983 2559 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jun 12 22:20:58.264966 ip-10-0-128-134 kubenswrapper[2559]: W0612 22:20:58.255987 2559 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jun 12 22:20:58.264966 ip-10-0-128-134 kubenswrapper[2559]: W0612 22:20:58.255991 2559 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jun 12 22:20:58.264966 ip-10-0-128-134 kubenswrapper[2559]: W0612 22:20:58.255995 2559 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jun 12 22:20:58.264966 ip-10-0-128-134 kubenswrapper[2559]: W0612 22:20:58.255999 2559 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jun 12 22:20:58.264966 ip-10-0-128-134 kubenswrapper[2559]: W0612 22:20:58.256004 2559 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jun 12 22:20:58.264966 ip-10-0-128-134 kubenswrapper[2559]: W0612 22:20:58.256008 2559 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jun 12 22:20:58.264966 ip-10-0-128-134 kubenswrapper[2559]: W0612 22:20:58.256012 2559 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jun 12 22:20:58.265842 ip-10-0-128-134 kubenswrapper[2559]: W0612 22:20:58.256016 2559 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jun 12 22:20:58.265842 ip-10-0-128-134 kubenswrapper[2559]: W0612 22:20:58.256020 2559 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jun 12 22:20:58.265842 ip-10-0-128-134 kubenswrapper[2559]: W0612 22:20:58.256024 2559 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jun 12 22:20:58.265842 ip-10-0-128-134 kubenswrapper[2559]: W0612 22:20:58.256028 2559 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jun 12 22:20:58.265842 ip-10-0-128-134 kubenswrapper[2559]: W0612 22:20:58.256032 2559 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jun 12 22:20:58.265842 ip-10-0-128-134 kubenswrapper[2559]: W0612 22:20:58.256036 2559 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jun 12 22:20:58.265842 ip-10-0-128-134 kubenswrapper[2559]: W0612 22:20:58.256041 2559 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jun 12 22:20:58.265842 ip-10-0-128-134 kubenswrapper[2559]: W0612 22:20:58.256047 2559 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jun 12 22:20:58.265842 ip-10-0-128-134 kubenswrapper[2559]: W0612 22:20:58.256052 2559 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jun 12 22:20:58.265842 ip-10-0-128-134 kubenswrapper[2559]: W0612 22:20:58.256057 2559 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jun 12 22:20:58.265842 ip-10-0-128-134 kubenswrapper[2559]: W0612 22:20:58.256062 2559 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jun 12 22:20:58.265842 ip-10-0-128-134 kubenswrapper[2559]: W0612 22:20:58.256067 2559 feature_gate.go:328] unrecognized feature gate: Example Jun 12 22:20:58.265842 ip-10-0-128-134 kubenswrapper[2559]: W0612 22:20:58.256072 2559 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jun 12 22:20:58.265842 ip-10-0-128-134 kubenswrapper[2559]: W0612 22:20:58.256076 2559 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jun 12 22:20:58.265842 ip-10-0-128-134 kubenswrapper[2559]: W0612 22:20:58.256080 2559 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jun 12 22:20:58.265842 ip-10-0-128-134 kubenswrapper[2559]: W0612 22:20:58.256086 2559 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jun 12 22:20:58.265842 ip-10-0-128-134 kubenswrapper[2559]: W0612 22:20:58.256094 2559 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jun 12 22:20:58.265842 ip-10-0-128-134 kubenswrapper[2559]: W0612 22:20:58.256098 2559 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jun 12 22:20:58.265842 ip-10-0-128-134 kubenswrapper[2559]: W0612 22:20:58.256102 2559 feature_gate.go:328] unrecognized feature gate: EventTTL Jun 12 22:20:58.266351 ip-10-0-128-134 kubenswrapper[2559]: W0612 22:20:58.256107 2559 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jun 12 22:20:58.266351 ip-10-0-128-134 kubenswrapper[2559]: W0612 22:20:58.256112 2559 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jun 12 22:20:58.266351 ip-10-0-128-134 kubenswrapper[2559]: W0612 22:20:58.256116 2559 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jun 12 22:20:58.266351 ip-10-0-128-134 kubenswrapper[2559]: W0612 22:20:58.256121 2559 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jun 12 22:20:58.266351 ip-10-0-128-134 kubenswrapper[2559]: W0612 22:20:58.256125 2559 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jun 12 22:20:58.266351 ip-10-0-128-134 kubenswrapper[2559]: W0612 22:20:58.256129 2559 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jun 12 22:20:58.266351 ip-10-0-128-134 kubenswrapper[2559]: I0612 22:20:58.256137 2559 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]} Jun 12 22:20:58.266351 ip-10-0-128-134 kubenswrapper[2559]: I0612 22:20:58.256296 2559 server.go:962] "Client rotation is on, will bootstrap in background" Jun 12 22:20:58.266351 ip-10-0-128-134 kubenswrapper[2559]: I0612 22:20:58.259048 2559 bootstrap.go:101] "Use the bootstrap credentials to request a cert, and set kubeconfig to point to the certificate dir" Jun 12 22:20:58.266351 ip-10-0-128-134 kubenswrapper[2559]: I0612 22:20:58.260664 2559 server.go:1019] "Starting client certificate rotation" Jun 12 22:20:58.266351 ip-10-0-128-134 kubenswrapper[2559]: I0612 22:20:58.260787 2559 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kube-apiserver-client-kubelet" Jun 12 22:20:58.266351 ip-10-0-128-134 kubenswrapper[2559]: I0612 22:20:58.260861 2559 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kube-apiserver-client-kubelet" Jun 12 22:20:58.266351 ip-10-0-128-134 kubenswrapper[2559]: I0612 22:20:58.263616 2559 dynamic_cafile_content.go:123] "Loaded a new CA Bundle and Verifier" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt" Jun 12 22:20:58.266911 ip-10-0-128-134 kubenswrapper[2559]: I0612 22:20:58.266896 2559 dynamic_cafile_content.go:161] "Starting controller" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt" Jun 12 22:20:58.278177 ip-10-0-128-134 kubenswrapper[2559]: I0612 22:20:58.278153 2559 log.go:25] "Validated CRI v1 runtime API" Jun 12 22:20:58.281342 ip-10-0-128-134 kubenswrapper[2559]: I0612 22:20:58.281324 2559 log.go:25] "Validated CRI v1 image API" Jun 12 22:20:58.282188 ip-10-0-128-134 kubenswrapper[2559]: I0612 22:20:58.282174 2559 server.go:1429] "Using cgroup driver setting received from the CRI runtime" cgroupDriver="systemd" Jun 12 22:20:58.284845 ip-10-0-128-134 kubenswrapper[2559]: I0612 22:20:58.284819 2559 fs.go:135] Filesystem UUIDs: map[5610a725-3cb8-4f07-8d29-46bde111c7bc:/dev/nvme0n1p3 6e5e49d1-ca12-42d2-b267-6f6cf66f97fd:/dev/nvme0n1p4 7B77-95E7:/dev/nvme0n1p2] Jun 12 22:20:58.284936 ip-10-0-128-134 kubenswrapper[2559]: I0612 22:20:58.284846 2559 fs.go:136] Filesystem partitions: map[/dev/nvme0n1p3:{mountpoint:/boot major:259 minor:3 fsType:ext4 blockSize:0} /dev/nvme0n1p4:{mountpoint:/var major:259 minor:4 fsType:xfs blockSize:0} /dev/shm:{mountpoint:/dev/shm major:0 minor:22 fsType:tmpfs blockSize:0} /run:{mountpoint:/run major:0 minor:24 fsType:tmpfs blockSize:0} /tmp:{mountpoint:/tmp major:0 minor:31 fsType:tmpfs blockSize:0} composefs_0-33:{mountpoint:/ major:0 minor:33 fsType:overlay blockSize:0}] Jun 12 22:20:58.290536 ip-10-0-128-134 kubenswrapper[2559]: I0612 22:20:58.290399 2559 manager.go:216] Machine: {Timestamp:2026-06-12 22:20:58.288871668 +0000 UTC m=+0.337241477 CPUVendorID:GenuineIntel NumCores:8 NumPhysicalCores:4 NumSockets:1 CpuFrequency:3140308 MemoryCapacity:32812175360 SwapCapacity:0 MemoryByType:map[] NVMInfo:{MemoryModeCapacity:0 AppDirectModeCapacity:0 AvgPowerBudget:0} HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] MachineID:ec2572c5e011924d3ebd100839e13bec SystemUUID:ec2572c5-e011-924d-3ebd-100839e13bec BootID:e5f45aca-9dd4-435c-be61-928ea9576d67 Filesystems:[{Device:/run DeviceMajor:0 DeviceMinor:24 Capacity:6562435072 Type:vfs Inodes:819200 HasInodes:true} {Device:/dev/nvme0n1p4 DeviceMajor:259 DeviceMinor:4 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:composefs_0-33 DeviceMajor:0 DeviceMinor:33 Capacity:6107136 Type:vfs Inodes:18446744073709551615 HasInodes:true} {Device:/tmp DeviceMajor:0 DeviceMinor:31 Capacity:16406089728 Type:vfs Inodes:1048576 HasInodes:true} {Device:/dev/nvme0n1p3 DeviceMajor:259 DeviceMinor:3 Capacity:366869504 Type:vfs Inodes:98304 HasInodes:true} {Device:/dev/shm DeviceMajor:0 DeviceMinor:22 Capacity:16406085632 Type:vfs Inodes:4005392 HasInodes:true}] DiskMap:map[259:0:{Name:nvme0n1 Major:259 Minor:0 Size:128849018880 Scheduler:none}] NetworkDevices:[{Name:br-ex MacAddress:02:81:5e:10:f2:dd Speed:0 Mtu:9001} {Name:ens5 MacAddress:02:81:5e:10:f2:dd Speed:0 Mtu:9001} {Name:ovs-system MacAddress:b2:e9:29:9b:1e:e0 Speed:0 Mtu:1500}] Topology:[{Id:0 Memory:32812175360 HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] Cores:[{Id:0 Threads:[0 4] Caches:[{Id:0 Size:32768 Type:Data Level:1} {Id:0 Size:32768 Type:Instruction Level:1} {Id:0 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:1 Threads:[1 5] Caches:[{Id:1 Size:32768 Type:Data Level:1} {Id:1 Size:32768 Type:Instruction Level:1} {Id:1 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:2 Threads:[2 6] Caches:[{Id:2 Size:32768 Type:Data Level:1} {Id:2 Size:32768 Type:Instruction Level:1} {Id:2 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:3 Threads:[3 7] Caches:[{Id:3 Size:32768 Type:Data Level:1} {Id:3 Size:32768 Type:Instruction Level:1} {Id:3 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:}] Caches:[{Id:0 Size:34603008 Type:Unified Level:3}] Distances:[10]}] CloudProvider:Unknown InstanceType:Unknown InstanceID:None} Jun 12 22:20:58.290536 ip-10-0-128-134 kubenswrapper[2559]: I0612 22:20:58.290525 2559 manager_no_libpfm.go:29] cAdvisor is build without cgo and/or libpfm support. Perf event counters are not available. Jun 12 22:20:58.290656 ip-10-0-128-134 kubenswrapper[2559]: I0612 22:20:58.290604 2559 manager.go:232] Version: {KernelVersion:5.14.0-570.120.1.el9_6.x86_64 ContainerOsVersion:Red Hat Enterprise Linux CoreOS 9.6.20260608-0 (Plow) DockerVersion: DockerAPIVersion: CadvisorVersion: CadvisorRevision:} Jun 12 22:20:58.294303 ip-10-0-128-134 kubenswrapper[2559]: I0612 22:20:58.294271 2559 container_manager_linux.go:273] "Container manager verified user specified cgroup-root exists" cgroupRoot=[] Jun 12 22:20:58.294509 ip-10-0-128-134 kubenswrapper[2559]: I0612 22:20:58.294306 2559 container_manager_linux.go:278] "Creating Container Manager object based on Node Config" nodeConfig={"NodeName":"ip-10-0-128-134.ec2.internal","RuntimeCgroupsName":"/system.slice/crio.service","SystemCgroupsName":"/system.slice","KubeletCgroupsName":"","KubeletOOMScoreAdj":-999,"ContainerRuntime":"","CgroupsPerQOS":true,"CgroupRoot":"/","CgroupDriver":"systemd","KubeletRootDir":"/var/lib/kubelet","ProtectKernelDefaults":true,"KubeReservedCgroupName":"","SystemReservedCgroupName":"","ReservedSystemCPUs":{},"EnforceNodeAllocatable":{"pods":{}},"KubeReserved":null,"SystemReserved":{"cpu":"500m","ephemeral-storage":"1Gi","memory":"1Gi"},"HardEvictionThresholds":[{"Signal":"memory.available","Operator":"LessThan","Value":{"Quantity":"100Mi","Percentage":0},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.1},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.15},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null}],"QOSReserved":{},"CPUManagerPolicy":"none","CPUManagerPolicyOptions":null,"TopologyManagerScope":"container","CPUManagerReconcilePeriod":10000000000,"MemoryManagerPolicy":"None","MemoryManagerReservedMemory":null,"PodPidsLimit":4096,"EnforceCPULimits":true,"CPUCFSQuotaPeriod":100000000,"TopologyManagerPolicy":"none","TopologyManagerPolicyOptions":null,"CgroupVersion":2} Jun 12 22:20:58.295148 ip-10-0-128-134 kubenswrapper[2559]: I0612 22:20:58.295137 2559 topology_manager.go:138] "Creating topology manager with none policy" Jun 12 22:20:58.295211 ip-10-0-128-134 kubenswrapper[2559]: I0612 22:20:58.295153 2559 container_manager_linux.go:309] "Creating device plugin manager" Jun 12 22:20:58.295211 ip-10-0-128-134 kubenswrapper[2559]: I0612 22:20:58.295163 2559 manager.go:141] "Creating Device Plugin manager" path="/var/lib/kubelet/device-plugins/kubelet.sock" Jun 12 22:20:58.296317 ip-10-0-128-134 kubenswrapper[2559]: I0612 22:20:58.296305 2559 server.go:74] "Creating device plugin registration server" version="v1beta1" socket="/var/lib/kubelet/device-plugins/kubelet.sock" Jun 12 22:20:58.296606 ip-10-0-128-134 kubenswrapper[2559]: I0612 22:20:58.296591 2559 reflector.go:439] "Caches populated" logger="kubernetes.io/kube-apiserver-client-kubelet" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162" Jun 12 22:20:58.298045 ip-10-0-128-134 kubenswrapper[2559]: I0612 22:20:58.298032 2559 container_manager_linux.go:318] "Creating Dynamic Resource Allocation (DRA) manager" Jun 12 22:20:58.306302 ip-10-0-128-134 kubenswrapper[2559]: I0612 22:20:58.306281 2559 state_mem.go:36] "Initialized new in-memory state store" Jun 12 22:20:58.306435 ip-10-0-128-134 kubenswrapper[2559]: I0612 22:20:58.306424 2559 server.go:1240] "Using root directory" path="/var/lib/kubelet" Jun 12 22:20:58.306509 ip-10-0-128-134 kubenswrapper[2559]: I0612 22:20:58.306482 2559 kubelet.go:486] "Attempting to sync node with API server" Jun 12 22:20:58.306509 ip-10-0-128-134 kubenswrapper[2559]: I0612 22:20:58.306497 2559 kubelet.go:387] "Adding static pod path" path="/etc/kubernetes/manifests" Jun 12 22:20:58.306589 ip-10-0-128-134 kubenswrapper[2559]: I0612 22:20:58.306512 2559 file.go:69] "Watching path" path="/etc/kubernetes/manifests" Jun 12 22:20:58.306589 ip-10-0-128-134 kubenswrapper[2559]: I0612 22:20:58.306527 2559 kubelet.go:398] "Adding apiserver pod source" Jun 12 22:20:58.306589 ip-10-0-128-134 kubenswrapper[2559]: I0612 22:20:58.306539 2559 apiserver.go:42] "Waiting for node sync before watching apiserver pods" Jun 12 22:20:58.306921 ip-10-0-128-134 kubenswrapper[2559]: I0612 22:20:58.306907 2559 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking" Jun 12 22:20:58.306988 ip-10-0-128-134 kubenswrapper[2559]: I0612 22:20:58.306931 2559 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking" Jun 12 22:20:58.313249 ip-10-0-128-134 kubenswrapper[2559]: I0612 22:20:58.313229 2559 kuberuntime_manager.go:301] "Container runtime initialized" containerRuntime="cri-o" version="1.34.8-3.rhaos4.21.git91b4b0b.el9" apiVersion="v1" Jun 12 22:20:58.314753 ip-10-0-128-134 kubenswrapper[2559]: I0612 22:20:58.314739 2559 kubelet.go:960] "Not starting ClusterTrustBundle informer because we are in static kubelet mode or the ClusterTrustBundleProjection featuregate is disabled" Jun 12 22:20:58.314802 ip-10-0-128-134 kubenswrapper[2559]: I0612 22:20:58.314770 2559 kubelet.go:984] "Not starting PodCertificateRequest manager because we are in static kubelet mode or the PodCertificateProjection feature gate is disabled" Jun 12 22:20:58.314916 ip-10-0-128-134 kubenswrapper[2559]: I0612 22:20:58.314906 2559 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/portworx-volume" Jun 12 22:20:58.314946 ip-10-0-128-134 kubenswrapper[2559]: I0612 22:20:58.314922 2559 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/empty-dir" Jun 12 22:20:58.314946 ip-10-0-128-134 kubenswrapper[2559]: I0612 22:20:58.314928 2559 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/git-repo" Jun 12 22:20:58.314946 ip-10-0-128-134 kubenswrapper[2559]: I0612 22:20:58.314934 2559 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/host-path" Jun 12 22:20:58.314946 ip-10-0-128-134 kubenswrapper[2559]: I0612 22:20:58.314942 2559 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/nfs" Jun 12 22:20:58.314946 ip-10-0-128-134 kubenswrapper[2559]: I0612 22:20:58.314948 2559 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/secret" Jun 12 22:20:58.315540 ip-10-0-128-134 kubenswrapper[2559]: I0612 22:20:58.315529 2559 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/iscsi" Jun 12 22:20:58.315540 ip-10-0-128-134 kubenswrapper[2559]: I0612 22:20:58.315540 2559 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/downward-api" Jun 12 22:20:58.315625 ip-10-0-128-134 kubenswrapper[2559]: I0612 22:20:58.315549 2559 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/fc" Jun 12 22:20:58.315625 ip-10-0-128-134 kubenswrapper[2559]: I0612 22:20:58.315555 2559 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/configmap" Jun 12 22:20:58.315625 ip-10-0-128-134 kubenswrapper[2559]: I0612 22:20:58.315564 2559 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/projected" Jun 12 22:20:58.315625 ip-10-0-128-134 kubenswrapper[2559]: I0612 22:20:58.315573 2559 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/local-volume" Jun 12 22:20:58.316339 ip-10-0-128-134 kubenswrapper[2559]: I0612 22:20:58.316329 2559 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/csi" Jun 12 22:20:58.316368 ip-10-0-128-134 kubenswrapper[2559]: I0612 22:20:58.316340 2559 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/image" Jun 12 22:20:58.319586 ip-10-0-128-134 kubenswrapper[2559]: I0612 22:20:58.319570 2559 server.go:1268] "Started kubelet" Jun 12 22:20:58.319586 ip-10-0-128-134 kubenswrapper[2559]: I0612 22:20:58.319575 2559 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-wzlsz" Jun 12 22:20:58.319721 ip-10-0-128-134 kubenswrapper[2559]: I0612 22:20:58.319671 2559 server.go:180] "Starting to listen" address="0.0.0.0" port=10250 Jun 12 22:20:58.319721 ip-10-0-128-134 kubenswrapper[2559]: I0612 22:20:58.319678 2559 ratelimit.go:56] "Setting rate limiting for endpoint" service="podresources" qps=100 burstTokens=10 Jun 12 22:20:58.319811 ip-10-0-128-134 kubenswrapper[2559]: I0612 22:20:58.319724 2559 server_v1.go:49] "podresources" method="list" useActivePods=true Jun 12 22:20:58.320624 ip-10-0-128-134 systemd[1]: Started Kubernetes Kubelet. Jun 12 22:20:58.321600 ip-10-0-128-134 kubenswrapper[2559]: I0612 22:20:58.321591 2559 server.go:249] "Starting to serve the podresources API" endpoint="unix:/var/lib/kubelet/pod-resources/kubelet.sock" Jun 12 22:20:58.322054 ip-10-0-128-134 kubenswrapper[2559]: E0612 22:20:58.322032 2559 reflector.go:205] "Failed to watch" err="failed to list *v1.Node: nodes \"ip-10-0-128-134.ec2.internal\" is forbidden: User \"system:anonymous\" cannot list resource \"nodes\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Node" Jun 12 22:20:58.322129 ip-10-0-128-134 kubenswrapper[2559]: I0612 22:20:58.322115 2559 server.go:310] "Adding debug handlers to kubelet server" Jun 12 22:20:58.326212 ip-10-0-128-134 kubenswrapper[2559]: I0612 22:20:58.326111 2559 csi_plugin.go:990] Failed to contact API server when waiting for CSINode publishing: csinodes.storage.k8s.io "ip-10-0-128-134.ec2.internal" is forbidden: User "system:anonymous" cannot get resource "csinodes" in API group "storage.k8s.io" at the cluster scope Jun 12 22:20:58.326342 ip-10-0-128-134 kubenswrapper[2559]: E0612 22:20:58.326314 2559 reflector.go:205] "Failed to watch" err="failed to list *v1.Service: services is forbidden: User \"system:anonymous\" cannot list resource \"services\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Service" Jun 12 22:20:58.326610 ip-10-0-128-134 kubenswrapper[2559]: I0612 22:20:58.326588 2559 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-wzlsz" Jun 12 22:20:58.329021 ip-10-0-128-134 kubenswrapper[2559]: E0612 22:20:58.328988 2559 kubelet.go:1638] "Image garbage collection failed once. Stats initialization may not have completed yet" err="failed to get imageFs info: unable to find data in memory cache" Jun 12 22:20:58.330284 ip-10-0-128-134 kubenswrapper[2559]: E0612 22:20:58.329282 2559 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-128-134.ec2.internal.18b875830b8654c8 default 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-128-134.ec2.internal,UID:ip-10-0-128-134.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:Starting,Message:Starting kubelet.,Source:EventSource{Component:kubelet,Host:ip-10-0-128-134.ec2.internal,},FirstTimestamp:2026-06-12 22:20:58.31954964 +0000 UTC m=+0.367919449,LastTimestamp:2026-06-12 22:20:58.31954964 +0000 UTC m=+0.367919449,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-128-134.ec2.internal,}" Jun 12 22:20:58.333825 ip-10-0-128-134 kubenswrapper[2559]: I0612 22:20:58.333804 2559 fs_resource_analyzer.go:67] "Starting FS ResourceAnalyzer" Jun 12 22:20:58.333897 ip-10-0-128-134 kubenswrapper[2559]: E0612 22:20:58.333883 2559 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-128-134.ec2.internal\" not found" Jun 12 22:20:58.333959 ip-10-0-128-134 kubenswrapper[2559]: I0612 22:20:58.333807 2559 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kubelet-serving" Jun 12 22:20:58.334880 ip-10-0-128-134 kubenswrapper[2559]: I0612 22:20:58.334866 2559 factory.go:153] Registering CRI-O factory Jun 12 22:20:58.334970 ip-10-0-128-134 kubenswrapper[2559]: I0612 22:20:58.334901 2559 factory.go:223] Registration of the crio container factory successfully Jun 12 22:20:58.335030 ip-10-0-128-134 kubenswrapper[2559]: I0612 22:20:58.334970 2559 volume_manager.go:311] "The desired_state_of_world populator starts" Jun 12 22:20:58.335030 ip-10-0-128-134 kubenswrapper[2559]: I0612 22:20:58.334985 2559 volume_manager.go:313] "Starting Kubelet Volume Manager" Jun 12 22:20:58.335030 ip-10-0-128-134 kubenswrapper[2559]: I0612 22:20:58.334998 2559 desired_state_of_world_populator.go:146] "Desired state populator starts to run" Jun 12 22:20:58.335163 ip-10-0-128-134 kubenswrapper[2559]: I0612 22:20:58.335065 2559 reconstruct.go:97] "Volume reconstruction finished" Jun 12 22:20:58.335163 ip-10-0-128-134 kubenswrapper[2559]: I0612 22:20:58.335073 2559 reconciler.go:29] "Reconciler: start to sync state" Jun 12 22:20:58.335163 ip-10-0-128-134 kubenswrapper[2559]: I0612 22:20:58.335095 2559 factory.go:221] Registration of the containerd container factory failed: unable to create containerd client: containerd: cannot unix dial containerd api service: dial unix /run/containerd/containerd.sock: connect: no such file or directory Jun 12 22:20:58.335163 ip-10-0-128-134 kubenswrapper[2559]: I0612 22:20:58.335106 2559 factory.go:55] Registering systemd factory Jun 12 22:20:58.335163 ip-10-0-128-134 kubenswrapper[2559]: I0612 22:20:58.335115 2559 factory.go:223] Registration of the systemd container factory successfully Jun 12 22:20:58.335163 ip-10-0-128-134 kubenswrapper[2559]: I0612 22:20:58.335140 2559 factory.go:103] Registering Raw factory Jun 12 22:20:58.335163 ip-10-0-128-134 kubenswrapper[2559]: I0612 22:20:58.335153 2559 manager.go:1196] Started watching for new ooms in manager Jun 12 22:20:58.335567 ip-10-0-128-134 kubenswrapper[2559]: I0612 22:20:58.335554 2559 manager.go:349] Starting recovery of all containers Jun 12 22:20:58.336019 ip-10-0-128-134 kubenswrapper[2559]: E0612 22:20:58.335996 2559 controller.go:145] "Failed to ensure lease exists, will retry" err="leases.coordination.k8s.io \"ip-10-0-128-134.ec2.internal\" is forbidden: User \"system:anonymous\" cannot get resource \"leases\" in API group \"coordination.k8s.io\" in the namespace \"kube-node-lease\"" interval="200ms" Jun 12 22:20:58.336019 ip-10-0-128-134 kubenswrapper[2559]: E0612 22:20:58.335997 2559 reflector.go:205] "Failed to watch" err="failed to list *v1.CSIDriver: csidrivers.storage.k8s.io is forbidden: User \"system:anonymous\" cannot list resource \"csidrivers\" in API group \"storage.k8s.io\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.CSIDriver" Jun 12 22:20:58.343594 ip-10-0-128-134 kubenswrapper[2559]: I0612 22:20:58.343580 2559 manager.go:354] Recovery completed Jun 12 22:20:58.347410 ip-10-0-128-134 kubenswrapper[2559]: I0612 22:20:58.347396 2559 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jun 12 22:20:58.349392 ip-10-0-128-134 kubenswrapper[2559]: I0612 22:20:58.349377 2559 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-128-134.ec2.internal" event="NodeHasSufficientMemory" Jun 12 22:20:58.349482 ip-10-0-128-134 kubenswrapper[2559]: I0612 22:20:58.349404 2559 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-128-134.ec2.internal" event="NodeHasNoDiskPressure" Jun 12 22:20:58.349482 ip-10-0-128-134 kubenswrapper[2559]: I0612 22:20:58.349415 2559 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-128-134.ec2.internal" event="NodeHasSufficientPID" Jun 12 22:20:58.350018 ip-10-0-128-134 kubenswrapper[2559]: I0612 22:20:58.349994 2559 cpu_manager.go:222] "Starting CPU manager" policy="none" Jun 12 22:20:58.350018 ip-10-0-128-134 kubenswrapper[2559]: I0612 22:20:58.350016 2559 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jun 12 22:20:58.350141 ip-10-0-128-134 kubenswrapper[2559]: I0612 22:20:58.350017 2559 cpu_manager.go:223] "Reconciling" reconcilePeriod="10s" Jun 12 22:20:58.350141 ip-10-0-128-134 kubenswrapper[2559]: I0612 22:20:58.350081 2559 state_mem.go:36] "Initialized new in-memory state store" Jun 12 22:20:58.350774 ip-10-0-128-134 kubenswrapper[2559]: I0612 22:20:58.350750 2559 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-128-134.ec2.internal" event="NodeHasSufficientMemory" Jun 12 22:20:58.350862 ip-10-0-128-134 kubenswrapper[2559]: I0612 22:20:58.350781 2559 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-128-134.ec2.internal" event="NodeHasNoDiskPressure" Jun 12 22:20:58.350862 ip-10-0-128-134 kubenswrapper[2559]: I0612 22:20:58.350791 2559 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-128-134.ec2.internal" event="NodeHasSufficientPID" Jun 12 22:20:58.351606 ip-10-0-128-134 kubenswrapper[2559]: I0612 22:20:58.351593 2559 policy_none.go:49] "None policy: Start" Jun 12 22:20:58.351677 ip-10-0-128-134 kubenswrapper[2559]: I0612 22:20:58.351612 2559 memory_manager.go:187] "Starting memorymanager" policy="None" Jun 12 22:20:58.351677 ip-10-0-128-134 kubenswrapper[2559]: I0612 22:20:58.351624 2559 state_mem.go:36] "Initializing new in-memory state store" logger="Memory Manager state checkpoint" Jun 12 22:20:58.353089 ip-10-0-128-134 kubenswrapper[2559]: I0612 22:20:58.353077 2559 policy_none.go:47] "Start" Jun 12 22:20:58.389181 ip-10-0-128-134 kubenswrapper[2559]: I0612 22:20:58.389155 2559 manager.go:337] "Starting Device Plugin manager" Jun 12 22:20:58.407134 ip-10-0-128-134 kubenswrapper[2559]: E0612 22:20:58.389189 2559 manager.go:513] "Failed to read data from checkpoint" err="checkpoint is not found" checkpoint="kubelet_internal_checkpoint" Jun 12 22:20:58.407134 ip-10-0-128-134 kubenswrapper[2559]: I0612 22:20:58.389198 2559 server.go:87] "Starting device plugin registration server" Jun 12 22:20:58.407134 ip-10-0-128-134 kubenswrapper[2559]: I0612 22:20:58.389519 2559 eviction_manager.go:189] "Eviction manager: starting control loop" Jun 12 22:20:58.407134 ip-10-0-128-134 kubenswrapper[2559]: I0612 22:20:58.389531 2559 container_log_manager.go:146] "Initializing container log rotate workers" workers=1 monitorPeriod="10s" Jun 12 22:20:58.407134 ip-10-0-128-134 kubenswrapper[2559]: I0612 22:20:58.389639 2559 plugin_watcher.go:51] "Plugin Watcher Start" path="/var/lib/kubelet/plugins_registry" Jun 12 22:20:58.407134 ip-10-0-128-134 kubenswrapper[2559]: I0612 22:20:58.389739 2559 plugin_manager.go:116] "The desired_state_of_world populator (plugin watcher) starts" Jun 12 22:20:58.407134 ip-10-0-128-134 kubenswrapper[2559]: I0612 22:20:58.389748 2559 plugin_manager.go:118] "Starting Kubelet Plugin Manager" Jun 12 22:20:58.407134 ip-10-0-128-134 kubenswrapper[2559]: E0612 22:20:58.390293 2559 eviction_manager.go:267] "eviction manager: failed to check if we have separate container filesystem. Ignoring." err="non-existent label \"crio-containers\"" Jun 12 22:20:58.407134 ip-10-0-128-134 kubenswrapper[2559]: E0612 22:20:58.390340 2559 eviction_manager.go:292] "Eviction manager: failed to get summary stats" err="failed to get node info: node \"ip-10-0-128-134.ec2.internal\" not found" Jun 12 22:20:58.407134 ip-10-0-128-134 kubenswrapper[2559]: I0612 22:20:58.402293 2559 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv4" Jun 12 22:20:58.407134 ip-10-0-128-134 kubenswrapper[2559]: I0612 22:20:58.403594 2559 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv6" Jun 12 22:20:58.407134 ip-10-0-128-134 kubenswrapper[2559]: I0612 22:20:58.403625 2559 status_manager.go:244] "Starting to sync pod status with apiserver" Jun 12 22:20:58.407134 ip-10-0-128-134 kubenswrapper[2559]: I0612 22:20:58.403690 2559 kubelet.go:2448] "Starting kubelet main sync loop" Jun 12 22:20:58.407134 ip-10-0-128-134 kubenswrapper[2559]: E0612 22:20:58.403763 2559 kubelet.go:2472] "Skipping pod synchronization" err="PLEG is not healthy: pleg has yet to be successful" Jun 12 22:20:58.407134 ip-10-0-128-134 kubenswrapper[2559]: I0612 22:20:58.405534 2559 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160" Jun 12 22:20:58.490050 ip-10-0-128-134 kubenswrapper[2559]: I0612 22:20:58.489953 2559 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jun 12 22:20:58.492322 ip-10-0-128-134 kubenswrapper[2559]: I0612 22:20:58.492286 2559 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-128-134.ec2.internal" event="NodeHasSufficientMemory" Jun 12 22:20:58.492495 ip-10-0-128-134 kubenswrapper[2559]: I0612 22:20:58.492342 2559 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-128-134.ec2.internal" event="NodeHasNoDiskPressure" Jun 12 22:20:58.492495 ip-10-0-128-134 kubenswrapper[2559]: I0612 22:20:58.492372 2559 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-128-134.ec2.internal" event="NodeHasSufficientPID" Jun 12 22:20:58.492495 ip-10-0-128-134 kubenswrapper[2559]: I0612 22:20:58.492424 2559 kubelet_node_status.go:78] "Attempting to register node" node="ip-10-0-128-134.ec2.internal" Jun 12 22:20:58.500374 ip-10-0-128-134 kubenswrapper[2559]: I0612 22:20:58.500349 2559 kubelet_node_status.go:81] "Successfully registered node" node="ip-10-0-128-134.ec2.internal" Jun 12 22:20:58.500374 ip-10-0-128-134 kubenswrapper[2559]: E0612 22:20:58.500379 2559 kubelet_node_status.go:536] "Error updating node status, will retry" err="error getting node \"ip-10-0-128-134.ec2.internal\": node \"ip-10-0-128-134.ec2.internal\" not found" Jun 12 22:20:58.503852 ip-10-0-128-134 kubenswrapper[2559]: I0612 22:20:58.503813 2559 kubelet.go:2535] "SyncLoop ADD" source="file" pods=["openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-128-134.ec2.internal","kube-system/kube-apiserver-proxy-ip-10-0-128-134.ec2.internal"] Jun 12 22:20:58.503991 ip-10-0-128-134 kubenswrapper[2559]: I0612 22:20:58.503902 2559 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jun 12 22:20:58.504759 ip-10-0-128-134 kubenswrapper[2559]: I0612 22:20:58.504742 2559 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-128-134.ec2.internal" event="NodeHasSufficientMemory" Jun 12 22:20:58.504841 ip-10-0-128-134 kubenswrapper[2559]: I0612 22:20:58.504772 2559 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-128-134.ec2.internal" event="NodeHasNoDiskPressure" Jun 12 22:20:58.504841 ip-10-0-128-134 kubenswrapper[2559]: I0612 22:20:58.504781 2559 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-128-134.ec2.internal" event="NodeHasSufficientPID" Jun 12 22:20:58.506120 ip-10-0-128-134 kubenswrapper[2559]: I0612 22:20:58.506108 2559 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jun 12 22:20:58.506254 ip-10-0-128-134 kubenswrapper[2559]: I0612 22:20:58.506239 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-128-134.ec2.internal" Jun 12 22:20:58.506304 ip-10-0-128-134 kubenswrapper[2559]: I0612 22:20:58.506275 2559 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jun 12 22:20:58.506926 ip-10-0-128-134 kubenswrapper[2559]: I0612 22:20:58.506909 2559 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-128-134.ec2.internal" event="NodeHasSufficientMemory" Jun 12 22:20:58.507015 ip-10-0-128-134 kubenswrapper[2559]: I0612 22:20:58.506932 2559 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-128-134.ec2.internal" event="NodeHasNoDiskPressure" Jun 12 22:20:58.507015 ip-10-0-128-134 kubenswrapper[2559]: I0612 22:20:58.506945 2559 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-128-134.ec2.internal" event="NodeHasSufficientPID" Jun 12 22:20:58.507015 ip-10-0-128-134 kubenswrapper[2559]: I0612 22:20:58.507006 2559 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-128-134.ec2.internal" event="NodeHasSufficientMemory" Jun 12 22:20:58.507153 ip-10-0-128-134 kubenswrapper[2559]: I0612 22:20:58.507030 2559 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-128-134.ec2.internal" event="NodeHasNoDiskPressure" Jun 12 22:20:58.507153 ip-10-0-128-134 kubenswrapper[2559]: I0612 22:20:58.507047 2559 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-128-134.ec2.internal" event="NodeHasSufficientPID" Jun 12 22:20:58.508180 ip-10-0-128-134 kubenswrapper[2559]: I0612 22:20:58.508162 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-128-134.ec2.internal" Jun 12 22:20:58.508266 ip-10-0-128-134 kubenswrapper[2559]: I0612 22:20:58.508196 2559 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jun 12 22:20:58.508867 ip-10-0-128-134 kubenswrapper[2559]: I0612 22:20:58.508849 2559 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-128-134.ec2.internal" event="NodeHasSufficientMemory" Jun 12 22:20:58.508938 ip-10-0-128-134 kubenswrapper[2559]: I0612 22:20:58.508874 2559 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-128-134.ec2.internal" event="NodeHasNoDiskPressure" Jun 12 22:20:58.508938 ip-10-0-128-134 kubenswrapper[2559]: I0612 22:20:58.508885 2559 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-128-134.ec2.internal" event="NodeHasSufficientPID" Jun 12 22:20:58.512890 ip-10-0-128-134 kubenswrapper[2559]: E0612 22:20:58.512869 2559 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-128-134.ec2.internal\" not found" Jun 12 22:20:58.535909 ip-10-0-128-134 kubenswrapper[2559]: I0612 22:20:58.535871 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/be987faa4fc50bfe0d9fa8445913d866-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-128-134.ec2.internal\" (UID: \"be987faa4fc50bfe0d9fa8445913d866\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-128-134.ec2.internal" Jun 12 22:20:58.536060 ip-10-0-128-134 kubenswrapper[2559]: I0612 22:20:58.535911 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/be987faa4fc50bfe0d9fa8445913d866-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-128-134.ec2.internal\" (UID: \"be987faa4fc50bfe0d9fa8445913d866\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-128-134.ec2.internal" Jun 12 22:20:58.536060 ip-10-0-128-134 kubenswrapper[2559]: I0612 22:20:58.535941 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/6d3e86596363af41e954bcae3f7c03e7-config\") pod \"kube-apiserver-proxy-ip-10-0-128-134.ec2.internal\" (UID: \"6d3e86596363af41e954bcae3f7c03e7\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-128-134.ec2.internal" Jun 12 22:20:58.544390 ip-10-0-128-134 kubenswrapper[2559]: E0612 22:20:58.544363 2559 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-128-134.ec2.internal\" not found" node="ip-10-0-128-134.ec2.internal" Jun 12 22:20:58.549425 ip-10-0-128-134 kubenswrapper[2559]: E0612 22:20:58.549405 2559 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-128-134.ec2.internal\" not found" node="ip-10-0-128-134.ec2.internal" Jun 12 22:20:58.613254 ip-10-0-128-134 kubenswrapper[2559]: E0612 22:20:58.613217 2559 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-128-134.ec2.internal\" not found" Jun 12 22:20:58.636597 ip-10-0-128-134 kubenswrapper[2559]: I0612 22:20:58.636566 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/6d3e86596363af41e954bcae3f7c03e7-config\") pod \"kube-apiserver-proxy-ip-10-0-128-134.ec2.internal\" (UID: \"6d3e86596363af41e954bcae3f7c03e7\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-128-134.ec2.internal" Jun 12 22:20:58.636682 ip-10-0-128-134 kubenswrapper[2559]: I0612 22:20:58.636603 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/be987faa4fc50bfe0d9fa8445913d866-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-128-134.ec2.internal\" (UID: \"be987faa4fc50bfe0d9fa8445913d866\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-128-134.ec2.internal" Jun 12 22:20:58.636682 ip-10-0-128-134 kubenswrapper[2559]: I0612 22:20:58.636635 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/be987faa4fc50bfe0d9fa8445913d866-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-128-134.ec2.internal\" (UID: \"be987faa4fc50bfe0d9fa8445913d866\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-128-134.ec2.internal" Jun 12 22:20:58.636781 ip-10-0-128-134 kubenswrapper[2559]: I0612 22:20:58.636682 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/be987faa4fc50bfe0d9fa8445913d866-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-128-134.ec2.internal\" (UID: \"be987faa4fc50bfe0d9fa8445913d866\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-128-134.ec2.internal" Jun 12 22:20:58.636781 ip-10-0-128-134 kubenswrapper[2559]: I0612 22:20:58.636682 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/host-path/6d3e86596363af41e954bcae3f7c03e7-config\") pod \"kube-apiserver-proxy-ip-10-0-128-134.ec2.internal\" (UID: \"6d3e86596363af41e954bcae3f7c03e7\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-128-134.ec2.internal" Jun 12 22:20:58.636781 ip-10-0-128-134 kubenswrapper[2559]: I0612 22:20:58.636710 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/be987faa4fc50bfe0d9fa8445913d866-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-128-134.ec2.internal\" (UID: \"be987faa4fc50bfe0d9fa8445913d866\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-128-134.ec2.internal" Jun 12 22:20:58.713733 ip-10-0-128-134 kubenswrapper[2559]: E0612 22:20:58.713694 2559 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-128-134.ec2.internal\" not found" Jun 12 22:20:58.814496 ip-10-0-128-134 kubenswrapper[2559]: E0612 22:20:58.814476 2559 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-128-134.ec2.internal\" not found" Jun 12 22:20:58.847048 ip-10-0-128-134 kubenswrapper[2559]: I0612 22:20:58.847017 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-128-134.ec2.internal" Jun 12 22:20:58.853356 ip-10-0-128-134 kubenswrapper[2559]: I0612 22:20:58.853337 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-128-134.ec2.internal" Jun 12 22:20:58.915026 ip-10-0-128-134 kubenswrapper[2559]: E0612 22:20:58.914988 2559 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-128-134.ec2.internal\" not found" Jun 12 22:20:59.015594 ip-10-0-128-134 kubenswrapper[2559]: E0612 22:20:59.015564 2559 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-128-134.ec2.internal\" not found" Jun 12 22:20:59.116218 ip-10-0-128-134 kubenswrapper[2559]: E0612 22:20:59.116128 2559 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-128-134.ec2.internal\" not found" Jun 12 22:20:59.216756 ip-10-0-128-134 kubenswrapper[2559]: E0612 22:20:59.216712 2559 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-128-134.ec2.internal\" not found" Jun 12 22:20:59.260268 ip-10-0-128-134 kubenswrapper[2559]: I0612 22:20:59.260237 2559 transport.go:147] "Certificate rotation detected, shutting down client connections to start using new credentials" Jun 12 22:20:59.260939 ip-10-0-128-134 kubenswrapper[2559]: I0612 22:20:59.260387 2559 reflector.go:571] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.RuntimeClass" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received" Jun 12 22:20:59.317715 ip-10-0-128-134 kubenswrapper[2559]: E0612 22:20:59.317676 2559 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-128-134.ec2.internal\" not found" Jun 12 22:20:59.334031 ip-10-0-128-134 kubenswrapper[2559]: I0612 22:20:59.333852 2559 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kube-apiserver-client-kubelet" expiration="2028-06-11 22:15:58 +0000 UTC" deadline="2028-03-29 21:45:53.652852632 +0000 UTC" Jun 12 22:20:59.334031 ip-10-0-128-134 kubenswrapper[2559]: I0612 22:20:59.334027 2559 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kube-apiserver-client-kubelet" sleep="15743h24m54.31882936s" Jun 12 22:20:59.415498 ip-10-0-128-134 kubenswrapper[2559]: W0612 22:20:59.415464 2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podbe987faa4fc50bfe0d9fa8445913d866.slice/crio-ae91176e996e6efea0691a31ed3541efd75782862dea34b29586bd334cd80952 WatchSource:0}: Error finding container ae91176e996e6efea0691a31ed3541efd75782862dea34b29586bd334cd80952: Status 404 returned error can't find the container with id ae91176e996e6efea0691a31ed3541efd75782862dea34b29586bd334cd80952 Jun 12 22:20:59.418372 ip-10-0-128-134 kubenswrapper[2559]: E0612 22:20:59.418353 2559 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-128-134.ec2.internal\" not found" Jun 12 22:20:59.420482 ip-10-0-128-134 kubenswrapper[2559]: I0612 22:20:59.420464 2559 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jun 12 22:20:59.426145 ip-10-0-128-134 kubenswrapper[2559]: W0612 22:20:59.426124 2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6d3e86596363af41e954bcae3f7c03e7.slice/crio-6248ef6db82a4416693392b31144e266a863470ce330e0837859f0ee37bd0f33 WatchSource:0}: Error finding container 6248ef6db82a4416693392b31144e266a863470ce330e0837859f0ee37bd0f33: Status 404 returned error can't find the container with id 6248ef6db82a4416693392b31144e266a863470ce330e0837859f0ee37bd0f33 Jun 12 22:20:59.519165 ip-10-0-128-134 kubenswrapper[2559]: E0612 22:20:59.519110 2559 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-128-134.ec2.internal\" not found" Jun 12 22:20:59.619693 ip-10-0-128-134 kubenswrapper[2559]: E0612 22:20:59.619660 2559 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-128-134.ec2.internal\" not found" Jun 12 22:20:59.684067 ip-10-0-128-134 kubenswrapper[2559]: I0612 22:20:59.683982 2559 reflector.go:439] "Caches populated" type="*v1.Node" reflector="k8s.io/client-go/informers/factory.go:160" Jun 12 22:20:59.729065 ip-10-0-128-134 kubenswrapper[2559]: I0612 22:20:59.729040 2559 reflector.go:439] "Caches populated" type="*v1.Service" reflector="k8s.io/client-go/informers/factory.go:160" Jun 12 22:20:59.734483 ip-10-0-128-134 kubenswrapper[2559]: I0612 22:20:59.734466 2559 kubelet.go:3248] "Creating a mirror pod for static pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-128-134.ec2.internal" Jun 12 22:20:59.747035 ip-10-0-128-134 kubenswrapper[2559]: I0612 22:20:59.747013 2559 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]" Jun 12 22:20:59.748102 ip-10-0-128-134 kubenswrapper[2559]: I0612 22:20:59.748089 2559 kubelet.go:3248] "Creating a mirror pod for static pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-128-134.ec2.internal" Jun 12 22:20:59.754067 ip-10-0-128-134 kubenswrapper[2559]: I0612 22:20:59.754052 2559 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]" Jun 12 22:20:59.871156 ip-10-0-128-134 kubenswrapper[2559]: I0612 22:20:59.871117 2559 reflector.go:439] "Caches populated" type="*v1.CSIDriver" reflector="k8s.io/client-go/informers/factory.go:160" Jun 12 22:21:00.067225 ip-10-0-128-134 kubenswrapper[2559]: I0612 22:21:00.067188 2559 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160" Jun 12 22:21:00.307982 ip-10-0-128-134 kubenswrapper[2559]: I0612 22:21:00.307938 2559 apiserver.go:52] "Watching apiserver" Jun 12 22:21:00.317051 ip-10-0-128-134 kubenswrapper[2559]: I0612 22:21:00.316673 2559 reflector.go:439] "Caches populated" type="*v1.Pod" reflector="pkg/kubelet/config/apiserver.go:66" Jun 12 22:21:00.318024 ip-10-0-128-134 kubenswrapper[2559]: I0612 22:21:00.317957 2559 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-cluster-node-tuning-operator/tuned-kbvj8","openshift-multus/multus-additional-cni-plugins-6fjft","openshift-network-operator/iptables-alerter-s2zxg","openshift-ovn-kubernetes/ovnkube-node-9qn4j","openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-hbdkt","openshift-dns/node-resolver-qdtqn","openshift-image-registry/node-ca-bghrt","openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-128-134.ec2.internal","openshift-multus/multus-bzp8z","openshift-multus/network-metrics-daemon-d9psx","openshift-network-diagnostics/network-check-target-c9wls","kube-system/global-pull-secret-syncer-zdjjt","kube-system/konnectivity-agent-f7h79","kube-system/kube-apiserver-proxy-ip-10-0-128-134.ec2.internal"] Jun 12 22:21:00.320685 ip-10-0-128-134 kubenswrapper[2559]: I0612 22:21:00.320663 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-bghrt" Jun 12 22:21:00.322861 ip-10-0-128-134 kubenswrapper[2559]: I0612 22:21:00.322836 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-f7h79" Jun 12 22:21:00.323339 ip-10-0-128-134 kubenswrapper[2559]: I0612 22:21:00.323322 2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"image-registry-certificates\"" Jun 12 22:21:00.323475 ip-10-0-128-134 kubenswrapper[2559]: I0612 22:21:00.323440 2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"openshift-service-ca.crt\"" Jun 12 22:21:00.324021 ip-10-0-128-134 kubenswrapper[2559]: I0612 22:21:00.324003 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"node-ca-dockercfg-jk4dq\"" Jun 12 22:21:00.324245 ip-10-0-128-134 kubenswrapper[2559]: I0612 22:21:00.324228 2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"kube-root-ca.crt\"" Jun 12 22:21:00.325311 ip-10-0-128-134 kubenswrapper[2559]: I0612 22:21:00.325289 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-s2zxg" Jun 12 22:21:00.327216 ip-10-0-128-134 kubenswrapper[2559]: I0612 22:21:00.327187 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"konnectivity-agent\"" Jun 12 22:21:00.327384 ip-10-0-128-134 kubenswrapper[2559]: I0612 22:21:00.327370 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"default-dockercfg-7g8pn\"" Jun 12 22:21:00.327836 ip-10-0-128-134 kubenswrapper[2559]: I0612 22:21:00.327819 2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kube-system\"/\"konnectivity-ca-bundle\"" Jun 12 22:21:00.328110 ip-10-0-128-134 kubenswrapper[2559]: I0612 22:21:00.328089 2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"openshift-service-ca.crt\"" Jun 12 22:21:00.328394 ip-10-0-128-134 kubenswrapper[2559]: I0612 22:21:00.328375 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-dockercfg-ckl4k\"" Jun 12 22:21:00.328504 ip-10-0-128-134 kubenswrapper[2559]: I0612 22:21:00.328472 2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-script\"" Jun 12 22:21:00.329084 ip-10-0-128-134 kubenswrapper[2559]: I0612 22:21:00.329066 2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"kube-root-ca.crt\"" Jun 12 22:21:00.331661 ip-10-0-128-134 kubenswrapper[2559]: I0612 22:21:00.331640 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-9qn4j" Jun 12 22:21:00.333724 ip-10-0-128-134 kubenswrapper[2559]: I0612 22:21:00.333690 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-hbdkt" Jun 12 22:21:00.334000 ip-10-0-128-134 kubenswrapper[2559]: I0612 22:21:00.333979 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-node-metrics-cert\"" Jun 12 22:21:00.334141 ip-10-0-128-134 kubenswrapper[2559]: I0612 22:21:00.334126 2559 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kubelet-serving" Jun 12 22:21:00.335245 ip-10-0-128-134 kubenswrapper[2559]: I0612 22:21:00.335224 2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"kube-root-ca.crt\"" Jun 12 22:21:00.335338 ip-10-0-128-134 kubenswrapper[2559]: I0612 22:21:00.335254 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-kubernetes-node-dockercfg-v4wrp\"" Jun 12 22:21:00.335645 ip-10-0-128-134 kubenswrapper[2559]: I0612 22:21:00.335628 2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-script-lib\"" Jun 12 22:21:00.335753 ip-10-0-128-134 kubenswrapper[2559]: I0612 22:21:00.335644 2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"openshift-service-ca.crt\"" Jun 12 22:21:00.335753 ip-10-0-128-134 kubenswrapper[2559]: I0612 22:21:00.335743 2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-config\"" Jun 12 22:21:00.335860 ip-10-0-128-134 kubenswrapper[2559]: I0612 22:21:00.335848 2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"env-overrides\"" Jun 12 22:21:00.335961 ip-10-0-128-134 kubenswrapper[2559]: I0612 22:21:00.335939 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-qdtqn" Jun 12 22:21:00.335961 ip-10-0-128-134 kubenswrapper[2559]: I0612 22:21:00.336413 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-sa-dockercfg-5zvl2\"" Jun 12 22:21:00.335961 ip-10-0-128-134 kubenswrapper[2559]: I0612 22:21:00.336423 2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"openshift-service-ca.crt\"" Jun 12 22:21:00.335961 ip-10-0-128-134 kubenswrapper[2559]: I0612 22:21:00.336416 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-metrics-serving-cert\"" Jun 12 22:21:00.335961 ip-10-0-128-134 kubenswrapper[2559]: I0612 22:21:00.336476 2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"kube-root-ca.crt\"" Jun 12 22:21:00.338361 ip-10-0-128-134 kubenswrapper[2559]: I0612 22:21:00.338317 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-bzp8z" Jun 12 22:21:00.338853 ip-10-0-128-134 kubenswrapper[2559]: I0612 22:21:00.338830 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"node-resolver-dockercfg-8vbzj\"" Jun 12 22:21:00.338957 ip-10-0-128-134 kubenswrapper[2559]: I0612 22:21:00.338837 2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"openshift-service-ca.crt\"" Jun 12 22:21:00.339066 ip-10-0-128-134 kubenswrapper[2559]: I0612 22:21:00.339025 2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"kube-root-ca.crt\"" Jun 12 22:21:00.341503 ip-10-0-128-134 kubenswrapper[2559]: I0612 22:21:00.341485 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"default-dockercfg-p2wxv\"" Jun 12 22:21:00.341819 ip-10-0-128-134 kubenswrapper[2559]: I0612 22:21:00.341801 2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"cni-copy-resources\"" Jun 12 22:21:00.341911 ip-10-0-128-134 kubenswrapper[2559]: I0612 22:21:00.341831 2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"openshift-service-ca.crt\"" Jun 12 22:21:00.342073 ip-10-0-128-134 kubenswrapper[2559]: I0612 22:21:00.342057 2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"kube-root-ca.crt\"" Jun 12 22:21:00.342302 ip-10-0-128-134 kubenswrapper[2559]: I0612 22:21:00.342285 2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"multus-daemon-config\"" Jun 12 22:21:00.342950 ip-10-0-128-134 kubenswrapper[2559]: I0612 22:21:00.342931 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-kbvj8" Jun 12 22:21:00.345417 ip-10-0-128-134 kubenswrapper[2559]: I0612 22:21:00.345398 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-6fjft" Jun 12 22:21:00.345613 ip-10-0-128-134 kubenswrapper[2559]: I0612 22:21:00.345593 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"tuned-dockercfg-zbr9t\"" Jun 12 22:21:00.345974 ip-10-0-128-134 kubenswrapper[2559]: I0612 22:21:00.345841 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/f6ddad48-94e1-479b-951c-ebf6be358f2c-run-ovn\") pod \"ovnkube-node-9qn4j\" (UID: \"f6ddad48-94e1-479b-951c-ebf6be358f2c\") " pod="openshift-ovn-kubernetes/ovnkube-node-9qn4j" Jun 12 22:21:00.345974 ip-10-0-128-134 kubenswrapper[2559]: I0612 22:21:00.345874 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/f6ddad48-94e1-479b-951c-ebf6be358f2c-node-log\") pod \"ovnkube-node-9qn4j\" (UID: \"f6ddad48-94e1-479b-951c-ebf6be358f2c\") " pod="openshift-ovn-kubernetes/ovnkube-node-9qn4j" Jun 12 22:21:00.345974 ip-10-0-128-134 kubenswrapper[2559]: I0612 22:21:00.345880 2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"openshift-service-ca.crt\"" Jun 12 22:21:00.345974 ip-10-0-128-134 kubenswrapper[2559]: I0612 22:21:00.345935 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/f6ddad48-94e1-479b-951c-ebf6be358f2c-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-9qn4j\" (UID: \"f6ddad48-94e1-479b-951c-ebf6be358f2c\") " pod="openshift-ovn-kubernetes/ovnkube-node-9qn4j" Jun 12 22:21:00.345974 ip-10-0-128-134 kubenswrapper[2559]: I0612 22:21:00.345962 2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"kube-root-ca.crt\"" Jun 12 22:21:00.346237 ip-10-0-128-134 kubenswrapper[2559]: I0612 22:21:00.345972 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/f6ddad48-94e1-479b-951c-ebf6be358f2c-systemd-units\") pod \"ovnkube-node-9qn4j\" (UID: \"f6ddad48-94e1-479b-951c-ebf6be358f2c\") " pod="openshift-ovn-kubernetes/ovnkube-node-9qn4j" Jun 12 22:21:00.346237 ip-10-0-128-134 kubenswrapper[2559]: I0612 22:21:00.346012 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/f6ddad48-94e1-479b-951c-ebf6be358f2c-host-slash\") pod \"ovnkube-node-9qn4j\" (UID: \"f6ddad48-94e1-479b-951c-ebf6be358f2c\") " pod="openshift-ovn-kubernetes/ovnkube-node-9qn4j" Jun 12 22:21:00.346237 ip-10-0-128-134 kubenswrapper[2559]: I0612 22:21:00.346037 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/f6ddad48-94e1-479b-951c-ebf6be358f2c-host-run-ovn-kubernetes\") pod \"ovnkube-node-9qn4j\" (UID: \"f6ddad48-94e1-479b-951c-ebf6be358f2c\") " pod="openshift-ovn-kubernetes/ovnkube-node-9qn4j" Jun 12 22:21:00.346237 ip-10-0-128-134 kubenswrapper[2559]: I0612 22:21:00.346081 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/5aa3f5cb-8c34-46e9-8b09-8af6c2318dce-kubelet-dir\") pod \"aws-ebs-csi-driver-node-hbdkt\" (UID: \"5aa3f5cb-8c34-46e9-8b09-8af6c2318dce\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-hbdkt" Jun 12 22:21:00.346237 ip-10-0-128-134 kubenswrapper[2559]: I0612 22:21:00.346108 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/5aa3f5cb-8c34-46e9-8b09-8af6c2318dce-registration-dir\") pod \"aws-ebs-csi-driver-node-hbdkt\" (UID: \"5aa3f5cb-8c34-46e9-8b09-8af6c2318dce\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-hbdkt" Jun 12 22:21:00.346237 ip-10-0-128-134 kubenswrapper[2559]: I0612 22:21:00.346213 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/f6ddad48-94e1-479b-951c-ebf6be358f2c-etc-openvswitch\") pod \"ovnkube-node-9qn4j\" (UID: \"f6ddad48-94e1-479b-951c-ebf6be358f2c\") " pod="openshift-ovn-kubernetes/ovnkube-node-9qn4j" Jun 12 22:21:00.346541 ip-10-0-128-134 kubenswrapper[2559]: I0612 22:21:00.346300 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/f6ddad48-94e1-479b-951c-ebf6be358f2c-host-cni-netd\") pod \"ovnkube-node-9qn4j\" (UID: \"f6ddad48-94e1-479b-951c-ebf6be358f2c\") " pod="openshift-ovn-kubernetes/ovnkube-node-9qn4j" Jun 12 22:21:00.346541 ip-10-0-128-134 kubenswrapper[2559]: I0612 22:21:00.346328 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/d01cad7b-32bc-45f8-8c98-057a798e0866-host\") pod \"node-ca-bghrt\" (UID: \"d01cad7b-32bc-45f8-8c98-057a798e0866\") " pod="openshift-image-registry/node-ca-bghrt" Jun 12 22:21:00.346541 ip-10-0-128-134 kubenswrapper[2559]: I0612 22:21:00.346349 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/f6ddad48-94e1-479b-951c-ebf6be358f2c-host-kubelet\") pod \"ovnkube-node-9qn4j\" (UID: \"f6ddad48-94e1-479b-951c-ebf6be358f2c\") " pod="openshift-ovn-kubernetes/ovnkube-node-9qn4j" Jun 12 22:21:00.346541 ip-10-0-128-134 kubenswrapper[2559]: I0612 22:21:00.346400 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/f6ddad48-94e1-479b-951c-ebf6be358f2c-ovnkube-config\") pod \"ovnkube-node-9qn4j\" (UID: \"f6ddad48-94e1-479b-951c-ebf6be358f2c\") " pod="openshift-ovn-kubernetes/ovnkube-node-9qn4j" Jun 12 22:21:00.346541 ip-10-0-128-134 kubenswrapper[2559]: I0612 22:21:00.346435 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/f6ddad48-94e1-479b-951c-ebf6be358f2c-env-overrides\") pod \"ovnkube-node-9qn4j\" (UID: \"f6ddad48-94e1-479b-951c-ebf6be358f2c\") " pod="openshift-ovn-kubernetes/ovnkube-node-9qn4j" Jun 12 22:21:00.346541 ip-10-0-128-134 kubenswrapper[2559]: I0612 22:21:00.346512 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/f6ddad48-94e1-479b-951c-ebf6be358f2c-ovnkube-script-lib\") pod \"ovnkube-node-9qn4j\" (UID: \"f6ddad48-94e1-479b-951c-ebf6be358f2c\") " pod="openshift-ovn-kubernetes/ovnkube-node-9qn4j" Jun 12 22:21:00.346541 ip-10-0-128-134 kubenswrapper[2559]: I0612 22:21:00.346537 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hw84x\" (UniqueName: \"kubernetes.io/projected/d01cad7b-32bc-45f8-8c98-057a798e0866-kube-api-access-hw84x\") pod \"node-ca-bghrt\" (UID: \"d01cad7b-32bc-45f8-8c98-057a798e0866\") " pod="openshift-image-registry/node-ca-bghrt" Jun 12 22:21:00.346899 ip-10-0-128-134 kubenswrapper[2559]: I0612 22:21:00.346561 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/fcd15bde-b438-4c03-a474-3424cfb17daa-iptables-alerter-script\") pod \"iptables-alerter-s2zxg\" (UID: \"fcd15bde-b438-4c03-a474-3424cfb17daa\") " pod="openshift-network-operator/iptables-alerter-s2zxg" Jun 12 22:21:00.346899 ip-10-0-128-134 kubenswrapper[2559]: I0612 22:21:00.346582 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-q9hxt\" (UniqueName: \"kubernetes.io/projected/fcd15bde-b438-4c03-a474-3424cfb17daa-kube-api-access-q9hxt\") pod \"iptables-alerter-s2zxg\" (UID: \"fcd15bde-b438-4c03-a474-3424cfb17daa\") " pod="openshift-network-operator/iptables-alerter-s2zxg" Jun 12 22:21:00.346899 ip-10-0-128-134 kubenswrapper[2559]: I0612 22:21:00.346604 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/f6ddad48-94e1-479b-951c-ebf6be358f2c-run-systemd\") pod \"ovnkube-node-9qn4j\" (UID: \"f6ddad48-94e1-479b-951c-ebf6be358f2c\") " pod="openshift-ovn-kubernetes/ovnkube-node-9qn4j" Jun 12 22:21:00.346899 ip-10-0-128-134 kubenswrapper[2559]: I0612 22:21:00.346630 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/f6ddad48-94e1-479b-951c-ebf6be358f2c-var-lib-openvswitch\") pod \"ovnkube-node-9qn4j\" (UID: \"f6ddad48-94e1-479b-951c-ebf6be358f2c\") " pod="openshift-ovn-kubernetes/ovnkube-node-9qn4j" Jun 12 22:21:00.346899 ip-10-0-128-134 kubenswrapper[2559]: I0612 22:21:00.346666 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/f6ddad48-94e1-479b-951c-ebf6be358f2c-run-openvswitch\") pod \"ovnkube-node-9qn4j\" (UID: \"f6ddad48-94e1-479b-951c-ebf6be358f2c\") " pod="openshift-ovn-kubernetes/ovnkube-node-9qn4j" Jun 12 22:21:00.346899 ip-10-0-128-134 kubenswrapper[2559]: I0612 22:21:00.346690 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/f6ddad48-94e1-479b-951c-ebf6be358f2c-ovn-node-metrics-cert\") pod \"ovnkube-node-9qn4j\" (UID: \"f6ddad48-94e1-479b-951c-ebf6be358f2c\") " pod="openshift-ovn-kubernetes/ovnkube-node-9qn4j" Jun 12 22:21:00.346899 ip-10-0-128-134 kubenswrapper[2559]: I0612 22:21:00.346719 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/5aa3f5cb-8c34-46e9-8b09-8af6c2318dce-device-dir\") pod \"aws-ebs-csi-driver-node-hbdkt\" (UID: \"5aa3f5cb-8c34-46e9-8b09-8af6c2318dce\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-hbdkt" Jun 12 22:21:00.346899 ip-10-0-128-134 kubenswrapper[2559]: I0612 22:21:00.346743 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/d01cad7b-32bc-45f8-8c98-057a798e0866-serviceca\") pod \"node-ca-bghrt\" (UID: \"d01cad7b-32bc-45f8-8c98-057a798e0866\") " pod="openshift-image-registry/node-ca-bghrt" Jun 12 22:21:00.346899 ip-10-0-128-134 kubenswrapper[2559]: I0612 22:21:00.346765 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/f6ddad48-94e1-479b-951c-ebf6be358f2c-host-run-netns\") pod \"ovnkube-node-9qn4j\" (UID: \"f6ddad48-94e1-479b-951c-ebf6be358f2c\") " pod="openshift-ovn-kubernetes/ovnkube-node-9qn4j" Jun 12 22:21:00.346899 ip-10-0-128-134 kubenswrapper[2559]: I0612 22:21:00.346805 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-fb2l5\" (UniqueName: \"kubernetes.io/projected/f6ddad48-94e1-479b-951c-ebf6be358f2c-kube-api-access-fb2l5\") pod \"ovnkube-node-9qn4j\" (UID: \"f6ddad48-94e1-479b-951c-ebf6be358f2c\") " pod="openshift-ovn-kubernetes/ovnkube-node-9qn4j" Jun 12 22:21:00.346899 ip-10-0-128-134 kubenswrapper[2559]: I0612 22:21:00.346839 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/5aa3f5cb-8c34-46e9-8b09-8af6c2318dce-sys-fs\") pod \"aws-ebs-csi-driver-node-hbdkt\" (UID: \"5aa3f5cb-8c34-46e9-8b09-8af6c2318dce\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-hbdkt" Jun 12 22:21:00.346899 ip-10-0-128-134 kubenswrapper[2559]: I0612 22:21:00.346863 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-gm8zg\" (UniqueName: \"kubernetes.io/projected/5aa3f5cb-8c34-46e9-8b09-8af6c2318dce-kube-api-access-gm8zg\") pod \"aws-ebs-csi-driver-node-hbdkt\" (UID: \"5aa3f5cb-8c34-46e9-8b09-8af6c2318dce\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-hbdkt" Jun 12 22:21:00.348170 ip-10-0-128-134 kubenswrapper[2559]: I0612 22:21:00.346908 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/843f3267-327c-4702-9510-3ceb40add4e1-hosts-file\") pod \"node-resolver-qdtqn\" (UID: \"843f3267-327c-4702-9510-3ceb40add4e1\") " pod="openshift-dns/node-resolver-qdtqn" Jun 12 22:21:00.348170 ip-10-0-128-134 kubenswrapper[2559]: I0612 22:21:00.346938 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/843f3267-327c-4702-9510-3ceb40add4e1-tmp-dir\") pod \"node-resolver-qdtqn\" (UID: \"843f3267-327c-4702-9510-3ceb40add4e1\") " pod="openshift-dns/node-resolver-qdtqn" Jun 12 22:21:00.348170 ip-10-0-128-134 kubenswrapper[2559]: I0612 22:21:00.346967 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-p7h9q\" (UniqueName: \"kubernetes.io/projected/843f3267-327c-4702-9510-3ceb40add4e1-kube-api-access-p7h9q\") pod \"node-resolver-qdtqn\" (UID: \"843f3267-327c-4702-9510-3ceb40add4e1\") " pod="openshift-dns/node-resolver-qdtqn" Jun 12 22:21:00.348170 ip-10-0-128-134 kubenswrapper[2559]: I0612 22:21:00.347006 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/2fe08918-3efc-4000-a321-8b319ead517c-konnectivity-ca\") pod \"konnectivity-agent-f7h79\" (UID: \"2fe08918-3efc-4000-a321-8b319ead517c\") " pod="kube-system/konnectivity-agent-f7h79" Jun 12 22:21:00.348170 ip-10-0-128-134 kubenswrapper[2559]: I0612 22:21:00.347030 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/f6ddad48-94e1-479b-951c-ebf6be358f2c-log-socket\") pod \"ovnkube-node-9qn4j\" (UID: \"f6ddad48-94e1-479b-951c-ebf6be358f2c\") " pod="openshift-ovn-kubernetes/ovnkube-node-9qn4j" Jun 12 22:21:00.348170 ip-10-0-128-134 kubenswrapper[2559]: I0612 22:21:00.347054 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/f6ddad48-94e1-479b-951c-ebf6be358f2c-host-cni-bin\") pod \"ovnkube-node-9qn4j\" (UID: \"f6ddad48-94e1-479b-951c-ebf6be358f2c\") " pod="openshift-ovn-kubernetes/ovnkube-node-9qn4j" Jun 12 22:21:00.348170 ip-10-0-128-134 kubenswrapper[2559]: I0612 22:21:00.347076 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/5aa3f5cb-8c34-46e9-8b09-8af6c2318dce-socket-dir\") pod \"aws-ebs-csi-driver-node-hbdkt\" (UID: \"5aa3f5cb-8c34-46e9-8b09-8af6c2318dce\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-hbdkt" Jun 12 22:21:00.348170 ip-10-0-128-134 kubenswrapper[2559]: I0612 22:21:00.347100 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/5aa3f5cb-8c34-46e9-8b09-8af6c2318dce-etc-selinux\") pod \"aws-ebs-csi-driver-node-hbdkt\" (UID: \"5aa3f5cb-8c34-46e9-8b09-8af6c2318dce\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-hbdkt" Jun 12 22:21:00.348170 ip-10-0-128-134 kubenswrapper[2559]: I0612 22:21:00.347120 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/2fe08918-3efc-4000-a321-8b319ead517c-agent-certs\") pod \"konnectivity-agent-f7h79\" (UID: \"2fe08918-3efc-4000-a321-8b319ead517c\") " pod="kube-system/konnectivity-agent-f7h79" Jun 12 22:21:00.348170 ip-10-0-128-134 kubenswrapper[2559]: I0612 22:21:00.347154 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/fcd15bde-b438-4c03-a474-3424cfb17daa-host-slash\") pod \"iptables-alerter-s2zxg\" (UID: \"fcd15bde-b438-4c03-a474-3424cfb17daa\") " pod="openshift-network-operator/iptables-alerter-s2zxg" Jun 12 22:21:00.348170 ip-10-0-128-134 kubenswrapper[2559]: I0612 22:21:00.347769 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-d9psx" Jun 12 22:21:00.348170 ip-10-0-128-134 kubenswrapper[2559]: E0612 22:21:00.347837 2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-d9psx" podUID="12fe1273-445c-4710-8579-38c99d08c036" Jun 12 22:21:00.348170 ip-10-0-128-134 kubenswrapper[2559]: I0612 22:21:00.347881 2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"default-cni-sysctl-allowlist\"" Jun 12 22:21:00.348839 ip-10-0-128-134 kubenswrapper[2559]: I0612 22:21:00.348212 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"multus-ancillary-tools-dockercfg-wfltn\"" Jun 12 22:21:00.348839 ip-10-0-128-134 kubenswrapper[2559]: I0612 22:21:00.348284 2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"whereabouts-flatfile-config\"" Jun 12 22:21:00.348839 ip-10-0-128-134 kubenswrapper[2559]: I0612 22:21:00.348645 2559 reflector.go:439] "Caches populated" logger="kubernetes.io/kubelet-serving" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162" Jun 12 22:21:00.350055 ip-10-0-128-134 kubenswrapper[2559]: I0612 22:21:00.350036 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-c9wls" Jun 12 22:21:00.350660 ip-10-0-128-134 kubenswrapper[2559]: E0612 22:21:00.350634 2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-c9wls" podUID="d4d1b0d2-aea6-421c-91e9-f74e3b7a4c6a" Jun 12 22:21:00.352500 ip-10-0-128-134 kubenswrapper[2559]: I0612 22:21:00.352479 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-zdjjt" Jun 12 22:21:00.352591 ip-10-0-128-134 kubenswrapper[2559]: E0612 22:21:00.352550 2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-zdjjt" podUID="73bd91e1-b3e8-495c-990c-3ab079745247" Jun 12 22:21:00.381644 ip-10-0-128-134 kubenswrapper[2559]: I0612 22:21:00.381619 2559 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kubelet-serving" csr="csr-fph5c" Jun 12 22:21:00.389639 ip-10-0-128-134 kubenswrapper[2559]: I0612 22:21:00.389614 2559 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kubelet-serving" csr="csr-fph5c" Jun 12 22:21:00.408568 ip-10-0-128-134 kubenswrapper[2559]: I0612 22:21:00.408524 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-128-134.ec2.internal" event={"ID":"6d3e86596363af41e954bcae3f7c03e7","Type":"ContainerStarted","Data":"6248ef6db82a4416693392b31144e266a863470ce330e0837859f0ee37bd0f33"} Jun 12 22:21:00.409646 ip-10-0-128-134 kubenswrapper[2559]: I0612 22:21:00.409619 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-128-134.ec2.internal" event={"ID":"be987faa4fc50bfe0d9fa8445913d866","Type":"ContainerStarted","Data":"ae91176e996e6efea0691a31ed3541efd75782862dea34b29586bd334cd80952"} Jun 12 22:21:00.436095 ip-10-0-128-134 kubenswrapper[2559]: I0612 22:21:00.436064 2559 desired_state_of_world_populator.go:154] "Finished populating initial desired state of world" Jun 12 22:21:00.448209 ip-10-0-128-134 kubenswrapper[2559]: I0612 22:21:00.448184 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-p7h9q\" (UniqueName: \"kubernetes.io/projected/843f3267-327c-4702-9510-3ceb40add4e1-kube-api-access-p7h9q\") pod \"node-resolver-qdtqn\" (UID: \"843f3267-327c-4702-9510-3ceb40add4e1\") " pod="openshift-dns/node-resolver-qdtqn" Jun 12 22:21:00.448366 ip-10-0-128-134 kubenswrapper[2559]: I0612 22:21:00.448216 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/73bd91e1-b3e8-495c-990c-3ab079745247-original-pull-secret\") pod \"global-pull-secret-syncer-zdjjt\" (UID: \"73bd91e1-b3e8-495c-990c-3ab079745247\") " pod="kube-system/global-pull-secret-syncer-zdjjt" Jun 12 22:21:00.448366 ip-10-0-128-134 kubenswrapper[2559]: I0612 22:21:00.448245 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/ca559a81-c5e6-4ba7-adc1-7ddafc57941a-host-run-k8s-cni-cncf-io\") pod \"multus-bzp8z\" (UID: \"ca559a81-c5e6-4ba7-adc1-7ddafc57941a\") " pod="openshift-multus/multus-bzp8z" Jun 12 22:21:00.448366 ip-10-0-128-134 kubenswrapper[2559]: I0612 22:21:00.448270 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/843f3267-327c-4702-9510-3ceb40add4e1-tmp-dir\") pod \"node-resolver-qdtqn\" (UID: \"843f3267-327c-4702-9510-3ceb40add4e1\") " pod="openshift-dns/node-resolver-qdtqn" Jun 12 22:21:00.448366 ip-10-0-128-134 kubenswrapper[2559]: I0612 22:21:00.448295 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/35a1db5d-f311-4962-9835-e21409e67513-etc-sysconfig\") pod \"tuned-kbvj8\" (UID: \"35a1db5d-f311-4962-9835-e21409e67513\") " pod="openshift-cluster-node-tuning-operator/tuned-kbvj8" Jun 12 22:21:00.448366 ip-10-0-128-134 kubenswrapper[2559]: I0612 22:21:00.448347 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/35a1db5d-f311-4962-9835-e21409e67513-lib-modules\") pod \"tuned-kbvj8\" (UID: \"35a1db5d-f311-4962-9835-e21409e67513\") " pod="openshift-cluster-node-tuning-operator/tuned-kbvj8" Jun 12 22:21:00.448624 ip-10-0-128-134 kubenswrapper[2559]: I0612 22:21:00.448381 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/ca559a81-c5e6-4ba7-adc1-7ddafc57941a-cnibin\") pod \"multus-bzp8z\" (UID: \"ca559a81-c5e6-4ba7-adc1-7ddafc57941a\") " pod="openshift-multus/multus-bzp8z" Jun 12 22:21:00.448624 ip-10-0-128-134 kubenswrapper[2559]: I0612 22:21:00.448406 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/ca559a81-c5e6-4ba7-adc1-7ddafc57941a-host-var-lib-kubelet\") pod \"multus-bzp8z\" (UID: \"ca559a81-c5e6-4ba7-adc1-7ddafc57941a\") " pod="openshift-multus/multus-bzp8z" Jun 12 22:21:00.448624 ip-10-0-128-134 kubenswrapper[2559]: I0612 22:21:00.448428 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/ca559a81-c5e6-4ba7-adc1-7ddafc57941a-multus-conf-dir\") pod \"multus-bzp8z\" (UID: \"ca559a81-c5e6-4ba7-adc1-7ddafc57941a\") " pod="openshift-multus/multus-bzp8z" Jun 12 22:21:00.448624 ip-10-0-128-134 kubenswrapper[2559]: I0612 22:21:00.448564 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/2dd3c6ba-dc0c-4b3e-92b7-94a6b0999c26-system-cni-dir\") pod \"multus-additional-cni-plugins-6fjft\" (UID: \"2dd3c6ba-dc0c-4b3e-92b7-94a6b0999c26\") " pod="openshift-multus/multus-additional-cni-plugins-6fjft" Jun 12 22:21:00.448624 ip-10-0-128-134 kubenswrapper[2559]: I0612 22:21:00.448605 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/f6ddad48-94e1-479b-951c-ebf6be358f2c-host-cni-bin\") pod \"ovnkube-node-9qn4j\" (UID: \"f6ddad48-94e1-479b-951c-ebf6be358f2c\") " pod="openshift-ovn-kubernetes/ovnkube-node-9qn4j" Jun 12 22:21:00.448849 ip-10-0-128-134 kubenswrapper[2559]: I0612 22:21:00.448648 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/5aa3f5cb-8c34-46e9-8b09-8af6c2318dce-etc-selinux\") pod \"aws-ebs-csi-driver-node-hbdkt\" (UID: \"5aa3f5cb-8c34-46e9-8b09-8af6c2318dce\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-hbdkt" Jun 12 22:21:00.448849 ip-10-0-128-134 kubenswrapper[2559]: I0612 22:21:00.448675 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/f6ddad48-94e1-479b-951c-ebf6be358f2c-host-cni-bin\") pod \"ovnkube-node-9qn4j\" (UID: \"f6ddad48-94e1-479b-951c-ebf6be358f2c\") " pod="openshift-ovn-kubernetes/ovnkube-node-9qn4j" Jun 12 22:21:00.448849 ip-10-0-128-134 kubenswrapper[2559]: I0612 22:21:00.448680 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/ca559a81-c5e6-4ba7-adc1-7ddafc57941a-multus-socket-dir-parent\") pod \"multus-bzp8z\" (UID: \"ca559a81-c5e6-4ba7-adc1-7ddafc57941a\") " pod="openshift-multus/multus-bzp8z" Jun 12 22:21:00.448849 ip-10-0-128-134 kubenswrapper[2559]: I0612 22:21:00.448645 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/843f3267-327c-4702-9510-3ceb40add4e1-tmp-dir\") pod \"node-resolver-qdtqn\" (UID: \"843f3267-327c-4702-9510-3ceb40add4e1\") " pod="openshift-dns/node-resolver-qdtqn" Jun 12 22:21:00.448849 ip-10-0-128-134 kubenswrapper[2559]: I0612 22:21:00.448714 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/ca559a81-c5e6-4ba7-adc1-7ddafc57941a-host-var-lib-cni-multus\") pod \"multus-bzp8z\" (UID: \"ca559a81-c5e6-4ba7-adc1-7ddafc57941a\") " pod="openshift-multus/multus-bzp8z" Jun 12 22:21:00.448849 ip-10-0-128-134 kubenswrapper[2559]: I0612 22:21:00.448719 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/5aa3f5cb-8c34-46e9-8b09-8af6c2318dce-etc-selinux\") pod \"aws-ebs-csi-driver-node-hbdkt\" (UID: \"5aa3f5cb-8c34-46e9-8b09-8af6c2318dce\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-hbdkt" Jun 12 22:21:00.448849 ip-10-0-128-134 kubenswrapper[2559]: I0612 22:21:00.448745 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/ca559a81-c5e6-4ba7-adc1-7ddafc57941a-multus-daemon-config\") pod \"multus-bzp8z\" (UID: \"ca559a81-c5e6-4ba7-adc1-7ddafc57941a\") " pod="openshift-multus/multus-bzp8z" Jun 12 22:21:00.448849 ip-10-0-128-134 kubenswrapper[2559]: I0612 22:21:00.448767 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/ca559a81-c5e6-4ba7-adc1-7ddafc57941a-host-run-multus-certs\") pod \"multus-bzp8z\" (UID: \"ca559a81-c5e6-4ba7-adc1-7ddafc57941a\") " pod="openshift-multus/multus-bzp8z" Jun 12 22:21:00.448849 ip-10-0-128-134 kubenswrapper[2559]: I0612 22:21:00.448802 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/2dd3c6ba-dc0c-4b3e-92b7-94a6b0999c26-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-6fjft\" (UID: \"2dd3c6ba-dc0c-4b3e-92b7-94a6b0999c26\") " pod="openshift-multus/multus-additional-cni-plugins-6fjft" Jun 12 22:21:00.448849 ip-10-0-128-134 kubenswrapper[2559]: I0612 22:21:00.448827 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/f6ddad48-94e1-479b-951c-ebf6be358f2c-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-9qn4j\" (UID: \"f6ddad48-94e1-479b-951c-ebf6be358f2c\") " pod="openshift-ovn-kubernetes/ovnkube-node-9qn4j" Jun 12 22:21:00.449288 ip-10-0-128-134 kubenswrapper[2559]: I0612 22:21:00.448866 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/f6ddad48-94e1-479b-951c-ebf6be358f2c-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-9qn4j\" (UID: \"f6ddad48-94e1-479b-951c-ebf6be358f2c\") " pod="openshift-ovn-kubernetes/ovnkube-node-9qn4j" Jun 12 22:21:00.449288 ip-10-0-128-134 kubenswrapper[2559]: I0612 22:21:00.448870 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/35a1db5d-f311-4962-9835-e21409e67513-etc-modprobe-d\") pod \"tuned-kbvj8\" (UID: \"35a1db5d-f311-4962-9835-e21409e67513\") " pod="openshift-cluster-node-tuning-operator/tuned-kbvj8" Jun 12 22:21:00.449288 ip-10-0-128-134 kubenswrapper[2559]: I0612 22:21:00.448901 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/2dd3c6ba-dc0c-4b3e-92b7-94a6b0999c26-os-release\") pod \"multus-additional-cni-plugins-6fjft\" (UID: \"2dd3c6ba-dc0c-4b3e-92b7-94a6b0999c26\") " pod="openshift-multus/multus-additional-cni-plugins-6fjft" Jun 12 22:21:00.449288 ip-10-0-128-134 kubenswrapper[2559]: I0612 22:21:00.448927 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/f6ddad48-94e1-479b-951c-ebf6be358f2c-systemd-units\") pod \"ovnkube-node-9qn4j\" (UID: \"f6ddad48-94e1-479b-951c-ebf6be358f2c\") " pod="openshift-ovn-kubernetes/ovnkube-node-9qn4j" Jun 12 22:21:00.449288 ip-10-0-128-134 kubenswrapper[2559]: I0612 22:21:00.448948 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/f6ddad48-94e1-479b-951c-ebf6be358f2c-host-slash\") pod \"ovnkube-node-9qn4j\" (UID: \"f6ddad48-94e1-479b-951c-ebf6be358f2c\") " pod="openshift-ovn-kubernetes/ovnkube-node-9qn4j" Jun 12 22:21:00.449288 ip-10-0-128-134 kubenswrapper[2559]: I0612 22:21:00.448970 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/f6ddad48-94e1-479b-951c-ebf6be358f2c-host-run-ovn-kubernetes\") pod \"ovnkube-node-9qn4j\" (UID: \"f6ddad48-94e1-479b-951c-ebf6be358f2c\") " pod="openshift-ovn-kubernetes/ovnkube-node-9qn4j" Jun 12 22:21:00.449288 ip-10-0-128-134 kubenswrapper[2559]: I0612 22:21:00.448986 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/5aa3f5cb-8c34-46e9-8b09-8af6c2318dce-registration-dir\") pod \"aws-ebs-csi-driver-node-hbdkt\" (UID: \"5aa3f5cb-8c34-46e9-8b09-8af6c2318dce\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-hbdkt" Jun 12 22:21:00.449288 ip-10-0-128-134 kubenswrapper[2559]: I0612 22:21:00.449001 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/f6ddad48-94e1-479b-951c-ebf6be358f2c-systemd-units\") pod \"ovnkube-node-9qn4j\" (UID: \"f6ddad48-94e1-479b-951c-ebf6be358f2c\") " pod="openshift-ovn-kubernetes/ovnkube-node-9qn4j" Jun 12 22:21:00.449288 ip-10-0-128-134 kubenswrapper[2559]: I0612 22:21:00.449004 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/ca559a81-c5e6-4ba7-adc1-7ddafc57941a-hostroot\") pod \"multus-bzp8z\" (UID: \"ca559a81-c5e6-4ba7-adc1-7ddafc57941a\") " pod="openshift-multus/multus-bzp8z" Jun 12 22:21:00.449288 ip-10-0-128-134 kubenswrapper[2559]: I0612 22:21:00.449068 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/f6ddad48-94e1-479b-951c-ebf6be358f2c-host-slash\") pod \"ovnkube-node-9qn4j\" (UID: \"f6ddad48-94e1-479b-951c-ebf6be358f2c\") " pod="openshift-ovn-kubernetes/ovnkube-node-9qn4j" Jun 12 22:21:00.449288 ip-10-0-128-134 kubenswrapper[2559]: I0612 22:21:00.449086 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/f6ddad48-94e1-479b-951c-ebf6be358f2c-host-run-ovn-kubernetes\") pod \"ovnkube-node-9qn4j\" (UID: \"f6ddad48-94e1-479b-951c-ebf6be358f2c\") " pod="openshift-ovn-kubernetes/ovnkube-node-9qn4j" Jun 12 22:21:00.449288 ip-10-0-128-134 kubenswrapper[2559]: I0612 22:21:00.449110 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/5aa3f5cb-8c34-46e9-8b09-8af6c2318dce-registration-dir\") pod \"aws-ebs-csi-driver-node-hbdkt\" (UID: \"5aa3f5cb-8c34-46e9-8b09-8af6c2318dce\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-hbdkt" Jun 12 22:21:00.449288 ip-10-0-128-134 kubenswrapper[2559]: I0612 22:21:00.449132 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-f7z4m\" (UniqueName: \"kubernetes.io/projected/2dd3c6ba-dc0c-4b3e-92b7-94a6b0999c26-kube-api-access-f7z4m\") pod \"multus-additional-cni-plugins-6fjft\" (UID: \"2dd3c6ba-dc0c-4b3e-92b7-94a6b0999c26\") " pod="openshift-multus/multus-additional-cni-plugins-6fjft" Jun 12 22:21:00.449288 ip-10-0-128-134 kubenswrapper[2559]: I0612 22:21:00.449165 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/f6ddad48-94e1-479b-951c-ebf6be358f2c-etc-openvswitch\") pod \"ovnkube-node-9qn4j\" (UID: \"f6ddad48-94e1-479b-951c-ebf6be358f2c\") " pod="openshift-ovn-kubernetes/ovnkube-node-9qn4j" Jun 12 22:21:00.449288 ip-10-0-128-134 kubenswrapper[2559]: I0612 22:21:00.449191 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/f6ddad48-94e1-479b-951c-ebf6be358f2c-host-cni-netd\") pod \"ovnkube-node-9qn4j\" (UID: \"f6ddad48-94e1-479b-951c-ebf6be358f2c\") " pod="openshift-ovn-kubernetes/ovnkube-node-9qn4j" Jun 12 22:21:00.449288 ip-10-0-128-134 kubenswrapper[2559]: I0612 22:21:00.449217 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/73bd91e1-b3e8-495c-990c-3ab079745247-dbus\") pod \"global-pull-secret-syncer-zdjjt\" (UID: \"73bd91e1-b3e8-495c-990c-3ab079745247\") " pod="kube-system/global-pull-secret-syncer-zdjjt" Jun 12 22:21:00.449288 ip-10-0-128-134 kubenswrapper[2559]: I0612 22:21:00.449221 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/f6ddad48-94e1-479b-951c-ebf6be358f2c-etc-openvswitch\") pod \"ovnkube-node-9qn4j\" (UID: \"f6ddad48-94e1-479b-951c-ebf6be358f2c\") " pod="openshift-ovn-kubernetes/ovnkube-node-9qn4j" Jun 12 22:21:00.450071 ip-10-0-128-134 kubenswrapper[2559]: I0612 22:21:00.449244 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/d01cad7b-32bc-45f8-8c98-057a798e0866-host\") pod \"node-ca-bghrt\" (UID: \"d01cad7b-32bc-45f8-8c98-057a798e0866\") " pod="openshift-image-registry/node-ca-bghrt" Jun 12 22:21:00.450071 ip-10-0-128-134 kubenswrapper[2559]: I0612 22:21:00.449259 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/f6ddad48-94e1-479b-951c-ebf6be358f2c-host-cni-netd\") pod \"ovnkube-node-9qn4j\" (UID: \"f6ddad48-94e1-479b-951c-ebf6be358f2c\") " pod="openshift-ovn-kubernetes/ovnkube-node-9qn4j" Jun 12 22:21:00.450071 ip-10-0-128-134 kubenswrapper[2559]: I0612 22:21:00.449301 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/f6ddad48-94e1-479b-951c-ebf6be358f2c-ovnkube-config\") pod \"ovnkube-node-9qn4j\" (UID: \"f6ddad48-94e1-479b-951c-ebf6be358f2c\") " pod="openshift-ovn-kubernetes/ovnkube-node-9qn4j" Jun 12 22:21:00.450071 ip-10-0-128-134 kubenswrapper[2559]: I0612 22:21:00.449325 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/fcd15bde-b438-4c03-a474-3424cfb17daa-iptables-alerter-script\") pod \"iptables-alerter-s2zxg\" (UID: \"fcd15bde-b438-4c03-a474-3424cfb17daa\") " pod="openshift-network-operator/iptables-alerter-s2zxg" Jun 12 22:21:00.450071 ip-10-0-128-134 kubenswrapper[2559]: I0612 22:21:00.449342 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-q9hxt\" (UniqueName: \"kubernetes.io/projected/fcd15bde-b438-4c03-a474-3424cfb17daa-kube-api-access-q9hxt\") pod \"iptables-alerter-s2zxg\" (UID: \"fcd15bde-b438-4c03-a474-3424cfb17daa\") " pod="openshift-network-operator/iptables-alerter-s2zxg" Jun 12 22:21:00.450071 ip-10-0-128-134 kubenswrapper[2559]: I0612 22:21:00.449364 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/f6ddad48-94e1-479b-951c-ebf6be358f2c-run-systemd\") pod \"ovnkube-node-9qn4j\" (UID: \"f6ddad48-94e1-479b-951c-ebf6be358f2c\") " pod="openshift-ovn-kubernetes/ovnkube-node-9qn4j" Jun 12 22:21:00.450071 ip-10-0-128-134 kubenswrapper[2559]: I0612 22:21:00.449301 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/d01cad7b-32bc-45f8-8c98-057a798e0866-host\") pod \"node-ca-bghrt\" (UID: \"d01cad7b-32bc-45f8-8c98-057a798e0866\") " pod="openshift-image-registry/node-ca-bghrt" Jun 12 22:21:00.450071 ip-10-0-128-134 kubenswrapper[2559]: I0612 22:21:00.449388 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/f6ddad48-94e1-479b-951c-ebf6be358f2c-var-lib-openvswitch\") pod \"ovnkube-node-9qn4j\" (UID: \"f6ddad48-94e1-479b-951c-ebf6be358f2c\") " pod="openshift-ovn-kubernetes/ovnkube-node-9qn4j" Jun 12 22:21:00.450071 ip-10-0-128-134 kubenswrapper[2559]: I0612 22:21:00.449418 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/f6ddad48-94e1-479b-951c-ebf6be358f2c-run-openvswitch\") pod \"ovnkube-node-9qn4j\" (UID: \"f6ddad48-94e1-479b-951c-ebf6be358f2c\") " pod="openshift-ovn-kubernetes/ovnkube-node-9qn4j" Jun 12 22:21:00.450071 ip-10-0-128-134 kubenswrapper[2559]: I0612 22:21:00.449461 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/5aa3f5cb-8c34-46e9-8b09-8af6c2318dce-sys-fs\") pod \"aws-ebs-csi-driver-node-hbdkt\" (UID: \"5aa3f5cb-8c34-46e9-8b09-8af6c2318dce\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-hbdkt" Jun 12 22:21:00.450071 ip-10-0-128-134 kubenswrapper[2559]: I0612 22:21:00.449487 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/35a1db5d-f311-4962-9835-e21409e67513-etc-kubernetes\") pod \"tuned-kbvj8\" (UID: \"35a1db5d-f311-4962-9835-e21409e67513\") " pod="openshift-cluster-node-tuning-operator/tuned-kbvj8" Jun 12 22:21:00.450071 ip-10-0-128-134 kubenswrapper[2559]: I0612 22:21:00.449495 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/f6ddad48-94e1-479b-951c-ebf6be358f2c-run-systemd\") pod \"ovnkube-node-9qn4j\" (UID: \"f6ddad48-94e1-479b-951c-ebf6be358f2c\") " pod="openshift-ovn-kubernetes/ovnkube-node-9qn4j" Jun 12 22:21:00.450071 ip-10-0-128-134 kubenswrapper[2559]: I0612 22:21:00.449507 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/f6ddad48-94e1-479b-951c-ebf6be358f2c-var-lib-openvswitch\") pod \"ovnkube-node-9qn4j\" (UID: \"f6ddad48-94e1-479b-951c-ebf6be358f2c\") " pod="openshift-ovn-kubernetes/ovnkube-node-9qn4j" Jun 12 22:21:00.450071 ip-10-0-128-134 kubenswrapper[2559]: I0612 22:21:00.449510 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/35a1db5d-f311-4962-9835-e21409e67513-etc-sysctl-conf\") pod \"tuned-kbvj8\" (UID: \"35a1db5d-f311-4962-9835-e21409e67513\") " pod="openshift-cluster-node-tuning-operator/tuned-kbvj8" Jun 12 22:21:00.450071 ip-10-0-128-134 kubenswrapper[2559]: I0612 22:21:00.449553 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/d01cad7b-32bc-45f8-8c98-057a798e0866-serviceca\") pod \"node-ca-bghrt\" (UID: \"d01cad7b-32bc-45f8-8c98-057a798e0866\") " pod="openshift-image-registry/node-ca-bghrt" Jun 12 22:21:00.450071 ip-10-0-128-134 kubenswrapper[2559]: I0612 22:21:00.449563 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/f6ddad48-94e1-479b-951c-ebf6be358f2c-run-openvswitch\") pod \"ovnkube-node-9qn4j\" (UID: \"f6ddad48-94e1-479b-951c-ebf6be358f2c\") " pod="openshift-ovn-kubernetes/ovnkube-node-9qn4j" Jun 12 22:21:00.450071 ip-10-0-128-134 kubenswrapper[2559]: I0612 22:21:00.449570 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/f6ddad48-94e1-479b-951c-ebf6be358f2c-host-run-netns\") pod \"ovnkube-node-9qn4j\" (UID: \"f6ddad48-94e1-479b-951c-ebf6be358f2c\") " pod="openshift-ovn-kubernetes/ovnkube-node-9qn4j" Jun 12 22:21:00.450846 ip-10-0-128-134 kubenswrapper[2559]: I0612 22:21:00.449595 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-fb2l5\" (UniqueName: \"kubernetes.io/projected/f6ddad48-94e1-479b-951c-ebf6be358f2c-kube-api-access-fb2l5\") pod \"ovnkube-node-9qn4j\" (UID: \"f6ddad48-94e1-479b-951c-ebf6be358f2c\") " pod="openshift-ovn-kubernetes/ovnkube-node-9qn4j" Jun 12 22:21:00.450846 ip-10-0-128-134 kubenswrapper[2559]: I0612 22:21:00.449596 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/f6ddad48-94e1-479b-951c-ebf6be358f2c-host-run-netns\") pod \"ovnkube-node-9qn4j\" (UID: \"f6ddad48-94e1-479b-951c-ebf6be358f2c\") " pod="openshift-ovn-kubernetes/ovnkube-node-9qn4j" Jun 12 22:21:00.450846 ip-10-0-128-134 kubenswrapper[2559]: I0612 22:21:00.449642 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/5aa3f5cb-8c34-46e9-8b09-8af6c2318dce-sys-fs\") pod \"aws-ebs-csi-driver-node-hbdkt\" (UID: \"5aa3f5cb-8c34-46e9-8b09-8af6c2318dce\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-hbdkt" Jun 12 22:21:00.450846 ip-10-0-128-134 kubenswrapper[2559]: I0612 22:21:00.449670 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/35a1db5d-f311-4962-9835-e21409e67513-sys\") pod \"tuned-kbvj8\" (UID: \"35a1db5d-f311-4962-9835-e21409e67513\") " pod="openshift-cluster-node-tuning-operator/tuned-kbvj8" Jun 12 22:21:00.450846 ip-10-0-128-134 kubenswrapper[2559]: I0612 22:21:00.449696 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/35a1db5d-f311-4962-9835-e21409e67513-var-lib-kubelet\") pod \"tuned-kbvj8\" (UID: \"35a1db5d-f311-4962-9835-e21409e67513\") " pod="openshift-cluster-node-tuning-operator/tuned-kbvj8" Jun 12 22:21:00.450846 ip-10-0-128-134 kubenswrapper[2559]: I0612 22:21:00.449718 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-57cq2\" (UniqueName: \"kubernetes.io/projected/35a1db5d-f311-4962-9835-e21409e67513-kube-api-access-57cq2\") pod \"tuned-kbvj8\" (UID: \"35a1db5d-f311-4962-9835-e21409e67513\") " pod="openshift-cluster-node-tuning-operator/tuned-kbvj8" Jun 12 22:21:00.450846 ip-10-0-128-134 kubenswrapper[2559]: I0612 22:21:00.449742 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xf2zc\" (UniqueName: \"kubernetes.io/projected/12fe1273-445c-4710-8579-38c99d08c036-kube-api-access-xf2zc\") pod \"network-metrics-daemon-d9psx\" (UID: \"12fe1273-445c-4710-8579-38c99d08c036\") " pod="openshift-multus/network-metrics-daemon-d9psx" Jun 12 22:21:00.450846 ip-10-0-128-134 kubenswrapper[2559]: I0612 22:21:00.449774 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/ca559a81-c5e6-4ba7-adc1-7ddafc57941a-cni-binary-copy\") pod \"multus-bzp8z\" (UID: \"ca559a81-c5e6-4ba7-adc1-7ddafc57941a\") " pod="openshift-multus/multus-bzp8z" Jun 12 22:21:00.450846 ip-10-0-128-134 kubenswrapper[2559]: I0612 22:21:00.449798 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/2fe08918-3efc-4000-a321-8b319ead517c-konnectivity-ca\") pod \"konnectivity-agent-f7h79\" (UID: \"2fe08918-3efc-4000-a321-8b319ead517c\") " pod="kube-system/konnectivity-agent-f7h79" Jun 12 22:21:00.450846 ip-10-0-128-134 kubenswrapper[2559]: I0612 22:21:00.449822 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/f6ddad48-94e1-479b-951c-ebf6be358f2c-log-socket\") pod \"ovnkube-node-9qn4j\" (UID: \"f6ddad48-94e1-479b-951c-ebf6be358f2c\") " pod="openshift-ovn-kubernetes/ovnkube-node-9qn4j" Jun 12 22:21:00.450846 ip-10-0-128-134 kubenswrapper[2559]: I0612 22:21:00.449845 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/5aa3f5cb-8c34-46e9-8b09-8af6c2318dce-socket-dir\") pod \"aws-ebs-csi-driver-node-hbdkt\" (UID: \"5aa3f5cb-8c34-46e9-8b09-8af6c2318dce\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-hbdkt" Jun 12 22:21:00.450846 ip-10-0-128-134 kubenswrapper[2559]: I0612 22:21:00.449869 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/ca559a81-c5e6-4ba7-adc1-7ddafc57941a-system-cni-dir\") pod \"multus-bzp8z\" (UID: \"ca559a81-c5e6-4ba7-adc1-7ddafc57941a\") " pod="openshift-multus/multus-bzp8z" Jun 12 22:21:00.450846 ip-10-0-128-134 kubenswrapper[2559]: I0612 22:21:00.449892 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/ca559a81-c5e6-4ba7-adc1-7ddafc57941a-multus-cni-dir\") pod \"multus-bzp8z\" (UID: \"ca559a81-c5e6-4ba7-adc1-7ddafc57941a\") " pod="openshift-multus/multus-bzp8z" Jun 12 22:21:00.450846 ip-10-0-128-134 kubenswrapper[2559]: I0612 22:21:00.449912 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/fcd15bde-b438-4c03-a474-3424cfb17daa-iptables-alerter-script\") pod \"iptables-alerter-s2zxg\" (UID: \"fcd15bde-b438-4c03-a474-3424cfb17daa\") " pod="openshift-network-operator/iptables-alerter-s2zxg" Jun 12 22:21:00.450846 ip-10-0-128-134 kubenswrapper[2559]: I0612 22:21:00.449916 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/ca559a81-c5e6-4ba7-adc1-7ddafc57941a-host-run-netns\") pod \"multus-bzp8z\" (UID: \"ca559a81-c5e6-4ba7-adc1-7ddafc57941a\") " pod="openshift-multus/multus-bzp8z" Jun 12 22:21:00.450846 ip-10-0-128-134 kubenswrapper[2559]: I0612 22:21:00.449929 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/f6ddad48-94e1-479b-951c-ebf6be358f2c-ovnkube-config\") pod \"ovnkube-node-9qn4j\" (UID: \"f6ddad48-94e1-479b-951c-ebf6be358f2c\") " pod="openshift-ovn-kubernetes/ovnkube-node-9qn4j" Jun 12 22:21:00.450846 ip-10-0-128-134 kubenswrapper[2559]: I0612 22:21:00.449958 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/ca559a81-c5e6-4ba7-adc1-7ddafc57941a-host-var-lib-cni-bin\") pod \"multus-bzp8z\" (UID: \"ca559a81-c5e6-4ba7-adc1-7ddafc57941a\") " pod="openshift-multus/multus-bzp8z" Jun 12 22:21:00.451702 ip-10-0-128-134 kubenswrapper[2559]: I0612 22:21:00.450007 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/f6ddad48-94e1-479b-951c-ebf6be358f2c-log-socket\") pod \"ovnkube-node-9qn4j\" (UID: \"f6ddad48-94e1-479b-951c-ebf6be358f2c\") " pod="openshift-ovn-kubernetes/ovnkube-node-9qn4j" Jun 12 22:21:00.451702 ip-10-0-128-134 kubenswrapper[2559]: I0612 22:21:00.450016 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/ca559a81-c5e6-4ba7-adc1-7ddafc57941a-etc-kubernetes\") pod \"multus-bzp8z\" (UID: \"ca559a81-c5e6-4ba7-adc1-7ddafc57941a\") " pod="openshift-multus/multus-bzp8z" Jun 12 22:21:00.451702 ip-10-0-128-134 kubenswrapper[2559]: I0612 22:21:00.450028 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/d01cad7b-32bc-45f8-8c98-057a798e0866-serviceca\") pod \"node-ca-bghrt\" (UID: \"d01cad7b-32bc-45f8-8c98-057a798e0866\") " pod="openshift-image-registry/node-ca-bghrt" Jun 12 22:21:00.451702 ip-10-0-128-134 kubenswrapper[2559]: I0612 22:21:00.450045 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/2fe08918-3efc-4000-a321-8b319ead517c-agent-certs\") pod \"konnectivity-agent-f7h79\" (UID: \"2fe08918-3efc-4000-a321-8b319ead517c\") " pod="kube-system/konnectivity-agent-f7h79" Jun 12 22:21:00.451702 ip-10-0-128-134 kubenswrapper[2559]: I0612 22:21:00.450077 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/5aa3f5cb-8c34-46e9-8b09-8af6c2318dce-socket-dir\") pod \"aws-ebs-csi-driver-node-hbdkt\" (UID: \"5aa3f5cb-8c34-46e9-8b09-8af6c2318dce\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-hbdkt" Jun 12 22:21:00.451702 ip-10-0-128-134 kubenswrapper[2559]: I0612 22:21:00.450094 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/fcd15bde-b438-4c03-a474-3424cfb17daa-host-slash\") pod \"iptables-alerter-s2zxg\" (UID: \"fcd15bde-b438-4c03-a474-3424cfb17daa\") " pod="openshift-network-operator/iptables-alerter-s2zxg" Jun 12 22:21:00.451702 ip-10-0-128-134 kubenswrapper[2559]: I0612 22:21:00.450119 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/35a1db5d-f311-4962-9835-e21409e67513-etc-systemd\") pod \"tuned-kbvj8\" (UID: \"35a1db5d-f311-4962-9835-e21409e67513\") " pod="openshift-cluster-node-tuning-operator/tuned-kbvj8" Jun 12 22:21:00.451702 ip-10-0-128-134 kubenswrapper[2559]: I0612 22:21:00.450144 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/fcd15bde-b438-4c03-a474-3424cfb17daa-host-slash\") pod \"iptables-alerter-s2zxg\" (UID: \"fcd15bde-b438-4c03-a474-3424cfb17daa\") " pod="openshift-network-operator/iptables-alerter-s2zxg" Jun 12 22:21:00.451702 ip-10-0-128-134 kubenswrapper[2559]: I0612 22:21:00.450144 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/2dd3c6ba-dc0c-4b3e-92b7-94a6b0999c26-cnibin\") pod \"multus-additional-cni-plugins-6fjft\" (UID: \"2dd3c6ba-dc0c-4b3e-92b7-94a6b0999c26\") " pod="openshift-multus/multus-additional-cni-plugins-6fjft" Jun 12 22:21:00.451702 ip-10-0-128-134 kubenswrapper[2559]: I0612 22:21:00.450168 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/f6ddad48-94e1-479b-951c-ebf6be358f2c-run-ovn\") pod \"ovnkube-node-9qn4j\" (UID: \"f6ddad48-94e1-479b-951c-ebf6be358f2c\") " pod="openshift-ovn-kubernetes/ovnkube-node-9qn4j" Jun 12 22:21:00.451702 ip-10-0-128-134 kubenswrapper[2559]: I0612 22:21:00.450183 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/f6ddad48-94e1-479b-951c-ebf6be358f2c-node-log\") pod \"ovnkube-node-9qn4j\" (UID: \"f6ddad48-94e1-479b-951c-ebf6be358f2c\") " pod="openshift-ovn-kubernetes/ovnkube-node-9qn4j" Jun 12 22:21:00.451702 ip-10-0-128-134 kubenswrapper[2559]: I0612 22:21:00.450206 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/35a1db5d-f311-4962-9835-e21409e67513-etc-tuned\") pod \"tuned-kbvj8\" (UID: \"35a1db5d-f311-4962-9835-e21409e67513\") " pod="openshift-cluster-node-tuning-operator/tuned-kbvj8" Jun 12 22:21:00.451702 ip-10-0-128-134 kubenswrapper[2559]: I0612 22:21:00.450222 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/35a1db5d-f311-4962-9835-e21409e67513-tmp\") pod \"tuned-kbvj8\" (UID: \"35a1db5d-f311-4962-9835-e21409e67513\") " pod="openshift-cluster-node-tuning-operator/tuned-kbvj8" Jun 12 22:21:00.451702 ip-10-0-128-134 kubenswrapper[2559]: I0612 22:21:00.450241 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vmtrf\" (UniqueName: \"kubernetes.io/projected/ca559a81-c5e6-4ba7-adc1-7ddafc57941a-kube-api-access-vmtrf\") pod \"multus-bzp8z\" (UID: \"ca559a81-c5e6-4ba7-adc1-7ddafc57941a\") " pod="openshift-multus/multus-bzp8z" Jun 12 22:21:00.451702 ip-10-0-128-134 kubenswrapper[2559]: I0612 22:21:00.450266 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/5aa3f5cb-8c34-46e9-8b09-8af6c2318dce-kubelet-dir\") pod \"aws-ebs-csi-driver-node-hbdkt\" (UID: \"5aa3f5cb-8c34-46e9-8b09-8af6c2318dce\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-hbdkt" Jun 12 22:21:00.451702 ip-10-0-128-134 kubenswrapper[2559]: I0612 22:21:00.450264 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/f6ddad48-94e1-479b-951c-ebf6be358f2c-node-log\") pod \"ovnkube-node-9qn4j\" (UID: \"f6ddad48-94e1-479b-951c-ebf6be358f2c\") " pod="openshift-ovn-kubernetes/ovnkube-node-9qn4j" Jun 12 22:21:00.451702 ip-10-0-128-134 kubenswrapper[2559]: I0612 22:21:00.450292 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/35a1db5d-f311-4962-9835-e21409e67513-host\") pod \"tuned-kbvj8\" (UID: \"35a1db5d-f311-4962-9835-e21409e67513\") " pod="openshift-cluster-node-tuning-operator/tuned-kbvj8" Jun 12 22:21:00.452477 ip-10-0-128-134 kubenswrapper[2559]: I0612 22:21:00.450314 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/2dd3c6ba-dc0c-4b3e-92b7-94a6b0999c26-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-6fjft\" (UID: \"2dd3c6ba-dc0c-4b3e-92b7-94a6b0999c26\") " pod="openshift-multus/multus-additional-cni-plugins-6fjft" Jun 12 22:21:00.452477 ip-10-0-128-134 kubenswrapper[2559]: I0612 22:21:00.450334 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/2fe08918-3efc-4000-a321-8b319ead517c-konnectivity-ca\") pod \"konnectivity-agent-f7h79\" (UID: \"2fe08918-3efc-4000-a321-8b319ead517c\") " pod="kube-system/konnectivity-agent-f7h79" Jun 12 22:21:00.452477 ip-10-0-128-134 kubenswrapper[2559]: I0612 22:21:00.450339 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/5aa3f5cb-8c34-46e9-8b09-8af6c2318dce-kubelet-dir\") pod \"aws-ebs-csi-driver-node-hbdkt\" (UID: \"5aa3f5cb-8c34-46e9-8b09-8af6c2318dce\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-hbdkt" Jun 12 22:21:00.452477 ip-10-0-128-134 kubenswrapper[2559]: I0612 22:21:00.450339 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/12fe1273-445c-4710-8579-38c99d08c036-metrics-certs\") pod \"network-metrics-daemon-d9psx\" (UID: \"12fe1273-445c-4710-8579-38c99d08c036\") " pod="openshift-multus/network-metrics-daemon-d9psx" Jun 12 22:21:00.452477 ip-10-0-128-134 kubenswrapper[2559]: I0612 22:21:00.450316 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/f6ddad48-94e1-479b-951c-ebf6be358f2c-run-ovn\") pod \"ovnkube-node-9qn4j\" (UID: \"f6ddad48-94e1-479b-951c-ebf6be358f2c\") " pod="openshift-ovn-kubernetes/ovnkube-node-9qn4j" Jun 12 22:21:00.452477 ip-10-0-128-134 kubenswrapper[2559]: I0612 22:21:00.450371 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/73bd91e1-b3e8-495c-990c-3ab079745247-kubelet-config\") pod \"global-pull-secret-syncer-zdjjt\" (UID: \"73bd91e1-b3e8-495c-990c-3ab079745247\") " pod="kube-system/global-pull-secret-syncer-zdjjt" Jun 12 22:21:00.452477 ip-10-0-128-134 kubenswrapper[2559]: I0612 22:21:00.450390 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/2dd3c6ba-dc0c-4b3e-92b7-94a6b0999c26-cni-binary-copy\") pod \"multus-additional-cni-plugins-6fjft\" (UID: \"2dd3c6ba-dc0c-4b3e-92b7-94a6b0999c26\") " pod="openshift-multus/multus-additional-cni-plugins-6fjft" Jun 12 22:21:00.452477 ip-10-0-128-134 kubenswrapper[2559]: I0612 22:21:00.450414 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/2dd3c6ba-dc0c-4b3e-92b7-94a6b0999c26-tuning-conf-dir\") pod \"multus-additional-cni-plugins-6fjft\" (UID: \"2dd3c6ba-dc0c-4b3e-92b7-94a6b0999c26\") " pod="openshift-multus/multus-additional-cni-plugins-6fjft" Jun 12 22:21:00.452477 ip-10-0-128-134 kubenswrapper[2559]: I0612 22:21:00.450437 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/f6ddad48-94e1-479b-951c-ebf6be358f2c-host-kubelet\") pod \"ovnkube-node-9qn4j\" (UID: \"f6ddad48-94e1-479b-951c-ebf6be358f2c\") " pod="openshift-ovn-kubernetes/ovnkube-node-9qn4j" Jun 12 22:21:00.452477 ip-10-0-128-134 kubenswrapper[2559]: I0612 22:21:00.450437 2559 swap_util.go:74] "error creating dir to test if tmpfs noswap is enabled. Assuming not supported" mount path="" error="stat /var/lib/kubelet/plugins/kubernetes.io/empty-dir: no such file or directory" Jun 12 22:21:00.452477 ip-10-0-128-134 kubenswrapper[2559]: I0612 22:21:00.450488 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/f6ddad48-94e1-479b-951c-ebf6be358f2c-env-overrides\") pod \"ovnkube-node-9qn4j\" (UID: \"f6ddad48-94e1-479b-951c-ebf6be358f2c\") " pod="openshift-ovn-kubernetes/ovnkube-node-9qn4j" Jun 12 22:21:00.452477 ip-10-0-128-134 kubenswrapper[2559]: I0612 22:21:00.450501 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/f6ddad48-94e1-479b-951c-ebf6be358f2c-host-kubelet\") pod \"ovnkube-node-9qn4j\" (UID: \"f6ddad48-94e1-479b-951c-ebf6be358f2c\") " pod="openshift-ovn-kubernetes/ovnkube-node-9qn4j" Jun 12 22:21:00.452477 ip-10-0-128-134 kubenswrapper[2559]: I0612 22:21:00.450515 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/f6ddad48-94e1-479b-951c-ebf6be358f2c-ovnkube-script-lib\") pod \"ovnkube-node-9qn4j\" (UID: \"f6ddad48-94e1-479b-951c-ebf6be358f2c\") " pod="openshift-ovn-kubernetes/ovnkube-node-9qn4j" Jun 12 22:21:00.452477 ip-10-0-128-134 kubenswrapper[2559]: I0612 22:21:00.450539 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/35a1db5d-f311-4962-9835-e21409e67513-etc-sysctl-d\") pod \"tuned-kbvj8\" (UID: \"35a1db5d-f311-4962-9835-e21409e67513\") " pod="openshift-cluster-node-tuning-operator/tuned-kbvj8" Jun 12 22:21:00.452477 ip-10-0-128-134 kubenswrapper[2559]: I0612 22:21:00.450564 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/35a1db5d-f311-4962-9835-e21409e67513-run\") pod \"tuned-kbvj8\" (UID: \"35a1db5d-f311-4962-9835-e21409e67513\") " pod="openshift-cluster-node-tuning-operator/tuned-kbvj8" Jun 12 22:21:00.452477 ip-10-0-128-134 kubenswrapper[2559]: I0612 22:21:00.450587 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-769tf\" (UniqueName: \"kubernetes.io/projected/d4d1b0d2-aea6-421c-91e9-f74e3b7a4c6a-kube-api-access-769tf\") pod \"network-check-target-c9wls\" (UID: \"d4d1b0d2-aea6-421c-91e9-f74e3b7a4c6a\") " pod="openshift-network-diagnostics/network-check-target-c9wls" Jun 12 22:21:00.452477 ip-10-0-128-134 kubenswrapper[2559]: I0612 22:21:00.450605 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/ca559a81-c5e6-4ba7-adc1-7ddafc57941a-os-release\") pod \"multus-bzp8z\" (UID: \"ca559a81-c5e6-4ba7-adc1-7ddafc57941a\") " pod="openshift-multus/multus-bzp8z" Jun 12 22:21:00.453304 ip-10-0-128-134 kubenswrapper[2559]: I0612 22:21:00.450627 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hw84x\" (UniqueName: \"kubernetes.io/projected/d01cad7b-32bc-45f8-8c98-057a798e0866-kube-api-access-hw84x\") pod \"node-ca-bghrt\" (UID: \"d01cad7b-32bc-45f8-8c98-057a798e0866\") " pod="openshift-image-registry/node-ca-bghrt" Jun 12 22:21:00.453304 ip-10-0-128-134 kubenswrapper[2559]: I0612 22:21:00.450699 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/f6ddad48-94e1-479b-951c-ebf6be358f2c-ovn-node-metrics-cert\") pod \"ovnkube-node-9qn4j\" (UID: \"f6ddad48-94e1-479b-951c-ebf6be358f2c\") " pod="openshift-ovn-kubernetes/ovnkube-node-9qn4j" Jun 12 22:21:00.453304 ip-10-0-128-134 kubenswrapper[2559]: I0612 22:21:00.450726 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/5aa3f5cb-8c34-46e9-8b09-8af6c2318dce-device-dir\") pod \"aws-ebs-csi-driver-node-hbdkt\" (UID: \"5aa3f5cb-8c34-46e9-8b09-8af6c2318dce\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-hbdkt" Jun 12 22:21:00.453304 ip-10-0-128-134 kubenswrapper[2559]: I0612 22:21:00.450749 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-gm8zg\" (UniqueName: \"kubernetes.io/projected/5aa3f5cb-8c34-46e9-8b09-8af6c2318dce-kube-api-access-gm8zg\") pod \"aws-ebs-csi-driver-node-hbdkt\" (UID: \"5aa3f5cb-8c34-46e9-8b09-8af6c2318dce\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-hbdkt" Jun 12 22:21:00.453304 ip-10-0-128-134 kubenswrapper[2559]: I0612 22:21:00.450773 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/843f3267-327c-4702-9510-3ceb40add4e1-hosts-file\") pod \"node-resolver-qdtqn\" (UID: \"843f3267-327c-4702-9510-3ceb40add4e1\") " pod="openshift-dns/node-resolver-qdtqn" Jun 12 22:21:00.453304 ip-10-0-128-134 kubenswrapper[2559]: I0612 22:21:00.450871 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/5aa3f5cb-8c34-46e9-8b09-8af6c2318dce-device-dir\") pod \"aws-ebs-csi-driver-node-hbdkt\" (UID: \"5aa3f5cb-8c34-46e9-8b09-8af6c2318dce\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-hbdkt" Jun 12 22:21:00.453304 ip-10-0-128-134 kubenswrapper[2559]: I0612 22:21:00.450883 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/f6ddad48-94e1-479b-951c-ebf6be358f2c-env-overrides\") pod \"ovnkube-node-9qn4j\" (UID: \"f6ddad48-94e1-479b-951c-ebf6be358f2c\") " pod="openshift-ovn-kubernetes/ovnkube-node-9qn4j" Jun 12 22:21:00.453304 ip-10-0-128-134 kubenswrapper[2559]: I0612 22:21:00.450923 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/843f3267-327c-4702-9510-3ceb40add4e1-hosts-file\") pod \"node-resolver-qdtqn\" (UID: \"843f3267-327c-4702-9510-3ceb40add4e1\") " pod="openshift-dns/node-resolver-qdtqn" Jun 12 22:21:00.453304 ip-10-0-128-134 kubenswrapper[2559]: I0612 22:21:00.451059 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/f6ddad48-94e1-479b-951c-ebf6be358f2c-ovnkube-script-lib\") pod \"ovnkube-node-9qn4j\" (UID: \"f6ddad48-94e1-479b-951c-ebf6be358f2c\") " pod="openshift-ovn-kubernetes/ovnkube-node-9qn4j" Jun 12 22:21:00.454039 ip-10-0-128-134 kubenswrapper[2559]: I0612 22:21:00.454020 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/f6ddad48-94e1-479b-951c-ebf6be358f2c-ovn-node-metrics-cert\") pod \"ovnkube-node-9qn4j\" (UID: \"f6ddad48-94e1-479b-951c-ebf6be358f2c\") " pod="openshift-ovn-kubernetes/ovnkube-node-9qn4j" Jun 12 22:21:00.454198 ip-10-0-128-134 kubenswrapper[2559]: I0612 22:21:00.454179 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/2fe08918-3efc-4000-a321-8b319ead517c-agent-certs\") pod \"konnectivity-agent-f7h79\" (UID: \"2fe08918-3efc-4000-a321-8b319ead517c\") " pod="kube-system/konnectivity-agent-f7h79" Jun 12 22:21:00.464493 ip-10-0-128-134 kubenswrapper[2559]: I0612 22:21:00.464468 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-q9hxt\" (UniqueName: \"kubernetes.io/projected/fcd15bde-b438-4c03-a474-3424cfb17daa-kube-api-access-q9hxt\") pod \"iptables-alerter-s2zxg\" (UID: \"fcd15bde-b438-4c03-a474-3424cfb17daa\") " pod="openshift-network-operator/iptables-alerter-s2zxg" Jun 12 22:21:00.464630 ip-10-0-128-134 kubenswrapper[2559]: I0612 22:21:00.464551 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-hw84x\" (UniqueName: \"kubernetes.io/projected/d01cad7b-32bc-45f8-8c98-057a798e0866-kube-api-access-hw84x\") pod \"node-ca-bghrt\" (UID: \"d01cad7b-32bc-45f8-8c98-057a798e0866\") " pod="openshift-image-registry/node-ca-bghrt" Jun 12 22:21:00.464630 ip-10-0-128-134 kubenswrapper[2559]: I0612 22:21:00.464579 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-p7h9q\" (UniqueName: \"kubernetes.io/projected/843f3267-327c-4702-9510-3ceb40add4e1-kube-api-access-p7h9q\") pod \"node-resolver-qdtqn\" (UID: \"843f3267-327c-4702-9510-3ceb40add4e1\") " pod="openshift-dns/node-resolver-qdtqn" Jun 12 22:21:00.466177 ip-10-0-128-134 kubenswrapper[2559]: I0612 22:21:00.466153 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-gm8zg\" (UniqueName: \"kubernetes.io/projected/5aa3f5cb-8c34-46e9-8b09-8af6c2318dce-kube-api-access-gm8zg\") pod \"aws-ebs-csi-driver-node-hbdkt\" (UID: \"5aa3f5cb-8c34-46e9-8b09-8af6c2318dce\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-hbdkt" Jun 12 22:21:00.467085 ip-10-0-128-134 kubenswrapper[2559]: I0612 22:21:00.467066 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-fb2l5\" (UniqueName: \"kubernetes.io/projected/f6ddad48-94e1-479b-951c-ebf6be358f2c-kube-api-access-fb2l5\") pod \"ovnkube-node-9qn4j\" (UID: \"f6ddad48-94e1-479b-951c-ebf6be358f2c\") " pod="openshift-ovn-kubernetes/ovnkube-node-9qn4j" Jun 12 22:21:00.551752 ip-10-0-128-134 kubenswrapper[2559]: I0612 22:21:00.551712 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/ca559a81-c5e6-4ba7-adc1-7ddafc57941a-hostroot\") pod \"multus-bzp8z\" (UID: \"ca559a81-c5e6-4ba7-adc1-7ddafc57941a\") " pod="openshift-multus/multus-bzp8z" Jun 12 22:21:00.551927 ip-10-0-128-134 kubenswrapper[2559]: I0612 22:21:00.551759 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-f7z4m\" (UniqueName: \"kubernetes.io/projected/2dd3c6ba-dc0c-4b3e-92b7-94a6b0999c26-kube-api-access-f7z4m\") pod \"multus-additional-cni-plugins-6fjft\" (UID: \"2dd3c6ba-dc0c-4b3e-92b7-94a6b0999c26\") " pod="openshift-multus/multus-additional-cni-plugins-6fjft" Jun 12 22:21:00.551927 ip-10-0-128-134 kubenswrapper[2559]: I0612 22:21:00.551790 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/73bd91e1-b3e8-495c-990c-3ab079745247-dbus\") pod \"global-pull-secret-syncer-zdjjt\" (UID: \"73bd91e1-b3e8-495c-990c-3ab079745247\") " pod="kube-system/global-pull-secret-syncer-zdjjt" Jun 12 22:21:00.551927 ip-10-0-128-134 kubenswrapper[2559]: I0612 22:21:00.551820 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/35a1db5d-f311-4962-9835-e21409e67513-etc-kubernetes\") pod \"tuned-kbvj8\" (UID: \"35a1db5d-f311-4962-9835-e21409e67513\") " pod="openshift-cluster-node-tuning-operator/tuned-kbvj8" Jun 12 22:21:00.551927 ip-10-0-128-134 kubenswrapper[2559]: I0612 22:21:00.551846 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/ca559a81-c5e6-4ba7-adc1-7ddafc57941a-hostroot\") pod \"multus-bzp8z\" (UID: \"ca559a81-c5e6-4ba7-adc1-7ddafc57941a\") " pod="openshift-multus/multus-bzp8z" Jun 12 22:21:00.551927 ip-10-0-128-134 kubenswrapper[2559]: I0612 22:21:00.551865 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/35a1db5d-f311-4962-9835-e21409e67513-etc-sysctl-conf\") pod \"tuned-kbvj8\" (UID: \"35a1db5d-f311-4962-9835-e21409e67513\") " pod="openshift-cluster-node-tuning-operator/tuned-kbvj8" Jun 12 22:21:00.551927 ip-10-0-128-134 kubenswrapper[2559]: I0612 22:21:00.551900 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/35a1db5d-f311-4962-9835-e21409e67513-sys\") pod \"tuned-kbvj8\" (UID: \"35a1db5d-f311-4962-9835-e21409e67513\") " pod="openshift-cluster-node-tuning-operator/tuned-kbvj8" Jun 12 22:21:00.551927 ip-10-0-128-134 kubenswrapper[2559]: I0612 22:21:00.551918 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/35a1db5d-f311-4962-9835-e21409e67513-var-lib-kubelet\") pod \"tuned-kbvj8\" (UID: \"35a1db5d-f311-4962-9835-e21409e67513\") " pod="openshift-cluster-node-tuning-operator/tuned-kbvj8" Jun 12 22:21:00.551927 ip-10-0-128-134 kubenswrapper[2559]: I0612 22:21:00.551921 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/73bd91e1-b3e8-495c-990c-3ab079745247-dbus\") pod \"global-pull-secret-syncer-zdjjt\" (UID: \"73bd91e1-b3e8-495c-990c-3ab079745247\") " pod="kube-system/global-pull-secret-syncer-zdjjt" Jun 12 22:21:00.552238 ip-10-0-128-134 kubenswrapper[2559]: I0612 22:21:00.551943 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-57cq2\" (UniqueName: \"kubernetes.io/projected/35a1db5d-f311-4962-9835-e21409e67513-kube-api-access-57cq2\") pod \"tuned-kbvj8\" (UID: \"35a1db5d-f311-4962-9835-e21409e67513\") " pod="openshift-cluster-node-tuning-operator/tuned-kbvj8" Jun 12 22:21:00.552238 ip-10-0-128-134 kubenswrapper[2559]: I0612 22:21:00.551978 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xf2zc\" (UniqueName: \"kubernetes.io/projected/12fe1273-445c-4710-8579-38c99d08c036-kube-api-access-xf2zc\") pod \"network-metrics-daemon-d9psx\" (UID: \"12fe1273-445c-4710-8579-38c99d08c036\") " pod="openshift-multus/network-metrics-daemon-d9psx" Jun 12 22:21:00.552238 ip-10-0-128-134 kubenswrapper[2559]: I0612 22:21:00.552001 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/ca559a81-c5e6-4ba7-adc1-7ddafc57941a-cni-binary-copy\") pod \"multus-bzp8z\" (UID: \"ca559a81-c5e6-4ba7-adc1-7ddafc57941a\") " pod="openshift-multus/multus-bzp8z" Jun 12 22:21:00.552238 ip-10-0-128-134 kubenswrapper[2559]: I0612 22:21:00.552027 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/ca559a81-c5e6-4ba7-adc1-7ddafc57941a-system-cni-dir\") pod \"multus-bzp8z\" (UID: \"ca559a81-c5e6-4ba7-adc1-7ddafc57941a\") " pod="openshift-multus/multus-bzp8z" Jun 12 22:21:00.552238 ip-10-0-128-134 kubenswrapper[2559]: I0612 22:21:00.552041 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/ca559a81-c5e6-4ba7-adc1-7ddafc57941a-multus-cni-dir\") pod \"multus-bzp8z\" (UID: \"ca559a81-c5e6-4ba7-adc1-7ddafc57941a\") " pod="openshift-multus/multus-bzp8z" Jun 12 22:21:00.552238 ip-10-0-128-134 kubenswrapper[2559]: I0612 22:21:00.552061 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/ca559a81-c5e6-4ba7-adc1-7ddafc57941a-host-run-netns\") pod \"multus-bzp8z\" (UID: \"ca559a81-c5e6-4ba7-adc1-7ddafc57941a\") " pod="openshift-multus/multus-bzp8z" Jun 12 22:21:00.552238 ip-10-0-128-134 kubenswrapper[2559]: I0612 22:21:00.552079 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/ca559a81-c5e6-4ba7-adc1-7ddafc57941a-host-var-lib-cni-bin\") pod \"multus-bzp8z\" (UID: \"ca559a81-c5e6-4ba7-adc1-7ddafc57941a\") " pod="openshift-multus/multus-bzp8z" Jun 12 22:21:00.552238 ip-10-0-128-134 kubenswrapper[2559]: I0612 22:21:00.552095 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/ca559a81-c5e6-4ba7-adc1-7ddafc57941a-etc-kubernetes\") pod \"multus-bzp8z\" (UID: \"ca559a81-c5e6-4ba7-adc1-7ddafc57941a\") " pod="openshift-multus/multus-bzp8z" Jun 12 22:21:00.552238 ip-10-0-128-134 kubenswrapper[2559]: I0612 22:21:00.552117 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/35a1db5d-f311-4962-9835-e21409e67513-etc-systemd\") pod \"tuned-kbvj8\" (UID: \"35a1db5d-f311-4962-9835-e21409e67513\") " pod="openshift-cluster-node-tuning-operator/tuned-kbvj8" Jun 12 22:21:00.552238 ip-10-0-128-134 kubenswrapper[2559]: I0612 22:21:00.552132 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/2dd3c6ba-dc0c-4b3e-92b7-94a6b0999c26-cnibin\") pod \"multus-additional-cni-plugins-6fjft\" (UID: \"2dd3c6ba-dc0c-4b3e-92b7-94a6b0999c26\") " pod="openshift-multus/multus-additional-cni-plugins-6fjft" Jun 12 22:21:00.552238 ip-10-0-128-134 kubenswrapper[2559]: I0612 22:21:00.552151 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/35a1db5d-f311-4962-9835-e21409e67513-etc-tuned\") pod \"tuned-kbvj8\" (UID: \"35a1db5d-f311-4962-9835-e21409e67513\") " pod="openshift-cluster-node-tuning-operator/tuned-kbvj8" Jun 12 22:21:00.552238 ip-10-0-128-134 kubenswrapper[2559]: I0612 22:21:00.552173 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/35a1db5d-f311-4962-9835-e21409e67513-tmp\") pod \"tuned-kbvj8\" (UID: \"35a1db5d-f311-4962-9835-e21409e67513\") " pod="openshift-cluster-node-tuning-operator/tuned-kbvj8" Jun 12 22:21:00.552238 ip-10-0-128-134 kubenswrapper[2559]: I0612 22:21:00.552198 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vmtrf\" (UniqueName: \"kubernetes.io/projected/ca559a81-c5e6-4ba7-adc1-7ddafc57941a-kube-api-access-vmtrf\") pod \"multus-bzp8z\" (UID: \"ca559a81-c5e6-4ba7-adc1-7ddafc57941a\") " pod="openshift-multus/multus-bzp8z" Jun 12 22:21:00.552238 ip-10-0-128-134 kubenswrapper[2559]: I0612 22:21:00.552218 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/35a1db5d-f311-4962-9835-e21409e67513-host\") pod \"tuned-kbvj8\" (UID: \"35a1db5d-f311-4962-9835-e21409e67513\") " pod="openshift-cluster-node-tuning-operator/tuned-kbvj8" Jun 12 22:21:00.552238 ip-10-0-128-134 kubenswrapper[2559]: I0612 22:21:00.552232 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/2dd3c6ba-dc0c-4b3e-92b7-94a6b0999c26-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-6fjft\" (UID: \"2dd3c6ba-dc0c-4b3e-92b7-94a6b0999c26\") " pod="openshift-multus/multus-additional-cni-plugins-6fjft" Jun 12 22:21:00.554115 ip-10-0-128-134 kubenswrapper[2559]: I0612 22:21:00.552247 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/12fe1273-445c-4710-8579-38c99d08c036-metrics-certs\") pod \"network-metrics-daemon-d9psx\" (UID: \"12fe1273-445c-4710-8579-38c99d08c036\") " pod="openshift-multus/network-metrics-daemon-d9psx" Jun 12 22:21:00.554115 ip-10-0-128-134 kubenswrapper[2559]: I0612 22:21:00.552263 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/73bd91e1-b3e8-495c-990c-3ab079745247-kubelet-config\") pod \"global-pull-secret-syncer-zdjjt\" (UID: \"73bd91e1-b3e8-495c-990c-3ab079745247\") " pod="kube-system/global-pull-secret-syncer-zdjjt" Jun 12 22:21:00.554115 ip-10-0-128-134 kubenswrapper[2559]: I0612 22:21:00.552280 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/2dd3c6ba-dc0c-4b3e-92b7-94a6b0999c26-cni-binary-copy\") pod \"multus-additional-cni-plugins-6fjft\" (UID: \"2dd3c6ba-dc0c-4b3e-92b7-94a6b0999c26\") " pod="openshift-multus/multus-additional-cni-plugins-6fjft" Jun 12 22:21:00.554115 ip-10-0-128-134 kubenswrapper[2559]: I0612 22:21:00.552306 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/2dd3c6ba-dc0c-4b3e-92b7-94a6b0999c26-tuning-conf-dir\") pod \"multus-additional-cni-plugins-6fjft\" (UID: \"2dd3c6ba-dc0c-4b3e-92b7-94a6b0999c26\") " pod="openshift-multus/multus-additional-cni-plugins-6fjft" Jun 12 22:21:00.554115 ip-10-0-128-134 kubenswrapper[2559]: I0612 22:21:00.552309 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/35a1db5d-f311-4962-9835-e21409e67513-etc-kubernetes\") pod \"tuned-kbvj8\" (UID: \"35a1db5d-f311-4962-9835-e21409e67513\") " pod="openshift-cluster-node-tuning-operator/tuned-kbvj8" Jun 12 22:21:00.554115 ip-10-0-128-134 kubenswrapper[2559]: I0612 22:21:00.552347 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/35a1db5d-f311-4962-9835-e21409e67513-etc-sysctl-d\") pod \"tuned-kbvj8\" (UID: \"35a1db5d-f311-4962-9835-e21409e67513\") " pod="openshift-cluster-node-tuning-operator/tuned-kbvj8" Jun 12 22:21:00.554115 ip-10-0-128-134 kubenswrapper[2559]: I0612 22:21:00.552368 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/35a1db5d-f311-4962-9835-e21409e67513-run\") pod \"tuned-kbvj8\" (UID: \"35a1db5d-f311-4962-9835-e21409e67513\") " pod="openshift-cluster-node-tuning-operator/tuned-kbvj8" Jun 12 22:21:00.554115 ip-10-0-128-134 kubenswrapper[2559]: I0612 22:21:00.552392 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-769tf\" (UniqueName: \"kubernetes.io/projected/d4d1b0d2-aea6-421c-91e9-f74e3b7a4c6a-kube-api-access-769tf\") pod \"network-check-target-c9wls\" (UID: \"d4d1b0d2-aea6-421c-91e9-f74e3b7a4c6a\") " pod="openshift-network-diagnostics/network-check-target-c9wls" Jun 12 22:21:00.554115 ip-10-0-128-134 kubenswrapper[2559]: I0612 22:21:00.552417 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/ca559a81-c5e6-4ba7-adc1-7ddafc57941a-os-release\") pod \"multus-bzp8z\" (UID: \"ca559a81-c5e6-4ba7-adc1-7ddafc57941a\") " pod="openshift-multus/multus-bzp8z" Jun 12 22:21:00.554115 ip-10-0-128-134 kubenswrapper[2559]: I0612 22:21:00.552465 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/73bd91e1-b3e8-495c-990c-3ab079745247-original-pull-secret\") pod \"global-pull-secret-syncer-zdjjt\" (UID: \"73bd91e1-b3e8-495c-990c-3ab079745247\") " pod="kube-system/global-pull-secret-syncer-zdjjt" Jun 12 22:21:00.554115 ip-10-0-128-134 kubenswrapper[2559]: I0612 22:21:00.552492 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/ca559a81-c5e6-4ba7-adc1-7ddafc57941a-host-run-k8s-cni-cncf-io\") pod \"multus-bzp8z\" (UID: \"ca559a81-c5e6-4ba7-adc1-7ddafc57941a\") " pod="openshift-multus/multus-bzp8z" Jun 12 22:21:00.554115 ip-10-0-128-134 kubenswrapper[2559]: I0612 22:21:00.552530 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run\" (UniqueName: \"kubernetes.io/host-path/35a1db5d-f311-4962-9835-e21409e67513-run\") pod \"tuned-kbvj8\" (UID: \"35a1db5d-f311-4962-9835-e21409e67513\") " pod="openshift-cluster-node-tuning-operator/tuned-kbvj8" Jun 12 22:21:00.554115 ip-10-0-128-134 kubenswrapper[2559]: E0612 22:21:00.552587 2559 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jun 12 22:21:00.554115 ip-10-0-128-134 kubenswrapper[2559]: I0612 22:21:00.552588 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/ca559a81-c5e6-4ba7-adc1-7ddafc57941a-os-release\") pod \"multus-bzp8z\" (UID: \"ca559a81-c5e6-4ba7-adc1-7ddafc57941a\") " pod="openshift-multus/multus-bzp8z" Jun 12 22:21:00.554115 ip-10-0-128-134 kubenswrapper[2559]: I0612 22:21:00.552600 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/35a1db5d-f311-4962-9835-e21409e67513-etc-sysctl-conf\") pod \"tuned-kbvj8\" (UID: \"35a1db5d-f311-4962-9835-e21409e67513\") " pod="openshift-cluster-node-tuning-operator/tuned-kbvj8" Jun 12 22:21:00.554115 ip-10-0-128-134 kubenswrapper[2559]: I0612 22:21:00.552636 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/35a1db5d-f311-4962-9835-e21409e67513-etc-sysconfig\") pod \"tuned-kbvj8\" (UID: \"35a1db5d-f311-4962-9835-e21409e67513\") " pod="openshift-cluster-node-tuning-operator/tuned-kbvj8" Jun 12 22:21:00.554115 ip-10-0-128-134 kubenswrapper[2559]: I0612 22:21:00.552654 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/35a1db5d-f311-4962-9835-e21409e67513-var-lib-kubelet\") pod \"tuned-kbvj8\" (UID: \"35a1db5d-f311-4962-9835-e21409e67513\") " pod="openshift-cluster-node-tuning-operator/tuned-kbvj8" Jun 12 22:21:00.554115 ip-10-0-128-134 kubenswrapper[2559]: I0612 22:21:00.552657 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/35a1db5d-f311-4962-9835-e21409e67513-etc-sysctl-d\") pod \"tuned-kbvj8\" (UID: \"35a1db5d-f311-4962-9835-e21409e67513\") " pod="openshift-cluster-node-tuning-operator/tuned-kbvj8" Jun 12 22:21:00.554965 ip-10-0-128-134 kubenswrapper[2559]: I0612 22:21:00.552678 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/35a1db5d-f311-4962-9835-e21409e67513-etc-sysconfig\") pod \"tuned-kbvj8\" (UID: \"35a1db5d-f311-4962-9835-e21409e67513\") " pod="openshift-cluster-node-tuning-operator/tuned-kbvj8" Jun 12 22:21:00.554965 ip-10-0-128-134 kubenswrapper[2559]: I0612 22:21:00.552693 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/ca559a81-c5e6-4ba7-adc1-7ddafc57941a-host-run-k8s-cni-cncf-io\") pod \"multus-bzp8z\" (UID: \"ca559a81-c5e6-4ba7-adc1-7ddafc57941a\") " pod="openshift-multus/multus-bzp8z" Jun 12 22:21:00.554965 ip-10-0-128-134 kubenswrapper[2559]: I0612 22:21:00.552697 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/2dd3c6ba-dc0c-4b3e-92b7-94a6b0999c26-tuning-conf-dir\") pod \"multus-additional-cni-plugins-6fjft\" (UID: \"2dd3c6ba-dc0c-4b3e-92b7-94a6b0999c26\") " pod="openshift-multus/multus-additional-cni-plugins-6fjft" Jun 12 22:21:00.554965 ip-10-0-128-134 kubenswrapper[2559]: E0612 22:21:00.552660 2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/73bd91e1-b3e8-495c-990c-3ab079745247-original-pull-secret podName:73bd91e1-b3e8-495c-990c-3ab079745247 nodeName:}" failed. No retries permitted until 2026-06-12 22:21:01.052638445 +0000 UTC m=+3.101008240 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/73bd91e1-b3e8-495c-990c-3ab079745247-original-pull-secret") pod "global-pull-secret-syncer-zdjjt" (UID: "73bd91e1-b3e8-495c-990c-3ab079745247") : object "kube-system"/"original-pull-secret" not registered Jun 12 22:21:00.554965 ip-10-0-128-134 kubenswrapper[2559]: I0612 22:21:00.552747 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/ca559a81-c5e6-4ba7-adc1-7ddafc57941a-host-var-lib-cni-bin\") pod \"multus-bzp8z\" (UID: \"ca559a81-c5e6-4ba7-adc1-7ddafc57941a\") " pod="openshift-multus/multus-bzp8z" Jun 12 22:21:00.554965 ip-10-0-128-134 kubenswrapper[2559]: I0612 22:21:00.552767 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/35a1db5d-f311-4962-9835-e21409e67513-sys\") pod \"tuned-kbvj8\" (UID: \"35a1db5d-f311-4962-9835-e21409e67513\") " pod="openshift-cluster-node-tuning-operator/tuned-kbvj8" Jun 12 22:21:00.554965 ip-10-0-128-134 kubenswrapper[2559]: I0612 22:21:00.552768 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/35a1db5d-f311-4962-9835-e21409e67513-lib-modules\") pod \"tuned-kbvj8\" (UID: \"35a1db5d-f311-4962-9835-e21409e67513\") " pod="openshift-cluster-node-tuning-operator/tuned-kbvj8" Jun 12 22:21:00.554965 ip-10-0-128-134 kubenswrapper[2559]: I0612 22:21:00.552801 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/ca559a81-c5e6-4ba7-adc1-7ddafc57941a-cnibin\") pod \"multus-bzp8z\" (UID: \"ca559a81-c5e6-4ba7-adc1-7ddafc57941a\") " pod="openshift-multus/multus-bzp8z" Jun 12 22:21:00.554965 ip-10-0-128-134 kubenswrapper[2559]: I0612 22:21:00.552828 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/ca559a81-c5e6-4ba7-adc1-7ddafc57941a-host-var-lib-kubelet\") pod \"multus-bzp8z\" (UID: \"ca559a81-c5e6-4ba7-adc1-7ddafc57941a\") " pod="openshift-multus/multus-bzp8z" Jun 12 22:21:00.554965 ip-10-0-128-134 kubenswrapper[2559]: I0612 22:21:00.552855 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/ca559a81-c5e6-4ba7-adc1-7ddafc57941a-multus-conf-dir\") pod \"multus-bzp8z\" (UID: \"ca559a81-c5e6-4ba7-adc1-7ddafc57941a\") " pod="openshift-multus/multus-bzp8z" Jun 12 22:21:00.554965 ip-10-0-128-134 kubenswrapper[2559]: I0612 22:21:00.552881 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/2dd3c6ba-dc0c-4b3e-92b7-94a6b0999c26-system-cni-dir\") pod \"multus-additional-cni-plugins-6fjft\" (UID: \"2dd3c6ba-dc0c-4b3e-92b7-94a6b0999c26\") " pod="openshift-multus/multus-additional-cni-plugins-6fjft" Jun 12 22:21:00.554965 ip-10-0-128-134 kubenswrapper[2559]: I0612 22:21:00.552887 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/35a1db5d-f311-4962-9835-e21409e67513-etc-systemd\") pod \"tuned-kbvj8\" (UID: \"35a1db5d-f311-4962-9835-e21409e67513\") " pod="openshift-cluster-node-tuning-operator/tuned-kbvj8" Jun 12 22:21:00.554965 ip-10-0-128-134 kubenswrapper[2559]: I0612 22:21:00.552890 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/35a1db5d-f311-4962-9835-e21409e67513-lib-modules\") pod \"tuned-kbvj8\" (UID: \"35a1db5d-f311-4962-9835-e21409e67513\") " pod="openshift-cluster-node-tuning-operator/tuned-kbvj8" Jun 12 22:21:00.554965 ip-10-0-128-134 kubenswrapper[2559]: I0612 22:21:00.552899 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/ca559a81-c5e6-4ba7-adc1-7ddafc57941a-cni-binary-copy\") pod \"multus-bzp8z\" (UID: \"ca559a81-c5e6-4ba7-adc1-7ddafc57941a\") " pod="openshift-multus/multus-bzp8z" Jun 12 22:21:00.554965 ip-10-0-128-134 kubenswrapper[2559]: I0612 22:21:00.552910 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/ca559a81-c5e6-4ba7-adc1-7ddafc57941a-multus-socket-dir-parent\") pod \"multus-bzp8z\" (UID: \"ca559a81-c5e6-4ba7-adc1-7ddafc57941a\") " pod="openshift-multus/multus-bzp8z" Jun 12 22:21:00.554965 ip-10-0-128-134 kubenswrapper[2559]: I0612 22:21:00.552935 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/ca559a81-c5e6-4ba7-adc1-7ddafc57941a-host-var-lib-cni-multus\") pod \"multus-bzp8z\" (UID: \"ca559a81-c5e6-4ba7-adc1-7ddafc57941a\") " pod="openshift-multus/multus-bzp8z" Jun 12 22:21:00.554965 ip-10-0-128-134 kubenswrapper[2559]: I0612 22:21:00.552942 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/ca559a81-c5e6-4ba7-adc1-7ddafc57941a-etc-kubernetes\") pod \"multus-bzp8z\" (UID: \"ca559a81-c5e6-4ba7-adc1-7ddafc57941a\") " pod="openshift-multus/multus-bzp8z" Jun 12 22:21:00.555579 ip-10-0-128-134 kubenswrapper[2559]: I0612 22:21:00.552949 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/ca559a81-c5e6-4ba7-adc1-7ddafc57941a-system-cni-dir\") pod \"multus-bzp8z\" (UID: \"ca559a81-c5e6-4ba7-adc1-7ddafc57941a\") " pod="openshift-multus/multus-bzp8z" Jun 12 22:21:00.555579 ip-10-0-128-134 kubenswrapper[2559]: I0612 22:21:00.552960 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/ca559a81-c5e6-4ba7-adc1-7ddafc57941a-multus-daemon-config\") pod \"multus-bzp8z\" (UID: \"ca559a81-c5e6-4ba7-adc1-7ddafc57941a\") " pod="openshift-multus/multus-bzp8z" Jun 12 22:21:00.555579 ip-10-0-128-134 kubenswrapper[2559]: E0612 22:21:00.552982 2559 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jun 12 22:21:00.555579 ip-10-0-128-134 kubenswrapper[2559]: I0612 22:21:00.552985 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/ca559a81-c5e6-4ba7-adc1-7ddafc57941a-host-run-multus-certs\") pod \"multus-bzp8z\" (UID: \"ca559a81-c5e6-4ba7-adc1-7ddafc57941a\") " pod="openshift-multus/multus-bzp8z" Jun 12 22:21:00.555579 ip-10-0-128-134 kubenswrapper[2559]: I0612 22:21:00.552990 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/2dd3c6ba-dc0c-4b3e-92b7-94a6b0999c26-cnibin\") pod \"multus-additional-cni-plugins-6fjft\" (UID: \"2dd3c6ba-dc0c-4b3e-92b7-94a6b0999c26\") " pod="openshift-multus/multus-additional-cni-plugins-6fjft" Jun 12 22:21:00.555579 ip-10-0-128-134 kubenswrapper[2559]: I0612 22:21:00.553003 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/ca559a81-c5e6-4ba7-adc1-7ddafc57941a-host-run-netns\") pod \"multus-bzp8z\" (UID: \"ca559a81-c5e6-4ba7-adc1-7ddafc57941a\") " pod="openshift-multus/multus-bzp8z" Jun 12 22:21:00.555579 ip-10-0-128-134 kubenswrapper[2559]: I0612 22:21:00.553010 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/2dd3c6ba-dc0c-4b3e-92b7-94a6b0999c26-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-6fjft\" (UID: \"2dd3c6ba-dc0c-4b3e-92b7-94a6b0999c26\") " pod="openshift-multus/multus-additional-cni-plugins-6fjft" Jun 12 22:21:00.555579 ip-10-0-128-134 kubenswrapper[2559]: E0612 22:21:00.553027 2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/12fe1273-445c-4710-8579-38c99d08c036-metrics-certs podName:12fe1273-445c-4710-8579-38c99d08c036 nodeName:}" failed. No retries permitted until 2026-06-12 22:21:01.053010797 +0000 UTC m=+3.101380611 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/12fe1273-445c-4710-8579-38c99d08c036-metrics-certs") pod "network-metrics-daemon-d9psx" (UID: "12fe1273-445c-4710-8579-38c99d08c036") : object "openshift-multus"/"metrics-daemon-secret" not registered Jun 12 22:21:00.555579 ip-10-0-128-134 kubenswrapper[2559]: I0612 22:21:00.553050 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/73bd91e1-b3e8-495c-990c-3ab079745247-kubelet-config\") pod \"global-pull-secret-syncer-zdjjt\" (UID: \"73bd91e1-b3e8-495c-990c-3ab079745247\") " pod="kube-system/global-pull-secret-syncer-zdjjt" Jun 12 22:21:00.555579 ip-10-0-128-134 kubenswrapper[2559]: I0612 22:21:00.553064 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/35a1db5d-f311-4962-9835-e21409e67513-etc-modprobe-d\") pod \"tuned-kbvj8\" (UID: \"35a1db5d-f311-4962-9835-e21409e67513\") " pod="openshift-cluster-node-tuning-operator/tuned-kbvj8" Jun 12 22:21:00.555579 ip-10-0-128-134 kubenswrapper[2559]: I0612 22:21:00.553096 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/2dd3c6ba-dc0c-4b3e-92b7-94a6b0999c26-os-release\") pod \"multus-additional-cni-plugins-6fjft\" (UID: \"2dd3c6ba-dc0c-4b3e-92b7-94a6b0999c26\") " pod="openshift-multus/multus-additional-cni-plugins-6fjft" Jun 12 22:21:00.555579 ip-10-0-128-134 kubenswrapper[2559]: I0612 22:21:00.553101 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/ca559a81-c5e6-4ba7-adc1-7ddafc57941a-multus-socket-dir-parent\") pod \"multus-bzp8z\" (UID: \"ca559a81-c5e6-4ba7-adc1-7ddafc57941a\") " pod="openshift-multus/multus-bzp8z" Jun 12 22:21:00.555579 ip-10-0-128-134 kubenswrapper[2559]: I0612 22:21:00.553193 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/ca559a81-c5e6-4ba7-adc1-7ddafc57941a-host-var-lib-cni-multus\") pod \"multus-bzp8z\" (UID: \"ca559a81-c5e6-4ba7-adc1-7ddafc57941a\") " pod="openshift-multus/multus-bzp8z" Jun 12 22:21:00.555579 ip-10-0-128-134 kubenswrapper[2559]: I0612 22:21:00.553279 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/35a1db5d-f311-4962-9835-e21409e67513-etc-modprobe-d\") pod \"tuned-kbvj8\" (UID: \"35a1db5d-f311-4962-9835-e21409e67513\") " pod="openshift-cluster-node-tuning-operator/tuned-kbvj8" Jun 12 22:21:00.555579 ip-10-0-128-134 kubenswrapper[2559]: I0612 22:21:00.553320 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/2dd3c6ba-dc0c-4b3e-92b7-94a6b0999c26-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-6fjft\" (UID: \"2dd3c6ba-dc0c-4b3e-92b7-94a6b0999c26\") " pod="openshift-multus/multus-additional-cni-plugins-6fjft" Jun 12 22:21:00.555579 ip-10-0-128-134 kubenswrapper[2559]: I0612 22:21:00.553335 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/2dd3c6ba-dc0c-4b3e-92b7-94a6b0999c26-os-release\") pod \"multus-additional-cni-plugins-6fjft\" (UID: \"2dd3c6ba-dc0c-4b3e-92b7-94a6b0999c26\") " pod="openshift-multus/multus-additional-cni-plugins-6fjft" Jun 12 22:21:00.555579 ip-10-0-128-134 kubenswrapper[2559]: I0612 22:21:00.553347 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/ca559a81-c5e6-4ba7-adc1-7ddafc57941a-multus-cni-dir\") pod \"multus-bzp8z\" (UID: \"ca559a81-c5e6-4ba7-adc1-7ddafc57941a\") " pod="openshift-multus/multus-bzp8z" Jun 12 22:21:00.556114 ip-10-0-128-134 kubenswrapper[2559]: I0612 22:21:00.553383 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/35a1db5d-f311-4962-9835-e21409e67513-host\") pod \"tuned-kbvj8\" (UID: \"35a1db5d-f311-4962-9835-e21409e67513\") " pod="openshift-cluster-node-tuning-operator/tuned-kbvj8" Jun 12 22:21:00.556114 ip-10-0-128-134 kubenswrapper[2559]: I0612 22:21:00.553389 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/ca559a81-c5e6-4ba7-adc1-7ddafc57941a-host-var-lib-kubelet\") pod \"multus-bzp8z\" (UID: \"ca559a81-c5e6-4ba7-adc1-7ddafc57941a\") " pod="openshift-multus/multus-bzp8z" Jun 12 22:21:00.556114 ip-10-0-128-134 kubenswrapper[2559]: I0612 22:21:00.553404 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/2dd3c6ba-dc0c-4b3e-92b7-94a6b0999c26-system-cni-dir\") pod \"multus-additional-cni-plugins-6fjft\" (UID: \"2dd3c6ba-dc0c-4b3e-92b7-94a6b0999c26\") " pod="openshift-multus/multus-additional-cni-plugins-6fjft" Jun 12 22:21:00.556114 ip-10-0-128-134 kubenswrapper[2559]: I0612 22:21:00.553424 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/ca559a81-c5e6-4ba7-adc1-7ddafc57941a-cnibin\") pod \"multus-bzp8z\" (UID: \"ca559a81-c5e6-4ba7-adc1-7ddafc57941a\") " pod="openshift-multus/multus-bzp8z" Jun 12 22:21:00.556114 ip-10-0-128-134 kubenswrapper[2559]: I0612 22:21:00.553432 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/ca559a81-c5e6-4ba7-adc1-7ddafc57941a-multus-conf-dir\") pod \"multus-bzp8z\" (UID: \"ca559a81-c5e6-4ba7-adc1-7ddafc57941a\") " pod="openshift-multus/multus-bzp8z" Jun 12 22:21:00.556114 ip-10-0-128-134 kubenswrapper[2559]: I0612 22:21:00.553472 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/ca559a81-c5e6-4ba7-adc1-7ddafc57941a-host-run-multus-certs\") pod \"multus-bzp8z\" (UID: \"ca559a81-c5e6-4ba7-adc1-7ddafc57941a\") " pod="openshift-multus/multus-bzp8z" Jun 12 22:21:00.556114 ip-10-0-128-134 kubenswrapper[2559]: I0612 22:21:00.553495 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/2dd3c6ba-dc0c-4b3e-92b7-94a6b0999c26-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-6fjft\" (UID: \"2dd3c6ba-dc0c-4b3e-92b7-94a6b0999c26\") " pod="openshift-multus/multus-additional-cni-plugins-6fjft" Jun 12 22:21:00.556114 ip-10-0-128-134 kubenswrapper[2559]: I0612 22:21:00.553551 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/2dd3c6ba-dc0c-4b3e-92b7-94a6b0999c26-cni-binary-copy\") pod \"multus-additional-cni-plugins-6fjft\" (UID: \"2dd3c6ba-dc0c-4b3e-92b7-94a6b0999c26\") " pod="openshift-multus/multus-additional-cni-plugins-6fjft" Jun 12 22:21:00.556114 ip-10-0-128-134 kubenswrapper[2559]: I0612 22:21:00.553654 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/ca559a81-c5e6-4ba7-adc1-7ddafc57941a-multus-daemon-config\") pod \"multus-bzp8z\" (UID: \"ca559a81-c5e6-4ba7-adc1-7ddafc57941a\") " pod="openshift-multus/multus-bzp8z" Jun 12 22:21:00.556114 ip-10-0-128-134 kubenswrapper[2559]: I0612 22:21:00.555092 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/35a1db5d-f311-4962-9835-e21409e67513-etc-tuned\") pod \"tuned-kbvj8\" (UID: \"35a1db5d-f311-4962-9835-e21409e67513\") " pod="openshift-cluster-node-tuning-operator/tuned-kbvj8" Jun 12 22:21:00.556114 ip-10-0-128-134 kubenswrapper[2559]: I0612 22:21:00.555283 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/35a1db5d-f311-4962-9835-e21409e67513-tmp\") pod \"tuned-kbvj8\" (UID: \"35a1db5d-f311-4962-9835-e21409e67513\") " pod="openshift-cluster-node-tuning-operator/tuned-kbvj8" Jun 12 22:21:00.564337 ip-10-0-128-134 kubenswrapper[2559]: E0612 22:21:00.564264 2559 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jun 12 22:21:00.564337 ip-10-0-128-134 kubenswrapper[2559]: E0612 22:21:00.564287 2559 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jun 12 22:21:00.564337 ip-10-0-128-134 kubenswrapper[2559]: E0612 22:21:00.564298 2559 projected.go:196] Error preparing data for projected volume kube-api-access-769tf for pod openshift-network-diagnostics/network-check-target-c9wls: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 12 22:21:00.564337 ip-10-0-128-134 kubenswrapper[2559]: E0612 22:21:00.564338 2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/d4d1b0d2-aea6-421c-91e9-f74e3b7a4c6a-kube-api-access-769tf podName:d4d1b0d2-aea6-421c-91e9-f74e3b7a4c6a nodeName:}" failed. No retries permitted until 2026-06-12 22:21:01.064327042 +0000 UTC m=+3.112696836 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-api-access-769tf" (UniqueName: "kubernetes.io/projected/d4d1b0d2-aea6-421c-91e9-f74e3b7a4c6a-kube-api-access-769tf") pod "network-check-target-c9wls" (UID: "d4d1b0d2-aea6-421c-91e9-f74e3b7a4c6a") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 12 22:21:00.565778 ip-10-0-128-134 kubenswrapper[2559]: I0612 22:21:00.565754 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-57cq2\" (UniqueName: \"kubernetes.io/projected/35a1db5d-f311-4962-9835-e21409e67513-kube-api-access-57cq2\") pod \"tuned-kbvj8\" (UID: \"35a1db5d-f311-4962-9835-e21409e67513\") " pod="openshift-cluster-node-tuning-operator/tuned-kbvj8" Jun 12 22:21:00.566215 ip-10-0-128-134 kubenswrapper[2559]: I0612 22:21:00.566193 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-xf2zc\" (UniqueName: \"kubernetes.io/projected/12fe1273-445c-4710-8579-38c99d08c036-kube-api-access-xf2zc\") pod \"network-metrics-daemon-d9psx\" (UID: \"12fe1273-445c-4710-8579-38c99d08c036\") " pod="openshift-multus/network-metrics-daemon-d9psx" Jun 12 22:21:00.566280 ip-10-0-128-134 kubenswrapper[2559]: I0612 22:21:00.566241 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-f7z4m\" (UniqueName: \"kubernetes.io/projected/2dd3c6ba-dc0c-4b3e-92b7-94a6b0999c26-kube-api-access-f7z4m\") pod \"multus-additional-cni-plugins-6fjft\" (UID: \"2dd3c6ba-dc0c-4b3e-92b7-94a6b0999c26\") " pod="openshift-multus/multus-additional-cni-plugins-6fjft" Jun 12 22:21:00.566868 ip-10-0-128-134 kubenswrapper[2559]: I0612 22:21:00.566846 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-vmtrf\" (UniqueName: \"kubernetes.io/projected/ca559a81-c5e6-4ba7-adc1-7ddafc57941a-kube-api-access-vmtrf\") pod \"multus-bzp8z\" (UID: \"ca559a81-c5e6-4ba7-adc1-7ddafc57941a\") " pod="openshift-multus/multus-bzp8z" Jun 12 22:21:00.636838 ip-10-0-128-134 kubenswrapper[2559]: I0612 22:21:00.636749 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-bghrt" Jun 12 22:21:00.644411 ip-10-0-128-134 kubenswrapper[2559]: I0612 22:21:00.644392 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-f7h79" Jun 12 22:21:00.654430 ip-10-0-128-134 kubenswrapper[2559]: I0612 22:21:00.654405 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-s2zxg" Jun 12 22:21:00.662359 ip-10-0-128-134 kubenswrapper[2559]: I0612 22:21:00.662340 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-9qn4j" Jun 12 22:21:00.670311 ip-10-0-128-134 kubenswrapper[2559]: I0612 22:21:00.670294 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-hbdkt" Jun 12 22:21:00.679100 ip-10-0-128-134 kubenswrapper[2559]: I0612 22:21:00.679084 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-qdtqn" Jun 12 22:21:00.685620 ip-10-0-128-134 kubenswrapper[2559]: I0612 22:21:00.685599 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-bzp8z" Jun 12 22:21:00.693302 ip-10-0-128-134 kubenswrapper[2559]: I0612 22:21:00.693280 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-kbvj8" Jun 12 22:21:00.698938 ip-10-0-128-134 kubenswrapper[2559]: I0612 22:21:00.698918 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-6fjft" Jun 12 22:21:01.056252 ip-10-0-128-134 kubenswrapper[2559]: I0612 22:21:01.056220 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/12fe1273-445c-4710-8579-38c99d08c036-metrics-certs\") pod \"network-metrics-daemon-d9psx\" (UID: \"12fe1273-445c-4710-8579-38c99d08c036\") " pod="openshift-multus/network-metrics-daemon-d9psx" Jun 12 22:21:01.056419 ip-10-0-128-134 kubenswrapper[2559]: I0612 22:21:01.056283 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/73bd91e1-b3e8-495c-990c-3ab079745247-original-pull-secret\") pod \"global-pull-secret-syncer-zdjjt\" (UID: \"73bd91e1-b3e8-495c-990c-3ab079745247\") " pod="kube-system/global-pull-secret-syncer-zdjjt" Jun 12 22:21:01.056419 ip-10-0-128-134 kubenswrapper[2559]: E0612 22:21:01.056396 2559 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jun 12 22:21:01.056549 ip-10-0-128-134 kubenswrapper[2559]: E0612 22:21:01.056421 2559 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jun 12 22:21:01.056549 ip-10-0-128-134 kubenswrapper[2559]: E0612 22:21:01.056493 2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/12fe1273-445c-4710-8579-38c99d08c036-metrics-certs podName:12fe1273-445c-4710-8579-38c99d08c036 nodeName:}" failed. No retries permitted until 2026-06-12 22:21:02.056471671 +0000 UTC m=+4.104841471 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/12fe1273-445c-4710-8579-38c99d08c036-metrics-certs") pod "network-metrics-daemon-d9psx" (UID: "12fe1273-445c-4710-8579-38c99d08c036") : object "openshift-multus"/"metrics-daemon-secret" not registered Jun 12 22:21:01.056549 ip-10-0-128-134 kubenswrapper[2559]: E0612 22:21:01.056511 2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/73bd91e1-b3e8-495c-990c-3ab079745247-original-pull-secret podName:73bd91e1-b3e8-495c-990c-3ab079745247 nodeName:}" failed. No retries permitted until 2026-06-12 22:21:02.056503818 +0000 UTC m=+4.104873612 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/73bd91e1-b3e8-495c-990c-3ab079745247-original-pull-secret") pod "global-pull-secret-syncer-zdjjt" (UID: "73bd91e1-b3e8-495c-990c-3ab079745247") : object "kube-system"/"original-pull-secret" not registered Jun 12 22:21:01.156848 ip-10-0-128-134 kubenswrapper[2559]: I0612 22:21:01.156807 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-769tf\" (UniqueName: \"kubernetes.io/projected/d4d1b0d2-aea6-421c-91e9-f74e3b7a4c6a-kube-api-access-769tf\") pod \"network-check-target-c9wls\" (UID: \"d4d1b0d2-aea6-421c-91e9-f74e3b7a4c6a\") " pod="openshift-network-diagnostics/network-check-target-c9wls" Jun 12 22:21:01.157014 ip-10-0-128-134 kubenswrapper[2559]: E0612 22:21:01.156972 2559 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jun 12 22:21:01.157014 ip-10-0-128-134 kubenswrapper[2559]: E0612 22:21:01.156996 2559 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jun 12 22:21:01.157014 ip-10-0-128-134 kubenswrapper[2559]: E0612 22:21:01.157009 2559 projected.go:196] Error preparing data for projected volume kube-api-access-769tf for pod openshift-network-diagnostics/network-check-target-c9wls: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 12 22:21:01.157172 ip-10-0-128-134 kubenswrapper[2559]: E0612 22:21:01.157058 2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/d4d1b0d2-aea6-421c-91e9-f74e3b7a4c6a-kube-api-access-769tf podName:d4d1b0d2-aea6-421c-91e9-f74e3b7a4c6a nodeName:}" failed. No retries permitted until 2026-06-12 22:21:02.15704449 +0000 UTC m=+4.205414286 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-api-access-769tf" (UniqueName: "kubernetes.io/projected/d4d1b0d2-aea6-421c-91e9-f74e3b7a4c6a-kube-api-access-769tf") pod "network-check-target-c9wls" (UID: "d4d1b0d2-aea6-421c-91e9-f74e3b7a4c6a") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 12 22:21:01.257749 ip-10-0-128-134 kubenswrapper[2559]: W0612 22:21:01.257724 2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2fe08918_3efc_4000_a321_8b319ead517c.slice/crio-e0c016ad35bb2ee321b352a6890573f2468eaeca9fa351824c8a3cd77b37d342 WatchSource:0}: Error finding container e0c016ad35bb2ee321b352a6890573f2468eaeca9fa351824c8a3cd77b37d342: Status 404 returned error can't find the container with id e0c016ad35bb2ee321b352a6890573f2468eaeca9fa351824c8a3cd77b37d342 Jun 12 22:21:01.259315 ip-10-0-128-134 kubenswrapper[2559]: W0612 22:21:01.259285 2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf6ddad48_94e1_479b_951c_ebf6be358f2c.slice/crio-d627350e7e72df3d84d6daffe5f4f3b94c427c26cddceebffabd82df777f48ce WatchSource:0}: Error finding container d627350e7e72df3d84d6daffe5f4f3b94c427c26cddceebffabd82df777f48ce: Status 404 returned error can't find the container with id d627350e7e72df3d84d6daffe5f4f3b94c427c26cddceebffabd82df777f48ce Jun 12 22:21:01.260239 ip-10-0-128-134 kubenswrapper[2559]: W0612 22:21:01.260220 2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod35a1db5d_f311_4962_9835_e21409e67513.slice/crio-f9815de3992a5381d1df835943a11f52f929743326cfaa86aacf482434db2b95 WatchSource:0}: Error finding container f9815de3992a5381d1df835943a11f52f929743326cfaa86aacf482434db2b95: Status 404 returned error can't find the container with id f9815de3992a5381d1df835943a11f52f929743326cfaa86aacf482434db2b95 Jun 12 22:21:01.261271 ip-10-0-128-134 kubenswrapper[2559]: W0612 22:21:01.261249 2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd01cad7b_32bc_45f8_8c98_057a798e0866.slice/crio-840f9d64aa5be35aa22760762df81738634784ac7452a30b62768c27084ada09 WatchSource:0}: Error finding container 840f9d64aa5be35aa22760762df81738634784ac7452a30b62768c27084ada09: Status 404 returned error can't find the container with id 840f9d64aa5be35aa22760762df81738634784ac7452a30b62768c27084ada09 Jun 12 22:21:01.263392 ip-10-0-128-134 kubenswrapper[2559]: W0612 22:21:01.263318 2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2dd3c6ba_dc0c_4b3e_92b7_94a6b0999c26.slice/crio-d434df0314e065b3e514f925e2b2dfa1111960305d04b9d5fc65c45b984c2fc9 WatchSource:0}: Error finding container d434df0314e065b3e514f925e2b2dfa1111960305d04b9d5fc65c45b984c2fc9: Status 404 returned error can't find the container with id d434df0314e065b3e514f925e2b2dfa1111960305d04b9d5fc65c45b984c2fc9 Jun 12 22:21:01.265070 ip-10-0-128-134 kubenswrapper[2559]: W0612 22:21:01.264519 2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5aa3f5cb_8c34_46e9_8b09_8af6c2318dce.slice/crio-3ebcb4662bf92412001b64abcefa1bddcf99c2dd75ce5d0e7c4aa73a7c147c26 WatchSource:0}: Error finding container 3ebcb4662bf92412001b64abcefa1bddcf99c2dd75ce5d0e7c4aa73a7c147c26: Status 404 returned error can't find the container with id 3ebcb4662bf92412001b64abcefa1bddcf99c2dd75ce5d0e7c4aa73a7c147c26 Jun 12 22:21:01.265755 ip-10-0-128-134 kubenswrapper[2559]: W0612 22:21:01.265568 2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podca559a81_c5e6_4ba7_adc1_7ddafc57941a.slice/crio-dcf0cc7411236118747643faf2b0a5ca1c21508f7651bb4d619b564fa3f29af3 WatchSource:0}: Error finding container dcf0cc7411236118747643faf2b0a5ca1c21508f7651bb4d619b564fa3f29af3: Status 404 returned error can't find the container with id dcf0cc7411236118747643faf2b0a5ca1c21508f7651bb4d619b564fa3f29af3 Jun 12 22:21:01.266244 ip-10-0-128-134 kubenswrapper[2559]: W0612 22:21:01.266150 2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podfcd15bde_b438_4c03_a474_3424cfb17daa.slice/crio-11fca1fd00b82d212db8644c9a26ae3783447dc4207e82df0e6171052fded02a WatchSource:0}: Error finding container 11fca1fd00b82d212db8644c9a26ae3783447dc4207e82df0e6171052fded02a: Status 404 returned error can't find the container with id 11fca1fd00b82d212db8644c9a26ae3783447dc4207e82df0e6171052fded02a Jun 12 22:21:01.392598 ip-10-0-128-134 kubenswrapper[2559]: I0612 22:21:01.392521 2559 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-06-11 22:16:00 +0000 UTC" deadline="2027-11-14 13:45:16.970691411 +0000 UTC" Jun 12 22:21:01.392598 ip-10-0-128-134 kubenswrapper[2559]: I0612 22:21:01.392596 2559 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="12471h24m15.578100807s" Jun 12 22:21:01.404849 ip-10-0-128-134 kubenswrapper[2559]: I0612 22:21:01.404817 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-d9psx" Jun 12 22:21:01.404989 ip-10-0-128-134 kubenswrapper[2559]: E0612 22:21:01.404965 2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-d9psx" podUID="12fe1273-445c-4710-8579-38c99d08c036" Jun 12 22:21:01.414008 ip-10-0-128-134 kubenswrapper[2559]: I0612 22:21:01.413949 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-kbvj8" event={"ID":"35a1db5d-f311-4962-9835-e21409e67513","Type":"ContainerStarted","Data":"f9815de3992a5381d1df835943a11f52f929743326cfaa86aacf482434db2b95"} Jun 12 22:21:01.415021 ip-10-0-128-134 kubenswrapper[2559]: I0612 22:21:01.414996 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-qdtqn" event={"ID":"843f3267-327c-4702-9510-3ceb40add4e1","Type":"ContainerStarted","Data":"3c7ec8f8163b2caeccaed34bd8f0cf98c6f172f51c68a92ccbfc3b2ab51e8a34"} Jun 12 22:21:01.415932 ip-10-0-128-134 kubenswrapper[2559]: I0612 22:21:01.415911 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-s2zxg" event={"ID":"fcd15bde-b438-4c03-a474-3424cfb17daa","Type":"ContainerStarted","Data":"11fca1fd00b82d212db8644c9a26ae3783447dc4207e82df0e6171052fded02a"} Jun 12 22:21:01.417523 ip-10-0-128-134 kubenswrapper[2559]: I0612 22:21:01.417505 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-hbdkt" event={"ID":"5aa3f5cb-8c34-46e9-8b09-8af6c2318dce","Type":"ContainerStarted","Data":"3ebcb4662bf92412001b64abcefa1bddcf99c2dd75ce5d0e7c4aa73a7c147c26"} Jun 12 22:21:01.418491 ip-10-0-128-134 kubenswrapper[2559]: I0612 22:21:01.418469 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-9qn4j" event={"ID":"f6ddad48-94e1-479b-951c-ebf6be358f2c","Type":"ContainerStarted","Data":"d627350e7e72df3d84d6daffe5f4f3b94c427c26cddceebffabd82df777f48ce"} Jun 12 22:21:01.420912 ip-10-0-128-134 kubenswrapper[2559]: I0612 22:21:01.420894 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-f7h79" event={"ID":"2fe08918-3efc-4000-a321-8b319ead517c","Type":"ContainerStarted","Data":"e0c016ad35bb2ee321b352a6890573f2468eaeca9fa351824c8a3cd77b37d342"} Jun 12 22:21:01.422718 ip-10-0-128-134 kubenswrapper[2559]: I0612 22:21:01.422692 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-128-134.ec2.internal" event={"ID":"6d3e86596363af41e954bcae3f7c03e7","Type":"ContainerStarted","Data":"c4401e292558828c0da6bcaf354744304dec0811c983660b645895289478322a"} Jun 12 22:21:01.425150 ip-10-0-128-134 kubenswrapper[2559]: I0612 22:21:01.425113 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-bzp8z" event={"ID":"ca559a81-c5e6-4ba7-adc1-7ddafc57941a","Type":"ContainerStarted","Data":"dcf0cc7411236118747643faf2b0a5ca1c21508f7651bb4d619b564fa3f29af3"} Jun 12 22:21:01.426244 ip-10-0-128-134 kubenswrapper[2559]: I0612 22:21:01.426216 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-6fjft" event={"ID":"2dd3c6ba-dc0c-4b3e-92b7-94a6b0999c26","Type":"ContainerStarted","Data":"d434df0314e065b3e514f925e2b2dfa1111960305d04b9d5fc65c45b984c2fc9"} Jun 12 22:21:01.427321 ip-10-0-128-134 kubenswrapper[2559]: I0612 22:21:01.427303 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-bghrt" event={"ID":"d01cad7b-32bc-45f8-8c98-057a798e0866","Type":"ContainerStarted","Data":"840f9d64aa5be35aa22760762df81738634784ac7452a30b62768c27084ada09"} Jun 12 22:21:01.437376 ip-10-0-128-134 kubenswrapper[2559]: I0612 22:21:01.437333 2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/kube-apiserver-proxy-ip-10-0-128-134.ec2.internal" podStartSLOduration=2.437320983 podStartE2EDuration="2.437320983s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-12 22:20:59 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-12 22:21:01.436892482 +0000 UTC m=+3.485262301" watchObservedRunningTime="2026-06-12 22:21:01.437320983 +0000 UTC m=+3.485690800" Jun 12 22:21:02.064633 ip-10-0-128-134 kubenswrapper[2559]: I0612 22:21:02.064592 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/12fe1273-445c-4710-8579-38c99d08c036-metrics-certs\") pod \"network-metrics-daemon-d9psx\" (UID: \"12fe1273-445c-4710-8579-38c99d08c036\") " pod="openshift-multus/network-metrics-daemon-d9psx" Jun 12 22:21:02.064834 ip-10-0-128-134 kubenswrapper[2559]: I0612 22:21:02.064666 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/73bd91e1-b3e8-495c-990c-3ab079745247-original-pull-secret\") pod \"global-pull-secret-syncer-zdjjt\" (UID: \"73bd91e1-b3e8-495c-990c-3ab079745247\") " pod="kube-system/global-pull-secret-syncer-zdjjt" Jun 12 22:21:02.064834 ip-10-0-128-134 kubenswrapper[2559]: E0612 22:21:02.064803 2559 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jun 12 22:21:02.064978 ip-10-0-128-134 kubenswrapper[2559]: E0612 22:21:02.064865 2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/73bd91e1-b3e8-495c-990c-3ab079745247-original-pull-secret podName:73bd91e1-b3e8-495c-990c-3ab079745247 nodeName:}" failed. No retries permitted until 2026-06-12 22:21:04.064847387 +0000 UTC m=+6.113217186 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/73bd91e1-b3e8-495c-990c-3ab079745247-original-pull-secret") pod "global-pull-secret-syncer-zdjjt" (UID: "73bd91e1-b3e8-495c-990c-3ab079745247") : object "kube-system"/"original-pull-secret" not registered Jun 12 22:21:02.065356 ip-10-0-128-134 kubenswrapper[2559]: E0612 22:21:02.065268 2559 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jun 12 22:21:02.065356 ip-10-0-128-134 kubenswrapper[2559]: E0612 22:21:02.065325 2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/12fe1273-445c-4710-8579-38c99d08c036-metrics-certs podName:12fe1273-445c-4710-8579-38c99d08c036 nodeName:}" failed. No retries permitted until 2026-06-12 22:21:04.065307523 +0000 UTC m=+6.113677332 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/12fe1273-445c-4710-8579-38c99d08c036-metrics-certs") pod "network-metrics-daemon-d9psx" (UID: "12fe1273-445c-4710-8579-38c99d08c036") : object "openshift-multus"/"metrics-daemon-secret" not registered Jun 12 22:21:02.165774 ip-10-0-128-134 kubenswrapper[2559]: I0612 22:21:02.165732 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-769tf\" (UniqueName: \"kubernetes.io/projected/d4d1b0d2-aea6-421c-91e9-f74e3b7a4c6a-kube-api-access-769tf\") pod \"network-check-target-c9wls\" (UID: \"d4d1b0d2-aea6-421c-91e9-f74e3b7a4c6a\") " pod="openshift-network-diagnostics/network-check-target-c9wls" Jun 12 22:21:02.165954 ip-10-0-128-134 kubenswrapper[2559]: E0612 22:21:02.165910 2559 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jun 12 22:21:02.165954 ip-10-0-128-134 kubenswrapper[2559]: E0612 22:21:02.165933 2559 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jun 12 22:21:02.165954 ip-10-0-128-134 kubenswrapper[2559]: E0612 22:21:02.165945 2559 projected.go:196] Error preparing data for projected volume kube-api-access-769tf for pod openshift-network-diagnostics/network-check-target-c9wls: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 12 22:21:02.166108 ip-10-0-128-134 kubenswrapper[2559]: E0612 22:21:02.166004 2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/d4d1b0d2-aea6-421c-91e9-f74e3b7a4c6a-kube-api-access-769tf podName:d4d1b0d2-aea6-421c-91e9-f74e3b7a4c6a nodeName:}" failed. No retries permitted until 2026-06-12 22:21:04.165984334 +0000 UTC m=+6.214354147 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-api-access-769tf" (UniqueName: "kubernetes.io/projected/d4d1b0d2-aea6-421c-91e9-f74e3b7a4c6a-kube-api-access-769tf") pod "network-check-target-c9wls" (UID: "d4d1b0d2-aea6-421c-91e9-f74e3b7a4c6a") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 12 22:21:02.392864 ip-10-0-128-134 kubenswrapper[2559]: I0612 22:21:02.392778 2559 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-06-11 22:16:00 +0000 UTC" deadline="2027-11-13 09:54:26.059310189 +0000 UTC" Jun 12 22:21:02.392864 ip-10-0-128-134 kubenswrapper[2559]: I0612 22:21:02.392812 2559 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="12443h33m23.666502242s" Jun 12 22:21:02.406386 ip-10-0-128-134 kubenswrapper[2559]: I0612 22:21:02.406353 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-c9wls" Jun 12 22:21:02.406542 ip-10-0-128-134 kubenswrapper[2559]: E0612 22:21:02.406485 2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-c9wls" podUID="d4d1b0d2-aea6-421c-91e9-f74e3b7a4c6a" Jun 12 22:21:02.406921 ip-10-0-128-134 kubenswrapper[2559]: I0612 22:21:02.406897 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-zdjjt" Jun 12 22:21:02.407019 ip-10-0-128-134 kubenswrapper[2559]: E0612 22:21:02.406995 2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-zdjjt" podUID="73bd91e1-b3e8-495c-990c-3ab079745247" Jun 12 22:21:02.445033 ip-10-0-128-134 kubenswrapper[2559]: I0612 22:21:02.444996 2559 generic.go:356] "Generic (PLEG): container finished" podID="be987faa4fc50bfe0d9fa8445913d866" containerID="3cbb2a178f725e9ff0a88e4c940cf75f2cafcdbf849d1fa008ababab631ea35c" exitCode=0 Jun 12 22:21:02.445950 ip-10-0-128-134 kubenswrapper[2559]: I0612 22:21:02.445919 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-128-134.ec2.internal" event={"ID":"be987faa4fc50bfe0d9fa8445913d866","Type":"ContainerDied","Data":"3cbb2a178f725e9ff0a88e4c940cf75f2cafcdbf849d1fa008ababab631ea35c"} Jun 12 22:21:03.404096 ip-10-0-128-134 kubenswrapper[2559]: I0612 22:21:03.404063 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-d9psx" Jun 12 22:21:03.404587 ip-10-0-128-134 kubenswrapper[2559]: E0612 22:21:03.404206 2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-d9psx" podUID="12fe1273-445c-4710-8579-38c99d08c036" Jun 12 22:21:03.481635 ip-10-0-128-134 kubenswrapper[2559]: I0612 22:21:03.481597 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-128-134.ec2.internal" event={"ID":"be987faa4fc50bfe0d9fa8445913d866","Type":"ContainerStarted","Data":"9ec140c483168bcc9c04986fe50509f235af6b328f706dff2d8000d00aeb03a4"} Jun 12 22:21:03.498212 ip-10-0-128-134 kubenswrapper[2559]: I0612 22:21:03.497571 2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-128-134.ec2.internal" podStartSLOduration=4.497553375 podStartE2EDuration="4.497553375s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-12 22:20:59 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-12 22:21:03.496823191 +0000 UTC m=+5.545193009" watchObservedRunningTime="2026-06-12 22:21:03.497553375 +0000 UTC m=+5.545923193" Jun 12 22:21:04.084980 ip-10-0-128-134 kubenswrapper[2559]: I0612 22:21:04.084943 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/12fe1273-445c-4710-8579-38c99d08c036-metrics-certs\") pod \"network-metrics-daemon-d9psx\" (UID: \"12fe1273-445c-4710-8579-38c99d08c036\") " pod="openshift-multus/network-metrics-daemon-d9psx" Jun 12 22:21:04.085183 ip-10-0-128-134 kubenswrapper[2559]: I0612 22:21:04.085014 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/73bd91e1-b3e8-495c-990c-3ab079745247-original-pull-secret\") pod \"global-pull-secret-syncer-zdjjt\" (UID: \"73bd91e1-b3e8-495c-990c-3ab079745247\") " pod="kube-system/global-pull-secret-syncer-zdjjt" Jun 12 22:21:04.085183 ip-10-0-128-134 kubenswrapper[2559]: E0612 22:21:04.085121 2559 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jun 12 22:21:04.085183 ip-10-0-128-134 kubenswrapper[2559]: E0612 22:21:04.085121 2559 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jun 12 22:21:04.085337 ip-10-0-128-134 kubenswrapper[2559]: E0612 22:21:04.085188 2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/12fe1273-445c-4710-8579-38c99d08c036-metrics-certs podName:12fe1273-445c-4710-8579-38c99d08c036 nodeName:}" failed. No retries permitted until 2026-06-12 22:21:08.085167866 +0000 UTC m=+10.133537667 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/12fe1273-445c-4710-8579-38c99d08c036-metrics-certs") pod "network-metrics-daemon-d9psx" (UID: "12fe1273-445c-4710-8579-38c99d08c036") : object "openshift-multus"/"metrics-daemon-secret" not registered Jun 12 22:21:04.085337 ip-10-0-128-134 kubenswrapper[2559]: E0612 22:21:04.085209 2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/73bd91e1-b3e8-495c-990c-3ab079745247-original-pull-secret podName:73bd91e1-b3e8-495c-990c-3ab079745247 nodeName:}" failed. No retries permitted until 2026-06-12 22:21:08.085198835 +0000 UTC m=+10.133568656 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/73bd91e1-b3e8-495c-990c-3ab079745247-original-pull-secret") pod "global-pull-secret-syncer-zdjjt" (UID: "73bd91e1-b3e8-495c-990c-3ab079745247") : object "kube-system"/"original-pull-secret" not registered Jun 12 22:21:04.186783 ip-10-0-128-134 kubenswrapper[2559]: I0612 22:21:04.186088 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-769tf\" (UniqueName: \"kubernetes.io/projected/d4d1b0d2-aea6-421c-91e9-f74e3b7a4c6a-kube-api-access-769tf\") pod \"network-check-target-c9wls\" (UID: \"d4d1b0d2-aea6-421c-91e9-f74e3b7a4c6a\") " pod="openshift-network-diagnostics/network-check-target-c9wls" Jun 12 22:21:04.186783 ip-10-0-128-134 kubenswrapper[2559]: E0612 22:21:04.186285 2559 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jun 12 22:21:04.186783 ip-10-0-128-134 kubenswrapper[2559]: E0612 22:21:04.186308 2559 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jun 12 22:21:04.186783 ip-10-0-128-134 kubenswrapper[2559]: E0612 22:21:04.186321 2559 projected.go:196] Error preparing data for projected volume kube-api-access-769tf for pod openshift-network-diagnostics/network-check-target-c9wls: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 12 22:21:04.186783 ip-10-0-128-134 kubenswrapper[2559]: E0612 22:21:04.186374 2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/d4d1b0d2-aea6-421c-91e9-f74e3b7a4c6a-kube-api-access-769tf podName:d4d1b0d2-aea6-421c-91e9-f74e3b7a4c6a nodeName:}" failed. No retries permitted until 2026-06-12 22:21:08.186357335 +0000 UTC m=+10.234727149 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-api-access-769tf" (UniqueName: "kubernetes.io/projected/d4d1b0d2-aea6-421c-91e9-f74e3b7a4c6a-kube-api-access-769tf") pod "network-check-target-c9wls" (UID: "d4d1b0d2-aea6-421c-91e9-f74e3b7a4c6a") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 12 22:21:04.407530 ip-10-0-128-134 kubenswrapper[2559]: I0612 22:21:04.406934 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-c9wls" Jun 12 22:21:04.407530 ip-10-0-128-134 kubenswrapper[2559]: E0612 22:21:04.407024 2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-c9wls" podUID="d4d1b0d2-aea6-421c-91e9-f74e3b7a4c6a" Jun 12 22:21:04.407530 ip-10-0-128-134 kubenswrapper[2559]: I0612 22:21:04.407327 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-zdjjt" Jun 12 22:21:04.407530 ip-10-0-128-134 kubenswrapper[2559]: E0612 22:21:04.407417 2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-zdjjt" podUID="73bd91e1-b3e8-495c-990c-3ab079745247" Jun 12 22:21:05.404279 ip-10-0-128-134 kubenswrapper[2559]: I0612 22:21:05.404244 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-d9psx" Jun 12 22:21:05.404464 ip-10-0-128-134 kubenswrapper[2559]: E0612 22:21:05.404403 2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-d9psx" podUID="12fe1273-445c-4710-8579-38c99d08c036" Jun 12 22:21:06.404143 ip-10-0-128-134 kubenswrapper[2559]: I0612 22:21:06.404109 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-c9wls" Jun 12 22:21:06.404610 ip-10-0-128-134 kubenswrapper[2559]: I0612 22:21:06.404122 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-zdjjt" Jun 12 22:21:06.404610 ip-10-0-128-134 kubenswrapper[2559]: E0612 22:21:06.404319 2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-zdjjt" podUID="73bd91e1-b3e8-495c-990c-3ab079745247" Jun 12 22:21:06.404610 ip-10-0-128-134 kubenswrapper[2559]: E0612 22:21:06.404332 2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-c9wls" podUID="d4d1b0d2-aea6-421c-91e9-f74e3b7a4c6a" Jun 12 22:21:07.404901 ip-10-0-128-134 kubenswrapper[2559]: I0612 22:21:07.404368 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-d9psx" Jun 12 22:21:07.404901 ip-10-0-128-134 kubenswrapper[2559]: E0612 22:21:07.404544 2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-d9psx" podUID="12fe1273-445c-4710-8579-38c99d08c036" Jun 12 22:21:08.120918 ip-10-0-128-134 kubenswrapper[2559]: I0612 22:21:08.120874 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/12fe1273-445c-4710-8579-38c99d08c036-metrics-certs\") pod \"network-metrics-daemon-d9psx\" (UID: \"12fe1273-445c-4710-8579-38c99d08c036\") " pod="openshift-multus/network-metrics-daemon-d9psx" Jun 12 22:21:08.121102 ip-10-0-128-134 kubenswrapper[2559]: I0612 22:21:08.120952 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/73bd91e1-b3e8-495c-990c-3ab079745247-original-pull-secret\") pod \"global-pull-secret-syncer-zdjjt\" (UID: \"73bd91e1-b3e8-495c-990c-3ab079745247\") " pod="kube-system/global-pull-secret-syncer-zdjjt" Jun 12 22:21:08.121179 ip-10-0-128-134 kubenswrapper[2559]: E0612 22:21:08.121103 2559 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jun 12 22:21:08.121179 ip-10-0-128-134 kubenswrapper[2559]: E0612 22:21:08.121178 2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/73bd91e1-b3e8-495c-990c-3ab079745247-original-pull-secret podName:73bd91e1-b3e8-495c-990c-3ab079745247 nodeName:}" failed. No retries permitted until 2026-06-12 22:21:16.121158409 +0000 UTC m=+18.169528221 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/73bd91e1-b3e8-495c-990c-3ab079745247-original-pull-secret") pod "global-pull-secret-syncer-zdjjt" (UID: "73bd91e1-b3e8-495c-990c-3ab079745247") : object "kube-system"/"original-pull-secret" not registered Jun 12 22:21:08.121626 ip-10-0-128-134 kubenswrapper[2559]: E0612 22:21:08.121601 2559 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jun 12 22:21:08.121744 ip-10-0-128-134 kubenswrapper[2559]: E0612 22:21:08.121657 2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/12fe1273-445c-4710-8579-38c99d08c036-metrics-certs podName:12fe1273-445c-4710-8579-38c99d08c036 nodeName:}" failed. No retries permitted until 2026-06-12 22:21:16.121640366 +0000 UTC m=+18.170010175 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/12fe1273-445c-4710-8579-38c99d08c036-metrics-certs") pod "network-metrics-daemon-d9psx" (UID: "12fe1273-445c-4710-8579-38c99d08c036") : object "openshift-multus"/"metrics-daemon-secret" not registered Jun 12 22:21:08.221548 ip-10-0-128-134 kubenswrapper[2559]: I0612 22:21:08.221511 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-769tf\" (UniqueName: \"kubernetes.io/projected/d4d1b0d2-aea6-421c-91e9-f74e3b7a4c6a-kube-api-access-769tf\") pod \"network-check-target-c9wls\" (UID: \"d4d1b0d2-aea6-421c-91e9-f74e3b7a4c6a\") " pod="openshift-network-diagnostics/network-check-target-c9wls" Jun 12 22:21:08.221728 ip-10-0-128-134 kubenswrapper[2559]: E0612 22:21:08.221693 2559 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jun 12 22:21:08.221728 ip-10-0-128-134 kubenswrapper[2559]: E0612 22:21:08.221713 2559 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jun 12 22:21:08.221728 ip-10-0-128-134 kubenswrapper[2559]: E0612 22:21:08.221724 2559 projected.go:196] Error preparing data for projected volume kube-api-access-769tf for pod openshift-network-diagnostics/network-check-target-c9wls: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 12 22:21:08.221879 ip-10-0-128-134 kubenswrapper[2559]: E0612 22:21:08.221784 2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/d4d1b0d2-aea6-421c-91e9-f74e3b7a4c6a-kube-api-access-769tf podName:d4d1b0d2-aea6-421c-91e9-f74e3b7a4c6a nodeName:}" failed. No retries permitted until 2026-06-12 22:21:16.22176493 +0000 UTC m=+18.270134747 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-api-access-769tf" (UniqueName: "kubernetes.io/projected/d4d1b0d2-aea6-421c-91e9-f74e3b7a4c6a-kube-api-access-769tf") pod "network-check-target-c9wls" (UID: "d4d1b0d2-aea6-421c-91e9-f74e3b7a4c6a") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 12 22:21:08.405283 ip-10-0-128-134 kubenswrapper[2559]: I0612 22:21:08.405200 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-c9wls" Jun 12 22:21:08.405690 ip-10-0-128-134 kubenswrapper[2559]: E0612 22:21:08.405310 2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-c9wls" podUID="d4d1b0d2-aea6-421c-91e9-f74e3b7a4c6a" Jun 12 22:21:08.405760 ip-10-0-128-134 kubenswrapper[2559]: I0612 22:21:08.405715 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-zdjjt" Jun 12 22:21:08.405825 ip-10-0-128-134 kubenswrapper[2559]: E0612 22:21:08.405804 2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-zdjjt" podUID="73bd91e1-b3e8-495c-990c-3ab079745247" Jun 12 22:21:09.404903 ip-10-0-128-134 kubenswrapper[2559]: I0612 22:21:09.404860 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-d9psx" Jun 12 22:21:09.405072 ip-10-0-128-134 kubenswrapper[2559]: E0612 22:21:09.405007 2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-d9psx" podUID="12fe1273-445c-4710-8579-38c99d08c036" Jun 12 22:21:10.404839 ip-10-0-128-134 kubenswrapper[2559]: I0612 22:21:10.404544 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-c9wls" Jun 12 22:21:10.404839 ip-10-0-128-134 kubenswrapper[2559]: E0612 22:21:10.404669 2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-c9wls" podUID="d4d1b0d2-aea6-421c-91e9-f74e3b7a4c6a" Jun 12 22:21:10.404839 ip-10-0-128-134 kubenswrapper[2559]: I0612 22:21:10.404732 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-zdjjt" Jun 12 22:21:10.404839 ip-10-0-128-134 kubenswrapper[2559]: E0612 22:21:10.404809 2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-zdjjt" podUID="73bd91e1-b3e8-495c-990c-3ab079745247" Jun 12 22:21:11.404938 ip-10-0-128-134 kubenswrapper[2559]: I0612 22:21:11.404676 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-d9psx" Jun 12 22:21:11.405363 ip-10-0-128-134 kubenswrapper[2559]: E0612 22:21:11.405075 2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-d9psx" podUID="12fe1273-445c-4710-8579-38c99d08c036" Jun 12 22:21:12.403954 ip-10-0-128-134 kubenswrapper[2559]: I0612 22:21:12.403909 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-c9wls" Jun 12 22:21:12.404139 ip-10-0-128-134 kubenswrapper[2559]: I0612 22:21:12.403909 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-zdjjt" Jun 12 22:21:12.404139 ip-10-0-128-134 kubenswrapper[2559]: E0612 22:21:12.404038 2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-c9wls" podUID="d4d1b0d2-aea6-421c-91e9-f74e3b7a4c6a" Jun 12 22:21:12.404278 ip-10-0-128-134 kubenswrapper[2559]: E0612 22:21:12.404136 2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-zdjjt" podUID="73bd91e1-b3e8-495c-990c-3ab079745247" Jun 12 22:21:13.403997 ip-10-0-128-134 kubenswrapper[2559]: I0612 22:21:13.403965 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-d9psx" Jun 12 22:21:13.404472 ip-10-0-128-134 kubenswrapper[2559]: E0612 22:21:13.404084 2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-d9psx" podUID="12fe1273-445c-4710-8579-38c99d08c036" Jun 12 22:21:14.404127 ip-10-0-128-134 kubenswrapper[2559]: I0612 22:21:14.404087 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-c9wls" Jun 12 22:21:14.404566 ip-10-0-128-134 kubenswrapper[2559]: E0612 22:21:14.404209 2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-c9wls" podUID="d4d1b0d2-aea6-421c-91e9-f74e3b7a4c6a" Jun 12 22:21:14.404566 ip-10-0-128-134 kubenswrapper[2559]: I0612 22:21:14.404273 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-zdjjt" Jun 12 22:21:14.404566 ip-10-0-128-134 kubenswrapper[2559]: E0612 22:21:14.404388 2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-zdjjt" podUID="73bd91e1-b3e8-495c-990c-3ab079745247" Jun 12 22:21:15.404028 ip-10-0-128-134 kubenswrapper[2559]: I0612 22:21:15.404001 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-d9psx" Jun 12 22:21:15.404168 ip-10-0-128-134 kubenswrapper[2559]: E0612 22:21:15.404110 2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-d9psx" podUID="12fe1273-445c-4710-8579-38c99d08c036" Jun 12 22:21:16.181122 ip-10-0-128-134 kubenswrapper[2559]: I0612 22:21:16.181077 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/12fe1273-445c-4710-8579-38c99d08c036-metrics-certs\") pod \"network-metrics-daemon-d9psx\" (UID: \"12fe1273-445c-4710-8579-38c99d08c036\") " pod="openshift-multus/network-metrics-daemon-d9psx" Jun 12 22:21:16.181281 ip-10-0-128-134 kubenswrapper[2559]: I0612 22:21:16.181152 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/73bd91e1-b3e8-495c-990c-3ab079745247-original-pull-secret\") pod \"global-pull-secret-syncer-zdjjt\" (UID: \"73bd91e1-b3e8-495c-990c-3ab079745247\") " pod="kube-system/global-pull-secret-syncer-zdjjt" Jun 12 22:21:16.181281 ip-10-0-128-134 kubenswrapper[2559]: E0612 22:21:16.181226 2559 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jun 12 22:21:16.181281 ip-10-0-128-134 kubenswrapper[2559]: E0612 22:21:16.181262 2559 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jun 12 22:21:16.181396 ip-10-0-128-134 kubenswrapper[2559]: E0612 22:21:16.181302 2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/12fe1273-445c-4710-8579-38c99d08c036-metrics-certs podName:12fe1273-445c-4710-8579-38c99d08c036 nodeName:}" failed. No retries permitted until 2026-06-12 22:21:32.181283354 +0000 UTC m=+34.229653165 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/12fe1273-445c-4710-8579-38c99d08c036-metrics-certs") pod "network-metrics-daemon-d9psx" (UID: "12fe1273-445c-4710-8579-38c99d08c036") : object "openshift-multus"/"metrics-daemon-secret" not registered Jun 12 22:21:16.181396 ip-10-0-128-134 kubenswrapper[2559]: E0612 22:21:16.181321 2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/73bd91e1-b3e8-495c-990c-3ab079745247-original-pull-secret podName:73bd91e1-b3e8-495c-990c-3ab079745247 nodeName:}" failed. No retries permitted until 2026-06-12 22:21:32.18131382 +0000 UTC m=+34.229683615 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/73bd91e1-b3e8-495c-990c-3ab079745247-original-pull-secret") pod "global-pull-secret-syncer-zdjjt" (UID: "73bd91e1-b3e8-495c-990c-3ab079745247") : object "kube-system"/"original-pull-secret" not registered Jun 12 22:21:16.282300 ip-10-0-128-134 kubenswrapper[2559]: I0612 22:21:16.282255 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-769tf\" (UniqueName: \"kubernetes.io/projected/d4d1b0d2-aea6-421c-91e9-f74e3b7a4c6a-kube-api-access-769tf\") pod \"network-check-target-c9wls\" (UID: \"d4d1b0d2-aea6-421c-91e9-f74e3b7a4c6a\") " pod="openshift-network-diagnostics/network-check-target-c9wls" Jun 12 22:21:16.282508 ip-10-0-128-134 kubenswrapper[2559]: E0612 22:21:16.282468 2559 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jun 12 22:21:16.282508 ip-10-0-128-134 kubenswrapper[2559]: E0612 22:21:16.282493 2559 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jun 12 22:21:16.282508 ip-10-0-128-134 kubenswrapper[2559]: E0612 22:21:16.282506 2559 projected.go:196] Error preparing data for projected volume kube-api-access-769tf for pod openshift-network-diagnostics/network-check-target-c9wls: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 12 22:21:16.282669 ip-10-0-128-134 kubenswrapper[2559]: E0612 22:21:16.282572 2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/d4d1b0d2-aea6-421c-91e9-f74e3b7a4c6a-kube-api-access-769tf podName:d4d1b0d2-aea6-421c-91e9-f74e3b7a4c6a nodeName:}" failed. No retries permitted until 2026-06-12 22:21:32.282552365 +0000 UTC m=+34.330922162 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "kube-api-access-769tf" (UniqueName: "kubernetes.io/projected/d4d1b0d2-aea6-421c-91e9-f74e3b7a4c6a-kube-api-access-769tf") pod "network-check-target-c9wls" (UID: "d4d1b0d2-aea6-421c-91e9-f74e3b7a4c6a") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 12 22:21:16.404112 ip-10-0-128-134 kubenswrapper[2559]: I0612 22:21:16.404083 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-c9wls" Jun 12 22:21:16.404112 ip-10-0-128-134 kubenswrapper[2559]: I0612 22:21:16.404101 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-zdjjt" Jun 12 22:21:16.404660 ip-10-0-128-134 kubenswrapper[2559]: E0612 22:21:16.404195 2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-c9wls" podUID="d4d1b0d2-aea6-421c-91e9-f74e3b7a4c6a" Jun 12 22:21:16.404660 ip-10-0-128-134 kubenswrapper[2559]: E0612 22:21:16.404336 2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-zdjjt" podUID="73bd91e1-b3e8-495c-990c-3ab079745247" Jun 12 22:21:17.403896 ip-10-0-128-134 kubenswrapper[2559]: I0612 22:21:17.403858 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-d9psx" Jun 12 22:21:17.404065 ip-10-0-128-134 kubenswrapper[2559]: E0612 22:21:17.404004 2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-d9psx" podUID="12fe1273-445c-4710-8579-38c99d08c036" Jun 12 22:21:18.404800 ip-10-0-128-134 kubenswrapper[2559]: I0612 22:21:18.404768 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-c9wls" Jun 12 22:21:18.405235 ip-10-0-128-134 kubenswrapper[2559]: E0612 22:21:18.404881 2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-c9wls" podUID="d4d1b0d2-aea6-421c-91e9-f74e3b7a4c6a" Jun 12 22:21:18.405235 ip-10-0-128-134 kubenswrapper[2559]: I0612 22:21:18.404917 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-zdjjt" Jun 12 22:21:18.405235 ip-10-0-128-134 kubenswrapper[2559]: E0612 22:21:18.405012 2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-zdjjt" podUID="73bd91e1-b3e8-495c-990c-3ab079745247" Jun 12 22:21:19.404122 ip-10-0-128-134 kubenswrapper[2559]: I0612 22:21:19.404088 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-d9psx" Jun 12 22:21:19.404290 ip-10-0-128-134 kubenswrapper[2559]: E0612 22:21:19.404232 2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-d9psx" podUID="12fe1273-445c-4710-8579-38c99d08c036" Jun 12 22:21:20.404712 ip-10-0-128-134 kubenswrapper[2559]: I0612 22:21:20.404375 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-c9wls" Jun 12 22:21:20.404712 ip-10-0-128-134 kubenswrapper[2559]: I0612 22:21:20.404550 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-zdjjt" Jun 12 22:21:20.404712 ip-10-0-128-134 kubenswrapper[2559]: E0612 22:21:20.404674 2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-c9wls" podUID="d4d1b0d2-aea6-421c-91e9-f74e3b7a4c6a" Jun 12 22:21:20.405342 ip-10-0-128-134 kubenswrapper[2559]: E0612 22:21:20.404740 2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-zdjjt" podUID="73bd91e1-b3e8-495c-990c-3ab079745247" Jun 12 22:21:20.519180 ip-10-0-128-134 kubenswrapper[2559]: I0612 22:21:20.519155 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-bghrt" event={"ID":"d01cad7b-32bc-45f8-8c98-057a798e0866","Type":"ContainerStarted","Data":"a84c70ef1a35ade8e62b311117e5adcec90a8428b416bd53bb6e7f2660c7cbbc"} Jun 12 22:21:20.520629 ip-10-0-128-134 kubenswrapper[2559]: I0612 22:21:20.520603 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-kbvj8" event={"ID":"35a1db5d-f311-4962-9835-e21409e67513","Type":"ContainerStarted","Data":"222ac4b6a771e5a664822a8918a73e2c7b43dbdd0d5bfdc05a62c736aab58c5d"} Jun 12 22:21:20.522634 ip-10-0-128-134 kubenswrapper[2559]: I0612 22:21:20.522615 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-qdtqn" event={"ID":"843f3267-327c-4702-9510-3ceb40add4e1","Type":"ContainerStarted","Data":"61ec2d136dbc22da72b9f0eb74c687d7c73a8e97c15eed52f77bc49113df2ada"} Jun 12 22:21:20.524014 ip-10-0-128-134 kubenswrapper[2559]: I0612 22:21:20.523991 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-hbdkt" event={"ID":"5aa3f5cb-8c34-46e9-8b09-8af6c2318dce","Type":"ContainerStarted","Data":"bd86ac33f3ab6f4b77d9731b975e1484e53bca66258328a927b549fe3255e9f1"} Jun 12 22:21:20.525719 ip-10-0-128-134 kubenswrapper[2559]: I0612 22:21:20.525701 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-9qn4j" event={"ID":"f6ddad48-94e1-479b-951c-ebf6be358f2c","Type":"ContainerStarted","Data":"c60e4c2da5e66bf74e2e64c16ab7b704ff45681a8c596f04133db63c474d80c0"} Jun 12 22:21:20.526904 ip-10-0-128-134 kubenswrapper[2559]: I0612 22:21:20.526877 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-f7h79" event={"ID":"2fe08918-3efc-4000-a321-8b319ead517c","Type":"ContainerStarted","Data":"d8485546a7428bad01fb818290e7b73d0c17a40e1114cd87598671bcfd5c46cc"} Jun 12 22:21:20.528182 ip-10-0-128-134 kubenswrapper[2559]: I0612 22:21:20.528157 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-bzp8z" event={"ID":"ca559a81-c5e6-4ba7-adc1-7ddafc57941a","Type":"ContainerStarted","Data":"75c289bec402f5969e67abf46b1dd8a1cb4016aa8ccd4716bf0577f79401d350"} Jun 12 22:21:20.529534 ip-10-0-128-134 kubenswrapper[2559]: I0612 22:21:20.529512 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-6fjft" event={"ID":"2dd3c6ba-dc0c-4b3e-92b7-94a6b0999c26","Type":"ContainerStarted","Data":"d74d809330d17b560808a7fe71b57b3ea782266072ba10e6878d67311b10c27d"} Jun 12 22:21:20.563701 ip-10-0-128-134 kubenswrapper[2559]: I0612 22:21:20.563662 2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/node-ca-bghrt" podStartSLOduration=3.687236106 podStartE2EDuration="22.563645137s" totalImagesPullingTime="18.876409031s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-12 22:20:58 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-12 22:21:20.537435897 +0000 UTC m=+22.585805718" watchObservedRunningTime="2026-06-12 22:21:20.563645137 +0000 UTC m=+22.612014954" Jun 12 22:21:20.563926 ip-10-0-128-134 kubenswrapper[2559]: I0612 22:21:20.563901 2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/konnectivity-agent-f7h79" podStartSLOduration=8.461229166 podStartE2EDuration="22.563896905s" totalImagesPullingTime="14.102667739s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-12 22:20:58 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-12 22:21:20.563748388 +0000 UTC m=+22.612118207" watchObservedRunningTime="2026-06-12 22:21:20.563896905 +0000 UTC m=+22.612266722" Jun 12 22:21:20.616079 ip-10-0-128-134 kubenswrapper[2559]: I0612 22:21:20.615213 2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/node-resolver-qdtqn" podStartSLOduration=3.744264957 podStartE2EDuration="22.615190842s" totalImagesPullingTime="18.870925885s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-12 22:20:58 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-12 22:21:20.583883647 +0000 UTC m=+22.632253457" watchObservedRunningTime="2026-06-12 22:21:20.615190842 +0000 UTC m=+22.663560661" Jun 12 22:21:20.634500 ip-10-0-128-134 kubenswrapper[2559]: I0612 22:21:20.634427 2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-bzp8z" podStartSLOduration=3.734677122 podStartE2EDuration="22.634411381s" totalImagesPullingTime="18.899734259s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-12 22:20:58 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-12 22:21:20.634025439 +0000 UTC m=+22.682395258" watchObservedRunningTime="2026-06-12 22:21:20.634411381 +0000 UTC m=+22.682781198" Jun 12 22:21:20.656979 ip-10-0-128-134 kubenswrapper[2559]: I0612 22:21:20.656933 2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-node-tuning-operator/tuned-kbvj8" podStartSLOduration=3.777268767 podStartE2EDuration="22.656917915s" totalImagesPullingTime="18.879649148s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-12 22:20:58 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-12 22:21:20.656882322 +0000 UTC m=+22.705252138" watchObservedRunningTime="2026-06-12 22:21:20.656917915 +0000 UTC m=+22.705287732" Jun 12 22:21:20.908260 ip-10-0-128-134 kubenswrapper[2559]: I0612 22:21:20.908227 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-f7h79_2fe08918-3efc-4000-a321-8b319ead517c/konnectivity-agent/0.log" limit=1024 Jun 12 22:21:20.984215 ip-10-0-128-134 kubenswrapper[2559]: I0612 22:21:20.984187 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-f7h79_2fe08918-3efc-4000-a321-8b319ead517c/konnectivity-agent/0.log" limit=1024 Jun 12 22:21:21.084967 ip-10-0-128-134 kubenswrapper[2559]: I0612 22:21:21.084934 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-f7h79_2fe08918-3efc-4000-a321-8b319ead517c/konnectivity-agent/0.log" limit=1024 Jun 12 22:21:21.255643 ip-10-0-128-134 kubenswrapper[2559]: I0612 22:21:21.255557 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-f7h79_2fe08918-3efc-4000-a321-8b319ead517c/konnectivity-agent/0.log" limit=1024 Jun 12 22:21:21.404688 ip-10-0-128-134 kubenswrapper[2559]: I0612 22:21:21.404514 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-d9psx" Jun 12 22:21:21.404842 ip-10-0-128-134 kubenswrapper[2559]: E0612 22:21:21.404767 2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-d9psx" podUID="12fe1273-445c-4710-8579-38c99d08c036" Jun 12 22:21:21.469815 ip-10-0-128-134 kubenswrapper[2559]: I0612 22:21:21.469789 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-f7h79_2fe08918-3efc-4000-a321-8b319ead517c/konnectivity-agent/0.log" limit=1024 Jun 12 22:21:21.533294 ip-10-0-128-134 kubenswrapper[2559]: I0612 22:21:21.533274 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-9qn4j_f6ddad48-94e1-479b-951c-ebf6be358f2c/ovn-acl-logging/0.log" Jun 12 22:21:21.533603 ip-10-0-128-134 kubenswrapper[2559]: I0612 22:21:21.533583 2559 generic.go:356] "Generic (PLEG): container finished" podID="f6ddad48-94e1-479b-951c-ebf6be358f2c" containerID="5dc234a62e5ed6ea12ceeadf3253011c602e0373501af4f75c34c1280cdb7a13" exitCode=1 Jun 12 22:21:21.533669 ip-10-0-128-134 kubenswrapper[2559]: I0612 22:21:21.533651 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-9qn4j" event={"ID":"f6ddad48-94e1-479b-951c-ebf6be358f2c","Type":"ContainerDied","Data":"5dc234a62e5ed6ea12ceeadf3253011c602e0373501af4f75c34c1280cdb7a13"} Jun 12 22:21:21.533732 ip-10-0-128-134 kubenswrapper[2559]: I0612 22:21:21.533719 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-9qn4j" event={"ID":"f6ddad48-94e1-479b-951c-ebf6be358f2c","Type":"ContainerStarted","Data":"884d00884f7c66331ed365ed0df5d6e230b85eb81a7008a17e676637aaeb8aec"} Jun 12 22:21:21.533768 ip-10-0-128-134 kubenswrapper[2559]: I0612 22:21:21.533763 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-9qn4j" event={"ID":"f6ddad48-94e1-479b-951c-ebf6be358f2c","Type":"ContainerStarted","Data":"5d7fbb369aa234728ca026d1bd4ae8127d1a7a4b5b26aadb945037f8dd1a3134"} Jun 12 22:21:21.533808 ip-10-0-128-134 kubenswrapper[2559]: I0612 22:21:21.533793 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-9qn4j" event={"ID":"f6ddad48-94e1-479b-951c-ebf6be358f2c","Type":"ContainerStarted","Data":"7a81b5efef3aceafef481e6b297f2fcc8d7cf30d37f8fc6bc39ae4d3e2bde693"} Jun 12 22:21:21.533846 ip-10-0-128-134 kubenswrapper[2559]: I0612 22:21:21.533825 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-9qn4j" event={"ID":"f6ddad48-94e1-479b-951c-ebf6be358f2c","Type":"ContainerStarted","Data":"f82a6f0daac45489f0c236f47a6f254aeb8f0eff6fa1e76bf948bf89ed068595"} Jun 12 22:21:21.535058 ip-10-0-128-134 kubenswrapper[2559]: I0612 22:21:21.535037 2559 generic.go:356] "Generic (PLEG): container finished" podID="2dd3c6ba-dc0c-4b3e-92b7-94a6b0999c26" containerID="d74d809330d17b560808a7fe71b57b3ea782266072ba10e6878d67311b10c27d" exitCode=0 Jun 12 22:21:21.535157 ip-10-0-128-134 kubenswrapper[2559]: I0612 22:21:21.535129 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-6fjft" event={"ID":"2dd3c6ba-dc0c-4b3e-92b7-94a6b0999c26","Type":"ContainerDied","Data":"d74d809330d17b560808a7fe71b57b3ea782266072ba10e6878d67311b10c27d"} Jun 12 22:21:21.694333 ip-10-0-128-134 kubenswrapper[2559]: I0612 22:21:21.694309 2559 plugin_watcher.go:194] "Adding socket path or updating timestamp to desired state cache" path="/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock" Jun 12 22:21:21.697152 ip-10-0-128-134 kubenswrapper[2559]: I0612 22:21:21.697122 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-f7h79_2fe08918-3efc-4000-a321-8b319ead517c/konnectivity-agent/0.log" limit=1024 Jun 12 22:21:21.795195 ip-10-0-128-134 kubenswrapper[2559]: I0612 22:21:21.795168 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-f7h79_2fe08918-3efc-4000-a321-8b319ead517c/konnectivity-agent/0.log" limit=1024 Jun 12 22:21:22.401025 ip-10-0-128-134 kubenswrapper[2559]: I0612 22:21:22.400901 2559 reconciler.go:161] "OperationExecutor.RegisterPlugin started" plugin={"SocketPath":"/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock","Timestamp":"2026-06-12T22:21:21.694329369Z","UUID":"13951fe8-3f9f-4645-85eb-19e0165a68c4","Handler":null,"Name":"","Endpoint":""} Jun 12 22:21:22.403638 ip-10-0-128-134 kubenswrapper[2559]: I0612 22:21:22.403610 2559 csi_plugin.go:106] kubernetes.io/csi: Trying to validate a new CSI Driver with name: ebs.csi.aws.com endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock versions: 1.0.0 Jun 12 22:21:22.403770 ip-10-0-128-134 kubenswrapper[2559]: I0612 22:21:22.403660 2559 csi_plugin.go:119] kubernetes.io/csi: Register new plugin with name: ebs.csi.aws.com at endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock Jun 12 22:21:22.403995 ip-10-0-128-134 kubenswrapper[2559]: I0612 22:21:22.403972 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-c9wls" Jun 12 22:21:22.404316 ip-10-0-128-134 kubenswrapper[2559]: E0612 22:21:22.404095 2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-c9wls" podUID="d4d1b0d2-aea6-421c-91e9-f74e3b7a4c6a" Jun 12 22:21:22.404316 ip-10-0-128-134 kubenswrapper[2559]: I0612 22:21:22.404112 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-zdjjt" Jun 12 22:21:22.404316 ip-10-0-128-134 kubenswrapper[2559]: E0612 22:21:22.404199 2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-zdjjt" podUID="73bd91e1-b3e8-495c-990c-3ab079745247" Jun 12 22:21:22.540087 ip-10-0-128-134 kubenswrapper[2559]: I0612 22:21:22.540044 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-s2zxg" event={"ID":"fcd15bde-b438-4c03-a474-3424cfb17daa","Type":"ContainerStarted","Data":"326ccd31d43e57bb7d2171d1e0bfef4ae9e2c92f7be817007a1f332b157f70da"} Jun 12 22:21:22.542581 ip-10-0-128-134 kubenswrapper[2559]: I0612 22:21:22.542557 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-hbdkt" event={"ID":"5aa3f5cb-8c34-46e9-8b09-8af6c2318dce","Type":"ContainerStarted","Data":"ca22f688392d01288cb90b79668f7b9c443bf9f0ddb309578558ad0b1abf4c0d"} Jun 12 22:21:22.557274 ip-10-0-128-134 kubenswrapper[2559]: I0612 22:21:22.557231 2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-operator/iptables-alerter-s2zxg" podStartSLOduration=5.713569586 podStartE2EDuration="24.557217185s" totalImagesPullingTime="18.843647599s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-12 22:20:58 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-12 22:21:22.556974026 +0000 UTC m=+24.605343844" watchObservedRunningTime="2026-06-12 22:21:22.557217185 +0000 UTC m=+24.605587014" Jun 12 22:21:22.654595 ip-10-0-128-134 kubenswrapper[2559]: I0612 22:21:22.654532 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-f7h79_2fe08918-3efc-4000-a321-8b319ead517c/konnectivity-agent/0.log" limit=1024 Jun 12 22:21:22.849721 ip-10-0-128-134 kubenswrapper[2559]: I0612 22:21:22.849682 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-f7h79_2fe08918-3efc-4000-a321-8b319ead517c/konnectivity-agent/0.log" limit=1024 Jun 12 22:21:23.058069 ip-10-0-128-134 kubenswrapper[2559]: I0612 22:21:23.058039 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-f7h79_2fe08918-3efc-4000-a321-8b319ead517c/konnectivity-agent/0.log" limit=1024 Jun 12 22:21:23.268739 ip-10-0-128-134 kubenswrapper[2559]: I0612 22:21:23.268709 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-f7h79_2fe08918-3efc-4000-a321-8b319ead517c/konnectivity-agent/0.log" limit=1024 Jun 12 22:21:23.404193 ip-10-0-128-134 kubenswrapper[2559]: I0612 22:21:23.404112 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-d9psx" Jun 12 22:21:23.404334 ip-10-0-128-134 kubenswrapper[2559]: E0612 22:21:23.404245 2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-d9psx" podUID="12fe1273-445c-4710-8579-38c99d08c036" Jun 12 22:21:23.444658 ip-10-0-128-134 kubenswrapper[2559]: I0612 22:21:23.444630 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-f7h79_2fe08918-3efc-4000-a321-8b319ead517c/konnectivity-agent/0.log" limit=1024 Jun 12 22:21:23.546990 ip-10-0-128-134 kubenswrapper[2559]: I0612 22:21:23.546957 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-hbdkt" event={"ID":"5aa3f5cb-8c34-46e9-8b09-8af6c2318dce","Type":"ContainerStarted","Data":"8790871969ba001d42ca7eb9a5b0fc0b9fe4df8f69c288b386a468b62e1cd0d2"} Jun 12 22:21:23.550674 ip-10-0-128-134 kubenswrapper[2559]: I0612 22:21:23.550642 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-9qn4j_f6ddad48-94e1-479b-951c-ebf6be358f2c/ovn-acl-logging/0.log" Jun 12 22:21:23.551104 ip-10-0-128-134 kubenswrapper[2559]: I0612 22:21:23.551078 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-9qn4j" event={"ID":"f6ddad48-94e1-479b-951c-ebf6be358f2c","Type":"ContainerStarted","Data":"34d2b03f72e6e599ec4f6e474420dff198fa308ac6c9dac72fd49e766b55f1d9"} Jun 12 22:21:23.568174 ip-10-0-128-134 kubenswrapper[2559]: I0612 22:21:23.568134 2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-hbdkt" podStartSLOduration=4.597497766 podStartE2EDuration="25.568120127s" totalImagesPullingTime="20.970622361s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-12 22:20:58 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-12 22:21:23.568093018 +0000 UTC m=+25.616462837" watchObservedRunningTime="2026-06-12 22:21:23.568120127 +0000 UTC m=+25.616489935" Jun 12 22:21:24.042834 ip-10-0-128-134 kubenswrapper[2559]: I0612 22:21:24.042791 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-f7h79_2fe08918-3efc-4000-a321-8b319ead517c/konnectivity-agent/0.log" limit=1024 Jun 12 22:21:24.404007 ip-10-0-128-134 kubenswrapper[2559]: I0612 22:21:24.403974 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-c9wls" Jun 12 22:21:24.404215 ip-10-0-128-134 kubenswrapper[2559]: E0612 22:21:24.404122 2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-c9wls" podUID="d4d1b0d2-aea6-421c-91e9-f74e3b7a4c6a" Jun 12 22:21:24.404215 ip-10-0-128-134 kubenswrapper[2559]: I0612 22:21:24.404171 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-zdjjt" Jun 12 22:21:24.404323 ip-10-0-128-134 kubenswrapper[2559]: E0612 22:21:24.404256 2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-zdjjt" podUID="73bd91e1-b3e8-495c-990c-3ab079745247" Jun 12 22:21:24.440275 ip-10-0-128-134 kubenswrapper[2559]: I0612 22:21:24.440221 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-f7h79_2fe08918-3efc-4000-a321-8b319ead517c/konnectivity-agent/0.log" limit=1024 Jun 12 22:21:24.635886 ip-10-0-128-134 kubenswrapper[2559]: I0612 22:21:24.635858 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-f7h79_2fe08918-3efc-4000-a321-8b319ead517c/konnectivity-agent/0.log" limit=1024 Jun 12 22:21:25.048183 ip-10-0-128-134 kubenswrapper[2559]: I0612 22:21:25.048114 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-f7h79_2fe08918-3efc-4000-a321-8b319ead517c/konnectivity-agent/0.log" limit=1024 Jun 12 22:21:25.344791 ip-10-0-128-134 kubenswrapper[2559]: I0612 22:21:25.344714 2559 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="kube-system/konnectivity-agent-f7h79" Jun 12 22:21:25.345747 ip-10-0-128-134 kubenswrapper[2559]: I0612 22:21:25.345725 2559 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="kube-system/konnectivity-agent-f7h79" Jun 12 22:21:25.404191 ip-10-0-128-134 kubenswrapper[2559]: I0612 22:21:25.404158 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-d9psx" Jun 12 22:21:25.404351 ip-10-0-128-134 kubenswrapper[2559]: E0612 22:21:25.404302 2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-d9psx" podUID="12fe1273-445c-4710-8579-38c99d08c036" Jun 12 22:21:25.555948 ip-10-0-128-134 kubenswrapper[2559]: I0612 22:21:25.555909 2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kube-system/konnectivity-agent-f7h79" Jun 12 22:21:25.556423 ip-10-0-128-134 kubenswrapper[2559]: I0612 22:21:25.556405 2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kube-system/konnectivity-agent-f7h79" Jun 12 22:21:26.404761 ip-10-0-128-134 kubenswrapper[2559]: I0612 22:21:26.404519 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-c9wls" Jun 12 22:21:26.405144 ip-10-0-128-134 kubenswrapper[2559]: I0612 22:21:26.404519 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-zdjjt" Jun 12 22:21:26.405144 ip-10-0-128-134 kubenswrapper[2559]: E0612 22:21:26.404799 2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-c9wls" podUID="d4d1b0d2-aea6-421c-91e9-f74e3b7a4c6a" Jun 12 22:21:26.405144 ip-10-0-128-134 kubenswrapper[2559]: E0612 22:21:26.404870 2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-zdjjt" podUID="73bd91e1-b3e8-495c-990c-3ab079745247" Jun 12 22:21:26.561653 ip-10-0-128-134 kubenswrapper[2559]: I0612 22:21:26.561631 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-9qn4j_f6ddad48-94e1-479b-951c-ebf6be358f2c/ovn-acl-logging/0.log" Jun 12 22:21:26.562017 ip-10-0-128-134 kubenswrapper[2559]: I0612 22:21:26.561994 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-9qn4j" event={"ID":"f6ddad48-94e1-479b-951c-ebf6be358f2c","Type":"ContainerStarted","Data":"3da5eaa2cece31beeba9aaa8cc2d47a04b2451961db44a0869b79d1ccdf102b4"} Jun 12 22:21:26.562255 ip-10-0-128-134 kubenswrapper[2559]: I0612 22:21:26.562236 2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-9qn4j" Jun 12 22:21:26.562421 ip-10-0-128-134 kubenswrapper[2559]: I0612 22:21:26.562388 2559 scope.go:117] "RemoveContainer" containerID="5dc234a62e5ed6ea12ceeadf3253011c602e0373501af4f75c34c1280cdb7a13" Jun 12 22:21:26.563975 ip-10-0-128-134 kubenswrapper[2559]: I0612 22:21:26.563955 2559 generic.go:356] "Generic (PLEG): container finished" podID="2dd3c6ba-dc0c-4b3e-92b7-94a6b0999c26" containerID="d7102d760e802fc9e7f56b15b775851e6f3a327ddb63a8bcebff70d4bbd4c98e" exitCode=0 Jun 12 22:21:26.564068 ip-10-0-128-134 kubenswrapper[2559]: I0612 22:21:26.564023 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-6fjft" event={"ID":"2dd3c6ba-dc0c-4b3e-92b7-94a6b0999c26","Type":"ContainerDied","Data":"d7102d760e802fc9e7f56b15b775851e6f3a327ddb63a8bcebff70d4bbd4c98e"} Jun 12 22:21:26.579466 ip-10-0-128-134 kubenswrapper[2559]: I0612 22:21:26.579431 2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-9qn4j" Jun 12 22:21:27.404088 ip-10-0-128-134 kubenswrapper[2559]: I0612 22:21:27.404034 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-d9psx" Jun 12 22:21:27.404360 ip-10-0-128-134 kubenswrapper[2559]: E0612 22:21:27.404185 2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-d9psx" podUID="12fe1273-445c-4710-8579-38c99d08c036" Jun 12 22:21:27.569861 ip-10-0-128-134 kubenswrapper[2559]: I0612 22:21:27.569830 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-9qn4j_f6ddad48-94e1-479b-951c-ebf6be358f2c/ovn-acl-logging/0.log" Jun 12 22:21:27.570305 ip-10-0-128-134 kubenswrapper[2559]: I0612 22:21:27.570193 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-9qn4j" event={"ID":"f6ddad48-94e1-479b-951c-ebf6be358f2c","Type":"ContainerStarted","Data":"b7fd54e3d97e3cf8fae4cbb1d40ba25aa3c17bc37c7e205d6e46db856b472da7"} Jun 12 22:21:27.570465 ip-10-0-128-134 kubenswrapper[2559]: I0612 22:21:27.570412 2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-9qn4j" Jun 12 22:21:27.570591 ip-10-0-128-134 kubenswrapper[2559]: I0612 22:21:27.570500 2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-9qn4j" Jun 12 22:21:27.585691 ip-10-0-128-134 kubenswrapper[2559]: I0612 22:21:27.585670 2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-9qn4j" Jun 12 22:21:27.598359 ip-10-0-128-134 kubenswrapper[2559]: I0612 22:21:27.598326 2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ovn-kubernetes/ovnkube-node-9qn4j" podStartSLOduration=10.663051602 podStartE2EDuration="29.5983151s" totalImagesPullingTime="18.935263498s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-12 22:20:58 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-12 22:21:27.597847141 +0000 UTC m=+29.646216957" watchObservedRunningTime="2026-06-12 22:21:27.5983151 +0000 UTC m=+29.646684917" Jun 12 22:21:28.405012 ip-10-0-128-134 kubenswrapper[2559]: I0612 22:21:28.404977 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-c9wls" Jun 12 22:21:28.405201 ip-10-0-128-134 kubenswrapper[2559]: E0612 22:21:28.405066 2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-c9wls" podUID="d4d1b0d2-aea6-421c-91e9-f74e3b7a4c6a" Jun 12 22:21:28.405201 ip-10-0-128-134 kubenswrapper[2559]: I0612 22:21:28.405160 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-zdjjt" Jun 12 22:21:28.405321 ip-10-0-128-134 kubenswrapper[2559]: E0612 22:21:28.405267 2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-zdjjt" podUID="73bd91e1-b3e8-495c-990c-3ab079745247" Jun 12 22:21:28.574660 ip-10-0-128-134 kubenswrapper[2559]: I0612 22:21:28.574626 2559 generic.go:356] "Generic (PLEG): container finished" podID="2dd3c6ba-dc0c-4b3e-92b7-94a6b0999c26" containerID="2088c0724fb6c00850efe9dfe63ab19deda77057b55dde1384a53f48087b7c88" exitCode=0 Jun 12 22:21:28.575126 ip-10-0-128-134 kubenswrapper[2559]: I0612 22:21:28.574712 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-6fjft" event={"ID":"2dd3c6ba-dc0c-4b3e-92b7-94a6b0999c26","Type":"ContainerDied","Data":"2088c0724fb6c00850efe9dfe63ab19deda77057b55dde1384a53f48087b7c88"} Jun 12 22:21:29.404224 ip-10-0-128-134 kubenswrapper[2559]: I0612 22:21:29.404187 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-d9psx" Jun 12 22:21:29.404402 ip-10-0-128-134 kubenswrapper[2559]: E0612 22:21:29.404305 2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-d9psx" podUID="12fe1273-445c-4710-8579-38c99d08c036" Jun 12 22:21:30.407026 ip-10-0-128-134 kubenswrapper[2559]: I0612 22:21:30.407000 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-c9wls" Jun 12 22:21:30.407402 ip-10-0-128-134 kubenswrapper[2559]: E0612 22:21:30.407094 2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-c9wls" podUID="d4d1b0d2-aea6-421c-91e9-f74e3b7a4c6a" Jun 12 22:21:30.407402 ip-10-0-128-134 kubenswrapper[2559]: I0612 22:21:30.407145 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-zdjjt" Jun 12 22:21:30.407402 ip-10-0-128-134 kubenswrapper[2559]: E0612 22:21:30.407225 2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-zdjjt" podUID="73bd91e1-b3e8-495c-990c-3ab079745247" Jun 12 22:21:30.581505 ip-10-0-128-134 kubenswrapper[2559]: I0612 22:21:30.581471 2559 generic.go:356] "Generic (PLEG): container finished" podID="2dd3c6ba-dc0c-4b3e-92b7-94a6b0999c26" containerID="1e521c3e819c9bda9cbaa92397d3d7cdd80eaf8c39e214cfbcbc4f51eff0f2c9" exitCode=0 Jun 12 22:21:30.581663 ip-10-0-128-134 kubenswrapper[2559]: I0612 22:21:30.581518 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-6fjft" event={"ID":"2dd3c6ba-dc0c-4b3e-92b7-94a6b0999c26","Type":"ContainerDied","Data":"1e521c3e819c9bda9cbaa92397d3d7cdd80eaf8c39e214cfbcbc4f51eff0f2c9"} Jun 12 22:21:31.403893 ip-10-0-128-134 kubenswrapper[2559]: I0612 22:21:31.403858 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-d9psx" Jun 12 22:21:31.404119 ip-10-0-128-134 kubenswrapper[2559]: E0612 22:21:31.404009 2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-d9psx" podUID="12fe1273-445c-4710-8579-38c99d08c036" Jun 12 22:21:32.203825 ip-10-0-128-134 kubenswrapper[2559]: I0612 22:21:32.203779 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/12fe1273-445c-4710-8579-38c99d08c036-metrics-certs\") pod \"network-metrics-daemon-d9psx\" (UID: \"12fe1273-445c-4710-8579-38c99d08c036\") " pod="openshift-multus/network-metrics-daemon-d9psx" Jun 12 22:21:32.204410 ip-10-0-128-134 kubenswrapper[2559]: I0612 22:21:32.203865 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/73bd91e1-b3e8-495c-990c-3ab079745247-original-pull-secret\") pod \"global-pull-secret-syncer-zdjjt\" (UID: \"73bd91e1-b3e8-495c-990c-3ab079745247\") " pod="kube-system/global-pull-secret-syncer-zdjjt" Jun 12 22:21:32.204410 ip-10-0-128-134 kubenswrapper[2559]: E0612 22:21:32.203951 2559 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jun 12 22:21:32.204410 ip-10-0-128-134 kubenswrapper[2559]: E0612 22:21:32.204015 2559 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jun 12 22:21:32.204410 ip-10-0-128-134 kubenswrapper[2559]: E0612 22:21:32.204025 2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/12fe1273-445c-4710-8579-38c99d08c036-metrics-certs podName:12fe1273-445c-4710-8579-38c99d08c036 nodeName:}" failed. No retries permitted until 2026-06-12 22:22:04.204009035 +0000 UTC m=+66.252378833 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/12fe1273-445c-4710-8579-38c99d08c036-metrics-certs") pod "network-metrics-daemon-d9psx" (UID: "12fe1273-445c-4710-8579-38c99d08c036") : object "openshift-multus"/"metrics-daemon-secret" not registered Jun 12 22:21:32.204410 ip-10-0-128-134 kubenswrapper[2559]: E0612 22:21:32.204078 2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/73bd91e1-b3e8-495c-990c-3ab079745247-original-pull-secret podName:73bd91e1-b3e8-495c-990c-3ab079745247 nodeName:}" failed. No retries permitted until 2026-06-12 22:22:04.204063614 +0000 UTC m=+66.252433412 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/73bd91e1-b3e8-495c-990c-3ab079745247-original-pull-secret") pod "global-pull-secret-syncer-zdjjt" (UID: "73bd91e1-b3e8-495c-990c-3ab079745247") : object "kube-system"/"original-pull-secret" not registered Jun 12 22:21:32.304524 ip-10-0-128-134 kubenswrapper[2559]: I0612 22:21:32.304487 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-769tf\" (UniqueName: \"kubernetes.io/projected/d4d1b0d2-aea6-421c-91e9-f74e3b7a4c6a-kube-api-access-769tf\") pod \"network-check-target-c9wls\" (UID: \"d4d1b0d2-aea6-421c-91e9-f74e3b7a4c6a\") " pod="openshift-network-diagnostics/network-check-target-c9wls" Jun 12 22:21:32.304702 ip-10-0-128-134 kubenswrapper[2559]: E0612 22:21:32.304678 2559 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jun 12 22:21:32.304750 ip-10-0-128-134 kubenswrapper[2559]: E0612 22:21:32.304706 2559 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jun 12 22:21:32.304750 ip-10-0-128-134 kubenswrapper[2559]: E0612 22:21:32.304720 2559 projected.go:196] Error preparing data for projected volume kube-api-access-769tf for pod openshift-network-diagnostics/network-check-target-c9wls: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 12 22:21:32.304837 ip-10-0-128-134 kubenswrapper[2559]: E0612 22:21:32.304786 2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/d4d1b0d2-aea6-421c-91e9-f74e3b7a4c6a-kube-api-access-769tf podName:d4d1b0d2-aea6-421c-91e9-f74e3b7a4c6a nodeName:}" failed. No retries permitted until 2026-06-12 22:22:04.304767234 +0000 UTC m=+66.353137045 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "kube-api-access-769tf" (UniqueName: "kubernetes.io/projected/d4d1b0d2-aea6-421c-91e9-f74e3b7a4c6a-kube-api-access-769tf") pod "network-check-target-c9wls" (UID: "d4d1b0d2-aea6-421c-91e9-f74e3b7a4c6a") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 12 22:21:32.404149 ip-10-0-128-134 kubenswrapper[2559]: I0612 22:21:32.404115 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-c9wls" Jun 12 22:21:32.404321 ip-10-0-128-134 kubenswrapper[2559]: E0612 22:21:32.404249 2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-c9wls" podUID="d4d1b0d2-aea6-421c-91e9-f74e3b7a4c6a" Jun 12 22:21:32.404321 ip-10-0-128-134 kubenswrapper[2559]: I0612 22:21:32.404301 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-zdjjt" Jun 12 22:21:32.404440 ip-10-0-128-134 kubenswrapper[2559]: E0612 22:21:32.404418 2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-zdjjt" podUID="73bd91e1-b3e8-495c-990c-3ab079745247" Jun 12 22:21:33.405205 ip-10-0-128-134 kubenswrapper[2559]: I0612 22:21:33.404758 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-d9psx" Jun 12 22:21:33.405205 ip-10-0-128-134 kubenswrapper[2559]: E0612 22:21:33.404897 2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-d9psx" podUID="12fe1273-445c-4710-8579-38c99d08c036" Jun 12 22:21:34.261200 ip-10-0-128-134 kubenswrapper[2559]: I0612 22:21:34.261161 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-f7h79_2fe08918-3efc-4000-a321-8b319ead517c/konnectivity-agent/0.log" limit=1024 Jun 12 22:21:34.401107 ip-10-0-128-134 kubenswrapper[2559]: I0612 22:21:34.401075 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-f7h79_2fe08918-3efc-4000-a321-8b319ead517c/konnectivity-agent/0.log" limit=1024 Jun 12 22:21:34.404109 ip-10-0-128-134 kubenswrapper[2559]: I0612 22:21:34.404085 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-c9wls" Jun 12 22:21:34.404249 ip-10-0-128-134 kubenswrapper[2559]: I0612 22:21:34.404089 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-zdjjt" Jun 12 22:21:34.404308 ip-10-0-128-134 kubenswrapper[2559]: E0612 22:21:34.404245 2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-c9wls" podUID="d4d1b0d2-aea6-421c-91e9-f74e3b7a4c6a" Jun 12 22:21:34.404371 ip-10-0-128-134 kubenswrapper[2559]: E0612 22:21:34.404352 2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-zdjjt" podUID="73bd91e1-b3e8-495c-990c-3ab079745247" Jun 12 22:21:34.487617 ip-10-0-128-134 kubenswrapper[2559]: I0612 22:21:34.487588 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-f7h79_2fe08918-3efc-4000-a321-8b319ead517c/konnectivity-agent/0.log" limit=1024 Jun 12 22:21:34.584244 ip-10-0-128-134 kubenswrapper[2559]: I0612 22:21:34.584189 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-f7h79_2fe08918-3efc-4000-a321-8b319ead517c/konnectivity-agent/0.log" limit=1024 Jun 12 22:21:34.681572 ip-10-0-128-134 kubenswrapper[2559]: I0612 22:21:34.681540 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-f7h79_2fe08918-3efc-4000-a321-8b319ead517c/konnectivity-agent/0.log" limit=1024 Jun 12 22:21:34.741029 ip-10-0-128-134 kubenswrapper[2559]: I0612 22:21:34.740992 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-f7h79_2fe08918-3efc-4000-a321-8b319ead517c/konnectivity-agent/0.log" limit=1024 Jun 12 22:21:34.969841 ip-10-0-128-134 kubenswrapper[2559]: I0612 22:21:34.969815 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-f7h79_2fe08918-3efc-4000-a321-8b319ead517c/konnectivity-agent/0.log" limit=1024 Jun 12 22:21:35.029275 ip-10-0-128-134 kubenswrapper[2559]: I0612 22:21:35.029248 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-f7h79_2fe08918-3efc-4000-a321-8b319ead517c/konnectivity-agent/0.log" limit=1024 Jun 12 22:21:35.404112 ip-10-0-128-134 kubenswrapper[2559]: I0612 22:21:35.404080 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-d9psx" Jun 12 22:21:35.404267 ip-10-0-128-134 kubenswrapper[2559]: E0612 22:21:35.404192 2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-d9psx" podUID="12fe1273-445c-4710-8579-38c99d08c036" Jun 12 22:21:35.596342 ip-10-0-128-134 kubenswrapper[2559]: I0612 22:21:35.596310 2559 generic.go:356] "Generic (PLEG): container finished" podID="2dd3c6ba-dc0c-4b3e-92b7-94a6b0999c26" containerID="5c8b00f15f338a613158b9d0a714ba432471675f2d88aef57e9586e22d610e5f" exitCode=0 Jun 12 22:21:35.596783 ip-10-0-128-134 kubenswrapper[2559]: I0612 22:21:35.596377 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-6fjft" event={"ID":"2dd3c6ba-dc0c-4b3e-92b7-94a6b0999c26","Type":"ContainerDied","Data":"5c8b00f15f338a613158b9d0a714ba432471675f2d88aef57e9586e22d610e5f"} Jun 12 22:21:35.909124 ip-10-0-128-134 kubenswrapper[2559]: I0612 22:21:35.909091 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-f7h79_2fe08918-3efc-4000-a321-8b319ead517c/konnectivity-agent/0.log" limit=1024 Jun 12 22:21:35.973728 ip-10-0-128-134 kubenswrapper[2559]: I0612 22:21:35.973693 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-f7h79_2fe08918-3efc-4000-a321-8b319ead517c/konnectivity-agent/0.log" limit=1024 Jun 12 22:21:36.069956 ip-10-0-128-134 kubenswrapper[2559]: I0612 22:21:36.069923 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-zdjjt"] Jun 12 22:21:36.070121 ip-10-0-128-134 kubenswrapper[2559]: I0612 22:21:36.070094 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-zdjjt" Jun 12 22:21:36.070204 ip-10-0-128-134 kubenswrapper[2559]: E0612 22:21:36.070186 2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-zdjjt" podUID="73bd91e1-b3e8-495c-990c-3ab079745247" Jun 12 22:21:36.073410 ip-10-0-128-134 kubenswrapper[2559]: I0612 22:21:36.073381 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-c9wls"] Jun 12 22:21:36.073559 ip-10-0-128-134 kubenswrapper[2559]: I0612 22:21:36.073526 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-c9wls" Jun 12 22:21:36.073652 ip-10-0-128-134 kubenswrapper[2559]: E0612 22:21:36.073630 2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-c9wls" podUID="d4d1b0d2-aea6-421c-91e9-f74e3b7a4c6a" Jun 12 22:21:36.074062 ip-10-0-128-134 kubenswrapper[2559]: I0612 22:21:36.074038 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-d9psx"] Jun 12 22:21:36.074161 ip-10-0-128-134 kubenswrapper[2559]: I0612 22:21:36.074137 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-d9psx" Jun 12 22:21:36.074252 ip-10-0-128-134 kubenswrapper[2559]: E0612 22:21:36.074226 2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-d9psx" podUID="12fe1273-445c-4710-8579-38c99d08c036" Jun 12 22:21:36.603083 ip-10-0-128-134 kubenswrapper[2559]: I0612 22:21:36.602799 2559 generic.go:356] "Generic (PLEG): container finished" podID="2dd3c6ba-dc0c-4b3e-92b7-94a6b0999c26" containerID="bcdb1f34ec9cb6a729a8c915a2d66fad817f83a9d2954787723037c6544f1567" exitCode=0 Jun 12 22:21:36.603645 ip-10-0-128-134 kubenswrapper[2559]: I0612 22:21:36.602861 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-6fjft" event={"ID":"2dd3c6ba-dc0c-4b3e-92b7-94a6b0999c26","Type":"ContainerDied","Data":"bcdb1f34ec9cb6a729a8c915a2d66fad817f83a9d2954787723037c6544f1567"} Jun 12 22:21:37.404894 ip-10-0-128-134 kubenswrapper[2559]: I0612 22:21:37.404863 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-zdjjt" Jun 12 22:21:37.405081 ip-10-0-128-134 kubenswrapper[2559]: E0612 22:21:37.404970 2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-zdjjt" podUID="73bd91e1-b3e8-495c-990c-3ab079745247" Jun 12 22:21:37.608231 ip-10-0-128-134 kubenswrapper[2559]: I0612 22:21:37.608190 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-6fjft" event={"ID":"2dd3c6ba-dc0c-4b3e-92b7-94a6b0999c26","Type":"ContainerStarted","Data":"0165c759d27a3fdbb4208a86b21eeda4f46aa9a09ea963f6f3ac42a4997fe073"} Jun 12 22:21:37.633714 ip-10-0-128-134 kubenswrapper[2559]: I0612 22:21:37.633669 2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-additional-cni-plugins-6fjft" podStartSLOduration=9.751173462 podStartE2EDuration="39.633655032s" totalImagesPullingTime="29.88248157s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-12 22:20:58 +0000 UTC" imagePullSessionsCount=5 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-12 22:21:37.633492089 +0000 UTC m=+39.681861906" watchObservedRunningTime="2026-06-12 22:21:37.633655032 +0000 UTC m=+39.682024848" Jun 12 22:21:37.755192 ip-10-0-128-134 kubenswrapper[2559]: I0612 22:21:37.755114 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-f7h79_2fe08918-3efc-4000-a321-8b319ead517c/konnectivity-agent/0.log" limit=1024 Jun 12 22:21:37.855027 ip-10-0-128-134 kubenswrapper[2559]: I0612 22:21:37.854994 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-f7h79_2fe08918-3efc-4000-a321-8b319ead517c/konnectivity-agent/0.log" limit=1024 Jun 12 22:21:38.405238 ip-10-0-128-134 kubenswrapper[2559]: I0612 22:21:38.405210 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-d9psx" Jun 12 22:21:38.405399 ip-10-0-128-134 kubenswrapper[2559]: E0612 22:21:38.405298 2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-d9psx" podUID="12fe1273-445c-4710-8579-38c99d08c036" Jun 12 22:21:38.405399 ip-10-0-128-134 kubenswrapper[2559]: I0612 22:21:38.405349 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-c9wls" Jun 12 22:21:38.405499 ip-10-0-128-134 kubenswrapper[2559]: E0612 22:21:38.405427 2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-c9wls" podUID="d4d1b0d2-aea6-421c-91e9-f74e3b7a4c6a" Jun 12 22:21:38.522584 ip-10-0-128-134 kubenswrapper[2559]: I0612 22:21:38.522550 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-f7h79_2fe08918-3efc-4000-a321-8b319ead517c/konnectivity-agent/0.log" limit=1024 Jun 12 22:21:38.636156 ip-10-0-128-134 kubenswrapper[2559]: I0612 22:21:38.636117 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-f7h79_2fe08918-3efc-4000-a321-8b319ead517c/konnectivity-agent/0.log" limit=1024 Jun 12 22:21:39.404540 ip-10-0-128-134 kubenswrapper[2559]: I0612 22:21:39.404509 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-zdjjt" Jun 12 22:21:39.404726 ip-10-0-128-134 kubenswrapper[2559]: E0612 22:21:39.404603 2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-zdjjt" podUID="73bd91e1-b3e8-495c-990c-3ab079745247" Jun 12 22:21:40.282817 ip-10-0-128-134 kubenswrapper[2559]: I0612 22:21:40.282741 2559 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-128-134.ec2.internal" event="NodeReady" Jun 12 22:21:40.283159 ip-10-0-128-134 kubenswrapper[2559]: I0612 22:21:40.282853 2559 kubelet_node_status.go:489] "Fast updating node status as it just became ready" Jun 12 22:21:40.329816 ip-10-0-128-134 kubenswrapper[2559]: I0612 22:21:40.329780 2559 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress-canary/ingress-canary-pmrz6"] Jun 12 22:21:40.333333 ip-10-0-128-134 kubenswrapper[2559]: I0612 22:21:40.333317 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-pmrz6" Jun 12 22:21:40.337630 ip-10-0-128-134 kubenswrapper[2559]: I0612 22:21:40.337606 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"canary-serving-cert\"" Jun 12 22:21:40.337782 ip-10-0-128-134 kubenswrapper[2559]: I0612 22:21:40.337665 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"default-dockercfg-j7ssk\"" Jun 12 22:21:40.337961 ip-10-0-128-134 kubenswrapper[2559]: I0612 22:21:40.337946 2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"kube-root-ca.crt\"" Jun 12 22:21:40.337961 ip-10-0-128-134 kubenswrapper[2559]: I0612 22:21:40.337954 2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"openshift-service-ca.crt\"" Jun 12 22:21:40.338166 ip-10-0-128-134 kubenswrapper[2559]: I0612 22:21:40.338148 2559 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-dns/dns-default-vjnc9"] Jun 12 22:21:40.342126 ip-10-0-128-134 kubenswrapper[2559]: I0612 22:21:40.342103 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-pmrz6"] Jun 12 22:21:40.342231 ip-10-0-128-134 kubenswrapper[2559]: I0612 22:21:40.342218 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-vjnc9" Jun 12 22:21:40.344748 ip-10-0-128-134 kubenswrapper[2559]: I0612 22:21:40.344726 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-6j5nq\"" Jun 12 22:21:40.344843 ip-10-0-128-134 kubenswrapper[2559]: I0612 22:21:40.344752 2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"dns-default\"" Jun 12 22:21:40.344843 ip-10-0-128-134 kubenswrapper[2559]: I0612 22:21:40.344779 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-default-metrics-tls\"" Jun 12 22:21:40.352400 ip-10-0-128-134 kubenswrapper[2559]: I0612 22:21:40.352376 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-vjnc9"] Jun 12 22:21:40.404612 ip-10-0-128-134 kubenswrapper[2559]: I0612 22:21:40.404580 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-d9psx" Jun 12 22:21:40.404785 ip-10-0-128-134 kubenswrapper[2559]: I0612 22:21:40.404588 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-c9wls" Jun 12 22:21:40.409572 ip-10-0-128-134 kubenswrapper[2559]: I0612 22:21:40.409550 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\"" Jun 12 22:21:40.409831 ip-10-0-128-134 kubenswrapper[2559]: I0612 22:21:40.409786 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-qtb4q\"" Jun 12 22:21:40.409960 ip-10-0-128-134 kubenswrapper[2559]: I0612 22:21:40.409946 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-chmrs\"" Jun 12 22:21:40.410116 ip-10-0-128-134 kubenswrapper[2559]: I0612 22:21:40.410099 2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\"" Jun 12 22:21:40.410558 ip-10-0-128-134 kubenswrapper[2559]: I0612 22:21:40.410544 2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\"" Jun 12 22:21:40.468820 ip-10-0-128-134 kubenswrapper[2559]: I0612 22:21:40.468794 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/aecd5c56-77f2-4faf-86c7-5d3d549fe908-tmp-dir\") pod \"dns-default-vjnc9\" (UID: \"aecd5c56-77f2-4faf-86c7-5d3d549fe908\") " pod="openshift-dns/dns-default-vjnc9" Jun 12 22:21:40.468985 ip-10-0-128-134 kubenswrapper[2559]: I0612 22:21:40.468829 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-fp676\" (UniqueName: \"kubernetes.io/projected/aecd5c56-77f2-4faf-86c7-5d3d549fe908-kube-api-access-fp676\") pod \"dns-default-vjnc9\" (UID: \"aecd5c56-77f2-4faf-86c7-5d3d549fe908\") " pod="openshift-dns/dns-default-vjnc9" Jun 12 22:21:40.468985 ip-10-0-128-134 kubenswrapper[2559]: I0612 22:21:40.468846 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/33f04902-b937-4a4f-96ef-74847dd5ce92-cert\") pod \"ingress-canary-pmrz6\" (UID: \"33f04902-b937-4a4f-96ef-74847dd5ce92\") " pod="openshift-ingress-canary/ingress-canary-pmrz6" Jun 12 22:21:40.468985 ip-10-0-128-134 kubenswrapper[2559]: I0612 22:21:40.468861 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-bl9kr\" (UniqueName: \"kubernetes.io/projected/33f04902-b937-4a4f-96ef-74847dd5ce92-kube-api-access-bl9kr\") pod \"ingress-canary-pmrz6\" (UID: \"33f04902-b937-4a4f-96ef-74847dd5ce92\") " pod="openshift-ingress-canary/ingress-canary-pmrz6" Jun 12 22:21:40.468985 ip-10-0-128-134 kubenswrapper[2559]: I0612 22:21:40.468879 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/aecd5c56-77f2-4faf-86c7-5d3d549fe908-config-volume\") pod \"dns-default-vjnc9\" (UID: \"aecd5c56-77f2-4faf-86c7-5d3d549fe908\") " pod="openshift-dns/dns-default-vjnc9" Jun 12 22:21:40.469129 ip-10-0-128-134 kubenswrapper[2559]: I0612 22:21:40.468992 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/aecd5c56-77f2-4faf-86c7-5d3d549fe908-metrics-tls\") pod \"dns-default-vjnc9\" (UID: \"aecd5c56-77f2-4faf-86c7-5d3d549fe908\") " pod="openshift-dns/dns-default-vjnc9" Jun 12 22:21:40.510405 ip-10-0-128-134 kubenswrapper[2559]: I0612 22:21:40.510376 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-f7h79_2fe08918-3efc-4000-a321-8b319ead517c/konnectivity-agent/0.log" limit=1024 Jun 12 22:21:40.569419 ip-10-0-128-134 kubenswrapper[2559]: I0612 22:21:40.569398 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/aecd5c56-77f2-4faf-86c7-5d3d549fe908-tmp-dir\") pod \"dns-default-vjnc9\" (UID: \"aecd5c56-77f2-4faf-86c7-5d3d549fe908\") " pod="openshift-dns/dns-default-vjnc9" Jun 12 22:21:40.569534 ip-10-0-128-134 kubenswrapper[2559]: I0612 22:21:40.569427 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-fp676\" (UniqueName: \"kubernetes.io/projected/aecd5c56-77f2-4faf-86c7-5d3d549fe908-kube-api-access-fp676\") pod \"dns-default-vjnc9\" (UID: \"aecd5c56-77f2-4faf-86c7-5d3d549fe908\") " pod="openshift-dns/dns-default-vjnc9" Jun 12 22:21:40.569534 ip-10-0-128-134 kubenswrapper[2559]: I0612 22:21:40.569460 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/33f04902-b937-4a4f-96ef-74847dd5ce92-cert\") pod \"ingress-canary-pmrz6\" (UID: \"33f04902-b937-4a4f-96ef-74847dd5ce92\") " pod="openshift-ingress-canary/ingress-canary-pmrz6" Jun 12 22:21:40.569642 ip-10-0-128-134 kubenswrapper[2559]: I0612 22:21:40.569590 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-bl9kr\" (UniqueName: \"kubernetes.io/projected/33f04902-b937-4a4f-96ef-74847dd5ce92-kube-api-access-bl9kr\") pod \"ingress-canary-pmrz6\" (UID: \"33f04902-b937-4a4f-96ef-74847dd5ce92\") " pod="openshift-ingress-canary/ingress-canary-pmrz6" Jun 12 22:21:40.569642 ip-10-0-128-134 kubenswrapper[2559]: I0612 22:21:40.569633 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/aecd5c56-77f2-4faf-86c7-5d3d549fe908-config-volume\") pod \"dns-default-vjnc9\" (UID: \"aecd5c56-77f2-4faf-86c7-5d3d549fe908\") " pod="openshift-dns/dns-default-vjnc9" Jun 12 22:21:40.569738 ip-10-0-128-134 kubenswrapper[2559]: I0612 22:21:40.569706 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/aecd5c56-77f2-4faf-86c7-5d3d549fe908-metrics-tls\") pod \"dns-default-vjnc9\" (UID: \"aecd5c56-77f2-4faf-86c7-5d3d549fe908\") " pod="openshift-dns/dns-default-vjnc9" Jun 12 22:21:40.569786 ip-10-0-128-134 kubenswrapper[2559]: I0612 22:21:40.569735 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/aecd5c56-77f2-4faf-86c7-5d3d549fe908-tmp-dir\") pod \"dns-default-vjnc9\" (UID: \"aecd5c56-77f2-4faf-86c7-5d3d549fe908\") " pod="openshift-dns/dns-default-vjnc9" Jun 12 22:21:40.570299 ip-10-0-128-134 kubenswrapper[2559]: I0612 22:21:40.570272 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/aecd5c56-77f2-4faf-86c7-5d3d549fe908-config-volume\") pod \"dns-default-vjnc9\" (UID: \"aecd5c56-77f2-4faf-86c7-5d3d549fe908\") " pod="openshift-dns/dns-default-vjnc9" Jun 12 22:21:40.573494 ip-10-0-128-134 kubenswrapper[2559]: I0612 22:21:40.573469 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/aecd5c56-77f2-4faf-86c7-5d3d549fe908-metrics-tls\") pod \"dns-default-vjnc9\" (UID: \"aecd5c56-77f2-4faf-86c7-5d3d549fe908\") " pod="openshift-dns/dns-default-vjnc9" Jun 12 22:21:40.573585 ip-10-0-128-134 kubenswrapper[2559]: I0612 22:21:40.573569 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/33f04902-b937-4a4f-96ef-74847dd5ce92-cert\") pod \"ingress-canary-pmrz6\" (UID: \"33f04902-b937-4a4f-96ef-74847dd5ce92\") " pod="openshift-ingress-canary/ingress-canary-pmrz6" Jun 12 22:21:40.586073 ip-10-0-128-134 kubenswrapper[2559]: I0612 22:21:40.586055 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-bl9kr\" (UniqueName: \"kubernetes.io/projected/33f04902-b937-4a4f-96ef-74847dd5ce92-kube-api-access-bl9kr\") pod \"ingress-canary-pmrz6\" (UID: \"33f04902-b937-4a4f-96ef-74847dd5ce92\") " pod="openshift-ingress-canary/ingress-canary-pmrz6" Jun 12 22:21:40.586320 ip-10-0-128-134 kubenswrapper[2559]: I0612 22:21:40.586305 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-fp676\" (UniqueName: \"kubernetes.io/projected/aecd5c56-77f2-4faf-86c7-5d3d549fe908-kube-api-access-fp676\") pod \"dns-default-vjnc9\" (UID: \"aecd5c56-77f2-4faf-86c7-5d3d549fe908\") " pod="openshift-dns/dns-default-vjnc9" Jun 12 22:21:40.611818 ip-10-0-128-134 kubenswrapper[2559]: I0612 22:21:40.611790 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-f7h79_2fe08918-3efc-4000-a321-8b319ead517c/konnectivity-agent/0.log" limit=1024 Jun 12 22:21:40.643954 ip-10-0-128-134 kubenswrapper[2559]: I0612 22:21:40.643930 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-pmrz6" Jun 12 22:21:40.654300 ip-10-0-128-134 kubenswrapper[2559]: I0612 22:21:40.654231 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-vjnc9" Jun 12 22:21:40.793103 ip-10-0-128-134 kubenswrapper[2559]: I0612 22:21:40.793071 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-pmrz6"] Jun 12 22:21:40.797868 ip-10-0-128-134 kubenswrapper[2559]: W0612 22:21:40.797822 2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod33f04902_b937_4a4f_96ef_74847dd5ce92.slice/crio-1d7d7ef41f441f0671f7484e3dffb891f1c353223f5f133b6eb4b2f9889ddc86 WatchSource:0}: Error finding container 1d7d7ef41f441f0671f7484e3dffb891f1c353223f5f133b6eb4b2f9889ddc86: Status 404 returned error can't find the container with id 1d7d7ef41f441f0671f7484e3dffb891f1c353223f5f133b6eb4b2f9889ddc86 Jun 12 22:21:40.797977 ip-10-0-128-134 kubenswrapper[2559]: I0612 22:21:40.797891 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-vjnc9"] Jun 12 22:21:40.800882 ip-10-0-128-134 kubenswrapper[2559]: W0612 22:21:40.800858 2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podaecd5c56_77f2_4faf_86c7_5d3d549fe908.slice/crio-c75991c325d55a60c218f9298f5874f0a91ae435d6fd17d6774060a8b0b717aa WatchSource:0}: Error finding container c75991c325d55a60c218f9298f5874f0a91ae435d6fd17d6774060a8b0b717aa: Status 404 returned error can't find the container with id c75991c325d55a60c218f9298f5874f0a91ae435d6fd17d6774060a8b0b717aa Jun 12 22:21:41.404323 ip-10-0-128-134 kubenswrapper[2559]: I0612 22:21:41.404280 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-zdjjt" Jun 12 22:21:41.407282 ip-10-0-128-134 kubenswrapper[2559]: I0612 22:21:41.407255 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\"" Jun 12 22:21:41.621432 ip-10-0-128-134 kubenswrapper[2559]: I0612 22:21:41.621394 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-vjnc9" event={"ID":"aecd5c56-77f2-4faf-86c7-5d3d549fe908","Type":"ContainerStarted","Data":"c75991c325d55a60c218f9298f5874f0a91ae435d6fd17d6774060a8b0b717aa"} Jun 12 22:21:41.622651 ip-10-0-128-134 kubenswrapper[2559]: I0612 22:21:41.622613 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-pmrz6" event={"ID":"33f04902-b937-4a4f-96ef-74847dd5ce92","Type":"ContainerStarted","Data":"1d7d7ef41f441f0671f7484e3dffb891f1c353223f5f133b6eb4b2f9889ddc86"} Jun 12 22:21:42.896069 ip-10-0-128-134 kubenswrapper[2559]: I0612 22:21:42.896035 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-f7h79_2fe08918-3efc-4000-a321-8b319ead517c/konnectivity-agent/0.log" limit=1024 Jun 12 22:21:42.954630 ip-10-0-128-134 kubenswrapper[2559]: I0612 22:21:42.954596 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-f7h79_2fe08918-3efc-4000-a321-8b319ead517c/konnectivity-agent/0.log" limit=1024 Jun 12 22:21:43.006381 ip-10-0-128-134 kubenswrapper[2559]: I0612 22:21:43.006352 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-f7h79_2fe08918-3efc-4000-a321-8b319ead517c/konnectivity-agent/0.log" limit=1024 Jun 12 22:21:43.629803 ip-10-0-128-134 kubenswrapper[2559]: I0612 22:21:43.629551 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-vjnc9" event={"ID":"aecd5c56-77f2-4faf-86c7-5d3d549fe908","Type":"ContainerStarted","Data":"41f4adf71cb776b8589d425a8ea5e6c4d3d3b08e8973833709f12988a6d22f44"} Jun 12 22:21:43.629988 ip-10-0-128-134 kubenswrapper[2559]: I0612 22:21:43.629848 2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-dns/dns-default-vjnc9" Jun 12 22:21:43.629988 ip-10-0-128-134 kubenswrapper[2559]: I0612 22:21:43.629879 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-vjnc9" event={"ID":"aecd5c56-77f2-4faf-86c7-5d3d549fe908","Type":"ContainerStarted","Data":"e9569cc603dbda1c1310cbd4c3b82bbd69203804ea86f74a1984338b55532659"} Jun 12 22:21:43.631032 ip-10-0-128-134 kubenswrapper[2559]: I0612 22:21:43.631011 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-pmrz6" event={"ID":"33f04902-b937-4a4f-96ef-74847dd5ce92","Type":"ContainerStarted","Data":"9c803293afd82af1fbf9495d80eb9cfcb272657f26faf897ed29c969a85438db"} Jun 12 22:21:43.646592 ip-10-0-128-134 kubenswrapper[2559]: I0612 22:21:43.646536 2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/dns-default-vjnc9" podStartSLOduration=1.162678253 podStartE2EDuration="3.646516751s" totalImagesPullingTime="2.483838498s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-12 22:21:40 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-12 22:21:43.646292726 +0000 UTC m=+45.694662573" watchObservedRunningTime="2026-06-12 22:21:43.646516751 +0000 UTC m=+45.694886569" Jun 12 22:21:43.662549 ip-10-0-128-134 kubenswrapper[2559]: I0612 22:21:43.662498 2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress-canary/ingress-canary-pmrz6" podStartSLOduration=1.1718961860000001 podStartE2EDuration="3.662482015s" totalImagesPullingTime="2.490585829s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-12 22:21:40 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-12 22:21:43.661946034 +0000 UTC m=+45.710315853" watchObservedRunningTime="2026-06-12 22:21:43.662482015 +0000 UTC m=+45.710851831" Jun 12 22:21:45.371952 ip-10-0-128-134 kubenswrapper[2559]: I0612 22:21:45.371913 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-f7h79_2fe08918-3efc-4000-a321-8b319ead517c/konnectivity-agent/0.log" limit=1024 Jun 12 22:21:45.484828 ip-10-0-128-134 kubenswrapper[2559]: I0612 22:21:45.484784 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-f7h79_2fe08918-3efc-4000-a321-8b319ead517c/konnectivity-agent/0.log" limit=1024 Jun 12 22:21:45.539657 ip-10-0-128-134 kubenswrapper[2559]: I0612 22:21:45.539625 2559 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/downloads-694c955b9-blb5k"] Jun 12 22:21:45.560701 ip-10-0-128-134 kubenswrapper[2559]: I0612 22:21:45.560676 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/downloads-694c955b9-blb5k"] Jun 12 22:21:45.560850 ip-10-0-128-134 kubenswrapper[2559]: I0612 22:21:45.560777 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/downloads-694c955b9-blb5k" Jun 12 22:21:45.565160 ip-10-0-128-134 kubenswrapper[2559]: I0612 22:21:45.565135 2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"kube-root-ca.crt\"" Jun 12 22:21:45.569576 ip-10-0-128-134 kubenswrapper[2559]: I0612 22:21:45.569558 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"default-dockercfg-2gjlw\"" Jun 12 22:21:45.569661 ip-10-0-128-134 kubenswrapper[2559]: I0612 22:21:45.569607 2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"openshift-service-ca.crt\"" Jun 12 22:21:45.582264 ip-10-0-128-134 kubenswrapper[2559]: I0612 22:21:45.582235 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-f7h79_2fe08918-3efc-4000-a321-8b319ead517c/konnectivity-agent/0.log" limit=1024 Jun 12 22:21:45.605484 ip-10-0-128-134 kubenswrapper[2559]: I0612 22:21:45.605458 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-bv6gd\" (UniqueName: \"kubernetes.io/projected/d1f3ee57-3b89-4d10-8159-57894504bebb-kube-api-access-bv6gd\") pod \"downloads-694c955b9-blb5k\" (UID: \"d1f3ee57-3b89-4d10-8159-57894504bebb\") " pod="openshift-console/downloads-694c955b9-blb5k" Jun 12 22:21:45.655743 ip-10-0-128-134 kubenswrapper[2559]: I0612 22:21:45.655711 2559 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/prometheus-operator-admission-webhook-5cf667749c-2hl4m"] Jun 12 22:21:45.676679 ip-10-0-128-134 kubenswrapper[2559]: I0612 22:21:45.676643 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-f7h79_2fe08918-3efc-4000-a321-8b319ead517c/konnectivity-agent/0.log" limit=1024 Jun 12 22:21:45.678365 ip-10-0-128-134 kubenswrapper[2559]: I0612 22:21:45.678348 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-admission-webhook-5cf667749c-2hl4m"] Jun 12 22:21:45.678440 ip-10-0-128-134 kubenswrapper[2559]: I0612 22:21:45.678430 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-admission-webhook-5cf667749c-2hl4m" Jun 12 22:21:45.684089 ip-10-0-128-134 kubenswrapper[2559]: I0612 22:21:45.684069 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-admission-webhook-dockercfg-ngmxc\"" Jun 12 22:21:45.684214 ip-10-0-128-134 kubenswrapper[2559]: I0612 22:21:45.684093 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-admission-webhook-tls\"" Jun 12 22:21:45.706042 ip-10-0-128-134 kubenswrapper[2559]: I0612 22:21:45.706016 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-bv6gd\" (UniqueName: \"kubernetes.io/projected/d1f3ee57-3b89-4d10-8159-57894504bebb-kube-api-access-bv6gd\") pod \"downloads-694c955b9-blb5k\" (UID: \"d1f3ee57-3b89-4d10-8159-57894504bebb\") " pod="openshift-console/downloads-694c955b9-blb5k" Jun 12 22:21:45.706177 ip-10-0-128-134 kubenswrapper[2559]: I0612 22:21:45.706058 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certificates\" (UniqueName: \"kubernetes.io/secret/1b3bbd8c-ff97-4ad6-bdcf-82c370788561-tls-certificates\") pod \"prometheus-operator-admission-webhook-5cf667749c-2hl4m\" (UID: \"1b3bbd8c-ff97-4ad6-bdcf-82c370788561\") " pod="openshift-monitoring/prometheus-operator-admission-webhook-5cf667749c-2hl4m" Jun 12 22:21:45.716884 ip-10-0-128-134 kubenswrapper[2559]: I0612 22:21:45.716858 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-bv6gd\" (UniqueName: \"kubernetes.io/projected/d1f3ee57-3b89-4d10-8159-57894504bebb-kube-api-access-bv6gd\") pod \"downloads-694c955b9-blb5k\" (UID: \"d1f3ee57-3b89-4d10-8159-57894504bebb\") " pod="openshift-console/downloads-694c955b9-blb5k" Jun 12 22:21:45.806839 ip-10-0-128-134 kubenswrapper[2559]: I0612 22:21:45.806807 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certificates\" (UniqueName: \"kubernetes.io/secret/1b3bbd8c-ff97-4ad6-bdcf-82c370788561-tls-certificates\") pod \"prometheus-operator-admission-webhook-5cf667749c-2hl4m\" (UID: \"1b3bbd8c-ff97-4ad6-bdcf-82c370788561\") " pod="openshift-monitoring/prometheus-operator-admission-webhook-5cf667749c-2hl4m" Jun 12 22:21:45.807006 ip-10-0-128-134 kubenswrapper[2559]: E0612 22:21:45.806948 2559 secret.go:189] Couldn't get secret openshift-monitoring/prometheus-operator-admission-webhook-tls: secret "prometheus-operator-admission-webhook-tls" not found Jun 12 22:21:45.807047 ip-10-0-128-134 kubenswrapper[2559]: E0612 22:21:45.807020 2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/1b3bbd8c-ff97-4ad6-bdcf-82c370788561-tls-certificates podName:1b3bbd8c-ff97-4ad6-bdcf-82c370788561 nodeName:}" failed. No retries permitted until 2026-06-12 22:21:46.307003698 +0000 UTC m=+48.355373493 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "tls-certificates" (UniqueName: "kubernetes.io/secret/1b3bbd8c-ff97-4ad6-bdcf-82c370788561-tls-certificates") pod "prometheus-operator-admission-webhook-5cf667749c-2hl4m" (UID: "1b3bbd8c-ff97-4ad6-bdcf-82c370788561") : secret "prometheus-operator-admission-webhook-tls" not found Jun 12 22:21:45.817668 ip-10-0-128-134 kubenswrapper[2559]: I0612 22:21:45.817644 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-f7h79_2fe08918-3efc-4000-a321-8b319ead517c/konnectivity-agent/0.log" limit=1024 Jun 12 22:21:45.869383 ip-10-0-128-134 kubenswrapper[2559]: I0612 22:21:45.869350 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/downloads-694c955b9-blb5k" Jun 12 22:21:45.989967 ip-10-0-128-134 kubenswrapper[2559]: I0612 22:21:45.989916 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-f7h79_2fe08918-3efc-4000-a321-8b319ead517c/konnectivity-agent/0.log" limit=1024 Jun 12 22:21:46.022954 ip-10-0-128-134 kubenswrapper[2559]: I0612 22:21:46.022916 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/downloads-694c955b9-blb5k"] Jun 12 22:21:46.027580 ip-10-0-128-134 kubenswrapper[2559]: W0612 22:21:46.027548 2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd1f3ee57_3b89_4d10_8159_57894504bebb.slice/crio-981ede8a240c7ab743ad03cea1483428c65e80fdafab6a658e2455004bbc226e WatchSource:0}: Error finding container 981ede8a240c7ab743ad03cea1483428c65e80fdafab6a658e2455004bbc226e: Status 404 returned error can't find the container with id 981ede8a240c7ab743ad03cea1483428c65e80fdafab6a658e2455004bbc226e Jun 12 22:21:46.083959 ip-10-0-128-134 kubenswrapper[2559]: I0612 22:21:46.083925 2559 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-insights/insights-runtime-extractor-hsj6t"] Jun 12 22:21:46.084525 ip-10-0-128-134 kubenswrapper[2559]: I0612 22:21:46.084504 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-f7h79_2fe08918-3efc-4000-a321-8b319ead517c/konnectivity-agent/0.log" limit=1024 Jun 12 22:21:46.110096 ip-10-0-128-134 kubenswrapper[2559]: I0612 22:21:46.110065 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-hsj6t"] Jun 12 22:21:46.110228 ip-10-0-128-134 kubenswrapper[2559]: I0612 22:21:46.110188 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-hsj6t" Jun 12 22:21:46.112794 ip-10-0-128-134 kubenswrapper[2559]: I0612 22:21:46.112729 2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-root-ca.crt\"" Jun 12 22:21:46.112912 ip-10-0-128-134 kubenswrapper[2559]: I0612 22:21:46.112849 2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-rbac-proxy\"" Jun 12 22:21:46.113213 ip-10-0-128-134 kubenswrapper[2559]: I0612 22:21:46.113197 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-sa-dockercfg-zdzp6\"" Jun 12 22:21:46.113272 ip-10-0-128-134 kubenswrapper[2559]: I0612 22:21:46.113243 2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"openshift-service-ca.crt\"" Jun 12 22:21:46.113476 ip-10-0-128-134 kubenswrapper[2559]: I0612 22:21:46.113440 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-tls\"" Jun 12 22:21:46.164481 ip-10-0-128-134 kubenswrapper[2559]: I0612 22:21:46.164384 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-f7h79_2fe08918-3efc-4000-a321-8b319ead517c/konnectivity-agent/0.log" limit=1024 Jun 12 22:21:46.209540 ip-10-0-128-134 kubenswrapper[2559]: I0612 22:21:46.209506 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-lmjx5\" (UniqueName: \"kubernetes.io/projected/c99154f1-7ad4-4ed4-a58e-6b0695e673fa-kube-api-access-lmjx5\") pod \"insights-runtime-extractor-hsj6t\" (UID: \"c99154f1-7ad4-4ed4-a58e-6b0695e673fa\") " pod="openshift-insights/insights-runtime-extractor-hsj6t" Jun 12 22:21:46.209702 ip-10-0-128-134 kubenswrapper[2559]: I0612 22:21:46.209563 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/c99154f1-7ad4-4ed4-a58e-6b0695e673fa-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-hsj6t\" (UID: \"c99154f1-7ad4-4ed4-a58e-6b0695e673fa\") " pod="openshift-insights/insights-runtime-extractor-hsj6t" Jun 12 22:21:46.209702 ip-10-0-128-134 kubenswrapper[2559]: I0612 22:21:46.209604 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/c99154f1-7ad4-4ed4-a58e-6b0695e673fa-data-volume\") pod \"insights-runtime-extractor-hsj6t\" (UID: \"c99154f1-7ad4-4ed4-a58e-6b0695e673fa\") " pod="openshift-insights/insights-runtime-extractor-hsj6t" Jun 12 22:21:46.209702 ip-10-0-128-134 kubenswrapper[2559]: I0612 22:21:46.209619 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/c99154f1-7ad4-4ed4-a58e-6b0695e673fa-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-hsj6t\" (UID: \"c99154f1-7ad4-4ed4-a58e-6b0695e673fa\") " pod="openshift-insights/insights-runtime-extractor-hsj6t" Jun 12 22:21:46.209824 ip-10-0-128-134 kubenswrapper[2559]: I0612 22:21:46.209710 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/c99154f1-7ad4-4ed4-a58e-6b0695e673fa-crio-socket\") pod \"insights-runtime-extractor-hsj6t\" (UID: \"c99154f1-7ad4-4ed4-a58e-6b0695e673fa\") " pod="openshift-insights/insights-runtime-extractor-hsj6t" Jun 12 22:21:46.310235 ip-10-0-128-134 kubenswrapper[2559]: I0612 22:21:46.310190 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-lmjx5\" (UniqueName: \"kubernetes.io/projected/c99154f1-7ad4-4ed4-a58e-6b0695e673fa-kube-api-access-lmjx5\") pod \"insights-runtime-extractor-hsj6t\" (UID: \"c99154f1-7ad4-4ed4-a58e-6b0695e673fa\") " pod="openshift-insights/insights-runtime-extractor-hsj6t" Jun 12 22:21:46.310429 ip-10-0-128-134 kubenswrapper[2559]: I0612 22:21:46.310255 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certificates\" (UniqueName: \"kubernetes.io/secret/1b3bbd8c-ff97-4ad6-bdcf-82c370788561-tls-certificates\") pod \"prometheus-operator-admission-webhook-5cf667749c-2hl4m\" (UID: \"1b3bbd8c-ff97-4ad6-bdcf-82c370788561\") " pod="openshift-monitoring/prometheus-operator-admission-webhook-5cf667749c-2hl4m" Jun 12 22:21:46.310429 ip-10-0-128-134 kubenswrapper[2559]: I0612 22:21:46.310283 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/c99154f1-7ad4-4ed4-a58e-6b0695e673fa-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-hsj6t\" (UID: \"c99154f1-7ad4-4ed4-a58e-6b0695e673fa\") " pod="openshift-insights/insights-runtime-extractor-hsj6t" Jun 12 22:21:46.310429 ip-10-0-128-134 kubenswrapper[2559]: I0612 22:21:46.310308 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/c99154f1-7ad4-4ed4-a58e-6b0695e673fa-data-volume\") pod \"insights-runtime-extractor-hsj6t\" (UID: \"c99154f1-7ad4-4ed4-a58e-6b0695e673fa\") " pod="openshift-insights/insights-runtime-extractor-hsj6t" Jun 12 22:21:46.310429 ip-10-0-128-134 kubenswrapper[2559]: I0612 22:21:46.310332 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/c99154f1-7ad4-4ed4-a58e-6b0695e673fa-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-hsj6t\" (UID: \"c99154f1-7ad4-4ed4-a58e-6b0695e673fa\") " pod="openshift-insights/insights-runtime-extractor-hsj6t" Jun 12 22:21:46.310429 ip-10-0-128-134 kubenswrapper[2559]: I0612 22:21:46.310414 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/c99154f1-7ad4-4ed4-a58e-6b0695e673fa-crio-socket\") pod \"insights-runtime-extractor-hsj6t\" (UID: \"c99154f1-7ad4-4ed4-a58e-6b0695e673fa\") " pod="openshift-insights/insights-runtime-extractor-hsj6t" Jun 12 22:21:46.310429 ip-10-0-128-134 kubenswrapper[2559]: E0612 22:21:46.310418 2559 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Jun 12 22:21:46.310720 ip-10-0-128-134 kubenswrapper[2559]: E0612 22:21:46.310506 2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c99154f1-7ad4-4ed4-a58e-6b0695e673fa-insights-runtime-extractor-tls podName:c99154f1-7ad4-4ed4-a58e-6b0695e673fa nodeName:}" failed. No retries permitted until 2026-06-12 22:21:46.810486443 +0000 UTC m=+48.858856258 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/c99154f1-7ad4-4ed4-a58e-6b0695e673fa-insights-runtime-extractor-tls") pod "insights-runtime-extractor-hsj6t" (UID: "c99154f1-7ad4-4ed4-a58e-6b0695e673fa") : secret "insights-runtime-extractor-tls" not found Jun 12 22:21:46.310720 ip-10-0-128-134 kubenswrapper[2559]: E0612 22:21:46.310528 2559 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found Jun 12 22:21:46.310720 ip-10-0-128-134 kubenswrapper[2559]: E0612 22:21:46.310577 2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/c99154f1-7ad4-4ed4-a58e-6b0695e673fa-kube-rbac-proxy-cm podName:c99154f1-7ad4-4ed4-a58e-6b0695e673fa nodeName:}" failed. No retries permitted until 2026-06-12 22:21:46.810564289 +0000 UTC m=+48.858934086 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/c99154f1-7ad4-4ed4-a58e-6b0695e673fa-kube-rbac-proxy-cm") pod "insights-runtime-extractor-hsj6t" (UID: "c99154f1-7ad4-4ed4-a58e-6b0695e673fa") : configmap "kube-rbac-proxy" not found Jun 12 22:21:46.310720 ip-10-0-128-134 kubenswrapper[2559]: I0612 22:21:46.310644 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/c99154f1-7ad4-4ed4-a58e-6b0695e673fa-crio-socket\") pod \"insights-runtime-extractor-hsj6t\" (UID: \"c99154f1-7ad4-4ed4-a58e-6b0695e673fa\") " pod="openshift-insights/insights-runtime-extractor-hsj6t" Jun 12 22:21:46.310852 ip-10-0-128-134 kubenswrapper[2559]: I0612 22:21:46.310736 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/c99154f1-7ad4-4ed4-a58e-6b0695e673fa-data-volume\") pod \"insights-runtime-extractor-hsj6t\" (UID: \"c99154f1-7ad4-4ed4-a58e-6b0695e673fa\") " pod="openshift-insights/insights-runtime-extractor-hsj6t" Jun 12 22:21:46.313699 ip-10-0-128-134 kubenswrapper[2559]: I0612 22:21:46.313681 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certificates\" (UniqueName: \"kubernetes.io/secret/1b3bbd8c-ff97-4ad6-bdcf-82c370788561-tls-certificates\") pod \"prometheus-operator-admission-webhook-5cf667749c-2hl4m\" (UID: \"1b3bbd8c-ff97-4ad6-bdcf-82c370788561\") " pod="openshift-monitoring/prometheus-operator-admission-webhook-5cf667749c-2hl4m" Jun 12 22:21:46.319043 ip-10-0-128-134 kubenswrapper[2559]: I0612 22:21:46.319018 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-lmjx5\" (UniqueName: \"kubernetes.io/projected/c99154f1-7ad4-4ed4-a58e-6b0695e673fa-kube-api-access-lmjx5\") pod \"insights-runtime-extractor-hsj6t\" (UID: \"c99154f1-7ad4-4ed4-a58e-6b0695e673fa\") " pod="openshift-insights/insights-runtime-extractor-hsj6t" Jun 12 22:21:46.391238 ip-10-0-128-134 kubenswrapper[2559]: I0612 22:21:46.391203 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-f7h79_2fe08918-3efc-4000-a321-8b319ead517c/konnectivity-agent/0.log" limit=1024 Jun 12 22:21:46.490832 ip-10-0-128-134 kubenswrapper[2559]: I0612 22:21:46.490748 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-f7h79_2fe08918-3efc-4000-a321-8b319ead517c/konnectivity-agent/0.log" limit=1024 Jun 12 22:21:46.586909 ip-10-0-128-134 kubenswrapper[2559]: I0612 22:21:46.586665 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-admission-webhook-5cf667749c-2hl4m" Jun 12 22:21:46.591533 ip-10-0-128-134 kubenswrapper[2559]: I0612 22:21:46.591504 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-f7h79_2fe08918-3efc-4000-a321-8b319ead517c/konnectivity-agent/0.log" limit=1024 Jun 12 22:21:46.640019 ip-10-0-128-134 kubenswrapper[2559]: I0612 22:21:46.639982 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/downloads-694c955b9-blb5k" event={"ID":"d1f3ee57-3b89-4d10-8159-57894504bebb","Type":"ContainerStarted","Data":"981ede8a240c7ab743ad03cea1483428c65e80fdafab6a658e2455004bbc226e"} Jun 12 22:21:46.647633 ip-10-0-128-134 kubenswrapper[2559]: I0612 22:21:46.647603 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-f7h79_2fe08918-3efc-4000-a321-8b319ead517c/konnectivity-agent/0.log" limit=1024 Jun 12 22:21:46.744949 ip-10-0-128-134 kubenswrapper[2559]: I0612 22:21:46.744872 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-admission-webhook-5cf667749c-2hl4m"] Jun 12 22:21:46.749412 ip-10-0-128-134 kubenswrapper[2559]: W0612 22:21:46.749385 2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1b3bbd8c_ff97_4ad6_bdcf_82c370788561.slice/crio-197075d1985681727de15df5ce3120f0078a6a8b97e966b1664d80ee979c1f58 WatchSource:0}: Error finding container 197075d1985681727de15df5ce3120f0078a6a8b97e966b1664d80ee979c1f58: Status 404 returned error can't find the container with id 197075d1985681727de15df5ce3120f0078a6a8b97e966b1664d80ee979c1f58 Jun 12 22:21:46.813944 ip-10-0-128-134 kubenswrapper[2559]: I0612 22:21:46.813894 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/c99154f1-7ad4-4ed4-a58e-6b0695e673fa-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-hsj6t\" (UID: \"c99154f1-7ad4-4ed4-a58e-6b0695e673fa\") " pod="openshift-insights/insights-runtime-extractor-hsj6t" Jun 12 22:21:46.813944 ip-10-0-128-134 kubenswrapper[2559]: I0612 22:21:46.813935 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/c99154f1-7ad4-4ed4-a58e-6b0695e673fa-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-hsj6t\" (UID: \"c99154f1-7ad4-4ed4-a58e-6b0695e673fa\") " pod="openshift-insights/insights-runtime-extractor-hsj6t" Jun 12 22:21:46.814203 ip-10-0-128-134 kubenswrapper[2559]: E0612 22:21:46.814059 2559 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found Jun 12 22:21:46.814203 ip-10-0-128-134 kubenswrapper[2559]: E0612 22:21:46.814065 2559 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Jun 12 22:21:46.814203 ip-10-0-128-134 kubenswrapper[2559]: E0612 22:21:46.814120 2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/c99154f1-7ad4-4ed4-a58e-6b0695e673fa-kube-rbac-proxy-cm podName:c99154f1-7ad4-4ed4-a58e-6b0695e673fa nodeName:}" failed. No retries permitted until 2026-06-12 22:21:47.814100519 +0000 UTC m=+49.862470314 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/c99154f1-7ad4-4ed4-a58e-6b0695e673fa-kube-rbac-proxy-cm") pod "insights-runtime-extractor-hsj6t" (UID: "c99154f1-7ad4-4ed4-a58e-6b0695e673fa") : configmap "kube-rbac-proxy" not found Jun 12 22:21:46.814203 ip-10-0-128-134 kubenswrapper[2559]: E0612 22:21:46.814139 2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c99154f1-7ad4-4ed4-a58e-6b0695e673fa-insights-runtime-extractor-tls podName:c99154f1-7ad4-4ed4-a58e-6b0695e673fa nodeName:}" failed. No retries permitted until 2026-06-12 22:21:47.814129632 +0000 UTC m=+49.862499432 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/c99154f1-7ad4-4ed4-a58e-6b0695e673fa-insights-runtime-extractor-tls") pod "insights-runtime-extractor-hsj6t" (UID: "c99154f1-7ad4-4ed4-a58e-6b0695e673fa") : secret "insights-runtime-extractor-tls" not found Jun 12 22:21:46.996878 ip-10-0-128-134 kubenswrapper[2559]: I0612 22:21:46.996791 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-f7h79_2fe08918-3efc-4000-a321-8b319ead517c/konnectivity-agent/0.log" limit=1024 Jun 12 22:21:47.203890 ip-10-0-128-134 kubenswrapper[2559]: I0612 22:21:47.203856 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-f7h79_2fe08918-3efc-4000-a321-8b319ead517c/konnectivity-agent/0.log" limit=1024 Jun 12 22:21:47.339992 ip-10-0-128-134 kubenswrapper[2559]: I0612 22:21:47.339954 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-f7h79_2fe08918-3efc-4000-a321-8b319ead517c/konnectivity-agent/0.log" limit=1024 Jun 12 22:21:47.441025 ip-10-0-128-134 kubenswrapper[2559]: I0612 22:21:47.440993 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-f7h79_2fe08918-3efc-4000-a321-8b319ead517c/konnectivity-agent/0.log" limit=1024 Jun 12 22:21:47.483464 ip-10-0-128-134 kubenswrapper[2559]: I0612 22:21:47.483420 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-vjnc9_aecd5c56-77f2-4faf-86c7-5d3d549fe908/dns/0.log" Jun 12 22:21:47.644941 ip-10-0-128-134 kubenswrapper[2559]: I0612 22:21:47.644782 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-admission-webhook-5cf667749c-2hl4m" event={"ID":"1b3bbd8c-ff97-4ad6-bdcf-82c370788561","Type":"ContainerStarted","Data":"197075d1985681727de15df5ce3120f0078a6a8b97e966b1664d80ee979c1f58"} Jun 12 22:21:47.686890 ip-10-0-128-134 kubenswrapper[2559]: I0612 22:21:47.686862 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-vjnc9_aecd5c56-77f2-4faf-86c7-5d3d549fe908/kube-rbac-proxy/0.log" Jun 12 22:21:47.821318 ip-10-0-128-134 kubenswrapper[2559]: I0612 22:21:47.821279 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/c99154f1-7ad4-4ed4-a58e-6b0695e673fa-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-hsj6t\" (UID: \"c99154f1-7ad4-4ed4-a58e-6b0695e673fa\") " pod="openshift-insights/insights-runtime-extractor-hsj6t" Jun 12 22:21:47.821530 ip-10-0-128-134 kubenswrapper[2559]: I0612 22:21:47.821327 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/c99154f1-7ad4-4ed4-a58e-6b0695e673fa-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-hsj6t\" (UID: \"c99154f1-7ad4-4ed4-a58e-6b0695e673fa\") " pod="openshift-insights/insights-runtime-extractor-hsj6t" Jun 12 22:21:47.822070 ip-10-0-128-134 kubenswrapper[2559]: I0612 22:21:47.822036 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/c99154f1-7ad4-4ed4-a58e-6b0695e673fa-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-hsj6t\" (UID: \"c99154f1-7ad4-4ed4-a58e-6b0695e673fa\") " pod="openshift-insights/insights-runtime-extractor-hsj6t" Jun 12 22:21:47.822200 ip-10-0-128-134 kubenswrapper[2559]: E0612 22:21:47.822159 2559 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Jun 12 22:21:47.822253 ip-10-0-128-134 kubenswrapper[2559]: E0612 22:21:47.822221 2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c99154f1-7ad4-4ed4-a58e-6b0695e673fa-insights-runtime-extractor-tls podName:c99154f1-7ad4-4ed4-a58e-6b0695e673fa nodeName:}" failed. No retries permitted until 2026-06-12 22:21:49.822207483 +0000 UTC m=+51.870577284 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/c99154f1-7ad4-4ed4-a58e-6b0695e673fa-insights-runtime-extractor-tls") pod "insights-runtime-extractor-hsj6t" (UID: "c99154f1-7ad4-4ed4-a58e-6b0695e673fa") : secret "insights-runtime-extractor-tls" not found Jun 12 22:21:47.984871 ip-10-0-128-134 kubenswrapper[2559]: I0612 22:21:47.984791 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-f7h79_2fe08918-3efc-4000-a321-8b319ead517c/konnectivity-agent/0.log" limit=1024 Jun 12 22:21:48.238380 ip-10-0-128-134 kubenswrapper[2559]: I0612 22:21:48.238302 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-f7h79_2fe08918-3efc-4000-a321-8b319ead517c/konnectivity-agent/0.log" limit=1024 Jun 12 22:21:48.283431 ip-10-0-128-134 kubenswrapper[2559]: I0612 22:21:48.283401 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-qdtqn_843f3267-327c-4702-9510-3ceb40add4e1/dns-node-resolver/0.log" Jun 12 22:21:48.649628 ip-10-0-128-134 kubenswrapper[2559]: I0612 22:21:48.649594 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-admission-webhook-5cf667749c-2hl4m" event={"ID":"1b3bbd8c-ff97-4ad6-bdcf-82c370788561","Type":"ContainerStarted","Data":"0be4d96f547f1cb60f440e057af8f0c72eaaa6a7e14a2db355cda47b7b472456"} Jun 12 22:21:48.650361 ip-10-0-128-134 kubenswrapper[2559]: I0612 22:21:48.649896 2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/prometheus-operator-admission-webhook-5cf667749c-2hl4m" Jun 12 22:21:48.655592 ip-10-0-128-134 kubenswrapper[2559]: I0612 22:21:48.655564 2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/prometheus-operator-admission-webhook-5cf667749c-2hl4m" Jun 12 22:21:48.667321 ip-10-0-128-134 kubenswrapper[2559]: I0612 22:21:48.667261 2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/prometheus-operator-admission-webhook-5cf667749c-2hl4m" podStartSLOduration=2.130791136 podStartE2EDuration="3.667245565s" totalImagesPullingTime="1.536454429s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-12 22:21:45 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-12 22:21:48.666328463 +0000 UTC m=+50.714698292" watchObservedRunningTime="2026-06-12 22:21:48.667245565 +0000 UTC m=+50.715615383" Jun 12 22:21:48.883937 ip-10-0-128-134 kubenswrapper[2559]: I0612 22:21:48.883901 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-bghrt_d01cad7b-32bc-45f8-8c98-057a798e0866/node-ca/0.log" Jun 12 22:21:49.680358 ip-10-0-128-134 kubenswrapper[2559]: I0612 22:21:49.680328 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-f7h79_2fe08918-3efc-4000-a321-8b319ead517c/konnectivity-agent/0.log" limit=1024 Jun 12 22:21:49.720092 ip-10-0-128-134 kubenswrapper[2559]: I0612 22:21:49.720054 2559 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/prometheus-operator-864fcfc6f9-rnvn5"] Jun 12 22:21:49.738357 ip-10-0-128-134 kubenswrapper[2559]: I0612 22:21:49.738329 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-864fcfc6f9-rnvn5"] Jun 12 22:21:49.738585 ip-10-0-128-134 kubenswrapper[2559]: I0612 22:21:49.738487 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-864fcfc6f9-rnvn5" Jun 12 22:21:49.741122 ip-10-0-128-134 kubenswrapper[2559]: I0612 22:21:49.741100 2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"openshift-service-ca.crt\"" Jun 12 22:21:49.741239 ip-10-0-128-134 kubenswrapper[2559]: I0612 22:21:49.741104 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-kube-rbac-proxy-config\"" Jun 12 22:21:49.742376 ip-10-0-128-134 kubenswrapper[2559]: I0612 22:21:49.742227 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-dockercfg-r75kx\"" Jun 12 22:21:49.742376 ip-10-0-128-134 kubenswrapper[2559]: I0612 22:21:49.742325 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-tls\"" Jun 12 22:21:49.742376 ip-10-0-128-134 kubenswrapper[2559]: I0612 22:21:49.742326 2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kube-root-ca.crt\"" Jun 12 22:21:49.742663 ip-10-0-128-134 kubenswrapper[2559]: I0612 22:21:49.742429 2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"metrics-client-ca\"" Jun 12 22:21:49.760157 ip-10-0-128-134 kubenswrapper[2559]: I0612 22:21:49.760130 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-f7h79_2fe08918-3efc-4000-a321-8b319ead517c/konnectivity-agent/0.log" limit=1024 Jun 12 22:21:49.820512 ip-10-0-128-134 kubenswrapper[2559]: I0612 22:21:49.819858 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-f7h79_2fe08918-3efc-4000-a321-8b319ead517c/konnectivity-agent/0.log" limit=1024 Jun 12 22:21:49.834781 ip-10-0-128-134 kubenswrapper[2559]: I0612 22:21:49.834736 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/c99154f1-7ad4-4ed4-a58e-6b0695e673fa-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-hsj6t\" (UID: \"c99154f1-7ad4-4ed4-a58e-6b0695e673fa\") " pod="openshift-insights/insights-runtime-extractor-hsj6t" Jun 12 22:21:49.834971 ip-10-0-128-134 kubenswrapper[2559]: I0612 22:21:49.834793 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-operator-tls\" (UniqueName: \"kubernetes.io/secret/20464bd8-4abc-4cbe-af35-ef5baa3a79ab-prometheus-operator-tls\") pod \"prometheus-operator-864fcfc6f9-rnvn5\" (UID: \"20464bd8-4abc-4cbe-af35-ef5baa3a79ab\") " pod="openshift-monitoring/prometheus-operator-864fcfc6f9-rnvn5" Jun 12 22:21:49.834971 ip-10-0-128-134 kubenswrapper[2559]: I0612 22:21:49.834828 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9wndn\" (UniqueName: \"kubernetes.io/projected/20464bd8-4abc-4cbe-af35-ef5baa3a79ab-kube-api-access-9wndn\") pod \"prometheus-operator-864fcfc6f9-rnvn5\" (UID: \"20464bd8-4abc-4cbe-af35-ef5baa3a79ab\") " pod="openshift-monitoring/prometheus-operator-864fcfc6f9-rnvn5" Jun 12 22:21:49.834971 ip-10-0-128-134 kubenswrapper[2559]: I0612 22:21:49.834872 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/20464bd8-4abc-4cbe-af35-ef5baa3a79ab-metrics-client-ca\") pod \"prometheus-operator-864fcfc6f9-rnvn5\" (UID: \"20464bd8-4abc-4cbe-af35-ef5baa3a79ab\") " pod="openshift-monitoring/prometheus-operator-864fcfc6f9-rnvn5" Jun 12 22:21:49.835119 ip-10-0-128-134 kubenswrapper[2559]: I0612 22:21:49.835006 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-operator-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/20464bd8-4abc-4cbe-af35-ef5baa3a79ab-prometheus-operator-kube-rbac-proxy-config\") pod \"prometheus-operator-864fcfc6f9-rnvn5\" (UID: \"20464bd8-4abc-4cbe-af35-ef5baa3a79ab\") " pod="openshift-monitoring/prometheus-operator-864fcfc6f9-rnvn5" Jun 12 22:21:49.838104 ip-10-0-128-134 kubenswrapper[2559]: I0612 22:21:49.838076 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/c99154f1-7ad4-4ed4-a58e-6b0695e673fa-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-hsj6t\" (UID: \"c99154f1-7ad4-4ed4-a58e-6b0695e673fa\") " pod="openshift-insights/insights-runtime-extractor-hsj6t" Jun 12 22:21:49.878007 ip-10-0-128-134 kubenswrapper[2559]: I0612 22:21:49.877974 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-f7h79_2fe08918-3efc-4000-a321-8b319ead517c/konnectivity-agent/0.log" limit=1024 Jun 12 22:21:49.936418 ip-10-0-128-134 kubenswrapper[2559]: I0612 22:21:49.936328 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-operator-tls\" (UniqueName: \"kubernetes.io/secret/20464bd8-4abc-4cbe-af35-ef5baa3a79ab-prometheus-operator-tls\") pod \"prometheus-operator-864fcfc6f9-rnvn5\" (UID: \"20464bd8-4abc-4cbe-af35-ef5baa3a79ab\") " pod="openshift-monitoring/prometheus-operator-864fcfc6f9-rnvn5" Jun 12 22:21:49.936418 ip-10-0-128-134 kubenswrapper[2559]: I0612 22:21:49.936373 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9wndn\" (UniqueName: \"kubernetes.io/projected/20464bd8-4abc-4cbe-af35-ef5baa3a79ab-kube-api-access-9wndn\") pod \"prometheus-operator-864fcfc6f9-rnvn5\" (UID: \"20464bd8-4abc-4cbe-af35-ef5baa3a79ab\") " pod="openshift-monitoring/prometheus-operator-864fcfc6f9-rnvn5" Jun 12 22:21:49.936710 ip-10-0-128-134 kubenswrapper[2559]: I0612 22:21:49.936417 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/20464bd8-4abc-4cbe-af35-ef5baa3a79ab-metrics-client-ca\") pod \"prometheus-operator-864fcfc6f9-rnvn5\" (UID: \"20464bd8-4abc-4cbe-af35-ef5baa3a79ab\") " pod="openshift-monitoring/prometheus-operator-864fcfc6f9-rnvn5" Jun 12 22:21:49.936710 ip-10-0-128-134 kubenswrapper[2559]: I0612 22:21:49.936508 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-operator-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/20464bd8-4abc-4cbe-af35-ef5baa3a79ab-prometheus-operator-kube-rbac-proxy-config\") pod \"prometheus-operator-864fcfc6f9-rnvn5\" (UID: \"20464bd8-4abc-4cbe-af35-ef5baa3a79ab\") " pod="openshift-monitoring/prometheus-operator-864fcfc6f9-rnvn5" Jun 12 22:21:49.937424 ip-10-0-128-134 kubenswrapper[2559]: I0612 22:21:49.937399 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/20464bd8-4abc-4cbe-af35-ef5baa3a79ab-metrics-client-ca\") pod \"prometheus-operator-864fcfc6f9-rnvn5\" (UID: \"20464bd8-4abc-4cbe-af35-ef5baa3a79ab\") " pod="openshift-monitoring/prometheus-operator-864fcfc6f9-rnvn5" Jun 12 22:21:49.939162 ip-10-0-128-134 kubenswrapper[2559]: I0612 22:21:49.939129 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-operator-tls\" (UniqueName: \"kubernetes.io/secret/20464bd8-4abc-4cbe-af35-ef5baa3a79ab-prometheus-operator-tls\") pod \"prometheus-operator-864fcfc6f9-rnvn5\" (UID: \"20464bd8-4abc-4cbe-af35-ef5baa3a79ab\") " pod="openshift-monitoring/prometheus-operator-864fcfc6f9-rnvn5" Jun 12 22:21:49.939268 ip-10-0-128-134 kubenswrapper[2559]: I0612 22:21:49.939247 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-operator-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/20464bd8-4abc-4cbe-af35-ef5baa3a79ab-prometheus-operator-kube-rbac-proxy-config\") pod \"prometheus-operator-864fcfc6f9-rnvn5\" (UID: \"20464bd8-4abc-4cbe-af35-ef5baa3a79ab\") " pod="openshift-monitoring/prometheus-operator-864fcfc6f9-rnvn5" Jun 12 22:21:49.945109 ip-10-0-128-134 kubenswrapper[2559]: I0612 22:21:49.945083 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-9wndn\" (UniqueName: \"kubernetes.io/projected/20464bd8-4abc-4cbe-af35-ef5baa3a79ab-kube-api-access-9wndn\") pod \"prometheus-operator-864fcfc6f9-rnvn5\" (UID: \"20464bd8-4abc-4cbe-af35-ef5baa3a79ab\") " pod="openshift-monitoring/prometheus-operator-864fcfc6f9-rnvn5" Jun 12 22:21:50.019526 ip-10-0-128-134 kubenswrapper[2559]: I0612 22:21:50.019495 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-hsj6t" Jun 12 22:21:50.049956 ip-10-0-128-134 kubenswrapper[2559]: I0612 22:21:50.049920 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-864fcfc6f9-rnvn5" Jun 12 22:21:50.084098 ip-10-0-128-134 kubenswrapper[2559]: I0612 22:21:50.084013 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-pmrz6_33f04902-b937-4a4f-96ef-74847dd5ce92/serve-healthcheck-canary/0.log" Jun 12 22:21:50.209742 ip-10-0-128-134 kubenswrapper[2559]: I0612 22:21:50.209294 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-hsj6t"] Jun 12 22:21:50.215931 ip-10-0-128-134 kubenswrapper[2559]: W0612 22:21:50.215906 2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc99154f1_7ad4_4ed4_a58e_6b0695e673fa.slice/crio-d7a943a00ed2a1b24e37bd7c4d3c6224e331767ea749e53b8a91dfe492e3bc5e WatchSource:0}: Error finding container d7a943a00ed2a1b24e37bd7c4d3c6224e331767ea749e53b8a91dfe492e3bc5e: Status 404 returned error can't find the container with id d7a943a00ed2a1b24e37bd7c4d3c6224e331767ea749e53b8a91dfe492e3bc5e Jun 12 22:21:50.227903 ip-10-0-128-134 kubenswrapper[2559]: I0612 22:21:50.227881 2559 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-679bdcbb85-plxpd"] Jun 12 22:21:50.235596 ip-10-0-128-134 kubenswrapper[2559]: W0612 22:21:50.235564 2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod20464bd8_4abc_4cbe_af35_ef5baa3a79ab.slice/crio-9726b81270f4822d5e8610e32baf5b1cb270e060eef03824e0f627a18bfed278 WatchSource:0}: Error finding container 9726b81270f4822d5e8610e32baf5b1cb270e060eef03824e0f627a18bfed278: Status 404 returned error can't find the container with id 9726b81270f4822d5e8610e32baf5b1cb270e060eef03824e0f627a18bfed278 Jun 12 22:21:50.251493 ip-10-0-128-134 kubenswrapper[2559]: I0612 22:21:50.251464 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-864fcfc6f9-rnvn5"] Jun 12 22:21:50.251627 ip-10-0-128-134 kubenswrapper[2559]: I0612 22:21:50.251512 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-679bdcbb85-plxpd"] Jun 12 22:21:50.251627 ip-10-0-128-134 kubenswrapper[2559]: I0612 22:21:50.251558 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-679bdcbb85-plxpd" Jun 12 22:21:50.255862 ip-10-0-128-134 kubenswrapper[2559]: I0612 22:21:50.255839 2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"console-config\"" Jun 12 22:21:50.256027 ip-10-0-128-134 kubenswrapper[2559]: I0612 22:21:50.256004 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-oauth-config\"" Jun 12 22:21:50.256619 ip-10-0-128-134 kubenswrapper[2559]: I0612 22:21:50.256600 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-dockercfg-h5f4g\"" Jun 12 22:21:50.256726 ip-10-0-128-134 kubenswrapper[2559]: I0612 22:21:50.256621 2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"oauth-serving-cert\"" Jun 12 22:21:50.256726 ip-10-0-128-134 kubenswrapper[2559]: I0612 22:21:50.256627 2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"service-ca\"" Jun 12 22:21:50.257113 ip-10-0-128-134 kubenswrapper[2559]: I0612 22:21:50.257096 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-serving-cert\"" Jun 12 22:21:50.339228 ip-10-0-128-134 kubenswrapper[2559]: I0612 22:21:50.339189 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/df717def-ede3-47ff-9464-b993c2f6d7ae-console-oauth-config\") pod \"console-679bdcbb85-plxpd\" (UID: \"df717def-ede3-47ff-9464-b993c2f6d7ae\") " pod="openshift-console/console-679bdcbb85-plxpd" Jun 12 22:21:50.339426 ip-10-0-128-134 kubenswrapper[2559]: I0612 22:21:50.339267 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/df717def-ede3-47ff-9464-b993c2f6d7ae-console-config\") pod \"console-679bdcbb85-plxpd\" (UID: \"df717def-ede3-47ff-9464-b993c2f6d7ae\") " pod="openshift-console/console-679bdcbb85-plxpd" Jun 12 22:21:50.339426 ip-10-0-128-134 kubenswrapper[2559]: I0612 22:21:50.339313 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/df717def-ede3-47ff-9464-b993c2f6d7ae-service-ca\") pod \"console-679bdcbb85-plxpd\" (UID: \"df717def-ede3-47ff-9464-b993c2f6d7ae\") " pod="openshift-console/console-679bdcbb85-plxpd" Jun 12 22:21:50.339426 ip-10-0-128-134 kubenswrapper[2559]: I0612 22:21:50.339373 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/df717def-ede3-47ff-9464-b993c2f6d7ae-oauth-serving-cert\") pod \"console-679bdcbb85-plxpd\" (UID: \"df717def-ede3-47ff-9464-b993c2f6d7ae\") " pod="openshift-console/console-679bdcbb85-plxpd" Jun 12 22:21:50.339426 ip-10-0-128-134 kubenswrapper[2559]: I0612 22:21:50.339401 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-dx526\" (UniqueName: \"kubernetes.io/projected/df717def-ede3-47ff-9464-b993c2f6d7ae-kube-api-access-dx526\") pod \"console-679bdcbb85-plxpd\" (UID: \"df717def-ede3-47ff-9464-b993c2f6d7ae\") " pod="openshift-console/console-679bdcbb85-plxpd" Jun 12 22:21:50.339673 ip-10-0-128-134 kubenswrapper[2559]: I0612 22:21:50.339456 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/df717def-ede3-47ff-9464-b993c2f6d7ae-console-serving-cert\") pod \"console-679bdcbb85-plxpd\" (UID: \"df717def-ede3-47ff-9464-b993c2f6d7ae\") " pod="openshift-console/console-679bdcbb85-plxpd" Jun 12 22:21:50.440678 ip-10-0-128-134 kubenswrapper[2559]: I0612 22:21:50.440635 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/df717def-ede3-47ff-9464-b993c2f6d7ae-console-config\") pod \"console-679bdcbb85-plxpd\" (UID: \"df717def-ede3-47ff-9464-b993c2f6d7ae\") " pod="openshift-console/console-679bdcbb85-plxpd" Jun 12 22:21:50.440678 ip-10-0-128-134 kubenswrapper[2559]: I0612 22:21:50.440682 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/df717def-ede3-47ff-9464-b993c2f6d7ae-service-ca\") pod \"console-679bdcbb85-plxpd\" (UID: \"df717def-ede3-47ff-9464-b993c2f6d7ae\") " pod="openshift-console/console-679bdcbb85-plxpd" Jun 12 22:21:50.440920 ip-10-0-128-134 kubenswrapper[2559]: I0612 22:21:50.440723 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/df717def-ede3-47ff-9464-b993c2f6d7ae-oauth-serving-cert\") pod \"console-679bdcbb85-plxpd\" (UID: \"df717def-ede3-47ff-9464-b993c2f6d7ae\") " pod="openshift-console/console-679bdcbb85-plxpd" Jun 12 22:21:50.440920 ip-10-0-128-134 kubenswrapper[2559]: I0612 22:21:50.440746 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-dx526\" (UniqueName: \"kubernetes.io/projected/df717def-ede3-47ff-9464-b993c2f6d7ae-kube-api-access-dx526\") pod \"console-679bdcbb85-plxpd\" (UID: \"df717def-ede3-47ff-9464-b993c2f6d7ae\") " pod="openshift-console/console-679bdcbb85-plxpd" Jun 12 22:21:50.440920 ip-10-0-128-134 kubenswrapper[2559]: I0612 22:21:50.440884 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/df717def-ede3-47ff-9464-b993c2f6d7ae-console-serving-cert\") pod \"console-679bdcbb85-plxpd\" (UID: \"df717def-ede3-47ff-9464-b993c2f6d7ae\") " pod="openshift-console/console-679bdcbb85-plxpd" Jun 12 22:21:50.441087 ip-10-0-128-134 kubenswrapper[2559]: I0612 22:21:50.440980 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/df717def-ede3-47ff-9464-b993c2f6d7ae-console-oauth-config\") pod \"console-679bdcbb85-plxpd\" (UID: \"df717def-ede3-47ff-9464-b993c2f6d7ae\") " pod="openshift-console/console-679bdcbb85-plxpd" Jun 12 22:21:50.441498 ip-10-0-128-134 kubenswrapper[2559]: I0612 22:21:50.441472 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/df717def-ede3-47ff-9464-b993c2f6d7ae-console-config\") pod \"console-679bdcbb85-plxpd\" (UID: \"df717def-ede3-47ff-9464-b993c2f6d7ae\") " pod="openshift-console/console-679bdcbb85-plxpd" Jun 12 22:21:50.441631 ip-10-0-128-134 kubenswrapper[2559]: I0612 22:21:50.441497 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/df717def-ede3-47ff-9464-b993c2f6d7ae-oauth-serving-cert\") pod \"console-679bdcbb85-plxpd\" (UID: \"df717def-ede3-47ff-9464-b993c2f6d7ae\") " pod="openshift-console/console-679bdcbb85-plxpd" Jun 12 22:21:50.441948 ip-10-0-128-134 kubenswrapper[2559]: I0612 22:21:50.441926 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/df717def-ede3-47ff-9464-b993c2f6d7ae-service-ca\") pod \"console-679bdcbb85-plxpd\" (UID: \"df717def-ede3-47ff-9464-b993c2f6d7ae\") " pod="openshift-console/console-679bdcbb85-plxpd" Jun 12 22:21:50.444687 ip-10-0-128-134 kubenswrapper[2559]: I0612 22:21:50.444660 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/df717def-ede3-47ff-9464-b993c2f6d7ae-console-oauth-config\") pod \"console-679bdcbb85-plxpd\" (UID: \"df717def-ede3-47ff-9464-b993c2f6d7ae\") " pod="openshift-console/console-679bdcbb85-plxpd" Jun 12 22:21:50.444809 ip-10-0-128-134 kubenswrapper[2559]: I0612 22:21:50.444716 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/df717def-ede3-47ff-9464-b993c2f6d7ae-console-serving-cert\") pod \"console-679bdcbb85-plxpd\" (UID: \"df717def-ede3-47ff-9464-b993c2f6d7ae\") " pod="openshift-console/console-679bdcbb85-plxpd" Jun 12 22:21:50.449155 ip-10-0-128-134 kubenswrapper[2559]: I0612 22:21:50.449134 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-dx526\" (UniqueName: \"kubernetes.io/projected/df717def-ede3-47ff-9464-b993c2f6d7ae-kube-api-access-dx526\") pod \"console-679bdcbb85-plxpd\" (UID: \"df717def-ede3-47ff-9464-b993c2f6d7ae\") " pod="openshift-console/console-679bdcbb85-plxpd" Jun 12 22:21:50.563684 ip-10-0-128-134 kubenswrapper[2559]: I0612 22:21:50.563647 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-679bdcbb85-plxpd" Jun 12 22:21:50.661063 ip-10-0-128-134 kubenswrapper[2559]: I0612 22:21:50.660965 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-hsj6t" event={"ID":"c99154f1-7ad4-4ed4-a58e-6b0695e673fa","Type":"ContainerStarted","Data":"d7a943a00ed2a1b24e37bd7c4d3c6224e331767ea749e53b8a91dfe492e3bc5e"} Jun 12 22:21:50.663133 ip-10-0-128-134 kubenswrapper[2559]: I0612 22:21:50.663098 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-864fcfc6f9-rnvn5" event={"ID":"20464bd8-4abc-4cbe-af35-ef5baa3a79ab","Type":"ContainerStarted","Data":"9726b81270f4822d5e8610e32baf5b1cb270e060eef03824e0f627a18bfed278"} Jun 12 22:21:50.746322 ip-10-0-128-134 kubenswrapper[2559]: I0612 22:21:50.746284 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-679bdcbb85-plxpd"] Jun 12 22:21:50.750460 ip-10-0-128-134 kubenswrapper[2559]: W0612 22:21:50.750413 2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poddf717def_ede3_47ff_9464_b993c2f6d7ae.slice/crio-560a272e91a6986def4047559e7ab0df4a1ac44c059233493b0209a808fd10af WatchSource:0}: Error finding container 560a272e91a6986def4047559e7ab0df4a1ac44c059233493b0209a808fd10af: Status 404 returned error can't find the container with id 560a272e91a6986def4047559e7ab0df4a1ac44c059233493b0209a808fd10af Jun 12 22:21:50.901030 ip-10-0-128-134 kubenswrapper[2559]: I0612 22:21:50.900993 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-f7h79_2fe08918-3efc-4000-a321-8b319ead517c/konnectivity-agent/0.log" limit=1024 Jun 12 22:21:50.953355 ip-10-0-128-134 kubenswrapper[2559]: I0612 22:21:50.953261 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-f7h79_2fe08918-3efc-4000-a321-8b319ead517c/konnectivity-agent/0.log" limit=1024 Jun 12 22:21:51.667489 ip-10-0-128-134 kubenswrapper[2559]: I0612 22:21:51.667390 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-679bdcbb85-plxpd" event={"ID":"df717def-ede3-47ff-9464-b993c2f6d7ae","Type":"ContainerStarted","Data":"560a272e91a6986def4047559e7ab0df4a1ac44c059233493b0209a808fd10af"} Jun 12 22:21:52.677218 ip-10-0-128-134 kubenswrapper[2559]: I0612 22:21:52.677140 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-864fcfc6f9-rnvn5" event={"ID":"20464bd8-4abc-4cbe-af35-ef5baa3a79ab","Type":"ContainerStarted","Data":"9b858ff69b73a4c6aa2229cc2d1c6fb0ea99391cc02bb81c19bd2e33f9f65a86"} Jun 12 22:21:52.695421 ip-10-0-128-134 kubenswrapper[2559]: I0612 22:21:52.695388 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-f7h79_2fe08918-3efc-4000-a321-8b319ead517c/konnectivity-agent/0.log" limit=1024 Jun 12 22:21:53.637018 ip-10-0-128-134 kubenswrapper[2559]: I0612 22:21:53.636981 2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-dns/dns-default-vjnc9" Jun 12 22:21:54.234675 ip-10-0-128-134 kubenswrapper[2559]: I0612 22:21:54.234637 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-f7h79_2fe08918-3efc-4000-a321-8b319ead517c/konnectivity-agent/0.log" limit=1024 Jun 12 22:21:54.611081 ip-10-0-128-134 kubenswrapper[2559]: I0612 22:21:54.611039 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-f7h79_2fe08918-3efc-4000-a321-8b319ead517c/konnectivity-agent/0.log" limit=1024 Jun 12 22:21:54.668387 ip-10-0-128-134 kubenswrapper[2559]: I0612 22:21:54.668320 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-f7h79_2fe08918-3efc-4000-a321-8b319ead517c/konnectivity-agent/0.log" limit=1024 Jun 12 22:21:55.231139 ip-10-0-128-134 kubenswrapper[2559]: I0612 22:21:55.231092 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-f7h79_2fe08918-3efc-4000-a321-8b319ead517c/konnectivity-agent/0.log" limit=1024 Jun 12 22:21:55.296837 ip-10-0-128-134 kubenswrapper[2559]: I0612 22:21:55.296800 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-f7h79_2fe08918-3efc-4000-a321-8b319ead517c/konnectivity-agent/0.log" limit=1024 Jun 12 22:21:55.527882 ip-10-0-128-134 kubenswrapper[2559]: I0612 22:21:55.527798 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-f7h79_2fe08918-3efc-4000-a321-8b319ead517c/konnectivity-agent/0.log" limit=1024 Jun 12 22:21:55.592835 ip-10-0-128-134 kubenswrapper[2559]: I0612 22:21:55.592796 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-f7h79_2fe08918-3efc-4000-a321-8b319ead517c/konnectivity-agent/0.log" limit=1024 Jun 12 22:21:56.694849 ip-10-0-128-134 kubenswrapper[2559]: I0612 22:21:56.694756 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-hsj6t" event={"ID":"c99154f1-7ad4-4ed4-a58e-6b0695e673fa","Type":"ContainerStarted","Data":"f506f15ea4be5221056a0ef5c1ff22566e18a1f7c24fdfaecc865e0d2574d1aa"} Jun 12 22:21:56.697385 ip-10-0-128-134 kubenswrapper[2559]: I0612 22:21:56.697348 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-864fcfc6f9-rnvn5" event={"ID":"20464bd8-4abc-4cbe-af35-ef5baa3a79ab","Type":"ContainerStarted","Data":"4e00cec994259f4bf7deb17e35833210ec8a41823fc2ea385d1b5b42279f1d57"} Jun 12 22:21:56.699180 ip-10-0-128-134 kubenswrapper[2559]: I0612 22:21:56.699123 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-679bdcbb85-plxpd" event={"ID":"df717def-ede3-47ff-9464-b993c2f6d7ae","Type":"ContainerStarted","Data":"88f0b74f22ad8f0d160ec95ca68324546b748a47dfe805d33b4143c4f7131d77"} Jun 12 22:21:56.717221 ip-10-0-128-134 kubenswrapper[2559]: I0612 22:21:56.717168 2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/prometheus-operator-864fcfc6f9-rnvn5" podStartSLOduration=5.569907627 podStartE2EDuration="7.717150544s" totalImagesPullingTime="2.147242917s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-12 22:21:49 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-12 22:21:56.715522692 +0000 UTC m=+58.763892534" watchObservedRunningTime="2026-06-12 22:21:56.717150544 +0000 UTC m=+58.765520399" Jun 12 22:21:56.735431 ip-10-0-128-134 kubenswrapper[2559]: I0612 22:21:56.735368 2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-679bdcbb85-plxpd" podStartSLOduration=1.128595518 podStartE2EDuration="6.735351726s" totalImagesPullingTime="5.606756208s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-12 22:21:50 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-12 22:21:56.734738435 +0000 UTC m=+58.783108252" watchObservedRunningTime="2026-06-12 22:21:56.735351726 +0000 UTC m=+58.783721544" Jun 12 22:21:56.753560 ip-10-0-128-134 kubenswrapper[2559]: I0612 22:21:56.753532 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-f7h79_2fe08918-3efc-4000-a321-8b319ead517c/konnectivity-agent/0.log" limit=1024 Jun 12 22:21:56.804716 ip-10-0-128-134 kubenswrapper[2559]: I0612 22:21:56.804685 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-f7h79_2fe08918-3efc-4000-a321-8b319ead517c/konnectivity-agent/0.log" limit=1024 Jun 12 22:21:56.916040 ip-10-0-128-134 kubenswrapper[2559]: I0612 22:21:56.916003 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-f7h79_2fe08918-3efc-4000-a321-8b319ead517c/konnectivity-agent/0.log" limit=1024 Jun 12 22:21:57.028417 ip-10-0-128-134 kubenswrapper[2559]: I0612 22:21:57.016779 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-f7h79_2fe08918-3efc-4000-a321-8b319ead517c/konnectivity-agent/0.log" limit=1024 Jun 12 22:21:58.841034 ip-10-0-128-134 kubenswrapper[2559]: I0612 22:21:58.840998 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-f7h79_2fe08918-3efc-4000-a321-8b319ead517c/konnectivity-agent/0.log" limit=1024 Jun 12 22:21:59.053579 ip-10-0-128-134 kubenswrapper[2559]: I0612 22:21:59.053538 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-f7h79_2fe08918-3efc-4000-a321-8b319ead517c/konnectivity-agent/0.log" limit=1024 Jun 12 22:21:59.104553 ip-10-0-128-134 kubenswrapper[2559]: I0612 22:21:59.104468 2559 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/node-exporter-x7lwm"] Jun 12 22:21:59.108070 ip-10-0-128-134 kubenswrapper[2559]: I0612 22:21:59.108045 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-x7lwm" Jun 12 22:21:59.110859 ip-10-0-128-134 kubenswrapper[2559]: I0612 22:21:59.110829 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-dockercfg-ndjg9\"" Jun 12 22:21:59.111181 ip-10-0-128-134 kubenswrapper[2559]: I0612 22:21:59.110913 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-kube-rbac-proxy-config\"" Jun 12 22:21:59.111181 ip-10-0-128-134 kubenswrapper[2559]: I0612 22:21:59.111069 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-tls\"" Jun 12 22:21:59.111328 ip-10-0-128-134 kubenswrapper[2559]: I0612 22:21:59.111289 2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"node-exporter-accelerators-collector-config\"" Jun 12 22:21:59.139986 ip-10-0-128-134 kubenswrapper[2559]: I0612 22:21:59.139945 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-f7h79_2fe08918-3efc-4000-a321-8b319ead517c/konnectivity-agent/0.log" limit=1024 Jun 12 22:21:59.205672 ip-10-0-128-134 kubenswrapper[2559]: I0612 22:21:59.205615 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-f7h79_2fe08918-3efc-4000-a321-8b319ead517c/konnectivity-agent/0.log" limit=1024 Jun 12 22:21:59.226432 ip-10-0-128-134 kubenswrapper[2559]: I0612 22:21:59.226393 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/ceaa8e94-a5c6-48ea-ba34-974490e3f735-node-exporter-textfile\") pod \"node-exporter-x7lwm\" (UID: \"ceaa8e94-a5c6-48ea-ba34-974490e3f735\") " pod="openshift-monitoring/node-exporter-x7lwm" Jun 12 22:21:59.226617 ip-10-0-128-134 kubenswrapper[2559]: I0612 22:21:59.226474 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/ceaa8e94-a5c6-48ea-ba34-974490e3f735-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-x7lwm\" (UID: \"ceaa8e94-a5c6-48ea-ba34-974490e3f735\") " pod="openshift-monitoring/node-exporter-x7lwm" Jun 12 22:21:59.226617 ip-10-0-128-134 kubenswrapper[2559]: I0612 22:21:59.226509 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/ceaa8e94-a5c6-48ea-ba34-974490e3f735-sys\") pod \"node-exporter-x7lwm\" (UID: \"ceaa8e94-a5c6-48ea-ba34-974490e3f735\") " pod="openshift-monitoring/node-exporter-x7lwm" Jun 12 22:21:59.226617 ip-10-0-128-134 kubenswrapper[2559]: I0612 22:21:59.226526 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/ceaa8e94-a5c6-48ea-ba34-974490e3f735-metrics-client-ca\") pod \"node-exporter-x7lwm\" (UID: \"ceaa8e94-a5c6-48ea-ba34-974490e3f735\") " pod="openshift-monitoring/node-exporter-x7lwm" Jun 12 22:21:59.226617 ip-10-0-128-134 kubenswrapper[2559]: I0612 22:21:59.226556 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/ceaa8e94-a5c6-48ea-ba34-974490e3f735-node-exporter-accelerators-collector-config\") pod \"node-exporter-x7lwm\" (UID: \"ceaa8e94-a5c6-48ea-ba34-974490e3f735\") " pod="openshift-monitoring/node-exporter-x7lwm" Jun 12 22:21:59.226617 ip-10-0-128-134 kubenswrapper[2559]: I0612 22:21:59.226590 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qk5hz\" (UniqueName: \"kubernetes.io/projected/ceaa8e94-a5c6-48ea-ba34-974490e3f735-kube-api-access-qk5hz\") pod \"node-exporter-x7lwm\" (UID: \"ceaa8e94-a5c6-48ea-ba34-974490e3f735\") " pod="openshift-monitoring/node-exporter-x7lwm" Jun 12 22:21:59.226820 ip-10-0-128-134 kubenswrapper[2559]: I0612 22:21:59.226693 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/ceaa8e94-a5c6-48ea-ba34-974490e3f735-root\") pod \"node-exporter-x7lwm\" (UID: \"ceaa8e94-a5c6-48ea-ba34-974490e3f735\") " pod="openshift-monitoring/node-exporter-x7lwm" Jun 12 22:21:59.226820 ip-10-0-128-134 kubenswrapper[2559]: I0612 22:21:59.226717 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/ceaa8e94-a5c6-48ea-ba34-974490e3f735-node-exporter-tls\") pod \"node-exporter-x7lwm\" (UID: \"ceaa8e94-a5c6-48ea-ba34-974490e3f735\") " pod="openshift-monitoring/node-exporter-x7lwm" Jun 12 22:21:59.226820 ip-10-0-128-134 kubenswrapper[2559]: I0612 22:21:59.226739 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/ceaa8e94-a5c6-48ea-ba34-974490e3f735-node-exporter-wtmp\") pod \"node-exporter-x7lwm\" (UID: \"ceaa8e94-a5c6-48ea-ba34-974490e3f735\") " pod="openshift-monitoring/node-exporter-x7lwm" Jun 12 22:21:59.305107 ip-10-0-128-134 kubenswrapper[2559]: I0612 22:21:59.305073 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-f7h79_2fe08918-3efc-4000-a321-8b319ead517c/konnectivity-agent/0.log" limit=1024 Jun 12 22:21:59.327909 ip-10-0-128-134 kubenswrapper[2559]: I0612 22:21:59.327874 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/ceaa8e94-a5c6-48ea-ba34-974490e3f735-node-exporter-textfile\") pod \"node-exporter-x7lwm\" (UID: \"ceaa8e94-a5c6-48ea-ba34-974490e3f735\") " pod="openshift-monitoring/node-exporter-x7lwm" Jun 12 22:21:59.328092 ip-10-0-128-134 kubenswrapper[2559]: I0612 22:21:59.327934 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/ceaa8e94-a5c6-48ea-ba34-974490e3f735-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-x7lwm\" (UID: \"ceaa8e94-a5c6-48ea-ba34-974490e3f735\") " pod="openshift-monitoring/node-exporter-x7lwm" Jun 12 22:21:59.328092 ip-10-0-128-134 kubenswrapper[2559]: I0612 22:21:59.327978 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/ceaa8e94-a5c6-48ea-ba34-974490e3f735-sys\") pod \"node-exporter-x7lwm\" (UID: \"ceaa8e94-a5c6-48ea-ba34-974490e3f735\") " pod="openshift-monitoring/node-exporter-x7lwm" Jun 12 22:21:59.328092 ip-10-0-128-134 kubenswrapper[2559]: I0612 22:21:59.328001 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/ceaa8e94-a5c6-48ea-ba34-974490e3f735-metrics-client-ca\") pod \"node-exporter-x7lwm\" (UID: \"ceaa8e94-a5c6-48ea-ba34-974490e3f735\") " pod="openshift-monitoring/node-exporter-x7lwm" Jun 12 22:21:59.328092 ip-10-0-128-134 kubenswrapper[2559]: I0612 22:21:59.328027 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/ceaa8e94-a5c6-48ea-ba34-974490e3f735-node-exporter-accelerators-collector-config\") pod \"node-exporter-x7lwm\" (UID: \"ceaa8e94-a5c6-48ea-ba34-974490e3f735\") " pod="openshift-monitoring/node-exporter-x7lwm" Jun 12 22:21:59.328092 ip-10-0-128-134 kubenswrapper[2559]: I0612 22:21:59.328077 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qk5hz\" (UniqueName: \"kubernetes.io/projected/ceaa8e94-a5c6-48ea-ba34-974490e3f735-kube-api-access-qk5hz\") pod \"node-exporter-x7lwm\" (UID: \"ceaa8e94-a5c6-48ea-ba34-974490e3f735\") " pod="openshift-monitoring/node-exporter-x7lwm" Jun 12 22:21:59.328339 ip-10-0-128-134 kubenswrapper[2559]: I0612 22:21:59.328084 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/ceaa8e94-a5c6-48ea-ba34-974490e3f735-sys\") pod \"node-exporter-x7lwm\" (UID: \"ceaa8e94-a5c6-48ea-ba34-974490e3f735\") " pod="openshift-monitoring/node-exporter-x7lwm" Jun 12 22:21:59.328339 ip-10-0-128-134 kubenswrapper[2559]: I0612 22:21:59.328163 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/ceaa8e94-a5c6-48ea-ba34-974490e3f735-root\") pod \"node-exporter-x7lwm\" (UID: \"ceaa8e94-a5c6-48ea-ba34-974490e3f735\") " pod="openshift-monitoring/node-exporter-x7lwm" Jun 12 22:21:59.328339 ip-10-0-128-134 kubenswrapper[2559]: I0612 22:21:59.328191 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/ceaa8e94-a5c6-48ea-ba34-974490e3f735-node-exporter-tls\") pod \"node-exporter-x7lwm\" (UID: \"ceaa8e94-a5c6-48ea-ba34-974490e3f735\") " pod="openshift-monitoring/node-exporter-x7lwm" Jun 12 22:21:59.328339 ip-10-0-128-134 kubenswrapper[2559]: I0612 22:21:59.328289 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/ceaa8e94-a5c6-48ea-ba34-974490e3f735-node-exporter-wtmp\") pod \"node-exporter-x7lwm\" (UID: \"ceaa8e94-a5c6-48ea-ba34-974490e3f735\") " pod="openshift-monitoring/node-exporter-x7lwm" Jun 12 22:21:59.328548 ip-10-0-128-134 kubenswrapper[2559]: I0612 22:21:59.328340 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/ceaa8e94-a5c6-48ea-ba34-974490e3f735-node-exporter-textfile\") pod \"node-exporter-x7lwm\" (UID: \"ceaa8e94-a5c6-48ea-ba34-974490e3f735\") " pod="openshift-monitoring/node-exporter-x7lwm" Jun 12 22:21:59.328548 ip-10-0-128-134 kubenswrapper[2559]: I0612 22:21:59.328393 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"root\" (UniqueName: \"kubernetes.io/host-path/ceaa8e94-a5c6-48ea-ba34-974490e3f735-root\") pod \"node-exporter-x7lwm\" (UID: \"ceaa8e94-a5c6-48ea-ba34-974490e3f735\") " pod="openshift-monitoring/node-exporter-x7lwm" Jun 12 22:21:59.328548 ip-10-0-128-134 kubenswrapper[2559]: I0612 22:21:59.328466 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/ceaa8e94-a5c6-48ea-ba34-974490e3f735-node-exporter-wtmp\") pod \"node-exporter-x7lwm\" (UID: \"ceaa8e94-a5c6-48ea-ba34-974490e3f735\") " pod="openshift-monitoring/node-exporter-x7lwm" Jun 12 22:21:59.328548 ip-10-0-128-134 kubenswrapper[2559]: E0612 22:21:59.328501 2559 secret.go:189] Couldn't get secret openshift-monitoring/node-exporter-tls: secret "node-exporter-tls" not found Jun 12 22:21:59.328703 ip-10-0-128-134 kubenswrapper[2559]: E0612 22:21:59.328592 2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ceaa8e94-a5c6-48ea-ba34-974490e3f735-node-exporter-tls podName:ceaa8e94-a5c6-48ea-ba34-974490e3f735 nodeName:}" failed. No retries permitted until 2026-06-12 22:21:59.828568258 +0000 UTC m=+61.876938054 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "node-exporter-tls" (UniqueName: "kubernetes.io/secret/ceaa8e94-a5c6-48ea-ba34-974490e3f735-node-exporter-tls") pod "node-exporter-x7lwm" (UID: "ceaa8e94-a5c6-48ea-ba34-974490e3f735") : secret "node-exporter-tls" not found Jun 12 22:21:59.328951 ip-10-0-128-134 kubenswrapper[2559]: I0612 22:21:59.328931 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/ceaa8e94-a5c6-48ea-ba34-974490e3f735-metrics-client-ca\") pod \"node-exporter-x7lwm\" (UID: \"ceaa8e94-a5c6-48ea-ba34-974490e3f735\") " pod="openshift-monitoring/node-exporter-x7lwm" Jun 12 22:21:59.328989 ip-10-0-128-134 kubenswrapper[2559]: I0612 22:21:59.328965 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/ceaa8e94-a5c6-48ea-ba34-974490e3f735-node-exporter-accelerators-collector-config\") pod \"node-exporter-x7lwm\" (UID: \"ceaa8e94-a5c6-48ea-ba34-974490e3f735\") " pod="openshift-monitoring/node-exporter-x7lwm" Jun 12 22:21:59.331394 ip-10-0-128-134 kubenswrapper[2559]: I0612 22:21:59.331367 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/ceaa8e94-a5c6-48ea-ba34-974490e3f735-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-x7lwm\" (UID: \"ceaa8e94-a5c6-48ea-ba34-974490e3f735\") " pod="openshift-monitoring/node-exporter-x7lwm" Jun 12 22:21:59.342181 ip-10-0-128-134 kubenswrapper[2559]: I0612 22:21:59.342137 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-qk5hz\" (UniqueName: \"kubernetes.io/projected/ceaa8e94-a5c6-48ea-ba34-974490e3f735-kube-api-access-qk5hz\") pod \"node-exporter-x7lwm\" (UID: \"ceaa8e94-a5c6-48ea-ba34-974490e3f735\") " pod="openshift-monitoring/node-exporter-x7lwm" Jun 12 22:21:59.405837 ip-10-0-128-134 kubenswrapper[2559]: I0612 22:21:59.405572 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-f7h79_2fe08918-3efc-4000-a321-8b319ead517c/konnectivity-agent/0.log" limit=1024 Jun 12 22:21:59.505119 ip-10-0-128-134 kubenswrapper[2559]: I0612 22:21:59.505072 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-f7h79_2fe08918-3efc-4000-a321-8b319ead517c/konnectivity-agent/0.log" limit=1024 Jun 12 22:21:59.589759 ip-10-0-128-134 kubenswrapper[2559]: I0612 22:21:59.589728 2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-9qn4j" Jun 12 22:21:59.604982 ip-10-0-128-134 kubenswrapper[2559]: I0612 22:21:59.604953 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-f7h79_2fe08918-3efc-4000-a321-8b319ead517c/konnectivity-agent/0.log" limit=1024 Jun 12 22:21:59.707722 ip-10-0-128-134 kubenswrapper[2559]: I0612 22:21:59.707635 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-f7h79_2fe08918-3efc-4000-a321-8b319ead517c/konnectivity-agent/0.log" limit=1024 Jun 12 22:21:59.806606 ip-10-0-128-134 kubenswrapper[2559]: I0612 22:21:59.806569 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-f7h79_2fe08918-3efc-4000-a321-8b319ead517c/konnectivity-agent/0.log" limit=1024 Jun 12 22:21:59.832241 ip-10-0-128-134 kubenswrapper[2559]: I0612 22:21:59.832203 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/ceaa8e94-a5c6-48ea-ba34-974490e3f735-node-exporter-tls\") pod \"node-exporter-x7lwm\" (UID: \"ceaa8e94-a5c6-48ea-ba34-974490e3f735\") " pod="openshift-monitoring/node-exporter-x7lwm" Jun 12 22:21:59.835034 ip-10-0-128-134 kubenswrapper[2559]: I0612 22:21:59.835010 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/ceaa8e94-a5c6-48ea-ba34-974490e3f735-node-exporter-tls\") pod \"node-exporter-x7lwm\" (UID: \"ceaa8e94-a5c6-48ea-ba34-974490e3f735\") " pod="openshift-monitoring/node-exporter-x7lwm" Jun 12 22:21:59.907429 ip-10-0-128-134 kubenswrapper[2559]: I0612 22:21:59.907375 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-f7h79_2fe08918-3efc-4000-a321-8b319ead517c/konnectivity-agent/0.log" limit=1024 Jun 12 22:22:00.018847 ip-10-0-128-134 kubenswrapper[2559]: I0612 22:22:00.018761 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-x7lwm" Jun 12 22:22:00.065906 ip-10-0-128-134 kubenswrapper[2559]: I0612 22:22:00.065836 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-f7h79_2fe08918-3efc-4000-a321-8b319ead517c/konnectivity-agent/0.log" limit=1024 Jun 12 22:22:00.172950 ip-10-0-128-134 kubenswrapper[2559]: I0612 22:22:00.172915 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-f7h79_2fe08918-3efc-4000-a321-8b319ead517c/konnectivity-agent/0.log" limit=1024 Jun 12 22:22:00.204618 ip-10-0-128-134 kubenswrapper[2559]: I0612 22:22:00.204590 2559 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Jun 12 22:22:00.210250 ip-10-0-128-134 kubenswrapper[2559]: I0612 22:22:00.210226 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0" Jun 12 22:22:00.212821 ip-10-0-128-134 kubenswrapper[2559]: I0612 22:22:00.212798 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy\"" Jun 12 22:22:00.213168 ip-10-0-128-134 kubenswrapper[2559]: I0612 22:22:00.213018 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy-web\"" Jun 12 22:22:00.213168 ip-10-0-128-134 kubenswrapper[2559]: I0612 22:22:00.213077 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy-metric\"" Jun 12 22:22:00.213362 ip-10-0-128-134 kubenswrapper[2559]: I0612 22:22:00.213171 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-tls\"" Jun 12 22:22:00.215356 ip-10-0-128-134 kubenswrapper[2559]: I0612 22:22:00.215336 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-tls-assets-0\"" Jun 12 22:22:00.215486 ip-10-0-128-134 kubenswrapper[2559]: I0612 22:22:00.215433 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-web-config\"" Jun 12 22:22:00.215670 ip-10-0-128-134 kubenswrapper[2559]: I0612 22:22:00.215654 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-cluster-tls-config\"" Jun 12 22:22:00.215750 ip-10-0-128-134 kubenswrapper[2559]: I0612 22:22:00.215659 2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"alertmanager-trusted-ca-bundle\"" Jun 12 22:22:00.215809 ip-10-0-128-134 kubenswrapper[2559]: I0612 22:22:00.215761 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-dockercfg-bb9rp\"" Jun 12 22:22:00.215865 ip-10-0-128-134 kubenswrapper[2559]: I0612 22:22:00.215831 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-generated\"" Jun 12 22:22:00.228979 ip-10-0-128-134 kubenswrapper[2559]: I0612 22:22:00.228957 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Jun 12 22:22:00.274512 ip-10-0-128-134 kubenswrapper[2559]: I0612 22:22:00.274418 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-f7h79_2fe08918-3efc-4000-a321-8b319ead517c/konnectivity-agent/0.log" limit=1024 Jun 12 22:22:00.337289 ip-10-0-128-134 kubenswrapper[2559]: I0612 22:22:00.337244 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/5463e61a-cf1a-4c7e-962c-ac94781324b1-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"5463e61a-cf1a-4c7e-962c-ac94781324b1\") " pod="openshift-monitoring/alertmanager-main-0" Jun 12 22:22:00.337499 ip-10-0-128-134 kubenswrapper[2559]: I0612 22:22:00.337294 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/5463e61a-cf1a-4c7e-962c-ac94781324b1-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"5463e61a-cf1a-4c7e-962c-ac94781324b1\") " pod="openshift-monitoring/alertmanager-main-0" Jun 12 22:22:00.337499 ip-10-0-128-134 kubenswrapper[2559]: I0612 22:22:00.337326 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/5463e61a-cf1a-4c7e-962c-ac94781324b1-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"5463e61a-cf1a-4c7e-962c-ac94781324b1\") " pod="openshift-monitoring/alertmanager-main-0" Jun 12 22:22:00.337499 ip-10-0-128-134 kubenswrapper[2559]: I0612 22:22:00.337356 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/5463e61a-cf1a-4c7e-962c-ac94781324b1-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"5463e61a-cf1a-4c7e-962c-ac94781324b1\") " pod="openshift-monitoring/alertmanager-main-0" Jun 12 22:22:00.337499 ip-10-0-128-134 kubenswrapper[2559]: I0612 22:22:00.337393 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/5463e61a-cf1a-4c7e-962c-ac94781324b1-config-out\") pod \"alertmanager-main-0\" (UID: \"5463e61a-cf1a-4c7e-962c-ac94781324b1\") " pod="openshift-monitoring/alertmanager-main-0" Jun 12 22:22:00.337499 ip-10-0-128-134 kubenswrapper[2559]: I0612 22:22:00.337425 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/5463e61a-cf1a-4c7e-962c-ac94781324b1-web-config\") pod \"alertmanager-main-0\" (UID: \"5463e61a-cf1a-4c7e-962c-ac94781324b1\") " pod="openshift-monitoring/alertmanager-main-0" Jun 12 22:22:00.337499 ip-10-0-128-134 kubenswrapper[2559]: I0612 22:22:00.337494 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/5463e61a-cf1a-4c7e-962c-ac94781324b1-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"5463e61a-cf1a-4c7e-962c-ac94781324b1\") " pod="openshift-monitoring/alertmanager-main-0" Jun 12 22:22:00.337822 ip-10-0-128-134 kubenswrapper[2559]: I0612 22:22:00.337524 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/5463e61a-cf1a-4c7e-962c-ac94781324b1-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"5463e61a-cf1a-4c7e-962c-ac94781324b1\") " pod="openshift-monitoring/alertmanager-main-0" Jun 12 22:22:00.337822 ip-10-0-128-134 kubenswrapper[2559]: I0612 22:22:00.337541 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/5463e61a-cf1a-4c7e-962c-ac94781324b1-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"5463e61a-cf1a-4c7e-962c-ac94781324b1\") " pod="openshift-monitoring/alertmanager-main-0" Jun 12 22:22:00.337822 ip-10-0-128-134 kubenswrapper[2559]: I0612 22:22:00.337568 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/5463e61a-cf1a-4c7e-962c-ac94781324b1-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"5463e61a-cf1a-4c7e-962c-ac94781324b1\") " pod="openshift-monitoring/alertmanager-main-0" Jun 12 22:22:00.337822 ip-10-0-128-134 kubenswrapper[2559]: I0612 22:22:00.337598 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/5463e61a-cf1a-4c7e-962c-ac94781324b1-config-volume\") pod \"alertmanager-main-0\" (UID: \"5463e61a-cf1a-4c7e-962c-ac94781324b1\") " pod="openshift-monitoring/alertmanager-main-0" Jun 12 22:22:00.337822 ip-10-0-128-134 kubenswrapper[2559]: I0612 22:22:00.337626 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zksws\" (UniqueName: \"kubernetes.io/projected/5463e61a-cf1a-4c7e-962c-ac94781324b1-kube-api-access-zksws\") pod \"alertmanager-main-0\" (UID: \"5463e61a-cf1a-4c7e-962c-ac94781324b1\") " pod="openshift-monitoring/alertmanager-main-0" Jun 12 22:22:00.337822 ip-10-0-128-134 kubenswrapper[2559]: I0612 22:22:00.337651 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/5463e61a-cf1a-4c7e-962c-ac94781324b1-tls-assets\") pod \"alertmanager-main-0\" (UID: \"5463e61a-cf1a-4c7e-962c-ac94781324b1\") " pod="openshift-monitoring/alertmanager-main-0" Jun 12 22:22:00.438655 ip-10-0-128-134 kubenswrapper[2559]: I0612 22:22:00.438611 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/5463e61a-cf1a-4c7e-962c-ac94781324b1-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"5463e61a-cf1a-4c7e-962c-ac94781324b1\") " pod="openshift-monitoring/alertmanager-main-0" Jun 12 22:22:00.438655 ip-10-0-128-134 kubenswrapper[2559]: I0612 22:22:00.438657 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/5463e61a-cf1a-4c7e-962c-ac94781324b1-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"5463e61a-cf1a-4c7e-962c-ac94781324b1\") " pod="openshift-monitoring/alertmanager-main-0" Jun 12 22:22:00.438896 ip-10-0-128-134 kubenswrapper[2559]: I0612 22:22:00.438681 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/5463e61a-cf1a-4c7e-962c-ac94781324b1-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"5463e61a-cf1a-4c7e-962c-ac94781324b1\") " pod="openshift-monitoring/alertmanager-main-0" Jun 12 22:22:00.438896 ip-10-0-128-134 kubenswrapper[2559]: I0612 22:22:00.438699 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/5463e61a-cf1a-4c7e-962c-ac94781324b1-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"5463e61a-cf1a-4c7e-962c-ac94781324b1\") " pod="openshift-monitoring/alertmanager-main-0" Jun 12 22:22:00.438896 ip-10-0-128-134 kubenswrapper[2559]: I0612 22:22:00.438729 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/5463e61a-cf1a-4c7e-962c-ac94781324b1-config-volume\") pod \"alertmanager-main-0\" (UID: \"5463e61a-cf1a-4c7e-962c-ac94781324b1\") " pod="openshift-monitoring/alertmanager-main-0" Jun 12 22:22:00.438896 ip-10-0-128-134 kubenswrapper[2559]: I0612 22:22:00.438759 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zksws\" (UniqueName: \"kubernetes.io/projected/5463e61a-cf1a-4c7e-962c-ac94781324b1-kube-api-access-zksws\") pod \"alertmanager-main-0\" (UID: \"5463e61a-cf1a-4c7e-962c-ac94781324b1\") " pod="openshift-monitoring/alertmanager-main-0" Jun 12 22:22:00.438896 ip-10-0-128-134 kubenswrapper[2559]: I0612 22:22:00.438785 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/5463e61a-cf1a-4c7e-962c-ac94781324b1-tls-assets\") pod \"alertmanager-main-0\" (UID: \"5463e61a-cf1a-4c7e-962c-ac94781324b1\") " pod="openshift-monitoring/alertmanager-main-0" Jun 12 22:22:00.438896 ip-10-0-128-134 kubenswrapper[2559]: I0612 22:22:00.438862 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/5463e61a-cf1a-4c7e-962c-ac94781324b1-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"5463e61a-cf1a-4c7e-962c-ac94781324b1\") " pod="openshift-monitoring/alertmanager-main-0" Jun 12 22:22:00.438896 ip-10-0-128-134 kubenswrapper[2559]: I0612 22:22:00.438892 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/5463e61a-cf1a-4c7e-962c-ac94781324b1-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"5463e61a-cf1a-4c7e-962c-ac94781324b1\") " pod="openshift-monitoring/alertmanager-main-0" Jun 12 22:22:00.439216 ip-10-0-128-134 kubenswrapper[2559]: I0612 22:22:00.438919 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/5463e61a-cf1a-4c7e-962c-ac94781324b1-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"5463e61a-cf1a-4c7e-962c-ac94781324b1\") " pod="openshift-monitoring/alertmanager-main-0" Jun 12 22:22:00.439216 ip-10-0-128-134 kubenswrapper[2559]: I0612 22:22:00.438953 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/5463e61a-cf1a-4c7e-962c-ac94781324b1-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"5463e61a-cf1a-4c7e-962c-ac94781324b1\") " pod="openshift-monitoring/alertmanager-main-0" Jun 12 22:22:00.439216 ip-10-0-128-134 kubenswrapper[2559]: I0612 22:22:00.438986 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/5463e61a-cf1a-4c7e-962c-ac94781324b1-config-out\") pod \"alertmanager-main-0\" (UID: \"5463e61a-cf1a-4c7e-962c-ac94781324b1\") " pod="openshift-monitoring/alertmanager-main-0" Jun 12 22:22:00.439216 ip-10-0-128-134 kubenswrapper[2559]: I0612 22:22:00.439023 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/5463e61a-cf1a-4c7e-962c-ac94781324b1-web-config\") pod \"alertmanager-main-0\" (UID: \"5463e61a-cf1a-4c7e-962c-ac94781324b1\") " pod="openshift-monitoring/alertmanager-main-0" Jun 12 22:22:00.439728 ip-10-0-128-134 kubenswrapper[2559]: I0612 22:22:00.439539 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/5463e61a-cf1a-4c7e-962c-ac94781324b1-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"5463e61a-cf1a-4c7e-962c-ac94781324b1\") " pod="openshift-monitoring/alertmanager-main-0" Jun 12 22:22:00.441050 ip-10-0-128-134 kubenswrapper[2559]: I0612 22:22:00.441018 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/5463e61a-cf1a-4c7e-962c-ac94781324b1-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"5463e61a-cf1a-4c7e-962c-ac94781324b1\") " pod="openshift-monitoring/alertmanager-main-0" Jun 12 22:22:00.441349 ip-10-0-128-134 kubenswrapper[2559]: I0612 22:22:00.441324 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/5463e61a-cf1a-4c7e-962c-ac94781324b1-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"5463e61a-cf1a-4c7e-962c-ac94781324b1\") " pod="openshift-monitoring/alertmanager-main-0" Jun 12 22:22:00.442762 ip-10-0-128-134 kubenswrapper[2559]: I0612 22:22:00.442736 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/5463e61a-cf1a-4c7e-962c-ac94781324b1-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"5463e61a-cf1a-4c7e-962c-ac94781324b1\") " pod="openshift-monitoring/alertmanager-main-0" Jun 12 22:22:00.443114 ip-10-0-128-134 kubenswrapper[2559]: I0612 22:22:00.443087 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/5463e61a-cf1a-4c7e-962c-ac94781324b1-tls-assets\") pod \"alertmanager-main-0\" (UID: \"5463e61a-cf1a-4c7e-962c-ac94781324b1\") " pod="openshift-monitoring/alertmanager-main-0" Jun 12 22:22:00.443357 ip-10-0-128-134 kubenswrapper[2559]: I0612 22:22:00.443338 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/5463e61a-cf1a-4c7e-962c-ac94781324b1-web-config\") pod \"alertmanager-main-0\" (UID: \"5463e61a-cf1a-4c7e-962c-ac94781324b1\") " pod="openshift-monitoring/alertmanager-main-0" Jun 12 22:22:00.444250 ip-10-0-128-134 kubenswrapper[2559]: I0612 22:22:00.444223 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/5463e61a-cf1a-4c7e-962c-ac94781324b1-config-out\") pod \"alertmanager-main-0\" (UID: \"5463e61a-cf1a-4c7e-962c-ac94781324b1\") " pod="openshift-monitoring/alertmanager-main-0" Jun 12 22:22:00.444357 ip-10-0-128-134 kubenswrapper[2559]: I0612 22:22:00.444274 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/5463e61a-cf1a-4c7e-962c-ac94781324b1-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"5463e61a-cf1a-4c7e-962c-ac94781324b1\") " pod="openshift-monitoring/alertmanager-main-0" Jun 12 22:22:00.444511 ip-10-0-128-134 kubenswrapper[2559]: I0612 22:22:00.444466 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/5463e61a-cf1a-4c7e-962c-ac94781324b1-config-volume\") pod \"alertmanager-main-0\" (UID: \"5463e61a-cf1a-4c7e-962c-ac94781324b1\") " pod="openshift-monitoring/alertmanager-main-0" Jun 12 22:22:00.444717 ip-10-0-128-134 kubenswrapper[2559]: I0612 22:22:00.444696 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/5463e61a-cf1a-4c7e-962c-ac94781324b1-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"5463e61a-cf1a-4c7e-962c-ac94781324b1\") " pod="openshift-monitoring/alertmanager-main-0" Jun 12 22:22:00.444987 ip-10-0-128-134 kubenswrapper[2559]: I0612 22:22:00.444965 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/5463e61a-cf1a-4c7e-962c-ac94781324b1-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"5463e61a-cf1a-4c7e-962c-ac94781324b1\") " pod="openshift-monitoring/alertmanager-main-0" Jun 12 22:22:00.445144 ip-10-0-128-134 kubenswrapper[2559]: I0612 22:22:00.445113 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/5463e61a-cf1a-4c7e-962c-ac94781324b1-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"5463e61a-cf1a-4c7e-962c-ac94781324b1\") " pod="openshift-monitoring/alertmanager-main-0" Jun 12 22:22:00.450969 ip-10-0-128-134 kubenswrapper[2559]: I0612 22:22:00.450947 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-zksws\" (UniqueName: \"kubernetes.io/projected/5463e61a-cf1a-4c7e-962c-ac94781324b1-kube-api-access-zksws\") pod \"alertmanager-main-0\" (UID: \"5463e61a-cf1a-4c7e-962c-ac94781324b1\") " pod="openshift-monitoring/alertmanager-main-0" Jun 12 22:22:00.521597 ip-10-0-128-134 kubenswrapper[2559]: I0612 22:22:00.521558 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0" Jun 12 22:22:00.564779 ip-10-0-128-134 kubenswrapper[2559]: I0612 22:22:00.564742 2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-679bdcbb85-plxpd" Jun 12 22:22:00.564979 ip-10-0-128-134 kubenswrapper[2559]: I0612 22:22:00.564817 2559 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-679bdcbb85-plxpd" Jun 12 22:22:00.570406 ip-10-0-128-134 kubenswrapper[2559]: I0612 22:22:00.570376 2559 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-679bdcbb85-plxpd" Jun 12 22:22:00.717484 ip-10-0-128-134 kubenswrapper[2559]: I0612 22:22:00.717435 2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-679bdcbb85-plxpd" Jun 12 22:22:01.064025 ip-10-0-128-134 kubenswrapper[2559]: I0612 22:22:01.063987 2559 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/thanos-querier-68f5fc465b-28vs9"] Jun 12 22:22:01.067184 ip-10-0-128-134 kubenswrapper[2559]: I0612 22:22:01.067166 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/thanos-querier-68f5fc465b-28vs9" Jun 12 22:22:01.070850 ip-10-0-128-134 kubenswrapper[2559]: I0612 22:22:01.070180 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-tls\"" Jun 12 22:22:01.070850 ip-10-0-128-134 kubenswrapper[2559]: I0612 22:22:01.070212 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy-metrics\"" Jun 12 22:22:01.070850 ip-10-0-128-134 kubenswrapper[2559]: I0612 22:22:01.070226 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy-web\"" Jun 12 22:22:01.070850 ip-10-0-128-134 kubenswrapper[2559]: I0612 22:22:01.070275 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy\"" Jun 12 22:22:01.070850 ip-10-0-128-134 kubenswrapper[2559]: I0612 22:22:01.070281 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-dockercfg-6zxpg\"" Jun 12 22:22:01.070850 ip-10-0-128-134 kubenswrapper[2559]: I0612 22:22:01.070227 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy-rules\"" Jun 12 22:22:01.070850 ip-10-0-128-134 kubenswrapper[2559]: I0612 22:22:01.070702 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-grpc-tls-fvc2l0uok1b6f\"" Jun 12 22:22:01.078990 ip-10-0-128-134 kubenswrapper[2559]: I0612 22:22:01.078963 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/thanos-querier-68f5fc465b-28vs9"] Jun 12 22:22:01.144970 ip-10-0-128-134 kubenswrapper[2559]: I0612 22:22:01.144926 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/b5a8f721-d758-49b4-9967-84ed17bf40a5-secret-grpc-tls\") pod \"thanos-querier-68f5fc465b-28vs9\" (UID: \"b5a8f721-d758-49b4-9967-84ed17bf40a5\") " pod="openshift-monitoring/thanos-querier-68f5fc465b-28vs9" Jun 12 22:22:01.144970 ip-10-0-128-134 kubenswrapper[2559]: I0612 22:22:01.144974 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-metrics\" (UniqueName: \"kubernetes.io/secret/b5a8f721-d758-49b4-9967-84ed17bf40a5-secret-thanos-querier-kube-rbac-proxy-metrics\") pod \"thanos-querier-68f5fc465b-28vs9\" (UID: \"b5a8f721-d758-49b4-9967-84ed17bf40a5\") " pod="openshift-monitoring/thanos-querier-68f5fc465b-28vs9" Jun 12 22:22:01.145216 ip-10-0-128-134 kubenswrapper[2559]: I0612 22:22:01.145055 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/b5a8f721-d758-49b4-9967-84ed17bf40a5-secret-thanos-querier-kube-rbac-proxy\") pod \"thanos-querier-68f5fc465b-28vs9\" (UID: \"b5a8f721-d758-49b4-9967-84ed17bf40a5\") " pod="openshift-monitoring/thanos-querier-68f5fc465b-28vs9" Jun 12 22:22:01.145216 ip-10-0-128-134 kubenswrapper[2559]: I0612 22:22:01.145111 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-gsxlh\" (UniqueName: \"kubernetes.io/projected/b5a8f721-d758-49b4-9967-84ed17bf40a5-kube-api-access-gsxlh\") pod \"thanos-querier-68f5fc465b-28vs9\" (UID: \"b5a8f721-d758-49b4-9967-84ed17bf40a5\") " pod="openshift-monitoring/thanos-querier-68f5fc465b-28vs9" Jun 12 22:22:01.145216 ip-10-0-128-134 kubenswrapper[2559]: I0612 22:22:01.145137 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/b5a8f721-d758-49b4-9967-84ed17bf40a5-secret-thanos-querier-kube-rbac-proxy-web\") pod \"thanos-querier-68f5fc465b-28vs9\" (UID: \"b5a8f721-d758-49b4-9967-84ed17bf40a5\") " pod="openshift-monitoring/thanos-querier-68f5fc465b-28vs9" Jun 12 22:22:01.145216 ip-10-0-128-134 kubenswrapper[2559]: I0612 22:22:01.145164 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/b5a8f721-d758-49b4-9967-84ed17bf40a5-metrics-client-ca\") pod \"thanos-querier-68f5fc465b-28vs9\" (UID: \"b5a8f721-d758-49b4-9967-84ed17bf40a5\") " pod="openshift-monitoring/thanos-querier-68f5fc465b-28vs9" Jun 12 22:22:01.145395 ip-10-0-128-134 kubenswrapper[2559]: I0612 22:22:01.145234 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-rules\" (UniqueName: \"kubernetes.io/secret/b5a8f721-d758-49b4-9967-84ed17bf40a5-secret-thanos-querier-kube-rbac-proxy-rules\") pod \"thanos-querier-68f5fc465b-28vs9\" (UID: \"b5a8f721-d758-49b4-9967-84ed17bf40a5\") " pod="openshift-monitoring/thanos-querier-68f5fc465b-28vs9" Jun 12 22:22:01.145395 ip-10-0-128-134 kubenswrapper[2559]: I0612 22:22:01.145315 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-tls\" (UniqueName: \"kubernetes.io/secret/b5a8f721-d758-49b4-9967-84ed17bf40a5-secret-thanos-querier-tls\") pod \"thanos-querier-68f5fc465b-28vs9\" (UID: \"b5a8f721-d758-49b4-9967-84ed17bf40a5\") " pod="openshift-monitoring/thanos-querier-68f5fc465b-28vs9" Jun 12 22:22:01.221161 ip-10-0-128-134 kubenswrapper[2559]: I0612 22:22:01.221128 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-f7h79_2fe08918-3efc-4000-a321-8b319ead517c/konnectivity-agent/0.log" limit=1024 Jun 12 22:22:01.246208 ip-10-0-128-134 kubenswrapper[2559]: I0612 22:22:01.246171 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-tls\" (UniqueName: \"kubernetes.io/secret/b5a8f721-d758-49b4-9967-84ed17bf40a5-secret-thanos-querier-tls\") pod \"thanos-querier-68f5fc465b-28vs9\" (UID: \"b5a8f721-d758-49b4-9967-84ed17bf40a5\") " pod="openshift-monitoring/thanos-querier-68f5fc465b-28vs9" Jun 12 22:22:01.246386 ip-10-0-128-134 kubenswrapper[2559]: I0612 22:22:01.246219 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/b5a8f721-d758-49b4-9967-84ed17bf40a5-secret-grpc-tls\") pod \"thanos-querier-68f5fc465b-28vs9\" (UID: \"b5a8f721-d758-49b4-9967-84ed17bf40a5\") " pod="openshift-monitoring/thanos-querier-68f5fc465b-28vs9" Jun 12 22:22:01.246386 ip-10-0-128-134 kubenswrapper[2559]: I0612 22:22:01.246283 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-metrics\" (UniqueName: \"kubernetes.io/secret/b5a8f721-d758-49b4-9967-84ed17bf40a5-secret-thanos-querier-kube-rbac-proxy-metrics\") pod \"thanos-querier-68f5fc465b-28vs9\" (UID: \"b5a8f721-d758-49b4-9967-84ed17bf40a5\") " pod="openshift-monitoring/thanos-querier-68f5fc465b-28vs9" Jun 12 22:22:01.246386 ip-10-0-128-134 kubenswrapper[2559]: I0612 22:22:01.246345 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/b5a8f721-d758-49b4-9967-84ed17bf40a5-secret-thanos-querier-kube-rbac-proxy\") pod \"thanos-querier-68f5fc465b-28vs9\" (UID: \"b5a8f721-d758-49b4-9967-84ed17bf40a5\") " pod="openshift-monitoring/thanos-querier-68f5fc465b-28vs9" Jun 12 22:22:01.246580 ip-10-0-128-134 kubenswrapper[2559]: I0612 22:22:01.246416 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-gsxlh\" (UniqueName: \"kubernetes.io/projected/b5a8f721-d758-49b4-9967-84ed17bf40a5-kube-api-access-gsxlh\") pod \"thanos-querier-68f5fc465b-28vs9\" (UID: \"b5a8f721-d758-49b4-9967-84ed17bf40a5\") " pod="openshift-monitoring/thanos-querier-68f5fc465b-28vs9" Jun 12 22:22:01.246580 ip-10-0-128-134 kubenswrapper[2559]: I0612 22:22:01.246475 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/b5a8f721-d758-49b4-9967-84ed17bf40a5-secret-thanos-querier-kube-rbac-proxy-web\") pod \"thanos-querier-68f5fc465b-28vs9\" (UID: \"b5a8f721-d758-49b4-9967-84ed17bf40a5\") " pod="openshift-monitoring/thanos-querier-68f5fc465b-28vs9" Jun 12 22:22:01.246580 ip-10-0-128-134 kubenswrapper[2559]: I0612 22:22:01.246506 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/b5a8f721-d758-49b4-9967-84ed17bf40a5-metrics-client-ca\") pod \"thanos-querier-68f5fc465b-28vs9\" (UID: \"b5a8f721-d758-49b4-9967-84ed17bf40a5\") " pod="openshift-monitoring/thanos-querier-68f5fc465b-28vs9" Jun 12 22:22:01.246580 ip-10-0-128-134 kubenswrapper[2559]: I0612 22:22:01.246572 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-rules\" (UniqueName: \"kubernetes.io/secret/b5a8f721-d758-49b4-9967-84ed17bf40a5-secret-thanos-querier-kube-rbac-proxy-rules\") pod \"thanos-querier-68f5fc465b-28vs9\" (UID: \"b5a8f721-d758-49b4-9967-84ed17bf40a5\") " pod="openshift-monitoring/thanos-querier-68f5fc465b-28vs9" Jun 12 22:22:01.248121 ip-10-0-128-134 kubenswrapper[2559]: I0612 22:22:01.248093 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/b5a8f721-d758-49b4-9967-84ed17bf40a5-metrics-client-ca\") pod \"thanos-querier-68f5fc465b-28vs9\" (UID: \"b5a8f721-d758-49b4-9967-84ed17bf40a5\") " pod="openshift-monitoring/thanos-querier-68f5fc465b-28vs9" Jun 12 22:22:01.249512 ip-10-0-128-134 kubenswrapper[2559]: I0612 22:22:01.249430 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy-rules\" (UniqueName: \"kubernetes.io/secret/b5a8f721-d758-49b4-9967-84ed17bf40a5-secret-thanos-querier-kube-rbac-proxy-rules\") pod \"thanos-querier-68f5fc465b-28vs9\" (UID: \"b5a8f721-d758-49b4-9967-84ed17bf40a5\") " pod="openshift-monitoring/thanos-querier-68f5fc465b-28vs9" Jun 12 22:22:01.249972 ip-10-0-128-134 kubenswrapper[2559]: I0612 22:22:01.249868 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy-metrics\" (UniqueName: \"kubernetes.io/secret/b5a8f721-d758-49b4-9967-84ed17bf40a5-secret-thanos-querier-kube-rbac-proxy-metrics\") pod \"thanos-querier-68f5fc465b-28vs9\" (UID: \"b5a8f721-d758-49b4-9967-84ed17bf40a5\") " pod="openshift-monitoring/thanos-querier-68f5fc465b-28vs9" Jun 12 22:22:01.250335 ip-10-0-128-134 kubenswrapper[2559]: I0612 22:22:01.250311 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-tls\" (UniqueName: \"kubernetes.io/secret/b5a8f721-d758-49b4-9967-84ed17bf40a5-secret-thanos-querier-tls\") pod \"thanos-querier-68f5fc465b-28vs9\" (UID: \"b5a8f721-d758-49b4-9967-84ed17bf40a5\") " pod="openshift-monitoring/thanos-querier-68f5fc465b-28vs9" Jun 12 22:22:01.250478 ip-10-0-128-134 kubenswrapper[2559]: I0612 22:22:01.250431 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/b5a8f721-d758-49b4-9967-84ed17bf40a5-secret-grpc-tls\") pod \"thanos-querier-68f5fc465b-28vs9\" (UID: \"b5a8f721-d758-49b4-9967-84ed17bf40a5\") " pod="openshift-monitoring/thanos-querier-68f5fc465b-28vs9" Jun 12 22:22:01.250564 ip-10-0-128-134 kubenswrapper[2559]: I0612 22:22:01.250520 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/b5a8f721-d758-49b4-9967-84ed17bf40a5-secret-thanos-querier-kube-rbac-proxy-web\") pod \"thanos-querier-68f5fc465b-28vs9\" (UID: \"b5a8f721-d758-49b4-9967-84ed17bf40a5\") " pod="openshift-monitoring/thanos-querier-68f5fc465b-28vs9" Jun 12 22:22:01.250813 ip-10-0-128-134 kubenswrapper[2559]: I0612 22:22:01.250788 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/b5a8f721-d758-49b4-9967-84ed17bf40a5-secret-thanos-querier-kube-rbac-proxy\") pod \"thanos-querier-68f5fc465b-28vs9\" (UID: \"b5a8f721-d758-49b4-9967-84ed17bf40a5\") " pod="openshift-monitoring/thanos-querier-68f5fc465b-28vs9" Jun 12 22:22:01.256082 ip-10-0-128-134 kubenswrapper[2559]: I0612 22:22:01.256054 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-gsxlh\" (UniqueName: \"kubernetes.io/projected/b5a8f721-d758-49b4-9967-84ed17bf40a5-kube-api-access-gsxlh\") pod \"thanos-querier-68f5fc465b-28vs9\" (UID: \"b5a8f721-d758-49b4-9967-84ed17bf40a5\") " pod="openshift-monitoring/thanos-querier-68f5fc465b-28vs9" Jun 12 22:22:01.321307 ip-10-0-128-134 kubenswrapper[2559]: I0612 22:22:01.321220 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-f7h79_2fe08918-3efc-4000-a321-8b319ead517c/konnectivity-agent/0.log" limit=1024 Jun 12 22:22:01.378921 ip-10-0-128-134 kubenswrapper[2559]: I0612 22:22:01.378889 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/thanos-querier-68f5fc465b-28vs9" Jun 12 22:22:02.031572 ip-10-0-128-134 kubenswrapper[2559]: I0612 22:22:02.031537 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-f7h79_2fe08918-3efc-4000-a321-8b319ead517c/konnectivity-agent/0.log" limit=1024 Jun 12 22:22:02.131357 ip-10-0-128-134 kubenswrapper[2559]: I0612 22:22:02.131318 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-f7h79_2fe08918-3efc-4000-a321-8b319ead517c/konnectivity-agent/0.log" limit=1024 Jun 12 22:22:02.232559 ip-10-0-128-134 kubenswrapper[2559]: I0612 22:22:02.232521 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-f7h79_2fe08918-3efc-4000-a321-8b319ead517c/konnectivity-agent/0.log" limit=1024 Jun 12 22:22:02.331673 ip-10-0-128-134 kubenswrapper[2559]: I0612 22:22:02.331641 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-f7h79_2fe08918-3efc-4000-a321-8b319ead517c/konnectivity-agent/0.log" limit=1024 Jun 12 22:22:02.433604 ip-10-0-128-134 kubenswrapper[2559]: I0612 22:22:02.433569 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-f7h79_2fe08918-3efc-4000-a321-8b319ead517c/konnectivity-agent/0.log" limit=1024 Jun 12 22:22:02.530570 ip-10-0-128-134 kubenswrapper[2559]: I0612 22:22:02.530533 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-f7h79_2fe08918-3efc-4000-a321-8b319ead517c/konnectivity-agent/0.log" limit=1024 Jun 12 22:22:03.656947 ip-10-0-128-134 kubenswrapper[2559]: W0612 22:22:03.656822 2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podceaa8e94_a5c6_48ea_ba34_974490e3f735.slice/crio-c78798807ae57110b37403a25427894d4fef5ba07b689f6188a4708259d468d6 WatchSource:0}: Error finding container c78798807ae57110b37403a25427894d4fef5ba07b689f6188a4708259d468d6: Status 404 returned error can't find the container with id c78798807ae57110b37403a25427894d4fef5ba07b689f6188a4708259d468d6 Jun 12 22:22:03.729146 ip-10-0-128-134 kubenswrapper[2559]: I0612 22:22:03.729111 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-x7lwm" event={"ID":"ceaa8e94-a5c6-48ea-ba34-974490e3f735","Type":"ContainerStarted","Data":"c78798807ae57110b37403a25427894d4fef5ba07b689f6188a4708259d468d6"} Jun 12 22:22:03.812394 ip-10-0-128-134 kubenswrapper[2559]: I0612 22:22:03.812366 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/thanos-querier-68f5fc465b-28vs9"] Jun 12 22:22:03.813768 ip-10-0-128-134 kubenswrapper[2559]: W0612 22:22:03.813734 2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb5a8f721_d758_49b4_9967_84ed17bf40a5.slice/crio-11635d2a7b837e2e1a5e20c9fc44426f0c20e92a5119ef1830d58211d9ea3025 WatchSource:0}: Error finding container 11635d2a7b837e2e1a5e20c9fc44426f0c20e92a5119ef1830d58211d9ea3025: Status 404 returned error can't find the container with id 11635d2a7b837e2e1a5e20c9fc44426f0c20e92a5119ef1830d58211d9ea3025 Jun 12 22:22:03.836753 ip-10-0-128-134 kubenswrapper[2559]: I0612 22:22:03.836697 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Jun 12 22:22:03.857858 ip-10-0-128-134 kubenswrapper[2559]: I0612 22:22:03.857824 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-f7h79_2fe08918-3efc-4000-a321-8b319ead517c/konnectivity-agent/0.log" limit=1024 Jun 12 22:22:03.924542 ip-10-0-128-134 kubenswrapper[2559]: W0612 22:22:03.924474 2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5463e61a_cf1a_4c7e_962c_ac94781324b1.slice/crio-69553d3198620292a14d58c3d2770f34debd8de3fc5a1e94528b5fb87bf4caed WatchSource:0}: Error finding container 69553d3198620292a14d58c3d2770f34debd8de3fc5a1e94528b5fb87bf4caed: Status 404 returned error can't find the container with id 69553d3198620292a14d58c3d2770f34debd8de3fc5a1e94528b5fb87bf4caed Jun 12 22:22:03.958825 ip-10-0-128-134 kubenswrapper[2559]: I0612 22:22:03.957912 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-f7h79_2fe08918-3efc-4000-a321-8b319ead517c/konnectivity-agent/0.log" limit=1024 Jun 12 22:22:04.065258 ip-10-0-128-134 kubenswrapper[2559]: I0612 22:22:04.065224 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-f7h79_2fe08918-3efc-4000-a321-8b319ead517c/konnectivity-agent/0.log" limit=1024 Jun 12 22:22:04.275776 ip-10-0-128-134 kubenswrapper[2559]: I0612 22:22:04.275684 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/73bd91e1-b3e8-495c-990c-3ab079745247-original-pull-secret\") pod \"global-pull-secret-syncer-zdjjt\" (UID: \"73bd91e1-b3e8-495c-990c-3ab079745247\") " pod="kube-system/global-pull-secret-syncer-zdjjt" Jun 12 22:22:04.275961 ip-10-0-128-134 kubenswrapper[2559]: I0612 22:22:04.275779 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/12fe1273-445c-4710-8579-38c99d08c036-metrics-certs\") pod \"network-metrics-daemon-d9psx\" (UID: \"12fe1273-445c-4710-8579-38c99d08c036\") " pod="openshift-multus/network-metrics-daemon-d9psx" Jun 12 22:22:04.278642 ip-10-0-128-134 kubenswrapper[2559]: I0612 22:22:04.278606 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\"" Jun 12 22:22:04.278890 ip-10-0-128-134 kubenswrapper[2559]: I0612 22:22:04.278874 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\"" Jun 12 22:22:04.289182 ip-10-0-128-134 kubenswrapper[2559]: I0612 22:22:04.289116 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/12fe1273-445c-4710-8579-38c99d08c036-metrics-certs\") pod \"network-metrics-daemon-d9psx\" (UID: \"12fe1273-445c-4710-8579-38c99d08c036\") " pod="openshift-multus/network-metrics-daemon-d9psx" Jun 12 22:22:04.290832 ip-10-0-128-134 kubenswrapper[2559]: I0612 22:22:04.290779 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/73bd91e1-b3e8-495c-990c-3ab079745247-original-pull-secret\") pod \"global-pull-secret-syncer-zdjjt\" (UID: \"73bd91e1-b3e8-495c-990c-3ab079745247\") " pod="kube-system/global-pull-secret-syncer-zdjjt" Jun 12 22:22:04.319969 ip-10-0-128-134 kubenswrapper[2559]: I0612 22:22:04.319931 2559 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/telemeter-client-558d966b89-9tqtf"] Jun 12 22:22:04.326930 ip-10-0-128-134 kubenswrapper[2559]: I0612 22:22:04.324684 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/telemeter-client-558d966b89-9tqtf" Jun 12 22:22:04.329874 ip-10-0-128-134 kubenswrapper[2559]: I0612 22:22:04.329818 2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"telemeter-client-serving-certs-ca-bundle\"" Jun 12 22:22:04.330478 ip-10-0-128-134 kubenswrapper[2559]: I0612 22:22:04.330370 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client-kube-rbac-proxy-config\"" Jun 12 22:22:04.345017 ip-10-0-128-134 kubenswrapper[2559]: I0612 22:22:04.330649 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"federate-client-certs\"" Jun 12 22:22:04.360227 ip-10-0-128-134 kubenswrapper[2559]: I0612 22:22:04.356789 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client-tls\"" Jun 12 22:22:04.360227 ip-10-0-128-134 kubenswrapper[2559]: I0612 22:22:04.357138 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client\"" Jun 12 22:22:04.360227 ip-10-0-128-134 kubenswrapper[2559]: I0612 22:22:04.357409 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client-dockercfg-78zck\"" Jun 12 22:22:04.360227 ip-10-0-128-134 kubenswrapper[2559]: I0612 22:22:04.359388 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/telemeter-client-558d966b89-9tqtf"] Jun 12 22:22:04.362368 ip-10-0-128-134 kubenswrapper[2559]: I0612 22:22:04.362335 2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"telemeter-trusted-ca-bundle-8i12ta5c71j38\"" Jun 12 22:22:04.377863 ip-10-0-128-134 kubenswrapper[2559]: I0612 22:22:04.377205 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-telemeter-client\" (UniqueName: \"kubernetes.io/secret/5cef91d1-5123-4ae8-ba08-1a8f898bae57-secret-telemeter-client\") pod \"telemeter-client-558d966b89-9tqtf\" (UID: \"5cef91d1-5123-4ae8-ba08-1a8f898bae57\") " pod="openshift-monitoring/telemeter-client-558d966b89-9tqtf" Jun 12 22:22:04.377863 ip-10-0-128-134 kubenswrapper[2559]: I0612 22:22:04.377259 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"telemeter-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/5cef91d1-5123-4ae8-ba08-1a8f898bae57-telemeter-trusted-ca-bundle\") pod \"telemeter-client-558d966b89-9tqtf\" (UID: \"5cef91d1-5123-4ae8-ba08-1a8f898bae57\") " pod="openshift-monitoring/telemeter-client-558d966b89-9tqtf" Jun 12 22:22:04.377863 ip-10-0-128-134 kubenswrapper[2559]: I0612 22:22:04.377292 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-telemeter-client-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/5cef91d1-5123-4ae8-ba08-1a8f898bae57-secret-telemeter-client-kube-rbac-proxy-config\") pod \"telemeter-client-558d966b89-9tqtf\" (UID: \"5cef91d1-5123-4ae8-ba08-1a8f898bae57\") " pod="openshift-monitoring/telemeter-client-558d966b89-9tqtf" Jun 12 22:22:04.377863 ip-10-0-128-134 kubenswrapper[2559]: I0612 22:22:04.377360 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/5cef91d1-5123-4ae8-ba08-1a8f898bae57-serving-certs-ca-bundle\") pod \"telemeter-client-558d966b89-9tqtf\" (UID: \"5cef91d1-5123-4ae8-ba08-1a8f898bae57\") " pod="openshift-monitoring/telemeter-client-558d966b89-9tqtf" Jun 12 22:22:04.377863 ip-10-0-128-134 kubenswrapper[2559]: I0612 22:22:04.377386 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"telemeter-client-tls\" (UniqueName: \"kubernetes.io/secret/5cef91d1-5123-4ae8-ba08-1a8f898bae57-telemeter-client-tls\") pod \"telemeter-client-558d966b89-9tqtf\" (UID: \"5cef91d1-5123-4ae8-ba08-1a8f898bae57\") " pod="openshift-monitoring/telemeter-client-558d966b89-9tqtf" Jun 12 22:22:04.377863 ip-10-0-128-134 kubenswrapper[2559]: I0612 22:22:04.377431 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"federate-client-tls\" (UniqueName: \"kubernetes.io/secret/5cef91d1-5123-4ae8-ba08-1a8f898bae57-federate-client-tls\") pod \"telemeter-client-558d966b89-9tqtf\" (UID: \"5cef91d1-5123-4ae8-ba08-1a8f898bae57\") " pod="openshift-monitoring/telemeter-client-558d966b89-9tqtf" Jun 12 22:22:04.377863 ip-10-0-128-134 kubenswrapper[2559]: I0612 22:22:04.377479 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7vrfp\" (UniqueName: \"kubernetes.io/projected/5cef91d1-5123-4ae8-ba08-1a8f898bae57-kube-api-access-7vrfp\") pod \"telemeter-client-558d966b89-9tqtf\" (UID: \"5cef91d1-5123-4ae8-ba08-1a8f898bae57\") " pod="openshift-monitoring/telemeter-client-558d966b89-9tqtf" Jun 12 22:22:04.377863 ip-10-0-128-134 kubenswrapper[2559]: I0612 22:22:04.377525 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-769tf\" (UniqueName: \"kubernetes.io/projected/d4d1b0d2-aea6-421c-91e9-f74e3b7a4c6a-kube-api-access-769tf\") pod \"network-check-target-c9wls\" (UID: \"d4d1b0d2-aea6-421c-91e9-f74e3b7a4c6a\") " pod="openshift-network-diagnostics/network-check-target-c9wls" Jun 12 22:22:04.377863 ip-10-0-128-134 kubenswrapper[2559]: I0612 22:22:04.377560 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/5cef91d1-5123-4ae8-ba08-1a8f898bae57-metrics-client-ca\") pod \"telemeter-client-558d966b89-9tqtf\" (UID: \"5cef91d1-5123-4ae8-ba08-1a8f898bae57\") " pod="openshift-monitoring/telemeter-client-558d966b89-9tqtf" Jun 12 22:22:04.385538 ip-10-0-128-134 kubenswrapper[2559]: I0612 22:22:04.385273 2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\"" Jun 12 22:22:04.400597 ip-10-0-128-134 kubenswrapper[2559]: I0612 22:22:04.400302 2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\"" Jun 12 22:22:04.412922 ip-10-0-128-134 kubenswrapper[2559]: I0612 22:22:04.412892 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-769tf\" (UniqueName: \"kubernetes.io/projected/d4d1b0d2-aea6-421c-91e9-f74e3b7a4c6a-kube-api-access-769tf\") pod \"network-check-target-c9wls\" (UID: \"d4d1b0d2-aea6-421c-91e9-f74e3b7a4c6a\") " pod="openshift-network-diagnostics/network-check-target-c9wls" Jun 12 22:22:04.416836 ip-10-0-128-134 kubenswrapper[2559]: I0612 22:22:04.416810 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-qtb4q\"" Jun 12 22:22:04.426866 ip-10-0-128-134 kubenswrapper[2559]: I0612 22:22:04.425511 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-d9psx" Jun 12 22:22:04.440394 ip-10-0-128-134 kubenswrapper[2559]: I0612 22:22:04.440006 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-chmrs\"" Jun 12 22:22:04.447014 ip-10-0-128-134 kubenswrapper[2559]: I0612 22:22:04.446958 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-c9wls" Jun 12 22:22:04.485822 ip-10-0-128-134 kubenswrapper[2559]: I0612 22:22:04.481817 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7vrfp\" (UniqueName: \"kubernetes.io/projected/5cef91d1-5123-4ae8-ba08-1a8f898bae57-kube-api-access-7vrfp\") pod \"telemeter-client-558d966b89-9tqtf\" (UID: \"5cef91d1-5123-4ae8-ba08-1a8f898bae57\") " pod="openshift-monitoring/telemeter-client-558d966b89-9tqtf" Jun 12 22:22:04.485822 ip-10-0-128-134 kubenswrapper[2559]: I0612 22:22:04.482382 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/5cef91d1-5123-4ae8-ba08-1a8f898bae57-metrics-client-ca\") pod \"telemeter-client-558d966b89-9tqtf\" (UID: \"5cef91d1-5123-4ae8-ba08-1a8f898bae57\") " pod="openshift-monitoring/telemeter-client-558d966b89-9tqtf" Jun 12 22:22:04.485822 ip-10-0-128-134 kubenswrapper[2559]: I0612 22:22:04.482479 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-telemeter-client\" (UniqueName: \"kubernetes.io/secret/5cef91d1-5123-4ae8-ba08-1a8f898bae57-secret-telemeter-client\") pod \"telemeter-client-558d966b89-9tqtf\" (UID: \"5cef91d1-5123-4ae8-ba08-1a8f898bae57\") " pod="openshift-monitoring/telemeter-client-558d966b89-9tqtf" Jun 12 22:22:04.485822 ip-10-0-128-134 kubenswrapper[2559]: I0612 22:22:04.482509 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"telemeter-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/5cef91d1-5123-4ae8-ba08-1a8f898bae57-telemeter-trusted-ca-bundle\") pod \"telemeter-client-558d966b89-9tqtf\" (UID: \"5cef91d1-5123-4ae8-ba08-1a8f898bae57\") " pod="openshift-monitoring/telemeter-client-558d966b89-9tqtf" Jun 12 22:22:04.485822 ip-10-0-128-134 kubenswrapper[2559]: I0612 22:22:04.482538 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-telemeter-client-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/5cef91d1-5123-4ae8-ba08-1a8f898bae57-secret-telemeter-client-kube-rbac-proxy-config\") pod \"telemeter-client-558d966b89-9tqtf\" (UID: \"5cef91d1-5123-4ae8-ba08-1a8f898bae57\") " pod="openshift-monitoring/telemeter-client-558d966b89-9tqtf" Jun 12 22:22:04.485822 ip-10-0-128-134 kubenswrapper[2559]: I0612 22:22:04.482596 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/5cef91d1-5123-4ae8-ba08-1a8f898bae57-serving-certs-ca-bundle\") pod \"telemeter-client-558d966b89-9tqtf\" (UID: \"5cef91d1-5123-4ae8-ba08-1a8f898bae57\") " pod="openshift-monitoring/telemeter-client-558d966b89-9tqtf" Jun 12 22:22:04.485822 ip-10-0-128-134 kubenswrapper[2559]: I0612 22:22:04.482624 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"telemeter-client-tls\" (UniqueName: \"kubernetes.io/secret/5cef91d1-5123-4ae8-ba08-1a8f898bae57-telemeter-client-tls\") pod \"telemeter-client-558d966b89-9tqtf\" (UID: \"5cef91d1-5123-4ae8-ba08-1a8f898bae57\") " pod="openshift-monitoring/telemeter-client-558d966b89-9tqtf" Jun 12 22:22:04.485822 ip-10-0-128-134 kubenswrapper[2559]: I0612 22:22:04.482681 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"federate-client-tls\" (UniqueName: \"kubernetes.io/secret/5cef91d1-5123-4ae8-ba08-1a8f898bae57-federate-client-tls\") pod \"telemeter-client-558d966b89-9tqtf\" (UID: \"5cef91d1-5123-4ae8-ba08-1a8f898bae57\") " pod="openshift-monitoring/telemeter-client-558d966b89-9tqtf" Jun 12 22:22:04.485822 ip-10-0-128-134 kubenswrapper[2559]: I0612 22:22:04.484180 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"telemeter-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/5cef91d1-5123-4ae8-ba08-1a8f898bae57-telemeter-trusted-ca-bundle\") pod \"telemeter-client-558d966b89-9tqtf\" (UID: \"5cef91d1-5123-4ae8-ba08-1a8f898bae57\") " pod="openshift-monitoring/telemeter-client-558d966b89-9tqtf" Jun 12 22:22:04.485822 ip-10-0-128-134 kubenswrapper[2559]: I0612 22:22:04.484851 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/5cef91d1-5123-4ae8-ba08-1a8f898bae57-metrics-client-ca\") pod \"telemeter-client-558d966b89-9tqtf\" (UID: \"5cef91d1-5123-4ae8-ba08-1a8f898bae57\") " pod="openshift-monitoring/telemeter-client-558d966b89-9tqtf" Jun 12 22:22:04.485822 ip-10-0-128-134 kubenswrapper[2559]: I0612 22:22:04.485775 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/5cef91d1-5123-4ae8-ba08-1a8f898bae57-serving-certs-ca-bundle\") pod \"telemeter-client-558d966b89-9tqtf\" (UID: \"5cef91d1-5123-4ae8-ba08-1a8f898bae57\") " pod="openshift-monitoring/telemeter-client-558d966b89-9tqtf" Jun 12 22:22:04.486706 ip-10-0-128-134 kubenswrapper[2559]: I0612 22:22:04.486681 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"federate-client-tls\" (UniqueName: \"kubernetes.io/secret/5cef91d1-5123-4ae8-ba08-1a8f898bae57-federate-client-tls\") pod \"telemeter-client-558d966b89-9tqtf\" (UID: \"5cef91d1-5123-4ae8-ba08-1a8f898bae57\") " pod="openshift-monitoring/telemeter-client-558d966b89-9tqtf" Jun 12 22:22:04.496770 ip-10-0-128-134 kubenswrapper[2559]: I0612 22:22:04.496689 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-f7h79_2fe08918-3efc-4000-a321-8b319ead517c/konnectivity-agent/0.log" limit=1024 Jun 12 22:22:04.502255 ip-10-0-128-134 kubenswrapper[2559]: I0612 22:22:04.502192 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-telemeter-client-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/5cef91d1-5123-4ae8-ba08-1a8f898bae57-secret-telemeter-client-kube-rbac-proxy-config\") pod \"telemeter-client-558d966b89-9tqtf\" (UID: \"5cef91d1-5123-4ae8-ba08-1a8f898bae57\") " pod="openshift-monitoring/telemeter-client-558d966b89-9tqtf" Jun 12 22:22:04.503049 ip-10-0-128-134 kubenswrapper[2559]: I0612 22:22:04.502991 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-7vrfp\" (UniqueName: \"kubernetes.io/projected/5cef91d1-5123-4ae8-ba08-1a8f898bae57-kube-api-access-7vrfp\") pod \"telemeter-client-558d966b89-9tqtf\" (UID: \"5cef91d1-5123-4ae8-ba08-1a8f898bae57\") " pod="openshift-monitoring/telemeter-client-558d966b89-9tqtf" Jun 12 22:22:04.503677 ip-10-0-128-134 kubenswrapper[2559]: I0612 22:22:04.503640 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"telemeter-client-tls\" (UniqueName: \"kubernetes.io/secret/5cef91d1-5123-4ae8-ba08-1a8f898bae57-telemeter-client-tls\") pod \"telemeter-client-558d966b89-9tqtf\" (UID: \"5cef91d1-5123-4ae8-ba08-1a8f898bae57\") " pod="openshift-monitoring/telemeter-client-558d966b89-9tqtf" Jun 12 22:22:04.504332 ip-10-0-128-134 kubenswrapper[2559]: I0612 22:22:04.504308 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-telemeter-client\" (UniqueName: \"kubernetes.io/secret/5cef91d1-5123-4ae8-ba08-1a8f898bae57-secret-telemeter-client\") pod \"telemeter-client-558d966b89-9tqtf\" (UID: \"5cef91d1-5123-4ae8-ba08-1a8f898bae57\") " pod="openshift-monitoring/telemeter-client-558d966b89-9tqtf" Jun 12 22:22:04.516992 ip-10-0-128-134 kubenswrapper[2559]: I0612 22:22:04.516698 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-zdjjt" Jun 12 22:22:04.553378 ip-10-0-128-134 kubenswrapper[2559]: I0612 22:22:04.553315 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-f7h79_2fe08918-3efc-4000-a321-8b319ead517c/konnectivity-agent/0.log" limit=1024 Jun 12 22:22:04.653204 ip-10-0-128-134 kubenswrapper[2559]: I0612 22:22:04.653167 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/telemeter-client-558d966b89-9tqtf" Jun 12 22:22:04.736473 ip-10-0-128-134 kubenswrapper[2559]: I0612 22:22:04.735558 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/downloads-694c955b9-blb5k" event={"ID":"d1f3ee57-3b89-4d10-8159-57894504bebb","Type":"ContainerStarted","Data":"3cffa8666dd8a7baa6b8ec327f7fe8249d7b6a2f6f1fff75ace96ae8f59ae7a3"} Jun 12 22:22:04.737046 ip-10-0-128-134 kubenswrapper[2559]: I0612 22:22:04.736992 2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/downloads-694c955b9-blb5k" Jun 12 22:22:04.743516 ip-10-0-128-134 kubenswrapper[2559]: I0612 22:22:04.743395 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"5463e61a-cf1a-4c7e-962c-ac94781324b1","Type":"ContainerStarted","Data":"69553d3198620292a14d58c3d2770f34debd8de3fc5a1e94528b5fb87bf4caed"} Jun 12 22:22:04.745521 ip-10-0-128-134 kubenswrapper[2559]: I0612 22:22:04.745408 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-68f5fc465b-28vs9" event={"ID":"b5a8f721-d758-49b4-9967-84ed17bf40a5","Type":"ContainerStarted","Data":"11635d2a7b837e2e1a5e20c9fc44426f0c20e92a5119ef1830d58211d9ea3025"} Jun 12 22:22:04.749478 ip-10-0-128-134 kubenswrapper[2559]: I0612 22:22:04.749386 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-hsj6t" event={"ID":"c99154f1-7ad4-4ed4-a58e-6b0695e673fa","Type":"ContainerStarted","Data":"cc9459b9721c8aba583f58d3b4ee76f790967905249eb5c806e971e69a94b5d7"} Jun 12 22:22:04.753776 ip-10-0-128-134 kubenswrapper[2559]: I0612 22:22:04.753750 2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/downloads-694c955b9-blb5k" Jun 12 22:22:04.773551 ip-10-0-128-134 kubenswrapper[2559]: I0612 22:22:04.773483 2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/downloads-694c955b9-blb5k" podStartSLOduration=2.064565757 podStartE2EDuration="19.773459845s" totalImagesPullingTime="17.708894088s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-12 22:21:45 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-12 22:22:04.756158892 +0000 UTC m=+66.804528710" watchObservedRunningTime="2026-06-12 22:22:04.773459845 +0000 UTC m=+66.821829654" Jun 12 22:22:05.366675 ip-10-0-128-134 kubenswrapper[2559]: I0612 22:22:05.366615 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-d9psx"] Jun 12 22:22:05.500363 ip-10-0-128-134 kubenswrapper[2559]: I0612 22:22:05.499760 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/telemeter-client-558d966b89-9tqtf"] Jun 12 22:22:05.500363 ip-10-0-128-134 kubenswrapper[2559]: I0612 22:22:05.500098 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-f7h79_2fe08918-3efc-4000-a321-8b319ead517c/konnectivity-agent/0.log" limit=1024 Jun 12 22:22:05.521757 ip-10-0-128-134 kubenswrapper[2559]: I0612 22:22:05.521715 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-c9wls"] Jun 12 22:22:05.551771 ip-10-0-128-134 kubenswrapper[2559]: I0612 22:22:05.551734 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-zdjjt"] Jun 12 22:22:05.557791 ip-10-0-128-134 kubenswrapper[2559]: I0612 22:22:05.556994 2559 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Jun 12 22:22:05.579981 ip-10-0-128-134 kubenswrapper[2559]: I0612 22:22:05.579877 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-f7h79_2fe08918-3efc-4000-a321-8b319ead517c/konnectivity-agent/0.log" limit=1024 Jun 12 22:22:05.588135 ip-10-0-128-134 kubenswrapper[2559]: I0612 22:22:05.588098 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0" Jun 12 22:22:05.589723 ip-10-0-128-134 kubenswrapper[2559]: I0612 22:22:05.589139 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Jun 12 22:22:05.592804 ip-10-0-128-134 kubenswrapper[2559]: I0612 22:22:05.592782 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-web-config\"" Jun 12 22:22:05.596636 ip-10-0-128-134 kubenswrapper[2559]: I0612 22:22:05.592952 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-rbac-proxy\"" Jun 12 22:22:05.596636 ip-10-0-128-134 kubenswrapper[2559]: I0612 22:22:05.593117 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-tls-assets-0\"" Jun 12 22:22:05.596636 ip-10-0-128-134 kubenswrapper[2559]: I0612 22:22:05.593216 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s\"" Jun 12 22:22:05.596636 ip-10-0-128-134 kubenswrapper[2559]: I0612 22:22:05.593351 2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"serving-certs-ca-bundle\"" Jun 12 22:22:05.596636 ip-10-0-128-134 kubenswrapper[2559]: I0612 22:22:05.593429 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-client-certs\"" Jun 12 22:22:05.596636 ip-10-0-128-134 kubenswrapper[2559]: I0612 22:22:05.592891 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-thanos-sidecar-tls\"" Jun 12 22:22:05.596636 ip-10-0-128-134 kubenswrapper[2559]: I0612 22:22:05.592811 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-tls\"" Jun 12 22:22:05.596636 ip-10-0-128-134 kubenswrapper[2559]: I0612 22:22:05.594351 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-kube-rbac-proxy-web\"" Jun 12 22:22:05.596636 ip-10-0-128-134 kubenswrapper[2559]: I0612 22:22:05.594626 2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kubelet-serving-ca-bundle\"" Jun 12 22:22:05.596636 ip-10-0-128-134 kubenswrapper[2559]: I0612 22:22:05.594817 2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-1\"" Jun 12 22:22:05.596636 ip-10-0-128-134 kubenswrapper[2559]: I0612 22:22:05.594988 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-thanos-prometheus-http-client-file\"" Jun 12 22:22:05.596636 ip-10-0-128-134 kubenswrapper[2559]: I0612 22:22:05.595262 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-dockercfg-5w5cg\"" Jun 12 22:22:05.596636 ip-10-0-128-134 kubenswrapper[2559]: I0612 22:22:05.595487 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-grpc-tls-79np3hg4qng4q\"" Jun 12 22:22:05.597315 ip-10-0-128-134 kubenswrapper[2559]: I0612 22:22:05.596964 2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-2\"" Jun 12 22:22:05.597624 ip-10-0-128-134 kubenswrapper[2559]: I0612 22:22:05.597405 2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-0\"" Jun 12 22:22:05.606140 ip-10-0-128-134 kubenswrapper[2559]: I0612 22:22:05.606101 2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-trusted-ca-bundle\"" Jun 12 22:22:05.700532 ip-10-0-128-134 kubenswrapper[2559]: I0612 22:22:05.700285 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/7f938da2-ffe5-4feb-988f-22bbc35e531f-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"7f938da2-ffe5-4feb-988f-22bbc35e531f\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 12 22:22:05.700532 ip-10-0-128-134 kubenswrapper[2559]: I0612 22:22:05.700340 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/7f938da2-ffe5-4feb-988f-22bbc35e531f-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"7f938da2-ffe5-4feb-988f-22bbc35e531f\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 12 22:22:05.700532 ip-10-0-128-134 kubenswrapper[2559]: I0612 22:22:05.700369 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/7f938da2-ffe5-4feb-988f-22bbc35e531f-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"7f938da2-ffe5-4feb-988f-22bbc35e531f\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 12 22:22:05.700532 ip-10-0-128-134 kubenswrapper[2559]: I0612 22:22:05.700393 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/7f938da2-ffe5-4feb-988f-22bbc35e531f-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"7f938da2-ffe5-4feb-988f-22bbc35e531f\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 12 22:22:05.700532 ip-10-0-128-134 kubenswrapper[2559]: I0612 22:22:05.700414 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/7f938da2-ffe5-4feb-988f-22bbc35e531f-config\") pod \"prometheus-k8s-0\" (UID: \"7f938da2-ffe5-4feb-988f-22bbc35e531f\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 12 22:22:05.700532 ip-10-0-128-134 kubenswrapper[2559]: I0612 22:22:05.700434 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-pkhfw\" (UniqueName: \"kubernetes.io/projected/7f938da2-ffe5-4feb-988f-22bbc35e531f-kube-api-access-pkhfw\") pod \"prometheus-k8s-0\" (UID: \"7f938da2-ffe5-4feb-988f-22bbc35e531f\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 12 22:22:05.701002 ip-10-0-128-134 kubenswrapper[2559]: I0612 22:22:05.700598 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/7f938da2-ffe5-4feb-988f-22bbc35e531f-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"7f938da2-ffe5-4feb-988f-22bbc35e531f\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 12 22:22:05.701002 ip-10-0-128-134 kubenswrapper[2559]: I0612 22:22:05.700644 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/7f938da2-ffe5-4feb-988f-22bbc35e531f-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"7f938da2-ffe5-4feb-988f-22bbc35e531f\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 12 22:22:05.701002 ip-10-0-128-134 kubenswrapper[2559]: I0612 22:22:05.700681 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/7f938da2-ffe5-4feb-988f-22bbc35e531f-config-out\") pod \"prometheus-k8s-0\" (UID: \"7f938da2-ffe5-4feb-988f-22bbc35e531f\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 12 22:22:05.701002 ip-10-0-128-134 kubenswrapper[2559]: I0612 22:22:05.700703 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/7f938da2-ffe5-4feb-988f-22bbc35e531f-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"7f938da2-ffe5-4feb-988f-22bbc35e531f\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 12 22:22:05.701002 ip-10-0-128-134 kubenswrapper[2559]: I0612 22:22:05.700726 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/7f938da2-ffe5-4feb-988f-22bbc35e531f-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"7f938da2-ffe5-4feb-988f-22bbc35e531f\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 12 22:22:05.701002 ip-10-0-128-134 kubenswrapper[2559]: I0612 22:22:05.700776 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/7f938da2-ffe5-4feb-988f-22bbc35e531f-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"7f938da2-ffe5-4feb-988f-22bbc35e531f\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 12 22:22:05.701002 ip-10-0-128-134 kubenswrapper[2559]: I0612 22:22:05.700823 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/7f938da2-ffe5-4feb-988f-22bbc35e531f-web-config\") pod \"prometheus-k8s-0\" (UID: \"7f938da2-ffe5-4feb-988f-22bbc35e531f\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 12 22:22:05.701002 ip-10-0-128-134 kubenswrapper[2559]: I0612 22:22:05.700859 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/7f938da2-ffe5-4feb-988f-22bbc35e531f-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"7f938da2-ffe5-4feb-988f-22bbc35e531f\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 12 22:22:05.701002 ip-10-0-128-134 kubenswrapper[2559]: I0612 22:22:05.700890 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/7f938da2-ffe5-4feb-988f-22bbc35e531f-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"7f938da2-ffe5-4feb-988f-22bbc35e531f\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 12 22:22:05.701002 ip-10-0-128-134 kubenswrapper[2559]: I0612 22:22:05.700915 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/7f938da2-ffe5-4feb-988f-22bbc35e531f-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"7f938da2-ffe5-4feb-988f-22bbc35e531f\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 12 22:22:05.701002 ip-10-0-128-134 kubenswrapper[2559]: I0612 22:22:05.700948 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/7f938da2-ffe5-4feb-988f-22bbc35e531f-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"7f938da2-ffe5-4feb-988f-22bbc35e531f\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 12 22:22:05.701002 ip-10-0-128-134 kubenswrapper[2559]: I0612 22:22:05.700995 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/7f938da2-ffe5-4feb-988f-22bbc35e531f-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"7f938da2-ffe5-4feb-988f-22bbc35e531f\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 12 22:22:05.701526 ip-10-0-128-134 kubenswrapper[2559]: I0612 22:22:05.701031 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/7f938da2-ffe5-4feb-988f-22bbc35e531f-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"7f938da2-ffe5-4feb-988f-22bbc35e531f\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 12 22:22:05.701526 ip-10-0-128-134 kubenswrapper[2559]: I0612 22:22:05.701082 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/7f938da2-ffe5-4feb-988f-22bbc35e531f-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"7f938da2-ffe5-4feb-988f-22bbc35e531f\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 12 22:22:05.802389 ip-10-0-128-134 kubenswrapper[2559]: I0612 22:22:05.802354 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/7f938da2-ffe5-4feb-988f-22bbc35e531f-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"7f938da2-ffe5-4feb-988f-22bbc35e531f\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 12 22:22:05.802874 ip-10-0-128-134 kubenswrapper[2559]: I0612 22:22:05.802404 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/7f938da2-ffe5-4feb-988f-22bbc35e531f-config-out\") pod \"prometheus-k8s-0\" (UID: \"7f938da2-ffe5-4feb-988f-22bbc35e531f\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 12 22:22:05.802874 ip-10-0-128-134 kubenswrapper[2559]: I0612 22:22:05.802433 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/7f938da2-ffe5-4feb-988f-22bbc35e531f-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"7f938da2-ffe5-4feb-988f-22bbc35e531f\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 12 22:22:05.805573 ip-10-0-128-134 kubenswrapper[2559]: I0612 22:22:05.805541 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/7f938da2-ffe5-4feb-988f-22bbc35e531f-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"7f938da2-ffe5-4feb-988f-22bbc35e531f\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 12 22:22:05.805705 ip-10-0-128-134 kubenswrapper[2559]: I0612 22:22:05.805590 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/7f938da2-ffe5-4feb-988f-22bbc35e531f-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"7f938da2-ffe5-4feb-988f-22bbc35e531f\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 12 22:22:05.805705 ip-10-0-128-134 kubenswrapper[2559]: I0612 22:22:05.805618 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/7f938da2-ffe5-4feb-988f-22bbc35e531f-web-config\") pod \"prometheus-k8s-0\" (UID: \"7f938da2-ffe5-4feb-988f-22bbc35e531f\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 12 22:22:05.805705 ip-10-0-128-134 kubenswrapper[2559]: I0612 22:22:05.805650 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/7f938da2-ffe5-4feb-988f-22bbc35e531f-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"7f938da2-ffe5-4feb-988f-22bbc35e531f\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 12 22:22:05.807577 ip-10-0-128-134 kubenswrapper[2559]: I0612 22:22:05.805680 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/7f938da2-ffe5-4feb-988f-22bbc35e531f-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"7f938da2-ffe5-4feb-988f-22bbc35e531f\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 12 22:22:05.807577 ip-10-0-128-134 kubenswrapper[2559]: I0612 22:22:05.805980 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/7f938da2-ffe5-4feb-988f-22bbc35e531f-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"7f938da2-ffe5-4feb-988f-22bbc35e531f\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 12 22:22:05.807577 ip-10-0-128-134 kubenswrapper[2559]: I0612 22:22:05.806017 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/7f938da2-ffe5-4feb-988f-22bbc35e531f-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"7f938da2-ffe5-4feb-988f-22bbc35e531f\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 12 22:22:05.807577 ip-10-0-128-134 kubenswrapper[2559]: I0612 22:22:05.806058 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/7f938da2-ffe5-4feb-988f-22bbc35e531f-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"7f938da2-ffe5-4feb-988f-22bbc35e531f\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 12 22:22:05.807577 ip-10-0-128-134 kubenswrapper[2559]: I0612 22:22:05.806083 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/7f938da2-ffe5-4feb-988f-22bbc35e531f-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"7f938da2-ffe5-4feb-988f-22bbc35e531f\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 12 22:22:05.807577 ip-10-0-128-134 kubenswrapper[2559]: I0612 22:22:05.806123 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/7f938da2-ffe5-4feb-988f-22bbc35e531f-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"7f938da2-ffe5-4feb-988f-22bbc35e531f\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 12 22:22:05.807577 ip-10-0-128-134 kubenswrapper[2559]: I0612 22:22:05.806166 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/7f938da2-ffe5-4feb-988f-22bbc35e531f-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"7f938da2-ffe5-4feb-988f-22bbc35e531f\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 12 22:22:05.807577 ip-10-0-128-134 kubenswrapper[2559]: I0612 22:22:05.806200 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/7f938da2-ffe5-4feb-988f-22bbc35e531f-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"7f938da2-ffe5-4feb-988f-22bbc35e531f\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 12 22:22:05.807577 ip-10-0-128-134 kubenswrapper[2559]: I0612 22:22:05.806242 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/7f938da2-ffe5-4feb-988f-22bbc35e531f-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"7f938da2-ffe5-4feb-988f-22bbc35e531f\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 12 22:22:05.807577 ip-10-0-128-134 kubenswrapper[2559]: I0612 22:22:05.806274 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/7f938da2-ffe5-4feb-988f-22bbc35e531f-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"7f938da2-ffe5-4feb-988f-22bbc35e531f\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 12 22:22:05.807577 ip-10-0-128-134 kubenswrapper[2559]: I0612 22:22:05.806312 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/7f938da2-ffe5-4feb-988f-22bbc35e531f-config\") pod \"prometheus-k8s-0\" (UID: \"7f938da2-ffe5-4feb-988f-22bbc35e531f\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 12 22:22:05.807577 ip-10-0-128-134 kubenswrapper[2559]: I0612 22:22:05.806342 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-pkhfw\" (UniqueName: \"kubernetes.io/projected/7f938da2-ffe5-4feb-988f-22bbc35e531f-kube-api-access-pkhfw\") pod \"prometheus-k8s-0\" (UID: \"7f938da2-ffe5-4feb-988f-22bbc35e531f\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 12 22:22:05.807577 ip-10-0-128-134 kubenswrapper[2559]: I0612 22:22:05.806396 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/7f938da2-ffe5-4feb-988f-22bbc35e531f-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"7f938da2-ffe5-4feb-988f-22bbc35e531f\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 12 22:22:05.807577 ip-10-0-128-134 kubenswrapper[2559]: I0612 22:22:05.806964 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/7f938da2-ffe5-4feb-988f-22bbc35e531f-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"7f938da2-ffe5-4feb-988f-22bbc35e531f\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 12 22:22:05.807577 ip-10-0-128-134 kubenswrapper[2559]: I0612 22:22:05.806964 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/7f938da2-ffe5-4feb-988f-22bbc35e531f-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"7f938da2-ffe5-4feb-988f-22bbc35e531f\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 12 22:22:05.807577 ip-10-0-128-134 kubenswrapper[2559]: I0612 22:22:05.807226 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/7f938da2-ffe5-4feb-988f-22bbc35e531f-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"7f938da2-ffe5-4feb-988f-22bbc35e531f\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 12 22:22:05.810313 ip-10-0-128-134 kubenswrapper[2559]: I0612 22:22:05.809156 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/7f938da2-ffe5-4feb-988f-22bbc35e531f-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"7f938da2-ffe5-4feb-988f-22bbc35e531f\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 12 22:22:05.810578 ip-10-0-128-134 kubenswrapper[2559]: I0612 22:22:05.810550 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/7f938da2-ffe5-4feb-988f-22bbc35e531f-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"7f938da2-ffe5-4feb-988f-22bbc35e531f\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 12 22:22:05.811722 ip-10-0-128-134 kubenswrapper[2559]: I0612 22:22:05.806341 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/7f938da2-ffe5-4feb-988f-22bbc35e531f-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"7f938da2-ffe5-4feb-988f-22bbc35e531f\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 12 22:22:05.812983 ip-10-0-128-134 kubenswrapper[2559]: I0612 22:22:05.812411 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/7f938da2-ffe5-4feb-988f-22bbc35e531f-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"7f938da2-ffe5-4feb-988f-22bbc35e531f\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 12 22:22:05.812983 ip-10-0-128-134 kubenswrapper[2559]: I0612 22:22:05.812666 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/7f938da2-ffe5-4feb-988f-22bbc35e531f-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"7f938da2-ffe5-4feb-988f-22bbc35e531f\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 12 22:22:05.824480 ip-10-0-128-134 kubenswrapper[2559]: I0612 22:22:05.824403 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/7f938da2-ffe5-4feb-988f-22bbc35e531f-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"7f938da2-ffe5-4feb-988f-22bbc35e531f\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 12 22:22:05.824976 ip-10-0-128-134 kubenswrapper[2559]: I0612 22:22:05.824952 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-pkhfw\" (UniqueName: \"kubernetes.io/projected/7f938da2-ffe5-4feb-988f-22bbc35e531f-kube-api-access-pkhfw\") pod \"prometheus-k8s-0\" (UID: \"7f938da2-ffe5-4feb-988f-22bbc35e531f\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 12 22:22:05.826243 ip-10-0-128-134 kubenswrapper[2559]: I0612 22:22:05.825792 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/7f938da2-ffe5-4feb-988f-22bbc35e531f-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"7f938da2-ffe5-4feb-988f-22bbc35e531f\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 12 22:22:05.826243 ip-10-0-128-134 kubenswrapper[2559]: I0612 22:22:05.826201 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/7f938da2-ffe5-4feb-988f-22bbc35e531f-web-config\") pod \"prometheus-k8s-0\" (UID: \"7f938da2-ffe5-4feb-988f-22bbc35e531f\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 12 22:22:05.827276 ip-10-0-128-134 kubenswrapper[2559]: I0612 22:22:05.826719 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/7f938da2-ffe5-4feb-988f-22bbc35e531f-config-out\") pod \"prometheus-k8s-0\" (UID: \"7f938da2-ffe5-4feb-988f-22bbc35e531f\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 12 22:22:05.827276 ip-10-0-128-134 kubenswrapper[2559]: I0612 22:22:05.826844 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/7f938da2-ffe5-4feb-988f-22bbc35e531f-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"7f938da2-ffe5-4feb-988f-22bbc35e531f\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 12 22:22:05.827276 ip-10-0-128-134 kubenswrapper[2559]: I0612 22:22:05.827090 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/7f938da2-ffe5-4feb-988f-22bbc35e531f-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"7f938da2-ffe5-4feb-988f-22bbc35e531f\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 12 22:22:05.827276 ip-10-0-128-134 kubenswrapper[2559]: I0612 22:22:05.827158 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/7f938da2-ffe5-4feb-988f-22bbc35e531f-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"7f938da2-ffe5-4feb-988f-22bbc35e531f\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 12 22:22:05.827276 ip-10-0-128-134 kubenswrapper[2559]: I0612 22:22:05.827242 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/secret/7f938da2-ffe5-4feb-988f-22bbc35e531f-config\") pod \"prometheus-k8s-0\" (UID: \"7f938da2-ffe5-4feb-988f-22bbc35e531f\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 12 22:22:05.828265 ip-10-0-128-134 kubenswrapper[2559]: I0612 22:22:05.828208 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/7f938da2-ffe5-4feb-988f-22bbc35e531f-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"7f938da2-ffe5-4feb-988f-22bbc35e531f\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 12 22:22:05.829947 ip-10-0-128-134 kubenswrapper[2559]: I0612 22:22:05.829902 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/7f938da2-ffe5-4feb-988f-22bbc35e531f-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"7f938da2-ffe5-4feb-988f-22bbc35e531f\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 12 22:22:05.830101 ip-10-0-128-134 kubenswrapper[2559]: I0612 22:22:05.830055 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/7f938da2-ffe5-4feb-988f-22bbc35e531f-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"7f938da2-ffe5-4feb-988f-22bbc35e531f\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 12 22:22:05.842110 ip-10-0-128-134 kubenswrapper[2559]: I0612 22:22:05.841145 2559 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-679bdcbb85-plxpd"] Jun 12 22:22:05.906265 ip-10-0-128-134 kubenswrapper[2559]: I0612 22:22:05.906229 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0" Jun 12 22:22:06.010308 ip-10-0-128-134 kubenswrapper[2559]: I0612 22:22:06.010145 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-f7h79_2fe08918-3efc-4000-a321-8b319ead517c/konnectivity-agent/0.log" limit=1024 Jun 12 22:22:06.101208 ip-10-0-128-134 kubenswrapper[2559]: I0612 22:22:06.101173 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-f7h79_2fe08918-3efc-4000-a321-8b319ead517c/konnectivity-agent/0.log" limit=1024 Jun 12 22:22:06.359605 ip-10-0-128-134 kubenswrapper[2559]: W0612 22:22:06.359564 2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd4d1b0d2_aea6_421c_91e9_f74e3b7a4c6a.slice/crio-faabd44f202171de54eb2c9060f2786eb52b80fbdde082b67780a6613af66d94 WatchSource:0}: Error finding container faabd44f202171de54eb2c9060f2786eb52b80fbdde082b67780a6613af66d94: Status 404 returned error can't find the container with id faabd44f202171de54eb2c9060f2786eb52b80fbdde082b67780a6613af66d94 Jun 12 22:22:06.360992 ip-10-0-128-134 kubenswrapper[2559]: W0612 22:22:06.360965 2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod12fe1273_445c_4710_8579_38c99d08c036.slice/crio-e8ee37f175b675958bafba3c21f3cdf4db201844261c75b25b61e428a816dcac WatchSource:0}: Error finding container e8ee37f175b675958bafba3c21f3cdf4db201844261c75b25b61e428a816dcac: Status 404 returned error can't find the container with id e8ee37f175b675958bafba3c21f3cdf4db201844261c75b25b61e428a816dcac Jun 12 22:22:06.362208 ip-10-0-128-134 kubenswrapper[2559]: W0612 22:22:06.361832 2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5cef91d1_5123_4ae8_ba08_1a8f898bae57.slice/crio-8f7c99064309f1c8b5a5311306eb8d66da755cf72f8cd1df4b0ab8cf655674fe WatchSource:0}: Error finding container 8f7c99064309f1c8b5a5311306eb8d66da755cf72f8cd1df4b0ab8cf655674fe: Status 404 returned error can't find the container with id 8f7c99064309f1c8b5a5311306eb8d66da755cf72f8cd1df4b0ab8cf655674fe Jun 12 22:22:06.366134 ip-10-0-128-134 kubenswrapper[2559]: W0612 22:22:06.366111 2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod73bd91e1_b3e8_495c_990c_3ab079745247.slice/crio-02956cf375f0fb7a68f03ded02cb32b6c34c885c621d5009920d9ba09789d4f6 WatchSource:0}: Error finding container 02956cf375f0fb7a68f03ded02cb32b6c34c885c621d5009920d9ba09789d4f6: Status 404 returned error can't find the container with id 02956cf375f0fb7a68f03ded02cb32b6c34c885c621d5009920d9ba09789d4f6 Jun 12 22:22:06.783495 ip-10-0-128-134 kubenswrapper[2559]: I0612 22:22:06.783322 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-c9wls" event={"ID":"d4d1b0d2-aea6-421c-91e9-f74e3b7a4c6a","Type":"ContainerStarted","Data":"faabd44f202171de54eb2c9060f2786eb52b80fbdde082b67780a6613af66d94"} Jun 12 22:22:06.785746 ip-10-0-128-134 kubenswrapper[2559]: I0612 22:22:06.785705 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-558d966b89-9tqtf" event={"ID":"5cef91d1-5123-4ae8-ba08-1a8f898bae57","Type":"ContainerStarted","Data":"8f7c99064309f1c8b5a5311306eb8d66da755cf72f8cd1df4b0ab8cf655674fe"} Jun 12 22:22:06.787468 ip-10-0-128-134 kubenswrapper[2559]: I0612 22:22:06.787412 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-zdjjt" event={"ID":"73bd91e1-b3e8-495c-990c-3ab079745247","Type":"ContainerStarted","Data":"02956cf375f0fb7a68f03ded02cb32b6c34c885c621d5009920d9ba09789d4f6"} Jun 12 22:22:06.789419 ip-10-0-128-134 kubenswrapper[2559]: I0612 22:22:06.789392 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-d9psx" event={"ID":"12fe1273-445c-4710-8579-38c99d08c036","Type":"ContainerStarted","Data":"e8ee37f175b675958bafba3c21f3cdf4db201844261c75b25b61e428a816dcac"} Jun 12 22:22:07.122063 ip-10-0-128-134 kubenswrapper[2559]: I0612 22:22:07.121978 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-f7h79_2fe08918-3efc-4000-a321-8b319ead517c/konnectivity-agent/0.log" limit=1024 Jun 12 22:22:07.222734 ip-10-0-128-134 kubenswrapper[2559]: I0612 22:22:07.222700 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-f7h79_2fe08918-3efc-4000-a321-8b319ead517c/konnectivity-agent/0.log" limit=1024 Jun 12 22:22:08.544632 ip-10-0-128-134 kubenswrapper[2559]: I0612 22:22:08.544599 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Jun 12 22:22:08.580358 ip-10-0-128-134 kubenswrapper[2559]: W0612 22:22:08.580311 2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7f938da2_ffe5_4feb_988f_22bbc35e531f.slice/crio-882777be4eb1130ac16e6f36676eb44316b94f2ad08565aab22c8c76dd35a369 WatchSource:0}: Error finding container 882777be4eb1130ac16e6f36676eb44316b94f2ad08565aab22c8c76dd35a369: Status 404 returned error can't find the container with id 882777be4eb1130ac16e6f36676eb44316b94f2ad08565aab22c8c76dd35a369 Jun 12 22:22:08.805284 ip-10-0-128-134 kubenswrapper[2559]: I0612 22:22:08.804325 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"7f938da2-ffe5-4feb-988f-22bbc35e531f","Type":"ContainerStarted","Data":"882777be4eb1130ac16e6f36676eb44316b94f2ad08565aab22c8c76dd35a369"} Jun 12 22:22:09.439252 ip-10-0-128-134 kubenswrapper[2559]: I0612 22:22:09.439195 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-f7h79_2fe08918-3efc-4000-a321-8b319ead517c/konnectivity-agent/0.log" limit=1024 Jun 12 22:22:09.500166 ip-10-0-128-134 kubenswrapper[2559]: I0612 22:22:09.500088 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-f7h79_2fe08918-3efc-4000-a321-8b319ead517c/konnectivity-agent/0.log" limit=1024 Jun 12 22:22:11.390156 ip-10-0-128-134 kubenswrapper[2559]: I0612 22:22:11.390028 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-f7h79_2fe08918-3efc-4000-a321-8b319ead517c/konnectivity-agent/0.log" limit=1024 Jun 12 22:22:11.485832 ip-10-0-128-134 kubenswrapper[2559]: I0612 22:22:11.485805 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-f7h79_2fe08918-3efc-4000-a321-8b319ead517c/konnectivity-agent/0.log" limit=1024 Jun 12 22:22:11.821310 ip-10-0-128-134 kubenswrapper[2559]: I0612 22:22:11.821270 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-68f5fc465b-28vs9" event={"ID":"b5a8f721-d758-49b4-9967-84ed17bf40a5","Type":"ContainerStarted","Data":"8a2ffb1a0c5941465843c7a2c64a2eaba8c2a4832ed70e03d2561ce13aec03c9"} Jun 12 22:22:11.821517 ip-10-0-128-134 kubenswrapper[2559]: I0612 22:22:11.821358 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-68f5fc465b-28vs9" event={"ID":"b5a8f721-d758-49b4-9967-84ed17bf40a5","Type":"ContainerStarted","Data":"e4476d74eac54ca6e6e8ffd63dc3f253e0441cb3228a06c30477a19aecfb54ac"} Jun 12 22:22:11.821517 ip-10-0-128-134 kubenswrapper[2559]: I0612 22:22:11.821393 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-68f5fc465b-28vs9" event={"ID":"b5a8f721-d758-49b4-9967-84ed17bf40a5","Type":"ContainerStarted","Data":"c4e1ac89e9192723394a09af874cd2a7b1335b90c2f647b768d5c3ea7c86fccd"} Jun 12 22:22:11.823316 ip-10-0-128-134 kubenswrapper[2559]: I0612 22:22:11.823287 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-d9psx" event={"ID":"12fe1273-445c-4710-8579-38c99d08c036","Type":"ContainerStarted","Data":"5c7cb66b1a7e39f48422de82fe0ac053d8fab39e8a63a92a9210a9e8f0865f18"} Jun 12 22:22:11.823428 ip-10-0-128-134 kubenswrapper[2559]: I0612 22:22:11.823350 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-d9psx" event={"ID":"12fe1273-445c-4710-8579-38c99d08c036","Type":"ContainerStarted","Data":"c3e355d83eed7cce93ab0ff115f4dcc5b631288315df46038b9aac93d7100153"} Jun 12 22:22:11.825659 ip-10-0-128-134 kubenswrapper[2559]: I0612 22:22:11.825631 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-hsj6t" event={"ID":"c99154f1-7ad4-4ed4-a58e-6b0695e673fa","Type":"ContainerStarted","Data":"d8fd578d133d362335bb7a06f3e7871b723ef590f0a48f883ebb37ffe08909f1"} Jun 12 22:22:11.828124 ip-10-0-128-134 kubenswrapper[2559]: I0612 22:22:11.828094 2559 generic.go:356] "Generic (PLEG): container finished" podID="ceaa8e94-a5c6-48ea-ba34-974490e3f735" containerID="919091069c9203c44c349b704b9daa61f6aa568f400652d1197ed70e6973a780" exitCode=0 Jun 12 22:22:11.828228 ip-10-0-128-134 kubenswrapper[2559]: I0612 22:22:11.828189 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-x7lwm" event={"ID":"ceaa8e94-a5c6-48ea-ba34-974490e3f735","Type":"ContainerDied","Data":"919091069c9203c44c349b704b9daa61f6aa568f400652d1197ed70e6973a780"} Jun 12 22:22:11.830625 ip-10-0-128-134 kubenswrapper[2559]: I0612 22:22:11.830532 2559 generic.go:356] "Generic (PLEG): container finished" podID="7f938da2-ffe5-4feb-988f-22bbc35e531f" containerID="658f3039844ce2d5a879bb100befc6969364d0f11ed9b8070d596c57f6760c56" exitCode=0 Jun 12 22:22:11.830722 ip-10-0-128-134 kubenswrapper[2559]: I0612 22:22:11.830621 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"7f938da2-ffe5-4feb-988f-22bbc35e531f","Type":"ContainerDied","Data":"658f3039844ce2d5a879bb100befc6969364d0f11ed9b8070d596c57f6760c56"} Jun 12 22:22:11.832579 ip-10-0-128-134 kubenswrapper[2559]: I0612 22:22:11.832560 2559 generic.go:356] "Generic (PLEG): container finished" podID="5463e61a-cf1a-4c7e-962c-ac94781324b1" containerID="821e1e465ae571c4090a1b3dd8cb87453556d570019963ac9f0ec9630df9e8f3" exitCode=0 Jun 12 22:22:11.832662 ip-10-0-128-134 kubenswrapper[2559]: I0612 22:22:11.832639 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"5463e61a-cf1a-4c7e-962c-ac94781324b1","Type":"ContainerDied","Data":"821e1e465ae571c4090a1b3dd8cb87453556d570019963ac9f0ec9630df9e8f3"} Jun 12 22:22:11.835821 ip-10-0-128-134 kubenswrapper[2559]: I0612 22:22:11.835177 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-558d966b89-9tqtf" event={"ID":"5cef91d1-5123-4ae8-ba08-1a8f898bae57","Type":"ContainerStarted","Data":"e85cad1cef7fa92f90c84312179fef6caeb709e6ef29e6f0d15a3338d9ed06b4"} Jun 12 22:22:11.835821 ip-10-0-128-134 kubenswrapper[2559]: I0612 22:22:11.835231 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-558d966b89-9tqtf" event={"ID":"5cef91d1-5123-4ae8-ba08-1a8f898bae57","Type":"ContainerStarted","Data":"613234dfaad0600941c96f461ba8aba256f59ef8298c46663eb9fcc618d00f8d"} Jun 12 22:22:11.835821 ip-10-0-128-134 kubenswrapper[2559]: I0612 22:22:11.835263 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-558d966b89-9tqtf" event={"ID":"5cef91d1-5123-4ae8-ba08-1a8f898bae57","Type":"ContainerStarted","Data":"f4f5f5cf0ed137618e3ea5528a6f7fad0a4fee59e1ae49592fc0a6931adfa853"} Jun 12 22:22:11.841515 ip-10-0-128-134 kubenswrapper[2559]: I0612 22:22:11.840352 2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/network-metrics-daemon-d9psx" podStartSLOduration=69.345573702 podStartE2EDuration="1m13.840340688s" totalImagesPullingTime="4.494766986s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-12 22:20:58 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-12 22:22:11.839184164 +0000 UTC m=+73.887553982" watchObservedRunningTime="2026-06-12 22:22:11.840340688 +0000 UTC m=+73.888710505" Jun 12 22:22:11.859066 ip-10-0-128-134 kubenswrapper[2559]: I0612 22:22:11.859012 2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-insights/insights-runtime-extractor-hsj6t" podStartSLOduration=7.596688545 podStartE2EDuration="25.858988848s" totalImagesPullingTime="18.262300303s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-12 22:21:46 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-12 22:22:11.856155285 +0000 UTC m=+73.904525125" watchObservedRunningTime="2026-06-12 22:22:11.858988848 +0000 UTC m=+73.907358660" Jun 12 22:22:11.924367 ip-10-0-128-134 kubenswrapper[2559]: I0612 22:22:11.924328 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-f7h79_2fe08918-3efc-4000-a321-8b319ead517c/konnectivity-agent/0.log" limit=1024 Jun 12 22:22:11.934170 ip-10-0-128-134 kubenswrapper[2559]: I0612 22:22:11.934127 2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/telemeter-client-558d966b89-9tqtf" podStartSLOduration=3.443237213 podStartE2EDuration="7.934107392s" totalImagesPullingTime="4.490870179s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-12 22:22:04 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-12 22:22:11.933333007 +0000 UTC m=+73.981702872" watchObservedRunningTime="2026-06-12 22:22:11.934107392 +0000 UTC m=+73.982477219" Jun 12 22:22:12.023644 ip-10-0-128-134 kubenswrapper[2559]: I0612 22:22:12.023597 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-f7h79_2fe08918-3efc-4000-a321-8b319ead517c/konnectivity-agent/0.log" limit=1024 Jun 12 22:22:12.085593 ip-10-0-128-134 kubenswrapper[2559]: I0612 22:22:12.085481 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-f7h79_2fe08918-3efc-4000-a321-8b319ead517c/konnectivity-agent/0.log" limit=1024 Jun 12 22:22:12.532016 ip-10-0-128-134 kubenswrapper[2559]: I0612 22:22:12.531925 2559 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-7569c88997-v8b6n"] Jun 12 22:22:12.557990 ip-10-0-128-134 kubenswrapper[2559]: I0612 22:22:12.557954 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-7569c88997-v8b6n"] Jun 12 22:22:12.558169 ip-10-0-128-134 kubenswrapper[2559]: I0612 22:22:12.558071 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-7569c88997-v8b6n" Jun 12 22:22:12.565352 ip-10-0-128-134 kubenswrapper[2559]: I0612 22:22:12.565322 2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"trusted-ca-bundle\"" Jun 12 22:22:12.682002 ip-10-0-128-134 kubenswrapper[2559]: I0612 22:22:12.681959 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/440350d8-f7d7-4966-81f4-12ed1cea6334-oauth-serving-cert\") pod \"console-7569c88997-v8b6n\" (UID: \"440350d8-f7d7-4966-81f4-12ed1cea6334\") " pod="openshift-console/console-7569c88997-v8b6n" Jun 12 22:22:12.682249 ip-10-0-128-134 kubenswrapper[2559]: I0612 22:22:12.682010 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-cw22f\" (UniqueName: \"kubernetes.io/projected/440350d8-f7d7-4966-81f4-12ed1cea6334-kube-api-access-cw22f\") pod \"console-7569c88997-v8b6n\" (UID: \"440350d8-f7d7-4966-81f4-12ed1cea6334\") " pod="openshift-console/console-7569c88997-v8b6n" Jun 12 22:22:12.682249 ip-10-0-128-134 kubenswrapper[2559]: I0612 22:22:12.682043 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/440350d8-f7d7-4966-81f4-12ed1cea6334-console-config\") pod \"console-7569c88997-v8b6n\" (UID: \"440350d8-f7d7-4966-81f4-12ed1cea6334\") " pod="openshift-console/console-7569c88997-v8b6n" Jun 12 22:22:12.682249 ip-10-0-128-134 kubenswrapper[2559]: I0612 22:22:12.682084 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/440350d8-f7d7-4966-81f4-12ed1cea6334-console-serving-cert\") pod \"console-7569c88997-v8b6n\" (UID: \"440350d8-f7d7-4966-81f4-12ed1cea6334\") " pod="openshift-console/console-7569c88997-v8b6n" Jun 12 22:22:12.682249 ip-10-0-128-134 kubenswrapper[2559]: I0612 22:22:12.682117 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/440350d8-f7d7-4966-81f4-12ed1cea6334-service-ca\") pod \"console-7569c88997-v8b6n\" (UID: \"440350d8-f7d7-4966-81f4-12ed1cea6334\") " pod="openshift-console/console-7569c88997-v8b6n" Jun 12 22:22:12.682249 ip-10-0-128-134 kubenswrapper[2559]: I0612 22:22:12.682146 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/440350d8-f7d7-4966-81f4-12ed1cea6334-console-oauth-config\") pod \"console-7569c88997-v8b6n\" (UID: \"440350d8-f7d7-4966-81f4-12ed1cea6334\") " pod="openshift-console/console-7569c88997-v8b6n" Jun 12 22:22:12.682249 ip-10-0-128-134 kubenswrapper[2559]: I0612 22:22:12.682221 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/440350d8-f7d7-4966-81f4-12ed1cea6334-trusted-ca-bundle\") pod \"console-7569c88997-v8b6n\" (UID: \"440350d8-f7d7-4966-81f4-12ed1cea6334\") " pod="openshift-console/console-7569c88997-v8b6n" Jun 12 22:22:12.783206 ip-10-0-128-134 kubenswrapper[2559]: I0612 22:22:12.783123 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/440350d8-f7d7-4966-81f4-12ed1cea6334-oauth-serving-cert\") pod \"console-7569c88997-v8b6n\" (UID: \"440350d8-f7d7-4966-81f4-12ed1cea6334\") " pod="openshift-console/console-7569c88997-v8b6n" Jun 12 22:22:12.783206 ip-10-0-128-134 kubenswrapper[2559]: I0612 22:22:12.783166 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-cw22f\" (UniqueName: \"kubernetes.io/projected/440350d8-f7d7-4966-81f4-12ed1cea6334-kube-api-access-cw22f\") pod \"console-7569c88997-v8b6n\" (UID: \"440350d8-f7d7-4966-81f4-12ed1cea6334\") " pod="openshift-console/console-7569c88997-v8b6n" Jun 12 22:22:12.783206 ip-10-0-128-134 kubenswrapper[2559]: I0612 22:22:12.783191 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/440350d8-f7d7-4966-81f4-12ed1cea6334-console-config\") pod \"console-7569c88997-v8b6n\" (UID: \"440350d8-f7d7-4966-81f4-12ed1cea6334\") " pod="openshift-console/console-7569c88997-v8b6n" Jun 12 22:22:12.783515 ip-10-0-128-134 kubenswrapper[2559]: I0612 22:22:12.783223 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/440350d8-f7d7-4966-81f4-12ed1cea6334-console-serving-cert\") pod \"console-7569c88997-v8b6n\" (UID: \"440350d8-f7d7-4966-81f4-12ed1cea6334\") " pod="openshift-console/console-7569c88997-v8b6n" Jun 12 22:22:12.783515 ip-10-0-128-134 kubenswrapper[2559]: I0612 22:22:12.783262 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/440350d8-f7d7-4966-81f4-12ed1cea6334-service-ca\") pod \"console-7569c88997-v8b6n\" (UID: \"440350d8-f7d7-4966-81f4-12ed1cea6334\") " pod="openshift-console/console-7569c88997-v8b6n" Jun 12 22:22:12.783515 ip-10-0-128-134 kubenswrapper[2559]: I0612 22:22:12.783295 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/440350d8-f7d7-4966-81f4-12ed1cea6334-console-oauth-config\") pod \"console-7569c88997-v8b6n\" (UID: \"440350d8-f7d7-4966-81f4-12ed1cea6334\") " pod="openshift-console/console-7569c88997-v8b6n" Jun 12 22:22:12.783515 ip-10-0-128-134 kubenswrapper[2559]: I0612 22:22:12.783323 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/440350d8-f7d7-4966-81f4-12ed1cea6334-trusted-ca-bundle\") pod \"console-7569c88997-v8b6n\" (UID: \"440350d8-f7d7-4966-81f4-12ed1cea6334\") " pod="openshift-console/console-7569c88997-v8b6n" Jun 12 22:22:12.784050 ip-10-0-128-134 kubenswrapper[2559]: I0612 22:22:12.784021 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/440350d8-f7d7-4966-81f4-12ed1cea6334-oauth-serving-cert\") pod \"console-7569c88997-v8b6n\" (UID: \"440350d8-f7d7-4966-81f4-12ed1cea6334\") " pod="openshift-console/console-7569c88997-v8b6n" Jun 12 22:22:12.784175 ip-10-0-128-134 kubenswrapper[2559]: I0612 22:22:12.784087 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/440350d8-f7d7-4966-81f4-12ed1cea6334-service-ca\") pod \"console-7569c88997-v8b6n\" (UID: \"440350d8-f7d7-4966-81f4-12ed1cea6334\") " pod="openshift-console/console-7569c88997-v8b6n" Jun 12 22:22:12.784435 ip-10-0-128-134 kubenswrapper[2559]: I0612 22:22:12.784268 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/440350d8-f7d7-4966-81f4-12ed1cea6334-console-config\") pod \"console-7569c88997-v8b6n\" (UID: \"440350d8-f7d7-4966-81f4-12ed1cea6334\") " pod="openshift-console/console-7569c88997-v8b6n" Jun 12 22:22:12.784435 ip-10-0-128-134 kubenswrapper[2559]: I0612 22:22:12.784395 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/440350d8-f7d7-4966-81f4-12ed1cea6334-trusted-ca-bundle\") pod \"console-7569c88997-v8b6n\" (UID: \"440350d8-f7d7-4966-81f4-12ed1cea6334\") " pod="openshift-console/console-7569c88997-v8b6n" Jun 12 22:22:12.786258 ip-10-0-128-134 kubenswrapper[2559]: I0612 22:22:12.786212 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/440350d8-f7d7-4966-81f4-12ed1cea6334-console-serving-cert\") pod \"console-7569c88997-v8b6n\" (UID: \"440350d8-f7d7-4966-81f4-12ed1cea6334\") " pod="openshift-console/console-7569c88997-v8b6n" Jun 12 22:22:12.786363 ip-10-0-128-134 kubenswrapper[2559]: I0612 22:22:12.786301 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/440350d8-f7d7-4966-81f4-12ed1cea6334-console-oauth-config\") pod \"console-7569c88997-v8b6n\" (UID: \"440350d8-f7d7-4966-81f4-12ed1cea6334\") " pod="openshift-console/console-7569c88997-v8b6n" Jun 12 22:22:12.791537 ip-10-0-128-134 kubenswrapper[2559]: I0612 22:22:12.791514 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-cw22f\" (UniqueName: \"kubernetes.io/projected/440350d8-f7d7-4966-81f4-12ed1cea6334-kube-api-access-cw22f\") pod \"console-7569c88997-v8b6n\" (UID: \"440350d8-f7d7-4966-81f4-12ed1cea6334\") " pod="openshift-console/console-7569c88997-v8b6n" Jun 12 22:22:12.868909 ip-10-0-128-134 kubenswrapper[2559]: I0612 22:22:12.868880 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-7569c88997-v8b6n" Jun 12 22:22:17.565686 ip-10-0-128-134 kubenswrapper[2559]: I0612 22:22:17.565655 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-7569c88997-v8b6n"] Jun 12 22:22:17.569394 ip-10-0-128-134 kubenswrapper[2559]: W0612 22:22:17.569362 2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod440350d8_f7d7_4966_81f4_12ed1cea6334.slice/crio-00bc76c3f83b0c5f5bc1dc4e834d3a7de73080d1adde5187bbc5b15d2fb13041 WatchSource:0}: Error finding container 00bc76c3f83b0c5f5bc1dc4e834d3a7de73080d1adde5187bbc5b15d2fb13041: Status 404 returned error can't find the container with id 00bc76c3f83b0c5f5bc1dc4e834d3a7de73080d1adde5187bbc5b15d2fb13041 Jun 12 22:22:17.878792 ip-10-0-128-134 kubenswrapper[2559]: I0612 22:22:17.878751 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-x7lwm" event={"ID":"ceaa8e94-a5c6-48ea-ba34-974490e3f735","Type":"ContainerStarted","Data":"92784ace5abecd8f8e2db7be91e73977f4ca0adc0328dafeb755c038d328c68d"} Jun 12 22:22:17.878943 ip-10-0-128-134 kubenswrapper[2559]: I0612 22:22:17.878919 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-x7lwm" event={"ID":"ceaa8e94-a5c6-48ea-ba34-974490e3f735","Type":"ContainerStarted","Data":"bc6b1bc21ef8f6a700d5879c94713e79131bac6948291a34a4c62ed874d2f917"} Jun 12 22:22:17.888021 ip-10-0-128-134 kubenswrapper[2559]: I0612 22:22:17.887929 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-c9wls" event={"ID":"d4d1b0d2-aea6-421c-91e9-f74e3b7a4c6a","Type":"ContainerStarted","Data":"f62d4b7d38d32dbf5dfc6385ecc00eeb576a07cc4e116587205b6b0be954ff6d"} Jun 12 22:22:17.893545 ip-10-0-128-134 kubenswrapper[2559]: I0612 22:22:17.893494 2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-network-diagnostics/network-check-target-c9wls" Jun 12 22:22:17.896103 ip-10-0-128-134 kubenswrapper[2559]: I0612 22:22:17.896007 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"7f938da2-ffe5-4feb-988f-22bbc35e531f","Type":"ContainerStarted","Data":"c963547e8486c32795df13ed7ed7556daab5bec95e9d840cd097a0524f16d488"} Jun 12 22:22:17.920808 ip-10-0-128-134 kubenswrapper[2559]: I0612 22:22:17.920736 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"5463e61a-cf1a-4c7e-962c-ac94781324b1","Type":"ContainerStarted","Data":"e56195491a55db22186bc95d972f0405656f15070b7d42f2136de6aa866d9e29"} Jun 12 22:22:17.925748 ip-10-0-128-134 kubenswrapper[2559]: I0612 22:22:17.925668 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-68f5fc465b-28vs9" event={"ID":"b5a8f721-d758-49b4-9967-84ed17bf40a5","Type":"ContainerStarted","Data":"3d65c1ce8679627053c224855f01bbb21ee4defc8621a795b7df78b09e19b354"} Jun 12 22:22:17.925748 ip-10-0-128-134 kubenswrapper[2559]: I0612 22:22:17.925744 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-68f5fc465b-28vs9" event={"ID":"b5a8f721-d758-49b4-9967-84ed17bf40a5","Type":"ContainerStarted","Data":"879d99f271f509cf0302709d144dc6a360a101914aef7b3108724226dde84c5e"} Jun 12 22:22:17.927366 ip-10-0-128-134 kubenswrapper[2559]: I0612 22:22:17.927246 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-zdjjt" event={"ID":"73bd91e1-b3e8-495c-990c-3ab079745247","Type":"ContainerStarted","Data":"96ae744b3c44696ceebd9e3d38d8b73dc1256c12eb6dec3164354a1c42e693d3"} Jun 12 22:22:17.928976 ip-10-0-128-134 kubenswrapper[2559]: I0612 22:22:17.928939 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-7569c88997-v8b6n" event={"ID":"440350d8-f7d7-4966-81f4-12ed1cea6334","Type":"ContainerStarted","Data":"cda0b5a0d90c4e801116b8c6c92321fde3325c8c7956bfbf2981f39b3ad26e7d"} Jun 12 22:22:17.928976 ip-10-0-128-134 kubenswrapper[2559]: I0612 22:22:17.928971 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-7569c88997-v8b6n" event={"ID":"440350d8-f7d7-4966-81f4-12ed1cea6334","Type":"ContainerStarted","Data":"00bc76c3f83b0c5f5bc1dc4e834d3a7de73080d1adde5187bbc5b15d2fb13041"} Jun 12 22:22:17.937028 ip-10-0-128-134 kubenswrapper[2559]: I0612 22:22:17.935044 2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-diagnostics/network-check-target-c9wls" podStartSLOduration=68.869572791 podStartE2EDuration="1m19.935027245s" totalImagesPullingTime="11.065454454s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-12 22:20:58 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-12 22:22:17.915285485 +0000 UTC m=+79.963655302" watchObservedRunningTime="2026-06-12 22:22:17.935027245 +0000 UTC m=+79.983397063" Jun 12 22:22:17.937028 ip-10-0-128-134 kubenswrapper[2559]: I0612 22:22:17.936087 2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/node-exporter-x7lwm" podStartSLOduration=15.214974341 podStartE2EDuration="18.936076752s" totalImagesPullingTime="3.581336021s" totalInitContainerRuntime="139.76639ms" isStatefulPod=true podCreationTimestamp="2026-06-12 22:21:59 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-12 22:22:17.934422012 +0000 UTC m=+79.982791857" watchObservedRunningTime="2026-06-12 22:22:17.936076752 +0000 UTC m=+79.984446570" Jun 12 22:22:17.963254 ip-10-0-128-134 kubenswrapper[2559]: I0612 22:22:17.963190 2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/global-pull-secret-syncer-zdjjt" podStartSLOduration=69.112878826 podStartE2EDuration="1m19.963169731s" totalImagesPullingTime="10.850290905s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-12 22:20:58 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-12 22:22:17.961862396 +0000 UTC m=+80.010232214" watchObservedRunningTime="2026-06-12 22:22:17.963169731 +0000 UTC m=+80.011539545" Jun 12 22:22:17.980716 ip-10-0-128-134 kubenswrapper[2559]: I0612 22:22:17.980495 2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-7569c88997-v8b6n" podStartSLOduration=5.980434998 podStartE2EDuration="5.980434998s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-12 22:22:12 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-12 22:22:17.97894121 +0000 UTC m=+80.027311050" watchObservedRunningTime="2026-06-12 22:22:17.980434998 +0000 UTC m=+80.028804816" Jun 12 22:22:18.935802 ip-10-0-128-134 kubenswrapper[2559]: I0612 22:22:18.935764 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"7f938da2-ffe5-4feb-988f-22bbc35e531f","Type":"ContainerStarted","Data":"bde92804a49e1037334e3fbe53bc09a6109a381182c1d66897f32f7e261d1dce"} Jun 12 22:22:18.936321 ip-10-0-128-134 kubenswrapper[2559]: I0612 22:22:18.935837 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"7f938da2-ffe5-4feb-988f-22bbc35e531f","Type":"ContainerStarted","Data":"93efbbf6f7581a4f314bfd8301608874210eeff8bb579f02eadb8baac6b0800f"} Jun 12 22:22:18.936321 ip-10-0-128-134 kubenswrapper[2559]: I0612 22:22:18.935879 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"7f938da2-ffe5-4feb-988f-22bbc35e531f","Type":"ContainerStarted","Data":"00e32bcb0aa0707cb776f6821ec7b8097e196f72126b66fab61025b5746d541f"} Jun 12 22:22:18.936321 ip-10-0-128-134 kubenswrapper[2559]: I0612 22:22:18.935916 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"7f938da2-ffe5-4feb-988f-22bbc35e531f","Type":"ContainerStarted","Data":"4299c05e286c1cc9a79799029d8eee24f3ab64c55860260d80207f2f4d89ffed"} Jun 12 22:22:18.936321 ip-10-0-128-134 kubenswrapper[2559]: I0612 22:22:18.935949 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"7f938da2-ffe5-4feb-988f-22bbc35e531f","Type":"ContainerStarted","Data":"a1f6f08ada38cf5826b49c75c834785e9f4d042c204466b996a4bfd9d73f1e69"} Jun 12 22:22:18.938846 ip-10-0-128-134 kubenswrapper[2559]: I0612 22:22:18.938822 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"5463e61a-cf1a-4c7e-962c-ac94781324b1","Type":"ContainerStarted","Data":"86d2e7337c54446660e4b07c502d069d4d753f6cb6a99da910a77d2543d0c457"} Jun 12 22:22:18.938964 ip-10-0-128-134 kubenswrapper[2559]: I0612 22:22:18.938886 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"5463e61a-cf1a-4c7e-962c-ac94781324b1","Type":"ContainerStarted","Data":"b105749579dcbf3060b6a92dc1eca3de79601b5c2771d736343e741bb562ed7b"} Jun 12 22:22:18.938964 ip-10-0-128-134 kubenswrapper[2559]: I0612 22:22:18.938930 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"5463e61a-cf1a-4c7e-962c-ac94781324b1","Type":"ContainerStarted","Data":"688db83ab4af42a9b09f3ca25456a0718419e5d793eae612b4cf9c4dbaba4d93"} Jun 12 22:22:18.939050 ip-10-0-128-134 kubenswrapper[2559]: I0612 22:22:18.938969 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"5463e61a-cf1a-4c7e-962c-ac94781324b1","Type":"ContainerStarted","Data":"d4c99b3ba4388acbaf896d6dc5dbd934c927465985472902e36ad03443452390"} Jun 12 22:22:18.939050 ip-10-0-128-134 kubenswrapper[2559]: I0612 22:22:18.939008 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"5463e61a-cf1a-4c7e-962c-ac94781324b1","Type":"ContainerStarted","Data":"2b530eddb23e9fe1da5383e4fd0829264d83eac2a9dde163a47ea5acd18d303c"} Jun 12 22:22:18.946294 ip-10-0-128-134 kubenswrapper[2559]: I0612 22:22:18.946263 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-68f5fc465b-28vs9" event={"ID":"b5a8f721-d758-49b4-9967-84ed17bf40a5","Type":"ContainerStarted","Data":"32ff9c82acbecfb8caee26acf7a5048b130199c036625d182fc68cd31222700e"} Jun 12 22:22:18.971687 ip-10-0-128-134 kubenswrapper[2559]: I0612 22:22:18.971633 2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/prometheus-k8s-0" podStartSLOduration=8.293939301 podStartE2EDuration="13.971617655s" totalImagesPullingTime="5.647720861s" totalInitContainerRuntime="29.957493ms" isStatefulPod=false podCreationTimestamp="2026-06-12 22:22:05 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-12 22:22:18.969108592 +0000 UTC m=+81.017478422" watchObservedRunningTime="2026-06-12 22:22:18.971617655 +0000 UTC m=+81.019987472" Jun 12 22:22:18.994889 ip-10-0-128-134 kubenswrapper[2559]: I0612 22:22:18.994841 2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/alertmanager-main-0" podStartSLOduration=8.637296963 podStartE2EDuration="18.994828755s" totalImagesPullingTime="10.325072305s" totalInitContainerRuntime="32.459487ms" isStatefulPod=false podCreationTimestamp="2026-06-12 22:22:00 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-12 22:22:18.992778474 +0000 UTC m=+81.041148291" watchObservedRunningTime="2026-06-12 22:22:18.994828755 +0000 UTC m=+81.043198572" Jun 12 22:22:19.018154 ip-10-0-128-134 kubenswrapper[2559]: I0612 22:22:19.018104 2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/thanos-querier-68f5fc465b-28vs9" podStartSLOduration=7.124321588 podStartE2EDuration="18.018086432s" totalImagesPullingTime="10.893764844s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-12 22:22:01 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-12 22:22:19.016151615 +0000 UTC m=+81.064521451" watchObservedRunningTime="2026-06-12 22:22:19.018086432 +0000 UTC m=+81.066456251" Jun 12 22:22:19.951532 ip-10-0-128-134 kubenswrapper[2559]: I0612 22:22:19.951493 2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/thanos-querier-68f5fc465b-28vs9" Jun 12 22:22:19.956482 ip-10-0-128-134 kubenswrapper[2559]: I0612 22:22:19.956460 2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/thanos-querier-68f5fc465b-28vs9" Jun 12 22:22:20.629098 ip-10-0-128-134 kubenswrapper[2559]: I0612 22:22:20.629064 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-f7h79_2fe08918-3efc-4000-a321-8b319ead517c/konnectivity-agent/0.log" limit=1024 Jun 12 22:22:20.684794 ip-10-0-128-134 kubenswrapper[2559]: I0612 22:22:20.684763 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-f7h79_2fe08918-3efc-4000-a321-8b319ead517c/konnectivity-agent/0.log" limit=1024 Jun 12 22:22:20.902606 ip-10-0-128-134 kubenswrapper[2559]: I0612 22:22:20.902523 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-f7h79_2fe08918-3efc-4000-a321-8b319ead517c/konnectivity-agent/0.log" limit=1024 Jun 12 22:22:20.907468 ip-10-0-128-134 kubenswrapper[2559]: I0612 22:22:20.907434 2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/prometheus-k8s-0" Jun 12 22:22:20.954330 ip-10-0-128-134 kubenswrapper[2559]: I0612 22:22:20.954293 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-f7h79_2fe08918-3efc-4000-a321-8b319ead517c/konnectivity-agent/0.log" limit=1024 Jun 12 22:22:22.869933 ip-10-0-128-134 kubenswrapper[2559]: I0612 22:22:22.869901 2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-7569c88997-v8b6n" Jun 12 22:22:22.870345 ip-10-0-128-134 kubenswrapper[2559]: I0612 22:22:22.870203 2559 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-7569c88997-v8b6n" Jun 12 22:22:22.875190 ip-10-0-128-134 kubenswrapper[2559]: I0612 22:22:22.875170 2559 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-7569c88997-v8b6n" Jun 12 22:22:22.966142 ip-10-0-128-134 kubenswrapper[2559]: I0612 22:22:22.966111 2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-7569c88997-v8b6n" Jun 12 22:22:23.125718 ip-10-0-128-134 kubenswrapper[2559]: I0612 22:22:23.125622 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-f7h79_2fe08918-3efc-4000-a321-8b319ead517c/konnectivity-agent/0.log" limit=1024 Jun 12 22:22:23.227259 ip-10-0-128-134 kubenswrapper[2559]: I0612 22:22:23.227229 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-f7h79_2fe08918-3efc-4000-a321-8b319ead517c/konnectivity-agent/0.log" limit=1024 Jun 12 22:22:23.285963 ip-10-0-128-134 kubenswrapper[2559]: I0612 22:22:23.285932 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-f7h79_2fe08918-3efc-4000-a321-8b319ead517c/konnectivity-agent/0.log" limit=1024 Jun 12 22:22:30.877241 ip-10-0-128-134 kubenswrapper[2559]: I0612 22:22:30.877181 2559 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-console/console-679bdcbb85-plxpd" podUID="df717def-ede3-47ff-9464-b993c2f6d7ae" containerName="console" containerID="cri-o://88f0b74f22ad8f0d160ec95ca68324546b748a47dfe805d33b4143c4f7131d77" gracePeriod=15 Jun 12 22:22:30.996193 ip-10-0-128-134 kubenswrapper[2559]: I0612 22:22:30.996153 2559 generic.go:356] "Generic (PLEG): container finished" podID="df717def-ede3-47ff-9464-b993c2f6d7ae" containerID="88f0b74f22ad8f0d160ec95ca68324546b748a47dfe805d33b4143c4f7131d77" exitCode=0 Jun 12 22:22:30.996342 ip-10-0-128-134 kubenswrapper[2559]: I0612 22:22:30.996222 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-679bdcbb85-plxpd" event={"ID":"df717def-ede3-47ff-9464-b993c2f6d7ae","Type":"ContainerDied","Data":"88f0b74f22ad8f0d160ec95ca68324546b748a47dfe805d33b4143c4f7131d77"} Jun 12 22:22:31.154833 ip-10-0-128-134 kubenswrapper[2559]: I0612 22:22:31.154751 2559 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-679bdcbb85-plxpd" Jun 12 22:22:31.252952 ip-10-0-128-134 kubenswrapper[2559]: I0612 22:22:31.252923 2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-dx526\" (UniqueName: \"kubernetes.io/projected/df717def-ede3-47ff-9464-b993c2f6d7ae-kube-api-access-dx526\") pod \"df717def-ede3-47ff-9464-b993c2f6d7ae\" (UID: \"df717def-ede3-47ff-9464-b993c2f6d7ae\") " Jun 12 22:22:31.253134 ip-10-0-128-134 kubenswrapper[2559]: I0612 22:22:31.252961 2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/df717def-ede3-47ff-9464-b993c2f6d7ae-console-serving-cert\") pod \"df717def-ede3-47ff-9464-b993c2f6d7ae\" (UID: \"df717def-ede3-47ff-9464-b993c2f6d7ae\") " Jun 12 22:22:31.253134 ip-10-0-128-134 kubenswrapper[2559]: I0612 22:22:31.253009 2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/df717def-ede3-47ff-9464-b993c2f6d7ae-service-ca\") pod \"df717def-ede3-47ff-9464-b993c2f6d7ae\" (UID: \"df717def-ede3-47ff-9464-b993c2f6d7ae\") " Jun 12 22:22:31.253134 ip-10-0-128-134 kubenswrapper[2559]: I0612 22:22:31.253064 2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/df717def-ede3-47ff-9464-b993c2f6d7ae-console-oauth-config\") pod \"df717def-ede3-47ff-9464-b993c2f6d7ae\" (UID: \"df717def-ede3-47ff-9464-b993c2f6d7ae\") " Jun 12 22:22:31.253134 ip-10-0-128-134 kubenswrapper[2559]: I0612 22:22:31.253090 2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/df717def-ede3-47ff-9464-b993c2f6d7ae-console-config\") pod \"df717def-ede3-47ff-9464-b993c2f6d7ae\" (UID: \"df717def-ede3-47ff-9464-b993c2f6d7ae\") " Jun 12 22:22:31.253134 ip-10-0-128-134 kubenswrapper[2559]: I0612 22:22:31.253130 2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/df717def-ede3-47ff-9464-b993c2f6d7ae-oauth-serving-cert\") pod \"df717def-ede3-47ff-9464-b993c2f6d7ae\" (UID: \"df717def-ede3-47ff-9464-b993c2f6d7ae\") " Jun 12 22:22:31.253529 ip-10-0-128-134 kubenswrapper[2559]: I0612 22:22:31.253494 2559 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/df717def-ede3-47ff-9464-b993c2f6d7ae-service-ca" (OuterVolumeSpecName: "service-ca") pod "df717def-ede3-47ff-9464-b993c2f6d7ae" (UID: "df717def-ede3-47ff-9464-b993c2f6d7ae"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 12 22:22:31.253658 ip-10-0-128-134 kubenswrapper[2559]: I0612 22:22:31.253562 2559 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/df717def-ede3-47ff-9464-b993c2f6d7ae-console-config" (OuterVolumeSpecName: "console-config") pod "df717def-ede3-47ff-9464-b993c2f6d7ae" (UID: "df717def-ede3-47ff-9464-b993c2f6d7ae"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 12 22:22:31.253658 ip-10-0-128-134 kubenswrapper[2559]: I0612 22:22:31.253589 2559 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/df717def-ede3-47ff-9464-b993c2f6d7ae-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "df717def-ede3-47ff-9464-b993c2f6d7ae" (UID: "df717def-ede3-47ff-9464-b993c2f6d7ae"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 12 22:22:31.255537 ip-10-0-128-134 kubenswrapper[2559]: I0612 22:22:31.255498 2559 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/df717def-ede3-47ff-9464-b993c2f6d7ae-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "df717def-ede3-47ff-9464-b993c2f6d7ae" (UID: "df717def-ede3-47ff-9464-b993c2f6d7ae"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 12 22:22:31.255843 ip-10-0-128-134 kubenswrapper[2559]: I0612 22:22:31.255817 2559 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/df717def-ede3-47ff-9464-b993c2f6d7ae-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "df717def-ede3-47ff-9464-b993c2f6d7ae" (UID: "df717def-ede3-47ff-9464-b993c2f6d7ae"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 12 22:22:31.255933 ip-10-0-128-134 kubenswrapper[2559]: I0612 22:22:31.255868 2559 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/df717def-ede3-47ff-9464-b993c2f6d7ae-kube-api-access-dx526" (OuterVolumeSpecName: "kube-api-access-dx526") pod "df717def-ede3-47ff-9464-b993c2f6d7ae" (UID: "df717def-ede3-47ff-9464-b993c2f6d7ae"). InnerVolumeSpecName "kube-api-access-dx526". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 12 22:22:31.354152 ip-10-0-128-134 kubenswrapper[2559]: I0612 22:22:31.354114 2559 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/df717def-ede3-47ff-9464-b993c2f6d7ae-service-ca\") on node \"ip-10-0-128-134.ec2.internal\" DevicePath \"\"" Jun 12 22:22:31.354152 ip-10-0-128-134 kubenswrapper[2559]: I0612 22:22:31.354146 2559 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/df717def-ede3-47ff-9464-b993c2f6d7ae-console-oauth-config\") on node \"ip-10-0-128-134.ec2.internal\" DevicePath \"\"" Jun 12 22:22:31.354152 ip-10-0-128-134 kubenswrapper[2559]: I0612 22:22:31.354155 2559 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/df717def-ede3-47ff-9464-b993c2f6d7ae-console-config\") on node \"ip-10-0-128-134.ec2.internal\" DevicePath \"\"" Jun 12 22:22:31.354379 ip-10-0-128-134 kubenswrapper[2559]: I0612 22:22:31.354166 2559 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/df717def-ede3-47ff-9464-b993c2f6d7ae-oauth-serving-cert\") on node \"ip-10-0-128-134.ec2.internal\" DevicePath \"\"" Jun 12 22:22:31.354379 ip-10-0-128-134 kubenswrapper[2559]: I0612 22:22:31.354175 2559 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-dx526\" (UniqueName: \"kubernetes.io/projected/df717def-ede3-47ff-9464-b993c2f6d7ae-kube-api-access-dx526\") on node \"ip-10-0-128-134.ec2.internal\" DevicePath \"\"" Jun 12 22:22:31.354379 ip-10-0-128-134 kubenswrapper[2559]: I0612 22:22:31.354183 2559 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/df717def-ede3-47ff-9464-b993c2f6d7ae-console-serving-cert\") on node \"ip-10-0-128-134.ec2.internal\" DevicePath \"\"" Jun 12 22:22:32.001917 ip-10-0-128-134 kubenswrapper[2559]: I0612 22:22:32.001882 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-679bdcbb85-plxpd" event={"ID":"df717def-ede3-47ff-9464-b993c2f6d7ae","Type":"ContainerDied","Data":"560a272e91a6986def4047559e7ab0df4a1ac44c059233493b0209a808fd10af"} Jun 12 22:22:32.001917 ip-10-0-128-134 kubenswrapper[2559]: I0612 22:22:32.001904 2559 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-679bdcbb85-plxpd" Jun 12 22:22:32.002402 ip-10-0-128-134 kubenswrapper[2559]: I0612 22:22:32.001941 2559 scope.go:117] "RemoveContainer" containerID="88f0b74f22ad8f0d160ec95ca68324546b748a47dfe805d33b4143c4f7131d77" Jun 12 22:22:32.022707 ip-10-0-128-134 kubenswrapper[2559]: I0612 22:22:32.022677 2559 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-679bdcbb85-plxpd"] Jun 12 22:22:32.026546 ip-10-0-128-134 kubenswrapper[2559]: I0612 22:22:32.026522 2559 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-679bdcbb85-plxpd"] Jun 12 22:22:32.409417 ip-10-0-128-134 kubenswrapper[2559]: I0612 22:22:32.409383 2559 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="df717def-ede3-47ff-9464-b993c2f6d7ae" path="/var/lib/kubelet/pods/df717def-ede3-47ff-9464-b993c2f6d7ae/volumes" Jun 12 22:22:43.128162 ip-10-0-128-134 kubenswrapper[2559]: I0612 22:22:43.128123 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-f7h79_2fe08918-3efc-4000-a321-8b319ead517c/konnectivity-agent/0.log" limit=1024 Jun 12 22:22:43.228860 ip-10-0-128-134 kubenswrapper[2559]: I0612 22:22:43.228828 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-f7h79_2fe08918-3efc-4000-a321-8b319ead517c/konnectivity-agent/0.log" limit=1024 Jun 12 22:22:43.285814 ip-10-0-128-134 kubenswrapper[2559]: I0612 22:22:43.285783 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-f7h79_2fe08918-3efc-4000-a321-8b319ead517c/konnectivity-agent/0.log" limit=1024 Jun 12 22:22:49.953943 ip-10-0-128-134 kubenswrapper[2559]: I0612 22:22:49.953915 2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-network-diagnostics/network-check-target-c9wls" Jun 12 22:23:05.907772 ip-10-0-128-134 kubenswrapper[2559]: I0612 22:23:05.907727 2559 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-monitoring/prometheus-k8s-0" Jun 12 22:23:05.928608 ip-10-0-128-134 kubenswrapper[2559]: I0612 22:23:05.928575 2559 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-monitoring/prometheus-k8s-0" Jun 12 22:23:06.148158 ip-10-0-128-134 kubenswrapper[2559]: I0612 22:23:06.148132 2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/prometheus-k8s-0" Jun 12 22:23:15.178282 ip-10-0-128-134 kubenswrapper[2559]: I0612 22:23:15.178242 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-f7h79_2fe08918-3efc-4000-a321-8b319ead517c/konnectivity-agent/0.log" limit=1024 Jun 12 22:23:15.229968 ip-10-0-128-134 kubenswrapper[2559]: I0612 22:23:15.229935 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-f7h79_2fe08918-3efc-4000-a321-8b319ead517c/konnectivity-agent/0.log" limit=1024 Jun 12 22:23:16.333187 ip-10-0-128-134 kubenswrapper[2559]: I0612 22:23:16.333146 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-f7h79_2fe08918-3efc-4000-a321-8b319ead517c/konnectivity-agent/0.log" limit=1024 Jun 12 22:23:16.384620 ip-10-0-128-134 kubenswrapper[2559]: I0612 22:23:16.384586 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-f7h79_2fe08918-3efc-4000-a321-8b319ead517c/konnectivity-agent/0.log" limit=1024 Jun 12 22:23:19.426334 ip-10-0-128-134 kubenswrapper[2559]: I0612 22:23:19.426298 2559 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Jun 12 22:23:19.426854 ip-10-0-128-134 kubenswrapper[2559]: I0612 22:23:19.426652 2559 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="5463e61a-cf1a-4c7e-962c-ac94781324b1" containerName="alertmanager" containerID="cri-o://e56195491a55db22186bc95d972f0405656f15070b7d42f2136de6aa866d9e29" gracePeriod=120 Jun 12 22:23:19.426854 ip-10-0-128-134 kubenswrapper[2559]: I0612 22:23:19.426732 2559 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="5463e61a-cf1a-4c7e-962c-ac94781324b1" containerName="kube-rbac-proxy-metric" containerID="cri-o://b105749579dcbf3060b6a92dc1eca3de79601b5c2771d736343e741bb562ed7b" gracePeriod=120 Jun 12 22:23:19.426854 ip-10-0-128-134 kubenswrapper[2559]: I0612 22:23:19.426762 2559 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="5463e61a-cf1a-4c7e-962c-ac94781324b1" containerName="prom-label-proxy" containerID="cri-o://86d2e7337c54446660e4b07c502d069d4d753f6cb6a99da910a77d2543d0c457" gracePeriod=120 Jun 12 22:23:19.426854 ip-10-0-128-134 kubenswrapper[2559]: I0612 22:23:19.426775 2559 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="5463e61a-cf1a-4c7e-962c-ac94781324b1" containerName="kube-rbac-proxy-web" containerID="cri-o://d4c99b3ba4388acbaf896d6dc5dbd934c927465985472902e36ad03443452390" gracePeriod=120 Jun 12 22:23:19.426854 ip-10-0-128-134 kubenswrapper[2559]: I0612 22:23:19.426793 2559 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="5463e61a-cf1a-4c7e-962c-ac94781324b1" containerName="kube-rbac-proxy" containerID="cri-o://688db83ab4af42a9b09f3ca25456a0718419e5d793eae612b4cf9c4dbaba4d93" gracePeriod=120 Jun 12 22:23:19.427113 ip-10-0-128-134 kubenswrapper[2559]: I0612 22:23:19.426798 2559 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="5463e61a-cf1a-4c7e-962c-ac94781324b1" containerName="config-reloader" containerID="cri-o://2b530eddb23e9fe1da5383e4fd0829264d83eac2a9dde163a47ea5acd18d303c" gracePeriod=120 Jun 12 22:23:20.186031 ip-10-0-128-134 kubenswrapper[2559]: I0612 22:23:20.186000 2559 generic.go:356] "Generic (PLEG): container finished" podID="5463e61a-cf1a-4c7e-962c-ac94781324b1" containerID="86d2e7337c54446660e4b07c502d069d4d753f6cb6a99da910a77d2543d0c457" exitCode=0 Jun 12 22:23:20.186031 ip-10-0-128-134 kubenswrapper[2559]: I0612 22:23:20.186025 2559 generic.go:356] "Generic (PLEG): container finished" podID="5463e61a-cf1a-4c7e-962c-ac94781324b1" containerID="688db83ab4af42a9b09f3ca25456a0718419e5d793eae612b4cf9c4dbaba4d93" exitCode=0 Jun 12 22:23:20.186031 ip-10-0-128-134 kubenswrapper[2559]: I0612 22:23:20.186031 2559 generic.go:356] "Generic (PLEG): container finished" podID="5463e61a-cf1a-4c7e-962c-ac94781324b1" containerID="2b530eddb23e9fe1da5383e4fd0829264d83eac2a9dde163a47ea5acd18d303c" exitCode=0 Jun 12 22:23:20.186031 ip-10-0-128-134 kubenswrapper[2559]: I0612 22:23:20.186037 2559 generic.go:356] "Generic (PLEG): container finished" podID="5463e61a-cf1a-4c7e-962c-ac94781324b1" containerID="e56195491a55db22186bc95d972f0405656f15070b7d42f2136de6aa866d9e29" exitCode=0 Jun 12 22:23:20.186303 ip-10-0-128-134 kubenswrapper[2559]: I0612 22:23:20.186079 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"5463e61a-cf1a-4c7e-962c-ac94781324b1","Type":"ContainerDied","Data":"86d2e7337c54446660e4b07c502d069d4d753f6cb6a99da910a77d2543d0c457"} Jun 12 22:23:20.186303 ip-10-0-128-134 kubenswrapper[2559]: I0612 22:23:20.186158 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"5463e61a-cf1a-4c7e-962c-ac94781324b1","Type":"ContainerDied","Data":"688db83ab4af42a9b09f3ca25456a0718419e5d793eae612b4cf9c4dbaba4d93"} Jun 12 22:23:20.186303 ip-10-0-128-134 kubenswrapper[2559]: I0612 22:23:20.186187 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"5463e61a-cf1a-4c7e-962c-ac94781324b1","Type":"ContainerDied","Data":"2b530eddb23e9fe1da5383e4fd0829264d83eac2a9dde163a47ea5acd18d303c"} Jun 12 22:23:20.186303 ip-10-0-128-134 kubenswrapper[2559]: I0612 22:23:20.186210 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"5463e61a-cf1a-4c7e-962c-ac94781324b1","Type":"ContainerDied","Data":"e56195491a55db22186bc95d972f0405656f15070b7d42f2136de6aa866d9e29"} Jun 12 22:23:20.669891 ip-10-0-128-134 kubenswrapper[2559]: I0612 22:23:20.669867 2559 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0" Jun 12 22:23:20.788555 ip-10-0-128-134 kubenswrapper[2559]: I0612 22:23:20.788432 2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/5463e61a-cf1a-4c7e-962c-ac94781324b1-alertmanager-main-db\") pod \"5463e61a-cf1a-4c7e-962c-ac94781324b1\" (UID: \"5463e61a-cf1a-4c7e-962c-ac94781324b1\") " Jun 12 22:23:20.788555 ip-10-0-128-134 kubenswrapper[2559]: I0612 22:23:20.788527 2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/5463e61a-cf1a-4c7e-962c-ac94781324b1-web-config\") pod \"5463e61a-cf1a-4c7e-962c-ac94781324b1\" (UID: \"5463e61a-cf1a-4c7e-962c-ac94781324b1\") " Jun 12 22:23:20.788555 ip-10-0-128-134 kubenswrapper[2559]: I0612 22:23:20.788546 2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-zksws\" (UniqueName: \"kubernetes.io/projected/5463e61a-cf1a-4c7e-962c-ac94781324b1-kube-api-access-zksws\") pod \"5463e61a-cf1a-4c7e-962c-ac94781324b1\" (UID: \"5463e61a-cf1a-4c7e-962c-ac94781324b1\") " Jun 12 22:23:20.788843 ip-10-0-128-134 kubenswrapper[2559]: I0612 22:23:20.788571 2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/5463e61a-cf1a-4c7e-962c-ac94781324b1-alertmanager-trusted-ca-bundle\") pod \"5463e61a-cf1a-4c7e-962c-ac94781324b1\" (UID: \"5463e61a-cf1a-4c7e-962c-ac94781324b1\") " Jun 12 22:23:20.788843 ip-10-0-128-134 kubenswrapper[2559]: I0612 22:23:20.788601 2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/5463e61a-cf1a-4c7e-962c-ac94781324b1-secret-alertmanager-kube-rbac-proxy-metric\") pod \"5463e61a-cf1a-4c7e-962c-ac94781324b1\" (UID: \"5463e61a-cf1a-4c7e-962c-ac94781324b1\") " Jun 12 22:23:20.788843 ip-10-0-128-134 kubenswrapper[2559]: I0612 22:23:20.788619 2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/5463e61a-cf1a-4c7e-962c-ac94781324b1-config-out\") pod \"5463e61a-cf1a-4c7e-962c-ac94781324b1\" (UID: \"5463e61a-cf1a-4c7e-962c-ac94781324b1\") " Jun 12 22:23:20.788843 ip-10-0-128-134 kubenswrapper[2559]: I0612 22:23:20.788682 2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/5463e61a-cf1a-4c7e-962c-ac94781324b1-secret-alertmanager-main-tls\") pod \"5463e61a-cf1a-4c7e-962c-ac94781324b1\" (UID: \"5463e61a-cf1a-4c7e-962c-ac94781324b1\") " Jun 12 22:23:20.788843 ip-10-0-128-134 kubenswrapper[2559]: I0612 22:23:20.788707 2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/5463e61a-cf1a-4c7e-962c-ac94781324b1-secret-alertmanager-kube-rbac-proxy\") pod \"5463e61a-cf1a-4c7e-962c-ac94781324b1\" (UID: \"5463e61a-cf1a-4c7e-962c-ac94781324b1\") " Jun 12 22:23:20.788843 ip-10-0-128-134 kubenswrapper[2559]: I0612 22:23:20.788747 2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/5463e61a-cf1a-4c7e-962c-ac94781324b1-metrics-client-ca\") pod \"5463e61a-cf1a-4c7e-962c-ac94781324b1\" (UID: \"5463e61a-cf1a-4c7e-962c-ac94781324b1\") " Jun 12 22:23:20.788843 ip-10-0-128-134 kubenswrapper[2559]: I0612 22:23:20.788771 2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/5463e61a-cf1a-4c7e-962c-ac94781324b1-secret-alertmanager-kube-rbac-proxy-web\") pod \"5463e61a-cf1a-4c7e-962c-ac94781324b1\" (UID: \"5463e61a-cf1a-4c7e-962c-ac94781324b1\") " Jun 12 22:23:20.788843 ip-10-0-128-134 kubenswrapper[2559]: I0612 22:23:20.788786 2559 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/5463e61a-cf1a-4c7e-962c-ac94781324b1-alertmanager-main-db" (OuterVolumeSpecName: "alertmanager-main-db") pod "5463e61a-cf1a-4c7e-962c-ac94781324b1" (UID: "5463e61a-cf1a-4c7e-962c-ac94781324b1"). InnerVolumeSpecName "alertmanager-main-db". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 12 22:23:20.788843 ip-10-0-128-134 kubenswrapper[2559]: I0612 22:23:20.788805 2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/5463e61a-cf1a-4c7e-962c-ac94781324b1-cluster-tls-config\") pod \"5463e61a-cf1a-4c7e-962c-ac94781324b1\" (UID: \"5463e61a-cf1a-4c7e-962c-ac94781324b1\") " Jun 12 22:23:20.788843 ip-10-0-128-134 kubenswrapper[2559]: I0612 22:23:20.788830 2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/5463e61a-cf1a-4c7e-962c-ac94781324b1-config-volume\") pod \"5463e61a-cf1a-4c7e-962c-ac94781324b1\" (UID: \"5463e61a-cf1a-4c7e-962c-ac94781324b1\") " Jun 12 22:23:20.789342 ip-10-0-128-134 kubenswrapper[2559]: I0612 22:23:20.788852 2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/5463e61a-cf1a-4c7e-962c-ac94781324b1-tls-assets\") pod \"5463e61a-cf1a-4c7e-962c-ac94781324b1\" (UID: \"5463e61a-cf1a-4c7e-962c-ac94781324b1\") " Jun 12 22:23:20.789342 ip-10-0-128-134 kubenswrapper[2559]: I0612 22:23:20.789100 2559 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/5463e61a-cf1a-4c7e-962c-ac94781324b1-alertmanager-trusted-ca-bundle" (OuterVolumeSpecName: "alertmanager-trusted-ca-bundle") pod "5463e61a-cf1a-4c7e-962c-ac94781324b1" (UID: "5463e61a-cf1a-4c7e-962c-ac94781324b1"). InnerVolumeSpecName "alertmanager-trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 12 22:23:20.789342 ip-10-0-128-134 kubenswrapper[2559]: I0612 22:23:20.789122 2559 reconciler_common.go:299] "Volume detached for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/5463e61a-cf1a-4c7e-962c-ac94781324b1-alertmanager-main-db\") on node \"ip-10-0-128-134.ec2.internal\" DevicePath \"\"" Jun 12 22:23:20.789342 ip-10-0-128-134 kubenswrapper[2559]: I0612 22:23:20.789131 2559 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/5463e61a-cf1a-4c7e-962c-ac94781324b1-metrics-client-ca" (OuterVolumeSpecName: "metrics-client-ca") pod "5463e61a-cf1a-4c7e-962c-ac94781324b1" (UID: "5463e61a-cf1a-4c7e-962c-ac94781324b1"). InnerVolumeSpecName "metrics-client-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 12 22:23:20.791945 ip-10-0-128-134 kubenswrapper[2559]: I0612 22:23:20.791909 2559 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/5463e61a-cf1a-4c7e-962c-ac94781324b1-kube-api-access-zksws" (OuterVolumeSpecName: "kube-api-access-zksws") pod "5463e61a-cf1a-4c7e-962c-ac94781324b1" (UID: "5463e61a-cf1a-4c7e-962c-ac94781324b1"). InnerVolumeSpecName "kube-api-access-zksws". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 12 22:23:20.792078 ip-10-0-128-134 kubenswrapper[2559]: I0612 22:23:20.791977 2559 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/5463e61a-cf1a-4c7e-962c-ac94781324b1-secret-alertmanager-main-tls" (OuterVolumeSpecName: "secret-alertmanager-main-tls") pod "5463e61a-cf1a-4c7e-962c-ac94781324b1" (UID: "5463e61a-cf1a-4c7e-962c-ac94781324b1"). InnerVolumeSpecName "secret-alertmanager-main-tls". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 12 22:23:20.792078 ip-10-0-128-134 kubenswrapper[2559]: I0612 22:23:20.791999 2559 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/5463e61a-cf1a-4c7e-962c-ac94781324b1-tls-assets" (OuterVolumeSpecName: "tls-assets") pod "5463e61a-cf1a-4c7e-962c-ac94781324b1" (UID: "5463e61a-cf1a-4c7e-962c-ac94781324b1"). InnerVolumeSpecName "tls-assets". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 12 22:23:20.792186 ip-10-0-128-134 kubenswrapper[2559]: I0612 22:23:20.792135 2559 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/5463e61a-cf1a-4c7e-962c-ac94781324b1-secret-alertmanager-kube-rbac-proxy-metric" (OuterVolumeSpecName: "secret-alertmanager-kube-rbac-proxy-metric") pod "5463e61a-cf1a-4c7e-962c-ac94781324b1" (UID: "5463e61a-cf1a-4c7e-962c-ac94781324b1"). InnerVolumeSpecName "secret-alertmanager-kube-rbac-proxy-metric". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 12 22:23:20.792239 ip-10-0-128-134 kubenswrapper[2559]: I0612 22:23:20.792220 2559 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/5463e61a-cf1a-4c7e-962c-ac94781324b1-secret-alertmanager-kube-rbac-proxy" (OuterVolumeSpecName: "secret-alertmanager-kube-rbac-proxy") pod "5463e61a-cf1a-4c7e-962c-ac94781324b1" (UID: "5463e61a-cf1a-4c7e-962c-ac94781324b1"). InnerVolumeSpecName "secret-alertmanager-kube-rbac-proxy". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 12 22:23:20.793781 ip-10-0-128-134 kubenswrapper[2559]: I0612 22:23:20.793757 2559 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/5463e61a-cf1a-4c7e-962c-ac94781324b1-config-out" (OuterVolumeSpecName: "config-out") pod "5463e61a-cf1a-4c7e-962c-ac94781324b1" (UID: "5463e61a-cf1a-4c7e-962c-ac94781324b1"). InnerVolumeSpecName "config-out". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 12 22:23:20.794460 ip-10-0-128-134 kubenswrapper[2559]: I0612 22:23:20.794423 2559 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/5463e61a-cf1a-4c7e-962c-ac94781324b1-config-volume" (OuterVolumeSpecName: "config-volume") pod "5463e61a-cf1a-4c7e-962c-ac94781324b1" (UID: "5463e61a-cf1a-4c7e-962c-ac94781324b1"). InnerVolumeSpecName "config-volume". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 12 22:23:20.794538 ip-10-0-128-134 kubenswrapper[2559]: I0612 22:23:20.794514 2559 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/5463e61a-cf1a-4c7e-962c-ac94781324b1-secret-alertmanager-kube-rbac-proxy-web" (OuterVolumeSpecName: "secret-alertmanager-kube-rbac-proxy-web") pod "5463e61a-cf1a-4c7e-962c-ac94781324b1" (UID: "5463e61a-cf1a-4c7e-962c-ac94781324b1"). InnerVolumeSpecName "secret-alertmanager-kube-rbac-proxy-web". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 12 22:23:20.796911 ip-10-0-128-134 kubenswrapper[2559]: I0612 22:23:20.796781 2559 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/5463e61a-cf1a-4c7e-962c-ac94781324b1-cluster-tls-config" (OuterVolumeSpecName: "cluster-tls-config") pod "5463e61a-cf1a-4c7e-962c-ac94781324b1" (UID: "5463e61a-cf1a-4c7e-962c-ac94781324b1"). InnerVolumeSpecName "cluster-tls-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 12 22:23:20.803062 ip-10-0-128-134 kubenswrapper[2559]: I0612 22:23:20.803038 2559 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/5463e61a-cf1a-4c7e-962c-ac94781324b1-web-config" (OuterVolumeSpecName: "web-config") pod "5463e61a-cf1a-4c7e-962c-ac94781324b1" (UID: "5463e61a-cf1a-4c7e-962c-ac94781324b1"). InnerVolumeSpecName "web-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 12 22:23:20.889793 ip-10-0-128-134 kubenswrapper[2559]: I0612 22:23:20.889755 2559 reconciler_common.go:299] "Volume detached for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/5463e61a-cf1a-4c7e-962c-ac94781324b1-web-config\") on node \"ip-10-0-128-134.ec2.internal\" DevicePath \"\"" Jun 12 22:23:20.889793 ip-10-0-128-134 kubenswrapper[2559]: I0612 22:23:20.889789 2559 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-zksws\" (UniqueName: \"kubernetes.io/projected/5463e61a-cf1a-4c7e-962c-ac94781324b1-kube-api-access-zksws\") on node \"ip-10-0-128-134.ec2.internal\" DevicePath \"\"" Jun 12 22:23:20.889793 ip-10-0-128-134 kubenswrapper[2559]: I0612 22:23:20.889799 2559 reconciler_common.go:299] "Volume detached for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/5463e61a-cf1a-4c7e-962c-ac94781324b1-alertmanager-trusted-ca-bundle\") on node \"ip-10-0-128-134.ec2.internal\" DevicePath \"\"" Jun 12 22:23:20.890015 ip-10-0-128-134 kubenswrapper[2559]: I0612 22:23:20.889812 2559 reconciler_common.go:299] "Volume detached for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/5463e61a-cf1a-4c7e-962c-ac94781324b1-secret-alertmanager-kube-rbac-proxy-metric\") on node \"ip-10-0-128-134.ec2.internal\" DevicePath \"\"" Jun 12 22:23:20.890015 ip-10-0-128-134 kubenswrapper[2559]: I0612 22:23:20.889824 2559 reconciler_common.go:299] "Volume detached for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/5463e61a-cf1a-4c7e-962c-ac94781324b1-config-out\") on node \"ip-10-0-128-134.ec2.internal\" DevicePath \"\"" Jun 12 22:23:20.890015 ip-10-0-128-134 kubenswrapper[2559]: I0612 22:23:20.889833 2559 reconciler_common.go:299] "Volume detached for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/5463e61a-cf1a-4c7e-962c-ac94781324b1-secret-alertmanager-main-tls\") on node \"ip-10-0-128-134.ec2.internal\" DevicePath \"\"" Jun 12 22:23:20.890015 ip-10-0-128-134 kubenswrapper[2559]: I0612 22:23:20.889840 2559 reconciler_common.go:299] "Volume detached for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/5463e61a-cf1a-4c7e-962c-ac94781324b1-secret-alertmanager-kube-rbac-proxy\") on node \"ip-10-0-128-134.ec2.internal\" DevicePath \"\"" Jun 12 22:23:20.890015 ip-10-0-128-134 kubenswrapper[2559]: I0612 22:23:20.889849 2559 reconciler_common.go:299] "Volume detached for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/5463e61a-cf1a-4c7e-962c-ac94781324b1-metrics-client-ca\") on node \"ip-10-0-128-134.ec2.internal\" DevicePath \"\"" Jun 12 22:23:20.890015 ip-10-0-128-134 kubenswrapper[2559]: I0612 22:23:20.889857 2559 reconciler_common.go:299] "Volume detached for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/5463e61a-cf1a-4c7e-962c-ac94781324b1-secret-alertmanager-kube-rbac-proxy-web\") on node \"ip-10-0-128-134.ec2.internal\" DevicePath \"\"" Jun 12 22:23:20.890015 ip-10-0-128-134 kubenswrapper[2559]: I0612 22:23:20.889865 2559 reconciler_common.go:299] "Volume detached for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/5463e61a-cf1a-4c7e-962c-ac94781324b1-cluster-tls-config\") on node \"ip-10-0-128-134.ec2.internal\" DevicePath \"\"" Jun 12 22:23:20.890015 ip-10-0-128-134 kubenswrapper[2559]: I0612 22:23:20.889873 2559 reconciler_common.go:299] "Volume detached for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/5463e61a-cf1a-4c7e-962c-ac94781324b1-config-volume\") on node \"ip-10-0-128-134.ec2.internal\" DevicePath \"\"" Jun 12 22:23:20.890015 ip-10-0-128-134 kubenswrapper[2559]: I0612 22:23:20.889881 2559 reconciler_common.go:299] "Volume detached for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/5463e61a-cf1a-4c7e-962c-ac94781324b1-tls-assets\") on node \"ip-10-0-128-134.ec2.internal\" DevicePath \"\"" Jun 12 22:23:21.193312 ip-10-0-128-134 kubenswrapper[2559]: I0612 22:23:21.193283 2559 generic.go:356] "Generic (PLEG): container finished" podID="5463e61a-cf1a-4c7e-962c-ac94781324b1" containerID="b105749579dcbf3060b6a92dc1eca3de79601b5c2771d736343e741bb562ed7b" exitCode=0 Jun 12 22:23:21.193312 ip-10-0-128-134 kubenswrapper[2559]: I0612 22:23:21.193309 2559 generic.go:356] "Generic (PLEG): container finished" podID="5463e61a-cf1a-4c7e-962c-ac94781324b1" containerID="d4c99b3ba4388acbaf896d6dc5dbd934c927465985472902e36ad03443452390" exitCode=0 Jun 12 22:23:21.193545 ip-10-0-128-134 kubenswrapper[2559]: I0612 22:23:21.193373 2559 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0" Jun 12 22:23:21.193545 ip-10-0-128-134 kubenswrapper[2559]: I0612 22:23:21.193367 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"5463e61a-cf1a-4c7e-962c-ac94781324b1","Type":"ContainerDied","Data":"b105749579dcbf3060b6a92dc1eca3de79601b5c2771d736343e741bb562ed7b"} Jun 12 22:23:21.193545 ip-10-0-128-134 kubenswrapper[2559]: I0612 22:23:21.193537 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"5463e61a-cf1a-4c7e-962c-ac94781324b1","Type":"ContainerDied","Data":"d4c99b3ba4388acbaf896d6dc5dbd934c927465985472902e36ad03443452390"} Jun 12 22:23:21.193651 ip-10-0-128-134 kubenswrapper[2559]: I0612 22:23:21.193567 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"5463e61a-cf1a-4c7e-962c-ac94781324b1","Type":"ContainerDied","Data":"69553d3198620292a14d58c3d2770f34debd8de3fc5a1e94528b5fb87bf4caed"} Jun 12 22:23:21.193651 ip-10-0-128-134 kubenswrapper[2559]: I0612 22:23:21.193599 2559 scope.go:117] "RemoveContainer" containerID="86d2e7337c54446660e4b07c502d069d4d753f6cb6a99da910a77d2543d0c457" Jun 12 22:23:21.201374 ip-10-0-128-134 kubenswrapper[2559]: I0612 22:23:21.201355 2559 scope.go:117] "RemoveContainer" containerID="b105749579dcbf3060b6a92dc1eca3de79601b5c2771d736343e741bb562ed7b" Jun 12 22:23:21.208294 ip-10-0-128-134 kubenswrapper[2559]: I0612 22:23:21.208280 2559 scope.go:117] "RemoveContainer" containerID="688db83ab4af42a9b09f3ca25456a0718419e5d793eae612b4cf9c4dbaba4d93" Jun 12 22:23:21.215029 ip-10-0-128-134 kubenswrapper[2559]: I0612 22:23:21.215009 2559 scope.go:117] "RemoveContainer" containerID="d4c99b3ba4388acbaf896d6dc5dbd934c927465985472902e36ad03443452390" Jun 12 22:23:21.217057 ip-10-0-128-134 kubenswrapper[2559]: I0612 22:23:21.217032 2559 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Jun 12 22:23:21.221494 ip-10-0-128-134 kubenswrapper[2559]: I0612 22:23:21.221470 2559 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Jun 12 22:23:21.223392 ip-10-0-128-134 kubenswrapper[2559]: I0612 22:23:21.223375 2559 scope.go:117] "RemoveContainer" containerID="2b530eddb23e9fe1da5383e4fd0829264d83eac2a9dde163a47ea5acd18d303c" Jun 12 22:23:21.230343 ip-10-0-128-134 kubenswrapper[2559]: I0612 22:23:21.230326 2559 scope.go:117] "RemoveContainer" containerID="e56195491a55db22186bc95d972f0405656f15070b7d42f2136de6aa866d9e29" Jun 12 22:23:21.237388 ip-10-0-128-134 kubenswrapper[2559]: I0612 22:23:21.237356 2559 scope.go:117] "RemoveContainer" containerID="821e1e465ae571c4090a1b3dd8cb87453556d570019963ac9f0ec9630df9e8f3" Jun 12 22:23:21.245214 ip-10-0-128-134 kubenswrapper[2559]: I0612 22:23:21.245191 2559 scope.go:117] "RemoveContainer" containerID="86d2e7337c54446660e4b07c502d069d4d753f6cb6a99da910a77d2543d0c457" Jun 12 22:23:21.245926 ip-10-0-128-134 kubenswrapper[2559]: E0612 22:23:21.245765 2559 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"86d2e7337c54446660e4b07c502d069d4d753f6cb6a99da910a77d2543d0c457\": container with ID starting with 86d2e7337c54446660e4b07c502d069d4d753f6cb6a99da910a77d2543d0c457 not found: ID does not exist" containerID="86d2e7337c54446660e4b07c502d069d4d753f6cb6a99da910a77d2543d0c457" Jun 12 22:23:21.245926 ip-10-0-128-134 kubenswrapper[2559]: I0612 22:23:21.245807 2559 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"86d2e7337c54446660e4b07c502d069d4d753f6cb6a99da910a77d2543d0c457"} err="failed to get container status \"86d2e7337c54446660e4b07c502d069d4d753f6cb6a99da910a77d2543d0c457\": rpc error: code = NotFound desc = could not find container \"86d2e7337c54446660e4b07c502d069d4d753f6cb6a99da910a77d2543d0c457\": container with ID starting with 86d2e7337c54446660e4b07c502d069d4d753f6cb6a99da910a77d2543d0c457 not found: ID does not exist" Jun 12 22:23:21.245926 ip-10-0-128-134 kubenswrapper[2559]: I0612 22:23:21.245851 2559 scope.go:117] "RemoveContainer" containerID="b105749579dcbf3060b6a92dc1eca3de79601b5c2771d736343e741bb562ed7b" Jun 12 22:23:21.246257 ip-10-0-128-134 kubenswrapper[2559]: E0612 22:23:21.246130 2559 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"b105749579dcbf3060b6a92dc1eca3de79601b5c2771d736343e741bb562ed7b\": container with ID starting with b105749579dcbf3060b6a92dc1eca3de79601b5c2771d736343e741bb562ed7b not found: ID does not exist" containerID="b105749579dcbf3060b6a92dc1eca3de79601b5c2771d736343e741bb562ed7b" Jun 12 22:23:21.246257 ip-10-0-128-134 kubenswrapper[2559]: I0612 22:23:21.246169 2559 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"b105749579dcbf3060b6a92dc1eca3de79601b5c2771d736343e741bb562ed7b"} err="failed to get container status \"b105749579dcbf3060b6a92dc1eca3de79601b5c2771d736343e741bb562ed7b\": rpc error: code = NotFound desc = could not find container \"b105749579dcbf3060b6a92dc1eca3de79601b5c2771d736343e741bb562ed7b\": container with ID starting with b105749579dcbf3060b6a92dc1eca3de79601b5c2771d736343e741bb562ed7b not found: ID does not exist" Jun 12 22:23:21.246257 ip-10-0-128-134 kubenswrapper[2559]: I0612 22:23:21.246216 2559 scope.go:117] "RemoveContainer" containerID="688db83ab4af42a9b09f3ca25456a0718419e5d793eae612b4cf9c4dbaba4d93" Jun 12 22:23:21.246586 ip-10-0-128-134 kubenswrapper[2559]: E0612 22:23:21.246563 2559 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"688db83ab4af42a9b09f3ca25456a0718419e5d793eae612b4cf9c4dbaba4d93\": container with ID starting with 688db83ab4af42a9b09f3ca25456a0718419e5d793eae612b4cf9c4dbaba4d93 not found: ID does not exist" containerID="688db83ab4af42a9b09f3ca25456a0718419e5d793eae612b4cf9c4dbaba4d93" Jun 12 22:23:21.246691 ip-10-0-128-134 kubenswrapper[2559]: I0612 22:23:21.246597 2559 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"688db83ab4af42a9b09f3ca25456a0718419e5d793eae612b4cf9c4dbaba4d93"} err="failed to get container status \"688db83ab4af42a9b09f3ca25456a0718419e5d793eae612b4cf9c4dbaba4d93\": rpc error: code = NotFound desc = could not find container \"688db83ab4af42a9b09f3ca25456a0718419e5d793eae612b4cf9c4dbaba4d93\": container with ID starting with 688db83ab4af42a9b09f3ca25456a0718419e5d793eae612b4cf9c4dbaba4d93 not found: ID does not exist" Jun 12 22:23:21.246691 ip-10-0-128-134 kubenswrapper[2559]: I0612 22:23:21.246620 2559 scope.go:117] "RemoveContainer" containerID="d4c99b3ba4388acbaf896d6dc5dbd934c927465985472902e36ad03443452390" Jun 12 22:23:21.246915 ip-10-0-128-134 kubenswrapper[2559]: E0612 22:23:21.246898 2559 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"d4c99b3ba4388acbaf896d6dc5dbd934c927465985472902e36ad03443452390\": container with ID starting with d4c99b3ba4388acbaf896d6dc5dbd934c927465985472902e36ad03443452390 not found: ID does not exist" containerID="d4c99b3ba4388acbaf896d6dc5dbd934c927465985472902e36ad03443452390" Jun 12 22:23:21.246985 ip-10-0-128-134 kubenswrapper[2559]: I0612 22:23:21.246924 2559 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"d4c99b3ba4388acbaf896d6dc5dbd934c927465985472902e36ad03443452390"} err="failed to get container status \"d4c99b3ba4388acbaf896d6dc5dbd934c927465985472902e36ad03443452390\": rpc error: code = NotFound desc = could not find container \"d4c99b3ba4388acbaf896d6dc5dbd934c927465985472902e36ad03443452390\": container with ID starting with d4c99b3ba4388acbaf896d6dc5dbd934c927465985472902e36ad03443452390 not found: ID does not exist" Jun 12 22:23:21.246985 ip-10-0-128-134 kubenswrapper[2559]: I0612 22:23:21.246948 2559 scope.go:117] "RemoveContainer" containerID="2b530eddb23e9fe1da5383e4fd0829264d83eac2a9dde163a47ea5acd18d303c" Jun 12 22:23:21.247206 ip-10-0-128-134 kubenswrapper[2559]: E0612 22:23:21.247189 2559 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"2b530eddb23e9fe1da5383e4fd0829264d83eac2a9dde163a47ea5acd18d303c\": container with ID starting with 2b530eddb23e9fe1da5383e4fd0829264d83eac2a9dde163a47ea5acd18d303c not found: ID does not exist" containerID="2b530eddb23e9fe1da5383e4fd0829264d83eac2a9dde163a47ea5acd18d303c" Jun 12 22:23:21.247270 ip-10-0-128-134 kubenswrapper[2559]: I0612 22:23:21.247212 2559 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"2b530eddb23e9fe1da5383e4fd0829264d83eac2a9dde163a47ea5acd18d303c"} err="failed to get container status \"2b530eddb23e9fe1da5383e4fd0829264d83eac2a9dde163a47ea5acd18d303c\": rpc error: code = NotFound desc = could not find container \"2b530eddb23e9fe1da5383e4fd0829264d83eac2a9dde163a47ea5acd18d303c\": container with ID starting with 2b530eddb23e9fe1da5383e4fd0829264d83eac2a9dde163a47ea5acd18d303c not found: ID does not exist" Jun 12 22:23:21.247270 ip-10-0-128-134 kubenswrapper[2559]: I0612 22:23:21.247233 2559 scope.go:117] "RemoveContainer" containerID="e56195491a55db22186bc95d972f0405656f15070b7d42f2136de6aa866d9e29" Jun 12 22:23:21.247513 ip-10-0-128-134 kubenswrapper[2559]: E0612 22:23:21.247495 2559 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"e56195491a55db22186bc95d972f0405656f15070b7d42f2136de6aa866d9e29\": container with ID starting with e56195491a55db22186bc95d972f0405656f15070b7d42f2136de6aa866d9e29 not found: ID does not exist" containerID="e56195491a55db22186bc95d972f0405656f15070b7d42f2136de6aa866d9e29" Jun 12 22:23:21.247592 ip-10-0-128-134 kubenswrapper[2559]: I0612 22:23:21.247517 2559 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"e56195491a55db22186bc95d972f0405656f15070b7d42f2136de6aa866d9e29"} err="failed to get container status \"e56195491a55db22186bc95d972f0405656f15070b7d42f2136de6aa866d9e29\": rpc error: code = NotFound desc = could not find container \"e56195491a55db22186bc95d972f0405656f15070b7d42f2136de6aa866d9e29\": container with ID starting with e56195491a55db22186bc95d972f0405656f15070b7d42f2136de6aa866d9e29 not found: ID does not exist" Jun 12 22:23:21.247592 ip-10-0-128-134 kubenswrapper[2559]: I0612 22:23:21.247535 2559 scope.go:117] "RemoveContainer" containerID="821e1e465ae571c4090a1b3dd8cb87453556d570019963ac9f0ec9630df9e8f3" Jun 12 22:23:21.247688 ip-10-0-128-134 kubenswrapper[2559]: I0612 22:23:21.247649 2559 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Jun 12 22:23:21.247821 ip-10-0-128-134 kubenswrapper[2559]: E0612 22:23:21.247803 2559 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"821e1e465ae571c4090a1b3dd8cb87453556d570019963ac9f0ec9630df9e8f3\": container with ID starting with 821e1e465ae571c4090a1b3dd8cb87453556d570019963ac9f0ec9630df9e8f3 not found: ID does not exist" containerID="821e1e465ae571c4090a1b3dd8cb87453556d570019963ac9f0ec9630df9e8f3" Jun 12 22:23:21.247859 ip-10-0-128-134 kubenswrapper[2559]: I0612 22:23:21.247828 2559 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"821e1e465ae571c4090a1b3dd8cb87453556d570019963ac9f0ec9630df9e8f3"} err="failed to get container status \"821e1e465ae571c4090a1b3dd8cb87453556d570019963ac9f0ec9630df9e8f3\": rpc error: code = NotFound desc = could not find container \"821e1e465ae571c4090a1b3dd8cb87453556d570019963ac9f0ec9630df9e8f3\": container with ID starting with 821e1e465ae571c4090a1b3dd8cb87453556d570019963ac9f0ec9630df9e8f3 not found: ID does not exist" Jun 12 22:23:21.247859 ip-10-0-128-134 kubenswrapper[2559]: I0612 22:23:21.247842 2559 scope.go:117] "RemoveContainer" containerID="86d2e7337c54446660e4b07c502d069d4d753f6cb6a99da910a77d2543d0c457" Jun 12 22:23:21.248010 ip-10-0-128-134 kubenswrapper[2559]: I0612 22:23:21.247991 2559 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="5463e61a-cf1a-4c7e-962c-ac94781324b1" containerName="alertmanager" Jun 12 22:23:21.248010 ip-10-0-128-134 kubenswrapper[2559]: I0612 22:23:21.248010 2559 state_mem.go:107] "Deleted CPUSet assignment" podUID="5463e61a-cf1a-4c7e-962c-ac94781324b1" containerName="alertmanager" Jun 12 22:23:21.248137 ip-10-0-128-134 kubenswrapper[2559]: I0612 22:23:21.248019 2559 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="5463e61a-cf1a-4c7e-962c-ac94781324b1" containerName="kube-rbac-proxy-metric" Jun 12 22:23:21.248137 ip-10-0-128-134 kubenswrapper[2559]: I0612 22:23:21.248028 2559 state_mem.go:107] "Deleted CPUSet assignment" podUID="5463e61a-cf1a-4c7e-962c-ac94781324b1" containerName="kube-rbac-proxy-metric" Jun 12 22:23:21.248137 ip-10-0-128-134 kubenswrapper[2559]: I0612 22:23:21.248038 2559 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="5463e61a-cf1a-4c7e-962c-ac94781324b1" containerName="prom-label-proxy" Jun 12 22:23:21.248137 ip-10-0-128-134 kubenswrapper[2559]: I0612 22:23:21.248044 2559 state_mem.go:107] "Deleted CPUSet assignment" podUID="5463e61a-cf1a-4c7e-962c-ac94781324b1" containerName="prom-label-proxy" Jun 12 22:23:21.248137 ip-10-0-128-134 kubenswrapper[2559]: I0612 22:23:21.248052 2559 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="5463e61a-cf1a-4c7e-962c-ac94781324b1" containerName="kube-rbac-proxy" Jun 12 22:23:21.248137 ip-10-0-128-134 kubenswrapper[2559]: I0612 22:23:21.248057 2559 state_mem.go:107] "Deleted CPUSet assignment" podUID="5463e61a-cf1a-4c7e-962c-ac94781324b1" containerName="kube-rbac-proxy" Jun 12 22:23:21.248137 ip-10-0-128-134 kubenswrapper[2559]: I0612 22:23:21.248067 2559 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="df717def-ede3-47ff-9464-b993c2f6d7ae" containerName="console" Jun 12 22:23:21.248137 ip-10-0-128-134 kubenswrapper[2559]: I0612 22:23:21.248072 2559 state_mem.go:107] "Deleted CPUSet assignment" podUID="df717def-ede3-47ff-9464-b993c2f6d7ae" containerName="console" Jun 12 22:23:21.248137 ip-10-0-128-134 kubenswrapper[2559]: I0612 22:23:21.248082 2559 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="5463e61a-cf1a-4c7e-962c-ac94781324b1" containerName="config-reloader" Jun 12 22:23:21.248137 ip-10-0-128-134 kubenswrapper[2559]: I0612 22:23:21.248090 2559 state_mem.go:107] "Deleted CPUSet assignment" podUID="5463e61a-cf1a-4c7e-962c-ac94781324b1" containerName="config-reloader" Jun 12 22:23:21.248137 ip-10-0-128-134 kubenswrapper[2559]: I0612 22:23:21.248107 2559 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="5463e61a-cf1a-4c7e-962c-ac94781324b1" containerName="kube-rbac-proxy-web" Jun 12 22:23:21.248137 ip-10-0-128-134 kubenswrapper[2559]: I0612 22:23:21.248116 2559 state_mem.go:107] "Deleted CPUSet assignment" podUID="5463e61a-cf1a-4c7e-962c-ac94781324b1" containerName="kube-rbac-proxy-web" Jun 12 22:23:21.248137 ip-10-0-128-134 kubenswrapper[2559]: I0612 22:23:21.248127 2559 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="5463e61a-cf1a-4c7e-962c-ac94781324b1" containerName="init-config-reloader" Jun 12 22:23:21.248137 ip-10-0-128-134 kubenswrapper[2559]: I0612 22:23:21.248132 2559 state_mem.go:107] "Deleted CPUSet assignment" podUID="5463e61a-cf1a-4c7e-962c-ac94781324b1" containerName="init-config-reloader" Jun 12 22:23:21.248629 ip-10-0-128-134 kubenswrapper[2559]: I0612 22:23:21.248157 2559 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"86d2e7337c54446660e4b07c502d069d4d753f6cb6a99da910a77d2543d0c457"} err="failed to get container status \"86d2e7337c54446660e4b07c502d069d4d753f6cb6a99da910a77d2543d0c457\": rpc error: code = NotFound desc = could not find container \"86d2e7337c54446660e4b07c502d069d4d753f6cb6a99da910a77d2543d0c457\": container with ID starting with 86d2e7337c54446660e4b07c502d069d4d753f6cb6a99da910a77d2543d0c457 not found: ID does not exist" Jun 12 22:23:21.248629 ip-10-0-128-134 kubenswrapper[2559]: I0612 22:23:21.248182 2559 scope.go:117] "RemoveContainer" containerID="b105749579dcbf3060b6a92dc1eca3de79601b5c2771d736343e741bb562ed7b" Jun 12 22:23:21.248629 ip-10-0-128-134 kubenswrapper[2559]: I0612 22:23:21.248195 2559 memory_manager.go:368] "RemoveStaleState removing state" podUID="5463e61a-cf1a-4c7e-962c-ac94781324b1" containerName="prom-label-proxy" Jun 12 22:23:21.248629 ip-10-0-128-134 kubenswrapper[2559]: I0612 22:23:21.248205 2559 memory_manager.go:368] "RemoveStaleState removing state" podUID="5463e61a-cf1a-4c7e-962c-ac94781324b1" containerName="kube-rbac-proxy-metric" Jun 12 22:23:21.248629 ip-10-0-128-134 kubenswrapper[2559]: I0612 22:23:21.248214 2559 memory_manager.go:368] "RemoveStaleState removing state" podUID="5463e61a-cf1a-4c7e-962c-ac94781324b1" containerName="kube-rbac-proxy" Jun 12 22:23:21.248629 ip-10-0-128-134 kubenswrapper[2559]: I0612 22:23:21.248223 2559 memory_manager.go:368] "RemoveStaleState removing state" podUID="5463e61a-cf1a-4c7e-962c-ac94781324b1" containerName="kube-rbac-proxy-web" Jun 12 22:23:21.248629 ip-10-0-128-134 kubenswrapper[2559]: I0612 22:23:21.248234 2559 memory_manager.go:368] "RemoveStaleState removing state" podUID="5463e61a-cf1a-4c7e-962c-ac94781324b1" containerName="config-reloader" Jun 12 22:23:21.248629 ip-10-0-128-134 kubenswrapper[2559]: I0612 22:23:21.248243 2559 memory_manager.go:368] "RemoveStaleState removing state" podUID="5463e61a-cf1a-4c7e-962c-ac94781324b1" containerName="alertmanager" Jun 12 22:23:21.248629 ip-10-0-128-134 kubenswrapper[2559]: I0612 22:23:21.248251 2559 memory_manager.go:368] "RemoveStaleState removing state" podUID="df717def-ede3-47ff-9464-b993c2f6d7ae" containerName="console" Jun 12 22:23:21.248629 ip-10-0-128-134 kubenswrapper[2559]: I0612 22:23:21.248484 2559 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"b105749579dcbf3060b6a92dc1eca3de79601b5c2771d736343e741bb562ed7b"} err="failed to get container status \"b105749579dcbf3060b6a92dc1eca3de79601b5c2771d736343e741bb562ed7b\": rpc error: code = NotFound desc = could not find container \"b105749579dcbf3060b6a92dc1eca3de79601b5c2771d736343e741bb562ed7b\": container with ID starting with b105749579dcbf3060b6a92dc1eca3de79601b5c2771d736343e741bb562ed7b not found: ID does not exist" Jun 12 22:23:21.248629 ip-10-0-128-134 kubenswrapper[2559]: I0612 22:23:21.248506 2559 scope.go:117] "RemoveContainer" containerID="688db83ab4af42a9b09f3ca25456a0718419e5d793eae612b4cf9c4dbaba4d93" Jun 12 22:23:21.249136 ip-10-0-128-134 kubenswrapper[2559]: I0612 22:23:21.248765 2559 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"688db83ab4af42a9b09f3ca25456a0718419e5d793eae612b4cf9c4dbaba4d93"} err="failed to get container status \"688db83ab4af42a9b09f3ca25456a0718419e5d793eae612b4cf9c4dbaba4d93\": rpc error: code = NotFound desc = could not find container \"688db83ab4af42a9b09f3ca25456a0718419e5d793eae612b4cf9c4dbaba4d93\": container with ID starting with 688db83ab4af42a9b09f3ca25456a0718419e5d793eae612b4cf9c4dbaba4d93 not found: ID does not exist" Jun 12 22:23:21.249136 ip-10-0-128-134 kubenswrapper[2559]: I0612 22:23:21.248784 2559 scope.go:117] "RemoveContainer" containerID="d4c99b3ba4388acbaf896d6dc5dbd934c927465985472902e36ad03443452390" Jun 12 22:23:21.249136 ip-10-0-128-134 kubenswrapper[2559]: I0612 22:23:21.249029 2559 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"d4c99b3ba4388acbaf896d6dc5dbd934c927465985472902e36ad03443452390"} err="failed to get container status \"d4c99b3ba4388acbaf896d6dc5dbd934c927465985472902e36ad03443452390\": rpc error: code = NotFound desc = could not find container \"d4c99b3ba4388acbaf896d6dc5dbd934c927465985472902e36ad03443452390\": container with ID starting with d4c99b3ba4388acbaf896d6dc5dbd934c927465985472902e36ad03443452390 not found: ID does not exist" Jun 12 22:23:21.249136 ip-10-0-128-134 kubenswrapper[2559]: I0612 22:23:21.249046 2559 scope.go:117] "RemoveContainer" containerID="2b530eddb23e9fe1da5383e4fd0829264d83eac2a9dde163a47ea5acd18d303c" Jun 12 22:23:21.249328 ip-10-0-128-134 kubenswrapper[2559]: I0612 22:23:21.249302 2559 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"2b530eddb23e9fe1da5383e4fd0829264d83eac2a9dde163a47ea5acd18d303c"} err="failed to get container status \"2b530eddb23e9fe1da5383e4fd0829264d83eac2a9dde163a47ea5acd18d303c\": rpc error: code = NotFound desc = could not find container \"2b530eddb23e9fe1da5383e4fd0829264d83eac2a9dde163a47ea5acd18d303c\": container with ID starting with 2b530eddb23e9fe1da5383e4fd0829264d83eac2a9dde163a47ea5acd18d303c not found: ID does not exist" Jun 12 22:23:21.249369 ip-10-0-128-134 kubenswrapper[2559]: I0612 22:23:21.249338 2559 scope.go:117] "RemoveContainer" containerID="e56195491a55db22186bc95d972f0405656f15070b7d42f2136de6aa866d9e29" Jun 12 22:23:21.249712 ip-10-0-128-134 kubenswrapper[2559]: I0612 22:23:21.249671 2559 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"e56195491a55db22186bc95d972f0405656f15070b7d42f2136de6aa866d9e29"} err="failed to get container status \"e56195491a55db22186bc95d972f0405656f15070b7d42f2136de6aa866d9e29\": rpc error: code = NotFound desc = could not find container \"e56195491a55db22186bc95d972f0405656f15070b7d42f2136de6aa866d9e29\": container with ID starting with e56195491a55db22186bc95d972f0405656f15070b7d42f2136de6aa866d9e29 not found: ID does not exist" Jun 12 22:23:21.249712 ip-10-0-128-134 kubenswrapper[2559]: I0612 22:23:21.249701 2559 scope.go:117] "RemoveContainer" containerID="821e1e465ae571c4090a1b3dd8cb87453556d570019963ac9f0ec9630df9e8f3" Jun 12 22:23:21.249941 ip-10-0-128-134 kubenswrapper[2559]: I0612 22:23:21.249923 2559 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"821e1e465ae571c4090a1b3dd8cb87453556d570019963ac9f0ec9630df9e8f3"} err="failed to get container status \"821e1e465ae571c4090a1b3dd8cb87453556d570019963ac9f0ec9630df9e8f3\": rpc error: code = NotFound desc = could not find container \"821e1e465ae571c4090a1b3dd8cb87453556d570019963ac9f0ec9630df9e8f3\": container with ID starting with 821e1e465ae571c4090a1b3dd8cb87453556d570019963ac9f0ec9630df9e8f3 not found: ID does not exist" Jun 12 22:23:21.250836 ip-10-0-128-134 kubenswrapper[2559]: I0612 22:23:21.250823 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0" Jun 12 22:23:21.254318 ip-10-0-128-134 kubenswrapper[2559]: I0612 22:23:21.253762 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-cluster-tls-config\"" Jun 12 22:23:21.254318 ip-10-0-128-134 kubenswrapper[2559]: I0612 22:23:21.254160 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy-metric\"" Jun 12 22:23:21.254544 ip-10-0-128-134 kubenswrapper[2559]: I0612 22:23:21.254491 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-web-config\"" Jun 12 22:23:21.254861 ip-10-0-128-134 kubenswrapper[2559]: I0612 22:23:21.254729 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy-web\"" Jun 12 22:23:21.254861 ip-10-0-128-134 kubenswrapper[2559]: I0612 22:23:21.254820 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-tls\"" Jun 12 22:23:21.255088 ip-10-0-128-134 kubenswrapper[2559]: I0612 22:23:21.254870 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-dockercfg-bb9rp\"" Jun 12 22:23:21.255088 ip-10-0-128-134 kubenswrapper[2559]: I0612 22:23:21.254880 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-tls-assets-0\"" Jun 12 22:23:21.255088 ip-10-0-128-134 kubenswrapper[2559]: I0612 22:23:21.255033 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy\"" Jun 12 22:23:21.255247 ip-10-0-128-134 kubenswrapper[2559]: I0612 22:23:21.255093 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-generated\"" Jun 12 22:23:21.258133 ip-10-0-128-134 kubenswrapper[2559]: I0612 22:23:21.258109 2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"alertmanager-trusted-ca-bundle\"" Jun 12 22:23:21.265127 ip-10-0-128-134 kubenswrapper[2559]: I0612 22:23:21.265105 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Jun 12 22:23:21.393500 ip-10-0-128-134 kubenswrapper[2559]: I0612 22:23:21.393465 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-nd6zk\" (UniqueName: \"kubernetes.io/projected/b11fdeb3-2f2a-4091-9a41-0e34731b5b1f-kube-api-access-nd6zk\") pod \"alertmanager-main-0\" (UID: \"b11fdeb3-2f2a-4091-9a41-0e34731b5b1f\") " pod="openshift-monitoring/alertmanager-main-0" Jun 12 22:23:21.393500 ip-10-0-128-134 kubenswrapper[2559]: I0612 22:23:21.393500 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/b11fdeb3-2f2a-4091-9a41-0e34731b5b1f-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"b11fdeb3-2f2a-4091-9a41-0e34731b5b1f\") " pod="openshift-monitoring/alertmanager-main-0" Jun 12 22:23:21.393678 ip-10-0-128-134 kubenswrapper[2559]: I0612 22:23:21.393517 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/b11fdeb3-2f2a-4091-9a41-0e34731b5b1f-config-out\") pod \"alertmanager-main-0\" (UID: \"b11fdeb3-2f2a-4091-9a41-0e34731b5b1f\") " pod="openshift-monitoring/alertmanager-main-0" Jun 12 22:23:21.393678 ip-10-0-128-134 kubenswrapper[2559]: I0612 22:23:21.393532 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/b11fdeb3-2f2a-4091-9a41-0e34731b5b1f-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"b11fdeb3-2f2a-4091-9a41-0e34731b5b1f\") " pod="openshift-monitoring/alertmanager-main-0" Jun 12 22:23:21.393678 ip-10-0-128-134 kubenswrapper[2559]: I0612 22:23:21.393598 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/b11fdeb3-2f2a-4091-9a41-0e34731b5b1f-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"b11fdeb3-2f2a-4091-9a41-0e34731b5b1f\") " pod="openshift-monitoring/alertmanager-main-0" Jun 12 22:23:21.393678 ip-10-0-128-134 kubenswrapper[2559]: I0612 22:23:21.393644 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/b11fdeb3-2f2a-4091-9a41-0e34731b5b1f-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"b11fdeb3-2f2a-4091-9a41-0e34731b5b1f\") " pod="openshift-monitoring/alertmanager-main-0" Jun 12 22:23:21.393678 ip-10-0-128-134 kubenswrapper[2559]: I0612 22:23:21.393663 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/b11fdeb3-2f2a-4091-9a41-0e34731b5b1f-config-volume\") pod \"alertmanager-main-0\" (UID: \"b11fdeb3-2f2a-4091-9a41-0e34731b5b1f\") " pod="openshift-monitoring/alertmanager-main-0" Jun 12 22:23:21.393831 ip-10-0-128-134 kubenswrapper[2559]: I0612 22:23:21.393690 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/b11fdeb3-2f2a-4091-9a41-0e34731b5b1f-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"b11fdeb3-2f2a-4091-9a41-0e34731b5b1f\") " pod="openshift-monitoring/alertmanager-main-0" Jun 12 22:23:21.393831 ip-10-0-128-134 kubenswrapper[2559]: I0612 22:23:21.393710 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/b11fdeb3-2f2a-4091-9a41-0e34731b5b1f-tls-assets\") pod \"alertmanager-main-0\" (UID: \"b11fdeb3-2f2a-4091-9a41-0e34731b5b1f\") " pod="openshift-monitoring/alertmanager-main-0" Jun 12 22:23:21.393831 ip-10-0-128-134 kubenswrapper[2559]: I0612 22:23:21.393746 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/b11fdeb3-2f2a-4091-9a41-0e34731b5b1f-web-config\") pod \"alertmanager-main-0\" (UID: \"b11fdeb3-2f2a-4091-9a41-0e34731b5b1f\") " pod="openshift-monitoring/alertmanager-main-0" Jun 12 22:23:21.393831 ip-10-0-128-134 kubenswrapper[2559]: I0612 22:23:21.393776 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/b11fdeb3-2f2a-4091-9a41-0e34731b5b1f-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"b11fdeb3-2f2a-4091-9a41-0e34731b5b1f\") " pod="openshift-monitoring/alertmanager-main-0" Jun 12 22:23:21.393831 ip-10-0-128-134 kubenswrapper[2559]: I0612 22:23:21.393800 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/b11fdeb3-2f2a-4091-9a41-0e34731b5b1f-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"b11fdeb3-2f2a-4091-9a41-0e34731b5b1f\") " pod="openshift-monitoring/alertmanager-main-0" Jun 12 22:23:21.393831 ip-10-0-128-134 kubenswrapper[2559]: I0612 22:23:21.393823 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/b11fdeb3-2f2a-4091-9a41-0e34731b5b1f-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"b11fdeb3-2f2a-4091-9a41-0e34731b5b1f\") " pod="openshift-monitoring/alertmanager-main-0" Jun 12 22:23:21.494617 ip-10-0-128-134 kubenswrapper[2559]: I0612 22:23:21.494533 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/b11fdeb3-2f2a-4091-9a41-0e34731b5b1f-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"b11fdeb3-2f2a-4091-9a41-0e34731b5b1f\") " pod="openshift-monitoring/alertmanager-main-0" Jun 12 22:23:21.494617 ip-10-0-128-134 kubenswrapper[2559]: I0612 22:23:21.494569 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/b11fdeb3-2f2a-4091-9a41-0e34731b5b1f-tls-assets\") pod \"alertmanager-main-0\" (UID: \"b11fdeb3-2f2a-4091-9a41-0e34731b5b1f\") " pod="openshift-monitoring/alertmanager-main-0" Jun 12 22:23:21.494617 ip-10-0-128-134 kubenswrapper[2559]: I0612 22:23:21.494590 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/b11fdeb3-2f2a-4091-9a41-0e34731b5b1f-web-config\") pod \"alertmanager-main-0\" (UID: \"b11fdeb3-2f2a-4091-9a41-0e34731b5b1f\") " pod="openshift-monitoring/alertmanager-main-0" Jun 12 22:23:21.494865 ip-10-0-128-134 kubenswrapper[2559]: I0612 22:23:21.494635 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/b11fdeb3-2f2a-4091-9a41-0e34731b5b1f-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"b11fdeb3-2f2a-4091-9a41-0e34731b5b1f\") " pod="openshift-monitoring/alertmanager-main-0" Jun 12 22:23:21.494865 ip-10-0-128-134 kubenswrapper[2559]: I0612 22:23:21.494677 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/b11fdeb3-2f2a-4091-9a41-0e34731b5b1f-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"b11fdeb3-2f2a-4091-9a41-0e34731b5b1f\") " pod="openshift-monitoring/alertmanager-main-0" Jun 12 22:23:21.494865 ip-10-0-128-134 kubenswrapper[2559]: I0612 22:23:21.494719 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/b11fdeb3-2f2a-4091-9a41-0e34731b5b1f-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"b11fdeb3-2f2a-4091-9a41-0e34731b5b1f\") " pod="openshift-monitoring/alertmanager-main-0" Jun 12 22:23:21.494865 ip-10-0-128-134 kubenswrapper[2559]: I0612 22:23:21.494791 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-nd6zk\" (UniqueName: \"kubernetes.io/projected/b11fdeb3-2f2a-4091-9a41-0e34731b5b1f-kube-api-access-nd6zk\") pod \"alertmanager-main-0\" (UID: \"b11fdeb3-2f2a-4091-9a41-0e34731b5b1f\") " pod="openshift-monitoring/alertmanager-main-0" Jun 12 22:23:21.494865 ip-10-0-128-134 kubenswrapper[2559]: I0612 22:23:21.494814 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/b11fdeb3-2f2a-4091-9a41-0e34731b5b1f-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"b11fdeb3-2f2a-4091-9a41-0e34731b5b1f\") " pod="openshift-monitoring/alertmanager-main-0" Jun 12 22:23:21.495088 ip-10-0-128-134 kubenswrapper[2559]: I0612 22:23:21.494945 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/b11fdeb3-2f2a-4091-9a41-0e34731b5b1f-config-out\") pod \"alertmanager-main-0\" (UID: \"b11fdeb3-2f2a-4091-9a41-0e34731b5b1f\") " pod="openshift-monitoring/alertmanager-main-0" Jun 12 22:23:21.495088 ip-10-0-128-134 kubenswrapper[2559]: I0612 22:23:21.494978 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/b11fdeb3-2f2a-4091-9a41-0e34731b5b1f-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"b11fdeb3-2f2a-4091-9a41-0e34731b5b1f\") " pod="openshift-monitoring/alertmanager-main-0" Jun 12 22:23:21.495088 ip-10-0-128-134 kubenswrapper[2559]: I0612 22:23:21.495021 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/b11fdeb3-2f2a-4091-9a41-0e34731b5b1f-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"b11fdeb3-2f2a-4091-9a41-0e34731b5b1f\") " pod="openshift-monitoring/alertmanager-main-0" Jun 12 22:23:21.495088 ip-10-0-128-134 kubenswrapper[2559]: I0612 22:23:21.495063 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/b11fdeb3-2f2a-4091-9a41-0e34731b5b1f-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"b11fdeb3-2f2a-4091-9a41-0e34731b5b1f\") " pod="openshift-monitoring/alertmanager-main-0" Jun 12 22:23:21.495274 ip-10-0-128-134 kubenswrapper[2559]: I0612 22:23:21.495087 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/b11fdeb3-2f2a-4091-9a41-0e34731b5b1f-config-volume\") pod \"alertmanager-main-0\" (UID: \"b11fdeb3-2f2a-4091-9a41-0e34731b5b1f\") " pod="openshift-monitoring/alertmanager-main-0" Jun 12 22:23:21.495675 ip-10-0-128-134 kubenswrapper[2559]: I0612 22:23:21.495540 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/b11fdeb3-2f2a-4091-9a41-0e34731b5b1f-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"b11fdeb3-2f2a-4091-9a41-0e34731b5b1f\") " pod="openshift-monitoring/alertmanager-main-0" Jun 12 22:23:21.495675 ip-10-0-128-134 kubenswrapper[2559]: I0612 22:23:21.495666 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/b11fdeb3-2f2a-4091-9a41-0e34731b5b1f-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"b11fdeb3-2f2a-4091-9a41-0e34731b5b1f\") " pod="openshift-monitoring/alertmanager-main-0" Jun 12 22:23:21.495847 ip-10-0-128-134 kubenswrapper[2559]: I0612 22:23:21.495812 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/b11fdeb3-2f2a-4091-9a41-0e34731b5b1f-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"b11fdeb3-2f2a-4091-9a41-0e34731b5b1f\") " pod="openshift-monitoring/alertmanager-main-0" Jun 12 22:23:21.497913 ip-10-0-128-134 kubenswrapper[2559]: I0612 22:23:21.497883 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/b11fdeb3-2f2a-4091-9a41-0e34731b5b1f-web-config\") pod \"alertmanager-main-0\" (UID: \"b11fdeb3-2f2a-4091-9a41-0e34731b5b1f\") " pod="openshift-monitoring/alertmanager-main-0" Jun 12 22:23:21.498016 ip-10-0-128-134 kubenswrapper[2559]: I0612 22:23:21.497911 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/b11fdeb3-2f2a-4091-9a41-0e34731b5b1f-tls-assets\") pod \"alertmanager-main-0\" (UID: \"b11fdeb3-2f2a-4091-9a41-0e34731b5b1f\") " pod="openshift-monitoring/alertmanager-main-0" Jun 12 22:23:21.498016 ip-10-0-128-134 kubenswrapper[2559]: I0612 22:23:21.497921 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/b11fdeb3-2f2a-4091-9a41-0e34731b5b1f-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"b11fdeb3-2f2a-4091-9a41-0e34731b5b1f\") " pod="openshift-monitoring/alertmanager-main-0" Jun 12 22:23:21.498016 ip-10-0-128-134 kubenswrapper[2559]: I0612 22:23:21.497994 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/b11fdeb3-2f2a-4091-9a41-0e34731b5b1f-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"b11fdeb3-2f2a-4091-9a41-0e34731b5b1f\") " pod="openshift-monitoring/alertmanager-main-0" Jun 12 22:23:21.498203 ip-10-0-128-134 kubenswrapper[2559]: I0612 22:23:21.498177 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/b11fdeb3-2f2a-4091-9a41-0e34731b5b1f-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"b11fdeb3-2f2a-4091-9a41-0e34731b5b1f\") " pod="openshift-monitoring/alertmanager-main-0" Jun 12 22:23:21.498504 ip-10-0-128-134 kubenswrapper[2559]: I0612 22:23:21.498405 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/b11fdeb3-2f2a-4091-9a41-0e34731b5b1f-config-out\") pod \"alertmanager-main-0\" (UID: \"b11fdeb3-2f2a-4091-9a41-0e34731b5b1f\") " pod="openshift-monitoring/alertmanager-main-0" Jun 12 22:23:21.498670 ip-10-0-128-134 kubenswrapper[2559]: I0612 22:23:21.498649 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/b11fdeb3-2f2a-4091-9a41-0e34731b5b1f-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"b11fdeb3-2f2a-4091-9a41-0e34731b5b1f\") " pod="openshift-monitoring/alertmanager-main-0" Jun 12 22:23:21.498732 ip-10-0-128-134 kubenswrapper[2559]: I0612 22:23:21.498715 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/b11fdeb3-2f2a-4091-9a41-0e34731b5b1f-config-volume\") pod \"alertmanager-main-0\" (UID: \"b11fdeb3-2f2a-4091-9a41-0e34731b5b1f\") " pod="openshift-monitoring/alertmanager-main-0" Jun 12 22:23:21.499823 ip-10-0-128-134 kubenswrapper[2559]: I0612 22:23:21.499806 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/b11fdeb3-2f2a-4091-9a41-0e34731b5b1f-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"b11fdeb3-2f2a-4091-9a41-0e34731b5b1f\") " pod="openshift-monitoring/alertmanager-main-0" Jun 12 22:23:21.503682 ip-10-0-128-134 kubenswrapper[2559]: I0612 22:23:21.503658 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-nd6zk\" (UniqueName: \"kubernetes.io/projected/b11fdeb3-2f2a-4091-9a41-0e34731b5b1f-kube-api-access-nd6zk\") pod \"alertmanager-main-0\" (UID: \"b11fdeb3-2f2a-4091-9a41-0e34731b5b1f\") " pod="openshift-monitoring/alertmanager-main-0" Jun 12 22:23:21.561404 ip-10-0-128-134 kubenswrapper[2559]: I0612 22:23:21.561372 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0" Jun 12 22:23:21.696691 ip-10-0-128-134 kubenswrapper[2559]: I0612 22:23:21.696606 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Jun 12 22:23:21.698764 ip-10-0-128-134 kubenswrapper[2559]: W0612 22:23:21.698733 2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb11fdeb3_2f2a_4091_9a41_0e34731b5b1f.slice/crio-39d3f47a4a9fa36ba212bc2751d7d1180847e98d3466bd9f92bb8f64733d30ee WatchSource:0}: Error finding container 39d3f47a4a9fa36ba212bc2751d7d1180847e98d3466bd9f92bb8f64733d30ee: Status 404 returned error can't find the container with id 39d3f47a4a9fa36ba212bc2751d7d1180847e98d3466bd9f92bb8f64733d30ee Jun 12 22:23:22.199426 ip-10-0-128-134 kubenswrapper[2559]: I0612 22:23:22.199394 2559 generic.go:356] "Generic (PLEG): container finished" podID="b11fdeb3-2f2a-4091-9a41-0e34731b5b1f" containerID="83fde854131da69d69497c82b40a7737a6c6a65f829222450f0590e9a58d3d45" exitCode=0 Jun 12 22:23:22.199592 ip-10-0-128-134 kubenswrapper[2559]: I0612 22:23:22.199485 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"b11fdeb3-2f2a-4091-9a41-0e34731b5b1f","Type":"ContainerDied","Data":"83fde854131da69d69497c82b40a7737a6c6a65f829222450f0590e9a58d3d45"} Jun 12 22:23:22.199592 ip-10-0-128-134 kubenswrapper[2559]: I0612 22:23:22.199557 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"b11fdeb3-2f2a-4091-9a41-0e34731b5b1f","Type":"ContainerStarted","Data":"39d3f47a4a9fa36ba212bc2751d7d1180847e98d3466bd9f92bb8f64733d30ee"} Jun 12 22:23:22.410360 ip-10-0-128-134 kubenswrapper[2559]: I0612 22:23:22.410329 2559 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="5463e61a-cf1a-4c7e-962c-ac94781324b1" path="/var/lib/kubelet/pods/5463e61a-cf1a-4c7e-962c-ac94781324b1/volumes" Jun 12 22:23:23.207682 ip-10-0-128-134 kubenswrapper[2559]: I0612 22:23:23.207649 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"b11fdeb3-2f2a-4091-9a41-0e34731b5b1f","Type":"ContainerStarted","Data":"2684331e06c8b2260f2222b70d12b0329cfbeb50e5518d65b44de900f01cde37"} Jun 12 22:23:23.208053 ip-10-0-128-134 kubenswrapper[2559]: I0612 22:23:23.207715 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"b11fdeb3-2f2a-4091-9a41-0e34731b5b1f","Type":"ContainerStarted","Data":"fb029a42024194af4b1f9133301993acc2abd5c809786626f314a93f60b17f88"} Jun 12 22:23:23.208053 ip-10-0-128-134 kubenswrapper[2559]: I0612 22:23:23.207744 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"b11fdeb3-2f2a-4091-9a41-0e34731b5b1f","Type":"ContainerStarted","Data":"93777e73bcefdd0246984ba7db59fe65f1fe70f414a60d73ebb257058fb98b82"} Jun 12 22:23:23.208053 ip-10-0-128-134 kubenswrapper[2559]: I0612 22:23:23.207769 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"b11fdeb3-2f2a-4091-9a41-0e34731b5b1f","Type":"ContainerStarted","Data":"81f4127765d76e3d7fcb2ca7ad7cdc3334a35a06e6f2eb1f6ea1060d721333ce"} Jun 12 22:23:23.208053 ip-10-0-128-134 kubenswrapper[2559]: I0612 22:23:23.207792 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"b11fdeb3-2f2a-4091-9a41-0e34731b5b1f","Type":"ContainerStarted","Data":"fd51105de8174f6f6243208b9849ca61ae2142b4fef72ab9fbb891e43b3b33a2"} Jun 12 22:23:23.208053 ip-10-0-128-134 kubenswrapper[2559]: I0612 22:23:23.207815 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"b11fdeb3-2f2a-4091-9a41-0e34731b5b1f","Type":"ContainerStarted","Data":"d4e8a285b62202b070e21b91369739f3ccda3f49864d4451d030012f64fc0a33"} Jun 12 22:23:23.252686 ip-10-0-128-134 kubenswrapper[2559]: I0612 22:23:23.252638 2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/alertmanager-main-0" podStartSLOduration=2.23387822 podStartE2EDuration="2.252622299s" totalImagesPullingTime="0s" totalInitContainerRuntime="18.744079ms" isStatefulPod=false podCreationTimestamp="2026-06-12 22:23:21 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-12 22:23:23.251415652 +0000 UTC m=+145.299785469" watchObservedRunningTime="2026-06-12 22:23:23.252622299 +0000 UTC m=+145.300992113" Jun 12 22:23:23.659078 ip-10-0-128-134 kubenswrapper[2559]: I0612 22:23:23.659043 2559 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Jun 12 22:23:23.659376 ip-10-0-128-134 kubenswrapper[2559]: I0612 22:23:23.659344 2559 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="7f938da2-ffe5-4feb-988f-22bbc35e531f" containerName="prometheus" containerID="cri-o://c963547e8486c32795df13ed7ed7556daab5bec95e9d840cd097a0524f16d488" gracePeriod=600 Jun 12 22:23:23.659491 ip-10-0-128-134 kubenswrapper[2559]: I0612 22:23:23.659406 2559 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="7f938da2-ffe5-4feb-988f-22bbc35e531f" containerName="kube-rbac-proxy" containerID="cri-o://00e32bcb0aa0707cb776f6821ec7b8097e196f72126b66fab61025b5746d541f" gracePeriod=600 Jun 12 22:23:23.659547 ip-10-0-128-134 kubenswrapper[2559]: I0612 22:23:23.659491 2559 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="7f938da2-ffe5-4feb-988f-22bbc35e531f" containerName="kube-rbac-proxy-thanos" containerID="cri-o://93efbbf6f7581a4f314bfd8301608874210eeff8bb579f02eadb8baac6b0800f" gracePeriod=600 Jun 12 22:23:23.659603 ip-10-0-128-134 kubenswrapper[2559]: I0612 22:23:23.659527 2559 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="7f938da2-ffe5-4feb-988f-22bbc35e531f" containerName="thanos-sidecar" containerID="cri-o://a1f6f08ada38cf5826b49c75c834785e9f4d042c204466b996a4bfd9d73f1e69" gracePeriod=600 Jun 12 22:23:23.659659 ip-10-0-128-134 kubenswrapper[2559]: I0612 22:23:23.659547 2559 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="7f938da2-ffe5-4feb-988f-22bbc35e531f" containerName="config-reloader" containerID="cri-o://bde92804a49e1037334e3fbe53bc09a6109a381182c1d66897f32f7e261d1dce" gracePeriod=600 Jun 12 22:23:23.659708 ip-10-0-128-134 kubenswrapper[2559]: I0612 22:23:23.659671 2559 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="7f938da2-ffe5-4feb-988f-22bbc35e531f" containerName="kube-rbac-proxy-web" containerID="cri-o://4299c05e286c1cc9a79799029d8eee24f3ab64c55860260d80207f2f4d89ffed" gracePeriod=600 Jun 12 22:23:23.908957 ip-10-0-128-134 kubenswrapper[2559]: I0612 22:23:23.908932 2559 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0" Jun 12 22:23:24.017401 ip-10-0-128-134 kubenswrapper[2559]: I0612 22:23:24.017311 2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-pkhfw\" (UniqueName: \"kubernetes.io/projected/7f938da2-ffe5-4feb-988f-22bbc35e531f-kube-api-access-pkhfw\") pod \"7f938da2-ffe5-4feb-988f-22bbc35e531f\" (UID: \"7f938da2-ffe5-4feb-988f-22bbc35e531f\") " Jun 12 22:23:24.017401 ip-10-0-128-134 kubenswrapper[2559]: I0612 22:23:24.017349 2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/7f938da2-ffe5-4feb-988f-22bbc35e531f-configmap-metrics-client-ca\") pod \"7f938da2-ffe5-4feb-988f-22bbc35e531f\" (UID: \"7f938da2-ffe5-4feb-988f-22bbc35e531f\") " Jun 12 22:23:24.017401 ip-10-0-128-134 kubenswrapper[2559]: I0612 22:23:24.017372 2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/7f938da2-ffe5-4feb-988f-22bbc35e531f-thanos-prometheus-http-client-file\") pod \"7f938da2-ffe5-4feb-988f-22bbc35e531f\" (UID: \"7f938da2-ffe5-4feb-988f-22bbc35e531f\") " Jun 12 22:23:24.017401 ip-10-0-128-134 kubenswrapper[2559]: I0612 22:23:24.017394 2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/7f938da2-ffe5-4feb-988f-22bbc35e531f-config-out\") pod \"7f938da2-ffe5-4feb-988f-22bbc35e531f\" (UID: \"7f938da2-ffe5-4feb-988f-22bbc35e531f\") " Jun 12 22:23:24.017741 ip-10-0-128-134 kubenswrapper[2559]: I0612 22:23:24.017419 2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/7f938da2-ffe5-4feb-988f-22bbc35e531f-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"7f938da2-ffe5-4feb-988f-22bbc35e531f\" (UID: \"7f938da2-ffe5-4feb-988f-22bbc35e531f\") " Jun 12 22:23:24.017741 ip-10-0-128-134 kubenswrapper[2559]: I0612 22:23:24.017467 2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/7f938da2-ffe5-4feb-988f-22bbc35e531f-secret-grpc-tls\") pod \"7f938da2-ffe5-4feb-988f-22bbc35e531f\" (UID: \"7f938da2-ffe5-4feb-988f-22bbc35e531f\") " Jun 12 22:23:24.017741 ip-10-0-128-134 kubenswrapper[2559]: I0612 22:23:24.017492 2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/7f938da2-ffe5-4feb-988f-22bbc35e531f-prometheus-k8s-rulefiles-1\") pod \"7f938da2-ffe5-4feb-988f-22bbc35e531f\" (UID: \"7f938da2-ffe5-4feb-988f-22bbc35e531f\") " Jun 12 22:23:24.017741 ip-10-0-128-134 kubenswrapper[2559]: I0612 22:23:24.017523 2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/7f938da2-ffe5-4feb-988f-22bbc35e531f-prometheus-k8s-db\") pod \"7f938da2-ffe5-4feb-988f-22bbc35e531f\" (UID: \"7f938da2-ffe5-4feb-988f-22bbc35e531f\") " Jun 12 22:23:24.017741 ip-10-0-128-134 kubenswrapper[2559]: I0612 22:23:24.017551 2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/7f938da2-ffe5-4feb-988f-22bbc35e531f-secret-prometheus-k8s-tls\") pod \"7f938da2-ffe5-4feb-988f-22bbc35e531f\" (UID: \"7f938da2-ffe5-4feb-988f-22bbc35e531f\") " Jun 12 22:23:24.017741 ip-10-0-128-134 kubenswrapper[2559]: I0612 22:23:24.017584 2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/7f938da2-ffe5-4feb-988f-22bbc35e531f-configmap-serving-certs-ca-bundle\") pod \"7f938da2-ffe5-4feb-988f-22bbc35e531f\" (UID: \"7f938da2-ffe5-4feb-988f-22bbc35e531f\") " Jun 12 22:23:24.017741 ip-10-0-128-134 kubenswrapper[2559]: I0612 22:23:24.017606 2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/7f938da2-ffe5-4feb-988f-22bbc35e531f-web-config\") pod \"7f938da2-ffe5-4feb-988f-22bbc35e531f\" (UID: \"7f938da2-ffe5-4feb-988f-22bbc35e531f\") " Jun 12 22:23:24.017741 ip-10-0-128-134 kubenswrapper[2559]: I0612 22:23:24.017635 2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/7f938da2-ffe5-4feb-988f-22bbc35e531f-prometheus-k8s-rulefiles-2\") pod \"7f938da2-ffe5-4feb-988f-22bbc35e531f\" (UID: \"7f938da2-ffe5-4feb-988f-22bbc35e531f\") " Jun 12 22:23:24.017741 ip-10-0-128-134 kubenswrapper[2559]: I0612 22:23:24.017672 2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/7f938da2-ffe5-4feb-988f-22bbc35e531f-tls-assets\") pod \"7f938da2-ffe5-4feb-988f-22bbc35e531f\" (UID: \"7f938da2-ffe5-4feb-988f-22bbc35e531f\") " Jun 12 22:23:24.017741 ip-10-0-128-134 kubenswrapper[2559]: I0612 22:23:24.017719 2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/7f938da2-ffe5-4feb-988f-22bbc35e531f-secret-metrics-client-certs\") pod \"7f938da2-ffe5-4feb-988f-22bbc35e531f\" (UID: \"7f938da2-ffe5-4feb-988f-22bbc35e531f\") " Jun 12 22:23:24.018223 ip-10-0-128-134 kubenswrapper[2559]: I0612 22:23:24.017785 2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/7f938da2-ffe5-4feb-988f-22bbc35e531f-prometheus-trusted-ca-bundle\") pod \"7f938da2-ffe5-4feb-988f-22bbc35e531f\" (UID: \"7f938da2-ffe5-4feb-988f-22bbc35e531f\") " Jun 12 22:23:24.018223 ip-10-0-128-134 kubenswrapper[2559]: I0612 22:23:24.017813 2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/7f938da2-ffe5-4feb-988f-22bbc35e531f-config\") pod \"7f938da2-ffe5-4feb-988f-22bbc35e531f\" (UID: \"7f938da2-ffe5-4feb-988f-22bbc35e531f\") " Jun 12 22:23:24.018223 ip-10-0-128-134 kubenswrapper[2559]: I0612 22:23:24.017802 2559 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/7f938da2-ffe5-4feb-988f-22bbc35e531f-configmap-metrics-client-ca" (OuterVolumeSpecName: "configmap-metrics-client-ca") pod "7f938da2-ffe5-4feb-988f-22bbc35e531f" (UID: "7f938da2-ffe5-4feb-988f-22bbc35e531f"). InnerVolumeSpecName "configmap-metrics-client-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 12 22:23:24.018223 ip-10-0-128-134 kubenswrapper[2559]: I0612 22:23:24.017845 2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/7f938da2-ffe5-4feb-988f-22bbc35e531f-configmap-kubelet-serving-ca-bundle\") pod \"7f938da2-ffe5-4feb-988f-22bbc35e531f\" (UID: \"7f938da2-ffe5-4feb-988f-22bbc35e531f\") " Jun 12 22:23:24.018223 ip-10-0-128-134 kubenswrapper[2559]: I0612 22:23:24.017883 2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/7f938da2-ffe5-4feb-988f-22bbc35e531f-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"7f938da2-ffe5-4feb-988f-22bbc35e531f\" (UID: \"7f938da2-ffe5-4feb-988f-22bbc35e531f\") " Jun 12 22:23:24.018223 ip-10-0-128-134 kubenswrapper[2559]: I0612 22:23:24.017926 2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/7f938da2-ffe5-4feb-988f-22bbc35e531f-secret-kube-rbac-proxy\") pod \"7f938da2-ffe5-4feb-988f-22bbc35e531f\" (UID: \"7f938da2-ffe5-4feb-988f-22bbc35e531f\") " Jun 12 22:23:24.018223 ip-10-0-128-134 kubenswrapper[2559]: I0612 22:23:24.017958 2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/7f938da2-ffe5-4feb-988f-22bbc35e531f-prometheus-k8s-rulefiles-0\") pod \"7f938da2-ffe5-4feb-988f-22bbc35e531f\" (UID: \"7f938da2-ffe5-4feb-988f-22bbc35e531f\") " Jun 12 22:23:24.018223 ip-10-0-128-134 kubenswrapper[2559]: I0612 22:23:24.018018 2559 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/7f938da2-ffe5-4feb-988f-22bbc35e531f-prometheus-k8s-rulefiles-2" (OuterVolumeSpecName: "prometheus-k8s-rulefiles-2") pod "7f938da2-ffe5-4feb-988f-22bbc35e531f" (UID: "7f938da2-ffe5-4feb-988f-22bbc35e531f"). InnerVolumeSpecName "prometheus-k8s-rulefiles-2". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 12 22:23:24.018809 ip-10-0-128-134 kubenswrapper[2559]: I0612 22:23:24.018233 2559 reconciler_common.go:299] "Volume detached for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/7f938da2-ffe5-4feb-988f-22bbc35e531f-configmap-metrics-client-ca\") on node \"ip-10-0-128-134.ec2.internal\" DevicePath \"\"" Jun 12 22:23:24.018809 ip-10-0-128-134 kubenswrapper[2559]: I0612 22:23:24.018251 2559 reconciler_common.go:299] "Volume detached for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/7f938da2-ffe5-4feb-988f-22bbc35e531f-prometheus-k8s-rulefiles-2\") on node \"ip-10-0-128-134.ec2.internal\" DevicePath \"\"" Jun 12 22:23:24.018809 ip-10-0-128-134 kubenswrapper[2559]: I0612 22:23:24.018254 2559 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/7f938da2-ffe5-4feb-988f-22bbc35e531f-configmap-serving-certs-ca-bundle" (OuterVolumeSpecName: "configmap-serving-certs-ca-bundle") pod "7f938da2-ffe5-4feb-988f-22bbc35e531f" (UID: "7f938da2-ffe5-4feb-988f-22bbc35e531f"). InnerVolumeSpecName "configmap-serving-certs-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 12 22:23:24.019706 ip-10-0-128-134 kubenswrapper[2559]: I0612 22:23:24.019675 2559 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/7f938da2-ffe5-4feb-988f-22bbc35e531f-prometheus-k8s-rulefiles-0" (OuterVolumeSpecName: "prometheus-k8s-rulefiles-0") pod "7f938da2-ffe5-4feb-988f-22bbc35e531f" (UID: "7f938da2-ffe5-4feb-988f-22bbc35e531f"). InnerVolumeSpecName "prometheus-k8s-rulefiles-0". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 12 22:23:24.019706 ip-10-0-128-134 kubenswrapper[2559]: I0612 22:23:24.019686 2559 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/7f938da2-ffe5-4feb-988f-22bbc35e531f-prometheus-trusted-ca-bundle" (OuterVolumeSpecName: "prometheus-trusted-ca-bundle") pod "7f938da2-ffe5-4feb-988f-22bbc35e531f" (UID: "7f938da2-ffe5-4feb-988f-22bbc35e531f"). InnerVolumeSpecName "prometheus-trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 12 22:23:24.020195 ip-10-0-128-134 kubenswrapper[2559]: I0612 22:23:24.020168 2559 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/7f938da2-ffe5-4feb-988f-22bbc35e531f-configmap-kubelet-serving-ca-bundle" (OuterVolumeSpecName: "configmap-kubelet-serving-ca-bundle") pod "7f938da2-ffe5-4feb-988f-22bbc35e531f" (UID: "7f938da2-ffe5-4feb-988f-22bbc35e531f"). InnerVolumeSpecName "configmap-kubelet-serving-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 12 22:23:24.020500 ip-10-0-128-134 kubenswrapper[2559]: I0612 22:23:24.020384 2559 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/7f938da2-ffe5-4feb-988f-22bbc35e531f-prometheus-k8s-rulefiles-1" (OuterVolumeSpecName: "prometheus-k8s-rulefiles-1") pod "7f938da2-ffe5-4feb-988f-22bbc35e531f" (UID: "7f938da2-ffe5-4feb-988f-22bbc35e531f"). InnerVolumeSpecName "prometheus-k8s-rulefiles-1". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 12 22:23:24.020747 ip-10-0-128-134 kubenswrapper[2559]: I0612 22:23:24.020727 2559 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/7f938da2-ffe5-4feb-988f-22bbc35e531f-kube-api-access-pkhfw" (OuterVolumeSpecName: "kube-api-access-pkhfw") pod "7f938da2-ffe5-4feb-988f-22bbc35e531f" (UID: "7f938da2-ffe5-4feb-988f-22bbc35e531f"). InnerVolumeSpecName "kube-api-access-pkhfw". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 12 22:23:24.020838 ip-10-0-128-134 kubenswrapper[2559]: I0612 22:23:24.020806 2559 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/7f938da2-ffe5-4feb-988f-22bbc35e531f-config-out" (OuterVolumeSpecName: "config-out") pod "7f938da2-ffe5-4feb-988f-22bbc35e531f" (UID: "7f938da2-ffe5-4feb-988f-22bbc35e531f"). InnerVolumeSpecName "config-out". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 12 22:23:24.021302 ip-10-0-128-134 kubenswrapper[2559]: I0612 22:23:24.021273 2559 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/7f938da2-ffe5-4feb-988f-22bbc35e531f-thanos-prometheus-http-client-file" (OuterVolumeSpecName: "thanos-prometheus-http-client-file") pod "7f938da2-ffe5-4feb-988f-22bbc35e531f" (UID: "7f938da2-ffe5-4feb-988f-22bbc35e531f"). InnerVolumeSpecName "thanos-prometheus-http-client-file". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 12 22:23:24.021702 ip-10-0-128-134 kubenswrapper[2559]: I0612 22:23:24.021676 2559 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/7f938da2-ffe5-4feb-988f-22bbc35e531f-prometheus-k8s-db" (OuterVolumeSpecName: "prometheus-k8s-db") pod "7f938da2-ffe5-4feb-988f-22bbc35e531f" (UID: "7f938da2-ffe5-4feb-988f-22bbc35e531f"). InnerVolumeSpecName "prometheus-k8s-db". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 12 22:23:24.021967 ip-10-0-128-134 kubenswrapper[2559]: I0612 22:23:24.021933 2559 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/7f938da2-ffe5-4feb-988f-22bbc35e531f-config" (OuterVolumeSpecName: "config") pod "7f938da2-ffe5-4feb-988f-22bbc35e531f" (UID: "7f938da2-ffe5-4feb-988f-22bbc35e531f"). InnerVolumeSpecName "config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 12 22:23:24.022989 ip-10-0-128-134 kubenswrapper[2559]: I0612 22:23:24.022959 2559 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/7f938da2-ffe5-4feb-988f-22bbc35e531f-secret-prometheus-k8s-thanos-sidecar-tls" (OuterVolumeSpecName: "secret-prometheus-k8s-thanos-sidecar-tls") pod "7f938da2-ffe5-4feb-988f-22bbc35e531f" (UID: "7f938da2-ffe5-4feb-988f-22bbc35e531f"). InnerVolumeSpecName "secret-prometheus-k8s-thanos-sidecar-tls". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 12 22:23:24.023085 ip-10-0-128-134 kubenswrapper[2559]: I0612 22:23:24.023053 2559 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/7f938da2-ffe5-4feb-988f-22bbc35e531f-secret-kube-rbac-proxy" (OuterVolumeSpecName: "secret-kube-rbac-proxy") pod "7f938da2-ffe5-4feb-988f-22bbc35e531f" (UID: "7f938da2-ffe5-4feb-988f-22bbc35e531f"). InnerVolumeSpecName "secret-kube-rbac-proxy". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 12 22:23:24.023294 ip-10-0-128-134 kubenswrapper[2559]: I0612 22:23:24.023265 2559 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/7f938da2-ffe5-4feb-988f-22bbc35e531f-secret-prometheus-k8s-kube-rbac-proxy-web" (OuterVolumeSpecName: "secret-prometheus-k8s-kube-rbac-proxy-web") pod "7f938da2-ffe5-4feb-988f-22bbc35e531f" (UID: "7f938da2-ffe5-4feb-988f-22bbc35e531f"). InnerVolumeSpecName "secret-prometheus-k8s-kube-rbac-proxy-web". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 12 22:23:24.023385 ip-10-0-128-134 kubenswrapper[2559]: I0612 22:23:24.023367 2559 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/7f938da2-ffe5-4feb-988f-22bbc35e531f-secret-grpc-tls" (OuterVolumeSpecName: "secret-grpc-tls") pod "7f938da2-ffe5-4feb-988f-22bbc35e531f" (UID: "7f938da2-ffe5-4feb-988f-22bbc35e531f"). InnerVolumeSpecName "secret-grpc-tls". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 12 22:23:24.023573 ip-10-0-128-134 kubenswrapper[2559]: I0612 22:23:24.023548 2559 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/7f938da2-ffe5-4feb-988f-22bbc35e531f-secret-prometheus-k8s-tls" (OuterVolumeSpecName: "secret-prometheus-k8s-tls") pod "7f938da2-ffe5-4feb-988f-22bbc35e531f" (UID: "7f938da2-ffe5-4feb-988f-22bbc35e531f"). InnerVolumeSpecName "secret-prometheus-k8s-tls". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 12 22:23:24.023677 ip-10-0-128-134 kubenswrapper[2559]: I0612 22:23:24.023615 2559 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/7f938da2-ffe5-4feb-988f-22bbc35e531f-secret-metrics-client-certs" (OuterVolumeSpecName: "secret-metrics-client-certs") pod "7f938da2-ffe5-4feb-988f-22bbc35e531f" (UID: "7f938da2-ffe5-4feb-988f-22bbc35e531f"). InnerVolumeSpecName "secret-metrics-client-certs". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 12 22:23:24.023765 ip-10-0-128-134 kubenswrapper[2559]: I0612 22:23:24.023748 2559 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/7f938da2-ffe5-4feb-988f-22bbc35e531f-tls-assets" (OuterVolumeSpecName: "tls-assets") pod "7f938da2-ffe5-4feb-988f-22bbc35e531f" (UID: "7f938da2-ffe5-4feb-988f-22bbc35e531f"). InnerVolumeSpecName "tls-assets". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 12 22:23:24.032646 ip-10-0-128-134 kubenswrapper[2559]: I0612 22:23:24.032624 2559 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/7f938da2-ffe5-4feb-988f-22bbc35e531f-web-config" (OuterVolumeSpecName: "web-config") pod "7f938da2-ffe5-4feb-988f-22bbc35e531f" (UID: "7f938da2-ffe5-4feb-988f-22bbc35e531f"). InnerVolumeSpecName "web-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 12 22:23:24.119531 ip-10-0-128-134 kubenswrapper[2559]: I0612 22:23:24.119496 2559 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-pkhfw\" (UniqueName: \"kubernetes.io/projected/7f938da2-ffe5-4feb-988f-22bbc35e531f-kube-api-access-pkhfw\") on node \"ip-10-0-128-134.ec2.internal\" DevicePath \"\"" Jun 12 22:23:24.119531 ip-10-0-128-134 kubenswrapper[2559]: I0612 22:23:24.119526 2559 reconciler_common.go:299] "Volume detached for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/7f938da2-ffe5-4feb-988f-22bbc35e531f-thanos-prometheus-http-client-file\") on node \"ip-10-0-128-134.ec2.internal\" DevicePath \"\"" Jun 12 22:23:24.119531 ip-10-0-128-134 kubenswrapper[2559]: I0612 22:23:24.119537 2559 reconciler_common.go:299] "Volume detached for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/7f938da2-ffe5-4feb-988f-22bbc35e531f-config-out\") on node \"ip-10-0-128-134.ec2.internal\" DevicePath \"\"" Jun 12 22:23:24.119757 ip-10-0-128-134 kubenswrapper[2559]: I0612 22:23:24.119546 2559 reconciler_common.go:299] "Volume detached for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/7f938da2-ffe5-4feb-988f-22bbc35e531f-secret-prometheus-k8s-thanos-sidecar-tls\") on node \"ip-10-0-128-134.ec2.internal\" DevicePath \"\"" Jun 12 22:23:24.119757 ip-10-0-128-134 kubenswrapper[2559]: I0612 22:23:24.119554 2559 reconciler_common.go:299] "Volume detached for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/7f938da2-ffe5-4feb-988f-22bbc35e531f-secret-grpc-tls\") on node \"ip-10-0-128-134.ec2.internal\" DevicePath \"\"" Jun 12 22:23:24.119757 ip-10-0-128-134 kubenswrapper[2559]: I0612 22:23:24.119564 2559 reconciler_common.go:299] "Volume detached for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/7f938da2-ffe5-4feb-988f-22bbc35e531f-prometheus-k8s-rulefiles-1\") on node \"ip-10-0-128-134.ec2.internal\" DevicePath \"\"" Jun 12 22:23:24.119757 ip-10-0-128-134 kubenswrapper[2559]: I0612 22:23:24.119572 2559 reconciler_common.go:299] "Volume detached for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/7f938da2-ffe5-4feb-988f-22bbc35e531f-prometheus-k8s-db\") on node \"ip-10-0-128-134.ec2.internal\" DevicePath \"\"" Jun 12 22:23:24.119757 ip-10-0-128-134 kubenswrapper[2559]: I0612 22:23:24.119582 2559 reconciler_common.go:299] "Volume detached for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/7f938da2-ffe5-4feb-988f-22bbc35e531f-secret-prometheus-k8s-tls\") on node \"ip-10-0-128-134.ec2.internal\" DevicePath \"\"" Jun 12 22:23:24.119757 ip-10-0-128-134 kubenswrapper[2559]: I0612 22:23:24.119590 2559 reconciler_common.go:299] "Volume detached for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/7f938da2-ffe5-4feb-988f-22bbc35e531f-configmap-serving-certs-ca-bundle\") on node \"ip-10-0-128-134.ec2.internal\" DevicePath \"\"" Jun 12 22:23:24.119757 ip-10-0-128-134 kubenswrapper[2559]: I0612 22:23:24.119601 2559 reconciler_common.go:299] "Volume detached for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/7f938da2-ffe5-4feb-988f-22bbc35e531f-web-config\") on node \"ip-10-0-128-134.ec2.internal\" DevicePath \"\"" Jun 12 22:23:24.119757 ip-10-0-128-134 kubenswrapper[2559]: I0612 22:23:24.119610 2559 reconciler_common.go:299] "Volume detached for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/7f938da2-ffe5-4feb-988f-22bbc35e531f-tls-assets\") on node \"ip-10-0-128-134.ec2.internal\" DevicePath \"\"" Jun 12 22:23:24.119757 ip-10-0-128-134 kubenswrapper[2559]: I0612 22:23:24.119617 2559 reconciler_common.go:299] "Volume detached for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/7f938da2-ffe5-4feb-988f-22bbc35e531f-secret-metrics-client-certs\") on node \"ip-10-0-128-134.ec2.internal\" DevicePath \"\"" Jun 12 22:23:24.119757 ip-10-0-128-134 kubenswrapper[2559]: I0612 22:23:24.119625 2559 reconciler_common.go:299] "Volume detached for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/7f938da2-ffe5-4feb-988f-22bbc35e531f-prometheus-trusted-ca-bundle\") on node \"ip-10-0-128-134.ec2.internal\" DevicePath \"\"" Jun 12 22:23:24.119757 ip-10-0-128-134 kubenswrapper[2559]: I0612 22:23:24.119634 2559 reconciler_common.go:299] "Volume detached for volume \"config\" (UniqueName: \"kubernetes.io/secret/7f938da2-ffe5-4feb-988f-22bbc35e531f-config\") on node \"ip-10-0-128-134.ec2.internal\" DevicePath \"\"" Jun 12 22:23:24.119757 ip-10-0-128-134 kubenswrapper[2559]: I0612 22:23:24.119642 2559 reconciler_common.go:299] "Volume detached for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/7f938da2-ffe5-4feb-988f-22bbc35e531f-configmap-kubelet-serving-ca-bundle\") on node \"ip-10-0-128-134.ec2.internal\" DevicePath \"\"" Jun 12 22:23:24.119757 ip-10-0-128-134 kubenswrapper[2559]: I0612 22:23:24.119650 2559 reconciler_common.go:299] "Volume detached for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/7f938da2-ffe5-4feb-988f-22bbc35e531f-secret-prometheus-k8s-kube-rbac-proxy-web\") on node \"ip-10-0-128-134.ec2.internal\" DevicePath \"\"" Jun 12 22:23:24.119757 ip-10-0-128-134 kubenswrapper[2559]: I0612 22:23:24.119658 2559 reconciler_common.go:299] "Volume detached for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/7f938da2-ffe5-4feb-988f-22bbc35e531f-secret-kube-rbac-proxy\") on node \"ip-10-0-128-134.ec2.internal\" DevicePath \"\"" Jun 12 22:23:24.119757 ip-10-0-128-134 kubenswrapper[2559]: I0612 22:23:24.119666 2559 reconciler_common.go:299] "Volume detached for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/7f938da2-ffe5-4feb-988f-22bbc35e531f-prometheus-k8s-rulefiles-0\") on node \"ip-10-0-128-134.ec2.internal\" DevicePath \"\"" Jun 12 22:23:24.215232 ip-10-0-128-134 kubenswrapper[2559]: I0612 22:23:24.215198 2559 generic.go:356] "Generic (PLEG): container finished" podID="7f938da2-ffe5-4feb-988f-22bbc35e531f" containerID="93efbbf6f7581a4f314bfd8301608874210eeff8bb579f02eadb8baac6b0800f" exitCode=0 Jun 12 22:23:24.215232 ip-10-0-128-134 kubenswrapper[2559]: I0612 22:23:24.215230 2559 generic.go:356] "Generic (PLEG): container finished" podID="7f938da2-ffe5-4feb-988f-22bbc35e531f" containerID="00e32bcb0aa0707cb776f6821ec7b8097e196f72126b66fab61025b5746d541f" exitCode=0 Jun 12 22:23:24.215232 ip-10-0-128-134 kubenswrapper[2559]: I0612 22:23:24.215239 2559 generic.go:356] "Generic (PLEG): container finished" podID="7f938da2-ffe5-4feb-988f-22bbc35e531f" containerID="4299c05e286c1cc9a79799029d8eee24f3ab64c55860260d80207f2f4d89ffed" exitCode=0 Jun 12 22:23:24.215787 ip-10-0-128-134 kubenswrapper[2559]: I0612 22:23:24.215247 2559 generic.go:356] "Generic (PLEG): container finished" podID="7f938da2-ffe5-4feb-988f-22bbc35e531f" containerID="a1f6f08ada38cf5826b49c75c834785e9f4d042c204466b996a4bfd9d73f1e69" exitCode=0 Jun 12 22:23:24.215787 ip-10-0-128-134 kubenswrapper[2559]: I0612 22:23:24.215255 2559 generic.go:356] "Generic (PLEG): container finished" podID="7f938da2-ffe5-4feb-988f-22bbc35e531f" containerID="bde92804a49e1037334e3fbe53bc09a6109a381182c1d66897f32f7e261d1dce" exitCode=0 Jun 12 22:23:24.215787 ip-10-0-128-134 kubenswrapper[2559]: I0612 22:23:24.215266 2559 generic.go:356] "Generic (PLEG): container finished" podID="7f938da2-ffe5-4feb-988f-22bbc35e531f" containerID="c963547e8486c32795df13ed7ed7556daab5bec95e9d840cd097a0524f16d488" exitCode=0 Jun 12 22:23:24.215787 ip-10-0-128-134 kubenswrapper[2559]: I0612 22:23:24.215275 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"7f938da2-ffe5-4feb-988f-22bbc35e531f","Type":"ContainerDied","Data":"93efbbf6f7581a4f314bfd8301608874210eeff8bb579f02eadb8baac6b0800f"} Jun 12 22:23:24.215787 ip-10-0-128-134 kubenswrapper[2559]: I0612 22:23:24.215291 2559 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0" Jun 12 22:23:24.215787 ip-10-0-128-134 kubenswrapper[2559]: I0612 22:23:24.215378 2559 scope.go:117] "RemoveContainer" containerID="93efbbf6f7581a4f314bfd8301608874210eeff8bb579f02eadb8baac6b0800f" Jun 12 22:23:24.215787 ip-10-0-128-134 kubenswrapper[2559]: I0612 22:23:24.215363 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"7f938da2-ffe5-4feb-988f-22bbc35e531f","Type":"ContainerDied","Data":"00e32bcb0aa0707cb776f6821ec7b8097e196f72126b66fab61025b5746d541f"} Jun 12 22:23:24.215787 ip-10-0-128-134 kubenswrapper[2559]: I0612 22:23:24.215515 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"7f938da2-ffe5-4feb-988f-22bbc35e531f","Type":"ContainerDied","Data":"4299c05e286c1cc9a79799029d8eee24f3ab64c55860260d80207f2f4d89ffed"} Jun 12 22:23:24.215787 ip-10-0-128-134 kubenswrapper[2559]: I0612 22:23:24.215561 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"7f938da2-ffe5-4feb-988f-22bbc35e531f","Type":"ContainerDied","Data":"a1f6f08ada38cf5826b49c75c834785e9f4d042c204466b996a4bfd9d73f1e69"} Jun 12 22:23:24.215787 ip-10-0-128-134 kubenswrapper[2559]: I0612 22:23:24.215602 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"7f938da2-ffe5-4feb-988f-22bbc35e531f","Type":"ContainerDied","Data":"bde92804a49e1037334e3fbe53bc09a6109a381182c1d66897f32f7e261d1dce"} Jun 12 22:23:24.215787 ip-10-0-128-134 kubenswrapper[2559]: I0612 22:23:24.215633 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"7f938da2-ffe5-4feb-988f-22bbc35e531f","Type":"ContainerDied","Data":"c963547e8486c32795df13ed7ed7556daab5bec95e9d840cd097a0524f16d488"} Jun 12 22:23:24.215787 ip-10-0-128-134 kubenswrapper[2559]: I0612 22:23:24.215675 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"7f938da2-ffe5-4feb-988f-22bbc35e531f","Type":"ContainerDied","Data":"882777be4eb1130ac16e6f36676eb44316b94f2ad08565aab22c8c76dd35a369"} Jun 12 22:23:24.226670 ip-10-0-128-134 kubenswrapper[2559]: I0612 22:23:24.224422 2559 scope.go:117] "RemoveContainer" containerID="00e32bcb0aa0707cb776f6821ec7b8097e196f72126b66fab61025b5746d541f" Jun 12 22:23:24.234127 ip-10-0-128-134 kubenswrapper[2559]: I0612 22:23:24.234107 2559 scope.go:117] "RemoveContainer" containerID="4299c05e286c1cc9a79799029d8eee24f3ab64c55860260d80207f2f4d89ffed" Jun 12 22:23:24.240847 ip-10-0-128-134 kubenswrapper[2559]: I0612 22:23:24.240829 2559 scope.go:117] "RemoveContainer" containerID="a1f6f08ada38cf5826b49c75c834785e9f4d042c204466b996a4bfd9d73f1e69" Jun 12 22:23:24.242763 ip-10-0-128-134 kubenswrapper[2559]: I0612 22:23:24.242745 2559 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Jun 12 22:23:24.247018 ip-10-0-128-134 kubenswrapper[2559]: I0612 22:23:24.246998 2559 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Jun 12 22:23:24.249060 ip-10-0-128-134 kubenswrapper[2559]: I0612 22:23:24.249045 2559 scope.go:117] "RemoveContainer" containerID="bde92804a49e1037334e3fbe53bc09a6109a381182c1d66897f32f7e261d1dce" Jun 12 22:23:24.255762 ip-10-0-128-134 kubenswrapper[2559]: I0612 22:23:24.255748 2559 scope.go:117] "RemoveContainer" containerID="c963547e8486c32795df13ed7ed7556daab5bec95e9d840cd097a0524f16d488" Jun 12 22:23:24.262824 ip-10-0-128-134 kubenswrapper[2559]: I0612 22:23:24.262805 2559 scope.go:117] "RemoveContainer" containerID="658f3039844ce2d5a879bb100befc6969364d0f11ed9b8070d596c57f6760c56" Jun 12 22:23:24.269555 ip-10-0-128-134 kubenswrapper[2559]: I0612 22:23:24.269490 2559 scope.go:117] "RemoveContainer" containerID="93efbbf6f7581a4f314bfd8301608874210eeff8bb579f02eadb8baac6b0800f" Jun 12 22:23:24.269813 ip-10-0-128-134 kubenswrapper[2559]: E0612 22:23:24.269780 2559 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"93efbbf6f7581a4f314bfd8301608874210eeff8bb579f02eadb8baac6b0800f\": container with ID starting with 93efbbf6f7581a4f314bfd8301608874210eeff8bb579f02eadb8baac6b0800f not found: ID does not exist" containerID="93efbbf6f7581a4f314bfd8301608874210eeff8bb579f02eadb8baac6b0800f" Jun 12 22:23:24.269866 ip-10-0-128-134 kubenswrapper[2559]: I0612 22:23:24.269826 2559 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"93efbbf6f7581a4f314bfd8301608874210eeff8bb579f02eadb8baac6b0800f"} err="failed to get container status \"93efbbf6f7581a4f314bfd8301608874210eeff8bb579f02eadb8baac6b0800f\": rpc error: code = NotFound desc = could not find container \"93efbbf6f7581a4f314bfd8301608874210eeff8bb579f02eadb8baac6b0800f\": container with ID starting with 93efbbf6f7581a4f314bfd8301608874210eeff8bb579f02eadb8baac6b0800f not found: ID does not exist" Jun 12 22:23:24.269866 ip-10-0-128-134 kubenswrapper[2559]: I0612 22:23:24.269852 2559 scope.go:117] "RemoveContainer" containerID="00e32bcb0aa0707cb776f6821ec7b8097e196f72126b66fab61025b5746d541f" Jun 12 22:23:24.270131 ip-10-0-128-134 kubenswrapper[2559]: E0612 22:23:24.270114 2559 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"00e32bcb0aa0707cb776f6821ec7b8097e196f72126b66fab61025b5746d541f\": container with ID starting with 00e32bcb0aa0707cb776f6821ec7b8097e196f72126b66fab61025b5746d541f not found: ID does not exist" containerID="00e32bcb0aa0707cb776f6821ec7b8097e196f72126b66fab61025b5746d541f" Jun 12 22:23:24.270175 ip-10-0-128-134 kubenswrapper[2559]: I0612 22:23:24.270137 2559 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"00e32bcb0aa0707cb776f6821ec7b8097e196f72126b66fab61025b5746d541f"} err="failed to get container status \"00e32bcb0aa0707cb776f6821ec7b8097e196f72126b66fab61025b5746d541f\": rpc error: code = NotFound desc = could not find container \"00e32bcb0aa0707cb776f6821ec7b8097e196f72126b66fab61025b5746d541f\": container with ID starting with 00e32bcb0aa0707cb776f6821ec7b8097e196f72126b66fab61025b5746d541f not found: ID does not exist" Jun 12 22:23:24.270175 ip-10-0-128-134 kubenswrapper[2559]: I0612 22:23:24.270151 2559 scope.go:117] "RemoveContainer" containerID="4299c05e286c1cc9a79799029d8eee24f3ab64c55860260d80207f2f4d89ffed" Jun 12 22:23:24.270374 ip-10-0-128-134 kubenswrapper[2559]: E0612 22:23:24.270359 2559 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"4299c05e286c1cc9a79799029d8eee24f3ab64c55860260d80207f2f4d89ffed\": container with ID starting with 4299c05e286c1cc9a79799029d8eee24f3ab64c55860260d80207f2f4d89ffed not found: ID does not exist" containerID="4299c05e286c1cc9a79799029d8eee24f3ab64c55860260d80207f2f4d89ffed" Jun 12 22:23:24.270413 ip-10-0-128-134 kubenswrapper[2559]: I0612 22:23:24.270379 2559 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"4299c05e286c1cc9a79799029d8eee24f3ab64c55860260d80207f2f4d89ffed"} err="failed to get container status \"4299c05e286c1cc9a79799029d8eee24f3ab64c55860260d80207f2f4d89ffed\": rpc error: code = NotFound desc = could not find container \"4299c05e286c1cc9a79799029d8eee24f3ab64c55860260d80207f2f4d89ffed\": container with ID starting with 4299c05e286c1cc9a79799029d8eee24f3ab64c55860260d80207f2f4d89ffed not found: ID does not exist" Jun 12 22:23:24.270413 ip-10-0-128-134 kubenswrapper[2559]: I0612 22:23:24.270392 2559 scope.go:117] "RemoveContainer" containerID="a1f6f08ada38cf5826b49c75c834785e9f4d042c204466b996a4bfd9d73f1e69" Jun 12 22:23:24.270728 ip-10-0-128-134 kubenswrapper[2559]: E0612 22:23:24.270701 2559 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"a1f6f08ada38cf5826b49c75c834785e9f4d042c204466b996a4bfd9d73f1e69\": container with ID starting with a1f6f08ada38cf5826b49c75c834785e9f4d042c204466b996a4bfd9d73f1e69 not found: ID does not exist" containerID="a1f6f08ada38cf5826b49c75c834785e9f4d042c204466b996a4bfd9d73f1e69" Jun 12 22:23:24.270822 ip-10-0-128-134 kubenswrapper[2559]: I0612 22:23:24.270738 2559 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Jun 12 22:23:24.270822 ip-10-0-128-134 kubenswrapper[2559]: I0612 22:23:24.270739 2559 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"a1f6f08ada38cf5826b49c75c834785e9f4d042c204466b996a4bfd9d73f1e69"} err="failed to get container status \"a1f6f08ada38cf5826b49c75c834785e9f4d042c204466b996a4bfd9d73f1e69\": rpc error: code = NotFound desc = could not find container \"a1f6f08ada38cf5826b49c75c834785e9f4d042c204466b996a4bfd9d73f1e69\": container with ID starting with a1f6f08ada38cf5826b49c75c834785e9f4d042c204466b996a4bfd9d73f1e69 not found: ID does not exist" Jun 12 22:23:24.270822 ip-10-0-128-134 kubenswrapper[2559]: I0612 22:23:24.270761 2559 scope.go:117] "RemoveContainer" containerID="bde92804a49e1037334e3fbe53bc09a6109a381182c1d66897f32f7e261d1dce" Jun 12 22:23:24.271003 ip-10-0-128-134 kubenswrapper[2559]: E0612 22:23:24.270980 2559 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"bde92804a49e1037334e3fbe53bc09a6109a381182c1d66897f32f7e261d1dce\": container with ID starting with bde92804a49e1037334e3fbe53bc09a6109a381182c1d66897f32f7e261d1dce not found: ID does not exist" containerID="bde92804a49e1037334e3fbe53bc09a6109a381182c1d66897f32f7e261d1dce" Jun 12 22:23:24.271038 ip-10-0-128-134 kubenswrapper[2559]: I0612 22:23:24.271009 2559 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"bde92804a49e1037334e3fbe53bc09a6109a381182c1d66897f32f7e261d1dce"} err="failed to get container status \"bde92804a49e1037334e3fbe53bc09a6109a381182c1d66897f32f7e261d1dce\": rpc error: code = NotFound desc = could not find container \"bde92804a49e1037334e3fbe53bc09a6109a381182c1d66897f32f7e261d1dce\": container with ID starting with bde92804a49e1037334e3fbe53bc09a6109a381182c1d66897f32f7e261d1dce not found: ID does not exist" Jun 12 22:23:24.271038 ip-10-0-128-134 kubenswrapper[2559]: I0612 22:23:24.271023 2559 scope.go:117] "RemoveContainer" containerID="c963547e8486c32795df13ed7ed7556daab5bec95e9d840cd097a0524f16d488" Jun 12 22:23:24.271114 ip-10-0-128-134 kubenswrapper[2559]: I0612 22:23:24.271048 2559 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="7f938da2-ffe5-4feb-988f-22bbc35e531f" containerName="init-config-reloader" Jun 12 22:23:24.271114 ip-10-0-128-134 kubenswrapper[2559]: I0612 22:23:24.271061 2559 state_mem.go:107] "Deleted CPUSet assignment" podUID="7f938da2-ffe5-4feb-988f-22bbc35e531f" containerName="init-config-reloader" Jun 12 22:23:24.271114 ip-10-0-128-134 kubenswrapper[2559]: I0612 22:23:24.271075 2559 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="7f938da2-ffe5-4feb-988f-22bbc35e531f" containerName="config-reloader" Jun 12 22:23:24.271114 ip-10-0-128-134 kubenswrapper[2559]: I0612 22:23:24.271081 2559 state_mem.go:107] "Deleted CPUSet assignment" podUID="7f938da2-ffe5-4feb-988f-22bbc35e531f" containerName="config-reloader" Jun 12 22:23:24.271114 ip-10-0-128-134 kubenswrapper[2559]: I0612 22:23:24.271088 2559 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="7f938da2-ffe5-4feb-988f-22bbc35e531f" containerName="thanos-sidecar" Jun 12 22:23:24.271114 ip-10-0-128-134 kubenswrapper[2559]: I0612 22:23:24.271094 2559 state_mem.go:107] "Deleted CPUSet assignment" podUID="7f938da2-ffe5-4feb-988f-22bbc35e531f" containerName="thanos-sidecar" Jun 12 22:23:24.271114 ip-10-0-128-134 kubenswrapper[2559]: I0612 22:23:24.271101 2559 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="7f938da2-ffe5-4feb-988f-22bbc35e531f" containerName="prometheus" Jun 12 22:23:24.271114 ip-10-0-128-134 kubenswrapper[2559]: I0612 22:23:24.271105 2559 state_mem.go:107] "Deleted CPUSet assignment" podUID="7f938da2-ffe5-4feb-988f-22bbc35e531f" containerName="prometheus" Jun 12 22:23:24.271114 ip-10-0-128-134 kubenswrapper[2559]: I0612 22:23:24.271115 2559 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="7f938da2-ffe5-4feb-988f-22bbc35e531f" containerName="kube-rbac-proxy-thanos" Jun 12 22:23:24.271114 ip-10-0-128-134 kubenswrapper[2559]: I0612 22:23:24.271120 2559 state_mem.go:107] "Deleted CPUSet assignment" podUID="7f938da2-ffe5-4feb-988f-22bbc35e531f" containerName="kube-rbac-proxy-thanos" Jun 12 22:23:24.271501 ip-10-0-128-134 kubenswrapper[2559]: I0612 22:23:24.271128 2559 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="7f938da2-ffe5-4feb-988f-22bbc35e531f" containerName="kube-rbac-proxy-web" Jun 12 22:23:24.271501 ip-10-0-128-134 kubenswrapper[2559]: I0612 22:23:24.271133 2559 state_mem.go:107] "Deleted CPUSet assignment" podUID="7f938da2-ffe5-4feb-988f-22bbc35e531f" containerName="kube-rbac-proxy-web" Jun 12 22:23:24.271501 ip-10-0-128-134 kubenswrapper[2559]: I0612 22:23:24.271138 2559 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="7f938da2-ffe5-4feb-988f-22bbc35e531f" containerName="kube-rbac-proxy" Jun 12 22:23:24.271501 ip-10-0-128-134 kubenswrapper[2559]: I0612 22:23:24.271143 2559 state_mem.go:107] "Deleted CPUSet assignment" podUID="7f938da2-ffe5-4feb-988f-22bbc35e531f" containerName="kube-rbac-proxy" Jun 12 22:23:24.271501 ip-10-0-128-134 kubenswrapper[2559]: I0612 22:23:24.271205 2559 memory_manager.go:368] "RemoveStaleState removing state" podUID="7f938da2-ffe5-4feb-988f-22bbc35e531f" containerName="prometheus" Jun 12 22:23:24.271501 ip-10-0-128-134 kubenswrapper[2559]: I0612 22:23:24.271214 2559 memory_manager.go:368] "RemoveStaleState removing state" podUID="7f938da2-ffe5-4feb-988f-22bbc35e531f" containerName="kube-rbac-proxy-thanos" Jun 12 22:23:24.271501 ip-10-0-128-134 kubenswrapper[2559]: I0612 22:23:24.271222 2559 memory_manager.go:368] "RemoveStaleState removing state" podUID="7f938da2-ffe5-4feb-988f-22bbc35e531f" containerName="config-reloader" Jun 12 22:23:24.271501 ip-10-0-128-134 kubenswrapper[2559]: I0612 22:23:24.271230 2559 memory_manager.go:368] "RemoveStaleState removing state" podUID="7f938da2-ffe5-4feb-988f-22bbc35e531f" containerName="kube-rbac-proxy-web" Jun 12 22:23:24.271501 ip-10-0-128-134 kubenswrapper[2559]: I0612 22:23:24.271237 2559 memory_manager.go:368] "RemoveStaleState removing state" podUID="7f938da2-ffe5-4feb-988f-22bbc35e531f" containerName="kube-rbac-proxy" Jun 12 22:23:24.271501 ip-10-0-128-134 kubenswrapper[2559]: I0612 22:23:24.271243 2559 memory_manager.go:368] "RemoveStaleState removing state" podUID="7f938da2-ffe5-4feb-988f-22bbc35e531f" containerName="thanos-sidecar" Jun 12 22:23:24.271501 ip-10-0-128-134 kubenswrapper[2559]: E0612 22:23:24.271297 2559 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"c963547e8486c32795df13ed7ed7556daab5bec95e9d840cd097a0524f16d488\": container with ID starting with c963547e8486c32795df13ed7ed7556daab5bec95e9d840cd097a0524f16d488 not found: ID does not exist" containerID="c963547e8486c32795df13ed7ed7556daab5bec95e9d840cd097a0524f16d488" Jun 12 22:23:24.271501 ip-10-0-128-134 kubenswrapper[2559]: I0612 22:23:24.271312 2559 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"c963547e8486c32795df13ed7ed7556daab5bec95e9d840cd097a0524f16d488"} err="failed to get container status \"c963547e8486c32795df13ed7ed7556daab5bec95e9d840cd097a0524f16d488\": rpc error: code = NotFound desc = could not find container \"c963547e8486c32795df13ed7ed7556daab5bec95e9d840cd097a0524f16d488\": container with ID starting with c963547e8486c32795df13ed7ed7556daab5bec95e9d840cd097a0524f16d488 not found: ID does not exist" Jun 12 22:23:24.271501 ip-10-0-128-134 kubenswrapper[2559]: I0612 22:23:24.271323 2559 scope.go:117] "RemoveContainer" containerID="658f3039844ce2d5a879bb100befc6969364d0f11ed9b8070d596c57f6760c56" Jun 12 22:23:24.271908 ip-10-0-128-134 kubenswrapper[2559]: E0612 22:23:24.271561 2559 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"658f3039844ce2d5a879bb100befc6969364d0f11ed9b8070d596c57f6760c56\": container with ID starting with 658f3039844ce2d5a879bb100befc6969364d0f11ed9b8070d596c57f6760c56 not found: ID does not exist" containerID="658f3039844ce2d5a879bb100befc6969364d0f11ed9b8070d596c57f6760c56" Jun 12 22:23:24.271908 ip-10-0-128-134 kubenswrapper[2559]: I0612 22:23:24.271577 2559 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"658f3039844ce2d5a879bb100befc6969364d0f11ed9b8070d596c57f6760c56"} err="failed to get container status \"658f3039844ce2d5a879bb100befc6969364d0f11ed9b8070d596c57f6760c56\": rpc error: code = NotFound desc = could not find container \"658f3039844ce2d5a879bb100befc6969364d0f11ed9b8070d596c57f6760c56\": container with ID starting with 658f3039844ce2d5a879bb100befc6969364d0f11ed9b8070d596c57f6760c56 not found: ID does not exist" Jun 12 22:23:24.271908 ip-10-0-128-134 kubenswrapper[2559]: I0612 22:23:24.271588 2559 scope.go:117] "RemoveContainer" containerID="93efbbf6f7581a4f314bfd8301608874210eeff8bb579f02eadb8baac6b0800f" Jun 12 22:23:24.271908 ip-10-0-128-134 kubenswrapper[2559]: I0612 22:23:24.271774 2559 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"93efbbf6f7581a4f314bfd8301608874210eeff8bb579f02eadb8baac6b0800f"} err="failed to get container status \"93efbbf6f7581a4f314bfd8301608874210eeff8bb579f02eadb8baac6b0800f\": rpc error: code = NotFound desc = could not find container \"93efbbf6f7581a4f314bfd8301608874210eeff8bb579f02eadb8baac6b0800f\": container with ID starting with 93efbbf6f7581a4f314bfd8301608874210eeff8bb579f02eadb8baac6b0800f not found: ID does not exist" Jun 12 22:23:24.271908 ip-10-0-128-134 kubenswrapper[2559]: I0612 22:23:24.271792 2559 scope.go:117] "RemoveContainer" containerID="00e32bcb0aa0707cb776f6821ec7b8097e196f72126b66fab61025b5746d541f" Jun 12 22:23:24.272058 ip-10-0-128-134 kubenswrapper[2559]: I0612 22:23:24.271969 2559 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"00e32bcb0aa0707cb776f6821ec7b8097e196f72126b66fab61025b5746d541f"} err="failed to get container status \"00e32bcb0aa0707cb776f6821ec7b8097e196f72126b66fab61025b5746d541f\": rpc error: code = NotFound desc = could not find container \"00e32bcb0aa0707cb776f6821ec7b8097e196f72126b66fab61025b5746d541f\": container with ID starting with 00e32bcb0aa0707cb776f6821ec7b8097e196f72126b66fab61025b5746d541f not found: ID does not exist" Jun 12 22:23:24.272058 ip-10-0-128-134 kubenswrapper[2559]: I0612 22:23:24.271981 2559 scope.go:117] "RemoveContainer" containerID="4299c05e286c1cc9a79799029d8eee24f3ab64c55860260d80207f2f4d89ffed" Jun 12 22:23:24.272162 ip-10-0-128-134 kubenswrapper[2559]: I0612 22:23:24.272147 2559 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"4299c05e286c1cc9a79799029d8eee24f3ab64c55860260d80207f2f4d89ffed"} err="failed to get container status \"4299c05e286c1cc9a79799029d8eee24f3ab64c55860260d80207f2f4d89ffed\": rpc error: code = NotFound desc = could not find container \"4299c05e286c1cc9a79799029d8eee24f3ab64c55860260d80207f2f4d89ffed\": container with ID starting with 4299c05e286c1cc9a79799029d8eee24f3ab64c55860260d80207f2f4d89ffed not found: ID does not exist" Jun 12 22:23:24.272203 ip-10-0-128-134 kubenswrapper[2559]: I0612 22:23:24.272162 2559 scope.go:117] "RemoveContainer" containerID="a1f6f08ada38cf5826b49c75c834785e9f4d042c204466b996a4bfd9d73f1e69" Jun 12 22:23:24.272312 ip-10-0-128-134 kubenswrapper[2559]: I0612 22:23:24.272296 2559 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"a1f6f08ada38cf5826b49c75c834785e9f4d042c204466b996a4bfd9d73f1e69"} err="failed to get container status \"a1f6f08ada38cf5826b49c75c834785e9f4d042c204466b996a4bfd9d73f1e69\": rpc error: code = NotFound desc = could not find container \"a1f6f08ada38cf5826b49c75c834785e9f4d042c204466b996a4bfd9d73f1e69\": container with ID starting with a1f6f08ada38cf5826b49c75c834785e9f4d042c204466b996a4bfd9d73f1e69 not found: ID does not exist" Jun 12 22:23:24.272350 ip-10-0-128-134 kubenswrapper[2559]: I0612 22:23:24.272312 2559 scope.go:117] "RemoveContainer" containerID="bde92804a49e1037334e3fbe53bc09a6109a381182c1d66897f32f7e261d1dce" Jun 12 22:23:24.272614 ip-10-0-128-134 kubenswrapper[2559]: I0612 22:23:24.272597 2559 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"bde92804a49e1037334e3fbe53bc09a6109a381182c1d66897f32f7e261d1dce"} err="failed to get container status \"bde92804a49e1037334e3fbe53bc09a6109a381182c1d66897f32f7e261d1dce\": rpc error: code = NotFound desc = could not find container \"bde92804a49e1037334e3fbe53bc09a6109a381182c1d66897f32f7e261d1dce\": container with ID starting with bde92804a49e1037334e3fbe53bc09a6109a381182c1d66897f32f7e261d1dce not found: ID does not exist" Jun 12 22:23:24.272614 ip-10-0-128-134 kubenswrapper[2559]: I0612 22:23:24.272612 2559 scope.go:117] "RemoveContainer" containerID="c963547e8486c32795df13ed7ed7556daab5bec95e9d840cd097a0524f16d488" Jun 12 22:23:24.272844 ip-10-0-128-134 kubenswrapper[2559]: I0612 22:23:24.272826 2559 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"c963547e8486c32795df13ed7ed7556daab5bec95e9d840cd097a0524f16d488"} err="failed to get container status \"c963547e8486c32795df13ed7ed7556daab5bec95e9d840cd097a0524f16d488\": rpc error: code = NotFound desc = could not find container \"c963547e8486c32795df13ed7ed7556daab5bec95e9d840cd097a0524f16d488\": container with ID starting with c963547e8486c32795df13ed7ed7556daab5bec95e9d840cd097a0524f16d488 not found: ID does not exist" Jun 12 22:23:24.272904 ip-10-0-128-134 kubenswrapper[2559]: I0612 22:23:24.272846 2559 scope.go:117] "RemoveContainer" containerID="658f3039844ce2d5a879bb100befc6969364d0f11ed9b8070d596c57f6760c56" Jun 12 22:23:24.273102 ip-10-0-128-134 kubenswrapper[2559]: I0612 22:23:24.273085 2559 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"658f3039844ce2d5a879bb100befc6969364d0f11ed9b8070d596c57f6760c56"} err="failed to get container status \"658f3039844ce2d5a879bb100befc6969364d0f11ed9b8070d596c57f6760c56\": rpc error: code = NotFound desc = could not find container \"658f3039844ce2d5a879bb100befc6969364d0f11ed9b8070d596c57f6760c56\": container with ID starting with 658f3039844ce2d5a879bb100befc6969364d0f11ed9b8070d596c57f6760c56 not found: ID does not exist" Jun 12 22:23:24.273153 ip-10-0-128-134 kubenswrapper[2559]: I0612 22:23:24.273102 2559 scope.go:117] "RemoveContainer" containerID="93efbbf6f7581a4f314bfd8301608874210eeff8bb579f02eadb8baac6b0800f" Jun 12 22:23:24.273299 ip-10-0-128-134 kubenswrapper[2559]: I0612 22:23:24.273283 2559 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"93efbbf6f7581a4f314bfd8301608874210eeff8bb579f02eadb8baac6b0800f"} err="failed to get container status \"93efbbf6f7581a4f314bfd8301608874210eeff8bb579f02eadb8baac6b0800f\": rpc error: code = NotFound desc = could not find container \"93efbbf6f7581a4f314bfd8301608874210eeff8bb579f02eadb8baac6b0800f\": container with ID starting with 93efbbf6f7581a4f314bfd8301608874210eeff8bb579f02eadb8baac6b0800f not found: ID does not exist" Jun 12 22:23:24.273299 ip-10-0-128-134 kubenswrapper[2559]: I0612 22:23:24.273298 2559 scope.go:117] "RemoveContainer" containerID="00e32bcb0aa0707cb776f6821ec7b8097e196f72126b66fab61025b5746d541f" Jun 12 22:23:24.273517 ip-10-0-128-134 kubenswrapper[2559]: I0612 22:23:24.273500 2559 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"00e32bcb0aa0707cb776f6821ec7b8097e196f72126b66fab61025b5746d541f"} err="failed to get container status \"00e32bcb0aa0707cb776f6821ec7b8097e196f72126b66fab61025b5746d541f\": rpc error: code = NotFound desc = could not find container \"00e32bcb0aa0707cb776f6821ec7b8097e196f72126b66fab61025b5746d541f\": container with ID starting with 00e32bcb0aa0707cb776f6821ec7b8097e196f72126b66fab61025b5746d541f not found: ID does not exist" Jun 12 22:23:24.273564 ip-10-0-128-134 kubenswrapper[2559]: I0612 22:23:24.273517 2559 scope.go:117] "RemoveContainer" containerID="4299c05e286c1cc9a79799029d8eee24f3ab64c55860260d80207f2f4d89ffed" Jun 12 22:23:24.273733 ip-10-0-128-134 kubenswrapper[2559]: I0612 22:23:24.273716 2559 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"4299c05e286c1cc9a79799029d8eee24f3ab64c55860260d80207f2f4d89ffed"} err="failed to get container status \"4299c05e286c1cc9a79799029d8eee24f3ab64c55860260d80207f2f4d89ffed\": rpc error: code = NotFound desc = could not find container \"4299c05e286c1cc9a79799029d8eee24f3ab64c55860260d80207f2f4d89ffed\": container with ID starting with 4299c05e286c1cc9a79799029d8eee24f3ab64c55860260d80207f2f4d89ffed not found: ID does not exist" Jun 12 22:23:24.273779 ip-10-0-128-134 kubenswrapper[2559]: I0612 22:23:24.273735 2559 scope.go:117] "RemoveContainer" containerID="a1f6f08ada38cf5826b49c75c834785e9f4d042c204466b996a4bfd9d73f1e69" Jun 12 22:23:24.273932 ip-10-0-128-134 kubenswrapper[2559]: I0612 22:23:24.273916 2559 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"a1f6f08ada38cf5826b49c75c834785e9f4d042c204466b996a4bfd9d73f1e69"} err="failed to get container status \"a1f6f08ada38cf5826b49c75c834785e9f4d042c204466b996a4bfd9d73f1e69\": rpc error: code = NotFound desc = could not find container \"a1f6f08ada38cf5826b49c75c834785e9f4d042c204466b996a4bfd9d73f1e69\": container with ID starting with a1f6f08ada38cf5826b49c75c834785e9f4d042c204466b996a4bfd9d73f1e69 not found: ID does not exist" Jun 12 22:23:24.273968 ip-10-0-128-134 kubenswrapper[2559]: I0612 22:23:24.273932 2559 scope.go:117] "RemoveContainer" containerID="bde92804a49e1037334e3fbe53bc09a6109a381182c1d66897f32f7e261d1dce" Jun 12 22:23:24.274131 ip-10-0-128-134 kubenswrapper[2559]: I0612 22:23:24.274112 2559 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"bde92804a49e1037334e3fbe53bc09a6109a381182c1d66897f32f7e261d1dce"} err="failed to get container status \"bde92804a49e1037334e3fbe53bc09a6109a381182c1d66897f32f7e261d1dce\": rpc error: code = NotFound desc = could not find container \"bde92804a49e1037334e3fbe53bc09a6109a381182c1d66897f32f7e261d1dce\": container with ID starting with bde92804a49e1037334e3fbe53bc09a6109a381182c1d66897f32f7e261d1dce not found: ID does not exist" Jun 12 22:23:24.274169 ip-10-0-128-134 kubenswrapper[2559]: I0612 22:23:24.274132 2559 scope.go:117] "RemoveContainer" containerID="c963547e8486c32795df13ed7ed7556daab5bec95e9d840cd097a0524f16d488" Jun 12 22:23:24.274315 ip-10-0-128-134 kubenswrapper[2559]: I0612 22:23:24.274300 2559 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"c963547e8486c32795df13ed7ed7556daab5bec95e9d840cd097a0524f16d488"} err="failed to get container status \"c963547e8486c32795df13ed7ed7556daab5bec95e9d840cd097a0524f16d488\": rpc error: code = NotFound desc = could not find container \"c963547e8486c32795df13ed7ed7556daab5bec95e9d840cd097a0524f16d488\": container with ID starting with c963547e8486c32795df13ed7ed7556daab5bec95e9d840cd097a0524f16d488 not found: ID does not exist" Jun 12 22:23:24.274348 ip-10-0-128-134 kubenswrapper[2559]: I0612 22:23:24.274315 2559 scope.go:117] "RemoveContainer" containerID="658f3039844ce2d5a879bb100befc6969364d0f11ed9b8070d596c57f6760c56" Jun 12 22:23:24.274530 ip-10-0-128-134 kubenswrapper[2559]: I0612 22:23:24.274511 2559 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"658f3039844ce2d5a879bb100befc6969364d0f11ed9b8070d596c57f6760c56"} err="failed to get container status \"658f3039844ce2d5a879bb100befc6969364d0f11ed9b8070d596c57f6760c56\": rpc error: code = NotFound desc = could not find container \"658f3039844ce2d5a879bb100befc6969364d0f11ed9b8070d596c57f6760c56\": container with ID starting with 658f3039844ce2d5a879bb100befc6969364d0f11ed9b8070d596c57f6760c56 not found: ID does not exist" Jun 12 22:23:24.274530 ip-10-0-128-134 kubenswrapper[2559]: I0612 22:23:24.274529 2559 scope.go:117] "RemoveContainer" containerID="93efbbf6f7581a4f314bfd8301608874210eeff8bb579f02eadb8baac6b0800f" Jun 12 22:23:24.274808 ip-10-0-128-134 kubenswrapper[2559]: I0612 22:23:24.274785 2559 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"93efbbf6f7581a4f314bfd8301608874210eeff8bb579f02eadb8baac6b0800f"} err="failed to get container status \"93efbbf6f7581a4f314bfd8301608874210eeff8bb579f02eadb8baac6b0800f\": rpc error: code = NotFound desc = could not find container \"93efbbf6f7581a4f314bfd8301608874210eeff8bb579f02eadb8baac6b0800f\": container with ID starting with 93efbbf6f7581a4f314bfd8301608874210eeff8bb579f02eadb8baac6b0800f not found: ID does not exist" Jun 12 22:23:24.274808 ip-10-0-128-134 kubenswrapper[2559]: I0612 22:23:24.274807 2559 scope.go:117] "RemoveContainer" containerID="00e32bcb0aa0707cb776f6821ec7b8097e196f72126b66fab61025b5746d541f" Jun 12 22:23:24.275071 ip-10-0-128-134 kubenswrapper[2559]: I0612 22:23:24.275047 2559 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"00e32bcb0aa0707cb776f6821ec7b8097e196f72126b66fab61025b5746d541f"} err="failed to get container status \"00e32bcb0aa0707cb776f6821ec7b8097e196f72126b66fab61025b5746d541f\": rpc error: code = NotFound desc = could not find container \"00e32bcb0aa0707cb776f6821ec7b8097e196f72126b66fab61025b5746d541f\": container with ID starting with 00e32bcb0aa0707cb776f6821ec7b8097e196f72126b66fab61025b5746d541f not found: ID does not exist" Jun 12 22:23:24.275071 ip-10-0-128-134 kubenswrapper[2559]: I0612 22:23:24.275071 2559 scope.go:117] "RemoveContainer" containerID="4299c05e286c1cc9a79799029d8eee24f3ab64c55860260d80207f2f4d89ffed" Jun 12 22:23:24.275256 ip-10-0-128-134 kubenswrapper[2559]: I0612 22:23:24.275116 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0" Jun 12 22:23:24.275349 ip-10-0-128-134 kubenswrapper[2559]: I0612 22:23:24.275323 2559 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"4299c05e286c1cc9a79799029d8eee24f3ab64c55860260d80207f2f4d89ffed"} err="failed to get container status \"4299c05e286c1cc9a79799029d8eee24f3ab64c55860260d80207f2f4d89ffed\": rpc error: code = NotFound desc = could not find container \"4299c05e286c1cc9a79799029d8eee24f3ab64c55860260d80207f2f4d89ffed\": container with ID starting with 4299c05e286c1cc9a79799029d8eee24f3ab64c55860260d80207f2f4d89ffed not found: ID does not exist" Jun 12 22:23:24.275418 ip-10-0-128-134 kubenswrapper[2559]: I0612 22:23:24.275352 2559 scope.go:117] "RemoveContainer" containerID="a1f6f08ada38cf5826b49c75c834785e9f4d042c204466b996a4bfd9d73f1e69" Jun 12 22:23:24.275965 ip-10-0-128-134 kubenswrapper[2559]: I0612 22:23:24.275939 2559 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"a1f6f08ada38cf5826b49c75c834785e9f4d042c204466b996a4bfd9d73f1e69"} err="failed to get container status \"a1f6f08ada38cf5826b49c75c834785e9f4d042c204466b996a4bfd9d73f1e69\": rpc error: code = NotFound desc = could not find container \"a1f6f08ada38cf5826b49c75c834785e9f4d042c204466b996a4bfd9d73f1e69\": container with ID starting with a1f6f08ada38cf5826b49c75c834785e9f4d042c204466b996a4bfd9d73f1e69 not found: ID does not exist" Jun 12 22:23:24.275965 ip-10-0-128-134 kubenswrapper[2559]: I0612 22:23:24.275965 2559 scope.go:117] "RemoveContainer" containerID="bde92804a49e1037334e3fbe53bc09a6109a381182c1d66897f32f7e261d1dce" Jun 12 22:23:24.276245 ip-10-0-128-134 kubenswrapper[2559]: I0612 22:23:24.276219 2559 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"bde92804a49e1037334e3fbe53bc09a6109a381182c1d66897f32f7e261d1dce"} err="failed to get container status \"bde92804a49e1037334e3fbe53bc09a6109a381182c1d66897f32f7e261d1dce\": rpc error: code = NotFound desc = could not find container \"bde92804a49e1037334e3fbe53bc09a6109a381182c1d66897f32f7e261d1dce\": container with ID starting with bde92804a49e1037334e3fbe53bc09a6109a381182c1d66897f32f7e261d1dce not found: ID does not exist" Jun 12 22:23:24.276294 ip-10-0-128-134 kubenswrapper[2559]: I0612 22:23:24.276246 2559 scope.go:117] "RemoveContainer" containerID="c963547e8486c32795df13ed7ed7556daab5bec95e9d840cd097a0524f16d488" Jun 12 22:23:24.276632 ip-10-0-128-134 kubenswrapper[2559]: I0612 22:23:24.276605 2559 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"c963547e8486c32795df13ed7ed7556daab5bec95e9d840cd097a0524f16d488"} err="failed to get container status \"c963547e8486c32795df13ed7ed7556daab5bec95e9d840cd097a0524f16d488\": rpc error: code = NotFound desc = could not find container \"c963547e8486c32795df13ed7ed7556daab5bec95e9d840cd097a0524f16d488\": container with ID starting with c963547e8486c32795df13ed7ed7556daab5bec95e9d840cd097a0524f16d488 not found: ID does not exist" Jun 12 22:23:24.276690 ip-10-0-128-134 kubenswrapper[2559]: I0612 22:23:24.276637 2559 scope.go:117] "RemoveContainer" containerID="658f3039844ce2d5a879bb100befc6969364d0f11ed9b8070d596c57f6760c56" Jun 12 22:23:24.276885 ip-10-0-128-134 kubenswrapper[2559]: I0612 22:23:24.276866 2559 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"658f3039844ce2d5a879bb100befc6969364d0f11ed9b8070d596c57f6760c56"} err="failed to get container status \"658f3039844ce2d5a879bb100befc6969364d0f11ed9b8070d596c57f6760c56\": rpc error: code = NotFound desc = could not find container \"658f3039844ce2d5a879bb100befc6969364d0f11ed9b8070d596c57f6760c56\": container with ID starting with 658f3039844ce2d5a879bb100befc6969364d0f11ed9b8070d596c57f6760c56 not found: ID does not exist" Jun 12 22:23:24.276948 ip-10-0-128-134 kubenswrapper[2559]: I0612 22:23:24.276886 2559 scope.go:117] "RemoveContainer" containerID="93efbbf6f7581a4f314bfd8301608874210eeff8bb579f02eadb8baac6b0800f" Jun 12 22:23:24.277142 ip-10-0-128-134 kubenswrapper[2559]: I0612 22:23:24.277128 2559 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"93efbbf6f7581a4f314bfd8301608874210eeff8bb579f02eadb8baac6b0800f"} err="failed to get container status \"93efbbf6f7581a4f314bfd8301608874210eeff8bb579f02eadb8baac6b0800f\": rpc error: code = NotFound desc = could not find container \"93efbbf6f7581a4f314bfd8301608874210eeff8bb579f02eadb8baac6b0800f\": container with ID starting with 93efbbf6f7581a4f314bfd8301608874210eeff8bb579f02eadb8baac6b0800f not found: ID does not exist" Jun 12 22:23:24.277142 ip-10-0-128-134 kubenswrapper[2559]: I0612 22:23:24.277142 2559 scope.go:117] "RemoveContainer" containerID="00e32bcb0aa0707cb776f6821ec7b8097e196f72126b66fab61025b5746d541f" Jun 12 22:23:24.277323 ip-10-0-128-134 kubenswrapper[2559]: I0612 22:23:24.277303 2559 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"00e32bcb0aa0707cb776f6821ec7b8097e196f72126b66fab61025b5746d541f"} err="failed to get container status \"00e32bcb0aa0707cb776f6821ec7b8097e196f72126b66fab61025b5746d541f\": rpc error: code = NotFound desc = could not find container \"00e32bcb0aa0707cb776f6821ec7b8097e196f72126b66fab61025b5746d541f\": container with ID starting with 00e32bcb0aa0707cb776f6821ec7b8097e196f72126b66fab61025b5746d541f not found: ID does not exist" Jun 12 22:23:24.277399 ip-10-0-128-134 kubenswrapper[2559]: I0612 22:23:24.277325 2559 scope.go:117] "RemoveContainer" containerID="4299c05e286c1cc9a79799029d8eee24f3ab64c55860260d80207f2f4d89ffed" Jun 12 22:23:24.277617 ip-10-0-128-134 kubenswrapper[2559]: I0612 22:23:24.277589 2559 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"4299c05e286c1cc9a79799029d8eee24f3ab64c55860260d80207f2f4d89ffed"} err="failed to get container status \"4299c05e286c1cc9a79799029d8eee24f3ab64c55860260d80207f2f4d89ffed\": rpc error: code = NotFound desc = could not find container \"4299c05e286c1cc9a79799029d8eee24f3ab64c55860260d80207f2f4d89ffed\": container with ID starting with 4299c05e286c1cc9a79799029d8eee24f3ab64c55860260d80207f2f4d89ffed not found: ID does not exist" Jun 12 22:23:24.277617 ip-10-0-128-134 kubenswrapper[2559]: I0612 22:23:24.277608 2559 scope.go:117] "RemoveContainer" containerID="a1f6f08ada38cf5826b49c75c834785e9f4d042c204466b996a4bfd9d73f1e69" Jun 12 22:23:24.277840 ip-10-0-128-134 kubenswrapper[2559]: I0612 22:23:24.277820 2559 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"a1f6f08ada38cf5826b49c75c834785e9f4d042c204466b996a4bfd9d73f1e69"} err="failed to get container status \"a1f6f08ada38cf5826b49c75c834785e9f4d042c204466b996a4bfd9d73f1e69\": rpc error: code = NotFound desc = could not find container \"a1f6f08ada38cf5826b49c75c834785e9f4d042c204466b996a4bfd9d73f1e69\": container with ID starting with a1f6f08ada38cf5826b49c75c834785e9f4d042c204466b996a4bfd9d73f1e69 not found: ID does not exist" Jun 12 22:23:24.277840 ip-10-0-128-134 kubenswrapper[2559]: I0612 22:23:24.277839 2559 scope.go:117] "RemoveContainer" containerID="bde92804a49e1037334e3fbe53bc09a6109a381182c1d66897f32f7e261d1dce" Jun 12 22:23:24.278072 ip-10-0-128-134 kubenswrapper[2559]: I0612 22:23:24.278049 2559 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"bde92804a49e1037334e3fbe53bc09a6109a381182c1d66897f32f7e261d1dce"} err="failed to get container status \"bde92804a49e1037334e3fbe53bc09a6109a381182c1d66897f32f7e261d1dce\": rpc error: code = NotFound desc = could not find container \"bde92804a49e1037334e3fbe53bc09a6109a381182c1d66897f32f7e261d1dce\": container with ID starting with bde92804a49e1037334e3fbe53bc09a6109a381182c1d66897f32f7e261d1dce not found: ID does not exist" Jun 12 22:23:24.278072 ip-10-0-128-134 kubenswrapper[2559]: I0612 22:23:24.278066 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-kube-rbac-proxy-web\"" Jun 12 22:23:24.278072 ip-10-0-128-134 kubenswrapper[2559]: I0612 22:23:24.278073 2559 scope.go:117] "RemoveContainer" containerID="c963547e8486c32795df13ed7ed7556daab5bec95e9d840cd097a0524f16d488" Jun 12 22:23:24.278267 ip-10-0-128-134 kubenswrapper[2559]: I0612 22:23:24.278107 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-client-certs\"" Jun 12 22:23:24.278325 ip-10-0-128-134 kubenswrapper[2559]: I0612 22:23:24.278312 2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-2\"" Jun 12 22:23:24.278388 ip-10-0-128-134 kubenswrapper[2559]: I0612 22:23:24.278331 2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"serving-certs-ca-bundle\"" Jun 12 22:23:24.278388 ip-10-0-128-134 kubenswrapper[2559]: I0612 22:23:24.278339 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s\"" Jun 12 22:23:24.278527 ip-10-0-128-134 kubenswrapper[2559]: I0612 22:23:24.278417 2559 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"c963547e8486c32795df13ed7ed7556daab5bec95e9d840cd097a0524f16d488"} err="failed to get container status \"c963547e8486c32795df13ed7ed7556daab5bec95e9d840cd097a0524f16d488\": rpc error: code = NotFound desc = could not find container \"c963547e8486c32795df13ed7ed7556daab5bec95e9d840cd097a0524f16d488\": container with ID starting with c963547e8486c32795df13ed7ed7556daab5bec95e9d840cd097a0524f16d488 not found: ID does not exist" Jun 12 22:23:24.278527 ip-10-0-128-134 kubenswrapper[2559]: I0612 22:23:24.278437 2559 scope.go:117] "RemoveContainer" containerID="658f3039844ce2d5a879bb100befc6969364d0f11ed9b8070d596c57f6760c56" Jun 12 22:23:24.278687 ip-10-0-128-134 kubenswrapper[2559]: I0612 22:23:24.278583 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-rbac-proxy\"" Jun 12 22:23:24.278687 ip-10-0-128-134 kubenswrapper[2559]: I0612 22:23:24.278610 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-tls-assets-0\"" Jun 12 22:23:24.278687 ip-10-0-128-134 kubenswrapper[2559]: I0612 22:23:24.278628 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-dockercfg-5w5cg\"" Jun 12 22:23:24.278687 ip-10-0-128-134 kubenswrapper[2559]: I0612 22:23:24.278635 2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kubelet-serving-ca-bundle\"" Jun 12 22:23:24.278990 ip-10-0-128-134 kubenswrapper[2559]: I0612 22:23:24.278717 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-web-config\"" Jun 12 22:23:24.278990 ip-10-0-128-134 kubenswrapper[2559]: I0612 22:23:24.278781 2559 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"658f3039844ce2d5a879bb100befc6969364d0f11ed9b8070d596c57f6760c56"} err="failed to get container status \"658f3039844ce2d5a879bb100befc6969364d0f11ed9b8070d596c57f6760c56\": rpc error: code = NotFound desc = could not find container \"658f3039844ce2d5a879bb100befc6969364d0f11ed9b8070d596c57f6760c56\": container with ID starting with 658f3039844ce2d5a879bb100befc6969364d0f11ed9b8070d596c57f6760c56 not found: ID does not exist" Jun 12 22:23:24.278990 ip-10-0-128-134 kubenswrapper[2559]: I0612 22:23:24.278805 2559 scope.go:117] "RemoveContainer" containerID="93efbbf6f7581a4f314bfd8301608874210eeff8bb579f02eadb8baac6b0800f" Jun 12 22:23:24.278990 ip-10-0-128-134 kubenswrapper[2559]: I0612 22:23:24.278854 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-thanos-prometheus-http-client-file\"" Jun 12 22:23:24.278990 ip-10-0-128-134 kubenswrapper[2559]: I0612 22:23:24.278978 2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-1\"" Jun 12 22:23:24.279323 ip-10-0-128-134 kubenswrapper[2559]: I0612 22:23:24.279154 2559 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"93efbbf6f7581a4f314bfd8301608874210eeff8bb579f02eadb8baac6b0800f"} err="failed to get container status \"93efbbf6f7581a4f314bfd8301608874210eeff8bb579f02eadb8baac6b0800f\": rpc error: code = NotFound desc = could not find container \"93efbbf6f7581a4f314bfd8301608874210eeff8bb579f02eadb8baac6b0800f\": container with ID starting with 93efbbf6f7581a4f314bfd8301608874210eeff8bb579f02eadb8baac6b0800f not found: ID does not exist" Jun 12 22:23:24.279323 ip-10-0-128-134 kubenswrapper[2559]: I0612 22:23:24.279183 2559 scope.go:117] "RemoveContainer" containerID="00e32bcb0aa0707cb776f6821ec7b8097e196f72126b66fab61025b5746d541f" Jun 12 22:23:24.279323 ip-10-0-128-134 kubenswrapper[2559]: I0612 22:23:24.279199 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-thanos-sidecar-tls\"" Jun 12 22:23:24.279518 ip-10-0-128-134 kubenswrapper[2559]: I0612 22:23:24.279498 2559 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"00e32bcb0aa0707cb776f6821ec7b8097e196f72126b66fab61025b5746d541f"} err="failed to get container status \"00e32bcb0aa0707cb776f6821ec7b8097e196f72126b66fab61025b5746d541f\": rpc error: code = NotFound desc = could not find container \"00e32bcb0aa0707cb776f6821ec7b8097e196f72126b66fab61025b5746d541f\": container with ID starting with 00e32bcb0aa0707cb776f6821ec7b8097e196f72126b66fab61025b5746d541f not found: ID does not exist" Jun 12 22:23:24.279587 ip-10-0-128-134 kubenswrapper[2559]: I0612 22:23:24.279519 2559 scope.go:117] "RemoveContainer" containerID="4299c05e286c1cc9a79799029d8eee24f3ab64c55860260d80207f2f4d89ffed" Jun 12 22:23:24.279730 ip-10-0-128-134 kubenswrapper[2559]: I0612 22:23:24.279709 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-grpc-tls-79np3hg4qng4q\"" Jun 12 22:23:24.279828 ip-10-0-128-134 kubenswrapper[2559]: I0612 22:23:24.279760 2559 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"4299c05e286c1cc9a79799029d8eee24f3ab64c55860260d80207f2f4d89ffed"} err="failed to get container status \"4299c05e286c1cc9a79799029d8eee24f3ab64c55860260d80207f2f4d89ffed\": rpc error: code = NotFound desc = could not find container \"4299c05e286c1cc9a79799029d8eee24f3ab64c55860260d80207f2f4d89ffed\": container with ID starting with 4299c05e286c1cc9a79799029d8eee24f3ab64c55860260d80207f2f4d89ffed not found: ID does not exist" Jun 12 22:23:24.279828 ip-10-0-128-134 kubenswrapper[2559]: I0612 22:23:24.279783 2559 scope.go:117] "RemoveContainer" containerID="a1f6f08ada38cf5826b49c75c834785e9f4d042c204466b996a4bfd9d73f1e69" Jun 12 22:23:24.280034 ip-10-0-128-134 kubenswrapper[2559]: I0612 22:23:24.280018 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-tls\"" Jun 12 22:23:24.280284 ip-10-0-128-134 kubenswrapper[2559]: I0612 22:23:24.280259 2559 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"a1f6f08ada38cf5826b49c75c834785e9f4d042c204466b996a4bfd9d73f1e69"} err="failed to get container status \"a1f6f08ada38cf5826b49c75c834785e9f4d042c204466b996a4bfd9d73f1e69\": rpc error: code = NotFound desc = could not find container \"a1f6f08ada38cf5826b49c75c834785e9f4d042c204466b996a4bfd9d73f1e69\": container with ID starting with a1f6f08ada38cf5826b49c75c834785e9f4d042c204466b996a4bfd9d73f1e69 not found: ID does not exist" Jun 12 22:23:24.280369 ip-10-0-128-134 kubenswrapper[2559]: I0612 22:23:24.280285 2559 scope.go:117] "RemoveContainer" containerID="bde92804a49e1037334e3fbe53bc09a6109a381182c1d66897f32f7e261d1dce" Jun 12 22:23:24.280757 ip-10-0-128-134 kubenswrapper[2559]: I0612 22:23:24.280649 2559 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"bde92804a49e1037334e3fbe53bc09a6109a381182c1d66897f32f7e261d1dce"} err="failed to get container status \"bde92804a49e1037334e3fbe53bc09a6109a381182c1d66897f32f7e261d1dce\": rpc error: code = NotFound desc = could not find container \"bde92804a49e1037334e3fbe53bc09a6109a381182c1d66897f32f7e261d1dce\": container with ID starting with bde92804a49e1037334e3fbe53bc09a6109a381182c1d66897f32f7e261d1dce not found: ID does not exist" Jun 12 22:23:24.280757 ip-10-0-128-134 kubenswrapper[2559]: I0612 22:23:24.280674 2559 scope.go:117] "RemoveContainer" containerID="c963547e8486c32795df13ed7ed7556daab5bec95e9d840cd097a0524f16d488" Jun 12 22:23:24.282870 ip-10-0-128-134 kubenswrapper[2559]: I0612 22:23:24.282837 2559 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"c963547e8486c32795df13ed7ed7556daab5bec95e9d840cd097a0524f16d488"} err="failed to get container status \"c963547e8486c32795df13ed7ed7556daab5bec95e9d840cd097a0524f16d488\": rpc error: code = NotFound desc = could not find container \"c963547e8486c32795df13ed7ed7556daab5bec95e9d840cd097a0524f16d488\": container with ID starting with c963547e8486c32795df13ed7ed7556daab5bec95e9d840cd097a0524f16d488 not found: ID does not exist" Jun 12 22:23:24.282961 ip-10-0-128-134 kubenswrapper[2559]: I0612 22:23:24.282871 2559 scope.go:117] "RemoveContainer" containerID="658f3039844ce2d5a879bb100befc6969364d0f11ed9b8070d596c57f6760c56" Jun 12 22:23:24.283599 ip-10-0-128-134 kubenswrapper[2559]: I0612 22:23:24.283572 2559 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"658f3039844ce2d5a879bb100befc6969364d0f11ed9b8070d596c57f6760c56"} err="failed to get container status \"658f3039844ce2d5a879bb100befc6969364d0f11ed9b8070d596c57f6760c56\": rpc error: code = NotFound desc = could not find container \"658f3039844ce2d5a879bb100befc6969364d0f11ed9b8070d596c57f6760c56\": container with ID starting with 658f3039844ce2d5a879bb100befc6969364d0f11ed9b8070d596c57f6760c56 not found: ID does not exist" Jun 12 22:23:24.283703 ip-10-0-128-134 kubenswrapper[2559]: I0612 22:23:24.283605 2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-0\"" Jun 12 22:23:24.285285 ip-10-0-128-134 kubenswrapper[2559]: I0612 22:23:24.285267 2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-trusted-ca-bundle\"" Jun 12 22:23:24.290203 ip-10-0-128-134 kubenswrapper[2559]: I0612 22:23:24.290181 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Jun 12 22:23:24.408892 ip-10-0-128-134 kubenswrapper[2559]: I0612 22:23:24.408862 2559 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="7f938da2-ffe5-4feb-988f-22bbc35e531f" path="/var/lib/kubelet/pods/7f938da2-ffe5-4feb-988f-22bbc35e531f/volumes" Jun 12 22:23:24.421708 ip-10-0-128-134 kubenswrapper[2559]: I0612 22:23:24.421687 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/faa60143-4f40-4865-9a35-398310205be8-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"faa60143-4f40-4865-9a35-398310205be8\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 12 22:23:24.421794 ip-10-0-128-134 kubenswrapper[2559]: I0612 22:23:24.421714 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/faa60143-4f40-4865-9a35-398310205be8-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"faa60143-4f40-4865-9a35-398310205be8\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 12 22:23:24.421794 ip-10-0-128-134 kubenswrapper[2559]: I0612 22:23:24.421737 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/faa60143-4f40-4865-9a35-398310205be8-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"faa60143-4f40-4865-9a35-398310205be8\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 12 22:23:24.421794 ip-10-0-128-134 kubenswrapper[2559]: I0612 22:23:24.421759 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/faa60143-4f40-4865-9a35-398310205be8-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"faa60143-4f40-4865-9a35-398310205be8\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 12 22:23:24.421910 ip-10-0-128-134 kubenswrapper[2559]: I0612 22:23:24.421816 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/faa60143-4f40-4865-9a35-398310205be8-config\") pod \"prometheus-k8s-0\" (UID: \"faa60143-4f40-4865-9a35-398310205be8\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 12 22:23:24.421910 ip-10-0-128-134 kubenswrapper[2559]: I0612 22:23:24.421837 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/faa60143-4f40-4865-9a35-398310205be8-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"faa60143-4f40-4865-9a35-398310205be8\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 12 22:23:24.421910 ip-10-0-128-134 kubenswrapper[2559]: I0612 22:23:24.421883 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/faa60143-4f40-4865-9a35-398310205be8-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"faa60143-4f40-4865-9a35-398310205be8\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 12 22:23:24.421910 ip-10-0-128-134 kubenswrapper[2559]: I0612 22:23:24.421909 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/faa60143-4f40-4865-9a35-398310205be8-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"faa60143-4f40-4865-9a35-398310205be8\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 12 22:23:24.422093 ip-10-0-128-134 kubenswrapper[2559]: I0612 22:23:24.421925 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/faa60143-4f40-4865-9a35-398310205be8-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"faa60143-4f40-4865-9a35-398310205be8\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 12 22:23:24.422093 ip-10-0-128-134 kubenswrapper[2559]: I0612 22:23:24.421948 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/faa60143-4f40-4865-9a35-398310205be8-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"faa60143-4f40-4865-9a35-398310205be8\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 12 22:23:24.422093 ip-10-0-128-134 kubenswrapper[2559]: I0612 22:23:24.421965 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/faa60143-4f40-4865-9a35-398310205be8-web-config\") pod \"prometheus-k8s-0\" (UID: \"faa60143-4f40-4865-9a35-398310205be8\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 12 22:23:24.422093 ip-10-0-128-134 kubenswrapper[2559]: I0612 22:23:24.422028 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/faa60143-4f40-4865-9a35-398310205be8-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"faa60143-4f40-4865-9a35-398310205be8\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 12 22:23:24.422093 ip-10-0-128-134 kubenswrapper[2559]: I0612 22:23:24.422064 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/faa60143-4f40-4865-9a35-398310205be8-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"faa60143-4f40-4865-9a35-398310205be8\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 12 22:23:24.422331 ip-10-0-128-134 kubenswrapper[2559]: I0612 22:23:24.422103 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/faa60143-4f40-4865-9a35-398310205be8-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"faa60143-4f40-4865-9a35-398310205be8\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 12 22:23:24.422331 ip-10-0-128-134 kubenswrapper[2559]: I0612 22:23:24.422133 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/faa60143-4f40-4865-9a35-398310205be8-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"faa60143-4f40-4865-9a35-398310205be8\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 12 22:23:24.422331 ip-10-0-128-134 kubenswrapper[2559]: I0612 22:23:24.422162 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-tblb4\" (UniqueName: \"kubernetes.io/projected/faa60143-4f40-4865-9a35-398310205be8-kube-api-access-tblb4\") pod \"prometheus-k8s-0\" (UID: \"faa60143-4f40-4865-9a35-398310205be8\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 12 22:23:24.422331 ip-10-0-128-134 kubenswrapper[2559]: I0612 22:23:24.422192 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/faa60143-4f40-4865-9a35-398310205be8-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"faa60143-4f40-4865-9a35-398310205be8\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 12 22:23:24.422331 ip-10-0-128-134 kubenswrapper[2559]: I0612 22:23:24.422218 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/faa60143-4f40-4865-9a35-398310205be8-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"faa60143-4f40-4865-9a35-398310205be8\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 12 22:23:24.422331 ip-10-0-128-134 kubenswrapper[2559]: I0612 22:23:24.422240 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/faa60143-4f40-4865-9a35-398310205be8-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"faa60143-4f40-4865-9a35-398310205be8\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 12 22:23:24.422331 ip-10-0-128-134 kubenswrapper[2559]: I0612 22:23:24.422266 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/faa60143-4f40-4865-9a35-398310205be8-config-out\") pod \"prometheus-k8s-0\" (UID: \"faa60143-4f40-4865-9a35-398310205be8\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 12 22:23:24.522956 ip-10-0-128-134 kubenswrapper[2559]: I0612 22:23:24.522861 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/faa60143-4f40-4865-9a35-398310205be8-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"faa60143-4f40-4865-9a35-398310205be8\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 12 22:23:24.522956 ip-10-0-128-134 kubenswrapper[2559]: I0612 22:23:24.522909 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/faa60143-4f40-4865-9a35-398310205be8-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"faa60143-4f40-4865-9a35-398310205be8\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 12 22:23:24.522956 ip-10-0-128-134 kubenswrapper[2559]: I0612 22:23:24.522932 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/faa60143-4f40-4865-9a35-398310205be8-config\") pod \"prometheus-k8s-0\" (UID: \"faa60143-4f40-4865-9a35-398310205be8\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 12 22:23:24.523219 ip-10-0-128-134 kubenswrapper[2559]: I0612 22:23:24.523043 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/faa60143-4f40-4865-9a35-398310205be8-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"faa60143-4f40-4865-9a35-398310205be8\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 12 22:23:24.523219 ip-10-0-128-134 kubenswrapper[2559]: I0612 22:23:24.523083 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/faa60143-4f40-4865-9a35-398310205be8-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"faa60143-4f40-4865-9a35-398310205be8\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 12 22:23:24.523219 ip-10-0-128-134 kubenswrapper[2559]: I0612 22:23:24.523112 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/faa60143-4f40-4865-9a35-398310205be8-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"faa60143-4f40-4865-9a35-398310205be8\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 12 22:23:24.523219 ip-10-0-128-134 kubenswrapper[2559]: I0612 22:23:24.523127 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/faa60143-4f40-4865-9a35-398310205be8-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"faa60143-4f40-4865-9a35-398310205be8\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 12 22:23:24.523219 ip-10-0-128-134 kubenswrapper[2559]: I0612 22:23:24.523152 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/faa60143-4f40-4865-9a35-398310205be8-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"faa60143-4f40-4865-9a35-398310205be8\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 12 22:23:24.523219 ip-10-0-128-134 kubenswrapper[2559]: I0612 22:23:24.523177 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/faa60143-4f40-4865-9a35-398310205be8-web-config\") pod \"prometheus-k8s-0\" (UID: \"faa60143-4f40-4865-9a35-398310205be8\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 12 22:23:24.523219 ip-10-0-128-134 kubenswrapper[2559]: I0612 22:23:24.523208 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/faa60143-4f40-4865-9a35-398310205be8-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"faa60143-4f40-4865-9a35-398310205be8\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 12 22:23:24.523581 ip-10-0-128-134 kubenswrapper[2559]: I0612 22:23:24.523234 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/faa60143-4f40-4865-9a35-398310205be8-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"faa60143-4f40-4865-9a35-398310205be8\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 12 22:23:24.523581 ip-10-0-128-134 kubenswrapper[2559]: I0612 22:23:24.523272 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/faa60143-4f40-4865-9a35-398310205be8-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"faa60143-4f40-4865-9a35-398310205be8\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 12 22:23:24.523581 ip-10-0-128-134 kubenswrapper[2559]: I0612 22:23:24.523304 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/faa60143-4f40-4865-9a35-398310205be8-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"faa60143-4f40-4865-9a35-398310205be8\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 12 22:23:24.523581 ip-10-0-128-134 kubenswrapper[2559]: I0612 22:23:24.523335 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-tblb4\" (UniqueName: \"kubernetes.io/projected/faa60143-4f40-4865-9a35-398310205be8-kube-api-access-tblb4\") pod \"prometheus-k8s-0\" (UID: \"faa60143-4f40-4865-9a35-398310205be8\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 12 22:23:24.523581 ip-10-0-128-134 kubenswrapper[2559]: I0612 22:23:24.523371 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/faa60143-4f40-4865-9a35-398310205be8-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"faa60143-4f40-4865-9a35-398310205be8\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 12 22:23:24.523581 ip-10-0-128-134 kubenswrapper[2559]: I0612 22:23:24.523400 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/faa60143-4f40-4865-9a35-398310205be8-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"faa60143-4f40-4865-9a35-398310205be8\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 12 22:23:24.523581 ip-10-0-128-134 kubenswrapper[2559]: I0612 22:23:24.523425 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/faa60143-4f40-4865-9a35-398310205be8-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"faa60143-4f40-4865-9a35-398310205be8\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 12 22:23:24.523581 ip-10-0-128-134 kubenswrapper[2559]: I0612 22:23:24.523482 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/faa60143-4f40-4865-9a35-398310205be8-config-out\") pod \"prometheus-k8s-0\" (UID: \"faa60143-4f40-4865-9a35-398310205be8\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 12 22:23:24.523581 ip-10-0-128-134 kubenswrapper[2559]: I0612 22:23:24.523559 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/faa60143-4f40-4865-9a35-398310205be8-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"faa60143-4f40-4865-9a35-398310205be8\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 12 22:23:24.524026 ip-10-0-128-134 kubenswrapper[2559]: I0612 22:23:24.523589 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/faa60143-4f40-4865-9a35-398310205be8-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"faa60143-4f40-4865-9a35-398310205be8\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 12 22:23:24.524026 ip-10-0-128-134 kubenswrapper[2559]: I0612 22:23:24.523863 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/faa60143-4f40-4865-9a35-398310205be8-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"faa60143-4f40-4865-9a35-398310205be8\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 12 22:23:24.524298 ip-10-0-128-134 kubenswrapper[2559]: I0612 22:23:24.524247 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/faa60143-4f40-4865-9a35-398310205be8-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"faa60143-4f40-4865-9a35-398310205be8\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 12 22:23:24.525732 ip-10-0-128-134 kubenswrapper[2559]: I0612 22:23:24.524796 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/faa60143-4f40-4865-9a35-398310205be8-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"faa60143-4f40-4865-9a35-398310205be8\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 12 22:23:24.525732 ip-10-0-128-134 kubenswrapper[2559]: I0612 22:23:24.525432 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/faa60143-4f40-4865-9a35-398310205be8-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"faa60143-4f40-4865-9a35-398310205be8\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 12 22:23:24.526130 ip-10-0-128-134 kubenswrapper[2559]: I0612 22:23:24.526096 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/faa60143-4f40-4865-9a35-398310205be8-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"faa60143-4f40-4865-9a35-398310205be8\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 12 22:23:24.526237 ip-10-0-128-134 kubenswrapper[2559]: I0612 22:23:24.526123 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/faa60143-4f40-4865-9a35-398310205be8-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"faa60143-4f40-4865-9a35-398310205be8\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 12 22:23:24.526237 ip-10-0-128-134 kubenswrapper[2559]: I0612 22:23:24.526162 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/secret/faa60143-4f40-4865-9a35-398310205be8-config\") pod \"prometheus-k8s-0\" (UID: \"faa60143-4f40-4865-9a35-398310205be8\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 12 22:23:24.526423 ip-10-0-128-134 kubenswrapper[2559]: I0612 22:23:24.526402 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/faa60143-4f40-4865-9a35-398310205be8-web-config\") pod \"prometheus-k8s-0\" (UID: \"faa60143-4f40-4865-9a35-398310205be8\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 12 22:23:24.526532 ip-10-0-128-134 kubenswrapper[2559]: I0612 22:23:24.526438 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/faa60143-4f40-4865-9a35-398310205be8-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"faa60143-4f40-4865-9a35-398310205be8\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 12 22:23:24.527497 ip-10-0-128-134 kubenswrapper[2559]: I0612 22:23:24.526999 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/faa60143-4f40-4865-9a35-398310205be8-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"faa60143-4f40-4865-9a35-398310205be8\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 12 22:23:24.527497 ip-10-0-128-134 kubenswrapper[2559]: I0612 22:23:24.527005 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/faa60143-4f40-4865-9a35-398310205be8-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"faa60143-4f40-4865-9a35-398310205be8\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 12 22:23:24.527497 ip-10-0-128-134 kubenswrapper[2559]: I0612 22:23:24.527260 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/faa60143-4f40-4865-9a35-398310205be8-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"faa60143-4f40-4865-9a35-398310205be8\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 12 22:23:24.527497 ip-10-0-128-134 kubenswrapper[2559]: I0612 22:23:24.527424 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/faa60143-4f40-4865-9a35-398310205be8-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"faa60143-4f40-4865-9a35-398310205be8\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 12 22:23:24.527741 ip-10-0-128-134 kubenswrapper[2559]: I0612 22:23:24.527500 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/faa60143-4f40-4865-9a35-398310205be8-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"faa60143-4f40-4865-9a35-398310205be8\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 12 22:23:24.528332 ip-10-0-128-134 kubenswrapper[2559]: I0612 22:23:24.528310 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/faa60143-4f40-4865-9a35-398310205be8-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"faa60143-4f40-4865-9a35-398310205be8\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 12 22:23:24.528766 ip-10-0-128-134 kubenswrapper[2559]: I0612 22:23:24.528751 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/faa60143-4f40-4865-9a35-398310205be8-config-out\") pod \"prometheus-k8s-0\" (UID: \"faa60143-4f40-4865-9a35-398310205be8\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 12 22:23:24.529285 ip-10-0-128-134 kubenswrapper[2559]: I0612 22:23:24.529268 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/faa60143-4f40-4865-9a35-398310205be8-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"faa60143-4f40-4865-9a35-398310205be8\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 12 22:23:24.529458 ip-10-0-128-134 kubenswrapper[2559]: I0612 22:23:24.529426 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/faa60143-4f40-4865-9a35-398310205be8-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"faa60143-4f40-4865-9a35-398310205be8\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 12 22:23:24.529635 ip-10-0-128-134 kubenswrapper[2559]: I0612 22:23:24.529620 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/faa60143-4f40-4865-9a35-398310205be8-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"faa60143-4f40-4865-9a35-398310205be8\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 12 22:23:24.534538 ip-10-0-128-134 kubenswrapper[2559]: I0612 22:23:24.534517 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-tblb4\" (UniqueName: \"kubernetes.io/projected/faa60143-4f40-4865-9a35-398310205be8-kube-api-access-tblb4\") pod \"prometheus-k8s-0\" (UID: \"faa60143-4f40-4865-9a35-398310205be8\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 12 22:23:24.586599 ip-10-0-128-134 kubenswrapper[2559]: I0612 22:23:24.586564 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0" Jun 12 22:23:24.723682 ip-10-0-128-134 kubenswrapper[2559]: I0612 22:23:24.723660 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Jun 12 22:23:24.725426 ip-10-0-128-134 kubenswrapper[2559]: W0612 22:23:24.725390 2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podfaa60143_4f40_4865_9a35_398310205be8.slice/crio-cb4040c2eac5884b3e60cc3a5f5fcc0b6730903de8cde472a7e4d5bdad4b0e06 WatchSource:0}: Error finding container cb4040c2eac5884b3e60cc3a5f5fcc0b6730903de8cde472a7e4d5bdad4b0e06: Status 404 returned error can't find the container with id cb4040c2eac5884b3e60cc3a5f5fcc0b6730903de8cde472a7e4d5bdad4b0e06 Jun 12 22:23:25.221159 ip-10-0-128-134 kubenswrapper[2559]: I0612 22:23:25.221123 2559 generic.go:356] "Generic (PLEG): container finished" podID="faa60143-4f40-4865-9a35-398310205be8" containerID="e5c4a089566d9964b96f64098d31d42049bb79dc528bac2196185680fee8808e" exitCode=0 Jun 12 22:23:25.221648 ip-10-0-128-134 kubenswrapper[2559]: I0612 22:23:25.221175 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"faa60143-4f40-4865-9a35-398310205be8","Type":"ContainerDied","Data":"e5c4a089566d9964b96f64098d31d42049bb79dc528bac2196185680fee8808e"} Jun 12 22:23:25.221648 ip-10-0-128-134 kubenswrapper[2559]: I0612 22:23:25.221244 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"faa60143-4f40-4865-9a35-398310205be8","Type":"ContainerStarted","Data":"cb4040c2eac5884b3e60cc3a5f5fcc0b6730903de8cde472a7e4d5bdad4b0e06"} Jun 12 22:23:26.228908 ip-10-0-128-134 kubenswrapper[2559]: I0612 22:23:26.228873 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"faa60143-4f40-4865-9a35-398310205be8","Type":"ContainerStarted","Data":"3eca94a1096365811e674d0b4420093b3eaa9dd59edc32cbd58a7a836b5e9865"} Jun 12 22:23:26.229250 ip-10-0-128-134 kubenswrapper[2559]: I0612 22:23:26.228961 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"faa60143-4f40-4865-9a35-398310205be8","Type":"ContainerStarted","Data":"c704501cb2c2f76dadae2cb7baef2a7fbb12bb1865f4a096d014f70dcaed3b54"} Jun 12 22:23:26.229250 ip-10-0-128-134 kubenswrapper[2559]: I0612 22:23:26.228989 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"faa60143-4f40-4865-9a35-398310205be8","Type":"ContainerStarted","Data":"227a86079400fd0389c093d268556c586bbe70d76b310fbc31367b8d3782c4db"} Jun 12 22:23:26.229250 ip-10-0-128-134 kubenswrapper[2559]: I0612 22:23:26.229015 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"faa60143-4f40-4865-9a35-398310205be8","Type":"ContainerStarted","Data":"a49ec861e9eec36ca5d85507f7af86c4f593c9cf522d3e878c3a7a89c9bf7587"} Jun 12 22:23:26.229250 ip-10-0-128-134 kubenswrapper[2559]: I0612 22:23:26.229037 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"faa60143-4f40-4865-9a35-398310205be8","Type":"ContainerStarted","Data":"8173655c389d0e44f9e58a45b436e2580007ea3cd1753217097d911640489146"} Jun 12 22:23:26.229250 ip-10-0-128-134 kubenswrapper[2559]: I0612 22:23:26.229072 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"faa60143-4f40-4865-9a35-398310205be8","Type":"ContainerStarted","Data":"7bc5e0a83cb3cf23d3cdace0d86a14908ad2c929d1b6d307b44e44c15e45654b"} Jun 12 22:23:26.267904 ip-10-0-128-134 kubenswrapper[2559]: I0612 22:23:26.267856 2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/prometheus-k8s-0" podStartSLOduration=2.248261213 podStartE2EDuration="2.267841716s" totalImagesPullingTime="0s" totalInitContainerRuntime="19.580503ms" isStatefulPod=false podCreationTimestamp="2026-06-12 22:23:24 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-12 22:23:26.26602784 +0000 UTC m=+148.314397656" watchObservedRunningTime="2026-06-12 22:23:26.267841716 +0000 UTC m=+148.316211575" Jun 12 22:23:27.069866 ip-10-0-128-134 kubenswrapper[2559]: I0612 22:23:27.069832 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-f7h79_2fe08918-3efc-4000-a321-8b319ead517c/konnectivity-agent/0.log" limit=1024 Jun 12 22:23:27.124109 ip-10-0-128-134 kubenswrapper[2559]: I0612 22:23:27.124079 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-f7h79_2fe08918-3efc-4000-a321-8b319ead517c/konnectivity-agent/0.log" limit=1024 Jun 12 22:23:29.587158 ip-10-0-128-134 kubenswrapper[2559]: I0612 22:23:29.587126 2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/prometheus-k8s-0" Jun 12 22:23:35.594842 ip-10-0-128-134 kubenswrapper[2559]: I0612 22:23:35.594808 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-f7h79_2fe08918-3efc-4000-a321-8b319ead517c/konnectivity-agent/0.log" limit=1024 Jun 12 22:23:35.654898 ip-10-0-128-134 kubenswrapper[2559]: I0612 22:23:35.654867 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-f7h79_2fe08918-3efc-4000-a321-8b319ead517c/konnectivity-agent/0.log" limit=1024 Jun 12 22:23:35.740749 ip-10-0-128-134 kubenswrapper[2559]: I0612 22:23:35.740713 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-f7h79_2fe08918-3efc-4000-a321-8b319ead517c/konnectivity-agent/0.log" limit=1024 Jun 12 22:23:35.842357 ip-10-0-128-134 kubenswrapper[2559]: I0612 22:23:35.842330 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-f7h79_2fe08918-3efc-4000-a321-8b319ead517c/konnectivity-agent/0.log" limit=1024 Jun 12 22:23:35.942052 ip-10-0-128-134 kubenswrapper[2559]: I0612 22:23:35.941955 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-f7h79_2fe08918-3efc-4000-a321-8b319ead517c/konnectivity-agent/0.log" limit=1024 Jun 12 22:23:36.042460 ip-10-0-128-134 kubenswrapper[2559]: I0612 22:23:36.042424 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-f7h79_2fe08918-3efc-4000-a321-8b319ead517c/konnectivity-agent/0.log" limit=1024 Jun 12 22:23:36.337628 ip-10-0-128-134 kubenswrapper[2559]: I0612 22:23:36.337597 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-f7h79_2fe08918-3efc-4000-a321-8b319ead517c/konnectivity-agent/0.log" limit=1024 Jun 12 22:23:46.162755 ip-10-0-128-134 kubenswrapper[2559]: I0612 22:23:46.162712 2559 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-7569c88997-v8b6n"] Jun 12 22:23:46.272554 ip-10-0-128-134 kubenswrapper[2559]: I0612 22:23:46.272520 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-f7h79_2fe08918-3efc-4000-a321-8b319ead517c/konnectivity-agent/0.log" limit=1024 Jun 12 22:23:46.372557 ip-10-0-128-134 kubenswrapper[2559]: I0612 22:23:46.372508 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-f7h79_2fe08918-3efc-4000-a321-8b319ead517c/konnectivity-agent/0.log" limit=1024 Jun 12 22:23:46.423017 ip-10-0-128-134 kubenswrapper[2559]: I0612 22:23:46.422937 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-f7h79_2fe08918-3efc-4000-a321-8b319ead517c/konnectivity-agent/0.log" limit=1024 Jun 12 22:23:52.151926 ip-10-0-128-134 kubenswrapper[2559]: I0612 22:23:52.151877 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-f7h79_2fe08918-3efc-4000-a321-8b319ead517c/konnectivity-agent/0.log" limit=1024 Jun 12 22:23:52.250102 ip-10-0-128-134 kubenswrapper[2559]: I0612 22:23:52.250068 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-f7h79_2fe08918-3efc-4000-a321-8b319ead517c/konnectivity-agent/0.log" limit=1024 Jun 12 22:24:05.917654 ip-10-0-128-134 kubenswrapper[2559]: I0612 22:24:05.917613 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-f7h79_2fe08918-3efc-4000-a321-8b319ead517c/konnectivity-agent/0.log" limit=1024 Jun 12 22:24:09.039634 ip-10-0-128-134 kubenswrapper[2559]: I0612 22:24:09.039602 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-f7h79_2fe08918-3efc-4000-a321-8b319ead517c/konnectivity-agent/0.log" limit=1024 Jun 12 22:24:11.183102 ip-10-0-128-134 kubenswrapper[2559]: I0612 22:24:11.183060 2559 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-console/console-7569c88997-v8b6n" podUID="440350d8-f7d7-4966-81f4-12ed1cea6334" containerName="console" containerID="cri-o://cda0b5a0d90c4e801116b8c6c92321fde3325c8c7956bfbf2981f39b3ad26e7d" gracePeriod=15 Jun 12 22:24:11.405265 ip-10-0-128-134 kubenswrapper[2559]: I0612 22:24:11.405237 2559 generic.go:356] "Generic (PLEG): container finished" podID="440350d8-f7d7-4966-81f4-12ed1cea6334" containerID="cda0b5a0d90c4e801116b8c6c92321fde3325c8c7956bfbf2981f39b3ad26e7d" exitCode=0 Jun 12 22:24:11.405386 ip-10-0-128-134 kubenswrapper[2559]: I0612 22:24:11.405287 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-7569c88997-v8b6n" event={"ID":"440350d8-f7d7-4966-81f4-12ed1cea6334","Type":"ContainerDied","Data":"cda0b5a0d90c4e801116b8c6c92321fde3325c8c7956bfbf2981f39b3ad26e7d"} Jun 12 22:24:11.419104 ip-10-0-128-134 kubenswrapper[2559]: I0612 22:24:11.419083 2559 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-7569c88997-v8b6n" Jun 12 22:24:11.516165 ip-10-0-128-134 kubenswrapper[2559]: I0612 22:24:11.516090 2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-cw22f\" (UniqueName: \"kubernetes.io/projected/440350d8-f7d7-4966-81f4-12ed1cea6334-kube-api-access-cw22f\") pod \"440350d8-f7d7-4966-81f4-12ed1cea6334\" (UID: \"440350d8-f7d7-4966-81f4-12ed1cea6334\") " Jun 12 22:24:11.516165 ip-10-0-128-134 kubenswrapper[2559]: I0612 22:24:11.516129 2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/440350d8-f7d7-4966-81f4-12ed1cea6334-console-serving-cert\") pod \"440350d8-f7d7-4966-81f4-12ed1cea6334\" (UID: \"440350d8-f7d7-4966-81f4-12ed1cea6334\") " Jun 12 22:24:11.516165 ip-10-0-128-134 kubenswrapper[2559]: I0612 22:24:11.516154 2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/440350d8-f7d7-4966-81f4-12ed1cea6334-service-ca\") pod \"440350d8-f7d7-4966-81f4-12ed1cea6334\" (UID: \"440350d8-f7d7-4966-81f4-12ed1cea6334\") " Jun 12 22:24:11.516420 ip-10-0-128-134 kubenswrapper[2559]: I0612 22:24:11.516177 2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/440350d8-f7d7-4966-81f4-12ed1cea6334-console-oauth-config\") pod \"440350d8-f7d7-4966-81f4-12ed1cea6334\" (UID: \"440350d8-f7d7-4966-81f4-12ed1cea6334\") " Jun 12 22:24:11.516420 ip-10-0-128-134 kubenswrapper[2559]: I0612 22:24:11.516239 2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/440350d8-f7d7-4966-81f4-12ed1cea6334-trusted-ca-bundle\") pod \"440350d8-f7d7-4966-81f4-12ed1cea6334\" (UID: \"440350d8-f7d7-4966-81f4-12ed1cea6334\") " Jun 12 22:24:11.516420 ip-10-0-128-134 kubenswrapper[2559]: I0612 22:24:11.516312 2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/440350d8-f7d7-4966-81f4-12ed1cea6334-oauth-serving-cert\") pod \"440350d8-f7d7-4966-81f4-12ed1cea6334\" (UID: \"440350d8-f7d7-4966-81f4-12ed1cea6334\") " Jun 12 22:24:11.516420 ip-10-0-128-134 kubenswrapper[2559]: I0612 22:24:11.516331 2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/440350d8-f7d7-4966-81f4-12ed1cea6334-console-config\") pod \"440350d8-f7d7-4966-81f4-12ed1cea6334\" (UID: \"440350d8-f7d7-4966-81f4-12ed1cea6334\") " Jun 12 22:24:11.516712 ip-10-0-128-134 kubenswrapper[2559]: I0612 22:24:11.516676 2559 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/440350d8-f7d7-4966-81f4-12ed1cea6334-service-ca" (OuterVolumeSpecName: "service-ca") pod "440350d8-f7d7-4966-81f4-12ed1cea6334" (UID: "440350d8-f7d7-4966-81f4-12ed1cea6334"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 12 22:24:11.516854 ip-10-0-128-134 kubenswrapper[2559]: I0612 22:24:11.516811 2559 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/440350d8-f7d7-4966-81f4-12ed1cea6334-trusted-ca-bundle" (OuterVolumeSpecName: "trusted-ca-bundle") pod "440350d8-f7d7-4966-81f4-12ed1cea6334" (UID: "440350d8-f7d7-4966-81f4-12ed1cea6334"). InnerVolumeSpecName "trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 12 22:24:11.517072 ip-10-0-128-134 kubenswrapper[2559]: I0612 22:24:11.517045 2559 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/440350d8-f7d7-4966-81f4-12ed1cea6334-console-config" (OuterVolumeSpecName: "console-config") pod "440350d8-f7d7-4966-81f4-12ed1cea6334" (UID: "440350d8-f7d7-4966-81f4-12ed1cea6334"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 12 22:24:11.517370 ip-10-0-128-134 kubenswrapper[2559]: I0612 22:24:11.517329 2559 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/440350d8-f7d7-4966-81f4-12ed1cea6334-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "440350d8-f7d7-4966-81f4-12ed1cea6334" (UID: "440350d8-f7d7-4966-81f4-12ed1cea6334"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 12 22:24:11.518595 ip-10-0-128-134 kubenswrapper[2559]: I0612 22:24:11.518571 2559 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/440350d8-f7d7-4966-81f4-12ed1cea6334-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "440350d8-f7d7-4966-81f4-12ed1cea6334" (UID: "440350d8-f7d7-4966-81f4-12ed1cea6334"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 12 22:24:11.518669 ip-10-0-128-134 kubenswrapper[2559]: I0612 22:24:11.518613 2559 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/440350d8-f7d7-4966-81f4-12ed1cea6334-kube-api-access-cw22f" (OuterVolumeSpecName: "kube-api-access-cw22f") pod "440350d8-f7d7-4966-81f4-12ed1cea6334" (UID: "440350d8-f7d7-4966-81f4-12ed1cea6334"). InnerVolumeSpecName "kube-api-access-cw22f". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 12 22:24:11.518669 ip-10-0-128-134 kubenswrapper[2559]: I0612 22:24:11.518634 2559 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/440350d8-f7d7-4966-81f4-12ed1cea6334-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "440350d8-f7d7-4966-81f4-12ed1cea6334" (UID: "440350d8-f7d7-4966-81f4-12ed1cea6334"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 12 22:24:11.617845 ip-10-0-128-134 kubenswrapper[2559]: I0612 22:24:11.617812 2559 reconciler_common.go:299] "Volume detached for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/440350d8-f7d7-4966-81f4-12ed1cea6334-trusted-ca-bundle\") on node \"ip-10-0-128-134.ec2.internal\" DevicePath \"\"" Jun 12 22:24:11.617845 ip-10-0-128-134 kubenswrapper[2559]: I0612 22:24:11.617836 2559 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/440350d8-f7d7-4966-81f4-12ed1cea6334-oauth-serving-cert\") on node \"ip-10-0-128-134.ec2.internal\" DevicePath \"\"" Jun 12 22:24:11.617845 ip-10-0-128-134 kubenswrapper[2559]: I0612 22:24:11.617845 2559 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/440350d8-f7d7-4966-81f4-12ed1cea6334-console-config\") on node \"ip-10-0-128-134.ec2.internal\" DevicePath \"\"" Jun 12 22:24:11.617845 ip-10-0-128-134 kubenswrapper[2559]: I0612 22:24:11.617854 2559 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-cw22f\" (UniqueName: \"kubernetes.io/projected/440350d8-f7d7-4966-81f4-12ed1cea6334-kube-api-access-cw22f\") on node \"ip-10-0-128-134.ec2.internal\" DevicePath \"\"" Jun 12 22:24:11.618093 ip-10-0-128-134 kubenswrapper[2559]: I0612 22:24:11.617863 2559 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/440350d8-f7d7-4966-81f4-12ed1cea6334-console-serving-cert\") on node \"ip-10-0-128-134.ec2.internal\" DevicePath \"\"" Jun 12 22:24:11.618093 ip-10-0-128-134 kubenswrapper[2559]: I0612 22:24:11.617871 2559 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/440350d8-f7d7-4966-81f4-12ed1cea6334-service-ca\") on node \"ip-10-0-128-134.ec2.internal\" DevicePath \"\"" Jun 12 22:24:11.618093 ip-10-0-128-134 kubenswrapper[2559]: I0612 22:24:11.617879 2559 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/440350d8-f7d7-4966-81f4-12ed1cea6334-console-oauth-config\") on node \"ip-10-0-128-134.ec2.internal\" DevicePath \"\"" Jun 12 22:24:12.410806 ip-10-0-128-134 kubenswrapper[2559]: I0612 22:24:12.410772 2559 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-7569c88997-v8b6n" Jun 12 22:24:12.411239 ip-10-0-128-134 kubenswrapper[2559]: I0612 22:24:12.410783 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-7569c88997-v8b6n" event={"ID":"440350d8-f7d7-4966-81f4-12ed1cea6334","Type":"ContainerDied","Data":"00bc76c3f83b0c5f5bc1dc4e834d3a7de73080d1adde5187bbc5b15d2fb13041"} Jun 12 22:24:12.411239 ip-10-0-128-134 kubenswrapper[2559]: I0612 22:24:12.410902 2559 scope.go:117] "RemoveContainer" containerID="cda0b5a0d90c4e801116b8c6c92321fde3325c8c7956bfbf2981f39b3ad26e7d" Jun 12 22:24:12.434639 ip-10-0-128-134 kubenswrapper[2559]: I0612 22:24:12.434612 2559 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-7569c88997-v8b6n"] Jun 12 22:24:12.438488 ip-10-0-128-134 kubenswrapper[2559]: I0612 22:24:12.438464 2559 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-7569c88997-v8b6n"] Jun 12 22:24:14.409202 ip-10-0-128-134 kubenswrapper[2559]: I0612 22:24:14.409170 2559 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="440350d8-f7d7-4966-81f4-12ed1cea6334" path="/var/lib/kubelet/pods/440350d8-f7d7-4966-81f4-12ed1cea6334/volumes" Jun 12 22:24:23.987721 ip-10-0-128-134 kubenswrapper[2559]: I0612 22:24:23.987688 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-f7h79_2fe08918-3efc-4000-a321-8b319ead517c/konnectivity-agent/0.log" limit=1024 Jun 12 22:24:24.587647 ip-10-0-128-134 kubenswrapper[2559]: I0612 22:24:24.587615 2559 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-monitoring/prometheus-k8s-0" Jun 12 22:24:24.603824 ip-10-0-128-134 kubenswrapper[2559]: I0612 22:24:24.603790 2559 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-monitoring/prometheus-k8s-0" Jun 12 22:24:25.372334 ip-10-0-128-134 kubenswrapper[2559]: I0612 22:24:25.372303 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-f7h79_2fe08918-3efc-4000-a321-8b319ead517c/konnectivity-agent/0.log" limit=1024 Jun 12 22:24:25.474142 ip-10-0-128-134 kubenswrapper[2559]: I0612 22:24:25.474113 2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/prometheus-k8s-0" Jun 12 22:24:27.641637 ip-10-0-128-134 kubenswrapper[2559]: I0612 22:24:27.641604 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-f7h79_2fe08918-3efc-4000-a321-8b319ead517c/konnectivity-agent/0.log" limit=1024 Jun 12 22:24:27.742269 ip-10-0-128-134 kubenswrapper[2559]: I0612 22:24:27.742236 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-f7h79_2fe08918-3efc-4000-a321-8b319ead517c/konnectivity-agent/0.log" limit=1024 Jun 12 22:24:28.240182 ip-10-0-128-134 kubenswrapper[2559]: I0612 22:24:28.240146 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-f7h79_2fe08918-3efc-4000-a321-8b319ead517c/konnectivity-agent/0.log" limit=1024 Jun 12 22:24:28.314424 ip-10-0-128-134 kubenswrapper[2559]: I0612 22:24:28.314390 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-f7h79_2fe08918-3efc-4000-a321-8b319ead517c/konnectivity-agent/0.log" limit=1024 Jun 12 22:24:28.730583 ip-10-0-128-134 kubenswrapper[2559]: I0612 22:24:28.730546 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-f7h79_2fe08918-3efc-4000-a321-8b319ead517c/konnectivity-agent/0.log" limit=1024 Jun 12 22:24:28.847187 ip-10-0-128-134 kubenswrapper[2559]: I0612 22:24:28.847155 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-f7h79_2fe08918-3efc-4000-a321-8b319ead517c/konnectivity-agent/0.log" limit=1024 Jun 12 22:24:31.668051 ip-10-0-128-134 kubenswrapper[2559]: I0612 22:24:31.668019 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-f7h79_2fe08918-3efc-4000-a321-8b319ead517c/konnectivity-agent/0.log" limit=1024 Jun 12 22:24:32.088675 ip-10-0-128-134 kubenswrapper[2559]: I0612 22:24:32.088641 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-f7h79_2fe08918-3efc-4000-a321-8b319ead517c/konnectivity-agent/0.log" limit=1024 Jun 12 22:24:34.597052 ip-10-0-128-134 kubenswrapper[2559]: I0612 22:24:34.597024 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-f7h79_2fe08918-3efc-4000-a321-8b319ead517c/konnectivity-agent/0.log" limit=1024 Jun 12 22:24:34.655735 ip-10-0-128-134 kubenswrapper[2559]: I0612 22:24:34.655702 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-f7h79_2fe08918-3efc-4000-a321-8b319ead517c/konnectivity-agent/0.log" limit=1024 Jun 12 22:24:36.082023 ip-10-0-128-134 kubenswrapper[2559]: I0612 22:24:36.081991 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-f7h79_2fe08918-3efc-4000-a321-8b319ead517c/konnectivity-agent/0.log" limit=1024 Jun 12 22:24:38.926547 ip-10-0-128-134 kubenswrapper[2559]: I0612 22:24:38.926507 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-f7h79_2fe08918-3efc-4000-a321-8b319ead517c/konnectivity-agent/0.log" limit=1024 Jun 12 22:24:41.556853 ip-10-0-128-134 kubenswrapper[2559]: I0612 22:24:41.556822 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-f7h79_2fe08918-3efc-4000-a321-8b319ead517c/konnectivity-agent/0.log" limit=1024 Jun 12 22:24:41.657285 ip-10-0-128-134 kubenswrapper[2559]: I0612 22:24:41.657257 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-f7h79_2fe08918-3efc-4000-a321-8b319ead517c/konnectivity-agent/0.log" limit=1024 Jun 12 22:24:41.760396 ip-10-0-128-134 kubenswrapper[2559]: I0612 22:24:41.760358 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-f7h79_2fe08918-3efc-4000-a321-8b319ead517c/konnectivity-agent/0.log" limit=1024 Jun 12 22:24:43.412534 ip-10-0-128-134 kubenswrapper[2559]: I0612 22:24:43.412506 2559 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-lws-operator/openshift-lws-operator-fd8ccff4c-qf2ws"] Jun 12 22:24:43.412914 ip-10-0-128-134 kubenswrapper[2559]: I0612 22:24:43.412828 2559 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="440350d8-f7d7-4966-81f4-12ed1cea6334" containerName="console" Jun 12 22:24:43.412914 ip-10-0-128-134 kubenswrapper[2559]: I0612 22:24:43.412839 2559 state_mem.go:107] "Deleted CPUSet assignment" podUID="440350d8-f7d7-4966-81f4-12ed1cea6334" containerName="console" Jun 12 22:24:43.412914 ip-10-0-128-134 kubenswrapper[2559]: I0612 22:24:43.412884 2559 memory_manager.go:368] "RemoveStaleState removing state" podUID="440350d8-f7d7-4966-81f4-12ed1cea6334" containerName="console" Jun 12 22:24:43.414687 ip-10-0-128-134 kubenswrapper[2559]: I0612 22:24:43.414671 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-qf2ws" Jun 12 22:24:43.417270 ip-10-0-128-134 kubenswrapper[2559]: I0612 22:24:43.417247 2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"kube-root-ca.crt\"" Jun 12 22:24:43.417378 ip-10-0-128-134 kubenswrapper[2559]: I0612 22:24:43.417247 2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"openshift-service-ca.crt\"" Jun 12 22:24:43.418506 ip-10-0-128-134 kubenswrapper[2559]: I0612 22:24:43.418491 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"openshift-lws-operator-dockercfg-mk5hh\"" Jun 12 22:24:43.424671 ip-10-0-128-134 kubenswrapper[2559]: I0612 22:24:43.424648 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/openshift-lws-operator-fd8ccff4c-qf2ws"] Jun 12 22:24:43.475488 ip-10-0-128-134 kubenswrapper[2559]: I0612 22:24:43.475439 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-npvgd\" (UniqueName: \"kubernetes.io/projected/4ac9953d-8ff2-4d5d-9315-64bc75440b5d-kube-api-access-npvgd\") pod \"openshift-lws-operator-fd8ccff4c-qf2ws\" (UID: \"4ac9953d-8ff2-4d5d-9315-64bc75440b5d\") " pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-qf2ws" Jun 12 22:24:43.475637 ip-10-0-128-134 kubenswrapper[2559]: I0612 22:24:43.475542 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/4ac9953d-8ff2-4d5d-9315-64bc75440b5d-tmp\") pod \"openshift-lws-operator-fd8ccff4c-qf2ws\" (UID: \"4ac9953d-8ff2-4d5d-9315-64bc75440b5d\") " pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-qf2ws" Jun 12 22:24:43.576151 ip-10-0-128-134 kubenswrapper[2559]: I0612 22:24:43.576121 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/4ac9953d-8ff2-4d5d-9315-64bc75440b5d-tmp\") pod \"openshift-lws-operator-fd8ccff4c-qf2ws\" (UID: \"4ac9953d-8ff2-4d5d-9315-64bc75440b5d\") " pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-qf2ws" Jun 12 22:24:43.576330 ip-10-0-128-134 kubenswrapper[2559]: I0612 22:24:43.576167 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-npvgd\" (UniqueName: \"kubernetes.io/projected/4ac9953d-8ff2-4d5d-9315-64bc75440b5d-kube-api-access-npvgd\") pod \"openshift-lws-operator-fd8ccff4c-qf2ws\" (UID: \"4ac9953d-8ff2-4d5d-9315-64bc75440b5d\") " pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-qf2ws" Jun 12 22:24:43.576519 ip-10-0-128-134 kubenswrapper[2559]: I0612 22:24:43.576500 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/4ac9953d-8ff2-4d5d-9315-64bc75440b5d-tmp\") pod \"openshift-lws-operator-fd8ccff4c-qf2ws\" (UID: \"4ac9953d-8ff2-4d5d-9315-64bc75440b5d\") " pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-qf2ws" Jun 12 22:24:43.587347 ip-10-0-128-134 kubenswrapper[2559]: I0612 22:24:43.587324 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-npvgd\" (UniqueName: \"kubernetes.io/projected/4ac9953d-8ff2-4d5d-9315-64bc75440b5d-kube-api-access-npvgd\") pod \"openshift-lws-operator-fd8ccff4c-qf2ws\" (UID: \"4ac9953d-8ff2-4d5d-9315-64bc75440b5d\") " pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-qf2ws" Jun 12 22:24:43.741039 ip-10-0-128-134 kubenswrapper[2559]: I0612 22:24:43.740937 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-qf2ws" Jun 12 22:24:43.765336 ip-10-0-128-134 kubenswrapper[2559]: I0612 22:24:43.765302 2559 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["cert-manager/cert-manager-59c77684cc-2vk78"] Jun 12 22:24:43.768199 ip-10-0-128-134 kubenswrapper[2559]: I0612 22:24:43.768178 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-59c77684cc-2vk78" Jun 12 22:24:43.770946 ip-10-0-128-134 kubenswrapper[2559]: I0612 22:24:43.770908 2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager\"/\"kube-root-ca.crt\"" Jun 12 22:24:43.770946 ip-10-0-128-134 kubenswrapper[2559]: I0612 22:24:43.770946 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"cert-manager\"/\"cert-manager-dockercfg-bx5z5\"" Jun 12 22:24:43.771098 ip-10-0-128-134 kubenswrapper[2559]: I0612 22:24:43.771009 2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager\"/\"openshift-service-ca.crt\"" Jun 12 22:24:43.781531 ip-10-0-128-134 kubenswrapper[2559]: I0612 22:24:43.781503 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-59c77684cc-2vk78"] Jun 12 22:24:43.870683 ip-10-0-128-134 kubenswrapper[2559]: I0612 22:24:43.870659 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/openshift-lws-operator-fd8ccff4c-qf2ws"] Jun 12 22:24:43.872976 ip-10-0-128-134 kubenswrapper[2559]: W0612 22:24:43.872950 2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod4ac9953d_8ff2_4d5d_9315_64bc75440b5d.slice/crio-7d243d9c01aa5512dec479ce97bab969ce64a84b8ebab2af131beabc1dfeff37 WatchSource:0}: Error finding container 7d243d9c01aa5512dec479ce97bab969ce64a84b8ebab2af131beabc1dfeff37: Status 404 returned error can't find the container with id 7d243d9c01aa5512dec479ce97bab969ce64a84b8ebab2af131beabc1dfeff37 Jun 12 22:24:43.879186 ip-10-0-128-134 kubenswrapper[2559]: I0612 22:24:43.879159 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-l6ggx\" (UniqueName: \"kubernetes.io/projected/ff176770-aa21-4a7b-99e0-9315ae71db02-kube-api-access-l6ggx\") pod \"cert-manager-59c77684cc-2vk78\" (UID: \"ff176770-aa21-4a7b-99e0-9315ae71db02\") " pod="cert-manager/cert-manager-59c77684cc-2vk78" Jun 12 22:24:43.879275 ip-10-0-128-134 kubenswrapper[2559]: I0612 22:24:43.879243 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/ff176770-aa21-4a7b-99e0-9315ae71db02-bound-sa-token\") pod \"cert-manager-59c77684cc-2vk78\" (UID: \"ff176770-aa21-4a7b-99e0-9315ae71db02\") " pod="cert-manager/cert-manager-59c77684cc-2vk78" Jun 12 22:24:43.980285 ip-10-0-128-134 kubenswrapper[2559]: I0612 22:24:43.980243 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-l6ggx\" (UniqueName: \"kubernetes.io/projected/ff176770-aa21-4a7b-99e0-9315ae71db02-kube-api-access-l6ggx\") pod \"cert-manager-59c77684cc-2vk78\" (UID: \"ff176770-aa21-4a7b-99e0-9315ae71db02\") " pod="cert-manager/cert-manager-59c77684cc-2vk78" Jun 12 22:24:43.980511 ip-10-0-128-134 kubenswrapper[2559]: I0612 22:24:43.980312 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/ff176770-aa21-4a7b-99e0-9315ae71db02-bound-sa-token\") pod \"cert-manager-59c77684cc-2vk78\" (UID: \"ff176770-aa21-4a7b-99e0-9315ae71db02\") " pod="cert-manager/cert-manager-59c77684cc-2vk78" Jun 12 22:24:43.988703 ip-10-0-128-134 kubenswrapper[2559]: I0612 22:24:43.988674 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/ff176770-aa21-4a7b-99e0-9315ae71db02-bound-sa-token\") pod \"cert-manager-59c77684cc-2vk78\" (UID: \"ff176770-aa21-4a7b-99e0-9315ae71db02\") " pod="cert-manager/cert-manager-59c77684cc-2vk78" Jun 12 22:24:43.988806 ip-10-0-128-134 kubenswrapper[2559]: I0612 22:24:43.988722 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-l6ggx\" (UniqueName: \"kubernetes.io/projected/ff176770-aa21-4a7b-99e0-9315ae71db02-kube-api-access-l6ggx\") pod \"cert-manager-59c77684cc-2vk78\" (UID: \"ff176770-aa21-4a7b-99e0-9315ae71db02\") " pod="cert-manager/cert-manager-59c77684cc-2vk78" Jun 12 22:24:44.078045 ip-10-0-128-134 kubenswrapper[2559]: I0612 22:24:44.078010 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-59c77684cc-2vk78" Jun 12 22:24:44.205615 ip-10-0-128-134 kubenswrapper[2559]: I0612 22:24:44.205590 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-59c77684cc-2vk78"] Jun 12 22:24:44.207863 ip-10-0-128-134 kubenswrapper[2559]: W0612 22:24:44.207836 2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podff176770_aa21_4a7b_99e0_9315ae71db02.slice/crio-bf3022dcb85b0f4aff08f5e17da9beccf2a0c8f4f632b61265ec8858b046ac1b WatchSource:0}: Error finding container bf3022dcb85b0f4aff08f5e17da9beccf2a0c8f4f632b61265ec8858b046ac1b: Status 404 returned error can't find the container with id bf3022dcb85b0f4aff08f5e17da9beccf2a0c8f4f632b61265ec8858b046ac1b Jun 12 22:24:44.537537 ip-10-0-128-134 kubenswrapper[2559]: I0612 22:24:44.537412 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-qf2ws" event={"ID":"4ac9953d-8ff2-4d5d-9315-64bc75440b5d","Type":"ContainerStarted","Data":"7d243d9c01aa5512dec479ce97bab969ce64a84b8ebab2af131beabc1dfeff37"} Jun 12 22:24:44.539154 ip-10-0-128-134 kubenswrapper[2559]: I0612 22:24:44.539127 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-59c77684cc-2vk78" event={"ID":"ff176770-aa21-4a7b-99e0-9315ae71db02","Type":"ContainerStarted","Data":"bf3022dcb85b0f4aff08f5e17da9beccf2a0c8f4f632b61265ec8858b046ac1b"} Jun 12 22:24:46.551919 ip-10-0-128-134 kubenswrapper[2559]: I0612 22:24:46.551857 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-qf2ws" event={"ID":"4ac9953d-8ff2-4d5d-9315-64bc75440b5d","Type":"ContainerStarted","Data":"e99ee67eb2e910f0b36da1d1d025d96dadc2daefda677a2fb8d08da689660941"} Jun 12 22:24:46.574798 ip-10-0-128-134 kubenswrapper[2559]: I0612 22:24:46.574733 2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-qf2ws" podStartSLOduration=1.3615822149999999 podStartE2EDuration="3.574713271s" totalImagesPullingTime="2.213131056s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-12 22:24:43 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-12 22:24:46.574528805 +0000 UTC m=+228.622898624" watchObservedRunningTime="2026-06-12 22:24:46.574713271 +0000 UTC m=+228.623083089" Jun 12 22:24:47.293084 ip-10-0-128-134 kubenswrapper[2559]: I0612 22:24:47.293051 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-f7h79_2fe08918-3efc-4000-a321-8b319ead517c/konnectivity-agent/0.log" limit=1024 Jun 12 22:24:47.391073 ip-10-0-128-134 kubenswrapper[2559]: I0612 22:24:47.391035 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-f7h79_2fe08918-3efc-4000-a321-8b319ead517c/konnectivity-agent/0.log" limit=1024 Jun 12 22:24:48.565597 ip-10-0-128-134 kubenswrapper[2559]: I0612 22:24:48.565571 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-59c77684cc-2vk78" event={"ID":"ff176770-aa21-4a7b-99e0-9315ae71db02","Type":"ContainerStarted","Data":"02dbd5ea0cf2a5bc130a810c668b4b976193b1da0be985125cb04c99aa3dcc88"} Jun 12 22:24:48.580439 ip-10-0-128-134 kubenswrapper[2559]: I0612 22:24:48.580395 2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="cert-manager/cert-manager-59c77684cc-2vk78" podStartSLOduration=1.29207934 podStartE2EDuration="5.580378505s" totalImagesPullingTime="4.288299165s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-12 22:24:43 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-12 22:24:48.579512147 +0000 UTC m=+230.627881965" watchObservedRunningTime="2026-06-12 22:24:48.580378505 +0000 UTC m=+230.628748322" Jun 12 22:24:49.832435 ip-10-0-128-134 kubenswrapper[2559]: I0612 22:24:49.832402 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-f7h79_2fe08918-3efc-4000-a321-8b319ead517c/konnectivity-agent/0.log" limit=1024 Jun 12 22:25:04.689604 ip-10-0-128-134 kubenswrapper[2559]: I0612 22:25:04.689568 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-f7h79_2fe08918-3efc-4000-a321-8b319ead517c/konnectivity-agent/0.log" limit=1024 Jun 12 22:25:04.791678 ip-10-0-128-134 kubenswrapper[2559]: I0612 22:25:04.791648 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-f7h79_2fe08918-3efc-4000-a321-8b319ead517c/konnectivity-agent/0.log" limit=1024 Jun 12 22:25:05.485289 ip-10-0-128-134 kubenswrapper[2559]: I0612 22:25:05.485259 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-f7h79_2fe08918-3efc-4000-a321-8b319ead517c/konnectivity-agent/0.log" limit=1024 Jun 12 22:25:05.835340 ip-10-0-128-134 kubenswrapper[2559]: I0612 22:25:05.835307 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-f7h79_2fe08918-3efc-4000-a321-8b319ead517c/konnectivity-agent/0.log" limit=1024 Jun 12 22:25:05.941101 ip-10-0-128-134 kubenswrapper[2559]: I0612 22:25:05.941042 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-f7h79_2fe08918-3efc-4000-a321-8b319ead517c/konnectivity-agent/0.log" limit=1024 Jun 12 22:25:06.006747 ip-10-0-128-134 kubenswrapper[2559]: I0612 22:25:06.006715 2559 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-69cd748fbc-t2pcx"] Jun 12 22:25:06.011453 ip-10-0-128-134 kubenswrapper[2559]: I0612 22:25:06.011426 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-69cd748fbc-t2pcx" Jun 12 22:25:06.016797 ip-10-0-128-134 kubenswrapper[2559]: I0612 22:25:06.016778 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-webhook-cert\"" Jun 12 22:25:06.016925 ip-10-0-128-134 kubenswrapper[2559]: I0612 22:25:06.016900 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-service-cert\"" Jun 12 22:25:06.017054 ip-10-0-128-134 kubenswrapper[2559]: I0612 22:25:06.017036 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-dockercfg-hv5kw\"" Jun 12 22:25:06.017877 ip-10-0-128-134 kubenswrapper[2559]: I0612 22:25:06.017724 2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"kube-root-ca.crt\"" Jun 12 22:25:06.017877 ip-10-0-128-134 kubenswrapper[2559]: I0612 22:25:06.017749 2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"openshift-service-ca.crt\"" Jun 12 22:25:06.037498 ip-10-0-128-134 kubenswrapper[2559]: I0612 22:25:06.037477 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-69cd748fbc-t2pcx"] Jun 12 22:25:06.146135 ip-10-0-128-134 kubenswrapper[2559]: I0612 22:25:06.146050 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-f7h79_2fe08918-3efc-4000-a321-8b319ead517c/konnectivity-agent/0.log" limit=1024 Jun 12 22:25:06.171547 ip-10-0-128-134 kubenswrapper[2559]: I0612 22:25:06.171518 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/20fec839-f5bc-4da8-ad4f-a87440e64ca2-manifests\") pod \"opendatahub-operator-controller-manager-69cd748fbc-t2pcx\" (UID: \"20fec839-f5bc-4da8-ad4f-a87440e64ca2\") " pod="opendatahub/opendatahub-operator-controller-manager-69cd748fbc-t2pcx" Jun 12 22:25:06.171690 ip-10-0-128-134 kubenswrapper[2559]: I0612 22:25:06.171552 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/20fec839-f5bc-4da8-ad4f-a87440e64ca2-tmp\") pod \"opendatahub-operator-controller-manager-69cd748fbc-t2pcx\" (UID: \"20fec839-f5bc-4da8-ad4f-a87440e64ca2\") " pod="opendatahub/opendatahub-operator-controller-manager-69cd748fbc-t2pcx" Jun 12 22:25:06.171690 ip-10-0-128-134 kubenswrapper[2559]: I0612 22:25:06.171579 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/20fec839-f5bc-4da8-ad4f-a87440e64ca2-webhook-cert\") pod \"opendatahub-operator-controller-manager-69cd748fbc-t2pcx\" (UID: \"20fec839-f5bc-4da8-ad4f-a87440e64ca2\") " pod="opendatahub/opendatahub-operator-controller-manager-69cd748fbc-t2pcx" Jun 12 22:25:06.171811 ip-10-0-128-134 kubenswrapper[2559]: I0612 22:25:06.171701 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-k58cq\" (UniqueName: \"kubernetes.io/projected/20fec839-f5bc-4da8-ad4f-a87440e64ca2-kube-api-access-k58cq\") pod \"opendatahub-operator-controller-manager-69cd748fbc-t2pcx\" (UID: \"20fec839-f5bc-4da8-ad4f-a87440e64ca2\") " pod="opendatahub/opendatahub-operator-controller-manager-69cd748fbc-t2pcx" Jun 12 22:25:06.171811 ip-10-0-128-134 kubenswrapper[2559]: I0612 22:25:06.171737 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/20fec839-f5bc-4da8-ad4f-a87440e64ca2-apiservice-cert\") pod \"opendatahub-operator-controller-manager-69cd748fbc-t2pcx\" (UID: \"20fec839-f5bc-4da8-ad4f-a87440e64ca2\") " pod="opendatahub/opendatahub-operator-controller-manager-69cd748fbc-t2pcx" Jun 12 22:25:06.242589 ip-10-0-128-134 kubenswrapper[2559]: I0612 22:25:06.242555 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-f7h79_2fe08918-3efc-4000-a321-8b319ead517c/konnectivity-agent/0.log" limit=1024 Jun 12 22:25:06.272253 ip-10-0-128-134 kubenswrapper[2559]: I0612 22:25:06.272221 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/20fec839-f5bc-4da8-ad4f-a87440e64ca2-manifests\") pod \"opendatahub-operator-controller-manager-69cd748fbc-t2pcx\" (UID: \"20fec839-f5bc-4da8-ad4f-a87440e64ca2\") " pod="opendatahub/opendatahub-operator-controller-manager-69cd748fbc-t2pcx" Jun 12 22:25:06.272253 ip-10-0-128-134 kubenswrapper[2559]: I0612 22:25:06.272254 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/20fec839-f5bc-4da8-ad4f-a87440e64ca2-tmp\") pod \"opendatahub-operator-controller-manager-69cd748fbc-t2pcx\" (UID: \"20fec839-f5bc-4da8-ad4f-a87440e64ca2\") " pod="opendatahub/opendatahub-operator-controller-manager-69cd748fbc-t2pcx" Jun 12 22:25:06.272503 ip-10-0-128-134 kubenswrapper[2559]: I0612 22:25:06.272279 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/20fec839-f5bc-4da8-ad4f-a87440e64ca2-webhook-cert\") pod \"opendatahub-operator-controller-manager-69cd748fbc-t2pcx\" (UID: \"20fec839-f5bc-4da8-ad4f-a87440e64ca2\") " pod="opendatahub/opendatahub-operator-controller-manager-69cd748fbc-t2pcx" Jun 12 22:25:06.272503 ip-10-0-128-134 kubenswrapper[2559]: I0612 22:25:06.272356 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-k58cq\" (UniqueName: \"kubernetes.io/projected/20fec839-f5bc-4da8-ad4f-a87440e64ca2-kube-api-access-k58cq\") pod \"opendatahub-operator-controller-manager-69cd748fbc-t2pcx\" (UID: \"20fec839-f5bc-4da8-ad4f-a87440e64ca2\") " pod="opendatahub/opendatahub-operator-controller-manager-69cd748fbc-t2pcx" Jun 12 22:25:06.272503 ip-10-0-128-134 kubenswrapper[2559]: I0612 22:25:06.272386 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/20fec839-f5bc-4da8-ad4f-a87440e64ca2-apiservice-cert\") pod \"opendatahub-operator-controller-manager-69cd748fbc-t2pcx\" (UID: \"20fec839-f5bc-4da8-ad4f-a87440e64ca2\") " pod="opendatahub/opendatahub-operator-controller-manager-69cd748fbc-t2pcx" Jun 12 22:25:06.272687 ip-10-0-128-134 kubenswrapper[2559]: I0612 22:25:06.272607 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/20fec839-f5bc-4da8-ad4f-a87440e64ca2-manifests\") pod \"opendatahub-operator-controller-manager-69cd748fbc-t2pcx\" (UID: \"20fec839-f5bc-4da8-ad4f-a87440e64ca2\") " pod="opendatahub/opendatahub-operator-controller-manager-69cd748fbc-t2pcx" Jun 12 22:25:06.274879 ip-10-0-128-134 kubenswrapper[2559]: I0612 22:25:06.274849 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/20fec839-f5bc-4da8-ad4f-a87440e64ca2-tmp\") pod \"opendatahub-operator-controller-manager-69cd748fbc-t2pcx\" (UID: \"20fec839-f5bc-4da8-ad4f-a87440e64ca2\") " pod="opendatahub/opendatahub-operator-controller-manager-69cd748fbc-t2pcx" Jun 12 22:25:06.274977 ip-10-0-128-134 kubenswrapper[2559]: I0612 22:25:06.274932 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/20fec839-f5bc-4da8-ad4f-a87440e64ca2-apiservice-cert\") pod \"opendatahub-operator-controller-manager-69cd748fbc-t2pcx\" (UID: \"20fec839-f5bc-4da8-ad4f-a87440e64ca2\") " pod="opendatahub/opendatahub-operator-controller-manager-69cd748fbc-t2pcx" Jun 12 22:25:06.274977 ip-10-0-128-134 kubenswrapper[2559]: I0612 22:25:06.274945 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/20fec839-f5bc-4da8-ad4f-a87440e64ca2-webhook-cert\") pod \"opendatahub-operator-controller-manager-69cd748fbc-t2pcx\" (UID: \"20fec839-f5bc-4da8-ad4f-a87440e64ca2\") " pod="opendatahub/opendatahub-operator-controller-manager-69cd748fbc-t2pcx" Jun 12 22:25:06.284212 ip-10-0-128-134 kubenswrapper[2559]: I0612 22:25:06.284192 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-k58cq\" (UniqueName: \"kubernetes.io/projected/20fec839-f5bc-4da8-ad4f-a87440e64ca2-kube-api-access-k58cq\") pod \"opendatahub-operator-controller-manager-69cd748fbc-t2pcx\" (UID: \"20fec839-f5bc-4da8-ad4f-a87440e64ca2\") " pod="opendatahub/opendatahub-operator-controller-manager-69cd748fbc-t2pcx" Jun 12 22:25:06.321379 ip-10-0-128-134 kubenswrapper[2559]: I0612 22:25:06.321351 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-69cd748fbc-t2pcx" Jun 12 22:25:06.410545 ip-10-0-128-134 kubenswrapper[2559]: I0612 22:25:06.410504 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-f7h79_2fe08918-3efc-4000-a321-8b319ead517c/konnectivity-agent/0.log" limit=1024 Jun 12 22:25:06.470565 ip-10-0-128-134 kubenswrapper[2559]: I0612 22:25:06.470523 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-69cd748fbc-t2pcx"] Jun 12 22:25:06.473250 ip-10-0-128-134 kubenswrapper[2559]: W0612 22:25:06.473226 2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod20fec839_f5bc_4da8_ad4f_a87440e64ca2.slice/crio-574be0c2d00adf0aa1bc64884424d6c8d7f7a00a7b6cd0f3d261b9f338bc7557 WatchSource:0}: Error finding container 574be0c2d00adf0aa1bc64884424d6c8d7f7a00a7b6cd0f3d261b9f338bc7557: Status 404 returned error can't find the container with id 574be0c2d00adf0aa1bc64884424d6c8d7f7a00a7b6cd0f3d261b9f338bc7557 Jun 12 22:25:06.516834 ip-10-0-128-134 kubenswrapper[2559]: I0612 22:25:06.516808 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-f7h79_2fe08918-3efc-4000-a321-8b319ead517c/konnectivity-agent/0.log" limit=1024 Jun 12 22:25:06.633922 ip-10-0-128-134 kubenswrapper[2559]: I0612 22:25:06.633888 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-69cd748fbc-t2pcx" event={"ID":"20fec839-f5bc-4da8-ad4f-a87440e64ca2","Type":"ContainerStarted","Data":"574be0c2d00adf0aa1bc64884424d6c8d7f7a00a7b6cd0f3d261b9f338bc7557"} Jun 12 22:25:06.664604 ip-10-0-128-134 kubenswrapper[2559]: I0612 22:25:06.664526 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-f7h79_2fe08918-3efc-4000-a321-8b319ead517c/konnectivity-agent/0.log" limit=1024 Jun 12 22:25:06.779941 ip-10-0-128-134 kubenswrapper[2559]: I0612 22:25:06.779906 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-f7h79_2fe08918-3efc-4000-a321-8b319ead517c/konnectivity-agent/0.log" limit=1024 Jun 12 22:25:06.889604 ip-10-0-128-134 kubenswrapper[2559]: I0612 22:25:06.889573 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-f7h79_2fe08918-3efc-4000-a321-8b319ead517c/konnectivity-agent/0.log" limit=1024 Jun 12 22:25:09.650146 ip-10-0-128-134 kubenswrapper[2559]: I0612 22:25:09.650072 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-69cd748fbc-t2pcx" event={"ID":"20fec839-f5bc-4da8-ad4f-a87440e64ca2","Type":"ContainerStarted","Data":"634eb033a7846e4e4b380093dde7e6df417e569f9fdff19bed17c8b7c80bee5c"} Jun 12 22:25:10.655335 ip-10-0-128-134 kubenswrapper[2559]: I0612 22:25:10.655303 2559 generic.go:356] "Generic (PLEG): container finished" podID="20fec839-f5bc-4da8-ad4f-a87440e64ca2" containerID="634eb033a7846e4e4b380093dde7e6df417e569f9fdff19bed17c8b7c80bee5c" exitCode=0 Jun 12 22:25:10.655827 ip-10-0-128-134 kubenswrapper[2559]: I0612 22:25:10.655348 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-69cd748fbc-t2pcx" event={"ID":"20fec839-f5bc-4da8-ad4f-a87440e64ca2","Type":"ContainerDied","Data":"634eb033a7846e4e4b380093dde7e6df417e569f9fdff19bed17c8b7c80bee5c"} Jun 12 22:25:11.661241 ip-10-0-128-134 kubenswrapper[2559]: I0612 22:25:11.661207 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-69cd748fbc-t2pcx" event={"ID":"20fec839-f5bc-4da8-ad4f-a87440e64ca2","Type":"ContainerStarted","Data":"8bec1c5c25cae654a8ce9a75cc897b4a957333551d1dcfbd25b777bf57834382"} Jun 12 22:25:11.661648 ip-10-0-128-134 kubenswrapper[2559]: I0612 22:25:11.661314 2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/opendatahub-operator-controller-manager-69cd748fbc-t2pcx" Jun 12 22:25:11.688656 ip-10-0-128-134 kubenswrapper[2559]: I0612 22:25:11.688575 2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/opendatahub-operator-controller-manager-69cd748fbc-t2pcx" podStartSLOduration=2.503887951 podStartE2EDuration="6.688564229s" totalImagesPullingTime="3.19427571s" totalInitContainerRuntime="990.400568ms" isStatefulPod=false podCreationTimestamp="2026-06-12 22:25:05 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-12 22:25:11.686473908 +0000 UTC m=+253.734843726" watchObservedRunningTime="2026-06-12 22:25:11.688564229 +0000 UTC m=+253.736934045" Jun 12 22:25:14.182080 ip-10-0-128-134 kubenswrapper[2559]: I0612 22:25:14.182035 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-f7h79_2fe08918-3efc-4000-a321-8b319ead517c/konnectivity-agent/0.log" limit=1024 Jun 12 22:25:14.266392 ip-10-0-128-134 kubenswrapper[2559]: I0612 22:25:14.266347 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-f7h79_2fe08918-3efc-4000-a321-8b319ead517c/konnectivity-agent/0.log" limit=1024 Jun 12 22:25:22.668078 ip-10-0-128-134 kubenswrapper[2559]: I0612 22:25:22.668044 2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/opendatahub-operator-controller-manager-69cd748fbc-t2pcx" Jun 12 22:25:24.946215 ip-10-0-128-134 kubenswrapper[2559]: I0612 22:25:24.946177 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-f7h79_2fe08918-3efc-4000-a321-8b319ead517c/konnectivity-agent/0.log" limit=1024 Jun 12 22:25:25.082748 ip-10-0-128-134 kubenswrapper[2559]: I0612 22:25:25.082714 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-f7h79_2fe08918-3efc-4000-a321-8b319ead517c/konnectivity-agent/0.log" limit=1024 Jun 12 22:25:25.722318 ip-10-0-128-134 kubenswrapper[2559]: I0612 22:25:25.722273 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-f7h79_2fe08918-3efc-4000-a321-8b319ead517c/konnectivity-agent/0.log" limit=1024 Jun 12 22:25:25.825404 ip-10-0-128-134 kubenswrapper[2559]: I0612 22:25:25.825378 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-f7h79_2fe08918-3efc-4000-a321-8b319ead517c/konnectivity-agent/0.log" limit=1024 Jun 12 22:25:25.929002 ip-10-0-128-134 kubenswrapper[2559]: I0612 22:25:25.928953 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-f7h79_2fe08918-3efc-4000-a321-8b319ead517c/konnectivity-agent/0.log" limit=1024 Jun 12 22:25:26.033952 ip-10-0-128-134 kubenswrapper[2559]: I0612 22:25:26.033870 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-f7h79_2fe08918-3efc-4000-a321-8b319ead517c/konnectivity-agent/0.log" limit=1024 Jun 12 22:25:26.329044 ip-10-0-128-134 kubenswrapper[2559]: I0612 22:25:26.329011 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-f7h79_2fe08918-3efc-4000-a321-8b319ead517c/konnectivity-agent/0.log" limit=1024 Jun 12 22:25:26.512109 ip-10-0-128-134 kubenswrapper[2559]: I0612 22:25:26.512080 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-f7h79_2fe08918-3efc-4000-a321-8b319ead517c/konnectivity-agent/0.log" limit=1024 Jun 12 22:25:30.853420 ip-10-0-128-134 kubenswrapper[2559]: I0612 22:25:30.853386 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-f7h79_2fe08918-3efc-4000-a321-8b319ead517c/konnectivity-agent/0.log" limit=1024 Jun 12 22:25:31.002591 ip-10-0-128-134 kubenswrapper[2559]: I0612 22:25:31.002552 2559 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/kube-auth-proxy-b7dfdf5dc-c2cfp"] Jun 12 22:25:31.011274 ip-10-0-128-134 kubenswrapper[2559]: I0612 22:25:31.011251 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/kube-auth-proxy-b7dfdf5dc-c2cfp" Jun 12 22:25:31.013863 ip-10-0-128-134 kubenswrapper[2559]: I0612 22:25:31.013843 2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-service-ca.crt\"" Jun 12 22:25:31.013863 ip-10-0-128-134 kubenswrapper[2559]: I0612 22:25:31.013857 2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"kube-root-ca.crt\"" Jun 12 22:25:31.014029 ip-10-0-128-134 kubenswrapper[2559]: I0612 22:25:31.013997 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-tls\"" Jun 12 22:25:31.014084 ip-10-0-128-134 kubenswrapper[2559]: I0612 22:25:31.014069 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-creds\"" Jun 12 22:25:31.015359 ip-10-0-128-134 kubenswrapper[2559]: I0612 22:25:31.015335 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-dockercfg-lxmxg\"" Jun 12 22:25:31.017356 ip-10-0-128-134 kubenswrapper[2559]: I0612 22:25:31.017281 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/kube-auth-proxy-b7dfdf5dc-c2cfp"] Jun 12 22:25:31.074350 ip-10-0-128-134 kubenswrapper[2559]: I0612 22:25:31.074305 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hw9mh\" (UniqueName: \"kubernetes.io/projected/c1fe5639-790d-4d66-8dff-bd202adc3c51-kube-api-access-hw9mh\") pod \"kube-auth-proxy-b7dfdf5dc-c2cfp\" (UID: \"c1fe5639-790d-4d66-8dff-bd202adc3c51\") " pod="openshift-ingress/kube-auth-proxy-b7dfdf5dc-c2cfp" Jun 12 22:25:31.074572 ip-10-0-128-134 kubenswrapper[2559]: I0612 22:25:31.074385 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/c1fe5639-790d-4d66-8dff-bd202adc3c51-tmp\") pod \"kube-auth-proxy-b7dfdf5dc-c2cfp\" (UID: \"c1fe5639-790d-4d66-8dff-bd202adc3c51\") " pod="openshift-ingress/kube-auth-proxy-b7dfdf5dc-c2cfp" Jun 12 22:25:31.074572 ip-10-0-128-134 kubenswrapper[2559]: I0612 22:25:31.074415 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/c1fe5639-790d-4d66-8dff-bd202adc3c51-tls-certs\") pod \"kube-auth-proxy-b7dfdf5dc-c2cfp\" (UID: \"c1fe5639-790d-4d66-8dff-bd202adc3c51\") " pod="openshift-ingress/kube-auth-proxy-b7dfdf5dc-c2cfp" Jun 12 22:25:31.175180 ip-10-0-128-134 kubenswrapper[2559]: I0612 22:25:31.175086 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/c1fe5639-790d-4d66-8dff-bd202adc3c51-tmp\") pod \"kube-auth-proxy-b7dfdf5dc-c2cfp\" (UID: \"c1fe5639-790d-4d66-8dff-bd202adc3c51\") " pod="openshift-ingress/kube-auth-proxy-b7dfdf5dc-c2cfp" Jun 12 22:25:31.175180 ip-10-0-128-134 kubenswrapper[2559]: I0612 22:25:31.175132 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/c1fe5639-790d-4d66-8dff-bd202adc3c51-tls-certs\") pod \"kube-auth-proxy-b7dfdf5dc-c2cfp\" (UID: \"c1fe5639-790d-4d66-8dff-bd202adc3c51\") " pod="openshift-ingress/kube-auth-proxy-b7dfdf5dc-c2cfp" Jun 12 22:25:31.175180 ip-10-0-128-134 kubenswrapper[2559]: I0612 22:25:31.175171 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hw9mh\" (UniqueName: \"kubernetes.io/projected/c1fe5639-790d-4d66-8dff-bd202adc3c51-kube-api-access-hw9mh\") pod \"kube-auth-proxy-b7dfdf5dc-c2cfp\" (UID: \"c1fe5639-790d-4d66-8dff-bd202adc3c51\") " pod="openshift-ingress/kube-auth-proxy-b7dfdf5dc-c2cfp" Jun 12 22:25:31.175397 ip-10-0-128-134 kubenswrapper[2559]: E0612 22:25:31.175297 2559 secret.go:189] Couldn't get secret openshift-ingress/kube-auth-proxy-tls: secret "kube-auth-proxy-tls" not found Jun 12 22:25:31.175397 ip-10-0-128-134 kubenswrapper[2559]: E0612 22:25:31.175377 2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c1fe5639-790d-4d66-8dff-bd202adc3c51-tls-certs podName:c1fe5639-790d-4d66-8dff-bd202adc3c51 nodeName:}" failed. No retries permitted until 2026-06-12 22:25:31.675353366 +0000 UTC m=+273.723723161 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "tls-certs" (UniqueName: "kubernetes.io/secret/c1fe5639-790d-4d66-8dff-bd202adc3c51-tls-certs") pod "kube-auth-proxy-b7dfdf5dc-c2cfp" (UID: "c1fe5639-790d-4d66-8dff-bd202adc3c51") : secret "kube-auth-proxy-tls" not found Jun 12 22:25:31.177662 ip-10-0-128-134 kubenswrapper[2559]: I0612 22:25:31.177629 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/c1fe5639-790d-4d66-8dff-bd202adc3c51-tmp\") pod \"kube-auth-proxy-b7dfdf5dc-c2cfp\" (UID: \"c1fe5639-790d-4d66-8dff-bd202adc3c51\") " pod="openshift-ingress/kube-auth-proxy-b7dfdf5dc-c2cfp" Jun 12 22:25:31.184816 ip-10-0-128-134 kubenswrapper[2559]: I0612 22:25:31.184794 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-hw9mh\" (UniqueName: \"kubernetes.io/projected/c1fe5639-790d-4d66-8dff-bd202adc3c51-kube-api-access-hw9mh\") pod \"kube-auth-proxy-b7dfdf5dc-c2cfp\" (UID: \"c1fe5639-790d-4d66-8dff-bd202adc3c51\") " pod="openshift-ingress/kube-auth-proxy-b7dfdf5dc-c2cfp" Jun 12 22:25:31.678938 ip-10-0-128-134 kubenswrapper[2559]: I0612 22:25:31.678895 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/c1fe5639-790d-4d66-8dff-bd202adc3c51-tls-certs\") pod \"kube-auth-proxy-b7dfdf5dc-c2cfp\" (UID: \"c1fe5639-790d-4d66-8dff-bd202adc3c51\") " pod="openshift-ingress/kube-auth-proxy-b7dfdf5dc-c2cfp" Jun 12 22:25:31.681520 ip-10-0-128-134 kubenswrapper[2559]: I0612 22:25:31.681497 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/c1fe5639-790d-4d66-8dff-bd202adc3c51-tls-certs\") pod \"kube-auth-proxy-b7dfdf5dc-c2cfp\" (UID: \"c1fe5639-790d-4d66-8dff-bd202adc3c51\") " pod="openshift-ingress/kube-auth-proxy-b7dfdf5dc-c2cfp" Jun 12 22:25:31.835758 ip-10-0-128-134 kubenswrapper[2559]: I0612 22:25:31.835718 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-f7h79_2fe08918-3efc-4000-a321-8b319ead517c/konnectivity-agent/0.log" limit=1024 Jun 12 22:25:31.922321 ip-10-0-128-134 kubenswrapper[2559]: I0612 22:25:31.922281 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/kube-auth-proxy-b7dfdf5dc-c2cfp" Jun 12 22:25:32.052290 ip-10-0-128-134 kubenswrapper[2559]: I0612 22:25:32.052258 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/kube-auth-proxy-b7dfdf5dc-c2cfp"] Jun 12 22:25:32.055389 ip-10-0-128-134 kubenswrapper[2559]: W0612 22:25:32.055358 2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc1fe5639_790d_4d66_8dff_bd202adc3c51.slice/crio-b47cf52e6666be25cf3ec9ac6f27b3220799d8a2386a003004056e6350f6b50e WatchSource:0}: Error finding container b47cf52e6666be25cf3ec9ac6f27b3220799d8a2386a003004056e6350f6b50e: Status 404 returned error can't find the container with id b47cf52e6666be25cf3ec9ac6f27b3220799d8a2386a003004056e6350f6b50e Jun 12 22:25:32.754328 ip-10-0-128-134 kubenswrapper[2559]: I0612 22:25:32.754254 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/kube-auth-proxy-b7dfdf5dc-c2cfp" event={"ID":"c1fe5639-790d-4d66-8dff-bd202adc3c51","Type":"ContainerStarted","Data":"b47cf52e6666be25cf3ec9ac6f27b3220799d8a2386a003004056e6350f6b50e"} Jun 12 22:25:34.766176 ip-10-0-128-134 kubenswrapper[2559]: I0612 22:25:34.766136 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/kube-auth-proxy-b7dfdf5dc-c2cfp" event={"ID":"c1fe5639-790d-4d66-8dff-bd202adc3c51","Type":"ContainerStarted","Data":"a492ce86cf32390f8b5ad47ceaf7184d00c34a4b0152c7a687929369040c41f2"} Jun 12 22:25:34.819655 ip-10-0-128-134 kubenswrapper[2559]: I0612 22:25:34.819598 2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/kube-auth-proxy-b7dfdf5dc-c2cfp" podStartSLOduration=2.178606152 podStartE2EDuration="4.819583356s" totalImagesPullingTime="2.640977204s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-12 22:25:30 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-12 22:25:34.81753473 +0000 UTC m=+276.865904546" watchObservedRunningTime="2026-06-12 22:25:34.819583356 +0000 UTC m=+276.867953207" Jun 12 22:25:34.837408 ip-10-0-128-134 kubenswrapper[2559]: I0612 22:25:34.837374 2559 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-lws-operator/lws-controller-manager-75d6d854-s5rhh"] Jun 12 22:25:34.840807 ip-10-0-128-134 kubenswrapper[2559]: I0612 22:25:34.840787 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/lws-controller-manager-75d6d854-s5rhh" Jun 12 22:25:34.844339 ip-10-0-128-134 kubenswrapper[2559]: I0612 22:25:34.844315 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"lws-controller-manager-dockercfg-q66xt\"" Jun 12 22:25:34.844494 ip-10-0-128-134 kubenswrapper[2559]: I0612 22:25:34.844329 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"metrics-server-cert\"" Jun 12 22:25:34.844572 ip-10-0-128-134 kubenswrapper[2559]: I0612 22:25:34.844515 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"webhook-server-cert\"" Jun 12 22:25:34.845708 ip-10-0-128-134 kubenswrapper[2559]: I0612 22:25:34.845693 2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"lws-manager-config\"" Jun 12 22:25:34.872223 ip-10-0-128-134 kubenswrapper[2559]: I0612 22:25:34.872196 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/lws-controller-manager-75d6d854-s5rhh"] Jun 12 22:25:34.909177 ip-10-0-128-134 kubenswrapper[2559]: I0612 22:25:34.909142 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/1fe7d3ef-9775-48ee-85dd-ab08849440b5-metrics-cert\") pod \"lws-controller-manager-75d6d854-s5rhh\" (UID: \"1fe7d3ef-9775-48ee-85dd-ab08849440b5\") " pod="openshift-lws-operator/lws-controller-manager-75d6d854-s5rhh" Jun 12 22:25:34.909373 ip-10-0-128-134 kubenswrapper[2559]: I0612 22:25:34.909205 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/1fe7d3ef-9775-48ee-85dd-ab08849440b5-cert\") pod \"lws-controller-manager-75d6d854-s5rhh\" (UID: \"1fe7d3ef-9775-48ee-85dd-ab08849440b5\") " pod="openshift-lws-operator/lws-controller-manager-75d6d854-s5rhh" Jun 12 22:25:34.909373 ip-10-0-128-134 kubenswrapper[2559]: I0612 22:25:34.909300 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/1fe7d3ef-9775-48ee-85dd-ab08849440b5-manager-config\") pod \"lws-controller-manager-75d6d854-s5rhh\" (UID: \"1fe7d3ef-9775-48ee-85dd-ab08849440b5\") " pod="openshift-lws-operator/lws-controller-manager-75d6d854-s5rhh" Jun 12 22:25:34.909373 ip-10-0-128-134 kubenswrapper[2559]: I0612 22:25:34.909333 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-scwxf\" (UniqueName: \"kubernetes.io/projected/1fe7d3ef-9775-48ee-85dd-ab08849440b5-kube-api-access-scwxf\") pod \"lws-controller-manager-75d6d854-s5rhh\" (UID: \"1fe7d3ef-9775-48ee-85dd-ab08849440b5\") " pod="openshift-lws-operator/lws-controller-manager-75d6d854-s5rhh" Jun 12 22:25:35.009843 ip-10-0-128-134 kubenswrapper[2559]: I0612 22:25:35.009753 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/1fe7d3ef-9775-48ee-85dd-ab08849440b5-cert\") pod \"lws-controller-manager-75d6d854-s5rhh\" (UID: \"1fe7d3ef-9775-48ee-85dd-ab08849440b5\") " pod="openshift-lws-operator/lws-controller-manager-75d6d854-s5rhh" Jun 12 22:25:35.009843 ip-10-0-128-134 kubenswrapper[2559]: I0612 22:25:35.009833 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/1fe7d3ef-9775-48ee-85dd-ab08849440b5-manager-config\") pod \"lws-controller-manager-75d6d854-s5rhh\" (UID: \"1fe7d3ef-9775-48ee-85dd-ab08849440b5\") " pod="openshift-lws-operator/lws-controller-manager-75d6d854-s5rhh" Jun 12 22:25:35.010078 ip-10-0-128-134 kubenswrapper[2559]: I0612 22:25:35.009862 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-scwxf\" (UniqueName: \"kubernetes.io/projected/1fe7d3ef-9775-48ee-85dd-ab08849440b5-kube-api-access-scwxf\") pod \"lws-controller-manager-75d6d854-s5rhh\" (UID: \"1fe7d3ef-9775-48ee-85dd-ab08849440b5\") " pod="openshift-lws-operator/lws-controller-manager-75d6d854-s5rhh" Jun 12 22:25:35.010078 ip-10-0-128-134 kubenswrapper[2559]: I0612 22:25:35.009898 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/1fe7d3ef-9775-48ee-85dd-ab08849440b5-metrics-cert\") pod \"lws-controller-manager-75d6d854-s5rhh\" (UID: \"1fe7d3ef-9775-48ee-85dd-ab08849440b5\") " pod="openshift-lws-operator/lws-controller-manager-75d6d854-s5rhh" Jun 12 22:25:35.010490 ip-10-0-128-134 kubenswrapper[2559]: I0612 22:25:35.010470 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/1fe7d3ef-9775-48ee-85dd-ab08849440b5-manager-config\") pod \"lws-controller-manager-75d6d854-s5rhh\" (UID: \"1fe7d3ef-9775-48ee-85dd-ab08849440b5\") " pod="openshift-lws-operator/lws-controller-manager-75d6d854-s5rhh" Jun 12 22:25:35.012279 ip-10-0-128-134 kubenswrapper[2559]: I0612 22:25:35.012258 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/1fe7d3ef-9775-48ee-85dd-ab08849440b5-cert\") pod \"lws-controller-manager-75d6d854-s5rhh\" (UID: \"1fe7d3ef-9775-48ee-85dd-ab08849440b5\") " pod="openshift-lws-operator/lws-controller-manager-75d6d854-s5rhh" Jun 12 22:25:35.012370 ip-10-0-128-134 kubenswrapper[2559]: I0612 22:25:35.012324 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/1fe7d3ef-9775-48ee-85dd-ab08849440b5-metrics-cert\") pod \"lws-controller-manager-75d6d854-s5rhh\" (UID: \"1fe7d3ef-9775-48ee-85dd-ab08849440b5\") " pod="openshift-lws-operator/lws-controller-manager-75d6d854-s5rhh" Jun 12 22:25:35.018635 ip-10-0-128-134 kubenswrapper[2559]: I0612 22:25:35.018597 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-scwxf\" (UniqueName: \"kubernetes.io/projected/1fe7d3ef-9775-48ee-85dd-ab08849440b5-kube-api-access-scwxf\") pod \"lws-controller-manager-75d6d854-s5rhh\" (UID: \"1fe7d3ef-9775-48ee-85dd-ab08849440b5\") " pod="openshift-lws-operator/lws-controller-manager-75d6d854-s5rhh" Jun 12 22:25:35.150832 ip-10-0-128-134 kubenswrapper[2559]: I0612 22:25:35.150790 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/lws-controller-manager-75d6d854-s5rhh" Jun 12 22:25:35.297308 ip-10-0-128-134 kubenswrapper[2559]: I0612 22:25:35.297286 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/lws-controller-manager-75d6d854-s5rhh"] Jun 12 22:25:35.299634 ip-10-0-128-134 kubenswrapper[2559]: W0612 22:25:35.299605 2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1fe7d3ef_9775_48ee_85dd_ab08849440b5.slice/crio-4a009aa34071d2ad915432e39ecba0aa3ab43e83bc64719751ba102dfa5cb910 WatchSource:0}: Error finding container 4a009aa34071d2ad915432e39ecba0aa3ab43e83bc64719751ba102dfa5cb910: Status 404 returned error can't find the container with id 4a009aa34071d2ad915432e39ecba0aa3ab43e83bc64719751ba102dfa5cb910 Jun 12 22:25:35.772066 ip-10-0-128-134 kubenswrapper[2559]: I0612 22:25:35.771974 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/lws-controller-manager-75d6d854-s5rhh" event={"ID":"1fe7d3ef-9775-48ee-85dd-ab08849440b5","Type":"ContainerStarted","Data":"4a009aa34071d2ad915432e39ecba0aa3ab43e83bc64719751ba102dfa5cb910"} Jun 12 22:25:35.997296 ip-10-0-128-134 kubenswrapper[2559]: I0612 22:25:35.997252 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-f7h79_2fe08918-3efc-4000-a321-8b319ead517c/konnectivity-agent/0.log" limit=1024 Jun 12 22:25:36.174171 ip-10-0-128-134 kubenswrapper[2559]: I0612 22:25:36.174137 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-f7h79_2fe08918-3efc-4000-a321-8b319ead517c/konnectivity-agent/0.log" limit=1024 Jun 12 22:25:36.345129 ip-10-0-128-134 kubenswrapper[2559]: I0612 22:25:36.345090 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-f7h79_2fe08918-3efc-4000-a321-8b319ead517c/konnectivity-agent/0.log" limit=1024 Jun 12 22:25:36.462093 ip-10-0-128-134 kubenswrapper[2559]: I0612 22:25:36.462006 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-f7h79_2fe08918-3efc-4000-a321-8b319ead517c/konnectivity-agent/0.log" limit=1024 Jun 12 22:25:36.577341 ip-10-0-128-134 kubenswrapper[2559]: I0612 22:25:36.577291 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-f7h79_2fe08918-3efc-4000-a321-8b319ead517c/konnectivity-agent/0.log" limit=1024 Jun 12 22:25:36.761090 ip-10-0-128-134 kubenswrapper[2559]: I0612 22:25:36.760999 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-f7h79_2fe08918-3efc-4000-a321-8b319ead517c/konnectivity-agent/0.log" limit=1024 Jun 12 22:25:37.783814 ip-10-0-128-134 kubenswrapper[2559]: I0612 22:25:37.783715 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/lws-controller-manager-75d6d854-s5rhh" event={"ID":"1fe7d3ef-9775-48ee-85dd-ab08849440b5","Type":"ContainerStarted","Data":"b59cdad532d859e93651628ebc95337276cf1aedcb5f975f208fb46fc4e03610"} Jun 12 22:25:37.783814 ip-10-0-128-134 kubenswrapper[2559]: I0612 22:25:37.783788 2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-lws-operator/lws-controller-manager-75d6d854-s5rhh" Jun 12 22:25:37.805067 ip-10-0-128-134 kubenswrapper[2559]: I0612 22:25:37.805003 2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-lws-operator/lws-controller-manager-75d6d854-s5rhh" podStartSLOduration=1.587362081 podStartE2EDuration="3.804985355s" totalImagesPullingTime="2.217623274s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-12 22:25:34 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-12 22:25:37.80411172 +0000 UTC m=+279.852481538" watchObservedRunningTime="2026-06-12 22:25:37.804985355 +0000 UTC m=+279.853355174" Jun 12 22:25:45.995491 ip-10-0-128-134 kubenswrapper[2559]: I0612 22:25:45.995382 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-f7h79_2fe08918-3efc-4000-a321-8b319ead517c/konnectivity-agent/0.log" limit=1024 Jun 12 22:25:46.096751 ip-10-0-128-134 kubenswrapper[2559]: I0612 22:25:46.096722 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-f7h79_2fe08918-3efc-4000-a321-8b319ead517c/konnectivity-agent/0.log" limit=1024 Jun 12 22:25:47.259995 ip-10-0-128-134 kubenswrapper[2559]: I0612 22:25:47.259951 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-f7h79_2fe08918-3efc-4000-a321-8b319ead517c/konnectivity-agent/0.log" limit=1024 Jun 12 22:25:47.354797 ip-10-0-128-134 kubenswrapper[2559]: I0612 22:25:47.354767 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-f7h79_2fe08918-3efc-4000-a321-8b319ead517c/konnectivity-agent/0.log" limit=1024 Jun 12 22:25:47.772022 ip-10-0-128-134 kubenswrapper[2559]: I0612 22:25:47.771984 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-f7h79_2fe08918-3efc-4000-a321-8b319ead517c/konnectivity-agent/0.log" limit=1024 Jun 12 22:25:48.043089 ip-10-0-128-134 kubenswrapper[2559]: I0612 22:25:48.042996 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-f7h79_2fe08918-3efc-4000-a321-8b319ead517c/konnectivity-agent/0.log" limit=1024 Jun 12 22:25:48.363219 ip-10-0-128-134 kubenswrapper[2559]: I0612 22:25:48.363158 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-f7h79_2fe08918-3efc-4000-a321-8b319ead517c/konnectivity-agent/0.log" limit=1024 Jun 12 22:25:48.791517 ip-10-0-128-134 kubenswrapper[2559]: I0612 22:25:48.791414 2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-lws-operator/lws-controller-manager-75d6d854-s5rhh" Jun 12 22:25:58.348891 ip-10-0-128-134 kubenswrapper[2559]: I0612 22:25:58.348820 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-f7h79_2fe08918-3efc-4000-a321-8b319ead517c/konnectivity-agent/0.log" limit=1024 Jun 12 22:25:58.359105 ip-10-0-128-134 kubenswrapper[2559]: I0612 22:25:58.358551 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-9qn4j_f6ddad48-94e1-479b-951c-ebf6be358f2c/ovn-acl-logging/0.log" Jun 12 22:25:58.363078 ip-10-0-128-134 kubenswrapper[2559]: I0612 22:25:58.363056 2559 kubelet.go:1648] "Image garbage collection succeeded" Jun 12 22:25:58.364757 ip-10-0-128-134 kubenswrapper[2559]: I0612 22:25:58.364734 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-9qn4j_f6ddad48-94e1-479b-951c-ebf6be358f2c/ovn-acl-logging/0.log" Jun 12 22:25:58.482006 ip-10-0-128-134 kubenswrapper[2559]: I0612 22:25:58.481848 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-f7h79_2fe08918-3efc-4000-a321-8b319ead517c/konnectivity-agent/0.log" limit=1024 Jun 12 22:25:58.739703 ip-10-0-128-134 kubenswrapper[2559]: I0612 22:25:58.739608 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-f7h79_2fe08918-3efc-4000-a321-8b319ead517c/konnectivity-agent/0.log" limit=1024 Jun 12 22:25:58.845896 ip-10-0-128-134 kubenswrapper[2559]: I0612 22:25:58.845849 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-f7h79_2fe08918-3efc-4000-a321-8b319ead517c/konnectivity-agent/0.log" limit=1024 Jun 12 22:26:03.777900 ip-10-0-128-134 kubenswrapper[2559]: I0612 22:26:03.777838 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-f7h79_2fe08918-3efc-4000-a321-8b319ead517c/konnectivity-agent/0.log" limit=1024 Jun 12 22:26:03.883332 ip-10-0-128-134 kubenswrapper[2559]: I0612 22:26:03.883302 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-f7h79_2fe08918-3efc-4000-a321-8b319ead517c/konnectivity-agent/0.log" limit=1024 Jun 12 22:26:04.611992 ip-10-0-128-134 kubenswrapper[2559]: I0612 22:26:04.611963 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-f7h79_2fe08918-3efc-4000-a321-8b319ead517c/konnectivity-agent/0.log" limit=1024 Jun 12 22:26:07.991679 ip-10-0-128-134 kubenswrapper[2559]: I0612 22:26:07.991638 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-f7h79_2fe08918-3efc-4000-a321-8b319ead517c/konnectivity-agent/0.log" limit=1024 Jun 12 22:26:08.131865 ip-10-0-128-134 kubenswrapper[2559]: I0612 22:26:08.131824 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-f7h79_2fe08918-3efc-4000-a321-8b319ead517c/konnectivity-agent/0.log" limit=1024 Jun 12 22:26:08.257880 ip-10-0-128-134 kubenswrapper[2559]: I0612 22:26:08.257790 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-f7h79_2fe08918-3efc-4000-a321-8b319ead517c/konnectivity-agent/0.log" limit=1024 Jun 12 22:26:08.524723 ip-10-0-128-134 kubenswrapper[2559]: I0612 22:26:08.524645 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-f7h79_2fe08918-3efc-4000-a321-8b319ead517c/konnectivity-agent/0.log" limit=1024 Jun 12 22:26:08.668877 ip-10-0-128-134 kubenswrapper[2559]: I0612 22:26:08.668847 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-f7h79_2fe08918-3efc-4000-a321-8b319ead517c/konnectivity-agent/0.log" limit=1024 Jun 12 22:26:12.521350 ip-10-0-128-134 kubenswrapper[2559]: I0612 22:26:12.521312 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-f7h79_2fe08918-3efc-4000-a321-8b319ead517c/konnectivity-agent/0.log" limit=1024 Jun 12 22:26:26.545347 ip-10-0-128-134 kubenswrapper[2559]: I0612 22:26:26.545315 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-f7h79_2fe08918-3efc-4000-a321-8b319ead517c/konnectivity-agent/0.log" limit=1024 Jun 12 22:26:26.629569 ip-10-0-128-134 kubenswrapper[2559]: I0612 22:26:26.629535 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-f7h79_2fe08918-3efc-4000-a321-8b319ead517c/konnectivity-agent/0.log" limit=1024 Jun 12 22:26:26.704488 ip-10-0-128-134 kubenswrapper[2559]: I0612 22:26:26.704458 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-f7h79_2fe08918-3efc-4000-a321-8b319ead517c/konnectivity-agent/0.log" limit=1024 Jun 12 22:26:55.764231 ip-10-0-128-134 kubenswrapper[2559]: I0612 22:26:55.764196 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-f7h79_2fe08918-3efc-4000-a321-8b319ead517c/konnectivity-agent/0.log" limit=1024 Jun 12 22:26:59.977704 ip-10-0-128-134 kubenswrapper[2559]: I0612 22:26:59.977668 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-f7h79_2fe08918-3efc-4000-a321-8b319ead517c/konnectivity-agent/0.log" limit=1024 Jun 12 22:27:02.540151 ip-10-0-128-134 kubenswrapper[2559]: I0612 22:27:02.540118 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-f7h79_2fe08918-3efc-4000-a321-8b319ead517c/konnectivity-agent/0.log" limit=1024 Jun 12 22:27:04.222810 ip-10-0-128-134 kubenswrapper[2559]: I0612 22:27:04.222779 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-f7h79_2fe08918-3efc-4000-a321-8b319ead517c/konnectivity-agent/0.log" limit=1024 Jun 12 22:27:05.598356 ip-10-0-128-134 kubenswrapper[2559]: I0612 22:27:05.598319 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-f7h79_2fe08918-3efc-4000-a321-8b319ead517c/konnectivity-agent/0.log" limit=1024 Jun 12 22:27:06.801253 ip-10-0-128-134 kubenswrapper[2559]: I0612 22:27:06.801214 2559 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-n776z"] Jun 12 22:27:06.809025 ip-10-0-128-134 kubenswrapper[2559]: I0612 22:27:06.808999 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-n776z" Jun 12 22:27:06.812061 ip-10-0-128-134 kubenswrapper[2559]: I0612 22:27:06.812026 2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"openshift-service-ca.crt\"" Jun 12 22:27:06.812061 ip-10-0-128-134 kubenswrapper[2559]: I0612 22:27:06.812046 2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"kube-root-ca.crt\"" Jun 12 22:27:06.812281 ip-10-0-128-134 kubenswrapper[2559]: I0612 22:27:06.812268 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"kuadrant-operator-controller-manager-dockercfg-mxxpp\"" Jun 12 22:27:06.817359 ip-10-0-128-134 kubenswrapper[2559]: I0612 22:27:06.817334 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-n776z"] Jun 12 22:27:06.908290 ip-10-0-128-134 kubenswrapper[2559]: I0612 22:27:06.908247 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/e6975c81-34e9-4046-88a9-89d28b47c1db-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-8684c9ff49-n776z\" (UID: \"e6975c81-34e9-4046-88a9-89d28b47c1db\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-n776z" Jun 12 22:27:06.908511 ip-10-0-128-134 kubenswrapper[2559]: I0612 22:27:06.908308 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-cr6pd\" (UniqueName: \"kubernetes.io/projected/e6975c81-34e9-4046-88a9-89d28b47c1db-kube-api-access-cr6pd\") pod \"kuadrant-operator-controller-manager-8684c9ff49-n776z\" (UID: \"e6975c81-34e9-4046-88a9-89d28b47c1db\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-n776z" Jun 12 22:27:07.009096 ip-10-0-128-134 kubenswrapper[2559]: I0612 22:27:07.009058 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/e6975c81-34e9-4046-88a9-89d28b47c1db-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-8684c9ff49-n776z\" (UID: \"e6975c81-34e9-4046-88a9-89d28b47c1db\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-n776z" Jun 12 22:27:07.009246 ip-10-0-128-134 kubenswrapper[2559]: I0612 22:27:07.009115 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-cr6pd\" (UniqueName: \"kubernetes.io/projected/e6975c81-34e9-4046-88a9-89d28b47c1db-kube-api-access-cr6pd\") pod \"kuadrant-operator-controller-manager-8684c9ff49-n776z\" (UID: \"e6975c81-34e9-4046-88a9-89d28b47c1db\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-n776z" Jun 12 22:27:07.009436 ip-10-0-128-134 kubenswrapper[2559]: I0612 22:27:07.009417 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/e6975c81-34e9-4046-88a9-89d28b47c1db-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-8684c9ff49-n776z\" (UID: \"e6975c81-34e9-4046-88a9-89d28b47c1db\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-n776z" Jun 12 22:27:07.018018 ip-10-0-128-134 kubenswrapper[2559]: I0612 22:27:07.017989 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-cr6pd\" (UniqueName: \"kubernetes.io/projected/e6975c81-34e9-4046-88a9-89d28b47c1db-kube-api-access-cr6pd\") pod \"kuadrant-operator-controller-manager-8684c9ff49-n776z\" (UID: \"e6975c81-34e9-4046-88a9-89d28b47c1db\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-n776z" Jun 12 22:27:07.120204 ip-10-0-128-134 kubenswrapper[2559]: I0612 22:27:07.120126 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-n776z" Jun 12 22:27:07.153224 ip-10-0-128-134 kubenswrapper[2559]: I0612 22:27:07.153185 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-f7h79_2fe08918-3efc-4000-a321-8b319ead517c/konnectivity-agent/0.log" limit=1024 Jun 12 22:27:07.261609 ip-10-0-128-134 kubenswrapper[2559]: I0612 22:27:07.261578 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-n776z"] Jun 12 22:27:07.264785 ip-10-0-128-134 kubenswrapper[2559]: W0612 22:27:07.264741 2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode6975c81_34e9_4046_88a9_89d28b47c1db.slice/crio-d0df7d808d503b9038c0b52e71ba3e5f98026f61435d75a7fe664b7802354898 WatchSource:0}: Error finding container d0df7d808d503b9038c0b52e71ba3e5f98026f61435d75a7fe664b7802354898: Status 404 returned error can't find the container with id d0df7d808d503b9038c0b52e71ba3e5f98026f61435d75a7fe664b7802354898 Jun 12 22:27:07.267273 ip-10-0-128-134 kubenswrapper[2559]: I0612 22:27:07.267255 2559 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jun 12 22:27:07.409727 ip-10-0-128-134 kubenswrapper[2559]: I0612 22:27:07.409634 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-f7h79_2fe08918-3efc-4000-a321-8b319ead517c/konnectivity-agent/0.log" limit=1024 Jun 12 22:27:07.738421 ip-10-0-128-134 kubenswrapper[2559]: I0612 22:27:07.738332 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-f7h79_2fe08918-3efc-4000-a321-8b319ead517c/konnectivity-agent/0.log" limit=1024 Jun 12 22:27:08.188849 ip-10-0-128-134 kubenswrapper[2559]: I0612 22:27:08.188816 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-n776z" event={"ID":"e6975c81-34e9-4046-88a9-89d28b47c1db","Type":"ContainerStarted","Data":"d0df7d808d503b9038c0b52e71ba3e5f98026f61435d75a7fe664b7802354898"} Jun 12 22:27:09.985314 ip-10-0-128-134 kubenswrapper[2559]: I0612 22:27:09.985261 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-f7h79_2fe08918-3efc-4000-a321-8b319ead517c/konnectivity-agent/0.log" limit=1024 Jun 12 22:27:10.085018 ip-10-0-128-134 kubenswrapper[2559]: I0612 22:27:10.084980 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-f7h79_2fe08918-3efc-4000-a321-8b319ead517c/konnectivity-agent/0.log" limit=1024 Jun 12 22:27:12.172695 ip-10-0-128-134 kubenswrapper[2559]: I0612 22:27:12.172658 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-f7h79_2fe08918-3efc-4000-a321-8b319ead517c/konnectivity-agent/0.log" limit=1024 Jun 12 22:27:12.268061 ip-10-0-128-134 kubenswrapper[2559]: I0612 22:27:12.268027 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-f7h79_2fe08918-3efc-4000-a321-8b319ead517c/konnectivity-agent/0.log" limit=1024 Jun 12 22:27:14.165377 ip-10-0-128-134 kubenswrapper[2559]: I0612 22:27:14.165343 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-f7h79_2fe08918-3efc-4000-a321-8b319ead517c/konnectivity-agent/0.log" limit=1024 Jun 12 22:27:14.216928 ip-10-0-128-134 kubenswrapper[2559]: I0612 22:27:14.216891 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-n776z" event={"ID":"e6975c81-34e9-4046-88a9-89d28b47c1db","Type":"ContainerStarted","Data":"8e3e7c3a65c509bd468abff83d3486faff439684ea361ed24e55695f6fc4643d"} Jun 12 22:27:14.217119 ip-10-0-128-134 kubenswrapper[2559]: I0612 22:27:14.216969 2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-n776z" Jun 12 22:27:14.238677 ip-10-0-128-134 kubenswrapper[2559]: I0612 22:27:14.238616 2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-n776z" podStartSLOduration=1.4789658669999999 podStartE2EDuration="8.238600804s" totalImagesPullingTime="6.759634937s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-12 22:27:06 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-12 22:27:14.236024116 +0000 UTC m=+376.284393932" watchObservedRunningTime="2026-06-12 22:27:14.238600804 +0000 UTC m=+376.286970622" Jun 12 22:27:14.240635 ip-10-0-128-134 kubenswrapper[2559]: I0612 22:27:14.240604 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-f7h79_2fe08918-3efc-4000-a321-8b319ead517c/konnectivity-agent/0.log" limit=1024 Jun 12 22:27:17.196549 ip-10-0-128-134 kubenswrapper[2559]: I0612 22:27:17.196505 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-f7h79_2fe08918-3efc-4000-a321-8b319ead517c/konnectivity-agent/0.log" limit=1024 Jun 12 22:27:17.426344 ip-10-0-128-134 kubenswrapper[2559]: I0612 22:27:17.426313 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-f7h79_2fe08918-3efc-4000-a321-8b319ead517c/konnectivity-agent/0.log" limit=1024 Jun 12 22:27:18.101907 ip-10-0-128-134 kubenswrapper[2559]: I0612 22:27:18.101876 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-f7h79_2fe08918-3efc-4000-a321-8b319ead517c/konnectivity-agent/0.log" limit=1024 Jun 12 22:27:19.359794 ip-10-0-128-134 kubenswrapper[2559]: I0612 22:27:19.359759 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-f7h79_2fe08918-3efc-4000-a321-8b319ead517c/konnectivity-agent/0.log" limit=1024 Jun 12 22:27:19.476785 ip-10-0-128-134 kubenswrapper[2559]: I0612 22:27:19.476751 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-f7h79_2fe08918-3efc-4000-a321-8b319ead517c/konnectivity-agent/0.log" limit=1024 Jun 12 22:27:25.224263 ip-10-0-128-134 kubenswrapper[2559]: I0612 22:27:25.224234 2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-n776z" Jun 12 22:27:27.035782 ip-10-0-128-134 kubenswrapper[2559]: I0612 22:27:27.035739 2559 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-n776z"] Jun 12 22:27:27.036229 ip-10-0-128-134 kubenswrapper[2559]: I0612 22:27:27.035970 2559 kuberuntime_container.go:872] "Killing container with a grace period" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-n776z" podUID="e6975c81-34e9-4046-88a9-89d28b47c1db" containerName="manager" containerID="cri-o://8e3e7c3a65c509bd468abff83d3486faff439684ea361ed24e55695f6fc4643d" gracePeriod=2 Jun 12 22:27:27.045647 ip-10-0-128-134 kubenswrapper[2559]: I0612 22:27:27.045618 2559 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-n776z"] Jun 12 22:27:27.052805 ip-10-0-128-134 kubenswrapper[2559]: E0612 22:27:27.052647 2559 status_manager.go:1041] "Failed to update status for pod" err="failed to patch status \"{\\\"metadata\\\":{\\\"uid\\\":\\\"e6975c81-34e9-4046-88a9-89d28b47c1db\\\"},\\\"status\\\":{\\\"$setElementOrder/conditions\\\":[{\\\"type\\\":\\\"PodReadyToStartContainers\\\"},{\\\"type\\\":\\\"Initialized\\\"},{\\\"type\\\":\\\"Ready\\\"},{\\\"type\\\":\\\"ContainersReady\\\"},{\\\"type\\\":\\\"PodScheduled\\\"}],\\\"conditions\\\":[{\\\"observedGeneration\\\":2,\\\"type\\\":\\\"PodReadyToStartContainers\\\"},{\\\"observedGeneration\\\":2,\\\"type\\\":\\\"Initialized\\\"},{\\\"observedGeneration\\\":2,\\\"type\\\":\\\"Ready\\\"},{\\\"observedGeneration\\\":2,\\\"type\\\":\\\"ContainersReady\\\"},{\\\"observedGeneration\\\":2,\\\"type\\\":\\\"PodScheduled\\\"}],\\\"observedGeneration\\\":2}}\" for pod \"kuadrant-system\"/\"kuadrant-operator-controller-manager-8684c9ff49-n776z\": pods \"kuadrant-operator-controller-manager-8684c9ff49-n776z\" not found" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-n776z" Jun 12 22:27:27.063813 ip-10-0-128-134 kubenswrapper[2559]: I0612 22:27:27.063788 2559 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-nxmqc"] Jun 12 22:27:27.064405 ip-10-0-128-134 kubenswrapper[2559]: I0612 22:27:27.064384 2559 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="e6975c81-34e9-4046-88a9-89d28b47c1db" containerName="manager" Jun 12 22:27:27.064405 ip-10-0-128-134 kubenswrapper[2559]: I0612 22:27:27.064405 2559 state_mem.go:107] "Deleted CPUSet assignment" podUID="e6975c81-34e9-4046-88a9-89d28b47c1db" containerName="manager" Jun 12 22:27:27.064562 ip-10-0-128-134 kubenswrapper[2559]: I0612 22:27:27.064519 2559 memory_manager.go:368] "RemoveStaleState removing state" podUID="e6975c81-34e9-4046-88a9-89d28b47c1db" containerName="manager" Jun 12 22:27:27.067694 ip-10-0-128-134 kubenswrapper[2559]: I0612 22:27:27.067676 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-nxmqc" Jun 12 22:27:27.080842 ip-10-0-128-134 kubenswrapper[2559]: I0612 22:27:27.080810 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-nxmqc"] Jun 12 22:27:27.097629 ip-10-0-128-134 kubenswrapper[2559]: E0612 22:27:27.097591 2559 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-8684c9ff49-n776z\" is forbidden: User \"system:node:ip-10-0-128-134.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-128-134.ec2.internal' and this object" podUID="e6975c81-34e9-4046-88a9-89d28b47c1db" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-n776z" Jun 12 22:27:27.186733 ip-10-0-128-134 kubenswrapper[2559]: I0612 22:27:27.186700 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-fmjdc\" (UniqueName: \"kubernetes.io/projected/eeafdf4d-8b6d-47ec-a841-2b6a01660bfc-kube-api-access-fmjdc\") pod \"kuadrant-operator-controller-manager-8684c9ff49-nxmqc\" (UID: \"eeafdf4d-8b6d-47ec-a841-2b6a01660bfc\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-nxmqc" Jun 12 22:27:27.186929 ip-10-0-128-134 kubenswrapper[2559]: I0612 22:27:27.186761 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/eeafdf4d-8b6d-47ec-a841-2b6a01660bfc-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-8684c9ff49-nxmqc\" (UID: \"eeafdf4d-8b6d-47ec-a841-2b6a01660bfc\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-nxmqc" Jun 12 22:27:27.282809 ip-10-0-128-134 kubenswrapper[2559]: I0612 22:27:27.282779 2559 generic.go:356] "Generic (PLEG): container finished" podID="e6975c81-34e9-4046-88a9-89d28b47c1db" containerID="8e3e7c3a65c509bd468abff83d3486faff439684ea361ed24e55695f6fc4643d" exitCode=0 Jun 12 22:27:27.282923 ip-10-0-128-134 kubenswrapper[2559]: I0612 22:27:27.282864 2559 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="d0df7d808d503b9038c0b52e71ba3e5f98026f61435d75a7fe664b7802354898" Jun 12 22:27:27.287302 ip-10-0-128-134 kubenswrapper[2559]: I0612 22:27:27.287229 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/eeafdf4d-8b6d-47ec-a841-2b6a01660bfc-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-8684c9ff49-nxmqc\" (UID: \"eeafdf4d-8b6d-47ec-a841-2b6a01660bfc\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-nxmqc" Jun 12 22:27:27.287415 ip-10-0-128-134 kubenswrapper[2559]: I0612 22:27:27.287333 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-fmjdc\" (UniqueName: \"kubernetes.io/projected/eeafdf4d-8b6d-47ec-a841-2b6a01660bfc-kube-api-access-fmjdc\") pod \"kuadrant-operator-controller-manager-8684c9ff49-nxmqc\" (UID: \"eeafdf4d-8b6d-47ec-a841-2b6a01660bfc\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-nxmqc" Jun 12 22:27:27.287660 ip-10-0-128-134 kubenswrapper[2559]: I0612 22:27:27.287638 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/eeafdf4d-8b6d-47ec-a841-2b6a01660bfc-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-8684c9ff49-nxmqc\" (UID: \"eeafdf4d-8b6d-47ec-a841-2b6a01660bfc\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-nxmqc" Jun 12 22:27:27.290692 ip-10-0-128-134 kubenswrapper[2559]: I0612 22:27:27.290675 2559 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-n776z" Jun 12 22:27:27.293308 ip-10-0-128-134 kubenswrapper[2559]: E0612 22:27:27.293285 2559 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-8684c9ff49-n776z\" is forbidden: User \"system:node:ip-10-0-128-134.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-128-134.ec2.internal' and this object" podUID="e6975c81-34e9-4046-88a9-89d28b47c1db" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-n776z" Jun 12 22:27:27.300022 ip-10-0-128-134 kubenswrapper[2559]: I0612 22:27:27.299993 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-fmjdc\" (UniqueName: \"kubernetes.io/projected/eeafdf4d-8b6d-47ec-a841-2b6a01660bfc-kube-api-access-fmjdc\") pod \"kuadrant-operator-controller-manager-8684c9ff49-nxmqc\" (UID: \"eeafdf4d-8b6d-47ec-a841-2b6a01660bfc\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-nxmqc" Jun 12 22:27:27.388666 ip-10-0-128-134 kubenswrapper[2559]: I0612 22:27:27.388628 2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/e6975c81-34e9-4046-88a9-89d28b47c1db-extensions-socket-volume\") pod \"e6975c81-34e9-4046-88a9-89d28b47c1db\" (UID: \"e6975c81-34e9-4046-88a9-89d28b47c1db\") " Jun 12 22:27:27.388861 ip-10-0-128-134 kubenswrapper[2559]: I0612 22:27:27.388719 2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-cr6pd\" (UniqueName: \"kubernetes.io/projected/e6975c81-34e9-4046-88a9-89d28b47c1db-kube-api-access-cr6pd\") pod \"e6975c81-34e9-4046-88a9-89d28b47c1db\" (UID: \"e6975c81-34e9-4046-88a9-89d28b47c1db\") " Jun 12 22:27:27.389176 ip-10-0-128-134 kubenswrapper[2559]: I0612 22:27:27.389145 2559 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/e6975c81-34e9-4046-88a9-89d28b47c1db-extensions-socket-volume" (OuterVolumeSpecName: "extensions-socket-volume") pod "e6975c81-34e9-4046-88a9-89d28b47c1db" (UID: "e6975c81-34e9-4046-88a9-89d28b47c1db"). InnerVolumeSpecName "extensions-socket-volume". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 12 22:27:27.391095 ip-10-0-128-134 kubenswrapper[2559]: I0612 22:27:27.391071 2559 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/e6975c81-34e9-4046-88a9-89d28b47c1db-kube-api-access-cr6pd" (OuterVolumeSpecName: "kube-api-access-cr6pd") pod "e6975c81-34e9-4046-88a9-89d28b47c1db" (UID: "e6975c81-34e9-4046-88a9-89d28b47c1db"). InnerVolumeSpecName "kube-api-access-cr6pd". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 12 22:27:27.412748 ip-10-0-128-134 kubenswrapper[2559]: I0612 22:27:27.412715 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-nxmqc" Jun 12 22:27:27.490408 ip-10-0-128-134 kubenswrapper[2559]: I0612 22:27:27.490372 2559 reconciler_common.go:299] "Volume detached for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/e6975c81-34e9-4046-88a9-89d28b47c1db-extensions-socket-volume\") on node \"ip-10-0-128-134.ec2.internal\" DevicePath \"\"" Jun 12 22:27:27.490561 ip-10-0-128-134 kubenswrapper[2559]: I0612 22:27:27.490412 2559 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-cr6pd\" (UniqueName: \"kubernetes.io/projected/e6975c81-34e9-4046-88a9-89d28b47c1db-kube-api-access-cr6pd\") on node \"ip-10-0-128-134.ec2.internal\" DevicePath \"\"" Jun 12 22:27:27.564247 ip-10-0-128-134 kubenswrapper[2559]: I0612 22:27:27.564221 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-nxmqc"] Jun 12 22:27:27.566966 ip-10-0-128-134 kubenswrapper[2559]: W0612 22:27:27.566943 2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podeeafdf4d_8b6d_47ec_a841_2b6a01660bfc.slice/crio-b02a3e48b006525b86d3f073529a068faeeea65814667bcc784e1179ce3c30d7 WatchSource:0}: Error finding container b02a3e48b006525b86d3f073529a068faeeea65814667bcc784e1179ce3c30d7: Status 404 returned error can't find the container with id b02a3e48b006525b86d3f073529a068faeeea65814667bcc784e1179ce3c30d7 Jun 12 22:27:27.630242 ip-10-0-128-134 kubenswrapper[2559]: I0612 22:27:27.630213 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-f7h79_2fe08918-3efc-4000-a321-8b319ead517c/konnectivity-agent/0.log" limit=1024 Jun 12 22:27:27.729047 ip-10-0-128-134 kubenswrapper[2559]: I0612 22:27:27.729011 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-f7h79_2fe08918-3efc-4000-a321-8b319ead517c/konnectivity-agent/0.log" limit=1024 Jun 12 22:27:27.823096 ip-10-0-128-134 kubenswrapper[2559]: I0612 22:27:27.823007 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-f7h79_2fe08918-3efc-4000-a321-8b319ead517c/konnectivity-agent/0.log" limit=1024 Jun 12 22:27:28.288678 ip-10-0-128-134 kubenswrapper[2559]: I0612 22:27:28.288580 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-nxmqc" event={"ID":"eeafdf4d-8b6d-47ec-a841-2b6a01660bfc","Type":"ContainerStarted","Data":"f884d11f78c1879658293f7a9eaaaa5db38667c2151600e7453eece2ae9e19e6"} Jun 12 22:27:28.288678 ip-10-0-128-134 kubenswrapper[2559]: I0612 22:27:28.288614 2559 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-n776z" Jun 12 22:27:28.288678 ip-10-0-128-134 kubenswrapper[2559]: I0612 22:27:28.288647 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-nxmqc" event={"ID":"eeafdf4d-8b6d-47ec-a841-2b6a01660bfc","Type":"ContainerStarted","Data":"b02a3e48b006525b86d3f073529a068faeeea65814667bcc784e1179ce3c30d7"} Jun 12 22:27:28.289114 ip-10-0-128-134 kubenswrapper[2559]: I0612 22:27:28.288701 2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-nxmqc" Jun 12 22:27:28.326875 ip-10-0-128-134 kubenswrapper[2559]: I0612 22:27:28.326812 2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-nxmqc" podStartSLOduration=1.326790443 podStartE2EDuration="1.326790443s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-12 22:27:27 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-12 22:27:28.324799712 +0000 UTC m=+390.373169530" watchObservedRunningTime="2026-06-12 22:27:28.326790443 +0000 UTC m=+390.375160261" Jun 12 22:27:28.331654 ip-10-0-128-134 kubenswrapper[2559]: E0612 22:27:28.331615 2559 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-8684c9ff49-n776z\" is forbidden: User \"system:node:ip-10-0-128-134.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-128-134.ec2.internal' and this object" podUID="e6975c81-34e9-4046-88a9-89d28b47c1db" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-n776z" Jun 12 22:27:28.333827 ip-10-0-128-134 kubenswrapper[2559]: E0612 22:27:28.333801 2559 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-8684c9ff49-n776z\" is forbidden: User \"system:node:ip-10-0-128-134.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-128-134.ec2.internal' and this object" podUID="e6975c81-34e9-4046-88a9-89d28b47c1db" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-n776z" Jun 12 22:27:28.410277 ip-10-0-128-134 kubenswrapper[2559]: I0612 22:27:28.410245 2559 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="e6975c81-34e9-4046-88a9-89d28b47c1db" path="/var/lib/kubelet/pods/e6975c81-34e9-4046-88a9-89d28b47c1db/volumes" Jun 12 22:27:28.411161 ip-10-0-128-134 kubenswrapper[2559]: E0612 22:27:28.411139 2559 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-8684c9ff49-n776z\" is forbidden: User \"system:node:ip-10-0-128-134.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-128-134.ec2.internal' and this object" podUID="e6975c81-34e9-4046-88a9-89d28b47c1db" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-n776z" Jun 12 22:27:29.549029 ip-10-0-128-134 kubenswrapper[2559]: I0612 22:27:29.548993 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-f7h79_2fe08918-3efc-4000-a321-8b319ead517c/konnectivity-agent/0.log" limit=1024 Jun 12 22:27:30.170573 ip-10-0-128-134 kubenswrapper[2559]: I0612 22:27:30.170543 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-f7h79_2fe08918-3efc-4000-a321-8b319ead517c/konnectivity-agent/0.log" limit=1024 Jun 12 22:27:30.273835 ip-10-0-128-134 kubenswrapper[2559]: I0612 22:27:30.273803 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-f7h79_2fe08918-3efc-4000-a321-8b319ead517c/konnectivity-agent/0.log" limit=1024 Jun 12 22:27:33.167189 ip-10-0-128-134 kubenswrapper[2559]: I0612 22:27:33.167156 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-f7h79_2fe08918-3efc-4000-a321-8b319ead517c/konnectivity-agent/0.log" limit=1024 Jun 12 22:27:33.266163 ip-10-0-128-134 kubenswrapper[2559]: I0612 22:27:33.266129 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-f7h79_2fe08918-3efc-4000-a321-8b319ead517c/konnectivity-agent/0.log" limit=1024 Jun 12 22:27:37.226962 ip-10-0-128-134 kubenswrapper[2559]: I0612 22:27:37.226920 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-f7h79_2fe08918-3efc-4000-a321-8b319ead517c/konnectivity-agent/0.log" limit=1024 Jun 12 22:27:37.339036 ip-10-0-128-134 kubenswrapper[2559]: I0612 22:27:37.339002 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-f7h79_2fe08918-3efc-4000-a321-8b319ead517c/konnectivity-agent/0.log" limit=1024 Jun 12 22:27:39.295003 ip-10-0-128-134 kubenswrapper[2559]: I0612 22:27:39.294977 2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-nxmqc" Jun 12 22:27:45.747767 ip-10-0-128-134 kubenswrapper[2559]: I0612 22:27:45.747719 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-f7h79_2fe08918-3efc-4000-a321-8b319ead517c/konnectivity-agent/0.log" limit=1024 Jun 12 22:27:45.917486 ip-10-0-128-134 kubenswrapper[2559]: I0612 22:27:45.917385 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-f7h79_2fe08918-3efc-4000-a321-8b319ead517c/konnectivity-agent/0.log" limit=1024 Jun 12 22:27:46.061694 ip-10-0-128-134 kubenswrapper[2559]: I0612 22:27:46.061663 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-f7h79_2fe08918-3efc-4000-a321-8b319ead517c/konnectivity-agent/0.log" limit=1024 Jun 12 22:27:55.024632 ip-10-0-128-134 kubenswrapper[2559]: I0612 22:27:55.024594 2559 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-nxmqc"] Jun 12 22:27:55.025193 ip-10-0-128-134 kubenswrapper[2559]: I0612 22:27:55.024845 2559 kuberuntime_container.go:872] "Killing container with a grace period" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-nxmqc" podUID="eeafdf4d-8b6d-47ec-a841-2b6a01660bfc" containerName="manager" containerID="cri-o://f884d11f78c1879658293f7a9eaaaa5db38667c2151600e7453eece2ae9e19e6" gracePeriod=10 Jun 12 22:27:55.281178 ip-10-0-128-134 kubenswrapper[2559]: I0612 22:27:55.281125 2559 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-nxmqc" Jun 12 22:27:55.407771 ip-10-0-128-134 kubenswrapper[2559]: I0612 22:27:55.407741 2559 generic.go:356] "Generic (PLEG): container finished" podID="eeafdf4d-8b6d-47ec-a841-2b6a01660bfc" containerID="f884d11f78c1879658293f7a9eaaaa5db38667c2151600e7453eece2ae9e19e6" exitCode=0 Jun 12 22:27:55.407938 ip-10-0-128-134 kubenswrapper[2559]: I0612 22:27:55.407788 2559 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-nxmqc" Jun 12 22:27:55.407938 ip-10-0-128-134 kubenswrapper[2559]: I0612 22:27:55.407814 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-nxmqc" event={"ID":"eeafdf4d-8b6d-47ec-a841-2b6a01660bfc","Type":"ContainerDied","Data":"f884d11f78c1879658293f7a9eaaaa5db38667c2151600e7453eece2ae9e19e6"} Jun 12 22:27:55.407938 ip-10-0-128-134 kubenswrapper[2559]: I0612 22:27:55.407849 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-nxmqc" event={"ID":"eeafdf4d-8b6d-47ec-a841-2b6a01660bfc","Type":"ContainerDied","Data":"b02a3e48b006525b86d3f073529a068faeeea65814667bcc784e1179ce3c30d7"} Jun 12 22:27:55.407938 ip-10-0-128-134 kubenswrapper[2559]: I0612 22:27:55.407874 2559 scope.go:117] "RemoveContainer" containerID="f884d11f78c1879658293f7a9eaaaa5db38667c2151600e7453eece2ae9e19e6" Jun 12 22:27:55.416507 ip-10-0-128-134 kubenswrapper[2559]: I0612 22:27:55.416488 2559 scope.go:117] "RemoveContainer" containerID="f884d11f78c1879658293f7a9eaaaa5db38667c2151600e7453eece2ae9e19e6" Jun 12 22:27:55.416784 ip-10-0-128-134 kubenswrapper[2559]: E0612 22:27:55.416761 2559 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"f884d11f78c1879658293f7a9eaaaa5db38667c2151600e7453eece2ae9e19e6\": container with ID starting with f884d11f78c1879658293f7a9eaaaa5db38667c2151600e7453eece2ae9e19e6 not found: ID does not exist" containerID="f884d11f78c1879658293f7a9eaaaa5db38667c2151600e7453eece2ae9e19e6" Jun 12 22:27:55.416857 ip-10-0-128-134 kubenswrapper[2559]: I0612 22:27:55.416787 2559 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"f884d11f78c1879658293f7a9eaaaa5db38667c2151600e7453eece2ae9e19e6"} err="failed to get container status \"f884d11f78c1879658293f7a9eaaaa5db38667c2151600e7453eece2ae9e19e6\": rpc error: code = NotFound desc = could not find container \"f884d11f78c1879658293f7a9eaaaa5db38667c2151600e7453eece2ae9e19e6\": container with ID starting with f884d11f78c1879658293f7a9eaaaa5db38667c2151600e7453eece2ae9e19e6 not found: ID does not exist" Jun 12 22:27:55.432070 ip-10-0-128-134 kubenswrapper[2559]: I0612 22:27:55.432049 2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/eeafdf4d-8b6d-47ec-a841-2b6a01660bfc-extensions-socket-volume\") pod \"eeafdf4d-8b6d-47ec-a841-2b6a01660bfc\" (UID: \"eeafdf4d-8b6d-47ec-a841-2b6a01660bfc\") " Jun 12 22:27:55.432163 ip-10-0-128-134 kubenswrapper[2559]: I0612 22:27:55.432132 2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-fmjdc\" (UniqueName: \"kubernetes.io/projected/eeafdf4d-8b6d-47ec-a841-2b6a01660bfc-kube-api-access-fmjdc\") pod \"eeafdf4d-8b6d-47ec-a841-2b6a01660bfc\" (UID: \"eeafdf4d-8b6d-47ec-a841-2b6a01660bfc\") " Jun 12 22:27:55.432410 ip-10-0-128-134 kubenswrapper[2559]: I0612 22:27:55.432390 2559 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/eeafdf4d-8b6d-47ec-a841-2b6a01660bfc-extensions-socket-volume" (OuterVolumeSpecName: "extensions-socket-volume") pod "eeafdf4d-8b6d-47ec-a841-2b6a01660bfc" (UID: "eeafdf4d-8b6d-47ec-a841-2b6a01660bfc"). InnerVolumeSpecName "extensions-socket-volume". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 12 22:27:55.434299 ip-10-0-128-134 kubenswrapper[2559]: I0612 22:27:55.434275 2559 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/eeafdf4d-8b6d-47ec-a841-2b6a01660bfc-kube-api-access-fmjdc" (OuterVolumeSpecName: "kube-api-access-fmjdc") pod "eeafdf4d-8b6d-47ec-a841-2b6a01660bfc" (UID: "eeafdf4d-8b6d-47ec-a841-2b6a01660bfc"). InnerVolumeSpecName "kube-api-access-fmjdc". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 12 22:27:55.533278 ip-10-0-128-134 kubenswrapper[2559]: I0612 22:27:55.533188 2559 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-fmjdc\" (UniqueName: \"kubernetes.io/projected/eeafdf4d-8b6d-47ec-a841-2b6a01660bfc-kube-api-access-fmjdc\") on node \"ip-10-0-128-134.ec2.internal\" DevicePath \"\"" Jun 12 22:27:55.533278 ip-10-0-128-134 kubenswrapper[2559]: I0612 22:27:55.533219 2559 reconciler_common.go:299] "Volume detached for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/eeafdf4d-8b6d-47ec-a841-2b6a01660bfc-extensions-socket-volume\") on node \"ip-10-0-128-134.ec2.internal\" DevicePath \"\"" Jun 12 22:27:55.737959 ip-10-0-128-134 kubenswrapper[2559]: I0612 22:27:55.737920 2559 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-nxmqc"] Jun 12 22:27:55.747778 ip-10-0-128-134 kubenswrapper[2559]: I0612 22:27:55.747744 2559 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-nxmqc"] Jun 12 22:27:56.409742 ip-10-0-128-134 kubenswrapper[2559]: I0612 22:27:56.409711 2559 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="eeafdf4d-8b6d-47ec-a841-2b6a01660bfc" path="/var/lib/kubelet/pods/eeafdf4d-8b6d-47ec-a841-2b6a01660bfc/volumes" Jun 12 22:28:11.370105 ip-10-0-128-134 kubenswrapper[2559]: I0612 22:28:11.370029 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-f7h79_2fe08918-3efc-4000-a321-8b319ead517c/konnectivity-agent/0.log" limit=1024 Jun 12 22:28:11.750296 ip-10-0-128-134 kubenswrapper[2559]: I0612 22:28:11.750211 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-f7h79_2fe08918-3efc-4000-a321-8b319ead517c/konnectivity-agent/0.log" limit=1024 Jun 12 22:28:14.571841 ip-10-0-128-134 kubenswrapper[2559]: I0612 22:28:14.571810 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-f7h79_2fe08918-3efc-4000-a321-8b319ead517c/konnectivity-agent/0.log" limit=1024 Jun 12 22:28:14.582469 ip-10-0-128-134 kubenswrapper[2559]: I0612 22:28:14.582432 2559 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/limitador-limitador-64c94fd64f-rx49s"] Jun 12 22:28:14.582772 ip-10-0-128-134 kubenswrapper[2559]: I0612 22:28:14.582760 2559 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="eeafdf4d-8b6d-47ec-a841-2b6a01660bfc" containerName="manager" Jun 12 22:28:14.582810 ip-10-0-128-134 kubenswrapper[2559]: I0612 22:28:14.582773 2559 state_mem.go:107] "Deleted CPUSet assignment" podUID="eeafdf4d-8b6d-47ec-a841-2b6a01660bfc" containerName="manager" Jun 12 22:28:14.582852 ip-10-0-128-134 kubenswrapper[2559]: I0612 22:28:14.582843 2559 memory_manager.go:368] "RemoveStaleState removing state" podUID="eeafdf4d-8b6d-47ec-a841-2b6a01660bfc" containerName="manager" Jun 12 22:28:14.585747 ip-10-0-128-134 kubenswrapper[2559]: I0612 22:28:14.585733 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-64c94fd64f-rx49s" Jun 12 22:28:14.588398 ip-10-0-128-134 kubenswrapper[2559]: I0612 22:28:14.588377 2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"openshift-service-ca.crt\"" Jun 12 22:28:14.588569 ip-10-0-128-134 kubenswrapper[2559]: I0612 22:28:14.588484 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"default-dockercfg-ctwcv\"" Jun 12 22:28:14.588569 ip-10-0-128-134 kubenswrapper[2559]: I0612 22:28:14.588513 2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"limitador-limits-config-limitador\"" Jun 12 22:28:14.589541 ip-10-0-128-134 kubenswrapper[2559]: I0612 22:28:14.589527 2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"kube-root-ca.crt\"" Jun 12 22:28:14.593800 ip-10-0-128-134 kubenswrapper[2559]: I0612 22:28:14.593607 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-64c94fd64f-rx49s"] Jun 12 22:28:14.678608 ip-10-0-128-134 kubenswrapper[2559]: I0612 22:28:14.678577 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-f7h79_2fe08918-3efc-4000-a321-8b319ead517c/konnectivity-agent/0.log" limit=1024 Jun 12 22:28:14.684401 ip-10-0-128-134 kubenswrapper[2559]: I0612 22:28:14.684367 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-64c94fd64f-rx49s"] Jun 12 22:28:14.705709 ip-10-0-128-134 kubenswrapper[2559]: I0612 22:28:14.705682 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/6f4eadad-0d92-4f46-99de-7463bbdca84a-config-file\") pod \"limitador-limitador-64c94fd64f-rx49s\" (UID: \"6f4eadad-0d92-4f46-99de-7463bbdca84a\") " pod="kuadrant-system/limitador-limitador-64c94fd64f-rx49s" Jun 12 22:28:14.705823 ip-10-0-128-134 kubenswrapper[2559]: I0612 22:28:14.705739 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-chjnp\" (UniqueName: \"kubernetes.io/projected/6f4eadad-0d92-4f46-99de-7463bbdca84a-kube-api-access-chjnp\") pod \"limitador-limitador-64c94fd64f-rx49s\" (UID: \"6f4eadad-0d92-4f46-99de-7463bbdca84a\") " pod="kuadrant-system/limitador-limitador-64c94fd64f-rx49s" Jun 12 22:28:14.779286 ip-10-0-128-134 kubenswrapper[2559]: I0612 22:28:14.779259 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-f7h79_2fe08918-3efc-4000-a321-8b319ead517c/konnectivity-agent/0.log" limit=1024 Jun 12 22:28:14.807234 ip-10-0-128-134 kubenswrapper[2559]: I0612 22:28:14.807196 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/6f4eadad-0d92-4f46-99de-7463bbdca84a-config-file\") pod \"limitador-limitador-64c94fd64f-rx49s\" (UID: \"6f4eadad-0d92-4f46-99de-7463bbdca84a\") " pod="kuadrant-system/limitador-limitador-64c94fd64f-rx49s" Jun 12 22:28:14.807526 ip-10-0-128-134 kubenswrapper[2559]: I0612 22:28:14.807502 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-chjnp\" (UniqueName: \"kubernetes.io/projected/6f4eadad-0d92-4f46-99de-7463bbdca84a-kube-api-access-chjnp\") pod \"limitador-limitador-64c94fd64f-rx49s\" (UID: \"6f4eadad-0d92-4f46-99de-7463bbdca84a\") " pod="kuadrant-system/limitador-limitador-64c94fd64f-rx49s" Jun 12 22:28:14.808819 ip-10-0-128-134 kubenswrapper[2559]: I0612 22:28:14.808789 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/6f4eadad-0d92-4f46-99de-7463bbdca84a-config-file\") pod \"limitador-limitador-64c94fd64f-rx49s\" (UID: \"6f4eadad-0d92-4f46-99de-7463bbdca84a\") " pod="kuadrant-system/limitador-limitador-64c94fd64f-rx49s" Jun 12 22:28:14.819187 ip-10-0-128-134 kubenswrapper[2559]: I0612 22:28:14.819164 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-chjnp\" (UniqueName: \"kubernetes.io/projected/6f4eadad-0d92-4f46-99de-7463bbdca84a-kube-api-access-chjnp\") pod \"limitador-limitador-64c94fd64f-rx49s\" (UID: \"6f4eadad-0d92-4f46-99de-7463bbdca84a\") " pod="kuadrant-system/limitador-limitador-64c94fd64f-rx49s" Jun 12 22:28:14.897773 ip-10-0-128-134 kubenswrapper[2559]: I0612 22:28:14.897692 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-64c94fd64f-rx49s" Jun 12 22:28:15.025907 ip-10-0-128-134 kubenswrapper[2559]: I0612 22:28:15.025882 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-64c94fd64f-rx49s"] Jun 12 22:28:15.028045 ip-10-0-128-134 kubenswrapper[2559]: W0612 22:28:15.028016 2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6f4eadad_0d92_4f46_99de_7463bbdca84a.slice/crio-7bec1ebffa5620524727ad2307288fa186893a3c09a4cd220cea0dc6022e6ee3 WatchSource:0}: Error finding container 7bec1ebffa5620524727ad2307288fa186893a3c09a4cd220cea0dc6022e6ee3: Status 404 returned error can't find the container with id 7bec1ebffa5620524727ad2307288fa186893a3c09a4cd220cea0dc6022e6ee3 Jun 12 22:28:15.375656 ip-10-0-128-134 kubenswrapper[2559]: I0612 22:28:15.375626 2559 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-58cd955675-6sr4s"] Jun 12 22:28:15.380039 ip-10-0-128-134 kubenswrapper[2559]: I0612 22:28:15.380018 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-58cd955675-6sr4s" Jun 12 22:28:15.382647 ip-10-0-128-134 kubenswrapper[2559]: I0612 22:28:15.382626 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"authorino-authorino-dockercfg-cch4c\"" Jun 12 22:28:15.387494 ip-10-0-128-134 kubenswrapper[2559]: I0612 22:28:15.387470 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-58cd955675-6sr4s"] Jun 12 22:28:15.411028 ip-10-0-128-134 kubenswrapper[2559]: I0612 22:28:15.411003 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-f7h79_2fe08918-3efc-4000-a321-8b319ead517c/konnectivity-agent/0.log" limit=1024 Jun 12 22:28:15.484404 ip-10-0-128-134 kubenswrapper[2559]: I0612 22:28:15.484354 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-f7h79_2fe08918-3efc-4000-a321-8b319ead517c/konnectivity-agent/0.log" limit=1024 Jun 12 22:28:15.498120 ip-10-0-128-134 kubenswrapper[2559]: I0612 22:28:15.498091 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-64c94fd64f-rx49s" event={"ID":"6f4eadad-0d92-4f46-99de-7463bbdca84a","Type":"ContainerStarted","Data":"7bec1ebffa5620524727ad2307288fa186893a3c09a4cd220cea0dc6022e6ee3"} Jun 12 22:28:15.515570 ip-10-0-128-134 kubenswrapper[2559]: I0612 22:28:15.515537 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jdtlp\" (UniqueName: \"kubernetes.io/projected/56a495e7-77d3-49e7-aaf1-42206908cefd-kube-api-access-jdtlp\") pod \"authorino-58cd955675-6sr4s\" (UID: \"56a495e7-77d3-49e7-aaf1-42206908cefd\") " pod="kuadrant-system/authorino-58cd955675-6sr4s" Jun 12 22:28:15.522724 ip-10-0-128-134 kubenswrapper[2559]: I0612 22:28:15.522699 2559 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-75d556bd77-vsbh7"] Jun 12 22:28:15.526004 ip-10-0-128-134 kubenswrapper[2559]: I0612 22:28:15.525990 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-75d556bd77-vsbh7" Jun 12 22:28:15.532522 ip-10-0-128-134 kubenswrapper[2559]: I0612 22:28:15.532497 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-75d556bd77-vsbh7"] Jun 12 22:28:15.617067 ip-10-0-128-134 kubenswrapper[2559]: I0612 22:28:15.617029 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jdtlp\" (UniqueName: \"kubernetes.io/projected/56a495e7-77d3-49e7-aaf1-42206908cefd-kube-api-access-jdtlp\") pod \"authorino-58cd955675-6sr4s\" (UID: \"56a495e7-77d3-49e7-aaf1-42206908cefd\") " pod="kuadrant-system/authorino-58cd955675-6sr4s" Jun 12 22:28:15.617067 ip-10-0-128-134 kubenswrapper[2559]: I0612 22:28:15.617070 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-cm76q\" (UniqueName: \"kubernetes.io/projected/31336d45-b4b0-4171-acbf-2b86793c4b83-kube-api-access-cm76q\") pod \"authorino-75d556bd77-vsbh7\" (UID: \"31336d45-b4b0-4171-acbf-2b86793c4b83\") " pod="kuadrant-system/authorino-75d556bd77-vsbh7" Jun 12 22:28:15.625710 ip-10-0-128-134 kubenswrapper[2559]: I0612 22:28:15.625658 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-jdtlp\" (UniqueName: \"kubernetes.io/projected/56a495e7-77d3-49e7-aaf1-42206908cefd-kube-api-access-jdtlp\") pod \"authorino-58cd955675-6sr4s\" (UID: \"56a495e7-77d3-49e7-aaf1-42206908cefd\") " pod="kuadrant-system/authorino-58cd955675-6sr4s" Jun 12 22:28:15.690817 ip-10-0-128-134 kubenswrapper[2559]: I0612 22:28:15.690758 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-58cd955675-6sr4s" Jun 12 22:28:15.718076 ip-10-0-128-134 kubenswrapper[2559]: I0612 22:28:15.718042 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-cm76q\" (UniqueName: \"kubernetes.io/projected/31336d45-b4b0-4171-acbf-2b86793c4b83-kube-api-access-cm76q\") pod \"authorino-75d556bd77-vsbh7\" (UID: \"31336d45-b4b0-4171-acbf-2b86793c4b83\") " pod="kuadrant-system/authorino-75d556bd77-vsbh7" Jun 12 22:28:15.726857 ip-10-0-128-134 kubenswrapper[2559]: I0612 22:28:15.726833 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-cm76q\" (UniqueName: \"kubernetes.io/projected/31336d45-b4b0-4171-acbf-2b86793c4b83-kube-api-access-cm76q\") pod \"authorino-75d556bd77-vsbh7\" (UID: \"31336d45-b4b0-4171-acbf-2b86793c4b83\") " pod="kuadrant-system/authorino-75d556bd77-vsbh7" Jun 12 22:28:15.836107 ip-10-0-128-134 kubenswrapper[2559]: I0612 22:28:15.836072 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-75d556bd77-vsbh7" Jun 12 22:28:15.860245 ip-10-0-128-134 kubenswrapper[2559]: I0612 22:28:15.860178 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-58cd955675-6sr4s"] Jun 12 22:28:15.868884 ip-10-0-128-134 kubenswrapper[2559]: W0612 22:28:15.868780 2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod56a495e7_77d3_49e7_aaf1_42206908cefd.slice/crio-f3b1b3508279a20f6e0612b72bf1e08f5f7e489f9146ba075ef7b4a69b372dda WatchSource:0}: Error finding container f3b1b3508279a20f6e0612b72bf1e08f5f7e489f9146ba075ef7b4a69b372dda: Status 404 returned error can't find the container with id f3b1b3508279a20f6e0612b72bf1e08f5f7e489f9146ba075ef7b4a69b372dda Jun 12 22:28:16.016214 ip-10-0-128-134 kubenswrapper[2559]: I0612 22:28:16.016182 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-75d556bd77-vsbh7"] Jun 12 22:28:16.019782 ip-10-0-128-134 kubenswrapper[2559]: W0612 22:28:16.019750 2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod31336d45_b4b0_4171_acbf_2b86793c4b83.slice/crio-6804b0b5cbd0dccfffa9596d9cf4adb7039a9b0ea0c18f6af70fcbcf44cb5de6 WatchSource:0}: Error finding container 6804b0b5cbd0dccfffa9596d9cf4adb7039a9b0ea0c18f6af70fcbcf44cb5de6: Status 404 returned error can't find the container with id 6804b0b5cbd0dccfffa9596d9cf4adb7039a9b0ea0c18f6af70fcbcf44cb5de6 Jun 12 22:28:16.504930 ip-10-0-128-134 kubenswrapper[2559]: I0612 22:28:16.504897 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-75d556bd77-vsbh7" event={"ID":"31336d45-b4b0-4171-acbf-2b86793c4b83","Type":"ContainerStarted","Data":"6804b0b5cbd0dccfffa9596d9cf4adb7039a9b0ea0c18f6af70fcbcf44cb5de6"} Jun 12 22:28:16.506161 ip-10-0-128-134 kubenswrapper[2559]: I0612 22:28:16.506132 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-58cd955675-6sr4s" event={"ID":"56a495e7-77d3-49e7-aaf1-42206908cefd","Type":"ContainerStarted","Data":"f3b1b3508279a20f6e0612b72bf1e08f5f7e489f9146ba075ef7b4a69b372dda"} Jun 12 22:28:18.315492 ip-10-0-128-134 kubenswrapper[2559]: I0612 22:28:18.315439 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-f7h79_2fe08918-3efc-4000-a321-8b319ead517c/konnectivity-agent/0.log" limit=1024 Jun 12 22:28:18.416867 ip-10-0-128-134 kubenswrapper[2559]: I0612 22:28:18.416836 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-f7h79_2fe08918-3efc-4000-a321-8b319ead517c/konnectivity-agent/0.log" limit=1024 Jun 12 22:28:21.533255 ip-10-0-128-134 kubenswrapper[2559]: I0612 22:28:21.533221 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-64c94fd64f-rx49s" event={"ID":"6f4eadad-0d92-4f46-99de-7463bbdca84a","Type":"ContainerStarted","Data":"884467f0f4de47cc45d9a6f3a11ae6d35c88ec71ca4c98c3acd21b5a461d0cf5"} Jun 12 22:28:21.533690 ip-10-0-128-134 kubenswrapper[2559]: I0612 22:28:21.533332 2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/limitador-limitador-64c94fd64f-rx49s" Jun 12 22:28:21.534781 ip-10-0-128-134 kubenswrapper[2559]: I0612 22:28:21.534758 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-75d556bd77-vsbh7" event={"ID":"31336d45-b4b0-4171-acbf-2b86793c4b83","Type":"ContainerStarted","Data":"eab03e6b7a21429a80233880118549c136fe084b25cd130af7af942bb879f133"} Jun 12 22:28:21.536209 ip-10-0-128-134 kubenswrapper[2559]: I0612 22:28:21.536179 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-58cd955675-6sr4s" event={"ID":"56a495e7-77d3-49e7-aaf1-42206908cefd","Type":"ContainerStarted","Data":"60d591f7d4476ccbad3a9462e0f46ec0f63ea039607079c7518cf17c029c9d54"} Jun 12 22:28:21.551232 ip-10-0-128-134 kubenswrapper[2559]: I0612 22:28:21.551193 2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/limitador-limitador-64c94fd64f-rx49s" podStartSLOduration=2.079801981 podStartE2EDuration="7.551176856s" totalImagesPullingTime="5.471374875s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-12 22:28:14 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-12 22:28:21.549337341 +0000 UTC m=+443.597707158" watchObservedRunningTime="2026-06-12 22:28:21.551176856 +0000 UTC m=+443.599546673" Jun 12 22:28:21.564172 ip-10-0-128-134 kubenswrapper[2559]: I0612 22:28:21.564123 2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/authorino-58cd955675-6sr4s" podStartSLOduration=1.934969822 podStartE2EDuration="6.564112559s" totalImagesPullingTime="4.629142737s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-12 22:28:15 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-12 22:28:21.562534365 +0000 UTC m=+443.610904183" watchObservedRunningTime="2026-06-12 22:28:21.564112559 +0000 UTC m=+443.612482375" Jun 12 22:28:21.578507 ip-10-0-128-134 kubenswrapper[2559]: I0612 22:28:21.578467 2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/authorino-75d556bd77-vsbh7" podStartSLOduration=2.087729156 podStartE2EDuration="6.578429291s" totalImagesPullingTime="4.490700135s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-12 22:28:15 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-12 22:28:21.577597589 +0000 UTC m=+443.625967408" watchObservedRunningTime="2026-06-12 22:28:21.578429291 +0000 UTC m=+443.626799107" Jun 12 22:28:21.600060 ip-10-0-128-134 kubenswrapper[2559]: I0612 22:28:21.600029 2559 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-58cd955675-6sr4s"] Jun 12 22:28:23.545463 ip-10-0-128-134 kubenswrapper[2559]: I0612 22:28:23.545400 2559 kuberuntime_container.go:872] "Killing container with a grace period" pod="kuadrant-system/authorino-58cd955675-6sr4s" podUID="56a495e7-77d3-49e7-aaf1-42206908cefd" containerName="authorino" containerID="cri-o://60d591f7d4476ccbad3a9462e0f46ec0f63ea039607079c7518cf17c029c9d54" gracePeriod=30 Jun 12 22:28:23.778120 ip-10-0-128-134 kubenswrapper[2559]: I0612 22:28:23.778098 2559 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-58cd955675-6sr4s" Jun 12 22:28:23.900653 ip-10-0-128-134 kubenswrapper[2559]: I0612 22:28:23.900562 2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-jdtlp\" (UniqueName: \"kubernetes.io/projected/56a495e7-77d3-49e7-aaf1-42206908cefd-kube-api-access-jdtlp\") pod \"56a495e7-77d3-49e7-aaf1-42206908cefd\" (UID: \"56a495e7-77d3-49e7-aaf1-42206908cefd\") " Jun 12 22:28:23.902695 ip-10-0-128-134 kubenswrapper[2559]: I0612 22:28:23.902661 2559 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/56a495e7-77d3-49e7-aaf1-42206908cefd-kube-api-access-jdtlp" (OuterVolumeSpecName: "kube-api-access-jdtlp") pod "56a495e7-77d3-49e7-aaf1-42206908cefd" (UID: "56a495e7-77d3-49e7-aaf1-42206908cefd"). InnerVolumeSpecName "kube-api-access-jdtlp". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 12 22:28:24.001113 ip-10-0-128-134 kubenswrapper[2559]: I0612 22:28:24.001070 2559 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-jdtlp\" (UniqueName: \"kubernetes.io/projected/56a495e7-77d3-49e7-aaf1-42206908cefd-kube-api-access-jdtlp\") on node \"ip-10-0-128-134.ec2.internal\" DevicePath \"\"" Jun 12 22:28:24.550811 ip-10-0-128-134 kubenswrapper[2559]: I0612 22:28:24.550775 2559 generic.go:356] "Generic (PLEG): container finished" podID="56a495e7-77d3-49e7-aaf1-42206908cefd" containerID="60d591f7d4476ccbad3a9462e0f46ec0f63ea039607079c7518cf17c029c9d54" exitCode=0 Jun 12 22:28:24.551266 ip-10-0-128-134 kubenswrapper[2559]: I0612 22:28:24.550820 2559 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-58cd955675-6sr4s" Jun 12 22:28:24.551266 ip-10-0-128-134 kubenswrapper[2559]: I0612 22:28:24.550860 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-58cd955675-6sr4s" event={"ID":"56a495e7-77d3-49e7-aaf1-42206908cefd","Type":"ContainerDied","Data":"60d591f7d4476ccbad3a9462e0f46ec0f63ea039607079c7518cf17c029c9d54"} Jun 12 22:28:24.551266 ip-10-0-128-134 kubenswrapper[2559]: I0612 22:28:24.550900 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-58cd955675-6sr4s" event={"ID":"56a495e7-77d3-49e7-aaf1-42206908cefd","Type":"ContainerDied","Data":"f3b1b3508279a20f6e0612b72bf1e08f5f7e489f9146ba075ef7b4a69b372dda"} Jun 12 22:28:24.551266 ip-10-0-128-134 kubenswrapper[2559]: I0612 22:28:24.550915 2559 scope.go:117] "RemoveContainer" containerID="60d591f7d4476ccbad3a9462e0f46ec0f63ea039607079c7518cf17c029c9d54" Jun 12 22:28:24.559376 ip-10-0-128-134 kubenswrapper[2559]: I0612 22:28:24.559360 2559 scope.go:117] "RemoveContainer" containerID="60d591f7d4476ccbad3a9462e0f46ec0f63ea039607079c7518cf17c029c9d54" Jun 12 22:28:24.559663 ip-10-0-128-134 kubenswrapper[2559]: E0612 22:28:24.559642 2559 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"60d591f7d4476ccbad3a9462e0f46ec0f63ea039607079c7518cf17c029c9d54\": container with ID starting with 60d591f7d4476ccbad3a9462e0f46ec0f63ea039607079c7518cf17c029c9d54 not found: ID does not exist" containerID="60d591f7d4476ccbad3a9462e0f46ec0f63ea039607079c7518cf17c029c9d54" Jun 12 22:28:24.559748 ip-10-0-128-134 kubenswrapper[2559]: I0612 22:28:24.559673 2559 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"60d591f7d4476ccbad3a9462e0f46ec0f63ea039607079c7518cf17c029c9d54"} err="failed to get container status \"60d591f7d4476ccbad3a9462e0f46ec0f63ea039607079c7518cf17c029c9d54\": rpc error: code = NotFound desc = could not find container \"60d591f7d4476ccbad3a9462e0f46ec0f63ea039607079c7518cf17c029c9d54\": container with ID starting with 60d591f7d4476ccbad3a9462e0f46ec0f63ea039607079c7518cf17c029c9d54 not found: ID does not exist" Jun 12 22:28:24.567677 ip-10-0-128-134 kubenswrapper[2559]: I0612 22:28:24.567653 2559 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-58cd955675-6sr4s"] Jun 12 22:28:24.571642 ip-10-0-128-134 kubenswrapper[2559]: I0612 22:28:24.571618 2559 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/authorino-58cd955675-6sr4s"] Jun 12 22:28:26.409515 ip-10-0-128-134 kubenswrapper[2559]: I0612 22:28:26.409478 2559 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="56a495e7-77d3-49e7-aaf1-42206908cefd" path="/var/lib/kubelet/pods/56a495e7-77d3-49e7-aaf1-42206908cefd/volumes" Jun 12 22:28:29.672331 ip-10-0-128-134 kubenswrapper[2559]: I0612 22:28:29.672299 2559 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/limitador-limitador-64c94fd64f-rx49s"] Jun 12 22:28:29.672812 ip-10-0-128-134 kubenswrapper[2559]: I0612 22:28:29.672508 2559 kuberuntime_container.go:872] "Killing container with a grace period" pod="kuadrant-system/limitador-limitador-64c94fd64f-rx49s" podUID="6f4eadad-0d92-4f46-99de-7463bbdca84a" containerName="limitador" containerID="cri-o://884467f0f4de47cc45d9a6f3a11ae6d35c88ec71ca4c98c3acd21b5a461d0cf5" gracePeriod=30 Jun 12 22:28:29.674611 ip-10-0-128-134 kubenswrapper[2559]: I0612 22:28:29.674585 2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/limitador-limitador-64c94fd64f-rx49s" Jun 12 22:28:30.225035 ip-10-0-128-134 kubenswrapper[2559]: I0612 22:28:30.225004 2559 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-64c94fd64f-rx49s" Jun 12 22:28:30.358431 ip-10-0-128-134 kubenswrapper[2559]: I0612 22:28:30.358396 2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/6f4eadad-0d92-4f46-99de-7463bbdca84a-config-file\") pod \"6f4eadad-0d92-4f46-99de-7463bbdca84a\" (UID: \"6f4eadad-0d92-4f46-99de-7463bbdca84a\") " Jun 12 22:28:30.358431 ip-10-0-128-134 kubenswrapper[2559]: I0612 22:28:30.358465 2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-chjnp\" (UniqueName: \"kubernetes.io/projected/6f4eadad-0d92-4f46-99de-7463bbdca84a-kube-api-access-chjnp\") pod \"6f4eadad-0d92-4f46-99de-7463bbdca84a\" (UID: \"6f4eadad-0d92-4f46-99de-7463bbdca84a\") " Jun 12 22:28:30.358813 ip-10-0-128-134 kubenswrapper[2559]: I0612 22:28:30.358790 2559 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/6f4eadad-0d92-4f46-99de-7463bbdca84a-config-file" (OuterVolumeSpecName: "config-file") pod "6f4eadad-0d92-4f46-99de-7463bbdca84a" (UID: "6f4eadad-0d92-4f46-99de-7463bbdca84a"). InnerVolumeSpecName "config-file". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 12 22:28:30.360647 ip-10-0-128-134 kubenswrapper[2559]: I0612 22:28:30.360625 2559 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/6f4eadad-0d92-4f46-99de-7463bbdca84a-kube-api-access-chjnp" (OuterVolumeSpecName: "kube-api-access-chjnp") pod "6f4eadad-0d92-4f46-99de-7463bbdca84a" (UID: "6f4eadad-0d92-4f46-99de-7463bbdca84a"). InnerVolumeSpecName "kube-api-access-chjnp". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 12 22:28:30.459065 ip-10-0-128-134 kubenswrapper[2559]: I0612 22:28:30.459031 2559 reconciler_common.go:299] "Volume detached for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/6f4eadad-0d92-4f46-99de-7463bbdca84a-config-file\") on node \"ip-10-0-128-134.ec2.internal\" DevicePath \"\"" Jun 12 22:28:30.459065 ip-10-0-128-134 kubenswrapper[2559]: I0612 22:28:30.459055 2559 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-chjnp\" (UniqueName: \"kubernetes.io/projected/6f4eadad-0d92-4f46-99de-7463bbdca84a-kube-api-access-chjnp\") on node \"ip-10-0-128-134.ec2.internal\" DevicePath \"\"" Jun 12 22:28:30.578502 ip-10-0-128-134 kubenswrapper[2559]: I0612 22:28:30.578469 2559 generic.go:356] "Generic (PLEG): container finished" podID="6f4eadad-0d92-4f46-99de-7463bbdca84a" containerID="884467f0f4de47cc45d9a6f3a11ae6d35c88ec71ca4c98c3acd21b5a461d0cf5" exitCode=0 Jun 12 22:28:30.578502 ip-10-0-128-134 kubenswrapper[2559]: I0612 22:28:30.578501 2559 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-64c94fd64f-rx49s" Jun 12 22:28:30.578705 ip-10-0-128-134 kubenswrapper[2559]: I0612 22:28:30.578526 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-64c94fd64f-rx49s" event={"ID":"6f4eadad-0d92-4f46-99de-7463bbdca84a","Type":"ContainerDied","Data":"884467f0f4de47cc45d9a6f3a11ae6d35c88ec71ca4c98c3acd21b5a461d0cf5"} Jun 12 22:28:30.578705 ip-10-0-128-134 kubenswrapper[2559]: I0612 22:28:30.578572 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-64c94fd64f-rx49s" event={"ID":"6f4eadad-0d92-4f46-99de-7463bbdca84a","Type":"ContainerDied","Data":"7bec1ebffa5620524727ad2307288fa186893a3c09a4cd220cea0dc6022e6ee3"} Jun 12 22:28:30.578705 ip-10-0-128-134 kubenswrapper[2559]: I0612 22:28:30.578595 2559 scope.go:117] "RemoveContainer" containerID="884467f0f4de47cc45d9a6f3a11ae6d35c88ec71ca4c98c3acd21b5a461d0cf5" Jun 12 22:28:30.587558 ip-10-0-128-134 kubenswrapper[2559]: I0612 22:28:30.587501 2559 scope.go:117] "RemoveContainer" containerID="884467f0f4de47cc45d9a6f3a11ae6d35c88ec71ca4c98c3acd21b5a461d0cf5" Jun 12 22:28:30.587856 ip-10-0-128-134 kubenswrapper[2559]: E0612 22:28:30.587831 2559 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"884467f0f4de47cc45d9a6f3a11ae6d35c88ec71ca4c98c3acd21b5a461d0cf5\": container with ID starting with 884467f0f4de47cc45d9a6f3a11ae6d35c88ec71ca4c98c3acd21b5a461d0cf5 not found: ID does not exist" containerID="884467f0f4de47cc45d9a6f3a11ae6d35c88ec71ca4c98c3acd21b5a461d0cf5" Jun 12 22:28:30.587958 ip-10-0-128-134 kubenswrapper[2559]: I0612 22:28:30.587860 2559 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"884467f0f4de47cc45d9a6f3a11ae6d35c88ec71ca4c98c3acd21b5a461d0cf5"} err="failed to get container status \"884467f0f4de47cc45d9a6f3a11ae6d35c88ec71ca4c98c3acd21b5a461d0cf5\": rpc error: code = NotFound desc = could not find container \"884467f0f4de47cc45d9a6f3a11ae6d35c88ec71ca4c98c3acd21b5a461d0cf5\": container with ID starting with 884467f0f4de47cc45d9a6f3a11ae6d35c88ec71ca4c98c3acd21b5a461d0cf5 not found: ID does not exist" Jun 12 22:28:30.597540 ip-10-0-128-134 kubenswrapper[2559]: I0612 22:28:30.597512 2559 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/limitador-limitador-64c94fd64f-rx49s"] Jun 12 22:28:30.601208 ip-10-0-128-134 kubenswrapper[2559]: I0612 22:28:30.601182 2559 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/limitador-limitador-64c94fd64f-rx49s"] Jun 12 22:28:32.409478 ip-10-0-128-134 kubenswrapper[2559]: I0612 22:28:32.409426 2559 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="6f4eadad-0d92-4f46-99de-7463bbdca84a" path="/var/lib/kubelet/pods/6f4eadad-0d92-4f46-99de-7463bbdca84a/volumes" Jun 12 22:28:34.843892 ip-10-0-128-134 kubenswrapper[2559]: I0612 22:28:34.843860 2559 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/postgres-69fb4594cf-4rkcc"] Jun 12 22:28:34.844416 ip-10-0-128-134 kubenswrapper[2559]: I0612 22:28:34.844332 2559 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="56a495e7-77d3-49e7-aaf1-42206908cefd" containerName="authorino" Jun 12 22:28:34.844416 ip-10-0-128-134 kubenswrapper[2559]: I0612 22:28:34.844356 2559 state_mem.go:107] "Deleted CPUSet assignment" podUID="56a495e7-77d3-49e7-aaf1-42206908cefd" containerName="authorino" Jun 12 22:28:34.844416 ip-10-0-128-134 kubenswrapper[2559]: I0612 22:28:34.844380 2559 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="6f4eadad-0d92-4f46-99de-7463bbdca84a" containerName="limitador" Jun 12 22:28:34.844416 ip-10-0-128-134 kubenswrapper[2559]: I0612 22:28:34.844387 2559 state_mem.go:107] "Deleted CPUSet assignment" podUID="6f4eadad-0d92-4f46-99de-7463bbdca84a" containerName="limitador" Jun 12 22:28:34.844697 ip-10-0-128-134 kubenswrapper[2559]: I0612 22:28:34.844509 2559 memory_manager.go:368] "RemoveStaleState removing state" podUID="6f4eadad-0d92-4f46-99de-7463bbdca84a" containerName="limitador" Jun 12 22:28:34.844697 ip-10-0-128-134 kubenswrapper[2559]: I0612 22:28:34.844525 2559 memory_manager.go:368] "RemoveStaleState removing state" podUID="56a495e7-77d3-49e7-aaf1-42206908cefd" containerName="authorino" Jun 12 22:28:34.849050 ip-10-0-128-134 kubenswrapper[2559]: I0612 22:28:34.849027 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/postgres-69fb4594cf-4rkcc" Jun 12 22:28:34.851829 ip-10-0-128-134 kubenswrapper[2559]: I0612 22:28:34.851590 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"postgres-creds\"" Jun 12 22:28:34.851829 ip-10-0-128-134 kubenswrapper[2559]: I0612 22:28:34.851651 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"default-dockercfg-qjksb\"" Jun 12 22:28:34.855408 ip-10-0-128-134 kubenswrapper[2559]: I0612 22:28:34.855381 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/postgres-69fb4594cf-4rkcc"] Jun 12 22:28:34.881915 ip-10-0-128-134 kubenswrapper[2559]: I0612 22:28:34.881870 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-f7h79_2fe08918-3efc-4000-a321-8b319ead517c/konnectivity-agent/0.log" limit=1024 Jun 12 22:28:34.999689 ip-10-0-128-134 kubenswrapper[2559]: I0612 22:28:34.999651 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zzwfh\" (UniqueName: \"kubernetes.io/projected/527e6b82-fbfa-4418-874d-ff5a5d8fdb46-kube-api-access-zzwfh\") pod \"postgres-69fb4594cf-4rkcc\" (UID: \"527e6b82-fbfa-4418-874d-ff5a5d8fdb46\") " pod="opendatahub/postgres-69fb4594cf-4rkcc" Jun 12 22:28:34.999864 ip-10-0-128-134 kubenswrapper[2559]: I0612 22:28:34.999714 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data\" (UniqueName: \"kubernetes.io/empty-dir/527e6b82-fbfa-4418-874d-ff5a5d8fdb46-data\") pod \"postgres-69fb4594cf-4rkcc\" (UID: \"527e6b82-fbfa-4418-874d-ff5a5d8fdb46\") " pod="opendatahub/postgres-69fb4594cf-4rkcc" Jun 12 22:28:35.100850 ip-10-0-128-134 kubenswrapper[2559]: I0612 22:28:35.100762 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zzwfh\" (UniqueName: \"kubernetes.io/projected/527e6b82-fbfa-4418-874d-ff5a5d8fdb46-kube-api-access-zzwfh\") pod \"postgres-69fb4594cf-4rkcc\" (UID: \"527e6b82-fbfa-4418-874d-ff5a5d8fdb46\") " pod="opendatahub/postgres-69fb4594cf-4rkcc" Jun 12 22:28:35.100850 ip-10-0-128-134 kubenswrapper[2559]: I0612 22:28:35.100824 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"data\" (UniqueName: \"kubernetes.io/empty-dir/527e6b82-fbfa-4418-874d-ff5a5d8fdb46-data\") pod \"postgres-69fb4594cf-4rkcc\" (UID: \"527e6b82-fbfa-4418-874d-ff5a5d8fdb46\") " pod="opendatahub/postgres-69fb4594cf-4rkcc" Jun 12 22:28:35.101185 ip-10-0-128-134 kubenswrapper[2559]: I0612 22:28:35.101169 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"data\" (UniqueName: \"kubernetes.io/empty-dir/527e6b82-fbfa-4418-874d-ff5a5d8fdb46-data\") pod \"postgres-69fb4594cf-4rkcc\" (UID: \"527e6b82-fbfa-4418-874d-ff5a5d8fdb46\") " pod="opendatahub/postgres-69fb4594cf-4rkcc" Jun 12 22:28:35.109505 ip-10-0-128-134 kubenswrapper[2559]: I0612 22:28:35.109473 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-zzwfh\" (UniqueName: \"kubernetes.io/projected/527e6b82-fbfa-4418-874d-ff5a5d8fdb46-kube-api-access-zzwfh\") pod \"postgres-69fb4594cf-4rkcc\" (UID: \"527e6b82-fbfa-4418-874d-ff5a5d8fdb46\") " pod="opendatahub/postgres-69fb4594cf-4rkcc" Jun 12 22:28:35.161516 ip-10-0-128-134 kubenswrapper[2559]: I0612 22:28:35.161492 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/postgres-69fb4594cf-4rkcc" Jun 12 22:28:35.291088 ip-10-0-128-134 kubenswrapper[2559]: I0612 22:28:35.291064 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/postgres-69fb4594cf-4rkcc"] Jun 12 22:28:35.293600 ip-10-0-128-134 kubenswrapper[2559]: W0612 22:28:35.293576 2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod527e6b82_fbfa_4418_874d_ff5a5d8fdb46.slice/crio-6b8188d275af560da5d7f56151402b1fa7b6228fd34beafb2543af637e11c8c0 WatchSource:0}: Error finding container 6b8188d275af560da5d7f56151402b1fa7b6228fd34beafb2543af637e11c8c0: Status 404 returned error can't find the container with id 6b8188d275af560da5d7f56151402b1fa7b6228fd34beafb2543af637e11c8c0 Jun 12 22:28:35.601945 ip-10-0-128-134 kubenswrapper[2559]: I0612 22:28:35.601912 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/postgres-69fb4594cf-4rkcc" event={"ID":"527e6b82-fbfa-4418-874d-ff5a5d8fdb46","Type":"ContainerStarted","Data":"6b8188d275af560da5d7f56151402b1fa7b6228fd34beafb2543af637e11c8c0"} Jun 12 22:28:37.614436 ip-10-0-128-134 kubenswrapper[2559]: I0612 22:28:37.614354 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/postgres-69fb4594cf-4rkcc" event={"ID":"527e6b82-fbfa-4418-874d-ff5a5d8fdb46","Type":"ContainerStarted","Data":"ac1256a24ed1b85aa1e4e487f87acc79cef58ab03e3d00a4aac89b07aeddd855"} Jun 12 22:28:37.614811 ip-10-0-128-134 kubenswrapper[2559]: I0612 22:28:37.614505 2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/postgres-69fb4594cf-4rkcc" Jun 12 22:28:37.632434 ip-10-0-128-134 kubenswrapper[2559]: I0612 22:28:37.632381 2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/postgres-69fb4594cf-4rkcc" podStartSLOduration=1.594150239 podStartE2EDuration="3.63236686s" totalImagesPullingTime="2.038216621s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-12 22:28:34 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-12 22:28:37.630789043 +0000 UTC m=+459.679158884" watchObservedRunningTime="2026-06-12 22:28:37.63236686 +0000 UTC m=+459.680736677" Jun 12 22:28:43.652606 ip-10-0-128-134 kubenswrapper[2559]: I0612 22:28:43.652568 2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/postgres-69fb4594cf-4rkcc" Jun 12 22:28:43.950714 ip-10-0-128-134 kubenswrapper[2559]: I0612 22:28:43.950615 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-f7h79_2fe08918-3efc-4000-a321-8b319ead517c/konnectivity-agent/0.log" limit=1024 Jun 12 22:28:44.047925 ip-10-0-128-134 kubenswrapper[2559]: I0612 22:28:44.047898 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-f7h79_2fe08918-3efc-4000-a321-8b319ead517c/konnectivity-agent/0.log" limit=1024 Jun 12 22:28:44.187045 ip-10-0-128-134 kubenswrapper[2559]: I0612 22:28:44.187002 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-f7h79_2fe08918-3efc-4000-a321-8b319ead517c/konnectivity-agent/0.log" limit=1024 Jun 12 22:28:52.943299 ip-10-0-128-134 kubenswrapper[2559]: I0612 22:28:52.943261 2559 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["keycloak-system/keycloak-operator-d67dbbb48-9dwbm"] Jun 12 22:28:52.952420 ip-10-0-128-134 kubenswrapper[2559]: I0612 22:28:52.952396 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="keycloak-system/keycloak-operator-d67dbbb48-9dwbm" Jun 12 22:28:52.956212 ip-10-0-128-134 kubenswrapper[2559]: I0612 22:28:52.956192 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"keycloak-system\"/\"keycloak-operator-dockercfg-jwsfb\"" Jun 12 22:28:52.957110 ip-10-0-128-134 kubenswrapper[2559]: I0612 22:28:52.957094 2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"keycloak-system\"/\"kube-root-ca.crt\"" Jun 12 22:28:52.959079 ip-10-0-128-134 kubenswrapper[2559]: I0612 22:28:52.959061 2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"keycloak-system\"/\"openshift-service-ca.crt\"" Jun 12 22:28:52.974545 ip-10-0-128-134 kubenswrapper[2559]: I0612 22:28:52.974516 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["keycloak-system/keycloak-operator-d67dbbb48-9dwbm"] Jun 12 22:28:53.047394 ip-10-0-128-134 kubenswrapper[2559]: I0612 22:28:53.047358 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-kb9rw\" (UniqueName: \"kubernetes.io/projected/bd198893-6354-4cd3-9280-91139af649d7-kube-api-access-kb9rw\") pod \"keycloak-operator-d67dbbb48-9dwbm\" (UID: \"bd198893-6354-4cd3-9280-91139af649d7\") " pod="keycloak-system/keycloak-operator-d67dbbb48-9dwbm" Jun 12 22:28:53.148718 ip-10-0-128-134 kubenswrapper[2559]: I0612 22:28:53.148677 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-kb9rw\" (UniqueName: \"kubernetes.io/projected/bd198893-6354-4cd3-9280-91139af649d7-kube-api-access-kb9rw\") pod \"keycloak-operator-d67dbbb48-9dwbm\" (UID: \"bd198893-6354-4cd3-9280-91139af649d7\") " pod="keycloak-system/keycloak-operator-d67dbbb48-9dwbm" Jun 12 22:28:53.158908 ip-10-0-128-134 kubenswrapper[2559]: I0612 22:28:53.158874 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-kb9rw\" (UniqueName: \"kubernetes.io/projected/bd198893-6354-4cd3-9280-91139af649d7-kube-api-access-kb9rw\") pod \"keycloak-operator-d67dbbb48-9dwbm\" (UID: \"bd198893-6354-4cd3-9280-91139af649d7\") " pod="keycloak-system/keycloak-operator-d67dbbb48-9dwbm" Jun 12 22:28:53.262815 ip-10-0-128-134 kubenswrapper[2559]: I0612 22:28:53.262723 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="keycloak-system/keycloak-operator-d67dbbb48-9dwbm" Jun 12 22:28:53.404938 ip-10-0-128-134 kubenswrapper[2559]: I0612 22:28:53.404913 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["keycloak-system/keycloak-operator-d67dbbb48-9dwbm"] Jun 12 22:28:53.407345 ip-10-0-128-134 kubenswrapper[2559]: W0612 22:28:53.407314 2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podbd198893_6354_4cd3_9280_91139af649d7.slice/crio-7d846b334a2fd4246c736652c1411d3f61aad94814da3d9e575339f91b644aeb WatchSource:0}: Error finding container 7d846b334a2fd4246c736652c1411d3f61aad94814da3d9e575339f91b644aeb: Status 404 returned error can't find the container with id 7d846b334a2fd4246c736652c1411d3f61aad94814da3d9e575339f91b644aeb Jun 12 22:28:53.689310 ip-10-0-128-134 kubenswrapper[2559]: I0612 22:28:53.689278 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="keycloak-system/keycloak-operator-d67dbbb48-9dwbm" event={"ID":"bd198893-6354-4cd3-9280-91139af649d7","Type":"ContainerStarted","Data":"7d846b334a2fd4246c736652c1411d3f61aad94814da3d9e575339f91b644aeb"} Jun 12 22:28:59.723463 ip-10-0-128-134 kubenswrapper[2559]: I0612 22:28:59.723421 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="keycloak-system/keycloak-operator-d67dbbb48-9dwbm" event={"ID":"bd198893-6354-4cd3-9280-91139af649d7","Type":"ContainerStarted","Data":"a0e9f1866ed55fa449516dc9b7db6a5e3303d58cd10769e415d78cd0edc3454c"} Jun 12 22:28:59.775145 ip-10-0-128-134 kubenswrapper[2559]: I0612 22:28:59.775084 2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="keycloak-system/keycloak-operator-d67dbbb48-9dwbm" podStartSLOduration=2.195191319 podStartE2EDuration="7.775068813s" totalImagesPullingTime="5.579877494s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-12 22:28:52 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-12 22:28:59.773378694 +0000 UTC m=+481.821748511" watchObservedRunningTime="2026-06-12 22:28:59.775068813 +0000 UTC m=+481.823438702" Jun 12 22:29:07.582203 ip-10-0-128-134 kubenswrapper[2559]: I0612 22:29:07.582153 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-f7h79_2fe08918-3efc-4000-a321-8b319ead517c/konnectivity-agent/0.log" limit=1024 Jun 12 22:29:07.681763 ip-10-0-128-134 kubenswrapper[2559]: I0612 22:29:07.681714 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-f7h79_2fe08918-3efc-4000-a321-8b319ead517c/konnectivity-agent/0.log" limit=1024 Jun 12 22:29:37.079117 ip-10-0-128-134 kubenswrapper[2559]: I0612 22:29:37.079073 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-f7h79_2fe08918-3efc-4000-a321-8b319ead517c/konnectivity-agent/0.log" limit=1024 Jun 12 22:29:37.302960 ip-10-0-128-134 kubenswrapper[2559]: I0612 22:29:37.302926 2559 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-5d4b67c446-6lc5z"] Jun 12 22:29:37.309712 ip-10-0-128-134 kubenswrapper[2559]: I0612 22:29:37.309689 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-5d4b67c446-6lc5z" Jun 12 22:29:37.313522 ip-10-0-128-134 kubenswrapper[2559]: I0612 22:29:37.313494 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-5d4b67c446-6lc5z"] Jun 12 22:29:37.339160 ip-10-0-128-134 kubenswrapper[2559]: I0612 22:29:37.339082 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wcc4p\" (UniqueName: \"kubernetes.io/projected/7da633ca-1701-4ea9-88f3-2574331dc5ff-kube-api-access-wcc4p\") pod \"authorino-5d4b67c446-6lc5z\" (UID: \"7da633ca-1701-4ea9-88f3-2574331dc5ff\") " pod="kuadrant-system/authorino-5d4b67c446-6lc5z" Jun 12 22:29:37.439954 ip-10-0-128-134 kubenswrapper[2559]: I0612 22:29:37.439921 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wcc4p\" (UniqueName: \"kubernetes.io/projected/7da633ca-1701-4ea9-88f3-2574331dc5ff-kube-api-access-wcc4p\") pod \"authorino-5d4b67c446-6lc5z\" (UID: \"7da633ca-1701-4ea9-88f3-2574331dc5ff\") " pod="kuadrant-system/authorino-5d4b67c446-6lc5z" Jun 12 22:29:37.448830 ip-10-0-128-134 kubenswrapper[2559]: I0612 22:29:37.448801 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-wcc4p\" (UniqueName: \"kubernetes.io/projected/7da633ca-1701-4ea9-88f3-2574331dc5ff-kube-api-access-wcc4p\") pod \"authorino-5d4b67c446-6lc5z\" (UID: \"7da633ca-1701-4ea9-88f3-2574331dc5ff\") " pod="kuadrant-system/authorino-5d4b67c446-6lc5z" Jun 12 22:29:37.525370 ip-10-0-128-134 kubenswrapper[2559]: I0612 22:29:37.525336 2559 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-5d4b67c446-6lc5z"] Jun 12 22:29:37.525612 ip-10-0-128-134 kubenswrapper[2559]: I0612 22:29:37.525598 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-5d4b67c446-6lc5z" Jun 12 22:29:37.555856 ip-10-0-128-134 kubenswrapper[2559]: I0612 22:29:37.555820 2559 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-5968f866ff-wcj6s"] Jun 12 22:29:37.558878 ip-10-0-128-134 kubenswrapper[2559]: I0612 22:29:37.558855 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-5968f866ff-wcj6s" Jun 12 22:29:37.565706 ip-10-0-128-134 kubenswrapper[2559]: I0612 22:29:37.565674 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-5968f866ff-wcj6s"] Jun 12 22:29:37.600172 ip-10-0-128-134 kubenswrapper[2559]: I0612 22:29:37.600059 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-f7h79_2fe08918-3efc-4000-a321-8b319ead517c/konnectivity-agent/0.log" limit=1024 Jun 12 22:29:37.642162 ip-10-0-128-134 kubenswrapper[2559]: I0612 22:29:37.642134 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-z2cb4\" (UniqueName: \"kubernetes.io/projected/deb6ee70-f206-41f3-b629-05a26ba55846-kube-api-access-z2cb4\") pod \"authorino-5968f866ff-wcj6s\" (UID: \"deb6ee70-f206-41f3-b629-05a26ba55846\") " pod="kuadrant-system/authorino-5968f866ff-wcj6s" Jun 12 22:29:37.666996 ip-10-0-128-134 kubenswrapper[2559]: I0612 22:29:37.666964 2559 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-5d4b67c446-6lc5z"] Jun 12 22:29:37.670465 ip-10-0-128-134 kubenswrapper[2559]: W0612 22:29:37.670426 2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod7da633ca_1701_4ea9_88f3_2574331dc5ff.slice/crio-7ad95cfe7937455ce7bde6427620f5c89e590a090c3d84f3ac88560b91d0af41 WatchSource:0}: Error finding container 7ad95cfe7937455ce7bde6427620f5c89e590a090c3d84f3ac88560b91d0af41: Status 404 returned error can't find the container with id 7ad95cfe7937455ce7bde6427620f5c89e590a090c3d84f3ac88560b91d0af41 Jun 12 22:29:37.742758 ip-10-0-128-134 kubenswrapper[2559]: I0612 22:29:37.742726 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-z2cb4\" (UniqueName: \"kubernetes.io/projected/deb6ee70-f206-41f3-b629-05a26ba55846-kube-api-access-z2cb4\") pod \"authorino-5968f866ff-wcj6s\" (UID: \"deb6ee70-f206-41f3-b629-05a26ba55846\") " pod="kuadrant-system/authorino-5968f866ff-wcj6s" Jun 12 22:29:37.751958 ip-10-0-128-134 kubenswrapper[2559]: I0612 22:29:37.751933 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-z2cb4\" (UniqueName: \"kubernetes.io/projected/deb6ee70-f206-41f3-b629-05a26ba55846-kube-api-access-z2cb4\") pod \"authorino-5968f866ff-wcj6s\" (UID: \"deb6ee70-f206-41f3-b629-05a26ba55846\") " pod="kuadrant-system/authorino-5968f866ff-wcj6s" Jun 12 22:29:37.787666 ip-10-0-128-134 kubenswrapper[2559]: I0612 22:29:37.787635 2559 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-5968f866ff-wcj6s"] Jun 12 22:29:37.787894 ip-10-0-128-134 kubenswrapper[2559]: I0612 22:29:37.787880 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-5968f866ff-wcj6s" Jun 12 22:29:37.818825 ip-10-0-128-134 kubenswrapper[2559]: I0612 22:29:37.818793 2559 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-59dc58b55-4br5g"] Jun 12 22:29:37.821051 ip-10-0-128-134 kubenswrapper[2559]: I0612 22:29:37.821035 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-59dc58b55-4br5g" Jun 12 22:29:37.823987 ip-10-0-128-134 kubenswrapper[2559]: I0612 22:29:37.823967 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"authorino-server-cert\"" Jun 12 22:29:37.833501 ip-10-0-128-134 kubenswrapper[2559]: I0612 22:29:37.832831 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-59dc58b55-4br5g"] Jun 12 22:29:37.843427 ip-10-0-128-134 kubenswrapper[2559]: I0612 22:29:37.843398 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/45e69c1f-a34e-4b40-bf18-272dfc23a3cb-tls-cert\") pod \"authorino-59dc58b55-4br5g\" (UID: \"45e69c1f-a34e-4b40-bf18-272dfc23a3cb\") " pod="kuadrant-system/authorino-59dc58b55-4br5g" Jun 12 22:29:37.843632 ip-10-0-128-134 kubenswrapper[2559]: I0612 22:29:37.843435 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xgq5g\" (UniqueName: \"kubernetes.io/projected/45e69c1f-a34e-4b40-bf18-272dfc23a3cb-kube-api-access-xgq5g\") pod \"authorino-59dc58b55-4br5g\" (UID: \"45e69c1f-a34e-4b40-bf18-272dfc23a3cb\") " pod="kuadrant-system/authorino-59dc58b55-4br5g" Jun 12 22:29:37.902107 ip-10-0-128-134 kubenswrapper[2559]: I0612 22:29:37.902070 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-5d4b67c446-6lc5z" event={"ID":"7da633ca-1701-4ea9-88f3-2574331dc5ff","Type":"ContainerStarted","Data":"7ad95cfe7937455ce7bde6427620f5c89e590a090c3d84f3ac88560b91d0af41"} Jun 12 22:29:37.925013 ip-10-0-128-134 kubenswrapper[2559]: I0612 22:29:37.924981 2559 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-5968f866ff-wcj6s"] Jun 12 22:29:37.928036 ip-10-0-128-134 kubenswrapper[2559]: W0612 22:29:37.928010 2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-poddeb6ee70_f206_41f3_b629_05a26ba55846.slice/crio-5ed3d58a0146b5e90d9ddbaa1aaacc7bc5e64bec2842cba856bc5bbfb2ecc970 WatchSource:0}: Error finding container 5ed3d58a0146b5e90d9ddbaa1aaacc7bc5e64bec2842cba856bc5bbfb2ecc970: Status 404 returned error can't find the container with id 5ed3d58a0146b5e90d9ddbaa1aaacc7bc5e64bec2842cba856bc5bbfb2ecc970 Jun 12 22:29:37.944486 ip-10-0-128-134 kubenswrapper[2559]: I0612 22:29:37.944438 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/45e69c1f-a34e-4b40-bf18-272dfc23a3cb-tls-cert\") pod \"authorino-59dc58b55-4br5g\" (UID: \"45e69c1f-a34e-4b40-bf18-272dfc23a3cb\") " pod="kuadrant-system/authorino-59dc58b55-4br5g" Jun 12 22:29:37.944659 ip-10-0-128-134 kubenswrapper[2559]: I0612 22:29:37.944503 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xgq5g\" (UniqueName: \"kubernetes.io/projected/45e69c1f-a34e-4b40-bf18-272dfc23a3cb-kube-api-access-xgq5g\") pod \"authorino-59dc58b55-4br5g\" (UID: \"45e69c1f-a34e-4b40-bf18-272dfc23a3cb\") " pod="kuadrant-system/authorino-59dc58b55-4br5g" Jun 12 22:29:37.946891 ip-10-0-128-134 kubenswrapper[2559]: I0612 22:29:37.946870 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/45e69c1f-a34e-4b40-bf18-272dfc23a3cb-tls-cert\") pod \"authorino-59dc58b55-4br5g\" (UID: \"45e69c1f-a34e-4b40-bf18-272dfc23a3cb\") " pod="kuadrant-system/authorino-59dc58b55-4br5g" Jun 12 22:29:37.952768 ip-10-0-128-134 kubenswrapper[2559]: I0612 22:29:37.952748 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-xgq5g\" (UniqueName: \"kubernetes.io/projected/45e69c1f-a34e-4b40-bf18-272dfc23a3cb-kube-api-access-xgq5g\") pod \"authorino-59dc58b55-4br5g\" (UID: \"45e69c1f-a34e-4b40-bf18-272dfc23a3cb\") " pod="kuadrant-system/authorino-59dc58b55-4br5g" Jun 12 22:29:38.140496 ip-10-0-128-134 kubenswrapper[2559]: I0612 22:29:38.140382 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-59dc58b55-4br5g" Jun 12 22:29:38.271404 ip-10-0-128-134 kubenswrapper[2559]: I0612 22:29:38.271373 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-59dc58b55-4br5g"] Jun 12 22:29:38.276358 ip-10-0-128-134 kubenswrapper[2559]: W0612 22:29:38.276334 2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod45e69c1f_a34e_4b40_bf18_272dfc23a3cb.slice/crio-16849419eece3d9819daf1400c16977d5a7fad44c0e227173f0e84375e318548 WatchSource:0}: Error finding container 16849419eece3d9819daf1400c16977d5a7fad44c0e227173f0e84375e318548: Status 404 returned error can't find the container with id 16849419eece3d9819daf1400c16977d5a7fad44c0e227173f0e84375e318548 Jun 12 22:29:38.908817 ip-10-0-128-134 kubenswrapper[2559]: I0612 22:29:38.908687 2559 kuberuntime_container.go:872] "Killing container with a grace period" pod="kuadrant-system/authorino-5d4b67c446-6lc5z" podUID="7da633ca-1701-4ea9-88f3-2574331dc5ff" containerName="authorino" containerID="cri-o://ea2174987b439c0607312f0accdc0824e2ebd9f5c94df515598541082fb912db" gracePeriod=30 Jun 12 22:29:38.908817 ip-10-0-128-134 kubenswrapper[2559]: I0612 22:29:38.908691 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-5d4b67c446-6lc5z" event={"ID":"7da633ca-1701-4ea9-88f3-2574331dc5ff","Type":"ContainerStarted","Data":"ea2174987b439c0607312f0accdc0824e2ebd9f5c94df515598541082fb912db"} Jun 12 22:29:38.910242 ip-10-0-128-134 kubenswrapper[2559]: I0612 22:29:38.910206 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-59dc58b55-4br5g" event={"ID":"45e69c1f-a34e-4b40-bf18-272dfc23a3cb","Type":"ContainerStarted","Data":"ff2ea1016cfdabf897a969be512ed8c77b1ab39787608623abacdd1aabfe478d"} Jun 12 22:29:38.910389 ip-10-0-128-134 kubenswrapper[2559]: I0612 22:29:38.910255 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-59dc58b55-4br5g" event={"ID":"45e69c1f-a34e-4b40-bf18-272dfc23a3cb","Type":"ContainerStarted","Data":"16849419eece3d9819daf1400c16977d5a7fad44c0e227173f0e84375e318548"} Jun 12 22:29:38.911773 ip-10-0-128-134 kubenswrapper[2559]: I0612 22:29:38.911732 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-5968f866ff-wcj6s" event={"ID":"deb6ee70-f206-41f3-b629-05a26ba55846","Type":"ContainerStarted","Data":"2c797de5ce09568c81cf9c6a941407edeb05e41625ade65cf78bdb52e9058b4b"} Jun 12 22:29:38.911773 ip-10-0-128-134 kubenswrapper[2559]: I0612 22:29:38.911773 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-5968f866ff-wcj6s" event={"ID":"deb6ee70-f206-41f3-b629-05a26ba55846","Type":"ContainerStarted","Data":"5ed3d58a0146b5e90d9ddbaa1aaacc7bc5e64bec2842cba856bc5bbfb2ecc970"} Jun 12 22:29:38.911922 ip-10-0-128-134 kubenswrapper[2559]: I0612 22:29:38.911878 2559 kuberuntime_container.go:872] "Killing container with a grace period" pod="kuadrant-system/authorino-5968f866ff-wcj6s" podUID="deb6ee70-f206-41f3-b629-05a26ba55846" containerName="authorino" containerID="cri-o://2c797de5ce09568c81cf9c6a941407edeb05e41625ade65cf78bdb52e9058b4b" gracePeriod=30 Jun 12 22:29:38.925556 ip-10-0-128-134 kubenswrapper[2559]: I0612 22:29:38.925513 2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/authorino-5d4b67c446-6lc5z" podStartSLOduration=1.5872024169999999 podStartE2EDuration="1.925428656s" totalImagesPullingTime="338.226239ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-12 22:29:37 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-12 22:29:38.92371723 +0000 UTC m=+520.972087038" watchObservedRunningTime="2026-06-12 22:29:38.925428656 +0000 UTC m=+520.973798473" Jun 12 22:29:38.939162 ip-10-0-128-134 kubenswrapper[2559]: I0612 22:29:38.939118 2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/authorino-5968f866ff-wcj6s" podStartSLOduration=1.66055053 podStartE2EDuration="1.939105211s" totalImagesPullingTime="278.554681ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-12 22:29:37 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-12 22:29:38.937879588 +0000 UTC m=+520.986249406" watchObservedRunningTime="2026-06-12 22:29:38.939105211 +0000 UTC m=+520.987475027" Jun 12 22:29:38.953352 ip-10-0-128-134 kubenswrapper[2559]: I0612 22:29:38.953308 2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/authorino-59dc58b55-4br5g" podStartSLOduration=1.620159982 podStartE2EDuration="1.953290865s" totalImagesPullingTime="333.130883ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-12 22:29:37 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-12 22:29:38.952095109 +0000 UTC m=+521.000464927" watchObservedRunningTime="2026-06-12 22:29:38.953290865 +0000 UTC m=+521.001660682" Jun 12 22:29:38.980551 ip-10-0-128-134 kubenswrapper[2559]: I0612 22:29:38.980511 2559 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-75d556bd77-vsbh7"] Jun 12 22:29:38.980757 ip-10-0-128-134 kubenswrapper[2559]: I0612 22:29:38.980732 2559 kuberuntime_container.go:872] "Killing container with a grace period" pod="kuadrant-system/authorino-75d556bd77-vsbh7" podUID="31336d45-b4b0-4171-acbf-2b86793c4b83" containerName="authorino" containerID="cri-o://eab03e6b7a21429a80233880118549c136fe084b25cd130af7af942bb879f133" gracePeriod=30 Jun 12 22:29:39.220084 ip-10-0-128-134 kubenswrapper[2559]: I0612 22:29:39.220059 2559 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-5d4b67c446-6lc5z" Jun 12 22:29:39.254090 ip-10-0-128-134 kubenswrapper[2559]: I0612 22:29:39.254063 2559 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-5968f866ff-wcj6s" Jun 12 22:29:39.254353 ip-10-0-128-134 kubenswrapper[2559]: I0612 22:29:39.254335 2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-wcc4p\" (UniqueName: \"kubernetes.io/projected/7da633ca-1701-4ea9-88f3-2574331dc5ff-kube-api-access-wcc4p\") pod \"7da633ca-1701-4ea9-88f3-2574331dc5ff\" (UID: \"7da633ca-1701-4ea9-88f3-2574331dc5ff\") " Jun 12 22:29:39.256822 ip-10-0-128-134 kubenswrapper[2559]: I0612 22:29:39.256798 2559 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/7da633ca-1701-4ea9-88f3-2574331dc5ff-kube-api-access-wcc4p" (OuterVolumeSpecName: "kube-api-access-wcc4p") pod "7da633ca-1701-4ea9-88f3-2574331dc5ff" (UID: "7da633ca-1701-4ea9-88f3-2574331dc5ff"). InnerVolumeSpecName "kube-api-access-wcc4p". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 12 22:29:39.260914 ip-10-0-128-134 kubenswrapper[2559]: I0612 22:29:39.260892 2559 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-75d556bd77-vsbh7" Jun 12 22:29:39.354975 ip-10-0-128-134 kubenswrapper[2559]: I0612 22:29:39.354941 2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-cm76q\" (UniqueName: \"kubernetes.io/projected/31336d45-b4b0-4171-acbf-2b86793c4b83-kube-api-access-cm76q\") pod \"31336d45-b4b0-4171-acbf-2b86793c4b83\" (UID: \"31336d45-b4b0-4171-acbf-2b86793c4b83\") " Jun 12 22:29:39.355144 ip-10-0-128-134 kubenswrapper[2559]: I0612 22:29:39.354985 2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-z2cb4\" (UniqueName: \"kubernetes.io/projected/deb6ee70-f206-41f3-b629-05a26ba55846-kube-api-access-z2cb4\") pod \"deb6ee70-f206-41f3-b629-05a26ba55846\" (UID: \"deb6ee70-f206-41f3-b629-05a26ba55846\") " Jun 12 22:29:39.355227 ip-10-0-128-134 kubenswrapper[2559]: I0612 22:29:39.355150 2559 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-wcc4p\" (UniqueName: \"kubernetes.io/projected/7da633ca-1701-4ea9-88f3-2574331dc5ff-kube-api-access-wcc4p\") on node \"ip-10-0-128-134.ec2.internal\" DevicePath \"\"" Jun 12 22:29:39.357198 ip-10-0-128-134 kubenswrapper[2559]: I0612 22:29:39.357165 2559 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/31336d45-b4b0-4171-acbf-2b86793c4b83-kube-api-access-cm76q" (OuterVolumeSpecName: "kube-api-access-cm76q") pod "31336d45-b4b0-4171-acbf-2b86793c4b83" (UID: "31336d45-b4b0-4171-acbf-2b86793c4b83"). InnerVolumeSpecName "kube-api-access-cm76q". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 12 22:29:39.357303 ip-10-0-128-134 kubenswrapper[2559]: I0612 22:29:39.357237 2559 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/deb6ee70-f206-41f3-b629-05a26ba55846-kube-api-access-z2cb4" (OuterVolumeSpecName: "kube-api-access-z2cb4") pod "deb6ee70-f206-41f3-b629-05a26ba55846" (UID: "deb6ee70-f206-41f3-b629-05a26ba55846"). InnerVolumeSpecName "kube-api-access-z2cb4". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 12 22:29:39.456044 ip-10-0-128-134 kubenswrapper[2559]: I0612 22:29:39.456018 2559 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-z2cb4\" (UniqueName: \"kubernetes.io/projected/deb6ee70-f206-41f3-b629-05a26ba55846-kube-api-access-z2cb4\") on node \"ip-10-0-128-134.ec2.internal\" DevicePath \"\"" Jun 12 22:29:39.456044 ip-10-0-128-134 kubenswrapper[2559]: I0612 22:29:39.456045 2559 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-cm76q\" (UniqueName: \"kubernetes.io/projected/31336d45-b4b0-4171-acbf-2b86793c4b83-kube-api-access-cm76q\") on node \"ip-10-0-128-134.ec2.internal\" DevicePath \"\"" Jun 12 22:29:39.918058 ip-10-0-128-134 kubenswrapper[2559]: I0612 22:29:39.918015 2559 generic.go:356] "Generic (PLEG): container finished" podID="deb6ee70-f206-41f3-b629-05a26ba55846" containerID="2c797de5ce09568c81cf9c6a941407edeb05e41625ade65cf78bdb52e9058b4b" exitCode=0 Jun 12 22:29:39.918058 ip-10-0-128-134 kubenswrapper[2559]: I0612 22:29:39.918062 2559 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-5968f866ff-wcj6s" Jun 12 22:29:39.918278 ip-10-0-128-134 kubenswrapper[2559]: I0612 22:29:39.918103 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-5968f866ff-wcj6s" event={"ID":"deb6ee70-f206-41f3-b629-05a26ba55846","Type":"ContainerDied","Data":"2c797de5ce09568c81cf9c6a941407edeb05e41625ade65cf78bdb52e9058b4b"} Jun 12 22:29:39.918278 ip-10-0-128-134 kubenswrapper[2559]: I0612 22:29:39.918144 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-5968f866ff-wcj6s" event={"ID":"deb6ee70-f206-41f3-b629-05a26ba55846","Type":"ContainerDied","Data":"5ed3d58a0146b5e90d9ddbaa1aaacc7bc5e64bec2842cba856bc5bbfb2ecc970"} Jun 12 22:29:39.918278 ip-10-0-128-134 kubenswrapper[2559]: I0612 22:29:39.918160 2559 scope.go:117] "RemoveContainer" containerID="2c797de5ce09568c81cf9c6a941407edeb05e41625ade65cf78bdb52e9058b4b" Jun 12 22:29:39.919500 ip-10-0-128-134 kubenswrapper[2559]: I0612 22:29:39.919479 2559 generic.go:356] "Generic (PLEG): container finished" podID="31336d45-b4b0-4171-acbf-2b86793c4b83" containerID="eab03e6b7a21429a80233880118549c136fe084b25cd130af7af942bb879f133" exitCode=0 Jun 12 22:29:39.919578 ip-10-0-128-134 kubenswrapper[2559]: I0612 22:29:39.919511 2559 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-75d556bd77-vsbh7" Jun 12 22:29:39.919578 ip-10-0-128-134 kubenswrapper[2559]: I0612 22:29:39.919559 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-75d556bd77-vsbh7" event={"ID":"31336d45-b4b0-4171-acbf-2b86793c4b83","Type":"ContainerDied","Data":"eab03e6b7a21429a80233880118549c136fe084b25cd130af7af942bb879f133"} Jun 12 22:29:39.919687 ip-10-0-128-134 kubenswrapper[2559]: I0612 22:29:39.919594 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-75d556bd77-vsbh7" event={"ID":"31336d45-b4b0-4171-acbf-2b86793c4b83","Type":"ContainerDied","Data":"6804b0b5cbd0dccfffa9596d9cf4adb7039a9b0ea0c18f6af70fcbcf44cb5de6"} Jun 12 22:29:39.920974 ip-10-0-128-134 kubenswrapper[2559]: I0612 22:29:39.920952 2559 generic.go:356] "Generic (PLEG): container finished" podID="7da633ca-1701-4ea9-88f3-2574331dc5ff" containerID="ea2174987b439c0607312f0accdc0824e2ebd9f5c94df515598541082fb912db" exitCode=0 Jun 12 22:29:39.921102 ip-10-0-128-134 kubenswrapper[2559]: I0612 22:29:39.920989 2559 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-5d4b67c446-6lc5z" Jun 12 22:29:39.921102 ip-10-0-128-134 kubenswrapper[2559]: I0612 22:29:39.921012 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-5d4b67c446-6lc5z" event={"ID":"7da633ca-1701-4ea9-88f3-2574331dc5ff","Type":"ContainerDied","Data":"ea2174987b439c0607312f0accdc0824e2ebd9f5c94df515598541082fb912db"} Jun 12 22:29:39.921102 ip-10-0-128-134 kubenswrapper[2559]: I0612 22:29:39.921038 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-5d4b67c446-6lc5z" event={"ID":"7da633ca-1701-4ea9-88f3-2574331dc5ff","Type":"ContainerDied","Data":"7ad95cfe7937455ce7bde6427620f5c89e590a090c3d84f3ac88560b91d0af41"} Jun 12 22:29:39.930934 ip-10-0-128-134 kubenswrapper[2559]: I0612 22:29:39.930150 2559 scope.go:117] "RemoveContainer" containerID="2c797de5ce09568c81cf9c6a941407edeb05e41625ade65cf78bdb52e9058b4b" Jun 12 22:29:39.930934 ip-10-0-128-134 kubenswrapper[2559]: E0612 22:29:39.930716 2559 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"2c797de5ce09568c81cf9c6a941407edeb05e41625ade65cf78bdb52e9058b4b\": container with ID starting with 2c797de5ce09568c81cf9c6a941407edeb05e41625ade65cf78bdb52e9058b4b not found: ID does not exist" containerID="2c797de5ce09568c81cf9c6a941407edeb05e41625ade65cf78bdb52e9058b4b" Jun 12 22:29:39.930934 ip-10-0-128-134 kubenswrapper[2559]: I0612 22:29:39.930747 2559 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"2c797de5ce09568c81cf9c6a941407edeb05e41625ade65cf78bdb52e9058b4b"} err="failed to get container status \"2c797de5ce09568c81cf9c6a941407edeb05e41625ade65cf78bdb52e9058b4b\": rpc error: code = NotFound desc = could not find container \"2c797de5ce09568c81cf9c6a941407edeb05e41625ade65cf78bdb52e9058b4b\": container with ID starting with 2c797de5ce09568c81cf9c6a941407edeb05e41625ade65cf78bdb52e9058b4b not found: ID does not exist" Jun 12 22:29:39.930934 ip-10-0-128-134 kubenswrapper[2559]: I0612 22:29:39.930771 2559 scope.go:117] "RemoveContainer" containerID="eab03e6b7a21429a80233880118549c136fe084b25cd130af7af942bb879f133" Jun 12 22:29:39.939806 ip-10-0-128-134 kubenswrapper[2559]: I0612 22:29:39.939788 2559 scope.go:117] "RemoveContainer" containerID="eab03e6b7a21429a80233880118549c136fe084b25cd130af7af942bb879f133" Jun 12 22:29:39.940036 ip-10-0-128-134 kubenswrapper[2559]: E0612 22:29:39.940020 2559 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"eab03e6b7a21429a80233880118549c136fe084b25cd130af7af942bb879f133\": container with ID starting with eab03e6b7a21429a80233880118549c136fe084b25cd130af7af942bb879f133 not found: ID does not exist" containerID="eab03e6b7a21429a80233880118549c136fe084b25cd130af7af942bb879f133" Jun 12 22:29:39.940097 ip-10-0-128-134 kubenswrapper[2559]: I0612 22:29:39.940041 2559 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"eab03e6b7a21429a80233880118549c136fe084b25cd130af7af942bb879f133"} err="failed to get container status \"eab03e6b7a21429a80233880118549c136fe084b25cd130af7af942bb879f133\": rpc error: code = NotFound desc = could not find container \"eab03e6b7a21429a80233880118549c136fe084b25cd130af7af942bb879f133\": container with ID starting with eab03e6b7a21429a80233880118549c136fe084b25cd130af7af942bb879f133 not found: ID does not exist" Jun 12 22:29:39.940097 ip-10-0-128-134 kubenswrapper[2559]: I0612 22:29:39.940056 2559 scope.go:117] "RemoveContainer" containerID="ea2174987b439c0607312f0accdc0824e2ebd9f5c94df515598541082fb912db" Jun 12 22:29:39.945831 ip-10-0-128-134 kubenswrapper[2559]: I0612 22:29:39.945806 2559 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-5968f866ff-wcj6s"] Jun 12 22:29:39.948065 ip-10-0-128-134 kubenswrapper[2559]: I0612 22:29:39.948050 2559 scope.go:117] "RemoveContainer" containerID="ea2174987b439c0607312f0accdc0824e2ebd9f5c94df515598541082fb912db" Jun 12 22:29:39.948313 ip-10-0-128-134 kubenswrapper[2559]: E0612 22:29:39.948296 2559 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"ea2174987b439c0607312f0accdc0824e2ebd9f5c94df515598541082fb912db\": container with ID starting with ea2174987b439c0607312f0accdc0824e2ebd9f5c94df515598541082fb912db not found: ID does not exist" containerID="ea2174987b439c0607312f0accdc0824e2ebd9f5c94df515598541082fb912db" Jun 12 22:29:39.948424 ip-10-0-128-134 kubenswrapper[2559]: I0612 22:29:39.948319 2559 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"ea2174987b439c0607312f0accdc0824e2ebd9f5c94df515598541082fb912db"} err="failed to get container status \"ea2174987b439c0607312f0accdc0824e2ebd9f5c94df515598541082fb912db\": rpc error: code = NotFound desc = could not find container \"ea2174987b439c0607312f0accdc0824e2ebd9f5c94df515598541082fb912db\": container with ID starting with ea2174987b439c0607312f0accdc0824e2ebd9f5c94df515598541082fb912db not found: ID does not exist" Jun 12 22:29:39.950836 ip-10-0-128-134 kubenswrapper[2559]: I0612 22:29:39.950813 2559 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/authorino-5968f866ff-wcj6s"] Jun 12 22:29:39.961125 ip-10-0-128-134 kubenswrapper[2559]: I0612 22:29:39.961102 2559 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-5d4b67c446-6lc5z"] Jun 12 22:29:39.964494 ip-10-0-128-134 kubenswrapper[2559]: I0612 22:29:39.964473 2559 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/authorino-5d4b67c446-6lc5z"] Jun 12 22:29:39.975163 ip-10-0-128-134 kubenswrapper[2559]: I0612 22:29:39.975137 2559 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-75d556bd77-vsbh7"] Jun 12 22:29:39.978956 ip-10-0-128-134 kubenswrapper[2559]: I0612 22:29:39.978937 2559 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/authorino-75d556bd77-vsbh7"] Jun 12 22:29:40.410988 ip-10-0-128-134 kubenswrapper[2559]: I0612 22:29:40.410943 2559 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="31336d45-b4b0-4171-acbf-2b86793c4b83" path="/var/lib/kubelet/pods/31336d45-b4b0-4171-acbf-2b86793c4b83/volumes" Jun 12 22:29:40.411499 ip-10-0-128-134 kubenswrapper[2559]: I0612 22:29:40.411409 2559 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="7da633ca-1701-4ea9-88f3-2574331dc5ff" path="/var/lib/kubelet/pods/7da633ca-1701-4ea9-88f3-2574331dc5ff/volumes" Jun 12 22:29:40.411773 ip-10-0-128-134 kubenswrapper[2559]: I0612 22:29:40.411754 2559 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="deb6ee70-f206-41f3-b629-05a26ba55846" path="/var/lib/kubelet/pods/deb6ee70-f206-41f3-b629-05a26ba55846/volumes" Jun 12 22:29:42.588607 ip-10-0-128-134 kubenswrapper[2559]: I0612 22:29:42.588569 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-f7h79_2fe08918-3efc-4000-a321-8b319ead517c/konnectivity-agent/0.log" limit=1024 Jun 12 22:29:42.677578 ip-10-0-128-134 kubenswrapper[2559]: I0612 22:29:42.677542 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-f7h79_2fe08918-3efc-4000-a321-8b319ead517c/konnectivity-agent/0.log" limit=1024 Jun 12 22:29:42.777278 ip-10-0-128-134 kubenswrapper[2559]: I0612 22:29:42.777245 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-f7h79_2fe08918-3efc-4000-a321-8b319ead517c/konnectivity-agent/0.log" limit=1024 Jun 12 22:29:45.050396 ip-10-0-128-134 kubenswrapper[2559]: I0612 22:29:45.050365 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-f7h79_2fe08918-3efc-4000-a321-8b319ead517c/konnectivity-agent/0.log" limit=1024 Jun 12 22:29:45.213672 ip-10-0-128-134 kubenswrapper[2559]: I0612 22:29:45.213634 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-f7h79_2fe08918-3efc-4000-a321-8b319ead517c/konnectivity-agent/0.log" limit=1024 Jun 12 22:30:14.306727 ip-10-0-128-134 kubenswrapper[2559]: I0612 22:30:14.306686 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-f7h79_2fe08918-3efc-4000-a321-8b319ead517c/konnectivity-agent/0.log" limit=1024 Jun 12 22:30:16.301976 ip-10-0-128-134 kubenswrapper[2559]: I0612 22:30:16.301944 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-f7h79_2fe08918-3efc-4000-a321-8b319ead517c/konnectivity-agent/0.log" limit=1024 Jun 12 22:30:16.465374 ip-10-0-128-134 kubenswrapper[2559]: I0612 22:30:16.465341 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-f7h79_2fe08918-3efc-4000-a321-8b319ead517c/konnectivity-agent/0.log" limit=1024 Jun 12 22:30:16.739170 ip-10-0-128-134 kubenswrapper[2559]: I0612 22:30:16.739089 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-f7h79_2fe08918-3efc-4000-a321-8b319ead517c/konnectivity-agent/0.log" limit=1024 Jun 12 22:30:16.845693 ip-10-0-128-134 kubenswrapper[2559]: I0612 22:30:16.845637 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-f7h79_2fe08918-3efc-4000-a321-8b319ead517c/konnectivity-agent/0.log" limit=1024 Jun 12 22:30:19.258643 ip-10-0-128-134 kubenswrapper[2559]: I0612 22:30:19.258603 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-f7h79_2fe08918-3efc-4000-a321-8b319ead517c/konnectivity-agent/0.log" limit=1024 Jun 12 22:30:26.906645 ip-10-0-128-134 kubenswrapper[2559]: I0612 22:30:26.906614 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-f7h79_2fe08918-3efc-4000-a321-8b319ead517c/konnectivity-agent/0.log" limit=1024 Jun 12 22:30:58.389864 ip-10-0-128-134 kubenswrapper[2559]: I0612 22:30:58.389835 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-9qn4j_f6ddad48-94e1-479b-951c-ebf6be358f2c/ovn-acl-logging/0.log" Jun 12 22:30:58.393294 ip-10-0-128-134 kubenswrapper[2559]: I0612 22:30:58.393274 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-9qn4j_f6ddad48-94e1-479b-951c-ebf6be358f2c/ovn-acl-logging/0.log" Jun 12 22:31:52.843437 ip-10-0-128-134 kubenswrapper[2559]: I0612 22:31:52.843405 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-f7h79_2fe08918-3efc-4000-a321-8b319ead517c/konnectivity-agent/0.log" limit=1024 Jun 12 22:32:18.773508 ip-10-0-128-134 kubenswrapper[2559]: I0612 22:32:18.773475 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-f7h79_2fe08918-3efc-4000-a321-8b319ead517c/konnectivity-agent/0.log" limit=1024 Jun 12 22:32:28.044904 ip-10-0-128-134 kubenswrapper[2559]: I0612 22:32:28.044874 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-f7h79_2fe08918-3efc-4000-a321-8b319ead517c/konnectivity-agent/0.log" limit=1024 Jun 12 22:33:06.577218 ip-10-0-128-134 kubenswrapper[2559]: I0612 22:33:06.577184 2559 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-b67c44f87-9dsg4"] Jun 12 22:33:06.577808 ip-10-0-128-134 kubenswrapper[2559]: I0612 22:33:06.577702 2559 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="7da633ca-1701-4ea9-88f3-2574331dc5ff" containerName="authorino" Jun 12 22:33:06.577808 ip-10-0-128-134 kubenswrapper[2559]: I0612 22:33:06.577723 2559 state_mem.go:107] "Deleted CPUSet assignment" podUID="7da633ca-1701-4ea9-88f3-2574331dc5ff" containerName="authorino" Jun 12 22:33:06.577808 ip-10-0-128-134 kubenswrapper[2559]: I0612 22:33:06.577741 2559 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="31336d45-b4b0-4171-acbf-2b86793c4b83" containerName="authorino" Jun 12 22:33:06.577808 ip-10-0-128-134 kubenswrapper[2559]: I0612 22:33:06.577749 2559 state_mem.go:107] "Deleted CPUSet assignment" podUID="31336d45-b4b0-4171-acbf-2b86793c4b83" containerName="authorino" Jun 12 22:33:06.577808 ip-10-0-128-134 kubenswrapper[2559]: I0612 22:33:06.577776 2559 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="deb6ee70-f206-41f3-b629-05a26ba55846" containerName="authorino" Jun 12 22:33:06.577808 ip-10-0-128-134 kubenswrapper[2559]: I0612 22:33:06.577785 2559 state_mem.go:107] "Deleted CPUSet assignment" podUID="deb6ee70-f206-41f3-b629-05a26ba55846" containerName="authorino" Jun 12 22:33:06.578108 ip-10-0-128-134 kubenswrapper[2559]: I0612 22:33:06.577871 2559 memory_manager.go:368] "RemoveStaleState removing state" podUID="7da633ca-1701-4ea9-88f3-2574331dc5ff" containerName="authorino" Jun 12 22:33:06.578108 ip-10-0-128-134 kubenswrapper[2559]: I0612 22:33:06.577884 2559 memory_manager.go:368] "RemoveStaleState removing state" podUID="deb6ee70-f206-41f3-b629-05a26ba55846" containerName="authorino" Jun 12 22:33:06.578108 ip-10-0-128-134 kubenswrapper[2559]: I0612 22:33:06.577897 2559 memory_manager.go:368] "RemoveStaleState removing state" podUID="31336d45-b4b0-4171-acbf-2b86793c4b83" containerName="authorino" Jun 12 22:33:06.580830 ip-10-0-128-134 kubenswrapper[2559]: I0612 22:33:06.580809 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-b67c44f87-9dsg4" Jun 12 22:33:06.583674 ip-10-0-128-134 kubenswrapper[2559]: I0612 22:33:06.583652 2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"authorino-oidc-ca\"" Jun 12 22:33:06.588194 ip-10-0-128-134 kubenswrapper[2559]: I0612 22:33:06.588170 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-b67c44f87-9dsg4"] Jun 12 22:33:06.707842 ip-10-0-128-134 kubenswrapper[2559]: I0612 22:33:06.707804 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oidc-ca\" (UniqueName: \"kubernetes.io/configmap/1497e880-9a09-42b8-9047-4bcbeb266bd3-oidc-ca\") pod \"authorino-b67c44f87-9dsg4\" (UID: \"1497e880-9a09-42b8-9047-4bcbeb266bd3\") " pod="kuadrant-system/authorino-b67c44f87-9dsg4" Jun 12 22:33:06.708017 ip-10-0-128-134 kubenswrapper[2559]: I0612 22:33:06.707887 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-68frm\" (UniqueName: \"kubernetes.io/projected/1497e880-9a09-42b8-9047-4bcbeb266bd3-kube-api-access-68frm\") pod \"authorino-b67c44f87-9dsg4\" (UID: \"1497e880-9a09-42b8-9047-4bcbeb266bd3\") " pod="kuadrant-system/authorino-b67c44f87-9dsg4" Jun 12 22:33:06.708017 ip-10-0-128-134 kubenswrapper[2559]: I0612 22:33:06.707913 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/1497e880-9a09-42b8-9047-4bcbeb266bd3-tls-cert\") pod \"authorino-b67c44f87-9dsg4\" (UID: \"1497e880-9a09-42b8-9047-4bcbeb266bd3\") " pod="kuadrant-system/authorino-b67c44f87-9dsg4" Jun 12 22:33:06.808551 ip-10-0-128-134 kubenswrapper[2559]: I0612 22:33:06.808503 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oidc-ca\" (UniqueName: \"kubernetes.io/configmap/1497e880-9a09-42b8-9047-4bcbeb266bd3-oidc-ca\") pod \"authorino-b67c44f87-9dsg4\" (UID: \"1497e880-9a09-42b8-9047-4bcbeb266bd3\") " pod="kuadrant-system/authorino-b67c44f87-9dsg4" Jun 12 22:33:06.808726 ip-10-0-128-134 kubenswrapper[2559]: I0612 22:33:06.808587 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-68frm\" (UniqueName: \"kubernetes.io/projected/1497e880-9a09-42b8-9047-4bcbeb266bd3-kube-api-access-68frm\") pod \"authorino-b67c44f87-9dsg4\" (UID: \"1497e880-9a09-42b8-9047-4bcbeb266bd3\") " pod="kuadrant-system/authorino-b67c44f87-9dsg4" Jun 12 22:33:06.808726 ip-10-0-128-134 kubenswrapper[2559]: I0612 22:33:06.808612 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/1497e880-9a09-42b8-9047-4bcbeb266bd3-tls-cert\") pod \"authorino-b67c44f87-9dsg4\" (UID: \"1497e880-9a09-42b8-9047-4bcbeb266bd3\") " pod="kuadrant-system/authorino-b67c44f87-9dsg4" Jun 12 22:33:06.809216 ip-10-0-128-134 kubenswrapper[2559]: I0612 22:33:06.809196 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"oidc-ca\" (UniqueName: \"kubernetes.io/configmap/1497e880-9a09-42b8-9047-4bcbeb266bd3-oidc-ca\") pod \"authorino-b67c44f87-9dsg4\" (UID: \"1497e880-9a09-42b8-9047-4bcbeb266bd3\") " pod="kuadrant-system/authorino-b67c44f87-9dsg4" Jun 12 22:33:06.811172 ip-10-0-128-134 kubenswrapper[2559]: I0612 22:33:06.811150 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/1497e880-9a09-42b8-9047-4bcbeb266bd3-tls-cert\") pod \"authorino-b67c44f87-9dsg4\" (UID: \"1497e880-9a09-42b8-9047-4bcbeb266bd3\") " pod="kuadrant-system/authorino-b67c44f87-9dsg4" Jun 12 22:33:06.817338 ip-10-0-128-134 kubenswrapper[2559]: I0612 22:33:06.817313 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-68frm\" (UniqueName: \"kubernetes.io/projected/1497e880-9a09-42b8-9047-4bcbeb266bd3-kube-api-access-68frm\") pod \"authorino-b67c44f87-9dsg4\" (UID: \"1497e880-9a09-42b8-9047-4bcbeb266bd3\") " pod="kuadrant-system/authorino-b67c44f87-9dsg4" Jun 12 22:33:06.891003 ip-10-0-128-134 kubenswrapper[2559]: I0612 22:33:06.890908 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-b67c44f87-9dsg4" Jun 12 22:33:07.016766 ip-10-0-128-134 kubenswrapper[2559]: I0612 22:33:07.016738 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-b67c44f87-9dsg4"] Jun 12 22:33:07.018806 ip-10-0-128-134 kubenswrapper[2559]: W0612 22:33:07.018779 2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod1497e880_9a09_42b8_9047_4bcbeb266bd3.slice/crio-341c85e2a64a4d4b1ef526637751b3f4507f0d05a5dbf6b9cf536b13cf8bf4f5 WatchSource:0}: Error finding container 341c85e2a64a4d4b1ef526637751b3f4507f0d05a5dbf6b9cf536b13cf8bf4f5: Status 404 returned error can't find the container with id 341c85e2a64a4d4b1ef526637751b3f4507f0d05a5dbf6b9cf536b13cf8bf4f5 Jun 12 22:33:07.019975 ip-10-0-128-134 kubenswrapper[2559]: I0612 22:33:07.019956 2559 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jun 12 22:33:07.871631 ip-10-0-128-134 kubenswrapper[2559]: I0612 22:33:07.871588 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-b67c44f87-9dsg4" event={"ID":"1497e880-9a09-42b8-9047-4bcbeb266bd3","Type":"ContainerStarted","Data":"4f8f54de27a0ae2527375295a3bd1e5618e529e4b9d63e1e7059ccf0cfeabde1"} Jun 12 22:33:07.871631 ip-10-0-128-134 kubenswrapper[2559]: I0612 22:33:07.871636 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-b67c44f87-9dsg4" event={"ID":"1497e880-9a09-42b8-9047-4bcbeb266bd3","Type":"ContainerStarted","Data":"341c85e2a64a4d4b1ef526637751b3f4507f0d05a5dbf6b9cf536b13cf8bf4f5"} Jun 12 22:33:07.889521 ip-10-0-128-134 kubenswrapper[2559]: I0612 22:33:07.889475 2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/authorino-b67c44f87-9dsg4" podStartSLOduration=1.5198008010000001 podStartE2EDuration="1.889434175s" totalImagesPullingTime="369.633374ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-12 22:33:06 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-12 22:33:07.887800353 +0000 UTC m=+729.936170205" watchObservedRunningTime="2026-06-12 22:33:07.889434175 +0000 UTC m=+729.937803993" Jun 12 22:33:07.916796 ip-10-0-128-134 kubenswrapper[2559]: I0612 22:33:07.916759 2559 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-59dc58b55-4br5g"] Jun 12 22:33:07.916983 ip-10-0-128-134 kubenswrapper[2559]: I0612 22:33:07.916960 2559 kuberuntime_container.go:872] "Killing container with a grace period" pod="kuadrant-system/authorino-59dc58b55-4br5g" podUID="45e69c1f-a34e-4b40-bf18-272dfc23a3cb" containerName="authorino" containerID="cri-o://ff2ea1016cfdabf897a969be512ed8c77b1ab39787608623abacdd1aabfe478d" gracePeriod=30 Jun 12 22:33:08.172509 ip-10-0-128-134 kubenswrapper[2559]: I0612 22:33:08.172484 2559 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-59dc58b55-4br5g" Jun 12 22:33:08.319268 ip-10-0-128-134 kubenswrapper[2559]: I0612 22:33:08.319234 2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/45e69c1f-a34e-4b40-bf18-272dfc23a3cb-tls-cert\") pod \"45e69c1f-a34e-4b40-bf18-272dfc23a3cb\" (UID: \"45e69c1f-a34e-4b40-bf18-272dfc23a3cb\") " Jun 12 22:33:08.319268 ip-10-0-128-134 kubenswrapper[2559]: I0612 22:33:08.319281 2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-xgq5g\" (UniqueName: \"kubernetes.io/projected/45e69c1f-a34e-4b40-bf18-272dfc23a3cb-kube-api-access-xgq5g\") pod \"45e69c1f-a34e-4b40-bf18-272dfc23a3cb\" (UID: \"45e69c1f-a34e-4b40-bf18-272dfc23a3cb\") " Jun 12 22:33:08.321394 ip-10-0-128-134 kubenswrapper[2559]: I0612 22:33:08.321370 2559 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/45e69c1f-a34e-4b40-bf18-272dfc23a3cb-kube-api-access-xgq5g" (OuterVolumeSpecName: "kube-api-access-xgq5g") pod "45e69c1f-a34e-4b40-bf18-272dfc23a3cb" (UID: "45e69c1f-a34e-4b40-bf18-272dfc23a3cb"). InnerVolumeSpecName "kube-api-access-xgq5g". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 12 22:33:08.331334 ip-10-0-128-134 kubenswrapper[2559]: I0612 22:33:08.331307 2559 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/45e69c1f-a34e-4b40-bf18-272dfc23a3cb-tls-cert" (OuterVolumeSpecName: "tls-cert") pod "45e69c1f-a34e-4b40-bf18-272dfc23a3cb" (UID: "45e69c1f-a34e-4b40-bf18-272dfc23a3cb"). InnerVolumeSpecName "tls-cert". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 12 22:33:08.420587 ip-10-0-128-134 kubenswrapper[2559]: I0612 22:33:08.420555 2559 reconciler_common.go:299] "Volume detached for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/45e69c1f-a34e-4b40-bf18-272dfc23a3cb-tls-cert\") on node \"ip-10-0-128-134.ec2.internal\" DevicePath \"\"" Jun 12 22:33:08.420587 ip-10-0-128-134 kubenswrapper[2559]: I0612 22:33:08.420579 2559 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-xgq5g\" (UniqueName: \"kubernetes.io/projected/45e69c1f-a34e-4b40-bf18-272dfc23a3cb-kube-api-access-xgq5g\") on node \"ip-10-0-128-134.ec2.internal\" DevicePath \"\"" Jun 12 22:33:08.553916 ip-10-0-128-134 kubenswrapper[2559]: I0612 22:33:08.553889 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-f7h79_2fe08918-3efc-4000-a321-8b319ead517c/konnectivity-agent/0.log" limit=1024 Jun 12 22:33:08.649726 ip-10-0-128-134 kubenswrapper[2559]: I0612 22:33:08.649691 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-f7h79_2fe08918-3efc-4000-a321-8b319ead517c/konnectivity-agent/0.log" limit=1024 Jun 12 22:33:08.877768 ip-10-0-128-134 kubenswrapper[2559]: I0612 22:33:08.877728 2559 generic.go:356] "Generic (PLEG): container finished" podID="45e69c1f-a34e-4b40-bf18-272dfc23a3cb" containerID="ff2ea1016cfdabf897a969be512ed8c77b1ab39787608623abacdd1aabfe478d" exitCode=0 Jun 12 22:33:08.878169 ip-10-0-128-134 kubenswrapper[2559]: I0612 22:33:08.877789 2559 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-59dc58b55-4br5g" Jun 12 22:33:08.878169 ip-10-0-128-134 kubenswrapper[2559]: I0612 22:33:08.877809 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-59dc58b55-4br5g" event={"ID":"45e69c1f-a34e-4b40-bf18-272dfc23a3cb","Type":"ContainerDied","Data":"ff2ea1016cfdabf897a969be512ed8c77b1ab39787608623abacdd1aabfe478d"} Jun 12 22:33:08.878169 ip-10-0-128-134 kubenswrapper[2559]: I0612 22:33:08.877863 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-59dc58b55-4br5g" event={"ID":"45e69c1f-a34e-4b40-bf18-272dfc23a3cb","Type":"ContainerDied","Data":"16849419eece3d9819daf1400c16977d5a7fad44c0e227173f0e84375e318548"} Jun 12 22:33:08.878169 ip-10-0-128-134 kubenswrapper[2559]: I0612 22:33:08.877893 2559 scope.go:117] "RemoveContainer" containerID="ff2ea1016cfdabf897a969be512ed8c77b1ab39787608623abacdd1aabfe478d" Jun 12 22:33:08.886616 ip-10-0-128-134 kubenswrapper[2559]: I0612 22:33:08.886594 2559 scope.go:117] "RemoveContainer" containerID="ff2ea1016cfdabf897a969be512ed8c77b1ab39787608623abacdd1aabfe478d" Jun 12 22:33:08.886865 ip-10-0-128-134 kubenswrapper[2559]: E0612 22:33:08.886844 2559 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"ff2ea1016cfdabf897a969be512ed8c77b1ab39787608623abacdd1aabfe478d\": container with ID starting with ff2ea1016cfdabf897a969be512ed8c77b1ab39787608623abacdd1aabfe478d not found: ID does not exist" containerID="ff2ea1016cfdabf897a969be512ed8c77b1ab39787608623abacdd1aabfe478d" Jun 12 22:33:08.886915 ip-10-0-128-134 kubenswrapper[2559]: I0612 22:33:08.886876 2559 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"ff2ea1016cfdabf897a969be512ed8c77b1ab39787608623abacdd1aabfe478d"} err="failed to get container status \"ff2ea1016cfdabf897a969be512ed8c77b1ab39787608623abacdd1aabfe478d\": rpc error: code = NotFound desc = could not find container \"ff2ea1016cfdabf897a969be512ed8c77b1ab39787608623abacdd1aabfe478d\": container with ID starting with ff2ea1016cfdabf897a969be512ed8c77b1ab39787608623abacdd1aabfe478d not found: ID does not exist" Jun 12 22:33:08.895575 ip-10-0-128-134 kubenswrapper[2559]: I0612 22:33:08.895551 2559 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-59dc58b55-4br5g"] Jun 12 22:33:08.902073 ip-10-0-128-134 kubenswrapper[2559]: I0612 22:33:08.902053 2559 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/authorino-59dc58b55-4br5g"] Jun 12 22:33:10.413090 ip-10-0-128-134 kubenswrapper[2559]: I0612 22:33:10.413050 2559 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="45e69c1f-a34e-4b40-bf18-272dfc23a3cb" path="/var/lib/kubelet/pods/45e69c1f-a34e-4b40-bf18-272dfc23a3cb/volumes" Jun 12 22:33:24.277880 ip-10-0-128-134 kubenswrapper[2559]: I0612 22:33:24.277841 2559 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/e2e-distinct-2-simulated-kserve-f5c55bdc-7wf72"] Jun 12 22:33:24.278239 ip-10-0-128-134 kubenswrapper[2559]: I0612 22:33:24.278198 2559 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="45e69c1f-a34e-4b40-bf18-272dfc23a3cb" containerName="authorino" Jun 12 22:33:24.278239 ip-10-0-128-134 kubenswrapper[2559]: I0612 22:33:24.278211 2559 state_mem.go:107] "Deleted CPUSet assignment" podUID="45e69c1f-a34e-4b40-bf18-272dfc23a3cb" containerName="authorino" Jun 12 22:33:24.278328 ip-10-0-128-134 kubenswrapper[2559]: I0612 22:33:24.278282 2559 memory_manager.go:368] "RemoveStaleState removing state" podUID="45e69c1f-a34e-4b40-bf18-272dfc23a3cb" containerName="authorino" Jun 12 22:33:24.281476 ip-10-0-128-134 kubenswrapper[2559]: I0612 22:33:24.281454 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-distinct-2-simulated-kserve-f5c55bdc-7wf72" Jun 12 22:33:24.284108 ip-10-0-128-134 kubenswrapper[2559]: I0612 22:33:24.284086 2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"llm\"/\"kube-root-ca.crt\"" Jun 12 22:33:24.285385 ip-10-0-128-134 kubenswrapper[2559]: I0612 22:33:24.285365 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"e2e-distinct-2-simulated-kserve-self-signed-certs\"" Jun 12 22:33:24.285553 ip-10-0-128-134 kubenswrapper[2559]: I0612 22:33:24.285393 2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"llm\"/\"openshift-service-ca.crt\"" Jun 12 22:33:24.285553 ip-10-0-128-134 kubenswrapper[2559]: I0612 22:33:24.285438 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"default-dockercfg-b87rj\"" Jun 12 22:33:24.293783 ip-10-0-128-134 kubenswrapper[2559]: I0612 22:33:24.293758 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-distinct-2-simulated-kserve-f5c55bdc-7wf72"] Jun 12 22:33:24.310921 ip-10-0-128-134 kubenswrapper[2559]: I0612 22:33:24.310898 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-f7h79_2fe08918-3efc-4000-a321-8b319ead517c/konnectivity-agent/0.log" limit=1024 Jun 12 22:33:24.343228 ip-10-0-128-134 kubenswrapper[2559]: I0612 22:33:24.343201 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/cc4305a0-f887-45c5-ad54-7cfca8b5403e-model-cache\") pod \"e2e-distinct-2-simulated-kserve-f5c55bdc-7wf72\" (UID: \"cc4305a0-f887-45c5-ad54-7cfca8b5403e\") " pod="llm/e2e-distinct-2-simulated-kserve-f5c55bdc-7wf72" Jun 12 22:33:24.343331 ip-10-0-128-134 kubenswrapper[2559]: I0612 22:33:24.343234 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/cc4305a0-f887-45c5-ad54-7cfca8b5403e-tls-certs\") pod \"e2e-distinct-2-simulated-kserve-f5c55bdc-7wf72\" (UID: \"cc4305a0-f887-45c5-ad54-7cfca8b5403e\") " pod="llm/e2e-distinct-2-simulated-kserve-f5c55bdc-7wf72" Jun 12 22:33:24.343331 ip-10-0-128-134 kubenswrapper[2559]: I0612 22:33:24.343274 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9cjf6\" (UniqueName: \"kubernetes.io/projected/cc4305a0-f887-45c5-ad54-7cfca8b5403e-kube-api-access-9cjf6\") pod \"e2e-distinct-2-simulated-kserve-f5c55bdc-7wf72\" (UID: \"cc4305a0-f887-45c5-ad54-7cfca8b5403e\") " pod="llm/e2e-distinct-2-simulated-kserve-f5c55bdc-7wf72" Jun 12 22:33:24.343438 ip-10-0-128-134 kubenswrapper[2559]: I0612 22:33:24.343350 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/cc4305a0-f887-45c5-ad54-7cfca8b5403e-home\") pod \"e2e-distinct-2-simulated-kserve-f5c55bdc-7wf72\" (UID: \"cc4305a0-f887-45c5-ad54-7cfca8b5403e\") " pod="llm/e2e-distinct-2-simulated-kserve-f5c55bdc-7wf72" Jun 12 22:33:24.343438 ip-10-0-128-134 kubenswrapper[2559]: I0612 22:33:24.343383 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/cc4305a0-f887-45c5-ad54-7cfca8b5403e-kserve-provision-location\") pod \"e2e-distinct-2-simulated-kserve-f5c55bdc-7wf72\" (UID: \"cc4305a0-f887-45c5-ad54-7cfca8b5403e\") " pod="llm/e2e-distinct-2-simulated-kserve-f5c55bdc-7wf72" Jun 12 22:33:24.343438 ip-10-0-128-134 kubenswrapper[2559]: I0612 22:33:24.343405 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/cc4305a0-f887-45c5-ad54-7cfca8b5403e-dshm\") pod \"e2e-distinct-2-simulated-kserve-f5c55bdc-7wf72\" (UID: \"cc4305a0-f887-45c5-ad54-7cfca8b5403e\") " pod="llm/e2e-distinct-2-simulated-kserve-f5c55bdc-7wf72" Jun 12 22:33:24.443888 ip-10-0-128-134 kubenswrapper[2559]: I0612 22:33:24.443854 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/cc4305a0-f887-45c5-ad54-7cfca8b5403e-home\") pod \"e2e-distinct-2-simulated-kserve-f5c55bdc-7wf72\" (UID: \"cc4305a0-f887-45c5-ad54-7cfca8b5403e\") " pod="llm/e2e-distinct-2-simulated-kserve-f5c55bdc-7wf72" Jun 12 22:33:24.444054 ip-10-0-128-134 kubenswrapper[2559]: I0612 22:33:24.443893 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/cc4305a0-f887-45c5-ad54-7cfca8b5403e-kserve-provision-location\") pod \"e2e-distinct-2-simulated-kserve-f5c55bdc-7wf72\" (UID: \"cc4305a0-f887-45c5-ad54-7cfca8b5403e\") " pod="llm/e2e-distinct-2-simulated-kserve-f5c55bdc-7wf72" Jun 12 22:33:24.444054 ip-10-0-128-134 kubenswrapper[2559]: I0612 22:33:24.444023 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/cc4305a0-f887-45c5-ad54-7cfca8b5403e-dshm\") pod \"e2e-distinct-2-simulated-kserve-f5c55bdc-7wf72\" (UID: \"cc4305a0-f887-45c5-ad54-7cfca8b5403e\") " pod="llm/e2e-distinct-2-simulated-kserve-f5c55bdc-7wf72" Jun 12 22:33:24.444132 ip-10-0-128-134 kubenswrapper[2559]: I0612 22:33:24.444092 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/cc4305a0-f887-45c5-ad54-7cfca8b5403e-model-cache\") pod \"e2e-distinct-2-simulated-kserve-f5c55bdc-7wf72\" (UID: \"cc4305a0-f887-45c5-ad54-7cfca8b5403e\") " pod="llm/e2e-distinct-2-simulated-kserve-f5c55bdc-7wf72" Jun 12 22:33:24.444132 ip-10-0-128-134 kubenswrapper[2559]: I0612 22:33:24.444124 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/cc4305a0-f887-45c5-ad54-7cfca8b5403e-tls-certs\") pod \"e2e-distinct-2-simulated-kserve-f5c55bdc-7wf72\" (UID: \"cc4305a0-f887-45c5-ad54-7cfca8b5403e\") " pod="llm/e2e-distinct-2-simulated-kserve-f5c55bdc-7wf72" Jun 12 22:33:24.444213 ip-10-0-128-134 kubenswrapper[2559]: I0612 22:33:24.444199 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9cjf6\" (UniqueName: \"kubernetes.io/projected/cc4305a0-f887-45c5-ad54-7cfca8b5403e-kube-api-access-9cjf6\") pod \"e2e-distinct-2-simulated-kserve-f5c55bdc-7wf72\" (UID: \"cc4305a0-f887-45c5-ad54-7cfca8b5403e\") " pod="llm/e2e-distinct-2-simulated-kserve-f5c55bdc-7wf72" Jun 12 22:33:24.444297 ip-10-0-128-134 kubenswrapper[2559]: I0612 22:33:24.444277 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/cc4305a0-f887-45c5-ad54-7cfca8b5403e-kserve-provision-location\") pod \"e2e-distinct-2-simulated-kserve-f5c55bdc-7wf72\" (UID: \"cc4305a0-f887-45c5-ad54-7cfca8b5403e\") " pod="llm/e2e-distinct-2-simulated-kserve-f5c55bdc-7wf72" Jun 12 22:33:24.444352 ip-10-0-128-134 kubenswrapper[2559]: I0612 22:33:24.444313 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/cc4305a0-f887-45c5-ad54-7cfca8b5403e-home\") pod \"e2e-distinct-2-simulated-kserve-f5c55bdc-7wf72\" (UID: \"cc4305a0-f887-45c5-ad54-7cfca8b5403e\") " pod="llm/e2e-distinct-2-simulated-kserve-f5c55bdc-7wf72" Jun 12 22:33:24.444423 ip-10-0-128-134 kubenswrapper[2559]: I0612 22:33:24.444407 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/cc4305a0-f887-45c5-ad54-7cfca8b5403e-model-cache\") pod \"e2e-distinct-2-simulated-kserve-f5c55bdc-7wf72\" (UID: \"cc4305a0-f887-45c5-ad54-7cfca8b5403e\") " pod="llm/e2e-distinct-2-simulated-kserve-f5c55bdc-7wf72" Jun 12 22:33:24.446382 ip-10-0-128-134 kubenswrapper[2559]: I0612 22:33:24.446363 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/cc4305a0-f887-45c5-ad54-7cfca8b5403e-dshm\") pod \"e2e-distinct-2-simulated-kserve-f5c55bdc-7wf72\" (UID: \"cc4305a0-f887-45c5-ad54-7cfca8b5403e\") " pod="llm/e2e-distinct-2-simulated-kserve-f5c55bdc-7wf72" Jun 12 22:33:24.446708 ip-10-0-128-134 kubenswrapper[2559]: I0612 22:33:24.446690 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/cc4305a0-f887-45c5-ad54-7cfca8b5403e-tls-certs\") pod \"e2e-distinct-2-simulated-kserve-f5c55bdc-7wf72\" (UID: \"cc4305a0-f887-45c5-ad54-7cfca8b5403e\") " pod="llm/e2e-distinct-2-simulated-kserve-f5c55bdc-7wf72" Jun 12 22:33:24.451868 ip-10-0-128-134 kubenswrapper[2559]: I0612 22:33:24.451847 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-9cjf6\" (UniqueName: \"kubernetes.io/projected/cc4305a0-f887-45c5-ad54-7cfca8b5403e-kube-api-access-9cjf6\") pod \"e2e-distinct-2-simulated-kserve-f5c55bdc-7wf72\" (UID: \"cc4305a0-f887-45c5-ad54-7cfca8b5403e\") " pod="llm/e2e-distinct-2-simulated-kserve-f5c55bdc-7wf72" Jun 12 22:33:24.591595 ip-10-0-128-134 kubenswrapper[2559]: I0612 22:33:24.591551 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-distinct-2-simulated-kserve-f5c55bdc-7wf72" Jun 12 22:33:24.734833 ip-10-0-128-134 kubenswrapper[2559]: I0612 22:33:24.734789 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-distinct-2-simulated-kserve-f5c55bdc-7wf72"] Jun 12 22:33:24.737711 ip-10-0-128-134 kubenswrapper[2559]: W0612 22:33:24.737678 2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podcc4305a0_f887_45c5_ad54_7cfca8b5403e.slice/crio-53b6ee1ede70c059d9a532a116eb1f76eafa8452c6128a877a4d8e7b994b7d90 WatchSource:0}: Error finding container 53b6ee1ede70c059d9a532a116eb1f76eafa8452c6128a877a4d8e7b994b7d90: Status 404 returned error can't find the container with id 53b6ee1ede70c059d9a532a116eb1f76eafa8452c6128a877a4d8e7b994b7d90 Jun 12 22:33:24.959249 ip-10-0-128-134 kubenswrapper[2559]: I0612 22:33:24.959165 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-2-simulated-kserve-f5c55bdc-7wf72" event={"ID":"cc4305a0-f887-45c5-ad54-7cfca8b5403e","Type":"ContainerStarted","Data":"53b6ee1ede70c059d9a532a116eb1f76eafa8452c6128a877a4d8e7b994b7d90"} Jun 12 22:33:28.983130 ip-10-0-128-134 kubenswrapper[2559]: I0612 22:33:28.983088 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-2-simulated-kserve-f5c55bdc-7wf72" event={"ID":"cc4305a0-f887-45c5-ad54-7cfca8b5403e","Type":"ContainerStarted","Data":"4241c6472f2c7cf1f4577cbbf7b6921a1e3a1fc520d60b46389932ac2d5db3be"} Jun 12 22:33:38.388807 ip-10-0-128-134 kubenswrapper[2559]: I0612 22:33:38.388776 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-f7h79_2fe08918-3efc-4000-a321-8b319ead517c/konnectivity-agent/0.log" limit=1024 Jun 12 22:33:58.968195 ip-10-0-128-134 kubenswrapper[2559]: I0612 22:33:58.968163 2559 scope.go:117] "RemoveContainer" containerID="8e3e7c3a65c509bd468abff83d3486faff439684ea361ed24e55695f6fc4643d" Jun 12 22:34:00.479120 ip-10-0-128-134 kubenswrapper[2559]: I0612 22:34:00.479088 2559 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-wsdq2"] Jun 12 22:34:00.484047 ip-10-0-128-134 kubenswrapper[2559]: I0612 22:34:00.484030 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-wsdq2" Jun 12 22:34:00.486846 ip-10-0-128-134 kubenswrapper[2559]: I0612 22:34:00.486825 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"e2e-trlp-test-simulated-kserve-self-signed-certs\"" Jun 12 22:34:00.494919 ip-10-0-128-134 kubenswrapper[2559]: I0612 22:34:00.494892 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-wsdq2"] Jun 12 22:34:00.568320 ip-10-0-128-134 kubenswrapper[2559]: I0612 22:34:00.568287 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/8c810636-cc9d-469b-8650-3c72624f8ae7-home\") pod \"e2e-trlp-test-simulated-kserve-68bb6c58d9-wsdq2\" (UID: \"8c810636-cc9d-469b-8650-3c72624f8ae7\") " pod="llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-wsdq2" Jun 12 22:34:00.568320 ip-10-0-128-134 kubenswrapper[2559]: I0612 22:34:00.568318 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/8c810636-cc9d-469b-8650-3c72624f8ae7-dshm\") pod \"e2e-trlp-test-simulated-kserve-68bb6c58d9-wsdq2\" (UID: \"8c810636-cc9d-469b-8650-3c72624f8ae7\") " pod="llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-wsdq2" Jun 12 22:34:00.568559 ip-10-0-128-134 kubenswrapper[2559]: I0612 22:34:00.568340 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/8c810636-cc9d-469b-8650-3c72624f8ae7-tls-certs\") pod \"e2e-trlp-test-simulated-kserve-68bb6c58d9-wsdq2\" (UID: \"8c810636-cc9d-469b-8650-3c72624f8ae7\") " pod="llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-wsdq2" Jun 12 22:34:00.568559 ip-10-0-128-134 kubenswrapper[2559]: I0612 22:34:00.568437 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/8c810636-cc9d-469b-8650-3c72624f8ae7-model-cache\") pod \"e2e-trlp-test-simulated-kserve-68bb6c58d9-wsdq2\" (UID: \"8c810636-cc9d-469b-8650-3c72624f8ae7\") " pod="llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-wsdq2" Jun 12 22:34:00.568559 ip-10-0-128-134 kubenswrapper[2559]: I0612 22:34:00.568495 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mjcxq\" (UniqueName: \"kubernetes.io/projected/8c810636-cc9d-469b-8650-3c72624f8ae7-kube-api-access-mjcxq\") pod \"e2e-trlp-test-simulated-kserve-68bb6c58d9-wsdq2\" (UID: \"8c810636-cc9d-469b-8650-3c72624f8ae7\") " pod="llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-wsdq2" Jun 12 22:34:00.568559 ip-10-0-128-134 kubenswrapper[2559]: I0612 22:34:00.568553 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/8c810636-cc9d-469b-8650-3c72624f8ae7-kserve-provision-location\") pod \"e2e-trlp-test-simulated-kserve-68bb6c58d9-wsdq2\" (UID: \"8c810636-cc9d-469b-8650-3c72624f8ae7\") " pod="llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-wsdq2" Jun 12 22:34:00.576740 ip-10-0-128-134 kubenswrapper[2559]: I0612 22:34:00.576717 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-f7h79_2fe08918-3efc-4000-a321-8b319ead517c/konnectivity-agent/0.log" limit=1024 Jun 12 22:34:00.669104 ip-10-0-128-134 kubenswrapper[2559]: I0612 22:34:00.669057 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mjcxq\" (UniqueName: \"kubernetes.io/projected/8c810636-cc9d-469b-8650-3c72624f8ae7-kube-api-access-mjcxq\") pod \"e2e-trlp-test-simulated-kserve-68bb6c58d9-wsdq2\" (UID: \"8c810636-cc9d-469b-8650-3c72624f8ae7\") " pod="llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-wsdq2" Jun 12 22:34:00.669309 ip-10-0-128-134 kubenswrapper[2559]: I0612 22:34:00.669124 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/8c810636-cc9d-469b-8650-3c72624f8ae7-kserve-provision-location\") pod \"e2e-trlp-test-simulated-kserve-68bb6c58d9-wsdq2\" (UID: \"8c810636-cc9d-469b-8650-3c72624f8ae7\") " pod="llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-wsdq2" Jun 12 22:34:00.669309 ip-10-0-128-134 kubenswrapper[2559]: I0612 22:34:00.669154 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/8c810636-cc9d-469b-8650-3c72624f8ae7-home\") pod \"e2e-trlp-test-simulated-kserve-68bb6c58d9-wsdq2\" (UID: \"8c810636-cc9d-469b-8650-3c72624f8ae7\") " pod="llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-wsdq2" Jun 12 22:34:00.669309 ip-10-0-128-134 kubenswrapper[2559]: I0612 22:34:00.669172 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/8c810636-cc9d-469b-8650-3c72624f8ae7-dshm\") pod \"e2e-trlp-test-simulated-kserve-68bb6c58d9-wsdq2\" (UID: \"8c810636-cc9d-469b-8650-3c72624f8ae7\") " pod="llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-wsdq2" Jun 12 22:34:00.669309 ip-10-0-128-134 kubenswrapper[2559]: I0612 22:34:00.669198 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/8c810636-cc9d-469b-8650-3c72624f8ae7-tls-certs\") pod \"e2e-trlp-test-simulated-kserve-68bb6c58d9-wsdq2\" (UID: \"8c810636-cc9d-469b-8650-3c72624f8ae7\") " pod="llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-wsdq2" Jun 12 22:34:00.669309 ip-10-0-128-134 kubenswrapper[2559]: I0612 22:34:00.669237 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/8c810636-cc9d-469b-8650-3c72624f8ae7-model-cache\") pod \"e2e-trlp-test-simulated-kserve-68bb6c58d9-wsdq2\" (UID: \"8c810636-cc9d-469b-8650-3c72624f8ae7\") " pod="llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-wsdq2" Jun 12 22:34:00.669633 ip-10-0-128-134 kubenswrapper[2559]: I0612 22:34:00.669608 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/8c810636-cc9d-469b-8650-3c72624f8ae7-home\") pod \"e2e-trlp-test-simulated-kserve-68bb6c58d9-wsdq2\" (UID: \"8c810636-cc9d-469b-8650-3c72624f8ae7\") " pod="llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-wsdq2" Jun 12 22:34:00.669633 ip-10-0-128-134 kubenswrapper[2559]: I0612 22:34:00.669625 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/8c810636-cc9d-469b-8650-3c72624f8ae7-kserve-provision-location\") pod \"e2e-trlp-test-simulated-kserve-68bb6c58d9-wsdq2\" (UID: \"8c810636-cc9d-469b-8650-3c72624f8ae7\") " pod="llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-wsdq2" Jun 12 22:34:00.669724 ip-10-0-128-134 kubenswrapper[2559]: I0612 22:34:00.669662 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/8c810636-cc9d-469b-8650-3c72624f8ae7-model-cache\") pod \"e2e-trlp-test-simulated-kserve-68bb6c58d9-wsdq2\" (UID: \"8c810636-cc9d-469b-8650-3c72624f8ae7\") " pod="llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-wsdq2" Jun 12 22:34:00.671636 ip-10-0-128-134 kubenswrapper[2559]: I0612 22:34:00.671615 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/8c810636-cc9d-469b-8650-3c72624f8ae7-dshm\") pod \"e2e-trlp-test-simulated-kserve-68bb6c58d9-wsdq2\" (UID: \"8c810636-cc9d-469b-8650-3c72624f8ae7\") " pod="llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-wsdq2" Jun 12 22:34:00.671934 ip-10-0-128-134 kubenswrapper[2559]: I0612 22:34:00.671919 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/8c810636-cc9d-469b-8650-3c72624f8ae7-tls-certs\") pod \"e2e-trlp-test-simulated-kserve-68bb6c58d9-wsdq2\" (UID: \"8c810636-cc9d-469b-8650-3c72624f8ae7\") " pod="llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-wsdq2" Jun 12 22:34:00.676651 ip-10-0-128-134 kubenswrapper[2559]: I0612 22:34:00.676634 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-mjcxq\" (UniqueName: \"kubernetes.io/projected/8c810636-cc9d-469b-8650-3c72624f8ae7-kube-api-access-mjcxq\") pod \"e2e-trlp-test-simulated-kserve-68bb6c58d9-wsdq2\" (UID: \"8c810636-cc9d-469b-8650-3c72624f8ae7\") " pod="llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-wsdq2" Jun 12 22:34:00.794956 ip-10-0-128-134 kubenswrapper[2559]: I0612 22:34:00.794915 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-wsdq2" Jun 12 22:34:00.930805 ip-10-0-128-134 kubenswrapper[2559]: I0612 22:34:00.930742 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-wsdq2"] Jun 12 22:34:00.932917 ip-10-0-128-134 kubenswrapper[2559]: W0612 22:34:00.932895 2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8c810636_cc9d_469b_8650_3c72624f8ae7.slice/crio-7aa545fe653369a5a554b088cf225e460af07afb67270b0a1b78339a0da7365b WatchSource:0}: Error finding container 7aa545fe653369a5a554b088cf225e460af07afb67270b0a1b78339a0da7365b: Status 404 returned error can't find the container with id 7aa545fe653369a5a554b088cf225e460af07afb67270b0a1b78339a0da7365b Jun 12 22:34:01.125545 ip-10-0-128-134 kubenswrapper[2559]: I0612 22:34:01.125440 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-wsdq2" event={"ID":"8c810636-cc9d-469b-8650-3c72624f8ae7","Type":"ContainerStarted","Data":"ac083e670e05d5852fd3669791171f41dc679f3e78e3214067fd82f0af7e387c"} Jun 12 22:34:01.125545 ip-10-0-128-134 kubenswrapper[2559]: I0612 22:34:01.125512 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-wsdq2" event={"ID":"8c810636-cc9d-469b-8650-3c72624f8ae7","Type":"ContainerStarted","Data":"7aa545fe653369a5a554b088cf225e460af07afb67270b0a1b78339a0da7365b"} Jun 12 22:34:16.697379 ip-10-0-128-134 kubenswrapper[2559]: I0612 22:34:16.697287 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-f7h79_2fe08918-3efc-4000-a321-8b319ead517c/konnectivity-agent/0.log" limit=1024 Jun 12 22:34:23.777521 ip-10-0-128-134 kubenswrapper[2559]: I0612 22:34:23.777485 2559 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/facebook-opt-125m-simulated-kserve-6f969c879b-sztxp"] Jun 12 22:34:23.786011 ip-10-0-128-134 kubenswrapper[2559]: I0612 22:34:23.785980 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/facebook-opt-125m-simulated-kserve-6f969c879b-sztxp" Jun 12 22:34:23.789129 ip-10-0-128-134 kubenswrapper[2559]: I0612 22:34:23.789097 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"facebook-opt-125m-simulated-kserve-self-signed-certs\"" Jun 12 22:34:23.790519 ip-10-0-128-134 kubenswrapper[2559]: I0612 22:34:23.790489 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/facebook-opt-125m-simulated-kserve-6f969c879b-sztxp"] Jun 12 22:34:23.809373 ip-10-0-128-134 kubenswrapper[2559]: I0612 22:34:23.809348 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-f7h79_2fe08918-3efc-4000-a321-8b319ead517c/konnectivity-agent/0.log" limit=1024 Jun 12 22:34:23.870546 ip-10-0-128-134 kubenswrapper[2559]: I0612 22:34:23.870504 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/8748c3d0-c996-4fb1-8b7f-48e8130b1e3c-home\") pod \"facebook-opt-125m-simulated-kserve-6f969c879b-sztxp\" (UID: \"8748c3d0-c996-4fb1-8b7f-48e8130b1e3c\") " pod="llm/facebook-opt-125m-simulated-kserve-6f969c879b-sztxp" Jun 12 22:34:23.870546 ip-10-0-128-134 kubenswrapper[2559]: I0612 22:34:23.870548 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rb5h5\" (UniqueName: \"kubernetes.io/projected/8748c3d0-c996-4fb1-8b7f-48e8130b1e3c-kube-api-access-rb5h5\") pod \"facebook-opt-125m-simulated-kserve-6f969c879b-sztxp\" (UID: \"8748c3d0-c996-4fb1-8b7f-48e8130b1e3c\") " pod="llm/facebook-opt-125m-simulated-kserve-6f969c879b-sztxp" Jun 12 22:34:23.870770 ip-10-0-128-134 kubenswrapper[2559]: I0612 22:34:23.870636 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/8748c3d0-c996-4fb1-8b7f-48e8130b1e3c-dshm\") pod \"facebook-opt-125m-simulated-kserve-6f969c879b-sztxp\" (UID: \"8748c3d0-c996-4fb1-8b7f-48e8130b1e3c\") " pod="llm/facebook-opt-125m-simulated-kserve-6f969c879b-sztxp" Jun 12 22:34:23.870770 ip-10-0-128-134 kubenswrapper[2559]: I0612 22:34:23.870663 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/8748c3d0-c996-4fb1-8b7f-48e8130b1e3c-kserve-provision-location\") pod \"facebook-opt-125m-simulated-kserve-6f969c879b-sztxp\" (UID: \"8748c3d0-c996-4fb1-8b7f-48e8130b1e3c\") " pod="llm/facebook-opt-125m-simulated-kserve-6f969c879b-sztxp" Jun 12 22:34:23.870770 ip-10-0-128-134 kubenswrapper[2559]: I0612 22:34:23.870683 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/8748c3d0-c996-4fb1-8b7f-48e8130b1e3c-model-cache\") pod \"facebook-opt-125m-simulated-kserve-6f969c879b-sztxp\" (UID: \"8748c3d0-c996-4fb1-8b7f-48e8130b1e3c\") " pod="llm/facebook-opt-125m-simulated-kserve-6f969c879b-sztxp" Jun 12 22:34:23.870770 ip-10-0-128-134 kubenswrapper[2559]: I0612 22:34:23.870702 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/8748c3d0-c996-4fb1-8b7f-48e8130b1e3c-tls-certs\") pod \"facebook-opt-125m-simulated-kserve-6f969c879b-sztxp\" (UID: \"8748c3d0-c996-4fb1-8b7f-48e8130b1e3c\") " pod="llm/facebook-opt-125m-simulated-kserve-6f969c879b-sztxp" Jun 12 22:34:23.971892 ip-10-0-128-134 kubenswrapper[2559]: I0612 22:34:23.971857 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/8748c3d0-c996-4fb1-8b7f-48e8130b1e3c-home\") pod \"facebook-opt-125m-simulated-kserve-6f969c879b-sztxp\" (UID: \"8748c3d0-c996-4fb1-8b7f-48e8130b1e3c\") " pod="llm/facebook-opt-125m-simulated-kserve-6f969c879b-sztxp" Jun 12 22:34:23.971892 ip-10-0-128-134 kubenswrapper[2559]: I0612 22:34:23.971894 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rb5h5\" (UniqueName: \"kubernetes.io/projected/8748c3d0-c996-4fb1-8b7f-48e8130b1e3c-kube-api-access-rb5h5\") pod \"facebook-opt-125m-simulated-kserve-6f969c879b-sztxp\" (UID: \"8748c3d0-c996-4fb1-8b7f-48e8130b1e3c\") " pod="llm/facebook-opt-125m-simulated-kserve-6f969c879b-sztxp" Jun 12 22:34:23.972141 ip-10-0-128-134 kubenswrapper[2559]: I0612 22:34:23.971932 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/8748c3d0-c996-4fb1-8b7f-48e8130b1e3c-dshm\") pod \"facebook-opt-125m-simulated-kserve-6f969c879b-sztxp\" (UID: \"8748c3d0-c996-4fb1-8b7f-48e8130b1e3c\") " pod="llm/facebook-opt-125m-simulated-kserve-6f969c879b-sztxp" Jun 12 22:34:23.972141 ip-10-0-128-134 kubenswrapper[2559]: I0612 22:34:23.971956 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/8748c3d0-c996-4fb1-8b7f-48e8130b1e3c-kserve-provision-location\") pod \"facebook-opt-125m-simulated-kserve-6f969c879b-sztxp\" (UID: \"8748c3d0-c996-4fb1-8b7f-48e8130b1e3c\") " pod="llm/facebook-opt-125m-simulated-kserve-6f969c879b-sztxp" Jun 12 22:34:23.972141 ip-10-0-128-134 kubenswrapper[2559]: I0612 22:34:23.972070 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/8748c3d0-c996-4fb1-8b7f-48e8130b1e3c-model-cache\") pod \"facebook-opt-125m-simulated-kserve-6f969c879b-sztxp\" (UID: \"8748c3d0-c996-4fb1-8b7f-48e8130b1e3c\") " pod="llm/facebook-opt-125m-simulated-kserve-6f969c879b-sztxp" Jun 12 22:34:23.972141 ip-10-0-128-134 kubenswrapper[2559]: I0612 22:34:23.972104 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/8748c3d0-c996-4fb1-8b7f-48e8130b1e3c-tls-certs\") pod \"facebook-opt-125m-simulated-kserve-6f969c879b-sztxp\" (UID: \"8748c3d0-c996-4fb1-8b7f-48e8130b1e3c\") " pod="llm/facebook-opt-125m-simulated-kserve-6f969c879b-sztxp" Jun 12 22:34:23.972358 ip-10-0-128-134 kubenswrapper[2559]: I0612 22:34:23.972322 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/8748c3d0-c996-4fb1-8b7f-48e8130b1e3c-home\") pod \"facebook-opt-125m-simulated-kserve-6f969c879b-sztxp\" (UID: \"8748c3d0-c996-4fb1-8b7f-48e8130b1e3c\") " pod="llm/facebook-opt-125m-simulated-kserve-6f969c879b-sztxp" Jun 12 22:34:23.972427 ip-10-0-128-134 kubenswrapper[2559]: I0612 22:34:23.972365 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/8748c3d0-c996-4fb1-8b7f-48e8130b1e3c-kserve-provision-location\") pod \"facebook-opt-125m-simulated-kserve-6f969c879b-sztxp\" (UID: \"8748c3d0-c996-4fb1-8b7f-48e8130b1e3c\") " pod="llm/facebook-opt-125m-simulated-kserve-6f969c879b-sztxp" Jun 12 22:34:23.972515 ip-10-0-128-134 kubenswrapper[2559]: I0612 22:34:23.972481 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/8748c3d0-c996-4fb1-8b7f-48e8130b1e3c-model-cache\") pod \"facebook-opt-125m-simulated-kserve-6f969c879b-sztxp\" (UID: \"8748c3d0-c996-4fb1-8b7f-48e8130b1e3c\") " pod="llm/facebook-opt-125m-simulated-kserve-6f969c879b-sztxp" Jun 12 22:34:23.974462 ip-10-0-128-134 kubenswrapper[2559]: I0612 22:34:23.974422 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/8748c3d0-c996-4fb1-8b7f-48e8130b1e3c-dshm\") pod \"facebook-opt-125m-simulated-kserve-6f969c879b-sztxp\" (UID: \"8748c3d0-c996-4fb1-8b7f-48e8130b1e3c\") " pod="llm/facebook-opt-125m-simulated-kserve-6f969c879b-sztxp" Jun 12 22:34:23.974647 ip-10-0-128-134 kubenswrapper[2559]: I0612 22:34:23.974632 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/8748c3d0-c996-4fb1-8b7f-48e8130b1e3c-tls-certs\") pod \"facebook-opt-125m-simulated-kserve-6f969c879b-sztxp\" (UID: \"8748c3d0-c996-4fb1-8b7f-48e8130b1e3c\") " pod="llm/facebook-opt-125m-simulated-kserve-6f969c879b-sztxp" Jun 12 22:34:23.980279 ip-10-0-128-134 kubenswrapper[2559]: I0612 22:34:23.980258 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-rb5h5\" (UniqueName: \"kubernetes.io/projected/8748c3d0-c996-4fb1-8b7f-48e8130b1e3c-kube-api-access-rb5h5\") pod \"facebook-opt-125m-simulated-kserve-6f969c879b-sztxp\" (UID: \"8748c3d0-c996-4fb1-8b7f-48e8130b1e3c\") " pod="llm/facebook-opt-125m-simulated-kserve-6f969c879b-sztxp" Jun 12 22:34:24.098905 ip-10-0-128-134 kubenswrapper[2559]: I0612 22:34:24.098872 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/facebook-opt-125m-simulated-kserve-6f969c879b-sztxp" Jun 12 22:34:24.231143 ip-10-0-128-134 kubenswrapper[2559]: I0612 22:34:24.231120 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/facebook-opt-125m-simulated-kserve-6f969c879b-sztxp"] Jun 12 22:34:24.237180 ip-10-0-128-134 kubenswrapper[2559]: W0612 22:34:24.236933 2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8748c3d0_c996_4fb1_8b7f_48e8130b1e3c.slice/crio-13e9cbc4190e085c239cacb1d6200842a1710d68e91c4577166e12a2bf6233c4 WatchSource:0}: Error finding container 13e9cbc4190e085c239cacb1d6200842a1710d68e91c4577166e12a2bf6233c4: Status 404 returned error can't find the container with id 13e9cbc4190e085c239cacb1d6200842a1710d68e91c4577166e12a2bf6233c4 Jun 12 22:34:25.236080 ip-10-0-128-134 kubenswrapper[2559]: I0612 22:34:25.236042 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/facebook-opt-125m-simulated-kserve-6f969c879b-sztxp" event={"ID":"8748c3d0-c996-4fb1-8b7f-48e8130b1e3c","Type":"ContainerStarted","Data":"2e8312b0aa0ad31b9ebaf12f7e144e657fb68f402acdd8d7b31e60cb329cf8c7"} Jun 12 22:34:25.236487 ip-10-0-128-134 kubenswrapper[2559]: I0612 22:34:25.236097 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/facebook-opt-125m-simulated-kserve-6f969c879b-sztxp" event={"ID":"8748c3d0-c996-4fb1-8b7f-48e8130b1e3c","Type":"ContainerStarted","Data":"13e9cbc4190e085c239cacb1d6200842a1710d68e91c4577166e12a2bf6233c4"} Jun 12 22:34:26.241843 ip-10-0-128-134 kubenswrapper[2559]: I0612 22:34:26.241751 2559 generic.go:356] "Generic (PLEG): container finished" podID="8748c3d0-c996-4fb1-8b7f-48e8130b1e3c" containerID="2e8312b0aa0ad31b9ebaf12f7e144e657fb68f402acdd8d7b31e60cb329cf8c7" exitCode=0 Jun 12 22:34:26.242189 ip-10-0-128-134 kubenswrapper[2559]: I0612 22:34:26.241840 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/facebook-opt-125m-simulated-kserve-6f969c879b-sztxp" event={"ID":"8748c3d0-c996-4fb1-8b7f-48e8130b1e3c","Type":"ContainerDied","Data":"2e8312b0aa0ad31b9ebaf12f7e144e657fb68f402acdd8d7b31e60cb329cf8c7"} Jun 12 22:34:28.252374 ip-10-0-128-134 kubenswrapper[2559]: I0612 22:34:28.252335 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/facebook-opt-125m-simulated-kserve-6f969c879b-sztxp" event={"ID":"8748c3d0-c996-4fb1-8b7f-48e8130b1e3c","Type":"ContainerStarted","Data":"263b144d17cc04f5a13e28e03361d64c37ec240be28f7d2c513026995901f5c2"} Jun 12 22:34:28.270937 ip-10-0-128-134 kubenswrapper[2559]: I0612 22:34:28.270883 2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/facebook-opt-125m-simulated-kserve-6f969c879b-sztxp" podStartSLOduration=2.726497873 podStartE2EDuration="5.270865751s" totalImagesPullingTime="1.023218828s" totalInitContainerRuntime="1.52114905s" isStatefulPod=false podCreationTimestamp="2026-06-12 22:34:23 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-12 22:34:28.270662522 +0000 UTC m=+810.319032339" watchObservedRunningTime="2026-06-12 22:34:28.270865751 +0000 UTC m=+810.319235568" Jun 12 22:34:34.099571 ip-10-0-128-134 kubenswrapper[2559]: I0612 22:34:34.099531 2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/facebook-opt-125m-simulated-kserve-6f969c879b-sztxp" Jun 12 22:34:34.100044 ip-10-0-128-134 kubenswrapper[2559]: I0612 22:34:34.099625 2559 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/facebook-opt-125m-simulated-kserve-6f969c879b-sztxp" Jun 12 22:34:34.111830 ip-10-0-128-134 kubenswrapper[2559]: I0612 22:34:34.111804 2559 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/facebook-opt-125m-simulated-kserve-6f969c879b-sztxp" Jun 12 22:34:34.290708 ip-10-0-128-134 kubenswrapper[2559]: I0612 22:34:34.290676 2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/facebook-opt-125m-simulated-kserve-6f969c879b-sztxp" Jun 12 22:34:42.122595 ip-10-0-128-134 kubenswrapper[2559]: I0612 22:34:42.122558 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-f7h79_2fe08918-3efc-4000-a321-8b319ead517c/konnectivity-agent/0.log" limit=1024 Jun 12 22:34:54.372640 ip-10-0-128-134 kubenswrapper[2559]: I0612 22:34:54.372605 2559 generic.go:356] "Generic (PLEG): container finished" podID="8c810636-cc9d-469b-8650-3c72624f8ae7" containerID="ac083e670e05d5852fd3669791171f41dc679f3e78e3214067fd82f0af7e387c" exitCode=0 Jun 12 22:34:54.373071 ip-10-0-128-134 kubenswrapper[2559]: I0612 22:34:54.372660 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-wsdq2" event={"ID":"8c810636-cc9d-469b-8650-3c72624f8ae7","Type":"ContainerDied","Data":"ac083e670e05d5852fd3669791171f41dc679f3e78e3214067fd82f0af7e387c"} Jun 12 22:34:55.379194 ip-10-0-128-134 kubenswrapper[2559]: I0612 22:34:55.379158 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-wsdq2" event={"ID":"8c810636-cc9d-469b-8650-3c72624f8ae7","Type":"ContainerStarted","Data":"2df72d6dec3657ad5a886fd8f8f2f68da793409a91915bd8aa8b9ccf73e9377d"} Jun 12 22:34:55.401034 ip-10-0-128-134 kubenswrapper[2559]: I0612 22:34:55.400979 2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-wsdq2" podStartSLOduration=2.453912129 podStartE2EDuration="55.40096274s" totalImagesPullingTime="201.316273ms" totalInitContainerRuntime="52.745734338s" isStatefulPod=false podCreationTimestamp="2026-06-12 22:34:00 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-12 22:34:55.399024775 +0000 UTC m=+837.447394616" watchObservedRunningTime="2026-06-12 22:34:55.40096274 +0000 UTC m=+837.449332556" Jun 12 22:35:00.795319 ip-10-0-128-134 kubenswrapper[2559]: I0612 22:35:00.795276 2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-wsdq2" Jun 12 22:35:00.795845 ip-10-0-128-134 kubenswrapper[2559]: I0612 22:35:00.795349 2559 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-wsdq2" Jun 12 22:35:00.807816 ip-10-0-128-134 kubenswrapper[2559]: I0612 22:35:00.807791 2559 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-wsdq2" Jun 12 22:35:01.418751 ip-10-0-128-134 kubenswrapper[2559]: I0612 22:35:01.418719 2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-wsdq2" Jun 12 22:35:58.421924 ip-10-0-128-134 kubenswrapper[2559]: I0612 22:35:58.421896 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-9qn4j_f6ddad48-94e1-479b-951c-ebf6be358f2c/ovn-acl-logging/0.log" Jun 12 22:35:58.423264 ip-10-0-128-134 kubenswrapper[2559]: I0612 22:35:58.423238 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-9qn4j_f6ddad48-94e1-479b-951c-ebf6be358f2c/ovn-acl-logging/0.log" Jun 12 22:36:11.580790 ip-10-0-128-134 kubenswrapper[2559]: I0612 22:36:11.580749 2559 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-6877d8d55d-gjm9r"] Jun 12 22:36:11.584000 ip-10-0-128-134 kubenswrapper[2559]: I0612 22:36:11.583982 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-6877d8d55d-gjm9r" Jun 12 22:36:11.591898 ip-10-0-128-134 kubenswrapper[2559]: I0612 22:36:11.591860 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-6877d8d55d-gjm9r"] Jun 12 22:36:11.719668 ip-10-0-128-134 kubenswrapper[2559]: I0612 22:36:11.719631 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-k8kbl\" (UniqueName: \"kubernetes.io/projected/6908f292-a5a4-4207-bdb5-4b7c30ade76d-kube-api-access-k8kbl\") pod \"authorino-6877d8d55d-gjm9r\" (UID: \"6908f292-a5a4-4207-bdb5-4b7c30ade76d\") " pod="kuadrant-system/authorino-6877d8d55d-gjm9r" Jun 12 22:36:11.719833 ip-10-0-128-134 kubenswrapper[2559]: I0612 22:36:11.719686 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/6908f292-a5a4-4207-bdb5-4b7c30ade76d-tls-cert\") pod \"authorino-6877d8d55d-gjm9r\" (UID: \"6908f292-a5a4-4207-bdb5-4b7c30ade76d\") " pod="kuadrant-system/authorino-6877d8d55d-gjm9r" Jun 12 22:36:11.719833 ip-10-0-128-134 kubenswrapper[2559]: I0612 22:36:11.719703 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oidc-ca\" (UniqueName: \"kubernetes.io/configmap/6908f292-a5a4-4207-bdb5-4b7c30ade76d-oidc-ca\") pod \"authorino-6877d8d55d-gjm9r\" (UID: \"6908f292-a5a4-4207-bdb5-4b7c30ade76d\") " pod="kuadrant-system/authorino-6877d8d55d-gjm9r" Jun 12 22:36:11.820344 ip-10-0-128-134 kubenswrapper[2559]: I0612 22:36:11.820308 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oidc-ca\" (UniqueName: \"kubernetes.io/configmap/6908f292-a5a4-4207-bdb5-4b7c30ade76d-oidc-ca\") pod \"authorino-6877d8d55d-gjm9r\" (UID: \"6908f292-a5a4-4207-bdb5-4b7c30ade76d\") " pod="kuadrant-system/authorino-6877d8d55d-gjm9r" Jun 12 22:36:11.820567 ip-10-0-128-134 kubenswrapper[2559]: I0612 22:36:11.820404 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-k8kbl\" (UniqueName: \"kubernetes.io/projected/6908f292-a5a4-4207-bdb5-4b7c30ade76d-kube-api-access-k8kbl\") pod \"authorino-6877d8d55d-gjm9r\" (UID: \"6908f292-a5a4-4207-bdb5-4b7c30ade76d\") " pod="kuadrant-system/authorino-6877d8d55d-gjm9r" Jun 12 22:36:11.820567 ip-10-0-128-134 kubenswrapper[2559]: I0612 22:36:11.820440 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/6908f292-a5a4-4207-bdb5-4b7c30ade76d-tls-cert\") pod \"authorino-6877d8d55d-gjm9r\" (UID: \"6908f292-a5a4-4207-bdb5-4b7c30ade76d\") " pod="kuadrant-system/authorino-6877d8d55d-gjm9r" Jun 12 22:36:11.821050 ip-10-0-128-134 kubenswrapper[2559]: I0612 22:36:11.821025 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"oidc-ca\" (UniqueName: \"kubernetes.io/configmap/6908f292-a5a4-4207-bdb5-4b7c30ade76d-oidc-ca\") pod \"authorino-6877d8d55d-gjm9r\" (UID: \"6908f292-a5a4-4207-bdb5-4b7c30ade76d\") " pod="kuadrant-system/authorino-6877d8d55d-gjm9r" Jun 12 22:36:11.822936 ip-10-0-128-134 kubenswrapper[2559]: I0612 22:36:11.822915 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/6908f292-a5a4-4207-bdb5-4b7c30ade76d-tls-cert\") pod \"authorino-6877d8d55d-gjm9r\" (UID: \"6908f292-a5a4-4207-bdb5-4b7c30ade76d\") " pod="kuadrant-system/authorino-6877d8d55d-gjm9r" Jun 12 22:36:11.828792 ip-10-0-128-134 kubenswrapper[2559]: I0612 22:36:11.828769 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-k8kbl\" (UniqueName: \"kubernetes.io/projected/6908f292-a5a4-4207-bdb5-4b7c30ade76d-kube-api-access-k8kbl\") pod \"authorino-6877d8d55d-gjm9r\" (UID: \"6908f292-a5a4-4207-bdb5-4b7c30ade76d\") " pod="kuadrant-system/authorino-6877d8d55d-gjm9r" Jun 12 22:36:11.894432 ip-10-0-128-134 kubenswrapper[2559]: I0612 22:36:11.894356 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-6877d8d55d-gjm9r" Jun 12 22:36:12.029110 ip-10-0-128-134 kubenswrapper[2559]: I0612 22:36:12.029086 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-6877d8d55d-gjm9r"] Jun 12 22:36:12.031178 ip-10-0-128-134 kubenswrapper[2559]: W0612 22:36:12.031144 2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod6908f292_a5a4_4207_bdb5_4b7c30ade76d.slice/crio-1071ad4938efec007594d6cf3cf271fe5347d7784027d756fd7237ee7ef43c8c WatchSource:0}: Error finding container 1071ad4938efec007594d6cf3cf271fe5347d7784027d756fd7237ee7ef43c8c: Status 404 returned error can't find the container with id 1071ad4938efec007594d6cf3cf271fe5347d7784027d756fd7237ee7ef43c8c Jun 12 22:36:12.093940 ip-10-0-128-134 kubenswrapper[2559]: I0612 22:36:12.093911 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-f7h79_2fe08918-3efc-4000-a321-8b319ead517c/konnectivity-agent/0.log" limit=1024 Jun 12 22:36:12.190362 ip-10-0-128-134 kubenswrapper[2559]: I0612 22:36:12.190271 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-f7h79_2fe08918-3efc-4000-a321-8b319ead517c/konnectivity-agent/0.log" limit=1024 Jun 12 22:36:12.747544 ip-10-0-128-134 kubenswrapper[2559]: I0612 22:36:12.747427 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-6877d8d55d-gjm9r" event={"ID":"6908f292-a5a4-4207-bdb5-4b7c30ade76d","Type":"ContainerStarted","Data":"2afa4b8b9e80cc15f7360c982a7962449b54df0e54d18f16e33eb7c525184dd7"} Jun 12 22:36:12.747544 ip-10-0-128-134 kubenswrapper[2559]: I0612 22:36:12.747504 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-6877d8d55d-gjm9r" event={"ID":"6908f292-a5a4-4207-bdb5-4b7c30ade76d","Type":"ContainerStarted","Data":"1071ad4938efec007594d6cf3cf271fe5347d7784027d756fd7237ee7ef43c8c"} Jun 12 22:36:12.774313 ip-10-0-128-134 kubenswrapper[2559]: I0612 22:36:12.774252 2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/authorino-6877d8d55d-gjm9r" podStartSLOduration=1.415537391 podStartE2EDuration="1.774229305s" totalImagesPullingTime="358.691914ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-12 22:36:11 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-12 22:36:12.771604649 +0000 UTC m=+914.819974478" watchObservedRunningTime="2026-06-12 22:36:12.774229305 +0000 UTC m=+914.822599136" Jun 12 22:36:12.819731 ip-10-0-128-134 kubenswrapper[2559]: I0612 22:36:12.819694 2559 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-b67c44f87-9dsg4"] Jun 12 22:36:12.820198 ip-10-0-128-134 kubenswrapper[2559]: I0612 22:36:12.820165 2559 kuberuntime_container.go:872] "Killing container with a grace period" pod="kuadrant-system/authorino-b67c44f87-9dsg4" podUID="1497e880-9a09-42b8-9047-4bcbeb266bd3" containerName="authorino" containerID="cri-o://4f8f54de27a0ae2527375295a3bd1e5618e529e4b9d63e1e7059ccf0cfeabde1" gracePeriod=30 Jun 12 22:36:13.089001 ip-10-0-128-134 kubenswrapper[2559]: I0612 22:36:13.088964 2559 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-b67c44f87-9dsg4" Jun 12 22:36:13.211125 ip-10-0-128-134 kubenswrapper[2559]: I0612 22:36:13.211077 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-f7h79_2fe08918-3efc-4000-a321-8b319ead517c/konnectivity-agent/0.log" limit=1024 Jun 12 22:36:13.234249 ip-10-0-128-134 kubenswrapper[2559]: I0612 22:36:13.234214 2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/1497e880-9a09-42b8-9047-4bcbeb266bd3-tls-cert\") pod \"1497e880-9a09-42b8-9047-4bcbeb266bd3\" (UID: \"1497e880-9a09-42b8-9047-4bcbeb266bd3\") " Jun 12 22:36:13.234412 ip-10-0-128-134 kubenswrapper[2559]: I0612 22:36:13.234363 2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"oidc-ca\" (UniqueName: \"kubernetes.io/configmap/1497e880-9a09-42b8-9047-4bcbeb266bd3-oidc-ca\") pod \"1497e880-9a09-42b8-9047-4bcbeb266bd3\" (UID: \"1497e880-9a09-42b8-9047-4bcbeb266bd3\") " Jun 12 22:36:13.234480 ip-10-0-128-134 kubenswrapper[2559]: I0612 22:36:13.234409 2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-68frm\" (UniqueName: \"kubernetes.io/projected/1497e880-9a09-42b8-9047-4bcbeb266bd3-kube-api-access-68frm\") pod \"1497e880-9a09-42b8-9047-4bcbeb266bd3\" (UID: \"1497e880-9a09-42b8-9047-4bcbeb266bd3\") " Jun 12 22:36:13.236487 ip-10-0-128-134 kubenswrapper[2559]: I0612 22:36:13.236425 2559 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/1497e880-9a09-42b8-9047-4bcbeb266bd3-kube-api-access-68frm" (OuterVolumeSpecName: "kube-api-access-68frm") pod "1497e880-9a09-42b8-9047-4bcbeb266bd3" (UID: "1497e880-9a09-42b8-9047-4bcbeb266bd3"). InnerVolumeSpecName "kube-api-access-68frm". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 12 22:36:13.240839 ip-10-0-128-134 kubenswrapper[2559]: I0612 22:36:13.240810 2559 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/1497e880-9a09-42b8-9047-4bcbeb266bd3-oidc-ca" (OuterVolumeSpecName: "oidc-ca") pod "1497e880-9a09-42b8-9047-4bcbeb266bd3" (UID: "1497e880-9a09-42b8-9047-4bcbeb266bd3"). InnerVolumeSpecName "oidc-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 12 22:36:13.245765 ip-10-0-128-134 kubenswrapper[2559]: I0612 22:36:13.245731 2559 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/1497e880-9a09-42b8-9047-4bcbeb266bd3-tls-cert" (OuterVolumeSpecName: "tls-cert") pod "1497e880-9a09-42b8-9047-4bcbeb266bd3" (UID: "1497e880-9a09-42b8-9047-4bcbeb266bd3"). InnerVolumeSpecName "tls-cert". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 12 22:36:13.302855 ip-10-0-128-134 kubenswrapper[2559]: I0612 22:36:13.302816 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-f7h79_2fe08918-3efc-4000-a321-8b319ead517c/konnectivity-agent/0.log" limit=1024 Jun 12 22:36:13.335543 ip-10-0-128-134 kubenswrapper[2559]: I0612 22:36:13.335499 2559 reconciler_common.go:299] "Volume detached for volume \"oidc-ca\" (UniqueName: \"kubernetes.io/configmap/1497e880-9a09-42b8-9047-4bcbeb266bd3-oidc-ca\") on node \"ip-10-0-128-134.ec2.internal\" DevicePath \"\"" Jun 12 22:36:13.335701 ip-10-0-128-134 kubenswrapper[2559]: I0612 22:36:13.335550 2559 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-68frm\" (UniqueName: \"kubernetes.io/projected/1497e880-9a09-42b8-9047-4bcbeb266bd3-kube-api-access-68frm\") on node \"ip-10-0-128-134.ec2.internal\" DevicePath \"\"" Jun 12 22:36:13.335701 ip-10-0-128-134 kubenswrapper[2559]: I0612 22:36:13.335568 2559 reconciler_common.go:299] "Volume detached for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/1497e880-9a09-42b8-9047-4bcbeb266bd3-tls-cert\") on node \"ip-10-0-128-134.ec2.internal\" DevicePath \"\"" Jun 12 22:36:13.753826 ip-10-0-128-134 kubenswrapper[2559]: I0612 22:36:13.753743 2559 generic.go:356] "Generic (PLEG): container finished" podID="1497e880-9a09-42b8-9047-4bcbeb266bd3" containerID="4f8f54de27a0ae2527375295a3bd1e5618e529e4b9d63e1e7059ccf0cfeabde1" exitCode=0 Jun 12 22:36:13.753826 ip-10-0-128-134 kubenswrapper[2559]: I0612 22:36:13.753785 2559 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-b67c44f87-9dsg4" Jun 12 22:36:13.754406 ip-10-0-128-134 kubenswrapper[2559]: I0612 22:36:13.753841 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-b67c44f87-9dsg4" event={"ID":"1497e880-9a09-42b8-9047-4bcbeb266bd3","Type":"ContainerDied","Data":"4f8f54de27a0ae2527375295a3bd1e5618e529e4b9d63e1e7059ccf0cfeabde1"} Jun 12 22:36:13.754406 ip-10-0-128-134 kubenswrapper[2559]: I0612 22:36:13.753887 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-b67c44f87-9dsg4" event={"ID":"1497e880-9a09-42b8-9047-4bcbeb266bd3","Type":"ContainerDied","Data":"341c85e2a64a4d4b1ef526637751b3f4507f0d05a5dbf6b9cf536b13cf8bf4f5"} Jun 12 22:36:13.754406 ip-10-0-128-134 kubenswrapper[2559]: I0612 22:36:13.753911 2559 scope.go:117] "RemoveContainer" containerID="4f8f54de27a0ae2527375295a3bd1e5618e529e4b9d63e1e7059ccf0cfeabde1" Jun 12 22:36:13.762958 ip-10-0-128-134 kubenswrapper[2559]: I0612 22:36:13.762940 2559 scope.go:117] "RemoveContainer" containerID="4f8f54de27a0ae2527375295a3bd1e5618e529e4b9d63e1e7059ccf0cfeabde1" Jun 12 22:36:13.763225 ip-10-0-128-134 kubenswrapper[2559]: E0612 22:36:13.763205 2559 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"4f8f54de27a0ae2527375295a3bd1e5618e529e4b9d63e1e7059ccf0cfeabde1\": container with ID starting with 4f8f54de27a0ae2527375295a3bd1e5618e529e4b9d63e1e7059ccf0cfeabde1 not found: ID does not exist" containerID="4f8f54de27a0ae2527375295a3bd1e5618e529e4b9d63e1e7059ccf0cfeabde1" Jun 12 22:36:13.763272 ip-10-0-128-134 kubenswrapper[2559]: I0612 22:36:13.763234 2559 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"4f8f54de27a0ae2527375295a3bd1e5618e529e4b9d63e1e7059ccf0cfeabde1"} err="failed to get container status \"4f8f54de27a0ae2527375295a3bd1e5618e529e4b9d63e1e7059ccf0cfeabde1\": rpc error: code = NotFound desc = could not find container \"4f8f54de27a0ae2527375295a3bd1e5618e529e4b9d63e1e7059ccf0cfeabde1\": container with ID starting with 4f8f54de27a0ae2527375295a3bd1e5618e529e4b9d63e1e7059ccf0cfeabde1 not found: ID does not exist" Jun 12 22:36:13.778813 ip-10-0-128-134 kubenswrapper[2559]: I0612 22:36:13.778784 2559 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-b67c44f87-9dsg4"] Jun 12 22:36:13.781137 ip-10-0-128-134 kubenswrapper[2559]: I0612 22:36:13.781115 2559 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/authorino-b67c44f87-9dsg4"] Jun 12 22:36:14.410888 ip-10-0-128-134 kubenswrapper[2559]: I0612 22:36:14.410857 2559 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="1497e880-9a09-42b8-9047-4bcbeb266bd3" path="/var/lib/kubelet/pods/1497e880-9a09-42b8-9047-4bcbeb266bd3/volumes" Jun 12 22:36:24.306647 ip-10-0-128-134 kubenswrapper[2559]: I0612 22:36:24.306610 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-f7h79_2fe08918-3efc-4000-a321-8b319ead517c/konnectivity-agent/0.log" limit=1024 Jun 12 22:37:39.560167 ip-10-0-128-134 kubenswrapper[2559]: I0612 22:37:39.560079 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-f7h79_2fe08918-3efc-4000-a321-8b319ead517c/konnectivity-agent/0.log" limit=1024 Jun 12 22:37:41.601426 ip-10-0-128-134 kubenswrapper[2559]: I0612 22:37:41.601370 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-f7h79_2fe08918-3efc-4000-a321-8b319ead517c/konnectivity-agent/0.log" limit=1024 Jun 12 22:38:21.523081 ip-10-0-128-134 kubenswrapper[2559]: I0612 22:38:21.523046 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-f7h79_2fe08918-3efc-4000-a321-8b319ead517c/konnectivity-agent/0.log" limit=1024 Jun 12 22:38:21.620609 ip-10-0-128-134 kubenswrapper[2559]: I0612 22:38:21.620571 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-f7h79_2fe08918-3efc-4000-a321-8b319ead517c/konnectivity-agent/0.log" limit=1024 Jun 12 22:38:30.032425 ip-10-0-128-134 kubenswrapper[2559]: I0612 22:38:30.032390 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-f7h79_2fe08918-3efc-4000-a321-8b319ead517c/konnectivity-agent/0.log" limit=1024 Jun 12 22:38:35.905048 ip-10-0-128-134 kubenswrapper[2559]: I0612 22:38:35.905011 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-f7h79_2fe08918-3efc-4000-a321-8b319ead517c/konnectivity-agent/0.log" limit=1024 Jun 12 22:38:36.004913 ip-10-0-128-134 kubenswrapper[2559]: I0612 22:38:36.004875 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-f7h79_2fe08918-3efc-4000-a321-8b319ead517c/konnectivity-agent/0.log" limit=1024 Jun 12 22:39:08.168410 ip-10-0-128-134 kubenswrapper[2559]: I0612 22:39:08.168355 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-f7h79_2fe08918-3efc-4000-a321-8b319ead517c/konnectivity-agent/0.log" limit=1024 Jun 12 22:39:08.284230 ip-10-0-128-134 kubenswrapper[2559]: I0612 22:39:08.284193 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-f7h79_2fe08918-3efc-4000-a321-8b319ead517c/konnectivity-agent/0.log" limit=1024 Jun 12 22:39:22.177023 ip-10-0-128-134 kubenswrapper[2559]: I0612 22:39:22.176988 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-f7h79_2fe08918-3efc-4000-a321-8b319ead517c/konnectivity-agent/0.log" limit=1024 Jun 12 22:39:32.185800 ip-10-0-128-134 kubenswrapper[2559]: I0612 22:39:32.185753 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-f7h79_2fe08918-3efc-4000-a321-8b319ead517c/konnectivity-agent/0.log" limit=1024 Jun 12 22:39:38.116558 ip-10-0-128-134 kubenswrapper[2559]: I0612 22:39:38.116519 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-f7h79_2fe08918-3efc-4000-a321-8b319ead517c/konnectivity-agent/0.log" limit=1024 Jun 12 22:39:38.220245 ip-10-0-128-134 kubenswrapper[2559]: I0612 22:39:38.220206 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-f7h79_2fe08918-3efc-4000-a321-8b319ead517c/konnectivity-agent/0.log" limit=1024 Jun 12 22:39:38.317022 ip-10-0-128-134 kubenswrapper[2559]: I0612 22:39:38.316987 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-f7h79_2fe08918-3efc-4000-a321-8b319ead517c/konnectivity-agent/0.log" limit=1024 Jun 12 22:39:38.456492 ip-10-0-128-134 kubenswrapper[2559]: I0612 22:39:38.456380 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-f7h79_2fe08918-3efc-4000-a321-8b319ead517c/konnectivity-agent/0.log" limit=1024 Jun 12 22:39:38.559657 ip-10-0-128-134 kubenswrapper[2559]: I0612 22:39:38.559605 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-f7h79_2fe08918-3efc-4000-a321-8b319ead517c/konnectivity-agent/0.log" limit=1024 Jun 12 22:39:55.113313 ip-10-0-128-134 kubenswrapper[2559]: I0612 22:39:55.113267 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-f7h79_2fe08918-3efc-4000-a321-8b319ead517c/konnectivity-agent/0.log" limit=1024 Jun 12 22:39:55.239832 ip-10-0-128-134 kubenswrapper[2559]: I0612 22:39:55.239793 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-f7h79_2fe08918-3efc-4000-a321-8b319ead517c/konnectivity-agent/0.log" limit=1024 Jun 12 22:39:55.344426 ip-10-0-128-134 kubenswrapper[2559]: I0612 22:39:55.344390 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-f7h79_2fe08918-3efc-4000-a321-8b319ead517c/konnectivity-agent/0.log" limit=1024 Jun 12 22:40:01.027288 ip-10-0-128-134 kubenswrapper[2559]: I0612 22:40:01.027252 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-f7h79_2fe08918-3efc-4000-a321-8b319ead517c/konnectivity-agent/0.log" limit=1024 Jun 12 22:40:01.127289 ip-10-0-128-134 kubenswrapper[2559]: I0612 22:40:01.127243 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-f7h79_2fe08918-3efc-4000-a321-8b319ead517c/konnectivity-agent/0.log" limit=1024 Jun 12 22:40:09.173784 ip-10-0-128-134 kubenswrapper[2559]: I0612 22:40:09.173709 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-f7h79_2fe08918-3efc-4000-a321-8b319ead517c/konnectivity-agent/0.log" limit=1024 Jun 12 22:40:09.272793 ip-10-0-128-134 kubenswrapper[2559]: I0612 22:40:09.272754 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-f7h79_2fe08918-3efc-4000-a321-8b319ead517c/konnectivity-agent/0.log" limit=1024 Jun 12 22:40:09.379318 ip-10-0-128-134 kubenswrapper[2559]: I0612 22:40:09.379289 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-f7h79_2fe08918-3efc-4000-a321-8b319ead517c/konnectivity-agent/0.log" limit=1024 Jun 12 22:40:09.497818 ip-10-0-128-134 kubenswrapper[2559]: I0612 22:40:09.497731 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-f7h79_2fe08918-3efc-4000-a321-8b319ead517c/konnectivity-agent/0.log" limit=1024 Jun 12 22:40:25.937751 ip-10-0-128-134 kubenswrapper[2559]: I0612 22:40:25.937715 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-f7h79_2fe08918-3efc-4000-a321-8b319ead517c/konnectivity-agent/0.log" limit=1024 Jun 12 22:40:26.046902 ip-10-0-128-134 kubenswrapper[2559]: I0612 22:40:26.046867 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-f7h79_2fe08918-3efc-4000-a321-8b319ead517c/konnectivity-agent/0.log" limit=1024 Jun 12 22:40:26.167598 ip-10-0-128-134 kubenswrapper[2559]: I0612 22:40:26.167550 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-f7h79_2fe08918-3efc-4000-a321-8b319ead517c/konnectivity-agent/0.log" limit=1024 Jun 12 22:40:31.928655 ip-10-0-128-134 kubenswrapper[2559]: I0612 22:40:31.928624 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-f7h79_2fe08918-3efc-4000-a321-8b319ead517c/konnectivity-agent/0.log" limit=1024 Jun 12 22:40:31.985583 ip-10-0-128-134 kubenswrapper[2559]: I0612 22:40:31.985547 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-f7h79_2fe08918-3efc-4000-a321-8b319ead517c/konnectivity-agent/0.log" limit=1024 Jun 12 22:40:48.173124 ip-10-0-128-134 kubenswrapper[2559]: I0612 22:40:48.173088 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-f7h79_2fe08918-3efc-4000-a321-8b319ead517c/konnectivity-agent/0.log" limit=1024 Jun 12 22:40:48.260059 ip-10-0-128-134 kubenswrapper[2559]: I0612 22:40:48.260023 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-f7h79_2fe08918-3efc-4000-a321-8b319ead517c/konnectivity-agent/0.log" limit=1024 Jun 12 22:40:48.365752 ip-10-0-128-134 kubenswrapper[2559]: I0612 22:40:48.365719 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-f7h79_2fe08918-3efc-4000-a321-8b319ead517c/konnectivity-agent/0.log" limit=1024 Jun 12 22:40:54.208354 ip-10-0-128-134 kubenswrapper[2559]: I0612 22:40:54.208320 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-f7h79_2fe08918-3efc-4000-a321-8b319ead517c/konnectivity-agent/0.log" limit=1024 Jun 12 22:40:54.269016 ip-10-0-128-134 kubenswrapper[2559]: I0612 22:40:54.268983 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-f7h79_2fe08918-3efc-4000-a321-8b319ead517c/konnectivity-agent/0.log" limit=1024 Jun 12 22:40:54.345425 ip-10-0-128-134 kubenswrapper[2559]: I0612 22:40:54.345392 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-f7h79_2fe08918-3efc-4000-a321-8b319ead517c/konnectivity-agent/0.log" limit=1024 Jun 12 22:40:54.445036 ip-10-0-128-134 kubenswrapper[2559]: I0612 22:40:54.444996 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-f7h79_2fe08918-3efc-4000-a321-8b319ead517c/konnectivity-agent/0.log" limit=1024 Jun 12 22:40:54.545912 ip-10-0-128-134 kubenswrapper[2559]: I0612 22:40:54.545880 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-f7h79_2fe08918-3efc-4000-a321-8b319ead517c/konnectivity-agent/0.log" limit=1024 Jun 12 22:40:58.451692 ip-10-0-128-134 kubenswrapper[2559]: I0612 22:40:58.451658 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-9qn4j_f6ddad48-94e1-479b-951c-ebf6be358f2c/ovn-acl-logging/0.log" Jun 12 22:40:58.452172 ip-10-0-128-134 kubenswrapper[2559]: I0612 22:40:58.451765 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-9qn4j_f6ddad48-94e1-479b-951c-ebf6be358f2c/ovn-acl-logging/0.log" Jun 12 22:41:00.155608 ip-10-0-128-134 kubenswrapper[2559]: I0612 22:41:00.155574 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-f7h79_2fe08918-3efc-4000-a321-8b319ead517c/konnectivity-agent/0.log" limit=1024 Jun 12 22:41:00.256302 ip-10-0-128-134 kubenswrapper[2559]: I0612 22:41:00.256255 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-f7h79_2fe08918-3efc-4000-a321-8b319ead517c/konnectivity-agent/0.log" limit=1024 Jun 12 22:41:14.854564 ip-10-0-128-134 kubenswrapper[2559]: I0612 22:41:14.854519 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-f7h79_2fe08918-3efc-4000-a321-8b319ead517c/konnectivity-agent/0.log" limit=1024 Jun 12 22:42:06.773343 ip-10-0-128-134 kubenswrapper[2559]: I0612 22:42:06.773303 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-f7h79_2fe08918-3efc-4000-a321-8b319ead517c/konnectivity-agent/0.log" limit=1024 Jun 12 22:42:06.874559 ip-10-0-128-134 kubenswrapper[2559]: I0612 22:42:06.874525 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-f7h79_2fe08918-3efc-4000-a321-8b319ead517c/konnectivity-agent/0.log" limit=1024 Jun 12 22:45:44.898585 ip-10-0-128-134 kubenswrapper[2559]: I0612 22:45:44.898553 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-f7h79_2fe08918-3efc-4000-a321-8b319ead517c/konnectivity-agent/0.log" limit=1024 Jun 12 22:45:46.040588 ip-10-0-128-134 kubenswrapper[2559]: I0612 22:45:46.040547 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-f7h79_2fe08918-3efc-4000-a321-8b319ead517c/konnectivity-agent/0.log" limit=1024 Jun 12 22:45:46.150694 ip-10-0-128-134 kubenswrapper[2559]: I0612 22:45:46.150661 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-f7h79_2fe08918-3efc-4000-a321-8b319ead517c/konnectivity-agent/0.log" limit=1024 Jun 12 22:45:58.480948 ip-10-0-128-134 kubenswrapper[2559]: I0612 22:45:58.480913 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-9qn4j_f6ddad48-94e1-479b-951c-ebf6be358f2c/ovn-acl-logging/0.log" Jun 12 22:45:58.481950 ip-10-0-128-134 kubenswrapper[2559]: I0612 22:45:58.481931 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-9qn4j_f6ddad48-94e1-479b-951c-ebf6be358f2c/ovn-acl-logging/0.log" Jun 12 22:47:38.242507 ip-10-0-128-134 kubenswrapper[2559]: I0612 22:47:38.242436 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-f7h79_2fe08918-3efc-4000-a321-8b319ead517c/konnectivity-agent/0.log" limit=1024 Jun 12 22:50:58.509861 ip-10-0-128-134 kubenswrapper[2559]: I0612 22:50:58.509834 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-9qn4j_f6ddad48-94e1-479b-951c-ebf6be358f2c/ovn-acl-logging/0.log" Jun 12 22:50:58.512072 ip-10-0-128-134 kubenswrapper[2559]: I0612 22:50:58.512053 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-9qn4j_f6ddad48-94e1-479b-951c-ebf6be358f2c/ovn-acl-logging/0.log" Jun 12 22:52:54.373360 ip-10-0-128-134 kubenswrapper[2559]: I0612 22:52:54.373315 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-f7h79_2fe08918-3efc-4000-a321-8b319ead517c/konnectivity-agent/0.log" limit=1024 Jun 12 22:53:54.773023 ip-10-0-128-134 kubenswrapper[2559]: I0612 22:53:54.772948 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-f7h79_2fe08918-3efc-4000-a321-8b319ead517c/konnectivity-agent/0.log" limit=1024 Jun 12 22:53:54.875728 ip-10-0-128-134 kubenswrapper[2559]: I0612 22:53:54.875691 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-f7h79_2fe08918-3efc-4000-a321-8b319ead517c/konnectivity-agent/0.log" limit=1024 Jun 12 22:55:21.248838 ip-10-0-128-134 kubenswrapper[2559]: I0612 22:55:21.248756 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-f7h79_2fe08918-3efc-4000-a321-8b319ead517c/konnectivity-agent/0.log" limit=1024 Jun 12 22:55:58.541468 ip-10-0-128-134 kubenswrapper[2559]: I0612 22:55:58.541423 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-9qn4j_f6ddad48-94e1-479b-951c-ebf6be358f2c/ovn-acl-logging/0.log" Jun 12 22:55:58.545800 ip-10-0-128-134 kubenswrapper[2559]: I0612 22:55:58.545777 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-9qn4j_f6ddad48-94e1-479b-951c-ebf6be358f2c/ovn-acl-logging/0.log" Jun 12 22:57:27.949904 ip-10-0-128-134 kubenswrapper[2559]: I0612 22:57:27.949867 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-f7h79_2fe08918-3efc-4000-a321-8b319ead517c/konnectivity-agent/0.log" limit=1024 Jun 12 22:57:31.285046 ip-10-0-128-134 kubenswrapper[2559]: I0612 22:57:31.285006 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-f7h79_2fe08918-3efc-4000-a321-8b319ead517c/konnectivity-agent/0.log" limit=1024 Jun 12 22:57:55.569228 ip-10-0-128-134 kubenswrapper[2559]: I0612 22:57:55.569195 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-f7h79_2fe08918-3efc-4000-a321-8b319ead517c/konnectivity-agent/0.log" limit=1024 Jun 12 22:58:09.109826 ip-10-0-128-134 kubenswrapper[2559]: I0612 22:58:09.109735 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-f7h79_2fe08918-3efc-4000-a321-8b319ead517c/konnectivity-agent/0.log" limit=1024 Jun 12 22:58:11.268836 ip-10-0-128-134 kubenswrapper[2559]: I0612 22:58:11.268805 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-f7h79_2fe08918-3efc-4000-a321-8b319ead517c/konnectivity-agent/0.log" limit=1024 Jun 12 22:58:11.364851 ip-10-0-128-134 kubenswrapper[2559]: I0612 22:58:11.364817 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-f7h79_2fe08918-3efc-4000-a321-8b319ead517c/konnectivity-agent/0.log" limit=1024 Jun 12 22:58:11.533104 ip-10-0-128-134 kubenswrapper[2559]: I0612 22:58:11.533023 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-f7h79_2fe08918-3efc-4000-a321-8b319ead517c/konnectivity-agent/0.log" limit=1024 Jun 12 22:58:11.629813 ip-10-0-128-134 kubenswrapper[2559]: I0612 22:58:11.629754 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-f7h79_2fe08918-3efc-4000-a321-8b319ead517c/konnectivity-agent/0.log" limit=1024 Jun 12 22:58:14.939792 ip-10-0-128-134 kubenswrapper[2559]: I0612 22:58:14.939764 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-f7h79_2fe08918-3efc-4000-a321-8b319ead517c/konnectivity-agent/0.log" limit=1024 Jun 12 22:58:18.921270 ip-10-0-128-134 kubenswrapper[2559]: I0612 22:58:18.921236 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-f7h79_2fe08918-3efc-4000-a321-8b319ead517c/konnectivity-agent/0.log" limit=1024 Jun 12 22:58:19.224305 ip-10-0-128-134 kubenswrapper[2559]: I0612 22:58:19.224211 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-f7h79_2fe08918-3efc-4000-a321-8b319ead517c/konnectivity-agent/0.log" limit=1024 Jun 12 22:58:19.419980 ip-10-0-128-134 kubenswrapper[2559]: I0612 22:58:19.419947 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-f7h79_2fe08918-3efc-4000-a321-8b319ead517c/konnectivity-agent/0.log" limit=1024 Jun 12 22:58:20.559745 ip-10-0-128-134 kubenswrapper[2559]: I0612 22:58:20.559714 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-f7h79_2fe08918-3efc-4000-a321-8b319ead517c/konnectivity-agent/0.log" limit=1024 Jun 12 22:58:25.280813 ip-10-0-128-134 kubenswrapper[2559]: I0612 22:58:25.280778 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-f7h79_2fe08918-3efc-4000-a321-8b319ead517c/konnectivity-agent/0.log" limit=1024 Jun 12 22:58:25.381224 ip-10-0-128-134 kubenswrapper[2559]: I0612 22:58:25.381184 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-f7h79_2fe08918-3efc-4000-a321-8b319ead517c/konnectivity-agent/0.log" limit=1024 Jun 12 22:58:25.669085 ip-10-0-128-134 kubenswrapper[2559]: I0612 22:58:25.669052 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-f7h79_2fe08918-3efc-4000-a321-8b319ead517c/konnectivity-agent/0.log" limit=1024 Jun 12 22:58:25.846562 ip-10-0-128-134 kubenswrapper[2559]: I0612 22:58:25.846519 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-f7h79_2fe08918-3efc-4000-a321-8b319ead517c/konnectivity-agent/0.log" limit=1024 Jun 12 22:58:25.928777 ip-10-0-128-134 kubenswrapper[2559]: I0612 22:58:25.928683 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-f7h79_2fe08918-3efc-4000-a321-8b319ead517c/konnectivity-agent/0.log" limit=1024 Jun 12 22:58:28.457199 ip-10-0-128-134 kubenswrapper[2559]: I0612 22:58:28.457170 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-f7h79_2fe08918-3efc-4000-a321-8b319ead517c/konnectivity-agent/0.log" limit=1024 Jun 12 22:58:29.699602 ip-10-0-128-134 kubenswrapper[2559]: I0612 22:58:29.699569 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-f7h79_2fe08918-3efc-4000-a321-8b319ead517c/konnectivity-agent/0.log" limit=1024 Jun 12 22:58:32.176752 ip-10-0-128-134 kubenswrapper[2559]: I0612 22:58:32.176718 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-f7h79_2fe08918-3efc-4000-a321-8b319ead517c/konnectivity-agent/0.log" limit=1024 Jun 12 22:58:33.483913 ip-10-0-128-134 kubenswrapper[2559]: I0612 22:58:33.483882 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-f7h79_2fe08918-3efc-4000-a321-8b319ead517c/konnectivity-agent/0.log" limit=1024 Jun 12 22:58:33.599982 ip-10-0-128-134 kubenswrapper[2559]: I0612 22:58:33.599955 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-f7h79_2fe08918-3efc-4000-a321-8b319ead517c/konnectivity-agent/0.log" limit=1024 Jun 12 22:58:35.623196 ip-10-0-128-134 kubenswrapper[2559]: I0612 22:58:35.623169 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-f7h79_2fe08918-3efc-4000-a321-8b319ead517c/konnectivity-agent/0.log" limit=1024 Jun 12 22:58:39.278341 ip-10-0-128-134 kubenswrapper[2559]: I0612 22:58:39.278293 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-f7h79_2fe08918-3efc-4000-a321-8b319ead517c/konnectivity-agent/0.log" limit=1024 Jun 12 22:58:39.340983 ip-10-0-128-134 kubenswrapper[2559]: I0612 22:58:39.340945 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-f7h79_2fe08918-3efc-4000-a321-8b319ead517c/konnectivity-agent/0.log" limit=1024 Jun 12 22:58:46.782744 ip-10-0-128-134 kubenswrapper[2559]: I0612 22:58:46.782697 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-6877d8d55d-gjm9r_6908f292-a5a4-4207-bdb5-4b7c30ade76d/authorino/0.log" Jun 12 22:58:52.533743 ip-10-0-128-134 kubenswrapper[2559]: I0612 22:58:52.533712 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-69cd748fbc-t2pcx_20fec839-f5bc-4da8-ad4f-a87440e64ca2/copy-manifests/0.log" Jun 12 22:58:52.539989 ip-10-0-128-134 kubenswrapper[2559]: I0612 22:58:52.539967 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-69cd748fbc-t2pcx_20fec839-f5bc-4da8-ad4f-a87440e64ca2/manager/0.log" Jun 12 22:58:52.652506 ip-10-0-128-134 kubenswrapper[2559]: I0612 22:58:52.652480 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_postgres-69fb4594cf-4rkcc_527e6b82-fbfa-4418-874d-ff5a5d8fdb46/postgres/0.log" Jun 12 22:58:53.891710 ip-10-0-128-134 kubenswrapper[2559]: I0612 22:58:53.891682 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-6877d8d55d-gjm9r_6908f292-a5a4-4207-bdb5-4b7c30ade76d/authorino/0.log" Jun 12 22:58:55.436196 ip-10-0-128-134 kubenswrapper[2559]: I0612 22:58:55.436165 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-b7dfdf5dc-c2cfp_c1fe5639-790d-4d66-8dff-bd202adc3c51/kube-auth-proxy/0.log" Jun 12 22:58:56.233969 ip-10-0-128-134 kubenswrapper[2559]: I0612 22:58:56.233936 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-distinct-2-simulated-kserve-f5c55bdc-7wf72_cc4305a0-f887-45c5-ad54-7cfca8b5403e/storage-initializer/0.log" Jun 12 22:58:56.467328 ip-10-0-128-134 kubenswrapper[2559]: I0612 22:58:56.467299 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-trlp-test-simulated-kserve-68bb6c58d9-wsdq2_8c810636-cc9d-469b-8650-3c72624f8ae7/storage-initializer/0.log" Jun 12 22:58:56.473975 ip-10-0-128-134 kubenswrapper[2559]: I0612 22:58:56.473957 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-trlp-test-simulated-kserve-68bb6c58d9-wsdq2_8c810636-cc9d-469b-8650-3c72624f8ae7/main/0.log" Jun 12 22:58:56.702437 ip-10-0-128-134 kubenswrapper[2559]: I0612 22:58:56.702407 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_facebook-opt-125m-simulated-kserve-6f969c879b-sztxp_8748c3d0-c996-4fb1-8b7f-48e8130b1e3c/storage-initializer/0.log" Jun 12 22:58:56.709585 ip-10-0-128-134 kubenswrapper[2559]: I0612 22:58:56.709563 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_facebook-opt-125m-simulated-kserve-6f969c879b-sztxp_8748c3d0-c996-4fb1-8b7f-48e8130b1e3c/main/0.log" Jun 12 22:59:00.793956 ip-10-0-128-134 kubenswrapper[2559]: I0612 22:59:00.793921 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-f7h79_2fe08918-3efc-4000-a321-8b319ead517c/konnectivity-agent/0.log" limit=1024 Jun 12 22:59:01.046999 ip-10-0-128-134 kubenswrapper[2559]: I0612 22:59:01.046971 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-f7h79_2fe08918-3efc-4000-a321-8b319ead517c/konnectivity-agent/0.log" limit=1024 Jun 12 22:59:01.146596 ip-10-0-128-134 kubenswrapper[2559]: I0612 22:59:01.146565 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-f7h79_2fe08918-3efc-4000-a321-8b319ead517c/konnectivity-agent/0.log" limit=1024 Jun 12 22:59:04.176187 ip-10-0-128-134 kubenswrapper[2559]: I0612 22:59:04.176152 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_global-pull-secret-syncer-zdjjt_73bd91e1-b3e8-495c-990c-3ab079745247/global-pull-secret-syncer/0.log" Jun 12 22:59:04.216332 ip-10-0-128-134 kubenswrapper[2559]: I0612 22:59:04.216300 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_konnectivity-agent-f7h79_2fe08918-3efc-4000-a321-8b319ead517c/konnectivity-agent/0.log" Jun 12 22:59:04.296805 ip-10-0-128-134 kubenswrapper[2559]: I0612 22:59:04.296778 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_kube-apiserver-proxy-ip-10-0-128-134.ec2.internal_6d3e86596363af41e954bcae3f7c03e7/haproxy/0.log" Jun 12 22:59:09.124260 ip-10-0-128-134 kubenswrapper[2559]: I0612 22:59:09.124226 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-f7h79_2fe08918-3efc-4000-a321-8b319ead517c/konnectivity-agent/0.log" limit=1024 Jun 12 22:59:09.171929 ip-10-0-128-134 kubenswrapper[2559]: I0612 22:59:09.171896 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-f7h79_2fe08918-3efc-4000-a321-8b319ead517c/konnectivity-agent/0.log" limit=1024 Jun 12 22:59:09.400808 ip-10-0-128-134 kubenswrapper[2559]: I0612 22:59:09.400727 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-6877d8d55d-gjm9r_6908f292-a5a4-4207-bdb5-4b7c30ade76d/authorino/0.log" Jun 12 22:59:11.266253 ip-10-0-128-134 kubenswrapper[2559]: I0612 22:59:11.266229 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_b11fdeb3-2f2a-4091-9a41-0e34731b5b1f/alertmanager/0.log" Jun 12 22:59:11.283861 ip-10-0-128-134 kubenswrapper[2559]: I0612 22:59:11.283823 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_b11fdeb3-2f2a-4091-9a41-0e34731b5b1f/config-reloader/0.log" Jun 12 22:59:11.302016 ip-10-0-128-134 kubenswrapper[2559]: I0612 22:59:11.301995 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_b11fdeb3-2f2a-4091-9a41-0e34731b5b1f/kube-rbac-proxy-web/0.log" Jun 12 22:59:11.318526 ip-10-0-128-134 kubenswrapper[2559]: I0612 22:59:11.318500 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_b11fdeb3-2f2a-4091-9a41-0e34731b5b1f/kube-rbac-proxy/0.log" Jun 12 22:59:11.334267 ip-10-0-128-134 kubenswrapper[2559]: I0612 22:59:11.334252 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_b11fdeb3-2f2a-4091-9a41-0e34731b5b1f/kube-rbac-proxy-metric/0.log" Jun 12 22:59:11.350912 ip-10-0-128-134 kubenswrapper[2559]: I0612 22:59:11.350892 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_b11fdeb3-2f2a-4091-9a41-0e34731b5b1f/prom-label-proxy/0.log" Jun 12 22:59:11.373322 ip-10-0-128-134 kubenswrapper[2559]: I0612 22:59:11.373299 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_b11fdeb3-2f2a-4091-9a41-0e34731b5b1f/init-config-reloader/0.log" Jun 12 22:59:11.641425 ip-10-0-128-134 kubenswrapper[2559]: I0612 22:59:11.641392 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-x7lwm_ceaa8e94-a5c6-48ea-ba34-974490e3f735/node-exporter/0.log" Jun 12 22:59:11.661689 ip-10-0-128-134 kubenswrapper[2559]: I0612 22:59:11.661671 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-x7lwm_ceaa8e94-a5c6-48ea-ba34-974490e3f735/kube-rbac-proxy/0.log" Jun 12 22:59:11.680242 ip-10-0-128-134 kubenswrapper[2559]: I0612 22:59:11.680221 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-x7lwm_ceaa8e94-a5c6-48ea-ba34-974490e3f735/init-textfile/0.log" Jun 12 22:59:11.868629 ip-10-0-128-134 kubenswrapper[2559]: I0612 22:59:11.868605 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_faa60143-4f40-4865-9a35-398310205be8/prometheus/0.log" Jun 12 22:59:11.886805 ip-10-0-128-134 kubenswrapper[2559]: I0612 22:59:11.886779 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_faa60143-4f40-4865-9a35-398310205be8/config-reloader/0.log" Jun 12 22:59:11.905923 ip-10-0-128-134 kubenswrapper[2559]: I0612 22:59:11.905855 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_faa60143-4f40-4865-9a35-398310205be8/thanos-sidecar/0.log" Jun 12 22:59:11.931780 ip-10-0-128-134 kubenswrapper[2559]: I0612 22:59:11.931760 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_faa60143-4f40-4865-9a35-398310205be8/kube-rbac-proxy-web/0.log" Jun 12 22:59:11.948214 ip-10-0-128-134 kubenswrapper[2559]: I0612 22:59:11.948197 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_faa60143-4f40-4865-9a35-398310205be8/kube-rbac-proxy/0.log" Jun 12 22:59:11.969915 ip-10-0-128-134 kubenswrapper[2559]: I0612 22:59:11.969895 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_faa60143-4f40-4865-9a35-398310205be8/kube-rbac-proxy-thanos/0.log" Jun 12 22:59:11.989692 ip-10-0-128-134 kubenswrapper[2559]: I0612 22:59:11.989677 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_faa60143-4f40-4865-9a35-398310205be8/init-config-reloader/0.log" Jun 12 22:59:12.014825 ip-10-0-128-134 kubenswrapper[2559]: I0612 22:59:12.014801 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-operator-864fcfc6f9-rnvn5_20464bd8-4abc-4cbe-af35-ef5baa3a79ab/prometheus-operator/0.log" Jun 12 22:59:12.030162 ip-10-0-128-134 kubenswrapper[2559]: I0612 22:59:12.030146 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-operator-864fcfc6f9-rnvn5_20464bd8-4abc-4cbe-af35-ef5baa3a79ab/kube-rbac-proxy/0.log" Jun 12 22:59:12.053042 ip-10-0-128-134 kubenswrapper[2559]: I0612 22:59:12.053017 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-operator-admission-webhook-5cf667749c-2hl4m_1b3bbd8c-ff97-4ad6-bdcf-82c370788561/prometheus-operator-admission-webhook/0.log" Jun 12 22:59:12.077543 ip-10-0-128-134 kubenswrapper[2559]: I0612 22:59:12.077523 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_telemeter-client-558d966b89-9tqtf_5cef91d1-5123-4ae8-ba08-1a8f898bae57/telemeter-client/0.log" Jun 12 22:59:12.096523 ip-10-0-128-134 kubenswrapper[2559]: I0612 22:59:12.096506 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_telemeter-client-558d966b89-9tqtf_5cef91d1-5123-4ae8-ba08-1a8f898bae57/reload/0.log" Jun 12 22:59:12.114355 ip-10-0-128-134 kubenswrapper[2559]: I0612 22:59:12.114331 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_telemeter-client-558d966b89-9tqtf_5cef91d1-5123-4ae8-ba08-1a8f898bae57/kube-rbac-proxy/0.log" Jun 12 22:59:12.161570 ip-10-0-128-134 kubenswrapper[2559]: I0612 22:59:12.161498 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-68f5fc465b-28vs9_b5a8f721-d758-49b4-9967-84ed17bf40a5/thanos-query/0.log" Jun 12 22:59:12.180894 ip-10-0-128-134 kubenswrapper[2559]: I0612 22:59:12.180870 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-68f5fc465b-28vs9_b5a8f721-d758-49b4-9967-84ed17bf40a5/kube-rbac-proxy-web/0.log" Jun 12 22:59:12.198458 ip-10-0-128-134 kubenswrapper[2559]: I0612 22:59:12.198430 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-68f5fc465b-28vs9_b5a8f721-d758-49b4-9967-84ed17bf40a5/kube-rbac-proxy/0.log" Jun 12 22:59:12.216845 ip-10-0-128-134 kubenswrapper[2559]: I0612 22:59:12.216819 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-68f5fc465b-28vs9_b5a8f721-d758-49b4-9967-84ed17bf40a5/prom-label-proxy/0.log" Jun 12 22:59:12.229904 ip-10-0-128-134 kubenswrapper[2559]: I0612 22:59:12.229883 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-68f5fc465b-28vs9_b5a8f721-d758-49b4-9967-84ed17bf40a5/kube-rbac-proxy-rules/0.log" Jun 12 22:59:12.250246 ip-10-0-128-134 kubenswrapper[2559]: I0612 22:59:12.250222 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-68f5fc465b-28vs9_b5a8f721-d758-49b4-9967-84ed17bf40a5/kube-rbac-proxy-metrics/0.log" Jun 12 22:59:14.891842 ip-10-0-128-134 kubenswrapper[2559]: I0612 22:59:14.891816 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console_downloads-694c955b9-blb5k_d1f3ee57-3b89-4d10-8159-57894504bebb/download-server/0.log" Jun 12 22:59:16.290138 ip-10-0-128-134 kubenswrapper[2559]: I0612 22:59:16.290102 2559 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-must-gather-w9xsf/perf-node-gather-daemonset-zt4fh"] Jun 12 22:59:16.290638 ip-10-0-128-134 kubenswrapper[2559]: I0612 22:59:16.290526 2559 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="1497e880-9a09-42b8-9047-4bcbeb266bd3" containerName="authorino" Jun 12 22:59:16.290638 ip-10-0-128-134 kubenswrapper[2559]: I0612 22:59:16.290540 2559 state_mem.go:107] "Deleted CPUSet assignment" podUID="1497e880-9a09-42b8-9047-4bcbeb266bd3" containerName="authorino" Jun 12 22:59:16.290638 ip-10-0-128-134 kubenswrapper[2559]: I0612 22:59:16.290619 2559 memory_manager.go:368] "RemoveStaleState removing state" podUID="1497e880-9a09-42b8-9047-4bcbeb266bd3" containerName="authorino" Jun 12 22:59:16.293767 ip-10-0-128-134 kubenswrapper[2559]: I0612 22:59:16.293747 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-w9xsf/perf-node-gather-daemonset-zt4fh" Jun 12 22:59:16.296350 ip-10-0-128-134 kubenswrapper[2559]: I0612 22:59:16.296298 2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-w9xsf\"/\"kube-root-ca.crt\"" Jun 12 22:59:16.297230 ip-10-0-128-134 kubenswrapper[2559]: I0612 22:59:16.297213 2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-w9xsf\"/\"openshift-service-ca.crt\"" Jun 12 22:59:16.297339 ip-10-0-128-134 kubenswrapper[2559]: I0612 22:59:16.297215 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-must-gather-w9xsf\"/\"default-dockercfg-b7wfq\"" Jun 12 22:59:16.303284 ip-10-0-128-134 kubenswrapper[2559]: I0612 22:59:16.303261 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-w9xsf/perf-node-gather-daemonset-zt4fh"] Jun 12 22:59:16.467605 ip-10-0-128-134 kubenswrapper[2559]: I0612 22:59:16.467574 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/3b15fdca-630d-4fc3-a871-101e6f1aa3d1-podres\") pod \"perf-node-gather-daemonset-zt4fh\" (UID: \"3b15fdca-630d-4fc3-a871-101e6f1aa3d1\") " pod="openshift-must-gather-w9xsf/perf-node-gather-daemonset-zt4fh" Jun 12 22:59:16.467799 ip-10-0-128-134 kubenswrapper[2559]: I0612 22:59:16.467624 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/3b15fdca-630d-4fc3-a871-101e6f1aa3d1-lib-modules\") pod \"perf-node-gather-daemonset-zt4fh\" (UID: \"3b15fdca-630d-4fc3-a871-101e6f1aa3d1\") " pod="openshift-must-gather-w9xsf/perf-node-gather-daemonset-zt4fh" Jun 12 22:59:16.467799 ip-10-0-128-134 kubenswrapper[2559]: I0612 22:59:16.467651 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-z8jsc\" (UniqueName: \"kubernetes.io/projected/3b15fdca-630d-4fc3-a871-101e6f1aa3d1-kube-api-access-z8jsc\") pod \"perf-node-gather-daemonset-zt4fh\" (UID: \"3b15fdca-630d-4fc3-a871-101e6f1aa3d1\") " pod="openshift-must-gather-w9xsf/perf-node-gather-daemonset-zt4fh" Jun 12 22:59:16.467799 ip-10-0-128-134 kubenswrapper[2559]: I0612 22:59:16.467752 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/3b15fdca-630d-4fc3-a871-101e6f1aa3d1-proc\") pod \"perf-node-gather-daemonset-zt4fh\" (UID: \"3b15fdca-630d-4fc3-a871-101e6f1aa3d1\") " pod="openshift-must-gather-w9xsf/perf-node-gather-daemonset-zt4fh" Jun 12 22:59:16.467799 ip-10-0-128-134 kubenswrapper[2559]: I0612 22:59:16.467789 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/3b15fdca-630d-4fc3-a871-101e6f1aa3d1-sys\") pod \"perf-node-gather-daemonset-zt4fh\" (UID: \"3b15fdca-630d-4fc3-a871-101e6f1aa3d1\") " pod="openshift-must-gather-w9xsf/perf-node-gather-daemonset-zt4fh" Jun 12 22:59:16.568291 ip-10-0-128-134 kubenswrapper[2559]: I0612 22:59:16.568251 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/3b15fdca-630d-4fc3-a871-101e6f1aa3d1-proc\") pod \"perf-node-gather-daemonset-zt4fh\" (UID: \"3b15fdca-630d-4fc3-a871-101e6f1aa3d1\") " pod="openshift-must-gather-w9xsf/perf-node-gather-daemonset-zt4fh" Jun 12 22:59:16.568520 ip-10-0-128-134 kubenswrapper[2559]: I0612 22:59:16.568306 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/3b15fdca-630d-4fc3-a871-101e6f1aa3d1-sys\") pod \"perf-node-gather-daemonset-zt4fh\" (UID: \"3b15fdca-630d-4fc3-a871-101e6f1aa3d1\") " pod="openshift-must-gather-w9xsf/perf-node-gather-daemonset-zt4fh" Jun 12 22:59:16.568520 ip-10-0-128-134 kubenswrapper[2559]: I0612 22:59:16.568360 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/3b15fdca-630d-4fc3-a871-101e6f1aa3d1-podres\") pod \"perf-node-gather-daemonset-zt4fh\" (UID: \"3b15fdca-630d-4fc3-a871-101e6f1aa3d1\") " pod="openshift-must-gather-w9xsf/perf-node-gather-daemonset-zt4fh" Jun 12 22:59:16.568520 ip-10-0-128-134 kubenswrapper[2559]: I0612 22:59:16.568386 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/3b15fdca-630d-4fc3-a871-101e6f1aa3d1-proc\") pod \"perf-node-gather-daemonset-zt4fh\" (UID: \"3b15fdca-630d-4fc3-a871-101e6f1aa3d1\") " pod="openshift-must-gather-w9xsf/perf-node-gather-daemonset-zt4fh" Jun 12 22:59:16.568520 ip-10-0-128-134 kubenswrapper[2559]: I0612 22:59:16.568407 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/3b15fdca-630d-4fc3-a871-101e6f1aa3d1-lib-modules\") pod \"perf-node-gather-daemonset-zt4fh\" (UID: \"3b15fdca-630d-4fc3-a871-101e6f1aa3d1\") " pod="openshift-must-gather-w9xsf/perf-node-gather-daemonset-zt4fh" Jun 12 22:59:16.568520 ip-10-0-128-134 kubenswrapper[2559]: I0612 22:59:16.568426 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/3b15fdca-630d-4fc3-a871-101e6f1aa3d1-sys\") pod \"perf-node-gather-daemonset-zt4fh\" (UID: \"3b15fdca-630d-4fc3-a871-101e6f1aa3d1\") " pod="openshift-must-gather-w9xsf/perf-node-gather-daemonset-zt4fh" Jun 12 22:59:16.568520 ip-10-0-128-134 kubenswrapper[2559]: I0612 22:59:16.568477 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-z8jsc\" (UniqueName: \"kubernetes.io/projected/3b15fdca-630d-4fc3-a871-101e6f1aa3d1-kube-api-access-z8jsc\") pod \"perf-node-gather-daemonset-zt4fh\" (UID: \"3b15fdca-630d-4fc3-a871-101e6f1aa3d1\") " pod="openshift-must-gather-w9xsf/perf-node-gather-daemonset-zt4fh" Jun 12 22:59:16.568520 ip-10-0-128-134 kubenswrapper[2559]: I0612 22:59:16.568521 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/3b15fdca-630d-4fc3-a871-101e6f1aa3d1-podres\") pod \"perf-node-gather-daemonset-zt4fh\" (UID: \"3b15fdca-630d-4fc3-a871-101e6f1aa3d1\") " pod="openshift-must-gather-w9xsf/perf-node-gather-daemonset-zt4fh" Jun 12 22:59:16.568928 ip-10-0-128-134 kubenswrapper[2559]: I0612 22:59:16.568529 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/3b15fdca-630d-4fc3-a871-101e6f1aa3d1-lib-modules\") pod \"perf-node-gather-daemonset-zt4fh\" (UID: \"3b15fdca-630d-4fc3-a871-101e6f1aa3d1\") " pod="openshift-must-gather-w9xsf/perf-node-gather-daemonset-zt4fh" Jun 12 22:59:16.576563 ip-10-0-128-134 kubenswrapper[2559]: I0612 22:59:16.576535 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-z8jsc\" (UniqueName: \"kubernetes.io/projected/3b15fdca-630d-4fc3-a871-101e6f1aa3d1-kube-api-access-z8jsc\") pod \"perf-node-gather-daemonset-zt4fh\" (UID: \"3b15fdca-630d-4fc3-a871-101e6f1aa3d1\") " pod="openshift-must-gather-w9xsf/perf-node-gather-daemonset-zt4fh" Jun 12 22:59:16.604062 ip-10-0-128-134 kubenswrapper[2559]: I0612 22:59:16.604015 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-w9xsf/perf-node-gather-daemonset-zt4fh" Jun 12 22:59:16.741546 ip-10-0-128-134 kubenswrapper[2559]: I0612 22:59:16.741512 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-w9xsf/perf-node-gather-daemonset-zt4fh"] Jun 12 22:59:16.743341 ip-10-0-128-134 kubenswrapper[2559]: W0612 22:59:16.743308 2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-pod3b15fdca_630d_4fc3_a871_101e6f1aa3d1.slice/crio-ca2e308a016759d97531a06b8f0b7442bfc9d17be4fff3517598bd5141fa7137 WatchSource:0}: Error finding container ca2e308a016759d97531a06b8f0b7442bfc9d17be4fff3517598bd5141fa7137: Status 404 returned error can't find the container with id ca2e308a016759d97531a06b8f0b7442bfc9d17be4fff3517598bd5141fa7137 Jun 12 22:59:16.888263 ip-10-0-128-134 kubenswrapper[2559]: I0612 22:59:16.888217 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-vjnc9_aecd5c56-77f2-4faf-86c7-5d3d549fe908/dns/0.log" Jun 12 22:59:16.905992 ip-10-0-128-134 kubenswrapper[2559]: I0612 22:59:16.905965 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-vjnc9_aecd5c56-77f2-4faf-86c7-5d3d549fe908/kube-rbac-proxy/0.log" Jun 12 22:59:16.962352 ip-10-0-128-134 kubenswrapper[2559]: I0612 22:59:16.962316 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-qdtqn_843f3267-327c-4702-9510-3ceb40add4e1/dns-node-resolver/0.log" Jun 12 22:59:17.278525 ip-10-0-128-134 kubenswrapper[2559]: I0612 22:59:17.278424 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-w9xsf/perf-node-gather-daemonset-zt4fh" event={"ID":"3b15fdca-630d-4fc3-a871-101e6f1aa3d1","Type":"ContainerStarted","Data":"9c225abe4e1d0f71c78f9899cc826d7a449f2409f6477d22391bd9c55c9df3d4"} Jun 12 22:59:17.278525 ip-10-0-128-134 kubenswrapper[2559]: I0612 22:59:17.278493 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-w9xsf/perf-node-gather-daemonset-zt4fh" event={"ID":"3b15fdca-630d-4fc3-a871-101e6f1aa3d1","Type":"ContainerStarted","Data":"ca2e308a016759d97531a06b8f0b7442bfc9d17be4fff3517598bd5141fa7137"} Jun 12 22:59:17.278717 ip-10-0-128-134 kubenswrapper[2559]: I0612 22:59:17.278585 2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-must-gather-w9xsf/perf-node-gather-daemonset-zt4fh" Jun 12 22:59:17.296960 ip-10-0-128-134 kubenswrapper[2559]: I0612 22:59:17.296902 2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-must-gather-w9xsf/perf-node-gather-daemonset-zt4fh" podStartSLOduration=1.296887578 podStartE2EDuration="1.296887578s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-12 22:59:16 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-12 22:59:17.29425484 +0000 UTC m=+2299.342624668" watchObservedRunningTime="2026-06-12 22:59:17.296887578 +0000 UTC m=+2299.345257394" Jun 12 22:59:17.495744 ip-10-0-128-134 kubenswrapper[2559]: I0612 22:59:17.495714 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-bghrt_d01cad7b-32bc-45f8-8c98-057a798e0866/node-ca/0.log" Jun 12 22:59:18.518848 ip-10-0-128-134 kubenswrapper[2559]: I0612 22:59:18.518821 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-b7dfdf5dc-c2cfp_c1fe5639-790d-4d66-8dff-bd202adc3c51/kube-auth-proxy/0.log" Jun 12 22:59:19.350333 ip-10-0-128-134 kubenswrapper[2559]: I0612 22:59:19.350303 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-pmrz6_33f04902-b937-4a4f-96ef-74847dd5ce92/serve-healthcheck-canary/0.log" Jun 12 22:59:19.851938 ip-10-0-128-134 kubenswrapper[2559]: I0612 22:59:19.851906 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-hsj6t_c99154f1-7ad4-4ed4-a58e-6b0695e673fa/kube-rbac-proxy/0.log" Jun 12 22:59:19.868886 ip-10-0-128-134 kubenswrapper[2559]: I0612 22:59:19.868843 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-hsj6t_c99154f1-7ad4-4ed4-a58e-6b0695e673fa/exporter/0.log" Jun 12 22:59:19.885569 ip-10-0-128-134 kubenswrapper[2559]: I0612 22:59:19.885533 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-hsj6t_c99154f1-7ad4-4ed4-a58e-6b0695e673fa/extractor/0.log" Jun 12 22:59:22.710717 ip-10-0-128-134 kubenswrapper[2559]: I0612 22:59:22.710690 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-69cd748fbc-t2pcx_20fec839-f5bc-4da8-ad4f-a87440e64ca2/manager/0.log" Jun 12 22:59:22.728982 ip-10-0-128-134 kubenswrapper[2559]: I0612 22:59:22.728955 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-69cd748fbc-t2pcx_20fec839-f5bc-4da8-ad4f-a87440e64ca2/copy-manifests/0.log" Jun 12 22:59:22.747381 ip-10-0-128-134 kubenswrapper[2559]: I0612 22:59:22.747360 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_postgres-69fb4594cf-4rkcc_527e6b82-fbfa-4418-874d-ff5a5d8fdb46/postgres/0.log" Jun 12 22:59:23.294215 ip-10-0-128-134 kubenswrapper[2559]: I0612 22:59:23.294184 2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-must-gather-w9xsf/perf-node-gather-daemonset-zt4fh" Jun 12 22:59:24.195068 ip-10-0-128-134 kubenswrapper[2559]: I0612 22:59:24.195031 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-lws-operator_lws-controller-manager-75d6d854-s5rhh_1fe7d3ef-9775-48ee-85dd-ab08849440b5/manager/0.log" Jun 12 22:59:24.214296 ip-10-0-128-134 kubenswrapper[2559]: I0612 22:59:24.214273 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-lws-operator_openshift-lws-operator-fd8ccff4c-qf2ws_4ac9953d-8ff2-4d5d-9315-64bc75440b5d/openshift-lws-operator/0.log" Jun 12 22:59:29.700774 ip-10-0-128-134 kubenswrapper[2559]: I0612 22:59:29.700748 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-b7dfdf5dc-c2cfp_c1fe5639-790d-4d66-8dff-bd202adc3c51/kube-auth-proxy/0.log" Jun 12 22:59:31.170755 ip-10-0-128-134 kubenswrapper[2559]: I0612 22:59:31.170724 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-b7dfdf5dc-c2cfp_c1fe5639-790d-4d66-8dff-bd202adc3c51/kube-auth-proxy/0.log" Jun 12 22:59:31.213544 ip-10-0-128-134 kubenswrapper[2559]: I0612 22:59:31.213510 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-6fjft_2dd3c6ba-dc0c-4b3e-92b7-94a6b0999c26/kube-multus-additional-cni-plugins/0.log" Jun 12 22:59:31.233198 ip-10-0-128-134 kubenswrapper[2559]: I0612 22:59:31.233172 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-6fjft_2dd3c6ba-dc0c-4b3e-92b7-94a6b0999c26/egress-router-binary-copy/0.log" Jun 12 22:59:31.250187 ip-10-0-128-134 kubenswrapper[2559]: I0612 22:59:31.250143 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-6fjft_2dd3c6ba-dc0c-4b3e-92b7-94a6b0999c26/cni-plugins/0.log" Jun 12 22:59:31.268129 ip-10-0-128-134 kubenswrapper[2559]: I0612 22:59:31.268107 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-6fjft_2dd3c6ba-dc0c-4b3e-92b7-94a6b0999c26/bond-cni-plugin/0.log" Jun 12 22:59:31.295599 ip-10-0-128-134 kubenswrapper[2559]: I0612 22:59:31.295577 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-6fjft_2dd3c6ba-dc0c-4b3e-92b7-94a6b0999c26/routeoverride-cni/0.log" Jun 12 22:59:31.313367 ip-10-0-128-134 kubenswrapper[2559]: I0612 22:59:31.313345 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-6fjft_2dd3c6ba-dc0c-4b3e-92b7-94a6b0999c26/whereabouts-cni-bincopy/0.log" Jun 12 22:59:31.333238 ip-10-0-128-134 kubenswrapper[2559]: I0612 22:59:31.333212 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-6fjft_2dd3c6ba-dc0c-4b3e-92b7-94a6b0999c26/whereabouts-cni/0.log" Jun 12 22:59:31.612022 ip-10-0-128-134 kubenswrapper[2559]: I0612 22:59:31.611986 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-bzp8z_ca559a81-c5e6-4ba7-adc1-7ddafc57941a/kube-multus/0.log" Jun 12 22:59:31.664669 ip-10-0-128-134 kubenswrapper[2559]: I0612 22:59:31.664640 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_network-metrics-daemon-d9psx_12fe1273-445c-4710-8579-38c99d08c036/network-metrics-daemon/0.log" Jun 12 22:59:31.678463 ip-10-0-128-134 kubenswrapper[2559]: I0612 22:59:31.678424 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_network-metrics-daemon-d9psx_12fe1273-445c-4710-8579-38c99d08c036/kube-rbac-proxy/0.log" Jun 12 22:59:32.661138 ip-10-0-128-134 kubenswrapper[2559]: I0612 22:59:32.661108 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-9qn4j_f6ddad48-94e1-479b-951c-ebf6be358f2c/ovn-controller/0.log" Jun 12 22:59:32.673698 ip-10-0-128-134 kubenswrapper[2559]: I0612 22:59:32.673673 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-9qn4j_f6ddad48-94e1-479b-951c-ebf6be358f2c/ovn-acl-logging/1.log" Jun 12 22:59:32.673859 ip-10-0-128-134 kubenswrapper[2559]: I0612 22:59:32.673709 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-9qn4j_f6ddad48-94e1-479b-951c-ebf6be358f2c/ovn-acl-logging/0.log" Jun 12 22:59:32.686494 ip-10-0-128-134 kubenswrapper[2559]: I0612 22:59:32.686470 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-9qn4j_f6ddad48-94e1-479b-951c-ebf6be358f2c/kube-rbac-proxy-node/0.log" Jun 12 22:59:32.706382 ip-10-0-128-134 kubenswrapper[2559]: I0612 22:59:32.706358 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-9qn4j_f6ddad48-94e1-479b-951c-ebf6be358f2c/kube-rbac-proxy-ovn-metrics/0.log" Jun 12 22:59:32.727035 ip-10-0-128-134 kubenswrapper[2559]: I0612 22:59:32.727014 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-9qn4j_f6ddad48-94e1-479b-951c-ebf6be358f2c/northd/0.log" Jun 12 22:59:32.744183 ip-10-0-128-134 kubenswrapper[2559]: I0612 22:59:32.744160 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-9qn4j_f6ddad48-94e1-479b-951c-ebf6be358f2c/nbdb/0.log" Jun 12 22:59:32.763073 ip-10-0-128-134 kubenswrapper[2559]: I0612 22:59:32.763031 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-9qn4j_f6ddad48-94e1-479b-951c-ebf6be358f2c/sbdb/0.log" Jun 12 22:59:32.799518 ip-10-0-128-134 kubenswrapper[2559]: I0612 22:59:32.799489 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-9qn4j_f6ddad48-94e1-479b-951c-ebf6be358f2c/ovnkube-controller/0.log" Jun 12 22:59:32.988487 ip-10-0-128-134 kubenswrapper[2559]: I0612 22:59:32.988372 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-b7dfdf5dc-c2cfp_c1fe5639-790d-4d66-8dff-bd202adc3c51/kube-auth-proxy/0.log"