Jun 08 13:43:51.793889 ip-10-0-140-46 systemd[1]: Starting Kubernetes Kubelet... Jun 08 13:43:52.211147 ip-10-0-140-46 kubenswrapper[2576]: Flag --container-runtime-endpoint has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Jun 08 13:43:52.211147 ip-10-0-140-46 kubenswrapper[2576]: Flag --minimum-container-ttl-duration has been deprecated, Use --eviction-hard or --eviction-soft instead. Will be removed in a future version. Jun 08 13:43:52.211147 ip-10-0-140-46 kubenswrapper[2576]: Flag --volume-plugin-dir has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Jun 08 13:43:52.211147 ip-10-0-140-46 kubenswrapper[2576]: Flag --pod-infra-container-image has been deprecated, will be removed in 1.35. Image garbage collector will get sandbox image information from CRI. Jun 08 13:43:52.211147 ip-10-0-140-46 kubenswrapper[2576]: Flag --system-reserved has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Jun 08 13:43:52.213058 ip-10-0-140-46 kubenswrapper[2576]: I0608 13:43:52.212955 2576 server.go:213] "--pod-infra-container-image will not be pruned by the image garbage collector in kubelet and should also be set in the remote runtime" Jun 08 13:43:52.219395 ip-10-0-140-46 kubenswrapper[2576]: W0608 13:43:52.219375 2576 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jun 08 13:43:52.219395 ip-10-0-140-46 kubenswrapper[2576]: W0608 13:43:52.219393 2576 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jun 08 13:43:52.219470 ip-10-0-140-46 kubenswrapper[2576]: W0608 13:43:52.219398 2576 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jun 08 13:43:52.219470 ip-10-0-140-46 kubenswrapper[2576]: W0608 13:43:52.219404 2576 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jun 08 13:43:52.219470 ip-10-0-140-46 kubenswrapper[2576]: W0608 13:43:52.219408 2576 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jun 08 13:43:52.219470 ip-10-0-140-46 kubenswrapper[2576]: W0608 13:43:52.219412 2576 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jun 08 13:43:52.219470 ip-10-0-140-46 kubenswrapper[2576]: W0608 13:43:52.219414 2576 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jun 08 13:43:52.219470 ip-10-0-140-46 kubenswrapper[2576]: W0608 13:43:52.219418 2576 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jun 08 13:43:52.219470 ip-10-0-140-46 kubenswrapper[2576]: W0608 13:43:52.219421 2576 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jun 08 13:43:52.219470 ip-10-0-140-46 kubenswrapper[2576]: W0608 13:43:52.219424 2576 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jun 08 13:43:52.219470 ip-10-0-140-46 kubenswrapper[2576]: W0608 13:43:52.219426 2576 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jun 08 13:43:52.219470 ip-10-0-140-46 kubenswrapper[2576]: W0608 13:43:52.219429 2576 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jun 08 13:43:52.219470 ip-10-0-140-46 kubenswrapper[2576]: W0608 13:43:52.219432 2576 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jun 08 13:43:52.219470 ip-10-0-140-46 kubenswrapper[2576]: W0608 13:43:52.219436 2576 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jun 08 13:43:52.219470 ip-10-0-140-46 kubenswrapper[2576]: W0608 13:43:52.219439 2576 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jun 08 13:43:52.219470 ip-10-0-140-46 kubenswrapper[2576]: W0608 13:43:52.219441 2576 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jun 08 13:43:52.219470 ip-10-0-140-46 kubenswrapper[2576]: W0608 13:43:52.219444 2576 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jun 08 13:43:52.219470 ip-10-0-140-46 kubenswrapper[2576]: W0608 13:43:52.219447 2576 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jun 08 13:43:52.219470 ip-10-0-140-46 kubenswrapper[2576]: W0608 13:43:52.219449 2576 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jun 08 13:43:52.219470 ip-10-0-140-46 kubenswrapper[2576]: W0608 13:43:52.219452 2576 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jun 08 13:43:52.219470 ip-10-0-140-46 kubenswrapper[2576]: W0608 13:43:52.219455 2576 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jun 08 13:43:52.219951 ip-10-0-140-46 kubenswrapper[2576]: W0608 13:43:52.219457 2576 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jun 08 13:43:52.219951 ip-10-0-140-46 kubenswrapper[2576]: W0608 13:43:52.219460 2576 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jun 08 13:43:52.219951 ip-10-0-140-46 kubenswrapper[2576]: W0608 13:43:52.219462 2576 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jun 08 13:43:52.219951 ip-10-0-140-46 kubenswrapper[2576]: W0608 13:43:52.219465 2576 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jun 08 13:43:52.219951 ip-10-0-140-46 kubenswrapper[2576]: W0608 13:43:52.219467 2576 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jun 08 13:43:52.219951 ip-10-0-140-46 kubenswrapper[2576]: W0608 13:43:52.219470 2576 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jun 08 13:43:52.219951 ip-10-0-140-46 kubenswrapper[2576]: W0608 13:43:52.219473 2576 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jun 08 13:43:52.219951 ip-10-0-140-46 kubenswrapper[2576]: W0608 13:43:52.219476 2576 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jun 08 13:43:52.219951 ip-10-0-140-46 kubenswrapper[2576]: W0608 13:43:52.219479 2576 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jun 08 13:43:52.219951 ip-10-0-140-46 kubenswrapper[2576]: W0608 13:43:52.219482 2576 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jun 08 13:43:52.219951 ip-10-0-140-46 kubenswrapper[2576]: W0608 13:43:52.219484 2576 feature_gate.go:328] unrecognized feature gate: Example2 Jun 08 13:43:52.219951 ip-10-0-140-46 kubenswrapper[2576]: W0608 13:43:52.219487 2576 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jun 08 13:43:52.219951 ip-10-0-140-46 kubenswrapper[2576]: W0608 13:43:52.219490 2576 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jun 08 13:43:52.219951 ip-10-0-140-46 kubenswrapper[2576]: W0608 13:43:52.219493 2576 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jun 08 13:43:52.219951 ip-10-0-140-46 kubenswrapper[2576]: W0608 13:43:52.219495 2576 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jun 08 13:43:52.219951 ip-10-0-140-46 kubenswrapper[2576]: W0608 13:43:52.219498 2576 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jun 08 13:43:52.219951 ip-10-0-140-46 kubenswrapper[2576]: W0608 13:43:52.219500 2576 feature_gate.go:328] unrecognized feature gate: SignatureStores Jun 08 13:43:52.219951 ip-10-0-140-46 kubenswrapper[2576]: W0608 13:43:52.219503 2576 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jun 08 13:43:52.219951 ip-10-0-140-46 kubenswrapper[2576]: W0608 13:43:52.219505 2576 feature_gate.go:328] unrecognized feature gate: EventTTL Jun 08 13:43:52.219951 ip-10-0-140-46 kubenswrapper[2576]: W0608 13:43:52.219508 2576 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jun 08 13:43:52.220461 ip-10-0-140-46 kubenswrapper[2576]: W0608 13:43:52.219510 2576 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jun 08 13:43:52.220461 ip-10-0-140-46 kubenswrapper[2576]: W0608 13:43:52.219513 2576 feature_gate.go:328] unrecognized feature gate: OVNObservability Jun 08 13:43:52.220461 ip-10-0-140-46 kubenswrapper[2576]: W0608 13:43:52.219515 2576 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jun 08 13:43:52.220461 ip-10-0-140-46 kubenswrapper[2576]: W0608 13:43:52.219518 2576 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jun 08 13:43:52.220461 ip-10-0-140-46 kubenswrapper[2576]: W0608 13:43:52.219521 2576 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jun 08 13:43:52.220461 ip-10-0-140-46 kubenswrapper[2576]: W0608 13:43:52.219524 2576 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jun 08 13:43:52.220461 ip-10-0-140-46 kubenswrapper[2576]: W0608 13:43:52.219526 2576 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jun 08 13:43:52.220461 ip-10-0-140-46 kubenswrapper[2576]: W0608 13:43:52.219528 2576 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jun 08 13:43:52.220461 ip-10-0-140-46 kubenswrapper[2576]: W0608 13:43:52.219531 2576 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jun 08 13:43:52.220461 ip-10-0-140-46 kubenswrapper[2576]: W0608 13:43:52.219533 2576 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jun 08 13:43:52.220461 ip-10-0-140-46 kubenswrapper[2576]: W0608 13:43:52.219537 2576 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jun 08 13:43:52.220461 ip-10-0-140-46 kubenswrapper[2576]: W0608 13:43:52.219539 2576 feature_gate.go:328] unrecognized feature gate: OSStreams Jun 08 13:43:52.220461 ip-10-0-140-46 kubenswrapper[2576]: W0608 13:43:52.219542 2576 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jun 08 13:43:52.220461 ip-10-0-140-46 kubenswrapper[2576]: W0608 13:43:52.219545 2576 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jun 08 13:43:52.220461 ip-10-0-140-46 kubenswrapper[2576]: W0608 13:43:52.219548 2576 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jun 08 13:43:52.220461 ip-10-0-140-46 kubenswrapper[2576]: W0608 13:43:52.219550 2576 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jun 08 13:43:52.220461 ip-10-0-140-46 kubenswrapper[2576]: W0608 13:43:52.219553 2576 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jun 08 13:43:52.220461 ip-10-0-140-46 kubenswrapper[2576]: W0608 13:43:52.219556 2576 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jun 08 13:43:52.220461 ip-10-0-140-46 kubenswrapper[2576]: W0608 13:43:52.219558 2576 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jun 08 13:43:52.220461 ip-10-0-140-46 kubenswrapper[2576]: W0608 13:43:52.219574 2576 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jun 08 13:43:52.220976 ip-10-0-140-46 kubenswrapper[2576]: W0608 13:43:52.219578 2576 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jun 08 13:43:52.220976 ip-10-0-140-46 kubenswrapper[2576]: W0608 13:43:52.219582 2576 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jun 08 13:43:52.220976 ip-10-0-140-46 kubenswrapper[2576]: W0608 13:43:52.219586 2576 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jun 08 13:43:52.220976 ip-10-0-140-46 kubenswrapper[2576]: W0608 13:43:52.219589 2576 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jun 08 13:43:52.220976 ip-10-0-140-46 kubenswrapper[2576]: W0608 13:43:52.219592 2576 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jun 08 13:43:52.220976 ip-10-0-140-46 kubenswrapper[2576]: W0608 13:43:52.219595 2576 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jun 08 13:43:52.220976 ip-10-0-140-46 kubenswrapper[2576]: W0608 13:43:52.219597 2576 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jun 08 13:43:52.220976 ip-10-0-140-46 kubenswrapper[2576]: W0608 13:43:52.219600 2576 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jun 08 13:43:52.220976 ip-10-0-140-46 kubenswrapper[2576]: W0608 13:43:52.219603 2576 feature_gate.go:328] unrecognized feature gate: DualReplica Jun 08 13:43:52.220976 ip-10-0-140-46 kubenswrapper[2576]: W0608 13:43:52.219606 2576 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jun 08 13:43:52.220976 ip-10-0-140-46 kubenswrapper[2576]: W0608 13:43:52.219609 2576 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jun 08 13:43:52.220976 ip-10-0-140-46 kubenswrapper[2576]: W0608 13:43:52.219613 2576 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jun 08 13:43:52.220976 ip-10-0-140-46 kubenswrapper[2576]: W0608 13:43:52.219615 2576 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jun 08 13:43:52.220976 ip-10-0-140-46 kubenswrapper[2576]: W0608 13:43:52.219618 2576 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jun 08 13:43:52.220976 ip-10-0-140-46 kubenswrapper[2576]: W0608 13:43:52.219620 2576 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jun 08 13:43:52.220976 ip-10-0-140-46 kubenswrapper[2576]: W0608 13:43:52.219623 2576 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jun 08 13:43:52.220976 ip-10-0-140-46 kubenswrapper[2576]: W0608 13:43:52.219627 2576 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jun 08 13:43:52.220976 ip-10-0-140-46 kubenswrapper[2576]: W0608 13:43:52.219629 2576 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jun 08 13:43:52.220976 ip-10-0-140-46 kubenswrapper[2576]: W0608 13:43:52.219632 2576 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jun 08 13:43:52.221437 ip-10-0-140-46 kubenswrapper[2576]: W0608 13:43:52.219635 2576 feature_gate.go:328] unrecognized feature gate: Example Jun 08 13:43:52.221437 ip-10-0-140-46 kubenswrapper[2576]: W0608 13:43:52.219637 2576 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jun 08 13:43:52.221437 ip-10-0-140-46 kubenswrapper[2576]: W0608 13:43:52.219640 2576 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jun 08 13:43:52.221437 ip-10-0-140-46 kubenswrapper[2576]: W0608 13:43:52.219644 2576 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jun 08 13:43:52.221437 ip-10-0-140-46 kubenswrapper[2576]: W0608 13:43:52.219647 2576 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jun 08 13:43:52.221437 ip-10-0-140-46 kubenswrapper[2576]: W0608 13:43:52.219651 2576 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jun 08 13:43:52.221437 ip-10-0-140-46 kubenswrapper[2576]: W0608 13:43:52.219656 2576 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jun 08 13:43:52.221437 ip-10-0-140-46 kubenswrapper[2576]: W0608 13:43:52.219659 2576 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jun 08 13:43:52.221437 ip-10-0-140-46 kubenswrapper[2576]: W0608 13:43:52.219662 2576 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jun 08 13:43:52.221437 ip-10-0-140-46 kubenswrapper[2576]: W0608 13:43:52.219664 2576 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jun 08 13:43:52.221437 ip-10-0-140-46 kubenswrapper[2576]: W0608 13:43:52.219667 2576 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jun 08 13:43:52.221437 ip-10-0-140-46 kubenswrapper[2576]: W0608 13:43:52.219670 2576 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jun 08 13:43:52.221437 ip-10-0-140-46 kubenswrapper[2576]: W0608 13:43:52.219674 2576 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jun 08 13:43:52.221437 ip-10-0-140-46 kubenswrapper[2576]: W0608 13:43:52.219678 2576 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jun 08 13:43:52.221437 ip-10-0-140-46 kubenswrapper[2576]: W0608 13:43:52.219681 2576 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jun 08 13:43:52.221437 ip-10-0-140-46 kubenswrapper[2576]: W0608 13:43:52.219683 2576 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jun 08 13:43:52.221437 ip-10-0-140-46 kubenswrapper[2576]: W0608 13:43:52.219686 2576 feature_gate.go:328] unrecognized feature gate: NewOLM Jun 08 13:43:52.221437 ip-10-0-140-46 kubenswrapper[2576]: W0608 13:43:52.219688 2576 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jun 08 13:43:52.221437 ip-10-0-140-46 kubenswrapper[2576]: W0608 13:43:52.219691 2576 feature_gate.go:328] unrecognized feature gate: PinnedImages Jun 08 13:43:52.221951 ip-10-0-140-46 kubenswrapper[2576]: W0608 13:43:52.220480 2576 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jun 08 13:43:52.221951 ip-10-0-140-46 kubenswrapper[2576]: W0608 13:43:52.220487 2576 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jun 08 13:43:52.221951 ip-10-0-140-46 kubenswrapper[2576]: W0608 13:43:52.220490 2576 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jun 08 13:43:52.221951 ip-10-0-140-46 kubenswrapper[2576]: W0608 13:43:52.220494 2576 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jun 08 13:43:52.221951 ip-10-0-140-46 kubenswrapper[2576]: W0608 13:43:52.220497 2576 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jun 08 13:43:52.221951 ip-10-0-140-46 kubenswrapper[2576]: W0608 13:43:52.220500 2576 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jun 08 13:43:52.221951 ip-10-0-140-46 kubenswrapper[2576]: W0608 13:43:52.220502 2576 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jun 08 13:43:52.221951 ip-10-0-140-46 kubenswrapper[2576]: W0608 13:43:52.220505 2576 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jun 08 13:43:52.221951 ip-10-0-140-46 kubenswrapper[2576]: W0608 13:43:52.220508 2576 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jun 08 13:43:52.221951 ip-10-0-140-46 kubenswrapper[2576]: W0608 13:43:52.220510 2576 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jun 08 13:43:52.221951 ip-10-0-140-46 kubenswrapper[2576]: W0608 13:43:52.220513 2576 feature_gate.go:328] unrecognized feature gate: SignatureStores Jun 08 13:43:52.221951 ip-10-0-140-46 kubenswrapper[2576]: W0608 13:43:52.220517 2576 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jun 08 13:43:52.221951 ip-10-0-140-46 kubenswrapper[2576]: W0608 13:43:52.220520 2576 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jun 08 13:43:52.221951 ip-10-0-140-46 kubenswrapper[2576]: W0608 13:43:52.220522 2576 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jun 08 13:43:52.221951 ip-10-0-140-46 kubenswrapper[2576]: W0608 13:43:52.220525 2576 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jun 08 13:43:52.221951 ip-10-0-140-46 kubenswrapper[2576]: W0608 13:43:52.220527 2576 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jun 08 13:43:52.221951 ip-10-0-140-46 kubenswrapper[2576]: W0608 13:43:52.220530 2576 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jun 08 13:43:52.221951 ip-10-0-140-46 kubenswrapper[2576]: W0608 13:43:52.220533 2576 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jun 08 13:43:52.221951 ip-10-0-140-46 kubenswrapper[2576]: W0608 13:43:52.220536 2576 feature_gate.go:328] unrecognized feature gate: EventTTL Jun 08 13:43:52.221951 ip-10-0-140-46 kubenswrapper[2576]: W0608 13:43:52.220539 2576 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jun 08 13:43:52.222468 ip-10-0-140-46 kubenswrapper[2576]: W0608 13:43:52.220542 2576 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jun 08 13:43:52.222468 ip-10-0-140-46 kubenswrapper[2576]: W0608 13:43:52.220545 2576 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jun 08 13:43:52.222468 ip-10-0-140-46 kubenswrapper[2576]: W0608 13:43:52.220547 2576 feature_gate.go:328] unrecognized feature gate: PinnedImages Jun 08 13:43:52.222468 ip-10-0-140-46 kubenswrapper[2576]: W0608 13:43:52.220550 2576 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jun 08 13:43:52.222468 ip-10-0-140-46 kubenswrapper[2576]: W0608 13:43:52.220555 2576 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jun 08 13:43:52.222468 ip-10-0-140-46 kubenswrapper[2576]: W0608 13:43:52.220559 2576 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jun 08 13:43:52.222468 ip-10-0-140-46 kubenswrapper[2576]: W0608 13:43:52.220576 2576 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jun 08 13:43:52.222468 ip-10-0-140-46 kubenswrapper[2576]: W0608 13:43:52.220580 2576 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jun 08 13:43:52.222468 ip-10-0-140-46 kubenswrapper[2576]: W0608 13:43:52.220584 2576 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jun 08 13:43:52.222468 ip-10-0-140-46 kubenswrapper[2576]: W0608 13:43:52.220586 2576 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jun 08 13:43:52.222468 ip-10-0-140-46 kubenswrapper[2576]: W0608 13:43:52.220589 2576 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jun 08 13:43:52.222468 ip-10-0-140-46 kubenswrapper[2576]: W0608 13:43:52.220592 2576 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jun 08 13:43:52.222468 ip-10-0-140-46 kubenswrapper[2576]: W0608 13:43:52.220595 2576 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jun 08 13:43:52.222468 ip-10-0-140-46 kubenswrapper[2576]: W0608 13:43:52.220598 2576 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jun 08 13:43:52.222468 ip-10-0-140-46 kubenswrapper[2576]: W0608 13:43:52.220601 2576 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jun 08 13:43:52.222468 ip-10-0-140-46 kubenswrapper[2576]: W0608 13:43:52.220604 2576 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jun 08 13:43:52.222468 ip-10-0-140-46 kubenswrapper[2576]: W0608 13:43:52.220607 2576 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jun 08 13:43:52.222468 ip-10-0-140-46 kubenswrapper[2576]: W0608 13:43:52.220609 2576 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jun 08 13:43:52.222468 ip-10-0-140-46 kubenswrapper[2576]: W0608 13:43:52.220612 2576 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jun 08 13:43:52.222468 ip-10-0-140-46 kubenswrapper[2576]: W0608 13:43:52.220615 2576 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jun 08 13:43:52.223006 ip-10-0-140-46 kubenswrapper[2576]: W0608 13:43:52.220617 2576 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jun 08 13:43:52.223006 ip-10-0-140-46 kubenswrapper[2576]: W0608 13:43:52.220619 2576 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jun 08 13:43:52.223006 ip-10-0-140-46 kubenswrapper[2576]: W0608 13:43:52.220622 2576 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jun 08 13:43:52.223006 ip-10-0-140-46 kubenswrapper[2576]: W0608 13:43:52.220625 2576 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jun 08 13:43:52.223006 ip-10-0-140-46 kubenswrapper[2576]: W0608 13:43:52.220630 2576 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jun 08 13:43:52.223006 ip-10-0-140-46 kubenswrapper[2576]: W0608 13:43:52.220632 2576 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jun 08 13:43:52.223006 ip-10-0-140-46 kubenswrapper[2576]: W0608 13:43:52.220635 2576 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jun 08 13:43:52.223006 ip-10-0-140-46 kubenswrapper[2576]: W0608 13:43:52.220637 2576 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jun 08 13:43:52.223006 ip-10-0-140-46 kubenswrapper[2576]: W0608 13:43:52.220640 2576 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jun 08 13:43:52.223006 ip-10-0-140-46 kubenswrapper[2576]: W0608 13:43:52.220643 2576 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jun 08 13:43:52.223006 ip-10-0-140-46 kubenswrapper[2576]: W0608 13:43:52.220648 2576 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jun 08 13:43:52.223006 ip-10-0-140-46 kubenswrapper[2576]: W0608 13:43:52.220652 2576 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jun 08 13:43:52.223006 ip-10-0-140-46 kubenswrapper[2576]: W0608 13:43:52.220655 2576 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jun 08 13:43:52.223006 ip-10-0-140-46 kubenswrapper[2576]: W0608 13:43:52.220658 2576 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jun 08 13:43:52.223006 ip-10-0-140-46 kubenswrapper[2576]: W0608 13:43:52.220661 2576 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jun 08 13:43:52.223006 ip-10-0-140-46 kubenswrapper[2576]: W0608 13:43:52.220664 2576 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jun 08 13:43:52.223006 ip-10-0-140-46 kubenswrapper[2576]: W0608 13:43:52.220667 2576 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jun 08 13:43:52.223006 ip-10-0-140-46 kubenswrapper[2576]: W0608 13:43:52.220670 2576 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jun 08 13:43:52.223006 ip-10-0-140-46 kubenswrapper[2576]: W0608 13:43:52.220673 2576 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jun 08 13:43:52.223463 ip-10-0-140-46 kubenswrapper[2576]: W0608 13:43:52.220676 2576 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jun 08 13:43:52.223463 ip-10-0-140-46 kubenswrapper[2576]: W0608 13:43:52.220679 2576 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jun 08 13:43:52.223463 ip-10-0-140-46 kubenswrapper[2576]: W0608 13:43:52.220682 2576 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jun 08 13:43:52.223463 ip-10-0-140-46 kubenswrapper[2576]: W0608 13:43:52.220684 2576 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jun 08 13:43:52.223463 ip-10-0-140-46 kubenswrapper[2576]: W0608 13:43:52.220687 2576 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jun 08 13:43:52.223463 ip-10-0-140-46 kubenswrapper[2576]: W0608 13:43:52.220689 2576 feature_gate.go:328] unrecognized feature gate: Example Jun 08 13:43:52.223463 ip-10-0-140-46 kubenswrapper[2576]: W0608 13:43:52.220692 2576 feature_gate.go:328] unrecognized feature gate: Example2 Jun 08 13:43:52.223463 ip-10-0-140-46 kubenswrapper[2576]: W0608 13:43:52.220695 2576 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jun 08 13:43:52.223463 ip-10-0-140-46 kubenswrapper[2576]: W0608 13:43:52.220698 2576 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jun 08 13:43:52.223463 ip-10-0-140-46 kubenswrapper[2576]: W0608 13:43:52.220700 2576 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jun 08 13:43:52.223463 ip-10-0-140-46 kubenswrapper[2576]: W0608 13:43:52.220704 2576 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jun 08 13:43:52.223463 ip-10-0-140-46 kubenswrapper[2576]: W0608 13:43:52.220706 2576 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jun 08 13:43:52.223463 ip-10-0-140-46 kubenswrapper[2576]: W0608 13:43:52.220709 2576 feature_gate.go:328] unrecognized feature gate: DualReplica Jun 08 13:43:52.223463 ip-10-0-140-46 kubenswrapper[2576]: W0608 13:43:52.220711 2576 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jun 08 13:43:52.223463 ip-10-0-140-46 kubenswrapper[2576]: W0608 13:43:52.220714 2576 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jun 08 13:43:52.223463 ip-10-0-140-46 kubenswrapper[2576]: W0608 13:43:52.220716 2576 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jun 08 13:43:52.223463 ip-10-0-140-46 kubenswrapper[2576]: W0608 13:43:52.220719 2576 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jun 08 13:43:52.223463 ip-10-0-140-46 kubenswrapper[2576]: W0608 13:43:52.220721 2576 feature_gate.go:328] unrecognized feature gate: OVNObservability Jun 08 13:43:52.223463 ip-10-0-140-46 kubenswrapper[2576]: W0608 13:43:52.220725 2576 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jun 08 13:43:52.223463 ip-10-0-140-46 kubenswrapper[2576]: W0608 13:43:52.220727 2576 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jun 08 13:43:52.224014 ip-10-0-140-46 kubenswrapper[2576]: W0608 13:43:52.220730 2576 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jun 08 13:43:52.224014 ip-10-0-140-46 kubenswrapper[2576]: W0608 13:43:52.220733 2576 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jun 08 13:43:52.224014 ip-10-0-140-46 kubenswrapper[2576]: W0608 13:43:52.220735 2576 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jun 08 13:43:52.224014 ip-10-0-140-46 kubenswrapper[2576]: W0608 13:43:52.220738 2576 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jun 08 13:43:52.224014 ip-10-0-140-46 kubenswrapper[2576]: W0608 13:43:52.220740 2576 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jun 08 13:43:52.224014 ip-10-0-140-46 kubenswrapper[2576]: W0608 13:43:52.220743 2576 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jun 08 13:43:52.224014 ip-10-0-140-46 kubenswrapper[2576]: W0608 13:43:52.220785 2576 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jun 08 13:43:52.224014 ip-10-0-140-46 kubenswrapper[2576]: W0608 13:43:52.220791 2576 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jun 08 13:43:52.224014 ip-10-0-140-46 kubenswrapper[2576]: W0608 13:43:52.220794 2576 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jun 08 13:43:52.224014 ip-10-0-140-46 kubenswrapper[2576]: W0608 13:43:52.220797 2576 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jun 08 13:43:52.224014 ip-10-0-140-46 kubenswrapper[2576]: W0608 13:43:52.220800 2576 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jun 08 13:43:52.224014 ip-10-0-140-46 kubenswrapper[2576]: W0608 13:43:52.220802 2576 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jun 08 13:43:52.224014 ip-10-0-140-46 kubenswrapper[2576]: W0608 13:43:52.220805 2576 feature_gate.go:328] unrecognized feature gate: NewOLM Jun 08 13:43:52.224014 ip-10-0-140-46 kubenswrapper[2576]: W0608 13:43:52.220808 2576 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jun 08 13:43:52.224014 ip-10-0-140-46 kubenswrapper[2576]: W0608 13:43:52.220811 2576 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jun 08 13:43:52.224014 ip-10-0-140-46 kubenswrapper[2576]: W0608 13:43:52.220814 2576 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jun 08 13:43:52.224014 ip-10-0-140-46 kubenswrapper[2576]: W0608 13:43:52.220817 2576 feature_gate.go:328] unrecognized feature gate: OSStreams Jun 08 13:43:52.224014 ip-10-0-140-46 kubenswrapper[2576]: W0608 13:43:52.220820 2576 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jun 08 13:43:52.224014 ip-10-0-140-46 kubenswrapper[2576]: W0608 13:43:52.220822 2576 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jun 08 13:43:52.224014 ip-10-0-140-46 kubenswrapper[2576]: W0608 13:43:52.220825 2576 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jun 08 13:43:52.224503 ip-10-0-140-46 kubenswrapper[2576]: W0608 13:43:52.221239 2576 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jun 08 13:43:52.224503 ip-10-0-140-46 kubenswrapper[2576]: W0608 13:43:52.221245 2576 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jun 08 13:43:52.224503 ip-10-0-140-46 kubenswrapper[2576]: W0608 13:43:52.221248 2576 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jun 08 13:43:52.224503 ip-10-0-140-46 kubenswrapper[2576]: W0608 13:43:52.221251 2576 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jun 08 13:43:52.224503 ip-10-0-140-46 kubenswrapper[2576]: W0608 13:43:52.221254 2576 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jun 08 13:43:52.224503 ip-10-0-140-46 kubenswrapper[2576]: W0608 13:43:52.221256 2576 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jun 08 13:43:52.224503 ip-10-0-140-46 kubenswrapper[2576]: W0608 13:43:52.221259 2576 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jun 08 13:43:52.224503 ip-10-0-140-46 kubenswrapper[2576]: W0608 13:43:52.221262 2576 feature_gate.go:328] unrecognized feature gate: DualReplica Jun 08 13:43:52.224503 ip-10-0-140-46 kubenswrapper[2576]: W0608 13:43:52.221265 2576 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jun 08 13:43:52.224503 ip-10-0-140-46 kubenswrapper[2576]: W0608 13:43:52.221267 2576 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jun 08 13:43:52.224503 ip-10-0-140-46 kubenswrapper[2576]: W0608 13:43:52.221271 2576 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jun 08 13:43:52.224503 ip-10-0-140-46 kubenswrapper[2576]: W0608 13:43:52.221274 2576 feature_gate.go:328] unrecognized feature gate: Example2 Jun 08 13:43:52.224503 ip-10-0-140-46 kubenswrapper[2576]: W0608 13:43:52.221277 2576 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jun 08 13:43:52.224503 ip-10-0-140-46 kubenswrapper[2576]: W0608 13:43:52.221290 2576 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jun 08 13:43:52.224503 ip-10-0-140-46 kubenswrapper[2576]: W0608 13:43:52.221293 2576 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jun 08 13:43:52.224503 ip-10-0-140-46 kubenswrapper[2576]: W0608 13:43:52.221296 2576 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jun 08 13:43:52.224503 ip-10-0-140-46 kubenswrapper[2576]: W0608 13:43:52.221299 2576 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jun 08 13:43:52.224503 ip-10-0-140-46 kubenswrapper[2576]: W0608 13:43:52.221301 2576 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jun 08 13:43:52.224503 ip-10-0-140-46 kubenswrapper[2576]: W0608 13:43:52.221304 2576 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jun 08 13:43:52.224503 ip-10-0-140-46 kubenswrapper[2576]: W0608 13:43:52.221307 2576 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jun 08 13:43:52.225004 ip-10-0-140-46 kubenswrapper[2576]: W0608 13:43:52.221309 2576 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jun 08 13:43:52.225004 ip-10-0-140-46 kubenswrapper[2576]: W0608 13:43:52.221312 2576 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jun 08 13:43:52.225004 ip-10-0-140-46 kubenswrapper[2576]: W0608 13:43:52.221315 2576 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jun 08 13:43:52.225004 ip-10-0-140-46 kubenswrapper[2576]: W0608 13:43:52.221317 2576 feature_gate.go:328] unrecognized feature gate: OSStreams Jun 08 13:43:52.225004 ip-10-0-140-46 kubenswrapper[2576]: W0608 13:43:52.221320 2576 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jun 08 13:43:52.225004 ip-10-0-140-46 kubenswrapper[2576]: W0608 13:43:52.221322 2576 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jun 08 13:43:52.225004 ip-10-0-140-46 kubenswrapper[2576]: W0608 13:43:52.221325 2576 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jun 08 13:43:52.225004 ip-10-0-140-46 kubenswrapper[2576]: W0608 13:43:52.221328 2576 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jun 08 13:43:52.225004 ip-10-0-140-46 kubenswrapper[2576]: W0608 13:43:52.221330 2576 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jun 08 13:43:52.225004 ip-10-0-140-46 kubenswrapper[2576]: W0608 13:43:52.221333 2576 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jun 08 13:43:52.225004 ip-10-0-140-46 kubenswrapper[2576]: W0608 13:43:52.221336 2576 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jun 08 13:43:52.225004 ip-10-0-140-46 kubenswrapper[2576]: W0608 13:43:52.221339 2576 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jun 08 13:43:52.225004 ip-10-0-140-46 kubenswrapper[2576]: W0608 13:43:52.221342 2576 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jun 08 13:43:52.225004 ip-10-0-140-46 kubenswrapper[2576]: W0608 13:43:52.221344 2576 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jun 08 13:43:52.225004 ip-10-0-140-46 kubenswrapper[2576]: W0608 13:43:52.221347 2576 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jun 08 13:43:52.225004 ip-10-0-140-46 kubenswrapper[2576]: W0608 13:43:52.221350 2576 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jun 08 13:43:52.225004 ip-10-0-140-46 kubenswrapper[2576]: W0608 13:43:52.221352 2576 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jun 08 13:43:52.225004 ip-10-0-140-46 kubenswrapper[2576]: W0608 13:43:52.221355 2576 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jun 08 13:43:52.225004 ip-10-0-140-46 kubenswrapper[2576]: W0608 13:43:52.221357 2576 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jun 08 13:43:52.225004 ip-10-0-140-46 kubenswrapper[2576]: W0608 13:43:52.221360 2576 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jun 08 13:43:52.225499 ip-10-0-140-46 kubenswrapper[2576]: W0608 13:43:52.221362 2576 feature_gate.go:328] unrecognized feature gate: OVNObservability Jun 08 13:43:52.225499 ip-10-0-140-46 kubenswrapper[2576]: W0608 13:43:52.221365 2576 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jun 08 13:43:52.225499 ip-10-0-140-46 kubenswrapper[2576]: W0608 13:43:52.221368 2576 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jun 08 13:43:52.225499 ip-10-0-140-46 kubenswrapper[2576]: W0608 13:43:52.221371 2576 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jun 08 13:43:52.225499 ip-10-0-140-46 kubenswrapper[2576]: W0608 13:43:52.221374 2576 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jun 08 13:43:52.225499 ip-10-0-140-46 kubenswrapper[2576]: W0608 13:43:52.221377 2576 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jun 08 13:43:52.225499 ip-10-0-140-46 kubenswrapper[2576]: W0608 13:43:52.221379 2576 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jun 08 13:43:52.225499 ip-10-0-140-46 kubenswrapper[2576]: W0608 13:43:52.221382 2576 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jun 08 13:43:52.225499 ip-10-0-140-46 kubenswrapper[2576]: W0608 13:43:52.221385 2576 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jun 08 13:43:52.225499 ip-10-0-140-46 kubenswrapper[2576]: W0608 13:43:52.221397 2576 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jun 08 13:43:52.225499 ip-10-0-140-46 kubenswrapper[2576]: W0608 13:43:52.221400 2576 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jun 08 13:43:52.225499 ip-10-0-140-46 kubenswrapper[2576]: W0608 13:43:52.221402 2576 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jun 08 13:43:52.225499 ip-10-0-140-46 kubenswrapper[2576]: W0608 13:43:52.221405 2576 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jun 08 13:43:52.225499 ip-10-0-140-46 kubenswrapper[2576]: W0608 13:43:52.221408 2576 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jun 08 13:43:52.225499 ip-10-0-140-46 kubenswrapper[2576]: W0608 13:43:52.221411 2576 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jun 08 13:43:52.225499 ip-10-0-140-46 kubenswrapper[2576]: W0608 13:43:52.221413 2576 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jun 08 13:43:52.225499 ip-10-0-140-46 kubenswrapper[2576]: W0608 13:43:52.221416 2576 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jun 08 13:43:52.225499 ip-10-0-140-46 kubenswrapper[2576]: W0608 13:43:52.221418 2576 feature_gate.go:328] unrecognized feature gate: Example Jun 08 13:43:52.225499 ip-10-0-140-46 kubenswrapper[2576]: W0608 13:43:52.221422 2576 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jun 08 13:43:52.225499 ip-10-0-140-46 kubenswrapper[2576]: W0608 13:43:52.221424 2576 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jun 08 13:43:52.226018 ip-10-0-140-46 kubenswrapper[2576]: W0608 13:43:52.221427 2576 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jun 08 13:43:52.226018 ip-10-0-140-46 kubenswrapper[2576]: W0608 13:43:52.221430 2576 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jun 08 13:43:52.226018 ip-10-0-140-46 kubenswrapper[2576]: W0608 13:43:52.221432 2576 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jun 08 13:43:52.226018 ip-10-0-140-46 kubenswrapper[2576]: W0608 13:43:52.221435 2576 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jun 08 13:43:52.226018 ip-10-0-140-46 kubenswrapper[2576]: W0608 13:43:52.221438 2576 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jun 08 13:43:52.226018 ip-10-0-140-46 kubenswrapper[2576]: W0608 13:43:52.221441 2576 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jun 08 13:43:52.226018 ip-10-0-140-46 kubenswrapper[2576]: W0608 13:43:52.221443 2576 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jun 08 13:43:52.226018 ip-10-0-140-46 kubenswrapper[2576]: W0608 13:43:52.221446 2576 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jun 08 13:43:52.226018 ip-10-0-140-46 kubenswrapper[2576]: W0608 13:43:52.221449 2576 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jun 08 13:43:52.226018 ip-10-0-140-46 kubenswrapper[2576]: W0608 13:43:52.221451 2576 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jun 08 13:43:52.226018 ip-10-0-140-46 kubenswrapper[2576]: W0608 13:43:52.221454 2576 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jun 08 13:43:52.226018 ip-10-0-140-46 kubenswrapper[2576]: W0608 13:43:52.221457 2576 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jun 08 13:43:52.226018 ip-10-0-140-46 kubenswrapper[2576]: W0608 13:43:52.221460 2576 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jun 08 13:43:52.226018 ip-10-0-140-46 kubenswrapper[2576]: W0608 13:43:52.221463 2576 feature_gate.go:328] unrecognized feature gate: PinnedImages Jun 08 13:43:52.226018 ip-10-0-140-46 kubenswrapper[2576]: W0608 13:43:52.221465 2576 feature_gate.go:328] unrecognized feature gate: EventTTL Jun 08 13:43:52.226018 ip-10-0-140-46 kubenswrapper[2576]: W0608 13:43:52.221468 2576 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jun 08 13:43:52.226018 ip-10-0-140-46 kubenswrapper[2576]: W0608 13:43:52.221471 2576 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jun 08 13:43:52.226018 ip-10-0-140-46 kubenswrapper[2576]: W0608 13:43:52.221473 2576 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jun 08 13:43:52.226018 ip-10-0-140-46 kubenswrapper[2576]: W0608 13:43:52.221476 2576 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jun 08 13:43:52.226018 ip-10-0-140-46 kubenswrapper[2576]: W0608 13:43:52.221478 2576 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jun 08 13:43:52.226493 ip-10-0-140-46 kubenswrapper[2576]: W0608 13:43:52.221481 2576 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jun 08 13:43:52.226493 ip-10-0-140-46 kubenswrapper[2576]: W0608 13:43:52.221483 2576 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jun 08 13:43:52.226493 ip-10-0-140-46 kubenswrapper[2576]: W0608 13:43:52.221486 2576 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jun 08 13:43:52.226493 ip-10-0-140-46 kubenswrapper[2576]: W0608 13:43:52.221490 2576 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jun 08 13:43:52.226493 ip-10-0-140-46 kubenswrapper[2576]: W0608 13:43:52.221493 2576 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jun 08 13:43:52.226493 ip-10-0-140-46 kubenswrapper[2576]: W0608 13:43:52.221496 2576 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jun 08 13:43:52.226493 ip-10-0-140-46 kubenswrapper[2576]: W0608 13:43:52.221498 2576 feature_gate.go:328] unrecognized feature gate: SignatureStores Jun 08 13:43:52.226493 ip-10-0-140-46 kubenswrapper[2576]: W0608 13:43:52.221501 2576 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jun 08 13:43:52.226493 ip-10-0-140-46 kubenswrapper[2576]: W0608 13:43:52.221503 2576 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jun 08 13:43:52.226493 ip-10-0-140-46 kubenswrapper[2576]: W0608 13:43:52.221506 2576 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jun 08 13:43:52.226493 ip-10-0-140-46 kubenswrapper[2576]: W0608 13:43:52.221509 2576 feature_gate.go:328] unrecognized feature gate: NewOLM Jun 08 13:43:52.226493 ip-10-0-140-46 kubenswrapper[2576]: W0608 13:43:52.221511 2576 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jun 08 13:43:52.226493 ip-10-0-140-46 kubenswrapper[2576]: W0608 13:43:52.221515 2576 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jun 08 13:43:52.226493 ip-10-0-140-46 kubenswrapper[2576]: W0608 13:43:52.221519 2576 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jun 08 13:43:52.226493 ip-10-0-140-46 kubenswrapper[2576]: W0608 13:43:52.221522 2576 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jun 08 13:43:52.226493 ip-10-0-140-46 kubenswrapper[2576]: W0608 13:43:52.221525 2576 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jun 08 13:43:52.226493 ip-10-0-140-46 kubenswrapper[2576]: W0608 13:43:52.221528 2576 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jun 08 13:43:52.226493 ip-10-0-140-46 kubenswrapper[2576]: W0608 13:43:52.221531 2576 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jun 08 13:43:52.226493 ip-10-0-140-46 kubenswrapper[2576]: W0608 13:43:52.221534 2576 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jun 08 13:43:52.226967 ip-10-0-140-46 kubenswrapper[2576]: I0608 13:43:52.221648 2576 flags.go:64] FLAG: --address="0.0.0.0" Jun 08 13:43:52.226967 ip-10-0-140-46 kubenswrapper[2576]: I0608 13:43:52.221675 2576 flags.go:64] FLAG: --allowed-unsafe-sysctls="[]" Jun 08 13:43:52.226967 ip-10-0-140-46 kubenswrapper[2576]: I0608 13:43:52.221685 2576 flags.go:64] FLAG: --anonymous-auth="true" Jun 08 13:43:52.226967 ip-10-0-140-46 kubenswrapper[2576]: I0608 13:43:52.221691 2576 flags.go:64] FLAG: --application-metrics-count-limit="100" Jun 08 13:43:52.226967 ip-10-0-140-46 kubenswrapper[2576]: I0608 13:43:52.221696 2576 flags.go:64] FLAG: --authentication-token-webhook="false" Jun 08 13:43:52.226967 ip-10-0-140-46 kubenswrapper[2576]: I0608 13:43:52.221699 2576 flags.go:64] FLAG: --authentication-token-webhook-cache-ttl="2m0s" Jun 08 13:43:52.226967 ip-10-0-140-46 kubenswrapper[2576]: I0608 13:43:52.221704 2576 flags.go:64] FLAG: --authorization-mode="AlwaysAllow" Jun 08 13:43:52.226967 ip-10-0-140-46 kubenswrapper[2576]: I0608 13:43:52.221708 2576 flags.go:64] FLAG: --authorization-webhook-cache-authorized-ttl="5m0s" Jun 08 13:43:52.226967 ip-10-0-140-46 kubenswrapper[2576]: I0608 13:43:52.221712 2576 flags.go:64] FLAG: --authorization-webhook-cache-unauthorized-ttl="30s" Jun 08 13:43:52.226967 ip-10-0-140-46 kubenswrapper[2576]: I0608 13:43:52.221715 2576 flags.go:64] FLAG: --boot-id-file="/proc/sys/kernel/random/boot_id" Jun 08 13:43:52.226967 ip-10-0-140-46 kubenswrapper[2576]: I0608 13:43:52.221718 2576 flags.go:64] FLAG: --bootstrap-kubeconfig="/etc/kubernetes/kubeconfig" Jun 08 13:43:52.226967 ip-10-0-140-46 kubenswrapper[2576]: I0608 13:43:52.221722 2576 flags.go:64] FLAG: --cert-dir="/var/lib/kubelet/pki" Jun 08 13:43:52.226967 ip-10-0-140-46 kubenswrapper[2576]: I0608 13:43:52.221725 2576 flags.go:64] FLAG: --cgroup-driver="cgroupfs" Jun 08 13:43:52.226967 ip-10-0-140-46 kubenswrapper[2576]: I0608 13:43:52.221728 2576 flags.go:64] FLAG: --cgroup-root="" Jun 08 13:43:52.226967 ip-10-0-140-46 kubenswrapper[2576]: I0608 13:43:52.221731 2576 flags.go:64] FLAG: --cgroups-per-qos="true" Jun 08 13:43:52.226967 ip-10-0-140-46 kubenswrapper[2576]: I0608 13:43:52.221734 2576 flags.go:64] FLAG: --client-ca-file="" Jun 08 13:43:52.226967 ip-10-0-140-46 kubenswrapper[2576]: I0608 13:43:52.221737 2576 flags.go:64] FLAG: --cloud-provider="external" Jun 08 13:43:52.226967 ip-10-0-140-46 kubenswrapper[2576]: I0608 13:43:52.221740 2576 flags.go:64] FLAG: --cluster-dns="[]" Jun 08 13:43:52.226967 ip-10-0-140-46 kubenswrapper[2576]: I0608 13:43:52.221745 2576 flags.go:64] FLAG: --cluster-domain="" Jun 08 13:43:52.226967 ip-10-0-140-46 kubenswrapper[2576]: I0608 13:43:52.221748 2576 flags.go:64] FLAG: --config="/etc/kubernetes/kubelet.conf" Jun 08 13:43:52.226967 ip-10-0-140-46 kubenswrapper[2576]: I0608 13:43:52.221752 2576 flags.go:64] FLAG: --config-dir="/etc/openshift/kubelet.conf.d" Jun 08 13:43:52.226967 ip-10-0-140-46 kubenswrapper[2576]: I0608 13:43:52.221755 2576 flags.go:64] FLAG: --container-hints="/etc/cadvisor/container_hints.json" Jun 08 13:43:52.226967 ip-10-0-140-46 kubenswrapper[2576]: I0608 13:43:52.221758 2576 flags.go:64] FLAG: --container-log-max-files="5" Jun 08 13:43:52.226967 ip-10-0-140-46 kubenswrapper[2576]: I0608 13:43:52.221762 2576 flags.go:64] FLAG: --container-log-max-size="10Mi" Jun 08 13:43:52.227529 ip-10-0-140-46 kubenswrapper[2576]: I0608 13:43:52.221765 2576 flags.go:64] FLAG: --container-runtime-endpoint="/var/run/crio/crio.sock" Jun 08 13:43:52.227529 ip-10-0-140-46 kubenswrapper[2576]: I0608 13:43:52.221768 2576 flags.go:64] FLAG: --containerd="/run/containerd/containerd.sock" Jun 08 13:43:52.227529 ip-10-0-140-46 kubenswrapper[2576]: I0608 13:43:52.221772 2576 flags.go:64] FLAG: --containerd-namespace="k8s.io" Jun 08 13:43:52.227529 ip-10-0-140-46 kubenswrapper[2576]: I0608 13:43:52.221775 2576 flags.go:64] FLAG: --contention-profiling="false" Jun 08 13:43:52.227529 ip-10-0-140-46 kubenswrapper[2576]: I0608 13:43:52.221778 2576 flags.go:64] FLAG: --cpu-cfs-quota="true" Jun 08 13:43:52.227529 ip-10-0-140-46 kubenswrapper[2576]: I0608 13:43:52.221781 2576 flags.go:64] FLAG: --cpu-cfs-quota-period="100ms" Jun 08 13:43:52.227529 ip-10-0-140-46 kubenswrapper[2576]: I0608 13:43:52.221784 2576 flags.go:64] FLAG: --cpu-manager-policy="none" Jun 08 13:43:52.227529 ip-10-0-140-46 kubenswrapper[2576]: I0608 13:43:52.221787 2576 flags.go:64] FLAG: --cpu-manager-policy-options="" Jun 08 13:43:52.227529 ip-10-0-140-46 kubenswrapper[2576]: I0608 13:43:52.221792 2576 flags.go:64] FLAG: --cpu-manager-reconcile-period="10s" Jun 08 13:43:52.227529 ip-10-0-140-46 kubenswrapper[2576]: I0608 13:43:52.221796 2576 flags.go:64] FLAG: --enable-controller-attach-detach="true" Jun 08 13:43:52.227529 ip-10-0-140-46 kubenswrapper[2576]: I0608 13:43:52.221800 2576 flags.go:64] FLAG: --enable-debugging-handlers="true" Jun 08 13:43:52.227529 ip-10-0-140-46 kubenswrapper[2576]: I0608 13:43:52.221803 2576 flags.go:64] FLAG: --enable-load-reader="false" Jun 08 13:43:52.227529 ip-10-0-140-46 kubenswrapper[2576]: I0608 13:43:52.221807 2576 flags.go:64] FLAG: --enable-server="true" Jun 08 13:43:52.227529 ip-10-0-140-46 kubenswrapper[2576]: I0608 13:43:52.221810 2576 flags.go:64] FLAG: --enforce-node-allocatable="[pods]" Jun 08 13:43:52.227529 ip-10-0-140-46 kubenswrapper[2576]: I0608 13:43:52.221816 2576 flags.go:64] FLAG: --event-burst="100" Jun 08 13:43:52.227529 ip-10-0-140-46 kubenswrapper[2576]: I0608 13:43:52.221820 2576 flags.go:64] FLAG: --event-qps="50" Jun 08 13:43:52.227529 ip-10-0-140-46 kubenswrapper[2576]: I0608 13:43:52.221823 2576 flags.go:64] FLAG: --event-storage-age-limit="default=0" Jun 08 13:43:52.227529 ip-10-0-140-46 kubenswrapper[2576]: I0608 13:43:52.221827 2576 flags.go:64] FLAG: --event-storage-event-limit="default=0" Jun 08 13:43:52.227529 ip-10-0-140-46 kubenswrapper[2576]: I0608 13:43:52.221830 2576 flags.go:64] FLAG: --eviction-hard="" Jun 08 13:43:52.227529 ip-10-0-140-46 kubenswrapper[2576]: I0608 13:43:52.221834 2576 flags.go:64] FLAG: --eviction-max-pod-grace-period="0" Jun 08 13:43:52.227529 ip-10-0-140-46 kubenswrapper[2576]: I0608 13:43:52.221837 2576 flags.go:64] FLAG: --eviction-minimum-reclaim="" Jun 08 13:43:52.227529 ip-10-0-140-46 kubenswrapper[2576]: I0608 13:43:52.221839 2576 flags.go:64] FLAG: --eviction-pressure-transition-period="5m0s" Jun 08 13:43:52.227529 ip-10-0-140-46 kubenswrapper[2576]: I0608 13:43:52.221842 2576 flags.go:64] FLAG: --eviction-soft="" Jun 08 13:43:52.227529 ip-10-0-140-46 kubenswrapper[2576]: I0608 13:43:52.221845 2576 flags.go:64] FLAG: --eviction-soft-grace-period="" Jun 08 13:43:52.227529 ip-10-0-140-46 kubenswrapper[2576]: I0608 13:43:52.221848 2576 flags.go:64] FLAG: --exit-on-lock-contention="false" Jun 08 13:43:52.228174 ip-10-0-140-46 kubenswrapper[2576]: I0608 13:43:52.221851 2576 flags.go:64] FLAG: --experimental-allocatable-ignore-eviction="false" Jun 08 13:43:52.228174 ip-10-0-140-46 kubenswrapper[2576]: I0608 13:43:52.221854 2576 flags.go:64] FLAG: --experimental-mounter-path="" Jun 08 13:43:52.228174 ip-10-0-140-46 kubenswrapper[2576]: I0608 13:43:52.221857 2576 flags.go:64] FLAG: --fail-cgroupv1="false" Jun 08 13:43:52.228174 ip-10-0-140-46 kubenswrapper[2576]: I0608 13:43:52.221860 2576 flags.go:64] FLAG: --fail-swap-on="true" Jun 08 13:43:52.228174 ip-10-0-140-46 kubenswrapper[2576]: I0608 13:43:52.221863 2576 flags.go:64] FLAG: --feature-gates="" Jun 08 13:43:52.228174 ip-10-0-140-46 kubenswrapper[2576]: I0608 13:43:52.221866 2576 flags.go:64] FLAG: --file-check-frequency="20s" Jun 08 13:43:52.228174 ip-10-0-140-46 kubenswrapper[2576]: I0608 13:43:52.221870 2576 flags.go:64] FLAG: --global-housekeeping-interval="1m0s" Jun 08 13:43:52.228174 ip-10-0-140-46 kubenswrapper[2576]: I0608 13:43:52.221873 2576 flags.go:64] FLAG: --hairpin-mode="promiscuous-bridge" Jun 08 13:43:52.228174 ip-10-0-140-46 kubenswrapper[2576]: I0608 13:43:52.221876 2576 flags.go:64] FLAG: --healthz-bind-address="127.0.0.1" Jun 08 13:43:52.228174 ip-10-0-140-46 kubenswrapper[2576]: I0608 13:43:52.221879 2576 flags.go:64] FLAG: --healthz-port="10248" Jun 08 13:43:52.228174 ip-10-0-140-46 kubenswrapper[2576]: I0608 13:43:52.221882 2576 flags.go:64] FLAG: --help="false" Jun 08 13:43:52.228174 ip-10-0-140-46 kubenswrapper[2576]: I0608 13:43:52.221886 2576 flags.go:64] FLAG: --hostname-override="ip-10-0-140-46.ec2.internal" Jun 08 13:43:52.228174 ip-10-0-140-46 kubenswrapper[2576]: I0608 13:43:52.221889 2576 flags.go:64] FLAG: --housekeeping-interval="10s" Jun 08 13:43:52.228174 ip-10-0-140-46 kubenswrapper[2576]: I0608 13:43:52.221892 2576 flags.go:64] FLAG: --http-check-frequency="20s" Jun 08 13:43:52.228174 ip-10-0-140-46 kubenswrapper[2576]: I0608 13:43:52.221895 2576 flags.go:64] FLAG: --image-credential-provider-bin-dir="/usr/libexec/kubelet-image-credential-provider-plugins" Jun 08 13:43:52.228174 ip-10-0-140-46 kubenswrapper[2576]: I0608 13:43:52.221899 2576 flags.go:64] FLAG: --image-credential-provider-config="/etc/kubernetes/credential-providers/ecr-credential-provider.yaml" Jun 08 13:43:52.228174 ip-10-0-140-46 kubenswrapper[2576]: I0608 13:43:52.221909 2576 flags.go:64] FLAG: --image-gc-high-threshold="85" Jun 08 13:43:52.228174 ip-10-0-140-46 kubenswrapper[2576]: I0608 13:43:52.221913 2576 flags.go:64] FLAG: --image-gc-low-threshold="80" Jun 08 13:43:52.228174 ip-10-0-140-46 kubenswrapper[2576]: I0608 13:43:52.221916 2576 flags.go:64] FLAG: --image-service-endpoint="" Jun 08 13:43:52.228174 ip-10-0-140-46 kubenswrapper[2576]: I0608 13:43:52.221919 2576 flags.go:64] FLAG: --kernel-memcg-notification="false" Jun 08 13:43:52.228174 ip-10-0-140-46 kubenswrapper[2576]: I0608 13:43:52.221922 2576 flags.go:64] FLAG: --kube-api-burst="100" Jun 08 13:43:52.228174 ip-10-0-140-46 kubenswrapper[2576]: I0608 13:43:52.221925 2576 flags.go:64] FLAG: --kube-api-content-type="application/vnd.kubernetes.protobuf" Jun 08 13:43:52.228174 ip-10-0-140-46 kubenswrapper[2576]: I0608 13:43:52.221929 2576 flags.go:64] FLAG: --kube-api-qps="50" Jun 08 13:43:52.228174 ip-10-0-140-46 kubenswrapper[2576]: I0608 13:43:52.221932 2576 flags.go:64] FLAG: --kube-reserved="" Jun 08 13:43:52.228781 ip-10-0-140-46 kubenswrapper[2576]: I0608 13:43:52.221934 2576 flags.go:64] FLAG: --kube-reserved-cgroup="" Jun 08 13:43:52.228781 ip-10-0-140-46 kubenswrapper[2576]: I0608 13:43:52.221937 2576 flags.go:64] FLAG: --kubeconfig="/var/lib/kubelet/kubeconfig" Jun 08 13:43:52.228781 ip-10-0-140-46 kubenswrapper[2576]: I0608 13:43:52.221940 2576 flags.go:64] FLAG: --kubelet-cgroups="" Jun 08 13:43:52.228781 ip-10-0-140-46 kubenswrapper[2576]: I0608 13:43:52.221943 2576 flags.go:64] FLAG: --local-storage-capacity-isolation="true" Jun 08 13:43:52.228781 ip-10-0-140-46 kubenswrapper[2576]: I0608 13:43:52.221946 2576 flags.go:64] FLAG: --lock-file="" Jun 08 13:43:52.228781 ip-10-0-140-46 kubenswrapper[2576]: I0608 13:43:52.221949 2576 flags.go:64] FLAG: --log-cadvisor-usage="false" Jun 08 13:43:52.228781 ip-10-0-140-46 kubenswrapper[2576]: I0608 13:43:52.221952 2576 flags.go:64] FLAG: --log-flush-frequency="5s" Jun 08 13:43:52.228781 ip-10-0-140-46 kubenswrapper[2576]: I0608 13:43:52.221956 2576 flags.go:64] FLAG: --log-json-info-buffer-size="0" Jun 08 13:43:52.228781 ip-10-0-140-46 kubenswrapper[2576]: I0608 13:43:52.221962 2576 flags.go:64] FLAG: --log-json-split-stream="false" Jun 08 13:43:52.228781 ip-10-0-140-46 kubenswrapper[2576]: I0608 13:43:52.221965 2576 flags.go:64] FLAG: --log-text-info-buffer-size="0" Jun 08 13:43:52.228781 ip-10-0-140-46 kubenswrapper[2576]: I0608 13:43:52.221968 2576 flags.go:64] FLAG: --log-text-split-stream="false" Jun 08 13:43:52.228781 ip-10-0-140-46 kubenswrapper[2576]: I0608 13:43:52.221971 2576 flags.go:64] FLAG: --logging-format="text" Jun 08 13:43:52.228781 ip-10-0-140-46 kubenswrapper[2576]: I0608 13:43:52.221974 2576 flags.go:64] FLAG: --machine-id-file="/etc/machine-id,/var/lib/dbus/machine-id" Jun 08 13:43:52.228781 ip-10-0-140-46 kubenswrapper[2576]: I0608 13:43:52.221978 2576 flags.go:64] FLAG: --make-iptables-util-chains="true" Jun 08 13:43:52.228781 ip-10-0-140-46 kubenswrapper[2576]: I0608 13:43:52.221980 2576 flags.go:64] FLAG: --manifest-url="" Jun 08 13:43:52.228781 ip-10-0-140-46 kubenswrapper[2576]: I0608 13:43:52.221983 2576 flags.go:64] FLAG: --manifest-url-header="" Jun 08 13:43:52.228781 ip-10-0-140-46 kubenswrapper[2576]: I0608 13:43:52.221988 2576 flags.go:64] FLAG: --max-housekeeping-interval="15s" Jun 08 13:43:52.228781 ip-10-0-140-46 kubenswrapper[2576]: I0608 13:43:52.221991 2576 flags.go:64] FLAG: --max-open-files="1000000" Jun 08 13:43:52.228781 ip-10-0-140-46 kubenswrapper[2576]: I0608 13:43:52.221995 2576 flags.go:64] FLAG: --max-pods="110" Jun 08 13:43:52.228781 ip-10-0-140-46 kubenswrapper[2576]: I0608 13:43:52.221998 2576 flags.go:64] FLAG: --maximum-dead-containers="-1" Jun 08 13:43:52.228781 ip-10-0-140-46 kubenswrapper[2576]: I0608 13:43:52.222001 2576 flags.go:64] FLAG: --maximum-dead-containers-per-container="1" Jun 08 13:43:52.228781 ip-10-0-140-46 kubenswrapper[2576]: I0608 13:43:52.222004 2576 flags.go:64] FLAG: --memory-manager-policy="None" Jun 08 13:43:52.228781 ip-10-0-140-46 kubenswrapper[2576]: I0608 13:43:52.222006 2576 flags.go:64] FLAG: --minimum-container-ttl-duration="6m0s" Jun 08 13:43:52.228781 ip-10-0-140-46 kubenswrapper[2576]: I0608 13:43:52.222010 2576 flags.go:64] FLAG: --minimum-image-ttl-duration="2m0s" Jun 08 13:43:52.228781 ip-10-0-140-46 kubenswrapper[2576]: I0608 13:43:52.222016 2576 flags.go:64] FLAG: --node-ip="0.0.0.0" Jun 08 13:43:52.229383 ip-10-0-140-46 kubenswrapper[2576]: I0608 13:43:52.222019 2576 flags.go:64] FLAG: --node-labels="node-role.kubernetes.io/worker=,node.openshift.io/os_id=rhel" Jun 08 13:43:52.229383 ip-10-0-140-46 kubenswrapper[2576]: I0608 13:43:52.222027 2576 flags.go:64] FLAG: --node-status-max-images="50" Jun 08 13:43:52.229383 ip-10-0-140-46 kubenswrapper[2576]: I0608 13:43:52.222031 2576 flags.go:64] FLAG: --node-status-update-frequency="10s" Jun 08 13:43:52.229383 ip-10-0-140-46 kubenswrapper[2576]: I0608 13:43:52.222034 2576 flags.go:64] FLAG: --oom-score-adj="-999" Jun 08 13:43:52.229383 ip-10-0-140-46 kubenswrapper[2576]: I0608 13:43:52.222037 2576 flags.go:64] FLAG: --pod-cidr="" Jun 08 13:43:52.229383 ip-10-0-140-46 kubenswrapper[2576]: I0608 13:43:52.222040 2576 flags.go:64] FLAG: --pod-infra-container-image="quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:746976bfb3a92b93dacc79c151b98fd4c932eef19c3e2c1516b14eebcac9184d" Jun 08 13:43:52.229383 ip-10-0-140-46 kubenswrapper[2576]: I0608 13:43:52.222045 2576 flags.go:64] FLAG: --pod-manifest-path="" Jun 08 13:43:52.229383 ip-10-0-140-46 kubenswrapper[2576]: I0608 13:43:52.222048 2576 flags.go:64] FLAG: --pod-max-pids="-1" Jun 08 13:43:52.229383 ip-10-0-140-46 kubenswrapper[2576]: I0608 13:43:52.222051 2576 flags.go:64] FLAG: --pods-per-core="0" Jun 08 13:43:52.229383 ip-10-0-140-46 kubenswrapper[2576]: I0608 13:43:52.222054 2576 flags.go:64] FLAG: --port="10250" Jun 08 13:43:52.229383 ip-10-0-140-46 kubenswrapper[2576]: I0608 13:43:52.222057 2576 flags.go:64] FLAG: --protect-kernel-defaults="false" Jun 08 13:43:52.229383 ip-10-0-140-46 kubenswrapper[2576]: I0608 13:43:52.222059 2576 flags.go:64] FLAG: --provider-id="aws:///us-east-1a/i-08090722864e7ee2c" Jun 08 13:43:52.229383 ip-10-0-140-46 kubenswrapper[2576]: I0608 13:43:52.222063 2576 flags.go:64] FLAG: --qos-reserved="" Jun 08 13:43:52.229383 ip-10-0-140-46 kubenswrapper[2576]: I0608 13:43:52.222066 2576 flags.go:64] FLAG: --read-only-port="10255" Jun 08 13:43:52.229383 ip-10-0-140-46 kubenswrapper[2576]: I0608 13:43:52.222070 2576 flags.go:64] FLAG: --register-node="true" Jun 08 13:43:52.229383 ip-10-0-140-46 kubenswrapper[2576]: I0608 13:43:52.222072 2576 flags.go:64] FLAG: --register-with-taints="" Jun 08 13:43:52.229383 ip-10-0-140-46 kubenswrapper[2576]: I0608 13:43:52.222076 2576 flags.go:64] FLAG: --registry-burst="10" Jun 08 13:43:52.229383 ip-10-0-140-46 kubenswrapper[2576]: I0608 13:43:52.222079 2576 flags.go:64] FLAG: --registry-qps="5" Jun 08 13:43:52.229383 ip-10-0-140-46 kubenswrapper[2576]: I0608 13:43:52.222082 2576 flags.go:64] FLAG: --reserved-cpus="" Jun 08 13:43:52.229383 ip-10-0-140-46 kubenswrapper[2576]: I0608 13:43:52.222085 2576 flags.go:64] FLAG: --reserved-memory="" Jun 08 13:43:52.229383 ip-10-0-140-46 kubenswrapper[2576]: I0608 13:43:52.222089 2576 flags.go:64] FLAG: --resolv-conf="/etc/resolv.conf" Jun 08 13:43:52.229383 ip-10-0-140-46 kubenswrapper[2576]: I0608 13:43:52.222092 2576 flags.go:64] FLAG: --root-dir="/var/lib/kubelet" Jun 08 13:43:52.229383 ip-10-0-140-46 kubenswrapper[2576]: I0608 13:43:52.222095 2576 flags.go:64] FLAG: --rotate-certificates="false" Jun 08 13:43:52.229383 ip-10-0-140-46 kubenswrapper[2576]: I0608 13:43:52.222098 2576 flags.go:64] FLAG: --rotate-server-certificates="false" Jun 08 13:43:52.229383 ip-10-0-140-46 kubenswrapper[2576]: I0608 13:43:52.222101 2576 flags.go:64] FLAG: --runonce="false" Jun 08 13:43:52.230049 ip-10-0-140-46 kubenswrapper[2576]: I0608 13:43:52.222104 2576 flags.go:64] FLAG: --runtime-cgroups="/system.slice/crio.service" Jun 08 13:43:52.230049 ip-10-0-140-46 kubenswrapper[2576]: I0608 13:43:52.222107 2576 flags.go:64] FLAG: --runtime-request-timeout="2m0s" Jun 08 13:43:52.230049 ip-10-0-140-46 kubenswrapper[2576]: I0608 13:43:52.222110 2576 flags.go:64] FLAG: --seccomp-default="false" Jun 08 13:43:52.230049 ip-10-0-140-46 kubenswrapper[2576]: I0608 13:43:52.222113 2576 flags.go:64] FLAG: --serialize-image-pulls="true" Jun 08 13:43:52.230049 ip-10-0-140-46 kubenswrapper[2576]: I0608 13:43:52.222116 2576 flags.go:64] FLAG: --storage-driver-buffer-duration="1m0s" Jun 08 13:43:52.230049 ip-10-0-140-46 kubenswrapper[2576]: I0608 13:43:52.222119 2576 flags.go:64] FLAG: --storage-driver-db="cadvisor" Jun 08 13:43:52.230049 ip-10-0-140-46 kubenswrapper[2576]: I0608 13:43:52.222123 2576 flags.go:64] FLAG: --storage-driver-host="localhost:8086" Jun 08 13:43:52.230049 ip-10-0-140-46 kubenswrapper[2576]: I0608 13:43:52.222127 2576 flags.go:64] FLAG: --storage-driver-password="root" Jun 08 13:43:52.230049 ip-10-0-140-46 kubenswrapper[2576]: I0608 13:43:52.222130 2576 flags.go:64] FLAG: --storage-driver-secure="false" Jun 08 13:43:52.230049 ip-10-0-140-46 kubenswrapper[2576]: I0608 13:43:52.222134 2576 flags.go:64] FLAG: --storage-driver-table="stats" Jun 08 13:43:52.230049 ip-10-0-140-46 kubenswrapper[2576]: I0608 13:43:52.222137 2576 flags.go:64] FLAG: --storage-driver-user="root" Jun 08 13:43:52.230049 ip-10-0-140-46 kubenswrapper[2576]: I0608 13:43:52.222140 2576 flags.go:64] FLAG: --streaming-connection-idle-timeout="4h0m0s" Jun 08 13:43:52.230049 ip-10-0-140-46 kubenswrapper[2576]: I0608 13:43:52.222144 2576 flags.go:64] FLAG: --sync-frequency="1m0s" Jun 08 13:43:52.230049 ip-10-0-140-46 kubenswrapper[2576]: I0608 13:43:52.222147 2576 flags.go:64] FLAG: --system-cgroups="" Jun 08 13:43:52.230049 ip-10-0-140-46 kubenswrapper[2576]: I0608 13:43:52.222150 2576 flags.go:64] FLAG: --system-reserved="cpu=500m,ephemeral-storage=1Gi,memory=1Gi" Jun 08 13:43:52.230049 ip-10-0-140-46 kubenswrapper[2576]: I0608 13:43:52.222157 2576 flags.go:64] FLAG: --system-reserved-cgroup="" Jun 08 13:43:52.230049 ip-10-0-140-46 kubenswrapper[2576]: I0608 13:43:52.222160 2576 flags.go:64] FLAG: --tls-cert-file="" Jun 08 13:43:52.230049 ip-10-0-140-46 kubenswrapper[2576]: I0608 13:43:52.222163 2576 flags.go:64] FLAG: --tls-cipher-suites="[]" Jun 08 13:43:52.230049 ip-10-0-140-46 kubenswrapper[2576]: I0608 13:43:52.222709 2576 flags.go:64] FLAG: --tls-min-version="" Jun 08 13:43:52.230049 ip-10-0-140-46 kubenswrapper[2576]: I0608 13:43:52.222712 2576 flags.go:64] FLAG: --tls-private-key-file="" Jun 08 13:43:52.230049 ip-10-0-140-46 kubenswrapper[2576]: I0608 13:43:52.222716 2576 flags.go:64] FLAG: --topology-manager-policy="none" Jun 08 13:43:52.230049 ip-10-0-140-46 kubenswrapper[2576]: I0608 13:43:52.222719 2576 flags.go:64] FLAG: --topology-manager-policy-options="" Jun 08 13:43:52.230049 ip-10-0-140-46 kubenswrapper[2576]: I0608 13:43:52.222722 2576 flags.go:64] FLAG: --topology-manager-scope="container" Jun 08 13:43:52.230049 ip-10-0-140-46 kubenswrapper[2576]: I0608 13:43:52.222725 2576 flags.go:64] FLAG: --v="2" Jun 08 13:43:52.230049 ip-10-0-140-46 kubenswrapper[2576]: I0608 13:43:52.222730 2576 flags.go:64] FLAG: --version="false" Jun 08 13:43:52.230685 ip-10-0-140-46 kubenswrapper[2576]: I0608 13:43:52.222734 2576 flags.go:64] FLAG: --vmodule="" Jun 08 13:43:52.230685 ip-10-0-140-46 kubenswrapper[2576]: I0608 13:43:52.222738 2576 flags.go:64] FLAG: --volume-plugin-dir="/etc/kubernetes/kubelet-plugins/volume/exec" Jun 08 13:43:52.230685 ip-10-0-140-46 kubenswrapper[2576]: I0608 13:43:52.222741 2576 flags.go:64] FLAG: --volume-stats-agg-period="1m0s" Jun 08 13:43:52.230685 ip-10-0-140-46 kubenswrapper[2576]: W0608 13:43:52.222872 2576 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jun 08 13:43:52.230685 ip-10-0-140-46 kubenswrapper[2576]: W0608 13:43:52.222877 2576 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jun 08 13:43:52.230685 ip-10-0-140-46 kubenswrapper[2576]: W0608 13:43:52.222880 2576 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jun 08 13:43:52.230685 ip-10-0-140-46 kubenswrapper[2576]: W0608 13:43:52.222883 2576 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jun 08 13:43:52.230685 ip-10-0-140-46 kubenswrapper[2576]: W0608 13:43:52.222885 2576 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jun 08 13:43:52.230685 ip-10-0-140-46 kubenswrapper[2576]: W0608 13:43:52.222888 2576 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jun 08 13:43:52.230685 ip-10-0-140-46 kubenswrapper[2576]: W0608 13:43:52.222890 2576 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jun 08 13:43:52.230685 ip-10-0-140-46 kubenswrapper[2576]: W0608 13:43:52.222893 2576 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jun 08 13:43:52.230685 ip-10-0-140-46 kubenswrapper[2576]: W0608 13:43:52.222896 2576 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jun 08 13:43:52.230685 ip-10-0-140-46 kubenswrapper[2576]: W0608 13:43:52.222898 2576 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jun 08 13:43:52.230685 ip-10-0-140-46 kubenswrapper[2576]: W0608 13:43:52.222902 2576 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jun 08 13:43:52.230685 ip-10-0-140-46 kubenswrapper[2576]: W0608 13:43:52.222906 2576 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jun 08 13:43:52.230685 ip-10-0-140-46 kubenswrapper[2576]: W0608 13:43:52.222909 2576 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jun 08 13:43:52.230685 ip-10-0-140-46 kubenswrapper[2576]: W0608 13:43:52.222912 2576 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jun 08 13:43:52.230685 ip-10-0-140-46 kubenswrapper[2576]: W0608 13:43:52.222915 2576 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jun 08 13:43:52.230685 ip-10-0-140-46 kubenswrapper[2576]: W0608 13:43:52.222918 2576 feature_gate.go:328] unrecognized feature gate: SignatureStores Jun 08 13:43:52.230685 ip-10-0-140-46 kubenswrapper[2576]: W0608 13:43:52.222920 2576 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jun 08 13:43:52.231177 ip-10-0-140-46 kubenswrapper[2576]: W0608 13:43:52.222923 2576 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jun 08 13:43:52.231177 ip-10-0-140-46 kubenswrapper[2576]: W0608 13:43:52.222926 2576 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jun 08 13:43:52.231177 ip-10-0-140-46 kubenswrapper[2576]: W0608 13:43:52.222928 2576 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jun 08 13:43:52.231177 ip-10-0-140-46 kubenswrapper[2576]: W0608 13:43:52.222931 2576 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jun 08 13:43:52.231177 ip-10-0-140-46 kubenswrapper[2576]: W0608 13:43:52.222933 2576 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jun 08 13:43:52.231177 ip-10-0-140-46 kubenswrapper[2576]: W0608 13:43:52.222936 2576 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jun 08 13:43:52.231177 ip-10-0-140-46 kubenswrapper[2576]: W0608 13:43:52.222938 2576 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jun 08 13:43:52.231177 ip-10-0-140-46 kubenswrapper[2576]: W0608 13:43:52.222941 2576 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jun 08 13:43:52.231177 ip-10-0-140-46 kubenswrapper[2576]: W0608 13:43:52.222944 2576 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jun 08 13:43:52.231177 ip-10-0-140-46 kubenswrapper[2576]: W0608 13:43:52.222948 2576 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jun 08 13:43:52.231177 ip-10-0-140-46 kubenswrapper[2576]: W0608 13:43:52.222953 2576 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jun 08 13:43:52.231177 ip-10-0-140-46 kubenswrapper[2576]: W0608 13:43:52.222955 2576 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jun 08 13:43:52.231177 ip-10-0-140-46 kubenswrapper[2576]: W0608 13:43:52.222958 2576 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jun 08 13:43:52.231177 ip-10-0-140-46 kubenswrapper[2576]: W0608 13:43:52.222961 2576 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jun 08 13:43:52.231177 ip-10-0-140-46 kubenswrapper[2576]: W0608 13:43:52.222964 2576 feature_gate.go:328] unrecognized feature gate: OSStreams Jun 08 13:43:52.231177 ip-10-0-140-46 kubenswrapper[2576]: W0608 13:43:52.222967 2576 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jun 08 13:43:52.231177 ip-10-0-140-46 kubenswrapper[2576]: W0608 13:43:52.222969 2576 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jun 08 13:43:52.231177 ip-10-0-140-46 kubenswrapper[2576]: W0608 13:43:52.222972 2576 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jun 08 13:43:52.231177 ip-10-0-140-46 kubenswrapper[2576]: W0608 13:43:52.222974 2576 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jun 08 13:43:52.231682 ip-10-0-140-46 kubenswrapper[2576]: W0608 13:43:52.222977 2576 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jun 08 13:43:52.231682 ip-10-0-140-46 kubenswrapper[2576]: W0608 13:43:52.222979 2576 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jun 08 13:43:52.231682 ip-10-0-140-46 kubenswrapper[2576]: W0608 13:43:52.222982 2576 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jun 08 13:43:52.231682 ip-10-0-140-46 kubenswrapper[2576]: W0608 13:43:52.222984 2576 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jun 08 13:43:52.231682 ip-10-0-140-46 kubenswrapper[2576]: W0608 13:43:52.222987 2576 feature_gate.go:328] unrecognized feature gate: Example2 Jun 08 13:43:52.231682 ip-10-0-140-46 kubenswrapper[2576]: W0608 13:43:52.222990 2576 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jun 08 13:43:52.231682 ip-10-0-140-46 kubenswrapper[2576]: W0608 13:43:52.222994 2576 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jun 08 13:43:52.231682 ip-10-0-140-46 kubenswrapper[2576]: W0608 13:43:52.222998 2576 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jun 08 13:43:52.231682 ip-10-0-140-46 kubenswrapper[2576]: W0608 13:43:52.223000 2576 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jun 08 13:43:52.231682 ip-10-0-140-46 kubenswrapper[2576]: W0608 13:43:52.223003 2576 feature_gate.go:328] unrecognized feature gate: OVNObservability Jun 08 13:43:52.231682 ip-10-0-140-46 kubenswrapper[2576]: W0608 13:43:52.223005 2576 feature_gate.go:328] unrecognized feature gate: PinnedImages Jun 08 13:43:52.231682 ip-10-0-140-46 kubenswrapper[2576]: W0608 13:43:52.223009 2576 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jun 08 13:43:52.231682 ip-10-0-140-46 kubenswrapper[2576]: W0608 13:43:52.223012 2576 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jun 08 13:43:52.231682 ip-10-0-140-46 kubenswrapper[2576]: W0608 13:43:52.223015 2576 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jun 08 13:43:52.231682 ip-10-0-140-46 kubenswrapper[2576]: W0608 13:43:52.223018 2576 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jun 08 13:43:52.231682 ip-10-0-140-46 kubenswrapper[2576]: W0608 13:43:52.223021 2576 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jun 08 13:43:52.231682 ip-10-0-140-46 kubenswrapper[2576]: W0608 13:43:52.223023 2576 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jun 08 13:43:52.231682 ip-10-0-140-46 kubenswrapper[2576]: W0608 13:43:52.223027 2576 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jun 08 13:43:52.231682 ip-10-0-140-46 kubenswrapper[2576]: W0608 13:43:52.223031 2576 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jun 08 13:43:52.231682 ip-10-0-140-46 kubenswrapper[2576]: W0608 13:43:52.223034 2576 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jun 08 13:43:52.232172 ip-10-0-140-46 kubenswrapper[2576]: W0608 13:43:52.223037 2576 feature_gate.go:328] unrecognized feature gate: DualReplica Jun 08 13:43:52.232172 ip-10-0-140-46 kubenswrapper[2576]: W0608 13:43:52.223039 2576 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jun 08 13:43:52.232172 ip-10-0-140-46 kubenswrapper[2576]: W0608 13:43:52.223042 2576 feature_gate.go:328] unrecognized feature gate: NewOLM Jun 08 13:43:52.232172 ip-10-0-140-46 kubenswrapper[2576]: W0608 13:43:52.223045 2576 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jun 08 13:43:52.232172 ip-10-0-140-46 kubenswrapper[2576]: W0608 13:43:52.223048 2576 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jun 08 13:43:52.232172 ip-10-0-140-46 kubenswrapper[2576]: W0608 13:43:52.223050 2576 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jun 08 13:43:52.232172 ip-10-0-140-46 kubenswrapper[2576]: W0608 13:43:52.223053 2576 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jun 08 13:43:52.232172 ip-10-0-140-46 kubenswrapper[2576]: W0608 13:43:52.223056 2576 feature_gate.go:328] unrecognized feature gate: Example Jun 08 13:43:52.232172 ip-10-0-140-46 kubenswrapper[2576]: W0608 13:43:52.223058 2576 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jun 08 13:43:52.232172 ip-10-0-140-46 kubenswrapper[2576]: W0608 13:43:52.223061 2576 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jun 08 13:43:52.232172 ip-10-0-140-46 kubenswrapper[2576]: W0608 13:43:52.223064 2576 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jun 08 13:43:52.232172 ip-10-0-140-46 kubenswrapper[2576]: W0608 13:43:52.223066 2576 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jun 08 13:43:52.232172 ip-10-0-140-46 kubenswrapper[2576]: W0608 13:43:52.223069 2576 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jun 08 13:43:52.232172 ip-10-0-140-46 kubenswrapper[2576]: W0608 13:43:52.223071 2576 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jun 08 13:43:52.232172 ip-10-0-140-46 kubenswrapper[2576]: W0608 13:43:52.223074 2576 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jun 08 13:43:52.232172 ip-10-0-140-46 kubenswrapper[2576]: W0608 13:43:52.223076 2576 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jun 08 13:43:52.232172 ip-10-0-140-46 kubenswrapper[2576]: W0608 13:43:52.223079 2576 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jun 08 13:43:52.232172 ip-10-0-140-46 kubenswrapper[2576]: W0608 13:43:52.223082 2576 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jun 08 13:43:52.232172 ip-10-0-140-46 kubenswrapper[2576]: W0608 13:43:52.223085 2576 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jun 08 13:43:52.232172 ip-10-0-140-46 kubenswrapper[2576]: W0608 13:43:52.223090 2576 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jun 08 13:43:52.232700 ip-10-0-140-46 kubenswrapper[2576]: W0608 13:43:52.223093 2576 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jun 08 13:43:52.232700 ip-10-0-140-46 kubenswrapper[2576]: W0608 13:43:52.223095 2576 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jun 08 13:43:52.232700 ip-10-0-140-46 kubenswrapper[2576]: W0608 13:43:52.223098 2576 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jun 08 13:43:52.232700 ip-10-0-140-46 kubenswrapper[2576]: W0608 13:43:52.223101 2576 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jun 08 13:43:52.232700 ip-10-0-140-46 kubenswrapper[2576]: W0608 13:43:52.223107 2576 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jun 08 13:43:52.232700 ip-10-0-140-46 kubenswrapper[2576]: W0608 13:43:52.223110 2576 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jun 08 13:43:52.232700 ip-10-0-140-46 kubenswrapper[2576]: W0608 13:43:52.223112 2576 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jun 08 13:43:52.232700 ip-10-0-140-46 kubenswrapper[2576]: W0608 13:43:52.223115 2576 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jun 08 13:43:52.232700 ip-10-0-140-46 kubenswrapper[2576]: W0608 13:43:52.223117 2576 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jun 08 13:43:52.232700 ip-10-0-140-46 kubenswrapper[2576]: W0608 13:43:52.223120 2576 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jun 08 13:43:52.232700 ip-10-0-140-46 kubenswrapper[2576]: W0608 13:43:52.223122 2576 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jun 08 13:43:52.232700 ip-10-0-140-46 kubenswrapper[2576]: W0608 13:43:52.223125 2576 feature_gate.go:328] unrecognized feature gate: EventTTL Jun 08 13:43:52.232700 ip-10-0-140-46 kubenswrapper[2576]: W0608 13:43:52.223127 2576 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jun 08 13:43:52.232700 ip-10-0-140-46 kubenswrapper[2576]: W0608 13:43:52.223130 2576 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jun 08 13:43:52.232700 ip-10-0-140-46 kubenswrapper[2576]: W0608 13:43:52.223132 2576 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jun 08 13:43:52.232700 ip-10-0-140-46 kubenswrapper[2576]: W0608 13:43:52.223135 2576 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jun 08 13:43:52.232700 ip-10-0-140-46 kubenswrapper[2576]: W0608 13:43:52.223138 2576 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jun 08 13:43:52.232700 ip-10-0-140-46 kubenswrapper[2576]: W0608 13:43:52.223142 2576 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jun 08 13:43:52.232700 ip-10-0-140-46 kubenswrapper[2576]: W0608 13:43:52.223145 2576 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jun 08 13:43:52.233156 ip-10-0-140-46 kubenswrapper[2576]: W0608 13:43:52.223148 2576 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jun 08 13:43:52.233156 ip-10-0-140-46 kubenswrapper[2576]: W0608 13:43:52.223151 2576 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jun 08 13:43:52.233156 ip-10-0-140-46 kubenswrapper[2576]: W0608 13:43:52.223154 2576 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jun 08 13:43:52.233156 ip-10-0-140-46 kubenswrapper[2576]: W0608 13:43:52.223156 2576 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jun 08 13:43:52.233156 ip-10-0-140-46 kubenswrapper[2576]: I0608 13:43:52.223652 2576 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]} Jun 08 13:43:52.233156 ip-10-0-140-46 kubenswrapper[2576]: I0608 13:43:52.231383 2576 server.go:529] "Kubelet version" kubeletVersion="v1.34.8" Jun 08 13:43:52.233156 ip-10-0-140-46 kubenswrapper[2576]: I0608 13:43:52.231401 2576 server.go:531] "Golang settings" GOGC="" GOMAXPROCS="" GOTRACEBACK="" Jun 08 13:43:52.233156 ip-10-0-140-46 kubenswrapper[2576]: I0608 13:43:52.232270 2576 watchdog_linux.go:95] "Systemd watchdog is not enabled" Jun 08 13:43:52.233156 ip-10-0-140-46 kubenswrapper[2576]: I0608 13:43:52.232278 2576 watchdog_linux.go:137] "Systemd watchdog is not enabled or the interval is invalid, so health checking will not be started." Jun 08 13:43:52.233156 ip-10-0-140-46 kubenswrapper[2576]: W0608 13:43:52.232349 2576 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jun 08 13:43:52.233156 ip-10-0-140-46 kubenswrapper[2576]: W0608 13:43:52.232355 2576 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jun 08 13:43:52.233156 ip-10-0-140-46 kubenswrapper[2576]: W0608 13:43:52.232360 2576 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jun 08 13:43:52.233156 ip-10-0-140-46 kubenswrapper[2576]: W0608 13:43:52.232364 2576 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jun 08 13:43:52.233156 ip-10-0-140-46 kubenswrapper[2576]: W0608 13:43:52.232367 2576 feature_gate.go:328] unrecognized feature gate: EventTTL Jun 08 13:43:52.233514 ip-10-0-140-46 kubenswrapper[2576]: W0608 13:43:52.232370 2576 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jun 08 13:43:52.233514 ip-10-0-140-46 kubenswrapper[2576]: W0608 13:43:52.232374 2576 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jun 08 13:43:52.233514 ip-10-0-140-46 kubenswrapper[2576]: W0608 13:43:52.232377 2576 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jun 08 13:43:52.233514 ip-10-0-140-46 kubenswrapper[2576]: W0608 13:43:52.232379 2576 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jun 08 13:43:52.233514 ip-10-0-140-46 kubenswrapper[2576]: W0608 13:43:52.232382 2576 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jun 08 13:43:52.233514 ip-10-0-140-46 kubenswrapper[2576]: W0608 13:43:52.232385 2576 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jun 08 13:43:52.233514 ip-10-0-140-46 kubenswrapper[2576]: W0608 13:43:52.232387 2576 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jun 08 13:43:52.233514 ip-10-0-140-46 kubenswrapper[2576]: W0608 13:43:52.232390 2576 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jun 08 13:43:52.233514 ip-10-0-140-46 kubenswrapper[2576]: W0608 13:43:52.232393 2576 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jun 08 13:43:52.233514 ip-10-0-140-46 kubenswrapper[2576]: W0608 13:43:52.232396 2576 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jun 08 13:43:52.233514 ip-10-0-140-46 kubenswrapper[2576]: W0608 13:43:52.232399 2576 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jun 08 13:43:52.233514 ip-10-0-140-46 kubenswrapper[2576]: W0608 13:43:52.232401 2576 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jun 08 13:43:52.233514 ip-10-0-140-46 kubenswrapper[2576]: W0608 13:43:52.232404 2576 feature_gate.go:328] unrecognized feature gate: DualReplica Jun 08 13:43:52.233514 ip-10-0-140-46 kubenswrapper[2576]: W0608 13:43:52.232407 2576 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jun 08 13:43:52.233514 ip-10-0-140-46 kubenswrapper[2576]: W0608 13:43:52.232409 2576 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jun 08 13:43:52.233514 ip-10-0-140-46 kubenswrapper[2576]: W0608 13:43:52.232412 2576 feature_gate.go:328] unrecognized feature gate: OVNObservability Jun 08 13:43:52.233514 ip-10-0-140-46 kubenswrapper[2576]: W0608 13:43:52.232415 2576 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jun 08 13:43:52.233514 ip-10-0-140-46 kubenswrapper[2576]: W0608 13:43:52.232417 2576 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jun 08 13:43:52.233514 ip-10-0-140-46 kubenswrapper[2576]: W0608 13:43:52.232420 2576 feature_gate.go:328] unrecognized feature gate: PinnedImages Jun 08 13:43:52.233514 ip-10-0-140-46 kubenswrapper[2576]: W0608 13:43:52.232422 2576 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jun 08 13:43:52.234004 ip-10-0-140-46 kubenswrapper[2576]: W0608 13:43:52.232425 2576 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jun 08 13:43:52.234004 ip-10-0-140-46 kubenswrapper[2576]: W0608 13:43:52.232427 2576 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jun 08 13:43:52.234004 ip-10-0-140-46 kubenswrapper[2576]: W0608 13:43:52.232430 2576 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jun 08 13:43:52.234004 ip-10-0-140-46 kubenswrapper[2576]: W0608 13:43:52.232432 2576 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jun 08 13:43:52.234004 ip-10-0-140-46 kubenswrapper[2576]: W0608 13:43:52.232437 2576 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jun 08 13:43:52.234004 ip-10-0-140-46 kubenswrapper[2576]: W0608 13:43:52.232440 2576 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jun 08 13:43:52.234004 ip-10-0-140-46 kubenswrapper[2576]: W0608 13:43:52.232442 2576 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jun 08 13:43:52.234004 ip-10-0-140-46 kubenswrapper[2576]: W0608 13:43:52.232445 2576 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jun 08 13:43:52.234004 ip-10-0-140-46 kubenswrapper[2576]: W0608 13:43:52.232447 2576 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jun 08 13:43:52.234004 ip-10-0-140-46 kubenswrapper[2576]: W0608 13:43:52.232450 2576 feature_gate.go:328] unrecognized feature gate: OSStreams Jun 08 13:43:52.234004 ip-10-0-140-46 kubenswrapper[2576]: W0608 13:43:52.232453 2576 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jun 08 13:43:52.234004 ip-10-0-140-46 kubenswrapper[2576]: W0608 13:43:52.232456 2576 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jun 08 13:43:52.234004 ip-10-0-140-46 kubenswrapper[2576]: W0608 13:43:52.232458 2576 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jun 08 13:43:52.234004 ip-10-0-140-46 kubenswrapper[2576]: W0608 13:43:52.232460 2576 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jun 08 13:43:52.234004 ip-10-0-140-46 kubenswrapper[2576]: W0608 13:43:52.232463 2576 feature_gate.go:328] unrecognized feature gate: SignatureStores Jun 08 13:43:52.234004 ip-10-0-140-46 kubenswrapper[2576]: W0608 13:43:52.232466 2576 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jun 08 13:43:52.234004 ip-10-0-140-46 kubenswrapper[2576]: W0608 13:43:52.232470 2576 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jun 08 13:43:52.234004 ip-10-0-140-46 kubenswrapper[2576]: W0608 13:43:52.232473 2576 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jun 08 13:43:52.234004 ip-10-0-140-46 kubenswrapper[2576]: W0608 13:43:52.232476 2576 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jun 08 13:43:52.234466 ip-10-0-140-46 kubenswrapper[2576]: W0608 13:43:52.232479 2576 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jun 08 13:43:52.234466 ip-10-0-140-46 kubenswrapper[2576]: W0608 13:43:52.232482 2576 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jun 08 13:43:52.234466 ip-10-0-140-46 kubenswrapper[2576]: W0608 13:43:52.232484 2576 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jun 08 13:43:52.234466 ip-10-0-140-46 kubenswrapper[2576]: W0608 13:43:52.232487 2576 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jun 08 13:43:52.234466 ip-10-0-140-46 kubenswrapper[2576]: W0608 13:43:52.232490 2576 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jun 08 13:43:52.234466 ip-10-0-140-46 kubenswrapper[2576]: W0608 13:43:52.232493 2576 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jun 08 13:43:52.234466 ip-10-0-140-46 kubenswrapper[2576]: W0608 13:43:52.232495 2576 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jun 08 13:43:52.234466 ip-10-0-140-46 kubenswrapper[2576]: W0608 13:43:52.232498 2576 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jun 08 13:43:52.234466 ip-10-0-140-46 kubenswrapper[2576]: W0608 13:43:52.232500 2576 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jun 08 13:43:52.234466 ip-10-0-140-46 kubenswrapper[2576]: W0608 13:43:52.232503 2576 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jun 08 13:43:52.234466 ip-10-0-140-46 kubenswrapper[2576]: W0608 13:43:52.232505 2576 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jun 08 13:43:52.234466 ip-10-0-140-46 kubenswrapper[2576]: W0608 13:43:52.232508 2576 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jun 08 13:43:52.234466 ip-10-0-140-46 kubenswrapper[2576]: W0608 13:43:52.232511 2576 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jun 08 13:43:52.234466 ip-10-0-140-46 kubenswrapper[2576]: W0608 13:43:52.232514 2576 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jun 08 13:43:52.234466 ip-10-0-140-46 kubenswrapper[2576]: W0608 13:43:52.232517 2576 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jun 08 13:43:52.234466 ip-10-0-140-46 kubenswrapper[2576]: W0608 13:43:52.232519 2576 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jun 08 13:43:52.234466 ip-10-0-140-46 kubenswrapper[2576]: W0608 13:43:52.232522 2576 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jun 08 13:43:52.234466 ip-10-0-140-46 kubenswrapper[2576]: W0608 13:43:52.232525 2576 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jun 08 13:43:52.234466 ip-10-0-140-46 kubenswrapper[2576]: W0608 13:43:52.232531 2576 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jun 08 13:43:52.234951 ip-10-0-140-46 kubenswrapper[2576]: W0608 13:43:52.232533 2576 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jun 08 13:43:52.234951 ip-10-0-140-46 kubenswrapper[2576]: W0608 13:43:52.232536 2576 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jun 08 13:43:52.234951 ip-10-0-140-46 kubenswrapper[2576]: W0608 13:43:52.232538 2576 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jun 08 13:43:52.234951 ip-10-0-140-46 kubenswrapper[2576]: W0608 13:43:52.232541 2576 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jun 08 13:43:52.234951 ip-10-0-140-46 kubenswrapper[2576]: W0608 13:43:52.232543 2576 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jun 08 13:43:52.234951 ip-10-0-140-46 kubenswrapper[2576]: W0608 13:43:52.232546 2576 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jun 08 13:43:52.234951 ip-10-0-140-46 kubenswrapper[2576]: W0608 13:43:52.232548 2576 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jun 08 13:43:52.234951 ip-10-0-140-46 kubenswrapper[2576]: W0608 13:43:52.232551 2576 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jun 08 13:43:52.234951 ip-10-0-140-46 kubenswrapper[2576]: W0608 13:43:52.232553 2576 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jun 08 13:43:52.234951 ip-10-0-140-46 kubenswrapper[2576]: W0608 13:43:52.232556 2576 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jun 08 13:43:52.234951 ip-10-0-140-46 kubenswrapper[2576]: W0608 13:43:52.232558 2576 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jun 08 13:43:52.234951 ip-10-0-140-46 kubenswrapper[2576]: W0608 13:43:52.232574 2576 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jun 08 13:43:52.234951 ip-10-0-140-46 kubenswrapper[2576]: W0608 13:43:52.232577 2576 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jun 08 13:43:52.234951 ip-10-0-140-46 kubenswrapper[2576]: W0608 13:43:52.232580 2576 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jun 08 13:43:52.234951 ip-10-0-140-46 kubenswrapper[2576]: W0608 13:43:52.232584 2576 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jun 08 13:43:52.234951 ip-10-0-140-46 kubenswrapper[2576]: W0608 13:43:52.232587 2576 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jun 08 13:43:52.234951 ip-10-0-140-46 kubenswrapper[2576]: W0608 13:43:52.232590 2576 feature_gate.go:328] unrecognized feature gate: Example Jun 08 13:43:52.234951 ip-10-0-140-46 kubenswrapper[2576]: W0608 13:43:52.232593 2576 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jun 08 13:43:52.234951 ip-10-0-140-46 kubenswrapper[2576]: W0608 13:43:52.232596 2576 feature_gate.go:328] unrecognized feature gate: NewOLM Jun 08 13:43:52.234951 ip-10-0-140-46 kubenswrapper[2576]: W0608 13:43:52.232598 2576 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jun 08 13:43:52.235435 ip-10-0-140-46 kubenswrapper[2576]: W0608 13:43:52.232601 2576 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jun 08 13:43:52.235435 ip-10-0-140-46 kubenswrapper[2576]: W0608 13:43:52.232603 2576 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jun 08 13:43:52.235435 ip-10-0-140-46 kubenswrapper[2576]: W0608 13:43:52.232606 2576 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jun 08 13:43:52.235435 ip-10-0-140-46 kubenswrapper[2576]: W0608 13:43:52.232609 2576 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jun 08 13:43:52.235435 ip-10-0-140-46 kubenswrapper[2576]: W0608 13:43:52.232611 2576 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jun 08 13:43:52.235435 ip-10-0-140-46 kubenswrapper[2576]: W0608 13:43:52.232614 2576 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jun 08 13:43:52.235435 ip-10-0-140-46 kubenswrapper[2576]: W0608 13:43:52.232616 2576 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jun 08 13:43:52.235435 ip-10-0-140-46 kubenswrapper[2576]: W0608 13:43:52.232619 2576 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jun 08 13:43:52.235435 ip-10-0-140-46 kubenswrapper[2576]: W0608 13:43:52.232622 2576 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jun 08 13:43:52.235435 ip-10-0-140-46 kubenswrapper[2576]: W0608 13:43:52.232624 2576 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jun 08 13:43:52.235435 ip-10-0-140-46 kubenswrapper[2576]: W0608 13:43:52.232627 2576 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jun 08 13:43:52.235435 ip-10-0-140-46 kubenswrapper[2576]: W0608 13:43:52.232630 2576 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jun 08 13:43:52.235435 ip-10-0-140-46 kubenswrapper[2576]: W0608 13:43:52.232633 2576 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jun 08 13:43:52.235435 ip-10-0-140-46 kubenswrapper[2576]: W0608 13:43:52.232636 2576 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jun 08 13:43:52.235435 ip-10-0-140-46 kubenswrapper[2576]: W0608 13:43:52.232638 2576 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jun 08 13:43:52.235435 ip-10-0-140-46 kubenswrapper[2576]: W0608 13:43:52.232641 2576 feature_gate.go:328] unrecognized feature gate: Example2 Jun 08 13:43:52.235856 ip-10-0-140-46 kubenswrapper[2576]: I0608 13:43:52.232646 2576 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]} Jun 08 13:43:52.235856 ip-10-0-140-46 kubenswrapper[2576]: W0608 13:43:52.232763 2576 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jun 08 13:43:52.235856 ip-10-0-140-46 kubenswrapper[2576]: W0608 13:43:52.232768 2576 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jun 08 13:43:52.235856 ip-10-0-140-46 kubenswrapper[2576]: W0608 13:43:52.232770 2576 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jun 08 13:43:52.235856 ip-10-0-140-46 kubenswrapper[2576]: W0608 13:43:52.232774 2576 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jun 08 13:43:52.235856 ip-10-0-140-46 kubenswrapper[2576]: W0608 13:43:52.232778 2576 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jun 08 13:43:52.235856 ip-10-0-140-46 kubenswrapper[2576]: W0608 13:43:52.232781 2576 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jun 08 13:43:52.235856 ip-10-0-140-46 kubenswrapper[2576]: W0608 13:43:52.232784 2576 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jun 08 13:43:52.235856 ip-10-0-140-46 kubenswrapper[2576]: W0608 13:43:52.232787 2576 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jun 08 13:43:52.235856 ip-10-0-140-46 kubenswrapper[2576]: W0608 13:43:52.232790 2576 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jun 08 13:43:52.235856 ip-10-0-140-46 kubenswrapper[2576]: W0608 13:43:52.232793 2576 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jun 08 13:43:52.235856 ip-10-0-140-46 kubenswrapper[2576]: W0608 13:43:52.232795 2576 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jun 08 13:43:52.235856 ip-10-0-140-46 kubenswrapper[2576]: W0608 13:43:52.232798 2576 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jun 08 13:43:52.235856 ip-10-0-140-46 kubenswrapper[2576]: W0608 13:43:52.232801 2576 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jun 08 13:43:52.236200 ip-10-0-140-46 kubenswrapper[2576]: W0608 13:43:52.232803 2576 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jun 08 13:43:52.236200 ip-10-0-140-46 kubenswrapper[2576]: W0608 13:43:52.232805 2576 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jun 08 13:43:52.236200 ip-10-0-140-46 kubenswrapper[2576]: W0608 13:43:52.232808 2576 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jun 08 13:43:52.236200 ip-10-0-140-46 kubenswrapper[2576]: W0608 13:43:52.232811 2576 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jun 08 13:43:52.236200 ip-10-0-140-46 kubenswrapper[2576]: W0608 13:43:52.232813 2576 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jun 08 13:43:52.236200 ip-10-0-140-46 kubenswrapper[2576]: W0608 13:43:52.232816 2576 feature_gate.go:328] unrecognized feature gate: SignatureStores Jun 08 13:43:52.236200 ip-10-0-140-46 kubenswrapper[2576]: W0608 13:43:52.232818 2576 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jun 08 13:43:52.236200 ip-10-0-140-46 kubenswrapper[2576]: W0608 13:43:52.232820 2576 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jun 08 13:43:52.236200 ip-10-0-140-46 kubenswrapper[2576]: W0608 13:43:52.232823 2576 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jun 08 13:43:52.236200 ip-10-0-140-46 kubenswrapper[2576]: W0608 13:43:52.232826 2576 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jun 08 13:43:52.236200 ip-10-0-140-46 kubenswrapper[2576]: W0608 13:43:52.232828 2576 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jun 08 13:43:52.236200 ip-10-0-140-46 kubenswrapper[2576]: W0608 13:43:52.232832 2576 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jun 08 13:43:52.236200 ip-10-0-140-46 kubenswrapper[2576]: W0608 13:43:52.232834 2576 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jun 08 13:43:52.236200 ip-10-0-140-46 kubenswrapper[2576]: W0608 13:43:52.232837 2576 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jun 08 13:43:52.236200 ip-10-0-140-46 kubenswrapper[2576]: W0608 13:43:52.232839 2576 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jun 08 13:43:52.236200 ip-10-0-140-46 kubenswrapper[2576]: W0608 13:43:52.232843 2576 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jun 08 13:43:52.236200 ip-10-0-140-46 kubenswrapper[2576]: W0608 13:43:52.232845 2576 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jun 08 13:43:52.236200 ip-10-0-140-46 kubenswrapper[2576]: W0608 13:43:52.232848 2576 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jun 08 13:43:52.236200 ip-10-0-140-46 kubenswrapper[2576]: W0608 13:43:52.232851 2576 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jun 08 13:43:52.236780 ip-10-0-140-46 kubenswrapper[2576]: W0608 13:43:52.232854 2576 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jun 08 13:43:52.236780 ip-10-0-140-46 kubenswrapper[2576]: W0608 13:43:52.232857 2576 feature_gate.go:328] unrecognized feature gate: Example Jun 08 13:43:52.236780 ip-10-0-140-46 kubenswrapper[2576]: W0608 13:43:52.232860 2576 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jun 08 13:43:52.236780 ip-10-0-140-46 kubenswrapper[2576]: W0608 13:43:52.232862 2576 feature_gate.go:328] unrecognized feature gate: NewOLM Jun 08 13:43:52.236780 ip-10-0-140-46 kubenswrapper[2576]: W0608 13:43:52.232865 2576 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jun 08 13:43:52.236780 ip-10-0-140-46 kubenswrapper[2576]: W0608 13:43:52.232867 2576 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jun 08 13:43:52.236780 ip-10-0-140-46 kubenswrapper[2576]: W0608 13:43:52.232869 2576 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jun 08 13:43:52.236780 ip-10-0-140-46 kubenswrapper[2576]: W0608 13:43:52.232872 2576 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jun 08 13:43:52.236780 ip-10-0-140-46 kubenswrapper[2576]: W0608 13:43:52.232874 2576 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jun 08 13:43:52.236780 ip-10-0-140-46 kubenswrapper[2576]: W0608 13:43:52.232877 2576 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jun 08 13:43:52.236780 ip-10-0-140-46 kubenswrapper[2576]: W0608 13:43:52.232879 2576 feature_gate.go:328] unrecognized feature gate: OSStreams Jun 08 13:43:52.236780 ip-10-0-140-46 kubenswrapper[2576]: W0608 13:43:52.232882 2576 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jun 08 13:43:52.236780 ip-10-0-140-46 kubenswrapper[2576]: W0608 13:43:52.232884 2576 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jun 08 13:43:52.236780 ip-10-0-140-46 kubenswrapper[2576]: W0608 13:43:52.232886 2576 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jun 08 13:43:52.236780 ip-10-0-140-46 kubenswrapper[2576]: W0608 13:43:52.232889 2576 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jun 08 13:43:52.236780 ip-10-0-140-46 kubenswrapper[2576]: W0608 13:43:52.232892 2576 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jun 08 13:43:52.236780 ip-10-0-140-46 kubenswrapper[2576]: W0608 13:43:52.232895 2576 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jun 08 13:43:52.236780 ip-10-0-140-46 kubenswrapper[2576]: W0608 13:43:52.232897 2576 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jun 08 13:43:52.236780 ip-10-0-140-46 kubenswrapper[2576]: W0608 13:43:52.232900 2576 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jun 08 13:43:52.236780 ip-10-0-140-46 kubenswrapper[2576]: W0608 13:43:52.232902 2576 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jun 08 13:43:52.237277 ip-10-0-140-46 kubenswrapper[2576]: W0608 13:43:52.232905 2576 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jun 08 13:43:52.237277 ip-10-0-140-46 kubenswrapper[2576]: W0608 13:43:52.232908 2576 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jun 08 13:43:52.237277 ip-10-0-140-46 kubenswrapper[2576]: W0608 13:43:52.232911 2576 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jun 08 13:43:52.237277 ip-10-0-140-46 kubenswrapper[2576]: W0608 13:43:52.232913 2576 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jun 08 13:43:52.237277 ip-10-0-140-46 kubenswrapper[2576]: W0608 13:43:52.232916 2576 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jun 08 13:43:52.237277 ip-10-0-140-46 kubenswrapper[2576]: W0608 13:43:52.232919 2576 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jun 08 13:43:52.237277 ip-10-0-140-46 kubenswrapper[2576]: W0608 13:43:52.232921 2576 feature_gate.go:328] unrecognized feature gate: PinnedImages Jun 08 13:43:52.237277 ip-10-0-140-46 kubenswrapper[2576]: W0608 13:43:52.232923 2576 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jun 08 13:43:52.237277 ip-10-0-140-46 kubenswrapper[2576]: W0608 13:43:52.232926 2576 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jun 08 13:43:52.237277 ip-10-0-140-46 kubenswrapper[2576]: W0608 13:43:52.232929 2576 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jun 08 13:43:52.237277 ip-10-0-140-46 kubenswrapper[2576]: W0608 13:43:52.232931 2576 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jun 08 13:43:52.237277 ip-10-0-140-46 kubenswrapper[2576]: W0608 13:43:52.232934 2576 feature_gate.go:328] unrecognized feature gate: DualReplica Jun 08 13:43:52.237277 ip-10-0-140-46 kubenswrapper[2576]: W0608 13:43:52.232937 2576 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jun 08 13:43:52.237277 ip-10-0-140-46 kubenswrapper[2576]: W0608 13:43:52.232939 2576 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jun 08 13:43:52.237277 ip-10-0-140-46 kubenswrapper[2576]: W0608 13:43:52.232942 2576 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jun 08 13:43:52.237277 ip-10-0-140-46 kubenswrapper[2576]: W0608 13:43:52.232945 2576 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jun 08 13:43:52.237277 ip-10-0-140-46 kubenswrapper[2576]: W0608 13:43:52.232947 2576 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jun 08 13:43:52.237277 ip-10-0-140-46 kubenswrapper[2576]: W0608 13:43:52.232950 2576 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jun 08 13:43:52.237277 ip-10-0-140-46 kubenswrapper[2576]: W0608 13:43:52.232952 2576 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jun 08 13:43:52.237277 ip-10-0-140-46 kubenswrapper[2576]: W0608 13:43:52.232954 2576 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jun 08 13:43:52.237774 ip-10-0-140-46 kubenswrapper[2576]: W0608 13:43:52.232957 2576 feature_gate.go:328] unrecognized feature gate: EventTTL Jun 08 13:43:52.237774 ip-10-0-140-46 kubenswrapper[2576]: W0608 13:43:52.232959 2576 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jun 08 13:43:52.237774 ip-10-0-140-46 kubenswrapper[2576]: W0608 13:43:52.232962 2576 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jun 08 13:43:52.237774 ip-10-0-140-46 kubenswrapper[2576]: W0608 13:43:52.232964 2576 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jun 08 13:43:52.237774 ip-10-0-140-46 kubenswrapper[2576]: W0608 13:43:52.232967 2576 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jun 08 13:43:52.237774 ip-10-0-140-46 kubenswrapper[2576]: W0608 13:43:52.232969 2576 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jun 08 13:43:52.237774 ip-10-0-140-46 kubenswrapper[2576]: W0608 13:43:52.232972 2576 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jun 08 13:43:52.237774 ip-10-0-140-46 kubenswrapper[2576]: W0608 13:43:52.232974 2576 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jun 08 13:43:52.237774 ip-10-0-140-46 kubenswrapper[2576]: W0608 13:43:52.232977 2576 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jun 08 13:43:52.237774 ip-10-0-140-46 kubenswrapper[2576]: W0608 13:43:52.232980 2576 feature_gate.go:328] unrecognized feature gate: Example2 Jun 08 13:43:52.237774 ip-10-0-140-46 kubenswrapper[2576]: W0608 13:43:52.232982 2576 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jun 08 13:43:52.237774 ip-10-0-140-46 kubenswrapper[2576]: W0608 13:43:52.232985 2576 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jun 08 13:43:52.237774 ip-10-0-140-46 kubenswrapper[2576]: W0608 13:43:52.232987 2576 feature_gate.go:328] unrecognized feature gate: OVNObservability Jun 08 13:43:52.237774 ip-10-0-140-46 kubenswrapper[2576]: W0608 13:43:52.232990 2576 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jun 08 13:43:52.237774 ip-10-0-140-46 kubenswrapper[2576]: W0608 13:43:52.232992 2576 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jun 08 13:43:52.237774 ip-10-0-140-46 kubenswrapper[2576]: W0608 13:43:52.232995 2576 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jun 08 13:43:52.237774 ip-10-0-140-46 kubenswrapper[2576]: W0608 13:43:52.232998 2576 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jun 08 13:43:52.237774 ip-10-0-140-46 kubenswrapper[2576]: W0608 13:43:52.233000 2576 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jun 08 13:43:52.237774 ip-10-0-140-46 kubenswrapper[2576]: W0608 13:43:52.233003 2576 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jun 08 13:43:52.237774 ip-10-0-140-46 kubenswrapper[2576]: W0608 13:43:52.233006 2576 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jun 08 13:43:52.238277 ip-10-0-140-46 kubenswrapper[2576]: W0608 13:43:52.233008 2576 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jun 08 13:43:52.238277 ip-10-0-140-46 kubenswrapper[2576]: W0608 13:43:52.233010 2576 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jun 08 13:43:52.238277 ip-10-0-140-46 kubenswrapper[2576]: W0608 13:43:52.233014 2576 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jun 08 13:43:52.238277 ip-10-0-140-46 kubenswrapper[2576]: W0608 13:43:52.233016 2576 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jun 08 13:43:52.238277 ip-10-0-140-46 kubenswrapper[2576]: W0608 13:43:52.233021 2576 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jun 08 13:43:52.238277 ip-10-0-140-46 kubenswrapper[2576]: W0608 13:43:52.233024 2576 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jun 08 13:43:52.238277 ip-10-0-140-46 kubenswrapper[2576]: W0608 13:43:52.233026 2576 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jun 08 13:43:52.238277 ip-10-0-140-46 kubenswrapper[2576]: I0608 13:43:52.233031 2576 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]} Jun 08 13:43:52.238277 ip-10-0-140-46 kubenswrapper[2576]: I0608 13:43:52.233139 2576 server.go:962] "Client rotation is on, will bootstrap in background" Jun 08 13:43:52.238277 ip-10-0-140-46 kubenswrapper[2576]: I0608 13:43:52.235301 2576 bootstrap.go:101] "Use the bootstrap credentials to request a cert, and set kubeconfig to point to the certificate dir" Jun 08 13:43:52.238277 ip-10-0-140-46 kubenswrapper[2576]: I0608 13:43:52.236675 2576 server.go:1019] "Starting client certificate rotation" Jun 08 13:43:52.238277 ip-10-0-140-46 kubenswrapper[2576]: I0608 13:43:52.236768 2576 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kube-apiserver-client-kubelet" Jun 08 13:43:52.238277 ip-10-0-140-46 kubenswrapper[2576]: I0608 13:43:52.237599 2576 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kube-apiserver-client-kubelet" Jun 08 13:43:52.239331 ip-10-0-140-46 kubenswrapper[2576]: I0608 13:43:52.239317 2576 dynamic_cafile_content.go:123] "Loaded a new CA Bundle and Verifier" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt" Jun 08 13:43:52.240674 ip-10-0-140-46 kubenswrapper[2576]: I0608 13:43:52.240656 2576 dynamic_cafile_content.go:161] "Starting controller" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt" Jun 08 13:43:52.251166 ip-10-0-140-46 kubenswrapper[2576]: I0608 13:43:52.251107 2576 log.go:25] "Validated CRI v1 runtime API" Jun 08 13:43:52.254136 ip-10-0-140-46 kubenswrapper[2576]: I0608 13:43:52.254118 2576 log.go:25] "Validated CRI v1 image API" Jun 08 13:43:52.255658 ip-10-0-140-46 kubenswrapper[2576]: I0608 13:43:52.255640 2576 server.go:1429] "Using cgroup driver setting received from the CRI runtime" cgroupDriver="systemd" Jun 08 13:43:52.260168 ip-10-0-140-46 kubenswrapper[2576]: I0608 13:43:52.260141 2576 fs.go:135] Filesystem UUIDs: map[4300404d-c094-445e-95ef-9a644dee30ae:/dev/nvme0n1p4 7B77-95E7:/dev/nvme0n1p2 c8577aa6-da04-4681-9e7f-44a1580b1686:/dev/nvme0n1p3] Jun 08 13:43:52.260256 ip-10-0-140-46 kubenswrapper[2576]: I0608 13:43:52.260167 2576 fs.go:136] Filesystem partitions: map[/dev/nvme0n1p3:{mountpoint:/boot major:259 minor:3 fsType:ext4 blockSize:0} /dev/nvme0n1p4:{mountpoint:/var major:259 minor:4 fsType:xfs blockSize:0} /dev/shm:{mountpoint:/dev/shm major:0 minor:22 fsType:tmpfs blockSize:0} /run:{mountpoint:/run major:0 minor:24 fsType:tmpfs blockSize:0} /tmp:{mountpoint:/tmp major:0 minor:31 fsType:tmpfs blockSize:0} composefs_0-33:{mountpoint:/ major:0 minor:33 fsType:overlay blockSize:0}] Jun 08 13:43:52.265922 ip-10-0-140-46 kubenswrapper[2576]: I0608 13:43:52.265799 2576 manager.go:216] Machine: {Timestamp:2026-06-08 13:43:52.263876308 +0000 UTC m=+0.343205191 CPUVendorID:GenuineIntel NumCores:8 NumPhysicalCores:4 NumSockets:1 CpuFrequency:3100178 MemoryCapacity:33164500992 SwapCapacity:0 MemoryByType:map[] NVMInfo:{MemoryModeCapacity:0 AppDirectModeCapacity:0 AvgPowerBudget:0} HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] MachineID:ec2a7a177d5952f14d86802c0f64620c SystemUUID:ec2a7a17-7d59-52f1-4d86-802c0f64620c BootID:db6838b0-e3e8-4bea-a439-1445b9ab1129 Filesystems:[{Device:/dev/nvme0n1p3 DeviceMajor:259 DeviceMinor:3 Capacity:366869504 Type:vfs Inodes:98304 HasInodes:true} {Device:/dev/shm DeviceMajor:0 DeviceMinor:22 Capacity:16582250496 Type:vfs Inodes:4048401 HasInodes:true} {Device:/run DeviceMajor:0 DeviceMinor:24 Capacity:6632902656 Type:vfs Inodes:819200 HasInodes:true} {Device:/dev/nvme0n1p4 DeviceMajor:259 DeviceMinor:4 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:composefs_0-33 DeviceMajor:0 DeviceMinor:33 Capacity:6107136 Type:vfs Inodes:18446744073709551615 HasInodes:true} {Device:/tmp DeviceMajor:0 DeviceMinor:31 Capacity:16582250496 Type:vfs Inodes:1048576 HasInodes:true}] DiskMap:map[259:0:{Name:nvme0n1 Major:259 Minor:0 Size:128849018880 Scheduler:none}] NetworkDevices:[{Name:br-ex MacAddress:02:be:5c:8d:a6:77 Speed:0 Mtu:9001} {Name:ens5 MacAddress:02:be:5c:8d:a6:77 Speed:0 Mtu:9001} {Name:ovs-system MacAddress:3a:98:ae:96:59:f0 Speed:0 Mtu:1500}] Topology:[{Id:0 Memory:33164500992 HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] Cores:[{Id:0 Threads:[0 4] Caches:[{Id:0 Size:32768 Type:Data Level:1} {Id:0 Size:32768 Type:Instruction Level:1} {Id:0 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:1 Threads:[1 5] Caches:[{Id:1 Size:32768 Type:Data Level:1} {Id:1 Size:32768 Type:Instruction Level:1} {Id:1 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:2 Threads:[2 6] Caches:[{Id:2 Size:32768 Type:Data Level:1} {Id:2 Size:32768 Type:Instruction Level:1} {Id:2 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:3 Threads:[3 7] Caches:[{Id:3 Size:32768 Type:Data Level:1} {Id:3 Size:32768 Type:Instruction Level:1} {Id:3 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:}] Caches:[{Id:0 Size:37486592 Type:Unified Level:3}] Distances:[10]}] CloudProvider:Unknown InstanceType:Unknown InstanceID:None} Jun 08 13:43:52.265922 ip-10-0-140-46 kubenswrapper[2576]: I0608 13:43:52.265915 2576 manager_no_libpfm.go:29] cAdvisor is build without cgo and/or libpfm support. Perf event counters are not available. Jun 08 13:43:52.266085 ip-10-0-140-46 kubenswrapper[2576]: I0608 13:43:52.266069 2576 manager.go:232] Version: {KernelVersion:5.14.0-570.118.1.el9_6.x86_64 ContainerOsVersion:Red Hat Enterprise Linux CoreOS 9.6.20260602-0 (Plow) DockerVersion: DockerAPIVersion: CadvisorVersion: CadvisorRevision:} Jun 08 13:43:52.269226 ip-10-0-140-46 kubenswrapper[2576]: I0608 13:43:52.269201 2576 container_manager_linux.go:273] "Container manager verified user specified cgroup-root exists" cgroupRoot=[] Jun 08 13:43:52.269372 ip-10-0-140-46 kubenswrapper[2576]: I0608 13:43:52.269228 2576 container_manager_linux.go:278] "Creating Container Manager object based on Node Config" nodeConfig={"NodeName":"ip-10-0-140-46.ec2.internal","RuntimeCgroupsName":"/system.slice/crio.service","SystemCgroupsName":"/system.slice","KubeletCgroupsName":"","KubeletOOMScoreAdj":-999,"ContainerRuntime":"","CgroupsPerQOS":true,"CgroupRoot":"/","CgroupDriver":"systemd","KubeletRootDir":"/var/lib/kubelet","ProtectKernelDefaults":true,"KubeReservedCgroupName":"","SystemReservedCgroupName":"","ReservedSystemCPUs":{},"EnforceNodeAllocatable":{"pods":{}},"KubeReserved":null,"SystemReserved":{"cpu":"500m","ephemeral-storage":"1Gi","memory":"1Gi"},"HardEvictionThresholds":[{"Signal":"nodefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.1},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.15},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"memory.available","Operator":"LessThan","Value":{"Quantity":"100Mi","Percentage":0},"GracePeriod":0,"MinReclaim":null}],"QOSReserved":{},"CPUManagerPolicy":"none","CPUManagerPolicyOptions":null,"TopologyManagerScope":"container","CPUManagerReconcilePeriod":10000000000,"MemoryManagerPolicy":"None","MemoryManagerReservedMemory":null,"PodPidsLimit":4096,"EnforceCPULimits":true,"CPUCFSQuotaPeriod":100000000,"TopologyManagerPolicy":"none","TopologyManagerPolicyOptions":null,"CgroupVersion":2} Jun 08 13:43:52.269945 ip-10-0-140-46 kubenswrapper[2576]: I0608 13:43:52.269935 2576 topology_manager.go:138] "Creating topology manager with none policy" Jun 08 13:43:52.269977 ip-10-0-140-46 kubenswrapper[2576]: I0608 13:43:52.269948 2576 container_manager_linux.go:309] "Creating device plugin manager" Jun 08 13:43:52.269977 ip-10-0-140-46 kubenswrapper[2576]: I0608 13:43:52.269956 2576 manager.go:141] "Creating Device Plugin manager" path="/var/lib/kubelet/device-plugins/kubelet.sock" Jun 08 13:43:52.271150 ip-10-0-140-46 kubenswrapper[2576]: I0608 13:43:52.271138 2576 server.go:74] "Creating device plugin registration server" version="v1beta1" socket="/var/lib/kubelet/device-plugins/kubelet.sock" Jun 08 13:43:52.272023 ip-10-0-140-46 kubenswrapper[2576]: I0608 13:43:52.272013 2576 container_manager_linux.go:318] "Creating Dynamic Resource Allocation (DRA) manager" Jun 08 13:43:52.274690 ip-10-0-140-46 kubenswrapper[2576]: I0608 13:43:52.274679 2576 state_mem.go:36] "Initialized new in-memory state store" Jun 08 13:43:52.274976 ip-10-0-140-46 kubenswrapper[2576]: I0608 13:43:52.274966 2576 server.go:1240] "Using root directory" path="/var/lib/kubelet" Jun 08 13:43:52.275017 ip-10-0-140-46 kubenswrapper[2576]: I0608 13:43:52.275010 2576 kubelet.go:486] "Attempting to sync node with API server" Jun 08 13:43:52.275048 ip-10-0-140-46 kubenswrapper[2576]: I0608 13:43:52.275020 2576 kubelet.go:387] "Adding static pod path" path="/etc/kubernetes/manifests" Jun 08 13:43:52.275048 ip-10-0-140-46 kubenswrapper[2576]: I0608 13:43:52.275035 2576 file.go:69] "Watching path" path="/etc/kubernetes/manifests" Jun 08 13:43:52.275048 ip-10-0-140-46 kubenswrapper[2576]: I0608 13:43:52.275044 2576 kubelet.go:398] "Adding apiserver pod source" Jun 08 13:43:52.275169 ip-10-0-140-46 kubenswrapper[2576]: I0608 13:43:52.275053 2576 apiserver.go:42] "Waiting for node sync before watching apiserver pods" Jun 08 13:43:52.275456 ip-10-0-140-46 kubenswrapper[2576]: I0608 13:43:52.275443 2576 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking" Jun 08 13:43:52.275486 ip-10-0-140-46 kubenswrapper[2576]: I0608 13:43:52.275469 2576 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking" Jun 08 13:43:52.277591 ip-10-0-140-46 kubenswrapper[2576]: I0608 13:43:52.277555 2576 kuberuntime_manager.go:301] "Container runtime initialized" containerRuntime="cri-o" version="1.34.8-3.rhaos4.21.git91b4b0b.el9" apiVersion="v1" Jun 08 13:43:52.278944 ip-10-0-140-46 kubenswrapper[2576]: I0608 13:43:52.278929 2576 kubelet.go:960] "Not starting ClusterTrustBundle informer because we are in static kubelet mode or the ClusterTrustBundleProjection featuregate is disabled" Jun 08 13:43:52.279018 ip-10-0-140-46 kubenswrapper[2576]: I0608 13:43:52.278959 2576 kubelet.go:984] "Not starting PodCertificateRequest manager because we are in static kubelet mode or the PodCertificateProjection feature gate is disabled" Jun 08 13:43:52.279759 ip-10-0-140-46 kubenswrapper[2576]: I0608 13:43:52.279747 2576 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/portworx-volume" Jun 08 13:43:52.279824 ip-10-0-140-46 kubenswrapper[2576]: I0608 13:43:52.279764 2576 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/empty-dir" Jun 08 13:43:52.279824 ip-10-0-140-46 kubenswrapper[2576]: I0608 13:43:52.279771 2576 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/git-repo" Jun 08 13:43:52.279824 ip-10-0-140-46 kubenswrapper[2576]: I0608 13:43:52.279775 2576 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/host-path" Jun 08 13:43:52.279824 ip-10-0-140-46 kubenswrapper[2576]: I0608 13:43:52.279784 2576 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/nfs" Jun 08 13:43:52.279824 ip-10-0-140-46 kubenswrapper[2576]: I0608 13:43:52.279789 2576 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/secret" Jun 08 13:43:52.279824 ip-10-0-140-46 kubenswrapper[2576]: I0608 13:43:52.279797 2576 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/iscsi" Jun 08 13:43:52.279824 ip-10-0-140-46 kubenswrapper[2576]: I0608 13:43:52.279803 2576 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/downward-api" Jun 08 13:43:52.279824 ip-10-0-140-46 kubenswrapper[2576]: I0608 13:43:52.279809 2576 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/fc" Jun 08 13:43:52.279824 ip-10-0-140-46 kubenswrapper[2576]: I0608 13:43:52.279814 2576 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/configmap" Jun 08 13:43:52.279824 ip-10-0-140-46 kubenswrapper[2576]: I0608 13:43:52.279823 2576 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/projected" Jun 08 13:43:52.280089 ip-10-0-140-46 kubenswrapper[2576]: I0608 13:43:52.279839 2576 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/local-volume" Jun 08 13:43:52.280659 ip-10-0-140-46 kubenswrapper[2576]: I0608 13:43:52.280646 2576 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/csi" Jun 08 13:43:52.280696 ip-10-0-140-46 kubenswrapper[2576]: I0608 13:43:52.280660 2576 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/image" Jun 08 13:43:52.284436 ip-10-0-140-46 kubenswrapper[2576]: I0608 13:43:52.284421 2576 server.go:1268] "Started kubelet" Jun 08 13:43:52.284663 ip-10-0-140-46 kubenswrapper[2576]: I0608 13:43:52.284554 2576 server.go:180] "Starting to listen" address="0.0.0.0" port=10250 Jun 08 13:43:52.285134 ip-10-0-140-46 kubenswrapper[2576]: I0608 13:43:52.284753 2576 ratelimit.go:56] "Setting rate limiting for endpoint" service="podresources" qps=100 burstTokens=10 Jun 08 13:43:52.285272 ip-10-0-140-46 kubenswrapper[2576]: I0608 13:43:52.285127 2576 server_v1.go:49] "podresources" method="list" useActivePods=true Jun 08 13:43:52.285447 ip-10-0-140-46 systemd[1]: Started Kubernetes Kubelet. Jun 08 13:43:52.286951 ip-10-0-140-46 kubenswrapper[2576]: I0608 13:43:52.286921 2576 server.go:249] "Starting to serve the podresources API" endpoint="unix:/var/lib/kubelet/pod-resources/kubelet.sock" Jun 08 13:43:52.287623 ip-10-0-140-46 kubenswrapper[2576]: I0608 13:43:52.287606 2576 reflector.go:439] "Caches populated" logger="kubernetes.io/kube-apiserver-client-kubelet" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162" Jun 08 13:43:52.287707 ip-10-0-140-46 kubenswrapper[2576]: I0608 13:43:52.287652 2576 server.go:310] "Adding debug handlers to kubelet server" Jun 08 13:43:52.291717 ip-10-0-140-46 kubenswrapper[2576]: E0608 13:43:52.291697 2576 kubelet.go:1638] "Image garbage collection failed once. Stats initialization may not have completed yet" err="failed to get imageFs info: unable to find data in memory cache" Jun 08 13:43:52.292592 ip-10-0-140-46 kubenswrapper[2576]: I0608 13:43:52.292558 2576 fs_resource_analyzer.go:67] "Starting FS ResourceAnalyzer" Jun 08 13:43:52.292693 ip-10-0-140-46 kubenswrapper[2576]: I0608 13:43:52.292591 2576 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kubelet-serving" Jun 08 13:43:52.293121 ip-10-0-140-46 kubenswrapper[2576]: E0608 13:43:52.292913 2576 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-140-46.ec2.internal\" not found" Jun 08 13:43:52.293267 ip-10-0-140-46 kubenswrapper[2576]: I0608 13:43:52.293247 2576 desired_state_of_world_populator.go:146] "Desired state populator starts to run" Jun 08 13:43:52.293428 ip-10-0-140-46 kubenswrapper[2576]: I0608 13:43:52.293255 2576 volume_manager.go:311] "The desired_state_of_world populator starts" Jun 08 13:43:52.293550 ip-10-0-140-46 kubenswrapper[2576]: I0608 13:43:52.293536 2576 volume_manager.go:313] "Starting Kubelet Volume Manager" Jun 08 13:43:52.293550 ip-10-0-140-46 kubenswrapper[2576]: I0608 13:43:52.293354 2576 factory.go:55] Registering systemd factory Jun 08 13:43:52.293686 ip-10-0-140-46 kubenswrapper[2576]: I0608 13:43:52.293583 2576 factory.go:223] Registration of the systemd container factory successfully Jun 08 13:43:52.293686 ip-10-0-140-46 kubenswrapper[2576]: I0608 13:43:52.293649 2576 reconstruct.go:97] "Volume reconstruction finished" Jun 08 13:43:52.293686 ip-10-0-140-46 kubenswrapper[2576]: I0608 13:43:52.293659 2576 reconciler.go:29] "Reconciler: start to sync state" Jun 08 13:43:52.293821 ip-10-0-140-46 kubenswrapper[2576]: E0608 13:43:52.293694 2576 reflector.go:205] "Failed to watch" err="failed to list *v1.Node: nodes \"ip-10-0-140-46.ec2.internal\" is forbidden: User \"system:anonymous\" cannot list resource \"nodes\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Node" Jun 08 13:43:52.293821 ip-10-0-140-46 kubenswrapper[2576]: E0608 13:43:52.293718 2576 reflector.go:205] "Failed to watch" err="failed to list *v1.Service: services is forbidden: User \"system:anonymous\" cannot list resource \"services\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Service" Jun 08 13:43:52.293821 ip-10-0-140-46 kubenswrapper[2576]: I0608 13:43:52.293770 2576 csi_plugin.go:990] Failed to contact API server when waiting for CSINode publishing: csinodes.storage.k8s.io "ip-10-0-140-46.ec2.internal" is forbidden: User "system:anonymous" cannot get resource "csinodes" in API group "storage.k8s.io" at the cluster scope Jun 08 13:43:52.293821 ip-10-0-140-46 kubenswrapper[2576]: I0608 13:43:52.293778 2576 factory.go:153] Registering CRI-O factory Jun 08 13:43:52.293821 ip-10-0-140-46 kubenswrapper[2576]: I0608 13:43:52.293809 2576 factory.go:223] Registration of the crio container factory successfully Jun 08 13:43:52.294023 ip-10-0-140-46 kubenswrapper[2576]: I0608 13:43:52.293890 2576 factory.go:221] Registration of the containerd container factory failed: unable to create containerd client: containerd: cannot unix dial containerd api service: dial unix /run/containerd/containerd.sock: connect: no such file or directory Jun 08 13:43:52.294023 ip-10-0-140-46 kubenswrapper[2576]: I0608 13:43:52.293916 2576 factory.go:103] Registering Raw factory Jun 08 13:43:52.294023 ip-10-0-140-46 kubenswrapper[2576]: I0608 13:43:52.293930 2576 manager.go:1196] Started watching for new ooms in manager Jun 08 13:43:52.294382 ip-10-0-140-46 kubenswrapper[2576]: I0608 13:43:52.294369 2576 manager.go:349] Starting recovery of all containers Jun 08 13:43:52.294648 ip-10-0-140-46 kubenswrapper[2576]: E0608 13:43:52.293700 2576 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-140-46.ec2.internal.18b71ef8f67c624b default 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-140-46.ec2.internal,UID:ip-10-0-140-46.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:Starting,Message:Starting kubelet.,Source:EventSource{Component:kubelet,Host:ip-10-0-140-46.ec2.internal,},FirstTimestamp:2026-06-08 13:43:52.284389963 +0000 UTC m=+0.363718846,LastTimestamp:2026-06-08 13:43:52.284389963 +0000 UTC m=+0.363718846,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-140-46.ec2.internal,}" Jun 08 13:43:52.295340 ip-10-0-140-46 kubenswrapper[2576]: E0608 13:43:52.295317 2576 controller.go:145] "Failed to ensure lease exists, will retry" err="leases.coordination.k8s.io \"ip-10-0-140-46.ec2.internal\" is forbidden: User \"system:anonymous\" cannot get resource \"leases\" in API group \"coordination.k8s.io\" in the namespace \"kube-node-lease\"" interval="200ms" Jun 08 13:43:52.295435 ip-10-0-140-46 kubenswrapper[2576]: E0608 13:43:52.295372 2576 reflector.go:205] "Failed to watch" err="failed to list *v1.CSIDriver: csidrivers.storage.k8s.io is forbidden: User \"system:anonymous\" cannot list resource \"csidrivers\" in API group \"storage.k8s.io\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.CSIDriver" Jun 08 13:43:52.301350 ip-10-0-140-46 kubenswrapper[2576]: I0608 13:43:52.301299 2576 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv6" Jun 08 13:43:52.304183 ip-10-0-140-46 kubenswrapper[2576]: I0608 13:43:52.304165 2576 manager.go:354] Recovery completed Jun 08 13:43:52.309922 ip-10-0-140-46 kubenswrapper[2576]: I0608 13:43:52.309910 2576 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jun 08 13:43:52.311976 ip-10-0-140-46 kubenswrapper[2576]: I0608 13:43:52.311954 2576 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-140-46.ec2.internal" event="NodeHasSufficientMemory" Jun 08 13:43:52.312083 ip-10-0-140-46 kubenswrapper[2576]: I0608 13:43:52.311994 2576 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-140-46.ec2.internal" event="NodeHasNoDiskPressure" Jun 08 13:43:52.312083 ip-10-0-140-46 kubenswrapper[2576]: I0608 13:43:52.312010 2576 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-140-46.ec2.internal" event="NodeHasSufficientPID" Jun 08 13:43:52.312526 ip-10-0-140-46 kubenswrapper[2576]: I0608 13:43:52.312511 2576 cpu_manager.go:222] "Starting CPU manager" policy="none" Jun 08 13:43:52.312587 ip-10-0-140-46 kubenswrapper[2576]: I0608 13:43:52.312527 2576 cpu_manager.go:223] "Reconciling" reconcilePeriod="10s" Jun 08 13:43:52.312587 ip-10-0-140-46 kubenswrapper[2576]: I0608 13:43:52.312544 2576 state_mem.go:36] "Initialized new in-memory state store" Jun 08 13:43:52.312587 ip-10-0-140-46 kubenswrapper[2576]: I0608 13:43:52.312516 2576 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jun 08 13:43:52.313266 ip-10-0-140-46 kubenswrapper[2576]: I0608 13:43:52.313248 2576 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-140-46.ec2.internal" event="NodeHasSufficientMemory" Jun 08 13:43:52.313355 ip-10-0-140-46 kubenswrapper[2576]: I0608 13:43:52.313279 2576 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-140-46.ec2.internal" event="NodeHasNoDiskPressure" Jun 08 13:43:52.313355 ip-10-0-140-46 kubenswrapper[2576]: I0608 13:43:52.313293 2576 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-140-46.ec2.internal" event="NodeHasSufficientPID" Jun 08 13:43:52.313687 ip-10-0-140-46 kubenswrapper[2576]: I0608 13:43:52.313675 2576 policy_none.go:49] "None policy: Start" Jun 08 13:43:52.313742 ip-10-0-140-46 kubenswrapper[2576]: I0608 13:43:52.313693 2576 memory_manager.go:187] "Starting memorymanager" policy="None" Jun 08 13:43:52.313742 ip-10-0-140-46 kubenswrapper[2576]: I0608 13:43:52.313703 2576 state_mem.go:36] "Initializing new in-memory state store" logger="Memory Manager state checkpoint" Jun 08 13:43:52.314614 ip-10-0-140-46 kubenswrapper[2576]: I0608 13:43:52.314603 2576 policy_none.go:47] "Start" Jun 08 13:43:52.316986 ip-10-0-140-46 kubenswrapper[2576]: E0608 13:43:52.316916 2576 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-140-46.ec2.internal.18b71ef8f8215078 default 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-140-46.ec2.internal,UID:ip-10-0-140-46.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:NodeHasSufficientMemory,Message:Node ip-10-0-140-46.ec2.internal status is now: NodeHasSufficientMemory,Source:EventSource{Component:kubelet,Host:ip-10-0-140-46.ec2.internal,},FirstTimestamp:2026-06-08 13:43:52.311976056 +0000 UTC m=+0.391304939,LastTimestamp:2026-06-08 13:43:52.311976056 +0000 UTC m=+0.391304939,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-140-46.ec2.internal,}" Jun 08 13:43:52.337124 ip-10-0-140-46 kubenswrapper[2576]: E0608 13:43:52.337034 2576 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-140-46.ec2.internal.18b71ef8f821b44a default 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-140-46.ec2.internal,UID:ip-10-0-140-46.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:NodeHasNoDiskPressure,Message:Node ip-10-0-140-46.ec2.internal status is now: NodeHasNoDiskPressure,Source:EventSource{Component:kubelet,Host:ip-10-0-140-46.ec2.internal,},FirstTimestamp:2026-06-08 13:43:52.31200161 +0000 UTC m=+0.391330494,LastTimestamp:2026-06-08 13:43:52.31200161 +0000 UTC m=+0.391330494,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-140-46.ec2.internal,}" Jun 08 13:43:52.355742 ip-10-0-140-46 kubenswrapper[2576]: E0608 13:43:52.355614 2576 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-140-46.ec2.internal.18b71ef8f821eee1 default 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-140-46.ec2.internal,UID:ip-10-0-140-46.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:NodeHasSufficientPID,Message:Node ip-10-0-140-46.ec2.internal status is now: NodeHasSufficientPID,Source:EventSource{Component:kubelet,Host:ip-10-0-140-46.ec2.internal,},FirstTimestamp:2026-06-08 13:43:52.312016609 +0000 UTC m=+0.391345496,LastTimestamp:2026-06-08 13:43:52.312016609 +0000 UTC m=+0.391345496,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-140-46.ec2.internal,}" Jun 08 13:43:52.371448 ip-10-0-140-46 kubenswrapper[2576]: I0608 13:43:52.357280 2576 manager.go:337] "Starting Device Plugin manager" Jun 08 13:43:52.371448 ip-10-0-140-46 kubenswrapper[2576]: E0608 13:43:52.357367 2576 manager.go:513] "Failed to read data from checkpoint" err="checkpoint is not found" checkpoint="kubelet_internal_checkpoint" Jun 08 13:43:52.371448 ip-10-0-140-46 kubenswrapper[2576]: I0608 13:43:52.357387 2576 server.go:87] "Starting device plugin registration server" Jun 08 13:43:52.371448 ip-10-0-140-46 kubenswrapper[2576]: I0608 13:43:52.357767 2576 eviction_manager.go:189] "Eviction manager: starting control loop" Jun 08 13:43:52.371448 ip-10-0-140-46 kubenswrapper[2576]: I0608 13:43:52.357780 2576 container_log_manager.go:146] "Initializing container log rotate workers" workers=1 monitorPeriod="10s" Jun 08 13:43:52.371448 ip-10-0-140-46 kubenswrapper[2576]: I0608 13:43:52.357876 2576 plugin_watcher.go:51] "Plugin Watcher Start" path="/var/lib/kubelet/plugins_registry" Jun 08 13:43:52.371448 ip-10-0-140-46 kubenswrapper[2576]: I0608 13:43:52.357965 2576 plugin_manager.go:116] "The desired_state_of_world populator (plugin watcher) starts" Jun 08 13:43:52.371448 ip-10-0-140-46 kubenswrapper[2576]: I0608 13:43:52.357975 2576 plugin_manager.go:118] "Starting Kubelet Plugin Manager" Jun 08 13:43:52.371448 ip-10-0-140-46 kubenswrapper[2576]: E0608 13:43:52.358511 2576 eviction_manager.go:267] "eviction manager: failed to check if we have separate container filesystem. Ignoring." err="non-existent label \"crio-containers\"" Jun 08 13:43:52.371448 ip-10-0-140-46 kubenswrapper[2576]: E0608 13:43:52.358557 2576 eviction_manager.go:292] "Eviction manager: failed to get summary stats" err="failed to get node info: node \"ip-10-0-140-46.ec2.internal\" not found" Jun 08 13:43:52.371448 ip-10-0-140-46 kubenswrapper[2576]: E0608 13:43:52.366132 2576 event.go:359] "Server rejected event (will not retry!)" err="events \"ip-10-0-140-46.ec2.internal.18b71ef8f8215078\" is forbidden: User \"system:anonymous\" cannot patch resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-140-46.ec2.internal.18b71ef8f8215078 default 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-140-46.ec2.internal,UID:ip-10-0-140-46.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:NodeHasSufficientMemory,Message:Node ip-10-0-140-46.ec2.internal status is now: NodeHasSufficientMemory,Source:EventSource{Component:kubelet,Host:ip-10-0-140-46.ec2.internal,},FirstTimestamp:2026-06-08 13:43:52.311976056 +0000 UTC m=+0.391304939,LastTimestamp:2026-06-08 13:43:52.31326434 +0000 UTC m=+0.392593224,Count:2,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-140-46.ec2.internal,}" Jun 08 13:43:52.371448 ip-10-0-140-46 kubenswrapper[2576]: I0608 13:43:52.370615 2576 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv4" Jun 08 13:43:52.371448 ip-10-0-140-46 kubenswrapper[2576]: I0608 13:43:52.370651 2576 status_manager.go:244] "Starting to sync pod status with apiserver" Jun 08 13:43:52.371448 ip-10-0-140-46 kubenswrapper[2576]: I0608 13:43:52.370672 2576 kubelet.go:2448] "Starting kubelet main sync loop" Jun 08 13:43:52.371448 ip-10-0-140-46 kubenswrapper[2576]: E0608 13:43:52.370704 2576 kubelet.go:2472] "Skipping pod synchronization" err="PLEG is not healthy: pleg has yet to be successful" Jun 08 13:43:52.375820 ip-10-0-140-46 kubenswrapper[2576]: I0608 13:43:52.375795 2576 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-4r592" Jun 08 13:43:52.378219 ip-10-0-140-46 kubenswrapper[2576]: E0608 13:43:52.378122 2576 event.go:359] "Server rejected event (will not retry!)" err="events \"ip-10-0-140-46.ec2.internal.18b71ef8f821b44a\" is forbidden: User \"system:anonymous\" cannot patch resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-140-46.ec2.internal.18b71ef8f821b44a default 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-140-46.ec2.internal,UID:ip-10-0-140-46.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:NodeHasNoDiskPressure,Message:Node ip-10-0-140-46.ec2.internal status is now: NodeHasNoDiskPressure,Source:EventSource{Component:kubelet,Host:ip-10-0-140-46.ec2.internal,},FirstTimestamp:2026-06-08 13:43:52.31200161 +0000 UTC m=+0.391330494,LastTimestamp:2026-06-08 13:43:52.313286161 +0000 UTC m=+0.392615046,Count:2,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-140-46.ec2.internal,}" Jun 08 13:43:52.378297 ip-10-0-140-46 kubenswrapper[2576]: E0608 13:43:52.378238 2576 reflector.go:205] "Failed to watch" err="failed to list *v1.RuntimeClass: runtimeclasses.node.k8s.io is forbidden: User \"system:anonymous\" cannot list resource \"runtimeclasses\" in API group \"node.k8s.io\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.RuntimeClass" Jun 08 13:43:52.388396 ip-10-0-140-46 kubenswrapper[2576]: I0608 13:43:52.388377 2576 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-4r592" Jun 08 13:43:52.388806 ip-10-0-140-46 kubenswrapper[2576]: E0608 13:43:52.388742 2576 event.go:359] "Server rejected event (will not retry!)" err="events \"ip-10-0-140-46.ec2.internal.18b71ef8f821eee1\" is forbidden: User \"system:anonymous\" cannot patch resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-140-46.ec2.internal.18b71ef8f821eee1 default 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-140-46.ec2.internal,UID:ip-10-0-140-46.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:NodeHasSufficientPID,Message:Node ip-10-0-140-46.ec2.internal status is now: NodeHasSufficientPID,Source:EventSource{Component:kubelet,Host:ip-10-0-140-46.ec2.internal,},FirstTimestamp:2026-06-08 13:43:52.312016609 +0000 UTC m=+0.391345496,LastTimestamp:2026-06-08 13:43:52.31329837 +0000 UTC m=+0.392627255,Count:2,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-140-46.ec2.internal,}" Jun 08 13:43:52.458591 ip-10-0-140-46 kubenswrapper[2576]: I0608 13:43:52.458546 2576 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jun 08 13:43:52.460375 ip-10-0-140-46 kubenswrapper[2576]: I0608 13:43:52.460359 2576 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-140-46.ec2.internal" event="NodeHasSufficientMemory" Jun 08 13:43:52.460440 ip-10-0-140-46 kubenswrapper[2576]: I0608 13:43:52.460391 2576 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-140-46.ec2.internal" event="NodeHasNoDiskPressure" Jun 08 13:43:52.460440 ip-10-0-140-46 kubenswrapper[2576]: I0608 13:43:52.460403 2576 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-140-46.ec2.internal" event="NodeHasSufficientPID" Jun 08 13:43:52.460440 ip-10-0-140-46 kubenswrapper[2576]: I0608 13:43:52.460431 2576 kubelet_node_status.go:78] "Attempting to register node" node="ip-10-0-140-46.ec2.internal" Jun 08 13:43:52.470779 ip-10-0-140-46 kubenswrapper[2576]: I0608 13:43:52.470753 2576 kubelet.go:2535] "SyncLoop ADD" source="file" pods=["openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-140-46.ec2.internal","kube-system/kube-apiserver-proxy-ip-10-0-140-46.ec2.internal"] Jun 08 13:43:52.470844 ip-10-0-140-46 kubenswrapper[2576]: I0608 13:43:52.470827 2576 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jun 08 13:43:52.472151 ip-10-0-140-46 kubenswrapper[2576]: I0608 13:43:52.472138 2576 kubelet_node_status.go:81] "Successfully registered node" node="ip-10-0-140-46.ec2.internal" Jun 08 13:43:52.472195 ip-10-0-140-46 kubenswrapper[2576]: E0608 13:43:52.472159 2576 kubelet_node_status.go:536] "Error updating node status, will retry" err="error getting node \"ip-10-0-140-46.ec2.internal\": node \"ip-10-0-140-46.ec2.internal\" not found" Jun 08 13:43:52.472491 ip-10-0-140-46 kubenswrapper[2576]: I0608 13:43:52.472478 2576 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-140-46.ec2.internal" event="NodeHasSufficientMemory" Jun 08 13:43:52.472535 ip-10-0-140-46 kubenswrapper[2576]: I0608 13:43:52.472504 2576 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-140-46.ec2.internal" event="NodeHasNoDiskPressure" Jun 08 13:43:52.472535 ip-10-0-140-46 kubenswrapper[2576]: I0608 13:43:52.472514 2576 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-140-46.ec2.internal" event="NodeHasSufficientPID" Jun 08 13:43:52.473858 ip-10-0-140-46 kubenswrapper[2576]: I0608 13:43:52.473845 2576 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jun 08 13:43:52.473973 ip-10-0-140-46 kubenswrapper[2576]: I0608 13:43:52.473953 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-140-46.ec2.internal" Jun 08 13:43:52.474018 ip-10-0-140-46 kubenswrapper[2576]: I0608 13:43:52.473994 2576 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jun 08 13:43:52.475351 ip-10-0-140-46 kubenswrapper[2576]: I0608 13:43:52.475337 2576 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-140-46.ec2.internal" event="NodeHasSufficientMemory" Jun 08 13:43:52.475412 ip-10-0-140-46 kubenswrapper[2576]: I0608 13:43:52.475362 2576 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-140-46.ec2.internal" event="NodeHasNoDiskPressure" Jun 08 13:43:52.475412 ip-10-0-140-46 kubenswrapper[2576]: I0608 13:43:52.475371 2576 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-140-46.ec2.internal" event="NodeHasSufficientPID" Jun 08 13:43:52.476008 ip-10-0-140-46 kubenswrapper[2576]: I0608 13:43:52.475990 2576 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-140-46.ec2.internal" event="NodeHasSufficientMemory" Jun 08 13:43:52.476083 ip-10-0-140-46 kubenswrapper[2576]: I0608 13:43:52.476025 2576 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-140-46.ec2.internal" event="NodeHasNoDiskPressure" Jun 08 13:43:52.476083 ip-10-0-140-46 kubenswrapper[2576]: I0608 13:43:52.476039 2576 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-140-46.ec2.internal" event="NodeHasSufficientPID" Jun 08 13:43:52.477083 ip-10-0-140-46 kubenswrapper[2576]: I0608 13:43:52.477069 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-140-46.ec2.internal" Jun 08 13:43:52.477157 ip-10-0-140-46 kubenswrapper[2576]: I0608 13:43:52.477094 2576 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jun 08 13:43:52.478494 ip-10-0-140-46 kubenswrapper[2576]: I0608 13:43:52.478481 2576 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-140-46.ec2.internal" event="NodeHasSufficientMemory" Jun 08 13:43:52.478573 ip-10-0-140-46 kubenswrapper[2576]: I0608 13:43:52.478501 2576 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-140-46.ec2.internal" event="NodeHasNoDiskPressure" Jun 08 13:43:52.478573 ip-10-0-140-46 kubenswrapper[2576]: I0608 13:43:52.478523 2576 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-140-46.ec2.internal" event="NodeHasSufficientPID" Jun 08 13:43:52.495013 ip-10-0-140-46 kubenswrapper[2576]: I0608 13:43:52.494989 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/2c0edf5a3fd2add71c45634ad4d02cef-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-140-46.ec2.internal\" (UID: \"2c0edf5a3fd2add71c45634ad4d02cef\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-140-46.ec2.internal" Jun 08 13:43:52.495098 ip-10-0-140-46 kubenswrapper[2576]: I0608 13:43:52.495016 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/2c0edf5a3fd2add71c45634ad4d02cef-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-140-46.ec2.internal\" (UID: \"2c0edf5a3fd2add71c45634ad4d02cef\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-140-46.ec2.internal" Jun 08 13:43:52.495098 ip-10-0-140-46 kubenswrapper[2576]: I0608 13:43:52.495033 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/9611281d5444879f19610790e9303c49-config\") pod \"kube-apiserver-proxy-ip-10-0-140-46.ec2.internal\" (UID: \"9611281d5444879f19610790e9303c49\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-140-46.ec2.internal" Jun 08 13:43:52.505407 ip-10-0-140-46 kubenswrapper[2576]: E0608 13:43:52.505346 2576 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-140-46.ec2.internal\" not found" Jun 08 13:43:52.509344 ip-10-0-140-46 kubenswrapper[2576]: E0608 13:43:52.509326 2576 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-140-46.ec2.internal\" not found" node="ip-10-0-140-46.ec2.internal" Jun 08 13:43:52.513810 ip-10-0-140-46 kubenswrapper[2576]: E0608 13:43:52.513793 2576 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-140-46.ec2.internal\" not found" node="ip-10-0-140-46.ec2.internal" Jun 08 13:43:52.595557 ip-10-0-140-46 kubenswrapper[2576]: I0608 13:43:52.595524 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/9611281d5444879f19610790e9303c49-config\") pod \"kube-apiserver-proxy-ip-10-0-140-46.ec2.internal\" (UID: \"9611281d5444879f19610790e9303c49\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-140-46.ec2.internal" Jun 08 13:43:52.595557 ip-10-0-140-46 kubenswrapper[2576]: I0608 13:43:52.595555 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/2c0edf5a3fd2add71c45634ad4d02cef-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-140-46.ec2.internal\" (UID: \"2c0edf5a3fd2add71c45634ad4d02cef\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-140-46.ec2.internal" Jun 08 13:43:52.595763 ip-10-0-140-46 kubenswrapper[2576]: I0608 13:43:52.595591 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/2c0edf5a3fd2add71c45634ad4d02cef-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-140-46.ec2.internal\" (UID: \"2c0edf5a3fd2add71c45634ad4d02cef\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-140-46.ec2.internal" Jun 08 13:43:52.595763 ip-10-0-140-46 kubenswrapper[2576]: I0608 13:43:52.595630 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/2c0edf5a3fd2add71c45634ad4d02cef-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-140-46.ec2.internal\" (UID: \"2c0edf5a3fd2add71c45634ad4d02cef\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-140-46.ec2.internal" Jun 08 13:43:52.595763 ip-10-0-140-46 kubenswrapper[2576]: I0608 13:43:52.595645 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/2c0edf5a3fd2add71c45634ad4d02cef-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-140-46.ec2.internal\" (UID: \"2c0edf5a3fd2add71c45634ad4d02cef\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-140-46.ec2.internal" Jun 08 13:43:52.595763 ip-10-0-140-46 kubenswrapper[2576]: I0608 13:43:52.595649 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/host-path/9611281d5444879f19610790e9303c49-config\") pod \"kube-apiserver-proxy-ip-10-0-140-46.ec2.internal\" (UID: \"9611281d5444879f19610790e9303c49\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-140-46.ec2.internal" Jun 08 13:43:52.605658 ip-10-0-140-46 kubenswrapper[2576]: E0608 13:43:52.605634 2576 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-140-46.ec2.internal\" not found" Jun 08 13:43:52.706222 ip-10-0-140-46 kubenswrapper[2576]: E0608 13:43:52.706173 2576 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-140-46.ec2.internal\" not found" Jun 08 13:43:52.806474 ip-10-0-140-46 kubenswrapper[2576]: E0608 13:43:52.806448 2576 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-140-46.ec2.internal\" not found" Jun 08 13:43:52.814421 ip-10-0-140-46 kubenswrapper[2576]: I0608 13:43:52.814398 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-140-46.ec2.internal" Jun 08 13:43:52.817694 ip-10-0-140-46 kubenswrapper[2576]: I0608 13:43:52.817389 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-140-46.ec2.internal" Jun 08 13:43:52.907380 ip-10-0-140-46 kubenswrapper[2576]: E0608 13:43:52.907342 2576 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-140-46.ec2.internal\" not found" Jun 08 13:43:53.007859 ip-10-0-140-46 kubenswrapper[2576]: E0608 13:43:53.007829 2576 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-140-46.ec2.internal\" not found" Jun 08 13:43:53.108509 ip-10-0-140-46 kubenswrapper[2576]: E0608 13:43:53.108421 2576 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-140-46.ec2.internal\" not found" Jun 08 13:43:53.119196 ip-10-0-140-46 kubenswrapper[2576]: I0608 13:43:53.119173 2576 reflector.go:439] "Caches populated" type="*v1.Node" reflector="k8s.io/client-go/informers/factory.go:160" Jun 08 13:43:53.193891 ip-10-0-140-46 kubenswrapper[2576]: I0608 13:43:53.193861 2576 kubelet.go:3248] "Creating a mirror pod for static pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-140-46.ec2.internal" Jun 08 13:43:53.228664 ip-10-0-140-46 kubenswrapper[2576]: I0608 13:43:53.228632 2576 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]" Jun 08 13:43:53.230383 ip-10-0-140-46 kubenswrapper[2576]: I0608 13:43:53.230363 2576 kubelet.go:3248] "Creating a mirror pod for static pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-140-46.ec2.internal" Jun 08 13:43:53.235776 ip-10-0-140-46 kubenswrapper[2576]: I0608 13:43:53.235754 2576 transport.go:147] "Certificate rotation detected, shutting down client connections to start using new credentials" Jun 08 13:43:53.236021 ip-10-0-140-46 kubenswrapper[2576]: E0608 13:43:53.235986 2576 kubelet.go:3250] "Failed creating a mirror pod" err="Post \"https://a3536c80f4256499a870d4c6760bd5e0-bf78dff477a96a9e.elb.us-east-1.amazonaws.com:6443/api/v1/namespaces/openshift-machine-config-operator/pods\": read tcp 10.0.140.46:46500->18.211.71.144:6443: use of closed network connection" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-140-46.ec2.internal" Jun 08 13:43:53.236086 ip-10-0-140-46 kubenswrapper[2576]: I0608 13:43:53.236027 2576 reflector.go:571] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Node" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received" Jun 08 13:43:53.263049 ip-10-0-140-46 kubenswrapper[2576]: I0608 13:43:53.263023 2576 reflector.go:439] "Caches populated" type="*v1.Service" reflector="k8s.io/client-go/informers/factory.go:160" Jun 08 13:43:53.275899 ip-10-0-140-46 kubenswrapper[2576]: I0608 13:43:53.275867 2576 apiserver.go:52] "Watching apiserver" Jun 08 13:43:53.282615 ip-10-0-140-46 kubenswrapper[2576]: I0608 13:43:53.282591 2576 reflector.go:439] "Caches populated" type="*v1.Pod" reflector="pkg/kubelet/config/apiserver.go:66" Jun 08 13:43:53.284104 ip-10-0-140-46 kubenswrapper[2576]: I0608 13:43:53.283553 2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-cluster-node-tuning-operator/tuned-jxwb8","openshift-multus/network-metrics-daemon-l62qm","openshift-network-diagnostics/network-check-target-99957","kube-system/global-pull-secret-syncer-dm2n6","openshift-dns/node-resolver-f25db","openshift-image-registry/node-ca-gcmjl","openshift-multus/multus-additional-cni-plugins-pxbdv","openshift-multus/multus-fd4mq","openshift-network-operator/iptables-alerter-7zkgm","openshift-ovn-kubernetes/ovnkube-node-ncffd","kube-system/konnectivity-agent-cx7sn","kube-system/kube-apiserver-proxy-ip-10-0-140-46.ec2.internal","openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-p78hl"] Jun 08 13:43:53.285515 ip-10-0-140-46 kubenswrapper[2576]: I0608 13:43:53.285493 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-pxbdv" Jun 08 13:43:53.286631 ip-10-0-140-46 kubenswrapper[2576]: I0608 13:43:53.286614 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-l62qm" Jun 08 13:43:53.286712 ip-10-0-140-46 kubenswrapper[2576]: E0608 13:43:53.286676 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-l62qm" podUID="52fab817-1614-450d-8ea9-d10e21821af6" Jun 08 13:43:53.287840 ip-10-0-140-46 kubenswrapper[2576]: I0608 13:43:53.287825 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-99957" Jun 08 13:43:53.287901 ip-10-0-140-46 kubenswrapper[2576]: E0608 13:43:53.287874 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-99957" podUID="4b283339-40c0-40f5-b9d9-c75e99e4f984" Jun 08 13:43:53.288862 ip-10-0-140-46 kubenswrapper[2576]: I0608 13:43:53.288844 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-dm2n6" Jun 08 13:43:53.288931 ip-10-0-140-46 kubenswrapper[2576]: E0608 13:43:53.288911 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-dm2n6" podUID="6da5a732-b003-412c-8308-e80cead7eb1c" Jun 08 13:43:53.289657 ip-10-0-140-46 kubenswrapper[2576]: I0608 13:43:53.289637 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"cni-copy-resources\"" Jun 08 13:43:53.289925 ip-10-0-140-46 kubenswrapper[2576]: I0608 13:43:53.289909 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-f25db" Jun 08 13:43:53.290135 ip-10-0-140-46 kubenswrapper[2576]: I0608 13:43:53.290032 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"kube-root-ca.crt\"" Jun 08 13:43:53.290135 ip-10-0-140-46 kubenswrapper[2576]: I0608 13:43:53.290042 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"default-cni-sysctl-allowlist\"" Jun 08 13:43:53.290341 ip-10-0-140-46 kubenswrapper[2576]: I0608 13:43:53.290325 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"multus-ancillary-tools-dockercfg-8wp48\"" Jun 08 13:43:53.290403 ip-10-0-140-46 kubenswrapper[2576]: I0608 13:43:53.290337 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"openshift-service-ca.crt\"" Jun 08 13:43:53.291235 ip-10-0-140-46 kubenswrapper[2576]: I0608 13:43:53.291218 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-gcmjl" Jun 08 13:43:53.291557 ip-10-0-140-46 kubenswrapper[2576]: I0608 13:43:53.291539 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"whereabouts-flatfile-config\"" Jun 08 13:43:53.292309 ip-10-0-140-46 kubenswrapper[2576]: I0608 13:43:53.292297 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-jxwb8" Jun 08 13:43:53.293466 ip-10-0-140-46 kubenswrapper[2576]: I0608 13:43:53.293442 2576 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kubelet-serving" Jun 08 13:43:53.293591 ip-10-0-140-46 kubenswrapper[2576]: I0608 13:43:53.293560 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-fd4mq" Jun 08 13:43:53.294772 ip-10-0-140-46 kubenswrapper[2576]: I0608 13:43:53.294750 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-7zkgm" Jun 08 13:43:53.296121 ip-10-0-140-46 kubenswrapper[2576]: I0608 13:43:53.296103 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-ncffd" Jun 08 13:43:53.297301 ip-10-0-140-46 kubenswrapper[2576]: I0608 13:43:53.297283 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-cx7sn" Jun 08 13:43:53.298806 ip-10-0-140-46 kubenswrapper[2576]: I0608 13:43:53.298788 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-p78hl" Jun 08 13:43:53.299113 ip-10-0-140-46 kubenswrapper[2576]: I0608 13:43:53.299095 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/f2c67e68-042b-487a-bafa-a22aa9bd82df-os-release\") pod \"multus-fd4mq\" (UID: \"f2c67e68-042b-487a-bafa-a22aa9bd82df\") " pod="openshift-multus/multus-fd4mq" Jun 08 13:43:53.299194 ip-10-0-140-46 kubenswrapper[2576]: I0608 13:43:53.299120 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/f2c67e68-042b-487a-bafa-a22aa9bd82df-host-var-lib-kubelet\") pod \"multus-fd4mq\" (UID: \"f2c67e68-042b-487a-bafa-a22aa9bd82df\") " pod="openshift-multus/multus-fd4mq" Jun 08 13:43:53.299194 ip-10-0-140-46 kubenswrapper[2576]: I0608 13:43:53.299168 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/18b84a5c-7b8b-4e1b-a70a-4fbda39064bf-system-cni-dir\") pod \"multus-additional-cni-plugins-pxbdv\" (UID: \"18b84a5c-7b8b-4e1b-a70a-4fbda39064bf\") " pod="openshift-multus/multus-additional-cni-plugins-pxbdv" Jun 08 13:43:53.299194 ip-10-0-140-46 kubenswrapper[2576]: I0608 13:43:53.299191 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/6da5a732-b003-412c-8308-e80cead7eb1c-original-pull-secret\") pod \"global-pull-secret-syncer-dm2n6\" (UID: \"6da5a732-b003-412c-8308-e80cead7eb1c\") " pod="kube-system/global-pull-secret-syncer-dm2n6" Jun 08 13:43:53.299350 ip-10-0-140-46 kubenswrapper[2576]: I0608 13:43:53.299208 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/f2c67e68-042b-487a-bafa-a22aa9bd82df-multus-cni-dir\") pod \"multus-fd4mq\" (UID: \"f2c67e68-042b-487a-bafa-a22aa9bd82df\") " pod="openshift-multus/multus-fd4mq" Jun 08 13:43:53.299350 ip-10-0-140-46 kubenswrapper[2576]: I0608 13:43:53.299224 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xjs6t\" (UniqueName: \"kubernetes.io/projected/ef6c467c-acc8-428e-950f-e0d25491f708-kube-api-access-xjs6t\") pod \"iptables-alerter-7zkgm\" (UID: \"ef6c467c-acc8-428e-950f-e0d25491f708\") " pod="openshift-network-operator/iptables-alerter-7zkgm" Jun 08 13:43:53.299350 ip-10-0-140-46 kubenswrapper[2576]: I0608 13:43:53.299251 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/f2c67e68-042b-487a-bafa-a22aa9bd82df-system-cni-dir\") pod \"multus-fd4mq\" (UID: \"f2c67e68-042b-487a-bafa-a22aa9bd82df\") " pod="openshift-multus/multus-fd4mq" Jun 08 13:43:53.299350 ip-10-0-140-46 kubenswrapper[2576]: I0608 13:43:53.299273 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xfzgf\" (UniqueName: \"kubernetes.io/projected/18b84a5c-7b8b-4e1b-a70a-4fbda39064bf-kube-api-access-xfzgf\") pod \"multus-additional-cni-plugins-pxbdv\" (UID: \"18b84a5c-7b8b-4e1b-a70a-4fbda39064bf\") " pod="openshift-multus/multus-additional-cni-plugins-pxbdv" Jun 08 13:43:53.299350 ip-10-0-140-46 kubenswrapper[2576]: I0608 13:43:53.299287 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/2cf3d8d4-e8f9-402e-9fa7-b564c4ea705c-hosts-file\") pod \"node-resolver-f25db\" (UID: \"2cf3d8d4-e8f9-402e-9fa7-b564c4ea705c\") " pod="openshift-dns/node-resolver-f25db" Jun 08 13:43:53.299350 ip-10-0-140-46 kubenswrapper[2576]: I0608 13:43:53.299300 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/899b8b33-b573-4d67-ae45-773ec4b36e28-etc-tuned\") pod \"tuned-jxwb8\" (UID: \"899b8b33-b573-4d67-ae45-773ec4b36e28\") " pod="openshift-cluster-node-tuning-operator/tuned-jxwb8" Jun 08 13:43:53.299350 ip-10-0-140-46 kubenswrapper[2576]: I0608 13:43:53.299322 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-22qn8\" (UniqueName: \"kubernetes.io/projected/899b8b33-b573-4d67-ae45-773ec4b36e28-kube-api-access-22qn8\") pod \"tuned-jxwb8\" (UID: \"899b8b33-b573-4d67-ae45-773ec4b36e28\") " pod="openshift-cluster-node-tuning-operator/tuned-jxwb8" Jun 08 13:43:53.299350 ip-10-0-140-46 kubenswrapper[2576]: I0608 13:43:53.299347 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/18b84a5c-7b8b-4e1b-a70a-4fbda39064bf-cnibin\") pod \"multus-additional-cni-plugins-pxbdv\" (UID: \"18b84a5c-7b8b-4e1b-a70a-4fbda39064bf\") " pod="openshift-multus/multus-additional-cni-plugins-pxbdv" Jun 08 13:43:53.299715 ip-10-0-140-46 kubenswrapper[2576]: I0608 13:43:53.299369 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/8e1453fa-6b1d-4b93-98cf-5fe4d2829935-host\") pod \"node-ca-gcmjl\" (UID: \"8e1453fa-6b1d-4b93-98cf-5fe4d2829935\") " pod="openshift-image-registry/node-ca-gcmjl" Jun 08 13:43:53.299715 ip-10-0-140-46 kubenswrapper[2576]: I0608 13:43:53.299385 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/899b8b33-b573-4d67-ae45-773ec4b36e28-tmp\") pod \"tuned-jxwb8\" (UID: \"899b8b33-b573-4d67-ae45-773ec4b36e28\") " pod="openshift-cluster-node-tuning-operator/tuned-jxwb8" Jun 08 13:43:53.299715 ip-10-0-140-46 kubenswrapper[2576]: I0608 13:43:53.299399 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/52fab817-1614-450d-8ea9-d10e21821af6-metrics-certs\") pod \"network-metrics-daemon-l62qm\" (UID: \"52fab817-1614-450d-8ea9-d10e21821af6\") " pod="openshift-multus/network-metrics-daemon-l62qm" Jun 08 13:43:53.299715 ip-10-0-140-46 kubenswrapper[2576]: I0608 13:43:53.299413 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hrtpg\" (UniqueName: \"kubernetes.io/projected/8e1453fa-6b1d-4b93-98cf-5fe4d2829935-kube-api-access-hrtpg\") pod \"node-ca-gcmjl\" (UID: \"8e1453fa-6b1d-4b93-98cf-5fe4d2829935\") " pod="openshift-image-registry/node-ca-gcmjl" Jun 08 13:43:53.299715 ip-10-0-140-46 kubenswrapper[2576]: I0608 13:43:53.299432 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/899b8b33-b573-4d67-ae45-773ec4b36e28-run\") pod \"tuned-jxwb8\" (UID: \"899b8b33-b573-4d67-ae45-773ec4b36e28\") " pod="openshift-cluster-node-tuning-operator/tuned-jxwb8" Jun 08 13:43:53.299715 ip-10-0-140-46 kubenswrapper[2576]: I0608 13:43:53.299460 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/899b8b33-b573-4d67-ae45-773ec4b36e28-host\") pod \"tuned-jxwb8\" (UID: \"899b8b33-b573-4d67-ae45-773ec4b36e28\") " pod="openshift-cluster-node-tuning-operator/tuned-jxwb8" Jun 08 13:43:53.299715 ip-10-0-140-46 kubenswrapper[2576]: I0608 13:43:53.299479 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/6da5a732-b003-412c-8308-e80cead7eb1c-kubelet-config\") pod \"global-pull-secret-syncer-dm2n6\" (UID: \"6da5a732-b003-412c-8308-e80cead7eb1c\") " pod="kube-system/global-pull-secret-syncer-dm2n6" Jun 08 13:43:53.299715 ip-10-0-140-46 kubenswrapper[2576]: I0608 13:43:53.299494 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/f2c67e68-042b-487a-bafa-a22aa9bd82df-cnibin\") pod \"multus-fd4mq\" (UID: \"f2c67e68-042b-487a-bafa-a22aa9bd82df\") " pod="openshift-multus/multus-fd4mq" Jun 08 13:43:53.299715 ip-10-0-140-46 kubenswrapper[2576]: I0608 13:43:53.299514 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/f2c67e68-042b-487a-bafa-a22aa9bd82df-host-run-multus-certs\") pod \"multus-fd4mq\" (UID: \"f2c67e68-042b-487a-bafa-a22aa9bd82df\") " pod="openshift-multus/multus-fd4mq" Jun 08 13:43:53.299715 ip-10-0-140-46 kubenswrapper[2576]: I0608 13:43:53.299543 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/8e1453fa-6b1d-4b93-98cf-5fe4d2829935-serviceca\") pod \"node-ca-gcmjl\" (UID: \"8e1453fa-6b1d-4b93-98cf-5fe4d2829935\") " pod="openshift-image-registry/node-ca-gcmjl" Jun 08 13:43:53.299715 ip-10-0-140-46 kubenswrapper[2576]: I0608 13:43:53.299556 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/899b8b33-b573-4d67-ae45-773ec4b36e28-etc-kubernetes\") pod \"tuned-jxwb8\" (UID: \"899b8b33-b573-4d67-ae45-773ec4b36e28\") " pod="openshift-cluster-node-tuning-operator/tuned-jxwb8" Jun 08 13:43:53.299715 ip-10-0-140-46 kubenswrapper[2576]: I0608 13:43:53.299592 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/899b8b33-b573-4d67-ae45-773ec4b36e28-etc-systemd\") pod \"tuned-jxwb8\" (UID: \"899b8b33-b573-4d67-ae45-773ec4b36e28\") " pod="openshift-cluster-node-tuning-operator/tuned-jxwb8" Jun 08 13:43:53.299715 ip-10-0-140-46 kubenswrapper[2576]: I0608 13:43:53.299615 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/f2c67e68-042b-487a-bafa-a22aa9bd82df-host-run-netns\") pod \"multus-fd4mq\" (UID: \"f2c67e68-042b-487a-bafa-a22aa9bd82df\") " pod="openshift-multus/multus-fd4mq" Jun 08 13:43:53.299715 ip-10-0-140-46 kubenswrapper[2576]: I0608 13:43:53.299638 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/f2c67e68-042b-487a-bafa-a22aa9bd82df-host-var-lib-cni-bin\") pod \"multus-fd4mq\" (UID: \"f2c67e68-042b-487a-bafa-a22aa9bd82df\") " pod="openshift-multus/multus-fd4mq" Jun 08 13:43:53.299715 ip-10-0-140-46 kubenswrapper[2576]: I0608 13:43:53.299660 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/f2c67e68-042b-487a-bafa-a22aa9bd82df-host-var-lib-cni-multus\") pod \"multus-fd4mq\" (UID: \"f2c67e68-042b-487a-bafa-a22aa9bd82df\") " pod="openshift-multus/multus-fd4mq" Jun 08 13:43:53.299715 ip-10-0-140-46 kubenswrapper[2576]: I0608 13:43:53.299683 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/f2c67e68-042b-487a-bafa-a22aa9bd82df-hostroot\") pod \"multus-fd4mq\" (UID: \"f2c67e68-042b-487a-bafa-a22aa9bd82df\") " pod="openshift-multus/multus-fd4mq" Jun 08 13:43:53.299715 ip-10-0-140-46 kubenswrapper[2576]: I0608 13:43:53.299713 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/18b84a5c-7b8b-4e1b-a70a-4fbda39064bf-os-release\") pod \"multus-additional-cni-plugins-pxbdv\" (UID: \"18b84a5c-7b8b-4e1b-a70a-4fbda39064bf\") " pod="openshift-multus/multus-additional-cni-plugins-pxbdv" Jun 08 13:43:53.300462 ip-10-0-140-46 kubenswrapper[2576]: I0608 13:43:53.299730 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/18b84a5c-7b8b-4e1b-a70a-4fbda39064bf-tuning-conf-dir\") pod \"multus-additional-cni-plugins-pxbdv\" (UID: \"18b84a5c-7b8b-4e1b-a70a-4fbda39064bf\") " pod="openshift-multus/multus-additional-cni-plugins-pxbdv" Jun 08 13:43:53.300462 ip-10-0-140-46 kubenswrapper[2576]: I0608 13:43:53.299743 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/f2c67e68-042b-487a-bafa-a22aa9bd82df-multus-socket-dir-parent\") pod \"multus-fd4mq\" (UID: \"f2c67e68-042b-487a-bafa-a22aa9bd82df\") " pod="openshift-multus/multus-fd4mq" Jun 08 13:43:53.300462 ip-10-0-140-46 kubenswrapper[2576]: I0608 13:43:53.299757 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/f2c67e68-042b-487a-bafa-a22aa9bd82df-multus-conf-dir\") pod \"multus-fd4mq\" (UID: \"f2c67e68-042b-487a-bafa-a22aa9bd82df\") " pod="openshift-multus/multus-fd4mq" Jun 08 13:43:53.300462 ip-10-0-140-46 kubenswrapper[2576]: I0608 13:43:53.299785 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/18b84a5c-7b8b-4e1b-a70a-4fbda39064bf-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-pxbdv\" (UID: \"18b84a5c-7b8b-4e1b-a70a-4fbda39064bf\") " pod="openshift-multus/multus-additional-cni-plugins-pxbdv" Jun 08 13:43:53.300462 ip-10-0-140-46 kubenswrapper[2576]: I0608 13:43:53.299810 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/f2c67e68-042b-487a-bafa-a22aa9bd82df-cni-binary-copy\") pod \"multus-fd4mq\" (UID: \"f2c67e68-042b-487a-bafa-a22aa9bd82df\") " pod="openshift-multus/multus-fd4mq" Jun 08 13:43:53.300462 ip-10-0-140-46 kubenswrapper[2576]: I0608 13:43:53.299827 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/f2c67e68-042b-487a-bafa-a22aa9bd82df-host-run-k8s-cni-cncf-io\") pod \"multus-fd4mq\" (UID: \"f2c67e68-042b-487a-bafa-a22aa9bd82df\") " pod="openshift-multus/multus-fd4mq" Jun 08 13:43:53.300462 ip-10-0-140-46 kubenswrapper[2576]: I0608 13:43:53.299842 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/f2c67e68-042b-487a-bafa-a22aa9bd82df-etc-kubernetes\") pod \"multus-fd4mq\" (UID: \"f2c67e68-042b-487a-bafa-a22aa9bd82df\") " pod="openshift-multus/multus-fd4mq" Jun 08 13:43:53.300462 ip-10-0-140-46 kubenswrapper[2576]: I0608 13:43:53.299857 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/ef6c467c-acc8-428e-950f-e0d25491f708-iptables-alerter-script\") pod \"iptables-alerter-7zkgm\" (UID: \"ef6c467c-acc8-428e-950f-e0d25491f708\") " pod="openshift-network-operator/iptables-alerter-7zkgm" Jun 08 13:43:53.300462 ip-10-0-140-46 kubenswrapper[2576]: I0608 13:43:53.299871 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5jttb\" (UniqueName: \"kubernetes.io/projected/4b283339-40c0-40f5-b9d9-c75e99e4f984-kube-api-access-5jttb\") pod \"network-check-target-99957\" (UID: \"4b283339-40c0-40f5-b9d9-c75e99e4f984\") " pod="openshift-network-diagnostics/network-check-target-99957" Jun 08 13:43:53.300462 ip-10-0-140-46 kubenswrapper[2576]: I0608 13:43:53.299884 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/6da5a732-b003-412c-8308-e80cead7eb1c-dbus\") pod \"global-pull-secret-syncer-dm2n6\" (UID: \"6da5a732-b003-412c-8308-e80cead7eb1c\") " pod="kube-system/global-pull-secret-syncer-dm2n6" Jun 08 13:43:53.300462 ip-10-0-140-46 kubenswrapper[2576]: I0608 13:43:53.299900 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/18b84a5c-7b8b-4e1b-a70a-4fbda39064bf-cni-binary-copy\") pod \"multus-additional-cni-plugins-pxbdv\" (UID: \"18b84a5c-7b8b-4e1b-a70a-4fbda39064bf\") " pod="openshift-multus/multus-additional-cni-plugins-pxbdv" Jun 08 13:43:53.300462 ip-10-0-140-46 kubenswrapper[2576]: I0608 13:43:53.299914 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xbc59\" (UniqueName: \"kubernetes.io/projected/2cf3d8d4-e8f9-402e-9fa7-b564c4ea705c-kube-api-access-xbc59\") pod \"node-resolver-f25db\" (UID: \"2cf3d8d4-e8f9-402e-9fa7-b564c4ea705c\") " pod="openshift-dns/node-resolver-f25db" Jun 08 13:43:53.300462 ip-10-0-140-46 kubenswrapper[2576]: I0608 13:43:53.299928 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/899b8b33-b573-4d67-ae45-773ec4b36e28-etc-sysctl-conf\") pod \"tuned-jxwb8\" (UID: \"899b8b33-b573-4d67-ae45-773ec4b36e28\") " pod="openshift-cluster-node-tuning-operator/tuned-jxwb8" Jun 08 13:43:53.300462 ip-10-0-140-46 kubenswrapper[2576]: I0608 13:43:53.299941 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6xckl\" (UniqueName: \"kubernetes.io/projected/f2c67e68-042b-487a-bafa-a22aa9bd82df-kube-api-access-6xckl\") pod \"multus-fd4mq\" (UID: \"f2c67e68-042b-487a-bafa-a22aa9bd82df\") " pod="openshift-multus/multus-fd4mq" Jun 08 13:43:53.300462 ip-10-0-140-46 kubenswrapper[2576]: I0608 13:43:53.299958 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/18b84a5c-7b8b-4e1b-a70a-4fbda39064bf-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-pxbdv\" (UID: \"18b84a5c-7b8b-4e1b-a70a-4fbda39064bf\") " pod="openshift-multus/multus-additional-cni-plugins-pxbdv" Jun 08 13:43:53.300462 ip-10-0-140-46 kubenswrapper[2576]: I0608 13:43:53.299979 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/2cf3d8d4-e8f9-402e-9fa7-b564c4ea705c-tmp-dir\") pod \"node-resolver-f25db\" (UID: \"2cf3d8d4-e8f9-402e-9fa7-b564c4ea705c\") " pod="openshift-dns/node-resolver-f25db" Jun 08 13:43:53.300976 ip-10-0-140-46 kubenswrapper[2576]: I0608 13:43:53.300001 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/899b8b33-b573-4d67-ae45-773ec4b36e28-etc-modprobe-d\") pod \"tuned-jxwb8\" (UID: \"899b8b33-b573-4d67-ae45-773ec4b36e28\") " pod="openshift-cluster-node-tuning-operator/tuned-jxwb8" Jun 08 13:43:53.300976 ip-10-0-140-46 kubenswrapper[2576]: I0608 13:43:53.300025 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/899b8b33-b573-4d67-ae45-773ec4b36e28-etc-sysconfig\") pod \"tuned-jxwb8\" (UID: \"899b8b33-b573-4d67-ae45-773ec4b36e28\") " pod="openshift-cluster-node-tuning-operator/tuned-jxwb8" Jun 08 13:43:53.300976 ip-10-0-140-46 kubenswrapper[2576]: I0608 13:43:53.300040 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/ef6c467c-acc8-428e-950f-e0d25491f708-host-slash\") pod \"iptables-alerter-7zkgm\" (UID: \"ef6c467c-acc8-428e-950f-e0d25491f708\") " pod="openshift-network-operator/iptables-alerter-7zkgm" Jun 08 13:43:53.300976 ip-10-0-140-46 kubenswrapper[2576]: I0608 13:43:53.300065 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/899b8b33-b573-4d67-ae45-773ec4b36e28-lib-modules\") pod \"tuned-jxwb8\" (UID: \"899b8b33-b573-4d67-ae45-773ec4b36e28\") " pod="openshift-cluster-node-tuning-operator/tuned-jxwb8" Jun 08 13:43:53.300976 ip-10-0-140-46 kubenswrapper[2576]: I0608 13:43:53.300090 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-pjqn4\" (UniqueName: \"kubernetes.io/projected/52fab817-1614-450d-8ea9-d10e21821af6-kube-api-access-pjqn4\") pod \"network-metrics-daemon-l62qm\" (UID: \"52fab817-1614-450d-8ea9-d10e21821af6\") " pod="openshift-multus/network-metrics-daemon-l62qm" Jun 08 13:43:53.300976 ip-10-0-140-46 kubenswrapper[2576]: I0608 13:43:53.300115 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/899b8b33-b573-4d67-ae45-773ec4b36e28-etc-sysctl-d\") pod \"tuned-jxwb8\" (UID: \"899b8b33-b573-4d67-ae45-773ec4b36e28\") " pod="openshift-cluster-node-tuning-operator/tuned-jxwb8" Jun 08 13:43:53.300976 ip-10-0-140-46 kubenswrapper[2576]: I0608 13:43:53.300146 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/899b8b33-b573-4d67-ae45-773ec4b36e28-sys\") pod \"tuned-jxwb8\" (UID: \"899b8b33-b573-4d67-ae45-773ec4b36e28\") " pod="openshift-cluster-node-tuning-operator/tuned-jxwb8" Jun 08 13:43:53.300976 ip-10-0-140-46 kubenswrapper[2576]: I0608 13:43:53.300161 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/f2c67e68-042b-487a-bafa-a22aa9bd82df-multus-daemon-config\") pod \"multus-fd4mq\" (UID: \"f2c67e68-042b-487a-bafa-a22aa9bd82df\") " pod="openshift-multus/multus-fd4mq" Jun 08 13:43:53.300976 ip-10-0-140-46 kubenswrapper[2576]: I0608 13:43:53.300175 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/899b8b33-b573-4d67-ae45-773ec4b36e28-var-lib-kubelet\") pod \"tuned-jxwb8\" (UID: \"899b8b33-b573-4d67-ae45-773ec4b36e28\") " pod="openshift-cluster-node-tuning-operator/tuned-jxwb8" Jun 08 13:43:53.306923 ip-10-0-140-46 kubenswrapper[2576]: I0608 13:43:53.306905 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"openshift-service-ca.crt\"" Jun 08 13:43:53.307005 ip-10-0-140-46 kubenswrapper[2576]: W0608 13:43:53.306912 2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2c0edf5a3fd2add71c45634ad4d02cef.slice/crio-9a8e1077e5c1dac75b497a6b151df8ada7405141be5dad94763f5c412d6b003e WatchSource:0}: Error finding container 9a8e1077e5c1dac75b497a6b151df8ada7405141be5dad94763f5c412d6b003e: Status 404 returned error can't find the container with id 9a8e1077e5c1dac75b497a6b151df8ada7405141be5dad94763f5c412d6b003e Jun 08 13:43:53.307131 ip-10-0-140-46 kubenswrapper[2576]: I0608 13:43:53.307117 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"image-registry-certificates\"" Jun 08 13:43:53.307200 ip-10-0-140-46 kubenswrapper[2576]: W0608 13:43:53.307147 2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9611281d5444879f19610790e9303c49.slice/crio-35a29522ddda5c635bc08e727be2a569929ef3a07503297a3182fdf02c1837f1 WatchSource:0}: Error finding container 35a29522ddda5c635bc08e727be2a569929ef3a07503297a3182fdf02c1837f1: Status 404 returned error can't find the container with id 35a29522ddda5c635bc08e727be2a569929ef3a07503297a3182fdf02c1837f1 Jun 08 13:43:53.313970 ip-10-0-140-46 kubenswrapper[2576]: I0608 13:43:53.313944 2576 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jun 08 13:43:53.314382 ip-10-0-140-46 kubenswrapper[2576]: I0608 13:43:53.314351 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"default-dockercfg-z98kp\"" Jun 08 13:43:53.331701 ip-10-0-140-46 kubenswrapper[2576]: I0608 13:43:53.331680 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kube-system\"/\"konnectivity-ca-bundle\"" Jun 08 13:43:53.331859 ip-10-0-140-46 kubenswrapper[2576]: I0608 13:43:53.331823 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"openshift-service-ca.crt\"" Jun 08 13:43:53.331955 ip-10-0-140-46 kubenswrapper[2576]: I0608 13:43:53.331911 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"kube-root-ca.crt\"" Jun 08 13:43:53.332239 ip-10-0-140-46 kubenswrapper[2576]: I0608 13:43:53.332193 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"kube-root-ca.crt\"" Jun 08 13:43:53.332239 ip-10-0-140-46 kubenswrapper[2576]: I0608 13:43:53.332208 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"openshift-service-ca.crt\"" Jun 08 13:43:53.332394 ip-10-0-140-46 kubenswrapper[2576]: I0608 13:43:53.332295 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-node-metrics-cert\"" Jun 08 13:43:53.332394 ip-10-0-140-46 kubenswrapper[2576]: I0608 13:43:53.332208 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"env-overrides\"" Jun 08 13:43:53.332394 ip-10-0-140-46 kubenswrapper[2576]: I0608 13:43:53.332350 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"node-ca-dockercfg-tfktm\"" Jun 08 13:43:53.332394 ip-10-0-140-46 kubenswrapper[2576]: I0608 13:43:53.332362 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"openshift-service-ca.crt\"" Jun 08 13:43:53.332592 ip-10-0-140-46 kubenswrapper[2576]: I0608 13:43:53.332392 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-config\"" Jun 08 13:43:53.332592 ip-10-0-140-46 kubenswrapper[2576]: I0608 13:43:53.332458 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"tuned-dockercfg-bpcf7\"" Jun 08 13:43:53.332592 ip-10-0-140-46 kubenswrapper[2576]: I0608 13:43:53.332536 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"kube-root-ca.crt\"" Jun 08 13:43:53.333846 ip-10-0-140-46 kubenswrapper[2576]: I0608 13:43:53.333551 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"kube-root-ca.crt\"" Jun 08 13:43:53.334176 ip-10-0-140-46 kubenswrapper[2576]: I0608 13:43:53.334154 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"konnectivity-agent\"" Jun 08 13:43:53.334727 ip-10-0-140-46 kubenswrapper[2576]: I0608 13:43:53.334707 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-metrics-serving-cert\"" Jun 08 13:43:53.334949 ip-10-0-140-46 kubenswrapper[2576]: I0608 13:43:53.334896 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"openshift-service-ca.crt\"" Jun 08 13:43:53.336460 ip-10-0-140-46 kubenswrapper[2576]: I0608 13:43:53.335435 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"kube-root-ca.crt\"" Jun 08 13:43:53.336460 ip-10-0-140-46 kubenswrapper[2576]: I0608 13:43:53.335842 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-kubernetes-node-dockercfg-gd5tr\"" Jun 08 13:43:53.336460 ip-10-0-140-46 kubenswrapper[2576]: I0608 13:43:53.335857 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-script-lib\"" Jun 08 13:43:53.336460 ip-10-0-140-46 kubenswrapper[2576]: I0608 13:43:53.336105 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"openshift-service-ca.crt\"" Jun 08 13:43:53.336460 ip-10-0-140-46 kubenswrapper[2576]: I0608 13:43:53.336211 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-script\"" Jun 08 13:43:53.336460 ip-10-0-140-46 kubenswrapper[2576]: I0608 13:43:53.336297 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-sa-dockercfg-p27ll\"" Jun 08 13:43:53.336460 ip-10-0-140-46 kubenswrapper[2576]: I0608 13:43:53.336399 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"node-resolver-dockercfg-8cg92\"" Jun 08 13:43:53.336460 ip-10-0-140-46 kubenswrapper[2576]: I0608 13:43:53.336415 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-dockercfg-k7fph\"" Jun 08 13:43:53.336847 ip-10-0-140-46 kubenswrapper[2576]: I0608 13:43:53.336529 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"kube-root-ca.crt\"" Jun 08 13:43:53.336847 ip-10-0-140-46 kubenswrapper[2576]: I0608 13:43:53.336790 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"multus-daemon-config\"" Jun 08 13:43:53.337226 ip-10-0-140-46 kubenswrapper[2576]: I0608 13:43:53.337210 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"default-dockercfg-jhbx7\"" Jun 08 13:43:53.348514 ip-10-0-140-46 kubenswrapper[2576]: I0608 13:43:53.348490 2576 reflector.go:439] "Caches populated" logger="kubernetes.io/kubelet-serving" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162" Jun 08 13:43:53.374526 ip-10-0-140-46 kubenswrapper[2576]: I0608 13:43:53.374432 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-140-46.ec2.internal" event={"ID":"2c0edf5a3fd2add71c45634ad4d02cef","Type":"ContainerStarted","Data":"9a8e1077e5c1dac75b497a6b151df8ada7405141be5dad94763f5c412d6b003e"} Jun 08 13:43:53.375412 ip-10-0-140-46 kubenswrapper[2576]: I0608 13:43:53.375392 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-140-46.ec2.internal" event={"ID":"9611281d5444879f19610790e9303c49","Type":"ContainerStarted","Data":"35a29522ddda5c635bc08e727be2a569929ef3a07503297a3182fdf02c1837f1"} Jun 08 13:43:53.384359 ip-10-0-140-46 kubenswrapper[2576]: I0608 13:43:53.384341 2576 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kubelet-serving" csr="csr-pn9jj" Jun 08 13:43:53.391524 ip-10-0-140-46 kubenswrapper[2576]: I0608 13:43:53.391481 2576 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kube-apiserver-client-kubelet" expiration="2028-06-07 13:38:52 +0000 UTC" deadline="2028-01-09 12:39:16.347567189 +0000 UTC" Jun 08 13:43:53.391589 ip-10-0-140-46 kubenswrapper[2576]: I0608 13:43:53.391526 2576 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kube-apiserver-client-kubelet" sleep="13918h55m22.956046018s" Jun 08 13:43:53.394198 ip-10-0-140-46 kubenswrapper[2576]: I0608 13:43:53.394181 2576 desired_state_of_world_populator.go:154] "Finished populating initial desired state of world" Jun 08 13:43:53.400893 ip-10-0-140-46 kubenswrapper[2576]: I0608 13:43:53.400872 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/c26912ca-10b4-4ae3-b306-890f93abfee3-host-run-netns\") pod \"ovnkube-node-ncffd\" (UID: \"c26912ca-10b4-4ae3-b306-890f93abfee3\") " pod="openshift-ovn-kubernetes/ovnkube-node-ncffd" Jun 08 13:43:53.400942 ip-10-0-140-46 kubenswrapper[2576]: I0608 13:43:53.400906 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/18b84a5c-7b8b-4e1b-a70a-4fbda39064bf-os-release\") pod \"multus-additional-cni-plugins-pxbdv\" (UID: \"18b84a5c-7b8b-4e1b-a70a-4fbda39064bf\") " pod="openshift-multus/multus-additional-cni-plugins-pxbdv" Jun 08 13:43:53.400942 ip-10-0-140-46 kubenswrapper[2576]: I0608 13:43:53.400924 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/18b84a5c-7b8b-4e1b-a70a-4fbda39064bf-tuning-conf-dir\") pod \"multus-additional-cni-plugins-pxbdv\" (UID: \"18b84a5c-7b8b-4e1b-a70a-4fbda39064bf\") " pod="openshift-multus/multus-additional-cni-plugins-pxbdv" Jun 08 13:43:53.400942 ip-10-0-140-46 kubenswrapper[2576]: I0608 13:43:53.400939 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/f2c67e68-042b-487a-bafa-a22aa9bd82df-multus-socket-dir-parent\") pod \"multus-fd4mq\" (UID: \"f2c67e68-042b-487a-bafa-a22aa9bd82df\") " pod="openshift-multus/multus-fd4mq" Jun 08 13:43:53.401093 ip-10-0-140-46 kubenswrapper[2576]: I0608 13:43:53.400981 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/f2c67e68-042b-487a-bafa-a22aa9bd82df-multus-conf-dir\") pod \"multus-fd4mq\" (UID: \"f2c67e68-042b-487a-bafa-a22aa9bd82df\") " pod="openshift-multus/multus-fd4mq" Jun 08 13:43:53.401093 ip-10-0-140-46 kubenswrapper[2576]: I0608 13:43:53.401006 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/f2c67e68-042b-487a-bafa-a22aa9bd82df-multus-socket-dir-parent\") pod \"multus-fd4mq\" (UID: \"f2c67e68-042b-487a-bafa-a22aa9bd82df\") " pod="openshift-multus/multus-fd4mq" Jun 08 13:43:53.401093 ip-10-0-140-46 kubenswrapper[2576]: I0608 13:43:53.401018 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/c26912ca-10b4-4ae3-b306-890f93abfee3-var-lib-openvswitch\") pod \"ovnkube-node-ncffd\" (UID: \"c26912ca-10b4-4ae3-b306-890f93abfee3\") " pod="openshift-ovn-kubernetes/ovnkube-node-ncffd" Jun 08 13:43:53.401093 ip-10-0-140-46 kubenswrapper[2576]: I0608 13:43:53.401065 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/18b84a5c-7b8b-4e1b-a70a-4fbda39064bf-os-release\") pod \"multus-additional-cni-plugins-pxbdv\" (UID: \"18b84a5c-7b8b-4e1b-a70a-4fbda39064bf\") " pod="openshift-multus/multus-additional-cni-plugins-pxbdv" Jun 08 13:43:53.401093 ip-10-0-140-46 kubenswrapper[2576]: I0608 13:43:53.401046 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/c26912ca-10b4-4ae3-b306-890f93abfee3-node-log\") pod \"ovnkube-node-ncffd\" (UID: \"c26912ca-10b4-4ae3-b306-890f93abfee3\") " pod="openshift-ovn-kubernetes/ovnkube-node-ncffd" Jun 08 13:43:53.401434 ip-10-0-140-46 kubenswrapper[2576]: I0608 13:43:53.401100 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/c26912ca-10b4-4ae3-b306-890f93abfee3-env-overrides\") pod \"ovnkube-node-ncffd\" (UID: \"c26912ca-10b4-4ae3-b306-890f93abfee3\") " pod="openshift-ovn-kubernetes/ovnkube-node-ncffd" Jun 08 13:43:53.401434 ip-10-0-140-46 kubenswrapper[2576]: I0608 13:43:53.401074 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/f2c67e68-042b-487a-bafa-a22aa9bd82df-multus-conf-dir\") pod \"multus-fd4mq\" (UID: \"f2c67e68-042b-487a-bafa-a22aa9bd82df\") " pod="openshift-multus/multus-fd4mq" Jun 08 13:43:53.401434 ip-10-0-140-46 kubenswrapper[2576]: I0608 13:43:53.401140 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/18b84a5c-7b8b-4e1b-a70a-4fbda39064bf-tuning-conf-dir\") pod \"multus-additional-cni-plugins-pxbdv\" (UID: \"18b84a5c-7b8b-4e1b-a70a-4fbda39064bf\") " pod="openshift-multus/multus-additional-cni-plugins-pxbdv" Jun 08 13:43:53.401434 ip-10-0-140-46 kubenswrapper[2576]: I0608 13:43:53.401125 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/18b84a5c-7b8b-4e1b-a70a-4fbda39064bf-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-pxbdv\" (UID: \"18b84a5c-7b8b-4e1b-a70a-4fbda39064bf\") " pod="openshift-multus/multus-additional-cni-plugins-pxbdv" Jun 08 13:43:53.401434 ip-10-0-140-46 kubenswrapper[2576]: I0608 13:43:53.401182 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/f2c67e68-042b-487a-bafa-a22aa9bd82df-cni-binary-copy\") pod \"multus-fd4mq\" (UID: \"f2c67e68-042b-487a-bafa-a22aa9bd82df\") " pod="openshift-multus/multus-fd4mq" Jun 08 13:43:53.401434 ip-10-0-140-46 kubenswrapper[2576]: I0608 13:43:53.401224 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/f2c67e68-042b-487a-bafa-a22aa9bd82df-host-run-k8s-cni-cncf-io\") pod \"multus-fd4mq\" (UID: \"f2c67e68-042b-487a-bafa-a22aa9bd82df\") " pod="openshift-multus/multus-fd4mq" Jun 08 13:43:53.401434 ip-10-0-140-46 kubenswrapper[2576]: I0608 13:43:53.401304 2576 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kubelet-serving" csr="csr-pn9jj" Jun 08 13:43:53.401434 ip-10-0-140-46 kubenswrapper[2576]: I0608 13:43:53.401326 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/f2c67e68-042b-487a-bafa-a22aa9bd82df-etc-kubernetes\") pod \"multus-fd4mq\" (UID: \"f2c67e68-042b-487a-bafa-a22aa9bd82df\") " pod="openshift-multus/multus-fd4mq" Jun 08 13:43:53.401434 ip-10-0-140-46 kubenswrapper[2576]: I0608 13:43:53.401351 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/ef6c467c-acc8-428e-950f-e0d25491f708-iptables-alerter-script\") pod \"iptables-alerter-7zkgm\" (UID: \"ef6c467c-acc8-428e-950f-e0d25491f708\") " pod="openshift-network-operator/iptables-alerter-7zkgm" Jun 08 13:43:53.401434 ip-10-0-140-46 kubenswrapper[2576]: I0608 13:43:53.401418 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/f2c67e68-042b-487a-bafa-a22aa9bd82df-etc-kubernetes\") pod \"multus-fd4mq\" (UID: \"f2c67e68-042b-487a-bafa-a22aa9bd82df\") " pod="openshift-multus/multus-fd4mq" Jun 08 13:43:53.401434 ip-10-0-140-46 kubenswrapper[2576]: I0608 13:43:53.401412 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5jttb\" (UniqueName: \"kubernetes.io/projected/4b283339-40c0-40f5-b9d9-c75e99e4f984-kube-api-access-5jttb\") pod \"network-check-target-99957\" (UID: \"4b283339-40c0-40f5-b9d9-c75e99e4f984\") " pod="openshift-network-diagnostics/network-check-target-99957" Jun 08 13:43:53.401951 ip-10-0-140-46 kubenswrapper[2576]: I0608 13:43:53.401458 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/f2c67e68-042b-487a-bafa-a22aa9bd82df-host-run-k8s-cni-cncf-io\") pod \"multus-fd4mq\" (UID: \"f2c67e68-042b-487a-bafa-a22aa9bd82df\") " pod="openshift-multus/multus-fd4mq" Jun 08 13:43:53.401951 ip-10-0-140-46 kubenswrapper[2576]: I0608 13:43:53.401517 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/6da5a732-b003-412c-8308-e80cead7eb1c-dbus\") pod \"global-pull-secret-syncer-dm2n6\" (UID: \"6da5a732-b003-412c-8308-e80cead7eb1c\") " pod="kube-system/global-pull-secret-syncer-dm2n6" Jun 08 13:43:53.401951 ip-10-0-140-46 kubenswrapper[2576]: I0608 13:43:53.401628 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/18b84a5c-7b8b-4e1b-a70a-4fbda39064bf-cni-binary-copy\") pod \"multus-additional-cni-plugins-pxbdv\" (UID: \"18b84a5c-7b8b-4e1b-a70a-4fbda39064bf\") " pod="openshift-multus/multus-additional-cni-plugins-pxbdv" Jun 08 13:43:53.401951 ip-10-0-140-46 kubenswrapper[2576]: I0608 13:43:53.401734 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/6da5a732-b003-412c-8308-e80cead7eb1c-dbus\") pod \"global-pull-secret-syncer-dm2n6\" (UID: \"6da5a732-b003-412c-8308-e80cead7eb1c\") " pod="kube-system/global-pull-secret-syncer-dm2n6" Jun 08 13:43:53.401951 ip-10-0-140-46 kubenswrapper[2576]: I0608 13:43:53.401777 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xbc59\" (UniqueName: \"kubernetes.io/projected/2cf3d8d4-e8f9-402e-9fa7-b564c4ea705c-kube-api-access-xbc59\") pod \"node-resolver-f25db\" (UID: \"2cf3d8d4-e8f9-402e-9fa7-b564c4ea705c\") " pod="openshift-dns/node-resolver-f25db" Jun 08 13:43:53.401951 ip-10-0-140-46 kubenswrapper[2576]: I0608 13:43:53.401807 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/899b8b33-b573-4d67-ae45-773ec4b36e28-etc-sysctl-conf\") pod \"tuned-jxwb8\" (UID: \"899b8b33-b573-4d67-ae45-773ec4b36e28\") " pod="openshift-cluster-node-tuning-operator/tuned-jxwb8" Jun 08 13:43:53.401951 ip-10-0-140-46 kubenswrapper[2576]: I0608 13:43:53.401831 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6xckl\" (UniqueName: \"kubernetes.io/projected/f2c67e68-042b-487a-bafa-a22aa9bd82df-kube-api-access-6xckl\") pod \"multus-fd4mq\" (UID: \"f2c67e68-042b-487a-bafa-a22aa9bd82df\") " pod="openshift-multus/multus-fd4mq" Jun 08 13:43:53.401951 ip-10-0-140-46 kubenswrapper[2576]: I0608 13:43:53.401857 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/18b84a5c-7b8b-4e1b-a70a-4fbda39064bf-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-pxbdv\" (UID: \"18b84a5c-7b8b-4e1b-a70a-4fbda39064bf\") " pod="openshift-multus/multus-additional-cni-plugins-pxbdv" Jun 08 13:43:53.401951 ip-10-0-140-46 kubenswrapper[2576]: I0608 13:43:53.401888 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/2cf3d8d4-e8f9-402e-9fa7-b564c4ea705c-tmp-dir\") pod \"node-resolver-f25db\" (UID: \"2cf3d8d4-e8f9-402e-9fa7-b564c4ea705c\") " pod="openshift-dns/node-resolver-f25db" Jun 08 13:43:53.401951 ip-10-0-140-46 kubenswrapper[2576]: I0608 13:43:53.401909 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/18b84a5c-7b8b-4e1b-a70a-4fbda39064bf-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-pxbdv\" (UID: \"18b84a5c-7b8b-4e1b-a70a-4fbda39064bf\") " pod="openshift-multus/multus-additional-cni-plugins-pxbdv" Jun 08 13:43:53.402350 ip-10-0-140-46 kubenswrapper[2576]: I0608 13:43:53.402057 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/ef6c467c-acc8-428e-950f-e0d25491f708-iptables-alerter-script\") pod \"iptables-alerter-7zkgm\" (UID: \"ef6c467c-acc8-428e-950f-e0d25491f708\") " pod="openshift-network-operator/iptables-alerter-7zkgm" Jun 08 13:43:53.402350 ip-10-0-140-46 kubenswrapper[2576]: I0608 13:43:53.402083 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/899b8b33-b573-4d67-ae45-773ec4b36e28-etc-sysctl-conf\") pod \"tuned-jxwb8\" (UID: \"899b8b33-b573-4d67-ae45-773ec4b36e28\") " pod="openshift-cluster-node-tuning-operator/tuned-jxwb8" Jun 08 13:43:53.402350 ip-10-0-140-46 kubenswrapper[2576]: I0608 13:43:53.402100 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/899b8b33-b573-4d67-ae45-773ec4b36e28-etc-modprobe-d\") pod \"tuned-jxwb8\" (UID: \"899b8b33-b573-4d67-ae45-773ec4b36e28\") " pod="openshift-cluster-node-tuning-operator/tuned-jxwb8" Jun 08 13:43:53.402350 ip-10-0-140-46 kubenswrapper[2576]: I0608 13:43:53.402145 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/18b84a5c-7b8b-4e1b-a70a-4fbda39064bf-cni-binary-copy\") pod \"multus-additional-cni-plugins-pxbdv\" (UID: \"18b84a5c-7b8b-4e1b-a70a-4fbda39064bf\") " pod="openshift-multus/multus-additional-cni-plugins-pxbdv" Jun 08 13:43:53.402350 ip-10-0-140-46 kubenswrapper[2576]: I0608 13:43:53.402147 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/899b8b33-b573-4d67-ae45-773ec4b36e28-etc-sysconfig\") pod \"tuned-jxwb8\" (UID: \"899b8b33-b573-4d67-ae45-773ec4b36e28\") " pod="openshift-cluster-node-tuning-operator/tuned-jxwb8" Jun 08 13:43:53.402350 ip-10-0-140-46 kubenswrapper[2576]: I0608 13:43:53.402185 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/2cf3d8d4-e8f9-402e-9fa7-b564c4ea705c-tmp-dir\") pod \"node-resolver-f25db\" (UID: \"2cf3d8d4-e8f9-402e-9fa7-b564c4ea705c\") " pod="openshift-dns/node-resolver-f25db" Jun 08 13:43:53.402350 ip-10-0-140-46 kubenswrapper[2576]: I0608 13:43:53.402192 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/ef6c467c-acc8-428e-950f-e0d25491f708-host-slash\") pod \"iptables-alerter-7zkgm\" (UID: \"ef6c467c-acc8-428e-950f-e0d25491f708\") " pod="openshift-network-operator/iptables-alerter-7zkgm" Jun 08 13:43:53.402350 ip-10-0-140-46 kubenswrapper[2576]: I0608 13:43:53.402197 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/899b8b33-b573-4d67-ae45-773ec4b36e28-etc-sysconfig\") pod \"tuned-jxwb8\" (UID: \"899b8b33-b573-4d67-ae45-773ec4b36e28\") " pod="openshift-cluster-node-tuning-operator/tuned-jxwb8" Jun 08 13:43:53.402350 ip-10-0-140-46 kubenswrapper[2576]: I0608 13:43:53.402220 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/c26912ca-10b4-4ae3-b306-890f93abfee3-log-socket\") pod \"ovnkube-node-ncffd\" (UID: \"c26912ca-10b4-4ae3-b306-890f93abfee3\") " pod="openshift-ovn-kubernetes/ovnkube-node-ncffd" Jun 08 13:43:53.402350 ip-10-0-140-46 kubenswrapper[2576]: I0608 13:43:53.402227 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/899b8b33-b573-4d67-ae45-773ec4b36e28-etc-modprobe-d\") pod \"tuned-jxwb8\" (UID: \"899b8b33-b573-4d67-ae45-773ec4b36e28\") " pod="openshift-cluster-node-tuning-operator/tuned-jxwb8" Jun 08 13:43:53.402350 ip-10-0-140-46 kubenswrapper[2576]: I0608 13:43:53.402243 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/ef6c467c-acc8-428e-950f-e0d25491f708-host-slash\") pod \"iptables-alerter-7zkgm\" (UID: \"ef6c467c-acc8-428e-950f-e0d25491f708\") " pod="openshift-network-operator/iptables-alerter-7zkgm" Jun 08 13:43:53.402350 ip-10-0-140-46 kubenswrapper[2576]: I0608 13:43:53.402246 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/c26912ca-10b4-4ae3-b306-890f93abfee3-host-run-ovn-kubernetes\") pod \"ovnkube-node-ncffd\" (UID: \"c26912ca-10b4-4ae3-b306-890f93abfee3\") " pod="openshift-ovn-kubernetes/ovnkube-node-ncffd" Jun 08 13:43:53.402350 ip-10-0-140-46 kubenswrapper[2576]: I0608 13:43:53.402281 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/3c9ae33a-4be0-4494-ae7d-b24b4421ae27-sys-fs\") pod \"aws-ebs-csi-driver-node-p78hl\" (UID: \"3c9ae33a-4be0-4494-ae7d-b24b4421ae27\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-p78hl" Jun 08 13:43:53.402350 ip-10-0-140-46 kubenswrapper[2576]: I0608 13:43:53.402307 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/899b8b33-b573-4d67-ae45-773ec4b36e28-lib-modules\") pod \"tuned-jxwb8\" (UID: \"899b8b33-b573-4d67-ae45-773ec4b36e28\") " pod="openshift-cluster-node-tuning-operator/tuned-jxwb8" Jun 08 13:43:53.402350 ip-10-0-140-46 kubenswrapper[2576]: I0608 13:43:53.402332 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-pjqn4\" (UniqueName: \"kubernetes.io/projected/52fab817-1614-450d-8ea9-d10e21821af6-kube-api-access-pjqn4\") pod \"network-metrics-daemon-l62qm\" (UID: \"52fab817-1614-450d-8ea9-d10e21821af6\") " pod="openshift-multus/network-metrics-daemon-l62qm" Jun 08 13:43:53.402350 ip-10-0-140-46 kubenswrapper[2576]: I0608 13:43:53.402356 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jnppj\" (UniqueName: \"kubernetes.io/projected/c26912ca-10b4-4ae3-b306-890f93abfee3-kube-api-access-jnppj\") pod \"ovnkube-node-ncffd\" (UID: \"c26912ca-10b4-4ae3-b306-890f93abfee3\") " pod="openshift-ovn-kubernetes/ovnkube-node-ncffd" Jun 08 13:43:53.402921 ip-10-0-140-46 kubenswrapper[2576]: I0608 13:43:53.402385 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/899b8b33-b573-4d67-ae45-773ec4b36e28-etc-sysctl-d\") pod \"tuned-jxwb8\" (UID: \"899b8b33-b573-4d67-ae45-773ec4b36e28\") " pod="openshift-cluster-node-tuning-operator/tuned-jxwb8" Jun 08 13:43:53.402921 ip-10-0-140-46 kubenswrapper[2576]: I0608 13:43:53.402402 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/899b8b33-b573-4d67-ae45-773ec4b36e28-lib-modules\") pod \"tuned-jxwb8\" (UID: \"899b8b33-b573-4d67-ae45-773ec4b36e28\") " pod="openshift-cluster-node-tuning-operator/tuned-jxwb8" Jun 08 13:43:53.402921 ip-10-0-140-46 kubenswrapper[2576]: I0608 13:43:53.402410 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/899b8b33-b573-4d67-ae45-773ec4b36e28-sys\") pod \"tuned-jxwb8\" (UID: \"899b8b33-b573-4d67-ae45-773ec4b36e28\") " pod="openshift-cluster-node-tuning-operator/tuned-jxwb8" Jun 08 13:43:53.402921 ip-10-0-140-46 kubenswrapper[2576]: I0608 13:43:53.402480 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/c26912ca-10b4-4ae3-b306-890f93abfee3-ovn-node-metrics-cert\") pod \"ovnkube-node-ncffd\" (UID: \"c26912ca-10b4-4ae3-b306-890f93abfee3\") " pod="openshift-ovn-kubernetes/ovnkube-node-ncffd" Jun 08 13:43:53.402921 ip-10-0-140-46 kubenswrapper[2576]: I0608 13:43:53.402495 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/899b8b33-b573-4d67-ae45-773ec4b36e28-sys\") pod \"tuned-jxwb8\" (UID: \"899b8b33-b573-4d67-ae45-773ec4b36e28\") " pod="openshift-cluster-node-tuning-operator/tuned-jxwb8" Jun 08 13:43:53.402921 ip-10-0-140-46 kubenswrapper[2576]: I0608 13:43:53.402507 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/f2c67e68-042b-487a-bafa-a22aa9bd82df-multus-daemon-config\") pod \"multus-fd4mq\" (UID: \"f2c67e68-042b-487a-bafa-a22aa9bd82df\") " pod="openshift-multus/multus-fd4mq" Jun 08 13:43:53.402921 ip-10-0-140-46 kubenswrapper[2576]: I0608 13:43:53.402530 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/899b8b33-b573-4d67-ae45-773ec4b36e28-etc-sysctl-d\") pod \"tuned-jxwb8\" (UID: \"899b8b33-b573-4d67-ae45-773ec4b36e28\") " pod="openshift-cluster-node-tuning-operator/tuned-jxwb8" Jun 08 13:43:53.402921 ip-10-0-140-46 kubenswrapper[2576]: I0608 13:43:53.402532 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/c26912ca-10b4-4ae3-b306-890f93abfee3-host-kubelet\") pod \"ovnkube-node-ncffd\" (UID: \"c26912ca-10b4-4ae3-b306-890f93abfee3\") " pod="openshift-ovn-kubernetes/ovnkube-node-ncffd" Jun 08 13:43:53.402921 ip-10-0-140-46 kubenswrapper[2576]: I0608 13:43:53.402533 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/18b84a5c-7b8b-4e1b-a70a-4fbda39064bf-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-pxbdv\" (UID: \"18b84a5c-7b8b-4e1b-a70a-4fbda39064bf\") " pod="openshift-multus/multus-additional-cni-plugins-pxbdv" Jun 08 13:43:53.402921 ip-10-0-140-46 kubenswrapper[2576]: I0608 13:43:53.402592 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/c26912ca-10b4-4ae3-b306-890f93abfee3-etc-openvswitch\") pod \"ovnkube-node-ncffd\" (UID: \"c26912ca-10b4-4ae3-b306-890f93abfee3\") " pod="openshift-ovn-kubernetes/ovnkube-node-ncffd" Jun 08 13:43:53.402921 ip-10-0-140-46 kubenswrapper[2576]: I0608 13:43:53.402612 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/c26912ca-10b4-4ae3-b306-890f93abfee3-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-ncffd\" (UID: \"c26912ca-10b4-4ae3-b306-890f93abfee3\") " pod="openshift-ovn-kubernetes/ovnkube-node-ncffd" Jun 08 13:43:53.402921 ip-10-0-140-46 kubenswrapper[2576]: I0608 13:43:53.402628 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/3c9ae33a-4be0-4494-ae7d-b24b4421ae27-socket-dir\") pod \"aws-ebs-csi-driver-node-p78hl\" (UID: \"3c9ae33a-4be0-4494-ae7d-b24b4421ae27\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-p78hl" Jun 08 13:43:53.402921 ip-10-0-140-46 kubenswrapper[2576]: I0608 13:43:53.402655 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/899b8b33-b573-4d67-ae45-773ec4b36e28-var-lib-kubelet\") pod \"tuned-jxwb8\" (UID: \"899b8b33-b573-4d67-ae45-773ec4b36e28\") " pod="openshift-cluster-node-tuning-operator/tuned-jxwb8" Jun 08 13:43:53.402921 ip-10-0-140-46 kubenswrapper[2576]: I0608 13:43:53.402674 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/c26912ca-10b4-4ae3-b306-890f93abfee3-run-ovn\") pod \"ovnkube-node-ncffd\" (UID: \"c26912ca-10b4-4ae3-b306-890f93abfee3\") " pod="openshift-ovn-kubernetes/ovnkube-node-ncffd" Jun 08 13:43:53.402921 ip-10-0-140-46 kubenswrapper[2576]: I0608 13:43:53.402700 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/c26912ca-10b4-4ae3-b306-890f93abfee3-host-cni-netd\") pod \"ovnkube-node-ncffd\" (UID: \"c26912ca-10b4-4ae3-b306-890f93abfee3\") " pod="openshift-ovn-kubernetes/ovnkube-node-ncffd" Jun 08 13:43:53.402921 ip-10-0-140-46 kubenswrapper[2576]: I0608 13:43:53.402737 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/899b8b33-b573-4d67-ae45-773ec4b36e28-var-lib-kubelet\") pod \"tuned-jxwb8\" (UID: \"899b8b33-b573-4d67-ae45-773ec4b36e28\") " pod="openshift-cluster-node-tuning-operator/tuned-jxwb8" Jun 08 13:43:53.402921 ip-10-0-140-46 kubenswrapper[2576]: I0608 13:43:53.402759 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ndrzx\" (UniqueName: \"kubernetes.io/projected/3c9ae33a-4be0-4494-ae7d-b24b4421ae27-kube-api-access-ndrzx\") pod \"aws-ebs-csi-driver-node-p78hl\" (UID: \"3c9ae33a-4be0-4494-ae7d-b24b4421ae27\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-p78hl" Jun 08 13:43:53.403472 ip-10-0-140-46 kubenswrapper[2576]: I0608 13:43:53.402777 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/f2c67e68-042b-487a-bafa-a22aa9bd82df-os-release\") pod \"multus-fd4mq\" (UID: \"f2c67e68-042b-487a-bafa-a22aa9bd82df\") " pod="openshift-multus/multus-fd4mq" Jun 08 13:43:53.403472 ip-10-0-140-46 kubenswrapper[2576]: I0608 13:43:53.402805 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/f2c67e68-042b-487a-bafa-a22aa9bd82df-host-var-lib-kubelet\") pod \"multus-fd4mq\" (UID: \"f2c67e68-042b-487a-bafa-a22aa9bd82df\") " pod="openshift-multus/multus-fd4mq" Jun 08 13:43:53.403472 ip-10-0-140-46 kubenswrapper[2576]: I0608 13:43:53.402850 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/f2c67e68-042b-487a-bafa-a22aa9bd82df-host-var-lib-kubelet\") pod \"multus-fd4mq\" (UID: \"f2c67e68-042b-487a-bafa-a22aa9bd82df\") " pod="openshift-multus/multus-fd4mq" Jun 08 13:43:53.403472 ip-10-0-140-46 kubenswrapper[2576]: I0608 13:43:53.402845 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/c26912ca-10b4-4ae3-b306-890f93abfee3-ovnkube-config\") pod \"ovnkube-node-ncffd\" (UID: \"c26912ca-10b4-4ae3-b306-890f93abfee3\") " pod="openshift-ovn-kubernetes/ovnkube-node-ncffd" Jun 08 13:43:53.403472 ip-10-0-140-46 kubenswrapper[2576]: I0608 13:43:53.402855 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/f2c67e68-042b-487a-bafa-a22aa9bd82df-os-release\") pod \"multus-fd4mq\" (UID: \"f2c67e68-042b-487a-bafa-a22aa9bd82df\") " pod="openshift-multus/multus-fd4mq" Jun 08 13:43:53.403472 ip-10-0-140-46 kubenswrapper[2576]: I0608 13:43:53.402882 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/3c9ae33a-4be0-4494-ae7d-b24b4421ae27-device-dir\") pod \"aws-ebs-csi-driver-node-p78hl\" (UID: \"3c9ae33a-4be0-4494-ae7d-b24b4421ae27\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-p78hl" Jun 08 13:43:53.403472 ip-10-0-140-46 kubenswrapper[2576]: I0608 13:43:53.402903 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/18b84a5c-7b8b-4e1b-a70a-4fbda39064bf-system-cni-dir\") pod \"multus-additional-cni-plugins-pxbdv\" (UID: \"18b84a5c-7b8b-4e1b-a70a-4fbda39064bf\") " pod="openshift-multus/multus-additional-cni-plugins-pxbdv" Jun 08 13:43:53.403472 ip-10-0-140-46 kubenswrapper[2576]: I0608 13:43:53.402919 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/6da5a732-b003-412c-8308-e80cead7eb1c-original-pull-secret\") pod \"global-pull-secret-syncer-dm2n6\" (UID: \"6da5a732-b003-412c-8308-e80cead7eb1c\") " pod="kube-system/global-pull-secret-syncer-dm2n6" Jun 08 13:43:53.403472 ip-10-0-140-46 kubenswrapper[2576]: I0608 13:43:53.402936 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/18b84a5c-7b8b-4e1b-a70a-4fbda39064bf-system-cni-dir\") pod \"multus-additional-cni-plugins-pxbdv\" (UID: \"18b84a5c-7b8b-4e1b-a70a-4fbda39064bf\") " pod="openshift-multus/multus-additional-cni-plugins-pxbdv" Jun 08 13:43:53.403472 ip-10-0-140-46 kubenswrapper[2576]: I0608 13:43:53.402940 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/f2c67e68-042b-487a-bafa-a22aa9bd82df-multus-cni-dir\") pod \"multus-fd4mq\" (UID: \"f2c67e68-042b-487a-bafa-a22aa9bd82df\") " pod="openshift-multus/multus-fd4mq" Jun 08 13:43:53.403472 ip-10-0-140-46 kubenswrapper[2576]: I0608 13:43:53.402955 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/c26912ca-10b4-4ae3-b306-890f93abfee3-host-cni-bin\") pod \"ovnkube-node-ncffd\" (UID: \"c26912ca-10b4-4ae3-b306-890f93abfee3\") " pod="openshift-ovn-kubernetes/ovnkube-node-ncffd" Jun 08 13:43:53.403472 ip-10-0-140-46 kubenswrapper[2576]: E0608 13:43:53.403006 2576 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jun 08 13:43:53.403472 ip-10-0-140-46 kubenswrapper[2576]: I0608 13:43:53.403011 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/f2c67e68-042b-487a-bafa-a22aa9bd82df-multus-cni-dir\") pod \"multus-fd4mq\" (UID: \"f2c67e68-042b-487a-bafa-a22aa9bd82df\") " pod="openshift-multus/multus-fd4mq" Jun 08 13:43:53.403472 ip-10-0-140-46 kubenswrapper[2576]: I0608 13:43:53.403024 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/6e4b50fc-3e91-4f50-b92a-e90919788248-konnectivity-ca\") pod \"konnectivity-agent-cx7sn\" (UID: \"6e4b50fc-3e91-4f50-b92a-e90919788248\") " pod="kube-system/konnectivity-agent-cx7sn" Jun 08 13:43:53.403472 ip-10-0-140-46 kubenswrapper[2576]: I0608 13:43:53.403046 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/3c9ae33a-4be0-4494-ae7d-b24b4421ae27-kubelet-dir\") pod \"aws-ebs-csi-driver-node-p78hl\" (UID: \"3c9ae33a-4be0-4494-ae7d-b24b4421ae27\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-p78hl" Jun 08 13:43:53.403472 ip-10-0-140-46 kubenswrapper[2576]: I0608 13:43:53.403007 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/f2c67e68-042b-487a-bafa-a22aa9bd82df-multus-daemon-config\") pod \"multus-fd4mq\" (UID: \"f2c67e68-042b-487a-bafa-a22aa9bd82df\") " pod="openshift-multus/multus-fd4mq" Jun 08 13:43:53.403472 ip-10-0-140-46 kubenswrapper[2576]: E0608 13:43:53.403056 2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/6da5a732-b003-412c-8308-e80cead7eb1c-original-pull-secret podName:6da5a732-b003-412c-8308-e80cead7eb1c nodeName:}" failed. No retries permitted until 2026-06-08 13:43:53.903041689 +0000 UTC m=+1.982370559 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/6da5a732-b003-412c-8308-e80cead7eb1c-original-pull-secret") pod "global-pull-secret-syncer-dm2n6" (UID: "6da5a732-b003-412c-8308-e80cead7eb1c") : object "kube-system"/"original-pull-secret" not registered Jun 08 13:43:53.404160 ip-10-0-140-46 kubenswrapper[2576]: I0608 13:43:53.403098 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xjs6t\" (UniqueName: \"kubernetes.io/projected/ef6c467c-acc8-428e-950f-e0d25491f708-kube-api-access-xjs6t\") pod \"iptables-alerter-7zkgm\" (UID: \"ef6c467c-acc8-428e-950f-e0d25491f708\") " pod="openshift-network-operator/iptables-alerter-7zkgm" Jun 08 13:43:53.404160 ip-10-0-140-46 kubenswrapper[2576]: I0608 13:43:53.403114 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/f2c67e68-042b-487a-bafa-a22aa9bd82df-system-cni-dir\") pod \"multus-fd4mq\" (UID: \"f2c67e68-042b-487a-bafa-a22aa9bd82df\") " pod="openshift-multus/multus-fd4mq" Jun 08 13:43:53.404160 ip-10-0-140-46 kubenswrapper[2576]: I0608 13:43:53.403130 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xfzgf\" (UniqueName: \"kubernetes.io/projected/18b84a5c-7b8b-4e1b-a70a-4fbda39064bf-kube-api-access-xfzgf\") pod \"multus-additional-cni-plugins-pxbdv\" (UID: \"18b84a5c-7b8b-4e1b-a70a-4fbda39064bf\") " pod="openshift-multus/multus-additional-cni-plugins-pxbdv" Jun 08 13:43:53.404160 ip-10-0-140-46 kubenswrapper[2576]: I0608 13:43:53.403159 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/2cf3d8d4-e8f9-402e-9fa7-b564c4ea705c-hosts-file\") pod \"node-resolver-f25db\" (UID: \"2cf3d8d4-e8f9-402e-9fa7-b564c4ea705c\") " pod="openshift-dns/node-resolver-f25db" Jun 08 13:43:53.404160 ip-10-0-140-46 kubenswrapper[2576]: I0608 13:43:53.403197 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/f2c67e68-042b-487a-bafa-a22aa9bd82df-system-cni-dir\") pod \"multus-fd4mq\" (UID: \"f2c67e68-042b-487a-bafa-a22aa9bd82df\") " pod="openshift-multus/multus-fd4mq" Jun 08 13:43:53.404160 ip-10-0-140-46 kubenswrapper[2576]: I0608 13:43:53.403227 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/899b8b33-b573-4d67-ae45-773ec4b36e28-etc-tuned\") pod \"tuned-jxwb8\" (UID: \"899b8b33-b573-4d67-ae45-773ec4b36e28\") " pod="openshift-cluster-node-tuning-operator/tuned-jxwb8" Jun 08 13:43:53.404160 ip-10-0-140-46 kubenswrapper[2576]: I0608 13:43:53.403257 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-22qn8\" (UniqueName: \"kubernetes.io/projected/899b8b33-b573-4d67-ae45-773ec4b36e28-kube-api-access-22qn8\") pod \"tuned-jxwb8\" (UID: \"899b8b33-b573-4d67-ae45-773ec4b36e28\") " pod="openshift-cluster-node-tuning-operator/tuned-jxwb8" Jun 08 13:43:53.404160 ip-10-0-140-46 kubenswrapper[2576]: I0608 13:43:53.403274 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/2cf3d8d4-e8f9-402e-9fa7-b564c4ea705c-hosts-file\") pod \"node-resolver-f25db\" (UID: \"2cf3d8d4-e8f9-402e-9fa7-b564c4ea705c\") " pod="openshift-dns/node-resolver-f25db" Jun 08 13:43:53.404160 ip-10-0-140-46 kubenswrapper[2576]: I0608 13:43:53.403288 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/c26912ca-10b4-4ae3-b306-890f93abfee3-host-slash\") pod \"ovnkube-node-ncffd\" (UID: \"c26912ca-10b4-4ae3-b306-890f93abfee3\") " pod="openshift-ovn-kubernetes/ovnkube-node-ncffd" Jun 08 13:43:53.404160 ip-10-0-140-46 kubenswrapper[2576]: I0608 13:43:53.403310 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/c26912ca-10b4-4ae3-b306-890f93abfee3-run-systemd\") pod \"ovnkube-node-ncffd\" (UID: \"c26912ca-10b4-4ae3-b306-890f93abfee3\") " pod="openshift-ovn-kubernetes/ovnkube-node-ncffd" Jun 08 13:43:53.404160 ip-10-0-140-46 kubenswrapper[2576]: I0608 13:43:53.403332 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/18b84a5c-7b8b-4e1b-a70a-4fbda39064bf-cnibin\") pod \"multus-additional-cni-plugins-pxbdv\" (UID: \"18b84a5c-7b8b-4e1b-a70a-4fbda39064bf\") " pod="openshift-multus/multus-additional-cni-plugins-pxbdv" Jun 08 13:43:53.404160 ip-10-0-140-46 kubenswrapper[2576]: I0608 13:43:53.403361 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/8e1453fa-6b1d-4b93-98cf-5fe4d2829935-host\") pod \"node-ca-gcmjl\" (UID: \"8e1453fa-6b1d-4b93-98cf-5fe4d2829935\") " pod="openshift-image-registry/node-ca-gcmjl" Jun 08 13:43:53.404160 ip-10-0-140-46 kubenswrapper[2576]: I0608 13:43:53.403399 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/18b84a5c-7b8b-4e1b-a70a-4fbda39064bf-cnibin\") pod \"multus-additional-cni-plugins-pxbdv\" (UID: \"18b84a5c-7b8b-4e1b-a70a-4fbda39064bf\") " pod="openshift-multus/multus-additional-cni-plugins-pxbdv" Jun 08 13:43:53.404160 ip-10-0-140-46 kubenswrapper[2576]: I0608 13:43:53.403406 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/8e1453fa-6b1d-4b93-98cf-5fe4d2829935-host\") pod \"node-ca-gcmjl\" (UID: \"8e1453fa-6b1d-4b93-98cf-5fe4d2829935\") " pod="openshift-image-registry/node-ca-gcmjl" Jun 08 13:43:53.404160 ip-10-0-140-46 kubenswrapper[2576]: I0608 13:43:53.403430 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/899b8b33-b573-4d67-ae45-773ec4b36e28-tmp\") pod \"tuned-jxwb8\" (UID: \"899b8b33-b573-4d67-ae45-773ec4b36e28\") " pod="openshift-cluster-node-tuning-operator/tuned-jxwb8" Jun 08 13:43:53.404160 ip-10-0-140-46 kubenswrapper[2576]: I0608 13:43:53.403463 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/c26912ca-10b4-4ae3-b306-890f93abfee3-run-openvswitch\") pod \"ovnkube-node-ncffd\" (UID: \"c26912ca-10b4-4ae3-b306-890f93abfee3\") " pod="openshift-ovn-kubernetes/ovnkube-node-ncffd" Jun 08 13:43:53.404160 ip-10-0-140-46 kubenswrapper[2576]: I0608 13:43:53.403485 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/3c9ae33a-4be0-4494-ae7d-b24b4421ae27-registration-dir\") pod \"aws-ebs-csi-driver-node-p78hl\" (UID: \"3c9ae33a-4be0-4494-ae7d-b24b4421ae27\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-p78hl" Jun 08 13:43:53.404715 ip-10-0-140-46 kubenswrapper[2576]: I0608 13:43:53.403510 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/52fab817-1614-450d-8ea9-d10e21821af6-metrics-certs\") pod \"network-metrics-daemon-l62qm\" (UID: \"52fab817-1614-450d-8ea9-d10e21821af6\") " pod="openshift-multus/network-metrics-daemon-l62qm" Jun 08 13:43:53.404715 ip-10-0-140-46 kubenswrapper[2576]: I0608 13:43:53.403534 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/c26912ca-10b4-4ae3-b306-890f93abfee3-systemd-units\") pod \"ovnkube-node-ncffd\" (UID: \"c26912ca-10b4-4ae3-b306-890f93abfee3\") " pod="openshift-ovn-kubernetes/ovnkube-node-ncffd" Jun 08 13:43:53.404715 ip-10-0-140-46 kubenswrapper[2576]: I0608 13:43:53.403561 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hrtpg\" (UniqueName: \"kubernetes.io/projected/8e1453fa-6b1d-4b93-98cf-5fe4d2829935-kube-api-access-hrtpg\") pod \"node-ca-gcmjl\" (UID: \"8e1453fa-6b1d-4b93-98cf-5fe4d2829935\") " pod="openshift-image-registry/node-ca-gcmjl" Jun 08 13:43:53.404715 ip-10-0-140-46 kubenswrapper[2576]: I0608 13:43:53.403616 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/899b8b33-b573-4d67-ae45-773ec4b36e28-run\") pod \"tuned-jxwb8\" (UID: \"899b8b33-b573-4d67-ae45-773ec4b36e28\") " pod="openshift-cluster-node-tuning-operator/tuned-jxwb8" Jun 08 13:43:53.404715 ip-10-0-140-46 kubenswrapper[2576]: I0608 13:43:53.403640 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/899b8b33-b573-4d67-ae45-773ec4b36e28-host\") pod \"tuned-jxwb8\" (UID: \"899b8b33-b573-4d67-ae45-773ec4b36e28\") " pod="openshift-cluster-node-tuning-operator/tuned-jxwb8" Jun 08 13:43:53.404715 ip-10-0-140-46 kubenswrapper[2576]: I0608 13:43:53.403665 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/6da5a732-b003-412c-8308-e80cead7eb1c-kubelet-config\") pod \"global-pull-secret-syncer-dm2n6\" (UID: \"6da5a732-b003-412c-8308-e80cead7eb1c\") " pod="kube-system/global-pull-secret-syncer-dm2n6" Jun 08 13:43:53.404715 ip-10-0-140-46 kubenswrapper[2576]: E0608 13:43:53.403659 2576 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jun 08 13:43:53.404715 ip-10-0-140-46 kubenswrapper[2576]: I0608 13:43:53.403725 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/899b8b33-b573-4d67-ae45-773ec4b36e28-host\") pod \"tuned-jxwb8\" (UID: \"899b8b33-b573-4d67-ae45-773ec4b36e28\") " pod="openshift-cluster-node-tuning-operator/tuned-jxwb8" Jun 08 13:43:53.404715 ip-10-0-140-46 kubenswrapper[2576]: I0608 13:43:53.403734 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run\" (UniqueName: \"kubernetes.io/host-path/899b8b33-b573-4d67-ae45-773ec4b36e28-run\") pod \"tuned-jxwb8\" (UID: \"899b8b33-b573-4d67-ae45-773ec4b36e28\") " pod="openshift-cluster-node-tuning-operator/tuned-jxwb8" Jun 08 13:43:53.404715 ip-10-0-140-46 kubenswrapper[2576]: E0608 13:43:53.403744 2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/52fab817-1614-450d-8ea9-d10e21821af6-metrics-certs podName:52fab817-1614-450d-8ea9-d10e21821af6 nodeName:}" failed. No retries permitted until 2026-06-08 13:43:53.903725699 +0000 UTC m=+1.983054572 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/52fab817-1614-450d-8ea9-d10e21821af6-metrics-certs") pod "network-metrics-daemon-l62qm" (UID: "52fab817-1614-450d-8ea9-d10e21821af6") : object "openshift-multus"/"metrics-daemon-secret" not registered Jun 08 13:43:53.404715 ip-10-0-140-46 kubenswrapper[2576]: I0608 13:43:53.403787 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/6da5a732-b003-412c-8308-e80cead7eb1c-kubelet-config\") pod \"global-pull-secret-syncer-dm2n6\" (UID: \"6da5a732-b003-412c-8308-e80cead7eb1c\") " pod="kube-system/global-pull-secret-syncer-dm2n6" Jun 08 13:43:53.404715 ip-10-0-140-46 kubenswrapper[2576]: I0608 13:43:53.403780 2576 swap_util.go:74] "error creating dir to test if tmpfs noswap is enabled. Assuming not supported" mount path="" error="stat /var/lib/kubelet/plugins/kubernetes.io/empty-dir: no such file or directory" Jun 08 13:43:53.404715 ip-10-0-140-46 kubenswrapper[2576]: I0608 13:43:53.403819 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/f2c67e68-042b-487a-bafa-a22aa9bd82df-cnibin\") pod \"multus-fd4mq\" (UID: \"f2c67e68-042b-487a-bafa-a22aa9bd82df\") " pod="openshift-multus/multus-fd4mq" Jun 08 13:43:53.404715 ip-10-0-140-46 kubenswrapper[2576]: I0608 13:43:53.403844 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/f2c67e68-042b-487a-bafa-a22aa9bd82df-host-run-multus-certs\") pod \"multus-fd4mq\" (UID: \"f2c67e68-042b-487a-bafa-a22aa9bd82df\") " pod="openshift-multus/multus-fd4mq" Jun 08 13:43:53.404715 ip-10-0-140-46 kubenswrapper[2576]: I0608 13:43:53.403865 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/3c9ae33a-4be0-4494-ae7d-b24b4421ae27-etc-selinux\") pod \"aws-ebs-csi-driver-node-p78hl\" (UID: \"3c9ae33a-4be0-4494-ae7d-b24b4421ae27\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-p78hl" Jun 08 13:43:53.404715 ip-10-0-140-46 kubenswrapper[2576]: I0608 13:43:53.403884 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/8e1453fa-6b1d-4b93-98cf-5fe4d2829935-serviceca\") pod \"node-ca-gcmjl\" (UID: \"8e1453fa-6b1d-4b93-98cf-5fe4d2829935\") " pod="openshift-image-registry/node-ca-gcmjl" Jun 08 13:43:53.404715 ip-10-0-140-46 kubenswrapper[2576]: I0608 13:43:53.403930 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/f2c67e68-042b-487a-bafa-a22aa9bd82df-host-run-multus-certs\") pod \"multus-fd4mq\" (UID: \"f2c67e68-042b-487a-bafa-a22aa9bd82df\") " pod="openshift-multus/multus-fd4mq" Jun 08 13:43:53.404715 ip-10-0-140-46 kubenswrapper[2576]: I0608 13:43:53.403971 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/899b8b33-b573-4d67-ae45-773ec4b36e28-etc-kubernetes\") pod \"tuned-jxwb8\" (UID: \"899b8b33-b573-4d67-ae45-773ec4b36e28\") " pod="openshift-cluster-node-tuning-operator/tuned-jxwb8" Jun 08 13:43:53.405235 ip-10-0-140-46 kubenswrapper[2576]: I0608 13:43:53.403989 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/f2c67e68-042b-487a-bafa-a22aa9bd82df-cni-binary-copy\") pod \"multus-fd4mq\" (UID: \"f2c67e68-042b-487a-bafa-a22aa9bd82df\") " pod="openshift-multus/multus-fd4mq" Jun 08 13:43:53.405235 ip-10-0-140-46 kubenswrapper[2576]: I0608 13:43:53.404030 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/f2c67e68-042b-487a-bafa-a22aa9bd82df-cnibin\") pod \"multus-fd4mq\" (UID: \"f2c67e68-042b-487a-bafa-a22aa9bd82df\") " pod="openshift-multus/multus-fd4mq" Jun 08 13:43:53.405235 ip-10-0-140-46 kubenswrapper[2576]: I0608 13:43:53.404067 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/c26912ca-10b4-4ae3-b306-890f93abfee3-ovnkube-script-lib\") pod \"ovnkube-node-ncffd\" (UID: \"c26912ca-10b4-4ae3-b306-890f93abfee3\") " pod="openshift-ovn-kubernetes/ovnkube-node-ncffd" Jun 08 13:43:53.405235 ip-10-0-140-46 kubenswrapper[2576]: I0608 13:43:53.404081 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/899b8b33-b573-4d67-ae45-773ec4b36e28-etc-kubernetes\") pod \"tuned-jxwb8\" (UID: \"899b8b33-b573-4d67-ae45-773ec4b36e28\") " pod="openshift-cluster-node-tuning-operator/tuned-jxwb8" Jun 08 13:43:53.405235 ip-10-0-140-46 kubenswrapper[2576]: I0608 13:43:53.404088 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/6e4b50fc-3e91-4f50-b92a-e90919788248-agent-certs\") pod \"konnectivity-agent-cx7sn\" (UID: \"6e4b50fc-3e91-4f50-b92a-e90919788248\") " pod="kube-system/konnectivity-agent-cx7sn" Jun 08 13:43:53.405235 ip-10-0-140-46 kubenswrapper[2576]: I0608 13:43:53.404114 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/899b8b33-b573-4d67-ae45-773ec4b36e28-etc-systemd\") pod \"tuned-jxwb8\" (UID: \"899b8b33-b573-4d67-ae45-773ec4b36e28\") " pod="openshift-cluster-node-tuning-operator/tuned-jxwb8" Jun 08 13:43:53.405235 ip-10-0-140-46 kubenswrapper[2576]: I0608 13:43:53.404141 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/f2c67e68-042b-487a-bafa-a22aa9bd82df-host-run-netns\") pod \"multus-fd4mq\" (UID: \"f2c67e68-042b-487a-bafa-a22aa9bd82df\") " pod="openshift-multus/multus-fd4mq" Jun 08 13:43:53.405235 ip-10-0-140-46 kubenswrapper[2576]: I0608 13:43:53.404157 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/f2c67e68-042b-487a-bafa-a22aa9bd82df-host-var-lib-cni-bin\") pod \"multus-fd4mq\" (UID: \"f2c67e68-042b-487a-bafa-a22aa9bd82df\") " pod="openshift-multus/multus-fd4mq" Jun 08 13:43:53.405235 ip-10-0-140-46 kubenswrapper[2576]: I0608 13:43:53.404193 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/f2c67e68-042b-487a-bafa-a22aa9bd82df-host-var-lib-cni-multus\") pod \"multus-fd4mq\" (UID: \"f2c67e68-042b-487a-bafa-a22aa9bd82df\") " pod="openshift-multus/multus-fd4mq" Jun 08 13:43:53.405235 ip-10-0-140-46 kubenswrapper[2576]: I0608 13:43:53.404214 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/f2c67e68-042b-487a-bafa-a22aa9bd82df-hostroot\") pod \"multus-fd4mq\" (UID: \"f2c67e68-042b-487a-bafa-a22aa9bd82df\") " pod="openshift-multus/multus-fd4mq" Jun 08 13:43:53.405235 ip-10-0-140-46 kubenswrapper[2576]: I0608 13:43:53.404215 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/f2c67e68-042b-487a-bafa-a22aa9bd82df-host-var-lib-cni-bin\") pod \"multus-fd4mq\" (UID: \"f2c67e68-042b-487a-bafa-a22aa9bd82df\") " pod="openshift-multus/multus-fd4mq" Jun 08 13:43:53.405235 ip-10-0-140-46 kubenswrapper[2576]: I0608 13:43:53.404226 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/899b8b33-b573-4d67-ae45-773ec4b36e28-etc-systemd\") pod \"tuned-jxwb8\" (UID: \"899b8b33-b573-4d67-ae45-773ec4b36e28\") " pod="openshift-cluster-node-tuning-operator/tuned-jxwb8" Jun 08 13:43:53.405235 ip-10-0-140-46 kubenswrapper[2576]: I0608 13:43:53.404253 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/f2c67e68-042b-487a-bafa-a22aa9bd82df-host-run-netns\") pod \"multus-fd4mq\" (UID: \"f2c67e68-042b-487a-bafa-a22aa9bd82df\") " pod="openshift-multus/multus-fd4mq" Jun 08 13:43:53.405235 ip-10-0-140-46 kubenswrapper[2576]: I0608 13:43:53.404295 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/f2c67e68-042b-487a-bafa-a22aa9bd82df-host-var-lib-cni-multus\") pod \"multus-fd4mq\" (UID: \"f2c67e68-042b-487a-bafa-a22aa9bd82df\") " pod="openshift-multus/multus-fd4mq" Jun 08 13:43:53.405235 ip-10-0-140-46 kubenswrapper[2576]: I0608 13:43:53.404324 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/8e1453fa-6b1d-4b93-98cf-5fe4d2829935-serviceca\") pod \"node-ca-gcmjl\" (UID: \"8e1453fa-6b1d-4b93-98cf-5fe4d2829935\") " pod="openshift-image-registry/node-ca-gcmjl" Jun 08 13:43:53.405235 ip-10-0-140-46 kubenswrapper[2576]: I0608 13:43:53.404323 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/f2c67e68-042b-487a-bafa-a22aa9bd82df-hostroot\") pod \"multus-fd4mq\" (UID: \"f2c67e68-042b-487a-bafa-a22aa9bd82df\") " pod="openshift-multus/multus-fd4mq" Jun 08 13:43:53.406799 ip-10-0-140-46 kubenswrapper[2576]: I0608 13:43:53.406780 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/899b8b33-b573-4d67-ae45-773ec4b36e28-tmp\") pod \"tuned-jxwb8\" (UID: \"899b8b33-b573-4d67-ae45-773ec4b36e28\") " pod="openshift-cluster-node-tuning-operator/tuned-jxwb8" Jun 08 13:43:53.406889 ip-10-0-140-46 kubenswrapper[2576]: I0608 13:43:53.406808 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/899b8b33-b573-4d67-ae45-773ec4b36e28-etc-tuned\") pod \"tuned-jxwb8\" (UID: \"899b8b33-b573-4d67-ae45-773ec4b36e28\") " pod="openshift-cluster-node-tuning-operator/tuned-jxwb8" Jun 08 13:43:53.419638 ip-10-0-140-46 kubenswrapper[2576]: E0608 13:43:53.419616 2576 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jun 08 13:43:53.419638 ip-10-0-140-46 kubenswrapper[2576]: E0608 13:43:53.419635 2576 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jun 08 13:43:53.419789 ip-10-0-140-46 kubenswrapper[2576]: E0608 13:43:53.419646 2576 projected.go:196] Error preparing data for projected volume kube-api-access-5jttb for pod openshift-network-diagnostics/network-check-target-99957: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 08 13:43:53.419789 ip-10-0-140-46 kubenswrapper[2576]: E0608 13:43:53.419696 2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/4b283339-40c0-40f5-b9d9-c75e99e4f984-kube-api-access-5jttb podName:4b283339-40c0-40f5-b9d9-c75e99e4f984 nodeName:}" failed. No retries permitted until 2026-06-08 13:43:53.91968247 +0000 UTC m=+1.999011340 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-api-access-5jttb" (UniqueName: "kubernetes.io/projected/4b283339-40c0-40f5-b9d9-c75e99e4f984-kube-api-access-5jttb") pod "network-check-target-99957" (UID: "4b283339-40c0-40f5-b9d9-c75e99e4f984") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 08 13:43:53.422970 ip-10-0-140-46 kubenswrapper[2576]: I0608 13:43:53.422951 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-22qn8\" (UniqueName: \"kubernetes.io/projected/899b8b33-b573-4d67-ae45-773ec4b36e28-kube-api-access-22qn8\") pod \"tuned-jxwb8\" (UID: \"899b8b33-b573-4d67-ae45-773ec4b36e28\") " pod="openshift-cluster-node-tuning-operator/tuned-jxwb8" Jun 08 13:43:53.431231 ip-10-0-140-46 kubenswrapper[2576]: I0608 13:43:53.431210 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-hrtpg\" (UniqueName: \"kubernetes.io/projected/8e1453fa-6b1d-4b93-98cf-5fe4d2829935-kube-api-access-hrtpg\") pod \"node-ca-gcmjl\" (UID: \"8e1453fa-6b1d-4b93-98cf-5fe4d2829935\") " pod="openshift-image-registry/node-ca-gcmjl" Jun 08 13:43:53.433019 ip-10-0-140-46 kubenswrapper[2576]: I0608 13:43:53.432989 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-xjs6t\" (UniqueName: \"kubernetes.io/projected/ef6c467c-acc8-428e-950f-e0d25491f708-kube-api-access-xjs6t\") pod \"iptables-alerter-7zkgm\" (UID: \"ef6c467c-acc8-428e-950f-e0d25491f708\") " pod="openshift-network-operator/iptables-alerter-7zkgm" Jun 08 13:43:53.433130 ip-10-0-140-46 kubenswrapper[2576]: I0608 13:43:53.433115 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-pjqn4\" (UniqueName: \"kubernetes.io/projected/52fab817-1614-450d-8ea9-d10e21821af6-kube-api-access-pjqn4\") pod \"network-metrics-daemon-l62qm\" (UID: \"52fab817-1614-450d-8ea9-d10e21821af6\") " pod="openshift-multus/network-metrics-daemon-l62qm" Jun 08 13:43:53.445710 ip-10-0-140-46 kubenswrapper[2576]: I0608 13:43:53.445686 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-xfzgf\" (UniqueName: \"kubernetes.io/projected/18b84a5c-7b8b-4e1b-a70a-4fbda39064bf-kube-api-access-xfzgf\") pod \"multus-additional-cni-plugins-pxbdv\" (UID: \"18b84a5c-7b8b-4e1b-a70a-4fbda39064bf\") " pod="openshift-multus/multus-additional-cni-plugins-pxbdv" Jun 08 13:43:53.472745 ip-10-0-140-46 kubenswrapper[2576]: I0608 13:43:53.472723 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-xbc59\" (UniqueName: \"kubernetes.io/projected/2cf3d8d4-e8f9-402e-9fa7-b564c4ea705c-kube-api-access-xbc59\") pod \"node-resolver-f25db\" (UID: \"2cf3d8d4-e8f9-402e-9fa7-b564c4ea705c\") " pod="openshift-dns/node-resolver-f25db" Jun 08 13:43:53.494788 ip-10-0-140-46 kubenswrapper[2576]: I0608 13:43:53.494759 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-6xckl\" (UniqueName: \"kubernetes.io/projected/f2c67e68-042b-487a-bafa-a22aa9bd82df-kube-api-access-6xckl\") pod \"multus-fd4mq\" (UID: \"f2c67e68-042b-487a-bafa-a22aa9bd82df\") " pod="openshift-multus/multus-fd4mq" Jun 08 13:43:53.505370 ip-10-0-140-46 kubenswrapper[2576]: I0608 13:43:53.505343 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/c26912ca-10b4-4ae3-b306-890f93abfee3-host-slash\") pod \"ovnkube-node-ncffd\" (UID: \"c26912ca-10b4-4ae3-b306-890f93abfee3\") " pod="openshift-ovn-kubernetes/ovnkube-node-ncffd" Jun 08 13:43:53.505507 ip-10-0-140-46 kubenswrapper[2576]: I0608 13:43:53.505374 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/c26912ca-10b4-4ae3-b306-890f93abfee3-run-systemd\") pod \"ovnkube-node-ncffd\" (UID: \"c26912ca-10b4-4ae3-b306-890f93abfee3\") " pod="openshift-ovn-kubernetes/ovnkube-node-ncffd" Jun 08 13:43:53.505507 ip-10-0-140-46 kubenswrapper[2576]: I0608 13:43:53.505400 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/c26912ca-10b4-4ae3-b306-890f93abfee3-run-openvswitch\") pod \"ovnkube-node-ncffd\" (UID: \"c26912ca-10b4-4ae3-b306-890f93abfee3\") " pod="openshift-ovn-kubernetes/ovnkube-node-ncffd" Jun 08 13:43:53.505507 ip-10-0-140-46 kubenswrapper[2576]: I0608 13:43:53.505417 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/3c9ae33a-4be0-4494-ae7d-b24b4421ae27-registration-dir\") pod \"aws-ebs-csi-driver-node-p78hl\" (UID: \"3c9ae33a-4be0-4494-ae7d-b24b4421ae27\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-p78hl" Jun 08 13:43:53.505507 ip-10-0-140-46 kubenswrapper[2576]: I0608 13:43:53.505442 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/c26912ca-10b4-4ae3-b306-890f93abfee3-systemd-units\") pod \"ovnkube-node-ncffd\" (UID: \"c26912ca-10b4-4ae3-b306-890f93abfee3\") " pod="openshift-ovn-kubernetes/ovnkube-node-ncffd" Jun 08 13:43:53.505507 ip-10-0-140-46 kubenswrapper[2576]: I0608 13:43:53.505466 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/c26912ca-10b4-4ae3-b306-890f93abfee3-host-slash\") pod \"ovnkube-node-ncffd\" (UID: \"c26912ca-10b4-4ae3-b306-890f93abfee3\") " pod="openshift-ovn-kubernetes/ovnkube-node-ncffd" Jun 08 13:43:53.505507 ip-10-0-140-46 kubenswrapper[2576]: I0608 13:43:53.505480 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/c26912ca-10b4-4ae3-b306-890f93abfee3-run-openvswitch\") pod \"ovnkube-node-ncffd\" (UID: \"c26912ca-10b4-4ae3-b306-890f93abfee3\") " pod="openshift-ovn-kubernetes/ovnkube-node-ncffd" Jun 08 13:43:53.505507 ip-10-0-140-46 kubenswrapper[2576]: I0608 13:43:53.505467 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/c26912ca-10b4-4ae3-b306-890f93abfee3-run-systemd\") pod \"ovnkube-node-ncffd\" (UID: \"c26912ca-10b4-4ae3-b306-890f93abfee3\") " pod="openshift-ovn-kubernetes/ovnkube-node-ncffd" Jun 08 13:43:53.505507 ip-10-0-140-46 kubenswrapper[2576]: I0608 13:43:53.505475 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/3c9ae33a-4be0-4494-ae7d-b24b4421ae27-etc-selinux\") pod \"aws-ebs-csi-driver-node-p78hl\" (UID: \"3c9ae33a-4be0-4494-ae7d-b24b4421ae27\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-p78hl" Jun 08 13:43:53.505507 ip-10-0-140-46 kubenswrapper[2576]: I0608 13:43:53.505511 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/3c9ae33a-4be0-4494-ae7d-b24b4421ae27-etc-selinux\") pod \"aws-ebs-csi-driver-node-p78hl\" (UID: \"3c9ae33a-4be0-4494-ae7d-b24b4421ae27\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-p78hl" Jun 08 13:43:53.505813 ip-10-0-140-46 kubenswrapper[2576]: I0608 13:43:53.505512 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/3c9ae33a-4be0-4494-ae7d-b24b4421ae27-registration-dir\") pod \"aws-ebs-csi-driver-node-p78hl\" (UID: \"3c9ae33a-4be0-4494-ae7d-b24b4421ae27\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-p78hl" Jun 08 13:43:53.505813 ip-10-0-140-46 kubenswrapper[2576]: I0608 13:43:53.505498 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/c26912ca-10b4-4ae3-b306-890f93abfee3-systemd-units\") pod \"ovnkube-node-ncffd\" (UID: \"c26912ca-10b4-4ae3-b306-890f93abfee3\") " pod="openshift-ovn-kubernetes/ovnkube-node-ncffd" Jun 08 13:43:53.505813 ip-10-0-140-46 kubenswrapper[2576]: I0608 13:43:53.505534 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/c26912ca-10b4-4ae3-b306-890f93abfee3-ovnkube-script-lib\") pod \"ovnkube-node-ncffd\" (UID: \"c26912ca-10b4-4ae3-b306-890f93abfee3\") " pod="openshift-ovn-kubernetes/ovnkube-node-ncffd" Jun 08 13:43:53.505813 ip-10-0-140-46 kubenswrapper[2576]: I0608 13:43:53.505599 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/6e4b50fc-3e91-4f50-b92a-e90919788248-agent-certs\") pod \"konnectivity-agent-cx7sn\" (UID: \"6e4b50fc-3e91-4f50-b92a-e90919788248\") " pod="kube-system/konnectivity-agent-cx7sn" Jun 08 13:43:53.505813 ip-10-0-140-46 kubenswrapper[2576]: I0608 13:43:53.505708 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/c26912ca-10b4-4ae3-b306-890f93abfee3-host-run-netns\") pod \"ovnkube-node-ncffd\" (UID: \"c26912ca-10b4-4ae3-b306-890f93abfee3\") " pod="openshift-ovn-kubernetes/ovnkube-node-ncffd" Jun 08 13:43:53.505813 ip-10-0-140-46 kubenswrapper[2576]: I0608 13:43:53.505734 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/c26912ca-10b4-4ae3-b306-890f93abfee3-var-lib-openvswitch\") pod \"ovnkube-node-ncffd\" (UID: \"c26912ca-10b4-4ae3-b306-890f93abfee3\") " pod="openshift-ovn-kubernetes/ovnkube-node-ncffd" Jun 08 13:43:53.505813 ip-10-0-140-46 kubenswrapper[2576]: I0608 13:43:53.505765 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/c26912ca-10b4-4ae3-b306-890f93abfee3-node-log\") pod \"ovnkube-node-ncffd\" (UID: \"c26912ca-10b4-4ae3-b306-890f93abfee3\") " pod="openshift-ovn-kubernetes/ovnkube-node-ncffd" Jun 08 13:43:53.505813 ip-10-0-140-46 kubenswrapper[2576]: I0608 13:43:53.505788 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/c26912ca-10b4-4ae3-b306-890f93abfee3-host-run-netns\") pod \"ovnkube-node-ncffd\" (UID: \"c26912ca-10b4-4ae3-b306-890f93abfee3\") " pod="openshift-ovn-kubernetes/ovnkube-node-ncffd" Jun 08 13:43:53.505813 ip-10-0-140-46 kubenswrapper[2576]: I0608 13:43:53.505789 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/c26912ca-10b4-4ae3-b306-890f93abfee3-env-overrides\") pod \"ovnkube-node-ncffd\" (UID: \"c26912ca-10b4-4ae3-b306-890f93abfee3\") " pod="openshift-ovn-kubernetes/ovnkube-node-ncffd" Jun 08 13:43:53.505813 ip-10-0-140-46 kubenswrapper[2576]: I0608 13:43:53.505809 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/c26912ca-10b4-4ae3-b306-890f93abfee3-var-lib-openvswitch\") pod \"ovnkube-node-ncffd\" (UID: \"c26912ca-10b4-4ae3-b306-890f93abfee3\") " pod="openshift-ovn-kubernetes/ovnkube-node-ncffd" Jun 08 13:43:53.506211 ip-10-0-140-46 kubenswrapper[2576]: I0608 13:43:53.505834 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/c26912ca-10b4-4ae3-b306-890f93abfee3-node-log\") pod \"ovnkube-node-ncffd\" (UID: \"c26912ca-10b4-4ae3-b306-890f93abfee3\") " pod="openshift-ovn-kubernetes/ovnkube-node-ncffd" Jun 08 13:43:53.506211 ip-10-0-140-46 kubenswrapper[2576]: I0608 13:43:53.505864 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/c26912ca-10b4-4ae3-b306-890f93abfee3-log-socket\") pod \"ovnkube-node-ncffd\" (UID: \"c26912ca-10b4-4ae3-b306-890f93abfee3\") " pod="openshift-ovn-kubernetes/ovnkube-node-ncffd" Jun 08 13:43:53.506211 ip-10-0-140-46 kubenswrapper[2576]: I0608 13:43:53.505889 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/c26912ca-10b4-4ae3-b306-890f93abfee3-host-run-ovn-kubernetes\") pod \"ovnkube-node-ncffd\" (UID: \"c26912ca-10b4-4ae3-b306-890f93abfee3\") " pod="openshift-ovn-kubernetes/ovnkube-node-ncffd" Jun 08 13:43:53.506211 ip-10-0-140-46 kubenswrapper[2576]: I0608 13:43:53.505912 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/c26912ca-10b4-4ae3-b306-890f93abfee3-log-socket\") pod \"ovnkube-node-ncffd\" (UID: \"c26912ca-10b4-4ae3-b306-890f93abfee3\") " pod="openshift-ovn-kubernetes/ovnkube-node-ncffd" Jun 08 13:43:53.506211 ip-10-0-140-46 kubenswrapper[2576]: I0608 13:43:53.505914 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/3c9ae33a-4be0-4494-ae7d-b24b4421ae27-sys-fs\") pod \"aws-ebs-csi-driver-node-p78hl\" (UID: \"3c9ae33a-4be0-4494-ae7d-b24b4421ae27\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-p78hl" Jun 08 13:43:53.506211 ip-10-0-140-46 kubenswrapper[2576]: I0608 13:43:53.505940 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jnppj\" (UniqueName: \"kubernetes.io/projected/c26912ca-10b4-4ae3-b306-890f93abfee3-kube-api-access-jnppj\") pod \"ovnkube-node-ncffd\" (UID: \"c26912ca-10b4-4ae3-b306-890f93abfee3\") " pod="openshift-ovn-kubernetes/ovnkube-node-ncffd" Jun 08 13:43:53.506211 ip-10-0-140-46 kubenswrapper[2576]: I0608 13:43:53.505974 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/c26912ca-10b4-4ae3-b306-890f93abfee3-ovn-node-metrics-cert\") pod \"ovnkube-node-ncffd\" (UID: \"c26912ca-10b4-4ae3-b306-890f93abfee3\") " pod="openshift-ovn-kubernetes/ovnkube-node-ncffd" Jun 08 13:43:53.506211 ip-10-0-140-46 kubenswrapper[2576]: I0608 13:43:53.505995 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/3c9ae33a-4be0-4494-ae7d-b24b4421ae27-sys-fs\") pod \"aws-ebs-csi-driver-node-p78hl\" (UID: \"3c9ae33a-4be0-4494-ae7d-b24b4421ae27\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-p78hl" Jun 08 13:43:53.506211 ip-10-0-140-46 kubenswrapper[2576]: I0608 13:43:53.505975 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/c26912ca-10b4-4ae3-b306-890f93abfee3-host-run-ovn-kubernetes\") pod \"ovnkube-node-ncffd\" (UID: \"c26912ca-10b4-4ae3-b306-890f93abfee3\") " pod="openshift-ovn-kubernetes/ovnkube-node-ncffd" Jun 08 13:43:53.506211 ip-10-0-140-46 kubenswrapper[2576]: I0608 13:43:53.506012 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/c26912ca-10b4-4ae3-b306-890f93abfee3-host-kubelet\") pod \"ovnkube-node-ncffd\" (UID: \"c26912ca-10b4-4ae3-b306-890f93abfee3\") " pod="openshift-ovn-kubernetes/ovnkube-node-ncffd" Jun 08 13:43:53.506211 ip-10-0-140-46 kubenswrapper[2576]: I0608 13:43:53.506045 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/c26912ca-10b4-4ae3-b306-890f93abfee3-host-kubelet\") pod \"ovnkube-node-ncffd\" (UID: \"c26912ca-10b4-4ae3-b306-890f93abfee3\") " pod="openshift-ovn-kubernetes/ovnkube-node-ncffd" Jun 08 13:43:53.506211 ip-10-0-140-46 kubenswrapper[2576]: I0608 13:43:53.506044 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/c26912ca-10b4-4ae3-b306-890f93abfee3-etc-openvswitch\") pod \"ovnkube-node-ncffd\" (UID: \"c26912ca-10b4-4ae3-b306-890f93abfee3\") " pod="openshift-ovn-kubernetes/ovnkube-node-ncffd" Jun 08 13:43:53.506211 ip-10-0-140-46 kubenswrapper[2576]: I0608 13:43:53.506080 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/c26912ca-10b4-4ae3-b306-890f93abfee3-etc-openvswitch\") pod \"ovnkube-node-ncffd\" (UID: \"c26912ca-10b4-4ae3-b306-890f93abfee3\") " pod="openshift-ovn-kubernetes/ovnkube-node-ncffd" Jun 08 13:43:53.506211 ip-10-0-140-46 kubenswrapper[2576]: I0608 13:43:53.506103 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/c26912ca-10b4-4ae3-b306-890f93abfee3-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-ncffd\" (UID: \"c26912ca-10b4-4ae3-b306-890f93abfee3\") " pod="openshift-ovn-kubernetes/ovnkube-node-ncffd" Jun 08 13:43:53.506211 ip-10-0-140-46 kubenswrapper[2576]: I0608 13:43:53.506129 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/3c9ae33a-4be0-4494-ae7d-b24b4421ae27-socket-dir\") pod \"aws-ebs-csi-driver-node-p78hl\" (UID: \"3c9ae33a-4be0-4494-ae7d-b24b4421ae27\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-p78hl" Jun 08 13:43:53.506211 ip-10-0-140-46 kubenswrapper[2576]: I0608 13:43:53.506136 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/c26912ca-10b4-4ae3-b306-890f93abfee3-env-overrides\") pod \"ovnkube-node-ncffd\" (UID: \"c26912ca-10b4-4ae3-b306-890f93abfee3\") " pod="openshift-ovn-kubernetes/ovnkube-node-ncffd" Jun 08 13:43:53.506211 ip-10-0-140-46 kubenswrapper[2576]: I0608 13:43:53.506156 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/c26912ca-10b4-4ae3-b306-890f93abfee3-run-ovn\") pod \"ovnkube-node-ncffd\" (UID: \"c26912ca-10b4-4ae3-b306-890f93abfee3\") " pod="openshift-ovn-kubernetes/ovnkube-node-ncffd" Jun 08 13:43:53.506879 ip-10-0-140-46 kubenswrapper[2576]: I0608 13:43:53.506193 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/c26912ca-10b4-4ae3-b306-890f93abfee3-host-cni-netd\") pod \"ovnkube-node-ncffd\" (UID: \"c26912ca-10b4-4ae3-b306-890f93abfee3\") " pod="openshift-ovn-kubernetes/ovnkube-node-ncffd" Jun 08 13:43:53.506879 ip-10-0-140-46 kubenswrapper[2576]: I0608 13:43:53.506248 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/c26912ca-10b4-4ae3-b306-890f93abfee3-run-ovn\") pod \"ovnkube-node-ncffd\" (UID: \"c26912ca-10b4-4ae3-b306-890f93abfee3\") " pod="openshift-ovn-kubernetes/ovnkube-node-ncffd" Jun 08 13:43:53.506879 ip-10-0-140-46 kubenswrapper[2576]: I0608 13:43:53.506260 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/3c9ae33a-4be0-4494-ae7d-b24b4421ae27-socket-dir\") pod \"aws-ebs-csi-driver-node-p78hl\" (UID: \"3c9ae33a-4be0-4494-ae7d-b24b4421ae27\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-p78hl" Jun 08 13:43:53.506879 ip-10-0-140-46 kubenswrapper[2576]: I0608 13:43:53.506265 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/c26912ca-10b4-4ae3-b306-890f93abfee3-host-cni-netd\") pod \"ovnkube-node-ncffd\" (UID: \"c26912ca-10b4-4ae3-b306-890f93abfee3\") " pod="openshift-ovn-kubernetes/ovnkube-node-ncffd" Jun 08 13:43:53.506879 ip-10-0-140-46 kubenswrapper[2576]: I0608 13:43:53.506274 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ndrzx\" (UniqueName: \"kubernetes.io/projected/3c9ae33a-4be0-4494-ae7d-b24b4421ae27-kube-api-access-ndrzx\") pod \"aws-ebs-csi-driver-node-p78hl\" (UID: \"3c9ae33a-4be0-4494-ae7d-b24b4421ae27\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-p78hl" Jun 08 13:43:53.506879 ip-10-0-140-46 kubenswrapper[2576]: I0608 13:43:53.506275 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/c26912ca-10b4-4ae3-b306-890f93abfee3-ovnkube-script-lib\") pod \"ovnkube-node-ncffd\" (UID: \"c26912ca-10b4-4ae3-b306-890f93abfee3\") " pod="openshift-ovn-kubernetes/ovnkube-node-ncffd" Jun 08 13:43:53.506879 ip-10-0-140-46 kubenswrapper[2576]: I0608 13:43:53.506203 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/c26912ca-10b4-4ae3-b306-890f93abfee3-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-ncffd\" (UID: \"c26912ca-10b4-4ae3-b306-890f93abfee3\") " pod="openshift-ovn-kubernetes/ovnkube-node-ncffd" Jun 08 13:43:53.506879 ip-10-0-140-46 kubenswrapper[2576]: I0608 13:43:53.506319 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/c26912ca-10b4-4ae3-b306-890f93abfee3-ovnkube-config\") pod \"ovnkube-node-ncffd\" (UID: \"c26912ca-10b4-4ae3-b306-890f93abfee3\") " pod="openshift-ovn-kubernetes/ovnkube-node-ncffd" Jun 08 13:43:53.506879 ip-10-0-140-46 kubenswrapper[2576]: I0608 13:43:53.506342 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/3c9ae33a-4be0-4494-ae7d-b24b4421ae27-device-dir\") pod \"aws-ebs-csi-driver-node-p78hl\" (UID: \"3c9ae33a-4be0-4494-ae7d-b24b4421ae27\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-p78hl" Jun 08 13:43:53.506879 ip-10-0-140-46 kubenswrapper[2576]: I0608 13:43:53.506391 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/c26912ca-10b4-4ae3-b306-890f93abfee3-host-cni-bin\") pod \"ovnkube-node-ncffd\" (UID: \"c26912ca-10b4-4ae3-b306-890f93abfee3\") " pod="openshift-ovn-kubernetes/ovnkube-node-ncffd" Jun 08 13:43:53.506879 ip-10-0-140-46 kubenswrapper[2576]: I0608 13:43:53.506414 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/6e4b50fc-3e91-4f50-b92a-e90919788248-konnectivity-ca\") pod \"konnectivity-agent-cx7sn\" (UID: \"6e4b50fc-3e91-4f50-b92a-e90919788248\") " pod="kube-system/konnectivity-agent-cx7sn" Jun 08 13:43:53.506879 ip-10-0-140-46 kubenswrapper[2576]: I0608 13:43:53.506432 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/3c9ae33a-4be0-4494-ae7d-b24b4421ae27-device-dir\") pod \"aws-ebs-csi-driver-node-p78hl\" (UID: \"3c9ae33a-4be0-4494-ae7d-b24b4421ae27\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-p78hl" Jun 08 13:43:53.506879 ip-10-0-140-46 kubenswrapper[2576]: I0608 13:43:53.506438 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/3c9ae33a-4be0-4494-ae7d-b24b4421ae27-kubelet-dir\") pod \"aws-ebs-csi-driver-node-p78hl\" (UID: \"3c9ae33a-4be0-4494-ae7d-b24b4421ae27\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-p78hl" Jun 08 13:43:53.506879 ip-10-0-140-46 kubenswrapper[2576]: I0608 13:43:53.506484 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/c26912ca-10b4-4ae3-b306-890f93abfee3-host-cni-bin\") pod \"ovnkube-node-ncffd\" (UID: \"c26912ca-10b4-4ae3-b306-890f93abfee3\") " pod="openshift-ovn-kubernetes/ovnkube-node-ncffd" Jun 08 13:43:53.506879 ip-10-0-140-46 kubenswrapper[2576]: I0608 13:43:53.506610 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/3c9ae33a-4be0-4494-ae7d-b24b4421ae27-kubelet-dir\") pod \"aws-ebs-csi-driver-node-p78hl\" (UID: \"3c9ae33a-4be0-4494-ae7d-b24b4421ae27\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-p78hl" Jun 08 13:43:53.506879 ip-10-0-140-46 kubenswrapper[2576]: I0608 13:43:53.506856 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/c26912ca-10b4-4ae3-b306-890f93abfee3-ovnkube-config\") pod \"ovnkube-node-ncffd\" (UID: \"c26912ca-10b4-4ae3-b306-890f93abfee3\") " pod="openshift-ovn-kubernetes/ovnkube-node-ncffd" Jun 08 13:43:53.507312 ip-10-0-140-46 kubenswrapper[2576]: I0608 13:43:53.506921 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/6e4b50fc-3e91-4f50-b92a-e90919788248-konnectivity-ca\") pod \"konnectivity-agent-cx7sn\" (UID: \"6e4b50fc-3e91-4f50-b92a-e90919788248\") " pod="kube-system/konnectivity-agent-cx7sn" Jun 08 13:43:53.507946 ip-10-0-140-46 kubenswrapper[2576]: I0608 13:43:53.507928 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/6e4b50fc-3e91-4f50-b92a-e90919788248-agent-certs\") pod \"konnectivity-agent-cx7sn\" (UID: \"6e4b50fc-3e91-4f50-b92a-e90919788248\") " pod="kube-system/konnectivity-agent-cx7sn" Jun 08 13:43:53.508112 ip-10-0-140-46 kubenswrapper[2576]: I0608 13:43:53.508097 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/c26912ca-10b4-4ae3-b306-890f93abfee3-ovn-node-metrics-cert\") pod \"ovnkube-node-ncffd\" (UID: \"c26912ca-10b4-4ae3-b306-890f93abfee3\") " pod="openshift-ovn-kubernetes/ovnkube-node-ncffd" Jun 08 13:43:53.539067 ip-10-0-140-46 kubenswrapper[2576]: I0608 13:43:53.539033 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-jnppj\" (UniqueName: \"kubernetes.io/projected/c26912ca-10b4-4ae3-b306-890f93abfee3-kube-api-access-jnppj\") pod \"ovnkube-node-ncffd\" (UID: \"c26912ca-10b4-4ae3-b306-890f93abfee3\") " pod="openshift-ovn-kubernetes/ovnkube-node-ncffd" Jun 08 13:43:53.552990 ip-10-0-140-46 kubenswrapper[2576]: I0608 13:43:53.552958 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-ndrzx\" (UniqueName: \"kubernetes.io/projected/3c9ae33a-4be0-4494-ae7d-b24b4421ae27-kube-api-access-ndrzx\") pod \"aws-ebs-csi-driver-node-p78hl\" (UID: \"3c9ae33a-4be0-4494-ae7d-b24b4421ae27\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-p78hl" Jun 08 13:43:53.606531 ip-10-0-140-46 kubenswrapper[2576]: I0608 13:43:53.606499 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-pxbdv" Jun 08 13:43:53.613097 ip-10-0-140-46 kubenswrapper[2576]: I0608 13:43:53.613067 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-f25db" Jun 08 13:43:53.614414 ip-10-0-140-46 kubenswrapper[2576]: W0608 13:43:53.614386 2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod18b84a5c_7b8b_4e1b_a70a_4fbda39064bf.slice/crio-eb98463a29b016a9be38fd946beb036c0f27eb5978dfdb0218e3334908d00ad1 WatchSource:0}: Error finding container eb98463a29b016a9be38fd946beb036c0f27eb5978dfdb0218e3334908d00ad1: Status 404 returned error can't find the container with id eb98463a29b016a9be38fd946beb036c0f27eb5978dfdb0218e3334908d00ad1 Jun 08 13:43:53.619704 ip-10-0-140-46 kubenswrapper[2576]: I0608 13:43:53.619686 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-gcmjl" Jun 08 13:43:53.621114 ip-10-0-140-46 kubenswrapper[2576]: W0608 13:43:53.621087 2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2cf3d8d4_e8f9_402e_9fa7_b564c4ea705c.slice/crio-4003cbb34a39daa9373a74cf0e9e93c6b895ef9593b144ee714ff647e3b7215a WatchSource:0}: Error finding container 4003cbb34a39daa9373a74cf0e9e93c6b895ef9593b144ee714ff647e3b7215a: Status 404 returned error can't find the container with id 4003cbb34a39daa9373a74cf0e9e93c6b895ef9593b144ee714ff647e3b7215a Jun 08 13:43:53.624764 ip-10-0-140-46 kubenswrapper[2576]: I0608 13:43:53.624700 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-jxwb8" Jun 08 13:43:53.628801 ip-10-0-140-46 kubenswrapper[2576]: W0608 13:43:53.628775 2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8e1453fa_6b1d_4b93_98cf_5fe4d2829935.slice/crio-4f8a7df186528a1f66108a51b1de6cfb6ebed8c0cdbac0f9564a6c2d83bd9afd WatchSource:0}: Error finding container 4f8a7df186528a1f66108a51b1de6cfb6ebed8c0cdbac0f9564a6c2d83bd9afd: Status 404 returned error can't find the container with id 4f8a7df186528a1f66108a51b1de6cfb6ebed8c0cdbac0f9564a6c2d83bd9afd Jun 08 13:43:53.629501 ip-10-0-140-46 kubenswrapper[2576]: I0608 13:43:53.629484 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-fd4mq" Jun 08 13:43:53.632514 ip-10-0-140-46 kubenswrapper[2576]: W0608 13:43:53.632492 2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod899b8b33_b573_4d67_ae45_773ec4b36e28.slice/crio-cc541ac32f45c7f3266c61dfa9dee7d6ef1ae5d41384b56914339bf81d42bd5d WatchSource:0}: Error finding container cc541ac32f45c7f3266c61dfa9dee7d6ef1ae5d41384b56914339bf81d42bd5d: Status 404 returned error can't find the container with id cc541ac32f45c7f3266c61dfa9dee7d6ef1ae5d41384b56914339bf81d42bd5d Jun 08 13:43:53.637364 ip-10-0-140-46 kubenswrapper[2576]: W0608 13:43:53.637148 2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf2c67e68_042b_487a_bafa_a22aa9bd82df.slice/crio-4503632748ee4cd3e8d4e0a394e845bad75d8d9589cd4c887e2cab685e5f96e7 WatchSource:0}: Error finding container 4503632748ee4cd3e8d4e0a394e845bad75d8d9589cd4c887e2cab685e5f96e7: Status 404 returned error can't find the container with id 4503632748ee4cd3e8d4e0a394e845bad75d8d9589cd4c887e2cab685e5f96e7 Jun 08 13:43:53.638028 ip-10-0-140-46 kubenswrapper[2576]: I0608 13:43:53.637981 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-7zkgm" Jun 08 13:43:53.645165 ip-10-0-140-46 kubenswrapper[2576]: I0608 13:43:53.645145 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-ncffd" Jun 08 13:43:53.645388 ip-10-0-140-46 kubenswrapper[2576]: W0608 13:43:53.645359 2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podef6c467c_acc8_428e_950f_e0d25491f708.slice/crio-00d4930ec4b3a4405ba4cd0fd606852a2ad1d659f2d4d48a0d66eec34c1697b8 WatchSource:0}: Error finding container 00d4930ec4b3a4405ba4cd0fd606852a2ad1d659f2d4d48a0d66eec34c1697b8: Status 404 returned error can't find the container with id 00d4930ec4b3a4405ba4cd0fd606852a2ad1d659f2d4d48a0d66eec34c1697b8 Jun 08 13:43:53.649132 ip-10-0-140-46 kubenswrapper[2576]: I0608 13:43:53.649113 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-cx7sn" Jun 08 13:43:53.652473 ip-10-0-140-46 kubenswrapper[2576]: W0608 13:43:53.652451 2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc26912ca_10b4_4ae3_b306_890f93abfee3.slice/crio-6c4e34acf53d035a1d08ec7530652f59e2ae01b66007abceecce5a49c362178f WatchSource:0}: Error finding container 6c4e34acf53d035a1d08ec7530652f59e2ae01b66007abceecce5a49c362178f: Status 404 returned error can't find the container with id 6c4e34acf53d035a1d08ec7530652f59e2ae01b66007abceecce5a49c362178f Jun 08 13:43:53.653976 ip-10-0-140-46 kubenswrapper[2576]: I0608 13:43:53.653960 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-p78hl" Jun 08 13:43:53.655352 ip-10-0-140-46 kubenswrapper[2576]: I0608 13:43:53.655337 2576 reflector.go:439] "Caches populated" type="*v1.CSIDriver" reflector="k8s.io/client-go/informers/factory.go:160" Jun 08 13:43:53.657116 ip-10-0-140-46 kubenswrapper[2576]: W0608 13:43:53.657097 2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6e4b50fc_3e91_4f50_b92a_e90919788248.slice/crio-e9bc1694c2218368eb24b7ecc21a89655045fdb44fa6468d35afd58c1a338695 WatchSource:0}: Error finding container e9bc1694c2218368eb24b7ecc21a89655045fdb44fa6468d35afd58c1a338695: Status 404 returned error can't find the container with id e9bc1694c2218368eb24b7ecc21a89655045fdb44fa6468d35afd58c1a338695 Jun 08 13:43:53.664353 ip-10-0-140-46 kubenswrapper[2576]: W0608 13:43:53.664327 2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3c9ae33a_4be0_4494_ae7d_b24b4421ae27.slice/crio-3f0b0808d29546843012dc7e2d20b0cc4788fe0906ed667ee5aeafb7d03c9e93 WatchSource:0}: Error finding container 3f0b0808d29546843012dc7e2d20b0cc4788fe0906ed667ee5aeafb7d03c9e93: Status 404 returned error can't find the container with id 3f0b0808d29546843012dc7e2d20b0cc4788fe0906ed667ee5aeafb7d03c9e93 Jun 08 13:43:53.725176 ip-10-0-140-46 kubenswrapper[2576]: I0608 13:43:53.725146 2576 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160" Jun 08 13:43:53.910609 ip-10-0-140-46 kubenswrapper[2576]: I0608 13:43:53.910507 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/52fab817-1614-450d-8ea9-d10e21821af6-metrics-certs\") pod \"network-metrics-daemon-l62qm\" (UID: \"52fab817-1614-450d-8ea9-d10e21821af6\") " pod="openshift-multus/network-metrics-daemon-l62qm" Jun 08 13:43:53.910757 ip-10-0-140-46 kubenswrapper[2576]: I0608 13:43:53.910619 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/6da5a732-b003-412c-8308-e80cead7eb1c-original-pull-secret\") pod \"global-pull-secret-syncer-dm2n6\" (UID: \"6da5a732-b003-412c-8308-e80cead7eb1c\") " pod="kube-system/global-pull-secret-syncer-dm2n6" Jun 08 13:43:53.910757 ip-10-0-140-46 kubenswrapper[2576]: E0608 13:43:53.910681 2576 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jun 08 13:43:53.910757 ip-10-0-140-46 kubenswrapper[2576]: E0608 13:43:53.910725 2576 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jun 08 13:43:53.910757 ip-10-0-140-46 kubenswrapper[2576]: E0608 13:43:53.910749 2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/52fab817-1614-450d-8ea9-d10e21821af6-metrics-certs podName:52fab817-1614-450d-8ea9-d10e21821af6 nodeName:}" failed. No retries permitted until 2026-06-08 13:43:54.910728274 +0000 UTC m=+2.990057150 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/52fab817-1614-450d-8ea9-d10e21821af6-metrics-certs") pod "network-metrics-daemon-l62qm" (UID: "52fab817-1614-450d-8ea9-d10e21821af6") : object "openshift-multus"/"metrics-daemon-secret" not registered Jun 08 13:43:53.910967 ip-10-0-140-46 kubenswrapper[2576]: E0608 13:43:53.910776 2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/6da5a732-b003-412c-8308-e80cead7eb1c-original-pull-secret podName:6da5a732-b003-412c-8308-e80cead7eb1c nodeName:}" failed. No retries permitted until 2026-06-08 13:43:54.910760123 +0000 UTC m=+2.990088999 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/6da5a732-b003-412c-8308-e80cead7eb1c-original-pull-secret") pod "global-pull-secret-syncer-dm2n6" (UID: "6da5a732-b003-412c-8308-e80cead7eb1c") : object "kube-system"/"original-pull-secret" not registered Jun 08 13:43:54.011910 ip-10-0-140-46 kubenswrapper[2576]: I0608 13:43:54.011149 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5jttb\" (UniqueName: \"kubernetes.io/projected/4b283339-40c0-40f5-b9d9-c75e99e4f984-kube-api-access-5jttb\") pod \"network-check-target-99957\" (UID: \"4b283339-40c0-40f5-b9d9-c75e99e4f984\") " pod="openshift-network-diagnostics/network-check-target-99957" Jun 08 13:43:54.011910 ip-10-0-140-46 kubenswrapper[2576]: E0608 13:43:54.011405 2576 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jun 08 13:43:54.011910 ip-10-0-140-46 kubenswrapper[2576]: E0608 13:43:54.011431 2576 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jun 08 13:43:54.011910 ip-10-0-140-46 kubenswrapper[2576]: E0608 13:43:54.011450 2576 projected.go:196] Error preparing data for projected volume kube-api-access-5jttb for pod openshift-network-diagnostics/network-check-target-99957: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 08 13:43:54.011910 ip-10-0-140-46 kubenswrapper[2576]: E0608 13:43:54.011512 2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/4b283339-40c0-40f5-b9d9-c75e99e4f984-kube-api-access-5jttb podName:4b283339-40c0-40f5-b9d9-c75e99e4f984 nodeName:}" failed. No retries permitted until 2026-06-08 13:43:55.01149326 +0000 UTC m=+3.090822133 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-api-access-5jttb" (UniqueName: "kubernetes.io/projected/4b283339-40c0-40f5-b9d9-c75e99e4f984-kube-api-access-5jttb") pod "network-check-target-99957" (UID: "4b283339-40c0-40f5-b9d9-c75e99e4f984") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 08 13:43:54.404818 ip-10-0-140-46 kubenswrapper[2576]: I0608 13:43:54.404766 2576 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-06-07 13:38:53 +0000 UTC" deadline="2028-02-22 15:38:30.922817298 +0000 UTC" Jun 08 13:43:54.404818 ip-10-0-140-46 kubenswrapper[2576]: I0608 13:43:54.404816 2576 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="14977h54m36.518006738s" Jun 08 13:43:54.420593 ip-10-0-140-46 kubenswrapper[2576]: I0608 13:43:54.420444 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-fd4mq" event={"ID":"f2c67e68-042b-487a-bafa-a22aa9bd82df","Type":"ContainerStarted","Data":"4503632748ee4cd3e8d4e0a394e845bad75d8d9589cd4c887e2cab685e5f96e7"} Jun 08 13:43:54.432621 ip-10-0-140-46 kubenswrapper[2576]: I0608 13:43:54.432515 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-jxwb8" event={"ID":"899b8b33-b573-4d67-ae45-773ec4b36e28","Type":"ContainerStarted","Data":"cc541ac32f45c7f3266c61dfa9dee7d6ef1ae5d41384b56914339bf81d42bd5d"} Jun 08 13:43:54.441347 ip-10-0-140-46 kubenswrapper[2576]: I0608 13:43:54.440912 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-gcmjl" event={"ID":"8e1453fa-6b1d-4b93-98cf-5fe4d2829935","Type":"ContainerStarted","Data":"4f8a7df186528a1f66108a51b1de6cfb6ebed8c0cdbac0f9564a6c2d83bd9afd"} Jun 08 13:43:54.448125 ip-10-0-140-46 kubenswrapper[2576]: I0608 13:43:54.448088 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-f25db" event={"ID":"2cf3d8d4-e8f9-402e-9fa7-b564c4ea705c","Type":"ContainerStarted","Data":"4003cbb34a39daa9373a74cf0e9e93c6b895ef9593b144ee714ff647e3b7215a"} Jun 08 13:43:54.452248 ip-10-0-140-46 kubenswrapper[2576]: I0608 13:43:54.452150 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-pxbdv" event={"ID":"18b84a5c-7b8b-4e1b-a70a-4fbda39064bf","Type":"ContainerStarted","Data":"eb98463a29b016a9be38fd946beb036c0f27eb5978dfdb0218e3334908d00ad1"} Jun 08 13:43:54.462249 ip-10-0-140-46 kubenswrapper[2576]: I0608 13:43:54.461886 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-p78hl" event={"ID":"3c9ae33a-4be0-4494-ae7d-b24b4421ae27","Type":"ContainerStarted","Data":"3f0b0808d29546843012dc7e2d20b0cc4788fe0906ed667ee5aeafb7d03c9e93"} Jun 08 13:43:54.465559 ip-10-0-140-46 kubenswrapper[2576]: I0608 13:43:54.465460 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-cx7sn" event={"ID":"6e4b50fc-3e91-4f50-b92a-e90919788248","Type":"ContainerStarted","Data":"e9bc1694c2218368eb24b7ecc21a89655045fdb44fa6468d35afd58c1a338695"} Jun 08 13:43:54.480608 ip-10-0-140-46 kubenswrapper[2576]: I0608 13:43:54.480459 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-ncffd" event={"ID":"c26912ca-10b4-4ae3-b306-890f93abfee3","Type":"ContainerStarted","Data":"6c4e34acf53d035a1d08ec7530652f59e2ae01b66007abceecce5a49c362178f"} Jun 08 13:43:54.487598 ip-10-0-140-46 kubenswrapper[2576]: I0608 13:43:54.487545 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-7zkgm" event={"ID":"ef6c467c-acc8-428e-950f-e0d25491f708","Type":"ContainerStarted","Data":"00d4930ec4b3a4405ba4cd0fd606852a2ad1d659f2d4d48a0d66eec34c1697b8"} Jun 08 13:43:54.917936 ip-10-0-140-46 kubenswrapper[2576]: I0608 13:43:54.917893 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/6da5a732-b003-412c-8308-e80cead7eb1c-original-pull-secret\") pod \"global-pull-secret-syncer-dm2n6\" (UID: \"6da5a732-b003-412c-8308-e80cead7eb1c\") " pod="kube-system/global-pull-secret-syncer-dm2n6" Jun 08 13:43:54.918111 ip-10-0-140-46 kubenswrapper[2576]: I0608 13:43:54.917946 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/52fab817-1614-450d-8ea9-d10e21821af6-metrics-certs\") pod \"network-metrics-daemon-l62qm\" (UID: \"52fab817-1614-450d-8ea9-d10e21821af6\") " pod="openshift-multus/network-metrics-daemon-l62qm" Jun 08 13:43:54.918111 ip-10-0-140-46 kubenswrapper[2576]: E0608 13:43:54.918098 2576 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jun 08 13:43:54.918230 ip-10-0-140-46 kubenswrapper[2576]: E0608 13:43:54.918160 2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/52fab817-1614-450d-8ea9-d10e21821af6-metrics-certs podName:52fab817-1614-450d-8ea9-d10e21821af6 nodeName:}" failed. No retries permitted until 2026-06-08 13:43:56.918142429 +0000 UTC m=+4.997471300 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/52fab817-1614-450d-8ea9-d10e21821af6-metrics-certs") pod "network-metrics-daemon-l62qm" (UID: "52fab817-1614-450d-8ea9-d10e21821af6") : object "openshift-multus"/"metrics-daemon-secret" not registered Jun 08 13:43:54.918558 ip-10-0-140-46 kubenswrapper[2576]: E0608 13:43:54.918542 2576 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jun 08 13:43:54.918677 ip-10-0-140-46 kubenswrapper[2576]: E0608 13:43:54.918612 2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/6da5a732-b003-412c-8308-e80cead7eb1c-original-pull-secret podName:6da5a732-b003-412c-8308-e80cead7eb1c nodeName:}" failed. No retries permitted until 2026-06-08 13:43:56.918596474 +0000 UTC m=+4.997925347 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/6da5a732-b003-412c-8308-e80cead7eb1c-original-pull-secret") pod "global-pull-secret-syncer-dm2n6" (UID: "6da5a732-b003-412c-8308-e80cead7eb1c") : object "kube-system"/"original-pull-secret" not registered Jun 08 13:43:55.018556 ip-10-0-140-46 kubenswrapper[2576]: I0608 13:43:55.018519 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5jttb\" (UniqueName: \"kubernetes.io/projected/4b283339-40c0-40f5-b9d9-c75e99e4f984-kube-api-access-5jttb\") pod \"network-check-target-99957\" (UID: \"4b283339-40c0-40f5-b9d9-c75e99e4f984\") " pod="openshift-network-diagnostics/network-check-target-99957" Jun 08 13:43:55.018730 ip-10-0-140-46 kubenswrapper[2576]: E0608 13:43:55.018713 2576 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jun 08 13:43:55.018788 ip-10-0-140-46 kubenswrapper[2576]: E0608 13:43:55.018733 2576 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jun 08 13:43:55.018788 ip-10-0-140-46 kubenswrapper[2576]: E0608 13:43:55.018745 2576 projected.go:196] Error preparing data for projected volume kube-api-access-5jttb for pod openshift-network-diagnostics/network-check-target-99957: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 08 13:43:55.018908 ip-10-0-140-46 kubenswrapper[2576]: E0608 13:43:55.018800 2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/4b283339-40c0-40f5-b9d9-c75e99e4f984-kube-api-access-5jttb podName:4b283339-40c0-40f5-b9d9-c75e99e4f984 nodeName:}" failed. No retries permitted until 2026-06-08 13:43:57.018781661 +0000 UTC m=+5.098110553 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-api-access-5jttb" (UniqueName: "kubernetes.io/projected/4b283339-40c0-40f5-b9d9-c75e99e4f984-kube-api-access-5jttb") pod "network-check-target-99957" (UID: "4b283339-40c0-40f5-b9d9-c75e99e4f984") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 08 13:43:55.200818 ip-10-0-140-46 kubenswrapper[2576]: I0608 13:43:55.200697 2576 reflector.go:439] "Caches populated" type="*v1.Node" reflector="k8s.io/client-go/informers/factory.go:160" Jun 08 13:43:55.371180 ip-10-0-140-46 kubenswrapper[2576]: I0608 13:43:55.371140 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-l62qm" Jun 08 13:43:55.371348 ip-10-0-140-46 kubenswrapper[2576]: E0608 13:43:55.371291 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-l62qm" podUID="52fab817-1614-450d-8ea9-d10e21821af6" Jun 08 13:43:55.371734 ip-10-0-140-46 kubenswrapper[2576]: I0608 13:43:55.371714 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-99957" Jun 08 13:43:55.371835 ip-10-0-140-46 kubenswrapper[2576]: E0608 13:43:55.371816 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-99957" podUID="4b283339-40c0-40f5-b9d9-c75e99e4f984" Jun 08 13:43:55.371904 ip-10-0-140-46 kubenswrapper[2576]: I0608 13:43:55.371891 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-dm2n6" Jun 08 13:43:55.371984 ip-10-0-140-46 kubenswrapper[2576]: E0608 13:43:55.371966 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-dm2n6" podUID="6da5a732-b003-412c-8308-e80cead7eb1c" Jun 08 13:43:55.405803 ip-10-0-140-46 kubenswrapper[2576]: I0608 13:43:55.405762 2576 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-06-07 13:38:53 +0000 UTC" deadline="2027-11-13 16:41:31.299278552 +0000 UTC" Jun 08 13:43:55.405803 ip-10-0-140-46 kubenswrapper[2576]: I0608 13:43:55.405802 2576 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="12554h57m35.893481804s" Jun 08 13:43:56.938274 ip-10-0-140-46 kubenswrapper[2576]: I0608 13:43:56.938231 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/52fab817-1614-450d-8ea9-d10e21821af6-metrics-certs\") pod \"network-metrics-daemon-l62qm\" (UID: \"52fab817-1614-450d-8ea9-d10e21821af6\") " pod="openshift-multus/network-metrics-daemon-l62qm" Jun 08 13:43:56.938748 ip-10-0-140-46 kubenswrapper[2576]: I0608 13:43:56.938352 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/6da5a732-b003-412c-8308-e80cead7eb1c-original-pull-secret\") pod \"global-pull-secret-syncer-dm2n6\" (UID: \"6da5a732-b003-412c-8308-e80cead7eb1c\") " pod="kube-system/global-pull-secret-syncer-dm2n6" Jun 08 13:43:56.938748 ip-10-0-140-46 kubenswrapper[2576]: E0608 13:43:56.938514 2576 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jun 08 13:43:56.938748 ip-10-0-140-46 kubenswrapper[2576]: E0608 13:43:56.938593 2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/6da5a732-b003-412c-8308-e80cead7eb1c-original-pull-secret podName:6da5a732-b003-412c-8308-e80cead7eb1c nodeName:}" failed. No retries permitted until 2026-06-08 13:44:00.938559803 +0000 UTC m=+9.017888676 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/6da5a732-b003-412c-8308-e80cead7eb1c-original-pull-secret") pod "global-pull-secret-syncer-dm2n6" (UID: "6da5a732-b003-412c-8308-e80cead7eb1c") : object "kube-system"/"original-pull-secret" not registered Jun 08 13:43:56.939067 ip-10-0-140-46 kubenswrapper[2576]: E0608 13:43:56.939030 2576 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jun 08 13:43:56.939157 ip-10-0-140-46 kubenswrapper[2576]: E0608 13:43:56.939080 2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/52fab817-1614-450d-8ea9-d10e21821af6-metrics-certs podName:52fab817-1614-450d-8ea9-d10e21821af6 nodeName:}" failed. No retries permitted until 2026-06-08 13:44:00.939064638 +0000 UTC m=+9.018393512 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/52fab817-1614-450d-8ea9-d10e21821af6-metrics-certs") pod "network-metrics-daemon-l62qm" (UID: "52fab817-1614-450d-8ea9-d10e21821af6") : object "openshift-multus"/"metrics-daemon-secret" not registered Jun 08 13:43:57.039006 ip-10-0-140-46 kubenswrapper[2576]: I0608 13:43:57.038961 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5jttb\" (UniqueName: \"kubernetes.io/projected/4b283339-40c0-40f5-b9d9-c75e99e4f984-kube-api-access-5jttb\") pod \"network-check-target-99957\" (UID: \"4b283339-40c0-40f5-b9d9-c75e99e4f984\") " pod="openshift-network-diagnostics/network-check-target-99957" Jun 08 13:43:57.039176 ip-10-0-140-46 kubenswrapper[2576]: E0608 13:43:57.039162 2576 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jun 08 13:43:57.039232 ip-10-0-140-46 kubenswrapper[2576]: E0608 13:43:57.039186 2576 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jun 08 13:43:57.039232 ip-10-0-140-46 kubenswrapper[2576]: E0608 13:43:57.039199 2576 projected.go:196] Error preparing data for projected volume kube-api-access-5jttb for pod openshift-network-diagnostics/network-check-target-99957: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 08 13:43:57.039351 ip-10-0-140-46 kubenswrapper[2576]: E0608 13:43:57.039259 2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/4b283339-40c0-40f5-b9d9-c75e99e4f984-kube-api-access-5jttb podName:4b283339-40c0-40f5-b9d9-c75e99e4f984 nodeName:}" failed. No retries permitted until 2026-06-08 13:44:01.039241761 +0000 UTC m=+9.118570636 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-api-access-5jttb" (UniqueName: "kubernetes.io/projected/4b283339-40c0-40f5-b9d9-c75e99e4f984-kube-api-access-5jttb") pod "network-check-target-99957" (UID: "4b283339-40c0-40f5-b9d9-c75e99e4f984") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 08 13:43:57.371112 ip-10-0-140-46 kubenswrapper[2576]: I0608 13:43:57.371078 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-l62qm" Jun 08 13:43:57.371289 ip-10-0-140-46 kubenswrapper[2576]: I0608 13:43:57.371120 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-99957" Jun 08 13:43:57.371289 ip-10-0-140-46 kubenswrapper[2576]: I0608 13:43:57.371078 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-dm2n6" Jun 08 13:43:57.371289 ip-10-0-140-46 kubenswrapper[2576]: E0608 13:43:57.371229 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-l62qm" podUID="52fab817-1614-450d-8ea9-d10e21821af6" Jun 08 13:43:57.371464 ip-10-0-140-46 kubenswrapper[2576]: E0608 13:43:57.371310 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-dm2n6" podUID="6da5a732-b003-412c-8308-e80cead7eb1c" Jun 08 13:43:57.371464 ip-10-0-140-46 kubenswrapper[2576]: E0608 13:43:57.371370 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-99957" podUID="4b283339-40c0-40f5-b9d9-c75e99e4f984" Jun 08 13:43:59.371111 ip-10-0-140-46 kubenswrapper[2576]: I0608 13:43:59.371073 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-dm2n6" Jun 08 13:43:59.371605 ip-10-0-140-46 kubenswrapper[2576]: E0608 13:43:59.371220 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-dm2n6" podUID="6da5a732-b003-412c-8308-e80cead7eb1c" Jun 08 13:43:59.371605 ip-10-0-140-46 kubenswrapper[2576]: I0608 13:43:59.371589 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-l62qm" Jun 08 13:43:59.371726 ip-10-0-140-46 kubenswrapper[2576]: E0608 13:43:59.371680 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-l62qm" podUID="52fab817-1614-450d-8ea9-d10e21821af6" Jun 08 13:43:59.371726 ip-10-0-140-46 kubenswrapper[2576]: I0608 13:43:59.371715 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-99957" Jun 08 13:43:59.371829 ip-10-0-140-46 kubenswrapper[2576]: E0608 13:43:59.371765 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-99957" podUID="4b283339-40c0-40f5-b9d9-c75e99e4f984" Jun 08 13:44:00.978112 ip-10-0-140-46 kubenswrapper[2576]: I0608 13:44:00.977456 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/6da5a732-b003-412c-8308-e80cead7eb1c-original-pull-secret\") pod \"global-pull-secret-syncer-dm2n6\" (UID: \"6da5a732-b003-412c-8308-e80cead7eb1c\") " pod="kube-system/global-pull-secret-syncer-dm2n6" Jun 08 13:44:00.978112 ip-10-0-140-46 kubenswrapper[2576]: I0608 13:44:00.977518 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/52fab817-1614-450d-8ea9-d10e21821af6-metrics-certs\") pod \"network-metrics-daemon-l62qm\" (UID: \"52fab817-1614-450d-8ea9-d10e21821af6\") " pod="openshift-multus/network-metrics-daemon-l62qm" Jun 08 13:44:00.978112 ip-10-0-140-46 kubenswrapper[2576]: E0608 13:44:00.977691 2576 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jun 08 13:44:00.978112 ip-10-0-140-46 kubenswrapper[2576]: E0608 13:44:00.977763 2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/52fab817-1614-450d-8ea9-d10e21821af6-metrics-certs podName:52fab817-1614-450d-8ea9-d10e21821af6 nodeName:}" failed. No retries permitted until 2026-06-08 13:44:08.977743132 +0000 UTC m=+17.057072027 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/52fab817-1614-450d-8ea9-d10e21821af6-metrics-certs") pod "network-metrics-daemon-l62qm" (UID: "52fab817-1614-450d-8ea9-d10e21821af6") : object "openshift-multus"/"metrics-daemon-secret" not registered Jun 08 13:44:00.978112 ip-10-0-140-46 kubenswrapper[2576]: E0608 13:44:00.978033 2576 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jun 08 13:44:00.978112 ip-10-0-140-46 kubenswrapper[2576]: E0608 13:44:00.978088 2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/6da5a732-b003-412c-8308-e80cead7eb1c-original-pull-secret podName:6da5a732-b003-412c-8308-e80cead7eb1c nodeName:}" failed. No retries permitted until 2026-06-08 13:44:08.978073518 +0000 UTC m=+17.057402403 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/6da5a732-b003-412c-8308-e80cead7eb1c-original-pull-secret") pod "global-pull-secret-syncer-dm2n6" (UID: "6da5a732-b003-412c-8308-e80cead7eb1c") : object "kube-system"/"original-pull-secret" not registered Jun 08 13:44:01.078391 ip-10-0-140-46 kubenswrapper[2576]: I0608 13:44:01.078268 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5jttb\" (UniqueName: \"kubernetes.io/projected/4b283339-40c0-40f5-b9d9-c75e99e4f984-kube-api-access-5jttb\") pod \"network-check-target-99957\" (UID: \"4b283339-40c0-40f5-b9d9-c75e99e4f984\") " pod="openshift-network-diagnostics/network-check-target-99957" Jun 08 13:44:01.078603 ip-10-0-140-46 kubenswrapper[2576]: E0608 13:44:01.078450 2576 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jun 08 13:44:01.078603 ip-10-0-140-46 kubenswrapper[2576]: E0608 13:44:01.078474 2576 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jun 08 13:44:01.078603 ip-10-0-140-46 kubenswrapper[2576]: E0608 13:44:01.078487 2576 projected.go:196] Error preparing data for projected volume kube-api-access-5jttb for pod openshift-network-diagnostics/network-check-target-99957: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 08 13:44:01.078603 ip-10-0-140-46 kubenswrapper[2576]: E0608 13:44:01.078544 2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/4b283339-40c0-40f5-b9d9-c75e99e4f984-kube-api-access-5jttb podName:4b283339-40c0-40f5-b9d9-c75e99e4f984 nodeName:}" failed. No retries permitted until 2026-06-08 13:44:09.078526831 +0000 UTC m=+17.157855716 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-api-access-5jttb" (UniqueName: "kubernetes.io/projected/4b283339-40c0-40f5-b9d9-c75e99e4f984-kube-api-access-5jttb") pod "network-check-target-99957" (UID: "4b283339-40c0-40f5-b9d9-c75e99e4f984") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 08 13:44:01.371096 ip-10-0-140-46 kubenswrapper[2576]: I0608 13:44:01.371051 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-dm2n6" Jun 08 13:44:01.371300 ip-10-0-140-46 kubenswrapper[2576]: E0608 13:44:01.371192 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-dm2n6" podUID="6da5a732-b003-412c-8308-e80cead7eb1c" Jun 08 13:44:01.371300 ip-10-0-140-46 kubenswrapper[2576]: I0608 13:44:01.371067 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-l62qm" Jun 08 13:44:01.371300 ip-10-0-140-46 kubenswrapper[2576]: I0608 13:44:01.371058 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-99957" Jun 08 13:44:01.371479 ip-10-0-140-46 kubenswrapper[2576]: E0608 13:44:01.371342 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-l62qm" podUID="52fab817-1614-450d-8ea9-d10e21821af6" Jun 08 13:44:01.371479 ip-10-0-140-46 kubenswrapper[2576]: E0608 13:44:01.371414 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-99957" podUID="4b283339-40c0-40f5-b9d9-c75e99e4f984" Jun 08 13:44:03.371251 ip-10-0-140-46 kubenswrapper[2576]: I0608 13:44:03.371131 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-dm2n6" Jun 08 13:44:03.371251 ip-10-0-140-46 kubenswrapper[2576]: I0608 13:44:03.371155 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-99957" Jun 08 13:44:03.371251 ip-10-0-140-46 kubenswrapper[2576]: I0608 13:44:03.371173 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-l62qm" Jun 08 13:44:03.371856 ip-10-0-140-46 kubenswrapper[2576]: E0608 13:44:03.371276 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-dm2n6" podUID="6da5a732-b003-412c-8308-e80cead7eb1c" Jun 08 13:44:03.371856 ip-10-0-140-46 kubenswrapper[2576]: E0608 13:44:03.371411 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-99957" podUID="4b283339-40c0-40f5-b9d9-c75e99e4f984" Jun 08 13:44:03.371856 ip-10-0-140-46 kubenswrapper[2576]: E0608 13:44:03.371520 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-l62qm" podUID="52fab817-1614-450d-8ea9-d10e21821af6" Jun 08 13:44:05.371061 ip-10-0-140-46 kubenswrapper[2576]: I0608 13:44:05.371024 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-l62qm" Jun 08 13:44:05.371464 ip-10-0-140-46 kubenswrapper[2576]: I0608 13:44:05.371024 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-99957" Jun 08 13:44:05.371464 ip-10-0-140-46 kubenswrapper[2576]: E0608 13:44:05.371158 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-l62qm" podUID="52fab817-1614-450d-8ea9-d10e21821af6" Jun 08 13:44:05.371464 ip-10-0-140-46 kubenswrapper[2576]: I0608 13:44:05.371033 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-dm2n6" Jun 08 13:44:05.371464 ip-10-0-140-46 kubenswrapper[2576]: E0608 13:44:05.371202 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-99957" podUID="4b283339-40c0-40f5-b9d9-c75e99e4f984" Jun 08 13:44:05.371464 ip-10-0-140-46 kubenswrapper[2576]: E0608 13:44:05.371283 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-dm2n6" podUID="6da5a732-b003-412c-8308-e80cead7eb1c" Jun 08 13:44:07.371670 ip-10-0-140-46 kubenswrapper[2576]: I0608 13:44:07.371632 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-dm2n6" Jun 08 13:44:07.372237 ip-10-0-140-46 kubenswrapper[2576]: I0608 13:44:07.371640 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-l62qm" Jun 08 13:44:07.372237 ip-10-0-140-46 kubenswrapper[2576]: E0608 13:44:07.371766 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-dm2n6" podUID="6da5a732-b003-412c-8308-e80cead7eb1c" Jun 08 13:44:07.372237 ip-10-0-140-46 kubenswrapper[2576]: I0608 13:44:07.371640 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-99957" Jun 08 13:44:07.372237 ip-10-0-140-46 kubenswrapper[2576]: E0608 13:44:07.371843 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-l62qm" podUID="52fab817-1614-450d-8ea9-d10e21821af6" Jun 08 13:44:07.372237 ip-10-0-140-46 kubenswrapper[2576]: E0608 13:44:07.371898 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-99957" podUID="4b283339-40c0-40f5-b9d9-c75e99e4f984" Jun 08 13:44:09.039826 ip-10-0-140-46 kubenswrapper[2576]: I0608 13:44:09.039786 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/6da5a732-b003-412c-8308-e80cead7eb1c-original-pull-secret\") pod \"global-pull-secret-syncer-dm2n6\" (UID: \"6da5a732-b003-412c-8308-e80cead7eb1c\") " pod="kube-system/global-pull-secret-syncer-dm2n6" Jun 08 13:44:09.040251 ip-10-0-140-46 kubenswrapper[2576]: I0608 13:44:09.039854 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/52fab817-1614-450d-8ea9-d10e21821af6-metrics-certs\") pod \"network-metrics-daemon-l62qm\" (UID: \"52fab817-1614-450d-8ea9-d10e21821af6\") " pod="openshift-multus/network-metrics-daemon-l62qm" Jun 08 13:44:09.040251 ip-10-0-140-46 kubenswrapper[2576]: E0608 13:44:09.039915 2576 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jun 08 13:44:09.040251 ip-10-0-140-46 kubenswrapper[2576]: E0608 13:44:09.040001 2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/6da5a732-b003-412c-8308-e80cead7eb1c-original-pull-secret podName:6da5a732-b003-412c-8308-e80cead7eb1c nodeName:}" failed. No retries permitted until 2026-06-08 13:44:25.039981521 +0000 UTC m=+33.119310404 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/6da5a732-b003-412c-8308-e80cead7eb1c-original-pull-secret") pod "global-pull-secret-syncer-dm2n6" (UID: "6da5a732-b003-412c-8308-e80cead7eb1c") : object "kube-system"/"original-pull-secret" not registered Jun 08 13:44:09.040251 ip-10-0-140-46 kubenswrapper[2576]: E0608 13:44:09.040009 2576 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jun 08 13:44:09.040251 ip-10-0-140-46 kubenswrapper[2576]: E0608 13:44:09.040063 2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/52fab817-1614-450d-8ea9-d10e21821af6-metrics-certs podName:52fab817-1614-450d-8ea9-d10e21821af6 nodeName:}" failed. No retries permitted until 2026-06-08 13:44:25.040044634 +0000 UTC m=+33.119373513 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/52fab817-1614-450d-8ea9-d10e21821af6-metrics-certs") pod "network-metrics-daemon-l62qm" (UID: "52fab817-1614-450d-8ea9-d10e21821af6") : object "openshift-multus"/"metrics-daemon-secret" not registered Jun 08 13:44:09.140500 ip-10-0-140-46 kubenswrapper[2576]: I0608 13:44:09.140465 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5jttb\" (UniqueName: \"kubernetes.io/projected/4b283339-40c0-40f5-b9d9-c75e99e4f984-kube-api-access-5jttb\") pod \"network-check-target-99957\" (UID: \"4b283339-40c0-40f5-b9d9-c75e99e4f984\") " pod="openshift-network-diagnostics/network-check-target-99957" Jun 08 13:44:09.140719 ip-10-0-140-46 kubenswrapper[2576]: E0608 13:44:09.140655 2576 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jun 08 13:44:09.140719 ip-10-0-140-46 kubenswrapper[2576]: E0608 13:44:09.140674 2576 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jun 08 13:44:09.140719 ip-10-0-140-46 kubenswrapper[2576]: E0608 13:44:09.140686 2576 projected.go:196] Error preparing data for projected volume kube-api-access-5jttb for pod openshift-network-diagnostics/network-check-target-99957: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 08 13:44:09.140880 ip-10-0-140-46 kubenswrapper[2576]: E0608 13:44:09.140749 2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/4b283339-40c0-40f5-b9d9-c75e99e4f984-kube-api-access-5jttb podName:4b283339-40c0-40f5-b9d9-c75e99e4f984 nodeName:}" failed. No retries permitted until 2026-06-08 13:44:25.140730658 +0000 UTC m=+33.220059549 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "kube-api-access-5jttb" (UniqueName: "kubernetes.io/projected/4b283339-40c0-40f5-b9d9-c75e99e4f984-kube-api-access-5jttb") pod "network-check-target-99957" (UID: "4b283339-40c0-40f5-b9d9-c75e99e4f984") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 08 13:44:09.370976 ip-10-0-140-46 kubenswrapper[2576]: I0608 13:44:09.370895 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-dm2n6" Jun 08 13:44:09.371173 ip-10-0-140-46 kubenswrapper[2576]: I0608 13:44:09.371013 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-l62qm" Jun 08 13:44:09.371173 ip-10-0-140-46 kubenswrapper[2576]: E0608 13:44:09.371025 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-dm2n6" podUID="6da5a732-b003-412c-8308-e80cead7eb1c" Jun 08 13:44:09.371173 ip-10-0-140-46 kubenswrapper[2576]: E0608 13:44:09.371139 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-l62qm" podUID="52fab817-1614-450d-8ea9-d10e21821af6" Jun 08 13:44:09.371332 ip-10-0-140-46 kubenswrapper[2576]: I0608 13:44:09.371207 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-99957" Jun 08 13:44:09.371332 ip-10-0-140-46 kubenswrapper[2576]: E0608 13:44:09.371278 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-99957" podUID="4b283339-40c0-40f5-b9d9-c75e99e4f984" Jun 08 13:44:11.371113 ip-10-0-140-46 kubenswrapper[2576]: I0608 13:44:11.371052 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-dm2n6" Jun 08 13:44:11.371600 ip-10-0-140-46 kubenswrapper[2576]: I0608 13:44:11.371067 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-99957" Jun 08 13:44:11.371600 ip-10-0-140-46 kubenswrapper[2576]: E0608 13:44:11.371192 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-dm2n6" podUID="6da5a732-b003-412c-8308-e80cead7eb1c" Jun 08 13:44:11.371600 ip-10-0-140-46 kubenswrapper[2576]: E0608 13:44:11.371305 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-99957" podUID="4b283339-40c0-40f5-b9d9-c75e99e4f984" Jun 08 13:44:11.371600 ip-10-0-140-46 kubenswrapper[2576]: I0608 13:44:11.371067 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-l62qm" Jun 08 13:44:11.371600 ip-10-0-140-46 kubenswrapper[2576]: E0608 13:44:11.371422 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-l62qm" podUID="52fab817-1614-450d-8ea9-d10e21821af6" Jun 08 13:44:13.371208 ip-10-0-140-46 kubenswrapper[2576]: I0608 13:44:13.371176 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-99957" Jun 08 13:44:13.371500 ip-10-0-140-46 kubenswrapper[2576]: I0608 13:44:13.371215 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-dm2n6" Jun 08 13:44:13.371500 ip-10-0-140-46 kubenswrapper[2576]: I0608 13:44:13.371175 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-l62qm" Jun 08 13:44:13.371500 ip-10-0-140-46 kubenswrapper[2576]: E0608 13:44:13.371288 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-99957" podUID="4b283339-40c0-40f5-b9d9-c75e99e4f984" Jun 08 13:44:13.371500 ip-10-0-140-46 kubenswrapper[2576]: E0608 13:44:13.371369 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-l62qm" podUID="52fab817-1614-450d-8ea9-d10e21821af6" Jun 08 13:44:13.371500 ip-10-0-140-46 kubenswrapper[2576]: E0608 13:44:13.371424 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-dm2n6" podUID="6da5a732-b003-412c-8308-e80cead7eb1c" Jun 08 13:44:14.534482 ip-10-0-140-46 kubenswrapper[2576]: I0608 13:44:14.534151 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-140-46.ec2.internal" event={"ID":"9611281d5444879f19610790e9303c49","Type":"ContainerStarted","Data":"f82b861062676b819fac42147089a6268ef90401fc59655dde379a72069f69a0"} Jun 08 13:44:14.536071 ip-10-0-140-46 kubenswrapper[2576]: I0608 13:44:14.536051 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-ncffd_c26912ca-10b4-4ae3-b306-890f93abfee3/ovn-acl-logging/0.log" Jun 08 13:44:14.536454 ip-10-0-140-46 kubenswrapper[2576]: I0608 13:44:14.536432 2576 generic.go:356] "Generic (PLEG): container finished" podID="c26912ca-10b4-4ae3-b306-890f93abfee3" containerID="ca2a5950a9872da6601c1b4eab5e224b521c3b932c8acb948738371a08aa2f62" exitCode=1 Jun 08 13:44:14.536553 ip-10-0-140-46 kubenswrapper[2576]: I0608 13:44:14.536506 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-ncffd" event={"ID":"c26912ca-10b4-4ae3-b306-890f93abfee3","Type":"ContainerStarted","Data":"cace999baed6698abd6e38a4578e39501bd0115db6eabd6f4638c12fd86cab77"} Jun 08 13:44:14.536650 ip-10-0-140-46 kubenswrapper[2576]: I0608 13:44:14.536586 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-ncffd" event={"ID":"c26912ca-10b4-4ae3-b306-890f93abfee3","Type":"ContainerStarted","Data":"b5d32d9ccc24b9a6742eea4e1466d13ddab1bb31e1b041f2d359dd9493dae2cf"} Jun 08 13:44:14.536650 ip-10-0-140-46 kubenswrapper[2576]: I0608 13:44:14.536633 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-ncffd" event={"ID":"c26912ca-10b4-4ae3-b306-890f93abfee3","Type":"ContainerDied","Data":"ca2a5950a9872da6601c1b4eab5e224b521c3b932c8acb948738371a08aa2f62"} Jun 08 13:44:14.536721 ip-10-0-140-46 kubenswrapper[2576]: I0608 13:44:14.536676 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-ncffd" event={"ID":"c26912ca-10b4-4ae3-b306-890f93abfee3","Type":"ContainerStarted","Data":"8b34d4f8a98af43d287e9e71e92ab0e0805ee162de67694dde2b3528af59f8fd"} Jun 08 13:44:14.540461 ip-10-0-140-46 kubenswrapper[2576]: I0608 13:44:14.540442 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-fd4mq" event={"ID":"f2c67e68-042b-487a-bafa-a22aa9bd82df","Type":"ContainerStarted","Data":"8be9d7518498bb1b42e1c4fb34b5ef41ebe4106bed902127b85789622e3bc9d2"} Jun 08 13:44:14.541771 ip-10-0-140-46 kubenswrapper[2576]: I0608 13:44:14.541746 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-jxwb8" event={"ID":"899b8b33-b573-4d67-ae45-773ec4b36e28","Type":"ContainerStarted","Data":"88e8c36d252ebb70c71c739a53d4ae5bef85ef191d242be85f196949e2539b88"} Jun 08 13:44:14.615710 ip-10-0-140-46 kubenswrapper[2576]: I0608 13:44:14.615667 2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-fd4mq" podStartSLOduration=2.6957889550000003 podStartE2EDuration="22.615652344s" totalImagesPullingTime="19.919863389s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-08 13:43:52 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-08 13:44:14.614427608 +0000 UTC m=+22.693756500" watchObservedRunningTime="2026-06-08 13:44:14.615652344 +0000 UTC m=+22.694981235" Jun 08 13:44:14.724265 ip-10-0-140-46 kubenswrapper[2576]: I0608 13:44:14.724219 2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-node-tuning-operator/tuned-jxwb8" podStartSLOduration=2.810861901 podStartE2EDuration="22.72420271s" totalImagesPullingTime="19.913340809s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-08 13:43:52 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-08 13:44:14.723830053 +0000 UTC m=+22.803158946" watchObservedRunningTime="2026-06-08 13:44:14.72420271 +0000 UTC m=+22.803531627" Jun 08 13:44:14.750233 ip-10-0-140-46 kubenswrapper[2576]: I0608 13:44:14.748429 2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/kube-apiserver-proxy-ip-10-0-140-46.ec2.internal" podStartSLOduration=21.748408863999998 podStartE2EDuration="21.748408864s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-08 13:43:53 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-08 13:44:14.747805938 +0000 UTC m=+22.827134831" watchObservedRunningTime="2026-06-08 13:44:14.748408864 +0000 UTC m=+22.827737757" Jun 08 13:44:15.371405 ip-10-0-140-46 kubenswrapper[2576]: I0608 13:44:15.371374 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-dm2n6" Jun 08 13:44:15.371654 ip-10-0-140-46 kubenswrapper[2576]: I0608 13:44:15.371491 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-l62qm" Jun 08 13:44:15.371654 ip-10-0-140-46 kubenswrapper[2576]: I0608 13:44:15.371503 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-99957" Jun 08 13:44:15.371654 ip-10-0-140-46 kubenswrapper[2576]: E0608 13:44:15.371502 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-dm2n6" podUID="6da5a732-b003-412c-8308-e80cead7eb1c" Jun 08 13:44:15.371654 ip-10-0-140-46 kubenswrapper[2576]: E0608 13:44:15.371623 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-l62qm" podUID="52fab817-1614-450d-8ea9-d10e21821af6" Jun 08 13:44:15.371837 ip-10-0-140-46 kubenswrapper[2576]: E0608 13:44:15.371697 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-99957" podUID="4b283339-40c0-40f5-b9d9-c75e99e4f984" Jun 08 13:44:15.544969 ip-10-0-140-46 kubenswrapper[2576]: I0608 13:44:15.544936 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-p78hl" event={"ID":"3c9ae33a-4be0-4494-ae7d-b24b4421ae27","Type":"ContainerStarted","Data":"3ad3529263766bede66d5f18a56d347ca2c584a67d2866d83588d7c18cd7751f"} Jun 08 13:44:15.546377 ip-10-0-140-46 kubenswrapper[2576]: I0608 13:44:15.546346 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-cx7sn" event={"ID":"6e4b50fc-3e91-4f50-b92a-e90919788248","Type":"ContainerStarted","Data":"37428ddad5aab0b6e5dd770b441cf06ed0ca812efeae563a4fbea068c17df6ba"} Jun 08 13:44:15.548935 ip-10-0-140-46 kubenswrapper[2576]: I0608 13:44:15.548916 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-ncffd_c26912ca-10b4-4ae3-b306-890f93abfee3/ovn-acl-logging/0.log" Jun 08 13:44:15.549246 ip-10-0-140-46 kubenswrapper[2576]: I0608 13:44:15.549229 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-ncffd" event={"ID":"c26912ca-10b4-4ae3-b306-890f93abfee3","Type":"ContainerStarted","Data":"4e4783395dc88208906b285afed0cefd1a804720c93e56f82dad8fe737ebc3c5"} Jun 08 13:44:15.549304 ip-10-0-140-46 kubenswrapper[2576]: I0608 13:44:15.549293 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-ncffd" event={"ID":"c26912ca-10b4-4ae3-b306-890f93abfee3","Type":"ContainerStarted","Data":"7cd3db8e4704866a6177c92f5c0c19e336f929bb51e232dae02b24131495719d"} Jun 08 13:44:15.550529 ip-10-0-140-46 kubenswrapper[2576]: I0608 13:44:15.550508 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-7zkgm" event={"ID":"ef6c467c-acc8-428e-950f-e0d25491f708","Type":"ContainerStarted","Data":"542b3f3fc29585594d2ad87e571ea14a7ed6d6d2ad4ca5dab9e63791bb5fb5dd"} Jun 08 13:44:15.551820 ip-10-0-140-46 kubenswrapper[2576]: I0608 13:44:15.551798 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-gcmjl" event={"ID":"8e1453fa-6b1d-4b93-98cf-5fe4d2829935","Type":"ContainerStarted","Data":"43339e8badaba98e45a3f549e41cdc301a2047a3840ef5f01c9951bb038d8be7"} Jun 08 13:44:15.553016 ip-10-0-140-46 kubenswrapper[2576]: I0608 13:44:15.552999 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-f25db" event={"ID":"2cf3d8d4-e8f9-402e-9fa7-b564c4ea705c","Type":"ContainerStarted","Data":"93593192dc090c4ab404189c008246cfed7024d7105b3a0cc5e9732080fd4219"} Jun 08 13:44:15.554343 ip-10-0-140-46 kubenswrapper[2576]: I0608 13:44:15.554323 2576 generic.go:356] "Generic (PLEG): container finished" podID="18b84a5c-7b8b-4e1b-a70a-4fbda39064bf" containerID="ae8038bb4a3e37f20bceb7be9d98a6ff6211ca0926de86fb62bab9383bf8d4e0" exitCode=0 Jun 08 13:44:15.554419 ip-10-0-140-46 kubenswrapper[2576]: I0608 13:44:15.554383 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-pxbdv" event={"ID":"18b84a5c-7b8b-4e1b-a70a-4fbda39064bf","Type":"ContainerDied","Data":"ae8038bb4a3e37f20bceb7be9d98a6ff6211ca0926de86fb62bab9383bf8d4e0"} Jun 08 13:44:15.555912 ip-10-0-140-46 kubenswrapper[2576]: I0608 13:44:15.555890 2576 generic.go:356] "Generic (PLEG): container finished" podID="2c0edf5a3fd2add71c45634ad4d02cef" containerID="e8bc4f75502e709305aa345d1327e7fdd899563698a504c9977be96d3fb6f425" exitCode=0 Jun 08 13:44:15.555979 ip-10-0-140-46 kubenswrapper[2576]: I0608 13:44:15.555926 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-140-46.ec2.internal" event={"ID":"2c0edf5a3fd2add71c45634ad4d02cef","Type":"ContainerDied","Data":"e8bc4f75502e709305aa345d1327e7fdd899563698a504c9977be96d3fb6f425"} Jun 08 13:44:15.556062 ip-10-0-140-46 kubenswrapper[2576]: I0608 13:44:15.556048 2576 kubelet.go:3248] "Creating a mirror pod for static pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-140-46.ec2.internal" Jun 08 13:44:15.586329 ip-10-0-140-46 kubenswrapper[2576]: I0608 13:44:15.586300 2576 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]" Jun 08 13:44:15.586857 ip-10-0-140-46 kubenswrapper[2576]: I0608 13:44:15.586807 2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/konnectivity-agent-cx7sn" podStartSLOduration=3.742101003 podStartE2EDuration="23.586788755s" totalImagesPullingTime="19.844687752s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-08 13:43:52 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-08 13:44:15.585040256 +0000 UTC m=+23.664369148" watchObservedRunningTime="2026-06-08 13:44:15.586788755 +0000 UTC m=+23.666117648" Jun 08 13:44:15.587208 ip-10-0-140-46 kubenswrapper[2576]: I0608 13:44:15.587188 2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-140-46.ec2.internal"] Jun 08 13:44:15.611804 ip-10-0-140-46 kubenswrapper[2576]: I0608 13:44:15.611743 2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-operator/iptables-alerter-7zkgm" podStartSLOduration=3.714259496 podStartE2EDuration="23.611726204s" totalImagesPullingTime="19.897466708s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-08 13:43:52 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-08 13:44:15.609499861 +0000 UTC m=+23.688828752" watchObservedRunningTime="2026-06-08 13:44:15.611726204 +0000 UTC m=+23.691055095" Jun 08 13:44:15.701535 ip-10-0-140-46 kubenswrapper[2576]: I0608 13:44:15.701432 2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/node-ca-gcmjl" podStartSLOduration=3.827597096 podStartE2EDuration="23.701414692s" totalImagesPullingTime="19.873817596s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-08 13:43:52 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-08 13:44:15.700210542 +0000 UTC m=+23.779539435" watchObservedRunningTime="2026-06-08 13:44:15.701414692 +0000 UTC m=+23.780743591" Jun 08 13:44:16.091270 ip-10-0-140-46 kubenswrapper[2576]: I0608 13:44:16.091239 2576 plugin_watcher.go:194] "Adding socket path or updating timestamp to desired state cache" path="/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock" Jun 08 13:44:16.372432 ip-10-0-140-46 kubenswrapper[2576]: I0608 13:44:16.372311 2576 reconciler.go:161] "OperationExecutor.RegisterPlugin started" plugin={"SocketPath":"/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock","Timestamp":"2026-06-08T13:44:16.091265301Z","UUID":"691de22c-afc5-44f1-a3d8-cde3eaa8aba0","Handler":null,"Name":"","Endpoint":""} Jun 08 13:44:16.374116 ip-10-0-140-46 kubenswrapper[2576]: I0608 13:44:16.374093 2576 csi_plugin.go:106] kubernetes.io/csi: Trying to validate a new CSI Driver with name: ebs.csi.aws.com endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock versions: 1.0.0 Jun 08 13:44:16.374239 ip-10-0-140-46 kubenswrapper[2576]: I0608 13:44:16.374137 2576 csi_plugin.go:119] kubernetes.io/csi: Register new plugin with name: ebs.csi.aws.com at endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock Jun 08 13:44:16.561177 ip-10-0-140-46 kubenswrapper[2576]: I0608 13:44:16.561140 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-140-46.ec2.internal" event={"ID":"2c0edf5a3fd2add71c45634ad4d02cef","Type":"ContainerStarted","Data":"c9c00f96ce7257b84f8219d617803df932badf4aa746e3f6f4f3a19e45f74185"} Jun 08 13:44:16.563662 ip-10-0-140-46 kubenswrapper[2576]: I0608 13:44:16.563629 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-p78hl" event={"ID":"3c9ae33a-4be0-4494-ae7d-b24b4421ae27","Type":"ContainerStarted","Data":"74f35040d8cbdbfdb6a8b5875f9df34151b65f1f788e16abf9210b0fe68cdfb4"} Jun 08 13:44:16.609932 ip-10-0-140-46 kubenswrapper[2576]: I0608 13:44:16.609881 2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/node-resolver-f25db" podStartSLOduration=4.731550499 podStartE2EDuration="24.609861071s" totalImagesPullingTime="19.878310572s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-08 13:43:52 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-08 13:44:15.792507509 +0000 UTC m=+23.871836400" watchObservedRunningTime="2026-06-08 13:44:16.609861071 +0000 UTC m=+24.689189966" Jun 08 13:44:17.371145 ip-10-0-140-46 kubenswrapper[2576]: I0608 13:44:17.370871 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-99957" Jun 08 13:44:17.371307 ip-10-0-140-46 kubenswrapper[2576]: I0608 13:44:17.370871 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-dm2n6" Jun 08 13:44:17.371307 ip-10-0-140-46 kubenswrapper[2576]: E0608 13:44:17.371198 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-99957" podUID="4b283339-40c0-40f5-b9d9-c75e99e4f984" Jun 08 13:44:17.371307 ip-10-0-140-46 kubenswrapper[2576]: I0608 13:44:17.370877 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-l62qm" Jun 08 13:44:17.371464 ip-10-0-140-46 kubenswrapper[2576]: E0608 13:44:17.371303 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-dm2n6" podUID="6da5a732-b003-412c-8308-e80cead7eb1c" Jun 08 13:44:17.371464 ip-10-0-140-46 kubenswrapper[2576]: E0608 13:44:17.371363 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-l62qm" podUID="52fab817-1614-450d-8ea9-d10e21821af6" Jun 08 13:44:17.568905 ip-10-0-140-46 kubenswrapper[2576]: I0608 13:44:17.568858 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-p78hl" event={"ID":"3c9ae33a-4be0-4494-ae7d-b24b4421ae27","Type":"ContainerStarted","Data":"3f4f8da8c53ca573c1cfd7815ec4ec29fb297ba8f04be06702fb3ade75aebaea"} Jun 08 13:44:17.572577 ip-10-0-140-46 kubenswrapper[2576]: I0608 13:44:17.572539 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-ncffd_c26912ca-10b4-4ae3-b306-890f93abfee3/ovn-acl-logging/0.log" Jun 08 13:44:17.573017 ip-10-0-140-46 kubenswrapper[2576]: I0608 13:44:17.572982 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-ncffd" event={"ID":"c26912ca-10b4-4ae3-b306-890f93abfee3","Type":"ContainerStarted","Data":"c7afe8b540c6481aadc33302364c6ef06be7c177395cac43937ec842f2b9dbba"} Jun 08 13:44:17.691468 ip-10-0-140-46 kubenswrapper[2576]: I0608 13:44:17.691361 2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-p78hl" podStartSLOduration=3.912576935 podStartE2EDuration="25.691337941s" totalImagesPullingTime="21.778761006s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-08 13:43:52 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-08 13:44:17.690218185 +0000 UTC m=+25.769547090" watchObservedRunningTime="2026-06-08 13:44:17.691337941 +0000 UTC m=+25.770666833" Jun 08 13:44:17.691739 ip-10-0-140-46 kubenswrapper[2576]: I0608 13:44:17.691711 2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-140-46.ec2.internal" podStartSLOduration=2.69170294 podStartE2EDuration="2.69170294s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-08 13:44:15 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-08 13:44:16.632907994 +0000 UTC m=+24.712236886" watchObservedRunningTime="2026-06-08 13:44:17.69170294 +0000 UTC m=+25.771031833" Jun 08 13:44:17.865246 ip-10-0-140-46 kubenswrapper[2576]: I0608 13:44:17.865207 2576 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="kube-system/konnectivity-agent-cx7sn" Jun 08 13:44:17.865827 ip-10-0-140-46 kubenswrapper[2576]: I0608 13:44:17.865808 2576 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="kube-system/konnectivity-agent-cx7sn" Jun 08 13:44:19.371806 ip-10-0-140-46 kubenswrapper[2576]: I0608 13:44:19.371720 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-dm2n6" Jun 08 13:44:19.371806 ip-10-0-140-46 kubenswrapper[2576]: I0608 13:44:19.371751 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-l62qm" Jun 08 13:44:19.371806 ip-10-0-140-46 kubenswrapper[2576]: I0608 13:44:19.371763 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-99957" Jun 08 13:44:19.372349 ip-10-0-140-46 kubenswrapper[2576]: E0608 13:44:19.371860 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-dm2n6" podUID="6da5a732-b003-412c-8308-e80cead7eb1c" Jun 08 13:44:19.372349 ip-10-0-140-46 kubenswrapper[2576]: E0608 13:44:19.371988 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-l62qm" podUID="52fab817-1614-450d-8ea9-d10e21821af6" Jun 08 13:44:19.372349 ip-10-0-140-46 kubenswrapper[2576]: E0608 13:44:19.372064 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-99957" podUID="4b283339-40c0-40f5-b9d9-c75e99e4f984" Jun 08 13:44:20.583069 ip-10-0-140-46 kubenswrapper[2576]: I0608 13:44:20.582874 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-ncffd_c26912ca-10b4-4ae3-b306-890f93abfee3/ovn-acl-logging/0.log" Jun 08 13:44:20.583559 ip-10-0-140-46 kubenswrapper[2576]: I0608 13:44:20.583413 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-ncffd" event={"ID":"c26912ca-10b4-4ae3-b306-890f93abfee3","Type":"ContainerStarted","Data":"e5a44db0ca62003cd295213235142329990c81535201753a873d3b00cf20d4ad"} Jun 08 13:44:20.583762 ip-10-0-140-46 kubenswrapper[2576]: I0608 13:44:20.583688 2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-ncffd" Jun 08 13:44:20.583762 ip-10-0-140-46 kubenswrapper[2576]: I0608 13:44:20.583755 2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-ncffd" Jun 08 13:44:20.583975 ip-10-0-140-46 kubenswrapper[2576]: I0608 13:44:20.583955 2576 scope.go:117] "RemoveContainer" containerID="ca2a5950a9872da6601c1b4eab5e224b521c3b932c8acb948738371a08aa2f62" Jun 08 13:44:20.585455 ip-10-0-140-46 kubenswrapper[2576]: I0608 13:44:20.585431 2576 generic.go:356] "Generic (PLEG): container finished" podID="18b84a5c-7b8b-4e1b-a70a-4fbda39064bf" containerID="57c43c0a55e2e66db4b9716f8d86f61853acd942e0a2d0ec7bbc0ba197e92c70" exitCode=0 Jun 08 13:44:20.585545 ip-10-0-140-46 kubenswrapper[2576]: I0608 13:44:20.585460 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-pxbdv" event={"ID":"18b84a5c-7b8b-4e1b-a70a-4fbda39064bf","Type":"ContainerDied","Data":"57c43c0a55e2e66db4b9716f8d86f61853acd942e0a2d0ec7bbc0ba197e92c70"} Jun 08 13:44:20.601798 ip-10-0-140-46 kubenswrapper[2576]: I0608 13:44:20.601775 2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-ncffd" Jun 08 13:44:21.371212 ip-10-0-140-46 kubenswrapper[2576]: I0608 13:44:21.371177 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-99957" Jun 08 13:44:21.371212 ip-10-0-140-46 kubenswrapper[2576]: I0608 13:44:21.371214 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-dm2n6" Jun 08 13:44:21.371469 ip-10-0-140-46 kubenswrapper[2576]: I0608 13:44:21.371265 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-l62qm" Jun 08 13:44:21.371469 ip-10-0-140-46 kubenswrapper[2576]: E0608 13:44:21.371280 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-99957" podUID="4b283339-40c0-40f5-b9d9-c75e99e4f984" Jun 08 13:44:21.371469 ip-10-0-140-46 kubenswrapper[2576]: E0608 13:44:21.371338 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-l62qm" podUID="52fab817-1614-450d-8ea9-d10e21821af6" Jun 08 13:44:21.371469 ip-10-0-140-46 kubenswrapper[2576]: E0608 13:44:21.371383 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-dm2n6" podUID="6da5a732-b003-412c-8308-e80cead7eb1c" Jun 08 13:44:21.591019 ip-10-0-140-46 kubenswrapper[2576]: I0608 13:44:21.590996 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-ncffd_c26912ca-10b4-4ae3-b306-890f93abfee3/ovn-acl-logging/0.log" Jun 08 13:44:21.591349 ip-10-0-140-46 kubenswrapper[2576]: I0608 13:44:21.591280 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-ncffd" event={"ID":"c26912ca-10b4-4ae3-b306-890f93abfee3","Type":"ContainerStarted","Data":"a45b7f1db7b1a54f8f6cf4d70f3d78becde40accfb365f7aec673560c3a11523"} Jun 08 13:44:21.592867 ip-10-0-140-46 kubenswrapper[2576]: I0608 13:44:21.592525 2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-ncffd" Jun 08 13:44:21.610824 ip-10-0-140-46 kubenswrapper[2576]: I0608 13:44:21.610794 2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-ncffd" Jun 08 13:44:21.706441 ip-10-0-140-46 kubenswrapper[2576]: I0608 13:44:21.706396 2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ovn-kubernetes/ovnkube-node-ncffd" podStartSLOduration=9.234792622 podStartE2EDuration="29.70638246s" totalImagesPullingTime="20.471589838s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-08 13:43:52 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-08 13:44:21.648112959 +0000 UTC m=+29.727441851" watchObservedRunningTime="2026-06-08 13:44:21.70638246 +0000 UTC m=+29.785711352" Jun 08 13:44:22.336287 ip-10-0-140-46 kubenswrapper[2576]: I0608 13:44:22.336105 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-99957"] Jun 08 13:44:22.336453 ip-10-0-140-46 kubenswrapper[2576]: I0608 13:44:22.336357 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-99957" Jun 08 13:44:22.336453 ip-10-0-140-46 kubenswrapper[2576]: E0608 13:44:22.336441 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-99957" podUID="4b283339-40c0-40f5-b9d9-c75e99e4f984" Jun 08 13:44:22.340407 ip-10-0-140-46 kubenswrapper[2576]: I0608 13:44:22.340384 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-l62qm"] Jun 08 13:44:22.340524 ip-10-0-140-46 kubenswrapper[2576]: I0608 13:44:22.340484 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-l62qm" Jun 08 13:44:22.340634 ip-10-0-140-46 kubenswrapper[2576]: E0608 13:44:22.340613 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-l62qm" podUID="52fab817-1614-450d-8ea9-d10e21821af6" Jun 08 13:44:22.341059 ip-10-0-140-46 kubenswrapper[2576]: I0608 13:44:22.341043 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-dm2n6"] Jun 08 13:44:22.341117 ip-10-0-140-46 kubenswrapper[2576]: I0608 13:44:22.341108 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-dm2n6" Jun 08 13:44:22.341185 ip-10-0-140-46 kubenswrapper[2576]: E0608 13:44:22.341171 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-dm2n6" podUID="6da5a732-b003-412c-8308-e80cead7eb1c" Jun 08 13:44:22.597937 ip-10-0-140-46 kubenswrapper[2576]: I0608 13:44:22.597903 2576 generic.go:356] "Generic (PLEG): container finished" podID="18b84a5c-7b8b-4e1b-a70a-4fbda39064bf" containerID="e3dbb34c051f76e22913ca0843c672ef2c3f8a44d1dec6e379b74c8077dfe5ba" exitCode=0 Jun 08 13:44:22.598337 ip-10-0-140-46 kubenswrapper[2576]: I0608 13:44:22.597993 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-pxbdv" event={"ID":"18b84a5c-7b8b-4e1b-a70a-4fbda39064bf","Type":"ContainerDied","Data":"e3dbb34c051f76e22913ca0843c672ef2c3f8a44d1dec6e379b74c8077dfe5ba"} Jun 08 13:44:22.733346 ip-10-0-140-46 kubenswrapper[2576]: I0608 13:44:22.733310 2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kube-system/konnectivity-agent-cx7sn" Jun 08 13:44:22.733529 ip-10-0-140-46 kubenswrapper[2576]: I0608 13:44:22.733451 2576 prober_manager.go:312] "Failed to trigger a manual run" probe="Readiness" Jun 08 13:44:22.733942 ip-10-0-140-46 kubenswrapper[2576]: I0608 13:44:22.733925 2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kube-system/konnectivity-agent-cx7sn" Jun 08 13:44:24.371095 ip-10-0-140-46 kubenswrapper[2576]: I0608 13:44:24.371057 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-dm2n6" Jun 08 13:44:24.371095 ip-10-0-140-46 kubenswrapper[2576]: I0608 13:44:24.371081 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-l62qm" Jun 08 13:44:24.372014 ip-10-0-140-46 kubenswrapper[2576]: I0608 13:44:24.371065 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-99957" Jun 08 13:44:24.372014 ip-10-0-140-46 kubenswrapper[2576]: E0608 13:44:24.371183 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-dm2n6" podUID="6da5a732-b003-412c-8308-e80cead7eb1c" Jun 08 13:44:24.372014 ip-10-0-140-46 kubenswrapper[2576]: E0608 13:44:24.371307 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-l62qm" podUID="52fab817-1614-450d-8ea9-d10e21821af6" Jun 08 13:44:24.372014 ip-10-0-140-46 kubenswrapper[2576]: E0608 13:44:24.371374 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-99957" podUID="4b283339-40c0-40f5-b9d9-c75e99e4f984" Jun 08 13:44:24.604880 ip-10-0-140-46 kubenswrapper[2576]: I0608 13:44:24.604844 2576 generic.go:356] "Generic (PLEG): container finished" podID="18b84a5c-7b8b-4e1b-a70a-4fbda39064bf" containerID="75b39454559aaba0c82248ea90007e32199966d2bce2a3491504d88bd8b08608" exitCode=0 Jun 08 13:44:24.605064 ip-10-0-140-46 kubenswrapper[2576]: I0608 13:44:24.604904 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-pxbdv" event={"ID":"18b84a5c-7b8b-4e1b-a70a-4fbda39064bf","Type":"ContainerDied","Data":"75b39454559aaba0c82248ea90007e32199966d2bce2a3491504d88bd8b08608"} Jun 08 13:44:25.057064 ip-10-0-140-46 kubenswrapper[2576]: I0608 13:44:25.057027 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/6da5a732-b003-412c-8308-e80cead7eb1c-original-pull-secret\") pod \"global-pull-secret-syncer-dm2n6\" (UID: \"6da5a732-b003-412c-8308-e80cead7eb1c\") " pod="kube-system/global-pull-secret-syncer-dm2n6" Jun 08 13:44:25.057233 ip-10-0-140-46 kubenswrapper[2576]: I0608 13:44:25.057081 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/52fab817-1614-450d-8ea9-d10e21821af6-metrics-certs\") pod \"network-metrics-daemon-l62qm\" (UID: \"52fab817-1614-450d-8ea9-d10e21821af6\") " pod="openshift-multus/network-metrics-daemon-l62qm" Jun 08 13:44:25.057233 ip-10-0-140-46 kubenswrapper[2576]: E0608 13:44:25.057191 2576 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jun 08 13:44:25.057332 ip-10-0-140-46 kubenswrapper[2576]: E0608 13:44:25.057255 2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/52fab817-1614-450d-8ea9-d10e21821af6-metrics-certs podName:52fab817-1614-450d-8ea9-d10e21821af6 nodeName:}" failed. No retries permitted until 2026-06-08 13:44:57.05723609 +0000 UTC m=+65.136564962 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/52fab817-1614-450d-8ea9-d10e21821af6-metrics-certs") pod "network-metrics-daemon-l62qm" (UID: "52fab817-1614-450d-8ea9-d10e21821af6") : object "openshift-multus"/"metrics-daemon-secret" not registered Jun 08 13:44:25.057332 ip-10-0-140-46 kubenswrapper[2576]: E0608 13:44:25.057191 2576 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jun 08 13:44:25.057449 ip-10-0-140-46 kubenswrapper[2576]: E0608 13:44:25.057367 2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/6da5a732-b003-412c-8308-e80cead7eb1c-original-pull-secret podName:6da5a732-b003-412c-8308-e80cead7eb1c nodeName:}" failed. No retries permitted until 2026-06-08 13:44:57.057338319 +0000 UTC m=+65.136667206 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/6da5a732-b003-412c-8308-e80cead7eb1c-original-pull-secret") pod "global-pull-secret-syncer-dm2n6" (UID: "6da5a732-b003-412c-8308-e80cead7eb1c") : object "kube-system"/"original-pull-secret" not registered Jun 08 13:44:25.157597 ip-10-0-140-46 kubenswrapper[2576]: I0608 13:44:25.157549 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5jttb\" (UniqueName: \"kubernetes.io/projected/4b283339-40c0-40f5-b9d9-c75e99e4f984-kube-api-access-5jttb\") pod \"network-check-target-99957\" (UID: \"4b283339-40c0-40f5-b9d9-c75e99e4f984\") " pod="openshift-network-diagnostics/network-check-target-99957" Jun 08 13:44:25.157761 ip-10-0-140-46 kubenswrapper[2576]: E0608 13:44:25.157706 2576 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jun 08 13:44:25.157761 ip-10-0-140-46 kubenswrapper[2576]: E0608 13:44:25.157728 2576 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jun 08 13:44:25.157761 ip-10-0-140-46 kubenswrapper[2576]: E0608 13:44:25.157739 2576 projected.go:196] Error preparing data for projected volume kube-api-access-5jttb for pod openshift-network-diagnostics/network-check-target-99957: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 08 13:44:25.157931 ip-10-0-140-46 kubenswrapper[2576]: E0608 13:44:25.157804 2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/4b283339-40c0-40f5-b9d9-c75e99e4f984-kube-api-access-5jttb podName:4b283339-40c0-40f5-b9d9-c75e99e4f984 nodeName:}" failed. No retries permitted until 2026-06-08 13:44:57.157786844 +0000 UTC m=+65.237115733 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "kube-api-access-5jttb" (UniqueName: "kubernetes.io/projected/4b283339-40c0-40f5-b9d9-c75e99e4f984-kube-api-access-5jttb") pod "network-check-target-99957" (UID: "4b283339-40c0-40f5-b9d9-c75e99e4f984") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 08 13:44:26.371347 ip-10-0-140-46 kubenswrapper[2576]: I0608 13:44:26.371314 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-99957" Jun 08 13:44:26.371820 ip-10-0-140-46 kubenswrapper[2576]: E0608 13:44:26.371436 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-99957" podUID="4b283339-40c0-40f5-b9d9-c75e99e4f984" Jun 08 13:44:26.371820 ip-10-0-140-46 kubenswrapper[2576]: I0608 13:44:26.371646 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-l62qm" Jun 08 13:44:26.371820 ip-10-0-140-46 kubenswrapper[2576]: I0608 13:44:26.371646 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-dm2n6" Jun 08 13:44:26.371820 ip-10-0-140-46 kubenswrapper[2576]: E0608 13:44:26.371744 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-l62qm" podUID="52fab817-1614-450d-8ea9-d10e21821af6" Jun 08 13:44:26.372029 ip-10-0-140-46 kubenswrapper[2576]: E0608 13:44:26.371842 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-dm2n6" podUID="6da5a732-b003-412c-8308-e80cead7eb1c" Jun 08 13:44:26.765956 ip-10-0-140-46 kubenswrapper[2576]: I0608 13:44:26.765880 2576 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-140-46.ec2.internal" event="NodeReady" Jun 08 13:44:26.766111 ip-10-0-140-46 kubenswrapper[2576]: I0608 13:44:26.766032 2576 kubelet_node_status.go:489] "Fast updating node status as it just became ready" Jun 08 13:44:26.772585 ip-10-0-140-46 kubenswrapper[2576]: I0608 13:44:26.772536 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cx7sn_6e4b50fc-3e91-4f50-b92a-e90919788248/konnectivity-agent/0.log" limit=1024 Jun 08 13:44:26.856028 ip-10-0-140-46 kubenswrapper[2576]: I0608 13:44:26.855989 2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-image-registry/image-registry-98b4d96dc-d224h"] Jun 08 13:44:26.857989 ip-10-0-140-46 kubenswrapper[2576]: I0608 13:44:26.857964 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-98b4d96dc-d224h" Jun 08 13:44:26.860742 ip-10-0-140-46 kubenswrapper[2576]: I0608 13:44:26.860715 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-tls\"" Jun 08 13:44:26.860844 ip-10-0-140-46 kubenswrapper[2576]: I0608 13:44:26.860796 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"installation-pull-secrets\"" Jun 08 13:44:26.861036 ip-10-0-140-46 kubenswrapper[2576]: I0608 13:44:26.861021 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"registry-dockercfg-7cm6t\"" Jun 08 13:44:26.861261 ip-10-0-140-46 kubenswrapper[2576]: I0608 13:44:26.861243 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-private-configuration\"" Jun 08 13:44:26.881965 ip-10-0-140-46 kubenswrapper[2576]: I0608 13:44:26.881942 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"trusted-ca\"" Jun 08 13:44:26.899079 ip-10-0-140-46 kubenswrapper[2576]: I0608 13:44:26.898982 2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-dns/dns-default-l52bl"] Jun 08 13:44:26.900969 ip-10-0-140-46 kubenswrapper[2576]: I0608 13:44:26.900946 2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress-canary/ingress-canary-5stwl"] Jun 08 13:44:26.901095 ip-10-0-140-46 kubenswrapper[2576]: I0608 13:44:26.901081 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-l52bl" Jun 08 13:44:26.902858 ip-10-0-140-46 kubenswrapper[2576]: I0608 13:44:26.902837 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-98b4d96dc-d224h"] Jun 08 13:44:26.903925 ip-10-0-140-46 kubenswrapper[2576]: I0608 13:44:26.903646 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-5stwl" Jun 08 13:44:26.904028 ip-10-0-140-46 kubenswrapper[2576]: I0608 13:44:26.903944 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"dns-default\"" Jun 08 13:44:26.904288 ip-10-0-140-46 kubenswrapper[2576]: I0608 13:44:26.904263 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-jsdkh\"" Jun 08 13:44:26.904458 ip-10-0-140-46 kubenswrapper[2576]: I0608 13:44:26.904435 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-default-metrics-tls\"" Jun 08 13:44:26.905775 ip-10-0-140-46 kubenswrapper[2576]: I0608 13:44:26.905750 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cx7sn_6e4b50fc-3e91-4f50-b92a-e90919788248/konnectivity-agent/0.log" limit=1024 Jun 08 13:44:26.910745 ip-10-0-140-46 kubenswrapper[2576]: I0608 13:44:26.910725 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"openshift-service-ca.crt\"" Jun 08 13:44:26.911206 ip-10-0-140-46 kubenswrapper[2576]: I0608 13:44:26.910977 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"kube-root-ca.crt\"" Jun 08 13:44:26.911206 ip-10-0-140-46 kubenswrapper[2576]: I0608 13:44:26.911054 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"default-dockercfg-tzbrf\"" Jun 08 13:44:26.911206 ip-10-0-140-46 kubenswrapper[2576]: I0608 13:44:26.911067 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"canary-serving-cert\"" Jun 08 13:44:26.956068 ip-10-0-140-46 kubenswrapper[2576]: I0608 13:44:26.956037 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-l52bl"] Jun 08 13:44:26.956840 ip-10-0-140-46 kubenswrapper[2576]: I0608 13:44:26.956816 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-5stwl"] Jun 08 13:44:26.969431 ip-10-0-140-46 kubenswrapper[2576]: I0608 13:44:26.969402 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/3d97d05c-9d8f-4d01-8543-610bc38837c4-trusted-ca\") pod \"image-registry-98b4d96dc-d224h\" (UID: \"3d97d05c-9d8f-4d01-8543-610bc38837c4\") " pod="openshift-image-registry/image-registry-98b4d96dc-d224h" Jun 08 13:44:26.969579 ip-10-0-140-46 kubenswrapper[2576]: I0608 13:44:26.969471 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/3d97d05c-9d8f-4d01-8543-610bc38837c4-image-registry-private-configuration\") pod \"image-registry-98b4d96dc-d224h\" (UID: \"3d97d05c-9d8f-4d01-8543-610bc38837c4\") " pod="openshift-image-registry/image-registry-98b4d96dc-d224h" Jun 08 13:44:26.969579 ip-10-0-140-46 kubenswrapper[2576]: I0608 13:44:26.969494 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/3d97d05c-9d8f-4d01-8543-610bc38837c4-installation-pull-secrets\") pod \"image-registry-98b4d96dc-d224h\" (UID: \"3d97d05c-9d8f-4d01-8543-610bc38837c4\") " pod="openshift-image-registry/image-registry-98b4d96dc-d224h" Jun 08 13:44:26.969579 ip-10-0-140-46 kubenswrapper[2576]: I0608 13:44:26.969519 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/3d97d05c-9d8f-4d01-8543-610bc38837c4-registry-certificates\") pod \"image-registry-98b4d96dc-d224h\" (UID: \"3d97d05c-9d8f-4d01-8543-610bc38837c4\") " pod="openshift-image-registry/image-registry-98b4d96dc-d224h" Jun 08 13:44:26.969579 ip-10-0-140-46 kubenswrapper[2576]: I0608 13:44:26.969543 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/3d97d05c-9d8f-4d01-8543-610bc38837c4-ca-trust-extracted\") pod \"image-registry-98b4d96dc-d224h\" (UID: \"3d97d05c-9d8f-4d01-8543-610bc38837c4\") " pod="openshift-image-registry/image-registry-98b4d96dc-d224h" Jun 08 13:44:26.969734 ip-10-0-140-46 kubenswrapper[2576]: I0608 13:44:26.969621 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-kfgjd\" (UniqueName: \"kubernetes.io/projected/3d97d05c-9d8f-4d01-8543-610bc38837c4-kube-api-access-kfgjd\") pod \"image-registry-98b4d96dc-d224h\" (UID: \"3d97d05c-9d8f-4d01-8543-610bc38837c4\") " pod="openshift-image-registry/image-registry-98b4d96dc-d224h" Jun 08 13:44:26.969734 ip-10-0-140-46 kubenswrapper[2576]: I0608 13:44:26.969651 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/3d97d05c-9d8f-4d01-8543-610bc38837c4-registry-tls\") pod \"image-registry-98b4d96dc-d224h\" (UID: \"3d97d05c-9d8f-4d01-8543-610bc38837c4\") " pod="openshift-image-registry/image-registry-98b4d96dc-d224h" Jun 08 13:44:26.969734 ip-10-0-140-46 kubenswrapper[2576]: I0608 13:44:26.969716 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/3d97d05c-9d8f-4d01-8543-610bc38837c4-bound-sa-token\") pod \"image-registry-98b4d96dc-d224h\" (UID: \"3d97d05c-9d8f-4d01-8543-610bc38837c4\") " pod="openshift-image-registry/image-registry-98b4d96dc-d224h" Jun 08 13:44:27.070211 ip-10-0-140-46 kubenswrapper[2576]: I0608 13:44:27.070164 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/3d97d05c-9d8f-4d01-8543-610bc38837c4-bound-sa-token\") pod \"image-registry-98b4d96dc-d224h\" (UID: \"3d97d05c-9d8f-4d01-8543-610bc38837c4\") " pod="openshift-image-registry/image-registry-98b4d96dc-d224h" Jun 08 13:44:27.070393 ip-10-0-140-46 kubenswrapper[2576]: I0608 13:44:27.070221 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/3d97d05c-9d8f-4d01-8543-610bc38837c4-trusted-ca\") pod \"image-registry-98b4d96dc-d224h\" (UID: \"3d97d05c-9d8f-4d01-8543-610bc38837c4\") " pod="openshift-image-registry/image-registry-98b4d96dc-d224h" Jun 08 13:44:27.070393 ip-10-0-140-46 kubenswrapper[2576]: I0608 13:44:27.070271 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/2ef5209f-d5f5-4fae-a86c-1bb23283f29a-config-volume\") pod \"dns-default-l52bl\" (UID: \"2ef5209f-d5f5-4fae-a86c-1bb23283f29a\") " pod="openshift-dns/dns-default-l52bl" Jun 08 13:44:27.070393 ip-10-0-140-46 kubenswrapper[2576]: I0608 13:44:27.070293 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/2ef5209f-d5f5-4fae-a86c-1bb23283f29a-metrics-tls\") pod \"dns-default-l52bl\" (UID: \"2ef5209f-d5f5-4fae-a86c-1bb23283f29a\") " pod="openshift-dns/dns-default-l52bl" Jun 08 13:44:27.070393 ip-10-0-140-46 kubenswrapper[2576]: I0608 13:44:27.070357 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/3d97d05c-9d8f-4d01-8543-610bc38837c4-image-registry-private-configuration\") pod \"image-registry-98b4d96dc-d224h\" (UID: \"3d97d05c-9d8f-4d01-8543-610bc38837c4\") " pod="openshift-image-registry/image-registry-98b4d96dc-d224h" Jun 08 13:44:27.070652 ip-10-0-140-46 kubenswrapper[2576]: I0608 13:44:27.070400 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/3d97d05c-9d8f-4d01-8543-610bc38837c4-installation-pull-secrets\") pod \"image-registry-98b4d96dc-d224h\" (UID: \"3d97d05c-9d8f-4d01-8543-610bc38837c4\") " pod="openshift-image-registry/image-registry-98b4d96dc-d224h" Jun 08 13:44:27.070652 ip-10-0-140-46 kubenswrapper[2576]: I0608 13:44:27.070429 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/aa1c8cf7-33d3-46fe-963b-c40cb5fd9674-cert\") pod \"ingress-canary-5stwl\" (UID: \"aa1c8cf7-33d3-46fe-963b-c40cb5fd9674\") " pod="openshift-ingress-canary/ingress-canary-5stwl" Jun 08 13:44:27.070652 ip-10-0-140-46 kubenswrapper[2576]: I0608 13:44:27.070468 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/3d97d05c-9d8f-4d01-8543-610bc38837c4-registry-certificates\") pod \"image-registry-98b4d96dc-d224h\" (UID: \"3d97d05c-9d8f-4d01-8543-610bc38837c4\") " pod="openshift-image-registry/image-registry-98b4d96dc-d224h" Jun 08 13:44:27.070652 ip-10-0-140-46 kubenswrapper[2576]: I0608 13:44:27.070494 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4tqs7\" (UniqueName: \"kubernetes.io/projected/aa1c8cf7-33d3-46fe-963b-c40cb5fd9674-kube-api-access-4tqs7\") pod \"ingress-canary-5stwl\" (UID: \"aa1c8cf7-33d3-46fe-963b-c40cb5fd9674\") " pod="openshift-ingress-canary/ingress-canary-5stwl" Jun 08 13:44:27.070652 ip-10-0-140-46 kubenswrapper[2576]: I0608 13:44:27.070517 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/3d97d05c-9d8f-4d01-8543-610bc38837c4-ca-trust-extracted\") pod \"image-registry-98b4d96dc-d224h\" (UID: \"3d97d05c-9d8f-4d01-8543-610bc38837c4\") " pod="openshift-image-registry/image-registry-98b4d96dc-d224h" Jun 08 13:44:27.070652 ip-10-0-140-46 kubenswrapper[2576]: I0608 13:44:27.070542 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-kfgjd\" (UniqueName: \"kubernetes.io/projected/3d97d05c-9d8f-4d01-8543-610bc38837c4-kube-api-access-kfgjd\") pod \"image-registry-98b4d96dc-d224h\" (UID: \"3d97d05c-9d8f-4d01-8543-610bc38837c4\") " pod="openshift-image-registry/image-registry-98b4d96dc-d224h" Jun 08 13:44:27.070652 ip-10-0-140-46 kubenswrapper[2576]: I0608 13:44:27.070583 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/2ef5209f-d5f5-4fae-a86c-1bb23283f29a-tmp-dir\") pod \"dns-default-l52bl\" (UID: \"2ef5209f-d5f5-4fae-a86c-1bb23283f29a\") " pod="openshift-dns/dns-default-l52bl" Jun 08 13:44:27.070652 ip-10-0-140-46 kubenswrapper[2576]: I0608 13:44:27.070641 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/3d97d05c-9d8f-4d01-8543-610bc38837c4-registry-tls\") pod \"image-registry-98b4d96dc-d224h\" (UID: \"3d97d05c-9d8f-4d01-8543-610bc38837c4\") " pod="openshift-image-registry/image-registry-98b4d96dc-d224h" Jun 08 13:44:27.071032 ip-10-0-140-46 kubenswrapper[2576]: I0608 13:44:27.070697 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2sl6j\" (UniqueName: \"kubernetes.io/projected/2ef5209f-d5f5-4fae-a86c-1bb23283f29a-kube-api-access-2sl6j\") pod \"dns-default-l52bl\" (UID: \"2ef5209f-d5f5-4fae-a86c-1bb23283f29a\") " pod="openshift-dns/dns-default-l52bl" Jun 08 13:44:27.071032 ip-10-0-140-46 kubenswrapper[2576]: E0608 13:44:27.070759 2576 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jun 08 13:44:27.071032 ip-10-0-140-46 kubenswrapper[2576]: E0608 13:44:27.070780 2576 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-98b4d96dc-d224h: secret "image-registry-tls" not found Jun 08 13:44:27.071032 ip-10-0-140-46 kubenswrapper[2576]: E0608 13:44:27.070852 2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/3d97d05c-9d8f-4d01-8543-610bc38837c4-registry-tls podName:3d97d05c-9d8f-4d01-8543-610bc38837c4 nodeName:}" failed. No retries permitted until 2026-06-08 13:44:27.570832467 +0000 UTC m=+35.650161350 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/3d97d05c-9d8f-4d01-8543-610bc38837c4-registry-tls") pod "image-registry-98b4d96dc-d224h" (UID: "3d97d05c-9d8f-4d01-8543-610bc38837c4") : secret "image-registry-tls" not found Jun 08 13:44:27.071345 ip-10-0-140-46 kubenswrapper[2576]: I0608 13:44:27.071297 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/3d97d05c-9d8f-4d01-8543-610bc38837c4-registry-certificates\") pod \"image-registry-98b4d96dc-d224h\" (UID: \"3d97d05c-9d8f-4d01-8543-610bc38837c4\") " pod="openshift-image-registry/image-registry-98b4d96dc-d224h" Jun 08 13:44:27.071449 ip-10-0-140-46 kubenswrapper[2576]: I0608 13:44:27.071421 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/3d97d05c-9d8f-4d01-8543-610bc38837c4-trusted-ca\") pod \"image-registry-98b4d96dc-d224h\" (UID: \"3d97d05c-9d8f-4d01-8543-610bc38837c4\") " pod="openshift-image-registry/image-registry-98b4d96dc-d224h" Jun 08 13:44:27.071587 ip-10-0-140-46 kubenswrapper[2576]: I0608 13:44:27.071519 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/3d97d05c-9d8f-4d01-8543-610bc38837c4-ca-trust-extracted\") pod \"image-registry-98b4d96dc-d224h\" (UID: \"3d97d05c-9d8f-4d01-8543-610bc38837c4\") " pod="openshift-image-registry/image-registry-98b4d96dc-d224h" Jun 08 13:44:27.075198 ip-10-0-140-46 kubenswrapper[2576]: I0608 13:44:27.075177 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/3d97d05c-9d8f-4d01-8543-610bc38837c4-image-registry-private-configuration\") pod \"image-registry-98b4d96dc-d224h\" (UID: \"3d97d05c-9d8f-4d01-8543-610bc38837c4\") " pod="openshift-image-registry/image-registry-98b4d96dc-d224h" Jun 08 13:44:27.075300 ip-10-0-140-46 kubenswrapper[2576]: I0608 13:44:27.075234 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/3d97d05c-9d8f-4d01-8543-610bc38837c4-installation-pull-secrets\") pod \"image-registry-98b4d96dc-d224h\" (UID: \"3d97d05c-9d8f-4d01-8543-610bc38837c4\") " pod="openshift-image-registry/image-registry-98b4d96dc-d224h" Jun 08 13:44:27.090442 ip-10-0-140-46 kubenswrapper[2576]: I0608 13:44:27.090415 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/3d97d05c-9d8f-4d01-8543-610bc38837c4-bound-sa-token\") pod \"image-registry-98b4d96dc-d224h\" (UID: \"3d97d05c-9d8f-4d01-8543-610bc38837c4\") " pod="openshift-image-registry/image-registry-98b4d96dc-d224h" Jun 08 13:44:27.094542 ip-10-0-140-46 kubenswrapper[2576]: I0608 13:44:27.094511 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-kfgjd\" (UniqueName: \"kubernetes.io/projected/3d97d05c-9d8f-4d01-8543-610bc38837c4-kube-api-access-kfgjd\") pod \"image-registry-98b4d96dc-d224h\" (UID: \"3d97d05c-9d8f-4d01-8543-610bc38837c4\") " pod="openshift-image-registry/image-registry-98b4d96dc-d224h" Jun 08 13:44:27.172143 ip-10-0-140-46 kubenswrapper[2576]: I0608 13:44:27.172102 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/2ef5209f-d5f5-4fae-a86c-1bb23283f29a-config-volume\") pod \"dns-default-l52bl\" (UID: \"2ef5209f-d5f5-4fae-a86c-1bb23283f29a\") " pod="openshift-dns/dns-default-l52bl" Jun 08 13:44:27.172313 ip-10-0-140-46 kubenswrapper[2576]: I0608 13:44:27.172153 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/2ef5209f-d5f5-4fae-a86c-1bb23283f29a-metrics-tls\") pod \"dns-default-l52bl\" (UID: \"2ef5209f-d5f5-4fae-a86c-1bb23283f29a\") " pod="openshift-dns/dns-default-l52bl" Jun 08 13:44:27.172313 ip-10-0-140-46 kubenswrapper[2576]: I0608 13:44:27.172189 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/aa1c8cf7-33d3-46fe-963b-c40cb5fd9674-cert\") pod \"ingress-canary-5stwl\" (UID: \"aa1c8cf7-33d3-46fe-963b-c40cb5fd9674\") " pod="openshift-ingress-canary/ingress-canary-5stwl" Jun 08 13:44:27.172313 ip-10-0-140-46 kubenswrapper[2576]: I0608 13:44:27.172224 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4tqs7\" (UniqueName: \"kubernetes.io/projected/aa1c8cf7-33d3-46fe-963b-c40cb5fd9674-kube-api-access-4tqs7\") pod \"ingress-canary-5stwl\" (UID: \"aa1c8cf7-33d3-46fe-963b-c40cb5fd9674\") " pod="openshift-ingress-canary/ingress-canary-5stwl" Jun 08 13:44:27.172313 ip-10-0-140-46 kubenswrapper[2576]: I0608 13:44:27.172256 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/2ef5209f-d5f5-4fae-a86c-1bb23283f29a-tmp-dir\") pod \"dns-default-l52bl\" (UID: \"2ef5209f-d5f5-4fae-a86c-1bb23283f29a\") " pod="openshift-dns/dns-default-l52bl" Jun 08 13:44:27.172527 ip-10-0-140-46 kubenswrapper[2576]: E0608 13:44:27.172345 2576 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jun 08 13:44:27.172527 ip-10-0-140-46 kubenswrapper[2576]: I0608 13:44:27.172409 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2sl6j\" (UniqueName: \"kubernetes.io/projected/2ef5209f-d5f5-4fae-a86c-1bb23283f29a-kube-api-access-2sl6j\") pod \"dns-default-l52bl\" (UID: \"2ef5209f-d5f5-4fae-a86c-1bb23283f29a\") " pod="openshift-dns/dns-default-l52bl" Jun 08 13:44:27.172527 ip-10-0-140-46 kubenswrapper[2576]: E0608 13:44:27.172434 2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/2ef5209f-d5f5-4fae-a86c-1bb23283f29a-metrics-tls podName:2ef5209f-d5f5-4fae-a86c-1bb23283f29a nodeName:}" failed. No retries permitted until 2026-06-08 13:44:27.672413548 +0000 UTC m=+35.751742424 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/2ef5209f-d5f5-4fae-a86c-1bb23283f29a-metrics-tls") pod "dns-default-l52bl" (UID: "2ef5209f-d5f5-4fae-a86c-1bb23283f29a") : secret "dns-default-metrics-tls" not found Jun 08 13:44:27.172721 ip-10-0-140-46 kubenswrapper[2576]: I0608 13:44:27.172612 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/2ef5209f-d5f5-4fae-a86c-1bb23283f29a-tmp-dir\") pod \"dns-default-l52bl\" (UID: \"2ef5209f-d5f5-4fae-a86c-1bb23283f29a\") " pod="openshift-dns/dns-default-l52bl" Jun 08 13:44:27.172838 ip-10-0-140-46 kubenswrapper[2576]: I0608 13:44:27.172812 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/2ef5209f-d5f5-4fae-a86c-1bb23283f29a-config-volume\") pod \"dns-default-l52bl\" (UID: \"2ef5209f-d5f5-4fae-a86c-1bb23283f29a\") " pod="openshift-dns/dns-default-l52bl" Jun 08 13:44:27.174994 ip-10-0-140-46 kubenswrapper[2576]: I0608 13:44:27.174969 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/aa1c8cf7-33d3-46fe-963b-c40cb5fd9674-cert\") pod \"ingress-canary-5stwl\" (UID: \"aa1c8cf7-33d3-46fe-963b-c40cb5fd9674\") " pod="openshift-ingress-canary/ingress-canary-5stwl" Jun 08 13:44:27.196042 ip-10-0-140-46 kubenswrapper[2576]: I0608 13:44:27.196020 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-2sl6j\" (UniqueName: \"kubernetes.io/projected/2ef5209f-d5f5-4fae-a86c-1bb23283f29a-kube-api-access-2sl6j\") pod \"dns-default-l52bl\" (UID: \"2ef5209f-d5f5-4fae-a86c-1bb23283f29a\") " pod="openshift-dns/dns-default-l52bl" Jun 08 13:44:27.200641 ip-10-0-140-46 kubenswrapper[2576]: I0608 13:44:27.200619 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-4tqs7\" (UniqueName: \"kubernetes.io/projected/aa1c8cf7-33d3-46fe-963b-c40cb5fd9674-kube-api-access-4tqs7\") pod \"ingress-canary-5stwl\" (UID: \"aa1c8cf7-33d3-46fe-963b-c40cb5fd9674\") " pod="openshift-ingress-canary/ingress-canary-5stwl" Jun 08 13:44:27.218461 ip-10-0-140-46 kubenswrapper[2576]: I0608 13:44:27.218429 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-5stwl" Jun 08 13:44:27.575776 ip-10-0-140-46 kubenswrapper[2576]: I0608 13:44:27.575736 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/3d97d05c-9d8f-4d01-8543-610bc38837c4-registry-tls\") pod \"image-registry-98b4d96dc-d224h\" (UID: \"3d97d05c-9d8f-4d01-8543-610bc38837c4\") " pod="openshift-image-registry/image-registry-98b4d96dc-d224h" Jun 08 13:44:27.576189 ip-10-0-140-46 kubenswrapper[2576]: E0608 13:44:27.575897 2576 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jun 08 13:44:27.576189 ip-10-0-140-46 kubenswrapper[2576]: E0608 13:44:27.575918 2576 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-98b4d96dc-d224h: secret "image-registry-tls" not found Jun 08 13:44:27.576189 ip-10-0-140-46 kubenswrapper[2576]: E0608 13:44:27.575998 2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/3d97d05c-9d8f-4d01-8543-610bc38837c4-registry-tls podName:3d97d05c-9d8f-4d01-8543-610bc38837c4 nodeName:}" failed. No retries permitted until 2026-06-08 13:44:28.575976141 +0000 UTC m=+36.655305014 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/3d97d05c-9d8f-4d01-8543-610bc38837c4-registry-tls") pod "image-registry-98b4d96dc-d224h" (UID: "3d97d05c-9d8f-4d01-8543-610bc38837c4") : secret "image-registry-tls" not found Jun 08 13:44:27.676965 ip-10-0-140-46 kubenswrapper[2576]: I0608 13:44:27.676936 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/2ef5209f-d5f5-4fae-a86c-1bb23283f29a-metrics-tls\") pod \"dns-default-l52bl\" (UID: \"2ef5209f-d5f5-4fae-a86c-1bb23283f29a\") " pod="openshift-dns/dns-default-l52bl" Jun 08 13:44:27.677147 ip-10-0-140-46 kubenswrapper[2576]: E0608 13:44:27.677115 2576 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jun 08 13:44:27.677216 ip-10-0-140-46 kubenswrapper[2576]: E0608 13:44:27.677204 2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/2ef5209f-d5f5-4fae-a86c-1bb23283f29a-metrics-tls podName:2ef5209f-d5f5-4fae-a86c-1bb23283f29a nodeName:}" failed. No retries permitted until 2026-06-08 13:44:28.677181161 +0000 UTC m=+36.756510038 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/2ef5209f-d5f5-4fae-a86c-1bb23283f29a-metrics-tls") pod "dns-default-l52bl" (UID: "2ef5209f-d5f5-4fae-a86c-1bb23283f29a") : secret "dns-default-metrics-tls" not found Jun 08 13:44:28.371533 ip-10-0-140-46 kubenswrapper[2576]: I0608 13:44:28.371471 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-l62qm" Jun 08 13:44:28.371734 ip-10-0-140-46 kubenswrapper[2576]: I0608 13:44:28.371472 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-99957" Jun 08 13:44:28.371734 ip-10-0-140-46 kubenswrapper[2576]: I0608 13:44:28.371688 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-dm2n6" Jun 08 13:44:28.374497 ip-10-0-140-46 kubenswrapper[2576]: I0608 13:44:28.374475 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-rt6hp\"" Jun 08 13:44:28.375453 ip-10-0-140-46 kubenswrapper[2576]: I0608 13:44:28.375415 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\"" Jun 08 13:44:28.375554 ip-10-0-140-46 kubenswrapper[2576]: I0608 13:44:28.375458 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\"" Jun 08 13:44:28.375554 ip-10-0-140-46 kubenswrapper[2576]: I0608 13:44:28.375468 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\"" Jun 08 13:44:28.375554 ip-10-0-140-46 kubenswrapper[2576]: I0608 13:44:28.375458 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\"" Jun 08 13:44:28.375921 ip-10-0-140-46 kubenswrapper[2576]: I0608 13:44:28.375901 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-sxqjm\"" Jun 08 13:44:28.555842 ip-10-0-140-46 kubenswrapper[2576]: I0608 13:44:28.555815 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-5stwl"] Jun 08 13:44:28.561458 ip-10-0-140-46 kubenswrapper[2576]: W0608 13:44:28.561431 2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podaa1c8cf7_33d3_46fe_963b_c40cb5fd9674.slice/crio-46706f0710af1633a6b6e048ddc58cda38f8748c1191ae455d248f178ea61c4a WatchSource:0}: Error finding container 46706f0710af1633a6b6e048ddc58cda38f8748c1191ae455d248f178ea61c4a: Status 404 returned error can't find the container with id 46706f0710af1633a6b6e048ddc58cda38f8748c1191ae455d248f178ea61c4a Jun 08 13:44:28.584470 ip-10-0-140-46 kubenswrapper[2576]: I0608 13:44:28.584448 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/3d97d05c-9d8f-4d01-8543-610bc38837c4-registry-tls\") pod \"image-registry-98b4d96dc-d224h\" (UID: \"3d97d05c-9d8f-4d01-8543-610bc38837c4\") " pod="openshift-image-registry/image-registry-98b4d96dc-d224h" Jun 08 13:44:28.584759 ip-10-0-140-46 kubenswrapper[2576]: E0608 13:44:28.584619 2576 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jun 08 13:44:28.584759 ip-10-0-140-46 kubenswrapper[2576]: E0608 13:44:28.584633 2576 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-98b4d96dc-d224h: secret "image-registry-tls" not found Jun 08 13:44:28.584759 ip-10-0-140-46 kubenswrapper[2576]: E0608 13:44:28.584679 2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/3d97d05c-9d8f-4d01-8543-610bc38837c4-registry-tls podName:3d97d05c-9d8f-4d01-8543-610bc38837c4 nodeName:}" failed. No retries permitted until 2026-06-08 13:44:30.584663844 +0000 UTC m=+38.663992725 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/3d97d05c-9d8f-4d01-8543-610bc38837c4-registry-tls") pod "image-registry-98b4d96dc-d224h" (UID: "3d97d05c-9d8f-4d01-8543-610bc38837c4") : secret "image-registry-tls" not found Jun 08 13:44:28.616501 ip-10-0-140-46 kubenswrapper[2576]: I0608 13:44:28.616466 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-5stwl" event={"ID":"aa1c8cf7-33d3-46fe-963b-c40cb5fd9674","Type":"ContainerStarted","Data":"46706f0710af1633a6b6e048ddc58cda38f8748c1191ae455d248f178ea61c4a"} Jun 08 13:44:28.619421 ip-10-0-140-46 kubenswrapper[2576]: I0608 13:44:28.619402 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-pxbdv" event={"ID":"18b84a5c-7b8b-4e1b-a70a-4fbda39064bf","Type":"ContainerStarted","Data":"943fc7f958703ee66b74ef57b307afe59a0ac3ad5029e12d51720b9f8502bfdb"} Jun 08 13:44:28.685065 ip-10-0-140-46 kubenswrapper[2576]: I0608 13:44:28.685040 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/2ef5209f-d5f5-4fae-a86c-1bb23283f29a-metrics-tls\") pod \"dns-default-l52bl\" (UID: \"2ef5209f-d5f5-4fae-a86c-1bb23283f29a\") " pod="openshift-dns/dns-default-l52bl" Jun 08 13:44:28.685213 ip-10-0-140-46 kubenswrapper[2576]: E0608 13:44:28.685195 2576 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jun 08 13:44:28.685280 ip-10-0-140-46 kubenswrapper[2576]: E0608 13:44:28.685273 2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/2ef5209f-d5f5-4fae-a86c-1bb23283f29a-metrics-tls podName:2ef5209f-d5f5-4fae-a86c-1bb23283f29a nodeName:}" failed. No retries permitted until 2026-06-08 13:44:30.685250598 +0000 UTC m=+38.764579484 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/2ef5209f-d5f5-4fae-a86c-1bb23283f29a-metrics-tls") pod "dns-default-l52bl" (UID: "2ef5209f-d5f5-4fae-a86c-1bb23283f29a") : secret "dns-default-metrics-tls" not found Jun 08 13:44:29.625956 ip-10-0-140-46 kubenswrapper[2576]: I0608 13:44:29.625915 2576 generic.go:356] "Generic (PLEG): container finished" podID="18b84a5c-7b8b-4e1b-a70a-4fbda39064bf" containerID="943fc7f958703ee66b74ef57b307afe59a0ac3ad5029e12d51720b9f8502bfdb" exitCode=0 Jun 08 13:44:29.626370 ip-10-0-140-46 kubenswrapper[2576]: I0608 13:44:29.625965 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-pxbdv" event={"ID":"18b84a5c-7b8b-4e1b-a70a-4fbda39064bf","Type":"ContainerDied","Data":"943fc7f958703ee66b74ef57b307afe59a0ac3ad5029e12d51720b9f8502bfdb"} Jun 08 13:44:29.767542 ip-10-0-140-46 kubenswrapper[2576]: I0608 13:44:29.767501 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cx7sn_6e4b50fc-3e91-4f50-b92a-e90919788248/konnectivity-agent/0.log" limit=1024 Jun 08 13:44:29.838157 ip-10-0-140-46 kubenswrapper[2576]: I0608 13:44:29.838120 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cx7sn_6e4b50fc-3e91-4f50-b92a-e90919788248/konnectivity-agent/0.log" limit=1024 Jun 08 13:44:30.601647 ip-10-0-140-46 kubenswrapper[2576]: I0608 13:44:30.601616 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/3d97d05c-9d8f-4d01-8543-610bc38837c4-registry-tls\") pod \"image-registry-98b4d96dc-d224h\" (UID: \"3d97d05c-9d8f-4d01-8543-610bc38837c4\") " pod="openshift-image-registry/image-registry-98b4d96dc-d224h" Jun 08 13:44:30.601807 ip-10-0-140-46 kubenswrapper[2576]: E0608 13:44:30.601754 2576 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jun 08 13:44:30.601807 ip-10-0-140-46 kubenswrapper[2576]: E0608 13:44:30.601769 2576 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-98b4d96dc-d224h: secret "image-registry-tls" not found Jun 08 13:44:30.601895 ip-10-0-140-46 kubenswrapper[2576]: E0608 13:44:30.601819 2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/3d97d05c-9d8f-4d01-8543-610bc38837c4-registry-tls podName:3d97d05c-9d8f-4d01-8543-610bc38837c4 nodeName:}" failed. No retries permitted until 2026-06-08 13:44:34.601805308 +0000 UTC m=+42.681134178 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/3d97d05c-9d8f-4d01-8543-610bc38837c4-registry-tls") pod "image-registry-98b4d96dc-d224h" (UID: "3d97d05c-9d8f-4d01-8543-610bc38837c4") : secret "image-registry-tls" not found Jun 08 13:44:30.631266 ip-10-0-140-46 kubenswrapper[2576]: I0608 13:44:30.631232 2576 generic.go:356] "Generic (PLEG): container finished" podID="18b84a5c-7b8b-4e1b-a70a-4fbda39064bf" containerID="7fe223d79a22f65696f1b37cbeef2a03e383599c9733143da33681d1f225707b" exitCode=0 Jun 08 13:44:30.632018 ip-10-0-140-46 kubenswrapper[2576]: I0608 13:44:30.631316 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-pxbdv" event={"ID":"18b84a5c-7b8b-4e1b-a70a-4fbda39064bf","Type":"ContainerDied","Data":"7fe223d79a22f65696f1b37cbeef2a03e383599c9733143da33681d1f225707b"} Jun 08 13:44:30.632825 ip-10-0-140-46 kubenswrapper[2576]: I0608 13:44:30.632805 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-5stwl" event={"ID":"aa1c8cf7-33d3-46fe-963b-c40cb5fd9674","Type":"ContainerStarted","Data":"9ec60374d4dc91bb66a7b916e8df50e38d21db321d4e6fea4a86dbd01c9045c2"} Jun 08 13:44:30.702643 ip-10-0-140-46 kubenswrapper[2576]: I0608 13:44:30.702614 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/2ef5209f-d5f5-4fae-a86c-1bb23283f29a-metrics-tls\") pod \"dns-default-l52bl\" (UID: \"2ef5209f-d5f5-4fae-a86c-1bb23283f29a\") " pod="openshift-dns/dns-default-l52bl" Jun 08 13:44:30.702786 ip-10-0-140-46 kubenswrapper[2576]: E0608 13:44:30.702768 2576 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jun 08 13:44:30.702841 ip-10-0-140-46 kubenswrapper[2576]: E0608 13:44:30.702832 2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/2ef5209f-d5f5-4fae-a86c-1bb23283f29a-metrics-tls podName:2ef5209f-d5f5-4fae-a86c-1bb23283f29a nodeName:}" failed. No retries permitted until 2026-06-08 13:44:34.70281653 +0000 UTC m=+42.782145420 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/2ef5209f-d5f5-4fae-a86c-1bb23283f29a-metrics-tls") pod "dns-default-l52bl" (UID: "2ef5209f-d5f5-4fae-a86c-1bb23283f29a") : secret "dns-default-metrics-tls" not found Jun 08 13:44:30.723793 ip-10-0-140-46 kubenswrapper[2576]: I0608 13:44:30.723753 2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress-canary/ingress-canary-5stwl" podStartSLOduration=2.877327461 podStartE2EDuration="4.723739706s" totalImagesPullingTime="1.846412245s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-08 13:44:26 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-08 13:44:30.722144294 +0000 UTC m=+38.801473186" watchObservedRunningTime="2026-06-08 13:44:30.723739706 +0000 UTC m=+38.803068597" Jun 08 13:44:31.188583 ip-10-0-140-46 kubenswrapper[2576]: I0608 13:44:31.188535 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cx7sn_6e4b50fc-3e91-4f50-b92a-e90919788248/konnectivity-agent/0.log" limit=1024 Jun 08 13:44:31.292082 ip-10-0-140-46 kubenswrapper[2576]: I0608 13:44:31.292053 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cx7sn_6e4b50fc-3e91-4f50-b92a-e90919788248/konnectivity-agent/0.log" limit=1024 Jun 08 13:44:31.638057 ip-10-0-140-46 kubenswrapper[2576]: I0608 13:44:31.638014 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-pxbdv" event={"ID":"18b84a5c-7b8b-4e1b-a70a-4fbda39064bf","Type":"ContainerStarted","Data":"85c9ae6302ee0409afd19fef47e8fc0309f2e6964cd6c27840665cb1e36dee7b"} Jun 08 13:44:31.690938 ip-10-0-140-46 kubenswrapper[2576]: I0608 13:44:31.690891 2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-additional-cni-plugins-pxbdv" podStartSLOduration=9.659687459 podStartE2EDuration="39.690877252s" totalImagesPullingTime="30.031189793s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-08 13:43:52 +0000 UTC" imagePullSessionsCount=5 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-08 13:44:31.685697899 +0000 UTC m=+39.765026791" watchObservedRunningTime="2026-06-08 13:44:31.690877252 +0000 UTC m=+39.770206136" Jun 08 13:44:31.861981 ip-10-0-140-46 kubenswrapper[2576]: I0608 13:44:31.861952 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cx7sn_6e4b50fc-3e91-4f50-b92a-e90919788248/konnectivity-agent/0.log" limit=1024 Jun 08 13:44:31.971002 ip-10-0-140-46 kubenswrapper[2576]: I0608 13:44:31.970934 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cx7sn_6e4b50fc-3e91-4f50-b92a-e90919788248/konnectivity-agent/0.log" limit=1024 Jun 08 13:44:32.073161 ip-10-0-140-46 kubenswrapper[2576]: I0608 13:44:32.073134 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cx7sn_6e4b50fc-3e91-4f50-b92a-e90919788248/konnectivity-agent/0.log" limit=1024 Jun 08 13:44:33.357820 ip-10-0-140-46 kubenswrapper[2576]: I0608 13:44:33.357783 2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-network-console/networking-console-plugin-d5d5bb78b-7g8ft"] Jun 08 13:44:33.371700 ip-10-0-140-46 kubenswrapper[2576]: I0608 13:44:33.371679 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-console/networking-console-plugin-d5d5bb78b-7g8ft" Jun 08 13:44:33.381027 ip-10-0-140-46 kubenswrapper[2576]: I0608 13:44:33.381004 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-console\"/\"networking-console-plugin-cert\"" Jun 08 13:44:33.381135 ip-10-0-140-46 kubenswrapper[2576]: I0608 13:44:33.381013 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-console\"/\"networking-console-plugin\"" Jun 08 13:44:33.381135 ip-10-0-140-46 kubenswrapper[2576]: I0608 13:44:33.381124 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-console\"/\"default-dockercfg-hztgh\"" Jun 08 13:44:33.392964 ip-10-0-140-46 kubenswrapper[2576]: I0608 13:44:33.392943 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-console/networking-console-plugin-d5d5bb78b-7g8ft"] Jun 08 13:44:33.522123 ip-10-0-140-46 kubenswrapper[2576]: I0608 13:44:33.522091 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/6cf15e88-7b22-4dc1-9a9e-1dc73867afa3-nginx-conf\") pod \"networking-console-plugin-d5d5bb78b-7g8ft\" (UID: \"6cf15e88-7b22-4dc1-9a9e-1dc73867afa3\") " pod="openshift-network-console/networking-console-plugin-d5d5bb78b-7g8ft" Jun 08 13:44:33.522284 ip-10-0-140-46 kubenswrapper[2576]: I0608 13:44:33.522128 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/6cf15e88-7b22-4dc1-9a9e-1dc73867afa3-networking-console-plugin-cert\") pod \"networking-console-plugin-d5d5bb78b-7g8ft\" (UID: \"6cf15e88-7b22-4dc1-9a9e-1dc73867afa3\") " pod="openshift-network-console/networking-console-plugin-d5d5bb78b-7g8ft" Jun 08 13:44:33.623063 ip-10-0-140-46 kubenswrapper[2576]: I0608 13:44:33.622994 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/6cf15e88-7b22-4dc1-9a9e-1dc73867afa3-nginx-conf\") pod \"networking-console-plugin-d5d5bb78b-7g8ft\" (UID: \"6cf15e88-7b22-4dc1-9a9e-1dc73867afa3\") " pod="openshift-network-console/networking-console-plugin-d5d5bb78b-7g8ft" Jun 08 13:44:33.623063 ip-10-0-140-46 kubenswrapper[2576]: I0608 13:44:33.623030 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/6cf15e88-7b22-4dc1-9a9e-1dc73867afa3-networking-console-plugin-cert\") pod \"networking-console-plugin-d5d5bb78b-7g8ft\" (UID: \"6cf15e88-7b22-4dc1-9a9e-1dc73867afa3\") " pod="openshift-network-console/networking-console-plugin-d5d5bb78b-7g8ft" Jun 08 13:44:33.623217 ip-10-0-140-46 kubenswrapper[2576]: E0608 13:44:33.623140 2576 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found Jun 08 13:44:33.623217 ip-10-0-140-46 kubenswrapper[2576]: E0608 13:44:33.623215 2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/6cf15e88-7b22-4dc1-9a9e-1dc73867afa3-networking-console-plugin-cert podName:6cf15e88-7b22-4dc1-9a9e-1dc73867afa3 nodeName:}" failed. No retries permitted until 2026-06-08 13:44:34.123193419 +0000 UTC m=+42.202522308 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/6cf15e88-7b22-4dc1-9a9e-1dc73867afa3-networking-console-plugin-cert") pod "networking-console-plugin-d5d5bb78b-7g8ft" (UID: "6cf15e88-7b22-4dc1-9a9e-1dc73867afa3") : secret "networking-console-plugin-cert" not found Jun 08 13:44:33.623779 ip-10-0-140-46 kubenswrapper[2576]: I0608 13:44:33.623759 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/6cf15e88-7b22-4dc1-9a9e-1dc73867afa3-nginx-conf\") pod \"networking-console-plugin-d5d5bb78b-7g8ft\" (UID: \"6cf15e88-7b22-4dc1-9a9e-1dc73867afa3\") " pod="openshift-network-console/networking-console-plugin-d5d5bb78b-7g8ft" Jun 08 13:44:33.835488 ip-10-0-140-46 kubenswrapper[2576]: I0608 13:44:33.835455 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cx7sn_6e4b50fc-3e91-4f50-b92a-e90919788248/konnectivity-agent/0.log" limit=1024 Jun 08 13:44:33.934119 ip-10-0-140-46 kubenswrapper[2576]: I0608 13:44:33.934049 2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-kube-storage-version-migrator/migrator-955ffdf5f-zqfkg"] Jun 08 13:44:33.951348 ip-10-0-140-46 kubenswrapper[2576]: I0608 13:44:33.951325 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-storage-version-migrator/migrator-955ffdf5f-zqfkg" Jun 08 13:44:33.955839 ip-10-0-140-46 kubenswrapper[2576]: I0608 13:44:33.955814 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator\"/\"openshift-service-ca.crt\"" Jun 08 13:44:33.955839 ip-10-0-140-46 kubenswrapper[2576]: I0608 13:44:33.955830 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cx7sn_6e4b50fc-3e91-4f50-b92a-e90919788248/konnectivity-agent/0.log" limit=1024 Jun 08 13:44:33.956011 ip-10-0-140-46 kubenswrapper[2576]: I0608 13:44:33.955818 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator\"/\"kube-root-ca.crt\"" Jun 08 13:44:33.956011 ip-10-0-140-46 kubenswrapper[2576]: I0608 13:44:33.955873 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-kube-storage-version-migrator\"/\"kube-storage-version-migrator-sa-dockercfg-zddmv\"" Jun 08 13:44:33.975006 ip-10-0-140-46 kubenswrapper[2576]: I0608 13:44:33.974988 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-kube-storage-version-migrator/migrator-955ffdf5f-zqfkg"] Jun 08 13:44:34.079965 ip-10-0-140-46 kubenswrapper[2576]: I0608 13:44:34.079913 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cx7sn_6e4b50fc-3e91-4f50-b92a-e90919788248/konnectivity-agent/0.log" limit=1024 Jun 08 13:44:34.127349 ip-10-0-140-46 kubenswrapper[2576]: I0608 13:44:34.127323 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-whfjp\" (UniqueName: \"kubernetes.io/projected/676442f6-eac2-4c1f-a040-e8af0728ae41-kube-api-access-whfjp\") pod \"migrator-955ffdf5f-zqfkg\" (UID: \"676442f6-eac2-4c1f-a040-e8af0728ae41\") " pod="openshift-kube-storage-version-migrator/migrator-955ffdf5f-zqfkg" Jun 08 13:44:34.127448 ip-10-0-140-46 kubenswrapper[2576]: I0608 13:44:34.127367 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/6cf15e88-7b22-4dc1-9a9e-1dc73867afa3-networking-console-plugin-cert\") pod \"networking-console-plugin-d5d5bb78b-7g8ft\" (UID: \"6cf15e88-7b22-4dc1-9a9e-1dc73867afa3\") " pod="openshift-network-console/networking-console-plugin-d5d5bb78b-7g8ft" Jun 08 13:44:34.127504 ip-10-0-140-46 kubenswrapper[2576]: E0608 13:44:34.127477 2576 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found Jun 08 13:44:34.127543 ip-10-0-140-46 kubenswrapper[2576]: E0608 13:44:34.127527 2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/6cf15e88-7b22-4dc1-9a9e-1dc73867afa3-networking-console-plugin-cert podName:6cf15e88-7b22-4dc1-9a9e-1dc73867afa3 nodeName:}" failed. No retries permitted until 2026-06-08 13:44:35.127510656 +0000 UTC m=+43.206839526 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/6cf15e88-7b22-4dc1-9a9e-1dc73867afa3-networking-console-plugin-cert") pod "networking-console-plugin-d5d5bb78b-7g8ft" (UID: "6cf15e88-7b22-4dc1-9a9e-1dc73867afa3") : secret "networking-console-plugin-cert" not found Jun 08 13:44:34.228764 ip-10-0-140-46 kubenswrapper[2576]: I0608 13:44:34.228718 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-whfjp\" (UniqueName: \"kubernetes.io/projected/676442f6-eac2-4c1f-a040-e8af0728ae41-kube-api-access-whfjp\") pod \"migrator-955ffdf5f-zqfkg\" (UID: \"676442f6-eac2-4c1f-a040-e8af0728ae41\") " pod="openshift-kube-storage-version-migrator/migrator-955ffdf5f-zqfkg" Jun 08 13:44:34.250175 ip-10-0-140-46 kubenswrapper[2576]: I0608 13:44:34.250147 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-whfjp\" (UniqueName: \"kubernetes.io/projected/676442f6-eac2-4c1f-a040-e8af0728ae41-kube-api-access-whfjp\") pod \"migrator-955ffdf5f-zqfkg\" (UID: \"676442f6-eac2-4c1f-a040-e8af0728ae41\") " pod="openshift-kube-storage-version-migrator/migrator-955ffdf5f-zqfkg" Jun 08 13:44:34.251758 ip-10-0-140-46 kubenswrapper[2576]: I0608 13:44:34.251734 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cx7sn_6e4b50fc-3e91-4f50-b92a-e90919788248/konnectivity-agent/0.log" limit=1024 Jun 08 13:44:34.259639 ip-10-0-140-46 kubenswrapper[2576]: I0608 13:44:34.259621 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-storage-version-migrator/migrator-955ffdf5f-zqfkg" Jun 08 13:44:34.417379 ip-10-0-140-46 kubenswrapper[2576]: I0608 13:44:34.417343 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-kube-storage-version-migrator/migrator-955ffdf5f-zqfkg"] Jun 08 13:44:34.420524 ip-10-0-140-46 kubenswrapper[2576]: W0608 13:44:34.420495 2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod676442f6_eac2_4c1f_a040_e8af0728ae41.slice/crio-ca804e287e7acd7d2cc13f13d3155a47f81ac2e9d006510ed78254a741b3b2d2 WatchSource:0}: Error finding container ca804e287e7acd7d2cc13f13d3155a47f81ac2e9d006510ed78254a741b3b2d2: Status 404 returned error can't find the container with id ca804e287e7acd7d2cc13f13d3155a47f81ac2e9d006510ed78254a741b3b2d2 Jun 08 13:44:34.442389 ip-10-0-140-46 kubenswrapper[2576]: I0608 13:44:34.442349 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cx7sn_6e4b50fc-3e91-4f50-b92a-e90919788248/konnectivity-agent/0.log" limit=1024 Jun 08 13:44:34.561332 ip-10-0-140-46 kubenswrapper[2576]: I0608 13:44:34.561302 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cx7sn_6e4b50fc-3e91-4f50-b92a-e90919788248/konnectivity-agent/0.log" limit=1024 Jun 08 13:44:34.631482 ip-10-0-140-46 kubenswrapper[2576]: I0608 13:44:34.631460 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/3d97d05c-9d8f-4d01-8543-610bc38837c4-registry-tls\") pod \"image-registry-98b4d96dc-d224h\" (UID: \"3d97d05c-9d8f-4d01-8543-610bc38837c4\") " pod="openshift-image-registry/image-registry-98b4d96dc-d224h" Jun 08 13:44:34.631647 ip-10-0-140-46 kubenswrapper[2576]: E0608 13:44:34.631629 2576 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jun 08 13:44:34.631687 ip-10-0-140-46 kubenswrapper[2576]: E0608 13:44:34.631650 2576 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-98b4d96dc-d224h: secret "image-registry-tls" not found Jun 08 13:44:34.631728 ip-10-0-140-46 kubenswrapper[2576]: E0608 13:44:34.631698 2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/3d97d05c-9d8f-4d01-8543-610bc38837c4-registry-tls podName:3d97d05c-9d8f-4d01-8543-610bc38837c4 nodeName:}" failed. No retries permitted until 2026-06-08 13:44:42.631684395 +0000 UTC m=+50.711013265 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/3d97d05c-9d8f-4d01-8543-610bc38837c4-registry-tls") pod "image-registry-98b4d96dc-d224h" (UID: "3d97d05c-9d8f-4d01-8543-610bc38837c4") : secret "image-registry-tls" not found Jun 08 13:44:34.644876 ip-10-0-140-46 kubenswrapper[2576]: I0608 13:44:34.644855 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator/migrator-955ffdf5f-zqfkg" event={"ID":"676442f6-eac2-4c1f-a040-e8af0728ae41","Type":"ContainerStarted","Data":"ca804e287e7acd7d2cc13f13d3155a47f81ac2e9d006510ed78254a741b3b2d2"} Jun 08 13:44:34.731825 ip-10-0-140-46 kubenswrapper[2576]: I0608 13:44:34.731804 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/2ef5209f-d5f5-4fae-a86c-1bb23283f29a-metrics-tls\") pod \"dns-default-l52bl\" (UID: \"2ef5209f-d5f5-4fae-a86c-1bb23283f29a\") " pod="openshift-dns/dns-default-l52bl" Jun 08 13:44:34.731979 ip-10-0-140-46 kubenswrapper[2576]: E0608 13:44:34.731960 2576 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jun 08 13:44:34.732044 ip-10-0-140-46 kubenswrapper[2576]: E0608 13:44:34.732032 2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/2ef5209f-d5f5-4fae-a86c-1bb23283f29a-metrics-tls podName:2ef5209f-d5f5-4fae-a86c-1bb23283f29a nodeName:}" failed. No retries permitted until 2026-06-08 13:44:42.732012495 +0000 UTC m=+50.811341369 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/2ef5209f-d5f5-4fae-a86c-1bb23283f29a-metrics-tls") pod "dns-default-l52bl" (UID: "2ef5209f-d5f5-4fae-a86c-1bb23283f29a") : secret "dns-default-metrics-tls" not found Jun 08 13:44:34.858619 ip-10-0-140-46 kubenswrapper[2576]: I0608 13:44:34.858534 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cx7sn_6e4b50fc-3e91-4f50-b92a-e90919788248/konnectivity-agent/0.log" limit=1024 Jun 08 13:44:34.956960 ip-10-0-140-46 kubenswrapper[2576]: I0608 13:44:34.956934 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cx7sn_6e4b50fc-3e91-4f50-b92a-e90919788248/konnectivity-agent/0.log" limit=1024 Jun 08 13:44:35.086244 ip-10-0-140-46 kubenswrapper[2576]: I0608 13:44:35.086208 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cx7sn_6e4b50fc-3e91-4f50-b92a-e90919788248/konnectivity-agent/0.log" limit=1024 Jun 08 13:44:35.135262 ip-10-0-140-46 kubenswrapper[2576]: I0608 13:44:35.135179 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/6cf15e88-7b22-4dc1-9a9e-1dc73867afa3-networking-console-plugin-cert\") pod \"networking-console-plugin-d5d5bb78b-7g8ft\" (UID: \"6cf15e88-7b22-4dc1-9a9e-1dc73867afa3\") " pod="openshift-network-console/networking-console-plugin-d5d5bb78b-7g8ft" Jun 08 13:44:35.135421 ip-10-0-140-46 kubenswrapper[2576]: E0608 13:44:35.135352 2576 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found Jun 08 13:44:35.135479 ip-10-0-140-46 kubenswrapper[2576]: E0608 13:44:35.135430 2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/6cf15e88-7b22-4dc1-9a9e-1dc73867afa3-networking-console-plugin-cert podName:6cf15e88-7b22-4dc1-9a9e-1dc73867afa3 nodeName:}" failed. No retries permitted until 2026-06-08 13:44:37.135408944 +0000 UTC m=+45.214737819 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/6cf15e88-7b22-4dc1-9a9e-1dc73867afa3-networking-console-plugin-cert") pod "networking-console-plugin-d5d5bb78b-7g8ft" (UID: "6cf15e88-7b22-4dc1-9a9e-1dc73867afa3") : secret "networking-console-plugin-cert" not found Jun 08 13:44:35.175273 ip-10-0-140-46 kubenswrapper[2576]: I0608 13:44:35.175243 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cx7sn_6e4b50fc-3e91-4f50-b92a-e90919788248/konnectivity-agent/0.log" limit=1024 Jun 08 13:44:35.845097 ip-10-0-140-46 kubenswrapper[2576]: I0608 13:44:35.845055 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cx7sn_6e4b50fc-3e91-4f50-b92a-e90919788248/konnectivity-agent/0.log" limit=1024 Jun 08 13:44:35.908108 ip-10-0-140-46 kubenswrapper[2576]: I0608 13:44:35.908071 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cx7sn_6e4b50fc-3e91-4f50-b92a-e90919788248/konnectivity-agent/0.log" limit=1024 Jun 08 13:44:36.556856 ip-10-0-140-46 kubenswrapper[2576]: I0608 13:44:36.556831 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-f25db_2cf3d8d4-e8f9-402e-9fa7-b564c4ea705c/dns-node-resolver/0.log" Jun 08 13:44:36.651331 ip-10-0-140-46 kubenswrapper[2576]: I0608 13:44:36.651301 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator/migrator-955ffdf5f-zqfkg" event={"ID":"676442f6-eac2-4c1f-a040-e8af0728ae41","Type":"ContainerStarted","Data":"d5fd0cfd2c830212dda749f1fb0e286feab967351984d3581d3481dff0b036b3"} Jun 08 13:44:36.651465 ip-10-0-140-46 kubenswrapper[2576]: I0608 13:44:36.651351 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator/migrator-955ffdf5f-zqfkg" event={"ID":"676442f6-eac2-4c1f-a040-e8af0728ae41","Type":"ContainerStarted","Data":"19b03f27c6c5389d537c6c16fd4de124a745a1f41129550c1a72f171cf30976f"} Jun 08 13:44:36.678177 ip-10-0-140-46 kubenswrapper[2576]: I0608 13:44:36.678130 2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-kube-storage-version-migrator/migrator-955ffdf5f-zqfkg" podStartSLOduration=2.118770592 podStartE2EDuration="3.678117124s" totalImagesPullingTime="1.559346532s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-08 13:44:33 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-08 13:44:36.676370607 +0000 UTC m=+44.755699506" watchObservedRunningTime="2026-06-08 13:44:36.678117124 +0000 UTC m=+44.757446016" Jun 08 13:44:36.729975 ip-10-0-140-46 kubenswrapper[2576]: I0608 13:44:36.729949 2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-service-ca/service-ca-7d74d578b8-9shw9"] Jun 08 13:44:36.754010 ip-10-0-140-46 kubenswrapper[2576]: I0608 13:44:36.753991 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-service-ca/service-ca-7d74d578b8-9shw9"] Jun 08 13:44:36.754090 ip-10-0-140-46 kubenswrapper[2576]: I0608 13:44:36.754064 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-service-ca/service-ca-7d74d578b8-9shw9" Jun 08 13:44:36.758668 ip-10-0-140-46 kubenswrapper[2576]: I0608 13:44:36.758651 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-service-ca\"/\"service-ca-dockercfg-qrzr4\"" Jun 08 13:44:36.758884 ip-10-0-140-46 kubenswrapper[2576]: I0608 13:44:36.758870 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca\"/\"signing-cabundle\"" Jun 08 13:44:36.758988 ip-10-0-140-46 kubenswrapper[2576]: I0608 13:44:36.758956 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca\"/\"kube-root-ca.crt\"" Jun 08 13:44:36.759087 ip-10-0-140-46 kubenswrapper[2576]: I0608 13:44:36.759010 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca\"/\"openshift-service-ca.crt\"" Jun 08 13:44:36.759087 ip-10-0-140-46 kubenswrapper[2576]: I0608 13:44:36.759064 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-service-ca\"/\"signing-key\"" Jun 08 13:44:36.773935 ip-10-0-140-46 kubenswrapper[2576]: I0608 13:44:36.773903 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cx7sn_6e4b50fc-3e91-4f50-b92a-e90919788248/konnectivity-agent/0.log" limit=1024 Jun 08 13:44:36.848963 ip-10-0-140-46 kubenswrapper[2576]: I0608 13:44:36.848910 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"signing-key\" (UniqueName: \"kubernetes.io/secret/909a4a9a-52ed-4e2e-8a25-2abc021773ee-signing-key\") pod \"service-ca-7d74d578b8-9shw9\" (UID: \"909a4a9a-52ed-4e2e-8a25-2abc021773ee\") " pod="openshift-service-ca/service-ca-7d74d578b8-9shw9" Jun 08 13:44:36.848963 ip-10-0-140-46 kubenswrapper[2576]: I0608 13:44:36.848937 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"signing-cabundle\" (UniqueName: \"kubernetes.io/configmap/909a4a9a-52ed-4e2e-8a25-2abc021773ee-signing-cabundle\") pod \"service-ca-7d74d578b8-9shw9\" (UID: \"909a4a9a-52ed-4e2e-8a25-2abc021773ee\") " pod="openshift-service-ca/service-ca-7d74d578b8-9shw9" Jun 08 13:44:36.849294 ip-10-0-140-46 kubenswrapper[2576]: I0608 13:44:36.848971 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4h47w\" (UniqueName: \"kubernetes.io/projected/909a4a9a-52ed-4e2e-8a25-2abc021773ee-kube-api-access-4h47w\") pod \"service-ca-7d74d578b8-9shw9\" (UID: \"909a4a9a-52ed-4e2e-8a25-2abc021773ee\") " pod="openshift-service-ca/service-ca-7d74d578b8-9shw9" Jun 08 13:44:36.867281 ip-10-0-140-46 kubenswrapper[2576]: I0608 13:44:36.867259 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cx7sn_6e4b50fc-3e91-4f50-b92a-e90919788248/konnectivity-agent/0.log" limit=1024 Jun 08 13:44:36.949705 ip-10-0-140-46 kubenswrapper[2576]: I0608 13:44:36.949675 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"signing-key\" (UniqueName: \"kubernetes.io/secret/909a4a9a-52ed-4e2e-8a25-2abc021773ee-signing-key\") pod \"service-ca-7d74d578b8-9shw9\" (UID: \"909a4a9a-52ed-4e2e-8a25-2abc021773ee\") " pod="openshift-service-ca/service-ca-7d74d578b8-9shw9" Jun 08 13:44:36.949705 ip-10-0-140-46 kubenswrapper[2576]: I0608 13:44:36.949708 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"signing-cabundle\" (UniqueName: \"kubernetes.io/configmap/909a4a9a-52ed-4e2e-8a25-2abc021773ee-signing-cabundle\") pod \"service-ca-7d74d578b8-9shw9\" (UID: \"909a4a9a-52ed-4e2e-8a25-2abc021773ee\") " pod="openshift-service-ca/service-ca-7d74d578b8-9shw9" Jun 08 13:44:36.949856 ip-10-0-140-46 kubenswrapper[2576]: I0608 13:44:36.949747 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4h47w\" (UniqueName: \"kubernetes.io/projected/909a4a9a-52ed-4e2e-8a25-2abc021773ee-kube-api-access-4h47w\") pod \"service-ca-7d74d578b8-9shw9\" (UID: \"909a4a9a-52ed-4e2e-8a25-2abc021773ee\") " pod="openshift-service-ca/service-ca-7d74d578b8-9shw9" Jun 08 13:44:36.950294 ip-10-0-140-46 kubenswrapper[2576]: I0608 13:44:36.950274 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"signing-cabundle\" (UniqueName: \"kubernetes.io/configmap/909a4a9a-52ed-4e2e-8a25-2abc021773ee-signing-cabundle\") pod \"service-ca-7d74d578b8-9shw9\" (UID: \"909a4a9a-52ed-4e2e-8a25-2abc021773ee\") " pod="openshift-service-ca/service-ca-7d74d578b8-9shw9" Jun 08 13:44:36.952051 ip-10-0-140-46 kubenswrapper[2576]: I0608 13:44:36.952028 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"signing-key\" (UniqueName: \"kubernetes.io/secret/909a4a9a-52ed-4e2e-8a25-2abc021773ee-signing-key\") pod \"service-ca-7d74d578b8-9shw9\" (UID: \"909a4a9a-52ed-4e2e-8a25-2abc021773ee\") " pod="openshift-service-ca/service-ca-7d74d578b8-9shw9" Jun 08 13:44:36.960171 ip-10-0-140-46 kubenswrapper[2576]: I0608 13:44:36.960145 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-4h47w\" (UniqueName: \"kubernetes.io/projected/909a4a9a-52ed-4e2e-8a25-2abc021773ee-kube-api-access-4h47w\") pod \"service-ca-7d74d578b8-9shw9\" (UID: \"909a4a9a-52ed-4e2e-8a25-2abc021773ee\") " pod="openshift-service-ca/service-ca-7d74d578b8-9shw9" Jun 08 13:44:37.063548 ip-10-0-140-46 kubenswrapper[2576]: I0608 13:44:37.063519 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-service-ca/service-ca-7d74d578b8-9shw9" Jun 08 13:44:37.151742 ip-10-0-140-46 kubenswrapper[2576]: I0608 13:44:37.151678 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/6cf15e88-7b22-4dc1-9a9e-1dc73867afa3-networking-console-plugin-cert\") pod \"networking-console-plugin-d5d5bb78b-7g8ft\" (UID: \"6cf15e88-7b22-4dc1-9a9e-1dc73867afa3\") " pod="openshift-network-console/networking-console-plugin-d5d5bb78b-7g8ft" Jun 08 13:44:37.151895 ip-10-0-140-46 kubenswrapper[2576]: E0608 13:44:37.151867 2576 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found Jun 08 13:44:37.151966 ip-10-0-140-46 kubenswrapper[2576]: E0608 13:44:37.151947 2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/6cf15e88-7b22-4dc1-9a9e-1dc73867afa3-networking-console-plugin-cert podName:6cf15e88-7b22-4dc1-9a9e-1dc73867afa3 nodeName:}" failed. No retries permitted until 2026-06-08 13:44:41.151925662 +0000 UTC m=+49.231254534 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/6cf15e88-7b22-4dc1-9a9e-1dc73867afa3-networking-console-plugin-cert") pod "networking-console-plugin-d5d5bb78b-7g8ft" (UID: "6cf15e88-7b22-4dc1-9a9e-1dc73867afa3") : secret "networking-console-plugin-cert" not found Jun 08 13:44:37.209024 ip-10-0-140-46 kubenswrapper[2576]: I0608 13:44:37.208995 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-service-ca/service-ca-7d74d578b8-9shw9"] Jun 08 13:44:37.212005 ip-10-0-140-46 kubenswrapper[2576]: W0608 13:44:37.211977 2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod909a4a9a_52ed_4e2e_8a25_2abc021773ee.slice/crio-b740de3c90012b6e4280fd5019418523d5ec96b006125dcd1440a03547b1afbf WatchSource:0}: Error finding container b740de3c90012b6e4280fd5019418523d5ec96b006125dcd1440a03547b1afbf: Status 404 returned error can't find the container with id b740de3c90012b6e4280fd5019418523d5ec96b006125dcd1440a03547b1afbf Jun 08 13:44:37.244889 ip-10-0-140-46 kubenswrapper[2576]: I0608 13:44:37.244864 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cx7sn_6e4b50fc-3e91-4f50-b92a-e90919788248/konnectivity-agent/0.log" limit=1024 Jun 08 13:44:37.350204 ip-10-0-140-46 kubenswrapper[2576]: I0608 13:44:37.350181 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-gcmjl_8e1453fa-6b1d-4b93-98cf-5fe4d2829935/node-ca/0.log" Jun 08 13:44:37.350413 ip-10-0-140-46 kubenswrapper[2576]: I0608 13:44:37.350397 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cx7sn_6e4b50fc-3e91-4f50-b92a-e90919788248/konnectivity-agent/0.log" limit=1024 Jun 08 13:44:37.655847 ip-10-0-140-46 kubenswrapper[2576]: I0608 13:44:37.655805 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca/service-ca-7d74d578b8-9shw9" event={"ID":"909a4a9a-52ed-4e2e-8a25-2abc021773ee","Type":"ContainerStarted","Data":"b740de3c90012b6e4280fd5019418523d5ec96b006125dcd1440a03547b1afbf"} Jun 08 13:44:38.161522 ip-10-0-140-46 kubenswrapper[2576]: I0608 13:44:38.161499 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-5stwl_aa1c8cf7-33d3-46fe-963b-c40cb5fd9674/serve-healthcheck-canary/0.log" Jun 08 13:44:38.260921 ip-10-0-140-46 kubenswrapper[2576]: I0608 13:44:38.260884 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cx7sn_6e4b50fc-3e91-4f50-b92a-e90919788248/konnectivity-agent/0.log" limit=1024 Jun 08 13:44:38.548325 ip-10-0-140-46 kubenswrapper[2576]: I0608 13:44:38.548280 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator_migrator-955ffdf5f-zqfkg_676442f6-eac2-4c1f-a040-e8af0728ae41/migrator/0.log" Jun 08 13:44:38.746200 ip-10-0-140-46 kubenswrapper[2576]: I0608 13:44:38.746152 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator_migrator-955ffdf5f-zqfkg_676442f6-eac2-4c1f-a040-e8af0728ae41/graceful-termination/0.log" Jun 08 13:44:39.662864 ip-10-0-140-46 kubenswrapper[2576]: I0608 13:44:39.662829 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca/service-ca-7d74d578b8-9shw9" event={"ID":"909a4a9a-52ed-4e2e-8a25-2abc021773ee","Type":"ContainerStarted","Data":"f82362dfff19dbb97a745601db9b2abdb80fa3afcd22867f153e851aaeef93c8"} Jun 08 13:44:39.692098 ip-10-0-140-46 kubenswrapper[2576]: I0608 13:44:39.692055 2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-service-ca/service-ca-7d74d578b8-9shw9" podStartSLOduration=1.633976874 podStartE2EDuration="3.692040938s" totalImagesPullingTime="2.058064064s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-08 13:44:36 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-08 13:44:39.691729727 +0000 UTC m=+47.771058619" watchObservedRunningTime="2026-06-08 13:44:39.692040938 +0000 UTC m=+47.771369879" Jun 08 13:44:40.386011 ip-10-0-140-46 kubenswrapper[2576]: I0608 13:44:40.385934 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cx7sn_6e4b50fc-3e91-4f50-b92a-e90919788248/konnectivity-agent/0.log" limit=1024 Jun 08 13:44:40.496186 ip-10-0-140-46 kubenswrapper[2576]: I0608 13:44:40.496145 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cx7sn_6e4b50fc-3e91-4f50-b92a-e90919788248/konnectivity-agent/0.log" limit=1024 Jun 08 13:44:40.631349 ip-10-0-140-46 kubenswrapper[2576]: I0608 13:44:40.631251 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cx7sn_6e4b50fc-3e91-4f50-b92a-e90919788248/konnectivity-agent/0.log" limit=1024 Jun 08 13:44:40.714017 ip-10-0-140-46 kubenswrapper[2576]: I0608 13:44:40.713945 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cx7sn_6e4b50fc-3e91-4f50-b92a-e90919788248/konnectivity-agent/0.log" limit=1024 Jun 08 13:44:40.817165 ip-10-0-140-46 kubenswrapper[2576]: I0608 13:44:40.817128 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cx7sn_6e4b50fc-3e91-4f50-b92a-e90919788248/konnectivity-agent/0.log" limit=1024 Jun 08 13:44:40.934714 ip-10-0-140-46 kubenswrapper[2576]: I0608 13:44:40.934686 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cx7sn_6e4b50fc-3e91-4f50-b92a-e90919788248/konnectivity-agent/0.log" limit=1024 Jun 08 13:44:41.060740 ip-10-0-140-46 kubenswrapper[2576]: I0608 13:44:41.060713 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cx7sn_6e4b50fc-3e91-4f50-b92a-e90919788248/konnectivity-agent/0.log" limit=1024 Jun 08 13:44:41.133594 ip-10-0-140-46 kubenswrapper[2576]: I0608 13:44:41.133544 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cx7sn_6e4b50fc-3e91-4f50-b92a-e90919788248/konnectivity-agent/0.log" limit=1024 Jun 08 13:44:41.195426 ip-10-0-140-46 kubenswrapper[2576]: I0608 13:44:41.195398 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/6cf15e88-7b22-4dc1-9a9e-1dc73867afa3-networking-console-plugin-cert\") pod \"networking-console-plugin-d5d5bb78b-7g8ft\" (UID: \"6cf15e88-7b22-4dc1-9a9e-1dc73867afa3\") " pod="openshift-network-console/networking-console-plugin-d5d5bb78b-7g8ft" Jun 08 13:44:41.195560 ip-10-0-140-46 kubenswrapper[2576]: E0608 13:44:41.195542 2576 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found Jun 08 13:44:41.195638 ip-10-0-140-46 kubenswrapper[2576]: E0608 13:44:41.195628 2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/6cf15e88-7b22-4dc1-9a9e-1dc73867afa3-networking-console-plugin-cert podName:6cf15e88-7b22-4dc1-9a9e-1dc73867afa3 nodeName:}" failed. No retries permitted until 2026-06-08 13:44:49.195608169 +0000 UTC m=+57.274937040 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/6cf15e88-7b22-4dc1-9a9e-1dc73867afa3-networking-console-plugin-cert") pod "networking-console-plugin-d5d5bb78b-7g8ft" (UID: "6cf15e88-7b22-4dc1-9a9e-1dc73867afa3") : secret "networking-console-plugin-cert" not found Jun 08 13:44:42.242807 ip-10-0-140-46 kubenswrapper[2576]: I0608 13:44:42.242775 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cx7sn_6e4b50fc-3e91-4f50-b92a-e90919788248/konnectivity-agent/0.log" limit=1024 Jun 08 13:44:42.460407 ip-10-0-140-46 kubenswrapper[2576]: I0608 13:44:42.460373 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cx7sn_6e4b50fc-3e91-4f50-b92a-e90919788248/konnectivity-agent/0.log" limit=1024 Jun 08 13:44:42.634015 ip-10-0-140-46 kubenswrapper[2576]: I0608 13:44:42.633985 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cx7sn_6e4b50fc-3e91-4f50-b92a-e90919788248/konnectivity-agent/0.log" limit=1024 Jun 08 13:44:42.707796 ip-10-0-140-46 kubenswrapper[2576]: I0608 13:44:42.707769 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/3d97d05c-9d8f-4d01-8543-610bc38837c4-registry-tls\") pod \"image-registry-98b4d96dc-d224h\" (UID: \"3d97d05c-9d8f-4d01-8543-610bc38837c4\") " pod="openshift-image-registry/image-registry-98b4d96dc-d224h" Jun 08 13:44:42.707940 ip-10-0-140-46 kubenswrapper[2576]: E0608 13:44:42.707881 2576 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jun 08 13:44:42.707940 ip-10-0-140-46 kubenswrapper[2576]: E0608 13:44:42.707893 2576 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-98b4d96dc-d224h: secret "image-registry-tls" not found Jun 08 13:44:42.708062 ip-10-0-140-46 kubenswrapper[2576]: E0608 13:44:42.707949 2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/3d97d05c-9d8f-4d01-8543-610bc38837c4-registry-tls podName:3d97d05c-9d8f-4d01-8543-610bc38837c4 nodeName:}" failed. No retries permitted until 2026-06-08 13:44:58.707933932 +0000 UTC m=+66.787262818 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/3d97d05c-9d8f-4d01-8543-610bc38837c4-registry-tls") pod "image-registry-98b4d96dc-d224h" (UID: "3d97d05c-9d8f-4d01-8543-610bc38837c4") : secret "image-registry-tls" not found Jun 08 13:44:42.808322 ip-10-0-140-46 kubenswrapper[2576]: I0608 13:44:42.808289 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/2ef5209f-d5f5-4fae-a86c-1bb23283f29a-metrics-tls\") pod \"dns-default-l52bl\" (UID: \"2ef5209f-d5f5-4fae-a86c-1bb23283f29a\") " pod="openshift-dns/dns-default-l52bl" Jun 08 13:44:42.808486 ip-10-0-140-46 kubenswrapper[2576]: E0608 13:44:42.808355 2576 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jun 08 13:44:42.808486 ip-10-0-140-46 kubenswrapper[2576]: E0608 13:44:42.808421 2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/2ef5209f-d5f5-4fae-a86c-1bb23283f29a-metrics-tls podName:2ef5209f-d5f5-4fae-a86c-1bb23283f29a nodeName:}" failed. No retries permitted until 2026-06-08 13:44:58.808403489 +0000 UTC m=+66.887732361 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/2ef5209f-d5f5-4fae-a86c-1bb23283f29a-metrics-tls") pod "dns-default-l52bl" (UID: "2ef5209f-d5f5-4fae-a86c-1bb23283f29a") : secret "dns-default-metrics-tls" not found Jun 08 13:44:42.845942 ip-10-0-140-46 kubenswrapper[2576]: I0608 13:44:42.845910 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cx7sn_6e4b50fc-3e91-4f50-b92a-e90919788248/konnectivity-agent/0.log" limit=1024 Jun 08 13:44:43.038719 ip-10-0-140-46 kubenswrapper[2576]: I0608 13:44:43.038685 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cx7sn_6e4b50fc-3e91-4f50-b92a-e90919788248/konnectivity-agent/0.log" limit=1024 Jun 08 13:44:43.757684 ip-10-0-140-46 kubenswrapper[2576]: I0608 13:44:43.757646 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cx7sn_6e4b50fc-3e91-4f50-b92a-e90919788248/konnectivity-agent/0.log" limit=1024 Jun 08 13:44:44.030538 ip-10-0-140-46 kubenswrapper[2576]: I0608 13:44:44.030509 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cx7sn_6e4b50fc-3e91-4f50-b92a-e90919788248/konnectivity-agent/0.log" limit=1024 Jun 08 13:44:44.100839 ip-10-0-140-46 kubenswrapper[2576]: I0608 13:44:44.100813 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cx7sn_6e4b50fc-3e91-4f50-b92a-e90919788248/konnectivity-agent/0.log" limit=1024 Jun 08 13:44:44.450558 ip-10-0-140-46 kubenswrapper[2576]: I0608 13:44:44.450474 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cx7sn_6e4b50fc-3e91-4f50-b92a-e90919788248/konnectivity-agent/0.log" limit=1024 Jun 08 13:44:44.645517 ip-10-0-140-46 kubenswrapper[2576]: I0608 13:44:44.645480 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cx7sn_6e4b50fc-3e91-4f50-b92a-e90919788248/konnectivity-agent/0.log" limit=1024 Jun 08 13:44:44.718231 ip-10-0-140-46 kubenswrapper[2576]: I0608 13:44:44.718162 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cx7sn_6e4b50fc-3e91-4f50-b92a-e90919788248/konnectivity-agent/0.log" limit=1024 Jun 08 13:44:44.828074 ip-10-0-140-46 kubenswrapper[2576]: I0608 13:44:44.828047 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cx7sn_6e4b50fc-3e91-4f50-b92a-e90919788248/konnectivity-agent/0.log" limit=1024 Jun 08 13:44:45.189660 ip-10-0-140-46 kubenswrapper[2576]: I0608 13:44:45.189631 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cx7sn_6e4b50fc-3e91-4f50-b92a-e90919788248/konnectivity-agent/0.log" limit=1024 Jun 08 13:44:45.289793 ip-10-0-140-46 kubenswrapper[2576]: I0608 13:44:45.289759 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cx7sn_6e4b50fc-3e91-4f50-b92a-e90919788248/konnectivity-agent/0.log" limit=1024 Jun 08 13:44:45.860939 ip-10-0-140-46 kubenswrapper[2576]: I0608 13:44:45.860906 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cx7sn_6e4b50fc-3e91-4f50-b92a-e90919788248/konnectivity-agent/0.log" limit=1024 Jun 08 13:44:46.037764 ip-10-0-140-46 kubenswrapper[2576]: I0608 13:44:46.037732 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cx7sn_6e4b50fc-3e91-4f50-b92a-e90919788248/konnectivity-agent/0.log" limit=1024 Jun 08 13:44:46.221487 ip-10-0-140-46 kubenswrapper[2576]: I0608 13:44:46.221408 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cx7sn_6e4b50fc-3e91-4f50-b92a-e90919788248/konnectivity-agent/0.log" limit=1024 Jun 08 13:44:46.652221 ip-10-0-140-46 kubenswrapper[2576]: I0608 13:44:46.652186 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cx7sn_6e4b50fc-3e91-4f50-b92a-e90919788248/konnectivity-agent/0.log" limit=1024 Jun 08 13:44:47.249689 ip-10-0-140-46 kubenswrapper[2576]: I0608 13:44:47.249657 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cx7sn_6e4b50fc-3e91-4f50-b92a-e90919788248/konnectivity-agent/0.log" limit=1024 Jun 08 13:44:47.421959 ip-10-0-140-46 kubenswrapper[2576]: I0608 13:44:47.421929 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cx7sn_6e4b50fc-3e91-4f50-b92a-e90919788248/konnectivity-agent/0.log" limit=1024 Jun 08 13:44:47.819354 ip-10-0-140-46 kubenswrapper[2576]: I0608 13:44:47.819324 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cx7sn_6e4b50fc-3e91-4f50-b92a-e90919788248/konnectivity-agent/0.log" limit=1024 Jun 08 13:44:48.025139 ip-10-0-140-46 kubenswrapper[2576]: I0608 13:44:48.025106 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cx7sn_6e4b50fc-3e91-4f50-b92a-e90919788248/konnectivity-agent/0.log" limit=1024 Jun 08 13:44:48.430455 ip-10-0-140-46 kubenswrapper[2576]: I0608 13:44:48.430419 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cx7sn_6e4b50fc-3e91-4f50-b92a-e90919788248/konnectivity-agent/0.log" limit=1024 Jun 08 13:44:49.224694 ip-10-0-140-46 kubenswrapper[2576]: I0608 13:44:49.224663 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cx7sn_6e4b50fc-3e91-4f50-b92a-e90919788248/konnectivity-agent/0.log" limit=1024 Jun 08 13:44:49.255597 ip-10-0-140-46 kubenswrapper[2576]: I0608 13:44:49.255556 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/6cf15e88-7b22-4dc1-9a9e-1dc73867afa3-networking-console-plugin-cert\") pod \"networking-console-plugin-d5d5bb78b-7g8ft\" (UID: \"6cf15e88-7b22-4dc1-9a9e-1dc73867afa3\") " pod="openshift-network-console/networking-console-plugin-d5d5bb78b-7g8ft" Jun 08 13:44:49.258561 ip-10-0-140-46 kubenswrapper[2576]: I0608 13:44:49.258528 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/6cf15e88-7b22-4dc1-9a9e-1dc73867afa3-networking-console-plugin-cert\") pod \"networking-console-plugin-d5d5bb78b-7g8ft\" (UID: \"6cf15e88-7b22-4dc1-9a9e-1dc73867afa3\") " pod="openshift-network-console/networking-console-plugin-d5d5bb78b-7g8ft" Jun 08 13:44:49.280496 ip-10-0-140-46 kubenswrapper[2576]: I0608 13:44:49.280473 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-console/networking-console-plugin-d5d5bb78b-7g8ft" Jun 08 13:44:49.408025 ip-10-0-140-46 kubenswrapper[2576]: I0608 13:44:49.407992 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-console/networking-console-plugin-d5d5bb78b-7g8ft"] Jun 08 13:44:49.414482 ip-10-0-140-46 kubenswrapper[2576]: W0608 13:44:49.414448 2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6cf15e88_7b22_4dc1_9a9e_1dc73867afa3.slice/crio-72862cab156a3c724ccba6db2ede5e6ea17b65cf70cca317b2eb71f6d19794cf WatchSource:0}: Error finding container 72862cab156a3c724ccba6db2ede5e6ea17b65cf70cca317b2eb71f6d19794cf: Status 404 returned error can't find the container with id 72862cab156a3c724ccba6db2ede5e6ea17b65cf70cca317b2eb71f6d19794cf Jun 08 13:44:49.427455 ip-10-0-140-46 kubenswrapper[2576]: I0608 13:44:49.427431 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cx7sn_6e4b50fc-3e91-4f50-b92a-e90919788248/konnectivity-agent/0.log" limit=1024 Jun 08 13:44:49.686519 ip-10-0-140-46 kubenswrapper[2576]: I0608 13:44:49.686485 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-console/networking-console-plugin-d5d5bb78b-7g8ft" event={"ID":"6cf15e88-7b22-4dc1-9a9e-1dc73867afa3","Type":"ContainerStarted","Data":"72862cab156a3c724ccba6db2ede5e6ea17b65cf70cca317b2eb71f6d19794cf"} Jun 08 13:44:49.835651 ip-10-0-140-46 kubenswrapper[2576]: I0608 13:44:49.835620 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cx7sn_6e4b50fc-3e91-4f50-b92a-e90919788248/konnectivity-agent/0.log" limit=1024 Jun 08 13:44:50.038843 ip-10-0-140-46 kubenswrapper[2576]: I0608 13:44:50.038809 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cx7sn_6e4b50fc-3e91-4f50-b92a-e90919788248/konnectivity-agent/0.log" limit=1024 Jun 08 13:44:50.424144 ip-10-0-140-46 kubenswrapper[2576]: I0608 13:44:50.424120 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cx7sn_6e4b50fc-3e91-4f50-b92a-e90919788248/konnectivity-agent/0.log" limit=1024 Jun 08 13:44:50.690935 ip-10-0-140-46 kubenswrapper[2576]: I0608 13:44:50.690859 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-console/networking-console-plugin-d5d5bb78b-7g8ft" event={"ID":"6cf15e88-7b22-4dc1-9a9e-1dc73867afa3","Type":"ContainerStarted","Data":"20b90b96b6d75dd682f55660a2d5446f47653cfc467a866d322ab1673368f25a"} Jun 08 13:44:50.714111 ip-10-0-140-46 kubenswrapper[2576]: I0608 13:44:50.714049 2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-console/networking-console-plugin-d5d5bb78b-7g8ft" podStartSLOduration=16.781484659 podStartE2EDuration="17.714031552s" totalImagesPullingTime="932.546893ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-08 13:44:33 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-08 13:44:50.713021214 +0000 UTC m=+58.792350106" watchObservedRunningTime="2026-06-08 13:44:50.714031552 +0000 UTC m=+58.793360443" Jun 08 13:44:50.830446 ip-10-0-140-46 kubenswrapper[2576]: I0608 13:44:50.830414 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cx7sn_6e4b50fc-3e91-4f50-b92a-e90919788248/konnectivity-agent/0.log" limit=1024 Jun 08 13:44:51.005829 ip-10-0-140-46 kubenswrapper[2576]: I0608 13:44:51.005755 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cx7sn_6e4b50fc-3e91-4f50-b92a-e90919788248/konnectivity-agent/0.log" limit=1024 Jun 08 13:44:51.096265 ip-10-0-140-46 kubenswrapper[2576]: I0608 13:44:51.096241 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cx7sn_6e4b50fc-3e91-4f50-b92a-e90919788248/konnectivity-agent/0.log" limit=1024 Jun 08 13:44:51.226304 ip-10-0-140-46 kubenswrapper[2576]: I0608 13:44:51.226276 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cx7sn_6e4b50fc-3e91-4f50-b92a-e90919788248/konnectivity-agent/0.log" limit=1024 Jun 08 13:44:51.309774 ip-10-0-140-46 kubenswrapper[2576]: I0608 13:44:51.309748 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cx7sn_6e4b50fc-3e91-4f50-b92a-e90919788248/konnectivity-agent/0.log" limit=1024 Jun 08 13:44:51.492164 ip-10-0-140-46 kubenswrapper[2576]: I0608 13:44:51.492133 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cx7sn_6e4b50fc-3e91-4f50-b92a-e90919788248/konnectivity-agent/0.log" limit=1024 Jun 08 13:44:51.553114 ip-10-0-140-46 kubenswrapper[2576]: I0608 13:44:51.553085 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cx7sn_6e4b50fc-3e91-4f50-b92a-e90919788248/konnectivity-agent/0.log" limit=1024 Jun 08 13:44:51.663242 ip-10-0-140-46 kubenswrapper[2576]: I0608 13:44:51.663164 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cx7sn_6e4b50fc-3e91-4f50-b92a-e90919788248/konnectivity-agent/0.log" limit=1024 Jun 08 13:44:51.761830 ip-10-0-140-46 kubenswrapper[2576]: I0608 13:44:51.761803 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cx7sn_6e4b50fc-3e91-4f50-b92a-e90919788248/konnectivity-agent/0.log" limit=1024 Jun 08 13:44:52.057155 ip-10-0-140-46 kubenswrapper[2576]: I0608 13:44:52.057123 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cx7sn_6e4b50fc-3e91-4f50-b92a-e90919788248/konnectivity-agent/0.log" limit=1024 Jun 08 13:44:52.130014 ip-10-0-140-46 kubenswrapper[2576]: I0608 13:44:52.129979 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cx7sn_6e4b50fc-3e91-4f50-b92a-e90919788248/konnectivity-agent/0.log" limit=1024 Jun 08 13:44:52.250428 ip-10-0-140-46 kubenswrapper[2576]: I0608 13:44:52.250393 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cx7sn_6e4b50fc-3e91-4f50-b92a-e90919788248/konnectivity-agent/0.log" limit=1024 Jun 08 13:44:52.309788 ip-10-0-140-46 kubenswrapper[2576]: I0608 13:44:52.309725 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cx7sn_6e4b50fc-3e91-4f50-b92a-e90919788248/konnectivity-agent/0.log" limit=1024 Jun 08 13:44:52.497046 ip-10-0-140-46 kubenswrapper[2576]: I0608 13:44:52.497011 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cx7sn_6e4b50fc-3e91-4f50-b92a-e90919788248/konnectivity-agent/0.log" limit=1024 Jun 08 13:44:52.610066 ip-10-0-140-46 kubenswrapper[2576]: I0608 13:44:52.609989 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cx7sn_6e4b50fc-3e91-4f50-b92a-e90919788248/konnectivity-agent/0.log" limit=1024 Jun 08 13:44:52.695698 ip-10-0-140-46 kubenswrapper[2576]: I0608 13:44:52.695658 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cx7sn_6e4b50fc-3e91-4f50-b92a-e90919788248/konnectivity-agent/0.log" limit=1024 Jun 08 13:44:52.901556 ip-10-0-140-46 kubenswrapper[2576]: I0608 13:44:52.901480 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cx7sn_6e4b50fc-3e91-4f50-b92a-e90919788248/konnectivity-agent/0.log" limit=1024 Jun 08 13:44:53.453549 ip-10-0-140-46 kubenswrapper[2576]: I0608 13:44:53.453516 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cx7sn_6e4b50fc-3e91-4f50-b92a-e90919788248/konnectivity-agent/0.log" limit=1024 Jun 08 13:44:53.613404 ip-10-0-140-46 kubenswrapper[2576]: I0608 13:44:53.613375 2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-ncffd" Jun 08 13:44:57.113325 ip-10-0-140-46 kubenswrapper[2576]: I0608 13:44:57.113283 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/6da5a732-b003-412c-8308-e80cead7eb1c-original-pull-secret\") pod \"global-pull-secret-syncer-dm2n6\" (UID: \"6da5a732-b003-412c-8308-e80cead7eb1c\") " pod="kube-system/global-pull-secret-syncer-dm2n6" Jun 08 13:44:57.113803 ip-10-0-140-46 kubenswrapper[2576]: I0608 13:44:57.113336 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/52fab817-1614-450d-8ea9-d10e21821af6-metrics-certs\") pod \"network-metrics-daemon-l62qm\" (UID: \"52fab817-1614-450d-8ea9-d10e21821af6\") " pod="openshift-multus/network-metrics-daemon-l62qm" Jun 08 13:44:57.115848 ip-10-0-140-46 kubenswrapper[2576]: I0608 13:44:57.115831 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\"" Jun 08 13:44:57.115898 ip-10-0-140-46 kubenswrapper[2576]: I0608 13:44:57.115832 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\"" Jun 08 13:44:57.126363 ip-10-0-140-46 kubenswrapper[2576]: I0608 13:44:57.126340 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/52fab817-1614-450d-8ea9-d10e21821af6-metrics-certs\") pod \"network-metrics-daemon-l62qm\" (UID: \"52fab817-1614-450d-8ea9-d10e21821af6\") " pod="openshift-multus/network-metrics-daemon-l62qm" Jun 08 13:44:57.126363 ip-10-0-140-46 kubenswrapper[2576]: I0608 13:44:57.126358 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/6da5a732-b003-412c-8308-e80cead7eb1c-original-pull-secret\") pod \"global-pull-secret-syncer-dm2n6\" (UID: \"6da5a732-b003-412c-8308-e80cead7eb1c\") " pod="kube-system/global-pull-secret-syncer-dm2n6" Jun 08 13:44:57.175022 ip-10-0-140-46 kubenswrapper[2576]: I0608 13:44:57.174998 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cx7sn_6e4b50fc-3e91-4f50-b92a-e90919788248/konnectivity-agent/0.log" limit=1024 Jun 08 13:44:57.195217 ip-10-0-140-46 kubenswrapper[2576]: I0608 13:44:57.195196 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-sxqjm\"" Jun 08 13:44:57.198270 ip-10-0-140-46 kubenswrapper[2576]: I0608 13:44:57.198256 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-dm2n6" Jun 08 13:44:57.204243 ip-10-0-140-46 kubenswrapper[2576]: I0608 13:44:57.204226 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-l62qm" Jun 08 13:44:57.214184 ip-10-0-140-46 kubenswrapper[2576]: I0608 13:44:57.214159 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5jttb\" (UniqueName: \"kubernetes.io/projected/4b283339-40c0-40f5-b9d9-c75e99e4f984-kube-api-access-5jttb\") pod \"network-check-target-99957\" (UID: \"4b283339-40c0-40f5-b9d9-c75e99e4f984\") " pod="openshift-network-diagnostics/network-check-target-99957" Jun 08 13:44:57.222739 ip-10-0-140-46 kubenswrapper[2576]: I0608 13:44:57.222656 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\"" Jun 08 13:44:57.227382 ip-10-0-140-46 kubenswrapper[2576]: I0608 13:44:57.227352 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\"" Jun 08 13:44:57.237991 ip-10-0-140-46 kubenswrapper[2576]: I0608 13:44:57.237964 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-5jttb\" (UniqueName: \"kubernetes.io/projected/4b283339-40c0-40f5-b9d9-c75e99e4f984-kube-api-access-5jttb\") pod \"network-check-target-99957\" (UID: \"4b283339-40c0-40f5-b9d9-c75e99e4f984\") " pod="openshift-network-diagnostics/network-check-target-99957" Jun 08 13:44:57.261794 ip-10-0-140-46 kubenswrapper[2576]: I0608 13:44:57.261729 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cx7sn_6e4b50fc-3e91-4f50-b92a-e90919788248/konnectivity-agent/0.log" limit=1024 Jun 08 13:44:57.342676 ip-10-0-140-46 kubenswrapper[2576]: I0608 13:44:57.342654 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-dm2n6"] Jun 08 13:44:57.355115 ip-10-0-140-46 kubenswrapper[2576]: I0608 13:44:57.355093 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-l62qm"] Jun 08 13:44:57.357531 ip-10-0-140-46 kubenswrapper[2576]: W0608 13:44:57.357510 2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod52fab817_1614_450d_8ea9_d10e21821af6.slice/crio-2ac0b94ade5ba1cbc9a58070ff63e929a20750bef00eb4a15b24a98d0ef2cd4a WatchSource:0}: Error finding container 2ac0b94ade5ba1cbc9a58070ff63e929a20750bef00eb4a15b24a98d0ef2cd4a: Status 404 returned error can't find the container with id 2ac0b94ade5ba1cbc9a58070ff63e929a20750bef00eb4a15b24a98d0ef2cd4a Jun 08 13:44:57.495130 ip-10-0-140-46 kubenswrapper[2576]: I0608 13:44:57.495045 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-rt6hp\"" Jun 08 13:44:57.503013 ip-10-0-140-46 kubenswrapper[2576]: I0608 13:44:57.502996 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-99957" Jun 08 13:44:57.630657 ip-10-0-140-46 kubenswrapper[2576]: I0608 13:44:57.630625 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-99957"] Jun 08 13:44:57.633835 ip-10-0-140-46 kubenswrapper[2576]: W0608 13:44:57.633809 2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4b283339_40c0_40f5_b9d9_c75e99e4f984.slice/crio-592f7d5845c6d4df40c26ef5ada6d63408e7220e58f3941dcddbd84d0ac1210d WatchSource:0}: Error finding container 592f7d5845c6d4df40c26ef5ada6d63408e7220e58f3941dcddbd84d0ac1210d: Status 404 returned error can't find the container with id 592f7d5845c6d4df40c26ef5ada6d63408e7220e58f3941dcddbd84d0ac1210d Jun 08 13:44:57.711012 ip-10-0-140-46 kubenswrapper[2576]: I0608 13:44:57.710983 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-99957" event={"ID":"4b283339-40c0-40f5-b9d9-c75e99e4f984","Type":"ContainerStarted","Data":"592f7d5845c6d4df40c26ef5ada6d63408e7220e58f3941dcddbd84d0ac1210d"} Jun 08 13:44:57.712119 ip-10-0-140-46 kubenswrapper[2576]: I0608 13:44:57.712073 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-l62qm" event={"ID":"52fab817-1614-450d-8ea9-d10e21821af6","Type":"ContainerStarted","Data":"2ac0b94ade5ba1cbc9a58070ff63e929a20750bef00eb4a15b24a98d0ef2cd4a"} Jun 08 13:44:57.713129 ip-10-0-140-46 kubenswrapper[2576]: I0608 13:44:57.713105 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-dm2n6" event={"ID":"6da5a732-b003-412c-8308-e80cead7eb1c","Type":"ContainerStarted","Data":"894221cd20e3d16bc08b4798379f86ae1a48f450babb8a84e741e97f573e0aa8"} Jun 08 13:44:58.719660 ip-10-0-140-46 kubenswrapper[2576]: I0608 13:44:58.719542 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-l62qm" event={"ID":"52fab817-1614-450d-8ea9-d10e21821af6","Type":"ContainerStarted","Data":"6707e300fe98204f7188bc129be0f6859d2fc7fdb19d8c6b6bdbf84c17c73a0a"} Jun 08 13:44:58.720039 ip-10-0-140-46 kubenswrapper[2576]: I0608 13:44:58.719736 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-l62qm" event={"ID":"52fab817-1614-450d-8ea9-d10e21821af6","Type":"ContainerStarted","Data":"0e80423dc5907d68164f00cde5a41c2f3f08a124a665a42bee5736df6e56534c"} Jun 08 13:44:58.724967 ip-10-0-140-46 kubenswrapper[2576]: I0608 13:44:58.724941 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/3d97d05c-9d8f-4d01-8543-610bc38837c4-registry-tls\") pod \"image-registry-98b4d96dc-d224h\" (UID: \"3d97d05c-9d8f-4d01-8543-610bc38837c4\") " pod="openshift-image-registry/image-registry-98b4d96dc-d224h" Jun 08 13:44:58.727691 ip-10-0-140-46 kubenswrapper[2576]: I0608 13:44:58.727668 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/3d97d05c-9d8f-4d01-8543-610bc38837c4-registry-tls\") pod \"image-registry-98b4d96dc-d224h\" (UID: \"3d97d05c-9d8f-4d01-8543-610bc38837c4\") " pod="openshift-image-registry/image-registry-98b4d96dc-d224h" Jun 08 13:44:58.761848 ip-10-0-140-46 kubenswrapper[2576]: I0608 13:44:58.761180 2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/network-metrics-daemon-l62qm" podStartSLOduration=65.795916609 podStartE2EDuration="1m6.761157763s" totalImagesPullingTime="965.241154ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-08 13:43:52 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-08 13:44:58.759192403 +0000 UTC m=+66.838521287" watchObservedRunningTime="2026-06-08 13:44:58.761157763 +0000 UTC m=+66.840486656" Jun 08 13:44:58.762810 ip-10-0-140-46 kubenswrapper[2576]: I0608 13:44:58.762781 2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-59f59d9cd6-pddlc"] Jun 08 13:44:58.766003 ip-10-0-140-46 kubenswrapper[2576]: I0608 13:44:58.765978 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-59f59d9cd6-pddlc" Jun 08 13:44:58.769546 ip-10-0-140-46 kubenswrapper[2576]: I0608 13:44:58.769520 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"open-cluster-management-image-pull-credentials\"" Jun 08 13:44:58.769740 ip-10-0-140-46 kubenswrapper[2576]: I0608 13:44:58.769714 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"managed-serviceaccount-hub-kubeconfig\"" Jun 08 13:44:58.771085 ip-10-0-140-46 kubenswrapper[2576]: I0608 13:44:58.769833 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"managed-serviceaccount-dockercfg-lxpqf\"" Jun 08 13:44:58.771085 ip-10-0-140-46 kubenswrapper[2576]: I0608 13:44:58.769855 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"open-cluster-management-agent-addon\"/\"kube-root-ca.crt\"" Jun 08 13:44:58.771085 ip-10-0-140-46 kubenswrapper[2576]: I0608 13:44:58.769966 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"open-cluster-management-agent-addon\"/\"openshift-service-ca.crt\"" Jun 08 13:44:58.771874 ip-10-0-140-46 kubenswrapper[2576]: I0608 13:44:58.771526 2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["open-cluster-management-agent-addon/klusterlet-addon-workmgr-7c846fcb8c-f5t5c"] Jun 08 13:44:58.774903 ip-10-0-140-46 kubenswrapper[2576]: I0608 13:44:58.774452 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-7c846fcb8c-f5t5c" Jun 08 13:44:58.779693 ip-10-0-140-46 kubenswrapper[2576]: I0608 13:44:58.779674 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"work-manager-hub-kubeconfig\"" Jun 08 13:44:58.799189 ip-10-0-140-46 kubenswrapper[2576]: I0608 13:44:58.799162 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-59f59d9cd6-pddlc"] Jun 08 13:44:58.822807 ip-10-0-140-46 kubenswrapper[2576]: I0608 13:44:58.822760 2576 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-image-registry/image-registry-98b4d96dc-d224h"] Jun 08 13:44:58.826089 ip-10-0-140-46 kubenswrapper[2576]: I0608 13:44:58.826060 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-dlnps\" (UniqueName: \"kubernetes.io/projected/f5ed7ee8-d9c0-46e1-8bc6-6ab79c7314bb-kube-api-access-dlnps\") pod \"klusterlet-addon-workmgr-7c846fcb8c-f5t5c\" (UID: \"f5ed7ee8-d9c0-46e1-8bc6-6ab79c7314bb\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-7c846fcb8c-f5t5c" Jun 08 13:44:58.826283 ip-10-0-140-46 kubenswrapper[2576]: I0608 13:44:58.826118 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/2ef5209f-d5f5-4fae-a86c-1bb23283f29a-metrics-tls\") pod \"dns-default-l52bl\" (UID: \"2ef5209f-d5f5-4fae-a86c-1bb23283f29a\") " pod="openshift-dns/dns-default-l52bl" Jun 08 13:44:58.826370 ip-10-0-140-46 kubenswrapper[2576]: I0608 13:44:58.826279 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-thlrc\" (UniqueName: \"kubernetes.io/projected/e759a1d3-8adc-492b-bedb-87ff772a3e79-kube-api-access-thlrc\") pod \"managed-serviceaccount-addon-agent-59f59d9cd6-pddlc\" (UID: \"e759a1d3-8adc-492b-bedb-87ff772a3e79\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-59f59d9cd6-pddlc" Jun 08 13:44:58.826370 ip-10-0-140-46 kubenswrapper[2576]: I0608 13:44:58.826335 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/e759a1d3-8adc-492b-bedb-87ff772a3e79-hub-kubeconfig\") pod \"managed-serviceaccount-addon-agent-59f59d9cd6-pddlc\" (UID: \"e759a1d3-8adc-492b-bedb-87ff772a3e79\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-59f59d9cd6-pddlc" Jun 08 13:44:58.826370 ip-10-0-140-46 kubenswrapper[2576]: I0608 13:44:58.826364 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/f5ed7ee8-d9c0-46e1-8bc6-6ab79c7314bb-tmp\") pod \"klusterlet-addon-workmgr-7c846fcb8c-f5t5c\" (UID: \"f5ed7ee8-d9c0-46e1-8bc6-6ab79c7314bb\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-7c846fcb8c-f5t5c" Jun 08 13:44:58.826538 ip-10-0-140-46 kubenswrapper[2576]: I0608 13:44:58.826410 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"klusterlet-config\" (UniqueName: \"kubernetes.io/secret/f5ed7ee8-d9c0-46e1-8bc6-6ab79c7314bb-klusterlet-config\") pod \"klusterlet-addon-workmgr-7c846fcb8c-f5t5c\" (UID: \"f5ed7ee8-d9c0-46e1-8bc6-6ab79c7314bb\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-7c846fcb8c-f5t5c" Jun 08 13:44:58.828857 ip-10-0-140-46 kubenswrapper[2576]: I0608 13:44:58.828829 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/klusterlet-addon-workmgr-7c846fcb8c-f5t5c"] Jun 08 13:44:58.829896 ip-10-0-140-46 kubenswrapper[2576]: I0608 13:44:58.829862 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"registry-dockercfg-7cm6t\"" Jun 08 13:44:58.830713 ip-10-0-140-46 kubenswrapper[2576]: I0608 13:44:58.830693 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/2ef5209f-d5f5-4fae-a86c-1bb23283f29a-metrics-tls\") pod \"dns-default-l52bl\" (UID: \"2ef5209f-d5f5-4fae-a86c-1bb23283f29a\") " pod="openshift-dns/dns-default-l52bl" Jun 08 13:44:58.833335 ip-10-0-140-46 kubenswrapper[2576]: I0608 13:44:58.833303 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-98b4d96dc-d224h" Jun 08 13:44:58.879181 ip-10-0-140-46 kubenswrapper[2576]: I0608 13:44:58.879040 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cx7sn_6e4b50fc-3e91-4f50-b92a-e90919788248/konnectivity-agent/0.log" limit=1024 Jun 08 13:44:58.882579 ip-10-0-140-46 kubenswrapper[2576]: I0608 13:44:58.882542 2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-5b7f5cbf55-rj4tt"] Jun 08 13:44:58.887138 ip-10-0-140-46 kubenswrapper[2576]: I0608 13:44:58.887117 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-5b7f5cbf55-rj4tt" Jun 08 13:44:58.902757 ip-10-0-140-46 kubenswrapper[2576]: I0608 13:44:58.902549 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"oauth-serving-cert\"" Jun 08 13:44:58.903789 ip-10-0-140-46 kubenswrapper[2576]: I0608 13:44:58.902893 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-oauth-config\"" Jun 08 13:44:58.903789 ip-10-0-140-46 kubenswrapper[2576]: I0608 13:44:58.902878 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"console-config\"" Jun 08 13:44:58.903789 ip-10-0-140-46 kubenswrapper[2576]: I0608 13:44:58.903178 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"openshift-service-ca.crt\"" Jun 08 13:44:58.903789 ip-10-0-140-46 kubenswrapper[2576]: I0608 13:44:58.903477 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"kube-root-ca.crt\"" Jun 08 13:44:58.904092 ip-10-0-140-46 kubenswrapper[2576]: I0608 13:44:58.903892 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-serving-cert\"" Jun 08 13:44:58.904396 ip-10-0-140-46 kubenswrapper[2576]: I0608 13:44:58.904336 2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/downloads-6657875f97-wxvf5"] Jun 08 13:44:58.905385 ip-10-0-140-46 kubenswrapper[2576]: I0608 13:44:58.905159 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"service-ca\"" Jun 08 13:44:58.909014 ip-10-0-140-46 kubenswrapper[2576]: I0608 13:44:58.908511 2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-insights/insights-runtime-extractor-pbqss"] Jun 08 13:44:58.909769 ip-10-0-140-46 kubenswrapper[2576]: I0608 13:44:58.909721 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/downloads-6657875f97-wxvf5" Jun 08 13:44:58.912121 ip-10-0-140-46 kubenswrapper[2576]: I0608 13:44:58.912099 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"default-dockercfg-8242x\"" Jun 08 13:44:58.914471 ip-10-0-140-46 kubenswrapper[2576]: I0608 13:44:58.914340 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-dockercfg-9r5l8\"" Jun 08 13:44:58.915969 ip-10-0-140-46 kubenswrapper[2576]: I0608 13:44:58.915351 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-5b7f5cbf55-rj4tt"] Jun 08 13:44:58.915969 ip-10-0-140-46 kubenswrapper[2576]: I0608 13:44:58.915454 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-pbqss" Jun 08 13:44:58.919379 ip-10-0-140-46 kubenswrapper[2576]: I0608 13:44:58.918002 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"openshift-service-ca.crt\"" Jun 08 13:44:58.920815 ip-10-0-140-46 kubenswrapper[2576]: I0608 13:44:58.919524 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-root-ca.crt\"" Jun 08 13:44:58.922274 ip-10-0-140-46 kubenswrapper[2576]: I0608 13:44:58.921195 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/downloads-6657875f97-wxvf5"] Jun 08 13:44:58.925729 ip-10-0-140-46 kubenswrapper[2576]: I0608 13:44:58.924868 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-tls\"" Jun 08 13:44:58.925729 ip-10-0-140-46 kubenswrapper[2576]: I0608 13:44:58.925237 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-rbac-proxy\"" Jun 08 13:44:58.925729 ip-10-0-140-46 kubenswrapper[2576]: I0608 13:44:58.925524 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-sa-dockercfg-7gphb\"" Jun 08 13:44:58.927588 ip-10-0-140-46 kubenswrapper[2576]: I0608 13:44:58.926970 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"klusterlet-config\" (UniqueName: \"kubernetes.io/secret/f5ed7ee8-d9c0-46e1-8bc6-6ab79c7314bb-klusterlet-config\") pod \"klusterlet-addon-workmgr-7c846fcb8c-f5t5c\" (UID: \"f5ed7ee8-d9c0-46e1-8bc6-6ab79c7314bb\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-7c846fcb8c-f5t5c" Jun 08 13:44:58.927588 ip-10-0-140-46 kubenswrapper[2576]: I0608 13:44:58.927010 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-dlnps\" (UniqueName: \"kubernetes.io/projected/f5ed7ee8-d9c0-46e1-8bc6-6ab79c7314bb-kube-api-access-dlnps\") pod \"klusterlet-addon-workmgr-7c846fcb8c-f5t5c\" (UID: \"f5ed7ee8-d9c0-46e1-8bc6-6ab79c7314bb\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-7c846fcb8c-f5t5c" Jun 08 13:44:58.927588 ip-10-0-140-46 kubenswrapper[2576]: I0608 13:44:58.927044 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qr4p9\" (UniqueName: \"kubernetes.io/projected/77b6314b-cbdb-49be-8d7d-41812b662df9-kube-api-access-qr4p9\") pod \"console-5b7f5cbf55-rj4tt\" (UID: \"77b6314b-cbdb-49be-8d7d-41812b662df9\") " pod="openshift-console/console-5b7f5cbf55-rj4tt" Jun 08 13:44:58.927588 ip-10-0-140-46 kubenswrapper[2576]: I0608 13:44:58.927070 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/77b6314b-cbdb-49be-8d7d-41812b662df9-service-ca\") pod \"console-5b7f5cbf55-rj4tt\" (UID: \"77b6314b-cbdb-49be-8d7d-41812b662df9\") " pod="openshift-console/console-5b7f5cbf55-rj4tt" Jun 08 13:44:58.927588 ip-10-0-140-46 kubenswrapper[2576]: I0608 13:44:58.927108 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/77b6314b-cbdb-49be-8d7d-41812b662df9-console-oauth-config\") pod \"console-5b7f5cbf55-rj4tt\" (UID: \"77b6314b-cbdb-49be-8d7d-41812b662df9\") " pod="openshift-console/console-5b7f5cbf55-rj4tt" Jun 08 13:44:58.927588 ip-10-0-140-46 kubenswrapper[2576]: I0608 13:44:58.927138 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/f5ed7ee8-d9c0-46e1-8bc6-6ab79c7314bb-tmp\") pod \"klusterlet-addon-workmgr-7c846fcb8c-f5t5c\" (UID: \"f5ed7ee8-d9c0-46e1-8bc6-6ab79c7314bb\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-7c846fcb8c-f5t5c" Jun 08 13:44:58.927588 ip-10-0-140-46 kubenswrapper[2576]: I0608 13:44:58.927166 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/77b6314b-cbdb-49be-8d7d-41812b662df9-console-config\") pod \"console-5b7f5cbf55-rj4tt\" (UID: \"77b6314b-cbdb-49be-8d7d-41812b662df9\") " pod="openshift-console/console-5b7f5cbf55-rj4tt" Jun 08 13:44:58.927588 ip-10-0-140-46 kubenswrapper[2576]: I0608 13:44:58.927200 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/77b6314b-cbdb-49be-8d7d-41812b662df9-console-serving-cert\") pod \"console-5b7f5cbf55-rj4tt\" (UID: \"77b6314b-cbdb-49be-8d7d-41812b662df9\") " pod="openshift-console/console-5b7f5cbf55-rj4tt" Jun 08 13:44:58.927588 ip-10-0-140-46 kubenswrapper[2576]: I0608 13:44:58.927227 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/77b6314b-cbdb-49be-8d7d-41812b662df9-oauth-serving-cert\") pod \"console-5b7f5cbf55-rj4tt\" (UID: \"77b6314b-cbdb-49be-8d7d-41812b662df9\") " pod="openshift-console/console-5b7f5cbf55-rj4tt" Jun 08 13:44:58.927588 ip-10-0-140-46 kubenswrapper[2576]: I0608 13:44:58.927267 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-thlrc\" (UniqueName: \"kubernetes.io/projected/e759a1d3-8adc-492b-bedb-87ff772a3e79-kube-api-access-thlrc\") pod \"managed-serviceaccount-addon-agent-59f59d9cd6-pddlc\" (UID: \"e759a1d3-8adc-492b-bedb-87ff772a3e79\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-59f59d9cd6-pddlc" Jun 08 13:44:58.927588 ip-10-0-140-46 kubenswrapper[2576]: I0608 13:44:58.927294 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/e759a1d3-8adc-492b-bedb-87ff772a3e79-hub-kubeconfig\") pod \"managed-serviceaccount-addon-agent-59f59d9cd6-pddlc\" (UID: \"e759a1d3-8adc-492b-bedb-87ff772a3e79\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-59f59d9cd6-pddlc" Jun 08 13:44:58.928168 ip-10-0-140-46 kubenswrapper[2576]: I0608 13:44:58.928090 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/f5ed7ee8-d9c0-46e1-8bc6-6ab79c7314bb-tmp\") pod \"klusterlet-addon-workmgr-7c846fcb8c-f5t5c\" (UID: \"f5ed7ee8-d9c0-46e1-8bc6-6ab79c7314bb\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-7c846fcb8c-f5t5c" Jun 08 13:44:58.930660 ip-10-0-140-46 kubenswrapper[2576]: I0608 13:44:58.930618 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"klusterlet-config\" (UniqueName: \"kubernetes.io/secret/f5ed7ee8-d9c0-46e1-8bc6-6ab79c7314bb-klusterlet-config\") pod \"klusterlet-addon-workmgr-7c846fcb8c-f5t5c\" (UID: \"f5ed7ee8-d9c0-46e1-8bc6-6ab79c7314bb\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-7c846fcb8c-f5t5c" Jun 08 13:44:58.932136 ip-10-0-140-46 kubenswrapper[2576]: I0608 13:44:58.932114 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/e759a1d3-8adc-492b-bedb-87ff772a3e79-hub-kubeconfig\") pod \"managed-serviceaccount-addon-agent-59f59d9cd6-pddlc\" (UID: \"e759a1d3-8adc-492b-bedb-87ff772a3e79\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-59f59d9cd6-pddlc" Jun 08 13:44:58.939797 ip-10-0-140-46 kubenswrapper[2576]: I0608 13:44:58.939698 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-pbqss"] Jun 08 13:44:58.958064 ip-10-0-140-46 kubenswrapper[2576]: I0608 13:44:58.958010 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-dlnps\" (UniqueName: \"kubernetes.io/projected/f5ed7ee8-d9c0-46e1-8bc6-6ab79c7314bb-kube-api-access-dlnps\") pod \"klusterlet-addon-workmgr-7c846fcb8c-f5t5c\" (UID: \"f5ed7ee8-d9c0-46e1-8bc6-6ab79c7314bb\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-7c846fcb8c-f5t5c" Jun 08 13:44:58.960727 ip-10-0-140-46 kubenswrapper[2576]: I0608 13:44:58.960683 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-thlrc\" (UniqueName: \"kubernetes.io/projected/e759a1d3-8adc-492b-bedb-87ff772a3e79-kube-api-access-thlrc\") pod \"managed-serviceaccount-addon-agent-59f59d9cd6-pddlc\" (UID: \"e759a1d3-8adc-492b-bedb-87ff772a3e79\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-59f59d9cd6-pddlc" Jun 08 13:44:58.967936 ip-10-0-140-46 kubenswrapper[2576]: I0608 13:44:58.967906 2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-image-registry/image-registry-6869cf9d57-q968v"] Jun 08 13:44:58.972181 ip-10-0-140-46 kubenswrapper[2576]: I0608 13:44:58.972136 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-6869cf9d57-q968v" Jun 08 13:44:59.005224 ip-10-0-140-46 kubenswrapper[2576]: I0608 13:44:59.005193 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-6869cf9d57-q968v"] Jun 08 13:44:59.007640 ip-10-0-140-46 kubenswrapper[2576]: I0608 13:44:59.007611 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cx7sn_6e4b50fc-3e91-4f50-b92a-e90919788248/konnectivity-agent/0.log" limit=1024 Jun 08 13:44:59.016764 ip-10-0-140-46 kubenswrapper[2576]: I0608 13:44:59.016731 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-jsdkh\"" Jun 08 13:44:59.024175 ip-10-0-140-46 kubenswrapper[2576]: I0608 13:44:59.024144 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-l52bl" Jun 08 13:44:59.029577 ip-10-0-140-46 kubenswrapper[2576]: I0608 13:44:59.028431 2576 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-image-registry/image-registry-98b4d96dc-d224h"] Jun 08 13:44:59.029577 ip-10-0-140-46 kubenswrapper[2576]: I0608 13:44:59.028802 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/77b6314b-cbdb-49be-8d7d-41812b662df9-console-config\") pod \"console-5b7f5cbf55-rj4tt\" (UID: \"77b6314b-cbdb-49be-8d7d-41812b662df9\") " pod="openshift-console/console-5b7f5cbf55-rj4tt" Jun 08 13:44:59.029577 ip-10-0-140-46 kubenswrapper[2576]: I0608 13:44:59.028841 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-t9vzf\" (UniqueName: \"kubernetes.io/projected/bde2853a-ccff-4f0e-88d2-0abaa5040401-kube-api-access-t9vzf\") pod \"downloads-6657875f97-wxvf5\" (UID: \"bde2853a-ccff-4f0e-88d2-0abaa5040401\") " pod="openshift-console/downloads-6657875f97-wxvf5" Jun 08 13:44:59.029577 ip-10-0-140-46 kubenswrapper[2576]: I0608 13:44:59.028886 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/bc51170c-32a5-4e1f-80b8-063889b6c079-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-pbqss\" (UID: \"bc51170c-32a5-4e1f-80b8-063889b6c079\") " pod="openshift-insights/insights-runtime-extractor-pbqss" Jun 08 13:44:59.029577 ip-10-0-140-46 kubenswrapper[2576]: I0608 13:44:59.028907 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-h7qr2\" (UniqueName: \"kubernetes.io/projected/bc51170c-32a5-4e1f-80b8-063889b6c079-kube-api-access-h7qr2\") pod \"insights-runtime-extractor-pbqss\" (UID: \"bc51170c-32a5-4e1f-80b8-063889b6c079\") " pod="openshift-insights/insights-runtime-extractor-pbqss" Jun 08 13:44:59.029577 ip-10-0-140-46 kubenswrapper[2576]: I0608 13:44:59.028940 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/ee2d069f-ad9b-4a11-8df6-3f4af3345b4d-bound-sa-token\") pod \"image-registry-6869cf9d57-q968v\" (UID: \"ee2d069f-ad9b-4a11-8df6-3f4af3345b4d\") " pod="openshift-image-registry/image-registry-6869cf9d57-q968v" Jun 08 13:44:59.029577 ip-10-0-140-46 kubenswrapper[2576]: I0608 13:44:59.028969 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/77b6314b-cbdb-49be-8d7d-41812b662df9-console-serving-cert\") pod \"console-5b7f5cbf55-rj4tt\" (UID: \"77b6314b-cbdb-49be-8d7d-41812b662df9\") " pod="openshift-console/console-5b7f5cbf55-rj4tt" Jun 08 13:44:59.029577 ip-10-0-140-46 kubenswrapper[2576]: I0608 13:44:59.029000 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/bc51170c-32a5-4e1f-80b8-063889b6c079-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-pbqss\" (UID: \"bc51170c-32a5-4e1f-80b8-063889b6c079\") " pod="openshift-insights/insights-runtime-extractor-pbqss" Jun 08 13:44:59.029577 ip-10-0-140-46 kubenswrapper[2576]: I0608 13:44:59.029028 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/77b6314b-cbdb-49be-8d7d-41812b662df9-oauth-serving-cert\") pod \"console-5b7f5cbf55-rj4tt\" (UID: \"77b6314b-cbdb-49be-8d7d-41812b662df9\") " pod="openshift-console/console-5b7f5cbf55-rj4tt" Jun 08 13:44:59.029577 ip-10-0-140-46 kubenswrapper[2576]: I0608 13:44:59.029051 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/ee2d069f-ad9b-4a11-8df6-3f4af3345b4d-registry-tls\") pod \"image-registry-6869cf9d57-q968v\" (UID: \"ee2d069f-ad9b-4a11-8df6-3f4af3345b4d\") " pod="openshift-image-registry/image-registry-6869cf9d57-q968v" Jun 08 13:44:59.029577 ip-10-0-140-46 kubenswrapper[2576]: I0608 13:44:59.029072 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/bc51170c-32a5-4e1f-80b8-063889b6c079-data-volume\") pod \"insights-runtime-extractor-pbqss\" (UID: \"bc51170c-32a5-4e1f-80b8-063889b6c079\") " pod="openshift-insights/insights-runtime-extractor-pbqss" Jun 08 13:44:59.030697 ip-10-0-140-46 kubenswrapper[2576]: I0608 13:44:59.029997 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/ee2d069f-ad9b-4a11-8df6-3f4af3345b4d-installation-pull-secrets\") pod \"image-registry-6869cf9d57-q968v\" (UID: \"ee2d069f-ad9b-4a11-8df6-3f4af3345b4d\") " pod="openshift-image-registry/image-registry-6869cf9d57-q968v" Jun 08 13:44:59.030697 ip-10-0-140-46 kubenswrapper[2576]: I0608 13:44:59.030055 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/ee2d069f-ad9b-4a11-8df6-3f4af3345b4d-trusted-ca\") pod \"image-registry-6869cf9d57-q968v\" (UID: \"ee2d069f-ad9b-4a11-8df6-3f4af3345b4d\") " pod="openshift-image-registry/image-registry-6869cf9d57-q968v" Jun 08 13:44:59.030697 ip-10-0-140-46 kubenswrapper[2576]: I0608 13:44:59.030121 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qr4p9\" (UniqueName: \"kubernetes.io/projected/77b6314b-cbdb-49be-8d7d-41812b662df9-kube-api-access-qr4p9\") pod \"console-5b7f5cbf55-rj4tt\" (UID: \"77b6314b-cbdb-49be-8d7d-41812b662df9\") " pod="openshift-console/console-5b7f5cbf55-rj4tt" Jun 08 13:44:59.030697 ip-10-0-140-46 kubenswrapper[2576]: I0608 13:44:59.030159 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/77b6314b-cbdb-49be-8d7d-41812b662df9-service-ca\") pod \"console-5b7f5cbf55-rj4tt\" (UID: \"77b6314b-cbdb-49be-8d7d-41812b662df9\") " pod="openshift-console/console-5b7f5cbf55-rj4tt" Jun 08 13:44:59.030697 ip-10-0-140-46 kubenswrapper[2576]: I0608 13:44:59.030196 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/bc51170c-32a5-4e1f-80b8-063889b6c079-crio-socket\") pod \"insights-runtime-extractor-pbqss\" (UID: \"bc51170c-32a5-4e1f-80b8-063889b6c079\") " pod="openshift-insights/insights-runtime-extractor-pbqss" Jun 08 13:44:59.030697 ip-10-0-140-46 kubenswrapper[2576]: I0608 13:44:59.030220 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/ee2d069f-ad9b-4a11-8df6-3f4af3345b4d-ca-trust-extracted\") pod \"image-registry-6869cf9d57-q968v\" (UID: \"ee2d069f-ad9b-4a11-8df6-3f4af3345b4d\") " pod="openshift-image-registry/image-registry-6869cf9d57-q968v" Jun 08 13:44:59.030697 ip-10-0-140-46 kubenswrapper[2576]: I0608 13:44:59.030245 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/ee2d069f-ad9b-4a11-8df6-3f4af3345b4d-registry-certificates\") pod \"image-registry-6869cf9d57-q968v\" (UID: \"ee2d069f-ad9b-4a11-8df6-3f4af3345b4d\") " pod="openshift-image-registry/image-registry-6869cf9d57-q968v" Jun 08 13:44:59.030697 ip-10-0-140-46 kubenswrapper[2576]: I0608 13:44:59.030279 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/ee2d069f-ad9b-4a11-8df6-3f4af3345b4d-image-registry-private-configuration\") pod \"image-registry-6869cf9d57-q968v\" (UID: \"ee2d069f-ad9b-4a11-8df6-3f4af3345b4d\") " pod="openshift-image-registry/image-registry-6869cf9d57-q968v" Jun 08 13:44:59.030697 ip-10-0-140-46 kubenswrapper[2576]: I0608 13:44:59.030307 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xqfwb\" (UniqueName: \"kubernetes.io/projected/ee2d069f-ad9b-4a11-8df6-3f4af3345b4d-kube-api-access-xqfwb\") pod \"image-registry-6869cf9d57-q968v\" (UID: \"ee2d069f-ad9b-4a11-8df6-3f4af3345b4d\") " pod="openshift-image-registry/image-registry-6869cf9d57-q968v" Jun 08 13:44:59.030697 ip-10-0-140-46 kubenswrapper[2576]: I0608 13:44:59.030342 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/77b6314b-cbdb-49be-8d7d-41812b662df9-console-oauth-config\") pod \"console-5b7f5cbf55-rj4tt\" (UID: \"77b6314b-cbdb-49be-8d7d-41812b662df9\") " pod="openshift-console/console-5b7f5cbf55-rj4tt" Jun 08 13:44:59.033441 ip-10-0-140-46 kubenswrapper[2576]: I0608 13:44:59.032137 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/77b6314b-cbdb-49be-8d7d-41812b662df9-service-ca\") pod \"console-5b7f5cbf55-rj4tt\" (UID: \"77b6314b-cbdb-49be-8d7d-41812b662df9\") " pod="openshift-console/console-5b7f5cbf55-rj4tt" Jun 08 13:44:59.033441 ip-10-0-140-46 kubenswrapper[2576]: I0608 13:44:59.032752 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/77b6314b-cbdb-49be-8d7d-41812b662df9-console-config\") pod \"console-5b7f5cbf55-rj4tt\" (UID: \"77b6314b-cbdb-49be-8d7d-41812b662df9\") " pod="openshift-console/console-5b7f5cbf55-rj4tt" Jun 08 13:44:59.033919 ip-10-0-140-46 kubenswrapper[2576]: I0608 13:44:59.033873 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/77b6314b-cbdb-49be-8d7d-41812b662df9-oauth-serving-cert\") pod \"console-5b7f5cbf55-rj4tt\" (UID: \"77b6314b-cbdb-49be-8d7d-41812b662df9\") " pod="openshift-console/console-5b7f5cbf55-rj4tt" Jun 08 13:44:59.034010 ip-10-0-140-46 kubenswrapper[2576]: I0608 13:44:59.033935 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/77b6314b-cbdb-49be-8d7d-41812b662df9-console-serving-cert\") pod \"console-5b7f5cbf55-rj4tt\" (UID: \"77b6314b-cbdb-49be-8d7d-41812b662df9\") " pod="openshift-console/console-5b7f5cbf55-rj4tt" Jun 08 13:44:59.034883 ip-10-0-140-46 kubenswrapper[2576]: I0608 13:44:59.034843 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/77b6314b-cbdb-49be-8d7d-41812b662df9-console-oauth-config\") pod \"console-5b7f5cbf55-rj4tt\" (UID: \"77b6314b-cbdb-49be-8d7d-41812b662df9\") " pod="openshift-console/console-5b7f5cbf55-rj4tt" Jun 08 13:44:59.035871 ip-10-0-140-46 kubenswrapper[2576]: W0608 13:44:59.035841 2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3d97d05c_9d8f_4d01_8543_610bc38837c4.slice/crio-84c2efb9bc185d935c425067c2a6736cb359dd2af44027f86da1bda86c9a7bc5 WatchSource:0}: Error finding container 84c2efb9bc185d935c425067c2a6736cb359dd2af44027f86da1bda86c9a7bc5: Status 404 returned error can't find the container with id 84c2efb9bc185d935c425067c2a6736cb359dd2af44027f86da1bda86c9a7bc5 Jun 08 13:44:59.047629 ip-10-0-140-46 kubenswrapper[2576]: I0608 13:44:59.047560 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-qr4p9\" (UniqueName: \"kubernetes.io/projected/77b6314b-cbdb-49be-8d7d-41812b662df9-kube-api-access-qr4p9\") pod \"console-5b7f5cbf55-rj4tt\" (UID: \"77b6314b-cbdb-49be-8d7d-41812b662df9\") " pod="openshift-console/console-5b7f5cbf55-rj4tt" Jun 08 13:44:59.090171 ip-10-0-140-46 kubenswrapper[2576]: I0608 13:44:59.089970 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-59f59d9cd6-pddlc" Jun 08 13:44:59.102055 ip-10-0-140-46 kubenswrapper[2576]: I0608 13:44:59.101518 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-7c846fcb8c-f5t5c" Jun 08 13:44:59.118942 ip-10-0-140-46 kubenswrapper[2576]: I0608 13:44:59.118881 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cx7sn_6e4b50fc-3e91-4f50-b92a-e90919788248/konnectivity-agent/0.log" limit=1024 Jun 08 13:44:59.130988 ip-10-0-140-46 kubenswrapper[2576]: I0608 13:44:59.130946 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/ee2d069f-ad9b-4a11-8df6-3f4af3345b4d-bound-sa-token\") pod \"image-registry-6869cf9d57-q968v\" (UID: \"ee2d069f-ad9b-4a11-8df6-3f4af3345b4d\") " pod="openshift-image-registry/image-registry-6869cf9d57-q968v" Jun 08 13:44:59.131150 ip-10-0-140-46 kubenswrapper[2576]: I0608 13:44:59.130998 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/bc51170c-32a5-4e1f-80b8-063889b6c079-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-pbqss\" (UID: \"bc51170c-32a5-4e1f-80b8-063889b6c079\") " pod="openshift-insights/insights-runtime-extractor-pbqss" Jun 08 13:44:59.131150 ip-10-0-140-46 kubenswrapper[2576]: I0608 13:44:59.131033 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/ee2d069f-ad9b-4a11-8df6-3f4af3345b4d-registry-tls\") pod \"image-registry-6869cf9d57-q968v\" (UID: \"ee2d069f-ad9b-4a11-8df6-3f4af3345b4d\") " pod="openshift-image-registry/image-registry-6869cf9d57-q968v" Jun 08 13:44:59.131150 ip-10-0-140-46 kubenswrapper[2576]: I0608 13:44:59.131062 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/bc51170c-32a5-4e1f-80b8-063889b6c079-data-volume\") pod \"insights-runtime-extractor-pbqss\" (UID: \"bc51170c-32a5-4e1f-80b8-063889b6c079\") " pod="openshift-insights/insights-runtime-extractor-pbqss" Jun 08 13:44:59.131150 ip-10-0-140-46 kubenswrapper[2576]: I0608 13:44:59.131105 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/ee2d069f-ad9b-4a11-8df6-3f4af3345b4d-installation-pull-secrets\") pod \"image-registry-6869cf9d57-q968v\" (UID: \"ee2d069f-ad9b-4a11-8df6-3f4af3345b4d\") " pod="openshift-image-registry/image-registry-6869cf9d57-q968v" Jun 08 13:44:59.131150 ip-10-0-140-46 kubenswrapper[2576]: I0608 13:44:59.131145 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/ee2d069f-ad9b-4a11-8df6-3f4af3345b4d-trusted-ca\") pod \"image-registry-6869cf9d57-q968v\" (UID: \"ee2d069f-ad9b-4a11-8df6-3f4af3345b4d\") " pod="openshift-image-registry/image-registry-6869cf9d57-q968v" Jun 08 13:44:59.131442 ip-10-0-140-46 kubenswrapper[2576]: I0608 13:44:59.131183 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/bc51170c-32a5-4e1f-80b8-063889b6c079-crio-socket\") pod \"insights-runtime-extractor-pbqss\" (UID: \"bc51170c-32a5-4e1f-80b8-063889b6c079\") " pod="openshift-insights/insights-runtime-extractor-pbqss" Jun 08 13:44:59.131442 ip-10-0-140-46 kubenswrapper[2576]: I0608 13:44:59.131210 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/ee2d069f-ad9b-4a11-8df6-3f4af3345b4d-ca-trust-extracted\") pod \"image-registry-6869cf9d57-q968v\" (UID: \"ee2d069f-ad9b-4a11-8df6-3f4af3345b4d\") " pod="openshift-image-registry/image-registry-6869cf9d57-q968v" Jun 08 13:44:59.131442 ip-10-0-140-46 kubenswrapper[2576]: I0608 13:44:59.131250 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/ee2d069f-ad9b-4a11-8df6-3f4af3345b4d-registry-certificates\") pod \"image-registry-6869cf9d57-q968v\" (UID: \"ee2d069f-ad9b-4a11-8df6-3f4af3345b4d\") " pod="openshift-image-registry/image-registry-6869cf9d57-q968v" Jun 08 13:44:59.131442 ip-10-0-140-46 kubenswrapper[2576]: I0608 13:44:59.131279 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/ee2d069f-ad9b-4a11-8df6-3f4af3345b4d-image-registry-private-configuration\") pod \"image-registry-6869cf9d57-q968v\" (UID: \"ee2d069f-ad9b-4a11-8df6-3f4af3345b4d\") " pod="openshift-image-registry/image-registry-6869cf9d57-q968v" Jun 08 13:44:59.131442 ip-10-0-140-46 kubenswrapper[2576]: I0608 13:44:59.131302 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xqfwb\" (UniqueName: \"kubernetes.io/projected/ee2d069f-ad9b-4a11-8df6-3f4af3345b4d-kube-api-access-xqfwb\") pod \"image-registry-6869cf9d57-q968v\" (UID: \"ee2d069f-ad9b-4a11-8df6-3f4af3345b4d\") " pod="openshift-image-registry/image-registry-6869cf9d57-q968v" Jun 08 13:44:59.131442 ip-10-0-140-46 kubenswrapper[2576]: I0608 13:44:59.131349 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-t9vzf\" (UniqueName: \"kubernetes.io/projected/bde2853a-ccff-4f0e-88d2-0abaa5040401-kube-api-access-t9vzf\") pod \"downloads-6657875f97-wxvf5\" (UID: \"bde2853a-ccff-4f0e-88d2-0abaa5040401\") " pod="openshift-console/downloads-6657875f97-wxvf5" Jun 08 13:44:59.131442 ip-10-0-140-46 kubenswrapper[2576]: I0608 13:44:59.131401 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/bc51170c-32a5-4e1f-80b8-063889b6c079-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-pbqss\" (UID: \"bc51170c-32a5-4e1f-80b8-063889b6c079\") " pod="openshift-insights/insights-runtime-extractor-pbqss" Jun 08 13:44:59.131442 ip-10-0-140-46 kubenswrapper[2576]: I0608 13:44:59.131427 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-h7qr2\" (UniqueName: \"kubernetes.io/projected/bc51170c-32a5-4e1f-80b8-063889b6c079-kube-api-access-h7qr2\") pod \"insights-runtime-extractor-pbqss\" (UID: \"bc51170c-32a5-4e1f-80b8-063889b6c079\") " pod="openshift-insights/insights-runtime-extractor-pbqss" Jun 08 13:44:59.131882 ip-10-0-140-46 kubenswrapper[2576]: I0608 13:44:59.131781 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/bc51170c-32a5-4e1f-80b8-063889b6c079-crio-socket\") pod \"insights-runtime-extractor-pbqss\" (UID: \"bc51170c-32a5-4e1f-80b8-063889b6c079\") " pod="openshift-insights/insights-runtime-extractor-pbqss" Jun 08 13:44:59.134225 ip-10-0-140-46 kubenswrapper[2576]: I0608 13:44:59.132178 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/ee2d069f-ad9b-4a11-8df6-3f4af3345b4d-ca-trust-extracted\") pod \"image-registry-6869cf9d57-q968v\" (UID: \"ee2d069f-ad9b-4a11-8df6-3f4af3345b4d\") " pod="openshift-image-registry/image-registry-6869cf9d57-q968v" Jun 08 13:44:59.135406 ip-10-0-140-46 kubenswrapper[2576]: I0608 13:44:59.134440 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/bc51170c-32a5-4e1f-80b8-063889b6c079-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-pbqss\" (UID: \"bc51170c-32a5-4e1f-80b8-063889b6c079\") " pod="openshift-insights/insights-runtime-extractor-pbqss" Jun 08 13:44:59.135406 ip-10-0-140-46 kubenswrapper[2576]: I0608 13:44:59.134645 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/bc51170c-32a5-4e1f-80b8-063889b6c079-data-volume\") pod \"insights-runtime-extractor-pbqss\" (UID: \"bc51170c-32a5-4e1f-80b8-063889b6c079\") " pod="openshift-insights/insights-runtime-extractor-pbqss" Jun 08 13:44:59.135406 ip-10-0-140-46 kubenswrapper[2576]: I0608 13:44:59.135373 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/ee2d069f-ad9b-4a11-8df6-3f4af3345b4d-trusted-ca\") pod \"image-registry-6869cf9d57-q968v\" (UID: \"ee2d069f-ad9b-4a11-8df6-3f4af3345b4d\") " pod="openshift-image-registry/image-registry-6869cf9d57-q968v" Jun 08 13:44:59.135406 ip-10-0-140-46 kubenswrapper[2576]: I0608 13:44:59.135371 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/ee2d069f-ad9b-4a11-8df6-3f4af3345b4d-registry-certificates\") pod \"image-registry-6869cf9d57-q968v\" (UID: \"ee2d069f-ad9b-4a11-8df6-3f4af3345b4d\") " pod="openshift-image-registry/image-registry-6869cf9d57-q968v" Jun 08 13:44:59.135931 ip-10-0-140-46 kubenswrapper[2576]: I0608 13:44:59.135844 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/bc51170c-32a5-4e1f-80b8-063889b6c079-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-pbqss\" (UID: \"bc51170c-32a5-4e1f-80b8-063889b6c079\") " pod="openshift-insights/insights-runtime-extractor-pbqss" Jun 08 13:44:59.136824 ip-10-0-140-46 kubenswrapper[2576]: I0608 13:44:59.136800 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/ee2d069f-ad9b-4a11-8df6-3f4af3345b4d-installation-pull-secrets\") pod \"image-registry-6869cf9d57-q968v\" (UID: \"ee2d069f-ad9b-4a11-8df6-3f4af3345b4d\") " pod="openshift-image-registry/image-registry-6869cf9d57-q968v" Jun 08 13:44:59.138159 ip-10-0-140-46 kubenswrapper[2576]: I0608 13:44:59.137584 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/ee2d069f-ad9b-4a11-8df6-3f4af3345b4d-image-registry-private-configuration\") pod \"image-registry-6869cf9d57-q968v\" (UID: \"ee2d069f-ad9b-4a11-8df6-3f4af3345b4d\") " pod="openshift-image-registry/image-registry-6869cf9d57-q968v" Jun 08 13:44:59.138159 ip-10-0-140-46 kubenswrapper[2576]: I0608 13:44:59.138142 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/ee2d069f-ad9b-4a11-8df6-3f4af3345b4d-registry-tls\") pod \"image-registry-6869cf9d57-q968v\" (UID: \"ee2d069f-ad9b-4a11-8df6-3f4af3345b4d\") " pod="openshift-image-registry/image-registry-6869cf9d57-q968v" Jun 08 13:44:59.142243 ip-10-0-140-46 kubenswrapper[2576]: I0608 13:44:59.142197 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/ee2d069f-ad9b-4a11-8df6-3f4af3345b4d-bound-sa-token\") pod \"image-registry-6869cf9d57-q968v\" (UID: \"ee2d069f-ad9b-4a11-8df6-3f4af3345b4d\") " pod="openshift-image-registry/image-registry-6869cf9d57-q968v" Jun 08 13:44:59.143557 ip-10-0-140-46 kubenswrapper[2576]: I0608 13:44:59.143506 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-h7qr2\" (UniqueName: \"kubernetes.io/projected/bc51170c-32a5-4e1f-80b8-063889b6c079-kube-api-access-h7qr2\") pod \"insights-runtime-extractor-pbqss\" (UID: \"bc51170c-32a5-4e1f-80b8-063889b6c079\") " pod="openshift-insights/insights-runtime-extractor-pbqss" Jun 08 13:44:59.148578 ip-10-0-140-46 kubenswrapper[2576]: I0608 13:44:59.148510 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-t9vzf\" (UniqueName: \"kubernetes.io/projected/bde2853a-ccff-4f0e-88d2-0abaa5040401-kube-api-access-t9vzf\") pod \"downloads-6657875f97-wxvf5\" (UID: \"bde2853a-ccff-4f0e-88d2-0abaa5040401\") " pod="openshift-console/downloads-6657875f97-wxvf5" Jun 08 13:44:59.159081 ip-10-0-140-46 kubenswrapper[2576]: I0608 13:44:59.159052 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-xqfwb\" (UniqueName: \"kubernetes.io/projected/ee2d069f-ad9b-4a11-8df6-3f4af3345b4d-kube-api-access-xqfwb\") pod \"image-registry-6869cf9d57-q968v\" (UID: \"ee2d069f-ad9b-4a11-8df6-3f4af3345b4d\") " pod="openshift-image-registry/image-registry-6869cf9d57-q968v" Jun 08 13:44:59.203379 ip-10-0-140-46 kubenswrapper[2576]: I0608 13:44:59.203039 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-5b7f5cbf55-rj4tt" Jun 08 13:44:59.206419 ip-10-0-140-46 kubenswrapper[2576]: I0608 13:44:59.206377 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cx7sn_6e4b50fc-3e91-4f50-b92a-e90919788248/konnectivity-agent/0.log" limit=1024 Jun 08 13:44:59.231433 ip-10-0-140-46 kubenswrapper[2576]: I0608 13:44:59.231383 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-l52bl"] Jun 08 13:44:59.231936 ip-10-0-140-46 kubenswrapper[2576]: I0608 13:44:59.231732 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/downloads-6657875f97-wxvf5" Jun 08 13:44:59.242625 ip-10-0-140-46 kubenswrapper[2576]: I0608 13:44:59.241922 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-pbqss" Jun 08 13:44:59.284628 ip-10-0-140-46 kubenswrapper[2576]: I0608 13:44:59.284435 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-6869cf9d57-q968v" Jun 08 13:44:59.306120 ip-10-0-140-46 kubenswrapper[2576]: I0608 13:44:59.305927 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-59f59d9cd6-pddlc"] Jun 08 13:44:59.328850 ip-10-0-140-46 kubenswrapper[2576]: I0608 13:44:59.328740 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cx7sn_6e4b50fc-3e91-4f50-b92a-e90919788248/konnectivity-agent/0.log" limit=1024 Jun 08 13:44:59.354595 ip-10-0-140-46 kubenswrapper[2576]: I0608 13:44:59.354544 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/klusterlet-addon-workmgr-7c846fcb8c-f5t5c"] Jun 08 13:44:59.496532 ip-10-0-140-46 kubenswrapper[2576]: I0608 13:44:59.496312 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-5b7f5cbf55-rj4tt"] Jun 08 13:44:59.501743 ip-10-0-140-46 kubenswrapper[2576]: W0608 13:44:59.501696 2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod77b6314b_cbdb_49be_8d7d_41812b662df9.slice/crio-0a50ea398fe39d6d4fe5d451eed379420643d4774a067e0d8aab88483e247d14 WatchSource:0}: Error finding container 0a50ea398fe39d6d4fe5d451eed379420643d4774a067e0d8aab88483e247d14: Status 404 returned error can't find the container with id 0a50ea398fe39d6d4fe5d451eed379420643d4774a067e0d8aab88483e247d14 Jun 08 13:44:59.529637 ip-10-0-140-46 kubenswrapper[2576]: I0608 13:44:59.529607 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-pbqss"] Jun 08 13:44:59.533131 ip-10-0-140-46 kubenswrapper[2576]: W0608 13:44:59.533104 2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podbc51170c_32a5_4e1f_80b8_063889b6c079.slice/crio-4b4540d406fc1bbf5bb696c57f8b381875fd9e6cad815b30e01bb415f01610e4 WatchSource:0}: Error finding container 4b4540d406fc1bbf5bb696c57f8b381875fd9e6cad815b30e01bb415f01610e4: Status 404 returned error can't find the container with id 4b4540d406fc1bbf5bb696c57f8b381875fd9e6cad815b30e01bb415f01610e4 Jun 08 13:44:59.545898 ip-10-0-140-46 kubenswrapper[2576]: I0608 13:44:59.545871 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/downloads-6657875f97-wxvf5"] Jun 08 13:44:59.548976 ip-10-0-140-46 kubenswrapper[2576]: W0608 13:44:59.548950 2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podbde2853a_ccff_4f0e_88d2_0abaa5040401.slice/crio-2769fb5fd81eba50715aa222b93bd41e08a96842d525d4eee3e990d33f7dba3d WatchSource:0}: Error finding container 2769fb5fd81eba50715aa222b93bd41e08a96842d525d4eee3e990d33f7dba3d: Status 404 returned error can't find the container with id 2769fb5fd81eba50715aa222b93bd41e08a96842d525d4eee3e990d33f7dba3d Jun 08 13:44:59.563383 ip-10-0-140-46 kubenswrapper[2576]: I0608 13:44:59.563346 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-6869cf9d57-q968v"] Jun 08 13:44:59.569129 ip-10-0-140-46 kubenswrapper[2576]: W0608 13:44:59.569098 2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podee2d069f_ad9b_4a11_8df6_3f4af3345b4d.slice/crio-990720d10b02444c2de33b200953d58e6cca05c5ccfc584e8e964b239209f882 WatchSource:0}: Error finding container 990720d10b02444c2de33b200953d58e6cca05c5ccfc584e8e964b239209f882: Status 404 returned error can't find the container with id 990720d10b02444c2de33b200953d58e6cca05c5ccfc584e8e964b239209f882 Jun 08 13:44:59.727349 ip-10-0-140-46 kubenswrapper[2576]: I0608 13:44:59.727254 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-6869cf9d57-q968v" event={"ID":"ee2d069f-ad9b-4a11-8df6-3f4af3345b4d","Type":"ContainerStarted","Data":"a399aee153727cafb5704f800a263a4fc581850b48aec965a6f0e37350ad39c6"} Jun 08 13:44:59.727349 ip-10-0-140-46 kubenswrapper[2576]: I0608 13:44:59.727317 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-6869cf9d57-q968v" event={"ID":"ee2d069f-ad9b-4a11-8df6-3f4af3345b4d","Type":"ContainerStarted","Data":"990720d10b02444c2de33b200953d58e6cca05c5ccfc584e8e964b239209f882"} Jun 08 13:44:59.729025 ip-10-0-140-46 kubenswrapper[2576]: I0608 13:44:59.728992 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-5b7f5cbf55-rj4tt" event={"ID":"77b6314b-cbdb-49be-8d7d-41812b662df9","Type":"ContainerStarted","Data":"0a50ea398fe39d6d4fe5d451eed379420643d4774a067e0d8aab88483e247d14"} Jun 08 13:44:59.732254 ip-10-0-140-46 kubenswrapper[2576]: I0608 13:44:59.732200 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-59f59d9cd6-pddlc" event={"ID":"e759a1d3-8adc-492b-bedb-87ff772a3e79","Type":"ContainerStarted","Data":"ee461d0029ceedfa0cede27cdc97563841e9ac92cdf110d6c25e7213c6ae33ed"} Jun 08 13:44:59.733947 ip-10-0-140-46 kubenswrapper[2576]: I0608 13:44:59.733866 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-l52bl" event={"ID":"2ef5209f-d5f5-4fae-a86c-1bb23283f29a","Type":"ContainerStarted","Data":"51a90f0de8b41953f4f9cac543dc784c2343dd4662b4173df4e60a5ce2d5a064"} Jun 08 13:44:59.736153 ip-10-0-140-46 kubenswrapper[2576]: I0608 13:44:59.735631 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-98b4d96dc-d224h" event={"ID":"3d97d05c-9d8f-4d01-8543-610bc38837c4","Type":"ContainerStarted","Data":"b441d8603000c55e3a3e00e10d6cc45e721248c5cd9fe6fa1d260e322eaaa679"} Jun 08 13:44:59.736153 ip-10-0-140-46 kubenswrapper[2576]: I0608 13:44:59.735669 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-98b4d96dc-d224h" event={"ID":"3d97d05c-9d8f-4d01-8543-610bc38837c4","Type":"ContainerStarted","Data":"84c2efb9bc185d935c425067c2a6736cb359dd2af44027f86da1bda86c9a7bc5"} Jun 08 13:44:59.736153 ip-10-0-140-46 kubenswrapper[2576]: I0608 13:44:59.735898 2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-image-registry/image-registry-98b4d96dc-d224h" Jun 08 13:44:59.739329 ip-10-0-140-46 kubenswrapper[2576]: I0608 13:44:59.739229 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-pbqss" event={"ID":"bc51170c-32a5-4e1f-80b8-063889b6c079","Type":"ContainerStarted","Data":"c6b714c6b3c8eb2c7a904a9f6a38b9e15381d900db440c7d235f3e7c2ba18845"} Jun 08 13:44:59.739329 ip-10-0-140-46 kubenswrapper[2576]: I0608 13:44:59.739277 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-pbqss" event={"ID":"bc51170c-32a5-4e1f-80b8-063889b6c079","Type":"ContainerStarted","Data":"4b4540d406fc1bbf5bb696c57f8b381875fd9e6cad815b30e01bb415f01610e4"} Jun 08 13:44:59.741337 ip-10-0-140-46 kubenswrapper[2576]: I0608 13:44:59.741163 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/downloads-6657875f97-wxvf5" event={"ID":"bde2853a-ccff-4f0e-88d2-0abaa5040401","Type":"ContainerStarted","Data":"2769fb5fd81eba50715aa222b93bd41e08a96842d525d4eee3e990d33f7dba3d"} Jun 08 13:44:59.743134 ip-10-0-140-46 kubenswrapper[2576]: I0608 13:44:59.743081 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-7c846fcb8c-f5t5c" event={"ID":"f5ed7ee8-d9c0-46e1-8bc6-6ab79c7314bb","Type":"ContainerStarted","Data":"e27590290c9f185e404bcb394cc0821afb4757cee0397848b6e5e446e2d2c55b"} Jun 08 13:44:59.765027 ip-10-0-140-46 kubenswrapper[2576]: I0608 13:44:59.764730 2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/image-registry-98b4d96dc-d224h" podStartSLOduration=52.76471673 podStartE2EDuration="52.76471673s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-08 13:44:07 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-08 13:44:59.762900717 +0000 UTC m=+67.842229609" watchObservedRunningTime="2026-06-08 13:44:59.76471673 +0000 UTC m=+67.844045621" Jun 08 13:45:00.749508 ip-10-0-140-46 kubenswrapper[2576]: I0608 13:45:00.749438 2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-image-registry/image-registry-6869cf9d57-q968v" Jun 08 13:45:00.787189 ip-10-0-140-46 kubenswrapper[2576]: I0608 13:45:00.786186 2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/image-registry-6869cf9d57-q968v" podStartSLOduration=2.786163093 podStartE2EDuration="2.786163093s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-08 13:44:58 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-08 13:45:00.781838627 +0000 UTC m=+68.861167613" watchObservedRunningTime="2026-06-08 13:45:00.786163093 +0000 UTC m=+68.865491965" Jun 08 13:45:01.482948 ip-10-0-140-46 kubenswrapper[2576]: I0608 13:45:01.482910 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cx7sn_6e4b50fc-3e91-4f50-b92a-e90919788248/konnectivity-agent/0.log" limit=1024 Jun 08 13:45:01.576834 ip-10-0-140-46 kubenswrapper[2576]: I0608 13:45:01.576750 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cx7sn_6e4b50fc-3e91-4f50-b92a-e90919788248/konnectivity-agent/0.log" limit=1024 Jun 08 13:45:01.719615 ip-10-0-140-46 kubenswrapper[2576]: I0608 13:45:01.719522 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cx7sn_6e4b50fc-3e91-4f50-b92a-e90919788248/konnectivity-agent/0.log" limit=1024 Jun 08 13:45:01.743958 ip-10-0-140-46 kubenswrapper[2576]: I0608 13:45:01.743123 2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/prometheus-operator-admission-webhook-5b6b8f594-bq2f6"] Jun 08 13:45:01.764952 ip-10-0-140-46 kubenswrapper[2576]: I0608 13:45:01.764926 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-admission-webhook-5b6b8f594-bq2f6"] Jun 08 13:45:01.765386 ip-10-0-140-46 kubenswrapper[2576]: I0608 13:45:01.765025 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-admission-webhook-5b6b8f594-bq2f6" Jun 08 13:45:01.768690 ip-10-0-140-46 kubenswrapper[2576]: I0608 13:45:01.768666 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-admission-webhook-dockercfg-k8dlq\"" Jun 08 13:45:01.768809 ip-10-0-140-46 kubenswrapper[2576]: I0608 13:45:01.768678 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-admission-webhook-tls\"" Jun 08 13:45:01.858785 ip-10-0-140-46 kubenswrapper[2576]: I0608 13:45:01.858089 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certificates\" (UniqueName: \"kubernetes.io/secret/10989532-bce1-496d-90c3-98c578e1effa-tls-certificates\") pod \"prometheus-operator-admission-webhook-5b6b8f594-bq2f6\" (UID: \"10989532-bce1-496d-90c3-98c578e1effa\") " pod="openshift-monitoring/prometheus-operator-admission-webhook-5b6b8f594-bq2f6" Jun 08 13:45:01.959508 ip-10-0-140-46 kubenswrapper[2576]: I0608 13:45:01.959464 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certificates\" (UniqueName: \"kubernetes.io/secret/10989532-bce1-496d-90c3-98c578e1effa-tls-certificates\") pod \"prometheus-operator-admission-webhook-5b6b8f594-bq2f6\" (UID: \"10989532-bce1-496d-90c3-98c578e1effa\") " pod="openshift-monitoring/prometheus-operator-admission-webhook-5b6b8f594-bq2f6" Jun 08 13:45:01.959713 ip-10-0-140-46 kubenswrapper[2576]: E0608 13:45:01.959681 2576 secret.go:189] Couldn't get secret openshift-monitoring/prometheus-operator-admission-webhook-tls: secret "prometheus-operator-admission-webhook-tls" not found Jun 08 13:45:01.959773 ip-10-0-140-46 kubenswrapper[2576]: E0608 13:45:01.959748 2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/10989532-bce1-496d-90c3-98c578e1effa-tls-certificates podName:10989532-bce1-496d-90c3-98c578e1effa nodeName:}" failed. No retries permitted until 2026-06-08 13:45:02.459729488 +0000 UTC m=+70.539058359 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "tls-certificates" (UniqueName: "kubernetes.io/secret/10989532-bce1-496d-90c3-98c578e1effa-tls-certificates") pod "prometheus-operator-admission-webhook-5b6b8f594-bq2f6" (UID: "10989532-bce1-496d-90c3-98c578e1effa") : secret "prometheus-operator-admission-webhook-tls" not found Jun 08 13:45:02.464215 ip-10-0-140-46 kubenswrapper[2576]: I0608 13:45:02.464176 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certificates\" (UniqueName: \"kubernetes.io/secret/10989532-bce1-496d-90c3-98c578e1effa-tls-certificates\") pod \"prometheus-operator-admission-webhook-5b6b8f594-bq2f6\" (UID: \"10989532-bce1-496d-90c3-98c578e1effa\") " pod="openshift-monitoring/prometheus-operator-admission-webhook-5b6b8f594-bq2f6" Jun 08 13:45:02.464510 ip-10-0-140-46 kubenswrapper[2576]: E0608 13:45:02.464360 2576 secret.go:189] Couldn't get secret openshift-monitoring/prometheus-operator-admission-webhook-tls: secret "prometheus-operator-admission-webhook-tls" not found Jun 08 13:45:02.464510 ip-10-0-140-46 kubenswrapper[2576]: E0608 13:45:02.464427 2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/10989532-bce1-496d-90c3-98c578e1effa-tls-certificates podName:10989532-bce1-496d-90c3-98c578e1effa nodeName:}" failed. No retries permitted until 2026-06-08 13:45:03.464405248 +0000 UTC m=+71.543734121 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "tls-certificates" (UniqueName: "kubernetes.io/secret/10989532-bce1-496d-90c3-98c578e1effa-tls-certificates") pod "prometheus-operator-admission-webhook-5b6b8f594-bq2f6" (UID: "10989532-bce1-496d-90c3-98c578e1effa") : secret "prometheus-operator-admission-webhook-tls" not found Jun 08 13:45:02.523825 ip-10-0-140-46 kubenswrapper[2576]: I0608 13:45:02.523790 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cx7sn_6e4b50fc-3e91-4f50-b92a-e90919788248/konnectivity-agent/0.log" limit=1024 Jun 08 13:45:02.626490 ip-10-0-140-46 kubenswrapper[2576]: I0608 13:45:02.626458 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cx7sn_6e4b50fc-3e91-4f50-b92a-e90919788248/konnectivity-agent/0.log" limit=1024 Jun 08 13:45:03.277178 ip-10-0-140-46 kubenswrapper[2576]: I0608 13:45:03.277143 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cx7sn_6e4b50fc-3e91-4f50-b92a-e90919788248/konnectivity-agent/0.log" limit=1024 Jun 08 13:45:03.473931 ip-10-0-140-46 kubenswrapper[2576]: I0608 13:45:03.473900 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certificates\" (UniqueName: \"kubernetes.io/secret/10989532-bce1-496d-90c3-98c578e1effa-tls-certificates\") pod \"prometheus-operator-admission-webhook-5b6b8f594-bq2f6\" (UID: \"10989532-bce1-496d-90c3-98c578e1effa\") " pod="openshift-monitoring/prometheus-operator-admission-webhook-5b6b8f594-bq2f6" Jun 08 13:45:03.476935 ip-10-0-140-46 kubenswrapper[2576]: I0608 13:45:03.476905 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certificates\" (UniqueName: \"kubernetes.io/secret/10989532-bce1-496d-90c3-98c578e1effa-tls-certificates\") pod \"prometheus-operator-admission-webhook-5b6b8f594-bq2f6\" (UID: \"10989532-bce1-496d-90c3-98c578e1effa\") " pod="openshift-monitoring/prometheus-operator-admission-webhook-5b6b8f594-bq2f6" Jun 08 13:45:03.582435 ip-10-0-140-46 kubenswrapper[2576]: I0608 13:45:03.582348 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-admission-webhook-5b6b8f594-bq2f6" Jun 08 13:45:05.106924 ip-10-0-140-46 kubenswrapper[2576]: I0608 13:45:05.106888 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cx7sn_6e4b50fc-3e91-4f50-b92a-e90919788248/konnectivity-agent/0.log" limit=1024 Jun 08 13:45:05.172772 ip-10-0-140-46 kubenswrapper[2576]: I0608 13:45:05.172712 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cx7sn_6e4b50fc-3e91-4f50-b92a-e90919788248/konnectivity-agent/0.log" limit=1024 Jun 08 13:45:06.518918 ip-10-0-140-46 kubenswrapper[2576]: I0608 13:45:06.518876 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cx7sn_6e4b50fc-3e91-4f50-b92a-e90919788248/konnectivity-agent/0.log" limit=1024 Jun 08 13:45:07.248879 ip-10-0-140-46 kubenswrapper[2576]: I0608 13:45:07.248841 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cx7sn_6e4b50fc-3e91-4f50-b92a-e90919788248/konnectivity-agent/0.log" limit=1024 Jun 08 13:45:07.342860 ip-10-0-140-46 kubenswrapper[2576]: I0608 13:45:07.342815 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cx7sn_6e4b50fc-3e91-4f50-b92a-e90919788248/konnectivity-agent/0.log" limit=1024 Jun 08 13:45:08.123530 ip-10-0-140-46 kubenswrapper[2576]: I0608 13:45:08.123500 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cx7sn_6e4b50fc-3e91-4f50-b92a-e90919788248/konnectivity-agent/0.log" limit=1024 Jun 08 13:45:08.234275 ip-10-0-140-46 kubenswrapper[2576]: I0608 13:45:08.234242 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cx7sn_6e4b50fc-3e91-4f50-b92a-e90919788248/konnectivity-agent/0.log" limit=1024 Jun 08 13:45:10.117318 ip-10-0-140-46 kubenswrapper[2576]: I0608 13:45:10.117247 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-admission-webhook-5b6b8f594-bq2f6"] Jun 08 13:45:10.803207 ip-10-0-140-46 kubenswrapper[2576]: I0608 13:45:10.802983 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-99957" event={"ID":"4b283339-40c0-40f5-b9d9-c75e99e4f984","Type":"ContainerStarted","Data":"94ce64452520a944d98088f0a274c066c00558055ee11fdeb5d42cdaccb59756"} Jun 08 13:45:10.812793 ip-10-0-140-46 kubenswrapper[2576]: I0608 13:45:10.807987 2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-network-diagnostics/network-check-target-99957" Jun 08 13:45:10.816922 ip-10-0-140-46 kubenswrapper[2576]: I0608 13:45:10.816857 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-5b7f5cbf55-rj4tt" event={"ID":"77b6314b-cbdb-49be-8d7d-41812b662df9","Type":"ContainerStarted","Data":"7b0d0e299d678d7e3008813692ad8d8a2f672b8dbd97f1617d4203e2b2b97c51"} Jun 08 13:45:10.818972 ip-10-0-140-46 kubenswrapper[2576]: I0608 13:45:10.818944 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-dm2n6" event={"ID":"6da5a732-b003-412c-8308-e80cead7eb1c","Type":"ContainerStarted","Data":"809a6da8088c2f59173d5e48c9775fb90e506850950d2b8d88617b25f557c275"} Jun 08 13:45:10.821835 ip-10-0-140-46 kubenswrapper[2576]: I0608 13:45:10.821459 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-59f59d9cd6-pddlc" event={"ID":"e759a1d3-8adc-492b-bedb-87ff772a3e79","Type":"ContainerStarted","Data":"68068d868f034cc6f873284ac8a39c1d01d5a50dd33b51345a480a878e40415f"} Jun 08 13:45:10.824427 ip-10-0-140-46 kubenswrapper[2576]: I0608 13:45:10.824405 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-l52bl" event={"ID":"2ef5209f-d5f5-4fae-a86c-1bb23283f29a","Type":"ContainerStarted","Data":"1c734a28959b2fba203b3321a5982889198c1e39ab62e3b3b28d72e614c8568e"} Jun 08 13:45:10.825006 ip-10-0-140-46 kubenswrapper[2576]: I0608 13:45:10.824879 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-l52bl" event={"ID":"2ef5209f-d5f5-4fae-a86c-1bb23283f29a","Type":"ContainerStarted","Data":"686ed77918f444df93f8f58bf8a5d3688c0b3a8c24c168a6c43f203b43d68f53"} Jun 08 13:45:10.825006 ip-10-0-140-46 kubenswrapper[2576]: I0608 13:45:10.824976 2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-dns/dns-default-l52bl" Jun 08 13:45:10.826639 ip-10-0-140-46 kubenswrapper[2576]: I0608 13:45:10.826558 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-admission-webhook-5b6b8f594-bq2f6" event={"ID":"10989532-bce1-496d-90c3-98c578e1effa","Type":"ContainerStarted","Data":"cf1dfce5c91047ee62abf2c7385a618c345ef9a7845c0b38902e5b1283b719a4"} Jun 08 13:45:10.829661 ip-10-0-140-46 kubenswrapper[2576]: I0608 13:45:10.829638 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-pbqss" event={"ID":"bc51170c-32a5-4e1f-80b8-063889b6c079","Type":"ContainerStarted","Data":"557fc1fe52f9309b3d9f9ccd4635b517b59543b406ca24d4622526c87f014fc6"} Jun 08 13:45:10.834941 ip-10-0-140-46 kubenswrapper[2576]: I0608 13:45:10.833119 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-7c846fcb8c-f5t5c" event={"ID":"f5ed7ee8-d9c0-46e1-8bc6-6ab79c7314bb","Type":"ContainerStarted","Data":"223686ff3911f75a817e169009cbb89538bb19e1b9e42f03d7e7e8f681719170"} Jun 08 13:45:10.834941 ip-10-0-140-46 kubenswrapper[2576]: I0608 13:45:10.833755 2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-7c846fcb8c-f5t5c" Jun 08 13:45:10.834941 ip-10-0-140-46 kubenswrapper[2576]: I0608 13:45:10.834895 2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-diagnostics/network-check-target-99957" podStartSLOduration=66.596378981 podStartE2EDuration="1m18.83487935s" totalImagesPullingTime="12.238500369s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-08 13:43:52 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-08 13:45:10.832874644 +0000 UTC m=+78.912203527" watchObservedRunningTime="2026-06-08 13:45:10.83487935 +0000 UTC m=+78.914208242" Jun 08 13:45:10.835424 ip-10-0-140-46 kubenswrapper[2576]: I0608 13:45:10.835407 2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-7c846fcb8c-f5t5c" Jun 08 13:45:10.891593 ip-10-0-140-46 kubenswrapper[2576]: I0608 13:45:10.891139 2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/dns-default-l52bl" podStartSLOduration=34.217503004 podStartE2EDuration="44.891117377s" totalImagesPullingTime="10.673614373s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-08 13:44:26 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-08 13:45:10.890921603 +0000 UTC m=+78.970250496" watchObservedRunningTime="2026-06-08 13:45:10.891117377 +0000 UTC m=+78.970446272" Jun 08 13:45:10.892509 ip-10-0-140-46 kubenswrapper[2576]: I0608 13:45:10.892031 2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/global-pull-secret-syncer-dm2n6" podStartSLOduration=66.324017095 podStartE2EDuration="1m18.892017796s" totalImagesPullingTime="12.568000701s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-08 13:43:52 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-08 13:45:10.859374004 +0000 UTC m=+78.938702896" watchObservedRunningTime="2026-06-08 13:45:10.892017796 +0000 UTC m=+78.971346690" Jun 08 13:45:10.949294 ip-10-0-140-46 kubenswrapper[2576]: I0608 13:45:10.949144 2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-59f59d9cd6-pddlc" podStartSLOduration=2.360903532 podStartE2EDuration="12.94912257s" totalImagesPullingTime="10.588219038s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-08 13:44:58 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-08 13:45:10.920018914 +0000 UTC m=+78.999347806" watchObservedRunningTime="2026-06-08 13:45:10.94912257 +0000 UTC m=+79.028451461" Jun 08 13:45:10.949294 ip-10-0-140-46 kubenswrapper[2576]: I0608 13:45:10.949250 2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-5b7f5cbf55-rj4tt" podStartSLOduration=2.583824849 podStartE2EDuration="12.949239525s" totalImagesPullingTime="10.365414676s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-08 13:44:58 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-08 13:45:10.947463919 +0000 UTC m=+79.026792812" watchObservedRunningTime="2026-06-08 13:45:10.949239525 +0000 UTC m=+79.028568417" Jun 08 13:45:10.957662 ip-10-0-140-46 kubenswrapper[2576]: I0608 13:45:10.957633 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cx7sn_6e4b50fc-3e91-4f50-b92a-e90919788248/konnectivity-agent/0.log" limit=1024 Jun 08 13:45:10.975453 ip-10-0-140-46 kubenswrapper[2576]: I0608 13:45:10.975393 2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-7c846fcb8c-f5t5c" podStartSLOduration=2.395279942 podStartE2EDuration="12.975374511s" totalImagesPullingTime="10.580094569s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-08 13:44:58 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-08 13:45:10.974333451 +0000 UTC m=+79.053662343" watchObservedRunningTime="2026-06-08 13:45:10.975374511 +0000 UTC m=+79.054703404" Jun 08 13:45:11.057923 ip-10-0-140-46 kubenswrapper[2576]: I0608 13:45:11.057849 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cx7sn_6e4b50fc-3e91-4f50-b92a-e90919788248/konnectivity-agent/0.log" limit=1024 Jun 08 13:45:11.509089 ip-10-0-140-46 kubenswrapper[2576]: I0608 13:45:11.509013 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cx7sn_6e4b50fc-3e91-4f50-b92a-e90919788248/konnectivity-agent/0.log" limit=1024 Jun 08 13:45:11.575770 ip-10-0-140-46 kubenswrapper[2576]: I0608 13:45:11.575733 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cx7sn_6e4b50fc-3e91-4f50-b92a-e90919788248/konnectivity-agent/0.log" limit=1024 Jun 08 13:45:13.119437 ip-10-0-140-46 kubenswrapper[2576]: I0608 13:45:13.119377 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cx7sn_6e4b50fc-3e91-4f50-b92a-e90919788248/konnectivity-agent/0.log" limit=1024 Jun 08 13:45:13.192241 ip-10-0-140-46 kubenswrapper[2576]: I0608 13:45:13.192206 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cx7sn_6e4b50fc-3e91-4f50-b92a-e90919788248/konnectivity-agent/0.log" limit=1024 Jun 08 13:45:14.051463 ip-10-0-140-46 kubenswrapper[2576]: I0608 13:45:14.051425 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cx7sn_6e4b50fc-3e91-4f50-b92a-e90919788248/konnectivity-agent/0.log" limit=1024 Jun 08 13:45:14.303691 ip-10-0-140-46 kubenswrapper[2576]: I0608 13:45:14.303601 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cx7sn_6e4b50fc-3e91-4f50-b92a-e90919788248/konnectivity-agent/0.log" limit=1024 Jun 08 13:45:14.398883 ip-10-0-140-46 kubenswrapper[2576]: I0608 13:45:14.398844 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cx7sn_6e4b50fc-3e91-4f50-b92a-e90919788248/konnectivity-agent/0.log" limit=1024 Jun 08 13:45:16.718493 ip-10-0-140-46 kubenswrapper[2576]: I0608 13:45:16.718445 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cx7sn_6e4b50fc-3e91-4f50-b92a-e90919788248/konnectivity-agent/0.log" limit=1024 Jun 08 13:45:16.819293 ip-10-0-140-46 kubenswrapper[2576]: I0608 13:45:16.819262 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cx7sn_6e4b50fc-3e91-4f50-b92a-e90919788248/konnectivity-agent/0.log" limit=1024 Jun 08 13:45:16.932353 ip-10-0-140-46 kubenswrapper[2576]: I0608 13:45:16.932311 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cx7sn_6e4b50fc-3e91-4f50-b92a-e90919788248/konnectivity-agent/0.log" limit=1024 Jun 08 13:45:17.740774 ip-10-0-140-46 kubenswrapper[2576]: I0608 13:45:17.740740 2576 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-5b7f5cbf55-rj4tt"] Jun 08 13:45:18.854736 ip-10-0-140-46 kubenswrapper[2576]: I0608 13:45:18.854704 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cx7sn_6e4b50fc-3e91-4f50-b92a-e90919788248/konnectivity-agent/0.log" limit=1024 Jun 08 13:45:18.917407 ip-10-0-140-46 kubenswrapper[2576]: I0608 13:45:18.917374 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cx7sn_6e4b50fc-3e91-4f50-b92a-e90919788248/konnectivity-agent/0.log" limit=1024 Jun 08 13:45:18.995415 ip-10-0-140-46 kubenswrapper[2576]: I0608 13:45:18.995367 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cx7sn_6e4b50fc-3e91-4f50-b92a-e90919788248/konnectivity-agent/0.log" limit=1024 Jun 08 13:45:19.095114 ip-10-0-140-46 kubenswrapper[2576]: I0608 13:45:19.095091 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cx7sn_6e4b50fc-3e91-4f50-b92a-e90919788248/konnectivity-agent/0.log" limit=1024 Jun 08 13:45:19.203863 ip-10-0-140-46 kubenswrapper[2576]: I0608 13:45:19.203829 2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-5b7f5cbf55-rj4tt" Jun 08 13:45:19.289819 ip-10-0-140-46 kubenswrapper[2576]: I0608 13:45:19.289783 2576 patch_prober.go:28] interesting pod/image-registry-6869cf9d57-q968v container/registry namespace/openshift-image-registry: Liveness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body={"errors":[{"code":"UNAVAILABLE","message":"service unavailable","detail":"health check failed: please see /debug/health"}]} Jun 08 13:45:19.290000 ip-10-0-140-46 kubenswrapper[2576]: I0608 13:45:19.289838 2576 prober.go:120] "Probe failed" probeType="Liveness" pod="openshift-image-registry/image-registry-6869cf9d57-q968v" podUID="ee2d069f-ad9b-4a11-8df6-3f4af3345b4d" containerName="registry" probeResult="failure" output="HTTP probe failed with statuscode: 503" Jun 08 13:45:19.742958 ip-10-0-140-46 kubenswrapper[2576]: I0608 13:45:19.742864 2576 patch_prober.go:28] interesting pod/image-registry-98b4d96dc-d224h container/registry namespace/openshift-image-registry: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body={"errors":[{"code":"UNAVAILABLE","message":"service unavailable","detail":"health check failed: please see /debug/health"}]} Jun 08 13:45:19.742958 ip-10-0-140-46 kubenswrapper[2576]: I0608 13:45:19.742924 2576 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-image-registry/image-registry-98b4d96dc-d224h" podUID="3d97d05c-9d8f-4d01-8543-610bc38837c4" containerName="registry" probeResult="failure" output="HTTP probe failed with statuscode: 503" Jun 08 13:45:19.876738 ip-10-0-140-46 kubenswrapper[2576]: I0608 13:45:19.876699 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-admission-webhook-5b6b8f594-bq2f6" event={"ID":"10989532-bce1-496d-90c3-98c578e1effa","Type":"ContainerStarted","Data":"f9e5018f62f7f850a06baa6f3ffe6f61f25906b6ea33787a3b274b4597876aa0"} Jun 08 13:45:19.877371 ip-10-0-140-46 kubenswrapper[2576]: I0608 13:45:19.877262 2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/prometheus-operator-admission-webhook-5b6b8f594-bq2f6" Jun 08 13:45:19.879368 ip-10-0-140-46 kubenswrapper[2576]: I0608 13:45:19.879343 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-pbqss" event={"ID":"bc51170c-32a5-4e1f-80b8-063889b6c079","Type":"ContainerStarted","Data":"4d7fbf0ed0d63ca401109be3a39ddfac30373a4ed8a2b7db5858d855e3c382fe"} Jun 08 13:45:19.881176 ip-10-0-140-46 kubenswrapper[2576]: I0608 13:45:19.881145 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/downloads-6657875f97-wxvf5" event={"ID":"bde2853a-ccff-4f0e-88d2-0abaa5040401","Type":"ContainerStarted","Data":"f9f2cb565ba640855b4e7540bb53b2496124e4968843ca938319d6281c8e0581"} Jun 08 13:45:19.881392 ip-10-0-140-46 kubenswrapper[2576]: I0608 13:45:19.881374 2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/downloads-6657875f97-wxvf5" Jun 08 13:45:19.882662 ip-10-0-140-46 kubenswrapper[2576]: I0608 13:45:19.882645 2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/prometheus-operator-admission-webhook-5b6b8f594-bq2f6" Jun 08 13:45:19.892758 ip-10-0-140-46 kubenswrapper[2576]: I0608 13:45:19.892733 2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/downloads-6657875f97-wxvf5" Jun 08 13:45:19.898592 ip-10-0-140-46 kubenswrapper[2576]: I0608 13:45:19.898531 2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/prometheus-operator-admission-webhook-5b6b8f594-bq2f6" podStartSLOduration=10.023336255 podStartE2EDuration="18.898515297s" totalImagesPullingTime="8.875179042s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-08 13:45:01 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-08 13:45:19.897750508 +0000 UTC m=+87.977079402" watchObservedRunningTime="2026-06-08 13:45:19.898515297 +0000 UTC m=+87.977844188" Jun 08 13:45:19.962188 ip-10-0-140-46 kubenswrapper[2576]: I0608 13:45:19.962115 2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-insights/insights-runtime-extractor-pbqss" podStartSLOduration=2.796815138 podStartE2EDuration="21.962093084s" totalImagesPullingTime="19.165277946s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-08 13:44:58 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-08 13:45:19.960672211 +0000 UTC m=+88.040001104" watchObservedRunningTime="2026-06-08 13:45:19.962093084 +0000 UTC m=+88.041421979" Jun 08 13:45:19.962818 ip-10-0-140-46 kubenswrapper[2576]: I0608 13:45:19.962776 2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/downloads-6657875f97-wxvf5" podStartSLOduration=2.457026235 podStartE2EDuration="21.962761335s" totalImagesPullingTime="19.5057351s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-08 13:44:58 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-08 13:45:19.930079961 +0000 UTC m=+88.009408853" watchObservedRunningTime="2026-06-08 13:45:19.962761335 +0000 UTC m=+88.042090228" Jun 08 13:45:20.785798 ip-10-0-140-46 kubenswrapper[2576]: I0608 13:45:20.785752 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cx7sn_6e4b50fc-3e91-4f50-b92a-e90919788248/konnectivity-agent/0.log" limit=1024 Jun 08 13:45:20.882927 ip-10-0-140-46 kubenswrapper[2576]: I0608 13:45:20.882893 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cx7sn_6e4b50fc-3e91-4f50-b92a-e90919788248/konnectivity-agent/0.log" limit=1024 Jun 08 13:45:21.634558 ip-10-0-140-46 kubenswrapper[2576]: I0608 13:45:21.634522 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cx7sn_6e4b50fc-3e91-4f50-b92a-e90919788248/konnectivity-agent/0.log" limit=1024 Jun 08 13:45:21.762293 ip-10-0-140-46 kubenswrapper[2576]: I0608 13:45:21.762263 2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-image-registry/image-registry-6869cf9d57-q968v" Jun 08 13:45:21.844326 ip-10-0-140-46 kubenswrapper[2576]: I0608 13:45:21.844292 2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-dns/dns-default-l52bl" Jun 08 13:45:21.934619 ip-10-0-140-46 kubenswrapper[2576]: I0608 13:45:21.934514 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cx7sn_6e4b50fc-3e91-4f50-b92a-e90919788248/konnectivity-agent/0.log" limit=1024 Jun 08 13:45:22.028078 ip-10-0-140-46 kubenswrapper[2576]: I0608 13:45:22.028038 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cx7sn_6e4b50fc-3e91-4f50-b92a-e90919788248/konnectivity-agent/0.log" limit=1024 Jun 08 13:45:23.968158 ip-10-0-140-46 kubenswrapper[2576]: I0608 13:45:23.968121 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cx7sn_6e4b50fc-3e91-4f50-b92a-e90919788248/konnectivity-agent/0.log" limit=1024 Jun 08 13:45:24.091355 ip-10-0-140-46 kubenswrapper[2576]: I0608 13:45:24.091300 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cx7sn_6e4b50fc-3e91-4f50-b92a-e90919788248/konnectivity-agent/0.log" limit=1024 Jun 08 13:45:24.557047 ip-10-0-140-46 kubenswrapper[2576]: I0608 13:45:24.557009 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cx7sn_6e4b50fc-3e91-4f50-b92a-e90919788248/konnectivity-agent/0.log" limit=1024 Jun 08 13:45:24.633135 ip-10-0-140-46 kubenswrapper[2576]: I0608 13:45:24.633099 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cx7sn_6e4b50fc-3e91-4f50-b92a-e90919788248/konnectivity-agent/0.log" limit=1024 Jun 08 13:45:24.765064 ip-10-0-140-46 kubenswrapper[2576]: I0608 13:45:24.765020 2576 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-image-registry/image-registry-98b4d96dc-d224h" podUID="3d97d05c-9d8f-4d01-8543-610bc38837c4" containerName="registry" containerID="cri-o://b441d8603000c55e3a3e00e10d6cc45e721248c5cd9fe6fa1d260e322eaaa679" gracePeriod=30 Jun 08 13:45:24.902090 ip-10-0-140-46 kubenswrapper[2576]: I0608 13:45:24.901975 2576 generic.go:356] "Generic (PLEG): container finished" podID="3d97d05c-9d8f-4d01-8543-610bc38837c4" containerID="b441d8603000c55e3a3e00e10d6cc45e721248c5cd9fe6fa1d260e322eaaa679" exitCode=0 Jun 08 13:45:24.902090 ip-10-0-140-46 kubenswrapper[2576]: I0608 13:45:24.902025 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-98b4d96dc-d224h" event={"ID":"3d97d05c-9d8f-4d01-8543-610bc38837c4","Type":"ContainerDied","Data":"b441d8603000c55e3a3e00e10d6cc45e721248c5cd9fe6fa1d260e322eaaa679"} Jun 08 13:45:25.053043 ip-10-0-140-46 kubenswrapper[2576]: I0608 13:45:25.052976 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cx7sn_6e4b50fc-3e91-4f50-b92a-e90919788248/konnectivity-agent/0.log" limit=1024 Jun 08 13:45:25.068362 ip-10-0-140-46 kubenswrapper[2576]: I0608 13:45:25.068290 2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-98b4d96dc-d224h" Jun 08 13:45:25.169203 ip-10-0-140-46 kubenswrapper[2576]: I0608 13:45:25.169167 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/3d97d05c-9d8f-4d01-8543-610bc38837c4-registry-certificates\") pod \"3d97d05c-9d8f-4d01-8543-610bc38837c4\" (UID: \"3d97d05c-9d8f-4d01-8543-610bc38837c4\") " Jun 08 13:45:25.169404 ip-10-0-140-46 kubenswrapper[2576]: I0608 13:45:25.169241 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/3d97d05c-9d8f-4d01-8543-610bc38837c4-image-registry-private-configuration\") pod \"3d97d05c-9d8f-4d01-8543-610bc38837c4\" (UID: \"3d97d05c-9d8f-4d01-8543-610bc38837c4\") " Jun 08 13:45:25.169404 ip-10-0-140-46 kubenswrapper[2576]: I0608 13:45:25.169278 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/3d97d05c-9d8f-4d01-8543-610bc38837c4-registry-tls\") pod \"3d97d05c-9d8f-4d01-8543-610bc38837c4\" (UID: \"3d97d05c-9d8f-4d01-8543-610bc38837c4\") " Jun 08 13:45:25.169404 ip-10-0-140-46 kubenswrapper[2576]: I0608 13:45:25.169308 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/3d97d05c-9d8f-4d01-8543-610bc38837c4-bound-sa-token\") pod \"3d97d05c-9d8f-4d01-8543-610bc38837c4\" (UID: \"3d97d05c-9d8f-4d01-8543-610bc38837c4\") " Jun 08 13:45:25.169404 ip-10-0-140-46 kubenswrapper[2576]: I0608 13:45:25.169336 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/3d97d05c-9d8f-4d01-8543-610bc38837c4-installation-pull-secrets\") pod \"3d97d05c-9d8f-4d01-8543-610bc38837c4\" (UID: \"3d97d05c-9d8f-4d01-8543-610bc38837c4\") " Jun 08 13:45:25.169404 ip-10-0-140-46 kubenswrapper[2576]: I0608 13:45:25.169364 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/3d97d05c-9d8f-4d01-8543-610bc38837c4-trusted-ca\") pod \"3d97d05c-9d8f-4d01-8543-610bc38837c4\" (UID: \"3d97d05c-9d8f-4d01-8543-610bc38837c4\") " Jun 08 13:45:25.169404 ip-10-0-140-46 kubenswrapper[2576]: I0608 13:45:25.169403 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-kfgjd\" (UniqueName: \"kubernetes.io/projected/3d97d05c-9d8f-4d01-8543-610bc38837c4-kube-api-access-kfgjd\") pod \"3d97d05c-9d8f-4d01-8543-610bc38837c4\" (UID: \"3d97d05c-9d8f-4d01-8543-610bc38837c4\") " Jun 08 13:45:25.169773 ip-10-0-140-46 kubenswrapper[2576]: I0608 13:45:25.169457 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/3d97d05c-9d8f-4d01-8543-610bc38837c4-ca-trust-extracted\") pod \"3d97d05c-9d8f-4d01-8543-610bc38837c4\" (UID: \"3d97d05c-9d8f-4d01-8543-610bc38837c4\") " Jun 08 13:45:25.169773 ip-10-0-140-46 kubenswrapper[2576]: I0608 13:45:25.169525 2576 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/3d97d05c-9d8f-4d01-8543-610bc38837c4-registry-certificates" (OuterVolumeSpecName: "registry-certificates") pod "3d97d05c-9d8f-4d01-8543-610bc38837c4" (UID: "3d97d05c-9d8f-4d01-8543-610bc38837c4"). InnerVolumeSpecName "registry-certificates". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 08 13:45:25.169773 ip-10-0-140-46 kubenswrapper[2576]: I0608 13:45:25.169709 2576 reconciler_common.go:299] "Volume detached for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/3d97d05c-9d8f-4d01-8543-610bc38837c4-registry-certificates\") on node \"ip-10-0-140-46.ec2.internal\" DevicePath \"\"" Jun 08 13:45:25.170318 ip-10-0-140-46 kubenswrapper[2576]: I0608 13:45:25.170275 2576 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/3d97d05c-9d8f-4d01-8543-610bc38837c4-trusted-ca" (OuterVolumeSpecName: "trusted-ca") pod "3d97d05c-9d8f-4d01-8543-610bc38837c4" (UID: "3d97d05c-9d8f-4d01-8543-610bc38837c4"). InnerVolumeSpecName "trusted-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 08 13:45:25.172691 ip-10-0-140-46 kubenswrapper[2576]: I0608 13:45:25.172639 2576 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/3d97d05c-9d8f-4d01-8543-610bc38837c4-installation-pull-secrets" (OuterVolumeSpecName: "installation-pull-secrets") pod "3d97d05c-9d8f-4d01-8543-610bc38837c4" (UID: "3d97d05c-9d8f-4d01-8543-610bc38837c4"). InnerVolumeSpecName "installation-pull-secrets". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 08 13:45:25.172916 ip-10-0-140-46 kubenswrapper[2576]: I0608 13:45:25.172883 2576 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/3d97d05c-9d8f-4d01-8543-610bc38837c4-registry-tls" (OuterVolumeSpecName: "registry-tls") pod "3d97d05c-9d8f-4d01-8543-610bc38837c4" (UID: "3d97d05c-9d8f-4d01-8543-610bc38837c4"). InnerVolumeSpecName "registry-tls". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 08 13:45:25.173043 ip-10-0-140-46 kubenswrapper[2576]: I0608 13:45:25.172941 2576 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/3d97d05c-9d8f-4d01-8543-610bc38837c4-kube-api-access-kfgjd" (OuterVolumeSpecName: "kube-api-access-kfgjd") pod "3d97d05c-9d8f-4d01-8543-610bc38837c4" (UID: "3d97d05c-9d8f-4d01-8543-610bc38837c4"). InnerVolumeSpecName "kube-api-access-kfgjd". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 08 13:45:25.174049 ip-10-0-140-46 kubenswrapper[2576]: I0608 13:45:25.174022 2576 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/3d97d05c-9d8f-4d01-8543-610bc38837c4-image-registry-private-configuration" (OuterVolumeSpecName: "image-registry-private-configuration") pod "3d97d05c-9d8f-4d01-8543-610bc38837c4" (UID: "3d97d05c-9d8f-4d01-8543-610bc38837c4"). InnerVolumeSpecName "image-registry-private-configuration". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 08 13:45:25.174211 ip-10-0-140-46 kubenswrapper[2576]: I0608 13:45:25.174181 2576 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/3d97d05c-9d8f-4d01-8543-610bc38837c4-bound-sa-token" (OuterVolumeSpecName: "bound-sa-token") pod "3d97d05c-9d8f-4d01-8543-610bc38837c4" (UID: "3d97d05c-9d8f-4d01-8543-610bc38837c4"). InnerVolumeSpecName "bound-sa-token". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 08 13:45:25.181149 ip-10-0-140-46 kubenswrapper[2576]: I0608 13:45:25.181123 2576 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/3d97d05c-9d8f-4d01-8543-610bc38837c4-ca-trust-extracted" (OuterVolumeSpecName: "ca-trust-extracted") pod "3d97d05c-9d8f-4d01-8543-610bc38837c4" (UID: "3d97d05c-9d8f-4d01-8543-610bc38837c4"). InnerVolumeSpecName "ca-trust-extracted". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 08 13:45:25.219876 ip-10-0-140-46 kubenswrapper[2576]: I0608 13:45:25.219833 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cx7sn_6e4b50fc-3e91-4f50-b92a-e90919788248/konnectivity-agent/0.log" limit=1024 Jun 08 13:45:25.271148 ip-10-0-140-46 kubenswrapper[2576]: I0608 13:45:25.271109 2576 reconciler_common.go:299] "Volume detached for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/3d97d05c-9d8f-4d01-8543-610bc38837c4-image-registry-private-configuration\") on node \"ip-10-0-140-46.ec2.internal\" DevicePath \"\"" Jun 08 13:45:25.271148 ip-10-0-140-46 kubenswrapper[2576]: I0608 13:45:25.271145 2576 reconciler_common.go:299] "Volume detached for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/3d97d05c-9d8f-4d01-8543-610bc38837c4-registry-tls\") on node \"ip-10-0-140-46.ec2.internal\" DevicePath \"\"" Jun 08 13:45:25.271392 ip-10-0-140-46 kubenswrapper[2576]: I0608 13:45:25.271161 2576 reconciler_common.go:299] "Volume detached for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/3d97d05c-9d8f-4d01-8543-610bc38837c4-bound-sa-token\") on node \"ip-10-0-140-46.ec2.internal\" DevicePath \"\"" Jun 08 13:45:25.271392 ip-10-0-140-46 kubenswrapper[2576]: I0608 13:45:25.271176 2576 reconciler_common.go:299] "Volume detached for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/3d97d05c-9d8f-4d01-8543-610bc38837c4-installation-pull-secrets\") on node \"ip-10-0-140-46.ec2.internal\" DevicePath \"\"" Jun 08 13:45:25.271392 ip-10-0-140-46 kubenswrapper[2576]: I0608 13:45:25.271189 2576 reconciler_common.go:299] "Volume detached for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/3d97d05c-9d8f-4d01-8543-610bc38837c4-trusted-ca\") on node \"ip-10-0-140-46.ec2.internal\" DevicePath \"\"" Jun 08 13:45:25.271392 ip-10-0-140-46 kubenswrapper[2576]: I0608 13:45:25.271202 2576 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-kfgjd\" (UniqueName: \"kubernetes.io/projected/3d97d05c-9d8f-4d01-8543-610bc38837c4-kube-api-access-kfgjd\") on node \"ip-10-0-140-46.ec2.internal\" DevicePath \"\"" Jun 08 13:45:25.271392 ip-10-0-140-46 kubenswrapper[2576]: I0608 13:45:25.271216 2576 reconciler_common.go:299] "Volume detached for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/3d97d05c-9d8f-4d01-8543-610bc38837c4-ca-trust-extracted\") on node \"ip-10-0-140-46.ec2.internal\" DevicePath \"\"" Jun 08 13:45:25.324906 ip-10-0-140-46 kubenswrapper[2576]: I0608 13:45:25.324816 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cx7sn_6e4b50fc-3e91-4f50-b92a-e90919788248/konnectivity-agent/0.log" limit=1024 Jun 08 13:45:25.408361 ip-10-0-140-46 kubenswrapper[2576]: I0608 13:45:25.408314 2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/node-exporter-j6qbt"] Jun 08 13:45:25.410077 ip-10-0-140-46 kubenswrapper[2576]: I0608 13:45:25.408917 2576 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="3d97d05c-9d8f-4d01-8543-610bc38837c4" containerName="registry" Jun 08 13:45:25.410077 ip-10-0-140-46 kubenswrapper[2576]: I0608 13:45:25.408938 2576 state_mem.go:107] "Deleted CPUSet assignment" podUID="3d97d05c-9d8f-4d01-8543-610bc38837c4" containerName="registry" Jun 08 13:45:25.410077 ip-10-0-140-46 kubenswrapper[2576]: I0608 13:45:25.409022 2576 memory_manager.go:368] "RemoveStaleState removing state" podUID="3d97d05c-9d8f-4d01-8543-610bc38837c4" containerName="registry" Jun 08 13:45:25.429805 ip-10-0-140-46 kubenswrapper[2576]: I0608 13:45:25.429658 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cx7sn_6e4b50fc-3e91-4f50-b92a-e90919788248/konnectivity-agent/0.log" limit=1024 Jun 08 13:45:25.440144 ip-10-0-140-46 kubenswrapper[2576]: I0608 13:45:25.440111 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-j6qbt" Jun 08 13:45:25.447803 ip-10-0-140-46 kubenswrapper[2576]: I0608 13:45:25.447514 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-kube-rbac-proxy-config\"" Jun 08 13:45:25.450594 ip-10-0-140-46 kubenswrapper[2576]: I0608 13:45:25.448143 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kube-root-ca.crt\"" Jun 08 13:45:25.450594 ip-10-0-140-46 kubenswrapper[2576]: I0608 13:45:25.448380 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"metrics-client-ca\"" Jun 08 13:45:25.450594 ip-10-0-140-46 kubenswrapper[2576]: I0608 13:45:25.448639 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"node-exporter-accelerators-collector-config\"" Jun 08 13:45:25.450594 ip-10-0-140-46 kubenswrapper[2576]: I0608 13:45:25.448846 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-dockercfg-ts75z\"" Jun 08 13:45:25.450594 ip-10-0-140-46 kubenswrapper[2576]: I0608 13:45:25.449015 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-tls\"" Jun 08 13:45:25.450594 ip-10-0-140-46 kubenswrapper[2576]: I0608 13:45:25.449191 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"openshift-service-ca.crt\"" Jun 08 13:45:25.573895 ip-10-0-140-46 kubenswrapper[2576]: I0608 13:45:25.573852 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/a5205237-e40b-4ebb-a5cd-89665b872b74-sys\") pod \"node-exporter-j6qbt\" (UID: \"a5205237-e40b-4ebb-a5cd-89665b872b74\") " pod="openshift-monitoring/node-exporter-j6qbt" Jun 08 13:45:25.574103 ip-10-0-140-46 kubenswrapper[2576]: I0608 13:45:25.573959 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/a5205237-e40b-4ebb-a5cd-89665b872b74-node-exporter-accelerators-collector-config\") pod \"node-exporter-j6qbt\" (UID: \"a5205237-e40b-4ebb-a5cd-89665b872b74\") " pod="openshift-monitoring/node-exporter-j6qbt" Jun 08 13:45:25.574103 ip-10-0-140-46 kubenswrapper[2576]: I0608 13:45:25.574037 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5f5vd\" (UniqueName: \"kubernetes.io/projected/a5205237-e40b-4ebb-a5cd-89665b872b74-kube-api-access-5f5vd\") pod \"node-exporter-j6qbt\" (UID: \"a5205237-e40b-4ebb-a5cd-89665b872b74\") " pod="openshift-monitoring/node-exporter-j6qbt" Jun 08 13:45:25.574103 ip-10-0-140-46 kubenswrapper[2576]: I0608 13:45:25.574061 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/a5205237-e40b-4ebb-a5cd-89665b872b74-node-exporter-wtmp\") pod \"node-exporter-j6qbt\" (UID: \"a5205237-e40b-4ebb-a5cd-89665b872b74\") " pod="openshift-monitoring/node-exporter-j6qbt" Jun 08 13:45:25.574275 ip-10-0-140-46 kubenswrapper[2576]: I0608 13:45:25.574108 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/a5205237-e40b-4ebb-a5cd-89665b872b74-node-exporter-textfile\") pod \"node-exporter-j6qbt\" (UID: \"a5205237-e40b-4ebb-a5cd-89665b872b74\") " pod="openshift-monitoring/node-exporter-j6qbt" Jun 08 13:45:25.574275 ip-10-0-140-46 kubenswrapper[2576]: I0608 13:45:25.574149 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/a5205237-e40b-4ebb-a5cd-89665b872b74-node-exporter-tls\") pod \"node-exporter-j6qbt\" (UID: \"a5205237-e40b-4ebb-a5cd-89665b872b74\") " pod="openshift-monitoring/node-exporter-j6qbt" Jun 08 13:45:25.574275 ip-10-0-140-46 kubenswrapper[2576]: I0608 13:45:25.574175 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/a5205237-e40b-4ebb-a5cd-89665b872b74-metrics-client-ca\") pod \"node-exporter-j6qbt\" (UID: \"a5205237-e40b-4ebb-a5cd-89665b872b74\") " pod="openshift-monitoring/node-exporter-j6qbt" Jun 08 13:45:25.574275 ip-10-0-140-46 kubenswrapper[2576]: I0608 13:45:25.574215 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/a5205237-e40b-4ebb-a5cd-89665b872b74-root\") pod \"node-exporter-j6qbt\" (UID: \"a5205237-e40b-4ebb-a5cd-89665b872b74\") " pod="openshift-monitoring/node-exporter-j6qbt" Jun 08 13:45:25.574275 ip-10-0-140-46 kubenswrapper[2576]: I0608 13:45:25.574254 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/a5205237-e40b-4ebb-a5cd-89665b872b74-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-j6qbt\" (UID: \"a5205237-e40b-4ebb-a5cd-89665b872b74\") " pod="openshift-monitoring/node-exporter-j6qbt" Jun 08 13:45:25.675753 ip-10-0-140-46 kubenswrapper[2576]: I0608 13:45:25.675185 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/a5205237-e40b-4ebb-a5cd-89665b872b74-node-exporter-tls\") pod \"node-exporter-j6qbt\" (UID: \"a5205237-e40b-4ebb-a5cd-89665b872b74\") " pod="openshift-monitoring/node-exporter-j6qbt" Jun 08 13:45:25.675753 ip-10-0-140-46 kubenswrapper[2576]: I0608 13:45:25.675244 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/a5205237-e40b-4ebb-a5cd-89665b872b74-metrics-client-ca\") pod \"node-exporter-j6qbt\" (UID: \"a5205237-e40b-4ebb-a5cd-89665b872b74\") " pod="openshift-monitoring/node-exporter-j6qbt" Jun 08 13:45:25.675753 ip-10-0-140-46 kubenswrapper[2576]: I0608 13:45:25.675281 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/a5205237-e40b-4ebb-a5cd-89665b872b74-root\") pod \"node-exporter-j6qbt\" (UID: \"a5205237-e40b-4ebb-a5cd-89665b872b74\") " pod="openshift-monitoring/node-exporter-j6qbt" Jun 08 13:45:25.675753 ip-10-0-140-46 kubenswrapper[2576]: I0608 13:45:25.675306 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/a5205237-e40b-4ebb-a5cd-89665b872b74-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-j6qbt\" (UID: \"a5205237-e40b-4ebb-a5cd-89665b872b74\") " pod="openshift-monitoring/node-exporter-j6qbt" Jun 08 13:45:25.675753 ip-10-0-140-46 kubenswrapper[2576]: I0608 13:45:25.675334 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/a5205237-e40b-4ebb-a5cd-89665b872b74-sys\") pod \"node-exporter-j6qbt\" (UID: \"a5205237-e40b-4ebb-a5cd-89665b872b74\") " pod="openshift-monitoring/node-exporter-j6qbt" Jun 08 13:45:25.675753 ip-10-0-140-46 kubenswrapper[2576]: I0608 13:45:25.675362 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/a5205237-e40b-4ebb-a5cd-89665b872b74-node-exporter-accelerators-collector-config\") pod \"node-exporter-j6qbt\" (UID: \"a5205237-e40b-4ebb-a5cd-89665b872b74\") " pod="openshift-monitoring/node-exporter-j6qbt" Jun 08 13:45:25.675753 ip-10-0-140-46 kubenswrapper[2576]: E0608 13:45:25.675371 2576 secret.go:189] Couldn't get secret openshift-monitoring/node-exporter-tls: secret "node-exporter-tls" not found Jun 08 13:45:25.675753 ip-10-0-140-46 kubenswrapper[2576]: I0608 13:45:25.675409 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5f5vd\" (UniqueName: \"kubernetes.io/projected/a5205237-e40b-4ebb-a5cd-89665b872b74-kube-api-access-5f5vd\") pod \"node-exporter-j6qbt\" (UID: \"a5205237-e40b-4ebb-a5cd-89665b872b74\") " pod="openshift-monitoring/node-exporter-j6qbt" Jun 08 13:45:25.675753 ip-10-0-140-46 kubenswrapper[2576]: I0608 13:45:25.675439 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/a5205237-e40b-4ebb-a5cd-89665b872b74-node-exporter-wtmp\") pod \"node-exporter-j6qbt\" (UID: \"a5205237-e40b-4ebb-a5cd-89665b872b74\") " pod="openshift-monitoring/node-exporter-j6qbt" Jun 08 13:45:25.675753 ip-10-0-140-46 kubenswrapper[2576]: E0608 13:45:25.675457 2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a5205237-e40b-4ebb-a5cd-89665b872b74-node-exporter-tls podName:a5205237-e40b-4ebb-a5cd-89665b872b74 nodeName:}" failed. No retries permitted until 2026-06-08 13:45:26.175432056 +0000 UTC m=+94.254760939 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "node-exporter-tls" (UniqueName: "kubernetes.io/secret/a5205237-e40b-4ebb-a5cd-89665b872b74-node-exporter-tls") pod "node-exporter-j6qbt" (UID: "a5205237-e40b-4ebb-a5cd-89665b872b74") : secret "node-exporter-tls" not found Jun 08 13:45:25.675753 ip-10-0-140-46 kubenswrapper[2576]: I0608 13:45:25.675515 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/a5205237-e40b-4ebb-a5cd-89665b872b74-node-exporter-textfile\") pod \"node-exporter-j6qbt\" (UID: \"a5205237-e40b-4ebb-a5cd-89665b872b74\") " pod="openshift-monitoring/node-exporter-j6qbt" Jun 08 13:45:25.675753 ip-10-0-140-46 kubenswrapper[2576]: I0608 13:45:25.675612 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/a5205237-e40b-4ebb-a5cd-89665b872b74-node-exporter-wtmp\") pod \"node-exporter-j6qbt\" (UID: \"a5205237-e40b-4ebb-a5cd-89665b872b74\") " pod="openshift-monitoring/node-exporter-j6qbt" Jun 08 13:45:25.676475 ip-10-0-140-46 kubenswrapper[2576]: I0608 13:45:25.676219 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/a5205237-e40b-4ebb-a5cd-89665b872b74-metrics-client-ca\") pod \"node-exporter-j6qbt\" (UID: \"a5205237-e40b-4ebb-a5cd-89665b872b74\") " pod="openshift-monitoring/node-exporter-j6qbt" Jun 08 13:45:25.676475 ip-10-0-140-46 kubenswrapper[2576]: I0608 13:45:25.676299 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"root\" (UniqueName: \"kubernetes.io/host-path/a5205237-e40b-4ebb-a5cd-89665b872b74-root\") pod \"node-exporter-j6qbt\" (UID: \"a5205237-e40b-4ebb-a5cd-89665b872b74\") " pod="openshift-monitoring/node-exporter-j6qbt" Jun 08 13:45:25.677900 ip-10-0-140-46 kubenswrapper[2576]: I0608 13:45:25.677502 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/a5205237-e40b-4ebb-a5cd-89665b872b74-node-exporter-accelerators-collector-config\") pod \"node-exporter-j6qbt\" (UID: \"a5205237-e40b-4ebb-a5cd-89665b872b74\") " pod="openshift-monitoring/node-exporter-j6qbt" Jun 08 13:45:25.677900 ip-10-0-140-46 kubenswrapper[2576]: I0608 13:45:25.677600 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/a5205237-e40b-4ebb-a5cd-89665b872b74-sys\") pod \"node-exporter-j6qbt\" (UID: \"a5205237-e40b-4ebb-a5cd-89665b872b74\") " pod="openshift-monitoring/node-exporter-j6qbt" Jun 08 13:45:25.678325 ip-10-0-140-46 kubenswrapper[2576]: I0608 13:45:25.678273 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/a5205237-e40b-4ebb-a5cd-89665b872b74-node-exporter-textfile\") pod \"node-exporter-j6qbt\" (UID: \"a5205237-e40b-4ebb-a5cd-89665b872b74\") " pod="openshift-monitoring/node-exporter-j6qbt" Jun 08 13:45:25.679141 ip-10-0-140-46 kubenswrapper[2576]: I0608 13:45:25.679099 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/a5205237-e40b-4ebb-a5cd-89665b872b74-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-j6qbt\" (UID: \"a5205237-e40b-4ebb-a5cd-89665b872b74\") " pod="openshift-monitoring/node-exporter-j6qbt" Jun 08 13:45:25.689921 ip-10-0-140-46 kubenswrapper[2576]: I0608 13:45:25.689891 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-5f5vd\" (UniqueName: \"kubernetes.io/projected/a5205237-e40b-4ebb-a5cd-89665b872b74-kube-api-access-5f5vd\") pod \"node-exporter-j6qbt\" (UID: \"a5205237-e40b-4ebb-a5cd-89665b872b74\") " pod="openshift-monitoring/node-exporter-j6qbt" Jun 08 13:45:25.754218 ip-10-0-140-46 kubenswrapper[2576]: I0608 13:45:25.754083 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cx7sn_6e4b50fc-3e91-4f50-b92a-e90919788248/konnectivity-agent/0.log" limit=1024 Jun 08 13:45:25.905116 ip-10-0-140-46 kubenswrapper[2576]: I0608 13:45:25.905014 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cx7sn_6e4b50fc-3e91-4f50-b92a-e90919788248/konnectivity-agent/0.log" limit=1024 Jun 08 13:45:25.908012 ip-10-0-140-46 kubenswrapper[2576]: I0608 13:45:25.907977 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-98b4d96dc-d224h" event={"ID":"3d97d05c-9d8f-4d01-8543-610bc38837c4","Type":"ContainerDied","Data":"84c2efb9bc185d935c425067c2a6736cb359dd2af44027f86da1bda86c9a7bc5"} Jun 08 13:45:25.908167 ip-10-0-140-46 kubenswrapper[2576]: I0608 13:45:25.908046 2576 scope.go:117] "RemoveContainer" containerID="b441d8603000c55e3a3e00e10d6cc45e721248c5cd9fe6fa1d260e322eaaa679" Jun 08 13:45:25.908167 ip-10-0-140-46 kubenswrapper[2576]: I0608 13:45:25.908048 2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-98b4d96dc-d224h" Jun 08 13:45:25.938286 ip-10-0-140-46 kubenswrapper[2576]: I0608 13:45:25.938257 2576 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-image-registry/image-registry-98b4d96dc-d224h"] Jun 08 13:45:25.943910 ip-10-0-140-46 kubenswrapper[2576]: I0608 13:45:25.943878 2576 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-image-registry/image-registry-98b4d96dc-d224h"] Jun 08 13:45:26.000626 ip-10-0-140-46 kubenswrapper[2576]: I0608 13:45:26.000588 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cx7sn_6e4b50fc-3e91-4f50-b92a-e90919788248/konnectivity-agent/0.log" limit=1024 Jun 08 13:45:26.163113 ip-10-0-140-46 kubenswrapper[2576]: I0608 13:45:26.163064 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cx7sn_6e4b50fc-3e91-4f50-b92a-e90919788248/konnectivity-agent/0.log" limit=1024 Jun 08 13:45:26.180201 ip-10-0-140-46 kubenswrapper[2576]: I0608 13:45:26.180113 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/a5205237-e40b-4ebb-a5cd-89665b872b74-node-exporter-tls\") pod \"node-exporter-j6qbt\" (UID: \"a5205237-e40b-4ebb-a5cd-89665b872b74\") " pod="openshift-monitoring/node-exporter-j6qbt" Jun 08 13:45:26.182823 ip-10-0-140-46 kubenswrapper[2576]: I0608 13:45:26.182800 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/a5205237-e40b-4ebb-a5cd-89665b872b74-node-exporter-tls\") pod \"node-exporter-j6qbt\" (UID: \"a5205237-e40b-4ebb-a5cd-89665b872b74\") " pod="openshift-monitoring/node-exporter-j6qbt" Jun 08 13:45:26.264994 ip-10-0-140-46 kubenswrapper[2576]: I0608 13:45:26.264940 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cx7sn_6e4b50fc-3e91-4f50-b92a-e90919788248/konnectivity-agent/0.log" limit=1024 Jun 08 13:45:26.354042 ip-10-0-140-46 kubenswrapper[2576]: I0608 13:45:26.353997 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-j6qbt" Jun 08 13:45:26.364609 ip-10-0-140-46 kubenswrapper[2576]: I0608 13:45:26.364551 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cx7sn_6e4b50fc-3e91-4f50-b92a-e90919788248/konnectivity-agent/0.log" limit=1024 Jun 08 13:45:26.377474 ip-10-0-140-46 kubenswrapper[2576]: I0608 13:45:26.377435 2576 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="3d97d05c-9d8f-4d01-8543-610bc38837c4" path="/var/lib/kubelet/pods/3d97d05c-9d8f-4d01-8543-610bc38837c4/volumes" Jun 08 13:45:26.397881 ip-10-0-140-46 kubenswrapper[2576]: W0608 13:45:26.397809 2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda5205237_e40b_4ebb_a5cd_89665b872b74.slice/crio-13d9b6f472a4ffda2578ececf7739dc260f2c17549a6aa1f02272b28ea923357 WatchSource:0}: Error finding container 13d9b6f472a4ffda2578ececf7739dc260f2c17549a6aa1f02272b28ea923357: Status 404 returned error can't find the container with id 13d9b6f472a4ffda2578ececf7739dc260f2c17549a6aa1f02272b28ea923357 Jun 08 13:45:26.446219 ip-10-0-140-46 kubenswrapper[2576]: I0608 13:45:26.446132 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cx7sn_6e4b50fc-3e91-4f50-b92a-e90919788248/konnectivity-agent/0.log" limit=1024 Jun 08 13:45:26.914250 ip-10-0-140-46 kubenswrapper[2576]: I0608 13:45:26.914120 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-j6qbt" event={"ID":"a5205237-e40b-4ebb-a5cd-89665b872b74","Type":"ContainerStarted","Data":"13d9b6f472a4ffda2578ececf7739dc260f2c17549a6aa1f02272b28ea923357"} Jun 08 13:45:26.974888 ip-10-0-140-46 kubenswrapper[2576]: I0608 13:45:26.974810 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cx7sn_6e4b50fc-3e91-4f50-b92a-e90919788248/konnectivity-agent/0.log" limit=1024 Jun 08 13:45:28.191692 ip-10-0-140-46 kubenswrapper[2576]: I0608 13:45:28.191654 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cx7sn_6e4b50fc-3e91-4f50-b92a-e90919788248/konnectivity-agent/0.log" limit=1024 Jun 08 13:45:28.297026 ip-10-0-140-46 kubenswrapper[2576]: I0608 13:45:28.296988 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cx7sn_6e4b50fc-3e91-4f50-b92a-e90919788248/konnectivity-agent/0.log" limit=1024 Jun 08 13:45:28.426302 ip-10-0-140-46 kubenswrapper[2576]: I0608 13:45:28.426272 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cx7sn_6e4b50fc-3e91-4f50-b92a-e90919788248/konnectivity-agent/0.log" limit=1024 Jun 08 13:45:28.526978 ip-10-0-140-46 kubenswrapper[2576]: I0608 13:45:28.526893 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cx7sn_6e4b50fc-3e91-4f50-b92a-e90919788248/konnectivity-agent/0.log" limit=1024 Jun 08 13:45:28.629753 ip-10-0-140-46 kubenswrapper[2576]: I0608 13:45:28.629718 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cx7sn_6e4b50fc-3e91-4f50-b92a-e90919788248/konnectivity-agent/0.log" limit=1024 Jun 08 13:45:28.695157 ip-10-0-140-46 kubenswrapper[2576]: I0608 13:45:28.695124 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cx7sn_6e4b50fc-3e91-4f50-b92a-e90919788248/konnectivity-agent/0.log" limit=1024 Jun 08 13:45:28.925229 ip-10-0-140-46 kubenswrapper[2576]: I0608 13:45:28.925172 2576 generic.go:356] "Generic (PLEG): container finished" podID="a5205237-e40b-4ebb-a5cd-89665b872b74" containerID="cd54b56c8bdca4937dbb9dca25433627c58a0668bbdc5b95115e07802546c95d" exitCode=0 Jun 08 13:45:28.925407 ip-10-0-140-46 kubenswrapper[2576]: I0608 13:45:28.925258 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-j6qbt" event={"ID":"a5205237-e40b-4ebb-a5cd-89665b872b74","Type":"ContainerDied","Data":"cd54b56c8bdca4937dbb9dca25433627c58a0668bbdc5b95115e07802546c95d"} Jun 08 13:45:29.931235 ip-10-0-140-46 kubenswrapper[2576]: I0608 13:45:29.931200 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-j6qbt" event={"ID":"a5205237-e40b-4ebb-a5cd-89665b872b74","Type":"ContainerStarted","Data":"087bb64dbcd1ae20ec157214c0e0d206b6dabeb3c51d555c65813e4a27cacfbb"} Jun 08 13:45:29.931742 ip-10-0-140-46 kubenswrapper[2576]: I0608 13:45:29.931260 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-j6qbt" event={"ID":"a5205237-e40b-4ebb-a5cd-89665b872b74","Type":"ContainerStarted","Data":"e833786229c20d4e692f1f2902b3af4966b5137c731ef53ef439eace53fce352"} Jun 08 13:45:29.970664 ip-10-0-140-46 kubenswrapper[2576]: I0608 13:45:29.970613 2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/node-exporter-j6qbt" podStartSLOduration=3.29686115 podStartE2EDuration="4.97059607s" totalImagesPullingTime="1.559925096s" totalInitContainerRuntime="113.809824ms" isStatefulPod=true podCreationTimestamp="2026-06-08 13:45:25 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-08 13:45:29.968072039 +0000 UTC m=+98.047400931" watchObservedRunningTime="2026-06-08 13:45:29.97059607 +0000 UTC m=+98.049924962" Jun 08 13:45:30.103865 ip-10-0-140-46 kubenswrapper[2576]: I0608 13:45:30.103834 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cx7sn_6e4b50fc-3e91-4f50-b92a-e90919788248/konnectivity-agent/0.log" limit=1024 Jun 08 13:45:30.219321 ip-10-0-140-46 kubenswrapper[2576]: I0608 13:45:30.219240 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cx7sn_6e4b50fc-3e91-4f50-b92a-e90919788248/konnectivity-agent/0.log" limit=1024 Jun 08 13:45:30.296937 ip-10-0-140-46 kubenswrapper[2576]: I0608 13:45:30.296896 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cx7sn_6e4b50fc-3e91-4f50-b92a-e90919788248/konnectivity-agent/0.log" limit=1024 Jun 08 13:45:30.429304 ip-10-0-140-46 kubenswrapper[2576]: I0608 13:45:30.429271 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cx7sn_6e4b50fc-3e91-4f50-b92a-e90919788248/konnectivity-agent/0.log" limit=1024 Jun 08 13:45:30.991086 ip-10-0-140-46 kubenswrapper[2576]: I0608 13:45:30.991050 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cx7sn_6e4b50fc-3e91-4f50-b92a-e90919788248/konnectivity-agent/0.log" limit=1024 Jun 08 13:45:31.094106 ip-10-0-140-46 kubenswrapper[2576]: I0608 13:45:31.094070 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cx7sn_6e4b50fc-3e91-4f50-b92a-e90919788248/konnectivity-agent/0.log" limit=1024 Jun 08 13:45:32.016591 ip-10-0-140-46 kubenswrapper[2576]: I0608 13:45:32.016490 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cx7sn_6e4b50fc-3e91-4f50-b92a-e90919788248/konnectivity-agent/0.log" limit=1024 Jun 08 13:45:32.134130 ip-10-0-140-46 kubenswrapper[2576]: I0608 13:45:32.134100 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cx7sn_6e4b50fc-3e91-4f50-b92a-e90919788248/konnectivity-agent/0.log" limit=1024 Jun 08 13:45:35.304178 ip-10-0-140-46 kubenswrapper[2576]: I0608 13:45:35.304141 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cx7sn_6e4b50fc-3e91-4f50-b92a-e90919788248/konnectivity-agent/0.log" limit=1024 Jun 08 13:45:35.410070 ip-10-0-140-46 kubenswrapper[2576]: I0608 13:45:35.410035 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cx7sn_6e4b50fc-3e91-4f50-b92a-e90919788248/konnectivity-agent/0.log" limit=1024 Jun 08 13:45:37.226527 ip-10-0-140-46 kubenswrapper[2576]: I0608 13:45:37.226485 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cx7sn_6e4b50fc-3e91-4f50-b92a-e90919788248/konnectivity-agent/0.log" limit=1024 Jun 08 13:45:37.286559 ip-10-0-140-46 kubenswrapper[2576]: I0608 13:45:37.286528 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cx7sn_6e4b50fc-3e91-4f50-b92a-e90919788248/konnectivity-agent/0.log" limit=1024 Jun 08 13:45:41.065799 ip-10-0-140-46 kubenswrapper[2576]: I0608 13:45:41.065759 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cx7sn_6e4b50fc-3e91-4f50-b92a-e90919788248/konnectivity-agent/0.log" limit=1024 Jun 08 13:45:41.165956 ip-10-0-140-46 kubenswrapper[2576]: I0608 13:45:41.165918 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cx7sn_6e4b50fc-3e91-4f50-b92a-e90919788248/konnectivity-agent/0.log" limit=1024 Jun 08 13:45:41.224453 ip-10-0-140-46 kubenswrapper[2576]: I0608 13:45:41.224413 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cx7sn_6e4b50fc-3e91-4f50-b92a-e90919788248/konnectivity-agent/0.log" limit=1024 Jun 08 13:45:42.762609 ip-10-0-140-46 kubenswrapper[2576]: I0608 13:45:42.762547 2576 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-console/console-5b7f5cbf55-rj4tt" podUID="77b6314b-cbdb-49be-8d7d-41812b662df9" containerName="console" containerID="cri-o://7b0d0e299d678d7e3008813692ad8d8a2f672b8dbd97f1617d4203e2b2b97c51" gracePeriod=15 Jun 08 13:45:42.843782 ip-10-0-140-46 kubenswrapper[2576]: I0608 13:45:42.843757 2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-network-diagnostics/network-check-target-99957" Jun 08 13:45:42.982846 ip-10-0-140-46 kubenswrapper[2576]: I0608 13:45:42.982813 2576 generic.go:356] "Generic (PLEG): container finished" podID="77b6314b-cbdb-49be-8d7d-41812b662df9" containerID="7b0d0e299d678d7e3008813692ad8d8a2f672b8dbd97f1617d4203e2b2b97c51" exitCode=0 Jun 08 13:45:42.983034 ip-10-0-140-46 kubenswrapper[2576]: I0608 13:45:42.982870 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-5b7f5cbf55-rj4tt" event={"ID":"77b6314b-cbdb-49be-8d7d-41812b662df9","Type":"ContainerDied","Data":"7b0d0e299d678d7e3008813692ad8d8a2f672b8dbd97f1617d4203e2b2b97c51"} Jun 08 13:45:43.046710 ip-10-0-140-46 kubenswrapper[2576]: I0608 13:45:43.046678 2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-5b7f5cbf55-rj4tt" Jun 08 13:45:43.102719 ip-10-0-140-46 kubenswrapper[2576]: I0608 13:45:43.102682 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/77b6314b-cbdb-49be-8d7d-41812b662df9-console-oauth-config\") pod \"77b6314b-cbdb-49be-8d7d-41812b662df9\" (UID: \"77b6314b-cbdb-49be-8d7d-41812b662df9\") " Jun 08 13:45:43.102719 ip-10-0-140-46 kubenswrapper[2576]: I0608 13:45:43.102724 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/77b6314b-cbdb-49be-8d7d-41812b662df9-console-serving-cert\") pod \"77b6314b-cbdb-49be-8d7d-41812b662df9\" (UID: \"77b6314b-cbdb-49be-8d7d-41812b662df9\") " Jun 08 13:45:43.102977 ip-10-0-140-46 kubenswrapper[2576]: I0608 13:45:43.102752 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-qr4p9\" (UniqueName: \"kubernetes.io/projected/77b6314b-cbdb-49be-8d7d-41812b662df9-kube-api-access-qr4p9\") pod \"77b6314b-cbdb-49be-8d7d-41812b662df9\" (UID: \"77b6314b-cbdb-49be-8d7d-41812b662df9\") " Jun 08 13:45:43.102977 ip-10-0-140-46 kubenswrapper[2576]: I0608 13:45:43.102801 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/77b6314b-cbdb-49be-8d7d-41812b662df9-console-config\") pod \"77b6314b-cbdb-49be-8d7d-41812b662df9\" (UID: \"77b6314b-cbdb-49be-8d7d-41812b662df9\") " Jun 08 13:45:43.102977 ip-10-0-140-46 kubenswrapper[2576]: I0608 13:45:43.102841 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/77b6314b-cbdb-49be-8d7d-41812b662df9-oauth-serving-cert\") pod \"77b6314b-cbdb-49be-8d7d-41812b662df9\" (UID: \"77b6314b-cbdb-49be-8d7d-41812b662df9\") " Jun 08 13:45:43.102977 ip-10-0-140-46 kubenswrapper[2576]: I0608 13:45:43.102884 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/77b6314b-cbdb-49be-8d7d-41812b662df9-service-ca\") pod \"77b6314b-cbdb-49be-8d7d-41812b662df9\" (UID: \"77b6314b-cbdb-49be-8d7d-41812b662df9\") " Jun 08 13:45:43.103275 ip-10-0-140-46 kubenswrapper[2576]: I0608 13:45:43.103239 2576 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/77b6314b-cbdb-49be-8d7d-41812b662df9-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "77b6314b-cbdb-49be-8d7d-41812b662df9" (UID: "77b6314b-cbdb-49be-8d7d-41812b662df9"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 08 13:45:43.103275 ip-10-0-140-46 kubenswrapper[2576]: I0608 13:45:43.103279 2576 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/77b6314b-cbdb-49be-8d7d-41812b662df9-console-config" (OuterVolumeSpecName: "console-config") pod "77b6314b-cbdb-49be-8d7d-41812b662df9" (UID: "77b6314b-cbdb-49be-8d7d-41812b662df9"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 08 13:45:43.103442 ip-10-0-140-46 kubenswrapper[2576]: I0608 13:45:43.103398 2576 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/77b6314b-cbdb-49be-8d7d-41812b662df9-service-ca" (OuterVolumeSpecName: "service-ca") pod "77b6314b-cbdb-49be-8d7d-41812b662df9" (UID: "77b6314b-cbdb-49be-8d7d-41812b662df9"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 08 13:45:43.105202 ip-10-0-140-46 kubenswrapper[2576]: I0608 13:45:43.105176 2576 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/77b6314b-cbdb-49be-8d7d-41812b662df9-kube-api-access-qr4p9" (OuterVolumeSpecName: "kube-api-access-qr4p9") pod "77b6314b-cbdb-49be-8d7d-41812b662df9" (UID: "77b6314b-cbdb-49be-8d7d-41812b662df9"). InnerVolumeSpecName "kube-api-access-qr4p9". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 08 13:45:43.105436 ip-10-0-140-46 kubenswrapper[2576]: I0608 13:45:43.105406 2576 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/77b6314b-cbdb-49be-8d7d-41812b662df9-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "77b6314b-cbdb-49be-8d7d-41812b662df9" (UID: "77b6314b-cbdb-49be-8d7d-41812b662df9"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 08 13:45:43.105536 ip-10-0-140-46 kubenswrapper[2576]: I0608 13:45:43.105486 2576 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/77b6314b-cbdb-49be-8d7d-41812b662df9-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "77b6314b-cbdb-49be-8d7d-41812b662df9" (UID: "77b6314b-cbdb-49be-8d7d-41812b662df9"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 08 13:45:43.203724 ip-10-0-140-46 kubenswrapper[2576]: I0608 13:45:43.203682 2576 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/77b6314b-cbdb-49be-8d7d-41812b662df9-service-ca\") on node \"ip-10-0-140-46.ec2.internal\" DevicePath \"\"" Jun 08 13:45:43.203724 ip-10-0-140-46 kubenswrapper[2576]: I0608 13:45:43.203715 2576 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/77b6314b-cbdb-49be-8d7d-41812b662df9-console-oauth-config\") on node \"ip-10-0-140-46.ec2.internal\" DevicePath \"\"" Jun 08 13:45:43.203724 ip-10-0-140-46 kubenswrapper[2576]: I0608 13:45:43.203726 2576 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/77b6314b-cbdb-49be-8d7d-41812b662df9-console-serving-cert\") on node \"ip-10-0-140-46.ec2.internal\" DevicePath \"\"" Jun 08 13:45:43.203724 ip-10-0-140-46 kubenswrapper[2576]: I0608 13:45:43.203735 2576 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-qr4p9\" (UniqueName: \"kubernetes.io/projected/77b6314b-cbdb-49be-8d7d-41812b662df9-kube-api-access-qr4p9\") on node \"ip-10-0-140-46.ec2.internal\" DevicePath \"\"" Jun 08 13:45:43.203987 ip-10-0-140-46 kubenswrapper[2576]: I0608 13:45:43.203744 2576 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/77b6314b-cbdb-49be-8d7d-41812b662df9-console-config\") on node \"ip-10-0-140-46.ec2.internal\" DevicePath \"\"" Jun 08 13:45:43.203987 ip-10-0-140-46 kubenswrapper[2576]: I0608 13:45:43.203753 2576 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/77b6314b-cbdb-49be-8d7d-41812b662df9-oauth-serving-cert\") on node \"ip-10-0-140-46.ec2.internal\" DevicePath \"\"" Jun 08 13:45:43.987468 ip-10-0-140-46 kubenswrapper[2576]: I0608 13:45:43.987427 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-5b7f5cbf55-rj4tt" event={"ID":"77b6314b-cbdb-49be-8d7d-41812b662df9","Type":"ContainerDied","Data":"0a50ea398fe39d6d4fe5d451eed379420643d4774a067e0d8aab88483e247d14"} Jun 08 13:45:43.987468 ip-10-0-140-46 kubenswrapper[2576]: I0608 13:45:43.987455 2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-5b7f5cbf55-rj4tt" Jun 08 13:45:43.988001 ip-10-0-140-46 kubenswrapper[2576]: I0608 13:45:43.987500 2576 scope.go:117] "RemoveContainer" containerID="7b0d0e299d678d7e3008813692ad8d8a2f672b8dbd97f1617d4203e2b2b97c51" Jun 08 13:45:44.039504 ip-10-0-140-46 kubenswrapper[2576]: I0608 13:45:44.039470 2576 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-5b7f5cbf55-rj4tt"] Jun 08 13:45:44.045949 ip-10-0-140-46 kubenswrapper[2576]: I0608 13:45:44.045919 2576 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-5b7f5cbf55-rj4tt"] Jun 08 13:45:44.375511 ip-10-0-140-46 kubenswrapper[2576]: I0608 13:45:44.375479 2576 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="77b6314b-cbdb-49be-8d7d-41812b662df9" path="/var/lib/kubelet/pods/77b6314b-cbdb-49be-8d7d-41812b662df9/volumes" Jun 08 13:45:52.261060 ip-10-0-140-46 kubenswrapper[2576]: I0608 13:45:52.261025 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cx7sn_6e4b50fc-3e91-4f50-b92a-e90919788248/konnectivity-agent/0.log" limit=1024 Jun 08 13:45:52.348401 ip-10-0-140-46 kubenswrapper[2576]: I0608 13:45:52.348375 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cx7sn_6e4b50fc-3e91-4f50-b92a-e90919788248/konnectivity-agent/0.log" limit=1024 Jun 08 13:46:20.328589 ip-10-0-140-46 kubenswrapper[2576]: I0608 13:46:20.328535 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cx7sn_6e4b50fc-3e91-4f50-b92a-e90919788248/konnectivity-agent/0.log" limit=1024 Jun 08 13:46:44.974929 ip-10-0-140-46 kubenswrapper[2576]: I0608 13:46:44.974841 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cx7sn_6e4b50fc-3e91-4f50-b92a-e90919788248/konnectivity-agent/0.log" limit=1024 Jun 08 13:46:45.478669 ip-10-0-140-46 kubenswrapper[2576]: I0608 13:46:45.478627 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cx7sn_6e4b50fc-3e91-4f50-b92a-e90919788248/konnectivity-agent/0.log" limit=1024 Jun 08 13:46:50.642494 ip-10-0-140-46 kubenswrapper[2576]: I0608 13:46:50.642452 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cx7sn_6e4b50fc-3e91-4f50-b92a-e90919788248/konnectivity-agent/0.log" limit=1024 Jun 08 13:46:54.245360 ip-10-0-140-46 kubenswrapper[2576]: I0608 13:46:54.245325 2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-d4fb6597-5cvrj"] Jun 08 13:46:54.245778 ip-10-0-140-46 kubenswrapper[2576]: I0608 13:46:54.245609 2576 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="77b6314b-cbdb-49be-8d7d-41812b662df9" containerName="console" Jun 08 13:46:54.245778 ip-10-0-140-46 kubenswrapper[2576]: I0608 13:46:54.245620 2576 state_mem.go:107] "Deleted CPUSet assignment" podUID="77b6314b-cbdb-49be-8d7d-41812b662df9" containerName="console" Jun 08 13:46:54.245778 ip-10-0-140-46 kubenswrapper[2576]: I0608 13:46:54.245662 2576 memory_manager.go:368] "RemoveStaleState removing state" podUID="77b6314b-cbdb-49be-8d7d-41812b662df9" containerName="console" Jun 08 13:46:54.247365 ip-10-0-140-46 kubenswrapper[2576]: I0608 13:46:54.247348 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-d4fb6597-5cvrj" Jun 08 13:46:54.250544 ip-10-0-140-46 kubenswrapper[2576]: I0608 13:46:54.250516 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"service-ca\"" Jun 08 13:46:54.251087 ip-10-0-140-46 kubenswrapper[2576]: I0608 13:46:54.251068 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-serving-cert\"" Jun 08 13:46:54.251087 ip-10-0-140-46 kubenswrapper[2576]: I0608 13:46:54.251080 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"console-config\"" Jun 08 13:46:54.252286 ip-10-0-140-46 kubenswrapper[2576]: I0608 13:46:54.252273 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"oauth-serving-cert\"" Jun 08 13:46:54.252676 ip-10-0-140-46 kubenswrapper[2576]: I0608 13:46:54.252658 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-oauth-config\"" Jun 08 13:46:54.252832 ip-10-0-140-46 kubenswrapper[2576]: I0608 13:46:54.252813 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-dockercfg-9r5l8\"" Jun 08 13:46:54.265441 ip-10-0-140-46 kubenswrapper[2576]: I0608 13:46:54.263658 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-d4fb6597-5cvrj"] Jun 08 13:46:54.265441 ip-10-0-140-46 kubenswrapper[2576]: I0608 13:46:54.263835 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"trusted-ca-bundle\"" Jun 08 13:46:54.302964 ip-10-0-140-46 kubenswrapper[2576]: I0608 13:46:54.302903 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cx7sn_6e4b50fc-3e91-4f50-b92a-e90919788248/konnectivity-agent/0.log" limit=1024 Jun 08 13:46:54.331023 ip-10-0-140-46 kubenswrapper[2576]: I0608 13:46:54.330993 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/79cfaf03-295d-4e53-acd8-fdb72e7b28d8-trusted-ca-bundle\") pod \"console-d4fb6597-5cvrj\" (UID: \"79cfaf03-295d-4e53-acd8-fdb72e7b28d8\") " pod="openshift-console/console-d4fb6597-5cvrj" Jun 08 13:46:54.331136 ip-10-0-140-46 kubenswrapper[2576]: I0608 13:46:54.331033 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/79cfaf03-295d-4e53-acd8-fdb72e7b28d8-console-config\") pod \"console-d4fb6597-5cvrj\" (UID: \"79cfaf03-295d-4e53-acd8-fdb72e7b28d8\") " pod="openshift-console/console-d4fb6597-5cvrj" Jun 08 13:46:54.331136 ip-10-0-140-46 kubenswrapper[2576]: I0608 13:46:54.331063 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/79cfaf03-295d-4e53-acd8-fdb72e7b28d8-service-ca\") pod \"console-d4fb6597-5cvrj\" (UID: \"79cfaf03-295d-4e53-acd8-fdb72e7b28d8\") " pod="openshift-console/console-d4fb6597-5cvrj" Jun 08 13:46:54.331136 ip-10-0-140-46 kubenswrapper[2576]: I0608 13:46:54.331107 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/79cfaf03-295d-4e53-acd8-fdb72e7b28d8-console-oauth-config\") pod \"console-d4fb6597-5cvrj\" (UID: \"79cfaf03-295d-4e53-acd8-fdb72e7b28d8\") " pod="openshift-console/console-d4fb6597-5cvrj" Jun 08 13:46:54.331136 ip-10-0-140-46 kubenswrapper[2576]: I0608 13:46:54.331125 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/79cfaf03-295d-4e53-acd8-fdb72e7b28d8-oauth-serving-cert\") pod \"console-d4fb6597-5cvrj\" (UID: \"79cfaf03-295d-4e53-acd8-fdb72e7b28d8\") " pod="openshift-console/console-d4fb6597-5cvrj" Jun 08 13:46:54.331261 ip-10-0-140-46 kubenswrapper[2576]: I0608 13:46:54.331148 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-l5rks\" (UniqueName: \"kubernetes.io/projected/79cfaf03-295d-4e53-acd8-fdb72e7b28d8-kube-api-access-l5rks\") pod \"console-d4fb6597-5cvrj\" (UID: \"79cfaf03-295d-4e53-acd8-fdb72e7b28d8\") " pod="openshift-console/console-d4fb6597-5cvrj" Jun 08 13:46:54.331261 ip-10-0-140-46 kubenswrapper[2576]: I0608 13:46:54.331200 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/79cfaf03-295d-4e53-acd8-fdb72e7b28d8-console-serving-cert\") pod \"console-d4fb6597-5cvrj\" (UID: \"79cfaf03-295d-4e53-acd8-fdb72e7b28d8\") " pod="openshift-console/console-d4fb6597-5cvrj" Jun 08 13:46:54.432204 ip-10-0-140-46 kubenswrapper[2576]: I0608 13:46:54.432162 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/79cfaf03-295d-4e53-acd8-fdb72e7b28d8-trusted-ca-bundle\") pod \"console-d4fb6597-5cvrj\" (UID: \"79cfaf03-295d-4e53-acd8-fdb72e7b28d8\") " pod="openshift-console/console-d4fb6597-5cvrj" Jun 08 13:46:54.432376 ip-10-0-140-46 kubenswrapper[2576]: I0608 13:46:54.432211 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/79cfaf03-295d-4e53-acd8-fdb72e7b28d8-console-config\") pod \"console-d4fb6597-5cvrj\" (UID: \"79cfaf03-295d-4e53-acd8-fdb72e7b28d8\") " pod="openshift-console/console-d4fb6597-5cvrj" Jun 08 13:46:54.432376 ip-10-0-140-46 kubenswrapper[2576]: I0608 13:46:54.432241 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/79cfaf03-295d-4e53-acd8-fdb72e7b28d8-service-ca\") pod \"console-d4fb6597-5cvrj\" (UID: \"79cfaf03-295d-4e53-acd8-fdb72e7b28d8\") " pod="openshift-console/console-d4fb6597-5cvrj" Jun 08 13:46:54.432376 ip-10-0-140-46 kubenswrapper[2576]: I0608 13:46:54.432268 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/79cfaf03-295d-4e53-acd8-fdb72e7b28d8-console-oauth-config\") pod \"console-d4fb6597-5cvrj\" (UID: \"79cfaf03-295d-4e53-acd8-fdb72e7b28d8\") " pod="openshift-console/console-d4fb6597-5cvrj" Jun 08 13:46:54.432376 ip-10-0-140-46 kubenswrapper[2576]: I0608 13:46:54.432294 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/79cfaf03-295d-4e53-acd8-fdb72e7b28d8-oauth-serving-cert\") pod \"console-d4fb6597-5cvrj\" (UID: \"79cfaf03-295d-4e53-acd8-fdb72e7b28d8\") " pod="openshift-console/console-d4fb6597-5cvrj" Jun 08 13:46:54.432376 ip-10-0-140-46 kubenswrapper[2576]: I0608 13:46:54.432311 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-l5rks\" (UniqueName: \"kubernetes.io/projected/79cfaf03-295d-4e53-acd8-fdb72e7b28d8-kube-api-access-l5rks\") pod \"console-d4fb6597-5cvrj\" (UID: \"79cfaf03-295d-4e53-acd8-fdb72e7b28d8\") " pod="openshift-console/console-d4fb6597-5cvrj" Jun 08 13:46:54.432376 ip-10-0-140-46 kubenswrapper[2576]: I0608 13:46:54.432335 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/79cfaf03-295d-4e53-acd8-fdb72e7b28d8-console-serving-cert\") pod \"console-d4fb6597-5cvrj\" (UID: \"79cfaf03-295d-4e53-acd8-fdb72e7b28d8\") " pod="openshift-console/console-d4fb6597-5cvrj" Jun 08 13:46:54.433186 ip-10-0-140-46 kubenswrapper[2576]: I0608 13:46:54.433161 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/79cfaf03-295d-4e53-acd8-fdb72e7b28d8-oauth-serving-cert\") pod \"console-d4fb6597-5cvrj\" (UID: \"79cfaf03-295d-4e53-acd8-fdb72e7b28d8\") " pod="openshift-console/console-d4fb6597-5cvrj" Jun 08 13:46:54.433186 ip-10-0-140-46 kubenswrapper[2576]: I0608 13:46:54.433180 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/79cfaf03-295d-4e53-acd8-fdb72e7b28d8-console-config\") pod \"console-d4fb6597-5cvrj\" (UID: \"79cfaf03-295d-4e53-acd8-fdb72e7b28d8\") " pod="openshift-console/console-d4fb6597-5cvrj" Jun 08 13:46:54.433328 ip-10-0-140-46 kubenswrapper[2576]: I0608 13:46:54.433206 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/79cfaf03-295d-4e53-acd8-fdb72e7b28d8-trusted-ca-bundle\") pod \"console-d4fb6597-5cvrj\" (UID: \"79cfaf03-295d-4e53-acd8-fdb72e7b28d8\") " pod="openshift-console/console-d4fb6597-5cvrj" Jun 08 13:46:54.433328 ip-10-0-140-46 kubenswrapper[2576]: I0608 13:46:54.433180 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/79cfaf03-295d-4e53-acd8-fdb72e7b28d8-service-ca\") pod \"console-d4fb6597-5cvrj\" (UID: \"79cfaf03-295d-4e53-acd8-fdb72e7b28d8\") " pod="openshift-console/console-d4fb6597-5cvrj" Jun 08 13:46:54.434826 ip-10-0-140-46 kubenswrapper[2576]: I0608 13:46:54.434803 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/79cfaf03-295d-4e53-acd8-fdb72e7b28d8-console-serving-cert\") pod \"console-d4fb6597-5cvrj\" (UID: \"79cfaf03-295d-4e53-acd8-fdb72e7b28d8\") " pod="openshift-console/console-d4fb6597-5cvrj" Jun 08 13:46:54.434936 ip-10-0-140-46 kubenswrapper[2576]: I0608 13:46:54.434896 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/79cfaf03-295d-4e53-acd8-fdb72e7b28d8-console-oauth-config\") pod \"console-d4fb6597-5cvrj\" (UID: \"79cfaf03-295d-4e53-acd8-fdb72e7b28d8\") " pod="openshift-console/console-d4fb6597-5cvrj" Jun 08 13:46:54.441876 ip-10-0-140-46 kubenswrapper[2576]: I0608 13:46:54.441848 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-l5rks\" (UniqueName: \"kubernetes.io/projected/79cfaf03-295d-4e53-acd8-fdb72e7b28d8-kube-api-access-l5rks\") pod \"console-d4fb6597-5cvrj\" (UID: \"79cfaf03-295d-4e53-acd8-fdb72e7b28d8\") " pod="openshift-console/console-d4fb6597-5cvrj" Jun 08 13:46:54.469431 ip-10-0-140-46 kubenswrapper[2576]: I0608 13:46:54.469384 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cx7sn_6e4b50fc-3e91-4f50-b92a-e90919788248/konnectivity-agent/0.log" limit=1024 Jun 08 13:46:54.556013 ip-10-0-140-46 kubenswrapper[2576]: I0608 13:46:54.555985 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-d4fb6597-5cvrj" Jun 08 13:46:54.569767 ip-10-0-140-46 kubenswrapper[2576]: I0608 13:46:54.569740 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cx7sn_6e4b50fc-3e91-4f50-b92a-e90919788248/konnectivity-agent/0.log" limit=1024 Jun 08 13:46:54.686369 ip-10-0-140-46 kubenswrapper[2576]: I0608 13:46:54.686331 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-d4fb6597-5cvrj"] Jun 08 13:46:54.688534 ip-10-0-140-46 kubenswrapper[2576]: W0608 13:46:54.688503 2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod79cfaf03_295d_4e53_acd8_fdb72e7b28d8.slice/crio-ec59d3dedd768af4f18aa3d7efe8bfb6f588727332a2254ee9c6f6c47a6d6b62 WatchSource:0}: Error finding container ec59d3dedd768af4f18aa3d7efe8bfb6f588727332a2254ee9c6f6c47a6d6b62: Status 404 returned error can't find the container with id ec59d3dedd768af4f18aa3d7efe8bfb6f588727332a2254ee9c6f6c47a6d6b62 Jun 08 13:46:54.926703 ip-10-0-140-46 kubenswrapper[2576]: I0608 13:46:54.926616 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cx7sn_6e4b50fc-3e91-4f50-b92a-e90919788248/konnectivity-agent/0.log" limit=1024 Jun 08 13:46:54.982405 ip-10-0-140-46 kubenswrapper[2576]: I0608 13:46:54.982377 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cx7sn_6e4b50fc-3e91-4f50-b92a-e90919788248/konnectivity-agent/0.log" limit=1024 Jun 08 13:46:55.231126 ip-10-0-140-46 kubenswrapper[2576]: I0608 13:46:55.231041 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-d4fb6597-5cvrj" event={"ID":"79cfaf03-295d-4e53-acd8-fdb72e7b28d8","Type":"ContainerStarted","Data":"87440d3c33a63cc713c63c2cc9b94d029c4c477546ade737481a4218afaf10ac"} Jun 08 13:46:55.231126 ip-10-0-140-46 kubenswrapper[2576]: I0608 13:46:55.231098 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-d4fb6597-5cvrj" event={"ID":"79cfaf03-295d-4e53-acd8-fdb72e7b28d8","Type":"ContainerStarted","Data":"ec59d3dedd768af4f18aa3d7efe8bfb6f588727332a2254ee9c6f6c47a6d6b62"} Jun 08 13:46:55.253311 ip-10-0-140-46 kubenswrapper[2576]: I0608 13:46:55.253256 2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-d4fb6597-5cvrj" podStartSLOduration=1.253238735 podStartE2EDuration="1.253238735s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-08 13:46:54 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-08 13:46:55.250743172 +0000 UTC m=+183.330072063" watchObservedRunningTime="2026-06-08 13:46:55.253238735 +0000 UTC m=+183.332567627" Jun 08 13:47:00.274975 ip-10-0-140-46 kubenswrapper[2576]: I0608 13:47:00.274944 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cx7sn_6e4b50fc-3e91-4f50-b92a-e90919788248/konnectivity-agent/0.log" limit=1024 Jun 08 13:47:00.336153 ip-10-0-140-46 kubenswrapper[2576]: I0608 13:47:00.336127 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cx7sn_6e4b50fc-3e91-4f50-b92a-e90919788248/konnectivity-agent/0.log" limit=1024 Jun 08 13:47:04.209252 ip-10-0-140-46 kubenswrapper[2576]: I0608 13:47:04.209216 2576 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-d4fb6597-5cvrj"] Jun 08 13:47:04.273785 ip-10-0-140-46 kubenswrapper[2576]: I0608 13:47:04.273751 2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-745c4cf9f4-bq8xr"] Jun 08 13:47:04.275655 ip-10-0-140-46 kubenswrapper[2576]: I0608 13:47:04.275640 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-745c4cf9f4-bq8xr" Jun 08 13:47:04.301069 ip-10-0-140-46 kubenswrapper[2576]: I0608 13:47:04.301044 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-745c4cf9f4-bq8xr"] Jun 08 13:47:04.406231 ip-10-0-140-46 kubenswrapper[2576]: I0608 13:47:04.406198 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xssc7\" (UniqueName: \"kubernetes.io/projected/89b1ca22-dc48-40a6-9033-f5199eb8075d-kube-api-access-xssc7\") pod \"console-745c4cf9f4-bq8xr\" (UID: \"89b1ca22-dc48-40a6-9033-f5199eb8075d\") " pod="openshift-console/console-745c4cf9f4-bq8xr" Jun 08 13:47:04.406402 ip-10-0-140-46 kubenswrapper[2576]: I0608 13:47:04.406241 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/89b1ca22-dc48-40a6-9033-f5199eb8075d-console-serving-cert\") pod \"console-745c4cf9f4-bq8xr\" (UID: \"89b1ca22-dc48-40a6-9033-f5199eb8075d\") " pod="openshift-console/console-745c4cf9f4-bq8xr" Jun 08 13:47:04.406402 ip-10-0-140-46 kubenswrapper[2576]: I0608 13:47:04.406293 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/89b1ca22-dc48-40a6-9033-f5199eb8075d-console-oauth-config\") pod \"console-745c4cf9f4-bq8xr\" (UID: \"89b1ca22-dc48-40a6-9033-f5199eb8075d\") " pod="openshift-console/console-745c4cf9f4-bq8xr" Jun 08 13:47:04.406402 ip-10-0-140-46 kubenswrapper[2576]: I0608 13:47:04.406345 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/89b1ca22-dc48-40a6-9033-f5199eb8075d-console-config\") pod \"console-745c4cf9f4-bq8xr\" (UID: \"89b1ca22-dc48-40a6-9033-f5199eb8075d\") " pod="openshift-console/console-745c4cf9f4-bq8xr" Jun 08 13:47:04.406402 ip-10-0-140-46 kubenswrapper[2576]: I0608 13:47:04.406382 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/89b1ca22-dc48-40a6-9033-f5199eb8075d-trusted-ca-bundle\") pod \"console-745c4cf9f4-bq8xr\" (UID: \"89b1ca22-dc48-40a6-9033-f5199eb8075d\") " pod="openshift-console/console-745c4cf9f4-bq8xr" Jun 08 13:47:04.406402 ip-10-0-140-46 kubenswrapper[2576]: I0608 13:47:04.406403 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/89b1ca22-dc48-40a6-9033-f5199eb8075d-service-ca\") pod \"console-745c4cf9f4-bq8xr\" (UID: \"89b1ca22-dc48-40a6-9033-f5199eb8075d\") " pod="openshift-console/console-745c4cf9f4-bq8xr" Jun 08 13:47:04.406616 ip-10-0-140-46 kubenswrapper[2576]: I0608 13:47:04.406417 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/89b1ca22-dc48-40a6-9033-f5199eb8075d-oauth-serving-cert\") pod \"console-745c4cf9f4-bq8xr\" (UID: \"89b1ca22-dc48-40a6-9033-f5199eb8075d\") " pod="openshift-console/console-745c4cf9f4-bq8xr" Jun 08 13:47:04.414102 ip-10-0-140-46 kubenswrapper[2576]: I0608 13:47:04.414077 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cx7sn_6e4b50fc-3e91-4f50-b92a-e90919788248/konnectivity-agent/0.log" limit=1024 Jun 08 13:47:04.479325 ip-10-0-140-46 kubenswrapper[2576]: I0608 13:47:04.479250 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cx7sn_6e4b50fc-3e91-4f50-b92a-e90919788248/konnectivity-agent/0.log" limit=1024 Jun 08 13:47:04.506855 ip-10-0-140-46 kubenswrapper[2576]: I0608 13:47:04.506821 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/89b1ca22-dc48-40a6-9033-f5199eb8075d-console-oauth-config\") pod \"console-745c4cf9f4-bq8xr\" (UID: \"89b1ca22-dc48-40a6-9033-f5199eb8075d\") " pod="openshift-console/console-745c4cf9f4-bq8xr" Jun 08 13:47:04.506948 ip-10-0-140-46 kubenswrapper[2576]: I0608 13:47:04.506875 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/89b1ca22-dc48-40a6-9033-f5199eb8075d-console-config\") pod \"console-745c4cf9f4-bq8xr\" (UID: \"89b1ca22-dc48-40a6-9033-f5199eb8075d\") " pod="openshift-console/console-745c4cf9f4-bq8xr" Jun 08 13:47:04.506948 ip-10-0-140-46 kubenswrapper[2576]: I0608 13:47:04.506900 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/89b1ca22-dc48-40a6-9033-f5199eb8075d-trusted-ca-bundle\") pod \"console-745c4cf9f4-bq8xr\" (UID: \"89b1ca22-dc48-40a6-9033-f5199eb8075d\") " pod="openshift-console/console-745c4cf9f4-bq8xr" Jun 08 13:47:04.506948 ip-10-0-140-46 kubenswrapper[2576]: I0608 13:47:04.506929 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/89b1ca22-dc48-40a6-9033-f5199eb8075d-service-ca\") pod \"console-745c4cf9f4-bq8xr\" (UID: \"89b1ca22-dc48-40a6-9033-f5199eb8075d\") " pod="openshift-console/console-745c4cf9f4-bq8xr" Jun 08 13:47:04.506948 ip-10-0-140-46 kubenswrapper[2576]: I0608 13:47:04.506945 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/89b1ca22-dc48-40a6-9033-f5199eb8075d-oauth-serving-cert\") pod \"console-745c4cf9f4-bq8xr\" (UID: \"89b1ca22-dc48-40a6-9033-f5199eb8075d\") " pod="openshift-console/console-745c4cf9f4-bq8xr" Jun 08 13:47:04.507101 ip-10-0-140-46 kubenswrapper[2576]: I0608 13:47:04.506970 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xssc7\" (UniqueName: \"kubernetes.io/projected/89b1ca22-dc48-40a6-9033-f5199eb8075d-kube-api-access-xssc7\") pod \"console-745c4cf9f4-bq8xr\" (UID: \"89b1ca22-dc48-40a6-9033-f5199eb8075d\") " pod="openshift-console/console-745c4cf9f4-bq8xr" Jun 08 13:47:04.507101 ip-10-0-140-46 kubenswrapper[2576]: I0608 13:47:04.506998 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/89b1ca22-dc48-40a6-9033-f5199eb8075d-console-serving-cert\") pod \"console-745c4cf9f4-bq8xr\" (UID: \"89b1ca22-dc48-40a6-9033-f5199eb8075d\") " pod="openshift-console/console-745c4cf9f4-bq8xr" Jun 08 13:47:04.507721 ip-10-0-140-46 kubenswrapper[2576]: I0608 13:47:04.507697 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/89b1ca22-dc48-40a6-9033-f5199eb8075d-service-ca\") pod \"console-745c4cf9f4-bq8xr\" (UID: \"89b1ca22-dc48-40a6-9033-f5199eb8075d\") " pod="openshift-console/console-745c4cf9f4-bq8xr" Jun 08 13:47:04.507813 ip-10-0-140-46 kubenswrapper[2576]: I0608 13:47:04.507739 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/89b1ca22-dc48-40a6-9033-f5199eb8075d-oauth-serving-cert\") pod \"console-745c4cf9f4-bq8xr\" (UID: \"89b1ca22-dc48-40a6-9033-f5199eb8075d\") " pod="openshift-console/console-745c4cf9f4-bq8xr" Jun 08 13:47:04.507813 ip-10-0-140-46 kubenswrapper[2576]: I0608 13:47:04.507718 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/89b1ca22-dc48-40a6-9033-f5199eb8075d-console-config\") pod \"console-745c4cf9f4-bq8xr\" (UID: \"89b1ca22-dc48-40a6-9033-f5199eb8075d\") " pod="openshift-console/console-745c4cf9f4-bq8xr" Jun 08 13:47:04.508062 ip-10-0-140-46 kubenswrapper[2576]: I0608 13:47:04.508036 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/89b1ca22-dc48-40a6-9033-f5199eb8075d-trusted-ca-bundle\") pod \"console-745c4cf9f4-bq8xr\" (UID: \"89b1ca22-dc48-40a6-9033-f5199eb8075d\") " pod="openshift-console/console-745c4cf9f4-bq8xr" Jun 08 13:47:04.509380 ip-10-0-140-46 kubenswrapper[2576]: I0608 13:47:04.509359 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/89b1ca22-dc48-40a6-9033-f5199eb8075d-console-oauth-config\") pod \"console-745c4cf9f4-bq8xr\" (UID: \"89b1ca22-dc48-40a6-9033-f5199eb8075d\") " pod="openshift-console/console-745c4cf9f4-bq8xr" Jun 08 13:47:04.509611 ip-10-0-140-46 kubenswrapper[2576]: I0608 13:47:04.509594 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/89b1ca22-dc48-40a6-9033-f5199eb8075d-console-serving-cert\") pod \"console-745c4cf9f4-bq8xr\" (UID: \"89b1ca22-dc48-40a6-9033-f5199eb8075d\") " pod="openshift-console/console-745c4cf9f4-bq8xr" Jun 08 13:47:04.518413 ip-10-0-140-46 kubenswrapper[2576]: I0608 13:47:04.518385 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-xssc7\" (UniqueName: \"kubernetes.io/projected/89b1ca22-dc48-40a6-9033-f5199eb8075d-kube-api-access-xssc7\") pod \"console-745c4cf9f4-bq8xr\" (UID: \"89b1ca22-dc48-40a6-9033-f5199eb8075d\") " pod="openshift-console/console-745c4cf9f4-bq8xr" Jun 08 13:47:04.556530 ip-10-0-140-46 kubenswrapper[2576]: I0608 13:47:04.556493 2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-d4fb6597-5cvrj" Jun 08 13:47:04.584723 ip-10-0-140-46 kubenswrapper[2576]: I0608 13:47:04.584700 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-745c4cf9f4-bq8xr" Jun 08 13:47:04.715367 ip-10-0-140-46 kubenswrapper[2576]: I0608 13:47:04.715343 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-745c4cf9f4-bq8xr"] Jun 08 13:47:04.717406 ip-10-0-140-46 kubenswrapper[2576]: W0608 13:47:04.717376 2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod89b1ca22_dc48_40a6_9033_f5199eb8075d.slice/crio-c02d4287bbfbc708efcd8d09eed5148c86d742dd648b0eff74ef8fd25cca49aa WatchSource:0}: Error finding container c02d4287bbfbc708efcd8d09eed5148c86d742dd648b0eff74ef8fd25cca49aa: Status 404 returned error can't find the container with id c02d4287bbfbc708efcd8d09eed5148c86d742dd648b0eff74ef8fd25cca49aa Jun 08 13:47:05.142730 ip-10-0-140-46 kubenswrapper[2576]: I0608 13:47:05.142702 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cx7sn_6e4b50fc-3e91-4f50-b92a-e90919788248/konnectivity-agent/0.log" limit=1024 Jun 08 13:47:05.201797 ip-10-0-140-46 kubenswrapper[2576]: I0608 13:47:05.201770 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cx7sn_6e4b50fc-3e91-4f50-b92a-e90919788248/konnectivity-agent/0.log" limit=1024 Jun 08 13:47:05.268855 ip-10-0-140-46 kubenswrapper[2576]: I0608 13:47:05.268823 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-745c4cf9f4-bq8xr" event={"ID":"89b1ca22-dc48-40a6-9033-f5199eb8075d","Type":"ContainerStarted","Data":"f8f32ef3d00fe77293b0ec5efb353063715529749fb7007a0e7df7be7787f8ff"} Jun 08 13:47:05.269182 ip-10-0-140-46 kubenswrapper[2576]: I0608 13:47:05.268868 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-745c4cf9f4-bq8xr" event={"ID":"89b1ca22-dc48-40a6-9033-f5199eb8075d","Type":"ContainerStarted","Data":"c02d4287bbfbc708efcd8d09eed5148c86d742dd648b0eff74ef8fd25cca49aa"} Jun 08 13:47:05.290167 ip-10-0-140-46 kubenswrapper[2576]: I0608 13:47:05.290123 2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-745c4cf9f4-bq8xr" podStartSLOduration=1.290106705 podStartE2EDuration="1.290106705s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-08 13:47:04 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-08 13:47:05.289348853 +0000 UTC m=+193.368677745" watchObservedRunningTime="2026-06-08 13:47:05.290106705 +0000 UTC m=+193.369435596" Jun 08 13:47:12.043870 ip-10-0-140-46 kubenswrapper[2576]: I0608 13:47:12.043836 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cx7sn_6e4b50fc-3e91-4f50-b92a-e90919788248/konnectivity-agent/0.log" limit=1024 Jun 08 13:47:12.236267 ip-10-0-140-46 kubenswrapper[2576]: I0608 13:47:12.236230 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cx7sn_6e4b50fc-3e91-4f50-b92a-e90919788248/konnectivity-agent/0.log" limit=1024 Jun 08 13:47:12.296776 ip-10-0-140-46 kubenswrapper[2576]: I0608 13:47:12.296705 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cx7sn_6e4b50fc-3e91-4f50-b92a-e90919788248/konnectivity-agent/0.log" limit=1024 Jun 08 13:47:14.585397 ip-10-0-140-46 kubenswrapper[2576]: I0608 13:47:14.585363 2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-745c4cf9f4-bq8xr" Jun 08 13:47:14.585852 ip-10-0-140-46 kubenswrapper[2576]: I0608 13:47:14.585447 2576 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-745c4cf9f4-bq8xr" Jun 08 13:47:14.590185 ip-10-0-140-46 kubenswrapper[2576]: I0608 13:47:14.590162 2576 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-745c4cf9f4-bq8xr" Jun 08 13:47:15.308851 ip-10-0-140-46 kubenswrapper[2576]: I0608 13:47:15.308826 2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-745c4cf9f4-bq8xr" Jun 08 13:47:15.528653 ip-10-0-140-46 kubenswrapper[2576]: I0608 13:47:15.528619 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cx7sn_6e4b50fc-3e91-4f50-b92a-e90919788248/konnectivity-agent/0.log" limit=1024 Jun 08 13:47:15.623254 ip-10-0-140-46 kubenswrapper[2576]: I0608 13:47:15.623181 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cx7sn_6e4b50fc-3e91-4f50-b92a-e90919788248/konnectivity-agent/0.log" limit=1024 Jun 08 13:47:15.684541 ip-10-0-140-46 kubenswrapper[2576]: I0608 13:47:15.684510 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cx7sn_6e4b50fc-3e91-4f50-b92a-e90919788248/konnectivity-agent/0.log" limit=1024 Jun 08 13:47:22.236175 ip-10-0-140-46 kubenswrapper[2576]: I0608 13:47:22.236139 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cx7sn_6e4b50fc-3e91-4f50-b92a-e90919788248/konnectivity-agent/0.log" limit=1024 Jun 08 13:47:22.337581 ip-10-0-140-46 kubenswrapper[2576]: I0608 13:47:22.337534 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cx7sn_6e4b50fc-3e91-4f50-b92a-e90919788248/konnectivity-agent/0.log" limit=1024 Jun 08 13:47:22.398966 ip-10-0-140-46 kubenswrapper[2576]: I0608 13:47:22.398930 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cx7sn_6e4b50fc-3e91-4f50-b92a-e90919788248/konnectivity-agent/0.log" limit=1024 Jun 08 13:47:29.228213 ip-10-0-140-46 kubenswrapper[2576]: I0608 13:47:29.228165 2576 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-console/console-d4fb6597-5cvrj" podUID="79cfaf03-295d-4e53-acd8-fdb72e7b28d8" containerName="console" containerID="cri-o://87440d3c33a63cc713c63c2cc9b94d029c4c477546ade737481a4218afaf10ac" gracePeriod=15 Jun 08 13:47:29.359633 ip-10-0-140-46 kubenswrapper[2576]: I0608 13:47:29.359601 2576 generic.go:356] "Generic (PLEG): container finished" podID="79cfaf03-295d-4e53-acd8-fdb72e7b28d8" containerID="87440d3c33a63cc713c63c2cc9b94d029c4c477546ade737481a4218afaf10ac" exitCode=0 Jun 08 13:47:29.359785 ip-10-0-140-46 kubenswrapper[2576]: I0608 13:47:29.359676 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-d4fb6597-5cvrj" event={"ID":"79cfaf03-295d-4e53-acd8-fdb72e7b28d8","Type":"ContainerDied","Data":"87440d3c33a63cc713c63c2cc9b94d029c4c477546ade737481a4218afaf10ac"} Jun 08 13:47:29.477946 ip-10-0-140-46 kubenswrapper[2576]: I0608 13:47:29.477923 2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-d4fb6597-5cvrj" Jun 08 13:47:29.590222 ip-10-0-140-46 kubenswrapper[2576]: I0608 13:47:29.590180 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/79cfaf03-295d-4e53-acd8-fdb72e7b28d8-console-config\") pod \"79cfaf03-295d-4e53-acd8-fdb72e7b28d8\" (UID: \"79cfaf03-295d-4e53-acd8-fdb72e7b28d8\") " Jun 08 13:47:29.590222 ip-10-0-140-46 kubenswrapper[2576]: I0608 13:47:29.590218 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/79cfaf03-295d-4e53-acd8-fdb72e7b28d8-oauth-serving-cert\") pod \"79cfaf03-295d-4e53-acd8-fdb72e7b28d8\" (UID: \"79cfaf03-295d-4e53-acd8-fdb72e7b28d8\") " Jun 08 13:47:29.590482 ip-10-0-140-46 kubenswrapper[2576]: I0608 13:47:29.590249 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/79cfaf03-295d-4e53-acd8-fdb72e7b28d8-trusted-ca-bundle\") pod \"79cfaf03-295d-4e53-acd8-fdb72e7b28d8\" (UID: \"79cfaf03-295d-4e53-acd8-fdb72e7b28d8\") " Jun 08 13:47:29.590482 ip-10-0-140-46 kubenswrapper[2576]: I0608 13:47:29.590282 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/79cfaf03-295d-4e53-acd8-fdb72e7b28d8-service-ca\") pod \"79cfaf03-295d-4e53-acd8-fdb72e7b28d8\" (UID: \"79cfaf03-295d-4e53-acd8-fdb72e7b28d8\") " Jun 08 13:47:29.590482 ip-10-0-140-46 kubenswrapper[2576]: I0608 13:47:29.590317 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/79cfaf03-295d-4e53-acd8-fdb72e7b28d8-console-oauth-config\") pod \"79cfaf03-295d-4e53-acd8-fdb72e7b28d8\" (UID: \"79cfaf03-295d-4e53-acd8-fdb72e7b28d8\") " Jun 08 13:47:29.590482 ip-10-0-140-46 kubenswrapper[2576]: I0608 13:47:29.590346 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/79cfaf03-295d-4e53-acd8-fdb72e7b28d8-console-serving-cert\") pod \"79cfaf03-295d-4e53-acd8-fdb72e7b28d8\" (UID: \"79cfaf03-295d-4e53-acd8-fdb72e7b28d8\") " Jun 08 13:47:29.590482 ip-10-0-140-46 kubenswrapper[2576]: I0608 13:47:29.590454 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-l5rks\" (UniqueName: \"kubernetes.io/projected/79cfaf03-295d-4e53-acd8-fdb72e7b28d8-kube-api-access-l5rks\") pod \"79cfaf03-295d-4e53-acd8-fdb72e7b28d8\" (UID: \"79cfaf03-295d-4e53-acd8-fdb72e7b28d8\") " Jun 08 13:47:29.590765 ip-10-0-140-46 kubenswrapper[2576]: I0608 13:47:29.590714 2576 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/79cfaf03-295d-4e53-acd8-fdb72e7b28d8-console-config" (OuterVolumeSpecName: "console-config") pod "79cfaf03-295d-4e53-acd8-fdb72e7b28d8" (UID: "79cfaf03-295d-4e53-acd8-fdb72e7b28d8"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 08 13:47:29.590765 ip-10-0-140-46 kubenswrapper[2576]: I0608 13:47:29.590725 2576 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/79cfaf03-295d-4e53-acd8-fdb72e7b28d8-trusted-ca-bundle" (OuterVolumeSpecName: "trusted-ca-bundle") pod "79cfaf03-295d-4e53-acd8-fdb72e7b28d8" (UID: "79cfaf03-295d-4e53-acd8-fdb72e7b28d8"). InnerVolumeSpecName "trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 08 13:47:29.590874 ip-10-0-140-46 kubenswrapper[2576]: I0608 13:47:29.590844 2576 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/79cfaf03-295d-4e53-acd8-fdb72e7b28d8-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "79cfaf03-295d-4e53-acd8-fdb72e7b28d8" (UID: "79cfaf03-295d-4e53-acd8-fdb72e7b28d8"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 08 13:47:29.591052 ip-10-0-140-46 kubenswrapper[2576]: I0608 13:47:29.591029 2576 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/79cfaf03-295d-4e53-acd8-fdb72e7b28d8-service-ca" (OuterVolumeSpecName: "service-ca") pod "79cfaf03-295d-4e53-acd8-fdb72e7b28d8" (UID: "79cfaf03-295d-4e53-acd8-fdb72e7b28d8"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 08 13:47:29.592644 ip-10-0-140-46 kubenswrapper[2576]: I0608 13:47:29.592621 2576 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/79cfaf03-295d-4e53-acd8-fdb72e7b28d8-kube-api-access-l5rks" (OuterVolumeSpecName: "kube-api-access-l5rks") pod "79cfaf03-295d-4e53-acd8-fdb72e7b28d8" (UID: "79cfaf03-295d-4e53-acd8-fdb72e7b28d8"). InnerVolumeSpecName "kube-api-access-l5rks". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 08 13:47:29.592739 ip-10-0-140-46 kubenswrapper[2576]: I0608 13:47:29.592659 2576 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/79cfaf03-295d-4e53-acd8-fdb72e7b28d8-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "79cfaf03-295d-4e53-acd8-fdb72e7b28d8" (UID: "79cfaf03-295d-4e53-acd8-fdb72e7b28d8"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 08 13:47:29.592739 ip-10-0-140-46 kubenswrapper[2576]: I0608 13:47:29.592681 2576 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/79cfaf03-295d-4e53-acd8-fdb72e7b28d8-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "79cfaf03-295d-4e53-acd8-fdb72e7b28d8" (UID: "79cfaf03-295d-4e53-acd8-fdb72e7b28d8"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 08 13:47:29.691730 ip-10-0-140-46 kubenswrapper[2576]: I0608 13:47:29.691690 2576 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-l5rks\" (UniqueName: \"kubernetes.io/projected/79cfaf03-295d-4e53-acd8-fdb72e7b28d8-kube-api-access-l5rks\") on node \"ip-10-0-140-46.ec2.internal\" DevicePath \"\"" Jun 08 13:47:29.691730 ip-10-0-140-46 kubenswrapper[2576]: I0608 13:47:29.691722 2576 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/79cfaf03-295d-4e53-acd8-fdb72e7b28d8-console-config\") on node \"ip-10-0-140-46.ec2.internal\" DevicePath \"\"" Jun 08 13:47:29.691730 ip-10-0-140-46 kubenswrapper[2576]: I0608 13:47:29.691732 2576 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/79cfaf03-295d-4e53-acd8-fdb72e7b28d8-oauth-serving-cert\") on node \"ip-10-0-140-46.ec2.internal\" DevicePath \"\"" Jun 08 13:47:29.691730 ip-10-0-140-46 kubenswrapper[2576]: I0608 13:47:29.691740 2576 reconciler_common.go:299] "Volume detached for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/79cfaf03-295d-4e53-acd8-fdb72e7b28d8-trusted-ca-bundle\") on node \"ip-10-0-140-46.ec2.internal\" DevicePath \"\"" Jun 08 13:47:29.691992 ip-10-0-140-46 kubenswrapper[2576]: I0608 13:47:29.691748 2576 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/79cfaf03-295d-4e53-acd8-fdb72e7b28d8-service-ca\") on node \"ip-10-0-140-46.ec2.internal\" DevicePath \"\"" Jun 08 13:47:29.691992 ip-10-0-140-46 kubenswrapper[2576]: I0608 13:47:29.691757 2576 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/79cfaf03-295d-4e53-acd8-fdb72e7b28d8-console-oauth-config\") on node \"ip-10-0-140-46.ec2.internal\" DevicePath \"\"" Jun 08 13:47:29.691992 ip-10-0-140-46 kubenswrapper[2576]: I0608 13:47:29.691766 2576 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/79cfaf03-295d-4e53-acd8-fdb72e7b28d8-console-serving-cert\") on node \"ip-10-0-140-46.ec2.internal\" DevicePath \"\"" Jun 08 13:47:30.364216 ip-10-0-140-46 kubenswrapper[2576]: I0608 13:47:30.364182 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-d4fb6597-5cvrj" event={"ID":"79cfaf03-295d-4e53-acd8-fdb72e7b28d8","Type":"ContainerDied","Data":"ec59d3dedd768af4f18aa3d7efe8bfb6f588727332a2254ee9c6f6c47a6d6b62"} Jun 08 13:47:30.364216 ip-10-0-140-46 kubenswrapper[2576]: I0608 13:47:30.364208 2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-d4fb6597-5cvrj" Jun 08 13:47:30.364695 ip-10-0-140-46 kubenswrapper[2576]: I0608 13:47:30.364242 2576 scope.go:117] "RemoveContainer" containerID="87440d3c33a63cc713c63c2cc9b94d029c4c477546ade737481a4218afaf10ac" Jun 08 13:47:30.386279 ip-10-0-140-46 kubenswrapper[2576]: I0608 13:47:30.386246 2576 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-d4fb6597-5cvrj"] Jun 08 13:47:30.399406 ip-10-0-140-46 kubenswrapper[2576]: I0608 13:47:30.399371 2576 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-d4fb6597-5cvrj"] Jun 08 13:47:32.376308 ip-10-0-140-46 kubenswrapper[2576]: I0608 13:47:32.376266 2576 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="79cfaf03-295d-4e53-acd8-fdb72e7b28d8" path="/var/lib/kubelet/pods/79cfaf03-295d-4e53-acd8-fdb72e7b28d8/volumes" Jun 08 13:48:01.710639 ip-10-0-140-46 kubenswrapper[2576]: I0608 13:48:01.710601 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cx7sn_6e4b50fc-3e91-4f50-b92a-e90919788248/konnectivity-agent/0.log" limit=1024 Jun 08 13:48:01.811216 ip-10-0-140-46 kubenswrapper[2576]: I0608 13:48:01.811179 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cx7sn_6e4b50fc-3e91-4f50-b92a-e90919788248/konnectivity-agent/0.log" limit=1024 Jun 08 13:48:02.387314 ip-10-0-140-46 kubenswrapper[2576]: I0608 13:48:02.387279 2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dtd4kt"] Jun 08 13:48:02.387583 ip-10-0-140-46 kubenswrapper[2576]: I0608 13:48:02.387551 2576 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="79cfaf03-295d-4e53-acd8-fdb72e7b28d8" containerName="console" Jun 08 13:48:02.387583 ip-10-0-140-46 kubenswrapper[2576]: I0608 13:48:02.387578 2576 state_mem.go:107] "Deleted CPUSet assignment" podUID="79cfaf03-295d-4e53-acd8-fdb72e7b28d8" containerName="console" Jun 08 13:48:02.387667 ip-10-0-140-46 kubenswrapper[2576]: I0608 13:48:02.387641 2576 memory_manager.go:368] "RemoveStaleState removing state" podUID="79cfaf03-295d-4e53-acd8-fdb72e7b28d8" containerName="console" Jun 08 13:48:02.390501 ip-10-0-140-46 kubenswrapper[2576]: I0608 13:48:02.390484 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dtd4kt" Jun 08 13:48:02.393553 ip-10-0-140-46 kubenswrapper[2576]: I0608 13:48:02.393531 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"kube-root-ca.crt\"" Jun 08 13:48:02.393682 ip-10-0-140-46 kubenswrapper[2576]: I0608 13:48:02.393651 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-marketplace\"/\"default-dockercfg-csk2k\"" Jun 08 13:48:02.394236 ip-10-0-140-46 kubenswrapper[2576]: I0608 13:48:02.394220 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"openshift-service-ca.crt\"" Jun 08 13:48:02.406252 ip-10-0-140-46 kubenswrapper[2576]: I0608 13:48:02.406225 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dtd4kt"] Jun 08 13:48:02.542263 ip-10-0-140-46 kubenswrapper[2576]: I0608 13:48:02.542218 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-66m6w\" (UniqueName: \"kubernetes.io/projected/a3285342-27e7-4060-863f-e14db62b0856-kube-api-access-66m6w\") pod \"2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dtd4kt\" (UID: \"a3285342-27e7-4060-863f-e14db62b0856\") " pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dtd4kt" Jun 08 13:48:02.542446 ip-10-0-140-46 kubenswrapper[2576]: I0608 13:48:02.542326 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/a3285342-27e7-4060-863f-e14db62b0856-bundle\") pod \"2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dtd4kt\" (UID: \"a3285342-27e7-4060-863f-e14db62b0856\") " pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dtd4kt" Jun 08 13:48:02.542446 ip-10-0-140-46 kubenswrapper[2576]: I0608 13:48:02.542363 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/a3285342-27e7-4060-863f-e14db62b0856-util\") pod \"2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dtd4kt\" (UID: \"a3285342-27e7-4060-863f-e14db62b0856\") " pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dtd4kt" Jun 08 13:48:02.643813 ip-10-0-140-46 kubenswrapper[2576]: I0608 13:48:02.643724 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/a3285342-27e7-4060-863f-e14db62b0856-bundle\") pod \"2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dtd4kt\" (UID: \"a3285342-27e7-4060-863f-e14db62b0856\") " pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dtd4kt" Jun 08 13:48:02.643813 ip-10-0-140-46 kubenswrapper[2576]: I0608 13:48:02.643765 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/a3285342-27e7-4060-863f-e14db62b0856-util\") pod \"2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dtd4kt\" (UID: \"a3285342-27e7-4060-863f-e14db62b0856\") " pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dtd4kt" Jun 08 13:48:02.643994 ip-10-0-140-46 kubenswrapper[2576]: I0608 13:48:02.643887 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-66m6w\" (UniqueName: \"kubernetes.io/projected/a3285342-27e7-4060-863f-e14db62b0856-kube-api-access-66m6w\") pod \"2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dtd4kt\" (UID: \"a3285342-27e7-4060-863f-e14db62b0856\") " pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dtd4kt" Jun 08 13:48:02.644112 ip-10-0-140-46 kubenswrapper[2576]: I0608 13:48:02.644097 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/a3285342-27e7-4060-863f-e14db62b0856-util\") pod \"2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dtd4kt\" (UID: \"a3285342-27e7-4060-863f-e14db62b0856\") " pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dtd4kt" Jun 08 13:48:02.644182 ip-10-0-140-46 kubenswrapper[2576]: I0608 13:48:02.644162 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/a3285342-27e7-4060-863f-e14db62b0856-bundle\") pod \"2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dtd4kt\" (UID: \"a3285342-27e7-4060-863f-e14db62b0856\") " pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dtd4kt" Jun 08 13:48:02.656968 ip-10-0-140-46 kubenswrapper[2576]: I0608 13:48:02.656938 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-66m6w\" (UniqueName: \"kubernetes.io/projected/a3285342-27e7-4060-863f-e14db62b0856-kube-api-access-66m6w\") pod \"2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dtd4kt\" (UID: \"a3285342-27e7-4060-863f-e14db62b0856\") " pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dtd4kt" Jun 08 13:48:02.699901 ip-10-0-140-46 kubenswrapper[2576]: I0608 13:48:02.699864 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dtd4kt" Jun 08 13:48:02.837201 ip-10-0-140-46 kubenswrapper[2576]: I0608 13:48:02.837169 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dtd4kt"] Jun 08 13:48:02.840127 ip-10-0-140-46 kubenswrapper[2576]: W0608 13:48:02.840096 2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda3285342_27e7_4060_863f_e14db62b0856.slice/crio-0c67f87c4a4e97decdcf4f93a7b281df1a5114d67dc23ff6c49494c3dea0c8b6 WatchSource:0}: Error finding container 0c67f87c4a4e97decdcf4f93a7b281df1a5114d67dc23ff6c49494c3dea0c8b6: Status 404 returned error can't find the container with id 0c67f87c4a4e97decdcf4f93a7b281df1a5114d67dc23ff6c49494c3dea0c8b6 Jun 08 13:48:03.482233 ip-10-0-140-46 kubenswrapper[2576]: I0608 13:48:03.482188 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dtd4kt" event={"ID":"a3285342-27e7-4060-863f-e14db62b0856","Type":"ContainerStarted","Data":"0c67f87c4a4e97decdcf4f93a7b281df1a5114d67dc23ff6c49494c3dea0c8b6"} Jun 08 13:48:08.502443 ip-10-0-140-46 kubenswrapper[2576]: I0608 13:48:08.502406 2576 generic.go:356] "Generic (PLEG): container finished" podID="a3285342-27e7-4060-863f-e14db62b0856" containerID="26adcc3471ec4d74e44c8dab73be0aba5893223dec0974f3ee4be064f44ee63b" exitCode=0 Jun 08 13:48:08.502928 ip-10-0-140-46 kubenswrapper[2576]: I0608 13:48:08.502445 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dtd4kt" event={"ID":"a3285342-27e7-4060-863f-e14db62b0856","Type":"ContainerDied","Data":"26adcc3471ec4d74e44c8dab73be0aba5893223dec0974f3ee4be064f44ee63b"} Jun 08 13:48:09.508860 ip-10-0-140-46 kubenswrapper[2576]: I0608 13:48:09.508827 2576 generic.go:356] "Generic (PLEG): container finished" podID="a3285342-27e7-4060-863f-e14db62b0856" containerID="7e49c205fb24e5552236ebeb8e40a46ff542b47acc9825967d4525d5d49cb850" exitCode=0 Jun 08 13:48:09.509260 ip-10-0-140-46 kubenswrapper[2576]: I0608 13:48:09.508919 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dtd4kt" event={"ID":"a3285342-27e7-4060-863f-e14db62b0856","Type":"ContainerDied","Data":"7e49c205fb24e5552236ebeb8e40a46ff542b47acc9825967d4525d5d49cb850"} Jun 08 13:48:16.538807 ip-10-0-140-46 kubenswrapper[2576]: I0608 13:48:16.538768 2576 generic.go:356] "Generic (PLEG): container finished" podID="a3285342-27e7-4060-863f-e14db62b0856" containerID="f58fc8554d2cf0fb10388decbeb3985840be218edbee2ae786bdaec833b74f94" exitCode=0 Jun 08 13:48:16.539183 ip-10-0-140-46 kubenswrapper[2576]: I0608 13:48:16.538816 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dtd4kt" event={"ID":"a3285342-27e7-4060-863f-e14db62b0856","Type":"ContainerDied","Data":"f58fc8554d2cf0fb10388decbeb3985840be218edbee2ae786bdaec833b74f94"} Jun 08 13:48:17.665530 ip-10-0-140-46 kubenswrapper[2576]: I0608 13:48:17.665507 2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dtd4kt" Jun 08 13:48:17.672309 ip-10-0-140-46 kubenswrapper[2576]: I0608 13:48:17.672284 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-66m6w\" (UniqueName: \"kubernetes.io/projected/a3285342-27e7-4060-863f-e14db62b0856-kube-api-access-66m6w\") pod \"a3285342-27e7-4060-863f-e14db62b0856\" (UID: \"a3285342-27e7-4060-863f-e14db62b0856\") " Jun 08 13:48:17.672401 ip-10-0-140-46 kubenswrapper[2576]: I0608 13:48:17.672320 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/a3285342-27e7-4060-863f-e14db62b0856-bundle\") pod \"a3285342-27e7-4060-863f-e14db62b0856\" (UID: \"a3285342-27e7-4060-863f-e14db62b0856\") " Jun 08 13:48:17.672401 ip-10-0-140-46 kubenswrapper[2576]: I0608 13:48:17.672337 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/a3285342-27e7-4060-863f-e14db62b0856-util\") pod \"a3285342-27e7-4060-863f-e14db62b0856\" (UID: \"a3285342-27e7-4060-863f-e14db62b0856\") " Jun 08 13:48:17.672981 ip-10-0-140-46 kubenswrapper[2576]: I0608 13:48:17.672958 2576 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/a3285342-27e7-4060-863f-e14db62b0856-bundle" (OuterVolumeSpecName: "bundle") pod "a3285342-27e7-4060-863f-e14db62b0856" (UID: "a3285342-27e7-4060-863f-e14db62b0856"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 08 13:48:17.674424 ip-10-0-140-46 kubenswrapper[2576]: I0608 13:48:17.674397 2576 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/a3285342-27e7-4060-863f-e14db62b0856-kube-api-access-66m6w" (OuterVolumeSpecName: "kube-api-access-66m6w") pod "a3285342-27e7-4060-863f-e14db62b0856" (UID: "a3285342-27e7-4060-863f-e14db62b0856"). InnerVolumeSpecName "kube-api-access-66m6w". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 08 13:48:17.676280 ip-10-0-140-46 kubenswrapper[2576]: I0608 13:48:17.676255 2576 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/a3285342-27e7-4060-863f-e14db62b0856-util" (OuterVolumeSpecName: "util") pod "a3285342-27e7-4060-863f-e14db62b0856" (UID: "a3285342-27e7-4060-863f-e14db62b0856"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 08 13:48:17.773376 ip-10-0-140-46 kubenswrapper[2576]: I0608 13:48:17.773348 2576 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/a3285342-27e7-4060-863f-e14db62b0856-bundle\") on node \"ip-10-0-140-46.ec2.internal\" DevicePath \"\"" Jun 08 13:48:17.773376 ip-10-0-140-46 kubenswrapper[2576]: I0608 13:48:17.773372 2576 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/a3285342-27e7-4060-863f-e14db62b0856-util\") on node \"ip-10-0-140-46.ec2.internal\" DevicePath \"\"" Jun 08 13:48:17.773376 ip-10-0-140-46 kubenswrapper[2576]: I0608 13:48:17.773381 2576 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-66m6w\" (UniqueName: \"kubernetes.io/projected/a3285342-27e7-4060-863f-e14db62b0856-kube-api-access-66m6w\") on node \"ip-10-0-140-46.ec2.internal\" DevicePath \"\"" Jun 08 13:48:18.548137 ip-10-0-140-46 kubenswrapper[2576]: I0608 13:48:18.548103 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dtd4kt" event={"ID":"a3285342-27e7-4060-863f-e14db62b0856","Type":"ContainerDied","Data":"0c67f87c4a4e97decdcf4f93a7b281df1a5114d67dc23ff6c49494c3dea0c8b6"} Jun 08 13:48:18.548325 ip-10-0-140-46 kubenswrapper[2576]: I0608 13:48:18.548155 2576 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="0c67f87c4a4e97decdcf4f93a7b281df1a5114d67dc23ff6c49494c3dea0c8b6" Jun 08 13:48:18.548325 ip-10-0-140-46 kubenswrapper[2576]: I0608 13:48:18.548116 2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dtd4kt" Jun 08 13:48:23.415008 ip-10-0-140-46 kubenswrapper[2576]: I0608 13:48:23.414977 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cx7sn_6e4b50fc-3e91-4f50-b92a-e90919788248/konnectivity-agent/0.log" limit=1024 Jun 08 13:48:24.387184 ip-10-0-140-46 kubenswrapper[2576]: I0608 13:48:24.387148 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cx7sn_6e4b50fc-3e91-4f50-b92a-e90919788248/konnectivity-agent/0.log" limit=1024 Jun 08 13:48:25.440369 ip-10-0-140-46 kubenswrapper[2576]: I0608 13:48:25.440334 2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["cert-manager-operator/cert-manager-operator-controller-manager-57757f7cfc-69st4"] Jun 08 13:48:25.440758 ip-10-0-140-46 kubenswrapper[2576]: I0608 13:48:25.440608 2576 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="a3285342-27e7-4060-863f-e14db62b0856" containerName="pull" Jun 08 13:48:25.440758 ip-10-0-140-46 kubenswrapper[2576]: I0608 13:48:25.440620 2576 state_mem.go:107] "Deleted CPUSet assignment" podUID="a3285342-27e7-4060-863f-e14db62b0856" containerName="pull" Jun 08 13:48:25.440758 ip-10-0-140-46 kubenswrapper[2576]: I0608 13:48:25.440628 2576 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="a3285342-27e7-4060-863f-e14db62b0856" containerName="extract" Jun 08 13:48:25.440758 ip-10-0-140-46 kubenswrapper[2576]: I0608 13:48:25.440634 2576 state_mem.go:107] "Deleted CPUSet assignment" podUID="a3285342-27e7-4060-863f-e14db62b0856" containerName="extract" Jun 08 13:48:25.440758 ip-10-0-140-46 kubenswrapper[2576]: I0608 13:48:25.440640 2576 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="a3285342-27e7-4060-863f-e14db62b0856" containerName="util" Jun 08 13:48:25.440758 ip-10-0-140-46 kubenswrapper[2576]: I0608 13:48:25.440647 2576 state_mem.go:107] "Deleted CPUSet assignment" podUID="a3285342-27e7-4060-863f-e14db62b0856" containerName="util" Jun 08 13:48:25.440758 ip-10-0-140-46 kubenswrapper[2576]: I0608 13:48:25.440694 2576 memory_manager.go:368] "RemoveStaleState removing state" podUID="a3285342-27e7-4060-863f-e14db62b0856" containerName="extract" Jun 08 13:48:25.463704 ip-10-0-140-46 kubenswrapper[2576]: I0608 13:48:25.463674 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager-operator/cert-manager-operator-controller-manager-57757f7cfc-69st4" Jun 08 13:48:25.466401 ip-10-0-140-46 kubenswrapper[2576]: I0608 13:48:25.466377 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"cert-manager-operator\"/\"cert-manager-operator-controller-manager-dockercfg-zvvsg\"" Jun 08 13:48:25.466401 ip-10-0-140-46 kubenswrapper[2576]: I0608 13:48:25.466393 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager-operator/cert-manager-operator-controller-manager-57757f7cfc-69st4"] Jun 08 13:48:25.467399 ip-10-0-140-46 kubenswrapper[2576]: I0608 13:48:25.467376 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager-operator\"/\"kube-root-ca.crt\"" Jun 08 13:48:25.467919 ip-10-0-140-46 kubenswrapper[2576]: I0608 13:48:25.467879 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager-operator\"/\"openshift-service-ca.crt\"" Jun 08 13:48:25.525476 ip-10-0-140-46 kubenswrapper[2576]: I0608 13:48:25.525433 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-bsmjp\" (UniqueName: \"kubernetes.io/projected/7fac7133-5bfa-4176-8db6-8bde8101c1cd-kube-api-access-bsmjp\") pod \"cert-manager-operator-controller-manager-57757f7cfc-69st4\" (UID: \"7fac7133-5bfa-4176-8db6-8bde8101c1cd\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-57757f7cfc-69st4" Jun 08 13:48:25.525476 ip-10-0-140-46 kubenswrapper[2576]: I0608 13:48:25.525479 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/7fac7133-5bfa-4176-8db6-8bde8101c1cd-tmp\") pod \"cert-manager-operator-controller-manager-57757f7cfc-69st4\" (UID: \"7fac7133-5bfa-4176-8db6-8bde8101c1cd\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-57757f7cfc-69st4" Jun 08 13:48:25.625897 ip-10-0-140-46 kubenswrapper[2576]: I0608 13:48:25.625854 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-bsmjp\" (UniqueName: \"kubernetes.io/projected/7fac7133-5bfa-4176-8db6-8bde8101c1cd-kube-api-access-bsmjp\") pod \"cert-manager-operator-controller-manager-57757f7cfc-69st4\" (UID: \"7fac7133-5bfa-4176-8db6-8bde8101c1cd\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-57757f7cfc-69st4" Jun 08 13:48:25.625897 ip-10-0-140-46 kubenswrapper[2576]: I0608 13:48:25.625901 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/7fac7133-5bfa-4176-8db6-8bde8101c1cd-tmp\") pod \"cert-manager-operator-controller-manager-57757f7cfc-69st4\" (UID: \"7fac7133-5bfa-4176-8db6-8bde8101c1cd\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-57757f7cfc-69st4" Jun 08 13:48:25.626314 ip-10-0-140-46 kubenswrapper[2576]: I0608 13:48:25.626292 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/7fac7133-5bfa-4176-8db6-8bde8101c1cd-tmp\") pod \"cert-manager-operator-controller-manager-57757f7cfc-69st4\" (UID: \"7fac7133-5bfa-4176-8db6-8bde8101c1cd\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-57757f7cfc-69st4" Jun 08 13:48:25.642441 ip-10-0-140-46 kubenswrapper[2576]: I0608 13:48:25.642407 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-bsmjp\" (UniqueName: \"kubernetes.io/projected/7fac7133-5bfa-4176-8db6-8bde8101c1cd-kube-api-access-bsmjp\") pod \"cert-manager-operator-controller-manager-57757f7cfc-69st4\" (UID: \"7fac7133-5bfa-4176-8db6-8bde8101c1cd\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-57757f7cfc-69st4" Jun 08 13:48:25.773701 ip-10-0-140-46 kubenswrapper[2576]: I0608 13:48:25.773616 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager-operator/cert-manager-operator-controller-manager-57757f7cfc-69st4" Jun 08 13:48:25.943896 ip-10-0-140-46 kubenswrapper[2576]: I0608 13:48:25.943848 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager-operator/cert-manager-operator-controller-manager-57757f7cfc-69st4"] Jun 08 13:48:25.951382 ip-10-0-140-46 kubenswrapper[2576]: W0608 13:48:25.951350 2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7fac7133_5bfa_4176_8db6_8bde8101c1cd.slice/crio-ea16b1ae2c8df58d74b2c7a3ddc58ac0081f9a3ea30a02aaf6997364832a7303 WatchSource:0}: Error finding container ea16b1ae2c8df58d74b2c7a3ddc58ac0081f9a3ea30a02aaf6997364832a7303: Status 404 returned error can't find the container with id ea16b1ae2c8df58d74b2c7a3ddc58ac0081f9a3ea30a02aaf6997364832a7303 Jun 08 13:48:26.577048 ip-10-0-140-46 kubenswrapper[2576]: I0608 13:48:26.577010 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager-operator/cert-manager-operator-controller-manager-57757f7cfc-69st4" event={"ID":"7fac7133-5bfa-4176-8db6-8bde8101c1cd","Type":"ContainerStarted","Data":"ea16b1ae2c8df58d74b2c7a3ddc58ac0081f9a3ea30a02aaf6997364832a7303"} Jun 08 13:48:27.260643 ip-10-0-140-46 kubenswrapper[2576]: I0608 13:48:27.260605 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cx7sn_6e4b50fc-3e91-4f50-b92a-e90919788248/konnectivity-agent/0.log" limit=1024 Jun 08 13:48:27.351690 ip-10-0-140-46 kubenswrapper[2576]: I0608 13:48:27.351658 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cx7sn_6e4b50fc-3e91-4f50-b92a-e90919788248/konnectivity-agent/0.log" limit=1024 Jun 08 13:48:28.587821 ip-10-0-140-46 kubenswrapper[2576]: I0608 13:48:28.587785 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager-operator/cert-manager-operator-controller-manager-57757f7cfc-69st4" event={"ID":"7fac7133-5bfa-4176-8db6-8bde8101c1cd","Type":"ContainerStarted","Data":"eac6985de3fafdbb5e9dfb30a1765695cc719bc894a86eb6c6f908976d3c90c7"} Jun 08 13:48:28.615082 ip-10-0-140-46 kubenswrapper[2576]: I0608 13:48:28.615020 2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="cert-manager-operator/cert-manager-operator-controller-manager-57757f7cfc-69st4" podStartSLOduration=1.38562181 podStartE2EDuration="3.614997448s" totalImagesPullingTime="2.229375638s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-08 13:48:25 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-08 13:48:28.612857244 +0000 UTC m=+276.692186135" watchObservedRunningTime="2026-06-08 13:48:28.614997448 +0000 UTC m=+276.694326344" Jun 08 13:48:29.072168 ip-10-0-140-46 kubenswrapper[2576]: I0608 13:48:29.072134 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cx7sn_6e4b50fc-3e91-4f50-b92a-e90919788248/konnectivity-agent/0.log" limit=1024 Jun 08 13:48:29.219916 ip-10-0-140-46 kubenswrapper[2576]: I0608 13:48:29.219884 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cx7sn_6e4b50fc-3e91-4f50-b92a-e90919788248/konnectivity-agent/0.log" limit=1024 Jun 08 13:48:30.058303 ip-10-0-140-46 kubenswrapper[2576]: I0608 13:48:30.058264 2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fpjwf2"] Jun 08 13:48:30.060375 ip-10-0-140-46 kubenswrapper[2576]: I0608 13:48:30.060357 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fpjwf2" Jun 08 13:48:30.064905 ip-10-0-140-46 kubenswrapper[2576]: I0608 13:48:30.064882 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-marketplace\"/\"default-dockercfg-csk2k\"" Jun 08 13:48:30.064905 ip-10-0-140-46 kubenswrapper[2576]: I0608 13:48:30.064897 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"openshift-service-ca.crt\"" Jun 08 13:48:30.065104 ip-10-0-140-46 kubenswrapper[2576]: I0608 13:48:30.064898 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"kube-root-ca.crt\"" Jun 08 13:48:30.073035 ip-10-0-140-46 kubenswrapper[2576]: I0608 13:48:30.073011 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fpjwf2"] Jun 08 13:48:30.155554 ip-10-0-140-46 kubenswrapper[2576]: I0608 13:48:30.155518 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/0d4ea87f-ee6a-453f-967d-673b6abb15a0-bundle\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fpjwf2\" (UID: \"0d4ea87f-ee6a-453f-967d-673b6abb15a0\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fpjwf2" Jun 08 13:48:30.155760 ip-10-0-140-46 kubenswrapper[2576]: I0608 13:48:30.155590 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-j2p4z\" (UniqueName: \"kubernetes.io/projected/0d4ea87f-ee6a-453f-967d-673b6abb15a0-kube-api-access-j2p4z\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fpjwf2\" (UID: \"0d4ea87f-ee6a-453f-967d-673b6abb15a0\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fpjwf2" Jun 08 13:48:30.155760 ip-10-0-140-46 kubenswrapper[2576]: I0608 13:48:30.155641 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/0d4ea87f-ee6a-453f-967d-673b6abb15a0-util\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fpjwf2\" (UID: \"0d4ea87f-ee6a-453f-967d-673b6abb15a0\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fpjwf2" Jun 08 13:48:30.256865 ip-10-0-140-46 kubenswrapper[2576]: I0608 13:48:30.256822 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/0d4ea87f-ee6a-453f-967d-673b6abb15a0-util\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fpjwf2\" (UID: \"0d4ea87f-ee6a-453f-967d-673b6abb15a0\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fpjwf2" Jun 08 13:48:30.257049 ip-10-0-140-46 kubenswrapper[2576]: I0608 13:48:30.256877 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/0d4ea87f-ee6a-453f-967d-673b6abb15a0-bundle\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fpjwf2\" (UID: \"0d4ea87f-ee6a-453f-967d-673b6abb15a0\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fpjwf2" Jun 08 13:48:30.257049 ip-10-0-140-46 kubenswrapper[2576]: I0608 13:48:30.256907 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-j2p4z\" (UniqueName: \"kubernetes.io/projected/0d4ea87f-ee6a-453f-967d-673b6abb15a0-kube-api-access-j2p4z\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fpjwf2\" (UID: \"0d4ea87f-ee6a-453f-967d-673b6abb15a0\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fpjwf2" Jun 08 13:48:30.257244 ip-10-0-140-46 kubenswrapper[2576]: I0608 13:48:30.257222 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/0d4ea87f-ee6a-453f-967d-673b6abb15a0-util\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fpjwf2\" (UID: \"0d4ea87f-ee6a-453f-967d-673b6abb15a0\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fpjwf2" Jun 08 13:48:30.257308 ip-10-0-140-46 kubenswrapper[2576]: I0608 13:48:30.257259 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/0d4ea87f-ee6a-453f-967d-673b6abb15a0-bundle\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fpjwf2\" (UID: \"0d4ea87f-ee6a-453f-967d-673b6abb15a0\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fpjwf2" Jun 08 13:48:30.266801 ip-10-0-140-46 kubenswrapper[2576]: I0608 13:48:30.266769 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-j2p4z\" (UniqueName: \"kubernetes.io/projected/0d4ea87f-ee6a-453f-967d-673b6abb15a0-kube-api-access-j2p4z\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fpjwf2\" (UID: \"0d4ea87f-ee6a-453f-967d-673b6abb15a0\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fpjwf2" Jun 08 13:48:30.369256 ip-10-0-140-46 kubenswrapper[2576]: I0608 13:48:30.369168 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fpjwf2" Jun 08 13:48:30.505784 ip-10-0-140-46 kubenswrapper[2576]: I0608 13:48:30.505760 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fpjwf2"] Jun 08 13:48:30.508285 ip-10-0-140-46 kubenswrapper[2576]: W0608 13:48:30.508263 2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0d4ea87f_ee6a_453f_967d_673b6abb15a0.slice/crio-69351516f87965d86b39a9cf118efdd3e8f8a7241377cc8abbd5c5190a259670 WatchSource:0}: Error finding container 69351516f87965d86b39a9cf118efdd3e8f8a7241377cc8abbd5c5190a259670: Status 404 returned error can't find the container with id 69351516f87965d86b39a9cf118efdd3e8f8a7241377cc8abbd5c5190a259670 Jun 08 13:48:30.597931 ip-10-0-140-46 kubenswrapper[2576]: I0608 13:48:30.597895 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fpjwf2" event={"ID":"0d4ea87f-ee6a-453f-967d-673b6abb15a0","Type":"ContainerStarted","Data":"35642a0cd9d363da6c2795788ad4086eaf412802afe0ce262275bee62da6fe5e"} Jun 08 13:48:30.598073 ip-10-0-140-46 kubenswrapper[2576]: I0608 13:48:30.597978 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fpjwf2" event={"ID":"0d4ea87f-ee6a-453f-967d-673b6abb15a0","Type":"ContainerStarted","Data":"69351516f87965d86b39a9cf118efdd3e8f8a7241377cc8abbd5c5190a259670"} Jun 08 13:48:31.603717 ip-10-0-140-46 kubenswrapper[2576]: I0608 13:48:31.603684 2576 generic.go:356] "Generic (PLEG): container finished" podID="0d4ea87f-ee6a-453f-967d-673b6abb15a0" containerID="35642a0cd9d363da6c2795788ad4086eaf412802afe0ce262275bee62da6fe5e" exitCode=0 Jun 08 13:48:31.604105 ip-10-0-140-46 kubenswrapper[2576]: I0608 13:48:31.603772 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fpjwf2" event={"ID":"0d4ea87f-ee6a-453f-967d-673b6abb15a0","Type":"ContainerDied","Data":"35642a0cd9d363da6c2795788ad4086eaf412802afe0ce262275bee62da6fe5e"} Jun 08 13:48:32.544512 ip-10-0-140-46 kubenswrapper[2576]: I0608 13:48:32.544457 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cx7sn_6e4b50fc-3e91-4f50-b92a-e90919788248/konnectivity-agent/0.log" limit=1024 Jun 08 13:48:33.541706 ip-10-0-140-46 kubenswrapper[2576]: I0608 13:48:33.541667 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cx7sn_6e4b50fc-3e91-4f50-b92a-e90919788248/konnectivity-agent/0.log" limit=1024 Jun 08 13:48:33.614126 ip-10-0-140-46 kubenswrapper[2576]: I0608 13:48:33.614092 2576 generic.go:356] "Generic (PLEG): container finished" podID="0d4ea87f-ee6a-453f-967d-673b6abb15a0" containerID="c9dee28b911b8cb346285f5a6003b415541a28bf3419c64a2a5c00f9fa943067" exitCode=0 Jun 08 13:48:33.614274 ip-10-0-140-46 kubenswrapper[2576]: I0608 13:48:33.614136 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fpjwf2" event={"ID":"0d4ea87f-ee6a-453f-967d-673b6abb15a0","Type":"ContainerDied","Data":"c9dee28b911b8cb346285f5a6003b415541a28bf3419c64a2a5c00f9fa943067"} Jun 08 13:48:34.186696 ip-10-0-140-46 kubenswrapper[2576]: I0608 13:48:34.186661 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cx7sn_6e4b50fc-3e91-4f50-b92a-e90919788248/konnectivity-agent/0.log" limit=1024 Jun 08 13:48:34.252904 ip-10-0-140-46 kubenswrapper[2576]: I0608 13:48:34.252870 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cx7sn_6e4b50fc-3e91-4f50-b92a-e90919788248/konnectivity-agent/0.log" limit=1024 Jun 08 13:48:34.621429 ip-10-0-140-46 kubenswrapper[2576]: I0608 13:48:34.621398 2576 generic.go:356] "Generic (PLEG): container finished" podID="0d4ea87f-ee6a-453f-967d-673b6abb15a0" containerID="6cac035c472ab699a921b5b7827bee679da242ba4e9471020b1284df55cd9a4f" exitCode=0 Jun 08 13:48:34.621840 ip-10-0-140-46 kubenswrapper[2576]: I0608 13:48:34.621435 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fpjwf2" event={"ID":"0d4ea87f-ee6a-453f-967d-673b6abb15a0","Type":"ContainerDied","Data":"6cac035c472ab699a921b5b7827bee679da242ba4e9471020b1284df55cd9a4f"} Jun 08 13:48:35.747730 ip-10-0-140-46 kubenswrapper[2576]: I0608 13:48:35.747706 2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fpjwf2" Jun 08 13:48:35.799086 ip-10-0-140-46 kubenswrapper[2576]: I0608 13:48:35.799047 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/0d4ea87f-ee6a-453f-967d-673b6abb15a0-bundle\") pod \"0d4ea87f-ee6a-453f-967d-673b6abb15a0\" (UID: \"0d4ea87f-ee6a-453f-967d-673b6abb15a0\") " Jun 08 13:48:35.799266 ip-10-0-140-46 kubenswrapper[2576]: I0608 13:48:35.799141 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-j2p4z\" (UniqueName: \"kubernetes.io/projected/0d4ea87f-ee6a-453f-967d-673b6abb15a0-kube-api-access-j2p4z\") pod \"0d4ea87f-ee6a-453f-967d-673b6abb15a0\" (UID: \"0d4ea87f-ee6a-453f-967d-673b6abb15a0\") " Jun 08 13:48:35.799266 ip-10-0-140-46 kubenswrapper[2576]: I0608 13:48:35.799175 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/0d4ea87f-ee6a-453f-967d-673b6abb15a0-util\") pod \"0d4ea87f-ee6a-453f-967d-673b6abb15a0\" (UID: \"0d4ea87f-ee6a-453f-967d-673b6abb15a0\") " Jun 08 13:48:35.799557 ip-10-0-140-46 kubenswrapper[2576]: I0608 13:48:35.799523 2576 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/0d4ea87f-ee6a-453f-967d-673b6abb15a0-bundle" (OuterVolumeSpecName: "bundle") pod "0d4ea87f-ee6a-453f-967d-673b6abb15a0" (UID: "0d4ea87f-ee6a-453f-967d-673b6abb15a0"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 08 13:48:35.801183 ip-10-0-140-46 kubenswrapper[2576]: I0608 13:48:35.801156 2576 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/0d4ea87f-ee6a-453f-967d-673b6abb15a0-kube-api-access-j2p4z" (OuterVolumeSpecName: "kube-api-access-j2p4z") pod "0d4ea87f-ee6a-453f-967d-673b6abb15a0" (UID: "0d4ea87f-ee6a-453f-967d-673b6abb15a0"). InnerVolumeSpecName "kube-api-access-j2p4z". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 08 13:48:35.804047 ip-10-0-140-46 kubenswrapper[2576]: I0608 13:48:35.804024 2576 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/0d4ea87f-ee6a-453f-967d-673b6abb15a0-util" (OuterVolumeSpecName: "util") pod "0d4ea87f-ee6a-453f-967d-673b6abb15a0" (UID: "0d4ea87f-ee6a-453f-967d-673b6abb15a0"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 08 13:48:35.899782 ip-10-0-140-46 kubenswrapper[2576]: I0608 13:48:35.899698 2576 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-j2p4z\" (UniqueName: \"kubernetes.io/projected/0d4ea87f-ee6a-453f-967d-673b6abb15a0-kube-api-access-j2p4z\") on node \"ip-10-0-140-46.ec2.internal\" DevicePath \"\"" Jun 08 13:48:35.899782 ip-10-0-140-46 kubenswrapper[2576]: I0608 13:48:35.899727 2576 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/0d4ea87f-ee6a-453f-967d-673b6abb15a0-util\") on node \"ip-10-0-140-46.ec2.internal\" DevicePath \"\"" Jun 08 13:48:35.899782 ip-10-0-140-46 kubenswrapper[2576]: I0608 13:48:35.899736 2576 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/0d4ea87f-ee6a-453f-967d-673b6abb15a0-bundle\") on node \"ip-10-0-140-46.ec2.internal\" DevicePath \"\"" Jun 08 13:48:36.630897 ip-10-0-140-46 kubenswrapper[2576]: I0608 13:48:36.630860 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fpjwf2" event={"ID":"0d4ea87f-ee6a-453f-967d-673b6abb15a0","Type":"ContainerDied","Data":"69351516f87965d86b39a9cf118efdd3e8f8a7241377cc8abbd5c5190a259670"} Jun 08 13:48:36.630897 ip-10-0-140-46 kubenswrapper[2576]: I0608 13:48:36.630884 2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fpjwf2" Jun 08 13:48:36.631090 ip-10-0-140-46 kubenswrapper[2576]: I0608 13:48:36.630907 2576 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="69351516f87965d86b39a9cf118efdd3e8f8a7241377cc8abbd5c5190a259670" Jun 08 13:48:38.516606 ip-10-0-140-46 kubenswrapper[2576]: I0608 13:48:38.516554 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cx7sn_6e4b50fc-3e91-4f50-b92a-e90919788248/konnectivity-agent/0.log" limit=1024 Jun 08 13:48:38.572319 ip-10-0-140-46 kubenswrapper[2576]: I0608 13:48:38.572289 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cx7sn_6e4b50fc-3e91-4f50-b92a-e90919788248/konnectivity-agent/0.log" limit=1024 Jun 08 13:48:39.931653 ip-10-0-140-46 kubenswrapper[2576]: I0608 13:48:39.931620 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cx7sn_6e4b50fc-3e91-4f50-b92a-e90919788248/konnectivity-agent/0.log" limit=1024 Jun 08 13:48:41.736667 ip-10-0-140-46 kubenswrapper[2576]: I0608 13:48:41.736633 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cx7sn_6e4b50fc-3e91-4f50-b92a-e90919788248/konnectivity-agent/0.log" limit=1024 Jun 08 13:48:41.835121 ip-10-0-140-46 kubenswrapper[2576]: I0608 13:48:41.835049 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cx7sn_6e4b50fc-3e91-4f50-b92a-e90919788248/konnectivity-agent/0.log" limit=1024 Jun 08 13:48:42.858143 ip-10-0-140-46 kubenswrapper[2576]: I0608 13:48:42.858109 2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-lws-operator/openshift-lws-operator-fd8ccff4c-q4lvv"] Jun 08 13:48:42.858636 ip-10-0-140-46 kubenswrapper[2576]: I0608 13:48:42.858476 2576 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="0d4ea87f-ee6a-453f-967d-673b6abb15a0" containerName="pull" Jun 08 13:48:42.858636 ip-10-0-140-46 kubenswrapper[2576]: I0608 13:48:42.858493 2576 state_mem.go:107] "Deleted CPUSet assignment" podUID="0d4ea87f-ee6a-453f-967d-673b6abb15a0" containerName="pull" Jun 08 13:48:42.858636 ip-10-0-140-46 kubenswrapper[2576]: I0608 13:48:42.858508 2576 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="0d4ea87f-ee6a-453f-967d-673b6abb15a0" containerName="util" Jun 08 13:48:42.858636 ip-10-0-140-46 kubenswrapper[2576]: I0608 13:48:42.858517 2576 state_mem.go:107] "Deleted CPUSet assignment" podUID="0d4ea87f-ee6a-453f-967d-673b6abb15a0" containerName="util" Jun 08 13:48:42.858636 ip-10-0-140-46 kubenswrapper[2576]: I0608 13:48:42.858541 2576 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="0d4ea87f-ee6a-453f-967d-673b6abb15a0" containerName="extract" Jun 08 13:48:42.858636 ip-10-0-140-46 kubenswrapper[2576]: I0608 13:48:42.858550 2576 state_mem.go:107] "Deleted CPUSet assignment" podUID="0d4ea87f-ee6a-453f-967d-673b6abb15a0" containerName="extract" Jun 08 13:48:42.858937 ip-10-0-140-46 kubenswrapper[2576]: I0608 13:48:42.858640 2576 memory_manager.go:368] "RemoveStaleState removing state" podUID="0d4ea87f-ee6a-453f-967d-673b6abb15a0" containerName="extract" Jun 08 13:48:42.862431 ip-10-0-140-46 kubenswrapper[2576]: I0608 13:48:42.862411 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-q4lvv" Jun 08 13:48:42.867956 ip-10-0-140-46 kubenswrapper[2576]: I0608 13:48:42.867923 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"openshift-lws-operator-dockercfg-kbzwx\"" Jun 08 13:48:42.868083 ip-10-0-140-46 kubenswrapper[2576]: I0608 13:48:42.867996 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"openshift-service-ca.crt\"" Jun 08 13:48:42.868083 ip-10-0-140-46 kubenswrapper[2576]: I0608 13:48:42.868014 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"kube-root-ca.crt\"" Jun 08 13:48:42.873737 ip-10-0-140-46 kubenswrapper[2576]: I0608 13:48:42.873714 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/openshift-lws-operator-fd8ccff4c-q4lvv"] Jun 08 13:48:42.954781 ip-10-0-140-46 kubenswrapper[2576]: I0608 13:48:42.954739 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-gm7h8\" (UniqueName: \"kubernetes.io/projected/0ce913d4-88c4-4acc-b283-4cf28992d10e-kube-api-access-gm7h8\") pod \"openshift-lws-operator-fd8ccff4c-q4lvv\" (UID: \"0ce913d4-88c4-4acc-b283-4cf28992d10e\") " pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-q4lvv" Jun 08 13:48:42.954947 ip-10-0-140-46 kubenswrapper[2576]: I0608 13:48:42.954789 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/0ce913d4-88c4-4acc-b283-4cf28992d10e-tmp\") pod \"openshift-lws-operator-fd8ccff4c-q4lvv\" (UID: \"0ce913d4-88c4-4acc-b283-4cf28992d10e\") " pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-q4lvv" Jun 08 13:48:43.055187 ip-10-0-140-46 kubenswrapper[2576]: I0608 13:48:43.055147 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/0ce913d4-88c4-4acc-b283-4cf28992d10e-tmp\") pod \"openshift-lws-operator-fd8ccff4c-q4lvv\" (UID: \"0ce913d4-88c4-4acc-b283-4cf28992d10e\") " pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-q4lvv" Jun 08 13:48:43.055347 ip-10-0-140-46 kubenswrapper[2576]: I0608 13:48:43.055256 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-gm7h8\" (UniqueName: \"kubernetes.io/projected/0ce913d4-88c4-4acc-b283-4cf28992d10e-kube-api-access-gm7h8\") pod \"openshift-lws-operator-fd8ccff4c-q4lvv\" (UID: \"0ce913d4-88c4-4acc-b283-4cf28992d10e\") " pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-q4lvv" Jun 08 13:48:43.055531 ip-10-0-140-46 kubenswrapper[2576]: I0608 13:48:43.055512 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/0ce913d4-88c4-4acc-b283-4cf28992d10e-tmp\") pod \"openshift-lws-operator-fd8ccff4c-q4lvv\" (UID: \"0ce913d4-88c4-4acc-b283-4cf28992d10e\") " pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-q4lvv" Jun 08 13:48:43.064743 ip-10-0-140-46 kubenswrapper[2576]: I0608 13:48:43.064724 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-gm7h8\" (UniqueName: \"kubernetes.io/projected/0ce913d4-88c4-4acc-b283-4cf28992d10e-kube-api-access-gm7h8\") pod \"openshift-lws-operator-fd8ccff4c-q4lvv\" (UID: \"0ce913d4-88c4-4acc-b283-4cf28992d10e\") " pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-q4lvv" Jun 08 13:48:43.171489 ip-10-0-140-46 kubenswrapper[2576]: I0608 13:48:43.171409 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-q4lvv" Jun 08 13:48:43.311804 ip-10-0-140-46 kubenswrapper[2576]: I0608 13:48:43.311771 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/openshift-lws-operator-fd8ccff4c-q4lvv"] Jun 08 13:48:43.315285 ip-10-0-140-46 kubenswrapper[2576]: W0608 13:48:43.315238 2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod0ce913d4_88c4_4acc_b283_4cf28992d10e.slice/crio-d4a89a9d1ca4c92652fe15bc43fa7420856d763713a47dabe10cef2d24168e50 WatchSource:0}: Error finding container d4a89a9d1ca4c92652fe15bc43fa7420856d763713a47dabe10cef2d24168e50: Status 404 returned error can't find the container with id d4a89a9d1ca4c92652fe15bc43fa7420856d763713a47dabe10cef2d24168e50 Jun 08 13:48:43.661059 ip-10-0-140-46 kubenswrapper[2576]: I0608 13:48:43.661026 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-q4lvv" event={"ID":"0ce913d4-88c4-4acc-b283-4cf28992d10e","Type":"ContainerStarted","Data":"d4a89a9d1ca4c92652fe15bc43fa7420856d763713a47dabe10cef2d24168e50"} Jun 08 13:48:45.670687 ip-10-0-140-46 kubenswrapper[2576]: I0608 13:48:45.670597 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-q4lvv" event={"ID":"0ce913d4-88c4-4acc-b283-4cf28992d10e","Type":"ContainerStarted","Data":"7ffcd89ff88e75c448c17741cb5f6cfbb704ac92ac490674c28ee57d12cca08a"} Jun 08 13:48:45.701773 ip-10-0-140-46 kubenswrapper[2576]: I0608 13:48:45.701710 2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-q4lvv" podStartSLOduration=1.699104687 podStartE2EDuration="3.701690873s" totalImagesPullingTime="2.002586186s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-08 13:48:42 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-08 13:48:45.701076682 +0000 UTC m=+293.780405577" watchObservedRunningTime="2026-06-08 13:48:45.701690873 +0000 UTC m=+293.781019765" Jun 08 13:48:46.466461 ip-10-0-140-46 kubenswrapper[2576]: I0608 13:48:46.466430 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cx7sn_6e4b50fc-3e91-4f50-b92a-e90919788248/konnectivity-agent/0.log" limit=1024 Jun 08 13:48:46.567212 ip-10-0-140-46 kubenswrapper[2576]: I0608 13:48:46.567182 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cx7sn_6e4b50fc-3e91-4f50-b92a-e90919788248/konnectivity-agent/0.log" limit=1024 Jun 08 13:48:48.554115 ip-10-0-140-46 kubenswrapper[2576]: I0608 13:48:48.554077 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cx7sn_6e4b50fc-3e91-4f50-b92a-e90919788248/konnectivity-agent/0.log" limit=1024 Jun 08 13:48:48.698904 ip-10-0-140-46 kubenswrapper[2576]: I0608 13:48:48.698872 2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-marketplace/410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cd22hlk"] Jun 08 13:48:48.702194 ip-10-0-140-46 kubenswrapper[2576]: I0608 13:48:48.702178 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cd22hlk" Jun 08 13:48:48.705683 ip-10-0-140-46 kubenswrapper[2576]: I0608 13:48:48.705652 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-marketplace\"/\"default-dockercfg-csk2k\"" Jun 08 13:48:48.705683 ip-10-0-140-46 kubenswrapper[2576]: I0608 13:48:48.705668 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"kube-root-ca.crt\"" Jun 08 13:48:48.706228 ip-10-0-140-46 kubenswrapper[2576]: I0608 13:48:48.706207 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"openshift-service-ca.crt\"" Jun 08 13:48:48.735004 ip-10-0-140-46 kubenswrapper[2576]: I0608 13:48:48.734973 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cd22hlk"] Jun 08 13:48:48.799488 ip-10-0-140-46 kubenswrapper[2576]: I0608 13:48:48.799451 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/678e0c93-48ff-4cdf-8392-c3bc35136610-util\") pod \"410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cd22hlk\" (UID: \"678e0c93-48ff-4cdf-8392-c3bc35136610\") " pod="openshift-marketplace/410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cd22hlk" Jun 08 13:48:48.799488 ip-10-0-140-46 kubenswrapper[2576]: I0608 13:48:48.799488 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/678e0c93-48ff-4cdf-8392-c3bc35136610-bundle\") pod \"410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cd22hlk\" (UID: \"678e0c93-48ff-4cdf-8392-c3bc35136610\") " pod="openshift-marketplace/410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cd22hlk" Jun 08 13:48:48.799725 ip-10-0-140-46 kubenswrapper[2576]: I0608 13:48:48.799513 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-q5wd6\" (UniqueName: \"kubernetes.io/projected/678e0c93-48ff-4cdf-8392-c3bc35136610-kube-api-access-q5wd6\") pod \"410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cd22hlk\" (UID: \"678e0c93-48ff-4cdf-8392-c3bc35136610\") " pod="openshift-marketplace/410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cd22hlk" Jun 08 13:48:48.901052 ip-10-0-140-46 kubenswrapper[2576]: I0608 13:48:48.900959 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/678e0c93-48ff-4cdf-8392-c3bc35136610-util\") pod \"410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cd22hlk\" (UID: \"678e0c93-48ff-4cdf-8392-c3bc35136610\") " pod="openshift-marketplace/410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cd22hlk" Jun 08 13:48:48.901052 ip-10-0-140-46 kubenswrapper[2576]: I0608 13:48:48.901001 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/678e0c93-48ff-4cdf-8392-c3bc35136610-bundle\") pod \"410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cd22hlk\" (UID: \"678e0c93-48ff-4cdf-8392-c3bc35136610\") " pod="openshift-marketplace/410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cd22hlk" Jun 08 13:48:48.901052 ip-10-0-140-46 kubenswrapper[2576]: I0608 13:48:48.901022 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-q5wd6\" (UniqueName: \"kubernetes.io/projected/678e0c93-48ff-4cdf-8392-c3bc35136610-kube-api-access-q5wd6\") pod \"410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cd22hlk\" (UID: \"678e0c93-48ff-4cdf-8392-c3bc35136610\") " pod="openshift-marketplace/410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cd22hlk" Jun 08 13:48:48.901445 ip-10-0-140-46 kubenswrapper[2576]: I0608 13:48:48.901421 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/678e0c93-48ff-4cdf-8392-c3bc35136610-util\") pod \"410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cd22hlk\" (UID: \"678e0c93-48ff-4cdf-8392-c3bc35136610\") " pod="openshift-marketplace/410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cd22hlk" Jun 08 13:48:48.901502 ip-10-0-140-46 kubenswrapper[2576]: I0608 13:48:48.901481 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/678e0c93-48ff-4cdf-8392-c3bc35136610-bundle\") pod \"410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cd22hlk\" (UID: \"678e0c93-48ff-4cdf-8392-c3bc35136610\") " pod="openshift-marketplace/410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cd22hlk" Jun 08 13:48:48.910528 ip-10-0-140-46 kubenswrapper[2576]: I0608 13:48:48.910496 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-q5wd6\" (UniqueName: \"kubernetes.io/projected/678e0c93-48ff-4cdf-8392-c3bc35136610-kube-api-access-q5wd6\") pod \"410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cd22hlk\" (UID: \"678e0c93-48ff-4cdf-8392-c3bc35136610\") " pod="openshift-marketplace/410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cd22hlk" Jun 08 13:48:49.011679 ip-10-0-140-46 kubenswrapper[2576]: I0608 13:48:49.011631 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cd22hlk" Jun 08 13:48:49.146901 ip-10-0-140-46 kubenswrapper[2576]: I0608 13:48:49.146874 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cd22hlk"] Jun 08 13:48:49.148978 ip-10-0-140-46 kubenswrapper[2576]: W0608 13:48:49.148951 2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod678e0c93_48ff_4cdf_8392_c3bc35136610.slice/crio-f9b3480a3e4e5d3dda8b028f94192b8138a71d042e33217371b41e899180edea WatchSource:0}: Error finding container f9b3480a3e4e5d3dda8b028f94192b8138a71d042e33217371b41e899180edea: Status 404 returned error can't find the container with id f9b3480a3e4e5d3dda8b028f94192b8138a71d042e33217371b41e899180edea Jun 08 13:48:49.688913 ip-10-0-140-46 kubenswrapper[2576]: I0608 13:48:49.688878 2576 generic.go:356] "Generic (PLEG): container finished" podID="678e0c93-48ff-4cdf-8392-c3bc35136610" containerID="adfa18f0cdbf58233146ffdf459a00bd5c6378ac0abf07f804a99bf82bff14cf" exitCode=0 Jun 08 13:48:49.689399 ip-10-0-140-46 kubenswrapper[2576]: I0608 13:48:49.688968 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cd22hlk" event={"ID":"678e0c93-48ff-4cdf-8392-c3bc35136610","Type":"ContainerDied","Data":"adfa18f0cdbf58233146ffdf459a00bd5c6378ac0abf07f804a99bf82bff14cf"} Jun 08 13:48:49.689399 ip-10-0-140-46 kubenswrapper[2576]: I0608 13:48:49.689031 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cd22hlk" event={"ID":"678e0c93-48ff-4cdf-8392-c3bc35136610","Type":"ContainerStarted","Data":"f9b3480a3e4e5d3dda8b028f94192b8138a71d042e33217371b41e899180edea"} Jun 08 13:48:50.695420 ip-10-0-140-46 kubenswrapper[2576]: I0608 13:48:50.695382 2576 generic.go:356] "Generic (PLEG): container finished" podID="678e0c93-48ff-4cdf-8392-c3bc35136610" containerID="c0260fbe478e691bf18487b3f5d59aa17b819b3e17cdcf5c2aa4597daad9e45d" exitCode=0 Jun 08 13:48:50.695837 ip-10-0-140-46 kubenswrapper[2576]: I0608 13:48:50.695443 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cd22hlk" event={"ID":"678e0c93-48ff-4cdf-8392-c3bc35136610","Type":"ContainerDied","Data":"c0260fbe478e691bf18487b3f5d59aa17b819b3e17cdcf5c2aa4597daad9e45d"} Jun 08 13:48:51.701642 ip-10-0-140-46 kubenswrapper[2576]: I0608 13:48:51.701607 2576 generic.go:356] "Generic (PLEG): container finished" podID="678e0c93-48ff-4cdf-8392-c3bc35136610" containerID="d257cb6edcd58175310a2fea60b70edaca7795d7669c8445ff0d03c622a23996" exitCode=0 Jun 08 13:48:51.702001 ip-10-0-140-46 kubenswrapper[2576]: I0608 13:48:51.701650 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cd22hlk" event={"ID":"678e0c93-48ff-4cdf-8392-c3bc35136610","Type":"ContainerDied","Data":"d257cb6edcd58175310a2fea60b70edaca7795d7669c8445ff0d03c622a23996"} Jun 08 13:48:52.313645 ip-10-0-140-46 kubenswrapper[2576]: I0608 13:48:52.313606 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-ncffd_c26912ca-10b4-4ae3-b306-890f93abfee3/ovn-acl-logging/0.log" Jun 08 13:48:52.313854 ip-10-0-140-46 kubenswrapper[2576]: I0608 13:48:52.313836 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-ncffd_c26912ca-10b4-4ae3-b306-890f93abfee3/ovn-acl-logging/0.log" Jun 08 13:48:52.320551 ip-10-0-140-46 kubenswrapper[2576]: I0608 13:48:52.320527 2576 kubelet.go:1648] "Image garbage collection succeeded" Jun 08 13:48:52.836117 ip-10-0-140-46 kubenswrapper[2576]: I0608 13:48:52.836091 2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cd22hlk" Jun 08 13:48:52.934136 ip-10-0-140-46 kubenswrapper[2576]: I0608 13:48:52.934098 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/678e0c93-48ff-4cdf-8392-c3bc35136610-bundle\") pod \"678e0c93-48ff-4cdf-8392-c3bc35136610\" (UID: \"678e0c93-48ff-4cdf-8392-c3bc35136610\") " Jun 08 13:48:52.934311 ip-10-0-140-46 kubenswrapper[2576]: I0608 13:48:52.934146 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/678e0c93-48ff-4cdf-8392-c3bc35136610-util\") pod \"678e0c93-48ff-4cdf-8392-c3bc35136610\" (UID: \"678e0c93-48ff-4cdf-8392-c3bc35136610\") " Jun 08 13:48:52.934311 ip-10-0-140-46 kubenswrapper[2576]: I0608 13:48:52.934208 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-q5wd6\" (UniqueName: \"kubernetes.io/projected/678e0c93-48ff-4cdf-8392-c3bc35136610-kube-api-access-q5wd6\") pod \"678e0c93-48ff-4cdf-8392-c3bc35136610\" (UID: \"678e0c93-48ff-4cdf-8392-c3bc35136610\") " Jun 08 13:48:52.934868 ip-10-0-140-46 kubenswrapper[2576]: I0608 13:48:52.934842 2576 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/678e0c93-48ff-4cdf-8392-c3bc35136610-bundle" (OuterVolumeSpecName: "bundle") pod "678e0c93-48ff-4cdf-8392-c3bc35136610" (UID: "678e0c93-48ff-4cdf-8392-c3bc35136610"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 08 13:48:52.936329 ip-10-0-140-46 kubenswrapper[2576]: I0608 13:48:52.936310 2576 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/678e0c93-48ff-4cdf-8392-c3bc35136610-kube-api-access-q5wd6" (OuterVolumeSpecName: "kube-api-access-q5wd6") pod "678e0c93-48ff-4cdf-8392-c3bc35136610" (UID: "678e0c93-48ff-4cdf-8392-c3bc35136610"). InnerVolumeSpecName "kube-api-access-q5wd6". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 08 13:48:52.939634 ip-10-0-140-46 kubenswrapper[2576]: I0608 13:48:52.939585 2576 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/678e0c93-48ff-4cdf-8392-c3bc35136610-util" (OuterVolumeSpecName: "util") pod "678e0c93-48ff-4cdf-8392-c3bc35136610" (UID: "678e0c93-48ff-4cdf-8392-c3bc35136610"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 08 13:48:53.034888 ip-10-0-140-46 kubenswrapper[2576]: I0608 13:48:53.034852 2576 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/678e0c93-48ff-4cdf-8392-c3bc35136610-bundle\") on node \"ip-10-0-140-46.ec2.internal\" DevicePath \"\"" Jun 08 13:48:53.034888 ip-10-0-140-46 kubenswrapper[2576]: I0608 13:48:53.034885 2576 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/678e0c93-48ff-4cdf-8392-c3bc35136610-util\") on node \"ip-10-0-140-46.ec2.internal\" DevicePath \"\"" Jun 08 13:48:53.035068 ip-10-0-140-46 kubenswrapper[2576]: I0608 13:48:53.034895 2576 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-q5wd6\" (UniqueName: \"kubernetes.io/projected/678e0c93-48ff-4cdf-8392-c3bc35136610-kube-api-access-q5wd6\") on node \"ip-10-0-140-46.ec2.internal\" DevicePath \"\"" Jun 08 13:48:53.712010 ip-10-0-140-46 kubenswrapper[2576]: I0608 13:48:53.711974 2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cd22hlk" Jun 08 13:48:53.712010 ip-10-0-140-46 kubenswrapper[2576]: I0608 13:48:53.711983 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cd22hlk" event={"ID":"678e0c93-48ff-4cdf-8392-c3bc35136610","Type":"ContainerDied","Data":"f9b3480a3e4e5d3dda8b028f94192b8138a71d042e33217371b41e899180edea"} Jun 08 13:48:53.712287 ip-10-0-140-46 kubenswrapper[2576]: I0608 13:48:53.712054 2576 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="f9b3480a3e4e5d3dda8b028f94192b8138a71d042e33217371b41e899180edea" Jun 08 13:48:58.813287 ip-10-0-140-46 kubenswrapper[2576]: I0608 13:48:58.813250 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cx7sn_6e4b50fc-3e91-4f50-b92a-e90919788248/konnectivity-agent/0.log" limit=1024 Jun 08 13:48:58.887774 ip-10-0-140-46 kubenswrapper[2576]: I0608 13:48:58.887742 2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-lws-operator/lws-controller-manager-68cd448d56-6j4jd"] Jun 08 13:48:58.888052 ip-10-0-140-46 kubenswrapper[2576]: I0608 13:48:58.888038 2576 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="678e0c93-48ff-4cdf-8392-c3bc35136610" containerName="pull" Jun 08 13:48:58.888096 ip-10-0-140-46 kubenswrapper[2576]: I0608 13:48:58.888054 2576 state_mem.go:107] "Deleted CPUSet assignment" podUID="678e0c93-48ff-4cdf-8392-c3bc35136610" containerName="pull" Jun 08 13:48:58.888096 ip-10-0-140-46 kubenswrapper[2576]: I0608 13:48:58.888068 2576 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="678e0c93-48ff-4cdf-8392-c3bc35136610" containerName="extract" Jun 08 13:48:58.888096 ip-10-0-140-46 kubenswrapper[2576]: I0608 13:48:58.888074 2576 state_mem.go:107] "Deleted CPUSet assignment" podUID="678e0c93-48ff-4cdf-8392-c3bc35136610" containerName="extract" Jun 08 13:48:58.888096 ip-10-0-140-46 kubenswrapper[2576]: I0608 13:48:58.888081 2576 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="678e0c93-48ff-4cdf-8392-c3bc35136610" containerName="util" Jun 08 13:48:58.888096 ip-10-0-140-46 kubenswrapper[2576]: I0608 13:48:58.888087 2576 state_mem.go:107] "Deleted CPUSet assignment" podUID="678e0c93-48ff-4cdf-8392-c3bc35136610" containerName="util" Jun 08 13:48:58.888319 ip-10-0-140-46 kubenswrapper[2576]: I0608 13:48:58.888142 2576 memory_manager.go:368] "RemoveStaleState removing state" podUID="678e0c93-48ff-4cdf-8392-c3bc35136610" containerName="extract" Jun 08 13:48:58.888662 ip-10-0-140-46 kubenswrapper[2576]: I0608 13:48:58.888642 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cx7sn_6e4b50fc-3e91-4f50-b92a-e90919788248/konnectivity-agent/0.log" limit=1024 Jun 08 13:48:58.891226 ip-10-0-140-46 kubenswrapper[2576]: I0608 13:48:58.891208 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/lws-controller-manager-68cd448d56-6j4jd" Jun 08 13:48:58.895190 ip-10-0-140-46 kubenswrapper[2576]: I0608 13:48:58.895168 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"lws-manager-config\"" Jun 08 13:48:58.895294 ip-10-0-140-46 kubenswrapper[2576]: I0608 13:48:58.895274 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"lws-controller-manager-dockercfg-9djrw\"" Jun 08 13:48:58.895431 ip-10-0-140-46 kubenswrapper[2576]: I0608 13:48:58.895416 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"webhook-server-cert\"" Jun 08 13:48:58.895478 ip-10-0-140-46 kubenswrapper[2576]: I0608 13:48:58.895447 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"metrics-server-cert\"" Jun 08 13:48:58.904988 ip-10-0-140-46 kubenswrapper[2576]: I0608 13:48:58.904966 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/lws-controller-manager-68cd448d56-6j4jd"] Jun 08 13:48:58.983042 ip-10-0-140-46 kubenswrapper[2576]: I0608 13:48:58.982993 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/a3f450d0-a752-48f2-85e5-1178237392d9-manager-config\") pod \"lws-controller-manager-68cd448d56-6j4jd\" (UID: \"a3f450d0-a752-48f2-85e5-1178237392d9\") " pod="openshift-lws-operator/lws-controller-manager-68cd448d56-6j4jd" Jun 08 13:48:58.983234 ip-10-0-140-46 kubenswrapper[2576]: I0608 13:48:58.983052 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/a3f450d0-a752-48f2-85e5-1178237392d9-cert\") pod \"lws-controller-manager-68cd448d56-6j4jd\" (UID: \"a3f450d0-a752-48f2-85e5-1178237392d9\") " pod="openshift-lws-operator/lws-controller-manager-68cd448d56-6j4jd" Jun 08 13:48:58.983234 ip-10-0-140-46 kubenswrapper[2576]: I0608 13:48:58.983125 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2cw2p\" (UniqueName: \"kubernetes.io/projected/a3f450d0-a752-48f2-85e5-1178237392d9-kube-api-access-2cw2p\") pod \"lws-controller-manager-68cd448d56-6j4jd\" (UID: \"a3f450d0-a752-48f2-85e5-1178237392d9\") " pod="openshift-lws-operator/lws-controller-manager-68cd448d56-6j4jd" Jun 08 13:48:58.983234 ip-10-0-140-46 kubenswrapper[2576]: I0608 13:48:58.983175 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/a3f450d0-a752-48f2-85e5-1178237392d9-metrics-cert\") pod \"lws-controller-manager-68cd448d56-6j4jd\" (UID: \"a3f450d0-a752-48f2-85e5-1178237392d9\") " pod="openshift-lws-operator/lws-controller-manager-68cd448d56-6j4jd" Jun 08 13:48:59.084216 ip-10-0-140-46 kubenswrapper[2576]: I0608 13:48:59.084111 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/a3f450d0-a752-48f2-85e5-1178237392d9-manager-config\") pod \"lws-controller-manager-68cd448d56-6j4jd\" (UID: \"a3f450d0-a752-48f2-85e5-1178237392d9\") " pod="openshift-lws-operator/lws-controller-manager-68cd448d56-6j4jd" Jun 08 13:48:59.084216 ip-10-0-140-46 kubenswrapper[2576]: I0608 13:48:59.084167 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/a3f450d0-a752-48f2-85e5-1178237392d9-cert\") pod \"lws-controller-manager-68cd448d56-6j4jd\" (UID: \"a3f450d0-a752-48f2-85e5-1178237392d9\") " pod="openshift-lws-operator/lws-controller-manager-68cd448d56-6j4jd" Jun 08 13:48:59.084216 ip-10-0-140-46 kubenswrapper[2576]: I0608 13:48:59.084189 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2cw2p\" (UniqueName: \"kubernetes.io/projected/a3f450d0-a752-48f2-85e5-1178237392d9-kube-api-access-2cw2p\") pod \"lws-controller-manager-68cd448d56-6j4jd\" (UID: \"a3f450d0-a752-48f2-85e5-1178237392d9\") " pod="openshift-lws-operator/lws-controller-manager-68cd448d56-6j4jd" Jun 08 13:48:59.084216 ip-10-0-140-46 kubenswrapper[2576]: I0608 13:48:59.084215 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/a3f450d0-a752-48f2-85e5-1178237392d9-metrics-cert\") pod \"lws-controller-manager-68cd448d56-6j4jd\" (UID: \"a3f450d0-a752-48f2-85e5-1178237392d9\") " pod="openshift-lws-operator/lws-controller-manager-68cd448d56-6j4jd" Jun 08 13:48:59.084902 ip-10-0-140-46 kubenswrapper[2576]: I0608 13:48:59.084877 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/a3f450d0-a752-48f2-85e5-1178237392d9-manager-config\") pod \"lws-controller-manager-68cd448d56-6j4jd\" (UID: \"a3f450d0-a752-48f2-85e5-1178237392d9\") " pod="openshift-lws-operator/lws-controller-manager-68cd448d56-6j4jd" Jun 08 13:48:59.086731 ip-10-0-140-46 kubenswrapper[2576]: I0608 13:48:59.086713 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/a3f450d0-a752-48f2-85e5-1178237392d9-metrics-cert\") pod \"lws-controller-manager-68cd448d56-6j4jd\" (UID: \"a3f450d0-a752-48f2-85e5-1178237392d9\") " pod="openshift-lws-operator/lws-controller-manager-68cd448d56-6j4jd" Jun 08 13:48:59.086855 ip-10-0-140-46 kubenswrapper[2576]: I0608 13:48:59.086838 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/a3f450d0-a752-48f2-85e5-1178237392d9-cert\") pod \"lws-controller-manager-68cd448d56-6j4jd\" (UID: \"a3f450d0-a752-48f2-85e5-1178237392d9\") " pod="openshift-lws-operator/lws-controller-manager-68cd448d56-6j4jd" Jun 08 13:48:59.095411 ip-10-0-140-46 kubenswrapper[2576]: I0608 13:48:59.095389 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-2cw2p\" (UniqueName: \"kubernetes.io/projected/a3f450d0-a752-48f2-85e5-1178237392d9-kube-api-access-2cw2p\") pod \"lws-controller-manager-68cd448d56-6j4jd\" (UID: \"a3f450d0-a752-48f2-85e5-1178237392d9\") " pod="openshift-lws-operator/lws-controller-manager-68cd448d56-6j4jd" Jun 08 13:48:59.200216 ip-10-0-140-46 kubenswrapper[2576]: I0608 13:48:59.200178 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/lws-controller-manager-68cd448d56-6j4jd" Jun 08 13:48:59.346414 ip-10-0-140-46 kubenswrapper[2576]: I0608 13:48:59.346334 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/lws-controller-manager-68cd448d56-6j4jd"] Jun 08 13:48:59.349194 ip-10-0-140-46 kubenswrapper[2576]: W0608 13:48:59.349164 2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda3f450d0_a752_48f2_85e5_1178237392d9.slice/crio-a15ba19cde3f40187cda63c1405bfe46a03fb42b9ad39125380038bbd830f551 WatchSource:0}: Error finding container a15ba19cde3f40187cda63c1405bfe46a03fb42b9ad39125380038bbd830f551: Status 404 returned error can't find the container with id a15ba19cde3f40187cda63c1405bfe46a03fb42b9ad39125380038bbd830f551 Jun 08 13:48:59.351169 ip-10-0-140-46 kubenswrapper[2576]: I0608 13:48:59.351152 2576 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jun 08 13:48:59.738435 ip-10-0-140-46 kubenswrapper[2576]: I0608 13:48:59.738350 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/lws-controller-manager-68cd448d56-6j4jd" event={"ID":"a3f450d0-a752-48f2-85e5-1178237392d9","Type":"ContainerStarted","Data":"a15ba19cde3f40187cda63c1405bfe46a03fb42b9ad39125380038bbd830f551"} Jun 08 13:49:01.748645 ip-10-0-140-46 kubenswrapper[2576]: I0608 13:49:01.748526 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/lws-controller-manager-68cd448d56-6j4jd" event={"ID":"a3f450d0-a752-48f2-85e5-1178237392d9","Type":"ContainerStarted","Data":"5b1fc20177c90e053a4be7cfbab975ab773dc35f573ebced461874ac7e6fe7cf"} Jun 08 13:49:01.749098 ip-10-0-140-46 kubenswrapper[2576]: I0608 13:49:01.748681 2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-lws-operator/lws-controller-manager-68cd448d56-6j4jd" Jun 08 13:49:01.772918 ip-10-0-140-46 kubenswrapper[2576]: I0608 13:49:01.772864 2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-lws-operator/lws-controller-manager-68cd448d56-6j4jd" podStartSLOduration=1.7244767300000001 podStartE2EDuration="3.772847701s" totalImagesPullingTime="2.048370971s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-08 13:48:58 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-08 13:49:01.771967925 +0000 UTC m=+309.851296818" watchObservedRunningTime="2026-06-08 13:49:01.772847701 +0000 UTC m=+309.852176592" Jun 08 13:49:04.843454 ip-10-0-140-46 kubenswrapper[2576]: I0608 13:49:04.843415 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cx7sn_6e4b50fc-3e91-4f50-b92a-e90919788248/konnectivity-agent/0.log" limit=1024 Jun 08 13:49:04.931838 ip-10-0-140-46 kubenswrapper[2576]: I0608 13:49:04.931800 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cx7sn_6e4b50fc-3e91-4f50-b92a-e90919788248/konnectivity-agent/0.log" limit=1024 Jun 08 13:49:05.428515 ip-10-0-140-46 kubenswrapper[2576]: I0608 13:49:05.428482 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cx7sn_6e4b50fc-3e91-4f50-b92a-e90919788248/konnectivity-agent/0.log" limit=1024 Jun 08 13:49:05.619217 ip-10-0-140-46 kubenswrapper[2576]: I0608 13:49:05.619175 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cx7sn_6e4b50fc-3e91-4f50-b92a-e90919788248/konnectivity-agent/0.log" limit=1024 Jun 08 13:49:05.722868 ip-10-0-140-46 kubenswrapper[2576]: I0608 13:49:05.722791 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cx7sn_6e4b50fc-3e91-4f50-b92a-e90919788248/konnectivity-agent/0.log" limit=1024 Jun 08 13:49:05.817029 ip-10-0-140-46 kubenswrapper[2576]: I0608 13:49:05.816997 2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-7b8d697984-b2fn4"] Jun 08 13:49:05.824823 ip-10-0-140-46 kubenswrapper[2576]: I0608 13:49:05.824807 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-7b8d697984-b2fn4" Jun 08 13:49:05.830232 ip-10-0-140-46 kubenswrapper[2576]: I0608 13:49:05.830209 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-dockercfg-27r7x\"" Jun 08 13:49:05.830364 ip-10-0-140-46 kubenswrapper[2576]: I0608 13:49:05.830245 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-webhook-cert\"" Jun 08 13:49:05.830771 ip-10-0-140-46 kubenswrapper[2576]: I0608 13:49:05.830753 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-service-cert\"" Jun 08 13:49:05.831320 ip-10-0-140-46 kubenswrapper[2576]: I0608 13:49:05.831304 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"kube-root-ca.crt\"" Jun 08 13:49:05.832111 ip-10-0-140-46 kubenswrapper[2576]: I0608 13:49:05.832085 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"openshift-service-ca.crt\"" Jun 08 13:49:05.838826 ip-10-0-140-46 kubenswrapper[2576]: I0608 13:49:05.838801 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-7b8d697984-b2fn4"] Jun 08 13:49:05.936815 ip-10-0-140-46 kubenswrapper[2576]: I0608 13:49:05.936779 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cx7sn_6e4b50fc-3e91-4f50-b92a-e90919788248/konnectivity-agent/0.log" limit=1024 Jun 08 13:49:05.941951 ip-10-0-140-46 kubenswrapper[2576]: I0608 13:49:05.941927 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7hzkz\" (UniqueName: \"kubernetes.io/projected/8d1dd660-213d-4c9b-92bf-1a4132f8b703-kube-api-access-7hzkz\") pod \"opendatahub-operator-controller-manager-7b8d697984-b2fn4\" (UID: \"8d1dd660-213d-4c9b-92bf-1a4132f8b703\") " pod="opendatahub/opendatahub-operator-controller-manager-7b8d697984-b2fn4" Jun 08 13:49:05.942067 ip-10-0-140-46 kubenswrapper[2576]: I0608 13:49:05.941974 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/8d1dd660-213d-4c9b-92bf-1a4132f8b703-webhook-cert\") pod \"opendatahub-operator-controller-manager-7b8d697984-b2fn4\" (UID: \"8d1dd660-213d-4c9b-92bf-1a4132f8b703\") " pod="opendatahub/opendatahub-operator-controller-manager-7b8d697984-b2fn4" Jun 08 13:49:05.942067 ip-10-0-140-46 kubenswrapper[2576]: I0608 13:49:05.942056 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/8d1dd660-213d-4c9b-92bf-1a4132f8b703-manifests\") pod \"opendatahub-operator-controller-manager-7b8d697984-b2fn4\" (UID: \"8d1dd660-213d-4c9b-92bf-1a4132f8b703\") " pod="opendatahub/opendatahub-operator-controller-manager-7b8d697984-b2fn4" Jun 08 13:49:05.942167 ip-10-0-140-46 kubenswrapper[2576]: I0608 13:49:05.942087 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/8d1dd660-213d-4c9b-92bf-1a4132f8b703-tmp\") pod \"opendatahub-operator-controller-manager-7b8d697984-b2fn4\" (UID: \"8d1dd660-213d-4c9b-92bf-1a4132f8b703\") " pod="opendatahub/opendatahub-operator-controller-manager-7b8d697984-b2fn4" Jun 08 13:49:05.942167 ip-10-0-140-46 kubenswrapper[2576]: I0608 13:49:05.942122 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/8d1dd660-213d-4c9b-92bf-1a4132f8b703-apiservice-cert\") pod \"opendatahub-operator-controller-manager-7b8d697984-b2fn4\" (UID: \"8d1dd660-213d-4c9b-92bf-1a4132f8b703\") " pod="opendatahub/opendatahub-operator-controller-manager-7b8d697984-b2fn4" Jun 08 13:49:06.040103 ip-10-0-140-46 kubenswrapper[2576]: I0608 13:49:06.040067 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cx7sn_6e4b50fc-3e91-4f50-b92a-e90919788248/konnectivity-agent/0.log" limit=1024 Jun 08 13:49:06.042582 ip-10-0-140-46 kubenswrapper[2576]: I0608 13:49:06.042545 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/8d1dd660-213d-4c9b-92bf-1a4132f8b703-manifests\") pod \"opendatahub-operator-controller-manager-7b8d697984-b2fn4\" (UID: \"8d1dd660-213d-4c9b-92bf-1a4132f8b703\") " pod="opendatahub/opendatahub-operator-controller-manager-7b8d697984-b2fn4" Jun 08 13:49:06.042660 ip-10-0-140-46 kubenswrapper[2576]: I0608 13:49:06.042590 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/8d1dd660-213d-4c9b-92bf-1a4132f8b703-tmp\") pod \"opendatahub-operator-controller-manager-7b8d697984-b2fn4\" (UID: \"8d1dd660-213d-4c9b-92bf-1a4132f8b703\") " pod="opendatahub/opendatahub-operator-controller-manager-7b8d697984-b2fn4" Jun 08 13:49:06.042660 ip-10-0-140-46 kubenswrapper[2576]: I0608 13:49:06.042621 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/8d1dd660-213d-4c9b-92bf-1a4132f8b703-apiservice-cert\") pod \"opendatahub-operator-controller-manager-7b8d697984-b2fn4\" (UID: \"8d1dd660-213d-4c9b-92bf-1a4132f8b703\") " pod="opendatahub/opendatahub-operator-controller-manager-7b8d697984-b2fn4" Jun 08 13:49:06.042758 ip-10-0-140-46 kubenswrapper[2576]: I0608 13:49:06.042677 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7hzkz\" (UniqueName: \"kubernetes.io/projected/8d1dd660-213d-4c9b-92bf-1a4132f8b703-kube-api-access-7hzkz\") pod \"opendatahub-operator-controller-manager-7b8d697984-b2fn4\" (UID: \"8d1dd660-213d-4c9b-92bf-1a4132f8b703\") " pod="opendatahub/opendatahub-operator-controller-manager-7b8d697984-b2fn4" Jun 08 13:49:06.042758 ip-10-0-140-46 kubenswrapper[2576]: I0608 13:49:06.042729 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/8d1dd660-213d-4c9b-92bf-1a4132f8b703-webhook-cert\") pod \"opendatahub-operator-controller-manager-7b8d697984-b2fn4\" (UID: \"8d1dd660-213d-4c9b-92bf-1a4132f8b703\") " pod="opendatahub/opendatahub-operator-controller-manager-7b8d697984-b2fn4" Jun 08 13:49:06.042980 ip-10-0-140-46 kubenswrapper[2576]: I0608 13:49:06.042959 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/8d1dd660-213d-4c9b-92bf-1a4132f8b703-manifests\") pod \"opendatahub-operator-controller-manager-7b8d697984-b2fn4\" (UID: \"8d1dd660-213d-4c9b-92bf-1a4132f8b703\") " pod="opendatahub/opendatahub-operator-controller-manager-7b8d697984-b2fn4" Jun 08 13:49:06.044977 ip-10-0-140-46 kubenswrapper[2576]: I0608 13:49:06.044955 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/8d1dd660-213d-4c9b-92bf-1a4132f8b703-tmp\") pod \"opendatahub-operator-controller-manager-7b8d697984-b2fn4\" (UID: \"8d1dd660-213d-4c9b-92bf-1a4132f8b703\") " pod="opendatahub/opendatahub-operator-controller-manager-7b8d697984-b2fn4" Jun 08 13:49:06.045070 ip-10-0-140-46 kubenswrapper[2576]: I0608 13:49:06.045020 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/8d1dd660-213d-4c9b-92bf-1a4132f8b703-webhook-cert\") pod \"opendatahub-operator-controller-manager-7b8d697984-b2fn4\" (UID: \"8d1dd660-213d-4c9b-92bf-1a4132f8b703\") " pod="opendatahub/opendatahub-operator-controller-manager-7b8d697984-b2fn4" Jun 08 13:49:06.045136 ip-10-0-140-46 kubenswrapper[2576]: I0608 13:49:06.045074 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/8d1dd660-213d-4c9b-92bf-1a4132f8b703-apiservice-cert\") pod \"opendatahub-operator-controller-manager-7b8d697984-b2fn4\" (UID: \"8d1dd660-213d-4c9b-92bf-1a4132f8b703\") " pod="opendatahub/opendatahub-operator-controller-manager-7b8d697984-b2fn4" Jun 08 13:49:06.053134 ip-10-0-140-46 kubenswrapper[2576]: I0608 13:49:06.053110 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-7hzkz\" (UniqueName: \"kubernetes.io/projected/8d1dd660-213d-4c9b-92bf-1a4132f8b703-kube-api-access-7hzkz\") pod \"opendatahub-operator-controller-manager-7b8d697984-b2fn4\" (UID: \"8d1dd660-213d-4c9b-92bf-1a4132f8b703\") " pod="opendatahub/opendatahub-operator-controller-manager-7b8d697984-b2fn4" Jun 08 13:49:06.134256 ip-10-0-140-46 kubenswrapper[2576]: I0608 13:49:06.134213 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-7b8d697984-b2fn4" Jun 08 13:49:06.138083 ip-10-0-140-46 kubenswrapper[2576]: I0608 13:49:06.137745 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cx7sn_6e4b50fc-3e91-4f50-b92a-e90919788248/konnectivity-agent/0.log" limit=1024 Jun 08 13:49:06.242668 ip-10-0-140-46 kubenswrapper[2576]: I0608 13:49:06.242626 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cx7sn_6e4b50fc-3e91-4f50-b92a-e90919788248/konnectivity-agent/0.log" limit=1024 Jun 08 13:49:06.273354 ip-10-0-140-46 kubenswrapper[2576]: I0608 13:49:06.273329 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-7b8d697984-b2fn4"] Jun 08 13:49:06.276175 ip-10-0-140-46 kubenswrapper[2576]: W0608 13:49:06.276149 2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8d1dd660_213d_4c9b_92bf_1a4132f8b703.slice/crio-a8fece09d2d70e8d66ef5afbda7390ea6bdd6ea65aad5f72da241d6d35a6dede WatchSource:0}: Error finding container a8fece09d2d70e8d66ef5afbda7390ea6bdd6ea65aad5f72da241d6d35a6dede: Status 404 returned error can't find the container with id a8fece09d2d70e8d66ef5afbda7390ea6bdd6ea65aad5f72da241d6d35a6dede Jun 08 13:49:06.347281 ip-10-0-140-46 kubenswrapper[2576]: I0608 13:49:06.347181 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cx7sn_6e4b50fc-3e91-4f50-b92a-e90919788248/konnectivity-agent/0.log" limit=1024 Jun 08 13:49:06.437234 ip-10-0-140-46 kubenswrapper[2576]: I0608 13:49:06.437202 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cx7sn_6e4b50fc-3e91-4f50-b92a-e90919788248/konnectivity-agent/0.log" limit=1024 Jun 08 13:49:06.541126 ip-10-0-140-46 kubenswrapper[2576]: I0608 13:49:06.541090 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cx7sn_6e4b50fc-3e91-4f50-b92a-e90919788248/konnectivity-agent/0.log" limit=1024 Jun 08 13:49:06.645914 ip-10-0-140-46 kubenswrapper[2576]: I0608 13:49:06.645834 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cx7sn_6e4b50fc-3e91-4f50-b92a-e90919788248/konnectivity-agent/0.log" limit=1024 Jun 08 13:49:06.772647 ip-10-0-140-46 kubenswrapper[2576]: I0608 13:49:06.772608 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-7b8d697984-b2fn4" event={"ID":"8d1dd660-213d-4c9b-92bf-1a4132f8b703","Type":"ContainerStarted","Data":"a8fece09d2d70e8d66ef5afbda7390ea6bdd6ea65aad5f72da241d6d35a6dede"} Jun 08 13:49:09.787832 ip-10-0-140-46 kubenswrapper[2576]: I0608 13:49:09.787797 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-7b8d697984-b2fn4" event={"ID":"8d1dd660-213d-4c9b-92bf-1a4132f8b703","Type":"ContainerStarted","Data":"a758a72758b2be2dc3aeacf58d684c54350d11f091fb0d59149121425a64581f"} Jun 08 13:49:10.793750 ip-10-0-140-46 kubenswrapper[2576]: I0608 13:49:10.793714 2576 generic.go:356] "Generic (PLEG): container finished" podID="8d1dd660-213d-4c9b-92bf-1a4132f8b703" containerID="a758a72758b2be2dc3aeacf58d684c54350d11f091fb0d59149121425a64581f" exitCode=0 Jun 08 13:49:10.794131 ip-10-0-140-46 kubenswrapper[2576]: I0608 13:49:10.793831 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-7b8d697984-b2fn4" event={"ID":"8d1dd660-213d-4c9b-92bf-1a4132f8b703","Type":"ContainerDied","Data":"a758a72758b2be2dc3aeacf58d684c54350d11f091fb0d59149121425a64581f"} Jun 08 13:49:11.800143 ip-10-0-140-46 kubenswrapper[2576]: I0608 13:49:11.800101 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-7b8d697984-b2fn4" event={"ID":"8d1dd660-213d-4c9b-92bf-1a4132f8b703","Type":"ContainerStarted","Data":"63e679bed4712473254771305b1033ae36cee33ffc24edc1667db1eab03628c7"} Jun 08 13:49:11.800535 ip-10-0-140-46 kubenswrapper[2576]: I0608 13:49:11.800215 2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/opendatahub-operator-controller-manager-7b8d697984-b2fn4" Jun 08 13:49:11.836436 ip-10-0-140-46 kubenswrapper[2576]: I0608 13:49:11.836386 2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/opendatahub-operator-controller-manager-7b8d697984-b2fn4" podStartSLOduration=2.9602881070000002 podStartE2EDuration="6.836366514s" totalImagesPullingTime="2.93332018s" totalInitContainerRuntime="942.758227ms" isStatefulPod=false podCreationTimestamp="2026-06-08 13:49:05 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-08 13:49:11.835033708 +0000 UTC m=+319.914362599" watchObservedRunningTime="2026-06-08 13:49:11.836366514 +0000 UTC m=+319.915695406" Jun 08 13:49:12.755294 ip-10-0-140-46 kubenswrapper[2576]: I0608 13:49:12.755262 2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-lws-operator/lws-controller-manager-68cd448d56-6j4jd" Jun 08 13:49:16.480713 ip-10-0-140-46 kubenswrapper[2576]: I0608 13:49:16.480647 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cx7sn_6e4b50fc-3e91-4f50-b92a-e90919788248/konnectivity-agent/0.log" limit=1024 Jun 08 13:49:16.582655 ip-10-0-140-46 kubenswrapper[2576]: I0608 13:49:16.582616 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cx7sn_6e4b50fc-3e91-4f50-b92a-e90919788248/konnectivity-agent/0.log" limit=1024 Jun 08 13:49:16.679730 ip-10-0-140-46 kubenswrapper[2576]: I0608 13:49:16.679696 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cx7sn_6e4b50fc-3e91-4f50-b92a-e90919788248/konnectivity-agent/0.log" limit=1024 Jun 08 13:49:16.821396 ip-10-0-140-46 kubenswrapper[2576]: I0608 13:49:16.821363 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cx7sn_6e4b50fc-3e91-4f50-b92a-e90919788248/konnectivity-agent/0.log" limit=1024 Jun 08 13:49:22.808636 ip-10-0-140-46 kubenswrapper[2576]: I0608 13:49:22.808606 2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/opendatahub-operator-controller-manager-7b8d697984-b2fn4" Jun 08 13:49:24.430784 ip-10-0-140-46 kubenswrapper[2576]: I0608 13:49:24.430744 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cx7sn_6e4b50fc-3e91-4f50-b92a-e90919788248/konnectivity-agent/0.log" limit=1024 Jun 08 13:49:24.545938 ip-10-0-140-46 kubenswrapper[2576]: I0608 13:49:24.545904 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cx7sn_6e4b50fc-3e91-4f50-b92a-e90919788248/konnectivity-agent/0.log" limit=1024 Jun 08 13:49:27.645046 ip-10-0-140-46 kubenswrapper[2576]: I0608 13:49:27.645014 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cx7sn_6e4b50fc-3e91-4f50-b92a-e90919788248/konnectivity-agent/0.log" limit=1024 Jun 08 13:49:27.747307 ip-10-0-140-46 kubenswrapper[2576]: I0608 13:49:27.747273 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cx7sn_6e4b50fc-3e91-4f50-b92a-e90919788248/konnectivity-agent/0.log" limit=1024 Jun 08 13:49:28.126140 ip-10-0-140-46 kubenswrapper[2576]: I0608 13:49:28.126104 2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-marketplace/4258531154569488b4b06856545cf53ed48b82e88ddd64b4ce22efab06xb6vs"] Jun 08 13:49:28.134470 ip-10-0-140-46 kubenswrapper[2576]: I0608 13:49:28.134442 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/4258531154569488b4b06856545cf53ed48b82e88ddd64b4ce22efab06xb6vs" Jun 08 13:49:28.140403 ip-10-0-140-46 kubenswrapper[2576]: I0608 13:49:28.140375 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"openshift-service-ca.crt\"" Jun 08 13:49:28.141090 ip-10-0-140-46 kubenswrapper[2576]: I0608 13:49:28.141070 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-marketplace\"/\"default-dockercfg-csk2k\"" Jun 08 13:49:28.141168 ip-10-0-140-46 kubenswrapper[2576]: I0608 13:49:28.141088 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"kube-root-ca.crt\"" Jun 08 13:49:28.155187 ip-10-0-140-46 kubenswrapper[2576]: I0608 13:49:28.155151 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/4258531154569488b4b06856545cf53ed48b82e88ddd64b4ce22efab06xb6vs"] Jun 08 13:49:28.168559 ip-10-0-140-46 kubenswrapper[2576]: I0608 13:49:28.168520 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cx7sn_6e4b50fc-3e91-4f50-b92a-e90919788248/konnectivity-agent/0.log" limit=1024 Jun 08 13:49:28.312414 ip-10-0-140-46 kubenswrapper[2576]: I0608 13:49:28.312383 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cx7sn_6e4b50fc-3e91-4f50-b92a-e90919788248/konnectivity-agent/0.log" limit=1024 Jun 08 13:49:28.329502 ip-10-0-140-46 kubenswrapper[2576]: I0608 13:49:28.329458 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jb5l6\" (UniqueName: \"kubernetes.io/projected/09888b9b-f01e-4e44-a17e-464d5f7a3978-kube-api-access-jb5l6\") pod \"4258531154569488b4b06856545cf53ed48b82e88ddd64b4ce22efab06xb6vs\" (UID: \"09888b9b-f01e-4e44-a17e-464d5f7a3978\") " pod="openshift-marketplace/4258531154569488b4b06856545cf53ed48b82e88ddd64b4ce22efab06xb6vs" Jun 08 13:49:28.329681 ip-10-0-140-46 kubenswrapper[2576]: I0608 13:49:28.329535 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/09888b9b-f01e-4e44-a17e-464d5f7a3978-util\") pod \"4258531154569488b4b06856545cf53ed48b82e88ddd64b4ce22efab06xb6vs\" (UID: \"09888b9b-f01e-4e44-a17e-464d5f7a3978\") " pod="openshift-marketplace/4258531154569488b4b06856545cf53ed48b82e88ddd64b4ce22efab06xb6vs" Jun 08 13:49:28.329681 ip-10-0-140-46 kubenswrapper[2576]: I0608 13:49:28.329578 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/09888b9b-f01e-4e44-a17e-464d5f7a3978-bundle\") pod \"4258531154569488b4b06856545cf53ed48b82e88ddd64b4ce22efab06xb6vs\" (UID: \"09888b9b-f01e-4e44-a17e-464d5f7a3978\") " pod="openshift-marketplace/4258531154569488b4b06856545cf53ed48b82e88ddd64b4ce22efab06xb6vs" Jun 08 13:49:28.397138 ip-10-0-140-46 kubenswrapper[2576]: I0608 13:49:28.397051 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cx7sn_6e4b50fc-3e91-4f50-b92a-e90919788248/konnectivity-agent/0.log" limit=1024 Jun 08 13:49:28.430057 ip-10-0-140-46 kubenswrapper[2576]: I0608 13:49:28.430021 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jb5l6\" (UniqueName: \"kubernetes.io/projected/09888b9b-f01e-4e44-a17e-464d5f7a3978-kube-api-access-jb5l6\") pod \"4258531154569488b4b06856545cf53ed48b82e88ddd64b4ce22efab06xb6vs\" (UID: \"09888b9b-f01e-4e44-a17e-464d5f7a3978\") " pod="openshift-marketplace/4258531154569488b4b06856545cf53ed48b82e88ddd64b4ce22efab06xb6vs" Jun 08 13:49:28.430218 ip-10-0-140-46 kubenswrapper[2576]: I0608 13:49:28.430080 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/09888b9b-f01e-4e44-a17e-464d5f7a3978-util\") pod \"4258531154569488b4b06856545cf53ed48b82e88ddd64b4ce22efab06xb6vs\" (UID: \"09888b9b-f01e-4e44-a17e-464d5f7a3978\") " pod="openshift-marketplace/4258531154569488b4b06856545cf53ed48b82e88ddd64b4ce22efab06xb6vs" Jun 08 13:49:28.430218 ip-10-0-140-46 kubenswrapper[2576]: I0608 13:49:28.430106 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/09888b9b-f01e-4e44-a17e-464d5f7a3978-bundle\") pod \"4258531154569488b4b06856545cf53ed48b82e88ddd64b4ce22efab06xb6vs\" (UID: \"09888b9b-f01e-4e44-a17e-464d5f7a3978\") " pod="openshift-marketplace/4258531154569488b4b06856545cf53ed48b82e88ddd64b4ce22efab06xb6vs" Jun 08 13:49:28.430446 ip-10-0-140-46 kubenswrapper[2576]: I0608 13:49:28.430431 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/09888b9b-f01e-4e44-a17e-464d5f7a3978-bundle\") pod \"4258531154569488b4b06856545cf53ed48b82e88ddd64b4ce22efab06xb6vs\" (UID: \"09888b9b-f01e-4e44-a17e-464d5f7a3978\") " pod="openshift-marketplace/4258531154569488b4b06856545cf53ed48b82e88ddd64b4ce22efab06xb6vs" Jun 08 13:49:28.430485 ip-10-0-140-46 kubenswrapper[2576]: I0608 13:49:28.430470 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/09888b9b-f01e-4e44-a17e-464d5f7a3978-util\") pod \"4258531154569488b4b06856545cf53ed48b82e88ddd64b4ce22efab06xb6vs\" (UID: \"09888b9b-f01e-4e44-a17e-464d5f7a3978\") " pod="openshift-marketplace/4258531154569488b4b06856545cf53ed48b82e88ddd64b4ce22efab06xb6vs" Jun 08 13:49:28.441239 ip-10-0-140-46 kubenswrapper[2576]: I0608 13:49:28.441206 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-jb5l6\" (UniqueName: \"kubernetes.io/projected/09888b9b-f01e-4e44-a17e-464d5f7a3978-kube-api-access-jb5l6\") pod \"4258531154569488b4b06856545cf53ed48b82e88ddd64b4ce22efab06xb6vs\" (UID: \"09888b9b-f01e-4e44-a17e-464d5f7a3978\") " pod="openshift-marketplace/4258531154569488b4b06856545cf53ed48b82e88ddd64b4ce22efab06xb6vs" Jun 08 13:49:28.442963 ip-10-0-140-46 kubenswrapper[2576]: I0608 13:49:28.442945 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/4258531154569488b4b06856545cf53ed48b82e88ddd64b4ce22efab06xb6vs" Jun 08 13:49:28.488493 ip-10-0-140-46 kubenswrapper[2576]: I0608 13:49:28.488461 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cx7sn_6e4b50fc-3e91-4f50-b92a-e90919788248/konnectivity-agent/0.log" limit=1024 Jun 08 13:49:28.589611 ip-10-0-140-46 kubenswrapper[2576]: I0608 13:49:28.589551 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cx7sn_6e4b50fc-3e91-4f50-b92a-e90919788248/konnectivity-agent/0.log" limit=1024 Jun 08 13:49:28.589879 ip-10-0-140-46 kubenswrapper[2576]: I0608 13:49:28.589856 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/4258531154569488b4b06856545cf53ed48b82e88ddd64b4ce22efab06xb6vs"] Jun 08 13:49:28.593062 ip-10-0-140-46 kubenswrapper[2576]: W0608 13:49:28.593039 2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod09888b9b_f01e_4e44_a17e_464d5f7a3978.slice/crio-721fdfdbbfad32231fd45ca40ec8bfb67028236fd1adfa1ae9da988c7749240f WatchSource:0}: Error finding container 721fdfdbbfad32231fd45ca40ec8bfb67028236fd1adfa1ae9da988c7749240f: Status 404 returned error can't find the container with id 721fdfdbbfad32231fd45ca40ec8bfb67028236fd1adfa1ae9da988c7749240f Jun 08 13:49:28.874629 ip-10-0-140-46 kubenswrapper[2576]: I0608 13:49:28.874598 2576 generic.go:356] "Generic (PLEG): container finished" podID="09888b9b-f01e-4e44-a17e-464d5f7a3978" containerID="5f280b0567cd77f35df6643b46d6c2603846b9218a260167862b98d62277403d" exitCode=0 Jun 08 13:49:28.875035 ip-10-0-140-46 kubenswrapper[2576]: I0608 13:49:28.874717 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/4258531154569488b4b06856545cf53ed48b82e88ddd64b4ce22efab06xb6vs" event={"ID":"09888b9b-f01e-4e44-a17e-464d5f7a3978","Type":"ContainerDied","Data":"5f280b0567cd77f35df6643b46d6c2603846b9218a260167862b98d62277403d"} Jun 08 13:49:28.875035 ip-10-0-140-46 kubenswrapper[2576]: I0608 13:49:28.874753 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/4258531154569488b4b06856545cf53ed48b82e88ddd64b4ce22efab06xb6vs" event={"ID":"09888b9b-f01e-4e44-a17e-464d5f7a3978","Type":"ContainerStarted","Data":"721fdfdbbfad32231fd45ca40ec8bfb67028236fd1adfa1ae9da988c7749240f"} Jun 08 13:49:28.934748 ip-10-0-140-46 kubenswrapper[2576]: I0608 13:49:28.934662 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cx7sn_6e4b50fc-3e91-4f50-b92a-e90919788248/konnectivity-agent/0.log" limit=1024 Jun 08 13:49:29.176699 ip-10-0-140-46 kubenswrapper[2576]: I0608 13:49:29.176664 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cx7sn_6e4b50fc-3e91-4f50-b92a-e90919788248/konnectivity-agent/0.log" limit=1024 Jun 08 13:49:29.881133 ip-10-0-140-46 kubenswrapper[2576]: I0608 13:49:29.881097 2576 generic.go:356] "Generic (PLEG): container finished" podID="09888b9b-f01e-4e44-a17e-464d5f7a3978" containerID="f3b5da6744a545bc489e34a6fd586c2f46b504883d966c2fef92f66713aacc9d" exitCode=0 Jun 08 13:49:29.881529 ip-10-0-140-46 kubenswrapper[2576]: I0608 13:49:29.881159 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/4258531154569488b4b06856545cf53ed48b82e88ddd64b4ce22efab06xb6vs" event={"ID":"09888b9b-f01e-4e44-a17e-464d5f7a3978","Type":"ContainerDied","Data":"f3b5da6744a545bc489e34a6fd586c2f46b504883d966c2fef92f66713aacc9d"} Jun 08 13:49:30.887627 ip-10-0-140-46 kubenswrapper[2576]: I0608 13:49:30.887595 2576 generic.go:356] "Generic (PLEG): container finished" podID="09888b9b-f01e-4e44-a17e-464d5f7a3978" containerID="35cea626948f5ce626472976b64d828bf9ecb847bb32dcc771f790399e45ffa7" exitCode=0 Jun 08 13:49:30.888015 ip-10-0-140-46 kubenswrapper[2576]: I0608 13:49:30.887677 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/4258531154569488b4b06856545cf53ed48b82e88ddd64b4ce22efab06xb6vs" event={"ID":"09888b9b-f01e-4e44-a17e-464d5f7a3978","Type":"ContainerDied","Data":"35cea626948f5ce626472976b64d828bf9ecb847bb32dcc771f790399e45ffa7"} Jun 08 13:49:32.015725 ip-10-0-140-46 kubenswrapper[2576]: I0608 13:49:32.015701 2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/4258531154569488b4b06856545cf53ed48b82e88ddd64b4ce22efab06xb6vs" Jun 08 13:49:32.162141 ip-10-0-140-46 kubenswrapper[2576]: I0608 13:49:32.162109 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-jb5l6\" (UniqueName: \"kubernetes.io/projected/09888b9b-f01e-4e44-a17e-464d5f7a3978-kube-api-access-jb5l6\") pod \"09888b9b-f01e-4e44-a17e-464d5f7a3978\" (UID: \"09888b9b-f01e-4e44-a17e-464d5f7a3978\") " Jun 08 13:49:32.162299 ip-10-0-140-46 kubenswrapper[2576]: I0608 13:49:32.162173 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/09888b9b-f01e-4e44-a17e-464d5f7a3978-util\") pod \"09888b9b-f01e-4e44-a17e-464d5f7a3978\" (UID: \"09888b9b-f01e-4e44-a17e-464d5f7a3978\") " Jun 08 13:49:32.162299 ip-10-0-140-46 kubenswrapper[2576]: I0608 13:49:32.162240 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/09888b9b-f01e-4e44-a17e-464d5f7a3978-bundle\") pod \"09888b9b-f01e-4e44-a17e-464d5f7a3978\" (UID: \"09888b9b-f01e-4e44-a17e-464d5f7a3978\") " Jun 08 13:49:32.163065 ip-10-0-140-46 kubenswrapper[2576]: I0608 13:49:32.163035 2576 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/09888b9b-f01e-4e44-a17e-464d5f7a3978-bundle" (OuterVolumeSpecName: "bundle") pod "09888b9b-f01e-4e44-a17e-464d5f7a3978" (UID: "09888b9b-f01e-4e44-a17e-464d5f7a3978"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 08 13:49:32.164287 ip-10-0-140-46 kubenswrapper[2576]: I0608 13:49:32.164263 2576 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/09888b9b-f01e-4e44-a17e-464d5f7a3978-kube-api-access-jb5l6" (OuterVolumeSpecName: "kube-api-access-jb5l6") pod "09888b9b-f01e-4e44-a17e-464d5f7a3978" (UID: "09888b9b-f01e-4e44-a17e-464d5f7a3978"). InnerVolumeSpecName "kube-api-access-jb5l6". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 08 13:49:32.167538 ip-10-0-140-46 kubenswrapper[2576]: I0608 13:49:32.167516 2576 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/09888b9b-f01e-4e44-a17e-464d5f7a3978-util" (OuterVolumeSpecName: "util") pod "09888b9b-f01e-4e44-a17e-464d5f7a3978" (UID: "09888b9b-f01e-4e44-a17e-464d5f7a3978"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 08 13:49:32.262890 ip-10-0-140-46 kubenswrapper[2576]: I0608 13:49:32.262805 2576 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-jb5l6\" (UniqueName: \"kubernetes.io/projected/09888b9b-f01e-4e44-a17e-464d5f7a3978-kube-api-access-jb5l6\") on node \"ip-10-0-140-46.ec2.internal\" DevicePath \"\"" Jun 08 13:49:32.262890 ip-10-0-140-46 kubenswrapper[2576]: I0608 13:49:32.262834 2576 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/09888b9b-f01e-4e44-a17e-464d5f7a3978-util\") on node \"ip-10-0-140-46.ec2.internal\" DevicePath \"\"" Jun 08 13:49:32.262890 ip-10-0-140-46 kubenswrapper[2576]: I0608 13:49:32.262843 2576 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/09888b9b-f01e-4e44-a17e-464d5f7a3978-bundle\") on node \"ip-10-0-140-46.ec2.internal\" DevicePath \"\"" Jun 08 13:49:32.897915 ip-10-0-140-46 kubenswrapper[2576]: I0608 13:49:32.897884 2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/4258531154569488b4b06856545cf53ed48b82e88ddd64b4ce22efab06xb6vs" Jun 08 13:49:32.897915 ip-10-0-140-46 kubenswrapper[2576]: I0608 13:49:32.897905 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/4258531154569488b4b06856545cf53ed48b82e88ddd64b4ce22efab06xb6vs" event={"ID":"09888b9b-f01e-4e44-a17e-464d5f7a3978","Type":"ContainerDied","Data":"721fdfdbbfad32231fd45ca40ec8bfb67028236fd1adfa1ae9da988c7749240f"} Jun 08 13:49:32.898126 ip-10-0-140-46 kubenswrapper[2576]: I0608 13:49:32.897949 2576 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="721fdfdbbfad32231fd45ca40ec8bfb67028236fd1adfa1ae9da988c7749240f" Jun 08 13:49:39.235606 ip-10-0-140-46 kubenswrapper[2576]: I0608 13:49:39.235495 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cx7sn_6e4b50fc-3e91-4f50-b92a-e90919788248/konnectivity-agent/0.log" limit=1024 Jun 08 13:49:39.340763 ip-10-0-140-46 kubenswrapper[2576]: I0608 13:49:39.340711 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cx7sn_6e4b50fc-3e91-4f50-b92a-e90919788248/konnectivity-agent/0.log" limit=1024 Jun 08 13:49:39.449937 ip-10-0-140-46 kubenswrapper[2576]: I0608 13:49:39.449899 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cx7sn_6e4b50fc-3e91-4f50-b92a-e90919788248/konnectivity-agent/0.log" limit=1024 Jun 08 13:49:39.564388 ip-10-0-140-46 kubenswrapper[2576]: I0608 13:49:39.564357 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cx7sn_6e4b50fc-3e91-4f50-b92a-e90919788248/konnectivity-agent/0.log" limit=1024 Jun 08 13:49:39.753150 ip-10-0-140-46 kubenswrapper[2576]: I0608 13:49:39.753098 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cx7sn_6e4b50fc-3e91-4f50-b92a-e90919788248/konnectivity-agent/0.log" limit=1024 Jun 08 13:49:40.651057 ip-10-0-140-46 kubenswrapper[2576]: I0608 13:49:40.651016 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cx7sn_6e4b50fc-3e91-4f50-b92a-e90919788248/konnectivity-agent/0.log" limit=1024 Jun 08 13:49:40.852978 ip-10-0-140-46 kubenswrapper[2576]: I0608 13:49:40.852925 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cx7sn_6e4b50fc-3e91-4f50-b92a-e90919788248/konnectivity-agent/0.log" limit=1024 Jun 08 13:49:41.931513 ip-10-0-140-46 kubenswrapper[2576]: I0608 13:49:41.931479 2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762acg6l8"] Jun 08 13:49:41.931901 ip-10-0-140-46 kubenswrapper[2576]: I0608 13:49:41.931804 2576 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="09888b9b-f01e-4e44-a17e-464d5f7a3978" containerName="extract" Jun 08 13:49:41.931901 ip-10-0-140-46 kubenswrapper[2576]: I0608 13:49:41.931816 2576 state_mem.go:107] "Deleted CPUSet assignment" podUID="09888b9b-f01e-4e44-a17e-464d5f7a3978" containerName="extract" Jun 08 13:49:41.931901 ip-10-0-140-46 kubenswrapper[2576]: I0608 13:49:41.931830 2576 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="09888b9b-f01e-4e44-a17e-464d5f7a3978" containerName="util" Jun 08 13:49:41.931901 ip-10-0-140-46 kubenswrapper[2576]: I0608 13:49:41.931838 2576 state_mem.go:107] "Deleted CPUSet assignment" podUID="09888b9b-f01e-4e44-a17e-464d5f7a3978" containerName="util" Jun 08 13:49:41.931901 ip-10-0-140-46 kubenswrapper[2576]: I0608 13:49:41.931846 2576 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="09888b9b-f01e-4e44-a17e-464d5f7a3978" containerName="pull" Jun 08 13:49:41.931901 ip-10-0-140-46 kubenswrapper[2576]: I0608 13:49:41.931851 2576 state_mem.go:107] "Deleted CPUSet assignment" podUID="09888b9b-f01e-4e44-a17e-464d5f7a3978" containerName="pull" Jun 08 13:49:41.931901 ip-10-0-140-46 kubenswrapper[2576]: I0608 13:49:41.931902 2576 memory_manager.go:368] "RemoveStaleState removing state" podUID="09888b9b-f01e-4e44-a17e-464d5f7a3978" containerName="extract" Jun 08 13:49:41.936908 ip-10-0-140-46 kubenswrapper[2576]: I0608 13:49:41.936888 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762acg6l8" Jun 08 13:49:41.947984 ip-10-0-140-46 kubenswrapper[2576]: I0608 13:49:41.947962 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-marketplace\"/\"default-dockercfg-csk2k\"" Jun 08 13:49:41.948749 ip-10-0-140-46 kubenswrapper[2576]: I0608 13:49:41.948735 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"kube-root-ca.crt\"" Jun 08 13:49:41.948982 ip-10-0-140-46 kubenswrapper[2576]: I0608 13:49:41.948967 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"openshift-service-ca.crt\"" Jun 08 13:49:41.956120 ip-10-0-140-46 kubenswrapper[2576]: I0608 13:49:41.956092 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762acg6l8"] Jun 08 13:49:42.030729 ip-10-0-140-46 kubenswrapper[2576]: I0608 13:49:42.030689 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-x46bn\" (UniqueName: \"kubernetes.io/projected/47b1ebe3-9fe5-4883-89aa-27d0e0c3b494-kube-api-access-x46bn\") pod \"c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762acg6l8\" (UID: \"47b1ebe3-9fe5-4883-89aa-27d0e0c3b494\") " pod="openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762acg6l8" Jun 08 13:49:42.030929 ip-10-0-140-46 kubenswrapper[2576]: I0608 13:49:42.030751 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/47b1ebe3-9fe5-4883-89aa-27d0e0c3b494-bundle\") pod \"c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762acg6l8\" (UID: \"47b1ebe3-9fe5-4883-89aa-27d0e0c3b494\") " pod="openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762acg6l8" Jun 08 13:49:42.030929 ip-10-0-140-46 kubenswrapper[2576]: I0608 13:49:42.030776 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/47b1ebe3-9fe5-4883-89aa-27d0e0c3b494-util\") pod \"c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762acg6l8\" (UID: \"47b1ebe3-9fe5-4883-89aa-27d0e0c3b494\") " pod="openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762acg6l8" Jun 08 13:49:42.131627 ip-10-0-140-46 kubenswrapper[2576]: I0608 13:49:42.131587 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-x46bn\" (UniqueName: \"kubernetes.io/projected/47b1ebe3-9fe5-4883-89aa-27d0e0c3b494-kube-api-access-x46bn\") pod \"c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762acg6l8\" (UID: \"47b1ebe3-9fe5-4883-89aa-27d0e0c3b494\") " pod="openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762acg6l8" Jun 08 13:49:42.131807 ip-10-0-140-46 kubenswrapper[2576]: I0608 13:49:42.131652 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/47b1ebe3-9fe5-4883-89aa-27d0e0c3b494-bundle\") pod \"c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762acg6l8\" (UID: \"47b1ebe3-9fe5-4883-89aa-27d0e0c3b494\") " pod="openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762acg6l8" Jun 08 13:49:42.131807 ip-10-0-140-46 kubenswrapper[2576]: I0608 13:49:42.131676 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/47b1ebe3-9fe5-4883-89aa-27d0e0c3b494-util\") pod \"c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762acg6l8\" (UID: \"47b1ebe3-9fe5-4883-89aa-27d0e0c3b494\") " pod="openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762acg6l8" Jun 08 13:49:42.131995 ip-10-0-140-46 kubenswrapper[2576]: I0608 13:49:42.131980 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/47b1ebe3-9fe5-4883-89aa-27d0e0c3b494-util\") pod \"c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762acg6l8\" (UID: \"47b1ebe3-9fe5-4883-89aa-27d0e0c3b494\") " pod="openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762acg6l8" Jun 08 13:49:42.132035 ip-10-0-140-46 kubenswrapper[2576]: I0608 13:49:42.132010 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/47b1ebe3-9fe5-4883-89aa-27d0e0c3b494-bundle\") pod \"c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762acg6l8\" (UID: \"47b1ebe3-9fe5-4883-89aa-27d0e0c3b494\") " pod="openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762acg6l8" Jun 08 13:49:42.147369 ip-10-0-140-46 kubenswrapper[2576]: I0608 13:49:42.147322 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-x46bn\" (UniqueName: \"kubernetes.io/projected/47b1ebe3-9fe5-4883-89aa-27d0e0c3b494-kube-api-access-x46bn\") pod \"c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762acg6l8\" (UID: \"47b1ebe3-9fe5-4883-89aa-27d0e0c3b494\") " pod="openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762acg6l8" Jun 08 13:49:42.246249 ip-10-0-140-46 kubenswrapper[2576]: I0608 13:49:42.246155 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762acg6l8" Jun 08 13:49:42.490548 ip-10-0-140-46 kubenswrapper[2576]: I0608 13:49:42.490372 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762acg6l8"] Jun 08 13:49:42.493260 ip-10-0-140-46 kubenswrapper[2576]: W0608 13:49:42.493226 2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod47b1ebe3_9fe5_4883_89aa_27d0e0c3b494.slice/crio-27134190ad616c673e4ff20555bd7480a8f4e8f74b95dd5d70ac7b155a888b26 WatchSource:0}: Error finding container 27134190ad616c673e4ff20555bd7480a8f4e8f74b95dd5d70ac7b155a888b26: Status 404 returned error can't find the container with id 27134190ad616c673e4ff20555bd7480a8f4e8f74b95dd5d70ac7b155a888b26 Jun 08 13:49:42.621191 ip-10-0-140-46 kubenswrapper[2576]: I0608 13:49:42.621160 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cx7sn_6e4b50fc-3e91-4f50-b92a-e90919788248/konnectivity-agent/0.log" limit=1024 Jun 08 13:49:42.726240 ip-10-0-140-46 kubenswrapper[2576]: I0608 13:49:42.726202 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cx7sn_6e4b50fc-3e91-4f50-b92a-e90919788248/konnectivity-agent/0.log" limit=1024 Jun 08 13:49:42.828044 ip-10-0-140-46 kubenswrapper[2576]: I0608 13:49:42.828009 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cx7sn_6e4b50fc-3e91-4f50-b92a-e90919788248/konnectivity-agent/0.log" limit=1024 Jun 08 13:49:42.943218 ip-10-0-140-46 kubenswrapper[2576]: I0608 13:49:42.943181 2576 generic.go:356] "Generic (PLEG): container finished" podID="47b1ebe3-9fe5-4883-89aa-27d0e0c3b494" containerID="ca6c88f69b6ab4f4da67ba4964296d51bfd042abf6fc28e7ac3a8389c7e3f044" exitCode=0 Jun 08 13:49:42.943620 ip-10-0-140-46 kubenswrapper[2576]: I0608 13:49:42.943267 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762acg6l8" event={"ID":"47b1ebe3-9fe5-4883-89aa-27d0e0c3b494","Type":"ContainerDied","Data":"ca6c88f69b6ab4f4da67ba4964296d51bfd042abf6fc28e7ac3a8389c7e3f044"} Jun 08 13:49:42.943620 ip-10-0-140-46 kubenswrapper[2576]: I0608 13:49:42.943316 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762acg6l8" event={"ID":"47b1ebe3-9fe5-4883-89aa-27d0e0c3b494","Type":"ContainerStarted","Data":"27134190ad616c673e4ff20555bd7480a8f4e8f74b95dd5d70ac7b155a888b26"} Jun 08 13:49:42.958148 ip-10-0-140-46 kubenswrapper[2576]: I0608 13:49:42.958122 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cx7sn_6e4b50fc-3e91-4f50-b92a-e90919788248/konnectivity-agent/0.log" limit=1024 Jun 08 13:49:43.348946 ip-10-0-140-46 kubenswrapper[2576]: I0608 13:49:43.348916 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cx7sn_6e4b50fc-3e91-4f50-b92a-e90919788248/konnectivity-agent/0.log" limit=1024 Jun 08 13:49:43.619536 ip-10-0-140-46 kubenswrapper[2576]: I0608 13:49:43.619508 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cx7sn_6e4b50fc-3e91-4f50-b92a-e90919788248/konnectivity-agent/0.log" limit=1024 Jun 08 13:49:43.949856 ip-10-0-140-46 kubenswrapper[2576]: I0608 13:49:43.949770 2576 generic.go:356] "Generic (PLEG): container finished" podID="47b1ebe3-9fe5-4883-89aa-27d0e0c3b494" containerID="a37e051b222a26cdeb800a1609b8021a76a835fd0ed17affc5cc776b0f0f8c11" exitCode=0 Jun 08 13:49:43.950222 ip-10-0-140-46 kubenswrapper[2576]: I0608 13:49:43.949852 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762acg6l8" event={"ID":"47b1ebe3-9fe5-4883-89aa-27d0e0c3b494","Type":"ContainerDied","Data":"a37e051b222a26cdeb800a1609b8021a76a835fd0ed17affc5cc776b0f0f8c11"} Jun 08 13:49:44.955730 ip-10-0-140-46 kubenswrapper[2576]: I0608 13:49:44.955698 2576 generic.go:356] "Generic (PLEG): container finished" podID="47b1ebe3-9fe5-4883-89aa-27d0e0c3b494" containerID="1ce6ebe56ee1f53a9fc27abd1e848c7ab4b460ac09068301a32cde42f732798c" exitCode=0 Jun 08 13:49:44.956127 ip-10-0-140-46 kubenswrapper[2576]: I0608 13:49:44.955802 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762acg6l8" event={"ID":"47b1ebe3-9fe5-4883-89aa-27d0e0c3b494","Type":"ContainerDied","Data":"1ce6ebe56ee1f53a9fc27abd1e848c7ab4b460ac09068301a32cde42f732798c"} Jun 08 13:49:46.090403 ip-10-0-140-46 kubenswrapper[2576]: I0608 13:49:46.090376 2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762acg6l8" Jun 08 13:49:46.157423 ip-10-0-140-46 kubenswrapper[2576]: I0608 13:49:46.157393 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-x46bn\" (UniqueName: \"kubernetes.io/projected/47b1ebe3-9fe5-4883-89aa-27d0e0c3b494-kube-api-access-x46bn\") pod \"47b1ebe3-9fe5-4883-89aa-27d0e0c3b494\" (UID: \"47b1ebe3-9fe5-4883-89aa-27d0e0c3b494\") " Jun 08 13:49:46.157640 ip-10-0-140-46 kubenswrapper[2576]: I0608 13:49:46.157453 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/47b1ebe3-9fe5-4883-89aa-27d0e0c3b494-bundle\") pod \"47b1ebe3-9fe5-4883-89aa-27d0e0c3b494\" (UID: \"47b1ebe3-9fe5-4883-89aa-27d0e0c3b494\") " Jun 08 13:49:46.157640 ip-10-0-140-46 kubenswrapper[2576]: I0608 13:49:46.157505 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/47b1ebe3-9fe5-4883-89aa-27d0e0c3b494-util\") pod \"47b1ebe3-9fe5-4883-89aa-27d0e0c3b494\" (UID: \"47b1ebe3-9fe5-4883-89aa-27d0e0c3b494\") " Jun 08 13:49:46.158474 ip-10-0-140-46 kubenswrapper[2576]: I0608 13:49:46.158447 2576 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/47b1ebe3-9fe5-4883-89aa-27d0e0c3b494-bundle" (OuterVolumeSpecName: "bundle") pod "47b1ebe3-9fe5-4883-89aa-27d0e0c3b494" (UID: "47b1ebe3-9fe5-4883-89aa-27d0e0c3b494"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 08 13:49:46.159613 ip-10-0-140-46 kubenswrapper[2576]: I0608 13:49:46.159581 2576 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/47b1ebe3-9fe5-4883-89aa-27d0e0c3b494-kube-api-access-x46bn" (OuterVolumeSpecName: "kube-api-access-x46bn") pod "47b1ebe3-9fe5-4883-89aa-27d0e0c3b494" (UID: "47b1ebe3-9fe5-4883-89aa-27d0e0c3b494"). InnerVolumeSpecName "kube-api-access-x46bn". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 08 13:49:46.163072 ip-10-0-140-46 kubenswrapper[2576]: I0608 13:49:46.163042 2576 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/47b1ebe3-9fe5-4883-89aa-27d0e0c3b494-util" (OuterVolumeSpecName: "util") pod "47b1ebe3-9fe5-4883-89aa-27d0e0c3b494" (UID: "47b1ebe3-9fe5-4883-89aa-27d0e0c3b494"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 08 13:49:46.258706 ip-10-0-140-46 kubenswrapper[2576]: I0608 13:49:46.258627 2576 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-x46bn\" (UniqueName: \"kubernetes.io/projected/47b1ebe3-9fe5-4883-89aa-27d0e0c3b494-kube-api-access-x46bn\") on node \"ip-10-0-140-46.ec2.internal\" DevicePath \"\"" Jun 08 13:49:46.258706 ip-10-0-140-46 kubenswrapper[2576]: I0608 13:49:46.258655 2576 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/47b1ebe3-9fe5-4883-89aa-27d0e0c3b494-bundle\") on node \"ip-10-0-140-46.ec2.internal\" DevicePath \"\"" Jun 08 13:49:46.258706 ip-10-0-140-46 kubenswrapper[2576]: I0608 13:49:46.258665 2576 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/47b1ebe3-9fe5-4883-89aa-27d0e0c3b494-util\") on node \"ip-10-0-140-46.ec2.internal\" DevicePath \"\"" Jun 08 13:49:46.270088 ip-10-0-140-46 kubenswrapper[2576]: I0608 13:49:46.270053 2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/dashboard-redirect-6d99dc5989-xs8bt"] Jun 08 13:49:46.270400 ip-10-0-140-46 kubenswrapper[2576]: I0608 13:49:46.270387 2576 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="47b1ebe3-9fe5-4883-89aa-27d0e0c3b494" containerName="pull" Jun 08 13:49:46.270441 ip-10-0-140-46 kubenswrapper[2576]: I0608 13:49:46.270402 2576 state_mem.go:107] "Deleted CPUSet assignment" podUID="47b1ebe3-9fe5-4883-89aa-27d0e0c3b494" containerName="pull" Jun 08 13:49:46.270441 ip-10-0-140-46 kubenswrapper[2576]: I0608 13:49:46.270415 2576 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="47b1ebe3-9fe5-4883-89aa-27d0e0c3b494" containerName="extract" Jun 08 13:49:46.270441 ip-10-0-140-46 kubenswrapper[2576]: I0608 13:49:46.270421 2576 state_mem.go:107] "Deleted CPUSet assignment" podUID="47b1ebe3-9fe5-4883-89aa-27d0e0c3b494" containerName="extract" Jun 08 13:49:46.270529 ip-10-0-140-46 kubenswrapper[2576]: I0608 13:49:46.270441 2576 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="47b1ebe3-9fe5-4883-89aa-27d0e0c3b494" containerName="util" Jun 08 13:49:46.270529 ip-10-0-140-46 kubenswrapper[2576]: I0608 13:49:46.270450 2576 state_mem.go:107] "Deleted CPUSet assignment" podUID="47b1ebe3-9fe5-4883-89aa-27d0e0c3b494" containerName="util" Jun 08 13:49:46.270529 ip-10-0-140-46 kubenswrapper[2576]: I0608 13:49:46.270505 2576 memory_manager.go:368] "RemoveStaleState removing state" podUID="47b1ebe3-9fe5-4883-89aa-27d0e0c3b494" containerName="extract" Jun 08 13:49:46.273137 ip-10-0-140-46 kubenswrapper[2576]: I0608 13:49:46.273119 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/dashboard-redirect-6d99dc5989-xs8bt" Jun 08 13:49:46.277890 ip-10-0-140-46 kubenswrapper[2576]: I0608 13:49:46.277868 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"default-dockercfg-bc7fl\"" Jun 08 13:49:46.278546 ip-10-0-140-46 kubenswrapper[2576]: I0608 13:49:46.278528 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"dashboard-redirect-config\"" Jun 08 13:49:46.299639 ip-10-0-140-46 kubenswrapper[2576]: I0608 13:49:46.299610 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/dashboard-redirect-6d99dc5989-xs8bt"] Jun 08 13:49:46.301293 ip-10-0-140-46 kubenswrapper[2576]: I0608 13:49:46.301268 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cx7sn_6e4b50fc-3e91-4f50-b92a-e90919788248/konnectivity-agent/0.log" limit=1024 Jun 08 13:49:46.359125 ip-10-0-140-46 kubenswrapper[2576]: I0608 13:49:46.359085 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"redirect-config\" (UniqueName: \"kubernetes.io/configmap/74e496ab-540e-4396-a177-f6da7a61d474-redirect-config\") pod \"dashboard-redirect-6d99dc5989-xs8bt\" (UID: \"74e496ab-540e-4396-a177-f6da7a61d474\") " pod="opendatahub/dashboard-redirect-6d99dc5989-xs8bt" Jun 08 13:49:46.359295 ip-10-0-140-46 kubenswrapper[2576]: I0608 13:49:46.359148 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4t4wr\" (UniqueName: \"kubernetes.io/projected/74e496ab-540e-4396-a177-f6da7a61d474-kube-api-access-4t4wr\") pod \"dashboard-redirect-6d99dc5989-xs8bt\" (UID: \"74e496ab-540e-4396-a177-f6da7a61d474\") " pod="opendatahub/dashboard-redirect-6d99dc5989-xs8bt" Jun 08 13:49:46.459877 ip-10-0-140-46 kubenswrapper[2576]: I0608 13:49:46.459829 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"redirect-config\" (UniqueName: \"kubernetes.io/configmap/74e496ab-540e-4396-a177-f6da7a61d474-redirect-config\") pod \"dashboard-redirect-6d99dc5989-xs8bt\" (UID: \"74e496ab-540e-4396-a177-f6da7a61d474\") " pod="opendatahub/dashboard-redirect-6d99dc5989-xs8bt" Jun 08 13:49:46.460049 ip-10-0-140-46 kubenswrapper[2576]: I0608 13:49:46.459913 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4t4wr\" (UniqueName: \"kubernetes.io/projected/74e496ab-540e-4396-a177-f6da7a61d474-kube-api-access-4t4wr\") pod \"dashboard-redirect-6d99dc5989-xs8bt\" (UID: \"74e496ab-540e-4396-a177-f6da7a61d474\") " pod="opendatahub/dashboard-redirect-6d99dc5989-xs8bt" Jun 08 13:49:46.460603 ip-10-0-140-46 kubenswrapper[2576]: I0608 13:49:46.460585 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"redirect-config\" (UniqueName: \"kubernetes.io/configmap/74e496ab-540e-4396-a177-f6da7a61d474-redirect-config\") pod \"dashboard-redirect-6d99dc5989-xs8bt\" (UID: \"74e496ab-540e-4396-a177-f6da7a61d474\") " pod="opendatahub/dashboard-redirect-6d99dc5989-xs8bt" Jun 08 13:49:46.471832 ip-10-0-140-46 kubenswrapper[2576]: I0608 13:49:46.471805 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-4t4wr\" (UniqueName: \"kubernetes.io/projected/74e496ab-540e-4396-a177-f6da7a61d474-kube-api-access-4t4wr\") pod \"dashboard-redirect-6d99dc5989-xs8bt\" (UID: \"74e496ab-540e-4396-a177-f6da7a61d474\") " pod="opendatahub/dashboard-redirect-6d99dc5989-xs8bt" Jun 08 13:49:46.582828 ip-10-0-140-46 kubenswrapper[2576]: I0608 13:49:46.582793 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/dashboard-redirect-6d99dc5989-xs8bt" Jun 08 13:49:46.723814 ip-10-0-140-46 kubenswrapper[2576]: I0608 13:49:46.723787 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/dashboard-redirect-6d99dc5989-xs8bt"] Jun 08 13:49:46.724907 ip-10-0-140-46 kubenswrapper[2576]: W0608 13:49:46.724883 2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod74e496ab_540e_4396_a177_f6da7a61d474.slice/crio-c85c463affb5fcdcc69f1e4e0a0fb5d90a4e9efb28b17df89da4502d287bda1f WatchSource:0}: Error finding container c85c463affb5fcdcc69f1e4e0a0fb5d90a4e9efb28b17df89da4502d287bda1f: Status 404 returned error can't find the container with id c85c463affb5fcdcc69f1e4e0a0fb5d90a4e9efb28b17df89da4502d287bda1f Jun 08 13:49:46.971920 ip-10-0-140-46 kubenswrapper[2576]: I0608 13:49:46.971814 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/dashboard-redirect-6d99dc5989-xs8bt" event={"ID":"74e496ab-540e-4396-a177-f6da7a61d474","Type":"ContainerStarted","Data":"c85c463affb5fcdcc69f1e4e0a0fb5d90a4e9efb28b17df89da4502d287bda1f"} Jun 08 13:49:46.973610 ip-10-0-140-46 kubenswrapper[2576]: I0608 13:49:46.973582 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762acg6l8" event={"ID":"47b1ebe3-9fe5-4883-89aa-27d0e0c3b494","Type":"ContainerDied","Data":"27134190ad616c673e4ff20555bd7480a8f4e8f74b95dd5d70ac7b155a888b26"} Jun 08 13:49:46.973737 ip-10-0-140-46 kubenswrapper[2576]: I0608 13:49:46.973626 2576 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="27134190ad616c673e4ff20555bd7480a8f4e8f74b95dd5d70ac7b155a888b26" Jun 08 13:49:46.973737 ip-10-0-140-46 kubenswrapper[2576]: I0608 13:49:46.973627 2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762acg6l8" Jun 08 13:49:48.985655 ip-10-0-140-46 kubenswrapper[2576]: I0608 13:49:48.985548 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/dashboard-redirect-6d99dc5989-xs8bt" event={"ID":"74e496ab-540e-4396-a177-f6da7a61d474","Type":"ContainerStarted","Data":"a97a8c2c81166f9122a2da7d55c688f6946a4b9254c0d77f3ed0a59e04a746ff"} Jun 08 13:49:49.009213 ip-10-0-140-46 kubenswrapper[2576]: I0608 13:49:49.009158 2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/dashboard-redirect-6d99dc5989-xs8bt" podStartSLOduration=1.054319856 podStartE2EDuration="3.009139841s" totalImagesPullingTime="1.954819985s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-08 13:49:46 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-08 13:49:49.006804353 +0000 UTC m=+357.086133235" watchObservedRunningTime="2026-06-08 13:49:49.009139841 +0000 UTC m=+357.088468732" Jun 08 13:49:53.961208 ip-10-0-140-46 kubenswrapper[2576]: I0608 13:49:53.961167 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cx7sn_6e4b50fc-3e91-4f50-b92a-e90919788248/konnectivity-agent/0.log" limit=1024 Jun 08 13:49:54.062088 ip-10-0-140-46 kubenswrapper[2576]: I0608 13:49:54.062051 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cx7sn_6e4b50fc-3e91-4f50-b92a-e90919788248/konnectivity-agent/0.log" limit=1024 Jun 08 13:49:58.331501 ip-10-0-140-46 kubenswrapper[2576]: I0608 13:49:58.331470 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cx7sn_6e4b50fc-3e91-4f50-b92a-e90919788248/konnectivity-agent/0.log" limit=1024 Jun 08 13:49:58.453084 ip-10-0-140-46 kubenswrapper[2576]: I0608 13:49:58.453035 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cx7sn_6e4b50fc-3e91-4f50-b92a-e90919788248/konnectivity-agent/0.log" limit=1024 Jun 08 13:49:58.966995 ip-10-0-140-46 kubenswrapper[2576]: I0608 13:49:58.966951 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cx7sn_6e4b50fc-3e91-4f50-b92a-e90919788248/konnectivity-agent/0.log" limit=1024 Jun 08 13:50:02.649209 ip-10-0-140-46 kubenswrapper[2576]: I0608 13:50:02.649169 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cx7sn_6e4b50fc-3e91-4f50-b92a-e90919788248/konnectivity-agent/0.log" limit=1024 Jun 08 13:50:02.789949 ip-10-0-140-46 kubenswrapper[2576]: I0608 13:50:02.789908 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cx7sn_6e4b50fc-3e91-4f50-b92a-e90919788248/konnectivity-agent/0.log" limit=1024 Jun 08 13:50:03.264315 ip-10-0-140-46 kubenswrapper[2576]: I0608 13:50:03.264278 2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/data-science-gateway-data-science-gateway-class-5b556588bc7dzbz"] Jun 08 13:50:03.268963 ip-10-0-140-46 kubenswrapper[2576]: I0608 13:50:03.268939 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-5b556588bc7dzbz" Jun 08 13:50:03.271716 ip-10-0-140-46 kubenswrapper[2576]: I0608 13:50:03.271693 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-service-ca.crt\"" Jun 08 13:50:03.271804 ip-10-0-140-46 kubenswrapper[2576]: I0608 13:50:03.271736 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-gw-ca-root-cert\"" Jun 08 13:50:03.272002 ip-10-0-140-46 kubenswrapper[2576]: I0608 13:50:03.271987 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"kube-root-ca.crt\"" Jun 08 13:50:03.272304 ip-10-0-140-46 kubenswrapper[2576]: I0608 13:50:03.272289 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"data-science-gateway-data-science-gateway-class-dockercfg-cdkh4\"" Jun 08 13:50:03.282941 ip-10-0-140-46 kubenswrapper[2576]: I0608 13:50:03.282918 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/1f2c8d2c-21ff-4629-a7cc-9adec5629613-istio-envoy\") pod \"data-science-gateway-data-science-gateway-class-5b556588bc7dzbz\" (UID: \"1f2c8d2c-21ff-4629-a7cc-9adec5629613\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-5b556588bc7dzbz" Jun 08 13:50:03.283044 ip-10-0-140-46 kubenswrapper[2576]: I0608 13:50:03.282978 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/1f2c8d2c-21ff-4629-a7cc-9adec5629613-istio-token\") pod \"data-science-gateway-data-science-gateway-class-5b556588bc7dzbz\" (UID: \"1f2c8d2c-21ff-4629-a7cc-9adec5629613\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-5b556588bc7dzbz" Jun 08 13:50:03.283044 ip-10-0-140-46 kubenswrapper[2576]: I0608 13:50:03.283020 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-bflzc\" (UniqueName: \"kubernetes.io/projected/1f2c8d2c-21ff-4629-a7cc-9adec5629613-kube-api-access-bflzc\") pod \"data-science-gateway-data-science-gateway-class-5b556588bc7dzbz\" (UID: \"1f2c8d2c-21ff-4629-a7cc-9adec5629613\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-5b556588bc7dzbz" Jun 08 13:50:03.283163 ip-10-0-140-46 kubenswrapper[2576]: I0608 13:50:03.283046 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/1f2c8d2c-21ff-4629-a7cc-9adec5629613-workload-socket\") pod \"data-science-gateway-data-science-gateway-class-5b556588bc7dzbz\" (UID: \"1f2c8d2c-21ff-4629-a7cc-9adec5629613\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-5b556588bc7dzbz" Jun 08 13:50:03.283163 ip-10-0-140-46 kubenswrapper[2576]: I0608 13:50:03.283064 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/1f2c8d2c-21ff-4629-a7cc-9adec5629613-workload-certs\") pod \"data-science-gateway-data-science-gateway-class-5b556588bc7dzbz\" (UID: \"1f2c8d2c-21ff-4629-a7cc-9adec5629613\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-5b556588bc7dzbz" Jun 08 13:50:03.283163 ip-10-0-140-46 kubenswrapper[2576]: I0608 13:50:03.283116 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/1f2c8d2c-21ff-4629-a7cc-9adec5629613-credential-socket\") pod \"data-science-gateway-data-science-gateway-class-5b556588bc7dzbz\" (UID: \"1f2c8d2c-21ff-4629-a7cc-9adec5629613\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-5b556588bc7dzbz" Jun 08 13:50:03.283313 ip-10-0-140-46 kubenswrapper[2576]: I0608 13:50:03.283199 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/1f2c8d2c-21ff-4629-a7cc-9adec5629613-istio-data\") pod \"data-science-gateway-data-science-gateway-class-5b556588bc7dzbz\" (UID: \"1f2c8d2c-21ff-4629-a7cc-9adec5629613\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-5b556588bc7dzbz" Jun 08 13:50:03.283313 ip-10-0-140-46 kubenswrapper[2576]: I0608 13:50:03.283234 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/1f2c8d2c-21ff-4629-a7cc-9adec5629613-istio-podinfo\") pod \"data-science-gateway-data-science-gateway-class-5b556588bc7dzbz\" (UID: \"1f2c8d2c-21ff-4629-a7cc-9adec5629613\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-5b556588bc7dzbz" Jun 08 13:50:03.283313 ip-10-0-140-46 kubenswrapper[2576]: I0608 13:50:03.283265 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/1f2c8d2c-21ff-4629-a7cc-9adec5629613-istiod-ca-cert\") pod \"data-science-gateway-data-science-gateway-class-5b556588bc7dzbz\" (UID: \"1f2c8d2c-21ff-4629-a7cc-9adec5629613\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-5b556588bc7dzbz" Jun 08 13:50:03.308081 ip-10-0-140-46 kubenswrapper[2576]: I0608 13:50:03.308046 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/data-science-gateway-data-science-gateway-class-5b556588bc7dzbz"] Jun 08 13:50:03.349476 ip-10-0-140-46 kubenswrapper[2576]: I0608 13:50:03.349439 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cx7sn_6e4b50fc-3e91-4f50-b92a-e90919788248/konnectivity-agent/0.log" limit=1024 Jun 08 13:50:03.383711 ip-10-0-140-46 kubenswrapper[2576]: I0608 13:50:03.383663 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/1f2c8d2c-21ff-4629-a7cc-9adec5629613-istio-data\") pod \"data-science-gateway-data-science-gateway-class-5b556588bc7dzbz\" (UID: \"1f2c8d2c-21ff-4629-a7cc-9adec5629613\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-5b556588bc7dzbz" Jun 08 13:50:03.383921 ip-10-0-140-46 kubenswrapper[2576]: I0608 13:50:03.383718 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/1f2c8d2c-21ff-4629-a7cc-9adec5629613-istio-podinfo\") pod \"data-science-gateway-data-science-gateway-class-5b556588bc7dzbz\" (UID: \"1f2c8d2c-21ff-4629-a7cc-9adec5629613\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-5b556588bc7dzbz" Jun 08 13:50:03.383921 ip-10-0-140-46 kubenswrapper[2576]: I0608 13:50:03.383758 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/1f2c8d2c-21ff-4629-a7cc-9adec5629613-istiod-ca-cert\") pod \"data-science-gateway-data-science-gateway-class-5b556588bc7dzbz\" (UID: \"1f2c8d2c-21ff-4629-a7cc-9adec5629613\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-5b556588bc7dzbz" Jun 08 13:50:03.383921 ip-10-0-140-46 kubenswrapper[2576]: I0608 13:50:03.383802 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/1f2c8d2c-21ff-4629-a7cc-9adec5629613-istio-envoy\") pod \"data-science-gateway-data-science-gateway-class-5b556588bc7dzbz\" (UID: \"1f2c8d2c-21ff-4629-a7cc-9adec5629613\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-5b556588bc7dzbz" Jun 08 13:50:03.383921 ip-10-0-140-46 kubenswrapper[2576]: I0608 13:50:03.383831 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/1f2c8d2c-21ff-4629-a7cc-9adec5629613-istio-token\") pod \"data-science-gateway-data-science-gateway-class-5b556588bc7dzbz\" (UID: \"1f2c8d2c-21ff-4629-a7cc-9adec5629613\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-5b556588bc7dzbz" Jun 08 13:50:03.383921 ip-10-0-140-46 kubenswrapper[2576]: I0608 13:50:03.383862 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-bflzc\" (UniqueName: \"kubernetes.io/projected/1f2c8d2c-21ff-4629-a7cc-9adec5629613-kube-api-access-bflzc\") pod \"data-science-gateway-data-science-gateway-class-5b556588bc7dzbz\" (UID: \"1f2c8d2c-21ff-4629-a7cc-9adec5629613\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-5b556588bc7dzbz" Jun 08 13:50:03.383921 ip-10-0-140-46 kubenswrapper[2576]: I0608 13:50:03.383898 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/1f2c8d2c-21ff-4629-a7cc-9adec5629613-workload-socket\") pod \"data-science-gateway-data-science-gateway-class-5b556588bc7dzbz\" (UID: \"1f2c8d2c-21ff-4629-a7cc-9adec5629613\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-5b556588bc7dzbz" Jun 08 13:50:03.384250 ip-10-0-140-46 kubenswrapper[2576]: I0608 13:50:03.383923 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/1f2c8d2c-21ff-4629-a7cc-9adec5629613-workload-certs\") pod \"data-science-gateway-data-science-gateway-class-5b556588bc7dzbz\" (UID: \"1f2c8d2c-21ff-4629-a7cc-9adec5629613\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-5b556588bc7dzbz" Jun 08 13:50:03.384250 ip-10-0-140-46 kubenswrapper[2576]: I0608 13:50:03.383949 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/1f2c8d2c-21ff-4629-a7cc-9adec5629613-credential-socket\") pod \"data-science-gateway-data-science-gateway-class-5b556588bc7dzbz\" (UID: \"1f2c8d2c-21ff-4629-a7cc-9adec5629613\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-5b556588bc7dzbz" Jun 08 13:50:03.384250 ip-10-0-140-46 kubenswrapper[2576]: I0608 13:50:03.384140 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/1f2c8d2c-21ff-4629-a7cc-9adec5629613-istio-data\") pod \"data-science-gateway-data-science-gateway-class-5b556588bc7dzbz\" (UID: \"1f2c8d2c-21ff-4629-a7cc-9adec5629613\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-5b556588bc7dzbz" Jun 08 13:50:03.384400 ip-10-0-140-46 kubenswrapper[2576]: I0608 13:50:03.384301 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/1f2c8d2c-21ff-4629-a7cc-9adec5629613-credential-socket\") pod \"data-science-gateway-data-science-gateway-class-5b556588bc7dzbz\" (UID: \"1f2c8d2c-21ff-4629-a7cc-9adec5629613\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-5b556588bc7dzbz" Jun 08 13:50:03.384510 ip-10-0-140-46 kubenswrapper[2576]: I0608 13:50:03.384465 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/1f2c8d2c-21ff-4629-a7cc-9adec5629613-workload-socket\") pod \"data-science-gateway-data-science-gateway-class-5b556588bc7dzbz\" (UID: \"1f2c8d2c-21ff-4629-a7cc-9adec5629613\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-5b556588bc7dzbz" Jun 08 13:50:03.384608 ip-10-0-140-46 kubenswrapper[2576]: I0608 13:50:03.384536 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/1f2c8d2c-21ff-4629-a7cc-9adec5629613-istiod-ca-cert\") pod \"data-science-gateway-data-science-gateway-class-5b556588bc7dzbz\" (UID: \"1f2c8d2c-21ff-4629-a7cc-9adec5629613\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-5b556588bc7dzbz" Jun 08 13:50:03.384728 ip-10-0-140-46 kubenswrapper[2576]: I0608 13:50:03.384704 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/1f2c8d2c-21ff-4629-a7cc-9adec5629613-workload-certs\") pod \"data-science-gateway-data-science-gateway-class-5b556588bc7dzbz\" (UID: \"1f2c8d2c-21ff-4629-a7cc-9adec5629613\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-5b556588bc7dzbz" Jun 08 13:50:03.386256 ip-10-0-140-46 kubenswrapper[2576]: I0608 13:50:03.386237 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/1f2c8d2c-21ff-4629-a7cc-9adec5629613-istio-envoy\") pod \"data-science-gateway-data-science-gateway-class-5b556588bc7dzbz\" (UID: \"1f2c8d2c-21ff-4629-a7cc-9adec5629613\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-5b556588bc7dzbz" Jun 08 13:50:03.386344 ip-10-0-140-46 kubenswrapper[2576]: I0608 13:50:03.386332 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/1f2c8d2c-21ff-4629-a7cc-9adec5629613-istio-podinfo\") pod \"data-science-gateway-data-science-gateway-class-5b556588bc7dzbz\" (UID: \"1f2c8d2c-21ff-4629-a7cc-9adec5629613\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-5b556588bc7dzbz" Jun 08 13:50:03.433701 ip-10-0-140-46 kubenswrapper[2576]: I0608 13:50:03.433667 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/1f2c8d2c-21ff-4629-a7cc-9adec5629613-istio-token\") pod \"data-science-gateway-data-science-gateway-class-5b556588bc7dzbz\" (UID: \"1f2c8d2c-21ff-4629-a7cc-9adec5629613\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-5b556588bc7dzbz" Jun 08 13:50:03.446968 ip-10-0-140-46 kubenswrapper[2576]: I0608 13:50:03.446939 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-bflzc\" (UniqueName: \"kubernetes.io/projected/1f2c8d2c-21ff-4629-a7cc-9adec5629613-kube-api-access-bflzc\") pod \"data-science-gateway-data-science-gateway-class-5b556588bc7dzbz\" (UID: \"1f2c8d2c-21ff-4629-a7cc-9adec5629613\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-5b556588bc7dzbz" Jun 08 13:50:03.535218 ip-10-0-140-46 kubenswrapper[2576]: I0608 13:50:03.535188 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cx7sn_6e4b50fc-3e91-4f50-b92a-e90919788248/konnectivity-agent/0.log" limit=1024 Jun 08 13:50:03.579450 ip-10-0-140-46 kubenswrapper[2576]: I0608 13:50:03.579410 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-5b556588bc7dzbz" Jun 08 13:50:03.764694 ip-10-0-140-46 kubenswrapper[2576]: I0608 13:50:03.764665 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/data-science-gateway-data-science-gateway-class-5b556588bc7dzbz"] Jun 08 13:50:03.767172 ip-10-0-140-46 kubenswrapper[2576]: W0608 13:50:03.767143 2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1f2c8d2c_21ff_4629_a7cc_9adec5629613.slice/crio-7995383aba43f23232c88529c264002a9dfe72dd4896f2e93aa5ea95660504c7 WatchSource:0}: Error finding container 7995383aba43f23232c88529c264002a9dfe72dd4896f2e93aa5ea95660504c7: Status 404 returned error can't find the container with id 7995383aba43f23232c88529c264002a9dfe72dd4896f2e93aa5ea95660504c7 Jun 08 13:50:03.836813 ip-10-0-140-46 kubenswrapper[2576]: I0608 13:50:03.836728 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cx7sn_6e4b50fc-3e91-4f50-b92a-e90919788248/konnectivity-agent/0.log" limit=1024 Jun 08 13:50:04.053230 ip-10-0-140-46 kubenswrapper[2576]: I0608 13:50:04.053196 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-5b556588bc7dzbz" event={"ID":"1f2c8d2c-21ff-4629-a7cc-9adec5629613","Type":"ContainerStarted","Data":"7995383aba43f23232c88529c264002a9dfe72dd4896f2e93aa5ea95660504c7"} Jun 08 13:50:07.005866 ip-10-0-140-46 kubenswrapper[2576]: I0608 13:50:07.005820 2576 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"} Jun 08 13:50:07.006243 ip-10-0-140-46 kubenswrapper[2576]: I0608 13:50:07.005901 2576 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"} Jun 08 13:50:07.006243 ip-10-0-140-46 kubenswrapper[2576]: I0608 13:50:07.005932 2576 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"} Jun 08 13:50:07.073541 ip-10-0-140-46 kubenswrapper[2576]: I0608 13:50:07.073512 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-5b556588bc7dzbz" event={"ID":"1f2c8d2c-21ff-4629-a7cc-9adec5629613","Type":"ContainerStarted","Data":"026eedbded803add05bf2d1adfd5424f382720e0fb44ecad1d1a596ba3d3638d"} Jun 08 13:50:07.103406 ip-10-0-140-46 kubenswrapper[2576]: I0608 13:50:07.103343 2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-5b556588bc7dzbz" podStartSLOduration=0.867056534 podStartE2EDuration="4.103319994s" totalImagesPullingTime="3.23626346s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-08 13:50:03 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-08 13:50:07.101965112 +0000 UTC m=+375.181294004" watchObservedRunningTime="2026-06-08 13:50:07.103319994 +0000 UTC m=+375.182648888" Jun 08 13:50:07.224458 ip-10-0-140-46 kubenswrapper[2576]: I0608 13:50:07.224420 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cx7sn_6e4b50fc-3e91-4f50-b92a-e90919788248/konnectivity-agent/0.log" limit=1024 Jun 08 13:50:07.580250 ip-10-0-140-46 kubenswrapper[2576]: I0608 13:50:07.580207 2576 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-5b556588bc7dzbz" Jun 08 13:50:08.585067 ip-10-0-140-46 kubenswrapper[2576]: I0608 13:50:08.585034 2576 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-5b556588bc7dzbz" Jun 08 13:50:09.082362 ip-10-0-140-46 kubenswrapper[2576]: I0608 13:50:09.082327 2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-5b556588bc7dzbz" Jun 08 13:50:09.083458 ip-10-0-140-46 kubenswrapper[2576]: I0608 13:50:09.083421 2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-5b556588bc7dzbz" Jun 08 13:50:26.012386 ip-10-0-140-46 kubenswrapper[2576]: I0608 13:50:26.012351 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cx7sn_6e4b50fc-3e91-4f50-b92a-e90919788248/konnectivity-agent/0.log" limit=1024 Jun 08 13:50:26.117304 ip-10-0-140-46 kubenswrapper[2576]: I0608 13:50:26.117266 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cx7sn_6e4b50fc-3e91-4f50-b92a-e90919788248/konnectivity-agent/0.log" limit=1024 Jun 08 13:50:26.164837 ip-10-0-140-46 kubenswrapper[2576]: I0608 13:50:26.164801 2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-zgmbg"] Jun 08 13:50:26.176838 ip-10-0-140-46 kubenswrapper[2576]: I0608 13:50:26.176810 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-catalog-zgmbg" Jun 08 13:50:26.182293 ip-10-0-140-46 kubenswrapper[2576]: I0608 13:50:26.182264 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"kube-root-ca.crt\"" Jun 08 13:50:26.183445 ip-10-0-140-46 kubenswrapper[2576]: I0608 13:50:26.183413 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"kuadrant-operator-catalog-dockercfg-5nn2f\"" Jun 08 13:50:26.183750 ip-10-0-140-46 kubenswrapper[2576]: I0608 13:50:26.183725 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"openshift-service-ca.crt\"" Jun 08 13:50:26.184140 ip-10-0-140-46 kubenswrapper[2576]: I0608 13:50:26.184106 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-zgmbg"] Jun 08 13:50:26.213909 ip-10-0-140-46 kubenswrapper[2576]: I0608 13:50:26.213877 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cx7sn_6e4b50fc-3e91-4f50-b92a-e90919788248/konnectivity-agent/0.log" limit=1024 Jun 08 13:50:26.290132 ip-10-0-140-46 kubenswrapper[2576]: I0608 13:50:26.290099 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qhwnm\" (UniqueName: \"kubernetes.io/projected/925b3198-6148-44ff-86b4-30cc3894a973-kube-api-access-qhwnm\") pod \"kuadrant-operator-catalog-zgmbg\" (UID: \"925b3198-6148-44ff-86b4-30cc3894a973\") " pod="kuadrant-system/kuadrant-operator-catalog-zgmbg" Jun 08 13:50:26.391166 ip-10-0-140-46 kubenswrapper[2576]: I0608 13:50:26.391129 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qhwnm\" (UniqueName: \"kubernetes.io/projected/925b3198-6148-44ff-86b4-30cc3894a973-kube-api-access-qhwnm\") pod \"kuadrant-operator-catalog-zgmbg\" (UID: \"925b3198-6148-44ff-86b4-30cc3894a973\") " pod="kuadrant-system/kuadrant-operator-catalog-zgmbg" Jun 08 13:50:26.402740 ip-10-0-140-46 kubenswrapper[2576]: I0608 13:50:26.402712 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-qhwnm\" (UniqueName: \"kubernetes.io/projected/925b3198-6148-44ff-86b4-30cc3894a973-kube-api-access-qhwnm\") pod \"kuadrant-operator-catalog-zgmbg\" (UID: \"925b3198-6148-44ff-86b4-30cc3894a973\") " pod="kuadrant-system/kuadrant-operator-catalog-zgmbg" Jun 08 13:50:26.488002 ip-10-0-140-46 kubenswrapper[2576]: I0608 13:50:26.487949 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-catalog-zgmbg" Jun 08 13:50:26.529502 ip-10-0-140-46 kubenswrapper[2576]: I0608 13:50:26.529458 2576 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-zgmbg"] Jun 08 13:50:26.645518 ip-10-0-140-46 kubenswrapper[2576]: I0608 13:50:26.645486 2576 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-zgmbg"] Jun 08 13:50:26.649330 ip-10-0-140-46 kubenswrapper[2576]: W0608 13:50:26.649301 2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod925b3198_6148_44ff_86b4_30cc3894a973.slice/crio-c8ca942167b8177f8a0752debb405e11f4ade0f491116e5f8c32e4e41080e890 WatchSource:0}: Error finding container c8ca942167b8177f8a0752debb405e11f4ade0f491116e5f8c32e4e41080e890: Status 404 returned error can't find the container with id c8ca942167b8177f8a0752debb405e11f4ade0f491116e5f8c32e4e41080e890 Jun 08 13:50:26.730395 ip-10-0-140-46 kubenswrapper[2576]: I0608 13:50:26.730356 2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-dsfh9"] Jun 08 13:50:26.734991 ip-10-0-140-46 kubenswrapper[2576]: I0608 13:50:26.734973 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-catalog-dsfh9" Jun 08 13:50:26.744981 ip-10-0-140-46 kubenswrapper[2576]: I0608 13:50:26.744954 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-dsfh9"] Jun 08 13:50:26.895833 ip-10-0-140-46 kubenswrapper[2576]: I0608 13:50:26.895741 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ljws8\" (UniqueName: \"kubernetes.io/projected/064b68f2-2d20-4e42-ab86-ec679227eacc-kube-api-access-ljws8\") pod \"kuadrant-operator-catalog-dsfh9\" (UID: \"064b68f2-2d20-4e42-ab86-ec679227eacc\") " pod="kuadrant-system/kuadrant-operator-catalog-dsfh9" Jun 08 13:50:26.951268 ip-10-0-140-46 kubenswrapper[2576]: I0608 13:50:26.951236 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cx7sn_6e4b50fc-3e91-4f50-b92a-e90919788248/konnectivity-agent/0.log" limit=1024 Jun 08 13:50:26.996450 ip-10-0-140-46 kubenswrapper[2576]: I0608 13:50:26.996421 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ljws8\" (UniqueName: \"kubernetes.io/projected/064b68f2-2d20-4e42-ab86-ec679227eacc-kube-api-access-ljws8\") pod \"kuadrant-operator-catalog-dsfh9\" (UID: \"064b68f2-2d20-4e42-ab86-ec679227eacc\") " pod="kuadrant-system/kuadrant-operator-catalog-dsfh9" Jun 08 13:50:27.006685 ip-10-0-140-46 kubenswrapper[2576]: I0608 13:50:27.006661 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-ljws8\" (UniqueName: \"kubernetes.io/projected/064b68f2-2d20-4e42-ab86-ec679227eacc-kube-api-access-ljws8\") pod \"kuadrant-operator-catalog-dsfh9\" (UID: \"064b68f2-2d20-4e42-ab86-ec679227eacc\") " pod="kuadrant-system/kuadrant-operator-catalog-dsfh9" Jun 08 13:50:27.044732 ip-10-0-140-46 kubenswrapper[2576]: I0608 13:50:27.044700 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-catalog-dsfh9" Jun 08 13:50:27.157408 ip-10-0-140-46 kubenswrapper[2576]: I0608 13:50:27.157340 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cx7sn_6e4b50fc-3e91-4f50-b92a-e90919788248/konnectivity-agent/0.log" limit=1024 Jun 08 13:50:27.165411 ip-10-0-140-46 kubenswrapper[2576]: I0608 13:50:27.165370 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-catalog-zgmbg" event={"ID":"925b3198-6148-44ff-86b4-30cc3894a973","Type":"ContainerStarted","Data":"c8ca942167b8177f8a0752debb405e11f4ade0f491116e5f8c32e4e41080e890"} Jun 08 13:50:27.205788 ip-10-0-140-46 kubenswrapper[2576]: I0608 13:50:27.205764 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-dsfh9"] Jun 08 13:50:27.213998 ip-10-0-140-46 kubenswrapper[2576]: W0608 13:50:27.213969 2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod064b68f2_2d20_4e42_ab86_ec679227eacc.slice/crio-fd815103b5841a65b3dc135c493504bf300eddba850fd66f0555baa136bbe625 WatchSource:0}: Error finding container fd815103b5841a65b3dc135c493504bf300eddba850fd66f0555baa136bbe625: Status 404 returned error can't find the container with id fd815103b5841a65b3dc135c493504bf300eddba850fd66f0555baa136bbe625 Jun 08 13:50:28.172402 ip-10-0-140-46 kubenswrapper[2576]: I0608 13:50:28.172361 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-catalog-dsfh9" event={"ID":"064b68f2-2d20-4e42-ab86-ec679227eacc","Type":"ContainerStarted","Data":"fd815103b5841a65b3dc135c493504bf300eddba850fd66f0555baa136bbe625"} Jun 08 13:50:29.178414 ip-10-0-140-46 kubenswrapper[2576]: I0608 13:50:29.178368 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-catalog-zgmbg" event={"ID":"925b3198-6148-44ff-86b4-30cc3894a973","Type":"ContainerStarted","Data":"bf3c5d2eee051e1080d31b785de7b7ae01354285d7e7d4ae616575ab5f4a195c"} Jun 08 13:50:29.178884 ip-10-0-140-46 kubenswrapper[2576]: I0608 13:50:29.178426 2576 kuberuntime_container.go:872] "Killing container with a grace period" pod="kuadrant-system/kuadrant-operator-catalog-zgmbg" podUID="925b3198-6148-44ff-86b4-30cc3894a973" containerName="registry-server" containerID="cri-o://bf3c5d2eee051e1080d31b785de7b7ae01354285d7e7d4ae616575ab5f4a195c" gracePeriod=2 Jun 08 13:50:29.180029 ip-10-0-140-46 kubenswrapper[2576]: I0608 13:50:29.180003 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-catalog-dsfh9" event={"ID":"064b68f2-2d20-4e42-ab86-ec679227eacc","Type":"ContainerStarted","Data":"6af8baaf323b5a07f2248713b0d0fd88228ee2a3ca6e4fe6832ce6f6cb831aea"} Jun 08 13:50:29.212849 ip-10-0-140-46 kubenswrapper[2576]: I0608 13:50:29.212796 2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-catalog-zgmbg" podStartSLOduration=1.111465614 podStartE2EDuration="3.212780315s" totalImagesPullingTime="2.101314701s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-08 13:50:26 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-08 13:50:29.209998208 +0000 UTC m=+397.289327101" watchObservedRunningTime="2026-06-08 13:50:29.212780315 +0000 UTC m=+397.292109206" Jun 08 13:50:29.237936 ip-10-0-140-46 kubenswrapper[2576]: I0608 13:50:29.237882 2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-catalog-dsfh9" podStartSLOduration=1.7005069609999999 podStartE2EDuration="3.237865442s" totalImagesPullingTime="1.537358481s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-08 13:50:26 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-08 13:50:29.23662188 +0000 UTC m=+397.315950769" watchObservedRunningTime="2026-06-08 13:50:29.237865442 +0000 UTC m=+397.317194386" Jun 08 13:50:29.427118 ip-10-0-140-46 kubenswrapper[2576]: I0608 13:50:29.427093 2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-catalog-zgmbg" Jun 08 13:50:29.518013 ip-10-0-140-46 kubenswrapper[2576]: I0608 13:50:29.517906 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-qhwnm\" (UniqueName: \"kubernetes.io/projected/925b3198-6148-44ff-86b4-30cc3894a973-kube-api-access-qhwnm\") pod \"925b3198-6148-44ff-86b4-30cc3894a973\" (UID: \"925b3198-6148-44ff-86b4-30cc3894a973\") " Jun 08 13:50:29.520150 ip-10-0-140-46 kubenswrapper[2576]: I0608 13:50:29.520124 2576 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/925b3198-6148-44ff-86b4-30cc3894a973-kube-api-access-qhwnm" (OuterVolumeSpecName: "kube-api-access-qhwnm") pod "925b3198-6148-44ff-86b4-30cc3894a973" (UID: "925b3198-6148-44ff-86b4-30cc3894a973"). InnerVolumeSpecName "kube-api-access-qhwnm". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 08 13:50:29.618987 ip-10-0-140-46 kubenswrapper[2576]: I0608 13:50:29.618941 2576 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-qhwnm\" (UniqueName: \"kubernetes.io/projected/925b3198-6148-44ff-86b4-30cc3894a973-kube-api-access-qhwnm\") on node \"ip-10-0-140-46.ec2.internal\" DevicePath \"\"" Jun 08 13:50:30.185832 ip-10-0-140-46 kubenswrapper[2576]: I0608 13:50:30.185799 2576 generic.go:356] "Generic (PLEG): container finished" podID="925b3198-6148-44ff-86b4-30cc3894a973" containerID="bf3c5d2eee051e1080d31b785de7b7ae01354285d7e7d4ae616575ab5f4a195c" exitCode=0 Jun 08 13:50:30.186208 ip-10-0-140-46 kubenswrapper[2576]: I0608 13:50:30.185862 2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-catalog-zgmbg" Jun 08 13:50:30.186208 ip-10-0-140-46 kubenswrapper[2576]: I0608 13:50:30.185886 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-catalog-zgmbg" event={"ID":"925b3198-6148-44ff-86b4-30cc3894a973","Type":"ContainerDied","Data":"bf3c5d2eee051e1080d31b785de7b7ae01354285d7e7d4ae616575ab5f4a195c"} Jun 08 13:50:30.186208 ip-10-0-140-46 kubenswrapper[2576]: I0608 13:50:30.185970 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-catalog-zgmbg" event={"ID":"925b3198-6148-44ff-86b4-30cc3894a973","Type":"ContainerDied","Data":"c8ca942167b8177f8a0752debb405e11f4ade0f491116e5f8c32e4e41080e890"} Jun 08 13:50:30.186208 ip-10-0-140-46 kubenswrapper[2576]: I0608 13:50:30.185997 2576 scope.go:117] "RemoveContainer" containerID="bf3c5d2eee051e1080d31b785de7b7ae01354285d7e7d4ae616575ab5f4a195c" Jun 08 13:50:30.195492 ip-10-0-140-46 kubenswrapper[2576]: I0608 13:50:30.195474 2576 scope.go:117] "RemoveContainer" containerID="bf3c5d2eee051e1080d31b785de7b7ae01354285d7e7d4ae616575ab5f4a195c" Jun 08 13:50:30.195805 ip-10-0-140-46 kubenswrapper[2576]: E0608 13:50:30.195782 2576 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"bf3c5d2eee051e1080d31b785de7b7ae01354285d7e7d4ae616575ab5f4a195c\": container with ID starting with bf3c5d2eee051e1080d31b785de7b7ae01354285d7e7d4ae616575ab5f4a195c not found: ID does not exist" containerID="bf3c5d2eee051e1080d31b785de7b7ae01354285d7e7d4ae616575ab5f4a195c" Jun 08 13:50:30.195885 ip-10-0-140-46 kubenswrapper[2576]: I0608 13:50:30.195811 2576 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"bf3c5d2eee051e1080d31b785de7b7ae01354285d7e7d4ae616575ab5f4a195c"} err="failed to get container status \"bf3c5d2eee051e1080d31b785de7b7ae01354285d7e7d4ae616575ab5f4a195c\": rpc error: code = NotFound desc = could not find container \"bf3c5d2eee051e1080d31b785de7b7ae01354285d7e7d4ae616575ab5f4a195c\": container with ID starting with bf3c5d2eee051e1080d31b785de7b7ae01354285d7e7d4ae616575ab5f4a195c not found: ID does not exist" Jun 08 13:50:30.208852 ip-10-0-140-46 kubenswrapper[2576]: I0608 13:50:30.208831 2576 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-zgmbg"] Jun 08 13:50:30.220197 ip-10-0-140-46 kubenswrapper[2576]: I0608 13:50:30.220175 2576 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-zgmbg"] Jun 08 13:50:30.376268 ip-10-0-140-46 kubenswrapper[2576]: I0608 13:50:30.376236 2576 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="925b3198-6148-44ff-86b4-30cc3894a973" path="/var/lib/kubelet/pods/925b3198-6148-44ff-86b4-30cc3894a973/volumes" Jun 08 13:50:32.369694 ip-10-0-140-46 kubenswrapper[2576]: I0608 13:50:32.369656 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cx7sn_6e4b50fc-3e91-4f50-b92a-e90919788248/konnectivity-agent/0.log" limit=1024 Jun 08 13:50:32.429604 ip-10-0-140-46 kubenswrapper[2576]: I0608 13:50:32.429549 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cx7sn_6e4b50fc-3e91-4f50-b92a-e90919788248/konnectivity-agent/0.log" limit=1024 Jun 08 13:50:37.045473 ip-10-0-140-46 kubenswrapper[2576]: I0608 13:50:37.045434 2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/kuadrant-operator-catalog-dsfh9" Jun 08 13:50:37.045909 ip-10-0-140-46 kubenswrapper[2576]: I0608 13:50:37.045507 2576 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="kuadrant-system/kuadrant-operator-catalog-dsfh9" Jun 08 13:50:37.067289 ip-10-0-140-46 kubenswrapper[2576]: I0608 13:50:37.067262 2576 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="kuadrant-system/kuadrant-operator-catalog-dsfh9" Jun 08 13:50:37.244132 ip-10-0-140-46 kubenswrapper[2576]: I0608 13:50:37.244101 2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/kuadrant-operator-catalog-dsfh9" Jun 08 13:50:41.978059 ip-10-0-140-46 kubenswrapper[2576]: I0608 13:50:41.978019 2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759s4f6m"] Jun 08 13:50:41.978435 ip-10-0-140-46 kubenswrapper[2576]: I0608 13:50:41.978316 2576 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="925b3198-6148-44ff-86b4-30cc3894a973" containerName="registry-server" Jun 08 13:50:41.978435 ip-10-0-140-46 kubenswrapper[2576]: I0608 13:50:41.978327 2576 state_mem.go:107] "Deleted CPUSet assignment" podUID="925b3198-6148-44ff-86b4-30cc3894a973" containerName="registry-server" Jun 08 13:50:41.978435 ip-10-0-140-46 kubenswrapper[2576]: I0608 13:50:41.978390 2576 memory_manager.go:368] "RemoveStaleState removing state" podUID="925b3198-6148-44ff-86b4-30cc3894a973" containerName="registry-server" Jun 08 13:50:41.983373 ip-10-0-140-46 kubenswrapper[2576]: I0608 13:50:41.983356 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759s4f6m" Jun 08 13:50:41.985798 ip-10-0-140-46 kubenswrapper[2576]: I0608 13:50:41.985780 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"default-dockercfg-mlhx2\"" Jun 08 13:50:41.993817 ip-10-0-140-46 kubenswrapper[2576]: I0608 13:50:41.993795 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759s4f6m"] Jun 08 13:50:42.132008 ip-10-0-140-46 kubenswrapper[2576]: I0608 13:50:42.131970 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/d9ad6cd5-b3ee-455f-9bb2-81a89d9b1f50-bundle\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759s4f6m\" (UID: \"d9ad6cd5-b3ee-455f-9bb2-81a89d9b1f50\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759s4f6m" Jun 08 13:50:42.132008 ip-10-0-140-46 kubenswrapper[2576]: I0608 13:50:42.132011 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vcft6\" (UniqueName: \"kubernetes.io/projected/d9ad6cd5-b3ee-455f-9bb2-81a89d9b1f50-kube-api-access-vcft6\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759s4f6m\" (UID: \"d9ad6cd5-b3ee-455f-9bb2-81a89d9b1f50\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759s4f6m" Jun 08 13:50:42.132251 ip-10-0-140-46 kubenswrapper[2576]: I0608 13:50:42.132045 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/d9ad6cd5-b3ee-455f-9bb2-81a89d9b1f50-util\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759s4f6m\" (UID: \"d9ad6cd5-b3ee-455f-9bb2-81a89d9b1f50\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759s4f6m" Jun 08 13:50:42.232996 ip-10-0-140-46 kubenswrapper[2576]: I0608 13:50:42.232901 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/d9ad6cd5-b3ee-455f-9bb2-81a89d9b1f50-bundle\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759s4f6m\" (UID: \"d9ad6cd5-b3ee-455f-9bb2-81a89d9b1f50\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759s4f6m" Jun 08 13:50:42.232996 ip-10-0-140-46 kubenswrapper[2576]: I0608 13:50:42.232943 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vcft6\" (UniqueName: \"kubernetes.io/projected/d9ad6cd5-b3ee-455f-9bb2-81a89d9b1f50-kube-api-access-vcft6\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759s4f6m\" (UID: \"d9ad6cd5-b3ee-455f-9bb2-81a89d9b1f50\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759s4f6m" Jun 08 13:50:42.232996 ip-10-0-140-46 kubenswrapper[2576]: I0608 13:50:42.232980 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/d9ad6cd5-b3ee-455f-9bb2-81a89d9b1f50-util\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759s4f6m\" (UID: \"d9ad6cd5-b3ee-455f-9bb2-81a89d9b1f50\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759s4f6m" Jun 08 13:50:42.233293 ip-10-0-140-46 kubenswrapper[2576]: I0608 13:50:42.233275 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/d9ad6cd5-b3ee-455f-9bb2-81a89d9b1f50-bundle\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759s4f6m\" (UID: \"d9ad6cd5-b3ee-455f-9bb2-81a89d9b1f50\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759s4f6m" Jun 08 13:50:42.233333 ip-10-0-140-46 kubenswrapper[2576]: I0608 13:50:42.233320 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/d9ad6cd5-b3ee-455f-9bb2-81a89d9b1f50-util\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759s4f6m\" (UID: \"d9ad6cd5-b3ee-455f-9bb2-81a89d9b1f50\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759s4f6m" Jun 08 13:50:42.242825 ip-10-0-140-46 kubenswrapper[2576]: I0608 13:50:42.242794 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-vcft6\" (UniqueName: \"kubernetes.io/projected/d9ad6cd5-b3ee-455f-9bb2-81a89d9b1f50-kube-api-access-vcft6\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759s4f6m\" (UID: \"d9ad6cd5-b3ee-455f-9bb2-81a89d9b1f50\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759s4f6m" Jun 08 13:50:42.292524 ip-10-0-140-46 kubenswrapper[2576]: I0608 13:50:42.292484 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759s4f6m" Jun 08 13:50:42.443527 ip-10-0-140-46 kubenswrapper[2576]: W0608 13:50:42.443480 2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd9ad6cd5_b3ee_455f_9bb2_81a89d9b1f50.slice/crio-85fcad72bbc0b508b3929ec6c07c1f93a194c745d1f030962741a15fd54e1d72 WatchSource:0}: Error finding container 85fcad72bbc0b508b3929ec6c07c1f93a194c745d1f030962741a15fd54e1d72: Status 404 returned error can't find the container with id 85fcad72bbc0b508b3929ec6c07c1f93a194c745d1f030962741a15fd54e1d72 Jun 08 13:50:42.443977 ip-10-0-140-46 kubenswrapper[2576]: I0608 13:50:42.443914 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759s4f6m"] Jun 08 13:50:42.583069 ip-10-0-140-46 kubenswrapper[2576]: I0608 13:50:42.583033 2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1tn8bh"] Jun 08 13:50:42.585437 ip-10-0-140-46 kubenswrapper[2576]: I0608 13:50:42.585420 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1tn8bh" Jun 08 13:50:42.600085 ip-10-0-140-46 kubenswrapper[2576]: I0608 13:50:42.600051 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1tn8bh"] Jun 08 13:50:42.736640 ip-10-0-140-46 kubenswrapper[2576]: I0608 13:50:42.736596 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/c437a6e3-d517-45f9-8d49-04d6db9e5b84-bundle\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1tn8bh\" (UID: \"c437a6e3-d517-45f9-8d49-04d6db9e5b84\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1tn8bh" Jun 08 13:50:42.736640 ip-10-0-140-46 kubenswrapper[2576]: I0608 13:50:42.736642 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/c437a6e3-d517-45f9-8d49-04d6db9e5b84-util\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1tn8bh\" (UID: \"c437a6e3-d517-45f9-8d49-04d6db9e5b84\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1tn8bh" Jun 08 13:50:42.736908 ip-10-0-140-46 kubenswrapper[2576]: I0608 13:50:42.736694 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mhzkw\" (UniqueName: \"kubernetes.io/projected/c437a6e3-d517-45f9-8d49-04d6db9e5b84-kube-api-access-mhzkw\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1tn8bh\" (UID: \"c437a6e3-d517-45f9-8d49-04d6db9e5b84\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1tn8bh" Jun 08 13:50:42.837781 ip-10-0-140-46 kubenswrapper[2576]: I0608 13:50:42.837747 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/c437a6e3-d517-45f9-8d49-04d6db9e5b84-bundle\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1tn8bh\" (UID: \"c437a6e3-d517-45f9-8d49-04d6db9e5b84\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1tn8bh" Jun 08 13:50:42.837936 ip-10-0-140-46 kubenswrapper[2576]: I0608 13:50:42.837789 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/c437a6e3-d517-45f9-8d49-04d6db9e5b84-util\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1tn8bh\" (UID: \"c437a6e3-d517-45f9-8d49-04d6db9e5b84\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1tn8bh" Jun 08 13:50:42.837936 ip-10-0-140-46 kubenswrapper[2576]: I0608 13:50:42.837813 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mhzkw\" (UniqueName: \"kubernetes.io/projected/c437a6e3-d517-45f9-8d49-04d6db9e5b84-kube-api-access-mhzkw\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1tn8bh\" (UID: \"c437a6e3-d517-45f9-8d49-04d6db9e5b84\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1tn8bh" Jun 08 13:50:42.838122 ip-10-0-140-46 kubenswrapper[2576]: I0608 13:50:42.838102 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/c437a6e3-d517-45f9-8d49-04d6db9e5b84-util\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1tn8bh\" (UID: \"c437a6e3-d517-45f9-8d49-04d6db9e5b84\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1tn8bh" Jun 08 13:50:42.838169 ip-10-0-140-46 kubenswrapper[2576]: I0608 13:50:42.838143 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/c437a6e3-d517-45f9-8d49-04d6db9e5b84-bundle\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1tn8bh\" (UID: \"c437a6e3-d517-45f9-8d49-04d6db9e5b84\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1tn8bh" Jun 08 13:50:42.847672 ip-10-0-140-46 kubenswrapper[2576]: I0608 13:50:42.847649 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-mhzkw\" (UniqueName: \"kubernetes.io/projected/c437a6e3-d517-45f9-8d49-04d6db9e5b84-kube-api-access-mhzkw\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1tn8bh\" (UID: \"c437a6e3-d517-45f9-8d49-04d6db9e5b84\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1tn8bh" Jun 08 13:50:42.923809 ip-10-0-140-46 kubenswrapper[2576]: I0608 13:50:42.923776 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1tn8bh" Jun 08 13:50:42.986780 ip-10-0-140-46 kubenswrapper[2576]: I0608 13:50:42.986749 2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed737rgss"] Jun 08 13:50:42.989767 ip-10-0-140-46 kubenswrapper[2576]: I0608 13:50:42.989748 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed737rgss" Jun 08 13:50:43.001799 ip-10-0-140-46 kubenswrapper[2576]: I0608 13:50:43.001772 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed737rgss"] Jun 08 13:50:43.062478 ip-10-0-140-46 kubenswrapper[2576]: I0608 13:50:43.062451 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1tn8bh"] Jun 08 13:50:43.064051 ip-10-0-140-46 kubenswrapper[2576]: W0608 13:50:43.064025 2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc437a6e3_d517_45f9_8d49_04d6db9e5b84.slice/crio-bce642aa2ee76c87189965804f360da77312a3045f6396cf299dad771239cb5b WatchSource:0}: Error finding container bce642aa2ee76c87189965804f360da77312a3045f6396cf299dad771239cb5b: Status 404 returned error can't find the container with id bce642aa2ee76c87189965804f360da77312a3045f6396cf299dad771239cb5b Jun 08 13:50:43.141692 ip-10-0-140-46 kubenswrapper[2576]: I0608 13:50:43.141657 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/9e845571-2c13-44bd-b1d0-85201e4bde63-bundle\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed737rgss\" (UID: \"9e845571-2c13-44bd-b1d0-85201e4bde63\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed737rgss" Jun 08 13:50:43.141863 ip-10-0-140-46 kubenswrapper[2576]: I0608 13:50:43.141709 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-lw6bp\" (UniqueName: \"kubernetes.io/projected/9e845571-2c13-44bd-b1d0-85201e4bde63-kube-api-access-lw6bp\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed737rgss\" (UID: \"9e845571-2c13-44bd-b1d0-85201e4bde63\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed737rgss" Jun 08 13:50:43.141863 ip-10-0-140-46 kubenswrapper[2576]: I0608 13:50:43.141790 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/9e845571-2c13-44bd-b1d0-85201e4bde63-util\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed737rgss\" (UID: \"9e845571-2c13-44bd-b1d0-85201e4bde63\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed737rgss" Jun 08 13:50:43.242767 ip-10-0-140-46 kubenswrapper[2576]: I0608 13:50:43.242723 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/9e845571-2c13-44bd-b1d0-85201e4bde63-bundle\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed737rgss\" (UID: \"9e845571-2c13-44bd-b1d0-85201e4bde63\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed737rgss" Jun 08 13:50:43.242935 ip-10-0-140-46 kubenswrapper[2576]: I0608 13:50:43.242779 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-lw6bp\" (UniqueName: \"kubernetes.io/projected/9e845571-2c13-44bd-b1d0-85201e4bde63-kube-api-access-lw6bp\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed737rgss\" (UID: \"9e845571-2c13-44bd-b1d0-85201e4bde63\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed737rgss" Jun 08 13:50:43.242935 ip-10-0-140-46 kubenswrapper[2576]: I0608 13:50:43.242828 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/9e845571-2c13-44bd-b1d0-85201e4bde63-util\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed737rgss\" (UID: \"9e845571-2c13-44bd-b1d0-85201e4bde63\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed737rgss" Jun 08 13:50:43.243104 ip-10-0-140-46 kubenswrapper[2576]: I0608 13:50:43.243084 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/9e845571-2c13-44bd-b1d0-85201e4bde63-bundle\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed737rgss\" (UID: \"9e845571-2c13-44bd-b1d0-85201e4bde63\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed737rgss" Jun 08 13:50:43.243191 ip-10-0-140-46 kubenswrapper[2576]: I0608 13:50:43.243171 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/9e845571-2c13-44bd-b1d0-85201e4bde63-util\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed737rgss\" (UID: \"9e845571-2c13-44bd-b1d0-85201e4bde63\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed737rgss" Jun 08 13:50:43.251605 ip-10-0-140-46 kubenswrapper[2576]: I0608 13:50:43.251466 2576 generic.go:356] "Generic (PLEG): container finished" podID="c437a6e3-d517-45f9-8d49-04d6db9e5b84" containerID="93a84117a388fb54a52a8f110a48056cccbff12c17bc1df9e15b83b6df998f95" exitCode=0 Jun 08 13:50:43.251605 ip-10-0-140-46 kubenswrapper[2576]: I0608 13:50:43.251553 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1tn8bh" event={"ID":"c437a6e3-d517-45f9-8d49-04d6db9e5b84","Type":"ContainerDied","Data":"93a84117a388fb54a52a8f110a48056cccbff12c17bc1df9e15b83b6df998f95"} Jun 08 13:50:43.251723 ip-10-0-140-46 kubenswrapper[2576]: I0608 13:50:43.251619 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1tn8bh" event={"ID":"c437a6e3-d517-45f9-8d49-04d6db9e5b84","Type":"ContainerStarted","Data":"bce642aa2ee76c87189965804f360da77312a3045f6396cf299dad771239cb5b"} Jun 08 13:50:43.253662 ip-10-0-140-46 kubenswrapper[2576]: I0608 13:50:43.253627 2576 generic.go:356] "Generic (PLEG): container finished" podID="d9ad6cd5-b3ee-455f-9bb2-81a89d9b1f50" containerID="d57f451d015ba888006698aeb121c9bfce71078b16ecfc37dd6b21ea6d7a45a5" exitCode=0 Jun 08 13:50:43.254166 ip-10-0-140-46 kubenswrapper[2576]: I0608 13:50:43.253717 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759s4f6m" event={"ID":"d9ad6cd5-b3ee-455f-9bb2-81a89d9b1f50","Type":"ContainerDied","Data":"d57f451d015ba888006698aeb121c9bfce71078b16ecfc37dd6b21ea6d7a45a5"} Jun 08 13:50:43.254166 ip-10-0-140-46 kubenswrapper[2576]: I0608 13:50:43.253803 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759s4f6m" event={"ID":"d9ad6cd5-b3ee-455f-9bb2-81a89d9b1f50","Type":"ContainerStarted","Data":"85fcad72bbc0b508b3929ec6c07c1f93a194c745d1f030962741a15fd54e1d72"} Jun 08 13:50:43.255381 ip-10-0-140-46 kubenswrapper[2576]: I0608 13:50:43.255358 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-lw6bp\" (UniqueName: \"kubernetes.io/projected/9e845571-2c13-44bd-b1d0-85201e4bde63-kube-api-access-lw6bp\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed737rgss\" (UID: \"9e845571-2c13-44bd-b1d0-85201e4bde63\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed737rgss" Jun 08 13:50:43.300003 ip-10-0-140-46 kubenswrapper[2576]: I0608 13:50:43.299967 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed737rgss" Jun 08 13:50:43.396730 ip-10-0-140-46 kubenswrapper[2576]: I0608 13:50:43.396700 2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0hbtqx"] Jun 08 13:50:43.399559 ip-10-0-140-46 kubenswrapper[2576]: I0608 13:50:43.399537 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0hbtqx" Jun 08 13:50:43.412974 ip-10-0-140-46 kubenswrapper[2576]: I0608 13:50:43.412948 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0hbtqx"] Jun 08 13:50:43.442610 ip-10-0-140-46 kubenswrapper[2576]: I0608 13:50:43.442583 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed737rgss"] Jun 08 13:50:43.444712 ip-10-0-140-46 kubenswrapper[2576]: W0608 13:50:43.444681 2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9e845571_2c13_44bd_b1d0_85201e4bde63.slice/crio-cecc97f1134cd26a4a62f58dcdb0769e1270c53e96489784f30b48ca91967b46 WatchSource:0}: Error finding container cecc97f1134cd26a4a62f58dcdb0769e1270c53e96489784f30b48ca91967b46: Status 404 returned error can't find the container with id cecc97f1134cd26a4a62f58dcdb0769e1270c53e96489784f30b48ca91967b46 Jun 08 13:50:43.545400 ip-10-0-140-46 kubenswrapper[2576]: I0608 13:50:43.545372 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hcprl\" (UniqueName: \"kubernetes.io/projected/c7ca31ae-c177-4655-8c06-087fb8c5de99-kube-api-access-hcprl\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0hbtqx\" (UID: \"c7ca31ae-c177-4655-8c06-087fb8c5de99\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0hbtqx" Jun 08 13:50:43.545537 ip-10-0-140-46 kubenswrapper[2576]: I0608 13:50:43.545440 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/c7ca31ae-c177-4655-8c06-087fb8c5de99-util\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0hbtqx\" (UID: \"c7ca31ae-c177-4655-8c06-087fb8c5de99\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0hbtqx" Jun 08 13:50:43.545537 ip-10-0-140-46 kubenswrapper[2576]: I0608 13:50:43.545482 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/c7ca31ae-c177-4655-8c06-087fb8c5de99-bundle\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0hbtqx\" (UID: \"c7ca31ae-c177-4655-8c06-087fb8c5de99\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0hbtqx" Jun 08 13:50:43.646774 ip-10-0-140-46 kubenswrapper[2576]: I0608 13:50:43.646689 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hcprl\" (UniqueName: \"kubernetes.io/projected/c7ca31ae-c177-4655-8c06-087fb8c5de99-kube-api-access-hcprl\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0hbtqx\" (UID: \"c7ca31ae-c177-4655-8c06-087fb8c5de99\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0hbtqx" Jun 08 13:50:43.646774 ip-10-0-140-46 kubenswrapper[2576]: I0608 13:50:43.646744 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/c7ca31ae-c177-4655-8c06-087fb8c5de99-util\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0hbtqx\" (UID: \"c7ca31ae-c177-4655-8c06-087fb8c5de99\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0hbtqx" Jun 08 13:50:43.646774 ip-10-0-140-46 kubenswrapper[2576]: I0608 13:50:43.646765 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/c7ca31ae-c177-4655-8c06-087fb8c5de99-bundle\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0hbtqx\" (UID: \"c7ca31ae-c177-4655-8c06-087fb8c5de99\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0hbtqx" Jun 08 13:50:43.647080 ip-10-0-140-46 kubenswrapper[2576]: I0608 13:50:43.647065 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/c7ca31ae-c177-4655-8c06-087fb8c5de99-bundle\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0hbtqx\" (UID: \"c7ca31ae-c177-4655-8c06-087fb8c5de99\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0hbtqx" Jun 08 13:50:43.647126 ip-10-0-140-46 kubenswrapper[2576]: I0608 13:50:43.647105 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/c7ca31ae-c177-4655-8c06-087fb8c5de99-util\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0hbtqx\" (UID: \"c7ca31ae-c177-4655-8c06-087fb8c5de99\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0hbtqx" Jun 08 13:50:43.658051 ip-10-0-140-46 kubenswrapper[2576]: I0608 13:50:43.658026 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-hcprl\" (UniqueName: \"kubernetes.io/projected/c7ca31ae-c177-4655-8c06-087fb8c5de99-kube-api-access-hcprl\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0hbtqx\" (UID: \"c7ca31ae-c177-4655-8c06-087fb8c5de99\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0hbtqx" Jun 08 13:50:43.710915 ip-10-0-140-46 kubenswrapper[2576]: I0608 13:50:43.710881 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0hbtqx" Jun 08 13:50:44.071855 ip-10-0-140-46 kubenswrapper[2576]: I0608 13:50:44.071829 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0hbtqx"] Jun 08 13:50:44.144528 ip-10-0-140-46 kubenswrapper[2576]: W0608 13:50:44.144487 2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc7ca31ae_c177_4655_8c06_087fb8c5de99.slice/crio-ca99222f3866afdf45955b612f3ad6bac08a3d40caeab8e82138ccd7f65c1b73 WatchSource:0}: Error finding container ca99222f3866afdf45955b612f3ad6bac08a3d40caeab8e82138ccd7f65c1b73: Status 404 returned error can't find the container with id ca99222f3866afdf45955b612f3ad6bac08a3d40caeab8e82138ccd7f65c1b73 Jun 08 13:50:44.260280 ip-10-0-140-46 kubenswrapper[2576]: I0608 13:50:44.260249 2576 generic.go:356] "Generic (PLEG): container finished" podID="9e845571-2c13-44bd-b1d0-85201e4bde63" containerID="10512613f0f6f7de8a1c54d4386f2be484692503bf3c38d8a8f6a2b9c52739dc" exitCode=0 Jun 08 13:50:44.260397 ip-10-0-140-46 kubenswrapper[2576]: I0608 13:50:44.260324 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed737rgss" event={"ID":"9e845571-2c13-44bd-b1d0-85201e4bde63","Type":"ContainerDied","Data":"10512613f0f6f7de8a1c54d4386f2be484692503bf3c38d8a8f6a2b9c52739dc"} Jun 08 13:50:44.260397 ip-10-0-140-46 kubenswrapper[2576]: I0608 13:50:44.260375 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed737rgss" event={"ID":"9e845571-2c13-44bd-b1d0-85201e4bde63","Type":"ContainerStarted","Data":"cecc97f1134cd26a4a62f58dcdb0769e1270c53e96489784f30b48ca91967b46"} Jun 08 13:50:44.268203 ip-10-0-140-46 kubenswrapper[2576]: I0608 13:50:44.268176 2576 generic.go:356] "Generic (PLEG): container finished" podID="d9ad6cd5-b3ee-455f-9bb2-81a89d9b1f50" containerID="11188f33bd95d47460ab9b9d93525e30d44a1fe24b9de8fa5a24f9adf6a256cb" exitCode=0 Jun 08 13:50:44.268326 ip-10-0-140-46 kubenswrapper[2576]: I0608 13:50:44.268250 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759s4f6m" event={"ID":"d9ad6cd5-b3ee-455f-9bb2-81a89d9b1f50","Type":"ContainerDied","Data":"11188f33bd95d47460ab9b9d93525e30d44a1fe24b9de8fa5a24f9adf6a256cb"} Jun 08 13:50:44.269984 ip-10-0-140-46 kubenswrapper[2576]: I0608 13:50:44.269964 2576 generic.go:356] "Generic (PLEG): container finished" podID="c7ca31ae-c177-4655-8c06-087fb8c5de99" containerID="857a588318b4ac6d01825fd76420cddcbf113d0afc7bf20ab3ab310079f51a87" exitCode=0 Jun 08 13:50:44.270070 ip-10-0-140-46 kubenswrapper[2576]: I0608 13:50:44.270044 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0hbtqx" event={"ID":"c7ca31ae-c177-4655-8c06-087fb8c5de99","Type":"ContainerDied","Data":"857a588318b4ac6d01825fd76420cddcbf113d0afc7bf20ab3ab310079f51a87"} Jun 08 13:50:44.270131 ip-10-0-140-46 kubenswrapper[2576]: I0608 13:50:44.270092 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0hbtqx" event={"ID":"c7ca31ae-c177-4655-8c06-087fb8c5de99","Type":"ContainerStarted","Data":"ca99222f3866afdf45955b612f3ad6bac08a3d40caeab8e82138ccd7f65c1b73"} Jun 08 13:50:44.271960 ip-10-0-140-46 kubenswrapper[2576]: I0608 13:50:44.271939 2576 generic.go:356] "Generic (PLEG): container finished" podID="c437a6e3-d517-45f9-8d49-04d6db9e5b84" containerID="ba4165e42d98404fac75e9c54c5496bf385b2100f07d25abb966617a429c07c7" exitCode=0 Jun 08 13:50:44.272047 ip-10-0-140-46 kubenswrapper[2576]: I0608 13:50:44.271974 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1tn8bh" event={"ID":"c437a6e3-d517-45f9-8d49-04d6db9e5b84","Type":"ContainerDied","Data":"ba4165e42d98404fac75e9c54c5496bf385b2100f07d25abb966617a429c07c7"} Jun 08 13:50:45.279916 ip-10-0-140-46 kubenswrapper[2576]: I0608 13:50:45.279879 2576 generic.go:356] "Generic (PLEG): container finished" podID="c437a6e3-d517-45f9-8d49-04d6db9e5b84" containerID="5390c625b01ac18651b3d709dcbe8c9ae388685bb64bb450218cda891ba05b2c" exitCode=0 Jun 08 13:50:45.280321 ip-10-0-140-46 kubenswrapper[2576]: I0608 13:50:45.279958 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1tn8bh" event={"ID":"c437a6e3-d517-45f9-8d49-04d6db9e5b84","Type":"ContainerDied","Data":"5390c625b01ac18651b3d709dcbe8c9ae388685bb64bb450218cda891ba05b2c"} Jun 08 13:50:45.281760 ip-10-0-140-46 kubenswrapper[2576]: I0608 13:50:45.281735 2576 generic.go:356] "Generic (PLEG): container finished" podID="9e845571-2c13-44bd-b1d0-85201e4bde63" containerID="97358cd3dbc84a8287780adb4c3d974108a25a034dfe92da5fa955bf73be48aa" exitCode=0 Jun 08 13:50:45.281880 ip-10-0-140-46 kubenswrapper[2576]: I0608 13:50:45.281815 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed737rgss" event={"ID":"9e845571-2c13-44bd-b1d0-85201e4bde63","Type":"ContainerDied","Data":"97358cd3dbc84a8287780adb4c3d974108a25a034dfe92da5fa955bf73be48aa"} Jun 08 13:50:45.284099 ip-10-0-140-46 kubenswrapper[2576]: I0608 13:50:45.284076 2576 generic.go:356] "Generic (PLEG): container finished" podID="d9ad6cd5-b3ee-455f-9bb2-81a89d9b1f50" containerID="1ab7ff88bcdb1eb3ad4dcd6533fcc54da028808037c773cfd12662c1e14a2720" exitCode=0 Jun 08 13:50:45.284188 ip-10-0-140-46 kubenswrapper[2576]: I0608 13:50:45.284161 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759s4f6m" event={"ID":"d9ad6cd5-b3ee-455f-9bb2-81a89d9b1f50","Type":"ContainerDied","Data":"1ab7ff88bcdb1eb3ad4dcd6533fcc54da028808037c773cfd12662c1e14a2720"} Jun 08 13:50:45.285856 ip-10-0-140-46 kubenswrapper[2576]: I0608 13:50:45.285834 2576 generic.go:356] "Generic (PLEG): container finished" podID="c7ca31ae-c177-4655-8c06-087fb8c5de99" containerID="3422d2126db2d12d407c94bfd8fb8c70a09c2032b29ea806111af232fc5e0ba2" exitCode=0 Jun 08 13:50:45.285945 ip-10-0-140-46 kubenswrapper[2576]: I0608 13:50:45.285867 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0hbtqx" event={"ID":"c7ca31ae-c177-4655-8c06-087fb8c5de99","Type":"ContainerDied","Data":"3422d2126db2d12d407c94bfd8fb8c70a09c2032b29ea806111af232fc5e0ba2"} Jun 08 13:50:46.293374 ip-10-0-140-46 kubenswrapper[2576]: I0608 13:50:46.293336 2576 generic.go:356] "Generic (PLEG): container finished" podID="9e845571-2c13-44bd-b1d0-85201e4bde63" containerID="1f154401e6b0db97de422fd6241db39c03178c15c41b7391b4fde432bb8351f1" exitCode=0 Jun 08 13:50:46.293868 ip-10-0-140-46 kubenswrapper[2576]: I0608 13:50:46.293420 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed737rgss" event={"ID":"9e845571-2c13-44bd-b1d0-85201e4bde63","Type":"ContainerDied","Data":"1f154401e6b0db97de422fd6241db39c03178c15c41b7391b4fde432bb8351f1"} Jun 08 13:50:46.295443 ip-10-0-140-46 kubenswrapper[2576]: I0608 13:50:46.295419 2576 generic.go:356] "Generic (PLEG): container finished" podID="c7ca31ae-c177-4655-8c06-087fb8c5de99" containerID="39c0abfe420f3dc1c6c6d7b192bab04c74ebebc5c7e6fda5dfc8d2dc4738b7fd" exitCode=0 Jun 08 13:50:46.295555 ip-10-0-140-46 kubenswrapper[2576]: I0608 13:50:46.295497 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0hbtqx" event={"ID":"c7ca31ae-c177-4655-8c06-087fb8c5de99","Type":"ContainerDied","Data":"39c0abfe420f3dc1c6c6d7b192bab04c74ebebc5c7e6fda5dfc8d2dc4738b7fd"} Jun 08 13:50:46.437506 ip-10-0-140-46 kubenswrapper[2576]: I0608 13:50:46.437480 2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1tn8bh" Jun 08 13:50:46.464811 ip-10-0-140-46 kubenswrapper[2576]: I0608 13:50:46.464772 2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759s4f6m" Jun 08 13:50:46.471920 ip-10-0-140-46 kubenswrapper[2576]: I0608 13:50:46.471894 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/d9ad6cd5-b3ee-455f-9bb2-81a89d9b1f50-bundle\") pod \"d9ad6cd5-b3ee-455f-9bb2-81a89d9b1f50\" (UID: \"d9ad6cd5-b3ee-455f-9bb2-81a89d9b1f50\") " Jun 08 13:50:46.472066 ip-10-0-140-46 kubenswrapper[2576]: I0608 13:50:46.471935 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/c437a6e3-d517-45f9-8d49-04d6db9e5b84-util\") pod \"c437a6e3-d517-45f9-8d49-04d6db9e5b84\" (UID: \"c437a6e3-d517-45f9-8d49-04d6db9e5b84\") " Jun 08 13:50:46.472066 ip-10-0-140-46 kubenswrapper[2576]: I0608 13:50:46.471971 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-mhzkw\" (UniqueName: \"kubernetes.io/projected/c437a6e3-d517-45f9-8d49-04d6db9e5b84-kube-api-access-mhzkw\") pod \"c437a6e3-d517-45f9-8d49-04d6db9e5b84\" (UID: \"c437a6e3-d517-45f9-8d49-04d6db9e5b84\") " Jun 08 13:50:46.472066 ip-10-0-140-46 kubenswrapper[2576]: I0608 13:50:46.472000 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/c437a6e3-d517-45f9-8d49-04d6db9e5b84-bundle\") pod \"c437a6e3-d517-45f9-8d49-04d6db9e5b84\" (UID: \"c437a6e3-d517-45f9-8d49-04d6db9e5b84\") " Jun 08 13:50:46.472066 ip-10-0-140-46 kubenswrapper[2576]: I0608 13:50:46.472025 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/d9ad6cd5-b3ee-455f-9bb2-81a89d9b1f50-util\") pod \"d9ad6cd5-b3ee-455f-9bb2-81a89d9b1f50\" (UID: \"d9ad6cd5-b3ee-455f-9bb2-81a89d9b1f50\") " Jun 08 13:50:46.472282 ip-10-0-140-46 kubenswrapper[2576]: I0608 13:50:46.472071 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-vcft6\" (UniqueName: \"kubernetes.io/projected/d9ad6cd5-b3ee-455f-9bb2-81a89d9b1f50-kube-api-access-vcft6\") pod \"d9ad6cd5-b3ee-455f-9bb2-81a89d9b1f50\" (UID: \"d9ad6cd5-b3ee-455f-9bb2-81a89d9b1f50\") " Jun 08 13:50:46.472647 ip-10-0-140-46 kubenswrapper[2576]: I0608 13:50:46.472616 2576 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/c437a6e3-d517-45f9-8d49-04d6db9e5b84-bundle" (OuterVolumeSpecName: "bundle") pod "c437a6e3-d517-45f9-8d49-04d6db9e5b84" (UID: "c437a6e3-d517-45f9-8d49-04d6db9e5b84"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 08 13:50:46.472792 ip-10-0-140-46 kubenswrapper[2576]: I0608 13:50:46.472759 2576 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/d9ad6cd5-b3ee-455f-9bb2-81a89d9b1f50-bundle" (OuterVolumeSpecName: "bundle") pod "d9ad6cd5-b3ee-455f-9bb2-81a89d9b1f50" (UID: "d9ad6cd5-b3ee-455f-9bb2-81a89d9b1f50"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 08 13:50:46.474254 ip-10-0-140-46 kubenswrapper[2576]: I0608 13:50:46.474231 2576 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/d9ad6cd5-b3ee-455f-9bb2-81a89d9b1f50-kube-api-access-vcft6" (OuterVolumeSpecName: "kube-api-access-vcft6") pod "d9ad6cd5-b3ee-455f-9bb2-81a89d9b1f50" (UID: "d9ad6cd5-b3ee-455f-9bb2-81a89d9b1f50"). InnerVolumeSpecName "kube-api-access-vcft6". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 08 13:50:46.474555 ip-10-0-140-46 kubenswrapper[2576]: I0608 13:50:46.474536 2576 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/c437a6e3-d517-45f9-8d49-04d6db9e5b84-kube-api-access-mhzkw" (OuterVolumeSpecName: "kube-api-access-mhzkw") pod "c437a6e3-d517-45f9-8d49-04d6db9e5b84" (UID: "c437a6e3-d517-45f9-8d49-04d6db9e5b84"). InnerVolumeSpecName "kube-api-access-mhzkw". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 08 13:50:46.478053 ip-10-0-140-46 kubenswrapper[2576]: I0608 13:50:46.478029 2576 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/d9ad6cd5-b3ee-455f-9bb2-81a89d9b1f50-util" (OuterVolumeSpecName: "util") pod "d9ad6cd5-b3ee-455f-9bb2-81a89d9b1f50" (UID: "d9ad6cd5-b3ee-455f-9bb2-81a89d9b1f50"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 08 13:50:46.478961 ip-10-0-140-46 kubenswrapper[2576]: I0608 13:50:46.478936 2576 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/c437a6e3-d517-45f9-8d49-04d6db9e5b84-util" (OuterVolumeSpecName: "util") pod "c437a6e3-d517-45f9-8d49-04d6db9e5b84" (UID: "c437a6e3-d517-45f9-8d49-04d6db9e5b84"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 08 13:50:46.572976 ip-10-0-140-46 kubenswrapper[2576]: I0608 13:50:46.572892 2576 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/c437a6e3-d517-45f9-8d49-04d6db9e5b84-bundle\") on node \"ip-10-0-140-46.ec2.internal\" DevicePath \"\"" Jun 08 13:50:46.572976 ip-10-0-140-46 kubenswrapper[2576]: I0608 13:50:46.572924 2576 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/d9ad6cd5-b3ee-455f-9bb2-81a89d9b1f50-util\") on node \"ip-10-0-140-46.ec2.internal\" DevicePath \"\"" Jun 08 13:50:46.572976 ip-10-0-140-46 kubenswrapper[2576]: I0608 13:50:46.572933 2576 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-vcft6\" (UniqueName: \"kubernetes.io/projected/d9ad6cd5-b3ee-455f-9bb2-81a89d9b1f50-kube-api-access-vcft6\") on node \"ip-10-0-140-46.ec2.internal\" DevicePath \"\"" Jun 08 13:50:46.572976 ip-10-0-140-46 kubenswrapper[2576]: I0608 13:50:46.572944 2576 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/d9ad6cd5-b3ee-455f-9bb2-81a89d9b1f50-bundle\") on node \"ip-10-0-140-46.ec2.internal\" DevicePath \"\"" Jun 08 13:50:46.572976 ip-10-0-140-46 kubenswrapper[2576]: I0608 13:50:46.572953 2576 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/c437a6e3-d517-45f9-8d49-04d6db9e5b84-util\") on node \"ip-10-0-140-46.ec2.internal\" DevicePath \"\"" Jun 08 13:50:46.572976 ip-10-0-140-46 kubenswrapper[2576]: I0608 13:50:46.572962 2576 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-mhzkw\" (UniqueName: \"kubernetes.io/projected/c437a6e3-d517-45f9-8d49-04d6db9e5b84-kube-api-access-mhzkw\") on node \"ip-10-0-140-46.ec2.internal\" DevicePath \"\"" Jun 08 13:50:47.302608 ip-10-0-140-46 kubenswrapper[2576]: I0608 13:50:47.302579 2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759s4f6m" Jun 08 13:50:47.303107 ip-10-0-140-46 kubenswrapper[2576]: I0608 13:50:47.302608 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759s4f6m" event={"ID":"d9ad6cd5-b3ee-455f-9bb2-81a89d9b1f50","Type":"ContainerDied","Data":"85fcad72bbc0b508b3929ec6c07c1f93a194c745d1f030962741a15fd54e1d72"} Jun 08 13:50:47.303107 ip-10-0-140-46 kubenswrapper[2576]: I0608 13:50:47.302664 2576 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="85fcad72bbc0b508b3929ec6c07c1f93a194c745d1f030962741a15fd54e1d72" Jun 08 13:50:47.304628 ip-10-0-140-46 kubenswrapper[2576]: I0608 13:50:47.304598 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1tn8bh" event={"ID":"c437a6e3-d517-45f9-8d49-04d6db9e5b84","Type":"ContainerDied","Data":"bce642aa2ee76c87189965804f360da77312a3045f6396cf299dad771239cb5b"} Jun 08 13:50:47.304777 ip-10-0-140-46 kubenswrapper[2576]: I0608 13:50:47.304646 2576 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="bce642aa2ee76c87189965804f360da77312a3045f6396cf299dad771239cb5b" Jun 08 13:50:47.304777 ip-10-0-140-46 kubenswrapper[2576]: I0608 13:50:47.304609 2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1tn8bh" Jun 08 13:50:47.463610 ip-10-0-140-46 kubenswrapper[2576]: I0608 13:50:47.463586 2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed737rgss" Jun 08 13:50:47.465730 ip-10-0-140-46 kubenswrapper[2576]: I0608 13:50:47.465714 2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0hbtqx" Jun 08 13:50:47.481005 ip-10-0-140-46 kubenswrapper[2576]: I0608 13:50:47.480978 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-hcprl\" (UniqueName: \"kubernetes.io/projected/c7ca31ae-c177-4655-8c06-087fb8c5de99-kube-api-access-hcprl\") pod \"c7ca31ae-c177-4655-8c06-087fb8c5de99\" (UID: \"c7ca31ae-c177-4655-8c06-087fb8c5de99\") " Jun 08 13:50:47.481127 ip-10-0-140-46 kubenswrapper[2576]: I0608 13:50:47.481032 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/9e845571-2c13-44bd-b1d0-85201e4bde63-util\") pod \"9e845571-2c13-44bd-b1d0-85201e4bde63\" (UID: \"9e845571-2c13-44bd-b1d0-85201e4bde63\") " Jun 08 13:50:47.481127 ip-10-0-140-46 kubenswrapper[2576]: I0608 13:50:47.481054 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-lw6bp\" (UniqueName: \"kubernetes.io/projected/9e845571-2c13-44bd-b1d0-85201e4bde63-kube-api-access-lw6bp\") pod \"9e845571-2c13-44bd-b1d0-85201e4bde63\" (UID: \"9e845571-2c13-44bd-b1d0-85201e4bde63\") " Jun 08 13:50:47.481127 ip-10-0-140-46 kubenswrapper[2576]: I0608 13:50:47.481083 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/9e845571-2c13-44bd-b1d0-85201e4bde63-bundle\") pod \"9e845571-2c13-44bd-b1d0-85201e4bde63\" (UID: \"9e845571-2c13-44bd-b1d0-85201e4bde63\") " Jun 08 13:50:47.481127 ip-10-0-140-46 kubenswrapper[2576]: I0608 13:50:47.481101 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/c7ca31ae-c177-4655-8c06-087fb8c5de99-bundle\") pod \"c7ca31ae-c177-4655-8c06-087fb8c5de99\" (UID: \"c7ca31ae-c177-4655-8c06-087fb8c5de99\") " Jun 08 13:50:47.481127 ip-10-0-140-46 kubenswrapper[2576]: I0608 13:50:47.481124 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/c7ca31ae-c177-4655-8c06-087fb8c5de99-util\") pod \"c7ca31ae-c177-4655-8c06-087fb8c5de99\" (UID: \"c7ca31ae-c177-4655-8c06-087fb8c5de99\") " Jun 08 13:50:47.481673 ip-10-0-140-46 kubenswrapper[2576]: I0608 13:50:47.481642 2576 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/c7ca31ae-c177-4655-8c06-087fb8c5de99-bundle" (OuterVolumeSpecName: "bundle") pod "c7ca31ae-c177-4655-8c06-087fb8c5de99" (UID: "c7ca31ae-c177-4655-8c06-087fb8c5de99"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 08 13:50:47.481895 ip-10-0-140-46 kubenswrapper[2576]: I0608 13:50:47.481855 2576 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/9e845571-2c13-44bd-b1d0-85201e4bde63-bundle" (OuterVolumeSpecName: "bundle") pod "9e845571-2c13-44bd-b1d0-85201e4bde63" (UID: "9e845571-2c13-44bd-b1d0-85201e4bde63"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 08 13:50:47.483426 ip-10-0-140-46 kubenswrapper[2576]: I0608 13:50:47.483404 2576 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/c7ca31ae-c177-4655-8c06-087fb8c5de99-kube-api-access-hcprl" (OuterVolumeSpecName: "kube-api-access-hcprl") pod "c7ca31ae-c177-4655-8c06-087fb8c5de99" (UID: "c7ca31ae-c177-4655-8c06-087fb8c5de99"). InnerVolumeSpecName "kube-api-access-hcprl". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 08 13:50:47.483825 ip-10-0-140-46 kubenswrapper[2576]: I0608 13:50:47.483799 2576 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/9e845571-2c13-44bd-b1d0-85201e4bde63-kube-api-access-lw6bp" (OuterVolumeSpecName: "kube-api-access-lw6bp") pod "9e845571-2c13-44bd-b1d0-85201e4bde63" (UID: "9e845571-2c13-44bd-b1d0-85201e4bde63"). InnerVolumeSpecName "kube-api-access-lw6bp". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 08 13:50:47.487807 ip-10-0-140-46 kubenswrapper[2576]: I0608 13:50:47.487519 2576 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/c7ca31ae-c177-4655-8c06-087fb8c5de99-util" (OuterVolumeSpecName: "util") pod "c7ca31ae-c177-4655-8c06-087fb8c5de99" (UID: "c7ca31ae-c177-4655-8c06-087fb8c5de99"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 08 13:50:47.487910 ip-10-0-140-46 kubenswrapper[2576]: I0608 13:50:47.487870 2576 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/9e845571-2c13-44bd-b1d0-85201e4bde63-util" (OuterVolumeSpecName: "util") pod "9e845571-2c13-44bd-b1d0-85201e4bde63" (UID: "9e845571-2c13-44bd-b1d0-85201e4bde63"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 08 13:50:47.581993 ip-10-0-140-46 kubenswrapper[2576]: I0608 13:50:47.581901 2576 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/9e845571-2c13-44bd-b1d0-85201e4bde63-util\") on node \"ip-10-0-140-46.ec2.internal\" DevicePath \"\"" Jun 08 13:50:47.581993 ip-10-0-140-46 kubenswrapper[2576]: I0608 13:50:47.581937 2576 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-lw6bp\" (UniqueName: \"kubernetes.io/projected/9e845571-2c13-44bd-b1d0-85201e4bde63-kube-api-access-lw6bp\") on node \"ip-10-0-140-46.ec2.internal\" DevicePath \"\"" Jun 08 13:50:47.581993 ip-10-0-140-46 kubenswrapper[2576]: I0608 13:50:47.581949 2576 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/9e845571-2c13-44bd-b1d0-85201e4bde63-bundle\") on node \"ip-10-0-140-46.ec2.internal\" DevicePath \"\"" Jun 08 13:50:47.581993 ip-10-0-140-46 kubenswrapper[2576]: I0608 13:50:47.581958 2576 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/c7ca31ae-c177-4655-8c06-087fb8c5de99-bundle\") on node \"ip-10-0-140-46.ec2.internal\" DevicePath \"\"" Jun 08 13:50:47.581993 ip-10-0-140-46 kubenswrapper[2576]: I0608 13:50:47.581965 2576 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/c7ca31ae-c177-4655-8c06-087fb8c5de99-util\") on node \"ip-10-0-140-46.ec2.internal\" DevicePath \"\"" Jun 08 13:50:47.581993 ip-10-0-140-46 kubenswrapper[2576]: I0608 13:50:47.581974 2576 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-hcprl\" (UniqueName: \"kubernetes.io/projected/c7ca31ae-c177-4655-8c06-087fb8c5de99-kube-api-access-hcprl\") on node \"ip-10-0-140-46.ec2.internal\" DevicePath \"\"" Jun 08 13:50:48.311417 ip-10-0-140-46 kubenswrapper[2576]: I0608 13:50:48.311387 2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed737rgss" Jun 08 13:50:48.311863 ip-10-0-140-46 kubenswrapper[2576]: I0608 13:50:48.311413 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed737rgss" event={"ID":"9e845571-2c13-44bd-b1d0-85201e4bde63","Type":"ContainerDied","Data":"cecc97f1134cd26a4a62f58dcdb0769e1270c53e96489784f30b48ca91967b46"} Jun 08 13:50:48.311863 ip-10-0-140-46 kubenswrapper[2576]: I0608 13:50:48.311462 2576 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="cecc97f1134cd26a4a62f58dcdb0769e1270c53e96489784f30b48ca91967b46" Jun 08 13:50:48.313244 ip-10-0-140-46 kubenswrapper[2576]: I0608 13:50:48.313220 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0hbtqx" event={"ID":"c7ca31ae-c177-4655-8c06-087fb8c5de99","Type":"ContainerDied","Data":"ca99222f3866afdf45955b612f3ad6bac08a3d40caeab8e82138ccd7f65c1b73"} Jun 08 13:50:48.313341 ip-10-0-140-46 kubenswrapper[2576]: I0608 13:50:48.313258 2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0hbtqx" Jun 08 13:50:48.313341 ip-10-0-140-46 kubenswrapper[2576]: I0608 13:50:48.313263 2576 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="ca99222f3866afdf45955b612f3ad6bac08a3d40caeab8e82138ccd7f65c1b73" Jun 08 13:50:49.275600 ip-10-0-140-46 kubenswrapper[2576]: I0608 13:50:49.275551 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cx7sn_6e4b50fc-3e91-4f50-b92a-e90919788248/konnectivity-agent/0.log" limit=1024 Jun 08 13:50:50.043723 ip-10-0-140-46 kubenswrapper[2576]: I0608 13:50:50.043687 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cx7sn_6e4b50fc-3e91-4f50-b92a-e90919788248/konnectivity-agent/0.log" limit=1024 Jun 08 13:50:51.291162 ip-10-0-140-46 kubenswrapper[2576]: I0608 13:50:51.291127 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cx7sn_6e4b50fc-3e91-4f50-b92a-e90919788248/konnectivity-agent/0.log" limit=1024 Jun 08 13:50:53.177700 ip-10-0-140-46 kubenswrapper[2576]: I0608 13:50:53.177666 2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-operator-75cc8d5cb7-4prdd"] Jun 08 13:50:53.178078 ip-10-0-140-46 kubenswrapper[2576]: I0608 13:50:53.177999 2576 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="9e845571-2c13-44bd-b1d0-85201e4bde63" containerName="extract" Jun 08 13:50:53.178078 ip-10-0-140-46 kubenswrapper[2576]: I0608 13:50:53.178012 2576 state_mem.go:107] "Deleted CPUSet assignment" podUID="9e845571-2c13-44bd-b1d0-85201e4bde63" containerName="extract" Jun 08 13:50:53.178078 ip-10-0-140-46 kubenswrapper[2576]: I0608 13:50:53.178026 2576 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="c437a6e3-d517-45f9-8d49-04d6db9e5b84" containerName="extract" Jun 08 13:50:53.178078 ip-10-0-140-46 kubenswrapper[2576]: I0608 13:50:53.178034 2576 state_mem.go:107] "Deleted CPUSet assignment" podUID="c437a6e3-d517-45f9-8d49-04d6db9e5b84" containerName="extract" Jun 08 13:50:53.178078 ip-10-0-140-46 kubenswrapper[2576]: I0608 13:50:53.178044 2576 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="d9ad6cd5-b3ee-455f-9bb2-81a89d9b1f50" containerName="pull" Jun 08 13:50:53.178078 ip-10-0-140-46 kubenswrapper[2576]: I0608 13:50:53.178050 2576 state_mem.go:107] "Deleted CPUSet assignment" podUID="d9ad6cd5-b3ee-455f-9bb2-81a89d9b1f50" containerName="pull" Jun 08 13:50:53.178078 ip-10-0-140-46 kubenswrapper[2576]: I0608 13:50:53.178056 2576 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="d9ad6cd5-b3ee-455f-9bb2-81a89d9b1f50" containerName="extract" Jun 08 13:50:53.178078 ip-10-0-140-46 kubenswrapper[2576]: I0608 13:50:53.178061 2576 state_mem.go:107] "Deleted CPUSet assignment" podUID="d9ad6cd5-b3ee-455f-9bb2-81a89d9b1f50" containerName="extract" Jun 08 13:50:53.178078 ip-10-0-140-46 kubenswrapper[2576]: I0608 13:50:53.178070 2576 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="c7ca31ae-c177-4655-8c06-087fb8c5de99" containerName="util" Jun 08 13:50:53.178078 ip-10-0-140-46 kubenswrapper[2576]: I0608 13:50:53.178075 2576 state_mem.go:107] "Deleted CPUSet assignment" podUID="c7ca31ae-c177-4655-8c06-087fb8c5de99" containerName="util" Jun 08 13:50:53.178078 ip-10-0-140-46 kubenswrapper[2576]: I0608 13:50:53.178081 2576 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="9e845571-2c13-44bd-b1d0-85201e4bde63" containerName="pull" Jun 08 13:50:53.178403 ip-10-0-140-46 kubenswrapper[2576]: I0608 13:50:53.178087 2576 state_mem.go:107] "Deleted CPUSet assignment" podUID="9e845571-2c13-44bd-b1d0-85201e4bde63" containerName="pull" Jun 08 13:50:53.178403 ip-10-0-140-46 kubenswrapper[2576]: I0608 13:50:53.178099 2576 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="9e845571-2c13-44bd-b1d0-85201e4bde63" containerName="util" Jun 08 13:50:53.178403 ip-10-0-140-46 kubenswrapper[2576]: I0608 13:50:53.178107 2576 state_mem.go:107] "Deleted CPUSet assignment" podUID="9e845571-2c13-44bd-b1d0-85201e4bde63" containerName="util" Jun 08 13:50:53.178403 ip-10-0-140-46 kubenswrapper[2576]: I0608 13:50:53.178112 2576 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="c7ca31ae-c177-4655-8c06-087fb8c5de99" containerName="pull" Jun 08 13:50:53.178403 ip-10-0-140-46 kubenswrapper[2576]: I0608 13:50:53.178117 2576 state_mem.go:107] "Deleted CPUSet assignment" podUID="c7ca31ae-c177-4655-8c06-087fb8c5de99" containerName="pull" Jun 08 13:50:53.178403 ip-10-0-140-46 kubenswrapper[2576]: I0608 13:50:53.178124 2576 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="c437a6e3-d517-45f9-8d49-04d6db9e5b84" containerName="util" Jun 08 13:50:53.178403 ip-10-0-140-46 kubenswrapper[2576]: I0608 13:50:53.178129 2576 state_mem.go:107] "Deleted CPUSet assignment" podUID="c437a6e3-d517-45f9-8d49-04d6db9e5b84" containerName="util" Jun 08 13:50:53.178403 ip-10-0-140-46 kubenswrapper[2576]: I0608 13:50:53.178134 2576 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="c7ca31ae-c177-4655-8c06-087fb8c5de99" containerName="extract" Jun 08 13:50:53.178403 ip-10-0-140-46 kubenswrapper[2576]: I0608 13:50:53.178139 2576 state_mem.go:107] "Deleted CPUSet assignment" podUID="c7ca31ae-c177-4655-8c06-087fb8c5de99" containerName="extract" Jun 08 13:50:53.178403 ip-10-0-140-46 kubenswrapper[2576]: I0608 13:50:53.178147 2576 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="d9ad6cd5-b3ee-455f-9bb2-81a89d9b1f50" containerName="util" Jun 08 13:50:53.178403 ip-10-0-140-46 kubenswrapper[2576]: I0608 13:50:53.178151 2576 state_mem.go:107] "Deleted CPUSet assignment" podUID="d9ad6cd5-b3ee-455f-9bb2-81a89d9b1f50" containerName="util" Jun 08 13:50:53.178403 ip-10-0-140-46 kubenswrapper[2576]: I0608 13:50:53.178156 2576 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="c437a6e3-d517-45f9-8d49-04d6db9e5b84" containerName="pull" Jun 08 13:50:53.178403 ip-10-0-140-46 kubenswrapper[2576]: I0608 13:50:53.178161 2576 state_mem.go:107] "Deleted CPUSet assignment" podUID="c437a6e3-d517-45f9-8d49-04d6db9e5b84" containerName="pull" Jun 08 13:50:53.178403 ip-10-0-140-46 kubenswrapper[2576]: I0608 13:50:53.178219 2576 memory_manager.go:368] "RemoveStaleState removing state" podUID="d9ad6cd5-b3ee-455f-9bb2-81a89d9b1f50" containerName="extract" Jun 08 13:50:53.178403 ip-10-0-140-46 kubenswrapper[2576]: I0608 13:50:53.178226 2576 memory_manager.go:368] "RemoveStaleState removing state" podUID="c437a6e3-d517-45f9-8d49-04d6db9e5b84" containerName="extract" Jun 08 13:50:53.178403 ip-10-0-140-46 kubenswrapper[2576]: I0608 13:50:53.178234 2576 memory_manager.go:368] "RemoveStaleState removing state" podUID="9e845571-2c13-44bd-b1d0-85201e4bde63" containerName="extract" Jun 08 13:50:53.178403 ip-10-0-140-46 kubenswrapper[2576]: I0608 13:50:53.178239 2576 memory_manager.go:368] "RemoveStaleState removing state" podUID="c7ca31ae-c177-4655-8c06-087fb8c5de99" containerName="extract" Jun 08 13:50:53.182510 ip-10-0-140-46 kubenswrapper[2576]: I0608 13:50:53.182494 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-operator-75cc8d5cb7-4prdd" Jun 08 13:50:53.185404 ip-10-0-140-46 kubenswrapper[2576]: I0608 13:50:53.185381 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"authorino-operator-dockercfg-jlg2q\"" Jun 08 13:50:53.196046 ip-10-0-140-46 kubenswrapper[2576]: I0608 13:50:53.196024 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-operator-75cc8d5cb7-4prdd"] Jun 08 13:50:53.227847 ip-10-0-140-46 kubenswrapper[2576]: I0608 13:50:53.227813 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ftwmz\" (UniqueName: \"kubernetes.io/projected/64301943-c8c4-4945-8f60-c67186c76503-kube-api-access-ftwmz\") pod \"authorino-operator-75cc8d5cb7-4prdd\" (UID: \"64301943-c8c4-4945-8f60-c67186c76503\") " pod="kuadrant-system/authorino-operator-75cc8d5cb7-4prdd" Jun 08 13:50:53.329138 ip-10-0-140-46 kubenswrapper[2576]: I0608 13:50:53.329105 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ftwmz\" (UniqueName: \"kubernetes.io/projected/64301943-c8c4-4945-8f60-c67186c76503-kube-api-access-ftwmz\") pod \"authorino-operator-75cc8d5cb7-4prdd\" (UID: \"64301943-c8c4-4945-8f60-c67186c76503\") " pod="kuadrant-system/authorino-operator-75cc8d5cb7-4prdd" Jun 08 13:50:53.351973 ip-10-0-140-46 kubenswrapper[2576]: I0608 13:50:53.351948 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-ftwmz\" (UniqueName: \"kubernetes.io/projected/64301943-c8c4-4945-8f60-c67186c76503-kube-api-access-ftwmz\") pod \"authorino-operator-75cc8d5cb7-4prdd\" (UID: \"64301943-c8c4-4945-8f60-c67186c76503\") " pod="kuadrant-system/authorino-operator-75cc8d5cb7-4prdd" Jun 08 13:50:53.492426 ip-10-0-140-46 kubenswrapper[2576]: I0608 13:50:53.492321 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-operator-75cc8d5cb7-4prdd" Jun 08 13:50:53.638810 ip-10-0-140-46 kubenswrapper[2576]: I0608 13:50:53.638784 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-operator-75cc8d5cb7-4prdd"] Jun 08 13:50:53.639969 ip-10-0-140-46 kubenswrapper[2576]: W0608 13:50:53.639940 2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod64301943_c8c4_4945_8f60_c67186c76503.slice/crio-e2fb1f44ebf04d0025b6238a13eb74915f096d09761bef0ea168553f7f8ea14b WatchSource:0}: Error finding container e2fb1f44ebf04d0025b6238a13eb74915f096d09761bef0ea168553f7f8ea14b: Status 404 returned error can't find the container with id e2fb1f44ebf04d0025b6238a13eb74915f096d09761bef0ea168553f7f8ea14b Jun 08 13:50:53.865082 ip-10-0-140-46 kubenswrapper[2576]: I0608 13:50:53.865050 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cx7sn_6e4b50fc-3e91-4f50-b92a-e90919788248/konnectivity-agent/0.log" limit=1024 Jun 08 13:50:54.132266 ip-10-0-140-46 kubenswrapper[2576]: I0608 13:50:54.132182 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cx7sn_6e4b50fc-3e91-4f50-b92a-e90919788248/konnectivity-agent/0.log" limit=1024 Jun 08 13:50:54.346236 ip-10-0-140-46 kubenswrapper[2576]: I0608 13:50:54.346195 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-operator-75cc8d5cb7-4prdd" event={"ID":"64301943-c8c4-4945-8f60-c67186c76503","Type":"ContainerStarted","Data":"e2fb1f44ebf04d0025b6238a13eb74915f096d09761bef0ea168553f7f8ea14b"} Jun 08 13:50:56.358878 ip-10-0-140-46 kubenswrapper[2576]: I0608 13:50:56.358839 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-operator-75cc8d5cb7-4prdd" event={"ID":"64301943-c8c4-4945-8f60-c67186c76503","Type":"ContainerStarted","Data":"9fe178c28ec17df7e93ad5107d42095c205b62a974dc02877b0582b9596c725e"} Jun 08 13:50:56.359244 ip-10-0-140-46 kubenswrapper[2576]: I0608 13:50:56.358926 2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/authorino-operator-75cc8d5cb7-4prdd" Jun 08 13:50:56.406633 ip-10-0-140-46 kubenswrapper[2576]: I0608 13:50:56.406575 2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/authorino-operator-75cc8d5cb7-4prdd" podStartSLOduration=1.30441129 podStartE2EDuration="3.40654478s" totalImagesPullingTime="2.10213349s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-08 13:50:53 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-08 13:50:56.403172116 +0000 UTC m=+424.482501019" watchObservedRunningTime="2026-06-08 13:50:56.40654478 +0000 UTC m=+424.485873671" Jun 08 13:50:57.705136 ip-10-0-140-46 kubenswrapper[2576]: I0608 13:50:57.705098 2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-q67f7"] Jun 08 13:50:57.708367 ip-10-0-140-46 kubenswrapper[2576]: I0608 13:50:57.708350 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-q67f7" Jun 08 13:50:57.711861 ip-10-0-140-46 kubenswrapper[2576]: I0608 13:50:57.711841 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"kuadrant-operator-controller-manager-dockercfg-t5hm6\"" Jun 08 13:50:57.737133 ip-10-0-140-46 kubenswrapper[2576]: I0608 13:50:57.737097 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-q67f7"] Jun 08 13:50:57.767329 ip-10-0-140-46 kubenswrapper[2576]: I0608 13:50:57.767292 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/2ca0c9f7-49fb-4978-bf27-b57af4c735fb-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-8684c9ff49-q67f7\" (UID: \"2ca0c9f7-49fb-4978-bf27-b57af4c735fb\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-q67f7" Jun 08 13:50:57.767329 ip-10-0-140-46 kubenswrapper[2576]: I0608 13:50:57.767329 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-k96z4\" (UniqueName: \"kubernetes.io/projected/2ca0c9f7-49fb-4978-bf27-b57af4c735fb-kube-api-access-k96z4\") pod \"kuadrant-operator-controller-manager-8684c9ff49-q67f7\" (UID: \"2ca0c9f7-49fb-4978-bf27-b57af4c735fb\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-q67f7" Jun 08 13:50:57.868795 ip-10-0-140-46 kubenswrapper[2576]: I0608 13:50:57.868761 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/2ca0c9f7-49fb-4978-bf27-b57af4c735fb-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-8684c9ff49-q67f7\" (UID: \"2ca0c9f7-49fb-4978-bf27-b57af4c735fb\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-q67f7" Jun 08 13:50:57.868988 ip-10-0-140-46 kubenswrapper[2576]: I0608 13:50:57.868805 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-k96z4\" (UniqueName: \"kubernetes.io/projected/2ca0c9f7-49fb-4978-bf27-b57af4c735fb-kube-api-access-k96z4\") pod \"kuadrant-operator-controller-manager-8684c9ff49-q67f7\" (UID: \"2ca0c9f7-49fb-4978-bf27-b57af4c735fb\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-q67f7" Jun 08 13:50:57.869159 ip-10-0-140-46 kubenswrapper[2576]: I0608 13:50:57.869137 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/2ca0c9f7-49fb-4978-bf27-b57af4c735fb-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-8684c9ff49-q67f7\" (UID: \"2ca0c9f7-49fb-4978-bf27-b57af4c735fb\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-q67f7" Jun 08 13:50:57.878632 ip-10-0-140-46 kubenswrapper[2576]: I0608 13:50:57.878604 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-k96z4\" (UniqueName: \"kubernetes.io/projected/2ca0c9f7-49fb-4978-bf27-b57af4c735fb-kube-api-access-k96z4\") pod \"kuadrant-operator-controller-manager-8684c9ff49-q67f7\" (UID: \"2ca0c9f7-49fb-4978-bf27-b57af4c735fb\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-q67f7" Jun 08 13:50:58.018365 ip-10-0-140-46 kubenswrapper[2576]: I0608 13:50:58.018265 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-q67f7" Jun 08 13:50:58.158848 ip-10-0-140-46 kubenswrapper[2576]: I0608 13:50:58.158821 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-q67f7"] Jun 08 13:50:58.160506 ip-10-0-140-46 kubenswrapper[2576]: W0608 13:50:58.160478 2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2ca0c9f7_49fb_4978_bf27_b57af4c735fb.slice/crio-842c45cbbc89fd2a74140f159afe856e78e09f09dc2fd5d07f24356021a8762f WatchSource:0}: Error finding container 842c45cbbc89fd2a74140f159afe856e78e09f09dc2fd5d07f24356021a8762f: Status 404 returned error can't find the container with id 842c45cbbc89fd2a74140f159afe856e78e09f09dc2fd5d07f24356021a8762f Jun 08 13:50:58.265643 ip-10-0-140-46 kubenswrapper[2576]: I0608 13:50:58.265598 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cx7sn_6e4b50fc-3e91-4f50-b92a-e90919788248/konnectivity-agent/0.log" limit=1024 Jun 08 13:50:58.376073 ip-10-0-140-46 kubenswrapper[2576]: I0608 13:50:58.376039 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-q67f7" event={"ID":"2ca0c9f7-49fb-4978-bf27-b57af4c735fb","Type":"ContainerStarted","Data":"842c45cbbc89fd2a74140f159afe856e78e09f09dc2fd5d07f24356021a8762f"} Jun 08 13:51:00.282583 ip-10-0-140-46 kubenswrapper[2576]: I0608 13:51:00.282522 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cx7sn_6e4b50fc-3e91-4f50-b92a-e90919788248/konnectivity-agent/0.log" limit=1024 Jun 08 13:51:00.492703 ip-10-0-140-46 kubenswrapper[2576]: I0608 13:51:00.492664 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cx7sn_6e4b50fc-3e91-4f50-b92a-e90919788248/konnectivity-agent/0.log" limit=1024 Jun 08 13:51:02.396488 ip-10-0-140-46 kubenswrapper[2576]: I0608 13:51:02.396448 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-q67f7" event={"ID":"2ca0c9f7-49fb-4978-bf27-b57af4c735fb","Type":"ContainerStarted","Data":"d354e91451680adf73964c147f1ff895e702b293ab903b3067004b1c8aed3e05"} Jun 08 13:51:02.396902 ip-10-0-140-46 kubenswrapper[2576]: I0608 13:51:02.396508 2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-q67f7" Jun 08 13:51:02.422430 ip-10-0-140-46 kubenswrapper[2576]: I0608 13:51:02.422369 2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-q67f7" podStartSLOduration=1.748630436 podStartE2EDuration="5.422355658s" totalImagesPullingTime="3.673725222s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-08 13:50:57 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-08 13:51:02.420558428 +0000 UTC m=+430.499887321" watchObservedRunningTime="2026-06-08 13:51:02.422355658 +0000 UTC m=+430.501684549" Jun 08 13:51:02.905065 ip-10-0-140-46 kubenswrapper[2576]: I0608 13:51:02.905032 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cx7sn_6e4b50fc-3e91-4f50-b92a-e90919788248/konnectivity-agent/0.log" limit=1024 Jun 08 13:51:03.862076 ip-10-0-140-46 kubenswrapper[2576]: I0608 13:51:03.862022 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cx7sn_6e4b50fc-3e91-4f50-b92a-e90919788248/konnectivity-agent/0.log" limit=1024 Jun 08 13:51:03.961864 ip-10-0-140-46 kubenswrapper[2576]: I0608 13:51:03.961823 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cx7sn_6e4b50fc-3e91-4f50-b92a-e90919788248/konnectivity-agent/0.log" limit=1024 Jun 08 13:51:04.263796 ip-10-0-140-46 kubenswrapper[2576]: I0608 13:51:04.263669 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cx7sn_6e4b50fc-3e91-4f50-b92a-e90919788248/konnectivity-agent/0.log" limit=1024 Jun 08 13:51:04.364218 ip-10-0-140-46 kubenswrapper[2576]: I0608 13:51:04.364156 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cx7sn_6e4b50fc-3e91-4f50-b92a-e90919788248/konnectivity-agent/0.log" limit=1024 Jun 08 13:51:04.770813 ip-10-0-140-46 kubenswrapper[2576]: I0608 13:51:04.770778 2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-console-plugin-66b5774985-9klbs"] Jun 08 13:51:04.771715 ip-10-0-140-46 kubenswrapper[2576]: I0608 13:51:04.771686 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cx7sn_6e4b50fc-3e91-4f50-b92a-e90919788248/konnectivity-agent/0.log" limit=1024 Jun 08 13:51:04.777272 ip-10-0-140-46 kubenswrapper[2576]: I0608 13:51:04.777251 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-console-plugin-66b5774985-9klbs" Jun 08 13:51:04.781785 ip-10-0-140-46 kubenswrapper[2576]: I0608 13:51:04.781763 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"plugin-serving-cert\"" Jun 08 13:51:04.781953 ip-10-0-140-46 kubenswrapper[2576]: I0608 13:51:04.781934 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"default-dockercfg-mlhx2\"" Jun 08 13:51:04.782352 ip-10-0-140-46 kubenswrapper[2576]: I0608 13:51:04.782338 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"kuadrant-console-nginx-conf\"" Jun 08 13:51:04.788132 ip-10-0-140-46 kubenswrapper[2576]: I0608 13:51:04.788110 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-console-plugin-66b5774985-9klbs"] Jun 08 13:51:04.828731 ip-10-0-140-46 kubenswrapper[2576]: I0608 13:51:04.828695 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-m2qjb\" (UniqueName: \"kubernetes.io/projected/173f795f-94e7-47e5-968a-c2d6fcf30bb1-kube-api-access-m2qjb\") pod \"kuadrant-console-plugin-66b5774985-9klbs\" (UID: \"173f795f-94e7-47e5-968a-c2d6fcf30bb1\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-9klbs" Jun 08 13:51:04.828900 ip-10-0-140-46 kubenswrapper[2576]: I0608 13:51:04.828755 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/173f795f-94e7-47e5-968a-c2d6fcf30bb1-nginx-conf\") pod \"kuadrant-console-plugin-66b5774985-9klbs\" (UID: \"173f795f-94e7-47e5-968a-c2d6fcf30bb1\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-9klbs" Jun 08 13:51:04.828955 ip-10-0-140-46 kubenswrapper[2576]: I0608 13:51:04.828929 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugin-serving-cert\" (UniqueName: \"kubernetes.io/secret/173f795f-94e7-47e5-968a-c2d6fcf30bb1-plugin-serving-cert\") pod \"kuadrant-console-plugin-66b5774985-9klbs\" (UID: \"173f795f-94e7-47e5-968a-c2d6fcf30bb1\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-9klbs" Jun 08 13:51:04.929694 ip-10-0-140-46 kubenswrapper[2576]: I0608 13:51:04.929650 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugin-serving-cert\" (UniqueName: \"kubernetes.io/secret/173f795f-94e7-47e5-968a-c2d6fcf30bb1-plugin-serving-cert\") pod \"kuadrant-console-plugin-66b5774985-9klbs\" (UID: \"173f795f-94e7-47e5-968a-c2d6fcf30bb1\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-9klbs" Jun 08 13:51:04.930100 ip-10-0-140-46 kubenswrapper[2576]: I0608 13:51:04.929706 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-m2qjb\" (UniqueName: \"kubernetes.io/projected/173f795f-94e7-47e5-968a-c2d6fcf30bb1-kube-api-access-m2qjb\") pod \"kuadrant-console-plugin-66b5774985-9klbs\" (UID: \"173f795f-94e7-47e5-968a-c2d6fcf30bb1\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-9klbs" Jun 08 13:51:04.930100 ip-10-0-140-46 kubenswrapper[2576]: I0608 13:51:04.929756 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/173f795f-94e7-47e5-968a-c2d6fcf30bb1-nginx-conf\") pod \"kuadrant-console-plugin-66b5774985-9klbs\" (UID: \"173f795f-94e7-47e5-968a-c2d6fcf30bb1\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-9klbs" Jun 08 13:51:04.930515 ip-10-0-140-46 kubenswrapper[2576]: I0608 13:51:04.930488 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/173f795f-94e7-47e5-968a-c2d6fcf30bb1-nginx-conf\") pod \"kuadrant-console-plugin-66b5774985-9klbs\" (UID: \"173f795f-94e7-47e5-968a-c2d6fcf30bb1\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-9klbs" Jun 08 13:51:04.932162 ip-10-0-140-46 kubenswrapper[2576]: I0608 13:51:04.932143 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"plugin-serving-cert\" (UniqueName: \"kubernetes.io/secret/173f795f-94e7-47e5-968a-c2d6fcf30bb1-plugin-serving-cert\") pod \"kuadrant-console-plugin-66b5774985-9klbs\" (UID: \"173f795f-94e7-47e5-968a-c2d6fcf30bb1\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-9klbs" Jun 08 13:51:04.950721 ip-10-0-140-46 kubenswrapper[2576]: I0608 13:51:04.950687 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cx7sn_6e4b50fc-3e91-4f50-b92a-e90919788248/konnectivity-agent/0.log" limit=1024 Jun 08 13:51:04.972434 ip-10-0-140-46 kubenswrapper[2576]: I0608 13:51:04.972399 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-m2qjb\" (UniqueName: \"kubernetes.io/projected/173f795f-94e7-47e5-968a-c2d6fcf30bb1-kube-api-access-m2qjb\") pod \"kuadrant-console-plugin-66b5774985-9klbs\" (UID: \"173f795f-94e7-47e5-968a-c2d6fcf30bb1\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-9klbs" Jun 08 13:51:05.087047 ip-10-0-140-46 kubenswrapper[2576]: I0608 13:51:05.087008 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-console-plugin-66b5774985-9klbs" Jun 08 13:51:05.230940 ip-10-0-140-46 kubenswrapper[2576]: I0608 13:51:05.230885 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-console-plugin-66b5774985-9klbs"] Jun 08 13:51:05.233289 ip-10-0-140-46 kubenswrapper[2576]: W0608 13:51:05.233240 2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod173f795f_94e7_47e5_968a_c2d6fcf30bb1.slice/crio-fa440f916a44c2bdcaf2f0c4e32785ce8132c931b6349cc4f7206034e896725b WatchSource:0}: Error finding container fa440f916a44c2bdcaf2f0c4e32785ce8132c931b6349cc4f7206034e896725b: Status 404 returned error can't find the container with id fa440f916a44c2bdcaf2f0c4e32785ce8132c931b6349cc4f7206034e896725b Jun 08 13:51:05.411371 ip-10-0-140-46 kubenswrapper[2576]: I0608 13:51:05.411287 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-console-plugin-66b5774985-9klbs" event={"ID":"173f795f-94e7-47e5-968a-c2d6fcf30bb1","Type":"ContainerStarted","Data":"fa440f916a44c2bdcaf2f0c4e32785ce8132c931b6349cc4f7206034e896725b"} Jun 08 13:51:07.367094 ip-10-0-140-46 kubenswrapper[2576]: I0608 13:51:07.367059 2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/authorino-operator-75cc8d5cb7-4prdd" Jun 08 13:51:08.117738 ip-10-0-140-46 kubenswrapper[2576]: I0608 13:51:08.117681 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cx7sn_6e4b50fc-3e91-4f50-b92a-e90919788248/konnectivity-agent/0.log" limit=1024 Jun 08 13:51:08.213105 ip-10-0-140-46 kubenswrapper[2576]: I0608 13:51:08.213007 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cx7sn_6e4b50fc-3e91-4f50-b92a-e90919788248/konnectivity-agent/0.log" limit=1024 Jun 08 13:51:13.404041 ip-10-0-140-46 kubenswrapper[2576]: I0608 13:51:13.404009 2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-q67f7" Jun 08 13:51:13.503286 ip-10-0-140-46 kubenswrapper[2576]: I0608 13:51:13.503239 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cx7sn_6e4b50fc-3e91-4f50-b92a-e90919788248/konnectivity-agent/0.log" limit=1024 Jun 08 13:51:15.239997 ip-10-0-140-46 kubenswrapper[2576]: I0608 13:51:15.239960 2576 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-q67f7"] Jun 08 13:51:15.240452 ip-10-0-140-46 kubenswrapper[2576]: I0608 13:51:15.240176 2576 kuberuntime_container.go:872] "Killing container with a grace period" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-q67f7" podUID="2ca0c9f7-49fb-4978-bf27-b57af4c735fb" containerName="manager" containerID="cri-o://d354e91451680adf73964c147f1ff895e702b293ab903b3067004b1c8aed3e05" gracePeriod=2 Jun 08 13:51:15.251988 ip-10-0-140-46 kubenswrapper[2576]: I0608 13:51:15.251913 2576 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-q67f7"] Jun 08 13:51:15.298024 ip-10-0-140-46 kubenswrapper[2576]: I0608 13:51:15.297986 2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-s7tmn"] Jun 08 13:51:15.298479 ip-10-0-140-46 kubenswrapper[2576]: I0608 13:51:15.298460 2576 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="2ca0c9f7-49fb-4978-bf27-b57af4c735fb" containerName="manager" Jun 08 13:51:15.298628 ip-10-0-140-46 kubenswrapper[2576]: I0608 13:51:15.298482 2576 state_mem.go:107] "Deleted CPUSet assignment" podUID="2ca0c9f7-49fb-4978-bf27-b57af4c735fb" containerName="manager" Jun 08 13:51:15.298628 ip-10-0-140-46 kubenswrapper[2576]: I0608 13:51:15.298581 2576 memory_manager.go:368] "RemoveStaleState removing state" podUID="2ca0c9f7-49fb-4978-bf27-b57af4c735fb" containerName="manager" Jun 08 13:51:15.304000 ip-10-0-140-46 kubenswrapper[2576]: I0608 13:51:15.303974 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-s7tmn" Jun 08 13:51:15.307070 ip-10-0-140-46 kubenswrapper[2576]: E0608 13:51:15.307022 2576 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-8684c9ff49-q67f7\" is forbidden: User \"system:node:ip-10-0-140-46.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-140-46.ec2.internal' and this object" podUID="2ca0c9f7-49fb-4978-bf27-b57af4c735fb" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-q67f7" Jun 08 13:51:15.307188 ip-10-0-140-46 kubenswrapper[2576]: I0608 13:51:15.307075 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"limitador-operator-controller-manager-dockercfg-mwcnp\"" Jun 08 13:51:15.323915 ip-10-0-140-46 kubenswrapper[2576]: I0608 13:51:15.323844 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-s7tmn"] Jun 08 13:51:15.390089 ip-10-0-140-46 kubenswrapper[2576]: I0608 13:51:15.390057 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cx7sn_6e4b50fc-3e91-4f50-b92a-e90919788248/konnectivity-agent/0.log" limit=1024 Jun 08 13:51:15.428922 ip-10-0-140-46 kubenswrapper[2576]: I0608 13:51:15.428879 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wbxv7\" (UniqueName: \"kubernetes.io/projected/e9249408-a139-46eb-99c1-94e45fa47197-kube-api-access-wbxv7\") pod \"limitador-operator-controller-manager-859d7b78bd-s7tmn\" (UID: \"e9249408-a139-46eb-99c1-94e45fa47197\") " pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-s7tmn" Jun 08 13:51:15.495730 ip-10-0-140-46 kubenswrapper[2576]: I0608 13:51:15.495640 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cx7sn_6e4b50fc-3e91-4f50-b92a-e90919788248/konnectivity-agent/0.log" limit=1024 Jun 08 13:51:15.529881 ip-10-0-140-46 kubenswrapper[2576]: I0608 13:51:15.529843 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wbxv7\" (UniqueName: \"kubernetes.io/projected/e9249408-a139-46eb-99c1-94e45fa47197-kube-api-access-wbxv7\") pod \"limitador-operator-controller-manager-859d7b78bd-s7tmn\" (UID: \"e9249408-a139-46eb-99c1-94e45fa47197\") " pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-s7tmn" Jun 08 13:51:15.544673 ip-10-0-140-46 kubenswrapper[2576]: I0608 13:51:15.544643 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-wbxv7\" (UniqueName: \"kubernetes.io/projected/e9249408-a139-46eb-99c1-94e45fa47197-kube-api-access-wbxv7\") pod \"limitador-operator-controller-manager-859d7b78bd-s7tmn\" (UID: \"e9249408-a139-46eb-99c1-94e45fa47197\") " pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-s7tmn" Jun 08 13:51:15.648856 ip-10-0-140-46 kubenswrapper[2576]: I0608 13:51:15.648809 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-s7tmn" Jun 08 13:51:20.089879 ip-10-0-140-46 kubenswrapper[2576]: I0608 13:51:20.089804 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cx7sn_6e4b50fc-3e91-4f50-b92a-e90919788248/konnectivity-agent/0.log" limit=1024 Jun 08 13:51:20.207810 ip-10-0-140-46 kubenswrapper[2576]: I0608 13:51:20.207773 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cx7sn_6e4b50fc-3e91-4f50-b92a-e90919788248/konnectivity-agent/0.log" limit=1024 Jun 08 13:51:23.876753 ip-10-0-140-46 kubenswrapper[2576]: I0608 13:51:23.876697 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cx7sn_6e4b50fc-3e91-4f50-b92a-e90919788248/konnectivity-agent/0.log" limit=1024 Jun 08 13:51:23.968297 ip-10-0-140-46 kubenswrapper[2576]: I0608 13:51:23.968262 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cx7sn_6e4b50fc-3e91-4f50-b92a-e90919788248/konnectivity-agent/0.log" limit=1024 Jun 08 13:51:24.150651 ip-10-0-140-46 kubenswrapper[2576]: I0608 13:51:24.150548 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cx7sn_6e4b50fc-3e91-4f50-b92a-e90919788248/konnectivity-agent/0.log" limit=1024 Jun 08 13:51:24.240795 ip-10-0-140-46 kubenswrapper[2576]: I0608 13:51:24.240740 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cx7sn_6e4b50fc-3e91-4f50-b92a-e90919788248/konnectivity-agent/0.log" limit=1024 Jun 08 13:51:26.055309 ip-10-0-140-46 kubenswrapper[2576]: I0608 13:51:26.055278 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-s7tmn"] Jun 08 13:51:26.056763 ip-10-0-140-46 kubenswrapper[2576]: W0608 13:51:26.056742 2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode9249408_a139_46eb_99c1_94e45fa47197.slice/crio-007a539c9bdb58872030bcad6ed51a8b28b136b119c3be53ef814474397f852d WatchSource:0}: Error finding container 007a539c9bdb58872030bcad6ed51a8b28b136b119c3be53ef814474397f852d: Status 404 returned error can't find the container with id 007a539c9bdb58872030bcad6ed51a8b28b136b119c3be53ef814474397f852d Jun 08 13:51:26.062490 ip-10-0-140-46 kubenswrapper[2576]: I0608 13:51:26.062468 2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-q67f7" Jun 08 13:51:26.066217 ip-10-0-140-46 kubenswrapper[2576]: E0608 13:51:26.066192 2576 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-8684c9ff49-q67f7\" is forbidden: User \"system:node:ip-10-0-140-46.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-140-46.ec2.internal' and this object" podUID="2ca0c9f7-49fb-4978-bf27-b57af4c735fb" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-q67f7" Jun 08 13:51:26.131938 ip-10-0-140-46 kubenswrapper[2576]: I0608 13:51:26.131901 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/2ca0c9f7-49fb-4978-bf27-b57af4c735fb-extensions-socket-volume\") pod \"2ca0c9f7-49fb-4978-bf27-b57af4c735fb\" (UID: \"2ca0c9f7-49fb-4978-bf27-b57af4c735fb\") " Jun 08 13:51:26.132120 ip-10-0-140-46 kubenswrapper[2576]: I0608 13:51:26.131997 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-k96z4\" (UniqueName: \"kubernetes.io/projected/2ca0c9f7-49fb-4978-bf27-b57af4c735fb-kube-api-access-k96z4\") pod \"2ca0c9f7-49fb-4978-bf27-b57af4c735fb\" (UID: \"2ca0c9f7-49fb-4978-bf27-b57af4c735fb\") " Jun 08 13:51:26.132495 ip-10-0-140-46 kubenswrapper[2576]: I0608 13:51:26.132464 2576 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/2ca0c9f7-49fb-4978-bf27-b57af4c735fb-extensions-socket-volume" (OuterVolumeSpecName: "extensions-socket-volume") pod "2ca0c9f7-49fb-4978-bf27-b57af4c735fb" (UID: "2ca0c9f7-49fb-4978-bf27-b57af4c735fb"). InnerVolumeSpecName "extensions-socket-volume". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 08 13:51:26.134210 ip-10-0-140-46 kubenswrapper[2576]: I0608 13:51:26.134188 2576 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/2ca0c9f7-49fb-4978-bf27-b57af4c735fb-kube-api-access-k96z4" (OuterVolumeSpecName: "kube-api-access-k96z4") pod "2ca0c9f7-49fb-4978-bf27-b57af4c735fb" (UID: "2ca0c9f7-49fb-4978-bf27-b57af4c735fb"). InnerVolumeSpecName "kube-api-access-k96z4". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 08 13:51:26.232645 ip-10-0-140-46 kubenswrapper[2576]: I0608 13:51:26.232531 2576 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-k96z4\" (UniqueName: \"kubernetes.io/projected/2ca0c9f7-49fb-4978-bf27-b57af4c735fb-kube-api-access-k96z4\") on node \"ip-10-0-140-46.ec2.internal\" DevicePath \"\"" Jun 08 13:51:26.232645 ip-10-0-140-46 kubenswrapper[2576]: I0608 13:51:26.232559 2576 reconciler_common.go:299] "Volume detached for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/2ca0c9f7-49fb-4978-bf27-b57af4c735fb-extensions-socket-volume\") on node \"ip-10-0-140-46.ec2.internal\" DevicePath \"\"" Jun 08 13:51:26.377760 ip-10-0-140-46 kubenswrapper[2576]: I0608 13:51:26.377727 2576 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="2ca0c9f7-49fb-4978-bf27-b57af4c735fb" path="/var/lib/kubelet/pods/2ca0c9f7-49fb-4978-bf27-b57af4c735fb/volumes" Jun 08 13:51:26.551736 ip-10-0-140-46 kubenswrapper[2576]: I0608 13:51:26.551696 2576 generic.go:356] "Generic (PLEG): container finished" podID="2ca0c9f7-49fb-4978-bf27-b57af4c735fb" containerID="d354e91451680adf73964c147f1ff895e702b293ab903b3067004b1c8aed3e05" exitCode=0 Jun 08 13:51:26.551936 ip-10-0-140-46 kubenswrapper[2576]: I0608 13:51:26.551744 2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-q67f7" Jun 08 13:51:26.551936 ip-10-0-140-46 kubenswrapper[2576]: I0608 13:51:26.551776 2576 scope.go:117] "RemoveContainer" containerID="d354e91451680adf73964c147f1ff895e702b293ab903b3067004b1c8aed3e05" Jun 08 13:51:26.553386 ip-10-0-140-46 kubenswrapper[2576]: I0608 13:51:26.553361 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-s7tmn" event={"ID":"e9249408-a139-46eb-99c1-94e45fa47197","Type":"ContainerStarted","Data":"007a539c9bdb58872030bcad6ed51a8b28b136b119c3be53ef814474397f852d"} Jun 08 13:51:26.554348 ip-10-0-140-46 kubenswrapper[2576]: E0608 13:51:26.554316 2576 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-8684c9ff49-q67f7\" is forbidden: User \"system:node:ip-10-0-140-46.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-140-46.ec2.internal' and this object" podUID="2ca0c9f7-49fb-4978-bf27-b57af4c735fb" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-q67f7" Jun 08 13:51:26.555456 ip-10-0-140-46 kubenswrapper[2576]: I0608 13:51:26.555429 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-console-plugin-66b5774985-9klbs" event={"ID":"173f795f-94e7-47e5-968a-c2d6fcf30bb1","Type":"ContainerStarted","Data":"aa4ea8ab2605d40168ee03d529556e6c5679042ec61062cee8c155ead5f6efd9"} Jun 08 13:51:26.556730 ip-10-0-140-46 kubenswrapper[2576]: E0608 13:51:26.556705 2576 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-8684c9ff49-q67f7\" is forbidden: User \"system:node:ip-10-0-140-46.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-140-46.ec2.internal' and this object" podUID="2ca0c9f7-49fb-4978-bf27-b57af4c735fb" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-q67f7" Jun 08 13:51:26.578122 ip-10-0-140-46 kubenswrapper[2576]: I0608 13:51:26.578072 2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-console-plugin-66b5774985-9klbs" podStartSLOduration=1.802817588 podStartE2EDuration="22.578055589s" totalImagesPullingTime="20.775238001s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-08 13:51:04 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-08 13:51:26.576860009 +0000 UTC m=+454.656188901" watchObservedRunningTime="2026-06-08 13:51:26.578055589 +0000 UTC m=+454.657384481" Jun 08 13:51:26.578863 ip-10-0-140-46 kubenswrapper[2576]: E0608 13:51:26.578832 2576 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-8684c9ff49-q67f7\" is forbidden: User \"system:node:ip-10-0-140-46.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-140-46.ec2.internal' and this object" podUID="2ca0c9f7-49fb-4978-bf27-b57af4c735fb" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-q67f7" Jun 08 13:51:26.579930 ip-10-0-140-46 kubenswrapper[2576]: I0608 13:51:26.579901 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cx7sn_6e4b50fc-3e91-4f50-b92a-e90919788248/konnectivity-agent/0.log" limit=1024 Jun 08 13:51:26.623127 ip-10-0-140-46 kubenswrapper[2576]: I0608 13:51:26.623102 2576 scope.go:117] "RemoveContainer" containerID="d354e91451680adf73964c147f1ff895e702b293ab903b3067004b1c8aed3e05" Jun 08 13:51:26.623454 ip-10-0-140-46 kubenswrapper[2576]: E0608 13:51:26.623434 2576 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"d354e91451680adf73964c147f1ff895e702b293ab903b3067004b1c8aed3e05\": container with ID starting with d354e91451680adf73964c147f1ff895e702b293ab903b3067004b1c8aed3e05 not found: ID does not exist" containerID="d354e91451680adf73964c147f1ff895e702b293ab903b3067004b1c8aed3e05" Jun 08 13:51:26.623507 ip-10-0-140-46 kubenswrapper[2576]: I0608 13:51:26.623463 2576 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"d354e91451680adf73964c147f1ff895e702b293ab903b3067004b1c8aed3e05"} err="failed to get container status \"d354e91451680adf73964c147f1ff895e702b293ab903b3067004b1c8aed3e05\": rpc error: code = NotFound desc = could not find container \"d354e91451680adf73964c147f1ff895e702b293ab903b3067004b1c8aed3e05\": container with ID starting with d354e91451680adf73964c147f1ff895e702b293ab903b3067004b1c8aed3e05 not found: ID does not exist" Jun 08 13:51:26.669434 ip-10-0-140-46 kubenswrapper[2576]: I0608 13:51:26.669380 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cx7sn_6e4b50fc-3e91-4f50-b92a-e90919788248/konnectivity-agent/0.log" limit=1024 Jun 08 13:51:27.564117 ip-10-0-140-46 kubenswrapper[2576]: I0608 13:51:27.564078 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-s7tmn" event={"ID":"e9249408-a139-46eb-99c1-94e45fa47197","Type":"ContainerStarted","Data":"b0e6b697bba01ce5aefb90d6cfd89fbe6d6ae5899828ba9d69e3804fddebeb4e"} Jun 08 13:51:27.564591 ip-10-0-140-46 kubenswrapper[2576]: I0608 13:51:27.564286 2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-s7tmn" Jun 08 13:51:27.566801 ip-10-0-140-46 kubenswrapper[2576]: E0608 13:51:27.566780 2576 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-8684c9ff49-q67f7\" is forbidden: User \"system:node:ip-10-0-140-46.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-140-46.ec2.internal' and this object" podUID="2ca0c9f7-49fb-4978-bf27-b57af4c735fb" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-q67f7" Jun 08 13:51:27.618871 ip-10-0-140-46 kubenswrapper[2576]: I0608 13:51:27.618820 2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-s7tmn" podStartSLOduration=11.299222964 podStartE2EDuration="12.618803806s" totalImagesPullingTime="1.319580842s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-08 13:51:15 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-08 13:51:27.609711995 +0000 UTC m=+455.689040886" watchObservedRunningTime="2026-06-08 13:51:27.618803806 +0000 UTC m=+455.698132698" Jun 08 13:51:32.354193 ip-10-0-140-46 kubenswrapper[2576]: I0608 13:51:32.354150 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cx7sn_6e4b50fc-3e91-4f50-b92a-e90919788248/konnectivity-agent/0.log" limit=1024 Jun 08 13:51:32.456938 ip-10-0-140-46 kubenswrapper[2576]: I0608 13:51:32.456898 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cx7sn_6e4b50fc-3e91-4f50-b92a-e90919788248/konnectivity-agent/0.log" limit=1024 Jun 08 13:51:33.094772 ip-10-0-140-46 kubenswrapper[2576]: I0608 13:51:33.094731 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cx7sn_6e4b50fc-3e91-4f50-b92a-e90919788248/konnectivity-agent/0.log" limit=1024 Jun 08 13:51:33.196508 ip-10-0-140-46 kubenswrapper[2576]: I0608 13:51:33.196474 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cx7sn_6e4b50fc-3e91-4f50-b92a-e90919788248/konnectivity-agent/0.log" limit=1024 Jun 08 13:51:37.861260 ip-10-0-140-46 kubenswrapper[2576]: I0608 13:51:37.861210 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cx7sn_6e4b50fc-3e91-4f50-b92a-e90919788248/konnectivity-agent/0.log" limit=1024 Jun 08 13:51:37.949701 ip-10-0-140-46 kubenswrapper[2576]: I0608 13:51:37.949667 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cx7sn_6e4b50fc-3e91-4f50-b92a-e90919788248/konnectivity-agent/0.log" limit=1024 Jun 08 13:51:38.570525 ip-10-0-140-46 kubenswrapper[2576]: I0608 13:51:38.570496 2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-s7tmn" Jun 08 13:51:47.820060 ip-10-0-140-46 kubenswrapper[2576]: I0608 13:51:47.820016 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cx7sn_6e4b50fc-3e91-4f50-b92a-e90919788248/konnectivity-agent/0.log" limit=1024 Jun 08 13:51:47.922951 ip-10-0-140-46 kubenswrapper[2576]: I0608 13:51:47.922913 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cx7sn_6e4b50fc-3e91-4f50-b92a-e90919788248/konnectivity-agent/0.log" limit=1024 Jun 08 13:51:50.762747 ip-10-0-140-46 kubenswrapper[2576]: I0608 13:51:50.762714 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cx7sn_6e4b50fc-3e91-4f50-b92a-e90919788248/konnectivity-agent/0.log" limit=1024 Jun 08 13:51:50.977475 ip-10-0-140-46 kubenswrapper[2576]: I0608 13:51:50.977434 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cx7sn_6e4b50fc-3e91-4f50-b92a-e90919788248/konnectivity-agent/0.log" limit=1024 Jun 08 13:51:51.079428 ip-10-0-140-46 kubenswrapper[2576]: I0608 13:51:51.079395 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cx7sn_6e4b50fc-3e91-4f50-b92a-e90919788248/konnectivity-agent/0.log" limit=1024 Jun 08 13:51:52.018254 ip-10-0-140-46 kubenswrapper[2576]: I0608 13:51:52.018213 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cx7sn_6e4b50fc-3e91-4f50-b92a-e90919788248/konnectivity-agent/0.log" limit=1024 Jun 08 13:51:52.146885 ip-10-0-140-46 kubenswrapper[2576]: I0608 13:51:52.146854 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cx7sn_6e4b50fc-3e91-4f50-b92a-e90919788248/konnectivity-agent/0.log" limit=1024 Jun 08 13:51:52.229173 ip-10-0-140-46 kubenswrapper[2576]: I0608 13:51:52.229121 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cx7sn_6e4b50fc-3e91-4f50-b92a-e90919788248/konnectivity-agent/0.log" limit=1024 Jun 08 13:51:52.979910 ip-10-0-140-46 kubenswrapper[2576]: I0608 13:51:52.979873 2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-58cd955675-csmxk"] Jun 08 13:51:53.005078 ip-10-0-140-46 kubenswrapper[2576]: I0608 13:51:53.005028 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cx7sn_6e4b50fc-3e91-4f50-b92a-e90919788248/konnectivity-agent/0.log" limit=1024 Jun 08 13:51:53.104928 ip-10-0-140-46 kubenswrapper[2576]: I0608 13:51:53.104895 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cx7sn_6e4b50fc-3e91-4f50-b92a-e90919788248/konnectivity-agent/0.log" limit=1024 Jun 08 13:51:53.126823 ip-10-0-140-46 kubenswrapper[2576]: I0608 13:51:53.126788 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-58cd955675-csmxk"] Jun 08 13:51:53.127003 ip-10-0-140-46 kubenswrapper[2576]: I0608 13:51:53.126903 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-58cd955675-csmxk" Jun 08 13:51:53.129407 ip-10-0-140-46 kubenswrapper[2576]: I0608 13:51:53.129380 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"authorino-authorino-dockercfg-cfzz6\"" Jun 08 13:51:53.161768 ip-10-0-140-46 kubenswrapper[2576]: I0608 13:51:53.161733 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hqjzl\" (UniqueName: \"kubernetes.io/projected/04cbb06b-a6d3-4ecd-bd14-7533c9c7858a-kube-api-access-hqjzl\") pod \"authorino-58cd955675-csmxk\" (UID: \"04cbb06b-a6d3-4ecd-bd14-7533c9c7858a\") " pod="kuadrant-system/authorino-58cd955675-csmxk" Jun 08 13:51:53.212445 ip-10-0-140-46 kubenswrapper[2576]: I0608 13:51:53.212404 2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-75d556bd77-kt9vt"] Jun 08 13:51:53.262404 ip-10-0-140-46 kubenswrapper[2576]: I0608 13:51:53.262324 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hqjzl\" (UniqueName: \"kubernetes.io/projected/04cbb06b-a6d3-4ecd-bd14-7533c9c7858a-kube-api-access-hqjzl\") pod \"authorino-58cd955675-csmxk\" (UID: \"04cbb06b-a6d3-4ecd-bd14-7533c9c7858a\") " pod="kuadrant-system/authorino-58cd955675-csmxk" Jun 08 13:51:53.268185 ip-10-0-140-46 kubenswrapper[2576]: I0608 13:51:53.268150 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-75d556bd77-kt9vt"] Jun 08 13:51:53.268328 ip-10-0-140-46 kubenswrapper[2576]: I0608 13:51:53.268251 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-75d556bd77-kt9vt" Jun 08 13:51:53.272435 ip-10-0-140-46 kubenswrapper[2576]: I0608 13:51:53.272408 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-hqjzl\" (UniqueName: \"kubernetes.io/projected/04cbb06b-a6d3-4ecd-bd14-7533c9c7858a-kube-api-access-hqjzl\") pod \"authorino-58cd955675-csmxk\" (UID: \"04cbb06b-a6d3-4ecd-bd14-7533c9c7858a\") " pod="kuadrant-system/authorino-58cd955675-csmxk" Jun 08 13:51:53.363706 ip-10-0-140-46 kubenswrapper[2576]: I0608 13:51:53.363661 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xkpck\" (UniqueName: \"kubernetes.io/projected/c78f6737-714c-4498-9b6b-8454c04a9d91-kube-api-access-xkpck\") pod \"authorino-75d556bd77-kt9vt\" (UID: \"c78f6737-714c-4498-9b6b-8454c04a9d91\") " pod="kuadrant-system/authorino-75d556bd77-kt9vt" Jun 08 13:51:53.443318 ip-10-0-140-46 kubenswrapper[2576]: I0608 13:51:53.443282 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-58cd955675-csmxk" Jun 08 13:51:53.464533 ip-10-0-140-46 kubenswrapper[2576]: I0608 13:51:53.464495 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xkpck\" (UniqueName: \"kubernetes.io/projected/c78f6737-714c-4498-9b6b-8454c04a9d91-kube-api-access-xkpck\") pod \"authorino-75d556bd77-kt9vt\" (UID: \"c78f6737-714c-4498-9b6b-8454c04a9d91\") " pod="kuadrant-system/authorino-75d556bd77-kt9vt" Jun 08 13:51:53.481385 ip-10-0-140-46 kubenswrapper[2576]: I0608 13:51:53.481333 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-xkpck\" (UniqueName: \"kubernetes.io/projected/c78f6737-714c-4498-9b6b-8454c04a9d91-kube-api-access-xkpck\") pod \"authorino-75d556bd77-kt9vt\" (UID: \"c78f6737-714c-4498-9b6b-8454c04a9d91\") " pod="kuadrant-system/authorino-75d556bd77-kt9vt" Jun 08 13:51:53.585706 ip-10-0-140-46 kubenswrapper[2576]: I0608 13:51:53.585671 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-75d556bd77-kt9vt" Jun 08 13:51:53.595826 ip-10-0-140-46 kubenswrapper[2576]: I0608 13:51:53.595801 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-58cd955675-csmxk"] Jun 08 13:51:53.599923 ip-10-0-140-46 kubenswrapper[2576]: W0608 13:51:53.599890 2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod04cbb06b_a6d3_4ecd_bd14_7533c9c7858a.slice/crio-3c5ffa16c013a15a2005d5bab790623984f46bd6a8063066c71d77b3c526c22d WatchSource:0}: Error finding container 3c5ffa16c013a15a2005d5bab790623984f46bd6a8063066c71d77b3c526c22d: Status 404 returned error can't find the container with id 3c5ffa16c013a15a2005d5bab790623984f46bd6a8063066c71d77b3c526c22d Jun 08 13:51:53.699026 ip-10-0-140-46 kubenswrapper[2576]: I0608 13:51:53.698778 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-58cd955675-csmxk" event={"ID":"04cbb06b-a6d3-4ecd-bd14-7533c9c7858a","Type":"ContainerStarted","Data":"3c5ffa16c013a15a2005d5bab790623984f46bd6a8063066c71d77b3c526c22d"} Jun 08 13:51:53.741896 ip-10-0-140-46 kubenswrapper[2576]: I0608 13:51:53.741866 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-75d556bd77-kt9vt"] Jun 08 13:51:53.744482 ip-10-0-140-46 kubenswrapper[2576]: W0608 13:51:53.744451 2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podc78f6737_714c_4498_9b6b_8454c04a9d91.slice/crio-bb24a15be48f4d550711aeaa6b4f818ec67891de33edd01ad90537de5fb21bf6 WatchSource:0}: Error finding container bb24a15be48f4d550711aeaa6b4f818ec67891de33edd01ad90537de5fb21bf6: Status 404 returned error can't find the container with id bb24a15be48f4d550711aeaa6b4f818ec67891de33edd01ad90537de5fb21bf6 Jun 08 13:51:54.707058 ip-10-0-140-46 kubenswrapper[2576]: I0608 13:51:54.707017 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-75d556bd77-kt9vt" event={"ID":"c78f6737-714c-4498-9b6b-8454c04a9d91","Type":"ContainerStarted","Data":"bb24a15be48f4d550711aeaa6b4f818ec67891de33edd01ad90537de5fb21bf6"} Jun 08 13:51:57.817953 ip-10-0-140-46 kubenswrapper[2576]: I0608 13:51:57.817917 2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-77b74bd885-sbktd"] Jun 08 13:51:57.820211 ip-10-0-140-46 kubenswrapper[2576]: I0608 13:51:57.820194 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-77b74bd885-sbktd" Jun 08 13:51:57.840257 ip-10-0-140-46 kubenswrapper[2576]: I0608 13:51:57.840226 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-77b74bd885-sbktd"] Jun 08 13:51:57.874638 ip-10-0-140-46 kubenswrapper[2576]: I0608 13:51:57.874603 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cx7sn_6e4b50fc-3e91-4f50-b92a-e90919788248/konnectivity-agent/0.log" limit=1024 Jun 08 13:51:57.905965 ip-10-0-140-46 kubenswrapper[2576]: I0608 13:51:57.905941 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/37c08b1e-6524-4cf5-a776-f0625505ebf5-console-config\") pod \"console-77b74bd885-sbktd\" (UID: \"37c08b1e-6524-4cf5-a776-f0625505ebf5\") " pod="openshift-console/console-77b74bd885-sbktd" Jun 08 13:51:57.906059 ip-10-0-140-46 kubenswrapper[2576]: I0608 13:51:57.905978 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/37c08b1e-6524-4cf5-a776-f0625505ebf5-console-oauth-config\") pod \"console-77b74bd885-sbktd\" (UID: \"37c08b1e-6524-4cf5-a776-f0625505ebf5\") " pod="openshift-console/console-77b74bd885-sbktd" Jun 08 13:51:57.906059 ip-10-0-140-46 kubenswrapper[2576]: I0608 13:51:57.906019 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/37c08b1e-6524-4cf5-a776-f0625505ebf5-console-serving-cert\") pod \"console-77b74bd885-sbktd\" (UID: \"37c08b1e-6524-4cf5-a776-f0625505ebf5\") " pod="openshift-console/console-77b74bd885-sbktd" Jun 08 13:51:57.906132 ip-10-0-140-46 kubenswrapper[2576]: I0608 13:51:57.906069 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-s4jpc\" (UniqueName: \"kubernetes.io/projected/37c08b1e-6524-4cf5-a776-f0625505ebf5-kube-api-access-s4jpc\") pod \"console-77b74bd885-sbktd\" (UID: \"37c08b1e-6524-4cf5-a776-f0625505ebf5\") " pod="openshift-console/console-77b74bd885-sbktd" Jun 08 13:51:57.906132 ip-10-0-140-46 kubenswrapper[2576]: I0608 13:51:57.906098 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/37c08b1e-6524-4cf5-a776-f0625505ebf5-trusted-ca-bundle\") pod \"console-77b74bd885-sbktd\" (UID: \"37c08b1e-6524-4cf5-a776-f0625505ebf5\") " pod="openshift-console/console-77b74bd885-sbktd" Jun 08 13:51:57.906198 ip-10-0-140-46 kubenswrapper[2576]: I0608 13:51:57.906147 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/37c08b1e-6524-4cf5-a776-f0625505ebf5-service-ca\") pod \"console-77b74bd885-sbktd\" (UID: \"37c08b1e-6524-4cf5-a776-f0625505ebf5\") " pod="openshift-console/console-77b74bd885-sbktd" Jun 08 13:51:57.906198 ip-10-0-140-46 kubenswrapper[2576]: I0608 13:51:57.906168 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/37c08b1e-6524-4cf5-a776-f0625505ebf5-oauth-serving-cert\") pod \"console-77b74bd885-sbktd\" (UID: \"37c08b1e-6524-4cf5-a776-f0625505ebf5\") " pod="openshift-console/console-77b74bd885-sbktd" Jun 08 13:51:58.007284 ip-10-0-140-46 kubenswrapper[2576]: I0608 13:51:58.007244 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/37c08b1e-6524-4cf5-a776-f0625505ebf5-console-serving-cert\") pod \"console-77b74bd885-sbktd\" (UID: \"37c08b1e-6524-4cf5-a776-f0625505ebf5\") " pod="openshift-console/console-77b74bd885-sbktd" Jun 08 13:51:58.007487 ip-10-0-140-46 kubenswrapper[2576]: I0608 13:51:58.007291 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-s4jpc\" (UniqueName: \"kubernetes.io/projected/37c08b1e-6524-4cf5-a776-f0625505ebf5-kube-api-access-s4jpc\") pod \"console-77b74bd885-sbktd\" (UID: \"37c08b1e-6524-4cf5-a776-f0625505ebf5\") " pod="openshift-console/console-77b74bd885-sbktd" Jun 08 13:51:58.007487 ip-10-0-140-46 kubenswrapper[2576]: I0608 13:51:58.007316 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/37c08b1e-6524-4cf5-a776-f0625505ebf5-trusted-ca-bundle\") pod \"console-77b74bd885-sbktd\" (UID: \"37c08b1e-6524-4cf5-a776-f0625505ebf5\") " pod="openshift-console/console-77b74bd885-sbktd" Jun 08 13:51:58.007487 ip-10-0-140-46 kubenswrapper[2576]: I0608 13:51:58.007363 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/37c08b1e-6524-4cf5-a776-f0625505ebf5-service-ca\") pod \"console-77b74bd885-sbktd\" (UID: \"37c08b1e-6524-4cf5-a776-f0625505ebf5\") " pod="openshift-console/console-77b74bd885-sbktd" Jun 08 13:51:58.007487 ip-10-0-140-46 kubenswrapper[2576]: I0608 13:51:58.007389 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/37c08b1e-6524-4cf5-a776-f0625505ebf5-oauth-serving-cert\") pod \"console-77b74bd885-sbktd\" (UID: \"37c08b1e-6524-4cf5-a776-f0625505ebf5\") " pod="openshift-console/console-77b74bd885-sbktd" Jun 08 13:51:58.007487 ip-10-0-140-46 kubenswrapper[2576]: I0608 13:51:58.007430 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/37c08b1e-6524-4cf5-a776-f0625505ebf5-console-config\") pod \"console-77b74bd885-sbktd\" (UID: \"37c08b1e-6524-4cf5-a776-f0625505ebf5\") " pod="openshift-console/console-77b74bd885-sbktd" Jun 08 13:51:58.007487 ip-10-0-140-46 kubenswrapper[2576]: I0608 13:51:58.007463 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/37c08b1e-6524-4cf5-a776-f0625505ebf5-console-oauth-config\") pod \"console-77b74bd885-sbktd\" (UID: \"37c08b1e-6524-4cf5-a776-f0625505ebf5\") " pod="openshift-console/console-77b74bd885-sbktd" Jun 08 13:51:58.008487 ip-10-0-140-46 kubenswrapper[2576]: I0608 13:51:58.008409 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/37c08b1e-6524-4cf5-a776-f0625505ebf5-service-ca\") pod \"console-77b74bd885-sbktd\" (UID: \"37c08b1e-6524-4cf5-a776-f0625505ebf5\") " pod="openshift-console/console-77b74bd885-sbktd" Jun 08 13:51:58.008641 ip-10-0-140-46 kubenswrapper[2576]: I0608 13:51:58.008537 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/37c08b1e-6524-4cf5-a776-f0625505ebf5-oauth-serving-cert\") pod \"console-77b74bd885-sbktd\" (UID: \"37c08b1e-6524-4cf5-a776-f0625505ebf5\") " pod="openshift-console/console-77b74bd885-sbktd" Jun 08 13:51:58.008726 ip-10-0-140-46 kubenswrapper[2576]: I0608 13:51:58.008643 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/37c08b1e-6524-4cf5-a776-f0625505ebf5-console-config\") pod \"console-77b74bd885-sbktd\" (UID: \"37c08b1e-6524-4cf5-a776-f0625505ebf5\") " pod="openshift-console/console-77b74bd885-sbktd" Jun 08 13:51:58.008785 ip-10-0-140-46 kubenswrapper[2576]: I0608 13:51:58.008731 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/37c08b1e-6524-4cf5-a776-f0625505ebf5-trusted-ca-bundle\") pod \"console-77b74bd885-sbktd\" (UID: \"37c08b1e-6524-4cf5-a776-f0625505ebf5\") " pod="openshift-console/console-77b74bd885-sbktd" Jun 08 13:51:58.010245 ip-10-0-140-46 kubenswrapper[2576]: I0608 13:51:58.010217 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/37c08b1e-6524-4cf5-a776-f0625505ebf5-console-serving-cert\") pod \"console-77b74bd885-sbktd\" (UID: \"37c08b1e-6524-4cf5-a776-f0625505ebf5\") " pod="openshift-console/console-77b74bd885-sbktd" Jun 08 13:51:58.010395 ip-10-0-140-46 kubenswrapper[2576]: I0608 13:51:58.010371 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/37c08b1e-6524-4cf5-a776-f0625505ebf5-console-oauth-config\") pod \"console-77b74bd885-sbktd\" (UID: \"37c08b1e-6524-4cf5-a776-f0625505ebf5\") " pod="openshift-console/console-77b74bd885-sbktd" Jun 08 13:51:58.022476 ip-10-0-140-46 kubenswrapper[2576]: I0608 13:51:58.022442 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-s4jpc\" (UniqueName: \"kubernetes.io/projected/37c08b1e-6524-4cf5-a776-f0625505ebf5-kube-api-access-s4jpc\") pod \"console-77b74bd885-sbktd\" (UID: \"37c08b1e-6524-4cf5-a776-f0625505ebf5\") " pod="openshift-console/console-77b74bd885-sbktd" Jun 08 13:51:58.130104 ip-10-0-140-46 kubenswrapper[2576]: I0608 13:51:58.130007 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-77b74bd885-sbktd" Jun 08 13:51:58.267619 ip-10-0-140-46 kubenswrapper[2576]: I0608 13:51:58.267587 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-77b74bd885-sbktd"] Jun 08 13:51:58.268949 ip-10-0-140-46 kubenswrapper[2576]: W0608 13:51:58.268917 2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod37c08b1e_6524_4cf5_a776_f0625505ebf5.slice/crio-3c73f30e95a55b8d57627772d2a0808d0687e3ad28936550ffe19c8342609b4f WatchSource:0}: Error finding container 3c73f30e95a55b8d57627772d2a0808d0687e3ad28936550ffe19c8342609b4f: Status 404 returned error can't find the container with id 3c73f30e95a55b8d57627772d2a0808d0687e3ad28936550ffe19c8342609b4f Jun 08 13:51:58.733648 ip-10-0-140-46 kubenswrapper[2576]: I0608 13:51:58.733608 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-77b74bd885-sbktd" event={"ID":"37c08b1e-6524-4cf5-a776-f0625505ebf5","Type":"ContainerStarted","Data":"89c17d963d8507acb26c7a6751f5a7ad230578e01fadd76e7aa71691a061829b"} Jun 08 13:51:58.733854 ip-10-0-140-46 kubenswrapper[2576]: I0608 13:51:58.733658 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-77b74bd885-sbktd" event={"ID":"37c08b1e-6524-4cf5-a776-f0625505ebf5","Type":"ContainerStarted","Data":"3c73f30e95a55b8d57627772d2a0808d0687e3ad28936550ffe19c8342609b4f"} Jun 08 13:51:58.735038 ip-10-0-140-46 kubenswrapper[2576]: I0608 13:51:58.735012 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-58cd955675-csmxk" event={"ID":"04cbb06b-a6d3-4ecd-bd14-7533c9c7858a","Type":"ContainerStarted","Data":"7284e27947791bba7bc864074eeb3a97092dc6ac9f33c3fb37ed5b02ebf7b39c"} Jun 08 13:51:58.736350 ip-10-0-140-46 kubenswrapper[2576]: I0608 13:51:58.736328 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-75d556bd77-kt9vt" event={"ID":"c78f6737-714c-4498-9b6b-8454c04a9d91","Type":"ContainerStarted","Data":"8eedb7fc5df9fa0b4219d7b409664ca9aeee1d32b262e084f33ba357f19383eb"} Jun 08 13:51:58.756054 ip-10-0-140-46 kubenswrapper[2576]: I0608 13:51:58.756002 2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-77b74bd885-sbktd" podStartSLOduration=1.755983827 podStartE2EDuration="1.755983827s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-08 13:51:57 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-08 13:51:58.754118306 +0000 UTC m=+486.833447198" watchObservedRunningTime="2026-06-08 13:51:58.755983827 +0000 UTC m=+486.835312697" Jun 08 13:51:58.771329 ip-10-0-140-46 kubenswrapper[2576]: I0608 13:51:58.771281 2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/authorino-58cd955675-csmxk" podStartSLOduration=2.486783602 podStartE2EDuration="6.771265271s" totalImagesPullingTime="4.284481669s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-08 13:51:52 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-08 13:51:58.770608622 +0000 UTC m=+486.849937515" watchObservedRunningTime="2026-06-08 13:51:58.771265271 +0000 UTC m=+486.850594162" Jun 08 13:51:58.793107 ip-10-0-140-46 kubenswrapper[2576]: I0608 13:51:58.793054 2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/authorino-75d556bd77-kt9vt" podStartSLOduration=1.664151585 podStartE2EDuration="5.79303575s" totalImagesPullingTime="4.128884165s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-08 13:51:53 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-08 13:51:58.790890061 +0000 UTC m=+486.870218954" watchObservedRunningTime="2026-06-08 13:51:58.79303575 +0000 UTC m=+486.872364642" Jun 08 13:51:58.831534 ip-10-0-140-46 kubenswrapper[2576]: I0608 13:51:58.831495 2576 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-58cd955675-csmxk"] Jun 08 13:52:00.747287 ip-10-0-140-46 kubenswrapper[2576]: I0608 13:52:00.747247 2576 kuberuntime_container.go:872] "Killing container with a grace period" pod="kuadrant-system/authorino-58cd955675-csmxk" podUID="04cbb06b-a6d3-4ecd-bd14-7533c9c7858a" containerName="authorino" containerID="cri-o://7284e27947791bba7bc864074eeb3a97092dc6ac9f33c3fb37ed5b02ebf7b39c" gracePeriod=30 Jun 08 13:52:01.030726 ip-10-0-140-46 kubenswrapper[2576]: I0608 13:52:01.030697 2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-58cd955675-csmxk" Jun 08 13:52:01.136378 ip-10-0-140-46 kubenswrapper[2576]: I0608 13:52:01.136339 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-hqjzl\" (UniqueName: \"kubernetes.io/projected/04cbb06b-a6d3-4ecd-bd14-7533c9c7858a-kube-api-access-hqjzl\") pod \"04cbb06b-a6d3-4ecd-bd14-7533c9c7858a\" (UID: \"04cbb06b-a6d3-4ecd-bd14-7533c9c7858a\") " Jun 08 13:52:01.138415 ip-10-0-140-46 kubenswrapper[2576]: I0608 13:52:01.138394 2576 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/04cbb06b-a6d3-4ecd-bd14-7533c9c7858a-kube-api-access-hqjzl" (OuterVolumeSpecName: "kube-api-access-hqjzl") pod "04cbb06b-a6d3-4ecd-bd14-7533c9c7858a" (UID: "04cbb06b-a6d3-4ecd-bd14-7533c9c7858a"). InnerVolumeSpecName "kube-api-access-hqjzl". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 08 13:52:01.237717 ip-10-0-140-46 kubenswrapper[2576]: I0608 13:52:01.237664 2576 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-hqjzl\" (UniqueName: \"kubernetes.io/projected/04cbb06b-a6d3-4ecd-bd14-7533c9c7858a-kube-api-access-hqjzl\") on node \"ip-10-0-140-46.ec2.internal\" DevicePath \"\"" Jun 08 13:52:01.759149 ip-10-0-140-46 kubenswrapper[2576]: I0608 13:52:01.759109 2576 generic.go:356] "Generic (PLEG): container finished" podID="04cbb06b-a6d3-4ecd-bd14-7533c9c7858a" containerID="7284e27947791bba7bc864074eeb3a97092dc6ac9f33c3fb37ed5b02ebf7b39c" exitCode=0 Jun 08 13:52:01.759600 ip-10-0-140-46 kubenswrapper[2576]: I0608 13:52:01.759159 2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-58cd955675-csmxk" Jun 08 13:52:01.759600 ip-10-0-140-46 kubenswrapper[2576]: I0608 13:52:01.759181 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-58cd955675-csmxk" event={"ID":"04cbb06b-a6d3-4ecd-bd14-7533c9c7858a","Type":"ContainerDied","Data":"7284e27947791bba7bc864074eeb3a97092dc6ac9f33c3fb37ed5b02ebf7b39c"} Jun 08 13:52:01.759600 ip-10-0-140-46 kubenswrapper[2576]: I0608 13:52:01.759220 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-58cd955675-csmxk" event={"ID":"04cbb06b-a6d3-4ecd-bd14-7533c9c7858a","Type":"ContainerDied","Data":"3c5ffa16c013a15a2005d5bab790623984f46bd6a8063066c71d77b3c526c22d"} Jun 08 13:52:01.759600 ip-10-0-140-46 kubenswrapper[2576]: I0608 13:52:01.759236 2576 scope.go:117] "RemoveContainer" containerID="7284e27947791bba7bc864074eeb3a97092dc6ac9f33c3fb37ed5b02ebf7b39c" Jun 08 13:52:01.768824 ip-10-0-140-46 kubenswrapper[2576]: I0608 13:52:01.768803 2576 scope.go:117] "RemoveContainer" containerID="7284e27947791bba7bc864074eeb3a97092dc6ac9f33c3fb37ed5b02ebf7b39c" Jun 08 13:52:01.769114 ip-10-0-140-46 kubenswrapper[2576]: E0608 13:52:01.769097 2576 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"7284e27947791bba7bc864074eeb3a97092dc6ac9f33c3fb37ed5b02ebf7b39c\": container with ID starting with 7284e27947791bba7bc864074eeb3a97092dc6ac9f33c3fb37ed5b02ebf7b39c not found: ID does not exist" containerID="7284e27947791bba7bc864074eeb3a97092dc6ac9f33c3fb37ed5b02ebf7b39c" Jun 08 13:52:01.769167 ip-10-0-140-46 kubenswrapper[2576]: I0608 13:52:01.769121 2576 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"7284e27947791bba7bc864074eeb3a97092dc6ac9f33c3fb37ed5b02ebf7b39c"} err="failed to get container status \"7284e27947791bba7bc864074eeb3a97092dc6ac9f33c3fb37ed5b02ebf7b39c\": rpc error: code = NotFound desc = could not find container \"7284e27947791bba7bc864074eeb3a97092dc6ac9f33c3fb37ed5b02ebf7b39c\": container with ID starting with 7284e27947791bba7bc864074eeb3a97092dc6ac9f33c3fb37ed5b02ebf7b39c not found: ID does not exist" Jun 08 13:52:01.790219 ip-10-0-140-46 kubenswrapper[2576]: I0608 13:52:01.790176 2576 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-58cd955675-csmxk"] Jun 08 13:52:01.793022 ip-10-0-140-46 kubenswrapper[2576]: I0608 13:52:01.792998 2576 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/authorino-58cd955675-csmxk"] Jun 08 13:52:02.376965 ip-10-0-140-46 kubenswrapper[2576]: I0608 13:52:02.376935 2576 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="04cbb06b-a6d3-4ecd-bd14-7533c9c7858a" path="/var/lib/kubelet/pods/04cbb06b-a6d3-4ecd-bd14-7533c9c7858a/volumes" Jun 08 13:52:08.130632 ip-10-0-140-46 kubenswrapper[2576]: I0608 13:52:08.130591 2576 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-77b74bd885-sbktd" Jun 08 13:52:08.131139 ip-10-0-140-46 kubenswrapper[2576]: I0608 13:52:08.130683 2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-77b74bd885-sbktd" Jun 08 13:52:08.135330 ip-10-0-140-46 kubenswrapper[2576]: I0608 13:52:08.135306 2576 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-77b74bd885-sbktd" Jun 08 13:52:08.798971 ip-10-0-140-46 kubenswrapper[2576]: I0608 13:52:08.798935 2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-77b74bd885-sbktd" Jun 08 13:52:08.861780 ip-10-0-140-46 kubenswrapper[2576]: I0608 13:52:08.861674 2576 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-745c4cf9f4-bq8xr"] Jun 08 13:52:08.983251 ip-10-0-140-46 kubenswrapper[2576]: I0608 13:52:08.983214 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cx7sn_6e4b50fc-3e91-4f50-b92a-e90919788248/konnectivity-agent/0.log" limit=1024 Jun 08 13:52:09.082879 ip-10-0-140-46 kubenswrapper[2576]: I0608 13:52:09.082769 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cx7sn_6e4b50fc-3e91-4f50-b92a-e90919788248/konnectivity-agent/0.log" limit=1024 Jun 08 13:52:09.148946 ip-10-0-140-46 kubenswrapper[2576]: I0608 13:52:09.148905 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cx7sn_6e4b50fc-3e91-4f50-b92a-e90919788248/konnectivity-agent/0.log" limit=1024 Jun 08 13:52:13.072224 ip-10-0-140-46 kubenswrapper[2576]: I0608 13:52:13.072191 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cx7sn_6e4b50fc-3e91-4f50-b92a-e90919788248/konnectivity-agent/0.log" limit=1024 Jun 08 13:52:22.903888 ip-10-0-140-46 kubenswrapper[2576]: I0608 13:52:22.903848 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cx7sn_6e4b50fc-3e91-4f50-b92a-e90919788248/konnectivity-agent/0.log" limit=1024 Jun 08 13:52:22.995769 ip-10-0-140-46 kubenswrapper[2576]: I0608 13:52:22.995734 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cx7sn_6e4b50fc-3e91-4f50-b92a-e90919788248/konnectivity-agent/0.log" limit=1024 Jun 08 13:52:23.158460 ip-10-0-140-46 kubenswrapper[2576]: I0608 13:52:23.158367 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cx7sn_6e4b50fc-3e91-4f50-b92a-e90919788248/konnectivity-agent/0.log" limit=1024 Jun 08 13:52:24.606677 ip-10-0-140-46 kubenswrapper[2576]: I0608 13:52:24.606640 2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-marketplace/0228a3cc79630676fae641e6a38dab1752e85a08a4a9edc59ccf0da748lsg8c"] Jun 08 13:52:24.607053 ip-10-0-140-46 kubenswrapper[2576]: I0608 13:52:24.606960 2576 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="04cbb06b-a6d3-4ecd-bd14-7533c9c7858a" containerName="authorino" Jun 08 13:52:24.607053 ip-10-0-140-46 kubenswrapper[2576]: I0608 13:52:24.606972 2576 state_mem.go:107] "Deleted CPUSet assignment" podUID="04cbb06b-a6d3-4ecd-bd14-7533c9c7858a" containerName="authorino" Jun 08 13:52:24.607053 ip-10-0-140-46 kubenswrapper[2576]: I0608 13:52:24.607029 2576 memory_manager.go:368] "RemoveStaleState removing state" podUID="04cbb06b-a6d3-4ecd-bd14-7533c9c7858a" containerName="authorino" Jun 08 13:52:24.610004 ip-10-0-140-46 kubenswrapper[2576]: I0608 13:52:24.609987 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/0228a3cc79630676fae641e6a38dab1752e85a08a4a9edc59ccf0da748lsg8c" Jun 08 13:52:24.613727 ip-10-0-140-46 kubenswrapper[2576]: I0608 13:52:24.613704 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-marketplace\"/\"default-dockercfg-csk2k\"" Jun 08 13:52:24.614456 ip-10-0-140-46 kubenswrapper[2576]: I0608 13:52:24.614439 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"openshift-service-ca.crt\"" Jun 08 13:52:24.614535 ip-10-0-140-46 kubenswrapper[2576]: I0608 13:52:24.614516 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"kube-root-ca.crt\"" Jun 08 13:52:24.625770 ip-10-0-140-46 kubenswrapper[2576]: I0608 13:52:24.625746 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/0228a3cc79630676fae641e6a38dab1752e85a08a4a9edc59ccf0da748lsg8c"] Jun 08 13:52:24.748358 ip-10-0-140-46 kubenswrapper[2576]: I0608 13:52:24.748324 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/8a89dd56-5e39-4b67-9ac3-fde75813f339-bundle\") pod \"0228a3cc79630676fae641e6a38dab1752e85a08a4a9edc59ccf0da748lsg8c\" (UID: \"8a89dd56-5e39-4b67-9ac3-fde75813f339\") " pod="openshift-marketplace/0228a3cc79630676fae641e6a38dab1752e85a08a4a9edc59ccf0da748lsg8c" Jun 08 13:52:24.748524 ip-10-0-140-46 kubenswrapper[2576]: I0608 13:52:24.748379 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/8a89dd56-5e39-4b67-9ac3-fde75813f339-util\") pod \"0228a3cc79630676fae641e6a38dab1752e85a08a4a9edc59ccf0da748lsg8c\" (UID: \"8a89dd56-5e39-4b67-9ac3-fde75813f339\") " pod="openshift-marketplace/0228a3cc79630676fae641e6a38dab1752e85a08a4a9edc59ccf0da748lsg8c" Jun 08 13:52:24.748524 ip-10-0-140-46 kubenswrapper[2576]: I0608 13:52:24.748444 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-fcxh9\" (UniqueName: \"kubernetes.io/projected/8a89dd56-5e39-4b67-9ac3-fde75813f339-kube-api-access-fcxh9\") pod \"0228a3cc79630676fae641e6a38dab1752e85a08a4a9edc59ccf0da748lsg8c\" (UID: \"8a89dd56-5e39-4b67-9ac3-fde75813f339\") " pod="openshift-marketplace/0228a3cc79630676fae641e6a38dab1752e85a08a4a9edc59ccf0da748lsg8c" Jun 08 13:52:24.849541 ip-10-0-140-46 kubenswrapper[2576]: I0608 13:52:24.849486 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/8a89dd56-5e39-4b67-9ac3-fde75813f339-bundle\") pod \"0228a3cc79630676fae641e6a38dab1752e85a08a4a9edc59ccf0da748lsg8c\" (UID: \"8a89dd56-5e39-4b67-9ac3-fde75813f339\") " pod="openshift-marketplace/0228a3cc79630676fae641e6a38dab1752e85a08a4a9edc59ccf0da748lsg8c" Jun 08 13:52:24.849749 ip-10-0-140-46 kubenswrapper[2576]: I0608 13:52:24.849676 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/8a89dd56-5e39-4b67-9ac3-fde75813f339-util\") pod \"0228a3cc79630676fae641e6a38dab1752e85a08a4a9edc59ccf0da748lsg8c\" (UID: \"8a89dd56-5e39-4b67-9ac3-fde75813f339\") " pod="openshift-marketplace/0228a3cc79630676fae641e6a38dab1752e85a08a4a9edc59ccf0da748lsg8c" Jun 08 13:52:24.849749 ip-10-0-140-46 kubenswrapper[2576]: I0608 13:52:24.849720 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-fcxh9\" (UniqueName: \"kubernetes.io/projected/8a89dd56-5e39-4b67-9ac3-fde75813f339-kube-api-access-fcxh9\") pod \"0228a3cc79630676fae641e6a38dab1752e85a08a4a9edc59ccf0da748lsg8c\" (UID: \"8a89dd56-5e39-4b67-9ac3-fde75813f339\") " pod="openshift-marketplace/0228a3cc79630676fae641e6a38dab1752e85a08a4a9edc59ccf0da748lsg8c" Jun 08 13:52:24.849965 ip-10-0-140-46 kubenswrapper[2576]: I0608 13:52:24.849946 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/8a89dd56-5e39-4b67-9ac3-fde75813f339-bundle\") pod \"0228a3cc79630676fae641e6a38dab1752e85a08a4a9edc59ccf0da748lsg8c\" (UID: \"8a89dd56-5e39-4b67-9ac3-fde75813f339\") " pod="openshift-marketplace/0228a3cc79630676fae641e6a38dab1752e85a08a4a9edc59ccf0da748lsg8c" Jun 08 13:52:24.850030 ip-10-0-140-46 kubenswrapper[2576]: I0608 13:52:24.849969 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/8a89dd56-5e39-4b67-9ac3-fde75813f339-util\") pod \"0228a3cc79630676fae641e6a38dab1752e85a08a4a9edc59ccf0da748lsg8c\" (UID: \"8a89dd56-5e39-4b67-9ac3-fde75813f339\") " pod="openshift-marketplace/0228a3cc79630676fae641e6a38dab1752e85a08a4a9edc59ccf0da748lsg8c" Jun 08 13:52:24.859444 ip-10-0-140-46 kubenswrapper[2576]: I0608 13:52:24.859379 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-fcxh9\" (UniqueName: \"kubernetes.io/projected/8a89dd56-5e39-4b67-9ac3-fde75813f339-kube-api-access-fcxh9\") pod \"0228a3cc79630676fae641e6a38dab1752e85a08a4a9edc59ccf0da748lsg8c\" (UID: \"8a89dd56-5e39-4b67-9ac3-fde75813f339\") " pod="openshift-marketplace/0228a3cc79630676fae641e6a38dab1752e85a08a4a9edc59ccf0da748lsg8c" Jun 08 13:52:24.919264 ip-10-0-140-46 kubenswrapper[2576]: I0608 13:52:24.919224 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/0228a3cc79630676fae641e6a38dab1752e85a08a4a9edc59ccf0da748lsg8c" Jun 08 13:52:25.057768 ip-10-0-140-46 kubenswrapper[2576]: I0608 13:52:25.057735 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/0228a3cc79630676fae641e6a38dab1752e85a08a4a9edc59ccf0da748lsg8c"] Jun 08 13:52:25.058371 ip-10-0-140-46 kubenswrapper[2576]: W0608 13:52:25.058339 2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8a89dd56_5e39_4b67_9ac3_fde75813f339.slice/crio-d490dbe7356937d0963ac3270548f10b6c0c4a8f09b5d4c39af8cfa39c449b40 WatchSource:0}: Error finding container d490dbe7356937d0963ac3270548f10b6c0c4a8f09b5d4c39af8cfa39c449b40: Status 404 returned error can't find the container with id d490dbe7356937d0963ac3270548f10b6c0c4a8f09b5d4c39af8cfa39c449b40 Jun 08 13:52:25.881925 ip-10-0-140-46 kubenswrapper[2576]: I0608 13:52:25.881891 2576 generic.go:356] "Generic (PLEG): container finished" podID="8a89dd56-5e39-4b67-9ac3-fde75813f339" containerID="4a5d6c94751708ede1195b5abdcb7ac407d2abc62c0d3f83892f0022b78eafae" exitCode=0 Jun 08 13:52:25.882338 ip-10-0-140-46 kubenswrapper[2576]: I0608 13:52:25.881974 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/0228a3cc79630676fae641e6a38dab1752e85a08a4a9edc59ccf0da748lsg8c" event={"ID":"8a89dd56-5e39-4b67-9ac3-fde75813f339","Type":"ContainerDied","Data":"4a5d6c94751708ede1195b5abdcb7ac407d2abc62c0d3f83892f0022b78eafae"} Jun 08 13:52:25.882338 ip-10-0-140-46 kubenswrapper[2576]: I0608 13:52:25.882047 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/0228a3cc79630676fae641e6a38dab1752e85a08a4a9edc59ccf0da748lsg8c" event={"ID":"8a89dd56-5e39-4b67-9ac3-fde75813f339","Type":"ContainerStarted","Data":"d490dbe7356937d0963ac3270548f10b6c0c4a8f09b5d4c39af8cfa39c449b40"} Jun 08 13:52:26.888442 ip-10-0-140-46 kubenswrapper[2576]: I0608 13:52:26.888407 2576 generic.go:356] "Generic (PLEG): container finished" podID="8a89dd56-5e39-4b67-9ac3-fde75813f339" containerID="053a8e7b12a224b2f0e34ee30bba9883154eae2ca41b6271e6763db96addc2c8" exitCode=0 Jun 08 13:52:26.888833 ip-10-0-140-46 kubenswrapper[2576]: I0608 13:52:26.888492 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/0228a3cc79630676fae641e6a38dab1752e85a08a4a9edc59ccf0da748lsg8c" event={"ID":"8a89dd56-5e39-4b67-9ac3-fde75813f339","Type":"ContainerDied","Data":"053a8e7b12a224b2f0e34ee30bba9883154eae2ca41b6271e6763db96addc2c8"} Jun 08 13:52:27.895869 ip-10-0-140-46 kubenswrapper[2576]: I0608 13:52:27.895837 2576 generic.go:356] "Generic (PLEG): container finished" podID="8a89dd56-5e39-4b67-9ac3-fde75813f339" containerID="62c73647a549e915098494a28ff6d8bd1046e739f7b6f3d66b00b6369e0980eb" exitCode=0 Jun 08 13:52:27.896240 ip-10-0-140-46 kubenswrapper[2576]: I0608 13:52:27.895879 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/0228a3cc79630676fae641e6a38dab1752e85a08a4a9edc59ccf0da748lsg8c" event={"ID":"8a89dd56-5e39-4b67-9ac3-fde75813f339","Type":"ContainerDied","Data":"62c73647a549e915098494a28ff6d8bd1046e739f7b6f3d66b00b6369e0980eb"} Jun 08 13:52:29.085852 ip-10-0-140-46 kubenswrapper[2576]: I0608 13:52:29.085813 2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/0228a3cc79630676fae641e6a38dab1752e85a08a4a9edc59ccf0da748lsg8c" Jun 08 13:52:29.186850 ip-10-0-140-46 kubenswrapper[2576]: I0608 13:52:29.186744 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-fcxh9\" (UniqueName: \"kubernetes.io/projected/8a89dd56-5e39-4b67-9ac3-fde75813f339-kube-api-access-fcxh9\") pod \"8a89dd56-5e39-4b67-9ac3-fde75813f339\" (UID: \"8a89dd56-5e39-4b67-9ac3-fde75813f339\") " Jun 08 13:52:29.186850 ip-10-0-140-46 kubenswrapper[2576]: I0608 13:52:29.186811 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/8a89dd56-5e39-4b67-9ac3-fde75813f339-bundle\") pod \"8a89dd56-5e39-4b67-9ac3-fde75813f339\" (UID: \"8a89dd56-5e39-4b67-9ac3-fde75813f339\") " Jun 08 13:52:29.187092 ip-10-0-140-46 kubenswrapper[2576]: I0608 13:52:29.186933 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/8a89dd56-5e39-4b67-9ac3-fde75813f339-util\") pod \"8a89dd56-5e39-4b67-9ac3-fde75813f339\" (UID: \"8a89dd56-5e39-4b67-9ac3-fde75813f339\") " Jun 08 13:52:29.187353 ip-10-0-140-46 kubenswrapper[2576]: I0608 13:52:29.187330 2576 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/8a89dd56-5e39-4b67-9ac3-fde75813f339-bundle" (OuterVolumeSpecName: "bundle") pod "8a89dd56-5e39-4b67-9ac3-fde75813f339" (UID: "8a89dd56-5e39-4b67-9ac3-fde75813f339"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 08 13:52:29.189014 ip-10-0-140-46 kubenswrapper[2576]: I0608 13:52:29.188996 2576 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/8a89dd56-5e39-4b67-9ac3-fde75813f339-kube-api-access-fcxh9" (OuterVolumeSpecName: "kube-api-access-fcxh9") pod "8a89dd56-5e39-4b67-9ac3-fde75813f339" (UID: "8a89dd56-5e39-4b67-9ac3-fde75813f339"). InnerVolumeSpecName "kube-api-access-fcxh9". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 08 13:52:29.193402 ip-10-0-140-46 kubenswrapper[2576]: I0608 13:52:29.193378 2576 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/8a89dd56-5e39-4b67-9ac3-fde75813f339-util" (OuterVolumeSpecName: "util") pod "8a89dd56-5e39-4b67-9ac3-fde75813f339" (UID: "8a89dd56-5e39-4b67-9ac3-fde75813f339"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 08 13:52:29.287949 ip-10-0-140-46 kubenswrapper[2576]: I0608 13:52:29.287915 2576 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-fcxh9\" (UniqueName: \"kubernetes.io/projected/8a89dd56-5e39-4b67-9ac3-fde75813f339-kube-api-access-fcxh9\") on node \"ip-10-0-140-46.ec2.internal\" DevicePath \"\"" Jun 08 13:52:29.287949 ip-10-0-140-46 kubenswrapper[2576]: I0608 13:52:29.287943 2576 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/8a89dd56-5e39-4b67-9ac3-fde75813f339-bundle\") on node \"ip-10-0-140-46.ec2.internal\" DevicePath \"\"" Jun 08 13:52:29.287949 ip-10-0-140-46 kubenswrapper[2576]: I0608 13:52:29.287953 2576 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/8a89dd56-5e39-4b67-9ac3-fde75813f339-util\") on node \"ip-10-0-140-46.ec2.internal\" DevicePath \"\"" Jun 08 13:52:29.907852 ip-10-0-140-46 kubenswrapper[2576]: I0608 13:52:29.907822 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/0228a3cc79630676fae641e6a38dab1752e85a08a4a9edc59ccf0da748lsg8c" event={"ID":"8a89dd56-5e39-4b67-9ac3-fde75813f339","Type":"ContainerDied","Data":"d490dbe7356937d0963ac3270548f10b6c0c4a8f09b5d4c39af8cfa39c449b40"} Jun 08 13:52:29.907852 ip-10-0-140-46 kubenswrapper[2576]: I0608 13:52:29.907853 2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/0228a3cc79630676fae641e6a38dab1752e85a08a4a9edc59ccf0da748lsg8c" Jun 08 13:52:29.907852 ip-10-0-140-46 kubenswrapper[2576]: I0608 13:52:29.907867 2576 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="d490dbe7356937d0963ac3270548f10b6c0c4a8f09b5d4c39af8cfa39c449b40" Jun 08 13:52:33.881969 ip-10-0-140-46 kubenswrapper[2576]: I0608 13:52:33.881935 2576 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-console/console-745c4cf9f4-bq8xr" podUID="89b1ca22-dc48-40a6-9033-f5199eb8075d" containerName="console" containerID="cri-o://f8f32ef3d00fe77293b0ec5efb353063715529749fb7007a0e7df7be7787f8ff" gracePeriod=15 Jun 08 13:52:34.123903 ip-10-0-140-46 kubenswrapper[2576]: I0608 13:52:34.123880 2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-745c4cf9f4-bq8xr" Jun 08 13:52:34.224906 ip-10-0-140-46 kubenswrapper[2576]: I0608 13:52:34.224805 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/89b1ca22-dc48-40a6-9033-f5199eb8075d-console-serving-cert\") pod \"89b1ca22-dc48-40a6-9033-f5199eb8075d\" (UID: \"89b1ca22-dc48-40a6-9033-f5199eb8075d\") " Jun 08 13:52:34.224906 ip-10-0-140-46 kubenswrapper[2576]: I0608 13:52:34.224845 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/89b1ca22-dc48-40a6-9033-f5199eb8075d-console-oauth-config\") pod \"89b1ca22-dc48-40a6-9033-f5199eb8075d\" (UID: \"89b1ca22-dc48-40a6-9033-f5199eb8075d\") " Jun 08 13:52:34.224906 ip-10-0-140-46 kubenswrapper[2576]: I0608 13:52:34.224879 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/89b1ca22-dc48-40a6-9033-f5199eb8075d-oauth-serving-cert\") pod \"89b1ca22-dc48-40a6-9033-f5199eb8075d\" (UID: \"89b1ca22-dc48-40a6-9033-f5199eb8075d\") " Jun 08 13:52:34.224906 ip-10-0-140-46 kubenswrapper[2576]: I0608 13:52:34.224900 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/89b1ca22-dc48-40a6-9033-f5199eb8075d-trusted-ca-bundle\") pod \"89b1ca22-dc48-40a6-9033-f5199eb8075d\" (UID: \"89b1ca22-dc48-40a6-9033-f5199eb8075d\") " Jun 08 13:52:34.225231 ip-10-0-140-46 kubenswrapper[2576]: I0608 13:52:34.225019 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/89b1ca22-dc48-40a6-9033-f5199eb8075d-service-ca\") pod \"89b1ca22-dc48-40a6-9033-f5199eb8075d\" (UID: \"89b1ca22-dc48-40a6-9033-f5199eb8075d\") " Jun 08 13:52:34.225231 ip-10-0-140-46 kubenswrapper[2576]: I0608 13:52:34.225064 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/89b1ca22-dc48-40a6-9033-f5199eb8075d-console-config\") pod \"89b1ca22-dc48-40a6-9033-f5199eb8075d\" (UID: \"89b1ca22-dc48-40a6-9033-f5199eb8075d\") " Jun 08 13:52:34.225231 ip-10-0-140-46 kubenswrapper[2576]: I0608 13:52:34.225149 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-xssc7\" (UniqueName: \"kubernetes.io/projected/89b1ca22-dc48-40a6-9033-f5199eb8075d-kube-api-access-xssc7\") pod \"89b1ca22-dc48-40a6-9033-f5199eb8075d\" (UID: \"89b1ca22-dc48-40a6-9033-f5199eb8075d\") " Jun 08 13:52:34.225400 ip-10-0-140-46 kubenswrapper[2576]: I0608 13:52:34.225320 2576 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/89b1ca22-dc48-40a6-9033-f5199eb8075d-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "89b1ca22-dc48-40a6-9033-f5199eb8075d" (UID: "89b1ca22-dc48-40a6-9033-f5199eb8075d"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 08 13:52:34.225470 ip-10-0-140-46 kubenswrapper[2576]: I0608 13:52:34.225339 2576 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/89b1ca22-dc48-40a6-9033-f5199eb8075d-trusted-ca-bundle" (OuterVolumeSpecName: "trusted-ca-bundle") pod "89b1ca22-dc48-40a6-9033-f5199eb8075d" (UID: "89b1ca22-dc48-40a6-9033-f5199eb8075d"). InnerVolumeSpecName "trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 08 13:52:34.225470 ip-10-0-140-46 kubenswrapper[2576]: I0608 13:52:34.225405 2576 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/89b1ca22-dc48-40a6-9033-f5199eb8075d-service-ca" (OuterVolumeSpecName: "service-ca") pod "89b1ca22-dc48-40a6-9033-f5199eb8075d" (UID: "89b1ca22-dc48-40a6-9033-f5199eb8075d"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 08 13:52:34.225662 ip-10-0-140-46 kubenswrapper[2576]: I0608 13:52:34.225605 2576 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/89b1ca22-dc48-40a6-9033-f5199eb8075d-oauth-serving-cert\") on node \"ip-10-0-140-46.ec2.internal\" DevicePath \"\"" Jun 08 13:52:34.225798 ip-10-0-140-46 kubenswrapper[2576]: I0608 13:52:34.225718 2576 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/89b1ca22-dc48-40a6-9033-f5199eb8075d-console-config" (OuterVolumeSpecName: "console-config") pod "89b1ca22-dc48-40a6-9033-f5199eb8075d" (UID: "89b1ca22-dc48-40a6-9033-f5199eb8075d"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 08 13:52:34.227199 ip-10-0-140-46 kubenswrapper[2576]: I0608 13:52:34.227177 2576 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/89b1ca22-dc48-40a6-9033-f5199eb8075d-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "89b1ca22-dc48-40a6-9033-f5199eb8075d" (UID: "89b1ca22-dc48-40a6-9033-f5199eb8075d"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 08 13:52:34.227284 ip-10-0-140-46 kubenswrapper[2576]: I0608 13:52:34.227201 2576 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/89b1ca22-dc48-40a6-9033-f5199eb8075d-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "89b1ca22-dc48-40a6-9033-f5199eb8075d" (UID: "89b1ca22-dc48-40a6-9033-f5199eb8075d"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 08 13:52:34.227284 ip-10-0-140-46 kubenswrapper[2576]: I0608 13:52:34.227265 2576 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/89b1ca22-dc48-40a6-9033-f5199eb8075d-kube-api-access-xssc7" (OuterVolumeSpecName: "kube-api-access-xssc7") pod "89b1ca22-dc48-40a6-9033-f5199eb8075d" (UID: "89b1ca22-dc48-40a6-9033-f5199eb8075d"). InnerVolumeSpecName "kube-api-access-xssc7". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 08 13:52:34.326049 ip-10-0-140-46 kubenswrapper[2576]: I0608 13:52:34.326002 2576 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/89b1ca22-dc48-40a6-9033-f5199eb8075d-console-serving-cert\") on node \"ip-10-0-140-46.ec2.internal\" DevicePath \"\"" Jun 08 13:52:34.326049 ip-10-0-140-46 kubenswrapper[2576]: I0608 13:52:34.326041 2576 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/89b1ca22-dc48-40a6-9033-f5199eb8075d-console-oauth-config\") on node \"ip-10-0-140-46.ec2.internal\" DevicePath \"\"" Jun 08 13:52:34.326049 ip-10-0-140-46 kubenswrapper[2576]: I0608 13:52:34.326051 2576 reconciler_common.go:299] "Volume detached for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/89b1ca22-dc48-40a6-9033-f5199eb8075d-trusted-ca-bundle\") on node \"ip-10-0-140-46.ec2.internal\" DevicePath \"\"" Jun 08 13:52:34.326296 ip-10-0-140-46 kubenswrapper[2576]: I0608 13:52:34.326061 2576 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/89b1ca22-dc48-40a6-9033-f5199eb8075d-service-ca\") on node \"ip-10-0-140-46.ec2.internal\" DevicePath \"\"" Jun 08 13:52:34.326296 ip-10-0-140-46 kubenswrapper[2576]: I0608 13:52:34.326079 2576 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/89b1ca22-dc48-40a6-9033-f5199eb8075d-console-config\") on node \"ip-10-0-140-46.ec2.internal\" DevicePath \"\"" Jun 08 13:52:34.326296 ip-10-0-140-46 kubenswrapper[2576]: I0608 13:52:34.326089 2576 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-xssc7\" (UniqueName: \"kubernetes.io/projected/89b1ca22-dc48-40a6-9033-f5199eb8075d-kube-api-access-xssc7\") on node \"ip-10-0-140-46.ec2.internal\" DevicePath \"\"" Jun 08 13:52:34.934040 ip-10-0-140-46 kubenswrapper[2576]: I0608 13:52:34.933998 2576 generic.go:356] "Generic (PLEG): container finished" podID="89b1ca22-dc48-40a6-9033-f5199eb8075d" containerID="f8f32ef3d00fe77293b0ec5efb353063715529749fb7007a0e7df7be7787f8ff" exitCode=0 Jun 08 13:52:34.934423 ip-10-0-140-46 kubenswrapper[2576]: I0608 13:52:34.934050 2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-745c4cf9f4-bq8xr" Jun 08 13:52:34.934423 ip-10-0-140-46 kubenswrapper[2576]: I0608 13:52:34.934076 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-745c4cf9f4-bq8xr" event={"ID":"89b1ca22-dc48-40a6-9033-f5199eb8075d","Type":"ContainerDied","Data":"f8f32ef3d00fe77293b0ec5efb353063715529749fb7007a0e7df7be7787f8ff"} Jun 08 13:52:34.934423 ip-10-0-140-46 kubenswrapper[2576]: I0608 13:52:34.934127 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-745c4cf9f4-bq8xr" event={"ID":"89b1ca22-dc48-40a6-9033-f5199eb8075d","Type":"ContainerDied","Data":"c02d4287bbfbc708efcd8d09eed5148c86d742dd648b0eff74ef8fd25cca49aa"} Jun 08 13:52:34.934423 ip-10-0-140-46 kubenswrapper[2576]: I0608 13:52:34.934149 2576 scope.go:117] "RemoveContainer" containerID="f8f32ef3d00fe77293b0ec5efb353063715529749fb7007a0e7df7be7787f8ff" Jun 08 13:52:34.942857 ip-10-0-140-46 kubenswrapper[2576]: I0608 13:52:34.942837 2576 scope.go:117] "RemoveContainer" containerID="f8f32ef3d00fe77293b0ec5efb353063715529749fb7007a0e7df7be7787f8ff" Jun 08 13:52:34.943116 ip-10-0-140-46 kubenswrapper[2576]: E0608 13:52:34.943098 2576 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"f8f32ef3d00fe77293b0ec5efb353063715529749fb7007a0e7df7be7787f8ff\": container with ID starting with f8f32ef3d00fe77293b0ec5efb353063715529749fb7007a0e7df7be7787f8ff not found: ID does not exist" containerID="f8f32ef3d00fe77293b0ec5efb353063715529749fb7007a0e7df7be7787f8ff" Jun 08 13:52:34.943163 ip-10-0-140-46 kubenswrapper[2576]: I0608 13:52:34.943123 2576 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"f8f32ef3d00fe77293b0ec5efb353063715529749fb7007a0e7df7be7787f8ff"} err="failed to get container status \"f8f32ef3d00fe77293b0ec5efb353063715529749fb7007a0e7df7be7787f8ff\": rpc error: code = NotFound desc = could not find container \"f8f32ef3d00fe77293b0ec5efb353063715529749fb7007a0e7df7be7787f8ff\": container with ID starting with f8f32ef3d00fe77293b0ec5efb353063715529749fb7007a0e7df7be7787f8ff not found: ID does not exist" Jun 08 13:52:34.968336 ip-10-0-140-46 kubenswrapper[2576]: I0608 13:52:34.968299 2576 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-745c4cf9f4-bq8xr"] Jun 08 13:52:34.983006 ip-10-0-140-46 kubenswrapper[2576]: I0608 13:52:34.982970 2576 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-745c4cf9f4-bq8xr"] Jun 08 13:52:36.377698 ip-10-0-140-46 kubenswrapper[2576]: I0608 13:52:36.377612 2576 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="89b1ca22-dc48-40a6-9033-f5199eb8075d" path="/var/lib/kubelet/pods/89b1ca22-dc48-40a6-9033-f5199eb8075d/volumes" Jun 08 13:52:46.389440 ip-10-0-140-46 kubenswrapper[2576]: I0608 13:52:46.389405 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cx7sn_6e4b50fc-3e91-4f50-b92a-e90919788248/konnectivity-agent/0.log" limit=1024 Jun 08 13:52:46.493729 ip-10-0-140-46 kubenswrapper[2576]: I0608 13:52:46.493693 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cx7sn_6e4b50fc-3e91-4f50-b92a-e90919788248/konnectivity-agent/0.log" limit=1024 Jun 08 13:52:46.801281 ip-10-0-140-46 kubenswrapper[2576]: I0608 13:52:46.801243 2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["keycloak-system/maas-keycloak-0"] Jun 08 13:52:46.801679 ip-10-0-140-46 kubenswrapper[2576]: I0608 13:52:46.801660 2576 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="89b1ca22-dc48-40a6-9033-f5199eb8075d" containerName="console" Jun 08 13:52:46.801787 ip-10-0-140-46 kubenswrapper[2576]: I0608 13:52:46.801682 2576 state_mem.go:107] "Deleted CPUSet assignment" podUID="89b1ca22-dc48-40a6-9033-f5199eb8075d" containerName="console" Jun 08 13:52:46.801787 ip-10-0-140-46 kubenswrapper[2576]: I0608 13:52:46.801703 2576 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="8a89dd56-5e39-4b67-9ac3-fde75813f339" containerName="extract" Jun 08 13:52:46.801787 ip-10-0-140-46 kubenswrapper[2576]: I0608 13:52:46.801710 2576 state_mem.go:107] "Deleted CPUSet assignment" podUID="8a89dd56-5e39-4b67-9ac3-fde75813f339" containerName="extract" Jun 08 13:52:46.801787 ip-10-0-140-46 kubenswrapper[2576]: I0608 13:52:46.801736 2576 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="8a89dd56-5e39-4b67-9ac3-fde75813f339" containerName="util" Jun 08 13:52:46.801787 ip-10-0-140-46 kubenswrapper[2576]: I0608 13:52:46.801745 2576 state_mem.go:107] "Deleted CPUSet assignment" podUID="8a89dd56-5e39-4b67-9ac3-fde75813f339" containerName="util" Jun 08 13:52:46.801787 ip-10-0-140-46 kubenswrapper[2576]: I0608 13:52:46.801761 2576 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="8a89dd56-5e39-4b67-9ac3-fde75813f339" containerName="pull" Jun 08 13:52:46.801787 ip-10-0-140-46 kubenswrapper[2576]: I0608 13:52:46.801768 2576 state_mem.go:107] "Deleted CPUSet assignment" podUID="8a89dd56-5e39-4b67-9ac3-fde75813f339" containerName="pull" Jun 08 13:52:46.802120 ip-10-0-140-46 kubenswrapper[2576]: I0608 13:52:46.801846 2576 memory_manager.go:368] "RemoveStaleState removing state" podUID="8a89dd56-5e39-4b67-9ac3-fde75813f339" containerName="extract" Jun 08 13:52:46.802120 ip-10-0-140-46 kubenswrapper[2576]: I0608 13:52:46.801862 2576 memory_manager.go:368] "RemoveStaleState removing state" podUID="89b1ca22-dc48-40a6-9033-f5199eb8075d" containerName="console" Jun 08 13:52:46.804960 ip-10-0-140-46 kubenswrapper[2576]: I0608 13:52:46.804938 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="keycloak-system/maas-keycloak-0" Jun 08 13:52:46.808813 ip-10-0-140-46 kubenswrapper[2576]: I0608 13:52:46.808792 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"keycloak-system\"/\"maas-keycloak-initial-admin\"" Jun 08 13:52:46.809140 ip-10-0-140-46 kubenswrapper[2576]: I0608 13:52:46.809121 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"keycloak-system\"/\"openshift-service-ca.crt\"" Jun 08 13:52:46.809234 ip-10-0-140-46 kubenswrapper[2576]: I0608 13:52:46.809181 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"keycloak-system\"/\"default-dockercfg-jt4bd\"" Jun 08 13:52:46.809464 ip-10-0-140-46 kubenswrapper[2576]: I0608 13:52:46.809442 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"keycloak-system\"/\"kube-root-ca.crt\"" Jun 08 13:52:46.817300 ip-10-0-140-46 kubenswrapper[2576]: I0608 13:52:46.817273 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["keycloak-system/maas-keycloak-0"] Jun 08 13:52:46.827725 ip-10-0-140-46 kubenswrapper[2576]: I0608 13:52:46.827699 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-k7896\" (UniqueName: \"kubernetes.io/projected/f3cca0f0-793c-4fbb-977a-30673e343be2-kube-api-access-k7896\") pod \"maas-keycloak-0\" (UID: \"f3cca0f0-793c-4fbb-977a-30673e343be2\") " pod="keycloak-system/maas-keycloak-0" Jun 08 13:52:46.928700 ip-10-0-140-46 kubenswrapper[2576]: I0608 13:52:46.928658 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-k7896\" (UniqueName: \"kubernetes.io/projected/f3cca0f0-793c-4fbb-977a-30673e343be2-kube-api-access-k7896\") pod \"maas-keycloak-0\" (UID: \"f3cca0f0-793c-4fbb-977a-30673e343be2\") " pod="keycloak-system/maas-keycloak-0" Jun 08 13:52:46.943475 ip-10-0-140-46 kubenswrapper[2576]: I0608 13:52:46.943447 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-k7896\" (UniqueName: \"kubernetes.io/projected/f3cca0f0-793c-4fbb-977a-30673e343be2-kube-api-access-k7896\") pod \"maas-keycloak-0\" (UID: \"f3cca0f0-793c-4fbb-977a-30673e343be2\") " pod="keycloak-system/maas-keycloak-0" Jun 08 13:52:47.115245 ip-10-0-140-46 kubenswrapper[2576]: I0608 13:52:47.114982 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="keycloak-system/maas-keycloak-0" Jun 08 13:52:47.271610 ip-10-0-140-46 kubenswrapper[2576]: I0608 13:52:47.271581 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["keycloak-system/maas-keycloak-0"] Jun 08 13:52:47.272311 ip-10-0-140-46 kubenswrapper[2576]: W0608 13:52:47.272283 2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf3cca0f0_793c_4fbb_977a_30673e343be2.slice/crio-7fe5c8694107fcd4cb36cb4a915f60076347e034efb81f52d2ce5bff0a02dab7 WatchSource:0}: Error finding container 7fe5c8694107fcd4cb36cb4a915f60076347e034efb81f52d2ce5bff0a02dab7: Status 404 returned error can't find the container with id 7fe5c8694107fcd4cb36cb4a915f60076347e034efb81f52d2ce5bff0a02dab7 Jun 08 13:52:48.007046 ip-10-0-140-46 kubenswrapper[2576]: I0608 13:52:48.005102 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="keycloak-system/maas-keycloak-0" event={"ID":"f3cca0f0-793c-4fbb-977a-30673e343be2","Type":"ContainerStarted","Data":"7fe5c8694107fcd4cb36cb4a915f60076347e034efb81f52d2ce5bff0a02dab7"} Jun 08 13:52:52.430171 ip-10-0-140-46 kubenswrapper[2576]: I0608 13:52:52.430149 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"keycloak-system\"/\"maas-keycloak-initial-admin\"" Jun 08 13:52:53.041420 ip-10-0-140-46 kubenswrapper[2576]: I0608 13:52:53.041374 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="keycloak-system/maas-keycloak-0" event={"ID":"f3cca0f0-793c-4fbb-977a-30673e343be2","Type":"ContainerStarted","Data":"4523f1608c0d3f45341716083bf5deec4ebc9533578d736b350dcfdc27165470"} Jun 08 13:52:53.063225 ip-10-0-140-46 kubenswrapper[2576]: I0608 13:52:53.063146 2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="keycloak-system/maas-keycloak-0" podStartSLOduration=1.909022724 podStartE2EDuration="7.063126326s" totalImagesPullingTime="5.154103602s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-08 13:52:46 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-08 13:52:53.061262703 +0000 UTC m=+541.140591597" watchObservedRunningTime="2026-06-08 13:52:53.063126326 +0000 UTC m=+541.142455219" Jun 08 13:52:53.115519 ip-10-0-140-46 kubenswrapper[2576]: I0608 13:52:53.115475 2576 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="keycloak-system/maas-keycloak-0" Jun 08 13:52:53.117148 ip-10-0-140-46 kubenswrapper[2576]: I0608 13:52:53.117112 2576 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="f3cca0f0-793c-4fbb-977a-30673e343be2" containerName="keycloak" probeResult="failure" output="Get \"http://10.133.0.46:9000/health/started\": dial tcp 10.133.0.46:9000: connect: connection refused" Jun 08 13:52:54.116089 ip-10-0-140-46 kubenswrapper[2576]: I0608 13:52:54.116009 2576 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="f3cca0f0-793c-4fbb-977a-30673e343be2" containerName="keycloak" probeResult="failure" output="Get \"http://10.133.0.46:9000/health/started\": dial tcp 10.133.0.46:9000: connect: connection refused" Jun 08 13:52:55.115872 ip-10-0-140-46 kubenswrapper[2576]: I0608 13:52:55.115826 2576 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="f3cca0f0-793c-4fbb-977a-30673e343be2" containerName="keycloak" probeResult="failure" output="Get \"http://10.133.0.46:9000/health/started\": dial tcp 10.133.0.46:9000: connect: connection refused" Jun 08 13:52:56.115516 ip-10-0-140-46 kubenswrapper[2576]: I0608 13:52:56.115459 2576 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="f3cca0f0-793c-4fbb-977a-30673e343be2" containerName="keycloak" probeResult="failure" output="Get \"http://10.133.0.46:9000/health/started\": dial tcp 10.133.0.46:9000: connect: connection refused" Jun 08 13:52:57.115841 ip-10-0-140-46 kubenswrapper[2576]: I0608 13:52:57.115798 2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="keycloak-system/maas-keycloak-0" Jun 08 13:52:57.116265 ip-10-0-140-46 kubenswrapper[2576]: I0608 13:52:57.116174 2576 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="f3cca0f0-793c-4fbb-977a-30673e343be2" containerName="keycloak" probeResult="failure" output="Get \"http://10.133.0.46:9000/health/started\": dial tcp 10.133.0.46:9000: connect: connection refused" Jun 08 13:52:57.310352 ip-10-0-140-46 kubenswrapper[2576]: I0608 13:52:57.310190 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cx7sn_6e4b50fc-3e91-4f50-b92a-e90919788248/konnectivity-agent/0.log" limit=1024 Jun 08 13:52:58.116182 ip-10-0-140-46 kubenswrapper[2576]: I0608 13:52:58.116132 2576 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="f3cca0f0-793c-4fbb-977a-30673e343be2" containerName="keycloak" probeResult="failure" output="Get \"http://10.133.0.46:9000/health/started\": dial tcp 10.133.0.46:9000: connect: connection refused" Jun 08 13:52:59.115754 ip-10-0-140-46 kubenswrapper[2576]: I0608 13:52:59.115695 2576 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="f3cca0f0-793c-4fbb-977a-30673e343be2" containerName="keycloak" probeResult="failure" output="Get \"http://10.133.0.46:9000/health/started\": dial tcp 10.133.0.46:9000: connect: connection refused" Jun 08 13:53:00.116247 ip-10-0-140-46 kubenswrapper[2576]: I0608 13:53:00.116186 2576 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="f3cca0f0-793c-4fbb-977a-30673e343be2" containerName="keycloak" probeResult="failure" output="Get \"http://10.133.0.46:9000/health/started\": dial tcp 10.133.0.46:9000: connect: connection refused" Jun 08 13:53:01.115865 ip-10-0-140-46 kubenswrapper[2576]: I0608 13:53:01.115805 2576 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="f3cca0f0-793c-4fbb-977a-30673e343be2" containerName="keycloak" probeResult="failure" output="Get \"http://10.133.0.46:9000/health/started\": dial tcp 10.133.0.46:9000: connect: connection refused" Jun 08 13:53:02.115830 ip-10-0-140-46 kubenswrapper[2576]: I0608 13:53:02.115777 2576 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="f3cca0f0-793c-4fbb-977a-30673e343be2" containerName="keycloak" probeResult="failure" output="Get \"http://10.133.0.46:9000/health/started\": dial tcp 10.133.0.46:9000: connect: connection refused" Jun 08 13:53:03.116523 ip-10-0-140-46 kubenswrapper[2576]: I0608 13:53:03.116471 2576 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="f3cca0f0-793c-4fbb-977a-30673e343be2" containerName="keycloak" probeResult="failure" output="Get \"http://10.133.0.46:9000/health/started\": dial tcp 10.133.0.46:9000: connect: connection refused" Jun 08 13:53:04.115730 ip-10-0-140-46 kubenswrapper[2576]: I0608 13:53:04.115678 2576 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="f3cca0f0-793c-4fbb-977a-30673e343be2" containerName="keycloak" probeResult="failure" output="Get \"http://10.133.0.46:9000/health/started\": dial tcp 10.133.0.46:9000: connect: connection refused" Jun 08 13:53:05.116160 ip-10-0-140-46 kubenswrapper[2576]: I0608 13:53:05.116123 2576 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="f3cca0f0-793c-4fbb-977a-30673e343be2" containerName="keycloak" probeResult="failure" output="Get \"http://10.133.0.46:9000/health/started\": dial tcp 10.133.0.46:9000: connect: connection refused" Jun 08 13:53:06.231038 ip-10-0-140-46 kubenswrapper[2576]: I0608 13:53:06.230997 2576 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="keycloak-system/maas-keycloak-0" Jun 08 13:53:06.249083 ip-10-0-140-46 kubenswrapper[2576]: I0608 13:53:06.249017 2576 prober.go:120] "Probe failed" probeType="Readiness" pod="keycloak-system/maas-keycloak-0" podUID="f3cca0f0-793c-4fbb-977a-30673e343be2" containerName="keycloak" probeResult="failure" output="HTTP probe failed with statuscode: 503" Jun 08 13:53:16.015314 ip-10-0-140-46 kubenswrapper[2576]: I0608 13:53:16.015271 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cx7sn_6e4b50fc-3e91-4f50-b92a-e90919788248/konnectivity-agent/0.log" limit=1024 Jun 08 13:53:16.239337 ip-10-0-140-46 kubenswrapper[2576]: I0608 13:53:16.239303 2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="keycloak-system/maas-keycloak-0" Jun 08 13:53:16.922159 ip-10-0-140-46 kubenswrapper[2576]: I0608 13:53:16.922128 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cx7sn_6e4b50fc-3e91-4f50-b92a-e90919788248/konnectivity-agent/0.log" limit=1024 Jun 08 13:53:17.173098 ip-10-0-140-46 kubenswrapper[2576]: I0608 13:53:17.173014 2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-5d4b67c446-sfb4p"] Jun 08 13:53:17.246320 ip-10-0-140-46 kubenswrapper[2576]: I0608 13:53:17.246294 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-5d4b67c446-sfb4p"] Jun 08 13:53:17.246486 ip-10-0-140-46 kubenswrapper[2576]: I0608 13:53:17.246381 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-5d4b67c446-sfb4p" Jun 08 13:53:17.411664 ip-10-0-140-46 kubenswrapper[2576]: I0608 13:53:17.411627 2576 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-5d4b67c446-sfb4p"] Jun 08 13:53:17.411891 ip-10-0-140-46 kubenswrapper[2576]: E0608 13:53:17.411872 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[kube-api-access-2v59j], unattached volumes=[], failed to process volumes=[]: context canceled" pod="kuadrant-system/authorino-5d4b67c446-sfb4p" podUID="fd12f340-72e3-487b-9ff7-adc893bc62f3" Jun 08 13:53:17.436531 ip-10-0-140-46 kubenswrapper[2576]: I0608 13:53:17.436443 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2v59j\" (UniqueName: \"kubernetes.io/projected/fd12f340-72e3-487b-9ff7-adc893bc62f3-kube-api-access-2v59j\") pod \"authorino-5d4b67c446-sfb4p\" (UID: \"fd12f340-72e3-487b-9ff7-adc893bc62f3\") " pod="kuadrant-system/authorino-5d4b67c446-sfb4p" Jun 08 13:53:17.448232 ip-10-0-140-46 kubenswrapper[2576]: I0608 13:53:17.448202 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cx7sn_6e4b50fc-3e91-4f50-b92a-e90919788248/konnectivity-agent/0.log" limit=1024 Jun 08 13:53:17.487469 ip-10-0-140-46 kubenswrapper[2576]: I0608 13:53:17.487439 2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-6c7879c647-szrq8"] Jun 08 13:53:17.499220 ip-10-0-140-46 kubenswrapper[2576]: I0608 13:53:17.499190 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-6c7879c647-szrq8" Jun 08 13:53:17.537064 ip-10-0-140-46 kubenswrapper[2576]: I0608 13:53:17.537033 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2v59j\" (UniqueName: \"kubernetes.io/projected/fd12f340-72e3-487b-9ff7-adc893bc62f3-kube-api-access-2v59j\") pod \"authorino-5d4b67c446-sfb4p\" (UID: \"fd12f340-72e3-487b-9ff7-adc893bc62f3\") " pod="kuadrant-system/authorino-5d4b67c446-sfb4p" Jun 08 13:53:17.558755 ip-10-0-140-46 kubenswrapper[2576]: I0608 13:53:17.558723 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-2v59j\" (UniqueName: \"kubernetes.io/projected/fd12f340-72e3-487b-9ff7-adc893bc62f3-kube-api-access-2v59j\") pod \"authorino-5d4b67c446-sfb4p\" (UID: \"fd12f340-72e3-487b-9ff7-adc893bc62f3\") " pod="kuadrant-system/authorino-5d4b67c446-sfb4p" Jun 08 13:53:17.572413 ip-10-0-140-46 kubenswrapper[2576]: I0608 13:53:17.572377 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-6c7879c647-szrq8"] Jun 08 13:53:17.638397 ip-10-0-140-46 kubenswrapper[2576]: I0608 13:53:17.638357 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-29r2w\" (UniqueName: \"kubernetes.io/projected/1ef90196-8a1b-4401-ae46-144a01413d51-kube-api-access-29r2w\") pod \"authorino-6c7879c647-szrq8\" (UID: \"1ef90196-8a1b-4401-ae46-144a01413d51\") " pod="kuadrant-system/authorino-6c7879c647-szrq8" Jun 08 13:53:17.739685 ip-10-0-140-46 kubenswrapper[2576]: I0608 13:53:17.739597 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-29r2w\" (UniqueName: \"kubernetes.io/projected/1ef90196-8a1b-4401-ae46-144a01413d51-kube-api-access-29r2w\") pod \"authorino-6c7879c647-szrq8\" (UID: \"1ef90196-8a1b-4401-ae46-144a01413d51\") " pod="kuadrant-system/authorino-6c7879c647-szrq8" Jun 08 13:53:17.755100 ip-10-0-140-46 kubenswrapper[2576]: I0608 13:53:17.755070 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-29r2w\" (UniqueName: \"kubernetes.io/projected/1ef90196-8a1b-4401-ae46-144a01413d51-kube-api-access-29r2w\") pod \"authorino-6c7879c647-szrq8\" (UID: \"1ef90196-8a1b-4401-ae46-144a01413d51\") " pod="kuadrant-system/authorino-6c7879c647-szrq8" Jun 08 13:53:17.807658 ip-10-0-140-46 kubenswrapper[2576]: I0608 13:53:17.807624 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-6c7879c647-szrq8" Jun 08 13:53:17.954353 ip-10-0-140-46 kubenswrapper[2576]: I0608 13:53:17.954319 2576 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-6c7879c647-szrq8"] Jun 08 13:53:17.982680 ip-10-0-140-46 kubenswrapper[2576]: I0608 13:53:17.982652 2576 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-6c7879c647-szrq8"] Jun 08 13:53:17.984242 ip-10-0-140-46 kubenswrapper[2576]: W0608 13:53:17.984217 2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod1ef90196_8a1b_4401_ae46_144a01413d51.slice/crio-0ddd41c077b9f0cc548ebf41e0ddf990818ca89bd66880268fb2e8c2ad33faff WatchSource:0}: Error finding container 0ddd41c077b9f0cc548ebf41e0ddf990818ca89bd66880268fb2e8c2ad33faff: Status 404 returned error can't find the container with id 0ddd41c077b9f0cc548ebf41e0ddf990818ca89bd66880268fb2e8c2ad33faff Jun 08 13:53:17.991734 ip-10-0-140-46 kubenswrapper[2576]: I0608 13:53:17.991464 2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-5855885687-jk7lw"] Jun 08 13:53:18.024356 ip-10-0-140-46 kubenswrapper[2576]: I0608 13:53:18.024313 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-5855885687-jk7lw"] Jun 08 13:53:18.024542 ip-10-0-140-46 kubenswrapper[2576]: I0608 13:53:18.024465 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-5855885687-jk7lw" Jun 08 13:53:18.027479 ip-10-0-140-46 kubenswrapper[2576]: I0608 13:53:18.027450 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"authorino-server-cert\"" Jun 08 13:53:18.043182 ip-10-0-140-46 kubenswrapper[2576]: I0608 13:53:18.043155 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/651b4b51-7b18-490a-909d-6c034efa9fd6-tls-cert\") pod \"authorino-5855885687-jk7lw\" (UID: \"651b4b51-7b18-490a-909d-6c034efa9fd6\") " pod="kuadrant-system/authorino-5855885687-jk7lw" Jun 08 13:53:18.043299 ip-10-0-140-46 kubenswrapper[2576]: I0608 13:53:18.043207 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-r6hnl\" (UniqueName: \"kubernetes.io/projected/651b4b51-7b18-490a-909d-6c034efa9fd6-kube-api-access-r6hnl\") pod \"authorino-5855885687-jk7lw\" (UID: \"651b4b51-7b18-490a-909d-6c034efa9fd6\") " pod="kuadrant-system/authorino-5855885687-jk7lw" Jun 08 13:53:18.144493 ip-10-0-140-46 kubenswrapper[2576]: I0608 13:53:18.144459 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/651b4b51-7b18-490a-909d-6c034efa9fd6-tls-cert\") pod \"authorino-5855885687-jk7lw\" (UID: \"651b4b51-7b18-490a-909d-6c034efa9fd6\") " pod="kuadrant-system/authorino-5855885687-jk7lw" Jun 08 13:53:18.144724 ip-10-0-140-46 kubenswrapper[2576]: I0608 13:53:18.144516 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-r6hnl\" (UniqueName: \"kubernetes.io/projected/651b4b51-7b18-490a-909d-6c034efa9fd6-kube-api-access-r6hnl\") pod \"authorino-5855885687-jk7lw\" (UID: \"651b4b51-7b18-490a-909d-6c034efa9fd6\") " pod="kuadrant-system/authorino-5855885687-jk7lw" Jun 08 13:53:18.146996 ip-10-0-140-46 kubenswrapper[2576]: I0608 13:53:18.146970 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/651b4b51-7b18-490a-909d-6c034efa9fd6-tls-cert\") pod \"authorino-5855885687-jk7lw\" (UID: \"651b4b51-7b18-490a-909d-6c034efa9fd6\") " pod="kuadrant-system/authorino-5855885687-jk7lw" Jun 08 13:53:18.154952 ip-10-0-140-46 kubenswrapper[2576]: I0608 13:53:18.154932 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-r6hnl\" (UniqueName: \"kubernetes.io/projected/651b4b51-7b18-490a-909d-6c034efa9fd6-kube-api-access-r6hnl\") pod \"authorino-5855885687-jk7lw\" (UID: \"651b4b51-7b18-490a-909d-6c034efa9fd6\") " pod="kuadrant-system/authorino-5855885687-jk7lw" Jun 08 13:53:18.214949 ip-10-0-140-46 kubenswrapper[2576]: I0608 13:53:18.214915 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-6c7879c647-szrq8" event={"ID":"1ef90196-8a1b-4401-ae46-144a01413d51","Type":"ContainerStarted","Data":"0ddd41c077b9f0cc548ebf41e0ddf990818ca89bd66880268fb2e8c2ad33faff"} Jun 08 13:53:18.214949 ip-10-0-140-46 kubenswrapper[2576]: I0608 13:53:18.214925 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-5d4b67c446-sfb4p" Jun 08 13:53:18.235899 ip-10-0-140-46 kubenswrapper[2576]: I0608 13:53:18.235866 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-5d4b67c446-sfb4p" Jun 08 13:53:18.244923 ip-10-0-140-46 kubenswrapper[2576]: I0608 13:53:18.244851 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-2v59j\" (UniqueName: \"kubernetes.io/projected/fd12f340-72e3-487b-9ff7-adc893bc62f3-kube-api-access-2v59j\") pod \"fd12f340-72e3-487b-9ff7-adc893bc62f3\" (UID: \"fd12f340-72e3-487b-9ff7-adc893bc62f3\") " Jun 08 13:53:18.247057 ip-10-0-140-46 kubenswrapper[2576]: I0608 13:53:18.247025 2576 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/fd12f340-72e3-487b-9ff7-adc893bc62f3-kube-api-access-2v59j" (OuterVolumeSpecName: "kube-api-access-2v59j") pod "fd12f340-72e3-487b-9ff7-adc893bc62f3" (UID: "fd12f340-72e3-487b-9ff7-adc893bc62f3"). InnerVolumeSpecName "kube-api-access-2v59j". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 08 13:53:18.335041 ip-10-0-140-46 kubenswrapper[2576]: I0608 13:53:18.335001 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-5855885687-jk7lw" Jun 08 13:53:18.345944 ip-10-0-140-46 kubenswrapper[2576]: I0608 13:53:18.345908 2576 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-2v59j\" (UniqueName: \"kubernetes.io/projected/fd12f340-72e3-487b-9ff7-adc893bc62f3-kube-api-access-2v59j\") on node \"ip-10-0-140-46.ec2.internal\" DevicePath \"\"" Jun 08 13:53:18.491410 ip-10-0-140-46 kubenswrapper[2576]: I0608 13:53:18.491376 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-5855885687-jk7lw"] Jun 08 13:53:18.493958 ip-10-0-140-46 kubenswrapper[2576]: W0608 13:53:18.493933 2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod651b4b51_7b18_490a_909d_6c034efa9fd6.slice/crio-18f6836487b965711c7b86b1d8c70f0e94ce7ff7d84344ae8107ff91e747b3d8 WatchSource:0}: Error finding container 18f6836487b965711c7b86b1d8c70f0e94ce7ff7d84344ae8107ff91e747b3d8: Status 404 returned error can't find the container with id 18f6836487b965711c7b86b1d8c70f0e94ce7ff7d84344ae8107ff91e747b3d8 Jun 08 13:53:19.221370 ip-10-0-140-46 kubenswrapper[2576]: I0608 13:53:19.221259 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-6c7879c647-szrq8" event={"ID":"1ef90196-8a1b-4401-ae46-144a01413d51","Type":"ContainerStarted","Data":"7e89d0759bc2da703f95dd9ab1992e794a398757e953a4d8ae288f4d4d8b7ab9"} Jun 08 13:53:19.221370 ip-10-0-140-46 kubenswrapper[2576]: I0608 13:53:19.221272 2576 kuberuntime_container.go:872] "Killing container with a grace period" pod="kuadrant-system/authorino-6c7879c647-szrq8" podUID="1ef90196-8a1b-4401-ae46-144a01413d51" containerName="authorino" containerID="cri-o://7e89d0759bc2da703f95dd9ab1992e794a398757e953a4d8ae288f4d4d8b7ab9" gracePeriod=30 Jun 08 13:53:19.222831 ip-10-0-140-46 kubenswrapper[2576]: I0608 13:53:19.222808 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-5d4b67c446-sfb4p" Jun 08 13:53:19.222962 ip-10-0-140-46 kubenswrapper[2576]: I0608 13:53:19.222853 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-5855885687-jk7lw" event={"ID":"651b4b51-7b18-490a-909d-6c034efa9fd6","Type":"ContainerStarted","Data":"5942fe8846e5b1040b578258e886c75bd1c7a24758c565064564e1150dbc02cd"} Jun 08 13:53:19.222962 ip-10-0-140-46 kubenswrapper[2576]: I0608 13:53:19.222892 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-5855885687-jk7lw" event={"ID":"651b4b51-7b18-490a-909d-6c034efa9fd6","Type":"ContainerStarted","Data":"18f6836487b965711c7b86b1d8c70f0e94ce7ff7d84344ae8107ff91e747b3d8"} Jun 08 13:53:19.244970 ip-10-0-140-46 kubenswrapper[2576]: I0608 13:53:19.244924 2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/authorino-6c7879c647-szrq8" podStartSLOduration=1.6406759100000001 podStartE2EDuration="2.24490893s" totalImagesPullingTime="604.23302ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-08 13:53:17 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-08 13:53:19.241541956 +0000 UTC m=+567.320870848" watchObservedRunningTime="2026-06-08 13:53:19.24490893 +0000 UTC m=+567.324237822" Jun 08 13:53:19.284605 ip-10-0-140-46 kubenswrapper[2576]: I0608 13:53:19.284556 2576 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-5d4b67c446-sfb4p"] Jun 08 13:53:19.291101 ip-10-0-140-46 kubenswrapper[2576]: I0608 13:53:19.291073 2576 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/authorino-5d4b67c446-sfb4p"] Jun 08 13:53:19.314671 ip-10-0-140-46 kubenswrapper[2576]: I0608 13:53:19.314606 2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/authorino-5855885687-jk7lw" podStartSLOduration=1.9765527920000001 podStartE2EDuration="2.314586285s" totalImagesPullingTime="338.033493ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-08 13:53:17 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-08 13:53:19.313853913 +0000 UTC m=+567.393182806" watchObservedRunningTime="2026-06-08 13:53:19.314586285 +0000 UTC m=+567.393915171" Jun 08 13:53:19.365545 ip-10-0-140-46 kubenswrapper[2576]: I0608 13:53:19.365511 2576 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-75d556bd77-kt9vt"] Jun 08 13:53:19.365749 ip-10-0-140-46 kubenswrapper[2576]: I0608 13:53:19.365706 2576 kuberuntime_container.go:872] "Killing container with a grace period" pod="kuadrant-system/authorino-75d556bd77-kt9vt" podUID="c78f6737-714c-4498-9b6b-8454c04a9d91" containerName="authorino" containerID="cri-o://8eedb7fc5df9fa0b4219d7b409664ca9aeee1d32b262e084f33ba357f19383eb" gracePeriod=30 Jun 08 13:53:19.476750 ip-10-0-140-46 kubenswrapper[2576]: I0608 13:53:19.476687 2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-6c7879c647-szrq8" Jun 08 13:53:19.555236 ip-10-0-140-46 kubenswrapper[2576]: I0608 13:53:19.555207 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-29r2w\" (UniqueName: \"kubernetes.io/projected/1ef90196-8a1b-4401-ae46-144a01413d51-kube-api-access-29r2w\") pod \"1ef90196-8a1b-4401-ae46-144a01413d51\" (UID: \"1ef90196-8a1b-4401-ae46-144a01413d51\") " Jun 08 13:53:19.557362 ip-10-0-140-46 kubenswrapper[2576]: I0608 13:53:19.557326 2576 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/1ef90196-8a1b-4401-ae46-144a01413d51-kube-api-access-29r2w" (OuterVolumeSpecName: "kube-api-access-29r2w") pod "1ef90196-8a1b-4401-ae46-144a01413d51" (UID: "1ef90196-8a1b-4401-ae46-144a01413d51"). InnerVolumeSpecName "kube-api-access-29r2w". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 08 13:53:19.612893 ip-10-0-140-46 kubenswrapper[2576]: I0608 13:53:19.612865 2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-75d556bd77-kt9vt" Jun 08 13:53:19.656756 ip-10-0-140-46 kubenswrapper[2576]: I0608 13:53:19.656721 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-xkpck\" (UniqueName: \"kubernetes.io/projected/c78f6737-714c-4498-9b6b-8454c04a9d91-kube-api-access-xkpck\") pod \"c78f6737-714c-4498-9b6b-8454c04a9d91\" (UID: \"c78f6737-714c-4498-9b6b-8454c04a9d91\") " Jun 08 13:53:19.656943 ip-10-0-140-46 kubenswrapper[2576]: I0608 13:53:19.656930 2576 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-29r2w\" (UniqueName: \"kubernetes.io/projected/1ef90196-8a1b-4401-ae46-144a01413d51-kube-api-access-29r2w\") on node \"ip-10-0-140-46.ec2.internal\" DevicePath \"\"" Jun 08 13:53:19.658893 ip-10-0-140-46 kubenswrapper[2576]: I0608 13:53:19.658857 2576 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/c78f6737-714c-4498-9b6b-8454c04a9d91-kube-api-access-xkpck" (OuterVolumeSpecName: "kube-api-access-xkpck") pod "c78f6737-714c-4498-9b6b-8454c04a9d91" (UID: "c78f6737-714c-4498-9b6b-8454c04a9d91"). InnerVolumeSpecName "kube-api-access-xkpck". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 08 13:53:19.757971 ip-10-0-140-46 kubenswrapper[2576]: I0608 13:53:19.757888 2576 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-xkpck\" (UniqueName: \"kubernetes.io/projected/c78f6737-714c-4498-9b6b-8454c04a9d91-kube-api-access-xkpck\") on node \"ip-10-0-140-46.ec2.internal\" DevicePath \"\"" Jun 08 13:53:20.229164 ip-10-0-140-46 kubenswrapper[2576]: I0608 13:53:20.229126 2576 generic.go:356] "Generic (PLEG): container finished" podID="c78f6737-714c-4498-9b6b-8454c04a9d91" containerID="8eedb7fc5df9fa0b4219d7b409664ca9aeee1d32b262e084f33ba357f19383eb" exitCode=0 Jun 08 13:53:20.229164 ip-10-0-140-46 kubenswrapper[2576]: I0608 13:53:20.229167 2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-75d556bd77-kt9vt" Jun 08 13:53:20.229679 ip-10-0-140-46 kubenswrapper[2576]: I0608 13:53:20.229214 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-75d556bd77-kt9vt" event={"ID":"c78f6737-714c-4498-9b6b-8454c04a9d91","Type":"ContainerDied","Data":"8eedb7fc5df9fa0b4219d7b409664ca9aeee1d32b262e084f33ba357f19383eb"} Jun 08 13:53:20.229679 ip-10-0-140-46 kubenswrapper[2576]: I0608 13:53:20.229255 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-75d556bd77-kt9vt" event={"ID":"c78f6737-714c-4498-9b6b-8454c04a9d91","Type":"ContainerDied","Data":"bb24a15be48f4d550711aeaa6b4f818ec67891de33edd01ad90537de5fb21bf6"} Jun 08 13:53:20.229679 ip-10-0-140-46 kubenswrapper[2576]: I0608 13:53:20.229277 2576 scope.go:117] "RemoveContainer" containerID="8eedb7fc5df9fa0b4219d7b409664ca9aeee1d32b262e084f33ba357f19383eb" Jun 08 13:53:20.230545 ip-10-0-140-46 kubenswrapper[2576]: I0608 13:53:20.230515 2576 generic.go:356] "Generic (PLEG): container finished" podID="1ef90196-8a1b-4401-ae46-144a01413d51" containerID="7e89d0759bc2da703f95dd9ab1992e794a398757e953a4d8ae288f4d4d8b7ab9" exitCode=0 Jun 08 13:53:20.230651 ip-10-0-140-46 kubenswrapper[2576]: I0608 13:53:20.230544 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-6c7879c647-szrq8" event={"ID":"1ef90196-8a1b-4401-ae46-144a01413d51","Type":"ContainerDied","Data":"7e89d0759bc2da703f95dd9ab1992e794a398757e953a4d8ae288f4d4d8b7ab9"} Jun 08 13:53:20.230651 ip-10-0-140-46 kubenswrapper[2576]: I0608 13:53:20.230597 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-6c7879c647-szrq8" event={"ID":"1ef90196-8a1b-4401-ae46-144a01413d51","Type":"ContainerDied","Data":"0ddd41c077b9f0cc548ebf41e0ddf990818ca89bd66880268fb2e8c2ad33faff"} Jun 08 13:53:20.230651 ip-10-0-140-46 kubenswrapper[2576]: I0608 13:53:20.230556 2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-6c7879c647-szrq8" Jun 08 13:53:20.238153 ip-10-0-140-46 kubenswrapper[2576]: I0608 13:53:20.238139 2576 scope.go:117] "RemoveContainer" containerID="8eedb7fc5df9fa0b4219d7b409664ca9aeee1d32b262e084f33ba357f19383eb" Jun 08 13:53:20.238501 ip-10-0-140-46 kubenswrapper[2576]: E0608 13:53:20.238391 2576 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"8eedb7fc5df9fa0b4219d7b409664ca9aeee1d32b262e084f33ba357f19383eb\": container with ID starting with 8eedb7fc5df9fa0b4219d7b409664ca9aeee1d32b262e084f33ba357f19383eb not found: ID does not exist" containerID="8eedb7fc5df9fa0b4219d7b409664ca9aeee1d32b262e084f33ba357f19383eb" Jun 08 13:53:20.238501 ip-10-0-140-46 kubenswrapper[2576]: I0608 13:53:20.238414 2576 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"8eedb7fc5df9fa0b4219d7b409664ca9aeee1d32b262e084f33ba357f19383eb"} err="failed to get container status \"8eedb7fc5df9fa0b4219d7b409664ca9aeee1d32b262e084f33ba357f19383eb\": rpc error: code = NotFound desc = could not find container \"8eedb7fc5df9fa0b4219d7b409664ca9aeee1d32b262e084f33ba357f19383eb\": container with ID starting with 8eedb7fc5df9fa0b4219d7b409664ca9aeee1d32b262e084f33ba357f19383eb not found: ID does not exist" Jun 08 13:53:20.238501 ip-10-0-140-46 kubenswrapper[2576]: I0608 13:53:20.238429 2576 scope.go:117] "RemoveContainer" containerID="7e89d0759bc2da703f95dd9ab1992e794a398757e953a4d8ae288f4d4d8b7ab9" Jun 08 13:53:20.246278 ip-10-0-140-46 kubenswrapper[2576]: I0608 13:53:20.246260 2576 scope.go:117] "RemoveContainer" containerID="7e89d0759bc2da703f95dd9ab1992e794a398757e953a4d8ae288f4d4d8b7ab9" Jun 08 13:53:20.246521 ip-10-0-140-46 kubenswrapper[2576]: E0608 13:53:20.246503 2576 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"7e89d0759bc2da703f95dd9ab1992e794a398757e953a4d8ae288f4d4d8b7ab9\": container with ID starting with 7e89d0759bc2da703f95dd9ab1992e794a398757e953a4d8ae288f4d4d8b7ab9 not found: ID does not exist" containerID="7e89d0759bc2da703f95dd9ab1992e794a398757e953a4d8ae288f4d4d8b7ab9" Jun 08 13:53:20.246610 ip-10-0-140-46 kubenswrapper[2576]: I0608 13:53:20.246527 2576 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"7e89d0759bc2da703f95dd9ab1992e794a398757e953a4d8ae288f4d4d8b7ab9"} err="failed to get container status \"7e89d0759bc2da703f95dd9ab1992e794a398757e953a4d8ae288f4d4d8b7ab9\": rpc error: code = NotFound desc = could not find container \"7e89d0759bc2da703f95dd9ab1992e794a398757e953a4d8ae288f4d4d8b7ab9\": container with ID starting with 7e89d0759bc2da703f95dd9ab1992e794a398757e953a4d8ae288f4d4d8b7ab9 not found: ID does not exist" Jun 08 13:53:20.259418 ip-10-0-140-46 kubenswrapper[2576]: I0608 13:53:20.259386 2576 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-75d556bd77-kt9vt"] Jun 08 13:53:20.267551 ip-10-0-140-46 kubenswrapper[2576]: I0608 13:53:20.267531 2576 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/authorino-75d556bd77-kt9vt"] Jun 08 13:53:20.279357 ip-10-0-140-46 kubenswrapper[2576]: I0608 13:53:20.279332 2576 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-6c7879c647-szrq8"] Jun 08 13:53:20.283905 ip-10-0-140-46 kubenswrapper[2576]: I0608 13:53:20.283884 2576 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/authorino-6c7879c647-szrq8"] Jun 08 13:53:20.377009 ip-10-0-140-46 kubenswrapper[2576]: I0608 13:53:20.376974 2576 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="1ef90196-8a1b-4401-ae46-144a01413d51" path="/var/lib/kubelet/pods/1ef90196-8a1b-4401-ae46-144a01413d51/volumes" Jun 08 13:53:20.377369 ip-10-0-140-46 kubenswrapper[2576]: I0608 13:53:20.377349 2576 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="c78f6737-714c-4498-9b6b-8454c04a9d91" path="/var/lib/kubelet/pods/c78f6737-714c-4498-9b6b-8454c04a9d91/volumes" Jun 08 13:53:20.377715 ip-10-0-140-46 kubenswrapper[2576]: I0608 13:53:20.377696 2576 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="fd12f340-72e3-487b-9ff7-adc893bc62f3" path="/var/lib/kubelet/pods/fd12f340-72e3-487b-9ff7-adc893bc62f3/volumes" Jun 08 13:53:23.081935 ip-10-0-140-46 kubenswrapper[2576]: I0608 13:53:23.081898 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cx7sn_6e4b50fc-3e91-4f50-b92a-e90919788248/konnectivity-agent/0.log" limit=1024 Jun 08 13:53:23.112707 ip-10-0-140-46 kubenswrapper[2576]: I0608 13:53:23.112673 2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/maas-controller-fd49d6dcb-4wczv"] Jun 08 13:53:23.113146 ip-10-0-140-46 kubenswrapper[2576]: I0608 13:53:23.113132 2576 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="1ef90196-8a1b-4401-ae46-144a01413d51" containerName="authorino" Jun 08 13:53:23.113193 ip-10-0-140-46 kubenswrapper[2576]: I0608 13:53:23.113150 2576 state_mem.go:107] "Deleted CPUSet assignment" podUID="1ef90196-8a1b-4401-ae46-144a01413d51" containerName="authorino" Jun 08 13:53:23.113193 ip-10-0-140-46 kubenswrapper[2576]: I0608 13:53:23.113181 2576 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="c78f6737-714c-4498-9b6b-8454c04a9d91" containerName="authorino" Jun 08 13:53:23.113193 ip-10-0-140-46 kubenswrapper[2576]: I0608 13:53:23.113189 2576 state_mem.go:107] "Deleted CPUSet assignment" podUID="c78f6737-714c-4498-9b6b-8454c04a9d91" containerName="authorino" Jun 08 13:53:23.113283 ip-10-0-140-46 kubenswrapper[2576]: I0608 13:53:23.113259 2576 memory_manager.go:368] "RemoveStaleState removing state" podUID="1ef90196-8a1b-4401-ae46-144a01413d51" containerName="authorino" Jun 08 13:53:23.113283 ip-10-0-140-46 kubenswrapper[2576]: I0608 13:53:23.113271 2576 memory_manager.go:368] "RemoveStaleState removing state" podUID="c78f6737-714c-4498-9b6b-8454c04a9d91" containerName="authorino" Jun 08 13:53:23.116138 ip-10-0-140-46 kubenswrapper[2576]: I0608 13:53:23.116120 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-fd49d6dcb-4wczv" Jun 08 13:53:23.118904 ip-10-0-140-46 kubenswrapper[2576]: I0608 13:53:23.118882 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"maas-parameters\"" Jun 08 13:53:23.119138 ip-10-0-140-46 kubenswrapper[2576]: I0608 13:53:23.118945 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-controller-webhook-cert\"" Jun 08 13:53:23.119247 ip-10-0-140-46 kubenswrapper[2576]: I0608 13:53:23.118986 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-controller-dockercfg-bf2t7\"" Jun 08 13:53:23.128320 ip-10-0-140-46 kubenswrapper[2576]: I0608 13:53:23.128294 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-fd49d6dcb-4wczv"] Jun 08 13:53:23.172753 ip-10-0-140-46 kubenswrapper[2576]: I0608 13:53:23.172717 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cx7sn_6e4b50fc-3e91-4f50-b92a-e90919788248/konnectivity-agent/0.log" limit=1024 Jun 08 13:53:23.188342 ip-10-0-140-46 kubenswrapper[2576]: I0608 13:53:23.188310 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/87da5b75-bab0-407f-bd24-d7e460a1a14b-webhook-cert\") pod \"maas-controller-fd49d6dcb-4wczv\" (UID: \"87da5b75-bab0-407f-bd24-d7e460a1a14b\") " pod="opendatahub/maas-controller-fd49d6dcb-4wczv" Jun 08 13:53:23.188503 ip-10-0-140-46 kubenswrapper[2576]: I0608 13:53:23.188350 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mxc4b\" (UniqueName: \"kubernetes.io/projected/87da5b75-bab0-407f-bd24-d7e460a1a14b-kube-api-access-mxc4b\") pod \"maas-controller-fd49d6dcb-4wczv\" (UID: \"87da5b75-bab0-407f-bd24-d7e460a1a14b\") " pod="opendatahub/maas-controller-fd49d6dcb-4wczv" Jun 08 13:53:23.243385 ip-10-0-140-46 kubenswrapper[2576]: I0608 13:53:23.243351 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cx7sn_6e4b50fc-3e91-4f50-b92a-e90919788248/konnectivity-agent/0.log" limit=1024 Jun 08 13:53:23.289311 ip-10-0-140-46 kubenswrapper[2576]: I0608 13:53:23.289277 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/87da5b75-bab0-407f-bd24-d7e460a1a14b-webhook-cert\") pod \"maas-controller-fd49d6dcb-4wczv\" (UID: \"87da5b75-bab0-407f-bd24-d7e460a1a14b\") " pod="opendatahub/maas-controller-fd49d6dcb-4wczv" Jun 08 13:53:23.289485 ip-10-0-140-46 kubenswrapper[2576]: I0608 13:53:23.289323 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mxc4b\" (UniqueName: \"kubernetes.io/projected/87da5b75-bab0-407f-bd24-d7e460a1a14b-kube-api-access-mxc4b\") pod \"maas-controller-fd49d6dcb-4wczv\" (UID: \"87da5b75-bab0-407f-bd24-d7e460a1a14b\") " pod="opendatahub/maas-controller-fd49d6dcb-4wczv" Jun 08 13:53:23.291942 ip-10-0-140-46 kubenswrapper[2576]: I0608 13:53:23.291918 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/87da5b75-bab0-407f-bd24-d7e460a1a14b-webhook-cert\") pod \"maas-controller-fd49d6dcb-4wczv\" (UID: \"87da5b75-bab0-407f-bd24-d7e460a1a14b\") " pod="opendatahub/maas-controller-fd49d6dcb-4wczv" Jun 08 13:53:23.299954 ip-10-0-140-46 kubenswrapper[2576]: I0608 13:53:23.299930 2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/maas-controller-b646647b6-msjv5"] Jun 08 13:53:23.302164 ip-10-0-140-46 kubenswrapper[2576]: I0608 13:53:23.302149 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-b646647b6-msjv5" Jun 08 13:53:23.307971 ip-10-0-140-46 kubenswrapper[2576]: I0608 13:53:23.307928 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-mxc4b\" (UniqueName: \"kubernetes.io/projected/87da5b75-bab0-407f-bd24-d7e460a1a14b-kube-api-access-mxc4b\") pod \"maas-controller-fd49d6dcb-4wczv\" (UID: \"87da5b75-bab0-407f-bd24-d7e460a1a14b\") " pod="opendatahub/maas-controller-fd49d6dcb-4wczv" Jun 08 13:53:23.318321 ip-10-0-140-46 kubenswrapper[2576]: I0608 13:53:23.318300 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-b646647b6-msjv5"] Jun 08 13:53:23.390084 ip-10-0-140-46 kubenswrapper[2576]: I0608 13:53:23.389992 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-w6rb7\" (UniqueName: \"kubernetes.io/projected/6b5fda6d-b6fd-4318-956e-6ce6b56e08d6-kube-api-access-w6rb7\") pod \"maas-controller-b646647b6-msjv5\" (UID: \"6b5fda6d-b6fd-4318-956e-6ce6b56e08d6\") " pod="opendatahub/maas-controller-b646647b6-msjv5" Jun 08 13:53:23.390084 ip-10-0-140-46 kubenswrapper[2576]: I0608 13:53:23.390038 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/6b5fda6d-b6fd-4318-956e-6ce6b56e08d6-webhook-cert\") pod \"maas-controller-b646647b6-msjv5\" (UID: \"6b5fda6d-b6fd-4318-956e-6ce6b56e08d6\") " pod="opendatahub/maas-controller-b646647b6-msjv5" Jun 08 13:53:23.427680 ip-10-0-140-46 kubenswrapper[2576]: I0608 13:53:23.427649 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-fd49d6dcb-4wczv" Jun 08 13:53:23.491204 ip-10-0-140-46 kubenswrapper[2576]: I0608 13:53:23.491113 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-w6rb7\" (UniqueName: \"kubernetes.io/projected/6b5fda6d-b6fd-4318-956e-6ce6b56e08d6-kube-api-access-w6rb7\") pod \"maas-controller-b646647b6-msjv5\" (UID: \"6b5fda6d-b6fd-4318-956e-6ce6b56e08d6\") " pod="opendatahub/maas-controller-b646647b6-msjv5" Jun 08 13:53:23.491204 ip-10-0-140-46 kubenswrapper[2576]: I0608 13:53:23.491182 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/6b5fda6d-b6fd-4318-956e-6ce6b56e08d6-webhook-cert\") pod \"maas-controller-b646647b6-msjv5\" (UID: \"6b5fda6d-b6fd-4318-956e-6ce6b56e08d6\") " pod="opendatahub/maas-controller-b646647b6-msjv5" Jun 08 13:53:23.494332 ip-10-0-140-46 kubenswrapper[2576]: I0608 13:53:23.494301 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/6b5fda6d-b6fd-4318-956e-6ce6b56e08d6-webhook-cert\") pod \"maas-controller-b646647b6-msjv5\" (UID: \"6b5fda6d-b6fd-4318-956e-6ce6b56e08d6\") " pod="opendatahub/maas-controller-b646647b6-msjv5" Jun 08 13:53:23.502308 ip-10-0-140-46 kubenswrapper[2576]: I0608 13:53:23.502281 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-w6rb7\" (UniqueName: \"kubernetes.io/projected/6b5fda6d-b6fd-4318-956e-6ce6b56e08d6-kube-api-access-w6rb7\") pod \"maas-controller-b646647b6-msjv5\" (UID: \"6b5fda6d-b6fd-4318-956e-6ce6b56e08d6\") " pod="opendatahub/maas-controller-b646647b6-msjv5" Jun 08 13:53:23.562639 ip-10-0-140-46 kubenswrapper[2576]: I0608 13:53:23.562612 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-fd49d6dcb-4wczv"] Jun 08 13:53:23.563260 ip-10-0-140-46 kubenswrapper[2576]: W0608 13:53:23.563231 2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod87da5b75_bab0_407f_bd24_d7e460a1a14b.slice/crio-4300e5d49b62092c99cec83b5b103ffe4770b9b4c2ac76f5044504ac41c0f434 WatchSource:0}: Error finding container 4300e5d49b62092c99cec83b5b103ffe4770b9b4c2ac76f5044504ac41c0f434: Status 404 returned error can't find the container with id 4300e5d49b62092c99cec83b5b103ffe4770b9b4c2ac76f5044504ac41c0f434 Jun 08 13:53:23.621430 ip-10-0-140-46 kubenswrapper[2576]: I0608 13:53:23.621397 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-b646647b6-msjv5" Jun 08 13:53:23.761659 ip-10-0-140-46 kubenswrapper[2576]: I0608 13:53:23.761635 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-b646647b6-msjv5"] Jun 08 13:53:23.762714 ip-10-0-140-46 kubenswrapper[2576]: W0608 13:53:23.762692 2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6b5fda6d_b6fd_4318_956e_6ce6b56e08d6.slice/crio-b1065251c53019bbe67f50f225dbf3dcd1627e51e2deb7478200c79ce77182fc WatchSource:0}: Error finding container b1065251c53019bbe67f50f225dbf3dcd1627e51e2deb7478200c79ce77182fc: Status 404 returned error can't find the container with id b1065251c53019bbe67f50f225dbf3dcd1627e51e2deb7478200c79ce77182fc Jun 08 13:53:24.262686 ip-10-0-140-46 kubenswrapper[2576]: I0608 13:53:24.262642 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-b646647b6-msjv5" event={"ID":"6b5fda6d-b6fd-4318-956e-6ce6b56e08d6","Type":"ContainerStarted","Data":"b1065251c53019bbe67f50f225dbf3dcd1627e51e2deb7478200c79ce77182fc"} Jun 08 13:53:24.264607 ip-10-0-140-46 kubenswrapper[2576]: I0608 13:53:24.264554 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-fd49d6dcb-4wczv" event={"ID":"87da5b75-bab0-407f-bd24-d7e460a1a14b","Type":"ContainerStarted","Data":"4300e5d49b62092c99cec83b5b103ffe4770b9b4c2ac76f5044504ac41c0f434"} Jun 08 13:53:26.527117 ip-10-0-140-46 kubenswrapper[2576]: I0608 13:53:26.527029 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cx7sn_6e4b50fc-3e91-4f50-b92a-e90919788248/konnectivity-agent/0.log" limit=1024 Jun 08 13:53:26.622910 ip-10-0-140-46 kubenswrapper[2576]: I0608 13:53:26.622875 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cx7sn_6e4b50fc-3e91-4f50-b92a-e90919788248/konnectivity-agent/0.log" limit=1024 Jun 08 13:53:27.284487 ip-10-0-140-46 kubenswrapper[2576]: I0608 13:53:27.284455 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-b646647b6-msjv5" event={"ID":"6b5fda6d-b6fd-4318-956e-6ce6b56e08d6","Type":"ContainerStarted","Data":"13eabea29736e3831a1702c316d4428f64762427969da19fa068d69e7b0a84ff"} Jun 08 13:53:27.284747 ip-10-0-140-46 kubenswrapper[2576]: I0608 13:53:27.284722 2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/maas-controller-b646647b6-msjv5" Jun 08 13:53:27.286036 ip-10-0-140-46 kubenswrapper[2576]: I0608 13:53:27.286012 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-fd49d6dcb-4wczv" event={"ID":"87da5b75-bab0-407f-bd24-d7e460a1a14b","Type":"ContainerStarted","Data":"fd2c7abb434e15c06f797f4326f1005c27d5865400f4eee415c4d1c248efdcf8"} Jun 08 13:53:27.286129 ip-10-0-140-46 kubenswrapper[2576]: I0608 13:53:27.286065 2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/maas-controller-fd49d6dcb-4wczv" Jun 08 13:53:27.306892 ip-10-0-140-46 kubenswrapper[2576]: I0608 13:53:27.306841 2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/maas-controller-b646647b6-msjv5" podStartSLOduration=1.794525521 podStartE2EDuration="4.306824983s" totalImagesPullingTime="2.512299462s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-08 13:53:23 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-08 13:53:27.306406161 +0000 UTC m=+575.385735053" watchObservedRunningTime="2026-06-08 13:53:27.306824983 +0000 UTC m=+575.386153878" Jun 08 13:53:27.332638 ip-10-0-140-46 kubenswrapper[2576]: I0608 13:53:27.332590 2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/maas-controller-fd49d6dcb-4wczv" podStartSLOduration=1.609418212 podStartE2EDuration="4.332575143s" totalImagesPullingTime="2.723156931s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-08 13:53:23 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-08 13:53:27.329918271 +0000 UTC m=+575.409247162" watchObservedRunningTime="2026-06-08 13:53:27.332575143 +0000 UTC m=+575.411904028" Jun 08 13:53:38.297863 ip-10-0-140-46 kubenswrapper[2576]: I0608 13:53:38.297825 2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/maas-controller-fd49d6dcb-4wczv" Jun 08 13:53:38.298344 ip-10-0-140-46 kubenswrapper[2576]: I0608 13:53:38.298168 2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/maas-controller-b646647b6-msjv5" Jun 08 13:53:38.363537 ip-10-0-140-46 kubenswrapper[2576]: I0608 13:53:38.363498 2576 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-controller-fd49d6dcb-4wczv"] Jun 08 13:53:38.363746 ip-10-0-140-46 kubenswrapper[2576]: I0608 13:53:38.363721 2576 kuberuntime_container.go:872] "Killing container with a grace period" pod="opendatahub/maas-controller-fd49d6dcb-4wczv" podUID="87da5b75-bab0-407f-bd24-d7e460a1a14b" containerName="manager" containerID="cri-o://fd2c7abb434e15c06f797f4326f1005c27d5865400f4eee415c4d1c248efdcf8" gracePeriod=30 Jun 08 13:53:38.621930 ip-10-0-140-46 kubenswrapper[2576]: I0608 13:53:38.621905 2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-fd49d6dcb-4wczv" Jun 08 13:53:38.725348 ip-10-0-140-46 kubenswrapper[2576]: I0608 13:53:38.725306 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/87da5b75-bab0-407f-bd24-d7e460a1a14b-webhook-cert\") pod \"87da5b75-bab0-407f-bd24-d7e460a1a14b\" (UID: \"87da5b75-bab0-407f-bd24-d7e460a1a14b\") " Jun 08 13:53:38.725552 ip-10-0-140-46 kubenswrapper[2576]: I0608 13:53:38.725436 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-mxc4b\" (UniqueName: \"kubernetes.io/projected/87da5b75-bab0-407f-bd24-d7e460a1a14b-kube-api-access-mxc4b\") pod \"87da5b75-bab0-407f-bd24-d7e460a1a14b\" (UID: \"87da5b75-bab0-407f-bd24-d7e460a1a14b\") " Jun 08 13:53:38.727615 ip-10-0-140-46 kubenswrapper[2576]: I0608 13:53:38.727589 2576 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/87da5b75-bab0-407f-bd24-d7e460a1a14b-webhook-cert" (OuterVolumeSpecName: "webhook-cert") pod "87da5b75-bab0-407f-bd24-d7e460a1a14b" (UID: "87da5b75-bab0-407f-bd24-d7e460a1a14b"). InnerVolumeSpecName "webhook-cert". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 08 13:53:38.727615 ip-10-0-140-46 kubenswrapper[2576]: I0608 13:53:38.727604 2576 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/87da5b75-bab0-407f-bd24-d7e460a1a14b-kube-api-access-mxc4b" (OuterVolumeSpecName: "kube-api-access-mxc4b") pod "87da5b75-bab0-407f-bd24-d7e460a1a14b" (UID: "87da5b75-bab0-407f-bd24-d7e460a1a14b"). InnerVolumeSpecName "kube-api-access-mxc4b". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 08 13:53:38.826659 ip-10-0-140-46 kubenswrapper[2576]: I0608 13:53:38.826625 2576 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-mxc4b\" (UniqueName: \"kubernetes.io/projected/87da5b75-bab0-407f-bd24-d7e460a1a14b-kube-api-access-mxc4b\") on node \"ip-10-0-140-46.ec2.internal\" DevicePath \"\"" Jun 08 13:53:38.826659 ip-10-0-140-46 kubenswrapper[2576]: I0608 13:53:38.826653 2576 reconciler_common.go:299] "Volume detached for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/87da5b75-bab0-407f-bd24-d7e460a1a14b-webhook-cert\") on node \"ip-10-0-140-46.ec2.internal\" DevicePath \"\"" Jun 08 13:53:39.354806 ip-10-0-140-46 kubenswrapper[2576]: I0608 13:53:39.354766 2576 generic.go:356] "Generic (PLEG): container finished" podID="87da5b75-bab0-407f-bd24-d7e460a1a14b" containerID="fd2c7abb434e15c06f797f4326f1005c27d5865400f4eee415c4d1c248efdcf8" exitCode=0 Jun 08 13:53:39.355183 ip-10-0-140-46 kubenswrapper[2576]: I0608 13:53:39.354817 2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-fd49d6dcb-4wczv" Jun 08 13:53:39.355183 ip-10-0-140-46 kubenswrapper[2576]: I0608 13:53:39.354833 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-fd49d6dcb-4wczv" event={"ID":"87da5b75-bab0-407f-bd24-d7e460a1a14b","Type":"ContainerDied","Data":"fd2c7abb434e15c06f797f4326f1005c27d5865400f4eee415c4d1c248efdcf8"} Jun 08 13:53:39.355183 ip-10-0-140-46 kubenswrapper[2576]: I0608 13:53:39.354885 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-fd49d6dcb-4wczv" event={"ID":"87da5b75-bab0-407f-bd24-d7e460a1a14b","Type":"ContainerDied","Data":"4300e5d49b62092c99cec83b5b103ffe4770b9b4c2ac76f5044504ac41c0f434"} Jun 08 13:53:39.355183 ip-10-0-140-46 kubenswrapper[2576]: I0608 13:53:39.354914 2576 scope.go:117] "RemoveContainer" containerID="fd2c7abb434e15c06f797f4326f1005c27d5865400f4eee415c4d1c248efdcf8" Jun 08 13:53:39.364240 ip-10-0-140-46 kubenswrapper[2576]: I0608 13:53:39.364221 2576 scope.go:117] "RemoveContainer" containerID="fd2c7abb434e15c06f797f4326f1005c27d5865400f4eee415c4d1c248efdcf8" Jun 08 13:53:39.364487 ip-10-0-140-46 kubenswrapper[2576]: E0608 13:53:39.364465 2576 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"fd2c7abb434e15c06f797f4326f1005c27d5865400f4eee415c4d1c248efdcf8\": container with ID starting with fd2c7abb434e15c06f797f4326f1005c27d5865400f4eee415c4d1c248efdcf8 not found: ID does not exist" containerID="fd2c7abb434e15c06f797f4326f1005c27d5865400f4eee415c4d1c248efdcf8" Jun 08 13:53:39.364537 ip-10-0-140-46 kubenswrapper[2576]: I0608 13:53:39.364496 2576 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"fd2c7abb434e15c06f797f4326f1005c27d5865400f4eee415c4d1c248efdcf8"} err="failed to get container status \"fd2c7abb434e15c06f797f4326f1005c27d5865400f4eee415c4d1c248efdcf8\": rpc error: code = NotFound desc = could not find container \"fd2c7abb434e15c06f797f4326f1005c27d5865400f4eee415c4d1c248efdcf8\": container with ID starting with fd2c7abb434e15c06f797f4326f1005c27d5865400f4eee415c4d1c248efdcf8 not found: ID does not exist" Jun 08 13:53:39.378344 ip-10-0-140-46 kubenswrapper[2576]: I0608 13:53:39.378312 2576 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-controller-fd49d6dcb-4wczv"] Jun 08 13:53:39.382360 ip-10-0-140-46 kubenswrapper[2576]: I0608 13:53:39.382336 2576 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/maas-controller-fd49d6dcb-4wczv"] Jun 08 13:53:40.376579 ip-10-0-140-46 kubenswrapper[2576]: I0608 13:53:40.376540 2576 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="87da5b75-bab0-407f-bd24-d7e460a1a14b" path="/var/lib/kubelet/pods/87da5b75-bab0-407f-bd24-d7e460a1a14b/volumes" Jun 08 13:53:52.348541 ip-10-0-140-46 kubenswrapper[2576]: I0608 13:53:52.348512 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-ncffd_c26912ca-10b4-4ae3-b306-890f93abfee3/ovn-acl-logging/0.log" Jun 08 13:53:52.350076 ip-10-0-140-46 kubenswrapper[2576]: I0608 13:53:52.350053 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-ncffd_c26912ca-10b4-4ae3-b306-890f93abfee3/ovn-acl-logging/0.log" Jun 08 13:53:57.644270 ip-10-0-140-46 kubenswrapper[2576]: I0608 13:53:57.644226 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cx7sn_6e4b50fc-3e91-4f50-b92a-e90919788248/konnectivity-agent/0.log" limit=1024 Jun 08 13:53:57.701851 ip-10-0-140-46 kubenswrapper[2576]: I0608 13:53:57.701813 2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/maas-api-56548fc74f-xmtkh"] Jun 08 13:53:57.702353 ip-10-0-140-46 kubenswrapper[2576]: I0608 13:53:57.702329 2576 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="87da5b75-bab0-407f-bd24-d7e460a1a14b" containerName="manager" Jun 08 13:53:57.702353 ip-10-0-140-46 kubenswrapper[2576]: I0608 13:53:57.702354 2576 state_mem.go:107] "Deleted CPUSet assignment" podUID="87da5b75-bab0-407f-bd24-d7e460a1a14b" containerName="manager" Jun 08 13:53:57.702523 ip-10-0-140-46 kubenswrapper[2576]: I0608 13:53:57.702464 2576 memory_manager.go:368] "RemoveStaleState removing state" podUID="87da5b75-bab0-407f-bd24-d7e460a1a14b" containerName="manager" Jun 08 13:53:57.706156 ip-10-0-140-46 kubenswrapper[2576]: I0608 13:53:57.706134 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-56548fc74f-xmtkh" Jun 08 13:53:57.709789 ip-10-0-140-46 kubenswrapper[2576]: I0608 13:53:57.709768 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-api-serving-cert\"" Jun 08 13:53:57.710064 ip-10-0-140-46 kubenswrapper[2576]: I0608 13:53:57.710049 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-api-dockercfg-grgwr\"" Jun 08 13:53:57.717422 ip-10-0-140-46 kubenswrapper[2576]: I0608 13:53:57.717397 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-api-56548fc74f-xmtkh"] Jun 08 13:53:57.787483 ip-10-0-140-46 kubenswrapper[2576]: I0608 13:53:57.787442 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/8638dcd6-699c-4954-a071-7ba9e81f7cd2-maas-api-tls\") pod \"maas-api-56548fc74f-xmtkh\" (UID: \"8638dcd6-699c-4954-a071-7ba9e81f7cd2\") " pod="opendatahub/maas-api-56548fc74f-xmtkh" Jun 08 13:53:57.787483 ip-10-0-140-46 kubenswrapper[2576]: I0608 13:53:57.787482 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-kvdcl\" (UniqueName: \"kubernetes.io/projected/8638dcd6-699c-4954-a071-7ba9e81f7cd2-kube-api-access-kvdcl\") pod \"maas-api-56548fc74f-xmtkh\" (UID: \"8638dcd6-699c-4954-a071-7ba9e81f7cd2\") " pod="opendatahub/maas-api-56548fc74f-xmtkh" Jun 08 13:53:57.888942 ip-10-0-140-46 kubenswrapper[2576]: I0608 13:53:57.888906 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/8638dcd6-699c-4954-a071-7ba9e81f7cd2-maas-api-tls\") pod \"maas-api-56548fc74f-xmtkh\" (UID: \"8638dcd6-699c-4954-a071-7ba9e81f7cd2\") " pod="opendatahub/maas-api-56548fc74f-xmtkh" Jun 08 13:53:57.888942 ip-10-0-140-46 kubenswrapper[2576]: I0608 13:53:57.888943 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-kvdcl\" (UniqueName: \"kubernetes.io/projected/8638dcd6-699c-4954-a071-7ba9e81f7cd2-kube-api-access-kvdcl\") pod \"maas-api-56548fc74f-xmtkh\" (UID: \"8638dcd6-699c-4954-a071-7ba9e81f7cd2\") " pod="opendatahub/maas-api-56548fc74f-xmtkh" Jun 08 13:53:57.891349 ip-10-0-140-46 kubenswrapper[2576]: I0608 13:53:57.891331 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/8638dcd6-699c-4954-a071-7ba9e81f7cd2-maas-api-tls\") pod \"maas-api-56548fc74f-xmtkh\" (UID: \"8638dcd6-699c-4954-a071-7ba9e81f7cd2\") " pod="opendatahub/maas-api-56548fc74f-xmtkh" Jun 08 13:53:57.897195 ip-10-0-140-46 kubenswrapper[2576]: I0608 13:53:57.897127 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-kvdcl\" (UniqueName: \"kubernetes.io/projected/8638dcd6-699c-4954-a071-7ba9e81f7cd2-kube-api-access-kvdcl\") pod \"maas-api-56548fc74f-xmtkh\" (UID: \"8638dcd6-699c-4954-a071-7ba9e81f7cd2\") " pod="opendatahub/maas-api-56548fc74f-xmtkh" Jun 08 13:53:58.019025 ip-10-0-140-46 kubenswrapper[2576]: I0608 13:53:58.018993 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-56548fc74f-xmtkh" Jun 08 13:53:58.170824 ip-10-0-140-46 kubenswrapper[2576]: I0608 13:53:58.170801 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-api-56548fc74f-xmtkh"] Jun 08 13:53:58.172652 ip-10-0-140-46 kubenswrapper[2576]: W0608 13:53:58.172623 2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8638dcd6_699c_4954_a071_7ba9e81f7cd2.slice/crio-05f7a4bf708f283970dbc19905757823a509c51599885052d0d9eb65a0cda8a9 WatchSource:0}: Error finding container 05f7a4bf708f283970dbc19905757823a509c51599885052d0d9eb65a0cda8a9: Status 404 returned error can't find the container with id 05f7a4bf708f283970dbc19905757823a509c51599885052d0d9eb65a0cda8a9 Jun 08 13:53:58.310051 ip-10-0-140-46 kubenswrapper[2576]: I0608 13:53:58.310012 2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-pre-processing-67d7689b65-jpbxk"] Jun 08 13:53:58.315503 ip-10-0-140-46 kubenswrapper[2576]: I0608 13:53:58.315479 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-67d7689b65-jpbxk" Jun 08 13:53:58.318447 ip-10-0-140-46 kubenswrapper[2576]: I0608 13:53:58.318412 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-dockercfg-brdxj\"" Jun 08 13:53:58.318628 ip-10-0-140-46 kubenswrapper[2576]: I0608 13:53:58.318599 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins\"" Jun 08 13:53:58.324817 ip-10-0-140-46 kubenswrapper[2576]: I0608 13:53:58.324781 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-67d7689b65-jpbxk"] Jun 08 13:53:58.392899 ip-10-0-140-46 kubenswrapper[2576]: I0608 13:53:58.392867 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-dngpg\" (UniqueName: \"kubernetes.io/projected/71aba221-b0b4-443a-a981-4b8feb2a4986-kube-api-access-dngpg\") pod \"payload-pre-processing-67d7689b65-jpbxk\" (UID: \"71aba221-b0b4-443a-a981-4b8feb2a4986\") " pod="openshift-ingress/payload-pre-processing-67d7689b65-jpbxk" Jun 08 13:53:58.457710 ip-10-0-140-46 kubenswrapper[2576]: I0608 13:53:58.457619 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-56548fc74f-xmtkh" event={"ID":"8638dcd6-699c-4954-a071-7ba9e81f7cd2","Type":"ContainerStarted","Data":"05f7a4bf708f283970dbc19905757823a509c51599885052d0d9eb65a0cda8a9"} Jun 08 13:53:58.494048 ip-10-0-140-46 kubenswrapper[2576]: I0608 13:53:58.494004 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-dngpg\" (UniqueName: \"kubernetes.io/projected/71aba221-b0b4-443a-a981-4b8feb2a4986-kube-api-access-dngpg\") pod \"payload-pre-processing-67d7689b65-jpbxk\" (UID: \"71aba221-b0b4-443a-a981-4b8feb2a4986\") " pod="openshift-ingress/payload-pre-processing-67d7689b65-jpbxk" Jun 08 13:53:58.503188 ip-10-0-140-46 kubenswrapper[2576]: I0608 13:53:58.503163 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-dngpg\" (UniqueName: \"kubernetes.io/projected/71aba221-b0b4-443a-a981-4b8feb2a4986-kube-api-access-dngpg\") pod \"payload-pre-processing-67d7689b65-jpbxk\" (UID: \"71aba221-b0b4-443a-a981-4b8feb2a4986\") " pod="openshift-ingress/payload-pre-processing-67d7689b65-jpbxk" Jun 08 13:53:58.537105 ip-10-0-140-46 kubenswrapper[2576]: I0608 13:53:58.537071 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cx7sn_6e4b50fc-3e91-4f50-b92a-e90919788248/konnectivity-agent/0.log" limit=1024 Jun 08 13:53:58.628270 ip-10-0-140-46 kubenswrapper[2576]: I0608 13:53:58.628234 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-67d7689b65-jpbxk" Jun 08 13:53:58.780712 ip-10-0-140-46 kubenswrapper[2576]: I0608 13:53:58.779840 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-67d7689b65-jpbxk"] Jun 08 13:53:59.468613 ip-10-0-140-46 kubenswrapper[2576]: I0608 13:53:59.468553 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-67d7689b65-jpbxk" event={"ID":"71aba221-b0b4-443a-a981-4b8feb2a4986","Type":"ContainerStarted","Data":"34a31fec0354dc282a589aa2179d994e71109d38014b5d6327af9664915d221e"} Jun 08 13:54:00.476125 ip-10-0-140-46 kubenswrapper[2576]: I0608 13:54:00.476001 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-56548fc74f-xmtkh" event={"ID":"8638dcd6-699c-4954-a071-7ba9e81f7cd2","Type":"ContainerStarted","Data":"28ee01f6fa3e42af8dc6133b566ac04440a2129c1d0a87c73cad3d322c46d5c7"} Jun 08 13:54:00.476543 ip-10-0-140-46 kubenswrapper[2576]: I0608 13:54:00.476193 2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/maas-api-56548fc74f-xmtkh" Jun 08 13:54:00.477536 ip-10-0-140-46 kubenswrapper[2576]: I0608 13:54:00.477515 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-67d7689b65-jpbxk" event={"ID":"71aba221-b0b4-443a-a981-4b8feb2a4986","Type":"ContainerStarted","Data":"83a64e6890cee32b78007d7f0cb3060ce90b185bbf84ec904200f8a0d2616e96"} Jun 08 13:54:00.477667 ip-10-0-140-46 kubenswrapper[2576]: I0608 13:54:00.477638 2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-pre-processing-67d7689b65-jpbxk" Jun 08 13:54:00.497689 ip-10-0-140-46 kubenswrapper[2576]: I0608 13:54:00.497636 2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/maas-api-56548fc74f-xmtkh" podStartSLOduration=1.458432856 podStartE2EDuration="3.497619488s" totalImagesPullingTime="2.039186632s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-08 13:53:57 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-08 13:54:00.494329664 +0000 UTC m=+608.573658547" watchObservedRunningTime="2026-06-08 13:54:00.497619488 +0000 UTC m=+608.576948380" Jun 08 13:54:00.511687 ip-10-0-140-46 kubenswrapper[2576]: I0608 13:54:00.511638 2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-pre-processing-67d7689b65-jpbxk" podStartSLOduration=1.084610483 podStartE2EDuration="2.511622265s" totalImagesPullingTime="1.427011782s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-08 13:53:58 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-08 13:54:00.508827926 +0000 UTC m=+608.588156822" watchObservedRunningTime="2026-06-08 13:54:00.511622265 +0000 UTC m=+608.590951231" Jun 08 13:54:06.488036 ip-10-0-140-46 kubenswrapper[2576]: I0608 13:54:06.487956 2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/maas-api-56548fc74f-xmtkh" Jun 08 13:54:08.314555 ip-10-0-140-46 kubenswrapper[2576]: I0608 13:54:08.314517 2576 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["keycloak-system/maas-keycloak-0"] Jun 08 13:54:08.314972 ip-10-0-140-46 kubenswrapper[2576]: I0608 13:54:08.314723 2576 kuberuntime_container.go:872] "Killing container with a grace period" pod="keycloak-system/maas-keycloak-0" podUID="f3cca0f0-793c-4fbb-977a-30673e343be2" containerName="keycloak" containerID="cri-o://4523f1608c0d3f45341716083bf5deec4ebc9533578d736b350dcfdc27165470" gracePeriod=30 Jun 08 13:54:09.972446 ip-10-0-140-46 kubenswrapper[2576]: I0608 13:54:09.972417 2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="keycloak-system/maas-keycloak-0" Jun 08 13:54:10.090286 ip-10-0-140-46 kubenswrapper[2576]: I0608 13:54:10.090251 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-k7896\" (UniqueName: \"kubernetes.io/projected/f3cca0f0-793c-4fbb-977a-30673e343be2-kube-api-access-k7896\") pod \"f3cca0f0-793c-4fbb-977a-30673e343be2\" (UID: \"f3cca0f0-793c-4fbb-977a-30673e343be2\") " Jun 08 13:54:10.092433 ip-10-0-140-46 kubenswrapper[2576]: I0608 13:54:10.092405 2576 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/f3cca0f0-793c-4fbb-977a-30673e343be2-kube-api-access-k7896" (OuterVolumeSpecName: "kube-api-access-k7896") pod "f3cca0f0-793c-4fbb-977a-30673e343be2" (UID: "f3cca0f0-793c-4fbb-977a-30673e343be2"). InnerVolumeSpecName "kube-api-access-k7896". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 08 13:54:10.191038 ip-10-0-140-46 kubenswrapper[2576]: I0608 13:54:10.190995 2576 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-k7896\" (UniqueName: \"kubernetes.io/projected/f3cca0f0-793c-4fbb-977a-30673e343be2-kube-api-access-k7896\") on node \"ip-10-0-140-46.ec2.internal\" DevicePath \"\"" Jun 08 13:54:10.530249 ip-10-0-140-46 kubenswrapper[2576]: I0608 13:54:10.530219 2576 generic.go:356] "Generic (PLEG): container finished" podID="f3cca0f0-793c-4fbb-977a-30673e343be2" containerID="4523f1608c0d3f45341716083bf5deec4ebc9533578d736b350dcfdc27165470" exitCode=143 Jun 08 13:54:10.530424 ip-10-0-140-46 kubenswrapper[2576]: I0608 13:54:10.530260 2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="keycloak-system/maas-keycloak-0" Jun 08 13:54:10.530424 ip-10-0-140-46 kubenswrapper[2576]: I0608 13:54:10.530281 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="keycloak-system/maas-keycloak-0" event={"ID":"f3cca0f0-793c-4fbb-977a-30673e343be2","Type":"ContainerDied","Data":"4523f1608c0d3f45341716083bf5deec4ebc9533578d736b350dcfdc27165470"} Jun 08 13:54:10.530424 ip-10-0-140-46 kubenswrapper[2576]: I0608 13:54:10.530321 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="keycloak-system/maas-keycloak-0" event={"ID":"f3cca0f0-793c-4fbb-977a-30673e343be2","Type":"ContainerDied","Data":"7fe5c8694107fcd4cb36cb4a915f60076347e034efb81f52d2ce5bff0a02dab7"} Jun 08 13:54:10.530424 ip-10-0-140-46 kubenswrapper[2576]: I0608 13:54:10.530340 2576 scope.go:117] "RemoveContainer" containerID="4523f1608c0d3f45341716083bf5deec4ebc9533578d736b350dcfdc27165470" Jun 08 13:54:10.540495 ip-10-0-140-46 kubenswrapper[2576]: I0608 13:54:10.540472 2576 scope.go:117] "RemoveContainer" containerID="4523f1608c0d3f45341716083bf5deec4ebc9533578d736b350dcfdc27165470" Jun 08 13:54:10.540794 ip-10-0-140-46 kubenswrapper[2576]: E0608 13:54:10.540771 2576 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"4523f1608c0d3f45341716083bf5deec4ebc9533578d736b350dcfdc27165470\": container with ID starting with 4523f1608c0d3f45341716083bf5deec4ebc9533578d736b350dcfdc27165470 not found: ID does not exist" containerID="4523f1608c0d3f45341716083bf5deec4ebc9533578d736b350dcfdc27165470" Jun 08 13:54:10.540843 ip-10-0-140-46 kubenswrapper[2576]: I0608 13:54:10.540803 2576 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"4523f1608c0d3f45341716083bf5deec4ebc9533578d736b350dcfdc27165470"} err="failed to get container status \"4523f1608c0d3f45341716083bf5deec4ebc9533578d736b350dcfdc27165470\": rpc error: code = NotFound desc = could not find container \"4523f1608c0d3f45341716083bf5deec4ebc9533578d736b350dcfdc27165470\": container with ID starting with 4523f1608c0d3f45341716083bf5deec4ebc9533578d736b350dcfdc27165470 not found: ID does not exist" Jun 08 13:54:10.549246 ip-10-0-140-46 kubenswrapper[2576]: I0608 13:54:10.549217 2576 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["keycloak-system/maas-keycloak-0"] Jun 08 13:54:10.552862 ip-10-0-140-46 kubenswrapper[2576]: I0608 13:54:10.552833 2576 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["keycloak-system/maas-keycloak-0"] Jun 08 13:54:10.583089 ip-10-0-140-46 kubenswrapper[2576]: I0608 13:54:10.580838 2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["keycloak-system/maas-keycloak-0"] Jun 08 13:54:10.583089 ip-10-0-140-46 kubenswrapper[2576]: I0608 13:54:10.581627 2576 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="f3cca0f0-793c-4fbb-977a-30673e343be2" containerName="keycloak" Jun 08 13:54:10.583089 ip-10-0-140-46 kubenswrapper[2576]: I0608 13:54:10.581646 2576 state_mem.go:107] "Deleted CPUSet assignment" podUID="f3cca0f0-793c-4fbb-977a-30673e343be2" containerName="keycloak" Jun 08 13:54:10.583089 ip-10-0-140-46 kubenswrapper[2576]: I0608 13:54:10.581829 2576 memory_manager.go:368] "RemoveStaleState removing state" podUID="f3cca0f0-793c-4fbb-977a-30673e343be2" containerName="keycloak" Jun 08 13:54:10.587181 ip-10-0-140-46 kubenswrapper[2576]: I0608 13:54:10.587148 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="keycloak-system/maas-keycloak-0" Jun 08 13:54:10.590091 ip-10-0-140-46 kubenswrapper[2576]: I0608 13:54:10.590059 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"keycloak-system\"/\"openshift-service-ca.crt\"" Jun 08 13:54:10.590304 ip-10-0-140-46 kubenswrapper[2576]: I0608 13:54:10.590287 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"keycloak-system\"/\"keycloak-test-realms\"" Jun 08 13:54:10.590407 ip-10-0-140-46 kubenswrapper[2576]: I0608 13:54:10.590388 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"keycloak-system\"/\"kube-root-ca.crt\"" Jun 08 13:54:10.590709 ip-10-0-140-46 kubenswrapper[2576]: I0608 13:54:10.590479 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"keycloak-system\"/\"maas-keycloak-initial-admin\"" Jun 08 13:54:10.590709 ip-10-0-140-46 kubenswrapper[2576]: I0608 13:54:10.590640 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"keycloak-system\"/\"default-dockercfg-jt4bd\"" Jun 08 13:54:10.592315 ip-10-0-140-46 kubenswrapper[2576]: I0608 13:54:10.592295 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["keycloak-system/maas-keycloak-0"] Jun 08 13:54:10.695342 ip-10-0-140-46 kubenswrapper[2576]: I0608 13:54:10.695245 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rtgwr\" (UniqueName: \"kubernetes.io/projected/6bd7552e-777d-43bc-bb18-90ab1ebcedf0-kube-api-access-rtgwr\") pod \"maas-keycloak-0\" (UID: \"6bd7552e-777d-43bc-bb18-90ab1ebcedf0\") " pod="keycloak-system/maas-keycloak-0" Jun 08 13:54:10.695342 ip-10-0-140-46 kubenswrapper[2576]: I0608 13:54:10.695331 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"test-realms\" (UniqueName: \"kubernetes.io/configmap/6bd7552e-777d-43bc-bb18-90ab1ebcedf0-test-realms\") pod \"maas-keycloak-0\" (UID: \"6bd7552e-777d-43bc-bb18-90ab1ebcedf0\") " pod="keycloak-system/maas-keycloak-0" Jun 08 13:54:10.796577 ip-10-0-140-46 kubenswrapper[2576]: I0608 13:54:10.796523 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"test-realms\" (UniqueName: \"kubernetes.io/configmap/6bd7552e-777d-43bc-bb18-90ab1ebcedf0-test-realms\") pod \"maas-keycloak-0\" (UID: \"6bd7552e-777d-43bc-bb18-90ab1ebcedf0\") " pod="keycloak-system/maas-keycloak-0" Jun 08 13:54:10.796795 ip-10-0-140-46 kubenswrapper[2576]: I0608 13:54:10.796627 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rtgwr\" (UniqueName: \"kubernetes.io/projected/6bd7552e-777d-43bc-bb18-90ab1ebcedf0-kube-api-access-rtgwr\") pod \"maas-keycloak-0\" (UID: \"6bd7552e-777d-43bc-bb18-90ab1ebcedf0\") " pod="keycloak-system/maas-keycloak-0" Jun 08 13:54:10.797332 ip-10-0-140-46 kubenswrapper[2576]: I0608 13:54:10.797305 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"test-realms\" (UniqueName: \"kubernetes.io/configmap/6bd7552e-777d-43bc-bb18-90ab1ebcedf0-test-realms\") pod \"maas-keycloak-0\" (UID: \"6bd7552e-777d-43bc-bb18-90ab1ebcedf0\") " pod="keycloak-system/maas-keycloak-0" Jun 08 13:54:10.806305 ip-10-0-140-46 kubenswrapper[2576]: I0608 13:54:10.806272 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-rtgwr\" (UniqueName: \"kubernetes.io/projected/6bd7552e-777d-43bc-bb18-90ab1ebcedf0-kube-api-access-rtgwr\") pod \"maas-keycloak-0\" (UID: \"6bd7552e-777d-43bc-bb18-90ab1ebcedf0\") " pod="keycloak-system/maas-keycloak-0" Jun 08 13:54:10.899273 ip-10-0-140-46 kubenswrapper[2576]: I0608 13:54:10.899221 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="keycloak-system/maas-keycloak-0" Jun 08 13:54:11.035681 ip-10-0-140-46 kubenswrapper[2576]: I0608 13:54:11.035652 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["keycloak-system/maas-keycloak-0"] Jun 08 13:54:11.037107 ip-10-0-140-46 kubenswrapper[2576]: W0608 13:54:11.037080 2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6bd7552e_777d_43bc_bb18_90ab1ebcedf0.slice/crio-ce18c3ec454f239d1affb982705b10fec51560f038a15ca2c142863a1e8d7aba WatchSource:0}: Error finding container ce18c3ec454f239d1affb982705b10fec51560f038a15ca2c142863a1e8d7aba: Status 404 returned error can't find the container with id ce18c3ec454f239d1affb982705b10fec51560f038a15ca2c142863a1e8d7aba Jun 08 13:54:11.038641 ip-10-0-140-46 kubenswrapper[2576]: I0608 13:54:11.038619 2576 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jun 08 13:54:11.485430 ip-10-0-140-46 kubenswrapper[2576]: I0608 13:54:11.485394 2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-pre-processing-67d7689b65-jpbxk" Jun 08 13:54:11.541012 ip-10-0-140-46 kubenswrapper[2576]: I0608 13:54:11.540964 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="keycloak-system/maas-keycloak-0" event={"ID":"6bd7552e-777d-43bc-bb18-90ab1ebcedf0","Type":"ContainerStarted","Data":"395d71ca1d7a57a0376e770439908bd9132530cfb1fe36c60f5d65346f06ff73"} Jun 08 13:54:11.541235 ip-10-0-140-46 kubenswrapper[2576]: I0608 13:54:11.541035 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="keycloak-system/maas-keycloak-0" event={"ID":"6bd7552e-777d-43bc-bb18-90ab1ebcedf0","Type":"ContainerStarted","Data":"ce18c3ec454f239d1affb982705b10fec51560f038a15ca2c142863a1e8d7aba"} Jun 08 13:54:11.563717 ip-10-0-140-46 kubenswrapper[2576]: I0608 13:54:11.563668 2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="keycloak-system/maas-keycloak-0" podStartSLOduration=1.274680094 podStartE2EDuration="1.563649921s" totalImagesPullingTime="288.969827ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-08 13:54:10 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-08 13:54:11.561987411 +0000 UTC m=+619.641316340" watchObservedRunningTime="2026-06-08 13:54:11.563649921 +0000 UTC m=+619.642978816" Jun 08 13:54:11.899541 ip-10-0-140-46 kubenswrapper[2576]: I0608 13:54:11.899487 2576 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="keycloak-system/maas-keycloak-0" Jun 08 13:54:11.901281 ip-10-0-140-46 kubenswrapper[2576]: I0608 13:54:11.901238 2576 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="6bd7552e-777d-43bc-bb18-90ab1ebcedf0" containerName="keycloak" probeResult="failure" output="Get \"http://10.133.0.54:9000/health/started\": dial tcp 10.133.0.54:9000: connect: connection refused" Jun 08 13:54:12.380487 ip-10-0-140-46 kubenswrapper[2576]: I0608 13:54:12.380446 2576 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="f3cca0f0-793c-4fbb-977a-30673e343be2" path="/var/lib/kubelet/pods/f3cca0f0-793c-4fbb-977a-30673e343be2/volumes" Jun 08 13:54:12.486421 ip-10-0-140-46 kubenswrapper[2576]: I0608 13:54:12.486380 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cx7sn_6e4b50fc-3e91-4f50-b92a-e90919788248/konnectivity-agent/0.log" limit=1024 Jun 08 13:54:12.900102 ip-10-0-140-46 kubenswrapper[2576]: I0608 13:54:12.900048 2576 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="6bd7552e-777d-43bc-bb18-90ab1ebcedf0" containerName="keycloak" probeResult="failure" output="Get \"http://10.133.0.54:9000/health/started\": dial tcp 10.133.0.54:9000: connect: connection refused" Jun 08 13:54:13.900170 ip-10-0-140-46 kubenswrapper[2576]: I0608 13:54:13.900130 2576 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="6bd7552e-777d-43bc-bb18-90ab1ebcedf0" containerName="keycloak" probeResult="failure" output="Get \"http://10.133.0.54:9000/health/started\": dial tcp 10.133.0.54:9000: connect: connection refused" Jun 08 13:54:14.900664 ip-10-0-140-46 kubenswrapper[2576]: I0608 13:54:14.900605 2576 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="6bd7552e-777d-43bc-bb18-90ab1ebcedf0" containerName="keycloak" probeResult="failure" output="Get \"http://10.133.0.54:9000/health/started\": dial tcp 10.133.0.54:9000: connect: connection refused" Jun 08 13:54:15.900699 ip-10-0-140-46 kubenswrapper[2576]: I0608 13:54:15.900645 2576 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="6bd7552e-777d-43bc-bb18-90ab1ebcedf0" containerName="keycloak" probeResult="failure" output="Get \"http://10.133.0.54:9000/health/started\": dial tcp 10.133.0.54:9000: connect: connection refused" Jun 08 13:54:16.900639 ip-10-0-140-46 kubenswrapper[2576]: I0608 13:54:16.900589 2576 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="6bd7552e-777d-43bc-bb18-90ab1ebcedf0" containerName="keycloak" probeResult="failure" output="Get \"http://10.133.0.54:9000/health/started\": dial tcp 10.133.0.54:9000: connect: connection refused" Jun 08 13:54:17.899990 ip-10-0-140-46 kubenswrapper[2576]: I0608 13:54:17.899934 2576 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="6bd7552e-777d-43bc-bb18-90ab1ebcedf0" containerName="keycloak" probeResult="failure" output="Get \"http://10.133.0.54:9000/health/started\": dial tcp 10.133.0.54:9000: connect: connection refused" Jun 08 13:54:18.899910 ip-10-0-140-46 kubenswrapper[2576]: I0608 13:54:18.899867 2576 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="6bd7552e-777d-43bc-bb18-90ab1ebcedf0" containerName="keycloak" probeResult="failure" output="Get \"http://10.133.0.54:9000/health/started\": dial tcp 10.133.0.54:9000: connect: connection refused" Jun 08 13:54:19.900492 ip-10-0-140-46 kubenswrapper[2576]: I0608 13:54:19.900436 2576 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="6bd7552e-777d-43bc-bb18-90ab1ebcedf0" containerName="keycloak" probeResult="failure" output="Get \"http://10.133.0.54:9000/health/started\": dial tcp 10.133.0.54:9000: connect: connection refused" Jun 08 13:54:20.900049 ip-10-0-140-46 kubenswrapper[2576]: I0608 13:54:20.900006 2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="keycloak-system/maas-keycloak-0" Jun 08 13:54:20.900362 ip-10-0-140-46 kubenswrapper[2576]: I0608 13:54:20.900328 2576 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="6bd7552e-777d-43bc-bb18-90ab1ebcedf0" containerName="keycloak" probeResult="failure" output="Get \"http://10.133.0.54:9000/health/started\": dial tcp 10.133.0.54:9000: connect: connection refused" Jun 08 13:54:21.899850 ip-10-0-140-46 kubenswrapper[2576]: I0608 13:54:21.899787 2576 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="6bd7552e-777d-43bc-bb18-90ab1ebcedf0" containerName="keycloak" probeResult="failure" output="Get \"http://10.133.0.54:9000/health/started\": dial tcp 10.133.0.54:9000: connect: connection refused" Jun 08 13:54:22.900674 ip-10-0-140-46 kubenswrapper[2576]: I0608 13:54:22.900632 2576 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="6bd7552e-777d-43bc-bb18-90ab1ebcedf0" containerName="keycloak" probeResult="failure" output="Get \"http://10.133.0.54:9000/health/started\": dial tcp 10.133.0.54:9000: connect: connection refused" Jun 08 13:54:23.899723 ip-10-0-140-46 kubenswrapper[2576]: I0608 13:54:23.899672 2576 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="6bd7552e-777d-43bc-bb18-90ab1ebcedf0" containerName="keycloak" probeResult="failure" output="Get \"http://10.133.0.54:9000/health/started\": dial tcp 10.133.0.54:9000: connect: connection refused" Jun 08 13:54:25.015157 ip-10-0-140-46 kubenswrapper[2576]: I0608 13:54:25.015104 2576 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="keycloak-system/maas-keycloak-0" Jun 08 13:54:25.032802 ip-10-0-140-46 kubenswrapper[2576]: I0608 13:54:25.032744 2576 prober.go:120] "Probe failed" probeType="Readiness" pod="keycloak-system/maas-keycloak-0" podUID="6bd7552e-777d-43bc-bb18-90ab1ebcedf0" containerName="keycloak" probeResult="failure" output="HTTP probe failed with statuscode: 503" Jun 08 13:54:35.023004 ip-10-0-140-46 kubenswrapper[2576]: I0608 13:54:35.022966 2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="keycloak-system/maas-keycloak-0" Jun 08 13:54:45.792416 ip-10-0-140-46 kubenswrapper[2576]: I0608 13:54:45.792372 2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-6d5768b547-5fp9p"] Jun 08 13:54:45.796252 ip-10-0-140-46 kubenswrapper[2576]: I0608 13:54:45.796229 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-6d5768b547-5fp9p" Jun 08 13:54:45.799974 ip-10-0-140-46 kubenswrapper[2576]: I0608 13:54:45.799952 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"authorino-oidc-ca\"" Jun 08 13:54:45.809064 ip-10-0-140-46 kubenswrapper[2576]: I0608 13:54:45.809038 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-6d5768b547-5fp9p"] Jun 08 13:54:45.925068 ip-10-0-140-46 kubenswrapper[2576]: I0608 13:54:45.925026 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/45ad9ab9-00b0-4853-a237-ec5f094c7369-tls-cert\") pod \"authorino-6d5768b547-5fp9p\" (UID: \"45ad9ab9-00b0-4853-a237-ec5f094c7369\") " pod="kuadrant-system/authorino-6d5768b547-5fp9p" Jun 08 13:54:45.925068 ip-10-0-140-46 kubenswrapper[2576]: I0608 13:54:45.925069 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oidc-ca\" (UniqueName: \"kubernetes.io/configmap/45ad9ab9-00b0-4853-a237-ec5f094c7369-oidc-ca\") pod \"authorino-6d5768b547-5fp9p\" (UID: \"45ad9ab9-00b0-4853-a237-ec5f094c7369\") " pod="kuadrant-system/authorino-6d5768b547-5fp9p" Jun 08 13:54:45.925329 ip-10-0-140-46 kubenswrapper[2576]: I0608 13:54:45.925183 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-kkq7q\" (UniqueName: \"kubernetes.io/projected/45ad9ab9-00b0-4853-a237-ec5f094c7369-kube-api-access-kkq7q\") pod \"authorino-6d5768b547-5fp9p\" (UID: \"45ad9ab9-00b0-4853-a237-ec5f094c7369\") " pod="kuadrant-system/authorino-6d5768b547-5fp9p" Jun 08 13:54:46.026187 ip-10-0-140-46 kubenswrapper[2576]: I0608 13:54:46.026142 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/45ad9ab9-00b0-4853-a237-ec5f094c7369-tls-cert\") pod \"authorino-6d5768b547-5fp9p\" (UID: \"45ad9ab9-00b0-4853-a237-ec5f094c7369\") " pod="kuadrant-system/authorino-6d5768b547-5fp9p" Jun 08 13:54:46.026187 ip-10-0-140-46 kubenswrapper[2576]: I0608 13:54:46.026188 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oidc-ca\" (UniqueName: \"kubernetes.io/configmap/45ad9ab9-00b0-4853-a237-ec5f094c7369-oidc-ca\") pod \"authorino-6d5768b547-5fp9p\" (UID: \"45ad9ab9-00b0-4853-a237-ec5f094c7369\") " pod="kuadrant-system/authorino-6d5768b547-5fp9p" Jun 08 13:54:46.026438 ip-10-0-140-46 kubenswrapper[2576]: I0608 13:54:46.026250 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-kkq7q\" (UniqueName: \"kubernetes.io/projected/45ad9ab9-00b0-4853-a237-ec5f094c7369-kube-api-access-kkq7q\") pod \"authorino-6d5768b547-5fp9p\" (UID: \"45ad9ab9-00b0-4853-a237-ec5f094c7369\") " pod="kuadrant-system/authorino-6d5768b547-5fp9p" Jun 08 13:54:46.027015 ip-10-0-140-46 kubenswrapper[2576]: I0608 13:54:46.026994 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"oidc-ca\" (UniqueName: \"kubernetes.io/configmap/45ad9ab9-00b0-4853-a237-ec5f094c7369-oidc-ca\") pod \"authorino-6d5768b547-5fp9p\" (UID: \"45ad9ab9-00b0-4853-a237-ec5f094c7369\") " pod="kuadrant-system/authorino-6d5768b547-5fp9p" Jun 08 13:54:46.028754 ip-10-0-140-46 kubenswrapper[2576]: I0608 13:54:46.028729 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/45ad9ab9-00b0-4853-a237-ec5f094c7369-tls-cert\") pod \"authorino-6d5768b547-5fp9p\" (UID: \"45ad9ab9-00b0-4853-a237-ec5f094c7369\") " pod="kuadrant-system/authorino-6d5768b547-5fp9p" Jun 08 13:54:46.035432 ip-10-0-140-46 kubenswrapper[2576]: I0608 13:54:46.035409 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-kkq7q\" (UniqueName: \"kubernetes.io/projected/45ad9ab9-00b0-4853-a237-ec5f094c7369-kube-api-access-kkq7q\") pod \"authorino-6d5768b547-5fp9p\" (UID: \"45ad9ab9-00b0-4853-a237-ec5f094c7369\") " pod="kuadrant-system/authorino-6d5768b547-5fp9p" Jun 08 13:54:46.105055 ip-10-0-140-46 kubenswrapper[2576]: I0608 13:54:46.104954 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-6d5768b547-5fp9p" Jun 08 13:54:46.250191 ip-10-0-140-46 kubenswrapper[2576]: I0608 13:54:46.250154 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-6d5768b547-5fp9p"] Jun 08 13:54:46.251879 ip-10-0-140-46 kubenswrapper[2576]: W0608 13:54:46.251848 2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod45ad9ab9_00b0_4853_a237_ec5f094c7369.slice/crio-60a06315a081a36cf8b07385f44f99a026721da97ba7b27bb8882689ec2f1aa1 WatchSource:0}: Error finding container 60a06315a081a36cf8b07385f44f99a026721da97ba7b27bb8882689ec2f1aa1: Status 404 returned error can't find the container with id 60a06315a081a36cf8b07385f44f99a026721da97ba7b27bb8882689ec2f1aa1 Jun 08 13:54:46.774360 ip-10-0-140-46 kubenswrapper[2576]: I0608 13:54:46.774278 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-6d5768b547-5fp9p" event={"ID":"45ad9ab9-00b0-4853-a237-ec5f094c7369","Type":"ContainerStarted","Data":"500e3e39418e33d61d82f2b1f36e51638663a16dc4f159b9d16926b9b0cbe700"} Jun 08 13:54:46.774360 ip-10-0-140-46 kubenswrapper[2576]: I0608 13:54:46.774329 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-6d5768b547-5fp9p" event={"ID":"45ad9ab9-00b0-4853-a237-ec5f094c7369","Type":"ContainerStarted","Data":"60a06315a081a36cf8b07385f44f99a026721da97ba7b27bb8882689ec2f1aa1"} Jun 08 13:54:46.809383 ip-10-0-140-46 kubenswrapper[2576]: I0608 13:54:46.809272 2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/authorino-6d5768b547-5fp9p" podStartSLOduration=1.521343553 podStartE2EDuration="1.809250023s" totalImagesPullingTime="287.90647ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-08 13:54:45 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-08 13:54:46.805676086 +0000 UTC m=+654.885004978" watchObservedRunningTime="2026-06-08 13:54:46.809250023 +0000 UTC m=+654.888578916" Jun 08 13:54:46.853590 ip-10-0-140-46 kubenswrapper[2576]: I0608 13:54:46.853414 2576 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-5855885687-jk7lw"] Jun 08 13:54:46.853778 ip-10-0-140-46 kubenswrapper[2576]: I0608 13:54:46.853687 2576 kuberuntime_container.go:872] "Killing container with a grace period" pod="kuadrant-system/authorino-5855885687-jk7lw" podUID="651b4b51-7b18-490a-909d-6c034efa9fd6" containerName="authorino" containerID="cri-o://5942fe8846e5b1040b578258e886c75bd1c7a24758c565064564e1150dbc02cd" gracePeriod=30 Jun 08 13:54:47.124157 ip-10-0-140-46 kubenswrapper[2576]: I0608 13:54:47.124120 2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-5855885687-jk7lw" Jun 08 13:54:47.237286 ip-10-0-140-46 kubenswrapper[2576]: I0608 13:54:47.237255 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-r6hnl\" (UniqueName: \"kubernetes.io/projected/651b4b51-7b18-490a-909d-6c034efa9fd6-kube-api-access-r6hnl\") pod \"651b4b51-7b18-490a-909d-6c034efa9fd6\" (UID: \"651b4b51-7b18-490a-909d-6c034efa9fd6\") " Jun 08 13:54:47.237457 ip-10-0-140-46 kubenswrapper[2576]: I0608 13:54:47.237317 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/651b4b51-7b18-490a-909d-6c034efa9fd6-tls-cert\") pod \"651b4b51-7b18-490a-909d-6c034efa9fd6\" (UID: \"651b4b51-7b18-490a-909d-6c034efa9fd6\") " Jun 08 13:54:47.239371 ip-10-0-140-46 kubenswrapper[2576]: I0608 13:54:47.239336 2576 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/651b4b51-7b18-490a-909d-6c034efa9fd6-kube-api-access-r6hnl" (OuterVolumeSpecName: "kube-api-access-r6hnl") pod "651b4b51-7b18-490a-909d-6c034efa9fd6" (UID: "651b4b51-7b18-490a-909d-6c034efa9fd6"). InnerVolumeSpecName "kube-api-access-r6hnl". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 08 13:54:47.248714 ip-10-0-140-46 kubenswrapper[2576]: I0608 13:54:47.248681 2576 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/651b4b51-7b18-490a-909d-6c034efa9fd6-tls-cert" (OuterVolumeSpecName: "tls-cert") pod "651b4b51-7b18-490a-909d-6c034efa9fd6" (UID: "651b4b51-7b18-490a-909d-6c034efa9fd6"). InnerVolumeSpecName "tls-cert". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 08 13:54:47.319714 ip-10-0-140-46 kubenswrapper[2576]: I0608 13:54:47.319685 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cx7sn_6e4b50fc-3e91-4f50-b92a-e90919788248/konnectivity-agent/0.log" limit=1024 Jun 08 13:54:47.338899 ip-10-0-140-46 kubenswrapper[2576]: I0608 13:54:47.338863 2576 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-r6hnl\" (UniqueName: \"kubernetes.io/projected/651b4b51-7b18-490a-909d-6c034efa9fd6-kube-api-access-r6hnl\") on node \"ip-10-0-140-46.ec2.internal\" DevicePath \"\"" Jun 08 13:54:47.338899 ip-10-0-140-46 kubenswrapper[2576]: I0608 13:54:47.338900 2576 reconciler_common.go:299] "Volume detached for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/651b4b51-7b18-490a-909d-6c034efa9fd6-tls-cert\") on node \"ip-10-0-140-46.ec2.internal\" DevicePath \"\"" Jun 08 13:54:47.396368 ip-10-0-140-46 kubenswrapper[2576]: I0608 13:54:47.396268 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cx7sn_6e4b50fc-3e91-4f50-b92a-e90919788248/konnectivity-agent/0.log" limit=1024 Jun 08 13:54:47.781121 ip-10-0-140-46 kubenswrapper[2576]: I0608 13:54:47.781091 2576 generic.go:356] "Generic (PLEG): container finished" podID="651b4b51-7b18-490a-909d-6c034efa9fd6" containerID="5942fe8846e5b1040b578258e886c75bd1c7a24758c565064564e1150dbc02cd" exitCode=0 Jun 08 13:54:47.781325 ip-10-0-140-46 kubenswrapper[2576]: I0608 13:54:47.781152 2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-5855885687-jk7lw" Jun 08 13:54:47.781325 ip-10-0-140-46 kubenswrapper[2576]: I0608 13:54:47.781179 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-5855885687-jk7lw" event={"ID":"651b4b51-7b18-490a-909d-6c034efa9fd6","Type":"ContainerDied","Data":"5942fe8846e5b1040b578258e886c75bd1c7a24758c565064564e1150dbc02cd"} Jun 08 13:54:47.781325 ip-10-0-140-46 kubenswrapper[2576]: I0608 13:54:47.781231 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-5855885687-jk7lw" event={"ID":"651b4b51-7b18-490a-909d-6c034efa9fd6","Type":"ContainerDied","Data":"18f6836487b965711c7b86b1d8c70f0e94ce7ff7d84344ae8107ff91e747b3d8"} Jun 08 13:54:47.781325 ip-10-0-140-46 kubenswrapper[2576]: I0608 13:54:47.781253 2576 scope.go:117] "RemoveContainer" containerID="5942fe8846e5b1040b578258e886c75bd1c7a24758c565064564e1150dbc02cd" Jun 08 13:54:47.790518 ip-10-0-140-46 kubenswrapper[2576]: I0608 13:54:47.790499 2576 scope.go:117] "RemoveContainer" containerID="5942fe8846e5b1040b578258e886c75bd1c7a24758c565064564e1150dbc02cd" Jun 08 13:54:47.790892 ip-10-0-140-46 kubenswrapper[2576]: E0608 13:54:47.790873 2576 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"5942fe8846e5b1040b578258e886c75bd1c7a24758c565064564e1150dbc02cd\": container with ID starting with 5942fe8846e5b1040b578258e886c75bd1c7a24758c565064564e1150dbc02cd not found: ID does not exist" containerID="5942fe8846e5b1040b578258e886c75bd1c7a24758c565064564e1150dbc02cd" Jun 08 13:54:47.790941 ip-10-0-140-46 kubenswrapper[2576]: I0608 13:54:47.790901 2576 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"5942fe8846e5b1040b578258e886c75bd1c7a24758c565064564e1150dbc02cd"} err="failed to get container status \"5942fe8846e5b1040b578258e886c75bd1c7a24758c565064564e1150dbc02cd\": rpc error: code = NotFound desc = could not find container \"5942fe8846e5b1040b578258e886c75bd1c7a24758c565064564e1150dbc02cd\": container with ID starting with 5942fe8846e5b1040b578258e886c75bd1c7a24758c565064564e1150dbc02cd not found: ID does not exist" Jun 08 13:54:47.805065 ip-10-0-140-46 kubenswrapper[2576]: I0608 13:54:47.805041 2576 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-5855885687-jk7lw"] Jun 08 13:54:47.811086 ip-10-0-140-46 kubenswrapper[2576]: I0608 13:54:47.811063 2576 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/authorino-5855885687-jk7lw"] Jun 08 13:54:48.377622 ip-10-0-140-46 kubenswrapper[2576]: I0608 13:54:48.377588 2576 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="651b4b51-7b18-490a-909d-6c034efa9fd6" path="/var/lib/kubelet/pods/651b4b51-7b18-490a-909d-6c034efa9fd6/volumes" Jun 08 13:54:49.125671 ip-10-0-140-46 kubenswrapper[2576]: I0608 13:54:49.125635 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cx7sn_6e4b50fc-3e91-4f50-b92a-e90919788248/konnectivity-agent/0.log" limit=1024 Jun 08 13:54:49.226170 ip-10-0-140-46 kubenswrapper[2576]: I0608 13:54:49.226133 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cx7sn_6e4b50fc-3e91-4f50-b92a-e90919788248/konnectivity-agent/0.log" limit=1024 Jun 08 13:55:05.269360 ip-10-0-140-46 kubenswrapper[2576]: I0608 13:55:05.269323 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cx7sn_6e4b50fc-3e91-4f50-b92a-e90919788248/konnectivity-agent/0.log" limit=1024 Jun 08 13:55:05.373658 ip-10-0-140-46 kubenswrapper[2576]: I0608 13:55:05.373628 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cx7sn_6e4b50fc-3e91-4f50-b92a-e90919788248/konnectivity-agent/0.log" limit=1024 Jun 08 13:55:12.193417 ip-10-0-140-46 kubenswrapper[2576]: I0608 13:55:12.193386 2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/e2e-distinct-2-simulated-kserve-f5c55bdc-cbtt6"] Jun 08 13:55:12.193827 ip-10-0-140-46 kubenswrapper[2576]: I0608 13:55:12.193813 2576 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="651b4b51-7b18-490a-909d-6c034efa9fd6" containerName="authorino" Jun 08 13:55:12.193827 ip-10-0-140-46 kubenswrapper[2576]: I0608 13:55:12.193829 2576 state_mem.go:107] "Deleted CPUSet assignment" podUID="651b4b51-7b18-490a-909d-6c034efa9fd6" containerName="authorino" Jun 08 13:55:12.193916 ip-10-0-140-46 kubenswrapper[2576]: I0608 13:55:12.193897 2576 memory_manager.go:368] "RemoveStaleState removing state" podUID="651b4b51-7b18-490a-909d-6c034efa9fd6" containerName="authorino" Jun 08 13:55:12.197049 ip-10-0-140-46 kubenswrapper[2576]: I0608 13:55:12.197030 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-distinct-2-simulated-kserve-f5c55bdc-cbtt6" Jun 08 13:55:12.203172 ip-10-0-140-46 kubenswrapper[2576]: I0608 13:55:12.203136 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"default-dockercfg-4fptq\"" Jun 08 13:55:12.203311 ip-10-0-140-46 kubenswrapper[2576]: I0608 13:55:12.203205 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"llm\"/\"openshift-service-ca.crt\"" Jun 08 13:55:12.203311 ip-10-0-140-46 kubenswrapper[2576]: I0608 13:55:12.203224 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"llm\"/\"kube-root-ca.crt\"" Jun 08 13:55:12.203422 ip-10-0-140-46 kubenswrapper[2576]: I0608 13:55:12.203136 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"e2e-distinct-2-simulated-kserve-self-signed-certs\"" Jun 08 13:55:12.220248 ip-10-0-140-46 kubenswrapper[2576]: I0608 13:55:12.220214 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cx7sn_6e4b50fc-3e91-4f50-b92a-e90919788248/konnectivity-agent/0.log" limit=1024 Jun 08 13:55:12.220403 ip-10-0-140-46 kubenswrapper[2576]: I0608 13:55:12.220223 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-distinct-2-simulated-kserve-f5c55bdc-cbtt6"] Jun 08 13:55:12.264183 ip-10-0-140-46 kubenswrapper[2576]: I0608 13:55:12.264148 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/ee3a2169-e786-43ad-93a6-0c7b2d065bf5-home\") pod \"e2e-distinct-2-simulated-kserve-f5c55bdc-cbtt6\" (UID: \"ee3a2169-e786-43ad-93a6-0c7b2d065bf5\") " pod="llm/e2e-distinct-2-simulated-kserve-f5c55bdc-cbtt6" Jun 08 13:55:12.264183 ip-10-0-140-46 kubenswrapper[2576]: I0608 13:55:12.264182 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/ee3a2169-e786-43ad-93a6-0c7b2d065bf5-tls-certs\") pod \"e2e-distinct-2-simulated-kserve-f5c55bdc-cbtt6\" (UID: \"ee3a2169-e786-43ad-93a6-0c7b2d065bf5\") " pod="llm/e2e-distinct-2-simulated-kserve-f5c55bdc-cbtt6" Jun 08 13:55:12.264407 ip-10-0-140-46 kubenswrapper[2576]: I0608 13:55:12.264234 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6xmx9\" (UniqueName: \"kubernetes.io/projected/ee3a2169-e786-43ad-93a6-0c7b2d065bf5-kube-api-access-6xmx9\") pod \"e2e-distinct-2-simulated-kserve-f5c55bdc-cbtt6\" (UID: \"ee3a2169-e786-43ad-93a6-0c7b2d065bf5\") " pod="llm/e2e-distinct-2-simulated-kserve-f5c55bdc-cbtt6" Jun 08 13:55:12.264407 ip-10-0-140-46 kubenswrapper[2576]: I0608 13:55:12.264279 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/ee3a2169-e786-43ad-93a6-0c7b2d065bf5-dshm\") pod \"e2e-distinct-2-simulated-kserve-f5c55bdc-cbtt6\" (UID: \"ee3a2169-e786-43ad-93a6-0c7b2d065bf5\") " pod="llm/e2e-distinct-2-simulated-kserve-f5c55bdc-cbtt6" Jun 08 13:55:12.264407 ip-10-0-140-46 kubenswrapper[2576]: I0608 13:55:12.264304 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/ee3a2169-e786-43ad-93a6-0c7b2d065bf5-model-cache\") pod \"e2e-distinct-2-simulated-kserve-f5c55bdc-cbtt6\" (UID: \"ee3a2169-e786-43ad-93a6-0c7b2d065bf5\") " pod="llm/e2e-distinct-2-simulated-kserve-f5c55bdc-cbtt6" Jun 08 13:55:12.264407 ip-10-0-140-46 kubenswrapper[2576]: I0608 13:55:12.264362 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/ee3a2169-e786-43ad-93a6-0c7b2d065bf5-kserve-provision-location\") pod \"e2e-distinct-2-simulated-kserve-f5c55bdc-cbtt6\" (UID: \"ee3a2169-e786-43ad-93a6-0c7b2d065bf5\") " pod="llm/e2e-distinct-2-simulated-kserve-f5c55bdc-cbtt6" Jun 08 13:55:12.365248 ip-10-0-140-46 kubenswrapper[2576]: I0608 13:55:12.365194 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/ee3a2169-e786-43ad-93a6-0c7b2d065bf5-kserve-provision-location\") pod \"e2e-distinct-2-simulated-kserve-f5c55bdc-cbtt6\" (UID: \"ee3a2169-e786-43ad-93a6-0c7b2d065bf5\") " pod="llm/e2e-distinct-2-simulated-kserve-f5c55bdc-cbtt6" Jun 08 13:55:12.365248 ip-10-0-140-46 kubenswrapper[2576]: I0608 13:55:12.365257 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/ee3a2169-e786-43ad-93a6-0c7b2d065bf5-home\") pod \"e2e-distinct-2-simulated-kserve-f5c55bdc-cbtt6\" (UID: \"ee3a2169-e786-43ad-93a6-0c7b2d065bf5\") " pod="llm/e2e-distinct-2-simulated-kserve-f5c55bdc-cbtt6" Jun 08 13:55:12.365531 ip-10-0-140-46 kubenswrapper[2576]: I0608 13:55:12.365279 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/ee3a2169-e786-43ad-93a6-0c7b2d065bf5-tls-certs\") pod \"e2e-distinct-2-simulated-kserve-f5c55bdc-cbtt6\" (UID: \"ee3a2169-e786-43ad-93a6-0c7b2d065bf5\") " pod="llm/e2e-distinct-2-simulated-kserve-f5c55bdc-cbtt6" Jun 08 13:55:12.365531 ip-10-0-140-46 kubenswrapper[2576]: I0608 13:55:12.365315 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6xmx9\" (UniqueName: \"kubernetes.io/projected/ee3a2169-e786-43ad-93a6-0c7b2d065bf5-kube-api-access-6xmx9\") pod \"e2e-distinct-2-simulated-kserve-f5c55bdc-cbtt6\" (UID: \"ee3a2169-e786-43ad-93a6-0c7b2d065bf5\") " pod="llm/e2e-distinct-2-simulated-kserve-f5c55bdc-cbtt6" Jun 08 13:55:12.365531 ip-10-0-140-46 kubenswrapper[2576]: I0608 13:55:12.365343 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/ee3a2169-e786-43ad-93a6-0c7b2d065bf5-dshm\") pod \"e2e-distinct-2-simulated-kserve-f5c55bdc-cbtt6\" (UID: \"ee3a2169-e786-43ad-93a6-0c7b2d065bf5\") " pod="llm/e2e-distinct-2-simulated-kserve-f5c55bdc-cbtt6" Jun 08 13:55:12.365531 ip-10-0-140-46 kubenswrapper[2576]: I0608 13:55:12.365360 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/ee3a2169-e786-43ad-93a6-0c7b2d065bf5-model-cache\") pod \"e2e-distinct-2-simulated-kserve-f5c55bdc-cbtt6\" (UID: \"ee3a2169-e786-43ad-93a6-0c7b2d065bf5\") " pod="llm/e2e-distinct-2-simulated-kserve-f5c55bdc-cbtt6" Jun 08 13:55:12.365791 ip-10-0-140-46 kubenswrapper[2576]: I0608 13:55:12.365687 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/ee3a2169-e786-43ad-93a6-0c7b2d065bf5-kserve-provision-location\") pod \"e2e-distinct-2-simulated-kserve-f5c55bdc-cbtt6\" (UID: \"ee3a2169-e786-43ad-93a6-0c7b2d065bf5\") " pod="llm/e2e-distinct-2-simulated-kserve-f5c55bdc-cbtt6" Jun 08 13:55:12.365791 ip-10-0-140-46 kubenswrapper[2576]: I0608 13:55:12.365733 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/ee3a2169-e786-43ad-93a6-0c7b2d065bf5-home\") pod \"e2e-distinct-2-simulated-kserve-f5c55bdc-cbtt6\" (UID: \"ee3a2169-e786-43ad-93a6-0c7b2d065bf5\") " pod="llm/e2e-distinct-2-simulated-kserve-f5c55bdc-cbtt6" Jun 08 13:55:12.365791 ip-10-0-140-46 kubenswrapper[2576]: I0608 13:55:12.365764 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/ee3a2169-e786-43ad-93a6-0c7b2d065bf5-model-cache\") pod \"e2e-distinct-2-simulated-kserve-f5c55bdc-cbtt6\" (UID: \"ee3a2169-e786-43ad-93a6-0c7b2d065bf5\") " pod="llm/e2e-distinct-2-simulated-kserve-f5c55bdc-cbtt6" Jun 08 13:55:12.367688 ip-10-0-140-46 kubenswrapper[2576]: I0608 13:55:12.367672 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/ee3a2169-e786-43ad-93a6-0c7b2d065bf5-dshm\") pod \"e2e-distinct-2-simulated-kserve-f5c55bdc-cbtt6\" (UID: \"ee3a2169-e786-43ad-93a6-0c7b2d065bf5\") " pod="llm/e2e-distinct-2-simulated-kserve-f5c55bdc-cbtt6" Jun 08 13:55:12.367807 ip-10-0-140-46 kubenswrapper[2576]: I0608 13:55:12.367789 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/ee3a2169-e786-43ad-93a6-0c7b2d065bf5-tls-certs\") pod \"e2e-distinct-2-simulated-kserve-f5c55bdc-cbtt6\" (UID: \"ee3a2169-e786-43ad-93a6-0c7b2d065bf5\") " pod="llm/e2e-distinct-2-simulated-kserve-f5c55bdc-cbtt6" Jun 08 13:55:12.377080 ip-10-0-140-46 kubenswrapper[2576]: I0608 13:55:12.377051 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-6xmx9\" (UniqueName: \"kubernetes.io/projected/ee3a2169-e786-43ad-93a6-0c7b2d065bf5-kube-api-access-6xmx9\") pod \"e2e-distinct-2-simulated-kserve-f5c55bdc-cbtt6\" (UID: \"ee3a2169-e786-43ad-93a6-0c7b2d065bf5\") " pod="llm/e2e-distinct-2-simulated-kserve-f5c55bdc-cbtt6" Jun 08 13:55:12.508180 ip-10-0-140-46 kubenswrapper[2576]: I0608 13:55:12.508092 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-distinct-2-simulated-kserve-f5c55bdc-cbtt6" Jun 08 13:55:12.664339 ip-10-0-140-46 kubenswrapper[2576]: I0608 13:55:12.664300 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-distinct-2-simulated-kserve-f5c55bdc-cbtt6"] Jun 08 13:55:12.664967 ip-10-0-140-46 kubenswrapper[2576]: W0608 13:55:12.664937 2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podee3a2169_e786_43ad_93a6_0c7b2d065bf5.slice/crio-048e411fec7a9c4b12567ba335a860423aa37a5565d7f5dcacccdd7148aa8f52 WatchSource:0}: Error finding container 048e411fec7a9c4b12567ba335a860423aa37a5565d7f5dcacccdd7148aa8f52: Status 404 returned error can't find the container with id 048e411fec7a9c4b12567ba335a860423aa37a5565d7f5dcacccdd7148aa8f52 Jun 08 13:55:12.918020 ip-10-0-140-46 kubenswrapper[2576]: I0608 13:55:12.917987 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-2-simulated-kserve-f5c55bdc-cbtt6" event={"ID":"ee3a2169-e786-43ad-93a6-0c7b2d065bf5","Type":"ContainerStarted","Data":"048e411fec7a9c4b12567ba335a860423aa37a5565d7f5dcacccdd7148aa8f52"} Jun 08 13:55:16.945612 ip-10-0-140-46 kubenswrapper[2576]: I0608 13:55:16.945552 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-2-simulated-kserve-f5c55bdc-cbtt6" event={"ID":"ee3a2169-e786-43ad-93a6-0c7b2d065bf5","Type":"ContainerStarted","Data":"014139fbe78e4d93d2ce10cac7276f16cbcec3056faf281874da8d23008effee"} Jun 08 13:55:17.953090 ip-10-0-140-46 kubenswrapper[2576]: I0608 13:55:17.953050 2576 generic.go:356] "Generic (PLEG): container finished" podID="ee3a2169-e786-43ad-93a6-0c7b2d065bf5" containerID="014139fbe78e4d93d2ce10cac7276f16cbcec3056faf281874da8d23008effee" exitCode=0 Jun 08 13:55:17.953683 ip-10-0-140-46 kubenswrapper[2576]: I0608 13:55:17.953133 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-2-simulated-kserve-f5c55bdc-cbtt6" event={"ID":"ee3a2169-e786-43ad-93a6-0c7b2d065bf5","Type":"ContainerDied","Data":"014139fbe78e4d93d2ce10cac7276f16cbcec3056faf281874da8d23008effee"} Jun 08 13:55:19.968463 ip-10-0-140-46 kubenswrapper[2576]: I0608 13:55:19.968427 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-2-simulated-kserve-f5c55bdc-cbtt6" event={"ID":"ee3a2169-e786-43ad-93a6-0c7b2d065bf5","Type":"ContainerStarted","Data":"9c80d54a104d5073a3d60c71526d24667657b43aa8326c67f1782daea728f911"} Jun 08 13:55:20.001305 ip-10-0-140-46 kubenswrapper[2576]: I0608 13:55:20.001244 2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/e2e-distinct-2-simulated-kserve-f5c55bdc-cbtt6" podStartSLOduration=1.837416187 podStartE2EDuration="8.001226375s" totalImagesPullingTime="4.670125445s" totalInitContainerRuntime="1.493684743s" isStatefulPod=false podCreationTimestamp="2026-06-08 13:55:12 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-08 13:55:19.999181986 +0000 UTC m=+688.078510879" watchObservedRunningTime="2026-06-08 13:55:20.001226375 +0000 UTC m=+688.080555266" Jun 08 13:55:20.219367 ip-10-0-140-46 kubenswrapper[2576]: I0608 13:55:20.219263 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cx7sn_6e4b50fc-3e91-4f50-b92a-e90919788248/konnectivity-agent/0.log" limit=1024 Jun 08 13:55:22.508903 ip-10-0-140-46 kubenswrapper[2576]: I0608 13:55:22.508871 2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/e2e-distinct-2-simulated-kserve-f5c55bdc-cbtt6" Jun 08 13:55:22.509315 ip-10-0-140-46 kubenswrapper[2576]: I0608 13:55:22.509158 2576 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/e2e-distinct-2-simulated-kserve-f5c55bdc-cbtt6" Jun 08 13:55:22.521653 ip-10-0-140-46 kubenswrapper[2576]: I0608 13:55:22.521628 2576 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/e2e-distinct-2-simulated-kserve-f5c55bdc-cbtt6" Jun 08 13:55:22.996452 ip-10-0-140-46 kubenswrapper[2576]: I0608 13:55:22.996416 2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/e2e-distinct-2-simulated-kserve-f5c55bdc-cbtt6" Jun 08 13:55:34.309964 ip-10-0-140-46 kubenswrapper[2576]: I0608 13:55:34.309927 2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-rvps2"] Jun 08 13:55:34.326542 ip-10-0-140-46 kubenswrapper[2576]: I0608 13:55:34.326515 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-rvps2" Jun 08 13:55:34.337447 ip-10-0-140-46 kubenswrapper[2576]: I0608 13:55:34.337421 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"e2e-trlp-test-simulated-kserve-self-signed-certs\"" Jun 08 13:55:34.362505 ip-10-0-140-46 kubenswrapper[2576]: I0608 13:55:34.362471 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-rvps2"] Jun 08 13:55:34.370375 ip-10-0-140-46 kubenswrapper[2576]: I0608 13:55:34.370342 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cx7sn_6e4b50fc-3e91-4f50-b92a-e90919788248/konnectivity-agent/0.log" limit=1024 Jun 08 13:55:34.457036 ip-10-0-140-46 kubenswrapper[2576]: I0608 13:55:34.456994 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/56e2e5c5-94dd-46fa-9ccf-d1a0e9fe43f6-home\") pod \"e2e-trlp-test-simulated-kserve-68bb6c58d9-rvps2\" (UID: \"56e2e5c5-94dd-46fa-9ccf-d1a0e9fe43f6\") " pod="llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-rvps2" Jun 08 13:55:34.457211 ip-10-0-140-46 kubenswrapper[2576]: I0608 13:55:34.457090 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vtblq\" (UniqueName: \"kubernetes.io/projected/56e2e5c5-94dd-46fa-9ccf-d1a0e9fe43f6-kube-api-access-vtblq\") pod \"e2e-trlp-test-simulated-kserve-68bb6c58d9-rvps2\" (UID: \"56e2e5c5-94dd-46fa-9ccf-d1a0e9fe43f6\") " pod="llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-rvps2" Jun 08 13:55:34.457211 ip-10-0-140-46 kubenswrapper[2576]: I0608 13:55:34.457111 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/56e2e5c5-94dd-46fa-9ccf-d1a0e9fe43f6-model-cache\") pod \"e2e-trlp-test-simulated-kserve-68bb6c58d9-rvps2\" (UID: \"56e2e5c5-94dd-46fa-9ccf-d1a0e9fe43f6\") " pod="llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-rvps2" Jun 08 13:55:34.457211 ip-10-0-140-46 kubenswrapper[2576]: I0608 13:55:34.457143 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/56e2e5c5-94dd-46fa-9ccf-d1a0e9fe43f6-kserve-provision-location\") pod \"e2e-trlp-test-simulated-kserve-68bb6c58d9-rvps2\" (UID: \"56e2e5c5-94dd-46fa-9ccf-d1a0e9fe43f6\") " pod="llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-rvps2" Jun 08 13:55:34.457211 ip-10-0-140-46 kubenswrapper[2576]: I0608 13:55:34.457194 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/56e2e5c5-94dd-46fa-9ccf-d1a0e9fe43f6-dshm\") pod \"e2e-trlp-test-simulated-kserve-68bb6c58d9-rvps2\" (UID: \"56e2e5c5-94dd-46fa-9ccf-d1a0e9fe43f6\") " pod="llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-rvps2" Jun 08 13:55:34.457462 ip-10-0-140-46 kubenswrapper[2576]: I0608 13:55:34.457225 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/56e2e5c5-94dd-46fa-9ccf-d1a0e9fe43f6-tls-certs\") pod \"e2e-trlp-test-simulated-kserve-68bb6c58d9-rvps2\" (UID: \"56e2e5c5-94dd-46fa-9ccf-d1a0e9fe43f6\") " pod="llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-rvps2" Jun 08 13:55:34.557886 ip-10-0-140-46 kubenswrapper[2576]: I0608 13:55:34.557846 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vtblq\" (UniqueName: \"kubernetes.io/projected/56e2e5c5-94dd-46fa-9ccf-d1a0e9fe43f6-kube-api-access-vtblq\") pod \"e2e-trlp-test-simulated-kserve-68bb6c58d9-rvps2\" (UID: \"56e2e5c5-94dd-46fa-9ccf-d1a0e9fe43f6\") " pod="llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-rvps2" Jun 08 13:55:34.557886 ip-10-0-140-46 kubenswrapper[2576]: I0608 13:55:34.557885 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/56e2e5c5-94dd-46fa-9ccf-d1a0e9fe43f6-model-cache\") pod \"e2e-trlp-test-simulated-kserve-68bb6c58d9-rvps2\" (UID: \"56e2e5c5-94dd-46fa-9ccf-d1a0e9fe43f6\") " pod="llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-rvps2" Jun 08 13:55:34.558141 ip-10-0-140-46 kubenswrapper[2576]: I0608 13:55:34.557918 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/56e2e5c5-94dd-46fa-9ccf-d1a0e9fe43f6-kserve-provision-location\") pod \"e2e-trlp-test-simulated-kserve-68bb6c58d9-rvps2\" (UID: \"56e2e5c5-94dd-46fa-9ccf-d1a0e9fe43f6\") " pod="llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-rvps2" Jun 08 13:55:34.558141 ip-10-0-140-46 kubenswrapper[2576]: I0608 13:55:34.557945 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/56e2e5c5-94dd-46fa-9ccf-d1a0e9fe43f6-dshm\") pod \"e2e-trlp-test-simulated-kserve-68bb6c58d9-rvps2\" (UID: \"56e2e5c5-94dd-46fa-9ccf-d1a0e9fe43f6\") " pod="llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-rvps2" Jun 08 13:55:34.558141 ip-10-0-140-46 kubenswrapper[2576]: I0608 13:55:34.558061 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/56e2e5c5-94dd-46fa-9ccf-d1a0e9fe43f6-tls-certs\") pod \"e2e-trlp-test-simulated-kserve-68bb6c58d9-rvps2\" (UID: \"56e2e5c5-94dd-46fa-9ccf-d1a0e9fe43f6\") " pod="llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-rvps2" Jun 08 13:55:34.558141 ip-10-0-140-46 kubenswrapper[2576]: I0608 13:55:34.558130 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/56e2e5c5-94dd-46fa-9ccf-d1a0e9fe43f6-home\") pod \"e2e-trlp-test-simulated-kserve-68bb6c58d9-rvps2\" (UID: \"56e2e5c5-94dd-46fa-9ccf-d1a0e9fe43f6\") " pod="llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-rvps2" Jun 08 13:55:34.558363 ip-10-0-140-46 kubenswrapper[2576]: I0608 13:55:34.558337 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/56e2e5c5-94dd-46fa-9ccf-d1a0e9fe43f6-kserve-provision-location\") pod \"e2e-trlp-test-simulated-kserve-68bb6c58d9-rvps2\" (UID: \"56e2e5c5-94dd-46fa-9ccf-d1a0e9fe43f6\") " pod="llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-rvps2" Jun 08 13:55:34.558467 ip-10-0-140-46 kubenswrapper[2576]: I0608 13:55:34.558337 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/56e2e5c5-94dd-46fa-9ccf-d1a0e9fe43f6-model-cache\") pod \"e2e-trlp-test-simulated-kserve-68bb6c58d9-rvps2\" (UID: \"56e2e5c5-94dd-46fa-9ccf-d1a0e9fe43f6\") " pod="llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-rvps2" Jun 08 13:55:34.558556 ip-10-0-140-46 kubenswrapper[2576]: I0608 13:55:34.558536 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/56e2e5c5-94dd-46fa-9ccf-d1a0e9fe43f6-home\") pod \"e2e-trlp-test-simulated-kserve-68bb6c58d9-rvps2\" (UID: \"56e2e5c5-94dd-46fa-9ccf-d1a0e9fe43f6\") " pod="llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-rvps2" Jun 08 13:55:34.560162 ip-10-0-140-46 kubenswrapper[2576]: I0608 13:55:34.560114 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/56e2e5c5-94dd-46fa-9ccf-d1a0e9fe43f6-dshm\") pod \"e2e-trlp-test-simulated-kserve-68bb6c58d9-rvps2\" (UID: \"56e2e5c5-94dd-46fa-9ccf-d1a0e9fe43f6\") " pod="llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-rvps2" Jun 08 13:55:34.560589 ip-10-0-140-46 kubenswrapper[2576]: I0608 13:55:34.560550 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/56e2e5c5-94dd-46fa-9ccf-d1a0e9fe43f6-tls-certs\") pod \"e2e-trlp-test-simulated-kserve-68bb6c58d9-rvps2\" (UID: \"56e2e5c5-94dd-46fa-9ccf-d1a0e9fe43f6\") " pod="llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-rvps2" Jun 08 13:55:34.574058 ip-10-0-140-46 kubenswrapper[2576]: I0608 13:55:34.574035 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-vtblq\" (UniqueName: \"kubernetes.io/projected/56e2e5c5-94dd-46fa-9ccf-d1a0e9fe43f6-kube-api-access-vtblq\") pod \"e2e-trlp-test-simulated-kserve-68bb6c58d9-rvps2\" (UID: \"56e2e5c5-94dd-46fa-9ccf-d1a0e9fe43f6\") " pod="llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-rvps2" Jun 08 13:55:34.637470 ip-10-0-140-46 kubenswrapper[2576]: I0608 13:55:34.637431 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-rvps2" Jun 08 13:55:34.789415 ip-10-0-140-46 kubenswrapper[2576]: I0608 13:55:34.789388 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-rvps2"] Jun 08 13:55:34.790480 ip-10-0-140-46 kubenswrapper[2576]: W0608 13:55:34.790454 2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod56e2e5c5_94dd_46fa_9ccf_d1a0e9fe43f6.slice/crio-6dfc65f014872ac8584f8cbf71c57c85f73e866a83c3178a77115eeeaad962b8 WatchSource:0}: Error finding container 6dfc65f014872ac8584f8cbf71c57c85f73e866a83c3178a77115eeeaad962b8: Status 404 returned error can't find the container with id 6dfc65f014872ac8584f8cbf71c57c85f73e866a83c3178a77115eeeaad962b8 Jun 08 13:55:35.057054 ip-10-0-140-46 kubenswrapper[2576]: I0608 13:55:35.057011 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-rvps2" event={"ID":"56e2e5c5-94dd-46fa-9ccf-d1a0e9fe43f6","Type":"ContainerStarted","Data":"8eea77cfe67906c2ed87120f5c4453c6001bf7895066acf3a7e0712d7808fcec"} Jun 08 13:55:35.057260 ip-10-0-140-46 kubenswrapper[2576]: I0608 13:55:35.057086 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-rvps2" event={"ID":"56e2e5c5-94dd-46fa-9ccf-d1a0e9fe43f6","Type":"ContainerStarted","Data":"6dfc65f014872ac8584f8cbf71c57c85f73e866a83c3178a77115eeeaad962b8"} Jun 08 13:55:36.063799 ip-10-0-140-46 kubenswrapper[2576]: I0608 13:55:36.063762 2576 generic.go:356] "Generic (PLEG): container finished" podID="56e2e5c5-94dd-46fa-9ccf-d1a0e9fe43f6" containerID="8eea77cfe67906c2ed87120f5c4453c6001bf7895066acf3a7e0712d7808fcec" exitCode=0 Jun 08 13:55:36.064262 ip-10-0-140-46 kubenswrapper[2576]: I0608 13:55:36.063817 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-rvps2" event={"ID":"56e2e5c5-94dd-46fa-9ccf-d1a0e9fe43f6","Type":"ContainerDied","Data":"8eea77cfe67906c2ed87120f5c4453c6001bf7895066acf3a7e0712d7808fcec"} Jun 08 13:55:37.071308 ip-10-0-140-46 kubenswrapper[2576]: I0608 13:55:37.071272 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-rvps2" event={"ID":"56e2e5c5-94dd-46fa-9ccf-d1a0e9fe43f6","Type":"ContainerStarted","Data":"be1258a1f462677495f3e0b8f8539aaf67ca2e0f61fe157bb816494147251888"} Jun 08 13:55:37.101224 ip-10-0-140-46 kubenswrapper[2576]: I0608 13:55:37.101175 2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-rvps2" podStartSLOduration=1.606564919 podStartE2EDuration="3.101159408s" totalImagesPullingTime="330.843748ms" totalInitContainerRuntime="1.163750741s" isStatefulPod=false podCreationTimestamp="2026-06-08 13:55:34 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-08 13:55:37.101069268 +0000 UTC m=+705.180398160" watchObservedRunningTime="2026-06-08 13:55:37.101159408 +0000 UTC m=+705.180488299" Jun 08 13:55:42.401244 ip-10-0-140-46 kubenswrapper[2576]: I0608 13:55:42.401206 2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477cwtq6m"] Jun 08 13:55:42.405893 ip-10-0-140-46 kubenswrapper[2576]: I0608 13:55:42.405875 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477cwtq6m" Jun 08 13:55:42.408864 ip-10-0-140-46 kubenswrapper[2576]: I0608 13:55:42.408840 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"e2e-unab60ef4d3a239b5143b412cab04acac3-kserve-self-signed-certs\"" Jun 08 13:55:42.416658 ip-10-0-140-46 kubenswrapper[2576]: I0608 13:55:42.416633 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477cwtq6m"] Jun 08 13:55:42.491293 ip-10-0-140-46 kubenswrapper[2576]: I0608 13:55:42.491257 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cx7sn_6e4b50fc-3e91-4f50-b92a-e90919788248/konnectivity-agent/0.log" limit=1024 Jun 08 13:55:42.529471 ip-10-0-140-46 kubenswrapper[2576]: I0608 13:55:42.529429 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/b4c23a29-21fd-4e06-a97d-5ea51c48d0b5-model-cache\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477cwtq6m\" (UID: \"b4c23a29-21fd-4e06-a97d-5ea51c48d0b5\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477cwtq6m" Jun 08 13:55:42.529471 ip-10-0-140-46 kubenswrapper[2576]: I0608 13:55:42.529472 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/b4c23a29-21fd-4e06-a97d-5ea51c48d0b5-kserve-provision-location\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477cwtq6m\" (UID: \"b4c23a29-21fd-4e06-a97d-5ea51c48d0b5\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477cwtq6m" Jun 08 13:55:42.529783 ip-10-0-140-46 kubenswrapper[2576]: I0608 13:55:42.529531 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/b4c23a29-21fd-4e06-a97d-5ea51c48d0b5-tls-certs\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477cwtq6m\" (UID: \"b4c23a29-21fd-4e06-a97d-5ea51c48d0b5\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477cwtq6m" Jun 08 13:55:42.529783 ip-10-0-140-46 kubenswrapper[2576]: I0608 13:55:42.529667 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/b4c23a29-21fd-4e06-a97d-5ea51c48d0b5-dshm\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477cwtq6m\" (UID: \"b4c23a29-21fd-4e06-a97d-5ea51c48d0b5\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477cwtq6m" Jun 08 13:55:42.529783 ip-10-0-140-46 kubenswrapper[2576]: I0608 13:55:42.529751 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2wxz4\" (UniqueName: \"kubernetes.io/projected/b4c23a29-21fd-4e06-a97d-5ea51c48d0b5-kube-api-access-2wxz4\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477cwtq6m\" (UID: \"b4c23a29-21fd-4e06-a97d-5ea51c48d0b5\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477cwtq6m" Jun 08 13:55:42.529920 ip-10-0-140-46 kubenswrapper[2576]: I0608 13:55:42.529789 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/b4c23a29-21fd-4e06-a97d-5ea51c48d0b5-home\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477cwtq6m\" (UID: \"b4c23a29-21fd-4e06-a97d-5ea51c48d0b5\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477cwtq6m" Jun 08 13:55:42.631012 ip-10-0-140-46 kubenswrapper[2576]: I0608 13:55:42.630967 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/b4c23a29-21fd-4e06-a97d-5ea51c48d0b5-home\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477cwtq6m\" (UID: \"b4c23a29-21fd-4e06-a97d-5ea51c48d0b5\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477cwtq6m" Jun 08 13:55:42.631208 ip-10-0-140-46 kubenswrapper[2576]: I0608 13:55:42.631027 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/b4c23a29-21fd-4e06-a97d-5ea51c48d0b5-model-cache\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477cwtq6m\" (UID: \"b4c23a29-21fd-4e06-a97d-5ea51c48d0b5\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477cwtq6m" Jun 08 13:55:42.631208 ip-10-0-140-46 kubenswrapper[2576]: I0608 13:55:42.631123 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/b4c23a29-21fd-4e06-a97d-5ea51c48d0b5-kserve-provision-location\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477cwtq6m\" (UID: \"b4c23a29-21fd-4e06-a97d-5ea51c48d0b5\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477cwtq6m" Jun 08 13:55:42.631208 ip-10-0-140-46 kubenswrapper[2576]: I0608 13:55:42.631145 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/b4c23a29-21fd-4e06-a97d-5ea51c48d0b5-tls-certs\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477cwtq6m\" (UID: \"b4c23a29-21fd-4e06-a97d-5ea51c48d0b5\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477cwtq6m" Jun 08 13:55:42.631208 ip-10-0-140-46 kubenswrapper[2576]: I0608 13:55:42.631205 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/b4c23a29-21fd-4e06-a97d-5ea51c48d0b5-dshm\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477cwtq6m\" (UID: \"b4c23a29-21fd-4e06-a97d-5ea51c48d0b5\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477cwtq6m" Jun 08 13:55:42.631387 ip-10-0-140-46 kubenswrapper[2576]: I0608 13:55:42.631358 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2wxz4\" (UniqueName: \"kubernetes.io/projected/b4c23a29-21fd-4e06-a97d-5ea51c48d0b5-kube-api-access-2wxz4\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477cwtq6m\" (UID: \"b4c23a29-21fd-4e06-a97d-5ea51c48d0b5\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477cwtq6m" Jun 08 13:55:42.631491 ip-10-0-140-46 kubenswrapper[2576]: I0608 13:55:42.631469 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/b4c23a29-21fd-4e06-a97d-5ea51c48d0b5-home\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477cwtq6m\" (UID: \"b4c23a29-21fd-4e06-a97d-5ea51c48d0b5\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477cwtq6m" Jun 08 13:55:42.631551 ip-10-0-140-46 kubenswrapper[2576]: I0608 13:55:42.631485 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/b4c23a29-21fd-4e06-a97d-5ea51c48d0b5-model-cache\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477cwtq6m\" (UID: \"b4c23a29-21fd-4e06-a97d-5ea51c48d0b5\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477cwtq6m" Jun 08 13:55:42.631551 ip-10-0-140-46 kubenswrapper[2576]: I0608 13:55:42.631536 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/b4c23a29-21fd-4e06-a97d-5ea51c48d0b5-kserve-provision-location\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477cwtq6m\" (UID: \"b4c23a29-21fd-4e06-a97d-5ea51c48d0b5\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477cwtq6m" Jun 08 13:55:42.633846 ip-10-0-140-46 kubenswrapper[2576]: I0608 13:55:42.633812 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/b4c23a29-21fd-4e06-a97d-5ea51c48d0b5-dshm\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477cwtq6m\" (UID: \"b4c23a29-21fd-4e06-a97d-5ea51c48d0b5\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477cwtq6m" Jun 08 13:55:42.634133 ip-10-0-140-46 kubenswrapper[2576]: I0608 13:55:42.634109 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/b4c23a29-21fd-4e06-a97d-5ea51c48d0b5-tls-certs\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477cwtq6m\" (UID: \"b4c23a29-21fd-4e06-a97d-5ea51c48d0b5\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477cwtq6m" Jun 08 13:55:42.640722 ip-10-0-140-46 kubenswrapper[2576]: I0608 13:55:42.640694 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-2wxz4\" (UniqueName: \"kubernetes.io/projected/b4c23a29-21fd-4e06-a97d-5ea51c48d0b5-kube-api-access-2wxz4\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477cwtq6m\" (UID: \"b4c23a29-21fd-4e06-a97d-5ea51c48d0b5\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477cwtq6m" Jun 08 13:55:42.716797 ip-10-0-140-46 kubenswrapper[2576]: I0608 13:55:42.716688 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477cwtq6m" Jun 08 13:55:42.857903 ip-10-0-140-46 kubenswrapper[2576]: I0608 13:55:42.857870 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477cwtq6m"] Jun 08 13:55:42.859001 ip-10-0-140-46 kubenswrapper[2576]: W0608 13:55:42.858974 2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb4c23a29_21fd_4e06_a97d_5ea51c48d0b5.slice/crio-86c02e4a907e556b9b4aa011b249731f6baa6fc2370b27f68c71b6bdb44e07d1 WatchSource:0}: Error finding container 86c02e4a907e556b9b4aa011b249731f6baa6fc2370b27f68c71b6bdb44e07d1: Status 404 returned error can't find the container with id 86c02e4a907e556b9b4aa011b249731f6baa6fc2370b27f68c71b6bdb44e07d1 Jun 08 13:55:43.106372 ip-10-0-140-46 kubenswrapper[2576]: I0608 13:55:43.106331 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477cwtq6m" event={"ID":"b4c23a29-21fd-4e06-a97d-5ea51c48d0b5","Type":"ContainerStarted","Data":"f3dce4e9912d20fabfba5af0055293bf1afaf4b56b55d02d91c6fb6999d50031"} Jun 08 13:55:43.106538 ip-10-0-140-46 kubenswrapper[2576]: I0608 13:55:43.106393 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477cwtq6m" event={"ID":"b4c23a29-21fd-4e06-a97d-5ea51c48d0b5","Type":"ContainerStarted","Data":"86c02e4a907e556b9b4aa011b249731f6baa6fc2370b27f68c71b6bdb44e07d1"} Jun 08 13:55:44.637665 ip-10-0-140-46 kubenswrapper[2576]: I0608 13:55:44.637626 2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-rvps2" Jun 08 13:55:44.638055 ip-10-0-140-46 kubenswrapper[2576]: I0608 13:55:44.637701 2576 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-rvps2" Jun 08 13:55:44.650707 ip-10-0-140-46 kubenswrapper[2576]: I0608 13:55:44.650678 2576 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-rvps2" Jun 08 13:55:45.128475 ip-10-0-140-46 kubenswrapper[2576]: I0608 13:55:45.128446 2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-rvps2" Jun 08 13:55:53.123089 ip-10-0-140-46 kubenswrapper[2576]: I0608 13:55:53.123035 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cx7sn_6e4b50fc-3e91-4f50-b92a-e90919788248/konnectivity-agent/0.log" limit=1024 Jun 08 13:55:57.724015 ip-10-0-140-46 kubenswrapper[2576]: I0608 13:55:57.723978 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cx7sn_6e4b50fc-3e91-4f50-b92a-e90919788248/konnectivity-agent/0.log" limit=1024 Jun 08 13:57:27.685396 ip-10-0-140-46 kubenswrapper[2576]: I0608 13:57:27.685355 2576 generic.go:356] "Generic (PLEG): container finished" podID="b4c23a29-21fd-4e06-a97d-5ea51c48d0b5" containerID="f3dce4e9912d20fabfba5af0055293bf1afaf4b56b55d02d91c6fb6999d50031" exitCode=0 Jun 08 13:57:27.685876 ip-10-0-140-46 kubenswrapper[2576]: I0608 13:57:27.685413 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477cwtq6m" event={"ID":"b4c23a29-21fd-4e06-a97d-5ea51c48d0b5","Type":"ContainerDied","Data":"f3dce4e9912d20fabfba5af0055293bf1afaf4b56b55d02d91c6fb6999d50031"} Jun 08 13:57:28.693131 ip-10-0-140-46 kubenswrapper[2576]: I0608 13:57:28.693096 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477cwtq6m" event={"ID":"b4c23a29-21fd-4e06-a97d-5ea51c48d0b5","Type":"ContainerStarted","Data":"5d6fbeb1a8970cc0b10b2c6e28ee566c0a599f4f84ee96a11c10c21d9d7bcbc1"} Jun 08 13:57:28.711660 ip-10-0-140-46 kubenswrapper[2576]: I0608 13:57:28.711597 2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477cwtq6m" podStartSLOduration=2.09151293 podStartE2EDuration="1m46.711575246s" totalImagesPullingTime="271.488394ms" totalInitContainerRuntime="1m44.348573922s" isStatefulPod=false podCreationTimestamp="2026-06-08 13:55:42 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-08 13:57:28.709777625 +0000 UTC m=+816.789106516" watchObservedRunningTime="2026-06-08 13:57:28.711575246 +0000 UTC m=+816.790904130" Jun 08 13:57:32.716905 ip-10-0-140-46 kubenswrapper[2576]: I0608 13:57:32.716874 2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477cwtq6m" Jun 08 13:57:32.717306 ip-10-0-140-46 kubenswrapper[2576]: I0608 13:57:32.716926 2576 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477cwtq6m" Jun 08 13:57:32.730029 ip-10-0-140-46 kubenswrapper[2576]: I0608 13:57:32.729998 2576 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477cwtq6m" Jun 08 13:57:33.731344 ip-10-0-140-46 kubenswrapper[2576]: I0608 13:57:33.731314 2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477cwtq6m" Jun 08 13:57:59.343671 ip-10-0-140-46 kubenswrapper[2576]: I0608 13:57:59.343630 2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-6d5c5c5dc4-5tgr4"] Jun 08 13:57:59.347124 ip-10-0-140-46 kubenswrapper[2576]: I0608 13:57:59.347108 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-6d5c5c5dc4-5tgr4" Jun 08 13:57:59.354745 ip-10-0-140-46 kubenswrapper[2576]: I0608 13:57:59.354630 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-6d5c5c5dc4-5tgr4"] Jun 08 13:57:59.454651 ip-10-0-140-46 kubenswrapper[2576]: I0608 13:57:59.454607 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/c416cc8e-81eb-49d2-ace9-886201b404f4-tls-cert\") pod \"authorino-6d5c5c5dc4-5tgr4\" (UID: \"c416cc8e-81eb-49d2-ace9-886201b404f4\") " pod="kuadrant-system/authorino-6d5c5c5dc4-5tgr4" Jun 08 13:57:59.454829 ip-10-0-140-46 kubenswrapper[2576]: I0608 13:57:59.454660 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5qpqz\" (UniqueName: \"kubernetes.io/projected/c416cc8e-81eb-49d2-ace9-886201b404f4-kube-api-access-5qpqz\") pod \"authorino-6d5c5c5dc4-5tgr4\" (UID: \"c416cc8e-81eb-49d2-ace9-886201b404f4\") " pod="kuadrant-system/authorino-6d5c5c5dc4-5tgr4" Jun 08 13:57:59.454829 ip-10-0-140-46 kubenswrapper[2576]: I0608 13:57:59.454753 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oidc-ca\" (UniqueName: \"kubernetes.io/configmap/c416cc8e-81eb-49d2-ace9-886201b404f4-oidc-ca\") pod \"authorino-6d5c5c5dc4-5tgr4\" (UID: \"c416cc8e-81eb-49d2-ace9-886201b404f4\") " pod="kuadrant-system/authorino-6d5c5c5dc4-5tgr4" Jun 08 13:57:59.556047 ip-10-0-140-46 kubenswrapper[2576]: I0608 13:57:59.556008 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/c416cc8e-81eb-49d2-ace9-886201b404f4-tls-cert\") pod \"authorino-6d5c5c5dc4-5tgr4\" (UID: \"c416cc8e-81eb-49d2-ace9-886201b404f4\") " pod="kuadrant-system/authorino-6d5c5c5dc4-5tgr4" Jun 08 13:57:59.556221 ip-10-0-140-46 kubenswrapper[2576]: I0608 13:57:59.556059 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5qpqz\" (UniqueName: \"kubernetes.io/projected/c416cc8e-81eb-49d2-ace9-886201b404f4-kube-api-access-5qpqz\") pod \"authorino-6d5c5c5dc4-5tgr4\" (UID: \"c416cc8e-81eb-49d2-ace9-886201b404f4\") " pod="kuadrant-system/authorino-6d5c5c5dc4-5tgr4" Jun 08 13:57:59.556221 ip-10-0-140-46 kubenswrapper[2576]: I0608 13:57:59.556098 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oidc-ca\" (UniqueName: \"kubernetes.io/configmap/c416cc8e-81eb-49d2-ace9-886201b404f4-oidc-ca\") pod \"authorino-6d5c5c5dc4-5tgr4\" (UID: \"c416cc8e-81eb-49d2-ace9-886201b404f4\") " pod="kuadrant-system/authorino-6d5c5c5dc4-5tgr4" Jun 08 13:57:59.556851 ip-10-0-140-46 kubenswrapper[2576]: I0608 13:57:59.556832 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"oidc-ca\" (UniqueName: \"kubernetes.io/configmap/c416cc8e-81eb-49d2-ace9-886201b404f4-oidc-ca\") pod \"authorino-6d5c5c5dc4-5tgr4\" (UID: \"c416cc8e-81eb-49d2-ace9-886201b404f4\") " pod="kuadrant-system/authorino-6d5c5c5dc4-5tgr4" Jun 08 13:57:59.558560 ip-10-0-140-46 kubenswrapper[2576]: I0608 13:57:59.558538 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/c416cc8e-81eb-49d2-ace9-886201b404f4-tls-cert\") pod \"authorino-6d5c5c5dc4-5tgr4\" (UID: \"c416cc8e-81eb-49d2-ace9-886201b404f4\") " pod="kuadrant-system/authorino-6d5c5c5dc4-5tgr4" Jun 08 13:57:59.564232 ip-10-0-140-46 kubenswrapper[2576]: I0608 13:57:59.564207 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-5qpqz\" (UniqueName: \"kubernetes.io/projected/c416cc8e-81eb-49d2-ace9-886201b404f4-kube-api-access-5qpqz\") pod \"authorino-6d5c5c5dc4-5tgr4\" (UID: \"c416cc8e-81eb-49d2-ace9-886201b404f4\") " pod="kuadrant-system/authorino-6d5c5c5dc4-5tgr4" Jun 08 13:57:59.657509 ip-10-0-140-46 kubenswrapper[2576]: I0608 13:57:59.657415 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-6d5c5c5dc4-5tgr4" Jun 08 13:57:59.789896 ip-10-0-140-46 kubenswrapper[2576]: I0608 13:57:59.789868 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-6d5c5c5dc4-5tgr4"] Jun 08 13:57:59.792026 ip-10-0-140-46 kubenswrapper[2576]: W0608 13:57:59.791997 2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podc416cc8e_81eb_49d2_ace9_886201b404f4.slice/crio-0a31610ccb6b54f2bc0a27cecd273adbf339686a523354e0808dda2c4abde2af WatchSource:0}: Error finding container 0a31610ccb6b54f2bc0a27cecd273adbf339686a523354e0808dda2c4abde2af: Status 404 returned error can't find the container with id 0a31610ccb6b54f2bc0a27cecd273adbf339686a523354e0808dda2c4abde2af Jun 08 13:57:59.865739 ip-10-0-140-46 kubenswrapper[2576]: I0608 13:57:59.865703 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-6d5c5c5dc4-5tgr4" event={"ID":"c416cc8e-81eb-49d2-ace9-886201b404f4","Type":"ContainerStarted","Data":"0a31610ccb6b54f2bc0a27cecd273adbf339686a523354e0808dda2c4abde2af"} Jun 08 13:57:59.878107 ip-10-0-140-46 kubenswrapper[2576]: I0608 13:57:59.878046 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cx7sn_6e4b50fc-3e91-4f50-b92a-e90919788248/konnectivity-agent/0.log" limit=1024 Jun 08 13:57:59.963494 ip-10-0-140-46 kubenswrapper[2576]: I0608 13:57:59.963413 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cx7sn_6e4b50fc-3e91-4f50-b92a-e90919788248/konnectivity-agent/0.log" limit=1024 Jun 08 13:58:00.878725 ip-10-0-140-46 kubenswrapper[2576]: I0608 13:58:00.878688 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-6d5c5c5dc4-5tgr4" event={"ID":"c416cc8e-81eb-49d2-ace9-886201b404f4","Type":"ContainerStarted","Data":"bd30603679f850b2713fd0b301625df12b3b0eade308586ad748b5f7329aee7f"} Jun 08 13:58:00.896381 ip-10-0-140-46 kubenswrapper[2576]: I0608 13:58:00.896330 2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/authorino-6d5c5c5dc4-5tgr4" podStartSLOduration=1.499004428 podStartE2EDuration="1.896315495s" totalImagesPullingTime="397.311067ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-08 13:57:59 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-08 13:58:00.894907617 +0000 UTC m=+848.974236510" watchObservedRunningTime="2026-06-08 13:58:00.896315495 +0000 UTC m=+848.975644386" Jun 08 13:58:00.933956 ip-10-0-140-46 kubenswrapper[2576]: I0608 13:58:00.933922 2576 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-6d5768b547-5fp9p"] Jun 08 13:58:00.934239 ip-10-0-140-46 kubenswrapper[2576]: I0608 13:58:00.934206 2576 kuberuntime_container.go:872] "Killing container with a grace period" pod="kuadrant-system/authorino-6d5768b547-5fp9p" podUID="45ad9ab9-00b0-4853-a237-ec5f094c7369" containerName="authorino" containerID="cri-o://500e3e39418e33d61d82f2b1f36e51638663a16dc4f159b9d16926b9b0cbe700" gracePeriod=30 Jun 08 13:58:00.963935 ip-10-0-140-46 kubenswrapper[2576]: I0608 13:58:00.963906 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cx7sn_6e4b50fc-3e91-4f50-b92a-e90919788248/konnectivity-agent/0.log" limit=1024 Jun 08 13:58:01.067721 ip-10-0-140-46 kubenswrapper[2576]: I0608 13:58:01.067686 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cx7sn_6e4b50fc-3e91-4f50-b92a-e90919788248/konnectivity-agent/0.log" limit=1024 Jun 08 13:58:01.179056 ip-10-0-140-46 kubenswrapper[2576]: I0608 13:58:01.179030 2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-6d5768b547-5fp9p" Jun 08 13:58:01.272427 ip-10-0-140-46 kubenswrapper[2576]: I0608 13:58:01.272388 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"oidc-ca\" (UniqueName: \"kubernetes.io/configmap/45ad9ab9-00b0-4853-a237-ec5f094c7369-oidc-ca\") pod \"45ad9ab9-00b0-4853-a237-ec5f094c7369\" (UID: \"45ad9ab9-00b0-4853-a237-ec5f094c7369\") " Jun 08 13:58:01.272635 ip-10-0-140-46 kubenswrapper[2576]: I0608 13:58:01.272441 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/45ad9ab9-00b0-4853-a237-ec5f094c7369-tls-cert\") pod \"45ad9ab9-00b0-4853-a237-ec5f094c7369\" (UID: \"45ad9ab9-00b0-4853-a237-ec5f094c7369\") " Jun 08 13:58:01.272635 ip-10-0-140-46 kubenswrapper[2576]: I0608 13:58:01.272465 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-kkq7q\" (UniqueName: \"kubernetes.io/projected/45ad9ab9-00b0-4853-a237-ec5f094c7369-kube-api-access-kkq7q\") pod \"45ad9ab9-00b0-4853-a237-ec5f094c7369\" (UID: \"45ad9ab9-00b0-4853-a237-ec5f094c7369\") " Jun 08 13:58:01.274542 ip-10-0-140-46 kubenswrapper[2576]: I0608 13:58:01.274507 2576 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/45ad9ab9-00b0-4853-a237-ec5f094c7369-kube-api-access-kkq7q" (OuterVolumeSpecName: "kube-api-access-kkq7q") pod "45ad9ab9-00b0-4853-a237-ec5f094c7369" (UID: "45ad9ab9-00b0-4853-a237-ec5f094c7369"). InnerVolumeSpecName "kube-api-access-kkq7q". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 08 13:58:01.277424 ip-10-0-140-46 kubenswrapper[2576]: I0608 13:58:01.277400 2576 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/45ad9ab9-00b0-4853-a237-ec5f094c7369-oidc-ca" (OuterVolumeSpecName: "oidc-ca") pod "45ad9ab9-00b0-4853-a237-ec5f094c7369" (UID: "45ad9ab9-00b0-4853-a237-ec5f094c7369"). InnerVolumeSpecName "oidc-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 08 13:58:01.282614 ip-10-0-140-46 kubenswrapper[2576]: I0608 13:58:01.282590 2576 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/45ad9ab9-00b0-4853-a237-ec5f094c7369-tls-cert" (OuterVolumeSpecName: "tls-cert") pod "45ad9ab9-00b0-4853-a237-ec5f094c7369" (UID: "45ad9ab9-00b0-4853-a237-ec5f094c7369"). InnerVolumeSpecName "tls-cert". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 08 13:58:01.373440 ip-10-0-140-46 kubenswrapper[2576]: I0608 13:58:01.373397 2576 reconciler_common.go:299] "Volume detached for volume \"oidc-ca\" (UniqueName: \"kubernetes.io/configmap/45ad9ab9-00b0-4853-a237-ec5f094c7369-oidc-ca\") on node \"ip-10-0-140-46.ec2.internal\" DevicePath \"\"" Jun 08 13:58:01.373440 ip-10-0-140-46 kubenswrapper[2576]: I0608 13:58:01.373427 2576 reconciler_common.go:299] "Volume detached for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/45ad9ab9-00b0-4853-a237-ec5f094c7369-tls-cert\") on node \"ip-10-0-140-46.ec2.internal\" DevicePath \"\"" Jun 08 13:58:01.373440 ip-10-0-140-46 kubenswrapper[2576]: I0608 13:58:01.373440 2576 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-kkq7q\" (UniqueName: \"kubernetes.io/projected/45ad9ab9-00b0-4853-a237-ec5f094c7369-kube-api-access-kkq7q\") on node \"ip-10-0-140-46.ec2.internal\" DevicePath \"\"" Jun 08 13:58:01.887221 ip-10-0-140-46 kubenswrapper[2576]: I0608 13:58:01.887130 2576 generic.go:356] "Generic (PLEG): container finished" podID="45ad9ab9-00b0-4853-a237-ec5f094c7369" containerID="500e3e39418e33d61d82f2b1f36e51638663a16dc4f159b9d16926b9b0cbe700" exitCode=0 Jun 08 13:58:01.887221 ip-10-0-140-46 kubenswrapper[2576]: I0608 13:58:01.887177 2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-6d5768b547-5fp9p" Jun 08 13:58:01.887769 ip-10-0-140-46 kubenswrapper[2576]: I0608 13:58:01.887223 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-6d5768b547-5fp9p" event={"ID":"45ad9ab9-00b0-4853-a237-ec5f094c7369","Type":"ContainerDied","Data":"500e3e39418e33d61d82f2b1f36e51638663a16dc4f159b9d16926b9b0cbe700"} Jun 08 13:58:01.887769 ip-10-0-140-46 kubenswrapper[2576]: I0608 13:58:01.887269 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-6d5768b547-5fp9p" event={"ID":"45ad9ab9-00b0-4853-a237-ec5f094c7369","Type":"ContainerDied","Data":"60a06315a081a36cf8b07385f44f99a026721da97ba7b27bb8882689ec2f1aa1"} Jun 08 13:58:01.887769 ip-10-0-140-46 kubenswrapper[2576]: I0608 13:58:01.887290 2576 scope.go:117] "RemoveContainer" containerID="500e3e39418e33d61d82f2b1f36e51638663a16dc4f159b9d16926b9b0cbe700" Jun 08 13:58:01.899936 ip-10-0-140-46 kubenswrapper[2576]: I0608 13:58:01.899867 2576 scope.go:117] "RemoveContainer" containerID="500e3e39418e33d61d82f2b1f36e51638663a16dc4f159b9d16926b9b0cbe700" Jun 08 13:58:01.900238 ip-10-0-140-46 kubenswrapper[2576]: E0608 13:58:01.900219 2576 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"500e3e39418e33d61d82f2b1f36e51638663a16dc4f159b9d16926b9b0cbe700\": container with ID starting with 500e3e39418e33d61d82f2b1f36e51638663a16dc4f159b9d16926b9b0cbe700 not found: ID does not exist" containerID="500e3e39418e33d61d82f2b1f36e51638663a16dc4f159b9d16926b9b0cbe700" Jun 08 13:58:01.900341 ip-10-0-140-46 kubenswrapper[2576]: I0608 13:58:01.900251 2576 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"500e3e39418e33d61d82f2b1f36e51638663a16dc4f159b9d16926b9b0cbe700"} err="failed to get container status \"500e3e39418e33d61d82f2b1f36e51638663a16dc4f159b9d16926b9b0cbe700\": rpc error: code = NotFound desc = could not find container \"500e3e39418e33d61d82f2b1f36e51638663a16dc4f159b9d16926b9b0cbe700\": container with ID starting with 500e3e39418e33d61d82f2b1f36e51638663a16dc4f159b9d16926b9b0cbe700 not found: ID does not exist" Jun 08 13:58:01.913787 ip-10-0-140-46 kubenswrapper[2576]: I0608 13:58:01.913756 2576 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-6d5768b547-5fp9p"] Jun 08 13:58:01.923019 ip-10-0-140-46 kubenswrapper[2576]: I0608 13:58:01.922987 2576 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/authorino-6d5768b547-5fp9p"] Jun 08 13:58:02.377782 ip-10-0-140-46 kubenswrapper[2576]: I0608 13:58:02.377747 2576 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="45ad9ab9-00b0-4853-a237-ec5f094c7369" path="/var/lib/kubelet/pods/45ad9ab9-00b0-4853-a237-ec5f094c7369/volumes" Jun 08 13:58:52.385695 ip-10-0-140-46 kubenswrapper[2576]: I0608 13:58:52.385666 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-ncffd_c26912ca-10b4-4ae3-b306-890f93abfee3/ovn-acl-logging/0.log" Jun 08 13:58:52.389644 ip-10-0-140-46 kubenswrapper[2576]: I0608 13:58:52.389612 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-ncffd_c26912ca-10b4-4ae3-b306-890f93abfee3/ovn-acl-logging/0.log" Jun 08 13:58:54.304639 ip-10-0-140-46 kubenswrapper[2576]: I0608 13:58:54.304601 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cx7sn_6e4b50fc-3e91-4f50-b92a-e90919788248/konnectivity-agent/0.log" limit=1024 Jun 08 13:59:46.962860 ip-10-0-140-46 kubenswrapper[2576]: I0608 13:59:46.962820 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cx7sn_6e4b50fc-3e91-4f50-b92a-e90919788248/konnectivity-agent/0.log" limit=1024 Jun 08 13:59:47.054334 ip-10-0-140-46 kubenswrapper[2576]: I0608 13:59:47.054304 2576 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-controller-b646647b6-msjv5"] Jun 08 13:59:47.054544 ip-10-0-140-46 kubenswrapper[2576]: I0608 13:59:47.054522 2576 kuberuntime_container.go:872] "Killing container with a grace period" pod="opendatahub/maas-controller-b646647b6-msjv5" podUID="6b5fda6d-b6fd-4318-956e-6ce6b56e08d6" containerName="manager" containerID="cri-o://13eabea29736e3831a1702c316d4428f64762427969da19fa068d69e7b0a84ff" gracePeriod=30 Jun 08 13:59:47.306699 ip-10-0-140-46 kubenswrapper[2576]: I0608 13:59:47.306672 2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-b646647b6-msjv5" Jun 08 13:59:47.430125 ip-10-0-140-46 kubenswrapper[2576]: I0608 13:59:47.430086 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-w6rb7\" (UniqueName: \"kubernetes.io/projected/6b5fda6d-b6fd-4318-956e-6ce6b56e08d6-kube-api-access-w6rb7\") pod \"6b5fda6d-b6fd-4318-956e-6ce6b56e08d6\" (UID: \"6b5fda6d-b6fd-4318-956e-6ce6b56e08d6\") " Jun 08 13:59:47.430306 ip-10-0-140-46 kubenswrapper[2576]: I0608 13:59:47.430202 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/6b5fda6d-b6fd-4318-956e-6ce6b56e08d6-webhook-cert\") pod \"6b5fda6d-b6fd-4318-956e-6ce6b56e08d6\" (UID: \"6b5fda6d-b6fd-4318-956e-6ce6b56e08d6\") " Jun 08 13:59:47.432466 ip-10-0-140-46 kubenswrapper[2576]: I0608 13:59:47.432440 2576 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/6b5fda6d-b6fd-4318-956e-6ce6b56e08d6-webhook-cert" (OuterVolumeSpecName: "webhook-cert") pod "6b5fda6d-b6fd-4318-956e-6ce6b56e08d6" (UID: "6b5fda6d-b6fd-4318-956e-6ce6b56e08d6"). InnerVolumeSpecName "webhook-cert". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 08 13:59:47.432672 ip-10-0-140-46 kubenswrapper[2576]: I0608 13:59:47.432648 2576 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/6b5fda6d-b6fd-4318-956e-6ce6b56e08d6-kube-api-access-w6rb7" (OuterVolumeSpecName: "kube-api-access-w6rb7") pod "6b5fda6d-b6fd-4318-956e-6ce6b56e08d6" (UID: "6b5fda6d-b6fd-4318-956e-6ce6b56e08d6"). InnerVolumeSpecName "kube-api-access-w6rb7". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 08 13:59:47.492930 ip-10-0-140-46 kubenswrapper[2576]: I0608 13:59:47.492848 2576 generic.go:356] "Generic (PLEG): container finished" podID="6b5fda6d-b6fd-4318-956e-6ce6b56e08d6" containerID="13eabea29736e3831a1702c316d4428f64762427969da19fa068d69e7b0a84ff" exitCode=0 Jun 08 13:59:47.492930 ip-10-0-140-46 kubenswrapper[2576]: I0608 13:59:47.492890 2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-b646647b6-msjv5" Jun 08 13:59:47.493108 ip-10-0-140-46 kubenswrapper[2576]: I0608 13:59:47.492933 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-b646647b6-msjv5" event={"ID":"6b5fda6d-b6fd-4318-956e-6ce6b56e08d6","Type":"ContainerDied","Data":"13eabea29736e3831a1702c316d4428f64762427969da19fa068d69e7b0a84ff"} Jun 08 13:59:47.493108 ip-10-0-140-46 kubenswrapper[2576]: I0608 13:59:47.492989 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-b646647b6-msjv5" event={"ID":"6b5fda6d-b6fd-4318-956e-6ce6b56e08d6","Type":"ContainerDied","Data":"b1065251c53019bbe67f50f225dbf3dcd1627e51e2deb7478200c79ce77182fc"} Jun 08 13:59:47.493108 ip-10-0-140-46 kubenswrapper[2576]: I0608 13:59:47.493011 2576 scope.go:117] "RemoveContainer" containerID="13eabea29736e3831a1702c316d4428f64762427969da19fa068d69e7b0a84ff" Jun 08 13:59:47.503435 ip-10-0-140-46 kubenswrapper[2576]: I0608 13:59:47.503416 2576 scope.go:117] "RemoveContainer" containerID="13eabea29736e3831a1702c316d4428f64762427969da19fa068d69e7b0a84ff" Jun 08 13:59:47.503746 ip-10-0-140-46 kubenswrapper[2576]: E0608 13:59:47.503726 2576 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"13eabea29736e3831a1702c316d4428f64762427969da19fa068d69e7b0a84ff\": container with ID starting with 13eabea29736e3831a1702c316d4428f64762427969da19fa068d69e7b0a84ff not found: ID does not exist" containerID="13eabea29736e3831a1702c316d4428f64762427969da19fa068d69e7b0a84ff" Jun 08 13:59:47.503813 ip-10-0-140-46 kubenswrapper[2576]: I0608 13:59:47.503756 2576 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"13eabea29736e3831a1702c316d4428f64762427969da19fa068d69e7b0a84ff"} err="failed to get container status \"13eabea29736e3831a1702c316d4428f64762427969da19fa068d69e7b0a84ff\": rpc error: code = NotFound desc = could not find container \"13eabea29736e3831a1702c316d4428f64762427969da19fa068d69e7b0a84ff\": container with ID starting with 13eabea29736e3831a1702c316d4428f64762427969da19fa068d69e7b0a84ff not found: ID does not exist" Jun 08 13:59:47.516016 ip-10-0-140-46 kubenswrapper[2576]: I0608 13:59:47.515989 2576 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-controller-b646647b6-msjv5"] Jun 08 13:59:47.519314 ip-10-0-140-46 kubenswrapper[2576]: I0608 13:59:47.519289 2576 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/maas-controller-b646647b6-msjv5"] Jun 08 13:59:47.531220 ip-10-0-140-46 kubenswrapper[2576]: I0608 13:59:47.531190 2576 reconciler_common.go:299] "Volume detached for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/6b5fda6d-b6fd-4318-956e-6ce6b56e08d6-webhook-cert\") on node \"ip-10-0-140-46.ec2.internal\" DevicePath \"\"" Jun 08 13:59:47.531220 ip-10-0-140-46 kubenswrapper[2576]: I0608 13:59:47.531218 2576 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-w6rb7\" (UniqueName: \"kubernetes.io/projected/6b5fda6d-b6fd-4318-956e-6ce6b56e08d6-kube-api-access-w6rb7\") on node \"ip-10-0-140-46.ec2.internal\" DevicePath \"\"" Jun 08 13:59:48.194680 ip-10-0-140-46 kubenswrapper[2576]: I0608 13:59:48.194635 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cx7sn_6e4b50fc-3e91-4f50-b92a-e90919788248/konnectivity-agent/0.log" limit=1024 Jun 08 13:59:48.312181 ip-10-0-140-46 kubenswrapper[2576]: I0608 13:59:48.312147 2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/maas-controller-b646647b6-jrdmt"] Jun 08 13:59:48.312531 ip-10-0-140-46 kubenswrapper[2576]: I0608 13:59:48.312519 2576 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="6b5fda6d-b6fd-4318-956e-6ce6b56e08d6" containerName="manager" Jun 08 13:59:48.312607 ip-10-0-140-46 kubenswrapper[2576]: I0608 13:59:48.312532 2576 state_mem.go:107] "Deleted CPUSet assignment" podUID="6b5fda6d-b6fd-4318-956e-6ce6b56e08d6" containerName="manager" Jun 08 13:59:48.312607 ip-10-0-140-46 kubenswrapper[2576]: I0608 13:59:48.312541 2576 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="45ad9ab9-00b0-4853-a237-ec5f094c7369" containerName="authorino" Jun 08 13:59:48.312607 ip-10-0-140-46 kubenswrapper[2576]: I0608 13:59:48.312546 2576 state_mem.go:107] "Deleted CPUSet assignment" podUID="45ad9ab9-00b0-4853-a237-ec5f094c7369" containerName="authorino" Jun 08 13:59:48.312724 ip-10-0-140-46 kubenswrapper[2576]: I0608 13:59:48.312644 2576 memory_manager.go:368] "RemoveStaleState removing state" podUID="6b5fda6d-b6fd-4318-956e-6ce6b56e08d6" containerName="manager" Jun 08 13:59:48.312724 ip-10-0-140-46 kubenswrapper[2576]: I0608 13:59:48.312658 2576 memory_manager.go:368] "RemoveStaleState removing state" podUID="45ad9ab9-00b0-4853-a237-ec5f094c7369" containerName="authorino" Jun 08 13:59:48.316812 ip-10-0-140-46 kubenswrapper[2576]: I0608 13:59:48.316797 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-b646647b6-jrdmt" Jun 08 13:59:48.320225 ip-10-0-140-46 kubenswrapper[2576]: I0608 13:59:48.320205 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"maas-parameters\"" Jun 08 13:59:48.320372 ip-10-0-140-46 kubenswrapper[2576]: I0608 13:59:48.320314 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-controller-webhook-cert\"" Jun 08 13:59:48.320372 ip-10-0-140-46 kubenswrapper[2576]: I0608 13:59:48.320368 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-controller-dockercfg-bf2t7\"" Jun 08 13:59:48.328772 ip-10-0-140-46 kubenswrapper[2576]: I0608 13:59:48.328743 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-b646647b6-jrdmt"] Jun 08 13:59:48.377306 ip-10-0-140-46 kubenswrapper[2576]: I0608 13:59:48.377264 2576 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="6b5fda6d-b6fd-4318-956e-6ce6b56e08d6" path="/var/lib/kubelet/pods/6b5fda6d-b6fd-4318-956e-6ce6b56e08d6/volumes" Jun 08 13:59:48.439665 ip-10-0-140-46 kubenswrapper[2576]: I0608 13:59:48.439623 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ncch5\" (UniqueName: \"kubernetes.io/projected/eeaae028-d070-434e-b899-5364783d007c-kube-api-access-ncch5\") pod \"maas-controller-b646647b6-jrdmt\" (UID: \"eeaae028-d070-434e-b899-5364783d007c\") " pod="opendatahub/maas-controller-b646647b6-jrdmt" Jun 08 13:59:48.439845 ip-10-0-140-46 kubenswrapper[2576]: I0608 13:59:48.439695 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/eeaae028-d070-434e-b899-5364783d007c-webhook-cert\") pod \"maas-controller-b646647b6-jrdmt\" (UID: \"eeaae028-d070-434e-b899-5364783d007c\") " pod="opendatahub/maas-controller-b646647b6-jrdmt" Jun 08 13:59:48.540472 ip-10-0-140-46 kubenswrapper[2576]: I0608 13:59:48.540429 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/eeaae028-d070-434e-b899-5364783d007c-webhook-cert\") pod \"maas-controller-b646647b6-jrdmt\" (UID: \"eeaae028-d070-434e-b899-5364783d007c\") " pod="opendatahub/maas-controller-b646647b6-jrdmt" Jun 08 13:59:48.540675 ip-10-0-140-46 kubenswrapper[2576]: I0608 13:59:48.540517 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ncch5\" (UniqueName: \"kubernetes.io/projected/eeaae028-d070-434e-b899-5364783d007c-kube-api-access-ncch5\") pod \"maas-controller-b646647b6-jrdmt\" (UID: \"eeaae028-d070-434e-b899-5364783d007c\") " pod="opendatahub/maas-controller-b646647b6-jrdmt" Jun 08 13:59:48.542926 ip-10-0-140-46 kubenswrapper[2576]: I0608 13:59:48.542900 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/eeaae028-d070-434e-b899-5364783d007c-webhook-cert\") pod \"maas-controller-b646647b6-jrdmt\" (UID: \"eeaae028-d070-434e-b899-5364783d007c\") " pod="opendatahub/maas-controller-b646647b6-jrdmt" Jun 08 13:59:48.549833 ip-10-0-140-46 kubenswrapper[2576]: I0608 13:59:48.549806 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-ncch5\" (UniqueName: \"kubernetes.io/projected/eeaae028-d070-434e-b899-5364783d007c-kube-api-access-ncch5\") pod \"maas-controller-b646647b6-jrdmt\" (UID: \"eeaae028-d070-434e-b899-5364783d007c\") " pod="opendatahub/maas-controller-b646647b6-jrdmt" Jun 08 13:59:48.630289 ip-10-0-140-46 kubenswrapper[2576]: I0608 13:59:48.630245 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-b646647b6-jrdmt" Jun 08 13:59:48.768899 ip-10-0-140-46 kubenswrapper[2576]: I0608 13:59:48.768874 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-b646647b6-jrdmt"] Jun 08 13:59:48.770541 ip-10-0-140-46 kubenswrapper[2576]: W0608 13:59:48.770517 2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podeeaae028_d070_434e_b899_5364783d007c.slice/crio-e9cf7d185c5bf290170a81135340b311999b313f971a38bb509272bf62b7fc65 WatchSource:0}: Error finding container e9cf7d185c5bf290170a81135340b311999b313f971a38bb509272bf62b7fc65: Status 404 returned error can't find the container with id e9cf7d185c5bf290170a81135340b311999b313f971a38bb509272bf62b7fc65 Jun 08 13:59:48.771993 ip-10-0-140-46 kubenswrapper[2576]: I0608 13:59:48.771972 2576 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jun 08 13:59:49.506820 ip-10-0-140-46 kubenswrapper[2576]: I0608 13:59:49.506784 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-b646647b6-jrdmt" event={"ID":"eeaae028-d070-434e-b899-5364783d007c","Type":"ContainerStarted","Data":"d4fc0f79a8b14c6b3ecd82404dcd14366d3c25a305f673d2cfccef3d16b03e09"} Jun 08 13:59:49.507282 ip-10-0-140-46 kubenswrapper[2576]: I0608 13:59:49.506835 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-b646647b6-jrdmt" event={"ID":"eeaae028-d070-434e-b899-5364783d007c","Type":"ContainerStarted","Data":"e9cf7d185c5bf290170a81135340b311999b313f971a38bb509272bf62b7fc65"} Jun 08 13:59:49.507282 ip-10-0-140-46 kubenswrapper[2576]: I0608 13:59:49.506868 2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/maas-controller-b646647b6-jrdmt" Jun 08 13:59:49.525987 ip-10-0-140-46 kubenswrapper[2576]: I0608 13:59:49.525938 2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/maas-controller-b646647b6-jrdmt" podStartSLOduration=0.980514255 podStartE2EDuration="1.525920234s" totalImagesPullingTime="545.405979ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-08 13:59:48 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-08 13:59:49.523819035 +0000 UTC m=+957.603147951" watchObservedRunningTime="2026-06-08 13:59:49.525920234 +0000 UTC m=+957.605249128" Jun 08 14:00:00.518219 ip-10-0-140-46 kubenswrapper[2576]: I0608 14:00:00.518189 2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/maas-controller-b646647b6-jrdmt" Jun 08 14:00:26.633436 ip-10-0-140-46 kubenswrapper[2576]: I0608 14:00:26.633349 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cx7sn_6e4b50fc-3e91-4f50-b92a-e90919788248/konnectivity-agent/0.log" limit=1024 Jun 08 14:00:26.682277 ip-10-0-140-46 kubenswrapper[2576]: I0608 14:00:26.682241 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cx7sn_6e4b50fc-3e91-4f50-b92a-e90919788248/konnectivity-agent/0.log" limit=1024 Jun 08 14:00:28.028013 ip-10-0-140-46 kubenswrapper[2576]: I0608 14:00:28.027981 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cx7sn_6e4b50fc-3e91-4f50-b92a-e90919788248/konnectivity-agent/0.log" limit=1024 Jun 08 14:00:28.123249 ip-10-0-140-46 kubenswrapper[2576]: I0608 14:00:28.123212 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cx7sn_6e4b50fc-3e91-4f50-b92a-e90919788248/konnectivity-agent/0.log" limit=1024 Jun 08 14:00:36.529462 ip-10-0-140-46 kubenswrapper[2576]: I0608 14:00:36.529427 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cx7sn_6e4b50fc-3e91-4f50-b92a-e90919788248/konnectivity-agent/0.log" limit=1024 Jun 08 14:00:42.416160 ip-10-0-140-46 kubenswrapper[2576]: I0608 14:00:42.416125 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cx7sn_6e4b50fc-3e91-4f50-b92a-e90919788248/konnectivity-agent/0.log" limit=1024 Jun 08 14:00:42.518414 ip-10-0-140-46 kubenswrapper[2576]: I0608 14:00:42.518379 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cx7sn_6e4b50fc-3e91-4f50-b92a-e90919788248/konnectivity-agent/0.log" limit=1024 Jun 08 14:01:03.330500 ip-10-0-140-46 kubenswrapper[2576]: I0608 14:01:03.330461 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cx7sn_6e4b50fc-3e91-4f50-b92a-e90919788248/konnectivity-agent/0.log" limit=1024 Jun 08 14:01:14.584408 ip-10-0-140-46 kubenswrapper[2576]: I0608 14:01:14.584371 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cx7sn_6e4b50fc-3e91-4f50-b92a-e90919788248/konnectivity-agent/0.log" limit=1024 Jun 08 14:01:14.668426 ip-10-0-140-46 kubenswrapper[2576]: I0608 14:01:14.668390 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cx7sn_6e4b50fc-3e91-4f50-b92a-e90919788248/konnectivity-agent/0.log" limit=1024 Jun 08 14:01:38.589318 ip-10-0-140-46 kubenswrapper[2576]: I0608 14:01:38.589233 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cx7sn_6e4b50fc-3e91-4f50-b92a-e90919788248/konnectivity-agent/0.log" limit=1024 Jun 08 14:01:44.964317 ip-10-0-140-46 kubenswrapper[2576]: I0608 14:01:44.964275 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cx7sn_6e4b50fc-3e91-4f50-b92a-e90919788248/konnectivity-agent/0.log" limit=1024 Jun 08 14:01:45.023267 ip-10-0-140-46 kubenswrapper[2576]: I0608 14:01:45.023213 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cx7sn_6e4b50fc-3e91-4f50-b92a-e90919788248/konnectivity-agent/0.log" limit=1024 Jun 08 14:01:45.088369 ip-10-0-140-46 kubenswrapper[2576]: I0608 14:01:45.088337 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cx7sn_6e4b50fc-3e91-4f50-b92a-e90919788248/konnectivity-agent/0.log" limit=1024 Jun 08 14:01:45.186726 ip-10-0-140-46 kubenswrapper[2576]: I0608 14:01:45.186687 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cx7sn_6e4b50fc-3e91-4f50-b92a-e90919788248/konnectivity-agent/0.log" limit=1024 Jun 08 14:01:45.310854 ip-10-0-140-46 kubenswrapper[2576]: I0608 14:01:45.310813 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cx7sn_6e4b50fc-3e91-4f50-b92a-e90919788248/konnectivity-agent/0.log" limit=1024 Jun 08 14:01:45.411377 ip-10-0-140-46 kubenswrapper[2576]: I0608 14:01:45.411334 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cx7sn_6e4b50fc-3e91-4f50-b92a-e90919788248/konnectivity-agent/0.log" limit=1024 Jun 08 14:02:01.981810 ip-10-0-140-46 kubenswrapper[2576]: I0608 14:02:01.981772 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cx7sn_6e4b50fc-3e91-4f50-b92a-e90919788248/konnectivity-agent/0.log" limit=1024 Jun 08 14:02:02.089322 ip-10-0-140-46 kubenswrapper[2576]: I0608 14:02:02.089289 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cx7sn_6e4b50fc-3e91-4f50-b92a-e90919788248/konnectivity-agent/0.log" limit=1024 Jun 08 14:02:02.190143 ip-10-0-140-46 kubenswrapper[2576]: I0608 14:02:02.190110 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cx7sn_6e4b50fc-3e91-4f50-b92a-e90919788248/konnectivity-agent/0.log" limit=1024 Jun 08 14:02:09.300674 ip-10-0-140-46 kubenswrapper[2576]: I0608 14:02:09.300638 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cx7sn_6e4b50fc-3e91-4f50-b92a-e90919788248/konnectivity-agent/0.log" limit=1024 Jun 08 14:02:09.400070 ip-10-0-140-46 kubenswrapper[2576]: I0608 14:02:09.400033 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cx7sn_6e4b50fc-3e91-4f50-b92a-e90919788248/konnectivity-agent/0.log" limit=1024 Jun 08 14:02:17.449297 ip-10-0-140-46 kubenswrapper[2576]: I0608 14:02:17.449260 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cx7sn_6e4b50fc-3e91-4f50-b92a-e90919788248/konnectivity-agent/0.log" limit=1024 Jun 08 14:02:17.546707 ip-10-0-140-46 kubenswrapper[2576]: I0608 14:02:17.546666 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cx7sn_6e4b50fc-3e91-4f50-b92a-e90919788248/konnectivity-agent/0.log" limit=1024 Jun 08 14:02:17.650030 ip-10-0-140-46 kubenswrapper[2576]: I0608 14:02:17.649995 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cx7sn_6e4b50fc-3e91-4f50-b92a-e90919788248/konnectivity-agent/0.log" limit=1024 Jun 08 14:02:17.757200 ip-10-0-140-46 kubenswrapper[2576]: I0608 14:02:17.757122 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cx7sn_6e4b50fc-3e91-4f50-b92a-e90919788248/konnectivity-agent/0.log" limit=1024 Jun 08 14:02:34.259852 ip-10-0-140-46 kubenswrapper[2576]: I0608 14:02:34.259813 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cx7sn_6e4b50fc-3e91-4f50-b92a-e90919788248/konnectivity-agent/0.log" limit=1024 Jun 08 14:02:34.359907 ip-10-0-140-46 kubenswrapper[2576]: I0608 14:02:34.359871 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cx7sn_6e4b50fc-3e91-4f50-b92a-e90919788248/konnectivity-agent/0.log" limit=1024 Jun 08 14:02:34.459164 ip-10-0-140-46 kubenswrapper[2576]: I0608 14:02:34.459131 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cx7sn_6e4b50fc-3e91-4f50-b92a-e90919788248/konnectivity-agent/0.log" limit=1024 Jun 08 14:02:39.639021 ip-10-0-140-46 kubenswrapper[2576]: I0608 14:02:39.638988 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cx7sn_6e4b50fc-3e91-4f50-b92a-e90919788248/konnectivity-agent/0.log" limit=1024 Jun 08 14:02:39.737374 ip-10-0-140-46 kubenswrapper[2576]: I0608 14:02:39.737343 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cx7sn_6e4b50fc-3e91-4f50-b92a-e90919788248/konnectivity-agent/0.log" limit=1024 Jun 08 14:02:40.653069 ip-10-0-140-46 kubenswrapper[2576]: I0608 14:02:40.653033 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cx7sn_6e4b50fc-3e91-4f50-b92a-e90919788248/konnectivity-agent/0.log" limit=1024 Jun 08 14:02:40.709288 ip-10-0-140-46 kubenswrapper[2576]: I0608 14:02:40.709253 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cx7sn_6e4b50fc-3e91-4f50-b92a-e90919788248/konnectivity-agent/0.log" limit=1024 Jun 08 14:03:01.047973 ip-10-0-140-46 kubenswrapper[2576]: I0608 14:03:01.047928 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cx7sn_6e4b50fc-3e91-4f50-b92a-e90919788248/konnectivity-agent/0.log" limit=1024 Jun 08 14:03:01.147772 ip-10-0-140-46 kubenswrapper[2576]: I0608 14:03:01.147734 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cx7sn_6e4b50fc-3e91-4f50-b92a-e90919788248/konnectivity-agent/0.log" limit=1024 Jun 08 14:03:01.257722 ip-10-0-140-46 kubenswrapper[2576]: I0608 14:03:01.257687 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cx7sn_6e4b50fc-3e91-4f50-b92a-e90919788248/konnectivity-agent/0.log" limit=1024 Jun 08 14:03:05.373266 ip-10-0-140-46 kubenswrapper[2576]: I0608 14:03:05.373231 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cx7sn_6e4b50fc-3e91-4f50-b92a-e90919788248/konnectivity-agent/0.log" limit=1024 Jun 08 14:03:07.241499 ip-10-0-140-46 kubenswrapper[2576]: I0608 14:03:07.241456 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cx7sn_6e4b50fc-3e91-4f50-b92a-e90919788248/konnectivity-agent/0.log" limit=1024 Jun 08 14:03:07.339591 ip-10-0-140-46 kubenswrapper[2576]: I0608 14:03:07.339538 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cx7sn_6e4b50fc-3e91-4f50-b92a-e90919788248/konnectivity-agent/0.log" limit=1024 Jun 08 14:03:07.437874 ip-10-0-140-46 kubenswrapper[2576]: I0608 14:03:07.437841 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cx7sn_6e4b50fc-3e91-4f50-b92a-e90919788248/konnectivity-agent/0.log" limit=1024 Jun 08 14:03:07.566169 ip-10-0-140-46 kubenswrapper[2576]: I0608 14:03:07.566133 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cx7sn_6e4b50fc-3e91-4f50-b92a-e90919788248/konnectivity-agent/0.log" limit=1024 Jun 08 14:03:13.655556 ip-10-0-140-46 kubenswrapper[2576]: I0608 14:03:13.655515 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cx7sn_6e4b50fc-3e91-4f50-b92a-e90919788248/konnectivity-agent/0.log" limit=1024 Jun 08 14:03:13.755254 ip-10-0-140-46 kubenswrapper[2576]: I0608 14:03:13.755217 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cx7sn_6e4b50fc-3e91-4f50-b92a-e90919788248/konnectivity-agent/0.log" limit=1024 Jun 08 14:03:52.422483 ip-10-0-140-46 kubenswrapper[2576]: I0608 14:03:52.422453 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-ncffd_c26912ca-10b4-4ae3-b306-890f93abfee3/ovn-acl-logging/0.log" Jun 08 14:03:52.427479 ip-10-0-140-46 kubenswrapper[2576]: I0608 14:03:52.427456 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-ncffd_c26912ca-10b4-4ae3-b306-890f93abfee3/ovn-acl-logging/0.log" Jun 08 14:06:42.987729 ip-10-0-140-46 kubenswrapper[2576]: I0608 14:06:42.987654 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cx7sn_6e4b50fc-3e91-4f50-b92a-e90919788248/konnectivity-agent/0.log" limit=1024 Jun 08 14:07:45.286087 ip-10-0-140-46 kubenswrapper[2576]: I0608 14:07:45.286004 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cx7sn_6e4b50fc-3e91-4f50-b92a-e90919788248/konnectivity-agent/0.log" limit=1024 Jun 08 14:07:58.874146 ip-10-0-140-46 kubenswrapper[2576]: I0608 14:07:58.874083 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cx7sn_6e4b50fc-3e91-4f50-b92a-e90919788248/konnectivity-agent/0.log" limit=1024 Jun 08 14:08:52.457979 ip-10-0-140-46 kubenswrapper[2576]: I0608 14:08:52.457940 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-ncffd_c26912ca-10b4-4ae3-b306-890f93abfee3/ovn-acl-logging/0.log" Jun 08 14:08:52.465081 ip-10-0-140-46 kubenswrapper[2576]: I0608 14:08:52.465054 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-ncffd_c26912ca-10b4-4ae3-b306-890f93abfee3/ovn-acl-logging/0.log" Jun 08 14:12:46.301255 ip-10-0-140-46 kubenswrapper[2576]: I0608 14:12:46.301217 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cx7sn_6e4b50fc-3e91-4f50-b92a-e90919788248/konnectivity-agent/0.log" limit=1024 Jun 08 14:13:52.493548 ip-10-0-140-46 kubenswrapper[2576]: I0608 14:13:52.493521 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-ncffd_c26912ca-10b4-4ae3-b306-890f93abfee3/ovn-acl-logging/0.log" Jun 08 14:13:52.502201 ip-10-0-140-46 kubenswrapper[2576]: I0608 14:13:52.502180 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-ncffd_c26912ca-10b4-4ae3-b306-890f93abfee3/ovn-acl-logging/0.log" Jun 08 14:17:05.440120 ip-10-0-140-46 kubenswrapper[2576]: I0608 14:17:05.440079 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cx7sn_6e4b50fc-3e91-4f50-b92a-e90919788248/konnectivity-agent/0.log" limit=1024 Jun 08 14:17:40.642374 ip-10-0-140-46 kubenswrapper[2576]: I0608 14:17:40.642335 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cx7sn_6e4b50fc-3e91-4f50-b92a-e90919788248/konnectivity-agent/0.log" limit=1024 Jun 08 14:18:52.530633 ip-10-0-140-46 kubenswrapper[2576]: I0608 14:18:52.530603 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-ncffd_c26912ca-10b4-4ae3-b306-890f93abfee3/ovn-acl-logging/0.log" Jun 08 14:18:52.543003 ip-10-0-140-46 kubenswrapper[2576]: I0608 14:18:52.542977 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-ncffd_c26912ca-10b4-4ae3-b306-890f93abfee3/ovn-acl-logging/0.log" Jun 08 14:19:28.897199 ip-10-0-140-46 kubenswrapper[2576]: I0608 14:19:28.897165 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cx7sn_6e4b50fc-3e91-4f50-b92a-e90919788248/konnectivity-agent/0.log" limit=1024 Jun 08 14:20:11.702424 ip-10-0-140-46 kubenswrapper[2576]: I0608 14:20:11.702373 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cx7sn_6e4b50fc-3e91-4f50-b92a-e90919788248/konnectivity-agent/0.log" limit=1024 Jun 08 14:20:11.844204 ip-10-0-140-46 kubenswrapper[2576]: I0608 14:20:11.844159 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cx7sn_6e4b50fc-3e91-4f50-b92a-e90919788248/konnectivity-agent/0.log" limit=1024 Jun 08 14:20:11.943064 ip-10-0-140-46 kubenswrapper[2576]: I0608 14:20:11.942962 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cx7sn_6e4b50fc-3e91-4f50-b92a-e90919788248/konnectivity-agent/0.log" limit=1024 Jun 08 14:20:15.828599 ip-10-0-140-46 kubenswrapper[2576]: I0608 14:20:15.828540 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cx7sn_6e4b50fc-3e91-4f50-b92a-e90919788248/konnectivity-agent/0.log" limit=1024 Jun 08 14:20:17.938607 ip-10-0-140-46 kubenswrapper[2576]: I0608 14:20:17.938523 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cx7sn_6e4b50fc-3e91-4f50-b92a-e90919788248/konnectivity-agent/0.log" limit=1024 Jun 08 14:20:18.119631 ip-10-0-140-46 kubenswrapper[2576]: I0608 14:20:18.119590 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cx7sn_6e4b50fc-3e91-4f50-b92a-e90919788248/konnectivity-agent/0.log" limit=1024 Jun 08 14:20:18.220229 ip-10-0-140-46 kubenswrapper[2576]: I0608 14:20:18.220120 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cx7sn_6e4b50fc-3e91-4f50-b92a-e90919788248/konnectivity-agent/0.log" limit=1024 Jun 08 14:20:22.179960 ip-10-0-140-46 kubenswrapper[2576]: I0608 14:20:22.179924 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cx7sn_6e4b50fc-3e91-4f50-b92a-e90919788248/konnectivity-agent/0.log" limit=1024 Jun 08 14:20:24.737138 ip-10-0-140-46 kubenswrapper[2576]: I0608 14:20:24.737105 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cx7sn_6e4b50fc-3e91-4f50-b92a-e90919788248/konnectivity-agent/0.log" limit=1024 Jun 08 14:20:24.845045 ip-10-0-140-46 kubenswrapper[2576]: I0608 14:20:24.845000 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cx7sn_6e4b50fc-3e91-4f50-b92a-e90919788248/konnectivity-agent/0.log" limit=1024 Jun 08 14:20:25.044676 ip-10-0-140-46 kubenswrapper[2576]: I0608 14:20:25.044636 2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-ait-56a8e437-openshift-default-6749b77676-w6w5g"] Jun 08 14:20:25.047968 ip-10-0-140-46 kubenswrapper[2576]: I0608 14:20:25.047950 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-56a8e437-openshift-default-6749b77676-w6w5g" Jun 08 14:20:25.052937 ip-10-0-140-46 kubenswrapper[2576]: I0608 14:20:25.052914 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-ait-56a8e437-openshift-default-dockercfg-6tvdd\"" Jun 08 14:20:25.072927 ip-10-0-140-46 kubenswrapper[2576]: I0608 14:20:25.072897 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-ait-56a8e437-openshift-default-6749b77676-w6w5g"] Jun 08 14:20:25.107264 ip-10-0-140-46 kubenswrapper[2576]: I0608 14:20:25.107227 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cx7sn_6e4b50fc-3e91-4f50-b92a-e90919788248/konnectivity-agent/0.log" limit=1024 Jun 08 14:20:25.126640 ip-10-0-140-46 kubenswrapper[2576]: I0608 14:20:25.126610 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/afc3b114-6220-4a7d-a371-f16958f4a1d4-credential-socket\") pod \"e2e-ait-56a8e437-openshift-default-6749b77676-w6w5g\" (UID: \"afc3b114-6220-4a7d-a371-f16958f4a1d4\") " pod="openshift-ingress/e2e-ait-56a8e437-openshift-default-6749b77676-w6w5g" Jun 08 14:20:25.126802 ip-10-0-140-46 kubenswrapper[2576]: I0608 14:20:25.126648 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/afc3b114-6220-4a7d-a371-f16958f4a1d4-istio-token\") pod \"e2e-ait-56a8e437-openshift-default-6749b77676-w6w5g\" (UID: \"afc3b114-6220-4a7d-a371-f16958f4a1d4\") " pod="openshift-ingress/e2e-ait-56a8e437-openshift-default-6749b77676-w6w5g" Jun 08 14:20:25.126802 ip-10-0-140-46 kubenswrapper[2576]: I0608 14:20:25.126669 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/afc3b114-6220-4a7d-a371-f16958f4a1d4-istio-envoy\") pod \"e2e-ait-56a8e437-openshift-default-6749b77676-w6w5g\" (UID: \"afc3b114-6220-4a7d-a371-f16958f4a1d4\") " pod="openshift-ingress/e2e-ait-56a8e437-openshift-default-6749b77676-w6w5g" Jun 08 14:20:25.126802 ip-10-0-140-46 kubenswrapper[2576]: I0608 14:20:25.126697 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/afc3b114-6220-4a7d-a371-f16958f4a1d4-istiod-ca-cert\") pod \"e2e-ait-56a8e437-openshift-default-6749b77676-w6w5g\" (UID: \"afc3b114-6220-4a7d-a371-f16958f4a1d4\") " pod="openshift-ingress/e2e-ait-56a8e437-openshift-default-6749b77676-w6w5g" Jun 08 14:20:25.126802 ip-10-0-140-46 kubenswrapper[2576]: I0608 14:20:25.126714 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/afc3b114-6220-4a7d-a371-f16958f4a1d4-workload-socket\") pod \"e2e-ait-56a8e437-openshift-default-6749b77676-w6w5g\" (UID: \"afc3b114-6220-4a7d-a371-f16958f4a1d4\") " pod="openshift-ingress/e2e-ait-56a8e437-openshift-default-6749b77676-w6w5g" Jun 08 14:20:25.126802 ip-10-0-140-46 kubenswrapper[2576]: I0608 14:20:25.126737 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/afc3b114-6220-4a7d-a371-f16958f4a1d4-istio-data\") pod \"e2e-ait-56a8e437-openshift-default-6749b77676-w6w5g\" (UID: \"afc3b114-6220-4a7d-a371-f16958f4a1d4\") " pod="openshift-ingress/e2e-ait-56a8e437-openshift-default-6749b77676-w6w5g" Jun 08 14:20:25.126802 ip-10-0-140-46 kubenswrapper[2576]: I0608 14:20:25.126755 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/afc3b114-6220-4a7d-a371-f16958f4a1d4-istio-podinfo\") pod \"e2e-ait-56a8e437-openshift-default-6749b77676-w6w5g\" (UID: \"afc3b114-6220-4a7d-a371-f16958f4a1d4\") " pod="openshift-ingress/e2e-ait-56a8e437-openshift-default-6749b77676-w6w5g" Jun 08 14:20:25.126802 ip-10-0-140-46 kubenswrapper[2576]: I0608 14:20:25.126772 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/afc3b114-6220-4a7d-a371-f16958f4a1d4-workload-certs\") pod \"e2e-ait-56a8e437-openshift-default-6749b77676-w6w5g\" (UID: \"afc3b114-6220-4a7d-a371-f16958f4a1d4\") " pod="openshift-ingress/e2e-ait-56a8e437-openshift-default-6749b77676-w6w5g" Jun 08 14:20:25.127061 ip-10-0-140-46 kubenswrapper[2576]: I0608 14:20:25.126806 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jzcdf\" (UniqueName: \"kubernetes.io/projected/afc3b114-6220-4a7d-a371-f16958f4a1d4-kube-api-access-jzcdf\") pod \"e2e-ait-56a8e437-openshift-default-6749b77676-w6w5g\" (UID: \"afc3b114-6220-4a7d-a371-f16958f4a1d4\") " pod="openshift-ingress/e2e-ait-56a8e437-openshift-default-6749b77676-w6w5g" Jun 08 14:20:25.224050 ip-10-0-140-46 kubenswrapper[2576]: I0608 14:20:25.224020 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cx7sn_6e4b50fc-3e91-4f50-b92a-e90919788248/konnectivity-agent/0.log" limit=1024 Jun 08 14:20:25.228144 ip-10-0-140-46 kubenswrapper[2576]: I0608 14:20:25.228116 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/afc3b114-6220-4a7d-a371-f16958f4a1d4-credential-socket\") pod \"e2e-ait-56a8e437-openshift-default-6749b77676-w6w5g\" (UID: \"afc3b114-6220-4a7d-a371-f16958f4a1d4\") " pod="openshift-ingress/e2e-ait-56a8e437-openshift-default-6749b77676-w6w5g" Jun 08 14:20:25.228273 ip-10-0-140-46 kubenswrapper[2576]: I0608 14:20:25.228155 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/afc3b114-6220-4a7d-a371-f16958f4a1d4-istio-token\") pod \"e2e-ait-56a8e437-openshift-default-6749b77676-w6w5g\" (UID: \"afc3b114-6220-4a7d-a371-f16958f4a1d4\") " pod="openshift-ingress/e2e-ait-56a8e437-openshift-default-6749b77676-w6w5g" Jun 08 14:20:25.228273 ip-10-0-140-46 kubenswrapper[2576]: I0608 14:20:25.228178 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/afc3b114-6220-4a7d-a371-f16958f4a1d4-istio-envoy\") pod \"e2e-ait-56a8e437-openshift-default-6749b77676-w6w5g\" (UID: \"afc3b114-6220-4a7d-a371-f16958f4a1d4\") " pod="openshift-ingress/e2e-ait-56a8e437-openshift-default-6749b77676-w6w5g" Jun 08 14:20:25.228273 ip-10-0-140-46 kubenswrapper[2576]: I0608 14:20:25.228209 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/afc3b114-6220-4a7d-a371-f16958f4a1d4-istiod-ca-cert\") pod \"e2e-ait-56a8e437-openshift-default-6749b77676-w6w5g\" (UID: \"afc3b114-6220-4a7d-a371-f16958f4a1d4\") " pod="openshift-ingress/e2e-ait-56a8e437-openshift-default-6749b77676-w6w5g" Jun 08 14:20:25.228273 ip-10-0-140-46 kubenswrapper[2576]: I0608 14:20:25.228224 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/afc3b114-6220-4a7d-a371-f16958f4a1d4-workload-socket\") pod \"e2e-ait-56a8e437-openshift-default-6749b77676-w6w5g\" (UID: \"afc3b114-6220-4a7d-a371-f16958f4a1d4\") " pod="openshift-ingress/e2e-ait-56a8e437-openshift-default-6749b77676-w6w5g" Jun 08 14:20:25.228273 ip-10-0-140-46 kubenswrapper[2576]: I0608 14:20:25.228241 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/afc3b114-6220-4a7d-a371-f16958f4a1d4-istio-data\") pod \"e2e-ait-56a8e437-openshift-default-6749b77676-w6w5g\" (UID: \"afc3b114-6220-4a7d-a371-f16958f4a1d4\") " pod="openshift-ingress/e2e-ait-56a8e437-openshift-default-6749b77676-w6w5g" Jun 08 14:20:25.228273 ip-10-0-140-46 kubenswrapper[2576]: I0608 14:20:25.228259 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/afc3b114-6220-4a7d-a371-f16958f4a1d4-istio-podinfo\") pod \"e2e-ait-56a8e437-openshift-default-6749b77676-w6w5g\" (UID: \"afc3b114-6220-4a7d-a371-f16958f4a1d4\") " pod="openshift-ingress/e2e-ait-56a8e437-openshift-default-6749b77676-w6w5g" Jun 08 14:20:25.228712 ip-10-0-140-46 kubenswrapper[2576]: I0608 14:20:25.228279 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/afc3b114-6220-4a7d-a371-f16958f4a1d4-workload-certs\") pod \"e2e-ait-56a8e437-openshift-default-6749b77676-w6w5g\" (UID: \"afc3b114-6220-4a7d-a371-f16958f4a1d4\") " pod="openshift-ingress/e2e-ait-56a8e437-openshift-default-6749b77676-w6w5g" Jun 08 14:20:25.228712 ip-10-0-140-46 kubenswrapper[2576]: I0608 14:20:25.228302 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jzcdf\" (UniqueName: \"kubernetes.io/projected/afc3b114-6220-4a7d-a371-f16958f4a1d4-kube-api-access-jzcdf\") pod \"e2e-ait-56a8e437-openshift-default-6749b77676-w6w5g\" (UID: \"afc3b114-6220-4a7d-a371-f16958f4a1d4\") " pod="openshift-ingress/e2e-ait-56a8e437-openshift-default-6749b77676-w6w5g" Jun 08 14:20:25.228712 ip-10-0-140-46 kubenswrapper[2576]: I0608 14:20:25.228702 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/afc3b114-6220-4a7d-a371-f16958f4a1d4-istio-data\") pod \"e2e-ait-56a8e437-openshift-default-6749b77676-w6w5g\" (UID: \"afc3b114-6220-4a7d-a371-f16958f4a1d4\") " pod="openshift-ingress/e2e-ait-56a8e437-openshift-default-6749b77676-w6w5g" Jun 08 14:20:25.228871 ip-10-0-140-46 kubenswrapper[2576]: I0608 14:20:25.228758 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/afc3b114-6220-4a7d-a371-f16958f4a1d4-credential-socket\") pod \"e2e-ait-56a8e437-openshift-default-6749b77676-w6w5g\" (UID: \"afc3b114-6220-4a7d-a371-f16958f4a1d4\") " pod="openshift-ingress/e2e-ait-56a8e437-openshift-default-6749b77676-w6w5g" Jun 08 14:20:25.228871 ip-10-0-140-46 kubenswrapper[2576]: I0608 14:20:25.228819 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/afc3b114-6220-4a7d-a371-f16958f4a1d4-workload-socket\") pod \"e2e-ait-56a8e437-openshift-default-6749b77676-w6w5g\" (UID: \"afc3b114-6220-4a7d-a371-f16958f4a1d4\") " pod="openshift-ingress/e2e-ait-56a8e437-openshift-default-6749b77676-w6w5g" Jun 08 14:20:25.228871 ip-10-0-140-46 kubenswrapper[2576]: I0608 14:20:25.228851 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/afc3b114-6220-4a7d-a371-f16958f4a1d4-workload-certs\") pod \"e2e-ait-56a8e437-openshift-default-6749b77676-w6w5g\" (UID: \"afc3b114-6220-4a7d-a371-f16958f4a1d4\") " pod="openshift-ingress/e2e-ait-56a8e437-openshift-default-6749b77676-w6w5g" Jun 08 14:20:25.229281 ip-10-0-140-46 kubenswrapper[2576]: I0608 14:20:25.229259 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/afc3b114-6220-4a7d-a371-f16958f4a1d4-istiod-ca-cert\") pod \"e2e-ait-56a8e437-openshift-default-6749b77676-w6w5g\" (UID: \"afc3b114-6220-4a7d-a371-f16958f4a1d4\") " pod="openshift-ingress/e2e-ait-56a8e437-openshift-default-6749b77676-w6w5g" Jun 08 14:20:25.230884 ip-10-0-140-46 kubenswrapper[2576]: I0608 14:20:25.230860 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/afc3b114-6220-4a7d-a371-f16958f4a1d4-istio-envoy\") pod \"e2e-ait-56a8e437-openshift-default-6749b77676-w6w5g\" (UID: \"afc3b114-6220-4a7d-a371-f16958f4a1d4\") " pod="openshift-ingress/e2e-ait-56a8e437-openshift-default-6749b77676-w6w5g" Jun 08 14:20:25.231122 ip-10-0-140-46 kubenswrapper[2576]: I0608 14:20:25.231101 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/afc3b114-6220-4a7d-a371-f16958f4a1d4-istio-podinfo\") pod \"e2e-ait-56a8e437-openshift-default-6749b77676-w6w5g\" (UID: \"afc3b114-6220-4a7d-a371-f16958f4a1d4\") " pod="openshift-ingress/e2e-ait-56a8e437-openshift-default-6749b77676-w6w5g" Jun 08 14:20:25.241748 ip-10-0-140-46 kubenswrapper[2576]: I0608 14:20:25.241719 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/afc3b114-6220-4a7d-a371-f16958f4a1d4-istio-token\") pod \"e2e-ait-56a8e437-openshift-default-6749b77676-w6w5g\" (UID: \"afc3b114-6220-4a7d-a371-f16958f4a1d4\") " pod="openshift-ingress/e2e-ait-56a8e437-openshift-default-6749b77676-w6w5g" Jun 08 14:20:25.242414 ip-10-0-140-46 kubenswrapper[2576]: I0608 14:20:25.242395 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-jzcdf\" (UniqueName: \"kubernetes.io/projected/afc3b114-6220-4a7d-a371-f16958f4a1d4-kube-api-access-jzcdf\") pod \"e2e-ait-56a8e437-openshift-default-6749b77676-w6w5g\" (UID: \"afc3b114-6220-4a7d-a371-f16958f4a1d4\") " pod="openshift-ingress/e2e-ait-56a8e437-openshift-default-6749b77676-w6w5g" Jun 08 14:20:25.311403 ip-10-0-140-46 kubenswrapper[2576]: I0608 14:20:25.311300 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cx7sn_6e4b50fc-3e91-4f50-b92a-e90919788248/konnectivity-agent/0.log" limit=1024 Jun 08 14:20:25.360224 ip-10-0-140-46 kubenswrapper[2576]: I0608 14:20:25.360189 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-56a8e437-openshift-default-6749b77676-w6w5g" Jun 08 14:20:25.506871 ip-10-0-140-46 kubenswrapper[2576]: I0608 14:20:25.506807 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-ait-56a8e437-openshift-default-6749b77676-w6w5g"] Jun 08 14:20:25.509189 ip-10-0-140-46 kubenswrapper[2576]: W0608 14:20:25.509146 2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podafc3b114_6220_4a7d_a371_f16958f4a1d4.slice/crio-34d09de14aadffd441029a8c5a885cea9aafea0ddc0624c48a85c53d14138f99 WatchSource:0}: Error finding container 34d09de14aadffd441029a8c5a885cea9aafea0ddc0624c48a85c53d14138f99: Status 404 returned error can't find the container with id 34d09de14aadffd441029a8c5a885cea9aafea0ddc0624c48a85c53d14138f99 Jun 08 14:20:25.511216 ip-10-0-140-46 kubenswrapper[2576]: I0608 14:20:25.511182 2576 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"} Jun 08 14:20:25.511283 ip-10-0-140-46 kubenswrapper[2576]: I0608 14:20:25.511250 2576 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"} Jun 08 14:20:25.511283 ip-10-0-140-46 kubenswrapper[2576]: I0608 14:20:25.511276 2576 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"} Jun 08 14:20:26.331264 ip-10-0-140-46 kubenswrapper[2576]: I0608 14:20:26.331227 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-56a8e437-openshift-default-6749b77676-w6w5g" event={"ID":"afc3b114-6220-4a7d-a371-f16958f4a1d4","Type":"ContainerStarted","Data":"c4f4d2caa9e1917a8ee5f85bac05349f50613a60ab168b845a30012c0d85c8e4"} Jun 08 14:20:26.331680 ip-10-0-140-46 kubenswrapper[2576]: I0608 14:20:26.331308 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-56a8e437-openshift-default-6749b77676-w6w5g" event={"ID":"afc3b114-6220-4a7d-a371-f16958f4a1d4","Type":"ContainerStarted","Data":"34d09de14aadffd441029a8c5a885cea9aafea0ddc0624c48a85c53d14138f99"} Jun 08 14:20:26.360401 ip-10-0-140-46 kubenswrapper[2576]: I0608 14:20:26.360367 2576 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-ait-56a8e437-openshift-default-6749b77676-w6w5g" Jun 08 14:20:26.362207 ip-10-0-140-46 kubenswrapper[2576]: I0608 14:20:26.362163 2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-ait-56a8e437-openshift-default-6749b77676-w6w5g" podStartSLOduration=2.362147676 podStartE2EDuration="2.362147676s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-08 14:20:24 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-08 14:20:26.360209026 +0000 UTC m=+2194.439537917" watchObservedRunningTime="2026-06-08 14:20:26.362147676 +0000 UTC m=+2194.441476570" Jun 08 14:20:26.365151 ip-10-0-140-46 kubenswrapper[2576]: I0608 14:20:26.365127 2576 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-ait-56a8e437-openshift-default-6749b77676-w6w5g" Jun 08 14:20:27.337276 ip-10-0-140-46 kubenswrapper[2576]: I0608 14:20:27.337247 2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-ait-56a8e437-openshift-default-6749b77676-w6w5g" Jun 08 14:20:27.338285 ip-10-0-140-46 kubenswrapper[2576]: I0608 14:20:27.338266 2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-ait-56a8e437-openshift-default-6749b77676-w6w5g" Jun 08 14:20:28.723830 ip-10-0-140-46 kubenswrapper[2576]: I0608 14:20:28.723791 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cx7sn_6e4b50fc-3e91-4f50-b92a-e90919788248/konnectivity-agent/0.log" limit=1024 Jun 08 14:20:31.334594 ip-10-0-140-46 kubenswrapper[2576]: I0608 14:20:31.334538 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cx7sn_6e4b50fc-3e91-4f50-b92a-e90919788248/konnectivity-agent/0.log" limit=1024 Jun 08 14:20:32.476205 ip-10-0-140-46 kubenswrapper[2576]: I0608 14:20:32.476167 2576 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-ait-56a8e437-openshift-default-6749b77676-w6w5g"] Jun 08 14:20:32.476647 ip-10-0-140-46 kubenswrapper[2576]: I0608 14:20:32.476369 2576 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-ingress/e2e-ait-56a8e437-openshift-default-6749b77676-w6w5g" podUID="afc3b114-6220-4a7d-a371-f16958f4a1d4" containerName="istio-proxy" containerID="cri-o://c4f4d2caa9e1917a8ee5f85bac05349f50613a60ab168b845a30012c0d85c8e4" gracePeriod=30 Jun 08 14:20:32.505954 ip-10-0-140-46 kubenswrapper[2576]: I0608 14:20:32.505904 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cx7sn_6e4b50fc-3e91-4f50-b92a-e90919788248/konnectivity-agent/0.log" limit=1024 Jun 08 14:20:32.626988 ip-10-0-140-46 kubenswrapper[2576]: I0608 14:20:32.626946 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cx7sn_6e4b50fc-3e91-4f50-b92a-e90919788248/konnectivity-agent/0.log" limit=1024 Jun 08 14:20:35.950669 ip-10-0-140-46 kubenswrapper[2576]: I0608 14:20:35.950637 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cx7sn_6e4b50fc-3e91-4f50-b92a-e90919788248/konnectivity-agent/0.log" limit=1024 Jun 08 14:20:37.725394 ip-10-0-140-46 kubenswrapper[2576]: I0608 14:20:37.725367 2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-56a8e437-openshift-default-6749b77676-w6w5g" Jun 08 14:20:37.850280 ip-10-0-140-46 kubenswrapper[2576]: I0608 14:20:37.850238 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/afc3b114-6220-4a7d-a371-f16958f4a1d4-workload-socket\") pod \"afc3b114-6220-4a7d-a371-f16958f4a1d4\" (UID: \"afc3b114-6220-4a7d-a371-f16958f4a1d4\") " Jun 08 14:20:37.850280 ip-10-0-140-46 kubenswrapper[2576]: I0608 14:20:37.850282 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/afc3b114-6220-4a7d-a371-f16958f4a1d4-istio-podinfo\") pod \"afc3b114-6220-4a7d-a371-f16958f4a1d4\" (UID: \"afc3b114-6220-4a7d-a371-f16958f4a1d4\") " Jun 08 14:20:37.850527 ip-10-0-140-46 kubenswrapper[2576]: I0608 14:20:37.850298 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/afc3b114-6220-4a7d-a371-f16958f4a1d4-workload-certs\") pod \"afc3b114-6220-4a7d-a371-f16958f4a1d4\" (UID: \"afc3b114-6220-4a7d-a371-f16958f4a1d4\") " Jun 08 14:20:37.850527 ip-10-0-140-46 kubenswrapper[2576]: I0608 14:20:37.850349 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/afc3b114-6220-4a7d-a371-f16958f4a1d4-istiod-ca-cert\") pod \"afc3b114-6220-4a7d-a371-f16958f4a1d4\" (UID: \"afc3b114-6220-4a7d-a371-f16958f4a1d4\") " Jun 08 14:20:37.850527 ip-10-0-140-46 kubenswrapper[2576]: I0608 14:20:37.850379 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/afc3b114-6220-4a7d-a371-f16958f4a1d4-istio-data\") pod \"afc3b114-6220-4a7d-a371-f16958f4a1d4\" (UID: \"afc3b114-6220-4a7d-a371-f16958f4a1d4\") " Jun 08 14:20:37.850527 ip-10-0-140-46 kubenswrapper[2576]: I0608 14:20:37.850408 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-jzcdf\" (UniqueName: \"kubernetes.io/projected/afc3b114-6220-4a7d-a371-f16958f4a1d4-kube-api-access-jzcdf\") pod \"afc3b114-6220-4a7d-a371-f16958f4a1d4\" (UID: \"afc3b114-6220-4a7d-a371-f16958f4a1d4\") " Jun 08 14:20:37.850527 ip-10-0-140-46 kubenswrapper[2576]: I0608 14:20:37.850444 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/afc3b114-6220-4a7d-a371-f16958f4a1d4-istio-envoy\") pod \"afc3b114-6220-4a7d-a371-f16958f4a1d4\" (UID: \"afc3b114-6220-4a7d-a371-f16958f4a1d4\") " Jun 08 14:20:37.850527 ip-10-0-140-46 kubenswrapper[2576]: I0608 14:20:37.850491 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/afc3b114-6220-4a7d-a371-f16958f4a1d4-istio-token\") pod \"afc3b114-6220-4a7d-a371-f16958f4a1d4\" (UID: \"afc3b114-6220-4a7d-a371-f16958f4a1d4\") " Jun 08 14:20:37.850527 ip-10-0-140-46 kubenswrapper[2576]: I0608 14:20:37.850525 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/afc3b114-6220-4a7d-a371-f16958f4a1d4-credential-socket\") pod \"afc3b114-6220-4a7d-a371-f16958f4a1d4\" (UID: \"afc3b114-6220-4a7d-a371-f16958f4a1d4\") " Jun 08 14:20:37.851013 ip-10-0-140-46 kubenswrapper[2576]: I0608 14:20:37.850668 2576 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/afc3b114-6220-4a7d-a371-f16958f4a1d4-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "afc3b114-6220-4a7d-a371-f16958f4a1d4" (UID: "afc3b114-6220-4a7d-a371-f16958f4a1d4"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 08 14:20:37.851013 ip-10-0-140-46 kubenswrapper[2576]: I0608 14:20:37.850686 2576 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/afc3b114-6220-4a7d-a371-f16958f4a1d4-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "afc3b114-6220-4a7d-a371-f16958f4a1d4" (UID: "afc3b114-6220-4a7d-a371-f16958f4a1d4"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 08 14:20:37.851013 ip-10-0-140-46 kubenswrapper[2576]: I0608 14:20:37.850770 2576 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/afc3b114-6220-4a7d-a371-f16958f4a1d4-istio-data" (OuterVolumeSpecName: "istio-data") pod "afc3b114-6220-4a7d-a371-f16958f4a1d4" (UID: "afc3b114-6220-4a7d-a371-f16958f4a1d4"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 08 14:20:37.851013 ip-10-0-140-46 kubenswrapper[2576]: I0608 14:20:37.850794 2576 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/afc3b114-6220-4a7d-a371-f16958f4a1d4-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "afc3b114-6220-4a7d-a371-f16958f4a1d4" (UID: "afc3b114-6220-4a7d-a371-f16958f4a1d4"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 08 14:20:37.851013 ip-10-0-140-46 kubenswrapper[2576]: I0608 14:20:37.850927 2576 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/afc3b114-6220-4a7d-a371-f16958f4a1d4-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "afc3b114-6220-4a7d-a371-f16958f4a1d4" (UID: "afc3b114-6220-4a7d-a371-f16958f4a1d4"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 08 14:20:37.851270 ip-10-0-140-46 kubenswrapper[2576]: I0608 14:20:37.851054 2576 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/afc3b114-6220-4a7d-a371-f16958f4a1d4-istiod-ca-cert\") on node \"ip-10-0-140-46.ec2.internal\" DevicePath \"\"" Jun 08 14:20:37.851270 ip-10-0-140-46 kubenswrapper[2576]: I0608 14:20:37.851073 2576 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/afc3b114-6220-4a7d-a371-f16958f4a1d4-istio-data\") on node \"ip-10-0-140-46.ec2.internal\" DevicePath \"\"" Jun 08 14:20:37.851270 ip-10-0-140-46 kubenswrapper[2576]: I0608 14:20:37.851086 2576 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/afc3b114-6220-4a7d-a371-f16958f4a1d4-credential-socket\") on node \"ip-10-0-140-46.ec2.internal\" DevicePath \"\"" Jun 08 14:20:37.851270 ip-10-0-140-46 kubenswrapper[2576]: I0608 14:20:37.851100 2576 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/afc3b114-6220-4a7d-a371-f16958f4a1d4-workload-socket\") on node \"ip-10-0-140-46.ec2.internal\" DevicePath \"\"" Jun 08 14:20:37.851270 ip-10-0-140-46 kubenswrapper[2576]: I0608 14:20:37.851115 2576 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/afc3b114-6220-4a7d-a371-f16958f4a1d4-workload-certs\") on node \"ip-10-0-140-46.ec2.internal\" DevicePath \"\"" Jun 08 14:20:37.852813 ip-10-0-140-46 kubenswrapper[2576]: I0608 14:20:37.852778 2576 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/afc3b114-6220-4a7d-a371-f16958f4a1d4-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "afc3b114-6220-4a7d-a371-f16958f4a1d4" (UID: "afc3b114-6220-4a7d-a371-f16958f4a1d4"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 08 14:20:37.852813 ip-10-0-140-46 kubenswrapper[2576]: I0608 14:20:37.852786 2576 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/afc3b114-6220-4a7d-a371-f16958f4a1d4-istio-token" (OuterVolumeSpecName: "istio-token") pod "afc3b114-6220-4a7d-a371-f16958f4a1d4" (UID: "afc3b114-6220-4a7d-a371-f16958f4a1d4"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 08 14:20:37.852954 ip-10-0-140-46 kubenswrapper[2576]: I0608 14:20:37.852862 2576 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/afc3b114-6220-4a7d-a371-f16958f4a1d4-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "afc3b114-6220-4a7d-a371-f16958f4a1d4" (UID: "afc3b114-6220-4a7d-a371-f16958f4a1d4"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue "" Jun 08 14:20:37.852954 ip-10-0-140-46 kubenswrapper[2576]: I0608 14:20:37.852862 2576 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/afc3b114-6220-4a7d-a371-f16958f4a1d4-kube-api-access-jzcdf" (OuterVolumeSpecName: "kube-api-access-jzcdf") pod "afc3b114-6220-4a7d-a371-f16958f4a1d4" (UID: "afc3b114-6220-4a7d-a371-f16958f4a1d4"). InnerVolumeSpecName "kube-api-access-jzcdf". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 08 14:20:37.952207 ip-10-0-140-46 kubenswrapper[2576]: I0608 14:20:37.952161 2576 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/afc3b114-6220-4a7d-a371-f16958f4a1d4-istio-podinfo\") on node \"ip-10-0-140-46.ec2.internal\" DevicePath \"\"" Jun 08 14:20:37.952207 ip-10-0-140-46 kubenswrapper[2576]: I0608 14:20:37.952200 2576 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-jzcdf\" (UniqueName: \"kubernetes.io/projected/afc3b114-6220-4a7d-a371-f16958f4a1d4-kube-api-access-jzcdf\") on node \"ip-10-0-140-46.ec2.internal\" DevicePath \"\"" Jun 08 14:20:37.952207 ip-10-0-140-46 kubenswrapper[2576]: I0608 14:20:37.952216 2576 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/afc3b114-6220-4a7d-a371-f16958f4a1d4-istio-envoy\") on node \"ip-10-0-140-46.ec2.internal\" DevicePath \"\"" Jun 08 14:20:37.952455 ip-10-0-140-46 kubenswrapper[2576]: I0608 14:20:37.952228 2576 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/afc3b114-6220-4a7d-a371-f16958f4a1d4-istio-token\") on node \"ip-10-0-140-46.ec2.internal\" DevicePath \"\"" Jun 08 14:20:38.400640 ip-10-0-140-46 kubenswrapper[2576]: I0608 14:20:38.400604 2576 generic.go:356] "Generic (PLEG): container finished" podID="afc3b114-6220-4a7d-a371-f16958f4a1d4" containerID="c4f4d2caa9e1917a8ee5f85bac05349f50613a60ab168b845a30012c0d85c8e4" exitCode=0 Jun 08 14:20:38.400817 ip-10-0-140-46 kubenswrapper[2576]: I0608 14:20:38.400645 2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-56a8e437-openshift-default-6749b77676-w6w5g" Jun 08 14:20:38.400817 ip-10-0-140-46 kubenswrapper[2576]: I0608 14:20:38.400666 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-56a8e437-openshift-default-6749b77676-w6w5g" event={"ID":"afc3b114-6220-4a7d-a371-f16958f4a1d4","Type":"ContainerDied","Data":"c4f4d2caa9e1917a8ee5f85bac05349f50613a60ab168b845a30012c0d85c8e4"} Jun 08 14:20:38.400817 ip-10-0-140-46 kubenswrapper[2576]: I0608 14:20:38.400710 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-56a8e437-openshift-default-6749b77676-w6w5g" event={"ID":"afc3b114-6220-4a7d-a371-f16958f4a1d4","Type":"ContainerDied","Data":"34d09de14aadffd441029a8c5a885cea9aafea0ddc0624c48a85c53d14138f99"} Jun 08 14:20:38.400817 ip-10-0-140-46 kubenswrapper[2576]: I0608 14:20:38.400731 2576 scope.go:117] "RemoveContainer" containerID="c4f4d2caa9e1917a8ee5f85bac05349f50613a60ab168b845a30012c0d85c8e4" Jun 08 14:20:38.410123 ip-10-0-140-46 kubenswrapper[2576]: I0608 14:20:38.410095 2576 scope.go:117] "RemoveContainer" containerID="c4f4d2caa9e1917a8ee5f85bac05349f50613a60ab168b845a30012c0d85c8e4" Jun 08 14:20:38.410432 ip-10-0-140-46 kubenswrapper[2576]: E0608 14:20:38.410413 2576 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"c4f4d2caa9e1917a8ee5f85bac05349f50613a60ab168b845a30012c0d85c8e4\": container with ID starting with c4f4d2caa9e1917a8ee5f85bac05349f50613a60ab168b845a30012c0d85c8e4 not found: ID does not exist" containerID="c4f4d2caa9e1917a8ee5f85bac05349f50613a60ab168b845a30012c0d85c8e4" Jun 08 14:20:38.410489 ip-10-0-140-46 kubenswrapper[2576]: I0608 14:20:38.410443 2576 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"c4f4d2caa9e1917a8ee5f85bac05349f50613a60ab168b845a30012c0d85c8e4"} err="failed to get container status \"c4f4d2caa9e1917a8ee5f85bac05349f50613a60ab168b845a30012c0d85c8e4\": rpc error: code = NotFound desc = could not find container \"c4f4d2caa9e1917a8ee5f85bac05349f50613a60ab168b845a30012c0d85c8e4\": container with ID starting with c4f4d2caa9e1917a8ee5f85bac05349f50613a60ab168b845a30012c0d85c8e4 not found: ID does not exist" Jun 08 14:20:38.426638 ip-10-0-140-46 kubenswrapper[2576]: I0608 14:20:38.426613 2576 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-ait-56a8e437-openshift-default-6749b77676-w6w5g"] Jun 08 14:20:38.430108 ip-10-0-140-46 kubenswrapper[2576]: I0608 14:20:38.430086 2576 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-ait-56a8e437-openshift-default-6749b77676-w6w5g"] Jun 08 14:20:39.162826 ip-10-0-140-46 kubenswrapper[2576]: I0608 14:20:39.162794 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cx7sn_6e4b50fc-3e91-4f50-b92a-e90919788248/konnectivity-agent/0.log" limit=1024 Jun 08 14:20:39.268104 ip-10-0-140-46 kubenswrapper[2576]: I0608 14:20:39.268067 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cx7sn_6e4b50fc-3e91-4f50-b92a-e90919788248/konnectivity-agent/0.log" limit=1024 Jun 08 14:20:40.377618 ip-10-0-140-46 kubenswrapper[2576]: I0608 14:20:40.377578 2576 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="afc3b114-6220-4a7d-a371-f16958f4a1d4" path="/var/lib/kubelet/pods/afc3b114-6220-4a7d-a371-f16958f4a1d4/volumes" Jun 08 14:20:45.481537 ip-10-0-140-46 kubenswrapper[2576]: I0608 14:20:45.481497 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-6d5c5c5dc4-5tgr4_c416cc8e-81eb-49d2-ace9-886201b404f4/authorino/0.log" Jun 08 14:20:50.247136 ip-10-0-140-46 kubenswrapper[2576]: I0608 14:20:50.247106 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_dashboard-redirect-6d99dc5989-xs8bt_74e496ab-540e-4396-a177-f6da7a61d474/nginx/0.log" Jun 08 14:20:50.615864 ip-10-0-140-46 kubenswrapper[2576]: I0608 14:20:50.615835 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_maas-api-56548fc74f-xmtkh_8638dcd6-699c-4954-a071-7ba9e81f7cd2/maas-api/0.log" Jun 08 14:20:50.998896 ip-10-0-140-46 kubenswrapper[2576]: I0608 14:20:50.998804 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_maas-controller-b646647b6-jrdmt_eeaae028-d070-434e-b899-5364783d007c/manager/0.log" Jun 08 14:20:51.365281 ip-10-0-140-46 kubenswrapper[2576]: I0608 14:20:51.365249 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-7b8d697984-b2fn4_8d1dd660-213d-4c9b-92bf-1a4132f8b703/copy-manifests/0.log" Jun 08 14:20:51.378441 ip-10-0-140-46 kubenswrapper[2576]: I0608 14:20:51.378414 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-7b8d697984-b2fn4_8d1dd660-213d-4c9b-92bf-1a4132f8b703/manager/0.log" Jun 08 14:20:52.538257 ip-10-0-140-46 kubenswrapper[2576]: I0608 14:20:52.538229 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759s4f6m_d9ad6cd5-b3ee-455f-9bb2-81a89d9b1f50/extract/0.log" Jun 08 14:20:52.549027 ip-10-0-140-46 kubenswrapper[2576]: I0608 14:20:52.548998 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759s4f6m_d9ad6cd5-b3ee-455f-9bb2-81a89d9b1f50/util/0.log" Jun 08 14:20:52.561556 ip-10-0-140-46 kubenswrapper[2576]: I0608 14:20:52.561536 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759s4f6m_d9ad6cd5-b3ee-455f-9bb2-81a89d9b1f50/pull/0.log" Jun 08 14:20:52.674614 ip-10-0-140-46 kubenswrapper[2576]: I0608 14:20:52.674585 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0hbtqx_c7ca31ae-c177-4655-8c06-087fb8c5de99/pull/0.log" Jun 08 14:20:52.682405 ip-10-0-140-46 kubenswrapper[2576]: I0608 14:20:52.682376 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0hbtqx_c7ca31ae-c177-4655-8c06-087fb8c5de99/extract/0.log" Jun 08 14:20:52.692660 ip-10-0-140-46 kubenswrapper[2576]: I0608 14:20:52.692636 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0hbtqx_c7ca31ae-c177-4655-8c06-087fb8c5de99/util/0.log" Jun 08 14:20:52.808705 ip-10-0-140-46 kubenswrapper[2576]: I0608 14:20:52.808620 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed737rgss_9e845571-2c13-44bd-b1d0-85201e4bde63/util/0.log" Jun 08 14:20:52.820460 ip-10-0-140-46 kubenswrapper[2576]: I0608 14:20:52.820432 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed737rgss_9e845571-2c13-44bd-b1d0-85201e4bde63/pull/0.log" Jun 08 14:20:52.830680 ip-10-0-140-46 kubenswrapper[2576]: I0608 14:20:52.830644 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed737rgss_9e845571-2c13-44bd-b1d0-85201e4bde63/extract/0.log" Jun 08 14:20:52.945296 ip-10-0-140-46 kubenswrapper[2576]: I0608 14:20:52.945271 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1tn8bh_c437a6e3-d517-45f9-8d49-04d6db9e5b84/util/0.log" Jun 08 14:20:52.954937 ip-10-0-140-46 kubenswrapper[2576]: I0608 14:20:52.954911 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1tn8bh_c437a6e3-d517-45f9-8d49-04d6db9e5b84/pull/0.log" Jun 08 14:20:52.965821 ip-10-0-140-46 kubenswrapper[2576]: I0608 14:20:52.965799 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1tn8bh_c437a6e3-d517-45f9-8d49-04d6db9e5b84/extract/0.log" Jun 08 14:20:53.093437 ip-10-0-140-46 kubenswrapper[2576]: I0608 14:20:53.093348 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-6d5c5c5dc4-5tgr4_c416cc8e-81eb-49d2-ace9-886201b404f4/authorino/0.log" Jun 08 14:20:53.236714 ip-10-0-140-46 kubenswrapper[2576]: I0608 14:20:53.236680 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-operator-75cc8d5cb7-4prdd_64301943-c8c4-4945-8f60-c67186c76503/manager/0.log" Jun 08 14:20:53.472456 ip-10-0-140-46 kubenswrapper[2576]: I0608 14:20:53.472374 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-console-plugin-66b5774985-9klbs_173f795f-94e7-47e5-968a-c2d6fcf30bb1/kuadrant-console-plugin/0.log" Jun 08 14:20:53.594767 ip-10-0-140-46 kubenswrapper[2576]: I0608 14:20:53.594735 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-operator-catalog-dsfh9_064b68f2-2d20-4e42-ab86-ec679227eacc/registry-server/0.log" Jun 08 14:20:53.976071 ip-10-0-140-46 kubenswrapper[2576]: I0608 14:20:53.976035 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_limitador-operator-controller-manager-859d7b78bd-s7tmn_e9249408-a139-46eb-99c1-94e45fa47197/manager/0.log" Jun 08 14:20:54.324696 ip-10-0-140-46 kubenswrapper[2576]: I0608 14:20:54.324670 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_data-science-gateway-data-science-gateway-class-5b556588bc7dzbz_1f2c8d2c-21ff-4629-a7cc-9adec5629613/istio-proxy/0.log" Jun 08 14:20:54.912816 ip-10-0-140-46 kubenswrapper[2576]: I0608 14:20:54.912762 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-pre-processing-67d7689b65-jpbxk_71aba221-b0b4-443a-a981-4b8feb2a4986/payload-pre-processing/0.log" Jun 08 14:20:55.515216 ip-10-0-140-46 kubenswrapper[2576]: I0608 14:20:55.515186 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-distinct-2-simulated-kserve-f5c55bdc-cbtt6_ee3a2169-e786-43ad-93a6-0c7b2d065bf5/storage-initializer/0.log" Jun 08 14:20:55.527485 ip-10-0-140-46 kubenswrapper[2576]: I0608 14:20:55.527459 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-distinct-2-simulated-kserve-f5c55bdc-cbtt6_ee3a2169-e786-43ad-93a6-0c7b2d065bf5/main/0.log" Jun 08 14:20:55.770294 ip-10-0-140-46 kubenswrapper[2576]: I0608 14:20:55.770201 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-trlp-test-simulated-kserve-68bb6c58d9-rvps2_56e2e5c5-94dd-46fa-9ccf-d1a0e9fe43f6/storage-initializer/0.log" Jun 08 14:20:55.783075 ip-10-0-140-46 kubenswrapper[2576]: I0608 14:20:55.783043 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-trlp-test-simulated-kserve-68bb6c58d9-rvps2_56e2e5c5-94dd-46fa-9ccf-d1a0e9fe43f6/main/0.log" Jun 08 14:20:55.896056 ip-10-0-140-46 kubenswrapper[2576]: I0608 14:20:55.896018 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477cwtq6m_b4c23a29-21fd-4e06-a97d-5ea51c48d0b5/storage-initializer/0.log" Jun 08 14:20:55.915141 ip-10-0-140-46 kubenswrapper[2576]: I0608 14:20:55.915105 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477cwtq6m_b4c23a29-21fd-4e06-a97d-5ea51c48d0b5/main/0.log" Jun 08 14:20:59.861748 ip-10-0-140-46 kubenswrapper[2576]: I0608 14:20:59.861710 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cx7sn_6e4b50fc-3e91-4f50-b92a-e90919788248/konnectivity-agent/0.log" limit=1024 Jun 08 14:20:59.950041 ip-10-0-140-46 kubenswrapper[2576]: I0608 14:20:59.950000 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cx7sn_6e4b50fc-3e91-4f50-b92a-e90919788248/konnectivity-agent/0.log" limit=1024 Jun 08 14:21:03.341613 ip-10-0-140-46 kubenswrapper[2576]: I0608 14:21:03.341579 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_global-pull-secret-syncer-dm2n6_6da5a732-b003-412c-8308-e80cead7eb1c/global-pull-secret-syncer/0.log" Jun 08 14:21:03.459783 ip-10-0-140-46 kubenswrapper[2576]: I0608 14:21:03.459746 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_konnectivity-agent-cx7sn_6e4b50fc-3e91-4f50-b92a-e90919788248/konnectivity-agent/0.log" Jun 08 14:21:03.594864 ip-10-0-140-46 kubenswrapper[2576]: I0608 14:21:03.594785 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_kube-apiserver-proxy-ip-10-0-140-46.ec2.internal_9611281d5444879f19610790e9303c49/haproxy/0.log" Jun 08 14:21:07.873440 ip-10-0-140-46 kubenswrapper[2576]: I0608 14:21:07.873349 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759s4f6m_d9ad6cd5-b3ee-455f-9bb2-81a89d9b1f50/extract/0.log" Jun 08 14:21:07.908702 ip-10-0-140-46 kubenswrapper[2576]: I0608 14:21:07.908665 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759s4f6m_d9ad6cd5-b3ee-455f-9bb2-81a89d9b1f50/util/0.log" Jun 08 14:21:07.932259 ip-10-0-140-46 kubenswrapper[2576]: I0608 14:21:07.932227 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759s4f6m_d9ad6cd5-b3ee-455f-9bb2-81a89d9b1f50/pull/0.log" Jun 08 14:21:07.962442 ip-10-0-140-46 kubenswrapper[2576]: I0608 14:21:07.962414 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0hbtqx_c7ca31ae-c177-4655-8c06-087fb8c5de99/extract/0.log" Jun 08 14:21:07.985178 ip-10-0-140-46 kubenswrapper[2576]: I0608 14:21:07.985146 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0hbtqx_c7ca31ae-c177-4655-8c06-087fb8c5de99/util/0.log" Jun 08 14:21:08.012273 ip-10-0-140-46 kubenswrapper[2576]: I0608 14:21:08.012247 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0hbtqx_c7ca31ae-c177-4655-8c06-087fb8c5de99/pull/0.log" Jun 08 14:21:08.040934 ip-10-0-140-46 kubenswrapper[2576]: I0608 14:21:08.040908 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed737rgss_9e845571-2c13-44bd-b1d0-85201e4bde63/extract/0.log" Jun 08 14:21:08.072176 ip-10-0-140-46 kubenswrapper[2576]: I0608 14:21:08.072152 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed737rgss_9e845571-2c13-44bd-b1d0-85201e4bde63/util/0.log" Jun 08 14:21:08.096884 ip-10-0-140-46 kubenswrapper[2576]: I0608 14:21:08.096858 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed737rgss_9e845571-2c13-44bd-b1d0-85201e4bde63/pull/0.log" Jun 08 14:21:08.130144 ip-10-0-140-46 kubenswrapper[2576]: I0608 14:21:08.130054 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1tn8bh_c437a6e3-d517-45f9-8d49-04d6db9e5b84/extract/0.log" Jun 08 14:21:08.154303 ip-10-0-140-46 kubenswrapper[2576]: I0608 14:21:08.154268 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1tn8bh_c437a6e3-d517-45f9-8d49-04d6db9e5b84/util/0.log" Jun 08 14:21:08.184412 ip-10-0-140-46 kubenswrapper[2576]: I0608 14:21:08.184381 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1tn8bh_c437a6e3-d517-45f9-8d49-04d6db9e5b84/pull/0.log" Jun 08 14:21:08.478723 ip-10-0-140-46 kubenswrapper[2576]: I0608 14:21:08.478641 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-6d5c5c5dc4-5tgr4_c416cc8e-81eb-49d2-ace9-886201b404f4/authorino/0.log" Jun 08 14:21:08.536449 ip-10-0-140-46 kubenswrapper[2576]: I0608 14:21:08.536417 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-operator-75cc8d5cb7-4prdd_64301943-c8c4-4945-8f60-c67186c76503/manager/0.log" Jun 08 14:21:08.597048 ip-10-0-140-46 kubenswrapper[2576]: I0608 14:21:08.597021 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-console-plugin-66b5774985-9klbs_173f795f-94e7-47e5-968a-c2d6fcf30bb1/kuadrant-console-plugin/0.log" Jun 08 14:21:08.648592 ip-10-0-140-46 kubenswrapper[2576]: I0608 14:21:08.648548 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-operator-catalog-dsfh9_064b68f2-2d20-4e42-ab86-ec679227eacc/registry-server/0.log" Jun 08 14:21:08.861846 ip-10-0-140-46 kubenswrapper[2576]: I0608 14:21:08.861814 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_limitador-operator-controller-manager-859d7b78bd-s7tmn_e9249408-a139-46eb-99c1-94e45fa47197/manager/0.log" Jun 08 14:21:11.127281 ip-10-0-140-46 kubenswrapper[2576]: I0608 14:21:11.127150 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-j6qbt_a5205237-e40b-4ebb-a5cd-89665b872b74/node-exporter/0.log" Jun 08 14:21:11.158356 ip-10-0-140-46 kubenswrapper[2576]: I0608 14:21:11.158320 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-j6qbt_a5205237-e40b-4ebb-a5cd-89665b872b74/kube-rbac-proxy/0.log" Jun 08 14:21:11.188600 ip-10-0-140-46 kubenswrapper[2576]: I0608 14:21:11.188536 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-j6qbt_a5205237-e40b-4ebb-a5cd-89665b872b74/init-textfile/0.log" Jun 08 14:21:11.796231 ip-10-0-140-46 kubenswrapper[2576]: I0608 14:21:11.796202 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-operator-admission-webhook-5b6b8f594-bq2f6_10989532-bce1-496d-90c3-98c578e1effa/prometheus-operator-admission-webhook/0.log" Jun 08 14:21:13.279174 ip-10-0-140-46 kubenswrapper[2576]: I0608 14:21:13.279141 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-network-console_networking-console-plugin-d5d5bb78b-7g8ft_6cf15e88-7b22-4dc1-9a9e-1dc73867afa3/networking-console-plugin/0.log" Jun 08 14:21:14.637552 ip-10-0-140-46 kubenswrapper[2576]: I0608 14:21:14.637516 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console_console-77b74bd885-sbktd_37c08b1e-6524-4cf5-a776-f0625505ebf5/console/0.log" Jun 08 14:21:14.680580 ip-10-0-140-46 kubenswrapper[2576]: I0608 14:21:14.680532 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console_downloads-6657875f97-wxvf5_bde2853a-ccff-4f0e-88d2-0abaa5040401/download-server/0.log" Jun 08 14:21:15.162145 ip-10-0-140-46 kubenswrapper[2576]: I0608 14:21:15.162113 2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-must-gather-8mlgz/perf-node-gather-daemonset-m4sth"] Jun 08 14:21:15.162500 ip-10-0-140-46 kubenswrapper[2576]: I0608 14:21:15.162487 2576 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="afc3b114-6220-4a7d-a371-f16958f4a1d4" containerName="istio-proxy" Jun 08 14:21:15.162584 ip-10-0-140-46 kubenswrapper[2576]: I0608 14:21:15.162502 2576 state_mem.go:107] "Deleted CPUSet assignment" podUID="afc3b114-6220-4a7d-a371-f16958f4a1d4" containerName="istio-proxy" Jun 08 14:21:15.162584 ip-10-0-140-46 kubenswrapper[2576]: I0608 14:21:15.162559 2576 memory_manager.go:368] "RemoveStaleState removing state" podUID="afc3b114-6220-4a7d-a371-f16958f4a1d4" containerName="istio-proxy" Jun 08 14:21:15.166682 ip-10-0-140-46 kubenswrapper[2576]: I0608 14:21:15.166660 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-8mlgz/perf-node-gather-daemonset-m4sth" Jun 08 14:21:15.169536 ip-10-0-140-46 kubenswrapper[2576]: I0608 14:21:15.169510 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-8mlgz\"/\"kube-root-ca.crt\"" Jun 08 14:21:15.169676 ip-10-0-140-46 kubenswrapper[2576]: I0608 14:21:15.169620 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-must-gather-8mlgz\"/\"default-dockercfg-wnb8t\"" Jun 08 14:21:15.170459 ip-10-0-140-46 kubenswrapper[2576]: I0608 14:21:15.170435 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-8mlgz\"/\"openshift-service-ca.crt\"" Jun 08 14:21:15.177910 ip-10-0-140-46 kubenswrapper[2576]: I0608 14:21:15.177890 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-8mlgz/perf-node-gather-daemonset-m4sth"] Jun 08 14:21:15.284852 ip-10-0-140-46 kubenswrapper[2576]: I0608 14:21:15.284813 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/f778b191-a2fd-4921-8963-821bb887928b-sys\") pod \"perf-node-gather-daemonset-m4sth\" (UID: \"f778b191-a2fd-4921-8963-821bb887928b\") " pod="openshift-must-gather-8mlgz/perf-node-gather-daemonset-m4sth" Jun 08 14:21:15.284852 ip-10-0-140-46 kubenswrapper[2576]: I0608 14:21:15.284855 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/f778b191-a2fd-4921-8963-821bb887928b-proc\") pod \"perf-node-gather-daemonset-m4sth\" (UID: \"f778b191-a2fd-4921-8963-821bb887928b\") " pod="openshift-must-gather-8mlgz/perf-node-gather-daemonset-m4sth" Jun 08 14:21:15.285085 ip-10-0-140-46 kubenswrapper[2576]: I0608 14:21:15.284915 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/f778b191-a2fd-4921-8963-821bb887928b-lib-modules\") pod \"perf-node-gather-daemonset-m4sth\" (UID: \"f778b191-a2fd-4921-8963-821bb887928b\") " pod="openshift-must-gather-8mlgz/perf-node-gather-daemonset-m4sth" Jun 08 14:21:15.285085 ip-10-0-140-46 kubenswrapper[2576]: I0608 14:21:15.284948 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/f778b191-a2fd-4921-8963-821bb887928b-podres\") pod \"perf-node-gather-daemonset-m4sth\" (UID: \"f778b191-a2fd-4921-8963-821bb887928b\") " pod="openshift-must-gather-8mlgz/perf-node-gather-daemonset-m4sth" Jun 08 14:21:15.285085 ip-10-0-140-46 kubenswrapper[2576]: I0608 14:21:15.284977 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4vmqj\" (UniqueName: \"kubernetes.io/projected/f778b191-a2fd-4921-8963-821bb887928b-kube-api-access-4vmqj\") pod \"perf-node-gather-daemonset-m4sth\" (UID: \"f778b191-a2fd-4921-8963-821bb887928b\") " pod="openshift-must-gather-8mlgz/perf-node-gather-daemonset-m4sth" Jun 08 14:21:15.386245 ip-10-0-140-46 kubenswrapper[2576]: I0608 14:21:15.386209 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4vmqj\" (UniqueName: \"kubernetes.io/projected/f778b191-a2fd-4921-8963-821bb887928b-kube-api-access-4vmqj\") pod \"perf-node-gather-daemonset-m4sth\" (UID: \"f778b191-a2fd-4921-8963-821bb887928b\") " pod="openshift-must-gather-8mlgz/perf-node-gather-daemonset-m4sth" Jun 08 14:21:15.386408 ip-10-0-140-46 kubenswrapper[2576]: I0608 14:21:15.386273 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/f778b191-a2fd-4921-8963-821bb887928b-sys\") pod \"perf-node-gather-daemonset-m4sth\" (UID: \"f778b191-a2fd-4921-8963-821bb887928b\") " pod="openshift-must-gather-8mlgz/perf-node-gather-daemonset-m4sth" Jun 08 14:21:15.386408 ip-10-0-140-46 kubenswrapper[2576]: I0608 14:21:15.386295 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/f778b191-a2fd-4921-8963-821bb887928b-proc\") pod \"perf-node-gather-daemonset-m4sth\" (UID: \"f778b191-a2fd-4921-8963-821bb887928b\") " pod="openshift-must-gather-8mlgz/perf-node-gather-daemonset-m4sth" Jun 08 14:21:15.386408 ip-10-0-140-46 kubenswrapper[2576]: I0608 14:21:15.386331 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/f778b191-a2fd-4921-8963-821bb887928b-lib-modules\") pod \"perf-node-gather-daemonset-m4sth\" (UID: \"f778b191-a2fd-4921-8963-821bb887928b\") " pod="openshift-must-gather-8mlgz/perf-node-gather-daemonset-m4sth" Jun 08 14:21:15.386408 ip-10-0-140-46 kubenswrapper[2576]: I0608 14:21:15.386350 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/f778b191-a2fd-4921-8963-821bb887928b-podres\") pod \"perf-node-gather-daemonset-m4sth\" (UID: \"f778b191-a2fd-4921-8963-821bb887928b\") " pod="openshift-must-gather-8mlgz/perf-node-gather-daemonset-m4sth" Jun 08 14:21:15.386408 ip-10-0-140-46 kubenswrapper[2576]: I0608 14:21:15.386354 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/f778b191-a2fd-4921-8963-821bb887928b-sys\") pod \"perf-node-gather-daemonset-m4sth\" (UID: \"f778b191-a2fd-4921-8963-821bb887928b\") " pod="openshift-must-gather-8mlgz/perf-node-gather-daemonset-m4sth" Jun 08 14:21:15.386667 ip-10-0-140-46 kubenswrapper[2576]: I0608 14:21:15.386423 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/f778b191-a2fd-4921-8963-821bb887928b-proc\") pod \"perf-node-gather-daemonset-m4sth\" (UID: \"f778b191-a2fd-4921-8963-821bb887928b\") " pod="openshift-must-gather-8mlgz/perf-node-gather-daemonset-m4sth" Jun 08 14:21:15.386667 ip-10-0-140-46 kubenswrapper[2576]: I0608 14:21:15.386493 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/f778b191-a2fd-4921-8963-821bb887928b-podres\") pod \"perf-node-gather-daemonset-m4sth\" (UID: \"f778b191-a2fd-4921-8963-821bb887928b\") " pod="openshift-must-gather-8mlgz/perf-node-gather-daemonset-m4sth" Jun 08 14:21:15.386667 ip-10-0-140-46 kubenswrapper[2576]: I0608 14:21:15.386493 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/f778b191-a2fd-4921-8963-821bb887928b-lib-modules\") pod \"perf-node-gather-daemonset-m4sth\" (UID: \"f778b191-a2fd-4921-8963-821bb887928b\") " pod="openshift-must-gather-8mlgz/perf-node-gather-daemonset-m4sth" Jun 08 14:21:15.395859 ip-10-0-140-46 kubenswrapper[2576]: I0608 14:21:15.395834 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-4vmqj\" (UniqueName: \"kubernetes.io/projected/f778b191-a2fd-4921-8963-821bb887928b-kube-api-access-4vmqj\") pod \"perf-node-gather-daemonset-m4sth\" (UID: \"f778b191-a2fd-4921-8963-821bb887928b\") " pod="openshift-must-gather-8mlgz/perf-node-gather-daemonset-m4sth" Jun 08 14:21:15.477766 ip-10-0-140-46 kubenswrapper[2576]: I0608 14:21:15.477669 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-8mlgz/perf-node-gather-daemonset-m4sth" Jun 08 14:21:15.631870 ip-10-0-140-46 kubenswrapper[2576]: I0608 14:21:15.631844 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-8mlgz/perf-node-gather-daemonset-m4sth"] Jun 08 14:21:15.634163 ip-10-0-140-46 kubenswrapper[2576]: W0608 14:21:15.634130 2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-podf778b191_a2fd_4921_8963_821bb887928b.slice/crio-a6a8af70d6f89f91828ffd9ac6efebe60262e78ee34865293d8ca5f89617b00b WatchSource:0}: Error finding container a6a8af70d6f89f91828ffd9ac6efebe60262e78ee34865293d8ca5f89617b00b: Status 404 returned error can't find the container with id a6a8af70d6f89f91828ffd9ac6efebe60262e78ee34865293d8ca5f89617b00b Jun 08 14:21:16.623006 ip-10-0-140-46 kubenswrapper[2576]: I0608 14:21:16.622973 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-8mlgz/perf-node-gather-daemonset-m4sth" event={"ID":"f778b191-a2fd-4921-8963-821bb887928b","Type":"ContainerStarted","Data":"795bcfd48a8c23140c384da8320b73d5498855c23fb7860614730b6d45541ccd"} Jun 08 14:21:16.623458 ip-10-0-140-46 kubenswrapper[2576]: I0608 14:21:16.623023 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-8mlgz/perf-node-gather-daemonset-m4sth" event={"ID":"f778b191-a2fd-4921-8963-821bb887928b","Type":"ContainerStarted","Data":"a6a8af70d6f89f91828ffd9ac6efebe60262e78ee34865293d8ca5f89617b00b"} Jun 08 14:21:16.623458 ip-10-0-140-46 kubenswrapper[2576]: I0608 14:21:16.623121 2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-must-gather-8mlgz/perf-node-gather-daemonset-m4sth" Jun 08 14:21:16.645276 ip-10-0-140-46 kubenswrapper[2576]: I0608 14:21:16.645215 2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-must-gather-8mlgz/perf-node-gather-daemonset-m4sth" podStartSLOduration=1.645200393 podStartE2EDuration="1.645200393s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-08 14:21:15 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-08 14:21:16.644118956 +0000 UTC m=+2244.723447848" watchObservedRunningTime="2026-06-08 14:21:16.645200393 +0000 UTC m=+2244.724529284" Jun 08 14:21:16.929561 ip-10-0-140-46 kubenswrapper[2576]: I0608 14:21:16.929481 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-l52bl_2ef5209f-d5f5-4fae-a86c-1bb23283f29a/dns/0.log" Jun 08 14:21:16.976383 ip-10-0-140-46 kubenswrapper[2576]: I0608 14:21:16.976341 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-l52bl_2ef5209f-d5f5-4fae-a86c-1bb23283f29a/kube-rbac-proxy/0.log" Jun 08 14:21:17.066659 ip-10-0-140-46 kubenswrapper[2576]: I0608 14:21:17.066633 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-f25db_2cf3d8d4-e8f9-402e-9fa7-b564c4ea705c/dns-node-resolver/0.log" Jun 08 14:21:17.862385 ip-10-0-140-46 kubenswrapper[2576]: I0608 14:21:17.862352 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_image-registry-6869cf9d57-q968v_ee2d069f-ad9b-4a11-8df6-3f4af3345b4d/registry/0.log" Jun 08 14:21:17.895425 ip-10-0-140-46 kubenswrapper[2576]: I0608 14:21:17.895376 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-gcmjl_8e1453fa-6b1d-4b93-98cf-5fe4d2829935/node-ca/0.log" Jun 08 14:21:19.029656 ip-10-0-140-46 kubenswrapper[2576]: I0608 14:21:19.029625 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_data-science-gateway-data-science-gateway-class-5b556588bc7dzbz_1f2c8d2c-21ff-4629-a7cc-9adec5629613/istio-proxy/0.log" Jun 08 14:21:19.301301 ip-10-0-140-46 kubenswrapper[2576]: I0608 14:21:19.301188 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-pre-processing-67d7689b65-jpbxk_71aba221-b0b4-443a-a981-4b8feb2a4986/payload-pre-processing/0.log" Jun 08 14:21:20.136916 ip-10-0-140-46 kubenswrapper[2576]: I0608 14:21:20.136880 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-5stwl_aa1c8cf7-33d3-46fe-963b-c40cb5fd9674/serve-healthcheck-canary/0.log" Jun 08 14:21:20.967963 ip-10-0-140-46 kubenswrapper[2576]: I0608 14:21:20.967932 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-pbqss_bc51170c-32a5-4e1f-80b8-063889b6c079/kube-rbac-proxy/0.log" Jun 08 14:21:20.995230 ip-10-0-140-46 kubenswrapper[2576]: I0608 14:21:20.995191 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-pbqss_bc51170c-32a5-4e1f-80b8-063889b6c079/exporter/0.log" Jun 08 14:21:21.023691 ip-10-0-140-46 kubenswrapper[2576]: I0608 14:21:21.023660 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-pbqss_bc51170c-32a5-4e1f-80b8-063889b6c079/extractor/0.log" Jun 08 14:21:22.638733 ip-10-0-140-46 kubenswrapper[2576]: I0608 14:21:22.638702 2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-must-gather-8mlgz/perf-node-gather-daemonset-m4sth" Jun 08 14:21:23.546533 ip-10-0-140-46 kubenswrapper[2576]: I0608 14:21:23.546501 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_dashboard-redirect-6d99dc5989-xs8bt_74e496ab-540e-4396-a177-f6da7a61d474/nginx/0.log" Jun 08 14:21:23.764656 ip-10-0-140-46 kubenswrapper[2576]: I0608 14:21:23.764615 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_maas-api-56548fc74f-xmtkh_8638dcd6-699c-4954-a071-7ba9e81f7cd2/maas-api/0.log" Jun 08 14:21:23.954928 ip-10-0-140-46 kubenswrapper[2576]: I0608 14:21:23.954843 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_maas-controller-b646647b6-jrdmt_eeaae028-d070-434e-b899-5364783d007c/manager/0.log" Jun 08 14:21:24.111503 ip-10-0-140-46 kubenswrapper[2576]: I0608 14:21:24.111474 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-7b8d697984-b2fn4_8d1dd660-213d-4c9b-92bf-1a4132f8b703/manager/0.log" Jun 08 14:21:24.139539 ip-10-0-140-46 kubenswrapper[2576]: I0608 14:21:24.139481 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-7b8d697984-b2fn4_8d1dd660-213d-4c9b-92bf-1a4132f8b703/copy-manifests/0.log" Jun 08 14:21:26.424862 ip-10-0-140-46 kubenswrapper[2576]: I0608 14:21:26.424825 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-lws-operator_lws-controller-manager-68cd448d56-6j4jd_a3f450d0-a752-48f2-85e5-1178237392d9/manager/0.log" Jun 08 14:21:26.523215 ip-10-0-140-46 kubenswrapper[2576]: I0608 14:21:26.523182 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-lws-operator_openshift-lws-operator-fd8ccff4c-q4lvv_0ce913d4-88c4-4acc-b283-4cf28992d10e/openshift-lws-operator/0.log" Jun 08 14:21:28.385421 ip-10-0-140-46 kubenswrapper[2576]: I0608 14:21:28.385393 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_data-science-gateway-data-science-gateway-class-5b556588bc7dzbz_1f2c8d2c-21ff-4629-a7cc-9adec5629613/istio-proxy/0.log" Jun 08 14:21:28.604649 ip-10-0-140-46 kubenswrapper[2576]: I0608 14:21:28.604614 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-pre-processing-67d7689b65-jpbxk_71aba221-b0b4-443a-a981-4b8feb2a4986/payload-pre-processing/0.log" Jun 08 14:21:29.802113 ip-10-0-140-46 kubenswrapper[2576]: I0608 14:21:29.802079 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_data-science-gateway-data-science-gateway-class-5b556588bc7dzbz_1f2c8d2c-21ff-4629-a7cc-9adec5629613/istio-proxy/0.log" Jun 08 14:21:30.097186 ip-10-0-140-46 kubenswrapper[2576]: I0608 14:21:30.097081 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-pre-processing-67d7689b65-jpbxk_71aba221-b0b4-443a-a981-4b8feb2a4986/payload-pre-processing/0.log" Jun 08 14:21:31.995097 ip-10-0-140-46 kubenswrapper[2576]: I0608 14:21:31.995054 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_data-science-gateway-data-science-gateway-class-5b556588bc7dzbz_1f2c8d2c-21ff-4629-a7cc-9adec5629613/istio-proxy/0.log" Jun 08 14:21:32.202545 ip-10-0-140-46 kubenswrapper[2576]: I0608 14:21:32.202516 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-pre-processing-67d7689b65-jpbxk_71aba221-b0b4-443a-a981-4b8feb2a4986/payload-pre-processing/0.log" Jun 08 14:21:32.341360 ip-10-0-140-46 kubenswrapper[2576]: I0608 14:21:32.341324 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator_migrator-955ffdf5f-zqfkg_676442f6-eac2-4c1f-a040-e8af0728ae41/migrator/0.log" Jun 08 14:21:32.377646 ip-10-0-140-46 kubenswrapper[2576]: I0608 14:21:32.377613 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator_migrator-955ffdf5f-zqfkg_676442f6-eac2-4c1f-a040-e8af0728ae41/graceful-termination/0.log"