Jun 11 18:36:33.950845 ip-10-0-141-55 systemd[1]: Starting Kubernetes Kubelet... Jun 11 18:36:34.276837 ip-10-0-141-55 kubenswrapper[2578]: Flag --container-runtime-endpoint has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Jun 11 18:36:34.276837 ip-10-0-141-55 kubenswrapper[2578]: Flag --minimum-container-ttl-duration has been deprecated, Use --eviction-hard or --eviction-soft instead. Will be removed in a future version. Jun 11 18:36:34.276837 ip-10-0-141-55 kubenswrapper[2578]: Flag --volume-plugin-dir has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Jun 11 18:36:34.276837 ip-10-0-141-55 kubenswrapper[2578]: Flag --pod-infra-container-image has been deprecated, will be removed in 1.35. Image garbage collector will get sandbox image information from CRI. Jun 11 18:36:34.276837 ip-10-0-141-55 kubenswrapper[2578]: Flag --system-reserved has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Jun 11 18:36:34.277652 ip-10-0-141-55 kubenswrapper[2578]: I0611 18:36:34.277566 2578 server.go:213] "--pod-infra-container-image will not be pruned by the image garbage collector in kubelet and should also be set in the remote runtime" Jun 11 18:36:34.281407 ip-10-0-141-55 kubenswrapper[2578]: W0611 18:36:34.281392 2578 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jun 11 18:36:34.281407 ip-10-0-141-55 kubenswrapper[2578]: W0611 18:36:34.281407 2578 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jun 11 18:36:34.281469 ip-10-0-141-55 kubenswrapper[2578]: W0611 18:36:34.281413 2578 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jun 11 18:36:34.281469 ip-10-0-141-55 kubenswrapper[2578]: W0611 18:36:34.281417 2578 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jun 11 18:36:34.281469 ip-10-0-141-55 kubenswrapper[2578]: W0611 18:36:34.281421 2578 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jun 11 18:36:34.281469 ip-10-0-141-55 kubenswrapper[2578]: W0611 18:36:34.281424 2578 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jun 11 18:36:34.281469 ip-10-0-141-55 kubenswrapper[2578]: W0611 18:36:34.281427 2578 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jun 11 18:36:34.281469 ip-10-0-141-55 kubenswrapper[2578]: W0611 18:36:34.281429 2578 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jun 11 18:36:34.281469 ip-10-0-141-55 kubenswrapper[2578]: W0611 18:36:34.281433 2578 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jun 11 18:36:34.281469 ip-10-0-141-55 kubenswrapper[2578]: W0611 18:36:34.281436 2578 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jun 11 18:36:34.281469 ip-10-0-141-55 kubenswrapper[2578]: W0611 18:36:34.281439 2578 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jun 11 18:36:34.281469 ip-10-0-141-55 kubenswrapper[2578]: W0611 18:36:34.281441 2578 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jun 11 18:36:34.281469 ip-10-0-141-55 kubenswrapper[2578]: W0611 18:36:34.281444 2578 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jun 11 18:36:34.281469 ip-10-0-141-55 kubenswrapper[2578]: W0611 18:36:34.281446 2578 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jun 11 18:36:34.281469 ip-10-0-141-55 kubenswrapper[2578]: W0611 18:36:34.281449 2578 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jun 11 18:36:34.281469 ip-10-0-141-55 kubenswrapper[2578]: W0611 18:36:34.281452 2578 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jun 11 18:36:34.281469 ip-10-0-141-55 kubenswrapper[2578]: W0611 18:36:34.281455 2578 feature_gate.go:328] unrecognized feature gate: Example Jun 11 18:36:34.281469 ip-10-0-141-55 kubenswrapper[2578]: W0611 18:36:34.281457 2578 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jun 11 18:36:34.281469 ip-10-0-141-55 kubenswrapper[2578]: W0611 18:36:34.281461 2578 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jun 11 18:36:34.281469 ip-10-0-141-55 kubenswrapper[2578]: W0611 18:36:34.281463 2578 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jun 11 18:36:34.281469 ip-10-0-141-55 kubenswrapper[2578]: W0611 18:36:34.281466 2578 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jun 11 18:36:34.281469 ip-10-0-141-55 kubenswrapper[2578]: W0611 18:36:34.281468 2578 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jun 11 18:36:34.281977 ip-10-0-141-55 kubenswrapper[2578]: W0611 18:36:34.281471 2578 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jun 11 18:36:34.281977 ip-10-0-141-55 kubenswrapper[2578]: W0611 18:36:34.281473 2578 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jun 11 18:36:34.281977 ip-10-0-141-55 kubenswrapper[2578]: W0611 18:36:34.281476 2578 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jun 11 18:36:34.281977 ip-10-0-141-55 kubenswrapper[2578]: W0611 18:36:34.281479 2578 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jun 11 18:36:34.281977 ip-10-0-141-55 kubenswrapper[2578]: W0611 18:36:34.281482 2578 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jun 11 18:36:34.281977 ip-10-0-141-55 kubenswrapper[2578]: W0611 18:36:34.281485 2578 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jun 11 18:36:34.281977 ip-10-0-141-55 kubenswrapper[2578]: W0611 18:36:34.281488 2578 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jun 11 18:36:34.281977 ip-10-0-141-55 kubenswrapper[2578]: W0611 18:36:34.281490 2578 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jun 11 18:36:34.281977 ip-10-0-141-55 kubenswrapper[2578]: W0611 18:36:34.281494 2578 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jun 11 18:36:34.281977 ip-10-0-141-55 kubenswrapper[2578]: W0611 18:36:34.281497 2578 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jun 11 18:36:34.281977 ip-10-0-141-55 kubenswrapper[2578]: W0611 18:36:34.281500 2578 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jun 11 18:36:34.281977 ip-10-0-141-55 kubenswrapper[2578]: W0611 18:36:34.281503 2578 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jun 11 18:36:34.281977 ip-10-0-141-55 kubenswrapper[2578]: W0611 18:36:34.281506 2578 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jun 11 18:36:34.281977 ip-10-0-141-55 kubenswrapper[2578]: W0611 18:36:34.281509 2578 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jun 11 18:36:34.281977 ip-10-0-141-55 kubenswrapper[2578]: W0611 18:36:34.281511 2578 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jun 11 18:36:34.281977 ip-10-0-141-55 kubenswrapper[2578]: W0611 18:36:34.281514 2578 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jun 11 18:36:34.281977 ip-10-0-141-55 kubenswrapper[2578]: W0611 18:36:34.281516 2578 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jun 11 18:36:34.281977 ip-10-0-141-55 kubenswrapper[2578]: W0611 18:36:34.281519 2578 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jun 11 18:36:34.281977 ip-10-0-141-55 kubenswrapper[2578]: W0611 18:36:34.281521 2578 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jun 11 18:36:34.282455 ip-10-0-141-55 kubenswrapper[2578]: W0611 18:36:34.281524 2578 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jun 11 18:36:34.282455 ip-10-0-141-55 kubenswrapper[2578]: W0611 18:36:34.281526 2578 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jun 11 18:36:34.282455 ip-10-0-141-55 kubenswrapper[2578]: W0611 18:36:34.281529 2578 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jun 11 18:36:34.282455 ip-10-0-141-55 kubenswrapper[2578]: W0611 18:36:34.281532 2578 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jun 11 18:36:34.282455 ip-10-0-141-55 kubenswrapper[2578]: W0611 18:36:34.281534 2578 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jun 11 18:36:34.282455 ip-10-0-141-55 kubenswrapper[2578]: W0611 18:36:34.281537 2578 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jun 11 18:36:34.282455 ip-10-0-141-55 kubenswrapper[2578]: W0611 18:36:34.281545 2578 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jun 11 18:36:34.282455 ip-10-0-141-55 kubenswrapper[2578]: W0611 18:36:34.281548 2578 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jun 11 18:36:34.282455 ip-10-0-141-55 kubenswrapper[2578]: W0611 18:36:34.281563 2578 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jun 11 18:36:34.282455 ip-10-0-141-55 kubenswrapper[2578]: W0611 18:36:34.281566 2578 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jun 11 18:36:34.282455 ip-10-0-141-55 kubenswrapper[2578]: W0611 18:36:34.281568 2578 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jun 11 18:36:34.282455 ip-10-0-141-55 kubenswrapper[2578]: W0611 18:36:34.281571 2578 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jun 11 18:36:34.282455 ip-10-0-141-55 kubenswrapper[2578]: W0611 18:36:34.281573 2578 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jun 11 18:36:34.282455 ip-10-0-141-55 kubenswrapper[2578]: W0611 18:36:34.281576 2578 feature_gate.go:328] unrecognized feature gate: PinnedImages Jun 11 18:36:34.282455 ip-10-0-141-55 kubenswrapper[2578]: W0611 18:36:34.281579 2578 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jun 11 18:36:34.282455 ip-10-0-141-55 kubenswrapper[2578]: W0611 18:36:34.281582 2578 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jun 11 18:36:34.282455 ip-10-0-141-55 kubenswrapper[2578]: W0611 18:36:34.281584 2578 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jun 11 18:36:34.282455 ip-10-0-141-55 kubenswrapper[2578]: W0611 18:36:34.281587 2578 feature_gate.go:328] unrecognized feature gate: DualReplica Jun 11 18:36:34.282455 ip-10-0-141-55 kubenswrapper[2578]: W0611 18:36:34.281590 2578 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jun 11 18:36:34.282951 ip-10-0-141-55 kubenswrapper[2578]: W0611 18:36:34.281594 2578 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jun 11 18:36:34.282951 ip-10-0-141-55 kubenswrapper[2578]: W0611 18:36:34.281598 2578 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jun 11 18:36:34.282951 ip-10-0-141-55 kubenswrapper[2578]: W0611 18:36:34.281601 2578 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jun 11 18:36:34.282951 ip-10-0-141-55 kubenswrapper[2578]: W0611 18:36:34.281603 2578 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jun 11 18:36:34.282951 ip-10-0-141-55 kubenswrapper[2578]: W0611 18:36:34.281606 2578 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jun 11 18:36:34.282951 ip-10-0-141-55 kubenswrapper[2578]: W0611 18:36:34.281609 2578 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jun 11 18:36:34.282951 ip-10-0-141-55 kubenswrapper[2578]: W0611 18:36:34.281611 2578 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jun 11 18:36:34.282951 ip-10-0-141-55 kubenswrapper[2578]: W0611 18:36:34.281614 2578 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jun 11 18:36:34.282951 ip-10-0-141-55 kubenswrapper[2578]: W0611 18:36:34.281616 2578 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jun 11 18:36:34.282951 ip-10-0-141-55 kubenswrapper[2578]: W0611 18:36:34.281619 2578 feature_gate.go:328] unrecognized feature gate: OVNObservability Jun 11 18:36:34.282951 ip-10-0-141-55 kubenswrapper[2578]: W0611 18:36:34.281622 2578 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jun 11 18:36:34.282951 ip-10-0-141-55 kubenswrapper[2578]: W0611 18:36:34.281624 2578 feature_gate.go:328] unrecognized feature gate: OSStreams Jun 11 18:36:34.282951 ip-10-0-141-55 kubenswrapper[2578]: W0611 18:36:34.281627 2578 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jun 11 18:36:34.282951 ip-10-0-141-55 kubenswrapper[2578]: W0611 18:36:34.281630 2578 feature_gate.go:328] unrecognized feature gate: NewOLM Jun 11 18:36:34.282951 ip-10-0-141-55 kubenswrapper[2578]: W0611 18:36:34.281632 2578 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jun 11 18:36:34.282951 ip-10-0-141-55 kubenswrapper[2578]: W0611 18:36:34.281635 2578 feature_gate.go:328] unrecognized feature gate: SignatureStores Jun 11 18:36:34.282951 ip-10-0-141-55 kubenswrapper[2578]: W0611 18:36:34.281637 2578 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jun 11 18:36:34.282951 ip-10-0-141-55 kubenswrapper[2578]: W0611 18:36:34.281640 2578 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jun 11 18:36:34.282951 ip-10-0-141-55 kubenswrapper[2578]: W0611 18:36:34.281642 2578 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jun 11 18:36:34.282951 ip-10-0-141-55 kubenswrapper[2578]: W0611 18:36:34.281645 2578 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jun 11 18:36:34.283427 ip-10-0-141-55 kubenswrapper[2578]: W0611 18:36:34.281653 2578 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jun 11 18:36:34.283427 ip-10-0-141-55 kubenswrapper[2578]: W0611 18:36:34.281656 2578 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jun 11 18:36:34.283427 ip-10-0-141-55 kubenswrapper[2578]: W0611 18:36:34.281658 2578 feature_gate.go:328] unrecognized feature gate: EventTTL Jun 11 18:36:34.283427 ip-10-0-141-55 kubenswrapper[2578]: W0611 18:36:34.281660 2578 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jun 11 18:36:34.283427 ip-10-0-141-55 kubenswrapper[2578]: W0611 18:36:34.281663 2578 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jun 11 18:36:34.283427 ip-10-0-141-55 kubenswrapper[2578]: W0611 18:36:34.281666 2578 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jun 11 18:36:34.283427 ip-10-0-141-55 kubenswrapper[2578]: W0611 18:36:34.281668 2578 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jun 11 18:36:34.283427 ip-10-0-141-55 kubenswrapper[2578]: W0611 18:36:34.281671 2578 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jun 11 18:36:34.283427 ip-10-0-141-55 kubenswrapper[2578]: W0611 18:36:34.281674 2578 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jun 11 18:36:34.283427 ip-10-0-141-55 kubenswrapper[2578]: W0611 18:36:34.281678 2578 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jun 11 18:36:34.283427 ip-10-0-141-55 kubenswrapper[2578]: W0611 18:36:34.281680 2578 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jun 11 18:36:34.283427 ip-10-0-141-55 kubenswrapper[2578]: W0611 18:36:34.281683 2578 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jun 11 18:36:34.283427 ip-10-0-141-55 kubenswrapper[2578]: W0611 18:36:34.281685 2578 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jun 11 18:36:34.283427 ip-10-0-141-55 kubenswrapper[2578]: W0611 18:36:34.281688 2578 feature_gate.go:328] unrecognized feature gate: Example2 Jun 11 18:36:34.283427 ip-10-0-141-55 kubenswrapper[2578]: W0611 18:36:34.281690 2578 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jun 11 18:36:34.283427 ip-10-0-141-55 kubenswrapper[2578]: W0611 18:36:34.281693 2578 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jun 11 18:36:34.283427 ip-10-0-141-55 kubenswrapper[2578]: W0611 18:36:34.281696 2578 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jun 11 18:36:34.283427 ip-10-0-141-55 kubenswrapper[2578]: W0611 18:36:34.281698 2578 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jun 11 18:36:34.283427 ip-10-0-141-55 kubenswrapper[2578]: W0611 18:36:34.281701 2578 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jun 11 18:36:34.283427 ip-10-0-141-55 kubenswrapper[2578]: W0611 18:36:34.282396 2578 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jun 11 18:36:34.284024 ip-10-0-141-55 kubenswrapper[2578]: W0611 18:36:34.282402 2578 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jun 11 18:36:34.284024 ip-10-0-141-55 kubenswrapper[2578]: W0611 18:36:34.282405 2578 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jun 11 18:36:34.284024 ip-10-0-141-55 kubenswrapper[2578]: W0611 18:36:34.282408 2578 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jun 11 18:36:34.284024 ip-10-0-141-55 kubenswrapper[2578]: W0611 18:36:34.282411 2578 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jun 11 18:36:34.284024 ip-10-0-141-55 kubenswrapper[2578]: W0611 18:36:34.282414 2578 feature_gate.go:328] unrecognized feature gate: Example2 Jun 11 18:36:34.284024 ip-10-0-141-55 kubenswrapper[2578]: W0611 18:36:34.282416 2578 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jun 11 18:36:34.284024 ip-10-0-141-55 kubenswrapper[2578]: W0611 18:36:34.282419 2578 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jun 11 18:36:34.284024 ip-10-0-141-55 kubenswrapper[2578]: W0611 18:36:34.282422 2578 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jun 11 18:36:34.284024 ip-10-0-141-55 kubenswrapper[2578]: W0611 18:36:34.282424 2578 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jun 11 18:36:34.284024 ip-10-0-141-55 kubenswrapper[2578]: W0611 18:36:34.282427 2578 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jun 11 18:36:34.284024 ip-10-0-141-55 kubenswrapper[2578]: W0611 18:36:34.282429 2578 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jun 11 18:36:34.284024 ip-10-0-141-55 kubenswrapper[2578]: W0611 18:36:34.282432 2578 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jun 11 18:36:34.284024 ip-10-0-141-55 kubenswrapper[2578]: W0611 18:36:34.282434 2578 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jun 11 18:36:34.284024 ip-10-0-141-55 kubenswrapper[2578]: W0611 18:36:34.282437 2578 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jun 11 18:36:34.284024 ip-10-0-141-55 kubenswrapper[2578]: W0611 18:36:34.282440 2578 feature_gate.go:328] unrecognized feature gate: OVNObservability Jun 11 18:36:34.284024 ip-10-0-141-55 kubenswrapper[2578]: W0611 18:36:34.282442 2578 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jun 11 18:36:34.284024 ip-10-0-141-55 kubenswrapper[2578]: W0611 18:36:34.282445 2578 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jun 11 18:36:34.284024 ip-10-0-141-55 kubenswrapper[2578]: W0611 18:36:34.282447 2578 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jun 11 18:36:34.284024 ip-10-0-141-55 kubenswrapper[2578]: W0611 18:36:34.282451 2578 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jun 11 18:36:34.284498 ip-10-0-141-55 kubenswrapper[2578]: W0611 18:36:34.282457 2578 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jun 11 18:36:34.284498 ip-10-0-141-55 kubenswrapper[2578]: W0611 18:36:34.282461 2578 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jun 11 18:36:34.284498 ip-10-0-141-55 kubenswrapper[2578]: W0611 18:36:34.282464 2578 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jun 11 18:36:34.284498 ip-10-0-141-55 kubenswrapper[2578]: W0611 18:36:34.282467 2578 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jun 11 18:36:34.284498 ip-10-0-141-55 kubenswrapper[2578]: W0611 18:36:34.282470 2578 feature_gate.go:328] unrecognized feature gate: SignatureStores Jun 11 18:36:34.284498 ip-10-0-141-55 kubenswrapper[2578]: W0611 18:36:34.282474 2578 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jun 11 18:36:34.284498 ip-10-0-141-55 kubenswrapper[2578]: W0611 18:36:34.282477 2578 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jun 11 18:36:34.284498 ip-10-0-141-55 kubenswrapper[2578]: W0611 18:36:34.282480 2578 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jun 11 18:36:34.284498 ip-10-0-141-55 kubenswrapper[2578]: W0611 18:36:34.282482 2578 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jun 11 18:36:34.284498 ip-10-0-141-55 kubenswrapper[2578]: W0611 18:36:34.282485 2578 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jun 11 18:36:34.284498 ip-10-0-141-55 kubenswrapper[2578]: W0611 18:36:34.282488 2578 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jun 11 18:36:34.284498 ip-10-0-141-55 kubenswrapper[2578]: W0611 18:36:34.282491 2578 feature_gate.go:328] unrecognized feature gate: NewOLM Jun 11 18:36:34.284498 ip-10-0-141-55 kubenswrapper[2578]: W0611 18:36:34.282493 2578 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jun 11 18:36:34.284498 ip-10-0-141-55 kubenswrapper[2578]: W0611 18:36:34.282496 2578 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jun 11 18:36:34.284498 ip-10-0-141-55 kubenswrapper[2578]: W0611 18:36:34.282498 2578 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jun 11 18:36:34.284498 ip-10-0-141-55 kubenswrapper[2578]: W0611 18:36:34.282501 2578 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jun 11 18:36:34.284498 ip-10-0-141-55 kubenswrapper[2578]: W0611 18:36:34.282503 2578 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jun 11 18:36:34.284498 ip-10-0-141-55 kubenswrapper[2578]: W0611 18:36:34.282506 2578 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jun 11 18:36:34.284498 ip-10-0-141-55 kubenswrapper[2578]: W0611 18:36:34.282508 2578 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jun 11 18:36:34.284498 ip-10-0-141-55 kubenswrapper[2578]: W0611 18:36:34.282511 2578 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jun 11 18:36:34.285032 ip-10-0-141-55 kubenswrapper[2578]: W0611 18:36:34.282513 2578 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jun 11 18:36:34.285032 ip-10-0-141-55 kubenswrapper[2578]: W0611 18:36:34.282516 2578 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jun 11 18:36:34.285032 ip-10-0-141-55 kubenswrapper[2578]: W0611 18:36:34.282519 2578 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jun 11 18:36:34.285032 ip-10-0-141-55 kubenswrapper[2578]: W0611 18:36:34.282523 2578 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jun 11 18:36:34.285032 ip-10-0-141-55 kubenswrapper[2578]: W0611 18:36:34.282527 2578 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jun 11 18:36:34.285032 ip-10-0-141-55 kubenswrapper[2578]: W0611 18:36:34.282530 2578 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jun 11 18:36:34.285032 ip-10-0-141-55 kubenswrapper[2578]: W0611 18:36:34.282533 2578 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jun 11 18:36:34.285032 ip-10-0-141-55 kubenswrapper[2578]: W0611 18:36:34.282536 2578 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jun 11 18:36:34.285032 ip-10-0-141-55 kubenswrapper[2578]: W0611 18:36:34.282539 2578 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jun 11 18:36:34.285032 ip-10-0-141-55 kubenswrapper[2578]: W0611 18:36:34.282541 2578 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jun 11 18:36:34.285032 ip-10-0-141-55 kubenswrapper[2578]: W0611 18:36:34.282544 2578 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jun 11 18:36:34.285032 ip-10-0-141-55 kubenswrapper[2578]: W0611 18:36:34.282546 2578 feature_gate.go:328] unrecognized feature gate: OSStreams Jun 11 18:36:34.285032 ip-10-0-141-55 kubenswrapper[2578]: W0611 18:36:34.282550 2578 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jun 11 18:36:34.285032 ip-10-0-141-55 kubenswrapper[2578]: W0611 18:36:34.282568 2578 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jun 11 18:36:34.285032 ip-10-0-141-55 kubenswrapper[2578]: W0611 18:36:34.282571 2578 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jun 11 18:36:34.285032 ip-10-0-141-55 kubenswrapper[2578]: W0611 18:36:34.282574 2578 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jun 11 18:36:34.285032 ip-10-0-141-55 kubenswrapper[2578]: W0611 18:36:34.282577 2578 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jun 11 18:36:34.285032 ip-10-0-141-55 kubenswrapper[2578]: W0611 18:36:34.282580 2578 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jun 11 18:36:34.285032 ip-10-0-141-55 kubenswrapper[2578]: W0611 18:36:34.282583 2578 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jun 11 18:36:34.285496 ip-10-0-141-55 kubenswrapper[2578]: W0611 18:36:34.282585 2578 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jun 11 18:36:34.285496 ip-10-0-141-55 kubenswrapper[2578]: W0611 18:36:34.282588 2578 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jun 11 18:36:34.285496 ip-10-0-141-55 kubenswrapper[2578]: W0611 18:36:34.282591 2578 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jun 11 18:36:34.285496 ip-10-0-141-55 kubenswrapper[2578]: W0611 18:36:34.282594 2578 feature_gate.go:328] unrecognized feature gate: DualReplica Jun 11 18:36:34.285496 ip-10-0-141-55 kubenswrapper[2578]: W0611 18:36:34.282596 2578 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jun 11 18:36:34.285496 ip-10-0-141-55 kubenswrapper[2578]: W0611 18:36:34.282599 2578 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jun 11 18:36:34.285496 ip-10-0-141-55 kubenswrapper[2578]: W0611 18:36:34.282602 2578 feature_gate.go:328] unrecognized feature gate: EventTTL Jun 11 18:36:34.285496 ip-10-0-141-55 kubenswrapper[2578]: W0611 18:36:34.282604 2578 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jun 11 18:36:34.285496 ip-10-0-141-55 kubenswrapper[2578]: W0611 18:36:34.282607 2578 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jun 11 18:36:34.285496 ip-10-0-141-55 kubenswrapper[2578]: W0611 18:36:34.282610 2578 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jun 11 18:36:34.285496 ip-10-0-141-55 kubenswrapper[2578]: W0611 18:36:34.282612 2578 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jun 11 18:36:34.285496 ip-10-0-141-55 kubenswrapper[2578]: W0611 18:36:34.282615 2578 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jun 11 18:36:34.285496 ip-10-0-141-55 kubenswrapper[2578]: W0611 18:36:34.282617 2578 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jun 11 18:36:34.285496 ip-10-0-141-55 kubenswrapper[2578]: W0611 18:36:34.282620 2578 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jun 11 18:36:34.285496 ip-10-0-141-55 kubenswrapper[2578]: W0611 18:36:34.282623 2578 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jun 11 18:36:34.285496 ip-10-0-141-55 kubenswrapper[2578]: W0611 18:36:34.282625 2578 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jun 11 18:36:34.285496 ip-10-0-141-55 kubenswrapper[2578]: W0611 18:36:34.282628 2578 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jun 11 18:36:34.285496 ip-10-0-141-55 kubenswrapper[2578]: W0611 18:36:34.282630 2578 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jun 11 18:36:34.285496 ip-10-0-141-55 kubenswrapper[2578]: W0611 18:36:34.282633 2578 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jun 11 18:36:34.285496 ip-10-0-141-55 kubenswrapper[2578]: W0611 18:36:34.282635 2578 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jun 11 18:36:34.286025 ip-10-0-141-55 kubenswrapper[2578]: W0611 18:36:34.282638 2578 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jun 11 18:36:34.286025 ip-10-0-141-55 kubenswrapper[2578]: W0611 18:36:34.282641 2578 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jun 11 18:36:34.286025 ip-10-0-141-55 kubenswrapper[2578]: W0611 18:36:34.282645 2578 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jun 11 18:36:34.286025 ip-10-0-141-55 kubenswrapper[2578]: W0611 18:36:34.282649 2578 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jun 11 18:36:34.286025 ip-10-0-141-55 kubenswrapper[2578]: W0611 18:36:34.282652 2578 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jun 11 18:36:34.286025 ip-10-0-141-55 kubenswrapper[2578]: W0611 18:36:34.282655 2578 feature_gate.go:328] unrecognized feature gate: Example Jun 11 18:36:34.286025 ip-10-0-141-55 kubenswrapper[2578]: W0611 18:36:34.282658 2578 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jun 11 18:36:34.286025 ip-10-0-141-55 kubenswrapper[2578]: W0611 18:36:34.282660 2578 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jun 11 18:36:34.286025 ip-10-0-141-55 kubenswrapper[2578]: W0611 18:36:34.282663 2578 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jun 11 18:36:34.286025 ip-10-0-141-55 kubenswrapper[2578]: W0611 18:36:34.282666 2578 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jun 11 18:36:34.286025 ip-10-0-141-55 kubenswrapper[2578]: W0611 18:36:34.282668 2578 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jun 11 18:36:34.286025 ip-10-0-141-55 kubenswrapper[2578]: W0611 18:36:34.282671 2578 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jun 11 18:36:34.286025 ip-10-0-141-55 kubenswrapper[2578]: W0611 18:36:34.282674 2578 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jun 11 18:36:34.286025 ip-10-0-141-55 kubenswrapper[2578]: W0611 18:36:34.282677 2578 feature_gate.go:328] unrecognized feature gate: PinnedImages Jun 11 18:36:34.286025 ip-10-0-141-55 kubenswrapper[2578]: W0611 18:36:34.282680 2578 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jun 11 18:36:34.286025 ip-10-0-141-55 kubenswrapper[2578]: W0611 18:36:34.282683 2578 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jun 11 18:36:34.286025 ip-10-0-141-55 kubenswrapper[2578]: W0611 18:36:34.282685 2578 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jun 11 18:36:34.286025 ip-10-0-141-55 kubenswrapper[2578]: W0611 18:36:34.282688 2578 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jun 11 18:36:34.286025 ip-10-0-141-55 kubenswrapper[2578]: W0611 18:36:34.282690 2578 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jun 11 18:36:34.286025 ip-10-0-141-55 kubenswrapper[2578]: W0611 18:36:34.282693 2578 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jun 11 18:36:34.286507 ip-10-0-141-55 kubenswrapper[2578]: W0611 18:36:34.283089 2578 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jun 11 18:36:34.286507 ip-10-0-141-55 kubenswrapper[2578]: W0611 18:36:34.283094 2578 feature_gate.go:328] unrecognized feature gate: SignatureStores Jun 11 18:36:34.286507 ip-10-0-141-55 kubenswrapper[2578]: W0611 18:36:34.283098 2578 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jun 11 18:36:34.286507 ip-10-0-141-55 kubenswrapper[2578]: W0611 18:36:34.283101 2578 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jun 11 18:36:34.286507 ip-10-0-141-55 kubenswrapper[2578]: W0611 18:36:34.283104 2578 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jun 11 18:36:34.286507 ip-10-0-141-55 kubenswrapper[2578]: W0611 18:36:34.283107 2578 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jun 11 18:36:34.286507 ip-10-0-141-55 kubenswrapper[2578]: W0611 18:36:34.283110 2578 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jun 11 18:36:34.286507 ip-10-0-141-55 kubenswrapper[2578]: W0611 18:36:34.283112 2578 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jun 11 18:36:34.286507 ip-10-0-141-55 kubenswrapper[2578]: W0611 18:36:34.283115 2578 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jun 11 18:36:34.286507 ip-10-0-141-55 kubenswrapper[2578]: W0611 18:36:34.283118 2578 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jun 11 18:36:34.286507 ip-10-0-141-55 kubenswrapper[2578]: W0611 18:36:34.283120 2578 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jun 11 18:36:34.286507 ip-10-0-141-55 kubenswrapper[2578]: W0611 18:36:34.283123 2578 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jun 11 18:36:34.286507 ip-10-0-141-55 kubenswrapper[2578]: W0611 18:36:34.283126 2578 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jun 11 18:36:34.286507 ip-10-0-141-55 kubenswrapper[2578]: W0611 18:36:34.283129 2578 feature_gate.go:328] unrecognized feature gate: PinnedImages Jun 11 18:36:34.286507 ip-10-0-141-55 kubenswrapper[2578]: W0611 18:36:34.283131 2578 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jun 11 18:36:34.286507 ip-10-0-141-55 kubenswrapper[2578]: W0611 18:36:34.283135 2578 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jun 11 18:36:34.286507 ip-10-0-141-55 kubenswrapper[2578]: W0611 18:36:34.283138 2578 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jun 11 18:36:34.286507 ip-10-0-141-55 kubenswrapper[2578]: W0611 18:36:34.283140 2578 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jun 11 18:36:34.286507 ip-10-0-141-55 kubenswrapper[2578]: W0611 18:36:34.283143 2578 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jun 11 18:36:34.286507 ip-10-0-141-55 kubenswrapper[2578]: W0611 18:36:34.283146 2578 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jun 11 18:36:34.286998 ip-10-0-141-55 kubenswrapper[2578]: W0611 18:36:34.283149 2578 feature_gate.go:328] unrecognized feature gate: OVNObservability Jun 11 18:36:34.286998 ip-10-0-141-55 kubenswrapper[2578]: W0611 18:36:34.283151 2578 feature_gate.go:328] unrecognized feature gate: DualReplica Jun 11 18:36:34.286998 ip-10-0-141-55 kubenswrapper[2578]: W0611 18:36:34.283154 2578 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jun 11 18:36:34.286998 ip-10-0-141-55 kubenswrapper[2578]: W0611 18:36:34.283157 2578 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jun 11 18:36:34.286998 ip-10-0-141-55 kubenswrapper[2578]: W0611 18:36:34.283159 2578 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jun 11 18:36:34.286998 ip-10-0-141-55 kubenswrapper[2578]: W0611 18:36:34.283162 2578 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jun 11 18:36:34.286998 ip-10-0-141-55 kubenswrapper[2578]: W0611 18:36:34.283166 2578 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jun 11 18:36:34.286998 ip-10-0-141-55 kubenswrapper[2578]: W0611 18:36:34.283169 2578 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jun 11 18:36:34.286998 ip-10-0-141-55 kubenswrapper[2578]: W0611 18:36:34.283172 2578 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jun 11 18:36:34.286998 ip-10-0-141-55 kubenswrapper[2578]: W0611 18:36:34.283175 2578 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jun 11 18:36:34.286998 ip-10-0-141-55 kubenswrapper[2578]: W0611 18:36:34.283177 2578 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jun 11 18:36:34.286998 ip-10-0-141-55 kubenswrapper[2578]: W0611 18:36:34.283180 2578 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jun 11 18:36:34.286998 ip-10-0-141-55 kubenswrapper[2578]: W0611 18:36:34.283182 2578 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jun 11 18:36:34.286998 ip-10-0-141-55 kubenswrapper[2578]: W0611 18:36:34.283185 2578 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jun 11 18:36:34.286998 ip-10-0-141-55 kubenswrapper[2578]: W0611 18:36:34.283188 2578 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jun 11 18:36:34.286998 ip-10-0-141-55 kubenswrapper[2578]: W0611 18:36:34.283191 2578 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jun 11 18:36:34.286998 ip-10-0-141-55 kubenswrapper[2578]: W0611 18:36:34.283193 2578 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jun 11 18:36:34.286998 ip-10-0-141-55 kubenswrapper[2578]: W0611 18:36:34.283196 2578 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jun 11 18:36:34.286998 ip-10-0-141-55 kubenswrapper[2578]: W0611 18:36:34.283198 2578 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jun 11 18:36:34.286998 ip-10-0-141-55 kubenswrapper[2578]: W0611 18:36:34.283201 2578 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jun 11 18:36:34.287477 ip-10-0-141-55 kubenswrapper[2578]: W0611 18:36:34.283203 2578 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jun 11 18:36:34.287477 ip-10-0-141-55 kubenswrapper[2578]: W0611 18:36:34.283205 2578 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jun 11 18:36:34.287477 ip-10-0-141-55 kubenswrapper[2578]: W0611 18:36:34.283208 2578 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jun 11 18:36:34.287477 ip-10-0-141-55 kubenswrapper[2578]: W0611 18:36:34.283210 2578 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jun 11 18:36:34.287477 ip-10-0-141-55 kubenswrapper[2578]: W0611 18:36:34.283213 2578 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jun 11 18:36:34.287477 ip-10-0-141-55 kubenswrapper[2578]: W0611 18:36:34.283215 2578 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jun 11 18:36:34.287477 ip-10-0-141-55 kubenswrapper[2578]: W0611 18:36:34.283219 2578 feature_gate.go:328] unrecognized feature gate: EventTTL Jun 11 18:36:34.287477 ip-10-0-141-55 kubenswrapper[2578]: W0611 18:36:34.283222 2578 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jun 11 18:36:34.287477 ip-10-0-141-55 kubenswrapper[2578]: W0611 18:36:34.283225 2578 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jun 11 18:36:34.287477 ip-10-0-141-55 kubenswrapper[2578]: W0611 18:36:34.283227 2578 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jun 11 18:36:34.287477 ip-10-0-141-55 kubenswrapper[2578]: W0611 18:36:34.283230 2578 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jun 11 18:36:34.287477 ip-10-0-141-55 kubenswrapper[2578]: W0611 18:36:34.283233 2578 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jun 11 18:36:34.287477 ip-10-0-141-55 kubenswrapper[2578]: W0611 18:36:34.283235 2578 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jun 11 18:36:34.287477 ip-10-0-141-55 kubenswrapper[2578]: W0611 18:36:34.283238 2578 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jun 11 18:36:34.287477 ip-10-0-141-55 kubenswrapper[2578]: W0611 18:36:34.283240 2578 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jun 11 18:36:34.287477 ip-10-0-141-55 kubenswrapper[2578]: W0611 18:36:34.283243 2578 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jun 11 18:36:34.287477 ip-10-0-141-55 kubenswrapper[2578]: W0611 18:36:34.283245 2578 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jun 11 18:36:34.287477 ip-10-0-141-55 kubenswrapper[2578]: W0611 18:36:34.283248 2578 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jun 11 18:36:34.287477 ip-10-0-141-55 kubenswrapper[2578]: W0611 18:36:34.283252 2578 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jun 11 18:36:34.287942 ip-10-0-141-55 kubenswrapper[2578]: W0611 18:36:34.283255 2578 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jun 11 18:36:34.287942 ip-10-0-141-55 kubenswrapper[2578]: W0611 18:36:34.283257 2578 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jun 11 18:36:34.287942 ip-10-0-141-55 kubenswrapper[2578]: W0611 18:36:34.283260 2578 feature_gate.go:328] unrecognized feature gate: NewOLM Jun 11 18:36:34.287942 ip-10-0-141-55 kubenswrapper[2578]: W0611 18:36:34.283262 2578 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jun 11 18:36:34.287942 ip-10-0-141-55 kubenswrapper[2578]: W0611 18:36:34.283265 2578 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jun 11 18:36:34.287942 ip-10-0-141-55 kubenswrapper[2578]: W0611 18:36:34.283268 2578 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jun 11 18:36:34.287942 ip-10-0-141-55 kubenswrapper[2578]: W0611 18:36:34.283271 2578 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jun 11 18:36:34.287942 ip-10-0-141-55 kubenswrapper[2578]: W0611 18:36:34.283274 2578 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jun 11 18:36:34.287942 ip-10-0-141-55 kubenswrapper[2578]: W0611 18:36:34.283276 2578 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jun 11 18:36:34.287942 ip-10-0-141-55 kubenswrapper[2578]: W0611 18:36:34.283279 2578 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jun 11 18:36:34.287942 ip-10-0-141-55 kubenswrapper[2578]: W0611 18:36:34.283281 2578 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jun 11 18:36:34.287942 ip-10-0-141-55 kubenswrapper[2578]: W0611 18:36:34.283284 2578 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jun 11 18:36:34.287942 ip-10-0-141-55 kubenswrapper[2578]: W0611 18:36:34.283286 2578 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jun 11 18:36:34.287942 ip-10-0-141-55 kubenswrapper[2578]: W0611 18:36:34.283289 2578 feature_gate.go:328] unrecognized feature gate: Example Jun 11 18:36:34.287942 ip-10-0-141-55 kubenswrapper[2578]: W0611 18:36:34.283292 2578 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jun 11 18:36:34.287942 ip-10-0-141-55 kubenswrapper[2578]: W0611 18:36:34.283294 2578 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jun 11 18:36:34.287942 ip-10-0-141-55 kubenswrapper[2578]: W0611 18:36:34.283298 2578 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jun 11 18:36:34.287942 ip-10-0-141-55 kubenswrapper[2578]: W0611 18:36:34.283302 2578 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jun 11 18:36:34.287942 ip-10-0-141-55 kubenswrapper[2578]: W0611 18:36:34.283304 2578 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jun 11 18:36:34.287942 ip-10-0-141-55 kubenswrapper[2578]: W0611 18:36:34.283307 2578 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jun 11 18:36:34.288422 ip-10-0-141-55 kubenswrapper[2578]: W0611 18:36:34.283310 2578 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jun 11 18:36:34.288422 ip-10-0-141-55 kubenswrapper[2578]: W0611 18:36:34.283313 2578 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jun 11 18:36:34.288422 ip-10-0-141-55 kubenswrapper[2578]: W0611 18:36:34.283316 2578 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jun 11 18:36:34.288422 ip-10-0-141-55 kubenswrapper[2578]: W0611 18:36:34.283318 2578 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jun 11 18:36:34.288422 ip-10-0-141-55 kubenswrapper[2578]: W0611 18:36:34.283321 2578 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jun 11 18:36:34.288422 ip-10-0-141-55 kubenswrapper[2578]: W0611 18:36:34.283323 2578 feature_gate.go:328] unrecognized feature gate: Example2 Jun 11 18:36:34.288422 ip-10-0-141-55 kubenswrapper[2578]: W0611 18:36:34.283326 2578 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jun 11 18:36:34.288422 ip-10-0-141-55 kubenswrapper[2578]: W0611 18:36:34.283328 2578 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jun 11 18:36:34.288422 ip-10-0-141-55 kubenswrapper[2578]: W0611 18:36:34.283331 2578 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jun 11 18:36:34.288422 ip-10-0-141-55 kubenswrapper[2578]: W0611 18:36:34.283333 2578 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jun 11 18:36:34.288422 ip-10-0-141-55 kubenswrapper[2578]: W0611 18:36:34.283336 2578 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jun 11 18:36:34.288422 ip-10-0-141-55 kubenswrapper[2578]: W0611 18:36:34.283341 2578 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jun 11 18:36:34.288422 ip-10-0-141-55 kubenswrapper[2578]: W0611 18:36:34.283344 2578 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jun 11 18:36:34.288422 ip-10-0-141-55 kubenswrapper[2578]: W0611 18:36:34.283347 2578 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jun 11 18:36:34.288422 ip-10-0-141-55 kubenswrapper[2578]: W0611 18:36:34.283350 2578 feature_gate.go:328] unrecognized feature gate: OSStreams Jun 11 18:36:34.288422 ip-10-0-141-55 kubenswrapper[2578]: W0611 18:36:34.283353 2578 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jun 11 18:36:34.288422 ip-10-0-141-55 kubenswrapper[2578]: W0611 18:36:34.283355 2578 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jun 11 18:36:34.288422 ip-10-0-141-55 kubenswrapper[2578]: W0611 18:36:34.283358 2578 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jun 11 18:36:34.288422 ip-10-0-141-55 kubenswrapper[2578]: W0611 18:36:34.283360 2578 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jun 11 18:36:34.288901 ip-10-0-141-55 kubenswrapper[2578]: W0611 18:36:34.283364 2578 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jun 11 18:36:34.288901 ip-10-0-141-55 kubenswrapper[2578]: I0611 18:36:34.283430 2578 flags.go:64] FLAG: --address="0.0.0.0" Jun 11 18:36:34.288901 ip-10-0-141-55 kubenswrapper[2578]: I0611 18:36:34.283441 2578 flags.go:64] FLAG: --allowed-unsafe-sysctls="[]" Jun 11 18:36:34.288901 ip-10-0-141-55 kubenswrapper[2578]: I0611 18:36:34.283447 2578 flags.go:64] FLAG: --anonymous-auth="true" Jun 11 18:36:34.288901 ip-10-0-141-55 kubenswrapper[2578]: I0611 18:36:34.283451 2578 flags.go:64] FLAG: --application-metrics-count-limit="100" Jun 11 18:36:34.288901 ip-10-0-141-55 kubenswrapper[2578]: I0611 18:36:34.283455 2578 flags.go:64] FLAG: --authentication-token-webhook="false" Jun 11 18:36:34.288901 ip-10-0-141-55 kubenswrapper[2578]: I0611 18:36:34.283458 2578 flags.go:64] FLAG: --authentication-token-webhook-cache-ttl="2m0s" Jun 11 18:36:34.288901 ip-10-0-141-55 kubenswrapper[2578]: I0611 18:36:34.283462 2578 flags.go:64] FLAG: --authorization-mode="AlwaysAllow" Jun 11 18:36:34.288901 ip-10-0-141-55 kubenswrapper[2578]: I0611 18:36:34.283466 2578 flags.go:64] FLAG: --authorization-webhook-cache-authorized-ttl="5m0s" Jun 11 18:36:34.288901 ip-10-0-141-55 kubenswrapper[2578]: I0611 18:36:34.283469 2578 flags.go:64] FLAG: --authorization-webhook-cache-unauthorized-ttl="30s" Jun 11 18:36:34.288901 ip-10-0-141-55 kubenswrapper[2578]: I0611 18:36:34.283472 2578 flags.go:64] FLAG: --boot-id-file="/proc/sys/kernel/random/boot_id" Jun 11 18:36:34.288901 ip-10-0-141-55 kubenswrapper[2578]: I0611 18:36:34.283475 2578 flags.go:64] FLAG: --bootstrap-kubeconfig="/etc/kubernetes/kubeconfig" Jun 11 18:36:34.288901 ip-10-0-141-55 kubenswrapper[2578]: I0611 18:36:34.283478 2578 flags.go:64] FLAG: --cert-dir="/var/lib/kubelet/pki" Jun 11 18:36:34.288901 ip-10-0-141-55 kubenswrapper[2578]: I0611 18:36:34.283483 2578 flags.go:64] FLAG: --cgroup-driver="cgroupfs" Jun 11 18:36:34.288901 ip-10-0-141-55 kubenswrapper[2578]: I0611 18:36:34.283487 2578 flags.go:64] FLAG: --cgroup-root="" Jun 11 18:36:34.288901 ip-10-0-141-55 kubenswrapper[2578]: I0611 18:36:34.283490 2578 flags.go:64] FLAG: --cgroups-per-qos="true" Jun 11 18:36:34.288901 ip-10-0-141-55 kubenswrapper[2578]: I0611 18:36:34.283493 2578 flags.go:64] FLAG: --client-ca-file="" Jun 11 18:36:34.288901 ip-10-0-141-55 kubenswrapper[2578]: I0611 18:36:34.283496 2578 flags.go:64] FLAG: --cloud-provider="external" Jun 11 18:36:34.288901 ip-10-0-141-55 kubenswrapper[2578]: I0611 18:36:34.283499 2578 flags.go:64] FLAG: --cluster-dns="[]" Jun 11 18:36:34.288901 ip-10-0-141-55 kubenswrapper[2578]: I0611 18:36:34.283503 2578 flags.go:64] FLAG: --cluster-domain="" Jun 11 18:36:34.288901 ip-10-0-141-55 kubenswrapper[2578]: I0611 18:36:34.283506 2578 flags.go:64] FLAG: --config="/etc/kubernetes/kubelet.conf" Jun 11 18:36:34.288901 ip-10-0-141-55 kubenswrapper[2578]: I0611 18:36:34.283509 2578 flags.go:64] FLAG: --config-dir="/etc/openshift/kubelet.conf.d" Jun 11 18:36:34.288901 ip-10-0-141-55 kubenswrapper[2578]: I0611 18:36:34.283512 2578 flags.go:64] FLAG: --container-hints="/etc/cadvisor/container_hints.json" Jun 11 18:36:34.289453 ip-10-0-141-55 kubenswrapper[2578]: I0611 18:36:34.283516 2578 flags.go:64] FLAG: --container-log-max-files="5" Jun 11 18:36:34.289453 ip-10-0-141-55 kubenswrapper[2578]: I0611 18:36:34.283522 2578 flags.go:64] FLAG: --container-log-max-size="10Mi" Jun 11 18:36:34.289453 ip-10-0-141-55 kubenswrapper[2578]: I0611 18:36:34.283525 2578 flags.go:64] FLAG: --container-runtime-endpoint="/var/run/crio/crio.sock" Jun 11 18:36:34.289453 ip-10-0-141-55 kubenswrapper[2578]: I0611 18:36:34.283529 2578 flags.go:64] FLAG: --containerd="/run/containerd/containerd.sock" Jun 11 18:36:34.289453 ip-10-0-141-55 kubenswrapper[2578]: I0611 18:36:34.283532 2578 flags.go:64] FLAG: --containerd-namespace="k8s.io" Jun 11 18:36:34.289453 ip-10-0-141-55 kubenswrapper[2578]: I0611 18:36:34.283535 2578 flags.go:64] FLAG: --contention-profiling="false" Jun 11 18:36:34.289453 ip-10-0-141-55 kubenswrapper[2578]: I0611 18:36:34.283538 2578 flags.go:64] FLAG: --cpu-cfs-quota="true" Jun 11 18:36:34.289453 ip-10-0-141-55 kubenswrapper[2578]: I0611 18:36:34.283541 2578 flags.go:64] FLAG: --cpu-cfs-quota-period="100ms" Jun 11 18:36:34.289453 ip-10-0-141-55 kubenswrapper[2578]: I0611 18:36:34.283544 2578 flags.go:64] FLAG: --cpu-manager-policy="none" Jun 11 18:36:34.289453 ip-10-0-141-55 kubenswrapper[2578]: I0611 18:36:34.283547 2578 flags.go:64] FLAG: --cpu-manager-policy-options="" Jun 11 18:36:34.289453 ip-10-0-141-55 kubenswrapper[2578]: I0611 18:36:34.283564 2578 flags.go:64] FLAG: --cpu-manager-reconcile-period="10s" Jun 11 18:36:34.289453 ip-10-0-141-55 kubenswrapper[2578]: I0611 18:36:34.283567 2578 flags.go:64] FLAG: --enable-controller-attach-detach="true" Jun 11 18:36:34.289453 ip-10-0-141-55 kubenswrapper[2578]: I0611 18:36:34.283571 2578 flags.go:64] FLAG: --enable-debugging-handlers="true" Jun 11 18:36:34.289453 ip-10-0-141-55 kubenswrapper[2578]: I0611 18:36:34.283573 2578 flags.go:64] FLAG: --enable-load-reader="false" Jun 11 18:36:34.289453 ip-10-0-141-55 kubenswrapper[2578]: I0611 18:36:34.283577 2578 flags.go:64] FLAG: --enable-server="true" Jun 11 18:36:34.289453 ip-10-0-141-55 kubenswrapper[2578]: I0611 18:36:34.283580 2578 flags.go:64] FLAG: --enforce-node-allocatable="[pods]" Jun 11 18:36:34.289453 ip-10-0-141-55 kubenswrapper[2578]: I0611 18:36:34.283584 2578 flags.go:64] FLAG: --event-burst="100" Jun 11 18:36:34.289453 ip-10-0-141-55 kubenswrapper[2578]: I0611 18:36:34.283587 2578 flags.go:64] FLAG: --event-qps="50" Jun 11 18:36:34.289453 ip-10-0-141-55 kubenswrapper[2578]: I0611 18:36:34.283590 2578 flags.go:64] FLAG: --event-storage-age-limit="default=0" Jun 11 18:36:34.289453 ip-10-0-141-55 kubenswrapper[2578]: I0611 18:36:34.283593 2578 flags.go:64] FLAG: --event-storage-event-limit="default=0" Jun 11 18:36:34.289453 ip-10-0-141-55 kubenswrapper[2578]: I0611 18:36:34.283596 2578 flags.go:64] FLAG: --eviction-hard="" Jun 11 18:36:34.289453 ip-10-0-141-55 kubenswrapper[2578]: I0611 18:36:34.283600 2578 flags.go:64] FLAG: --eviction-max-pod-grace-period="0" Jun 11 18:36:34.289453 ip-10-0-141-55 kubenswrapper[2578]: I0611 18:36:34.283604 2578 flags.go:64] FLAG: --eviction-minimum-reclaim="" Jun 11 18:36:34.289453 ip-10-0-141-55 kubenswrapper[2578]: I0611 18:36:34.283607 2578 flags.go:64] FLAG: --eviction-pressure-transition-period="5m0s" Jun 11 18:36:34.289453 ip-10-0-141-55 kubenswrapper[2578]: I0611 18:36:34.283610 2578 flags.go:64] FLAG: --eviction-soft="" Jun 11 18:36:34.290117 ip-10-0-141-55 kubenswrapper[2578]: I0611 18:36:34.283613 2578 flags.go:64] FLAG: --eviction-soft-grace-period="" Jun 11 18:36:34.290117 ip-10-0-141-55 kubenswrapper[2578]: I0611 18:36:34.283616 2578 flags.go:64] FLAG: --exit-on-lock-contention="false" Jun 11 18:36:34.290117 ip-10-0-141-55 kubenswrapper[2578]: I0611 18:36:34.283618 2578 flags.go:64] FLAG: --experimental-allocatable-ignore-eviction="false" Jun 11 18:36:34.290117 ip-10-0-141-55 kubenswrapper[2578]: I0611 18:36:34.283621 2578 flags.go:64] FLAG: --experimental-mounter-path="" Jun 11 18:36:34.290117 ip-10-0-141-55 kubenswrapper[2578]: I0611 18:36:34.283624 2578 flags.go:64] FLAG: --fail-cgroupv1="false" Jun 11 18:36:34.290117 ip-10-0-141-55 kubenswrapper[2578]: I0611 18:36:34.283627 2578 flags.go:64] FLAG: --fail-swap-on="true" Jun 11 18:36:34.290117 ip-10-0-141-55 kubenswrapper[2578]: I0611 18:36:34.283630 2578 flags.go:64] FLAG: --feature-gates="" Jun 11 18:36:34.290117 ip-10-0-141-55 kubenswrapper[2578]: I0611 18:36:34.283634 2578 flags.go:64] FLAG: --file-check-frequency="20s" Jun 11 18:36:34.290117 ip-10-0-141-55 kubenswrapper[2578]: I0611 18:36:34.283638 2578 flags.go:64] FLAG: --global-housekeeping-interval="1m0s" Jun 11 18:36:34.290117 ip-10-0-141-55 kubenswrapper[2578]: I0611 18:36:34.283641 2578 flags.go:64] FLAG: --hairpin-mode="promiscuous-bridge" Jun 11 18:36:34.290117 ip-10-0-141-55 kubenswrapper[2578]: I0611 18:36:34.283644 2578 flags.go:64] FLAG: --healthz-bind-address="127.0.0.1" Jun 11 18:36:34.290117 ip-10-0-141-55 kubenswrapper[2578]: I0611 18:36:34.283647 2578 flags.go:64] FLAG: --healthz-port="10248" Jun 11 18:36:34.290117 ip-10-0-141-55 kubenswrapper[2578]: I0611 18:36:34.283650 2578 flags.go:64] FLAG: --help="false" Jun 11 18:36:34.290117 ip-10-0-141-55 kubenswrapper[2578]: I0611 18:36:34.283653 2578 flags.go:64] FLAG: --hostname-override="ip-10-0-141-55.ec2.internal" Jun 11 18:36:34.290117 ip-10-0-141-55 kubenswrapper[2578]: I0611 18:36:34.283656 2578 flags.go:64] FLAG: --housekeeping-interval="10s" Jun 11 18:36:34.290117 ip-10-0-141-55 kubenswrapper[2578]: I0611 18:36:34.283659 2578 flags.go:64] FLAG: --http-check-frequency="20s" Jun 11 18:36:34.290117 ip-10-0-141-55 kubenswrapper[2578]: I0611 18:36:34.283662 2578 flags.go:64] FLAG: --image-credential-provider-bin-dir="/usr/libexec/kubelet-image-credential-provider-plugins" Jun 11 18:36:34.290117 ip-10-0-141-55 kubenswrapper[2578]: I0611 18:36:34.283665 2578 flags.go:64] FLAG: --image-credential-provider-config="/etc/kubernetes/credential-providers/ecr-credential-provider.yaml" Jun 11 18:36:34.290117 ip-10-0-141-55 kubenswrapper[2578]: I0611 18:36:34.283669 2578 flags.go:64] FLAG: --image-gc-high-threshold="85" Jun 11 18:36:34.290117 ip-10-0-141-55 kubenswrapper[2578]: I0611 18:36:34.283672 2578 flags.go:64] FLAG: --image-gc-low-threshold="80" Jun 11 18:36:34.290117 ip-10-0-141-55 kubenswrapper[2578]: I0611 18:36:34.283674 2578 flags.go:64] FLAG: --image-service-endpoint="" Jun 11 18:36:34.290117 ip-10-0-141-55 kubenswrapper[2578]: I0611 18:36:34.283677 2578 flags.go:64] FLAG: --kernel-memcg-notification="false" Jun 11 18:36:34.290117 ip-10-0-141-55 kubenswrapper[2578]: I0611 18:36:34.283680 2578 flags.go:64] FLAG: --kube-api-burst="100" Jun 11 18:36:34.291053 ip-10-0-141-55 kubenswrapper[2578]: I0611 18:36:34.283682 2578 flags.go:64] FLAG: --kube-api-content-type="application/vnd.kubernetes.protobuf" Jun 11 18:36:34.291053 ip-10-0-141-55 kubenswrapper[2578]: I0611 18:36:34.283686 2578 flags.go:64] FLAG: --kube-api-qps="50" Jun 11 18:36:34.291053 ip-10-0-141-55 kubenswrapper[2578]: I0611 18:36:34.283689 2578 flags.go:64] FLAG: --kube-reserved="" Jun 11 18:36:34.291053 ip-10-0-141-55 kubenswrapper[2578]: I0611 18:36:34.283692 2578 flags.go:64] FLAG: --kube-reserved-cgroup="" Jun 11 18:36:34.291053 ip-10-0-141-55 kubenswrapper[2578]: I0611 18:36:34.283694 2578 flags.go:64] FLAG: --kubeconfig="/var/lib/kubelet/kubeconfig" Jun 11 18:36:34.291053 ip-10-0-141-55 kubenswrapper[2578]: I0611 18:36:34.283697 2578 flags.go:64] FLAG: --kubelet-cgroups="" Jun 11 18:36:34.291053 ip-10-0-141-55 kubenswrapper[2578]: I0611 18:36:34.283702 2578 flags.go:64] FLAG: --local-storage-capacity-isolation="true" Jun 11 18:36:34.291053 ip-10-0-141-55 kubenswrapper[2578]: I0611 18:36:34.283705 2578 flags.go:64] FLAG: --lock-file="" Jun 11 18:36:34.291053 ip-10-0-141-55 kubenswrapper[2578]: I0611 18:36:34.283707 2578 flags.go:64] FLAG: --log-cadvisor-usage="false" Jun 11 18:36:34.291053 ip-10-0-141-55 kubenswrapper[2578]: I0611 18:36:34.283711 2578 flags.go:64] FLAG: --log-flush-frequency="5s" Jun 11 18:36:34.291053 ip-10-0-141-55 kubenswrapper[2578]: I0611 18:36:34.283714 2578 flags.go:64] FLAG: --log-json-info-buffer-size="0" Jun 11 18:36:34.291053 ip-10-0-141-55 kubenswrapper[2578]: I0611 18:36:34.283719 2578 flags.go:64] FLAG: --log-json-split-stream="false" Jun 11 18:36:34.291053 ip-10-0-141-55 kubenswrapper[2578]: I0611 18:36:34.283722 2578 flags.go:64] FLAG: --log-text-info-buffer-size="0" Jun 11 18:36:34.291053 ip-10-0-141-55 kubenswrapper[2578]: I0611 18:36:34.283725 2578 flags.go:64] FLAG: --log-text-split-stream="false" Jun 11 18:36:34.291053 ip-10-0-141-55 kubenswrapper[2578]: I0611 18:36:34.283727 2578 flags.go:64] FLAG: --logging-format="text" Jun 11 18:36:34.291053 ip-10-0-141-55 kubenswrapper[2578]: I0611 18:36:34.283730 2578 flags.go:64] FLAG: --machine-id-file="/etc/machine-id,/var/lib/dbus/machine-id" Jun 11 18:36:34.291053 ip-10-0-141-55 kubenswrapper[2578]: I0611 18:36:34.283734 2578 flags.go:64] FLAG: --make-iptables-util-chains="true" Jun 11 18:36:34.291053 ip-10-0-141-55 kubenswrapper[2578]: I0611 18:36:34.283737 2578 flags.go:64] FLAG: --manifest-url="" Jun 11 18:36:34.291053 ip-10-0-141-55 kubenswrapper[2578]: I0611 18:36:34.283740 2578 flags.go:64] FLAG: --manifest-url-header="" Jun 11 18:36:34.291053 ip-10-0-141-55 kubenswrapper[2578]: I0611 18:36:34.283744 2578 flags.go:64] FLAG: --max-housekeeping-interval="15s" Jun 11 18:36:34.291053 ip-10-0-141-55 kubenswrapper[2578]: I0611 18:36:34.283747 2578 flags.go:64] FLAG: --max-open-files="1000000" Jun 11 18:36:34.291053 ip-10-0-141-55 kubenswrapper[2578]: I0611 18:36:34.283751 2578 flags.go:64] FLAG: --max-pods="110" Jun 11 18:36:34.291053 ip-10-0-141-55 kubenswrapper[2578]: I0611 18:36:34.283754 2578 flags.go:64] FLAG: --maximum-dead-containers="-1" Jun 11 18:36:34.291053 ip-10-0-141-55 kubenswrapper[2578]: I0611 18:36:34.283757 2578 flags.go:64] FLAG: --maximum-dead-containers-per-container="1" Jun 11 18:36:34.291053 ip-10-0-141-55 kubenswrapper[2578]: I0611 18:36:34.283760 2578 flags.go:64] FLAG: --memory-manager-policy="None" Jun 11 18:36:34.291683 ip-10-0-141-55 kubenswrapper[2578]: I0611 18:36:34.283763 2578 flags.go:64] FLAG: --minimum-container-ttl-duration="6m0s" Jun 11 18:36:34.291683 ip-10-0-141-55 kubenswrapper[2578]: I0611 18:36:34.283766 2578 flags.go:64] FLAG: --minimum-image-ttl-duration="2m0s" Jun 11 18:36:34.291683 ip-10-0-141-55 kubenswrapper[2578]: I0611 18:36:34.283769 2578 flags.go:64] FLAG: --node-ip="0.0.0.0" Jun 11 18:36:34.291683 ip-10-0-141-55 kubenswrapper[2578]: I0611 18:36:34.283772 2578 flags.go:64] FLAG: --node-labels="node-role.kubernetes.io/worker=,node.openshift.io/os_id=rhel" Jun 11 18:36:34.291683 ip-10-0-141-55 kubenswrapper[2578]: I0611 18:36:34.283779 2578 flags.go:64] FLAG: --node-status-max-images="50" Jun 11 18:36:34.291683 ip-10-0-141-55 kubenswrapper[2578]: I0611 18:36:34.283782 2578 flags.go:64] FLAG: --node-status-update-frequency="10s" Jun 11 18:36:34.291683 ip-10-0-141-55 kubenswrapper[2578]: I0611 18:36:34.283785 2578 flags.go:64] FLAG: --oom-score-adj="-999" Jun 11 18:36:34.291683 ip-10-0-141-55 kubenswrapper[2578]: I0611 18:36:34.283788 2578 flags.go:64] FLAG: --pod-cidr="" Jun 11 18:36:34.291683 ip-10-0-141-55 kubenswrapper[2578]: I0611 18:36:34.283791 2578 flags.go:64] FLAG: --pod-infra-container-image="quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:4a2e90c8ef7d783e4d635e24fb09435f5e1f6e954583512c0944f9e57bc77b52" Jun 11 18:36:34.291683 ip-10-0-141-55 kubenswrapper[2578]: I0611 18:36:34.283796 2578 flags.go:64] FLAG: --pod-manifest-path="" Jun 11 18:36:34.291683 ip-10-0-141-55 kubenswrapper[2578]: I0611 18:36:34.283799 2578 flags.go:64] FLAG: --pod-max-pids="-1" Jun 11 18:36:34.291683 ip-10-0-141-55 kubenswrapper[2578]: I0611 18:36:34.283802 2578 flags.go:64] FLAG: --pods-per-core="0" Jun 11 18:36:34.291683 ip-10-0-141-55 kubenswrapper[2578]: I0611 18:36:34.283805 2578 flags.go:64] FLAG: --port="10250" Jun 11 18:36:34.291683 ip-10-0-141-55 kubenswrapper[2578]: I0611 18:36:34.283808 2578 flags.go:64] FLAG: --protect-kernel-defaults="false" Jun 11 18:36:34.291683 ip-10-0-141-55 kubenswrapper[2578]: I0611 18:36:34.283825 2578 flags.go:64] FLAG: --provider-id="aws:///us-east-1a/i-030a16b8b0456b1f3" Jun 11 18:36:34.291683 ip-10-0-141-55 kubenswrapper[2578]: I0611 18:36:34.283829 2578 flags.go:64] FLAG: --qos-reserved="" Jun 11 18:36:34.291683 ip-10-0-141-55 kubenswrapper[2578]: I0611 18:36:34.283832 2578 flags.go:64] FLAG: --read-only-port="10255" Jun 11 18:36:34.291683 ip-10-0-141-55 kubenswrapper[2578]: I0611 18:36:34.283836 2578 flags.go:64] FLAG: --register-node="true" Jun 11 18:36:34.291683 ip-10-0-141-55 kubenswrapper[2578]: I0611 18:36:34.283840 2578 flags.go:64] FLAG: --register-with-taints="" Jun 11 18:36:34.291683 ip-10-0-141-55 kubenswrapper[2578]: I0611 18:36:34.283843 2578 flags.go:64] FLAG: --registry-burst="10" Jun 11 18:36:34.291683 ip-10-0-141-55 kubenswrapper[2578]: I0611 18:36:34.283846 2578 flags.go:64] FLAG: --registry-qps="5" Jun 11 18:36:34.291683 ip-10-0-141-55 kubenswrapper[2578]: I0611 18:36:34.283849 2578 flags.go:64] FLAG: --reserved-cpus="" Jun 11 18:36:34.291683 ip-10-0-141-55 kubenswrapper[2578]: I0611 18:36:34.283852 2578 flags.go:64] FLAG: --reserved-memory="" Jun 11 18:36:34.291683 ip-10-0-141-55 kubenswrapper[2578]: I0611 18:36:34.283856 2578 flags.go:64] FLAG: --resolv-conf="/etc/resolv.conf" Jun 11 18:36:34.291683 ip-10-0-141-55 kubenswrapper[2578]: I0611 18:36:34.283859 2578 flags.go:64] FLAG: --root-dir="/var/lib/kubelet" Jun 11 18:36:34.292291 ip-10-0-141-55 kubenswrapper[2578]: I0611 18:36:34.283862 2578 flags.go:64] FLAG: --rotate-certificates="false" Jun 11 18:36:34.292291 ip-10-0-141-55 kubenswrapper[2578]: I0611 18:36:34.283865 2578 flags.go:64] FLAG: --rotate-server-certificates="false" Jun 11 18:36:34.292291 ip-10-0-141-55 kubenswrapper[2578]: I0611 18:36:34.283868 2578 flags.go:64] FLAG: --runonce="false" Jun 11 18:36:34.292291 ip-10-0-141-55 kubenswrapper[2578]: I0611 18:36:34.283871 2578 flags.go:64] FLAG: --runtime-cgroups="/system.slice/crio.service" Jun 11 18:36:34.292291 ip-10-0-141-55 kubenswrapper[2578]: I0611 18:36:34.283874 2578 flags.go:64] FLAG: --runtime-request-timeout="2m0s" Jun 11 18:36:34.292291 ip-10-0-141-55 kubenswrapper[2578]: I0611 18:36:34.283877 2578 flags.go:64] FLAG: --seccomp-default="false" Jun 11 18:36:34.292291 ip-10-0-141-55 kubenswrapper[2578]: I0611 18:36:34.283880 2578 flags.go:64] FLAG: --serialize-image-pulls="true" Jun 11 18:36:34.292291 ip-10-0-141-55 kubenswrapper[2578]: I0611 18:36:34.283883 2578 flags.go:64] FLAG: --storage-driver-buffer-duration="1m0s" Jun 11 18:36:34.292291 ip-10-0-141-55 kubenswrapper[2578]: I0611 18:36:34.283886 2578 flags.go:64] FLAG: --storage-driver-db="cadvisor" Jun 11 18:36:34.292291 ip-10-0-141-55 kubenswrapper[2578]: I0611 18:36:34.283889 2578 flags.go:64] FLAG: --storage-driver-host="localhost:8086" Jun 11 18:36:34.292291 ip-10-0-141-55 kubenswrapper[2578]: I0611 18:36:34.283892 2578 flags.go:64] FLAG: --storage-driver-password="root" Jun 11 18:36:34.292291 ip-10-0-141-55 kubenswrapper[2578]: I0611 18:36:34.283895 2578 flags.go:64] FLAG: --storage-driver-secure="false" Jun 11 18:36:34.292291 ip-10-0-141-55 kubenswrapper[2578]: I0611 18:36:34.283898 2578 flags.go:64] FLAG: --storage-driver-table="stats" Jun 11 18:36:34.292291 ip-10-0-141-55 kubenswrapper[2578]: I0611 18:36:34.283901 2578 flags.go:64] FLAG: --storage-driver-user="root" Jun 11 18:36:34.292291 ip-10-0-141-55 kubenswrapper[2578]: I0611 18:36:34.283903 2578 flags.go:64] FLAG: --streaming-connection-idle-timeout="4h0m0s" Jun 11 18:36:34.292291 ip-10-0-141-55 kubenswrapper[2578]: I0611 18:36:34.283906 2578 flags.go:64] FLAG: --sync-frequency="1m0s" Jun 11 18:36:34.292291 ip-10-0-141-55 kubenswrapper[2578]: I0611 18:36:34.283909 2578 flags.go:64] FLAG: --system-cgroups="" Jun 11 18:36:34.292291 ip-10-0-141-55 kubenswrapper[2578]: I0611 18:36:34.283912 2578 flags.go:64] FLAG: --system-reserved="cpu=500m,ephemeral-storage=1Gi,memory=1Gi" Jun 11 18:36:34.292291 ip-10-0-141-55 kubenswrapper[2578]: I0611 18:36:34.283917 2578 flags.go:64] FLAG: --system-reserved-cgroup="" Jun 11 18:36:34.292291 ip-10-0-141-55 kubenswrapper[2578]: I0611 18:36:34.283920 2578 flags.go:64] FLAG: --tls-cert-file="" Jun 11 18:36:34.292291 ip-10-0-141-55 kubenswrapper[2578]: I0611 18:36:34.283923 2578 flags.go:64] FLAG: --tls-cipher-suites="[]" Jun 11 18:36:34.292291 ip-10-0-141-55 kubenswrapper[2578]: I0611 18:36:34.283935 2578 flags.go:64] FLAG: --tls-min-version="" Jun 11 18:36:34.292291 ip-10-0-141-55 kubenswrapper[2578]: I0611 18:36:34.283937 2578 flags.go:64] FLAG: --tls-private-key-file="" Jun 11 18:36:34.292291 ip-10-0-141-55 kubenswrapper[2578]: I0611 18:36:34.283940 2578 flags.go:64] FLAG: --topology-manager-policy="none" Jun 11 18:36:34.292291 ip-10-0-141-55 kubenswrapper[2578]: I0611 18:36:34.283943 2578 flags.go:64] FLAG: --topology-manager-policy-options="" Jun 11 18:36:34.292919 ip-10-0-141-55 kubenswrapper[2578]: I0611 18:36:34.283946 2578 flags.go:64] FLAG: --topology-manager-scope="container" Jun 11 18:36:34.292919 ip-10-0-141-55 kubenswrapper[2578]: I0611 18:36:34.283949 2578 flags.go:64] FLAG: --v="2" Jun 11 18:36:34.292919 ip-10-0-141-55 kubenswrapper[2578]: I0611 18:36:34.283957 2578 flags.go:64] FLAG: --version="false" Jun 11 18:36:34.292919 ip-10-0-141-55 kubenswrapper[2578]: I0611 18:36:34.283961 2578 flags.go:64] FLAG: --vmodule="" Jun 11 18:36:34.292919 ip-10-0-141-55 kubenswrapper[2578]: I0611 18:36:34.283965 2578 flags.go:64] FLAG: --volume-plugin-dir="/etc/kubernetes/kubelet-plugins/volume/exec" Jun 11 18:36:34.292919 ip-10-0-141-55 kubenswrapper[2578]: I0611 18:36:34.283968 2578 flags.go:64] FLAG: --volume-stats-agg-period="1m0s" Jun 11 18:36:34.292919 ip-10-0-141-55 kubenswrapper[2578]: W0611 18:36:34.284080 2578 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jun 11 18:36:34.292919 ip-10-0-141-55 kubenswrapper[2578]: W0611 18:36:34.284084 2578 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jun 11 18:36:34.292919 ip-10-0-141-55 kubenswrapper[2578]: W0611 18:36:34.284087 2578 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jun 11 18:36:34.292919 ip-10-0-141-55 kubenswrapper[2578]: W0611 18:36:34.284090 2578 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jun 11 18:36:34.292919 ip-10-0-141-55 kubenswrapper[2578]: W0611 18:36:34.284093 2578 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jun 11 18:36:34.292919 ip-10-0-141-55 kubenswrapper[2578]: W0611 18:36:34.284097 2578 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jun 11 18:36:34.292919 ip-10-0-141-55 kubenswrapper[2578]: W0611 18:36:34.284100 2578 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jun 11 18:36:34.292919 ip-10-0-141-55 kubenswrapper[2578]: W0611 18:36:34.284102 2578 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jun 11 18:36:34.292919 ip-10-0-141-55 kubenswrapper[2578]: W0611 18:36:34.284105 2578 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jun 11 18:36:34.292919 ip-10-0-141-55 kubenswrapper[2578]: W0611 18:36:34.284108 2578 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jun 11 18:36:34.292919 ip-10-0-141-55 kubenswrapper[2578]: W0611 18:36:34.284110 2578 feature_gate.go:328] unrecognized feature gate: PinnedImages Jun 11 18:36:34.292919 ip-10-0-141-55 kubenswrapper[2578]: W0611 18:36:34.284113 2578 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jun 11 18:36:34.292919 ip-10-0-141-55 kubenswrapper[2578]: W0611 18:36:34.284116 2578 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jun 11 18:36:34.292919 ip-10-0-141-55 kubenswrapper[2578]: W0611 18:36:34.284118 2578 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jun 11 18:36:34.292919 ip-10-0-141-55 kubenswrapper[2578]: W0611 18:36:34.284121 2578 feature_gate.go:328] unrecognized feature gate: NewOLM Jun 11 18:36:34.293440 ip-10-0-141-55 kubenswrapper[2578]: W0611 18:36:34.284123 2578 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jun 11 18:36:34.293440 ip-10-0-141-55 kubenswrapper[2578]: W0611 18:36:34.284126 2578 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jun 11 18:36:34.293440 ip-10-0-141-55 kubenswrapper[2578]: W0611 18:36:34.284129 2578 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jun 11 18:36:34.293440 ip-10-0-141-55 kubenswrapper[2578]: W0611 18:36:34.284131 2578 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jun 11 18:36:34.293440 ip-10-0-141-55 kubenswrapper[2578]: W0611 18:36:34.284135 2578 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jun 11 18:36:34.293440 ip-10-0-141-55 kubenswrapper[2578]: W0611 18:36:34.284139 2578 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jun 11 18:36:34.293440 ip-10-0-141-55 kubenswrapper[2578]: W0611 18:36:34.284142 2578 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jun 11 18:36:34.293440 ip-10-0-141-55 kubenswrapper[2578]: W0611 18:36:34.284146 2578 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jun 11 18:36:34.293440 ip-10-0-141-55 kubenswrapper[2578]: W0611 18:36:34.284149 2578 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jun 11 18:36:34.293440 ip-10-0-141-55 kubenswrapper[2578]: W0611 18:36:34.284152 2578 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jun 11 18:36:34.293440 ip-10-0-141-55 kubenswrapper[2578]: W0611 18:36:34.284155 2578 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jun 11 18:36:34.293440 ip-10-0-141-55 kubenswrapper[2578]: W0611 18:36:34.284158 2578 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jun 11 18:36:34.293440 ip-10-0-141-55 kubenswrapper[2578]: W0611 18:36:34.284161 2578 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jun 11 18:36:34.293440 ip-10-0-141-55 kubenswrapper[2578]: W0611 18:36:34.284164 2578 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jun 11 18:36:34.293440 ip-10-0-141-55 kubenswrapper[2578]: W0611 18:36:34.284166 2578 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jun 11 18:36:34.293440 ip-10-0-141-55 kubenswrapper[2578]: W0611 18:36:34.284170 2578 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jun 11 18:36:34.293440 ip-10-0-141-55 kubenswrapper[2578]: W0611 18:36:34.284174 2578 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jun 11 18:36:34.293440 ip-10-0-141-55 kubenswrapper[2578]: W0611 18:36:34.284178 2578 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jun 11 18:36:34.293951 ip-10-0-141-55 kubenswrapper[2578]: W0611 18:36:34.284181 2578 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jun 11 18:36:34.293951 ip-10-0-141-55 kubenswrapper[2578]: W0611 18:36:34.284184 2578 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jun 11 18:36:34.293951 ip-10-0-141-55 kubenswrapper[2578]: W0611 18:36:34.284187 2578 feature_gate.go:328] unrecognized feature gate: OVNObservability Jun 11 18:36:34.293951 ip-10-0-141-55 kubenswrapper[2578]: W0611 18:36:34.284190 2578 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jun 11 18:36:34.293951 ip-10-0-141-55 kubenswrapper[2578]: W0611 18:36:34.284192 2578 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jun 11 18:36:34.293951 ip-10-0-141-55 kubenswrapper[2578]: W0611 18:36:34.284195 2578 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jun 11 18:36:34.293951 ip-10-0-141-55 kubenswrapper[2578]: W0611 18:36:34.284197 2578 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jun 11 18:36:34.293951 ip-10-0-141-55 kubenswrapper[2578]: W0611 18:36:34.284200 2578 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jun 11 18:36:34.293951 ip-10-0-141-55 kubenswrapper[2578]: W0611 18:36:34.284202 2578 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jun 11 18:36:34.293951 ip-10-0-141-55 kubenswrapper[2578]: W0611 18:36:34.284205 2578 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jun 11 18:36:34.293951 ip-10-0-141-55 kubenswrapper[2578]: W0611 18:36:34.284207 2578 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jun 11 18:36:34.293951 ip-10-0-141-55 kubenswrapper[2578]: W0611 18:36:34.284210 2578 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jun 11 18:36:34.293951 ip-10-0-141-55 kubenswrapper[2578]: W0611 18:36:34.284213 2578 feature_gate.go:328] unrecognized feature gate: EventTTL Jun 11 18:36:34.293951 ip-10-0-141-55 kubenswrapper[2578]: W0611 18:36:34.284215 2578 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jun 11 18:36:34.293951 ip-10-0-141-55 kubenswrapper[2578]: W0611 18:36:34.284218 2578 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jun 11 18:36:34.293951 ip-10-0-141-55 kubenswrapper[2578]: W0611 18:36:34.284220 2578 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jun 11 18:36:34.293951 ip-10-0-141-55 kubenswrapper[2578]: W0611 18:36:34.284223 2578 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jun 11 18:36:34.293951 ip-10-0-141-55 kubenswrapper[2578]: W0611 18:36:34.284226 2578 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jun 11 18:36:34.293951 ip-10-0-141-55 kubenswrapper[2578]: W0611 18:36:34.284228 2578 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jun 11 18:36:34.293951 ip-10-0-141-55 kubenswrapper[2578]: W0611 18:36:34.284231 2578 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jun 11 18:36:34.294467 ip-10-0-141-55 kubenswrapper[2578]: W0611 18:36:34.284233 2578 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jun 11 18:36:34.294467 ip-10-0-141-55 kubenswrapper[2578]: W0611 18:36:34.284237 2578 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jun 11 18:36:34.294467 ip-10-0-141-55 kubenswrapper[2578]: W0611 18:36:34.284240 2578 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jun 11 18:36:34.294467 ip-10-0-141-55 kubenswrapper[2578]: W0611 18:36:34.284242 2578 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jun 11 18:36:34.294467 ip-10-0-141-55 kubenswrapper[2578]: W0611 18:36:34.284245 2578 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jun 11 18:36:34.294467 ip-10-0-141-55 kubenswrapper[2578]: W0611 18:36:34.284247 2578 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jun 11 18:36:34.294467 ip-10-0-141-55 kubenswrapper[2578]: W0611 18:36:34.284250 2578 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jun 11 18:36:34.294467 ip-10-0-141-55 kubenswrapper[2578]: W0611 18:36:34.284253 2578 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jun 11 18:36:34.294467 ip-10-0-141-55 kubenswrapper[2578]: W0611 18:36:34.284256 2578 feature_gate.go:328] unrecognized feature gate: Example2 Jun 11 18:36:34.294467 ip-10-0-141-55 kubenswrapper[2578]: W0611 18:36:34.284258 2578 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jun 11 18:36:34.294467 ip-10-0-141-55 kubenswrapper[2578]: W0611 18:36:34.284261 2578 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jun 11 18:36:34.294467 ip-10-0-141-55 kubenswrapper[2578]: W0611 18:36:34.284265 2578 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jun 11 18:36:34.294467 ip-10-0-141-55 kubenswrapper[2578]: W0611 18:36:34.284268 2578 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jun 11 18:36:34.294467 ip-10-0-141-55 kubenswrapper[2578]: W0611 18:36:34.284271 2578 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jun 11 18:36:34.294467 ip-10-0-141-55 kubenswrapper[2578]: W0611 18:36:34.284273 2578 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jun 11 18:36:34.294467 ip-10-0-141-55 kubenswrapper[2578]: W0611 18:36:34.284275 2578 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jun 11 18:36:34.294467 ip-10-0-141-55 kubenswrapper[2578]: W0611 18:36:34.284278 2578 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jun 11 18:36:34.294467 ip-10-0-141-55 kubenswrapper[2578]: W0611 18:36:34.284281 2578 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jun 11 18:36:34.294467 ip-10-0-141-55 kubenswrapper[2578]: W0611 18:36:34.284284 2578 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jun 11 18:36:34.294467 ip-10-0-141-55 kubenswrapper[2578]: W0611 18:36:34.284286 2578 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jun 11 18:36:34.294962 ip-10-0-141-55 kubenswrapper[2578]: W0611 18:36:34.284289 2578 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jun 11 18:36:34.294962 ip-10-0-141-55 kubenswrapper[2578]: W0611 18:36:34.284292 2578 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jun 11 18:36:34.294962 ip-10-0-141-55 kubenswrapper[2578]: W0611 18:36:34.284296 2578 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jun 11 18:36:34.294962 ip-10-0-141-55 kubenswrapper[2578]: W0611 18:36:34.284299 2578 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jun 11 18:36:34.294962 ip-10-0-141-55 kubenswrapper[2578]: W0611 18:36:34.284301 2578 feature_gate.go:328] unrecognized feature gate: OSStreams Jun 11 18:36:34.294962 ip-10-0-141-55 kubenswrapper[2578]: W0611 18:36:34.284304 2578 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jun 11 18:36:34.294962 ip-10-0-141-55 kubenswrapper[2578]: W0611 18:36:34.284306 2578 feature_gate.go:328] unrecognized feature gate: SignatureStores Jun 11 18:36:34.294962 ip-10-0-141-55 kubenswrapper[2578]: W0611 18:36:34.284309 2578 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jun 11 18:36:34.294962 ip-10-0-141-55 kubenswrapper[2578]: W0611 18:36:34.284311 2578 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jun 11 18:36:34.294962 ip-10-0-141-55 kubenswrapper[2578]: W0611 18:36:34.284314 2578 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jun 11 18:36:34.294962 ip-10-0-141-55 kubenswrapper[2578]: W0611 18:36:34.284316 2578 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jun 11 18:36:34.294962 ip-10-0-141-55 kubenswrapper[2578]: W0611 18:36:34.284319 2578 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jun 11 18:36:34.294962 ip-10-0-141-55 kubenswrapper[2578]: W0611 18:36:34.284321 2578 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jun 11 18:36:34.294962 ip-10-0-141-55 kubenswrapper[2578]: W0611 18:36:34.284325 2578 feature_gate.go:328] unrecognized feature gate: Example Jun 11 18:36:34.294962 ip-10-0-141-55 kubenswrapper[2578]: W0611 18:36:34.284328 2578 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jun 11 18:36:34.294962 ip-10-0-141-55 kubenswrapper[2578]: W0611 18:36:34.284330 2578 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jun 11 18:36:34.294962 ip-10-0-141-55 kubenswrapper[2578]: W0611 18:36:34.284333 2578 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jun 11 18:36:34.294962 ip-10-0-141-55 kubenswrapper[2578]: W0611 18:36:34.284335 2578 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jun 11 18:36:34.294962 ip-10-0-141-55 kubenswrapper[2578]: W0611 18:36:34.284338 2578 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jun 11 18:36:34.294962 ip-10-0-141-55 kubenswrapper[2578]: W0611 18:36:34.284341 2578 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jun 11 18:36:34.295452 ip-10-0-141-55 kubenswrapper[2578]: W0611 18:36:34.284344 2578 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jun 11 18:36:34.295452 ip-10-0-141-55 kubenswrapper[2578]: W0611 18:36:34.284346 2578 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jun 11 18:36:34.295452 ip-10-0-141-55 kubenswrapper[2578]: W0611 18:36:34.284348 2578 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jun 11 18:36:34.295452 ip-10-0-141-55 kubenswrapper[2578]: W0611 18:36:34.284352 2578 feature_gate.go:328] unrecognized feature gate: DualReplica Jun 11 18:36:34.295452 ip-10-0-141-55 kubenswrapper[2578]: W0611 18:36:34.284355 2578 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jun 11 18:36:34.295452 ip-10-0-141-55 kubenswrapper[2578]: W0611 18:36:34.284357 2578 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jun 11 18:36:34.295452 ip-10-0-141-55 kubenswrapper[2578]: I0611 18:36:34.284818 2578 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]} Jun 11 18:36:34.295452 ip-10-0-141-55 kubenswrapper[2578]: I0611 18:36:34.292346 2578 server.go:529] "Kubelet version" kubeletVersion="v1.34.8" Jun 11 18:36:34.295452 ip-10-0-141-55 kubenswrapper[2578]: I0611 18:36:34.292361 2578 server.go:531] "Golang settings" GOGC="" GOMAXPROCS="" GOTRACEBACK="" Jun 11 18:36:34.295452 ip-10-0-141-55 kubenswrapper[2578]: I0611 18:36:34.292380 2578 watchdog_linux.go:95] "Systemd watchdog is not enabled" Jun 11 18:36:34.295452 ip-10-0-141-55 kubenswrapper[2578]: I0611 18:36:34.292386 2578 watchdog_linux.go:137] "Systemd watchdog is not enabled or the interval is invalid, so health checking will not be started." Jun 11 18:36:34.295452 ip-10-0-141-55 kubenswrapper[2578]: W0611 18:36:34.292443 2578 feature_gate.go:328] unrecognized feature gate: EventTTL Jun 11 18:36:34.295452 ip-10-0-141-55 kubenswrapper[2578]: W0611 18:36:34.292448 2578 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jun 11 18:36:34.295452 ip-10-0-141-55 kubenswrapper[2578]: W0611 18:36:34.292451 2578 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jun 11 18:36:34.295452 ip-10-0-141-55 kubenswrapper[2578]: W0611 18:36:34.292454 2578 feature_gate.go:328] unrecognized feature gate: SignatureStores Jun 11 18:36:34.295940 ip-10-0-141-55 kubenswrapper[2578]: W0611 18:36:34.292457 2578 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jun 11 18:36:34.295940 ip-10-0-141-55 kubenswrapper[2578]: W0611 18:36:34.292460 2578 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jun 11 18:36:34.295940 ip-10-0-141-55 kubenswrapper[2578]: W0611 18:36:34.292463 2578 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jun 11 18:36:34.295940 ip-10-0-141-55 kubenswrapper[2578]: W0611 18:36:34.292466 2578 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jun 11 18:36:34.295940 ip-10-0-141-55 kubenswrapper[2578]: W0611 18:36:34.292468 2578 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jun 11 18:36:34.295940 ip-10-0-141-55 kubenswrapper[2578]: W0611 18:36:34.292471 2578 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jun 11 18:36:34.295940 ip-10-0-141-55 kubenswrapper[2578]: W0611 18:36:34.292474 2578 feature_gate.go:328] unrecognized feature gate: Example Jun 11 18:36:34.295940 ip-10-0-141-55 kubenswrapper[2578]: W0611 18:36:34.292476 2578 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jun 11 18:36:34.295940 ip-10-0-141-55 kubenswrapper[2578]: W0611 18:36:34.292480 2578 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jun 11 18:36:34.295940 ip-10-0-141-55 kubenswrapper[2578]: W0611 18:36:34.292482 2578 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jun 11 18:36:34.295940 ip-10-0-141-55 kubenswrapper[2578]: W0611 18:36:34.292485 2578 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jun 11 18:36:34.295940 ip-10-0-141-55 kubenswrapper[2578]: W0611 18:36:34.292487 2578 feature_gate.go:328] unrecognized feature gate: OVNObservability Jun 11 18:36:34.295940 ip-10-0-141-55 kubenswrapper[2578]: W0611 18:36:34.292490 2578 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jun 11 18:36:34.295940 ip-10-0-141-55 kubenswrapper[2578]: W0611 18:36:34.292492 2578 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jun 11 18:36:34.295940 ip-10-0-141-55 kubenswrapper[2578]: W0611 18:36:34.292496 2578 feature_gate.go:328] unrecognized feature gate: PinnedImages Jun 11 18:36:34.295940 ip-10-0-141-55 kubenswrapper[2578]: W0611 18:36:34.292498 2578 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jun 11 18:36:34.295940 ip-10-0-141-55 kubenswrapper[2578]: W0611 18:36:34.292501 2578 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jun 11 18:36:34.295940 ip-10-0-141-55 kubenswrapper[2578]: W0611 18:36:34.292504 2578 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jun 11 18:36:34.295940 ip-10-0-141-55 kubenswrapper[2578]: W0611 18:36:34.292506 2578 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jun 11 18:36:34.295940 ip-10-0-141-55 kubenswrapper[2578]: W0611 18:36:34.292509 2578 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jun 11 18:36:34.296412 ip-10-0-141-55 kubenswrapper[2578]: W0611 18:36:34.292512 2578 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jun 11 18:36:34.296412 ip-10-0-141-55 kubenswrapper[2578]: W0611 18:36:34.292514 2578 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jun 11 18:36:34.296412 ip-10-0-141-55 kubenswrapper[2578]: W0611 18:36:34.292517 2578 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jun 11 18:36:34.296412 ip-10-0-141-55 kubenswrapper[2578]: W0611 18:36:34.292519 2578 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jun 11 18:36:34.296412 ip-10-0-141-55 kubenswrapper[2578]: W0611 18:36:34.292522 2578 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jun 11 18:36:34.296412 ip-10-0-141-55 kubenswrapper[2578]: W0611 18:36:34.292526 2578 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jun 11 18:36:34.296412 ip-10-0-141-55 kubenswrapper[2578]: W0611 18:36:34.292529 2578 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jun 11 18:36:34.296412 ip-10-0-141-55 kubenswrapper[2578]: W0611 18:36:34.292532 2578 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jun 11 18:36:34.296412 ip-10-0-141-55 kubenswrapper[2578]: W0611 18:36:34.292536 2578 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jun 11 18:36:34.296412 ip-10-0-141-55 kubenswrapper[2578]: W0611 18:36:34.292540 2578 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jun 11 18:36:34.296412 ip-10-0-141-55 kubenswrapper[2578]: W0611 18:36:34.292543 2578 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jun 11 18:36:34.296412 ip-10-0-141-55 kubenswrapper[2578]: W0611 18:36:34.292546 2578 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jun 11 18:36:34.296412 ip-10-0-141-55 kubenswrapper[2578]: W0611 18:36:34.292549 2578 feature_gate.go:328] unrecognized feature gate: OSStreams Jun 11 18:36:34.296412 ip-10-0-141-55 kubenswrapper[2578]: W0611 18:36:34.292566 2578 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jun 11 18:36:34.296412 ip-10-0-141-55 kubenswrapper[2578]: W0611 18:36:34.292569 2578 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jun 11 18:36:34.296412 ip-10-0-141-55 kubenswrapper[2578]: W0611 18:36:34.292572 2578 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jun 11 18:36:34.296412 ip-10-0-141-55 kubenswrapper[2578]: W0611 18:36:34.292575 2578 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jun 11 18:36:34.296412 ip-10-0-141-55 kubenswrapper[2578]: W0611 18:36:34.292578 2578 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jun 11 18:36:34.296412 ip-10-0-141-55 kubenswrapper[2578]: W0611 18:36:34.292581 2578 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jun 11 18:36:34.296882 ip-10-0-141-55 kubenswrapper[2578]: W0611 18:36:34.292583 2578 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jun 11 18:36:34.296882 ip-10-0-141-55 kubenswrapper[2578]: W0611 18:36:34.292586 2578 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jun 11 18:36:34.296882 ip-10-0-141-55 kubenswrapper[2578]: W0611 18:36:34.292589 2578 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jun 11 18:36:34.296882 ip-10-0-141-55 kubenswrapper[2578]: W0611 18:36:34.292593 2578 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jun 11 18:36:34.296882 ip-10-0-141-55 kubenswrapper[2578]: W0611 18:36:34.292597 2578 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jun 11 18:36:34.296882 ip-10-0-141-55 kubenswrapper[2578]: W0611 18:36:34.292600 2578 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jun 11 18:36:34.296882 ip-10-0-141-55 kubenswrapper[2578]: W0611 18:36:34.292602 2578 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jun 11 18:36:34.296882 ip-10-0-141-55 kubenswrapper[2578]: W0611 18:36:34.292605 2578 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jun 11 18:36:34.296882 ip-10-0-141-55 kubenswrapper[2578]: W0611 18:36:34.292608 2578 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jun 11 18:36:34.296882 ip-10-0-141-55 kubenswrapper[2578]: W0611 18:36:34.292611 2578 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jun 11 18:36:34.296882 ip-10-0-141-55 kubenswrapper[2578]: W0611 18:36:34.292613 2578 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jun 11 18:36:34.296882 ip-10-0-141-55 kubenswrapper[2578]: W0611 18:36:34.292616 2578 feature_gate.go:328] unrecognized feature gate: DualReplica Jun 11 18:36:34.296882 ip-10-0-141-55 kubenswrapper[2578]: W0611 18:36:34.292618 2578 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jun 11 18:36:34.296882 ip-10-0-141-55 kubenswrapper[2578]: W0611 18:36:34.292621 2578 feature_gate.go:328] unrecognized feature gate: NewOLM Jun 11 18:36:34.296882 ip-10-0-141-55 kubenswrapper[2578]: W0611 18:36:34.292623 2578 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jun 11 18:36:34.296882 ip-10-0-141-55 kubenswrapper[2578]: W0611 18:36:34.292626 2578 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jun 11 18:36:34.296882 ip-10-0-141-55 kubenswrapper[2578]: W0611 18:36:34.292628 2578 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jun 11 18:36:34.296882 ip-10-0-141-55 kubenswrapper[2578]: W0611 18:36:34.292631 2578 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jun 11 18:36:34.296882 ip-10-0-141-55 kubenswrapper[2578]: W0611 18:36:34.292634 2578 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jun 11 18:36:34.296882 ip-10-0-141-55 kubenswrapper[2578]: W0611 18:36:34.292637 2578 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jun 11 18:36:34.297350 ip-10-0-141-55 kubenswrapper[2578]: W0611 18:36:34.292639 2578 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jun 11 18:36:34.297350 ip-10-0-141-55 kubenswrapper[2578]: W0611 18:36:34.292642 2578 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jun 11 18:36:34.297350 ip-10-0-141-55 kubenswrapper[2578]: W0611 18:36:34.292645 2578 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jun 11 18:36:34.297350 ip-10-0-141-55 kubenswrapper[2578]: W0611 18:36:34.292647 2578 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jun 11 18:36:34.297350 ip-10-0-141-55 kubenswrapper[2578]: W0611 18:36:34.292650 2578 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jun 11 18:36:34.297350 ip-10-0-141-55 kubenswrapper[2578]: W0611 18:36:34.292652 2578 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jun 11 18:36:34.297350 ip-10-0-141-55 kubenswrapper[2578]: W0611 18:36:34.292655 2578 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jun 11 18:36:34.297350 ip-10-0-141-55 kubenswrapper[2578]: W0611 18:36:34.292657 2578 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jun 11 18:36:34.297350 ip-10-0-141-55 kubenswrapper[2578]: W0611 18:36:34.292660 2578 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jun 11 18:36:34.297350 ip-10-0-141-55 kubenswrapper[2578]: W0611 18:36:34.292663 2578 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jun 11 18:36:34.297350 ip-10-0-141-55 kubenswrapper[2578]: W0611 18:36:34.292665 2578 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jun 11 18:36:34.297350 ip-10-0-141-55 kubenswrapper[2578]: W0611 18:36:34.292668 2578 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jun 11 18:36:34.297350 ip-10-0-141-55 kubenswrapper[2578]: W0611 18:36:34.292670 2578 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jun 11 18:36:34.297350 ip-10-0-141-55 kubenswrapper[2578]: W0611 18:36:34.292673 2578 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jun 11 18:36:34.297350 ip-10-0-141-55 kubenswrapper[2578]: W0611 18:36:34.292676 2578 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jun 11 18:36:34.297350 ip-10-0-141-55 kubenswrapper[2578]: W0611 18:36:34.292678 2578 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jun 11 18:36:34.297350 ip-10-0-141-55 kubenswrapper[2578]: W0611 18:36:34.292682 2578 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jun 11 18:36:34.297350 ip-10-0-141-55 kubenswrapper[2578]: W0611 18:36:34.292684 2578 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jun 11 18:36:34.297350 ip-10-0-141-55 kubenswrapper[2578]: W0611 18:36:34.292686 2578 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jun 11 18:36:34.297350 ip-10-0-141-55 kubenswrapper[2578]: W0611 18:36:34.292689 2578 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jun 11 18:36:34.297849 ip-10-0-141-55 kubenswrapper[2578]: W0611 18:36:34.292692 2578 feature_gate.go:328] unrecognized feature gate: Example2 Jun 11 18:36:34.297849 ip-10-0-141-55 kubenswrapper[2578]: W0611 18:36:34.292694 2578 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jun 11 18:36:34.297849 ip-10-0-141-55 kubenswrapper[2578]: W0611 18:36:34.292697 2578 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jun 11 18:36:34.297849 ip-10-0-141-55 kubenswrapper[2578]: W0611 18:36:34.292699 2578 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jun 11 18:36:34.297849 ip-10-0-141-55 kubenswrapper[2578]: W0611 18:36:34.292702 2578 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jun 11 18:36:34.297849 ip-10-0-141-55 kubenswrapper[2578]: W0611 18:36:34.292705 2578 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jun 11 18:36:34.297849 ip-10-0-141-55 kubenswrapper[2578]: W0611 18:36:34.292709 2578 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jun 11 18:36:34.297849 ip-10-0-141-55 kubenswrapper[2578]: W0611 18:36:34.292712 2578 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jun 11 18:36:34.297849 ip-10-0-141-55 kubenswrapper[2578]: W0611 18:36:34.292715 2578 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jun 11 18:36:34.297849 ip-10-0-141-55 kubenswrapper[2578]: W0611 18:36:34.292718 2578 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jun 11 18:36:34.297849 ip-10-0-141-55 kubenswrapper[2578]: W0611 18:36:34.292721 2578 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jun 11 18:36:34.297849 ip-10-0-141-55 kubenswrapper[2578]: W0611 18:36:34.292724 2578 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jun 11 18:36:34.297849 ip-10-0-141-55 kubenswrapper[2578]: W0611 18:36:34.292726 2578 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jun 11 18:36:34.297849 ip-10-0-141-55 kubenswrapper[2578]: W0611 18:36:34.292729 2578 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jun 11 18:36:34.297849 ip-10-0-141-55 kubenswrapper[2578]: W0611 18:36:34.292731 2578 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jun 11 18:36:34.297849 ip-10-0-141-55 kubenswrapper[2578]: W0611 18:36:34.292734 2578 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jun 11 18:36:34.298234 ip-10-0-141-55 kubenswrapper[2578]: I0611 18:36:34.292739 2578 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]} Jun 11 18:36:34.298234 ip-10-0-141-55 kubenswrapper[2578]: W0611 18:36:34.292847 2578 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jun 11 18:36:34.298234 ip-10-0-141-55 kubenswrapper[2578]: W0611 18:36:34.292851 2578 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jun 11 18:36:34.298234 ip-10-0-141-55 kubenswrapper[2578]: W0611 18:36:34.292855 2578 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jun 11 18:36:34.298234 ip-10-0-141-55 kubenswrapper[2578]: W0611 18:36:34.292858 2578 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jun 11 18:36:34.298234 ip-10-0-141-55 kubenswrapper[2578]: W0611 18:36:34.292860 2578 feature_gate.go:328] unrecognized feature gate: Example2 Jun 11 18:36:34.298234 ip-10-0-141-55 kubenswrapper[2578]: W0611 18:36:34.292863 2578 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jun 11 18:36:34.298234 ip-10-0-141-55 kubenswrapper[2578]: W0611 18:36:34.292866 2578 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jun 11 18:36:34.298234 ip-10-0-141-55 kubenswrapper[2578]: W0611 18:36:34.292869 2578 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jun 11 18:36:34.298234 ip-10-0-141-55 kubenswrapper[2578]: W0611 18:36:34.292872 2578 feature_gate.go:328] unrecognized feature gate: DualReplica Jun 11 18:36:34.298234 ip-10-0-141-55 kubenswrapper[2578]: W0611 18:36:34.292875 2578 feature_gate.go:328] unrecognized feature gate: PinnedImages Jun 11 18:36:34.298234 ip-10-0-141-55 kubenswrapper[2578]: W0611 18:36:34.292877 2578 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jun 11 18:36:34.298234 ip-10-0-141-55 kubenswrapper[2578]: W0611 18:36:34.292880 2578 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jun 11 18:36:34.298234 ip-10-0-141-55 kubenswrapper[2578]: W0611 18:36:34.292883 2578 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jun 11 18:36:34.298234 ip-10-0-141-55 kubenswrapper[2578]: W0611 18:36:34.292886 2578 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jun 11 18:36:34.298620 ip-10-0-141-55 kubenswrapper[2578]: W0611 18:36:34.292888 2578 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jun 11 18:36:34.298620 ip-10-0-141-55 kubenswrapper[2578]: W0611 18:36:34.292891 2578 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jun 11 18:36:34.298620 ip-10-0-141-55 kubenswrapper[2578]: W0611 18:36:34.292894 2578 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jun 11 18:36:34.298620 ip-10-0-141-55 kubenswrapper[2578]: W0611 18:36:34.292896 2578 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jun 11 18:36:34.298620 ip-10-0-141-55 kubenswrapper[2578]: W0611 18:36:34.292898 2578 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jun 11 18:36:34.298620 ip-10-0-141-55 kubenswrapper[2578]: W0611 18:36:34.292901 2578 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jun 11 18:36:34.298620 ip-10-0-141-55 kubenswrapper[2578]: W0611 18:36:34.292903 2578 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jun 11 18:36:34.298620 ip-10-0-141-55 kubenswrapper[2578]: W0611 18:36:34.292906 2578 feature_gate.go:328] unrecognized feature gate: SignatureStores Jun 11 18:36:34.298620 ip-10-0-141-55 kubenswrapper[2578]: W0611 18:36:34.292908 2578 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jun 11 18:36:34.298620 ip-10-0-141-55 kubenswrapper[2578]: W0611 18:36:34.292912 2578 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jun 11 18:36:34.298620 ip-10-0-141-55 kubenswrapper[2578]: W0611 18:36:34.292914 2578 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jun 11 18:36:34.298620 ip-10-0-141-55 kubenswrapper[2578]: W0611 18:36:34.292917 2578 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jun 11 18:36:34.298620 ip-10-0-141-55 kubenswrapper[2578]: W0611 18:36:34.292919 2578 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jun 11 18:36:34.298620 ip-10-0-141-55 kubenswrapper[2578]: W0611 18:36:34.292922 2578 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jun 11 18:36:34.298620 ip-10-0-141-55 kubenswrapper[2578]: W0611 18:36:34.292925 2578 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jun 11 18:36:34.298620 ip-10-0-141-55 kubenswrapper[2578]: W0611 18:36:34.292927 2578 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jun 11 18:36:34.298620 ip-10-0-141-55 kubenswrapper[2578]: W0611 18:36:34.292930 2578 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jun 11 18:36:34.298620 ip-10-0-141-55 kubenswrapper[2578]: W0611 18:36:34.292933 2578 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jun 11 18:36:34.298620 ip-10-0-141-55 kubenswrapper[2578]: W0611 18:36:34.292935 2578 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jun 11 18:36:34.299087 ip-10-0-141-55 kubenswrapper[2578]: W0611 18:36:34.292940 2578 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jun 11 18:36:34.299087 ip-10-0-141-55 kubenswrapper[2578]: W0611 18:36:34.292944 2578 feature_gate.go:328] unrecognized feature gate: NewOLM Jun 11 18:36:34.299087 ip-10-0-141-55 kubenswrapper[2578]: W0611 18:36:34.292947 2578 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jun 11 18:36:34.299087 ip-10-0-141-55 kubenswrapper[2578]: W0611 18:36:34.292950 2578 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jun 11 18:36:34.299087 ip-10-0-141-55 kubenswrapper[2578]: W0611 18:36:34.292953 2578 feature_gate.go:328] unrecognized feature gate: EventTTL Jun 11 18:36:34.299087 ip-10-0-141-55 kubenswrapper[2578]: W0611 18:36:34.292955 2578 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jun 11 18:36:34.299087 ip-10-0-141-55 kubenswrapper[2578]: W0611 18:36:34.292958 2578 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jun 11 18:36:34.299087 ip-10-0-141-55 kubenswrapper[2578]: W0611 18:36:34.292962 2578 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jun 11 18:36:34.299087 ip-10-0-141-55 kubenswrapper[2578]: W0611 18:36:34.292966 2578 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jun 11 18:36:34.299087 ip-10-0-141-55 kubenswrapper[2578]: W0611 18:36:34.292968 2578 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jun 11 18:36:34.299087 ip-10-0-141-55 kubenswrapper[2578]: W0611 18:36:34.292971 2578 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jun 11 18:36:34.299087 ip-10-0-141-55 kubenswrapper[2578]: W0611 18:36:34.292974 2578 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jun 11 18:36:34.299087 ip-10-0-141-55 kubenswrapper[2578]: W0611 18:36:34.292977 2578 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jun 11 18:36:34.299087 ip-10-0-141-55 kubenswrapper[2578]: W0611 18:36:34.292980 2578 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jun 11 18:36:34.299087 ip-10-0-141-55 kubenswrapper[2578]: W0611 18:36:34.292983 2578 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jun 11 18:36:34.299087 ip-10-0-141-55 kubenswrapper[2578]: W0611 18:36:34.292985 2578 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jun 11 18:36:34.299087 ip-10-0-141-55 kubenswrapper[2578]: W0611 18:36:34.292987 2578 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jun 11 18:36:34.299087 ip-10-0-141-55 kubenswrapper[2578]: W0611 18:36:34.292990 2578 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jun 11 18:36:34.299087 ip-10-0-141-55 kubenswrapper[2578]: W0611 18:36:34.292993 2578 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jun 11 18:36:34.299535 ip-10-0-141-55 kubenswrapper[2578]: W0611 18:36:34.292995 2578 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jun 11 18:36:34.299535 ip-10-0-141-55 kubenswrapper[2578]: W0611 18:36:34.292997 2578 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jun 11 18:36:34.299535 ip-10-0-141-55 kubenswrapper[2578]: W0611 18:36:34.293000 2578 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jun 11 18:36:34.299535 ip-10-0-141-55 kubenswrapper[2578]: W0611 18:36:34.293003 2578 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jun 11 18:36:34.299535 ip-10-0-141-55 kubenswrapper[2578]: W0611 18:36:34.293005 2578 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jun 11 18:36:34.299535 ip-10-0-141-55 kubenswrapper[2578]: W0611 18:36:34.293008 2578 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jun 11 18:36:34.299535 ip-10-0-141-55 kubenswrapper[2578]: W0611 18:36:34.293010 2578 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jun 11 18:36:34.299535 ip-10-0-141-55 kubenswrapper[2578]: W0611 18:36:34.293013 2578 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jun 11 18:36:34.299535 ip-10-0-141-55 kubenswrapper[2578]: W0611 18:36:34.293015 2578 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jun 11 18:36:34.299535 ip-10-0-141-55 kubenswrapper[2578]: W0611 18:36:34.293018 2578 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jun 11 18:36:34.299535 ip-10-0-141-55 kubenswrapper[2578]: W0611 18:36:34.293022 2578 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jun 11 18:36:34.299535 ip-10-0-141-55 kubenswrapper[2578]: W0611 18:36:34.293025 2578 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jun 11 18:36:34.299535 ip-10-0-141-55 kubenswrapper[2578]: W0611 18:36:34.293028 2578 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jun 11 18:36:34.299535 ip-10-0-141-55 kubenswrapper[2578]: W0611 18:36:34.293030 2578 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jun 11 18:36:34.299535 ip-10-0-141-55 kubenswrapper[2578]: W0611 18:36:34.293033 2578 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jun 11 18:36:34.299535 ip-10-0-141-55 kubenswrapper[2578]: W0611 18:36:34.293036 2578 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jun 11 18:36:34.299535 ip-10-0-141-55 kubenswrapper[2578]: W0611 18:36:34.293038 2578 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jun 11 18:36:34.299535 ip-10-0-141-55 kubenswrapper[2578]: W0611 18:36:34.293041 2578 feature_gate.go:328] unrecognized feature gate: OVNObservability Jun 11 18:36:34.299535 ip-10-0-141-55 kubenswrapper[2578]: W0611 18:36:34.293043 2578 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jun 11 18:36:34.299535 ip-10-0-141-55 kubenswrapper[2578]: W0611 18:36:34.293045 2578 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jun 11 18:36:34.300100 ip-10-0-141-55 kubenswrapper[2578]: W0611 18:36:34.293048 2578 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jun 11 18:36:34.300100 ip-10-0-141-55 kubenswrapper[2578]: W0611 18:36:34.293050 2578 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jun 11 18:36:34.300100 ip-10-0-141-55 kubenswrapper[2578]: W0611 18:36:34.293053 2578 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jun 11 18:36:34.300100 ip-10-0-141-55 kubenswrapper[2578]: W0611 18:36:34.293055 2578 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jun 11 18:36:34.300100 ip-10-0-141-55 kubenswrapper[2578]: W0611 18:36:34.293058 2578 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jun 11 18:36:34.300100 ip-10-0-141-55 kubenswrapper[2578]: W0611 18:36:34.293060 2578 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jun 11 18:36:34.300100 ip-10-0-141-55 kubenswrapper[2578]: W0611 18:36:34.293064 2578 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jun 11 18:36:34.300100 ip-10-0-141-55 kubenswrapper[2578]: W0611 18:36:34.293067 2578 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jun 11 18:36:34.300100 ip-10-0-141-55 kubenswrapper[2578]: W0611 18:36:34.293069 2578 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jun 11 18:36:34.300100 ip-10-0-141-55 kubenswrapper[2578]: W0611 18:36:34.293072 2578 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jun 11 18:36:34.300100 ip-10-0-141-55 kubenswrapper[2578]: W0611 18:36:34.293074 2578 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jun 11 18:36:34.300100 ip-10-0-141-55 kubenswrapper[2578]: W0611 18:36:34.293077 2578 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jun 11 18:36:34.300100 ip-10-0-141-55 kubenswrapper[2578]: W0611 18:36:34.293080 2578 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jun 11 18:36:34.300100 ip-10-0-141-55 kubenswrapper[2578]: W0611 18:36:34.293082 2578 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jun 11 18:36:34.300100 ip-10-0-141-55 kubenswrapper[2578]: W0611 18:36:34.293085 2578 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jun 11 18:36:34.300100 ip-10-0-141-55 kubenswrapper[2578]: W0611 18:36:34.293087 2578 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jun 11 18:36:34.300100 ip-10-0-141-55 kubenswrapper[2578]: W0611 18:36:34.293090 2578 feature_gate.go:328] unrecognized feature gate: OSStreams Jun 11 18:36:34.300100 ip-10-0-141-55 kubenswrapper[2578]: W0611 18:36:34.293093 2578 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jun 11 18:36:34.300100 ip-10-0-141-55 kubenswrapper[2578]: W0611 18:36:34.293095 2578 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jun 11 18:36:34.300100 ip-10-0-141-55 kubenswrapper[2578]: W0611 18:36:34.293097 2578 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jun 11 18:36:34.300595 ip-10-0-141-55 kubenswrapper[2578]: W0611 18:36:34.293100 2578 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jun 11 18:36:34.300595 ip-10-0-141-55 kubenswrapper[2578]: W0611 18:36:34.293102 2578 feature_gate.go:328] unrecognized feature gate: Example Jun 11 18:36:34.300595 ip-10-0-141-55 kubenswrapper[2578]: W0611 18:36:34.293105 2578 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jun 11 18:36:34.300595 ip-10-0-141-55 kubenswrapper[2578]: W0611 18:36:34.293107 2578 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jun 11 18:36:34.300595 ip-10-0-141-55 kubenswrapper[2578]: W0611 18:36:34.293109 2578 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jun 11 18:36:34.300595 ip-10-0-141-55 kubenswrapper[2578]: W0611 18:36:34.293112 2578 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jun 11 18:36:34.300595 ip-10-0-141-55 kubenswrapper[2578]: W0611 18:36:34.293114 2578 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jun 11 18:36:34.300595 ip-10-0-141-55 kubenswrapper[2578]: I0611 18:36:34.293119 2578 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]} Jun 11 18:36:34.300595 ip-10-0-141-55 kubenswrapper[2578]: I0611 18:36:34.293216 2578 server.go:962] "Client rotation is on, will bootstrap in background" Jun 11 18:36:34.300595 ip-10-0-141-55 kubenswrapper[2578]: I0611 18:36:34.296533 2578 bootstrap.go:101] "Use the bootstrap credentials to request a cert, and set kubeconfig to point to the certificate dir" Jun 11 18:36:34.300595 ip-10-0-141-55 kubenswrapper[2578]: I0611 18:36:34.297776 2578 server.go:1019] "Starting client certificate rotation" Jun 11 18:36:34.300595 ip-10-0-141-55 kubenswrapper[2578]: I0611 18:36:34.297883 2578 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kube-apiserver-client-kubelet" Jun 11 18:36:34.300595 ip-10-0-141-55 kubenswrapper[2578]: I0611 18:36:34.297918 2578 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kube-apiserver-client-kubelet" Jun 11 18:36:34.300915 ip-10-0-141-55 kubenswrapper[2578]: I0611 18:36:34.299889 2578 dynamic_cafile_content.go:123] "Loaded a new CA Bundle and Verifier" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt" Jun 11 18:36:34.303569 ip-10-0-141-55 kubenswrapper[2578]: I0611 18:36:34.303540 2578 dynamic_cafile_content.go:161] "Starting controller" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt" Jun 11 18:36:34.311899 ip-10-0-141-55 kubenswrapper[2578]: I0611 18:36:34.311883 2578 log.go:25] "Validated CRI v1 runtime API" Jun 11 18:36:34.315050 ip-10-0-141-55 kubenswrapper[2578]: I0611 18:36:34.315032 2578 log.go:25] "Validated CRI v1 image API" Jun 11 18:36:34.316499 ip-10-0-141-55 kubenswrapper[2578]: I0611 18:36:34.316481 2578 server.go:1429] "Using cgroup driver setting received from the CRI runtime" cgroupDriver="systemd" Jun 11 18:36:34.318531 ip-10-0-141-55 kubenswrapper[2578]: I0611 18:36:34.318512 2578 fs.go:135] Filesystem UUIDs: map[7B77-95E7:/dev/nvme0n1p2 8f35ab17-0cc1-4060-aac8-830db6dc5a6e:/dev/nvme0n1p3 a570cb72-85fc-452c-8121-cac462fae0cd:/dev/nvme0n1p4] Jun 11 18:36:34.318607 ip-10-0-141-55 kubenswrapper[2578]: I0611 18:36:34.318530 2578 fs.go:136] Filesystem partitions: map[/dev/nvme0n1p3:{mountpoint:/boot major:259 minor:3 fsType:ext4 blockSize:0} /dev/nvme0n1p4:{mountpoint:/var major:259 minor:4 fsType:xfs blockSize:0} /dev/shm:{mountpoint:/dev/shm major:0 minor:22 fsType:tmpfs blockSize:0} /run:{mountpoint:/run major:0 minor:24 fsType:tmpfs blockSize:0} /tmp:{mountpoint:/tmp major:0 minor:31 fsType:tmpfs blockSize:0} composefs_0-33:{mountpoint:/ major:0 minor:33 fsType:overlay blockSize:0}] Jun 11 18:36:34.325479 ip-10-0-141-55 kubenswrapper[2578]: I0611 18:36:34.325362 2578 manager.go:216] Machine: {Timestamp:2026-06-11 18:36:34.324253178 +0000 UTC m=+0.278927797 CPUVendorID:GenuineIntel NumCores:8 NumPhysicalCores:4 NumSockets:1 CpuFrequency:3087453 MemoryCapacity:33164500992 SwapCapacity:0 MemoryByType:map[] NVMInfo:{MemoryModeCapacity:0 AppDirectModeCapacity:0 AvgPowerBudget:0} HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] MachineID:ec27d864f8a4af7b1dcfd3480936411b SystemUUID:ec27d864-f8a4-af7b-1dcf-d3480936411b BootID:d64ce778-488b-4112-abd2-e3b13b4aebcd Filesystems:[{Device:/dev/shm DeviceMajor:0 DeviceMinor:22 Capacity:16582250496 Type:vfs Inodes:4048401 HasInodes:true} {Device:/run DeviceMajor:0 DeviceMinor:24 Capacity:6632902656 Type:vfs Inodes:819200 HasInodes:true} {Device:/dev/nvme0n1p4 DeviceMajor:259 DeviceMinor:4 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:composefs_0-33 DeviceMajor:0 DeviceMinor:33 Capacity:6107136 Type:vfs Inodes:18446744073709551615 HasInodes:true} {Device:/tmp DeviceMajor:0 DeviceMinor:31 Capacity:16582250496 Type:vfs Inodes:1048576 HasInodes:true} {Device:/dev/nvme0n1p3 DeviceMajor:259 DeviceMinor:3 Capacity:366869504 Type:vfs Inodes:98304 HasInodes:true}] DiskMap:map[259:0:{Name:nvme0n1 Major:259 Minor:0 Size:128849018880 Scheduler:none}] NetworkDevices:[{Name:br-ex MacAddress:02:6d:a8:8e:07:a1 Speed:0 Mtu:9001} {Name:ens5 MacAddress:02:6d:a8:8e:07:a1 Speed:0 Mtu:9001} {Name:ovs-system MacAddress:8e:69:1c:a0:89:db Speed:0 Mtu:1500}] Topology:[{Id:0 Memory:33164500992 HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] Cores:[{Id:0 Threads:[0 4] Caches:[{Id:0 Size:32768 Type:Data Level:1} {Id:0 Size:32768 Type:Instruction Level:1} {Id:0 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:1 Threads:[1 5] Caches:[{Id:1 Size:32768 Type:Data Level:1} {Id:1 Size:32768 Type:Instruction Level:1} {Id:1 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:2 Threads:[2 6] Caches:[{Id:2 Size:32768 Type:Data Level:1} {Id:2 Size:32768 Type:Instruction Level:1} {Id:2 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:3 Threads:[3 7] Caches:[{Id:3 Size:32768 Type:Data Level:1} {Id:3 Size:32768 Type:Instruction Level:1} {Id:3 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:}] Caches:[{Id:0 Size:37486592 Type:Unified Level:3}] Distances:[10]}] CloudProvider:Unknown InstanceType:Unknown InstanceID:None} Jun 11 18:36:34.325479 ip-10-0-141-55 kubenswrapper[2578]: I0611 18:36:34.325469 2578 manager_no_libpfm.go:29] cAdvisor is build without cgo and/or libpfm support. Perf event counters are not available. Jun 11 18:36:34.325634 ip-10-0-141-55 kubenswrapper[2578]: I0611 18:36:34.325589 2578 manager.go:232] Version: {KernelVersion:5.14.0-570.120.1.el9_6.x86_64 ContainerOsVersion:Red Hat Enterprise Linux CoreOS 9.6.20260608-0 (Plow) DockerVersion: DockerAPIVersion: CadvisorVersion: CadvisorRevision:} Jun 11 18:36:34.328104 ip-10-0-141-55 kubenswrapper[2578]: I0611 18:36:34.328076 2578 container_manager_linux.go:273] "Container manager verified user specified cgroup-root exists" cgroupRoot=[] Jun 11 18:36:34.328229 ip-10-0-141-55 kubenswrapper[2578]: I0611 18:36:34.328108 2578 container_manager_linux.go:278] "Creating Container Manager object based on Node Config" nodeConfig={"NodeName":"ip-10-0-141-55.ec2.internal","RuntimeCgroupsName":"/system.slice/crio.service","SystemCgroupsName":"/system.slice","KubeletCgroupsName":"","KubeletOOMScoreAdj":-999,"ContainerRuntime":"","CgroupsPerQOS":true,"CgroupRoot":"/","CgroupDriver":"systemd","KubeletRootDir":"/var/lib/kubelet","ProtectKernelDefaults":true,"KubeReservedCgroupName":"","SystemReservedCgroupName":"","ReservedSystemCPUs":{},"EnforceNodeAllocatable":{"pods":{}},"KubeReserved":null,"SystemReserved":{"cpu":"500m","ephemeral-storage":"1Gi","memory":"1Gi"},"HardEvictionThresholds":[{"Signal":"imagefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.15},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"memory.available","Operator":"LessThan","Value":{"Quantity":"100Mi","Percentage":0},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.1},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null}],"QOSReserved":{},"CPUManagerPolicy":"none","CPUManagerPolicyOptions":null,"TopologyManagerScope":"container","CPUManagerReconcilePeriod":10000000000,"MemoryManagerPolicy":"None","MemoryManagerReservedMemory":null,"PodPidsLimit":4096,"EnforceCPULimits":true,"CPUCFSQuotaPeriod":100000000,"TopologyManagerPolicy":"none","TopologyManagerPolicyOptions":null,"CgroupVersion":2} Jun 11 18:36:34.329147 ip-10-0-141-55 kubenswrapper[2578]: I0611 18:36:34.329130 2578 reflector.go:439] "Caches populated" logger="kubernetes.io/kube-apiserver-client-kubelet" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162" Jun 11 18:36:34.329181 ip-10-0-141-55 kubenswrapper[2578]: I0611 18:36:34.329156 2578 topology_manager.go:138] "Creating topology manager with none policy" Jun 11 18:36:34.329181 ip-10-0-141-55 kubenswrapper[2578]: I0611 18:36:34.329168 2578 container_manager_linux.go:309] "Creating device plugin manager" Jun 11 18:36:34.329181 ip-10-0-141-55 kubenswrapper[2578]: I0611 18:36:34.329177 2578 manager.go:141] "Creating Device Plugin manager" path="/var/lib/kubelet/device-plugins/kubelet.sock" Jun 11 18:36:34.329724 ip-10-0-141-55 kubenswrapper[2578]: I0611 18:36:34.329714 2578 server.go:74] "Creating device plugin registration server" version="v1beta1" socket="/var/lib/kubelet/device-plugins/kubelet.sock" Jun 11 18:36:34.330930 ip-10-0-141-55 kubenswrapper[2578]: I0611 18:36:34.330919 2578 container_manager_linux.go:318] "Creating Dynamic Resource Allocation (DRA) manager" Jun 11 18:36:34.333799 ip-10-0-141-55 kubenswrapper[2578]: I0611 18:36:34.333787 2578 state_mem.go:36] "Initialized new in-memory state store" Jun 11 18:36:34.334090 ip-10-0-141-55 kubenswrapper[2578]: I0611 18:36:34.334079 2578 server.go:1240] "Using root directory" path="/var/lib/kubelet" Jun 11 18:36:34.334132 ip-10-0-141-55 kubenswrapper[2578]: I0611 18:36:34.334111 2578 kubelet.go:486] "Attempting to sync node with API server" Jun 11 18:36:34.334132 ip-10-0-141-55 kubenswrapper[2578]: I0611 18:36:34.334121 2578 kubelet.go:387] "Adding static pod path" path="/etc/kubernetes/manifests" Jun 11 18:36:34.334132 ip-10-0-141-55 kubenswrapper[2578]: I0611 18:36:34.334132 2578 file.go:69] "Watching path" path="/etc/kubernetes/manifests" Jun 11 18:36:34.334234 ip-10-0-141-55 kubenswrapper[2578]: I0611 18:36:34.334140 2578 kubelet.go:398] "Adding apiserver pod source" Jun 11 18:36:34.334234 ip-10-0-141-55 kubenswrapper[2578]: I0611 18:36:34.334149 2578 apiserver.go:42] "Waiting for node sync before watching apiserver pods" Jun 11 18:36:34.334614 ip-10-0-141-55 kubenswrapper[2578]: I0611 18:36:34.334602 2578 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking" Jun 11 18:36:34.334654 ip-10-0-141-55 kubenswrapper[2578]: I0611 18:36:34.334621 2578 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking" Jun 11 18:36:34.336305 ip-10-0-141-55 kubenswrapper[2578]: I0611 18:36:34.336287 2578 kuberuntime_manager.go:301] "Container runtime initialized" containerRuntime="cri-o" version="1.34.8-3.rhaos4.21.git91b4b0b.el9" apiVersion="v1" Jun 11 18:36:34.337743 ip-10-0-141-55 kubenswrapper[2578]: I0611 18:36:34.337727 2578 kubelet.go:960] "Not starting ClusterTrustBundle informer because we are in static kubelet mode or the ClusterTrustBundleProjection featuregate is disabled" Jun 11 18:36:34.337801 ip-10-0-141-55 kubenswrapper[2578]: I0611 18:36:34.337775 2578 kubelet.go:984] "Not starting PodCertificateRequest manager because we are in static kubelet mode or the PodCertificateProjection feature gate is disabled" Jun 11 18:36:34.338029 ip-10-0-141-55 kubenswrapper[2578]: I0611 18:36:34.338017 2578 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/portworx-volume" Jun 11 18:36:34.338079 ip-10-0-141-55 kubenswrapper[2578]: I0611 18:36:34.338043 2578 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/empty-dir" Jun 11 18:36:34.338079 ip-10-0-141-55 kubenswrapper[2578]: I0611 18:36:34.338053 2578 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/git-repo" Jun 11 18:36:34.338079 ip-10-0-141-55 kubenswrapper[2578]: I0611 18:36:34.338060 2578 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/host-path" Jun 11 18:36:34.338079 ip-10-0-141-55 kubenswrapper[2578]: I0611 18:36:34.338069 2578 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/nfs" Jun 11 18:36:34.338079 ip-10-0-141-55 kubenswrapper[2578]: I0611 18:36:34.338075 2578 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/secret" Jun 11 18:36:34.338362 ip-10-0-141-55 kubenswrapper[2578]: I0611 18:36:34.338353 2578 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/iscsi" Jun 11 18:36:34.338362 ip-10-0-141-55 kubenswrapper[2578]: I0611 18:36:34.338362 2578 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/downward-api" Jun 11 18:36:34.338416 ip-10-0-141-55 kubenswrapper[2578]: I0611 18:36:34.338368 2578 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/fc" Jun 11 18:36:34.338416 ip-10-0-141-55 kubenswrapper[2578]: I0611 18:36:34.338374 2578 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/configmap" Jun 11 18:36:34.338416 ip-10-0-141-55 kubenswrapper[2578]: I0611 18:36:34.338386 2578 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/projected" Jun 11 18:36:34.338416 ip-10-0-141-55 kubenswrapper[2578]: I0611 18:36:34.338393 2578 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/local-volume" Jun 11 18:36:34.339108 ip-10-0-141-55 kubenswrapper[2578]: I0611 18:36:34.339097 2578 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/csi" Jun 11 18:36:34.339108 ip-10-0-141-55 kubenswrapper[2578]: I0611 18:36:34.339107 2578 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/image" Jun 11 18:36:34.342501 ip-10-0-141-55 kubenswrapper[2578]: I0611 18:36:34.342485 2578 server.go:1268] "Started kubelet" Jun 11 18:36:34.342630 ip-10-0-141-55 kubenswrapper[2578]: I0611 18:36:34.342588 2578 server.go:180] "Starting to listen" address="0.0.0.0" port=10250 Jun 11 18:36:34.342705 ip-10-0-141-55 kubenswrapper[2578]: I0611 18:36:34.342644 2578 ratelimit.go:56] "Setting rate limiting for endpoint" service="podresources" qps=100 burstTokens=10 Jun 11 18:36:34.342779 ip-10-0-141-55 kubenswrapper[2578]: I0611 18:36:34.342759 2578 server_v1.go:49] "podresources" method="list" useActivePods=true Jun 11 18:36:34.342826 ip-10-0-141-55 kubenswrapper[2578]: E0611 18:36:34.342792 2578 reflector.go:205] "Failed to watch" err="failed to list *v1.Node: nodes \"ip-10-0-141-55.ec2.internal\" is forbidden: User \"system:anonymous\" cannot list resource \"nodes\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Node" Jun 11 18:36:34.342982 ip-10-0-141-55 kubenswrapper[2578]: E0611 18:36:34.342960 2578 reflector.go:205] "Failed to watch" err="failed to list *v1.Service: services is forbidden: User \"system:anonymous\" cannot list resource \"services\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Service" Jun 11 18:36:34.343105 ip-10-0-141-55 kubenswrapper[2578]: I0611 18:36:34.343091 2578 csi_plugin.go:990] Failed to contact API server when waiting for CSINode publishing: csinodes.storage.k8s.io "ip-10-0-141-55.ec2.internal" is forbidden: User "system:anonymous" cannot get resource "csinodes" in API group "storage.k8s.io" at the cluster scope Jun 11 18:36:34.344227 ip-10-0-141-55 systemd[1]: Started Kubernetes Kubelet. Jun 11 18:36:34.344362 ip-10-0-141-55 kubenswrapper[2578]: I0611 18:36:34.344309 2578 server.go:249] "Starting to serve the podresources API" endpoint="unix:/var/lib/kubelet/pod-resources/kubelet.sock" Jun 11 18:36:34.345805 ip-10-0-141-55 kubenswrapper[2578]: I0611 18:36:34.345790 2578 server.go:310] "Adding debug handlers to kubelet server" Jun 11 18:36:34.348651 ip-10-0-141-55 kubenswrapper[2578]: I0611 18:36:34.348628 2578 fs_resource_analyzer.go:67] "Starting FS ResourceAnalyzer" Jun 11 18:36:34.348651 ip-10-0-141-55 kubenswrapper[2578]: I0611 18:36:34.348642 2578 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kubelet-serving" Jun 11 18:36:34.348774 ip-10-0-141-55 kubenswrapper[2578]: E0611 18:36:34.348727 2578 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-141-55.ec2.internal\" not found" Jun 11 18:36:34.349246 ip-10-0-141-55 kubenswrapper[2578]: I0611 18:36:34.349171 2578 volume_manager.go:311] "The desired_state_of_world populator starts" Jun 11 18:36:34.349246 ip-10-0-141-55 kubenswrapper[2578]: I0611 18:36:34.349188 2578 volume_manager.go:313] "Starting Kubelet Volume Manager" Jun 11 18:36:34.349246 ip-10-0-141-55 kubenswrapper[2578]: I0611 18:36:34.349171 2578 desired_state_of_world_populator.go:146] "Desired state populator starts to run" Jun 11 18:36:34.349630 ip-10-0-141-55 kubenswrapper[2578]: I0611 18:36:34.349580 2578 factory.go:55] Registering systemd factory Jun 11 18:36:34.349630 ip-10-0-141-55 kubenswrapper[2578]: I0611 18:36:34.349603 2578 factory.go:223] Registration of the systemd container factory successfully Jun 11 18:36:34.349757 ip-10-0-141-55 kubenswrapper[2578]: E0611 18:36:34.349699 2578 kubelet.go:1638] "Image garbage collection failed once. Stats initialization may not have completed yet" err="failed to get imageFs info: unable to find data in memory cache" Jun 11 18:36:34.349876 ip-10-0-141-55 kubenswrapper[2578]: I0611 18:36:34.349838 2578 factory.go:153] Registering CRI-O factory Jun 11 18:36:34.349876 ip-10-0-141-55 kubenswrapper[2578]: I0611 18:36:34.349869 2578 factory.go:223] Registration of the crio container factory successfully Jun 11 18:36:34.350035 ip-10-0-141-55 kubenswrapper[2578]: I0611 18:36:34.349921 2578 factory.go:221] Registration of the containerd container factory failed: unable to create containerd client: containerd: cannot unix dial containerd api service: dial unix /run/containerd/containerd.sock: connect: no such file or directory Jun 11 18:36:34.350035 ip-10-0-141-55 kubenswrapper[2578]: I0611 18:36:34.349945 2578 factory.go:103] Registering Raw factory Jun 11 18:36:34.350035 ip-10-0-141-55 kubenswrapper[2578]: I0611 18:36:34.349960 2578 manager.go:1196] Started watching for new ooms in manager Jun 11 18:36:34.350035 ip-10-0-141-55 kubenswrapper[2578]: I0611 18:36:34.349989 2578 reconstruct.go:97] "Volume reconstruction finished" Jun 11 18:36:34.350035 ip-10-0-141-55 kubenswrapper[2578]: I0611 18:36:34.349998 2578 reconciler.go:29] "Reconciler: start to sync state" Jun 11 18:36:34.350637 ip-10-0-141-55 kubenswrapper[2578]: I0611 18:36:34.350617 2578 manager.go:349] Starting recovery of all containers Jun 11 18:36:34.354879 ip-10-0-141-55 kubenswrapper[2578]: E0611 18:36:34.354836 2578 reflector.go:205] "Failed to watch" err="failed to list *v1.CSIDriver: csidrivers.storage.k8s.io is forbidden: User \"system:anonymous\" cannot list resource \"csidrivers\" in API group \"storage.k8s.io\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.CSIDriver" Jun 11 18:36:34.355960 ip-10-0-141-55 kubenswrapper[2578]: E0611 18:36:34.355927 2578 controller.go:145] "Failed to ensure lease exists, will retry" err="leases.coordination.k8s.io \"ip-10-0-141-55.ec2.internal\" is forbidden: User \"system:anonymous\" cannot get resource \"leases\" in API group \"coordination.k8s.io\" in the namespace \"kube-node-lease\"" interval="200ms" Jun 11 18:36:34.356051 ip-10-0-141-55 kubenswrapper[2578]: E0611 18:36:34.354416 2578 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-141-55.ec2.internal.18b81aafa6a4f830 default 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-141-55.ec2.internal,UID:ip-10-0-141-55.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:Starting,Message:Starting kubelet.,Source:EventSource{Component:kubelet,Host:ip-10-0-141-55.ec2.internal,},FirstTimestamp:2026-06-11 18:36:34.34245944 +0000 UTC m=+0.297134036,LastTimestamp:2026-06-11 18:36:34.34245944 +0000 UTC m=+0.297134036,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-141-55.ec2.internal,}" Jun 11 18:36:34.363180 ip-10-0-141-55 kubenswrapper[2578]: I0611 18:36:34.363078 2578 manager.go:354] Recovery completed Jun 11 18:36:34.367065 ip-10-0-141-55 kubenswrapper[2578]: I0611 18:36:34.367054 2578 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jun 11 18:36:34.370370 ip-10-0-141-55 kubenswrapper[2578]: I0611 18:36:34.370345 2578 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-141-55.ec2.internal" event="NodeHasSufficientMemory" Jun 11 18:36:34.370453 ip-10-0-141-55 kubenswrapper[2578]: I0611 18:36:34.370385 2578 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-141-55.ec2.internal" event="NodeHasNoDiskPressure" Jun 11 18:36:34.370453 ip-10-0-141-55 kubenswrapper[2578]: I0611 18:36:34.370396 2578 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-141-55.ec2.internal" event="NodeHasSufficientPID" Jun 11 18:36:34.370926 ip-10-0-141-55 kubenswrapper[2578]: I0611 18:36:34.370910 2578 cpu_manager.go:222] "Starting CPU manager" policy="none" Jun 11 18:36:34.370926 ip-10-0-141-55 kubenswrapper[2578]: I0611 18:36:34.370926 2578 cpu_manager.go:223] "Reconciling" reconcilePeriod="10s" Jun 11 18:36:34.371024 ip-10-0-141-55 kubenswrapper[2578]: I0611 18:36:34.370941 2578 state_mem.go:36] "Initialized new in-memory state store" Jun 11 18:36:34.371024 ip-10-0-141-55 kubenswrapper[2578]: I0611 18:36:34.370917 2578 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jun 11 18:36:34.371979 ip-10-0-141-55 kubenswrapper[2578]: I0611 18:36:34.371960 2578 policy_none.go:49] "None policy: Start" Jun 11 18:36:34.372049 ip-10-0-141-55 kubenswrapper[2578]: I0611 18:36:34.371983 2578 memory_manager.go:187] "Starting memorymanager" policy="None" Jun 11 18:36:34.372049 ip-10-0-141-55 kubenswrapper[2578]: I0611 18:36:34.371997 2578 state_mem.go:36] "Initializing new in-memory state store" logger="Memory Manager state checkpoint" Jun 11 18:36:34.372227 ip-10-0-141-55 kubenswrapper[2578]: I0611 18:36:34.372206 2578 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-141-55.ec2.internal" event="NodeHasSufficientMemory" Jun 11 18:36:34.372295 ip-10-0-141-55 kubenswrapper[2578]: I0611 18:36:34.372242 2578 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-141-55.ec2.internal" event="NodeHasNoDiskPressure" Jun 11 18:36:34.372295 ip-10-0-141-55 kubenswrapper[2578]: I0611 18:36:34.372255 2578 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-141-55.ec2.internal" event="NodeHasSufficientPID" Jun 11 18:36:34.373010 ip-10-0-141-55 kubenswrapper[2578]: E0611 18:36:34.372812 2578 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-141-55.ec2.internal.18b81aafa84ed9da default 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-141-55.ec2.internal,UID:ip-10-0-141-55.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:NodeHasSufficientMemory,Message:Node ip-10-0-141-55.ec2.internal status is now: NodeHasSufficientMemory,Source:EventSource{Component:kubelet,Host:ip-10-0-141-55.ec2.internal,},FirstTimestamp:2026-06-11 18:36:34.37037001 +0000 UTC m=+0.325044613,LastTimestamp:2026-06-11 18:36:34.37037001 +0000 UTC m=+0.325044613,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-141-55.ec2.internal,}" Jun 11 18:36:34.373541 ip-10-0-141-55 kubenswrapper[2578]: I0611 18:36:34.373528 2578 policy_none.go:47] "Start" Jun 11 18:36:34.383240 ip-10-0-141-55 kubenswrapper[2578]: E0611 18:36:34.383179 2578 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-141-55.ec2.internal.18b81aafa84f2b6a default 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-141-55.ec2.internal,UID:ip-10-0-141-55.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:NodeHasNoDiskPressure,Message:Node ip-10-0-141-55.ec2.internal status is now: NodeHasNoDiskPressure,Source:EventSource{Component:kubelet,Host:ip-10-0-141-55.ec2.internal,},FirstTimestamp:2026-06-11 18:36:34.37039089 +0000 UTC m=+0.325065486,LastTimestamp:2026-06-11 18:36:34.37039089 +0000 UTC m=+0.325065486,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-141-55.ec2.internal,}" Jun 11 18:36:34.393819 ip-10-0-141-55 kubenswrapper[2578]: E0611 18:36:34.393735 2578 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-141-55.ec2.internal.18b81aafa84f50c4 default 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-141-55.ec2.internal,UID:ip-10-0-141-55.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:NodeHasSufficientPID,Message:Node ip-10-0-141-55.ec2.internal status is now: NodeHasSufficientPID,Source:EventSource{Component:kubelet,Host:ip-10-0-141-55.ec2.internal,},FirstTimestamp:2026-06-11 18:36:34.370400452 +0000 UTC m=+0.325075050,LastTimestamp:2026-06-11 18:36:34.370400452 +0000 UTC m=+0.325075050,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-141-55.ec2.internal,}" Jun 11 18:36:34.401073 ip-10-0-141-55 kubenswrapper[2578]: E0611 18:36:34.401005 2578 event.go:359] "Server rejected event (will not retry!)" err="events \"ip-10-0-141-55.ec2.internal.18b81aafa84ed9da\" is forbidden: User \"system:anonymous\" cannot patch resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-141-55.ec2.internal.18b81aafa84ed9da default 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-141-55.ec2.internal,UID:ip-10-0-141-55.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:NodeHasSufficientMemory,Message:Node ip-10-0-141-55.ec2.internal status is now: NodeHasSufficientMemory,Source:EventSource{Component:kubelet,Host:ip-10-0-141-55.ec2.internal,},FirstTimestamp:2026-06-11 18:36:34.37037001 +0000 UTC m=+0.325044613,LastTimestamp:2026-06-11 18:36:34.372224954 +0000 UTC m=+0.326899553,Count:2,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-141-55.ec2.internal,}" Jun 11 18:36:34.408133 ip-10-0-141-55 kubenswrapper[2578]: I0611 18:36:34.408120 2578 manager.go:337] "Starting Device Plugin manager" Jun 11 18:36:34.413612 ip-10-0-141-55 kubenswrapper[2578]: E0611 18:36:34.408149 2578 manager.go:513] "Failed to read data from checkpoint" err="checkpoint is not found" checkpoint="kubelet_internal_checkpoint" Jun 11 18:36:34.413612 ip-10-0-141-55 kubenswrapper[2578]: I0611 18:36:34.408158 2578 server.go:87] "Starting device plugin registration server" Jun 11 18:36:34.413612 ip-10-0-141-55 kubenswrapper[2578]: I0611 18:36:34.408359 2578 eviction_manager.go:189] "Eviction manager: starting control loop" Jun 11 18:36:34.413612 ip-10-0-141-55 kubenswrapper[2578]: I0611 18:36:34.408372 2578 container_log_manager.go:146] "Initializing container log rotate workers" workers=1 monitorPeriod="10s" Jun 11 18:36:34.413612 ip-10-0-141-55 kubenswrapper[2578]: I0611 18:36:34.408968 2578 plugin_watcher.go:51] "Plugin Watcher Start" path="/var/lib/kubelet/plugins_registry" Jun 11 18:36:34.413612 ip-10-0-141-55 kubenswrapper[2578]: I0611 18:36:34.409041 2578 plugin_manager.go:116] "The desired_state_of_world populator (plugin watcher) starts" Jun 11 18:36:34.413612 ip-10-0-141-55 kubenswrapper[2578]: I0611 18:36:34.409049 2578 plugin_manager.go:118] "Starting Kubelet Plugin Manager" Jun 11 18:36:34.413612 ip-10-0-141-55 kubenswrapper[2578]: E0611 18:36:34.409199 2578 eviction_manager.go:267] "eviction manager: failed to check if we have separate container filesystem. Ignoring." err="non-existent label \"crio-containers\"" Jun 11 18:36:34.413612 ip-10-0-141-55 kubenswrapper[2578]: E0611 18:36:34.409252 2578 eviction_manager.go:292] "Eviction manager: failed to get summary stats" err="failed to get node info: node \"ip-10-0-141-55.ec2.internal\" not found" Jun 11 18:36:34.413612 ip-10-0-141-55 kubenswrapper[2578]: E0611 18:36:34.411732 2578 event.go:359] "Server rejected event (will not retry!)" err="events \"ip-10-0-141-55.ec2.internal.18b81aafa84f2b6a\" is forbidden: User \"system:anonymous\" cannot patch resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-141-55.ec2.internal.18b81aafa84f2b6a default 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-141-55.ec2.internal,UID:ip-10-0-141-55.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:NodeHasNoDiskPressure,Message:Node ip-10-0-141-55.ec2.internal status is now: NodeHasNoDiskPressure,Source:EventSource{Component:kubelet,Host:ip-10-0-141-55.ec2.internal,},FirstTimestamp:2026-06-11 18:36:34.37039089 +0000 UTC m=+0.325065486,LastTimestamp:2026-06-11 18:36:34.372247794 +0000 UTC m=+0.326922393,Count:2,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-141-55.ec2.internal,}" Jun 11 18:36:34.414003 ip-10-0-141-55 kubenswrapper[2578]: I0611 18:36:34.413798 2578 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv4" Jun 11 18:36:34.414980 ip-10-0-141-55 kubenswrapper[2578]: I0611 18:36:34.414966 2578 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv6" Jun 11 18:36:34.415029 ip-10-0-141-55 kubenswrapper[2578]: I0611 18:36:34.414998 2578 status_manager.go:244] "Starting to sync pod status with apiserver" Jun 11 18:36:34.415029 ip-10-0-141-55 kubenswrapper[2578]: I0611 18:36:34.415015 2578 kubelet.go:2448] "Starting kubelet main sync loop" Jun 11 18:36:34.415125 ip-10-0-141-55 kubenswrapper[2578]: E0611 18:36:34.415049 2578 kubelet.go:2472] "Skipping pod synchronization" err="PLEG is not healthy: pleg has yet to be successful" Jun 11 18:36:34.423138 ip-10-0-141-55 kubenswrapper[2578]: E0611 18:36:34.423076 2578 event.go:359] "Server rejected event (will not retry!)" err="events \"ip-10-0-141-55.ec2.internal.18b81aafa84f50c4\" is forbidden: User \"system:anonymous\" cannot patch resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-141-55.ec2.internal.18b81aafa84f50c4 default 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-141-55.ec2.internal,UID:ip-10-0-141-55.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:NodeHasSufficientPID,Message:Node ip-10-0-141-55.ec2.internal status is now: NodeHasSufficientPID,Source:EventSource{Component:kubelet,Host:ip-10-0-141-55.ec2.internal,},FirstTimestamp:2026-06-11 18:36:34.370400452 +0000 UTC m=+0.325075050,LastTimestamp:2026-06-11 18:36:34.372260192 +0000 UTC m=+0.326934793,Count:2,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-141-55.ec2.internal,}" Jun 11 18:36:34.423228 ip-10-0-141-55 kubenswrapper[2578]: E0611 18:36:34.423159 2578 reflector.go:205] "Failed to watch" err="failed to list *v1.RuntimeClass: runtimeclasses.node.k8s.io is forbidden: User \"system:anonymous\" cannot list resource \"runtimeclasses\" in API group \"node.k8s.io\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.RuntimeClass" Jun 11 18:36:34.434572 ip-10-0-141-55 kubenswrapper[2578]: E0611 18:36:34.434500 2578 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-141-55.ec2.internal.18b81aafaab1b259 default 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-141-55.ec2.internal,UID:ip-10-0-141-55.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:NodeAllocatableEnforced,Message:Updated Node Allocatable limit across pods,Source:EventSource{Component:kubelet,Host:ip-10-0-141-55.ec2.internal,},FirstTimestamp:2026-06-11 18:36:34.410402393 +0000 UTC m=+0.365076982,LastTimestamp:2026-06-11 18:36:34.410402393 +0000 UTC m=+0.365076982,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-141-55.ec2.internal,}" Jun 11 18:36:34.509945 ip-10-0-141-55 kubenswrapper[2578]: I0611 18:36:34.509916 2578 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jun 11 18:36:34.510906 ip-10-0-141-55 kubenswrapper[2578]: I0611 18:36:34.510883 2578 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-141-55.ec2.internal" event="NodeHasSufficientMemory" Jun 11 18:36:34.511029 ip-10-0-141-55 kubenswrapper[2578]: I0611 18:36:34.510924 2578 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-141-55.ec2.internal" event="NodeHasNoDiskPressure" Jun 11 18:36:34.511363 ip-10-0-141-55 kubenswrapper[2578]: I0611 18:36:34.511348 2578 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-141-55.ec2.internal" event="NodeHasSufficientPID" Jun 11 18:36:34.511450 ip-10-0-141-55 kubenswrapper[2578]: I0611 18:36:34.511387 2578 kubelet_node_status.go:78] "Attempting to register node" node="ip-10-0-141-55.ec2.internal" Jun 11 18:36:34.515938 ip-10-0-141-55 kubenswrapper[2578]: I0611 18:36:34.515917 2578 kubelet.go:2535] "SyncLoop ADD" source="file" pods=["openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-141-55.ec2.internal","kube-system/kube-apiserver-proxy-ip-10-0-141-55.ec2.internal"] Jun 11 18:36:34.516039 ip-10-0-141-55 kubenswrapper[2578]: I0611 18:36:34.515988 2578 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jun 11 18:36:34.517247 ip-10-0-141-55 kubenswrapper[2578]: I0611 18:36:34.517230 2578 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-141-55.ec2.internal" event="NodeHasSufficientMemory" Jun 11 18:36:34.517336 ip-10-0-141-55 kubenswrapper[2578]: I0611 18:36:34.517258 2578 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-141-55.ec2.internal" event="NodeHasNoDiskPressure" Jun 11 18:36:34.517336 ip-10-0-141-55 kubenswrapper[2578]: I0611 18:36:34.517268 2578 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-141-55.ec2.internal" event="NodeHasSufficientPID" Jun 11 18:36:34.518520 ip-10-0-141-55 kubenswrapper[2578]: I0611 18:36:34.518509 2578 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jun 11 18:36:34.518646 ip-10-0-141-55 kubenswrapper[2578]: I0611 18:36:34.518632 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-141-55.ec2.internal" Jun 11 18:36:34.518689 ip-10-0-141-55 kubenswrapper[2578]: I0611 18:36:34.518664 2578 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jun 11 18:36:34.519227 ip-10-0-141-55 kubenswrapper[2578]: I0611 18:36:34.519206 2578 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-141-55.ec2.internal" event="NodeHasSufficientMemory" Jun 11 18:36:34.519319 ip-10-0-141-55 kubenswrapper[2578]: I0611 18:36:34.519239 2578 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-141-55.ec2.internal" event="NodeHasNoDiskPressure" Jun 11 18:36:34.519319 ip-10-0-141-55 kubenswrapper[2578]: I0611 18:36:34.519249 2578 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-141-55.ec2.internal" event="NodeHasSufficientPID" Jun 11 18:36:34.519319 ip-10-0-141-55 kubenswrapper[2578]: I0611 18:36:34.519260 2578 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-141-55.ec2.internal" event="NodeHasSufficientMemory" Jun 11 18:36:34.519319 ip-10-0-141-55 kubenswrapper[2578]: I0611 18:36:34.519301 2578 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-141-55.ec2.internal" event="NodeHasNoDiskPressure" Jun 11 18:36:34.519469 ip-10-0-141-55 kubenswrapper[2578]: I0611 18:36:34.519327 2578 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-141-55.ec2.internal" event="NodeHasSufficientPID" Jun 11 18:36:34.519642 ip-10-0-141-55 kubenswrapper[2578]: E0611 18:36:34.519522 2578 event.go:359] "Server rejected event (will not retry!)" err="events \"ip-10-0-141-55.ec2.internal.18b81aafa84ed9da\" is forbidden: User \"system:anonymous\" cannot patch resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-141-55.ec2.internal.18b81aafa84ed9da default 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-141-55.ec2.internal,UID:ip-10-0-141-55.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:NodeHasSufficientMemory,Message:Node ip-10-0-141-55.ec2.internal status is now: NodeHasSufficientMemory,Source:EventSource{Component:kubelet,Host:ip-10-0-141-55.ec2.internal,},FirstTimestamp:2026-06-11 18:36:34.37037001 +0000 UTC m=+0.325044613,LastTimestamp:2026-06-11 18:36:34.510905835 +0000 UTC m=+0.465580435,Count:3,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-141-55.ec2.internal,}" Jun 11 18:36:34.520279 ip-10-0-141-55 kubenswrapper[2578]: I0611 18:36:34.520262 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-141-55.ec2.internal" Jun 11 18:36:34.520326 ip-10-0-141-55 kubenswrapper[2578]: I0611 18:36:34.520303 2578 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jun 11 18:36:34.520960 ip-10-0-141-55 kubenswrapper[2578]: I0611 18:36:34.520945 2578 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-141-55.ec2.internal" event="NodeHasSufficientMemory" Jun 11 18:36:34.521052 ip-10-0-141-55 kubenswrapper[2578]: I0611 18:36:34.520974 2578 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-141-55.ec2.internal" event="NodeHasNoDiskPressure" Jun 11 18:36:34.521052 ip-10-0-141-55 kubenswrapper[2578]: I0611 18:36:34.520987 2578 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-141-55.ec2.internal" event="NodeHasSufficientPID" Jun 11 18:36:34.522860 ip-10-0-141-55 kubenswrapper[2578]: E0611 18:36:34.522838 2578 kubelet_node_status.go:116] "Unable to register node with API server, error getting existing node" err="nodes \"ip-10-0-141-55.ec2.internal\" is forbidden: User \"system:anonymous\" cannot get resource \"nodes\" in API group \"\" at the cluster scope" node="ip-10-0-141-55.ec2.internal" Jun 11 18:36:34.523063 ip-10-0-141-55 kubenswrapper[2578]: E0611 18:36:34.522969 2578 event.go:359] "Server rejected event (will not retry!)" err="events \"ip-10-0-141-55.ec2.internal.18b81aafa84f2b6a\" is forbidden: User \"system:anonymous\" cannot patch resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-141-55.ec2.internal.18b81aafa84f2b6a default 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-141-55.ec2.internal,UID:ip-10-0-141-55.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:NodeHasNoDiskPressure,Message:Node ip-10-0-141-55.ec2.internal status is now: NodeHasNoDiskPressure,Source:EventSource{Component:kubelet,Host:ip-10-0-141-55.ec2.internal,},FirstTimestamp:2026-06-11 18:36:34.37039089 +0000 UTC m=+0.325065486,LastTimestamp:2026-06-11 18:36:34.51093162 +0000 UTC m=+0.465606217,Count:3,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-141-55.ec2.internal,}" Jun 11 18:36:34.528601 ip-10-0-141-55 kubenswrapper[2578]: E0611 18:36:34.528499 2578 event.go:359] "Server rejected event (will not retry!)" err="events \"ip-10-0-141-55.ec2.internal.18b81aafa84f50c4\" is forbidden: User \"system:anonymous\" cannot patch resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-141-55.ec2.internal.18b81aafa84f50c4 default 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-141-55.ec2.internal,UID:ip-10-0-141-55.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:NodeHasSufficientPID,Message:Node ip-10-0-141-55.ec2.internal status is now: NodeHasSufficientPID,Source:EventSource{Component:kubelet,Host:ip-10-0-141-55.ec2.internal,},FirstTimestamp:2026-06-11 18:36:34.370400452 +0000 UTC m=+0.325075050,LastTimestamp:2026-06-11 18:36:34.511359135 +0000 UTC m=+0.466033731,Count:3,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-141-55.ec2.internal,}" Jun 11 18:36:34.532091 ip-10-0-141-55 kubenswrapper[2578]: E0611 18:36:34.532031 2578 event.go:359] "Server rejected event (will not retry!)" err="events \"ip-10-0-141-55.ec2.internal.18b81aafa84ed9da\" is forbidden: User \"system:anonymous\" cannot patch resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-141-55.ec2.internal.18b81aafa84ed9da default 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-141-55.ec2.internal,UID:ip-10-0-141-55.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:NodeHasSufficientMemory,Message:Node ip-10-0-141-55.ec2.internal status is now: NodeHasSufficientMemory,Source:EventSource{Component:kubelet,Host:ip-10-0-141-55.ec2.internal,},FirstTimestamp:2026-06-11 18:36:34.37037001 +0000 UTC m=+0.325044613,LastTimestamp:2026-06-11 18:36:34.517245271 +0000 UTC m=+0.471919868,Count:4,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-141-55.ec2.internal,}" Jun 11 18:36:34.535610 ip-10-0-141-55 kubenswrapper[2578]: E0611 18:36:34.535538 2578 event.go:359] "Server rejected event (will not retry!)" err="events \"ip-10-0-141-55.ec2.internal.18b81aafa84f2b6a\" is forbidden: User \"system:anonymous\" cannot patch resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-141-55.ec2.internal.18b81aafa84f2b6a default 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-141-55.ec2.internal,UID:ip-10-0-141-55.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:NodeHasNoDiskPressure,Message:Node ip-10-0-141-55.ec2.internal status is now: NodeHasNoDiskPressure,Source:EventSource{Component:kubelet,Host:ip-10-0-141-55.ec2.internal,},FirstTimestamp:2026-06-11 18:36:34.37039089 +0000 UTC m=+0.325065486,LastTimestamp:2026-06-11 18:36:34.517262786 +0000 UTC m=+0.471937383,Count:4,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-141-55.ec2.internal,}" Jun 11 18:36:34.543279 ip-10-0-141-55 kubenswrapper[2578]: E0611 18:36:34.543191 2578 event.go:359] "Server rejected event (will not retry!)" err="events \"ip-10-0-141-55.ec2.internal.18b81aafa84f50c4\" is forbidden: User \"system:anonymous\" cannot patch resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-141-55.ec2.internal.18b81aafa84f50c4 default 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-141-55.ec2.internal,UID:ip-10-0-141-55.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:NodeHasSufficientPID,Message:Node ip-10-0-141-55.ec2.internal status is now: NodeHasSufficientPID,Source:EventSource{Component:kubelet,Host:ip-10-0-141-55.ec2.internal,},FirstTimestamp:2026-06-11 18:36:34.370400452 +0000 UTC m=+0.325075050,LastTimestamp:2026-06-11 18:36:34.517272941 +0000 UTC m=+0.471947539,Count:4,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-141-55.ec2.internal,}" Jun 11 18:36:34.544748 ip-10-0-141-55 kubenswrapper[2578]: E0611 18:36:34.544730 2578 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-141-55.ec2.internal\" not found" node="ip-10-0-141-55.ec2.internal" Jun 11 18:36:34.549185 ip-10-0-141-55 kubenswrapper[2578]: E0611 18:36:34.549169 2578 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-141-55.ec2.internal\" not found" node="ip-10-0-141-55.ec2.internal" Jun 11 18:36:34.551067 ip-10-0-141-55 kubenswrapper[2578]: I0611 18:36:34.551050 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/a7e51dec29aa10b42d4127d190b80186-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-141-55.ec2.internal\" (UID: \"a7e51dec29aa10b42d4127d190b80186\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-141-55.ec2.internal" Jun 11 18:36:34.551153 ip-10-0-141-55 kubenswrapper[2578]: I0611 18:36:34.551075 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/a7e51dec29aa10b42d4127d190b80186-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-141-55.ec2.internal\" (UID: \"a7e51dec29aa10b42d4127d190b80186\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-141-55.ec2.internal" Jun 11 18:36:34.551153 ip-10-0-141-55 kubenswrapper[2578]: I0611 18:36:34.551099 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/668e0dfb5ee3fc6875806e2b3acb31d7-config\") pod \"kube-apiserver-proxy-ip-10-0-141-55.ec2.internal\" (UID: \"668e0dfb5ee3fc6875806e2b3acb31d7\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-141-55.ec2.internal" Jun 11 18:36:34.551264 ip-10-0-141-55 kubenswrapper[2578]: E0611 18:36:34.551154 2578 event.go:359] "Server rejected event (will not retry!)" err="events \"ip-10-0-141-55.ec2.internal.18b81aafa84ed9da\" is forbidden: User \"system:anonymous\" cannot patch resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-141-55.ec2.internal.18b81aafa84ed9da default 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-141-55.ec2.internal,UID:ip-10-0-141-55.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:NodeHasSufficientMemory,Message:Node ip-10-0-141-55.ec2.internal status is now: NodeHasSufficientMemory,Source:EventSource{Component:kubelet,Host:ip-10-0-141-55.ec2.internal,},FirstTimestamp:2026-06-11 18:36:34.37037001 +0000 UTC m=+0.325044613,LastTimestamp:2026-06-11 18:36:34.519226256 +0000 UTC m=+0.473900854,Count:5,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-141-55.ec2.internal,}" Jun 11 18:36:34.563206 ip-10-0-141-55 kubenswrapper[2578]: E0611 18:36:34.563177 2578 controller.go:145] "Failed to ensure lease exists, will retry" err="leases.coordination.k8s.io \"ip-10-0-141-55.ec2.internal\" is forbidden: User \"system:anonymous\" cannot get resource \"leases\" in API group \"coordination.k8s.io\" in the namespace \"kube-node-lease\"" interval="400ms" Jun 11 18:36:34.563294 ip-10-0-141-55 kubenswrapper[2578]: E0611 18:36:34.563175 2578 event.go:359] "Server rejected event (will not retry!)" err="events \"ip-10-0-141-55.ec2.internal.18b81aafa84f2b6a\" is forbidden: User \"system:anonymous\" cannot patch resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-141-55.ec2.internal.18b81aafa84f2b6a default 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-141-55.ec2.internal,UID:ip-10-0-141-55.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:NodeHasNoDiskPressure,Message:Node ip-10-0-141-55.ec2.internal status is now: NodeHasNoDiskPressure,Source:EventSource{Component:kubelet,Host:ip-10-0-141-55.ec2.internal,},FirstTimestamp:2026-06-11 18:36:34.37039089 +0000 UTC m=+0.325065486,LastTimestamp:2026-06-11 18:36:34.519244668 +0000 UTC m=+0.473919265,Count:5,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-141-55.ec2.internal,}" Jun 11 18:36:34.567393 ip-10-0-141-55 kubenswrapper[2578]: E0611 18:36:34.567334 2578 event.go:359] "Server rejected event (will not retry!)" err="events \"ip-10-0-141-55.ec2.internal.18b81aafa84f50c4\" is forbidden: User \"system:anonymous\" cannot patch resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-141-55.ec2.internal.18b81aafa84f50c4 default 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-141-55.ec2.internal,UID:ip-10-0-141-55.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:NodeHasSufficientPID,Message:Node ip-10-0-141-55.ec2.internal status is now: NodeHasSufficientPID,Source:EventSource{Component:kubelet,Host:ip-10-0-141-55.ec2.internal,},FirstTimestamp:2026-06-11 18:36:34.370400452 +0000 UTC m=+0.325075050,LastTimestamp:2026-06-11 18:36:34.519254475 +0000 UTC m=+0.473929072,Count:5,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-141-55.ec2.internal,}" Jun 11 18:36:34.570720 ip-10-0-141-55 kubenswrapper[2578]: E0611 18:36:34.570657 2578 event.go:359] "Server rejected event (will not retry!)" err="events \"ip-10-0-141-55.ec2.internal.18b81aafa84ed9da\" is forbidden: User \"system:anonymous\" cannot patch resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-141-55.ec2.internal.18b81aafa84ed9da default 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-141-55.ec2.internal,UID:ip-10-0-141-55.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:NodeHasSufficientMemory,Message:Node ip-10-0-141-55.ec2.internal status is now: NodeHasSufficientMemory,Source:EventSource{Component:kubelet,Host:ip-10-0-141-55.ec2.internal,},FirstTimestamp:2026-06-11 18:36:34.37037001 +0000 UTC m=+0.325044613,LastTimestamp:2026-06-11 18:36:34.519272302 +0000 UTC m=+0.473946900,Count:6,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-141-55.ec2.internal,}" Jun 11 18:36:34.578298 ip-10-0-141-55 kubenswrapper[2578]: E0611 18:36:34.578243 2578 event.go:359] "Server rejected event (will not retry!)" err="events \"ip-10-0-141-55.ec2.internal.18b81aafa84f2b6a\" is forbidden: User \"system:anonymous\" cannot patch resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-141-55.ec2.internal.18b81aafa84f2b6a default 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-141-55.ec2.internal,UID:ip-10-0-141-55.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:NodeHasNoDiskPressure,Message:Node ip-10-0-141-55.ec2.internal status is now: NodeHasNoDiskPressure,Source:EventSource{Component:kubelet,Host:ip-10-0-141-55.ec2.internal,},FirstTimestamp:2026-06-11 18:36:34.37039089 +0000 UTC m=+0.325065486,LastTimestamp:2026-06-11 18:36:34.519308015 +0000 UTC m=+0.473982613,Count:6,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-141-55.ec2.internal,}" Jun 11 18:36:34.587400 ip-10-0-141-55 kubenswrapper[2578]: E0611 18:36:34.587343 2578 event.go:359] "Server rejected event (will not retry!)" err="events \"ip-10-0-141-55.ec2.internal.18b81aafa84f50c4\" is forbidden: User \"system:anonymous\" cannot patch resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-141-55.ec2.internal.18b81aafa84f50c4 default 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-141-55.ec2.internal,UID:ip-10-0-141-55.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:NodeHasSufficientPID,Message:Node ip-10-0-141-55.ec2.internal status is now: NodeHasSufficientPID,Source:EventSource{Component:kubelet,Host:ip-10-0-141-55.ec2.internal,},FirstTimestamp:2026-06-11 18:36:34.370400452 +0000 UTC m=+0.325075050,LastTimestamp:2026-06-11 18:36:34.519331997 +0000 UTC m=+0.474006595,Count:6,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-141-55.ec2.internal,}" Jun 11 18:36:34.598397 ip-10-0-141-55 kubenswrapper[2578]: E0611 18:36:34.598340 2578 event.go:359] "Server rejected event (will not retry!)" err="events \"ip-10-0-141-55.ec2.internal.18b81aafa84ed9da\" is forbidden: User \"system:anonymous\" cannot patch resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-141-55.ec2.internal.18b81aafa84ed9da default 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-141-55.ec2.internal,UID:ip-10-0-141-55.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:NodeHasSufficientMemory,Message:Node ip-10-0-141-55.ec2.internal status is now: NodeHasSufficientMemory,Source:EventSource{Component:kubelet,Host:ip-10-0-141-55.ec2.internal,},FirstTimestamp:2026-06-11 18:36:34.37037001 +0000 UTC m=+0.325044613,LastTimestamp:2026-06-11 18:36:34.520958711 +0000 UTC m=+0.475633310,Count:7,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-141-55.ec2.internal,}" Jun 11 18:36:34.608640 ip-10-0-141-55 kubenswrapper[2578]: E0611 18:36:34.608585 2578 event.go:359] "Server rejected event (will not retry!)" err="events \"ip-10-0-141-55.ec2.internal.18b81aafa84f2b6a\" is forbidden: User \"system:anonymous\" cannot patch resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-141-55.ec2.internal.18b81aafa84f2b6a default 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-141-55.ec2.internal,UID:ip-10-0-141-55.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:NodeHasNoDiskPressure,Message:Node ip-10-0-141-55.ec2.internal status is now: NodeHasNoDiskPressure,Source:EventSource{Component:kubelet,Host:ip-10-0-141-55.ec2.internal,},FirstTimestamp:2026-06-11 18:36:34.37039089 +0000 UTC m=+0.325065486,LastTimestamp:2026-06-11 18:36:34.52098072 +0000 UTC m=+0.475655318,Count:7,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-141-55.ec2.internal,}" Jun 11 18:36:34.620085 ip-10-0-141-55 kubenswrapper[2578]: E0611 18:36:34.620022 2578 event.go:359] "Server rejected event (will not retry!)" err="events \"ip-10-0-141-55.ec2.internal.18b81aafa84f50c4\" is forbidden: User \"system:anonymous\" cannot patch resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-141-55.ec2.internal.18b81aafa84f50c4 default 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-141-55.ec2.internal,UID:ip-10-0-141-55.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:NodeHasSufficientPID,Message:Node ip-10-0-141-55.ec2.internal status is now: NodeHasSufficientPID,Source:EventSource{Component:kubelet,Host:ip-10-0-141-55.ec2.internal,},FirstTimestamp:2026-06-11 18:36:34.370400452 +0000 UTC m=+0.325075050,LastTimestamp:2026-06-11 18:36:34.520992692 +0000 UTC m=+0.475667290,Count:7,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-141-55.ec2.internal,}" Jun 11 18:36:34.651387 ip-10-0-141-55 kubenswrapper[2578]: I0611 18:36:34.651347 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/a7e51dec29aa10b42d4127d190b80186-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-141-55.ec2.internal\" (UID: \"a7e51dec29aa10b42d4127d190b80186\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-141-55.ec2.internal" Jun 11 18:36:34.651387 ip-10-0-141-55 kubenswrapper[2578]: I0611 18:36:34.651392 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/a7e51dec29aa10b42d4127d190b80186-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-141-55.ec2.internal\" (UID: \"a7e51dec29aa10b42d4127d190b80186\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-141-55.ec2.internal" Jun 11 18:36:34.651581 ip-10-0-141-55 kubenswrapper[2578]: I0611 18:36:34.651408 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/668e0dfb5ee3fc6875806e2b3acb31d7-config\") pod \"kube-apiserver-proxy-ip-10-0-141-55.ec2.internal\" (UID: \"668e0dfb5ee3fc6875806e2b3acb31d7\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-141-55.ec2.internal" Jun 11 18:36:34.651581 ip-10-0-141-55 kubenswrapper[2578]: I0611 18:36:34.651471 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/a7e51dec29aa10b42d4127d190b80186-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-141-55.ec2.internal\" (UID: \"a7e51dec29aa10b42d4127d190b80186\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-141-55.ec2.internal" Jun 11 18:36:34.651581 ip-10-0-141-55 kubenswrapper[2578]: I0611 18:36:34.651524 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/a7e51dec29aa10b42d4127d190b80186-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-141-55.ec2.internal\" (UID: \"a7e51dec29aa10b42d4127d190b80186\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-141-55.ec2.internal" Jun 11 18:36:34.651742 ip-10-0-141-55 kubenswrapper[2578]: I0611 18:36:34.651600 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/host-path/668e0dfb5ee3fc6875806e2b3acb31d7-config\") pod \"kube-apiserver-proxy-ip-10-0-141-55.ec2.internal\" (UID: \"668e0dfb5ee3fc6875806e2b3acb31d7\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-141-55.ec2.internal" Jun 11 18:36:34.723515 ip-10-0-141-55 kubenswrapper[2578]: I0611 18:36:34.723484 2578 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jun 11 18:36:34.724676 ip-10-0-141-55 kubenswrapper[2578]: I0611 18:36:34.724657 2578 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-141-55.ec2.internal" event="NodeHasSufficientMemory" Jun 11 18:36:34.724779 ip-10-0-141-55 kubenswrapper[2578]: I0611 18:36:34.724694 2578 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-141-55.ec2.internal" event="NodeHasNoDiskPressure" Jun 11 18:36:34.724779 ip-10-0-141-55 kubenswrapper[2578]: I0611 18:36:34.724708 2578 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-141-55.ec2.internal" event="NodeHasSufficientPID" Jun 11 18:36:34.724779 ip-10-0-141-55 kubenswrapper[2578]: I0611 18:36:34.724744 2578 kubelet_node_status.go:78] "Attempting to register node" node="ip-10-0-141-55.ec2.internal" Jun 11 18:36:34.734425 ip-10-0-141-55 kubenswrapper[2578]: E0611 18:36:34.734345 2578 event.go:359] "Server rejected event (will not retry!)" err="events \"ip-10-0-141-55.ec2.internal.18b81aafa84ed9da\" is forbidden: User \"system:anonymous\" cannot patch resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-141-55.ec2.internal.18b81aafa84ed9da default 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-141-55.ec2.internal,UID:ip-10-0-141-55.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:NodeHasSufficientMemory,Message:Node ip-10-0-141-55.ec2.internal status is now: NodeHasSufficientMemory,Source:EventSource{Component:kubelet,Host:ip-10-0-141-55.ec2.internal,},FirstTimestamp:2026-06-11 18:36:34.37037001 +0000 UTC m=+0.325044613,LastTimestamp:2026-06-11 18:36:34.724676226 +0000 UTC m=+0.679350829,Count:8,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-141-55.ec2.internal,}" Jun 11 18:36:34.741462 ip-10-0-141-55 kubenswrapper[2578]: E0611 18:36:34.741441 2578 kubelet_node_status.go:116] "Unable to register node with API server, error getting existing node" err="nodes \"ip-10-0-141-55.ec2.internal\" is forbidden: User \"system:anonymous\" cannot get resource \"nodes\" in API group \"\" at the cluster scope" node="ip-10-0-141-55.ec2.internal" Jun 11 18:36:34.741549 ip-10-0-141-55 kubenswrapper[2578]: E0611 18:36:34.741494 2578 event.go:359] "Server rejected event (will not retry!)" err="events \"ip-10-0-141-55.ec2.internal.18b81aafa84f2b6a\" is forbidden: User \"system:anonymous\" cannot patch resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-141-55.ec2.internal.18b81aafa84f2b6a default 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-141-55.ec2.internal,UID:ip-10-0-141-55.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:NodeHasNoDiskPressure,Message:Node ip-10-0-141-55.ec2.internal status is now: NodeHasNoDiskPressure,Source:EventSource{Component:kubelet,Host:ip-10-0-141-55.ec2.internal,},FirstTimestamp:2026-06-11 18:36:34.37039089 +0000 UTC m=+0.325065486,LastTimestamp:2026-06-11 18:36:34.724700939 +0000 UTC m=+0.679375538,Count:8,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-141-55.ec2.internal,}" Jun 11 18:36:34.847546 ip-10-0-141-55 kubenswrapper[2578]: I0611 18:36:34.847443 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-141-55.ec2.internal" Jun 11 18:36:34.852388 ip-10-0-141-55 kubenswrapper[2578]: I0611 18:36:34.852374 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-141-55.ec2.internal" Jun 11 18:36:34.965781 ip-10-0-141-55 kubenswrapper[2578]: E0611 18:36:34.965744 2578 controller.go:145] "Failed to ensure lease exists, will retry" err="leases.coordination.k8s.io \"ip-10-0-141-55.ec2.internal\" is forbidden: User \"system:anonymous\" cannot get resource \"leases\" in API group \"coordination.k8s.io\" in the namespace \"kube-node-lease\"" interval="800ms" Jun 11 18:36:35.142311 ip-10-0-141-55 kubenswrapper[2578]: I0611 18:36:35.142236 2578 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jun 11 18:36:35.143432 ip-10-0-141-55 kubenswrapper[2578]: I0611 18:36:35.143405 2578 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-141-55.ec2.internal" event="NodeHasSufficientMemory" Jun 11 18:36:35.143594 ip-10-0-141-55 kubenswrapper[2578]: I0611 18:36:35.143447 2578 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-141-55.ec2.internal" event="NodeHasNoDiskPressure" Jun 11 18:36:35.143594 ip-10-0-141-55 kubenswrapper[2578]: I0611 18:36:35.143461 2578 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-141-55.ec2.internal" event="NodeHasSufficientPID" Jun 11 18:36:35.143594 ip-10-0-141-55 kubenswrapper[2578]: I0611 18:36:35.143496 2578 kubelet_node_status.go:78] "Attempting to register node" node="ip-10-0-141-55.ec2.internal" Jun 11 18:36:35.161933 ip-10-0-141-55 kubenswrapper[2578]: E0611 18:36:35.161902 2578 kubelet_node_status.go:116] "Unable to register node with API server, error getting existing node" err="nodes \"ip-10-0-141-55.ec2.internal\" is forbidden: User \"system:anonymous\" cannot get resource \"nodes\" in API group \"\" at the cluster scope" node="ip-10-0-141-55.ec2.internal" Jun 11 18:36:35.195990 ip-10-0-141-55 kubenswrapper[2578]: I0611 18:36:35.195960 2578 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-fdhxb" Jun 11 18:36:35.204033 ip-10-0-141-55 kubenswrapper[2578]: I0611 18:36:35.204000 2578 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-fdhxb" Jun 11 18:36:35.241788 ip-10-0-141-55 kubenswrapper[2578]: I0611 18:36:35.241766 2578 reflector.go:439] "Caches populated" type="*v1.Node" reflector="k8s.io/client-go/informers/factory.go:160" Jun 11 18:36:35.273347 ip-10-0-141-55 kubenswrapper[2578]: I0611 18:36:35.273314 2578 reflector.go:439] "Caches populated" type="*v1.Service" reflector="k8s.io/client-go/informers/factory.go:160" Jun 11 18:36:35.297814 ip-10-0-141-55 kubenswrapper[2578]: I0611 18:36:35.297793 2578 transport.go:147] "Certificate rotation detected, shutting down client connections to start using new credentials" Jun 11 18:36:35.298583 ip-10-0-141-55 kubenswrapper[2578]: I0611 18:36:35.297917 2578 reflector.go:571] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Service" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received" Jun 11 18:36:35.298583 ip-10-0-141-55 kubenswrapper[2578]: I0611 18:36:35.297917 2578 reflector.go:571] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Node" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received" Jun 11 18:36:35.307031 ip-10-0-141-55 kubenswrapper[2578]: W0611 18:36:35.307004 2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda7e51dec29aa10b42d4127d190b80186.slice/crio-2995be565f10e79a8de156c459b3f9836f6f26b82d100309e8da0c5d5d4586bf WatchSource:0}: Error finding container 2995be565f10e79a8de156c459b3f9836f6f26b82d100309e8da0c5d5d4586bf: Status 404 returned error can't find the container with id 2995be565f10e79a8de156c459b3f9836f6f26b82d100309e8da0c5d5d4586bf Jun 11 18:36:35.307441 ip-10-0-141-55 kubenswrapper[2578]: W0611 18:36:35.307423 2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod668e0dfb5ee3fc6875806e2b3acb31d7.slice/crio-c140c2dbe95f45c347dcd6c0c66f06813fb8968733708bc78b94b8cbbef9cccd WatchSource:0}: Error finding container c140c2dbe95f45c347dcd6c0c66f06813fb8968733708bc78b94b8cbbef9cccd: Status 404 returned error can't find the container with id c140c2dbe95f45c347dcd6c0c66f06813fb8968733708bc78b94b8cbbef9cccd Jun 11 18:36:35.310852 ip-10-0-141-55 kubenswrapper[2578]: I0611 18:36:35.310839 2578 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jun 11 18:36:35.334940 ip-10-0-141-55 kubenswrapper[2578]: I0611 18:36:35.334918 2578 apiserver.go:52] "Watching apiserver" Jun 11 18:36:35.338047 ip-10-0-141-55 kubenswrapper[2578]: I0611 18:36:35.338030 2578 reflector.go:439] "Caches populated" type="*v1.Pod" reflector="pkg/kubelet/config/apiserver.go:66" Jun 11 18:36:35.338142 ip-10-0-141-55 kubenswrapper[2578]: I0611 18:36:35.338126 2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=[] Jun 11 18:36:35.350096 ip-10-0-141-55 kubenswrapper[2578]: I0611 18:36:35.350078 2578 desired_state_of_world_populator.go:154] "Finished populating initial desired state of world" Jun 11 18:36:35.351895 ip-10-0-141-55 kubenswrapper[2578]: I0611 18:36:35.351884 2578 nodeinfomanager.go:417] Failed to publish CSINode: nodes "ip-10-0-141-55.ec2.internal" not found Jun 11 18:36:35.370351 ip-10-0-141-55 kubenswrapper[2578]: I0611 18:36:35.370331 2578 nodeinfomanager.go:417] Failed to publish CSINode: nodes "ip-10-0-141-55.ec2.internal" not found Jun 11 18:36:35.385995 ip-10-0-141-55 kubenswrapper[2578]: I0611 18:36:35.385979 2578 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160" Jun 11 18:36:35.392167 ip-10-0-141-55 kubenswrapper[2578]: I0611 18:36:35.392153 2578 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jun 11 18:36:35.393295 ip-10-0-141-55 kubenswrapper[2578]: I0611 18:36:35.393249 2578 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-141-55.ec2.internal" event="NodeHasSufficientMemory" Jun 11 18:36:35.393295 ip-10-0-141-55 kubenswrapper[2578]: I0611 18:36:35.393276 2578 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-141-55.ec2.internal" event="NodeHasNoDiskPressure" Jun 11 18:36:35.393295 ip-10-0-141-55 kubenswrapper[2578]: I0611 18:36:35.393287 2578 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-141-55.ec2.internal" event="NodeHasSufficientPID" Jun 11 18:36:35.418237 ip-10-0-141-55 kubenswrapper[2578]: I0611 18:36:35.418196 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-141-55.ec2.internal" event={"ID":"a7e51dec29aa10b42d4127d190b80186","Type":"ContainerStarted","Data":"2995be565f10e79a8de156c459b3f9836f6f26b82d100309e8da0c5d5d4586bf"} Jun 11 18:36:35.419192 ip-10-0-141-55 kubenswrapper[2578]: I0611 18:36:35.419171 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-141-55.ec2.internal" event={"ID":"668e0dfb5ee3fc6875806e2b3acb31d7","Type":"ContainerStarted","Data":"c140c2dbe95f45c347dcd6c0c66f06813fb8968733708bc78b94b8cbbef9cccd"} Jun 11 18:36:35.436304 ip-10-0-141-55 kubenswrapper[2578]: I0611 18:36:35.436289 2578 nodeinfomanager.go:417] Failed to publish CSINode: nodes "ip-10-0-141-55.ec2.internal" not found Jun 11 18:36:35.521804 ip-10-0-141-55 kubenswrapper[2578]: I0611 18:36:35.521781 2578 reflector.go:439] "Caches populated" type="*v1.CSIDriver" reflector="k8s.io/client-go/informers/factory.go:160" Jun 11 18:36:35.712047 ip-10-0-141-55 kubenswrapper[2578]: I0611 18:36:35.711970 2578 nodeinfomanager.go:417] Failed to publish CSINode: nodes "ip-10-0-141-55.ec2.internal" not found Jun 11 18:36:35.712047 ip-10-0-141-55 kubenswrapper[2578]: E0611 18:36:35.712003 2578 csi_plugin.go:399] Failed to initialize CSINode: error updating CSINode annotation: timed out waiting for the condition; caused by: nodes "ip-10-0-141-55.ec2.internal" not found Jun 11 18:36:35.748866 ip-10-0-141-55 kubenswrapper[2578]: I0611 18:36:35.748835 2578 nodeinfomanager.go:417] Failed to publish CSINode: nodes "ip-10-0-141-55.ec2.internal" not found Jun 11 18:36:35.767936 ip-10-0-141-55 kubenswrapper[2578]: I0611 18:36:35.767908 2578 nodeinfomanager.go:417] Failed to publish CSINode: nodes "ip-10-0-141-55.ec2.internal" not found Jun 11 18:36:35.772886 ip-10-0-141-55 kubenswrapper[2578]: E0611 18:36:35.772857 2578 nodelease.go:49] "Failed to get node when trying to set owner ref to the node lease" err="nodes \"ip-10-0-141-55.ec2.internal\" not found" node="ip-10-0-141-55.ec2.internal" Jun 11 18:36:35.828934 ip-10-0-141-55 kubenswrapper[2578]: I0611 18:36:35.828907 2578 nodeinfomanager.go:417] Failed to publish CSINode: nodes "ip-10-0-141-55.ec2.internal" not found Jun 11 18:36:35.962290 ip-10-0-141-55 kubenswrapper[2578]: I0611 18:36:35.962208 2578 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jun 11 18:36:35.963596 ip-10-0-141-55 kubenswrapper[2578]: I0611 18:36:35.963573 2578 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-141-55.ec2.internal" event="NodeHasSufficientMemory" Jun 11 18:36:35.963726 ip-10-0-141-55 kubenswrapper[2578]: I0611 18:36:35.963613 2578 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-141-55.ec2.internal" event="NodeHasNoDiskPressure" Jun 11 18:36:35.963726 ip-10-0-141-55 kubenswrapper[2578]: I0611 18:36:35.963627 2578 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-141-55.ec2.internal" event="NodeHasSufficientPID" Jun 11 18:36:35.963726 ip-10-0-141-55 kubenswrapper[2578]: I0611 18:36:35.963668 2578 kubelet_node_status.go:78] "Attempting to register node" node="ip-10-0-141-55.ec2.internal" Jun 11 18:36:35.974888 ip-10-0-141-55 kubenswrapper[2578]: I0611 18:36:35.974865 2578 kubelet_node_status.go:81] "Successfully registered node" node="ip-10-0-141-55.ec2.internal" Jun 11 18:36:35.975014 ip-10-0-141-55 kubenswrapper[2578]: E0611 18:36:35.974903 2578 kubelet_node_status.go:536] "Error updating node status, will retry" err="error getting node \"ip-10-0-141-55.ec2.internal\": node \"ip-10-0-141-55.ec2.internal\" not found" Jun 11 18:36:35.998531 ip-10-0-141-55 kubenswrapper[2578]: E0611 18:36:35.998496 2578 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-141-55.ec2.internal\" not found" Jun 11 18:36:36.006317 ip-10-0-141-55 kubenswrapper[2578]: I0611 18:36:36.006158 2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-multus/multus-additional-cni-plugins-jttqf"] Jun 11 18:36:36.006439 ip-10-0-141-55 kubenswrapper[2578]: I0611 18:36:36.006388 2578 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jun 11 18:36:36.007590 ip-10-0-141-55 kubenswrapper[2578]: I0611 18:36:36.007544 2578 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-141-55.ec2.internal" event="NodeHasSufficientMemory" Jun 11 18:36:36.007590 ip-10-0-141-55 kubenswrapper[2578]: I0611 18:36:36.007595 2578 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-141-55.ec2.internal" event="NodeHasNoDiskPressure" Jun 11 18:36:36.007769 ip-10-0-141-55 kubenswrapper[2578]: I0611 18:36:36.007612 2578 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-141-55.ec2.internal" event="NodeHasSufficientPID" Jun 11 18:36:36.008759 ip-10-0-141-55 kubenswrapper[2578]: I0611 18:36:36.008739 2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-multus/multus-zlzks"] Jun 11 18:36:36.008864 ip-10-0-141-55 kubenswrapper[2578]: I0611 18:36:36.008827 2578 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jun 11 18:36:36.008930 ip-10-0-141-55 kubenswrapper[2578]: I0611 18:36:36.008912 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-jttqf" Jun 11 18:36:36.008991 ip-10-0-141-55 kubenswrapper[2578]: I0611 18:36:36.008957 2578 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jun 11 18:36:36.010937 ip-10-0-141-55 kubenswrapper[2578]: I0611 18:36:36.009840 2578 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-141-55.ec2.internal" event="NodeHasSufficientMemory" Jun 11 18:36:36.010937 ip-10-0-141-55 kubenswrapper[2578]: I0611 18:36:36.009881 2578 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-141-55.ec2.internal" event="NodeHasNoDiskPressure" Jun 11 18:36:36.010937 ip-10-0-141-55 kubenswrapper[2578]: I0611 18:36:36.009896 2578 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-141-55.ec2.internal" event="NodeHasSufficientPID" Jun 11 18:36:36.010937 ip-10-0-141-55 kubenswrapper[2578]: I0611 18:36:36.010430 2578 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-141-55.ec2.internal" event="NodeHasSufficientMemory" Jun 11 18:36:36.010937 ip-10-0-141-55 kubenswrapper[2578]: I0611 18:36:36.010453 2578 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-141-55.ec2.internal" event="NodeHasNoDiskPressure" Jun 11 18:36:36.010937 ip-10-0-141-55 kubenswrapper[2578]: I0611 18:36:36.010465 2578 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-141-55.ec2.internal" event="NodeHasSufficientPID" Jun 11 18:36:36.014349 ip-10-0-141-55 kubenswrapper[2578]: I0611 18:36:36.012926 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"whereabouts-flatfile-config\"" Jun 11 18:36:36.014349 ip-10-0-141-55 kubenswrapper[2578]: I0611 18:36:36.013413 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"cni-copy-resources\"" Jun 11 18:36:36.014349 ip-10-0-141-55 kubenswrapper[2578]: I0611 18:36:36.013792 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"default-cni-sysctl-allowlist\"" Jun 11 18:36:36.018386 ip-10-0-141-55 kubenswrapper[2578]: I0611 18:36:36.016218 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-zlzks" Jun 11 18:36:36.018386 ip-10-0-141-55 kubenswrapper[2578]: I0611 18:36:36.016265 2578 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jun 11 18:36:36.018386 ip-10-0-141-55 kubenswrapper[2578]: I0611 18:36:36.017890 2578 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-141-55.ec2.internal" event="NodeHasSufficientMemory" Jun 11 18:36:36.018386 ip-10-0-141-55 kubenswrapper[2578]: I0611 18:36:36.017922 2578 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-141-55.ec2.internal" event="NodeHasNoDiskPressure" Jun 11 18:36:36.018386 ip-10-0-141-55 kubenswrapper[2578]: I0611 18:36:36.017948 2578 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-141-55.ec2.internal" event="NodeHasSufficientPID" Jun 11 18:36:36.018386 ip-10-0-141-55 kubenswrapper[2578]: I0611 18:36:36.018151 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"multus-ancillary-tools-dockercfg-k7kdr\"" Jun 11 18:36:36.019702 ip-10-0-141-55 kubenswrapper[2578]: I0611 18:36:36.019175 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"openshift-service-ca.crt\"" Jun 11 18:36:36.019702 ip-10-0-141-55 kubenswrapper[2578]: I0611 18:36:36.019272 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"kube-root-ca.crt\"" Jun 11 18:36:36.021898 ip-10-0-141-55 kubenswrapper[2578]: I0611 18:36:36.021880 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"default-dockercfg-zl6j2\"" Jun 11 18:36:36.022134 ip-10-0-141-55 kubenswrapper[2578]: I0611 18:36:36.022117 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"multus-daemon-config\"" Jun 11 18:36:36.034704 ip-10-0-141-55 kubenswrapper[2578]: I0611 18:36:36.034684 2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kube-system/konnectivity-agent-ffv42"] Jun 11 18:36:36.034825 ip-10-0-141-55 kubenswrapper[2578]: I0611 18:36:36.034811 2578 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jun 11 18:36:36.036018 ip-10-0-141-55 kubenswrapper[2578]: I0611 18:36:36.035999 2578 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-141-55.ec2.internal" event="NodeHasSufficientMemory" Jun 11 18:36:36.036110 ip-10-0-141-55 kubenswrapper[2578]: I0611 18:36:36.036029 2578 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-141-55.ec2.internal" event="NodeHasNoDiskPressure" Jun 11 18:36:36.036110 ip-10-0-141-55 kubenswrapper[2578]: I0611 18:36:36.036044 2578 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-141-55.ec2.internal" event="NodeHasSufficientPID" Jun 11 18:36:36.037183 ip-10-0-141-55 kubenswrapper[2578]: I0611 18:36:36.037161 2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-network-diagnostics/network-check-target-hjkh2"] Jun 11 18:36:36.037295 ip-10-0-141-55 kubenswrapper[2578]: I0611 18:36:36.037281 2578 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jun 11 18:36:36.037356 ip-10-0-141-55 kubenswrapper[2578]: I0611 18:36:36.037295 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-ffv42" Jun 11 18:36:36.037356 ip-10-0-141-55 kubenswrapper[2578]: I0611 18:36:36.037328 2578 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jun 11 18:36:36.038349 ip-10-0-141-55 kubenswrapper[2578]: I0611 18:36:36.038334 2578 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-141-55.ec2.internal" event="NodeHasSufficientMemory" Jun 11 18:36:36.038509 ip-10-0-141-55 kubenswrapper[2578]: I0611 18:36:36.038499 2578 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-141-55.ec2.internal" event="NodeHasNoDiskPressure" Jun 11 18:36:36.038765 ip-10-0-141-55 kubenswrapper[2578]: I0611 18:36:36.038754 2578 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-141-55.ec2.internal" event="NodeHasSufficientPID" Jun 11 18:36:36.039057 ip-10-0-141-55 kubenswrapper[2578]: I0611 18:36:36.039040 2578 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-141-55.ec2.internal" event="NodeHasSufficientMemory" Jun 11 18:36:36.039142 ip-10-0-141-55 kubenswrapper[2578]: I0611 18:36:36.039068 2578 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-141-55.ec2.internal" event="NodeHasNoDiskPressure" Jun 11 18:36:36.039142 ip-10-0-141-55 kubenswrapper[2578]: I0611 18:36:36.039082 2578 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-141-55.ec2.internal" event="NodeHasSufficientPID" Jun 11 18:36:36.040893 ip-10-0-141-55 kubenswrapper[2578]: I0611 18:36:36.040138 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-hjkh2" Jun 11 18:36:36.040893 ip-10-0-141-55 kubenswrapper[2578]: I0611 18:36:36.040167 2578 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jun 11 18:36:36.041287 ip-10-0-141-55 kubenswrapper[2578]: I0611 18:36:36.041270 2578 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-141-55.ec2.internal" event="NodeHasSufficientMemory" Jun 11 18:36:36.041369 ip-10-0-141-55 kubenswrapper[2578]: I0611 18:36:36.041298 2578 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-141-55.ec2.internal" event="NodeHasNoDiskPressure" Jun 11 18:36:36.041369 ip-10-0-141-55 kubenswrapper[2578]: I0611 18:36:36.041312 2578 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-141-55.ec2.internal" event="NodeHasSufficientPID" Jun 11 18:36:36.041466 ip-10-0-141-55 kubenswrapper[2578]: E0611 18:36:36.041371 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-hjkh2" podUID="04686d4c-5c3d-49ac-9b61-09e80f5e4dff" Jun 11 18:36:36.042574 ip-10-0-141-55 kubenswrapper[2578]: I0611 18:36:36.042208 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"konnectivity-agent\"" Jun 11 18:36:36.042574 ip-10-0-141-55 kubenswrapper[2578]: I0611 18:36:36.042411 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"default-dockercfg-fq8wl\"" Jun 11 18:36:36.042706 ip-10-0-141-55 kubenswrapper[2578]: I0611 18:36:36.042677 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kube-system\"/\"konnectivity-ca-bundle\"" Jun 11 18:36:36.050865 ip-10-0-141-55 kubenswrapper[2578]: I0611 18:36:36.050841 2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-network-operator/iptables-alerter-kkqxh"] Jun 11 18:36:36.051009 ip-10-0-141-55 kubenswrapper[2578]: I0611 18:36:36.050995 2578 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jun 11 18:36:36.051920 ip-10-0-141-55 kubenswrapper[2578]: I0611 18:36:36.051902 2578 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-141-55.ec2.internal" event="NodeHasSufficientMemory" Jun 11 18:36:36.052005 ip-10-0-141-55 kubenswrapper[2578]: I0611 18:36:36.051933 2578 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-141-55.ec2.internal" event="NodeHasNoDiskPressure" Jun 11 18:36:36.052005 ip-10-0-141-55 kubenswrapper[2578]: I0611 18:36:36.051948 2578 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-141-55.ec2.internal" event="NodeHasSufficientPID" Jun 11 18:36:36.053404 ip-10-0-141-55 kubenswrapper[2578]: I0611 18:36:36.053385 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-kkqxh" Jun 11 18:36:36.053497 ip-10-0-141-55 kubenswrapper[2578]: I0611 18:36:36.053420 2578 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jun 11 18:36:36.054183 ip-10-0-141-55 kubenswrapper[2578]: I0611 18:36:36.053908 2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-image-registry/node-ca-qc45v"] Jun 11 18:36:36.054183 ip-10-0-141-55 kubenswrapper[2578]: I0611 18:36:36.054022 2578 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jun 11 18:36:36.055059 ip-10-0-141-55 kubenswrapper[2578]: I0611 18:36:36.055011 2578 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-141-55.ec2.internal" event="NodeHasSufficientMemory" Jun 11 18:36:36.055059 ip-10-0-141-55 kubenswrapper[2578]: I0611 18:36:36.055038 2578 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-141-55.ec2.internal" event="NodeHasNoDiskPressure" Jun 11 18:36:36.055059 ip-10-0-141-55 kubenswrapper[2578]: I0611 18:36:36.055051 2578 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-141-55.ec2.internal" event="NodeHasSufficientPID" Jun 11 18:36:36.055577 ip-10-0-141-55 kubenswrapper[2578]: I0611 18:36:36.055346 2578 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-141-55.ec2.internal" event="NodeHasSufficientMemory" Jun 11 18:36:36.055577 ip-10-0-141-55 kubenswrapper[2578]: I0611 18:36:36.055374 2578 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-141-55.ec2.internal" event="NodeHasNoDiskPressure" Jun 11 18:36:36.055577 ip-10-0-141-55 kubenswrapper[2578]: I0611 18:36:36.055388 2578 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-141-55.ec2.internal" event="NodeHasSufficientPID" Jun 11 18:36:36.056533 ip-10-0-141-55 kubenswrapper[2578]: I0611 18:36:36.056513 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-qc45v" Jun 11 18:36:36.056637 ip-10-0-141-55 kubenswrapper[2578]: I0611 18:36:36.056614 2578 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jun 11 18:36:36.058577 ip-10-0-141-55 kubenswrapper[2578]: I0611 18:36:36.058491 2578 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-141-55.ec2.internal" event="NodeHasSufficientMemory" Jun 11 18:36:36.058577 ip-10-0-141-55 kubenswrapper[2578]: I0611 18:36:36.058523 2578 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-141-55.ec2.internal" event="NodeHasNoDiskPressure" Jun 11 18:36:36.058577 ip-10-0-141-55 kubenswrapper[2578]: I0611 18:36:36.058539 2578 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-141-55.ec2.internal" event="NodeHasSufficientPID" Jun 11 18:36:36.059384 ip-10-0-141-55 kubenswrapper[2578]: I0611 18:36:36.059147 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"kube-root-ca.crt\"" Jun 11 18:36:36.059384 ip-10-0-141-55 kubenswrapper[2578]: I0611 18:36:36.059187 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"openshift-service-ca.crt\"" Jun 11 18:36:36.059384 ip-10-0-141-55 kubenswrapper[2578]: I0611 18:36:36.059227 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-script\"" Jun 11 18:36:36.059384 ip-10-0-141-55 kubenswrapper[2578]: I0611 18:36:36.059300 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-dockercfg-ckvpn\"" Jun 11 18:36:36.060983 ip-10-0-141-55 kubenswrapper[2578]: I0611 18:36:36.060962 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/8b02eb7c-e526-4079-b139-e46f4626d3e5-cni-binary-copy\") pod \"multus-zlzks\" (UID: \"8b02eb7c-e526-4079-b139-e46f4626d3e5\") " pod="openshift-multus/multus-zlzks" Jun 11 18:36:36.061083 ip-10-0-141-55 kubenswrapper[2578]: I0611 18:36:36.060995 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/8b02eb7c-e526-4079-b139-e46f4626d3e5-multus-conf-dir\") pod \"multus-zlzks\" (UID: \"8b02eb7c-e526-4079-b139-e46f4626d3e5\") " pod="openshift-multus/multus-zlzks" Jun 11 18:36:36.061083 ip-10-0-141-55 kubenswrapper[2578]: I0611 18:36:36.061021 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/cd01660e-add6-419b-8f21-9dbd7c1efd86-tuning-conf-dir\") pod \"multus-additional-cni-plugins-jttqf\" (UID: \"cd01660e-add6-419b-8f21-9dbd7c1efd86\") " pod="openshift-multus/multus-additional-cni-plugins-jttqf" Jun 11 18:36:36.061083 ip-10-0-141-55 kubenswrapper[2578]: I0611 18:36:36.061048 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/8b02eb7c-e526-4079-b139-e46f4626d3e5-multus-daemon-config\") pod \"multus-zlzks\" (UID: \"8b02eb7c-e526-4079-b139-e46f4626d3e5\") " pod="openshift-multus/multus-zlzks" Jun 11 18:36:36.061083 ip-10-0-141-55 kubenswrapper[2578]: I0611 18:36:36.061071 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/0cc2bcd7-3d68-4ebb-9ab5-4529e5485a69-agent-certs\") pod \"konnectivity-agent-ffv42\" (UID: \"0cc2bcd7-3d68-4ebb-9ab5-4529e5485a69\") " pod="kube-system/konnectivity-agent-ffv42" Jun 11 18:36:36.061300 ip-10-0-141-55 kubenswrapper[2578]: I0611 18:36:36.061095 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-kf5bh\" (UniqueName: \"kubernetes.io/projected/418a2cf3-d8f2-412c-8365-ba9c61004229-kube-api-access-kf5bh\") pod \"iptables-alerter-kkqxh\" (UID: \"418a2cf3-d8f2-412c-8365-ba9c61004229\") " pod="openshift-network-operator/iptables-alerter-kkqxh" Jun 11 18:36:36.061300 ip-10-0-141-55 kubenswrapper[2578]: I0611 18:36:36.061120 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/cd01660e-add6-419b-8f21-9dbd7c1efd86-cnibin\") pod \"multus-additional-cni-plugins-jttqf\" (UID: \"cd01660e-add6-419b-8f21-9dbd7c1efd86\") " pod="openshift-multus/multus-additional-cni-plugins-jttqf" Jun 11 18:36:36.061300 ip-10-0-141-55 kubenswrapper[2578]: I0611 18:36:36.061144 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/cd01660e-add6-419b-8f21-9dbd7c1efd86-os-release\") pod \"multus-additional-cni-plugins-jttqf\" (UID: \"cd01660e-add6-419b-8f21-9dbd7c1efd86\") " pod="openshift-multus/multus-additional-cni-plugins-jttqf" Jun 11 18:36:36.061300 ip-10-0-141-55 kubenswrapper[2578]: I0611 18:36:36.061167 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/8b02eb7c-e526-4079-b139-e46f4626d3e5-os-release\") pod \"multus-zlzks\" (UID: \"8b02eb7c-e526-4079-b139-e46f4626d3e5\") " pod="openshift-multus/multus-zlzks" Jun 11 18:36:36.061300 ip-10-0-141-55 kubenswrapper[2578]: I0611 18:36:36.061217 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/8b02eb7c-e526-4079-b139-e46f4626d3e5-multus-socket-dir-parent\") pod \"multus-zlzks\" (UID: \"8b02eb7c-e526-4079-b139-e46f4626d3e5\") " pod="openshift-multus/multus-zlzks" Jun 11 18:36:36.061300 ip-10-0-141-55 kubenswrapper[2578]: I0611 18:36:36.061240 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/8b02eb7c-e526-4079-b139-e46f4626d3e5-host-run-k8s-cni-cncf-io\") pod \"multus-zlzks\" (UID: \"8b02eb7c-e526-4079-b139-e46f4626d3e5\") " pod="openshift-multus/multus-zlzks" Jun 11 18:36:36.061300 ip-10-0-141-55 kubenswrapper[2578]: I0611 18:36:36.061262 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/8b02eb7c-e526-4079-b139-e46f4626d3e5-host-run-netns\") pod \"multus-zlzks\" (UID: \"8b02eb7c-e526-4079-b139-e46f4626d3e5\") " pod="openshift-multus/multus-zlzks" Jun 11 18:36:36.061300 ip-10-0-141-55 kubenswrapper[2578]: I0611 18:36:36.061287 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/8b02eb7c-e526-4079-b139-e46f4626d3e5-host-var-lib-cni-bin\") pod \"multus-zlzks\" (UID: \"8b02eb7c-e526-4079-b139-e46f4626d3e5\") " pod="openshift-multus/multus-zlzks" Jun 11 18:36:36.061691 ip-10-0-141-55 kubenswrapper[2578]: I0611 18:36:36.061312 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/cd01660e-add6-419b-8f21-9dbd7c1efd86-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-jttqf\" (UID: \"cd01660e-add6-419b-8f21-9dbd7c1efd86\") " pod="openshift-multus/multus-additional-cni-plugins-jttqf" Jun 11 18:36:36.061691 ip-10-0-141-55 kubenswrapper[2578]: I0611 18:36:36.061336 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/8b02eb7c-e526-4079-b139-e46f4626d3e5-etc-kubernetes\") pod \"multus-zlzks\" (UID: \"8b02eb7c-e526-4079-b139-e46f4626d3e5\") " pod="openshift-multus/multus-zlzks" Jun 11 18:36:36.061691 ip-10-0-141-55 kubenswrapper[2578]: I0611 18:36:36.061361 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-c4ths\" (UniqueName: \"kubernetes.io/projected/04686d4c-5c3d-49ac-9b61-09e80f5e4dff-kube-api-access-c4ths\") pod \"network-check-target-hjkh2\" (UID: \"04686d4c-5c3d-49ac-9b61-09e80f5e4dff\") " pod="openshift-network-diagnostics/network-check-target-hjkh2" Jun 11 18:36:36.061691 ip-10-0-141-55 kubenswrapper[2578]: I0611 18:36:36.061383 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/418a2cf3-d8f2-412c-8365-ba9c61004229-host-slash\") pod \"iptables-alerter-kkqxh\" (UID: \"418a2cf3-d8f2-412c-8365-ba9c61004229\") " pod="openshift-network-operator/iptables-alerter-kkqxh" Jun 11 18:36:36.061691 ip-10-0-141-55 kubenswrapper[2578]: I0611 18:36:36.061409 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/cd01660e-add6-419b-8f21-9dbd7c1efd86-system-cni-dir\") pod \"multus-additional-cni-plugins-jttqf\" (UID: \"cd01660e-add6-419b-8f21-9dbd7c1efd86\") " pod="openshift-multus/multus-additional-cni-plugins-jttqf" Jun 11 18:36:36.061691 ip-10-0-141-55 kubenswrapper[2578]: I0611 18:36:36.061436 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/8b02eb7c-e526-4079-b139-e46f4626d3e5-cnibin\") pod \"multus-zlzks\" (UID: \"8b02eb7c-e526-4079-b139-e46f4626d3e5\") " pod="openshift-multus/multus-zlzks" Jun 11 18:36:36.061691 ip-10-0-141-55 kubenswrapper[2578]: I0611 18:36:36.061464 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/8b02eb7c-e526-4079-b139-e46f4626d3e5-host-var-lib-kubelet\") pod \"multus-zlzks\" (UID: \"8b02eb7c-e526-4079-b139-e46f4626d3e5\") " pod="openshift-multus/multus-zlzks" Jun 11 18:36:36.061691 ip-10-0-141-55 kubenswrapper[2578]: I0611 18:36:36.061486 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-bq4lj\" (UniqueName: \"kubernetes.io/projected/8b02eb7c-e526-4079-b139-e46f4626d3e5-kube-api-access-bq4lj\") pod \"multus-zlzks\" (UID: \"8b02eb7c-e526-4079-b139-e46f4626d3e5\") " pod="openshift-multus/multus-zlzks" Jun 11 18:36:36.061691 ip-10-0-141-55 kubenswrapper[2578]: I0611 18:36:36.061516 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/0cc2bcd7-3d68-4ebb-9ab5-4529e5485a69-konnectivity-ca\") pod \"konnectivity-agent-ffv42\" (UID: \"0cc2bcd7-3d68-4ebb-9ab5-4529e5485a69\") " pod="kube-system/konnectivity-agent-ffv42" Jun 11 18:36:36.061691 ip-10-0-141-55 kubenswrapper[2578]: I0611 18:36:36.061539 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/418a2cf3-d8f2-412c-8365-ba9c61004229-iptables-alerter-script\") pod \"iptables-alerter-kkqxh\" (UID: \"418a2cf3-d8f2-412c-8365-ba9c61004229\") " pod="openshift-network-operator/iptables-alerter-kkqxh" Jun 11 18:36:36.061691 ip-10-0-141-55 kubenswrapper[2578]: I0611 18:36:36.061582 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/cd01660e-add6-419b-8f21-9dbd7c1efd86-cni-binary-copy\") pod \"multus-additional-cni-plugins-jttqf\" (UID: \"cd01660e-add6-419b-8f21-9dbd7c1efd86\") " pod="openshift-multus/multus-additional-cni-plugins-jttqf" Jun 11 18:36:36.061691 ip-10-0-141-55 kubenswrapper[2578]: I0611 18:36:36.061607 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/cd01660e-add6-419b-8f21-9dbd7c1efd86-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-jttqf\" (UID: \"cd01660e-add6-419b-8f21-9dbd7c1efd86\") " pod="openshift-multus/multus-additional-cni-plugins-jttqf" Jun 11 18:36:36.061691 ip-10-0-141-55 kubenswrapper[2578]: I0611 18:36:36.061631 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6b444\" (UniqueName: \"kubernetes.io/projected/cd01660e-add6-419b-8f21-9dbd7c1efd86-kube-api-access-6b444\") pod \"multus-additional-cni-plugins-jttqf\" (UID: \"cd01660e-add6-419b-8f21-9dbd7c1efd86\") " pod="openshift-multus/multus-additional-cni-plugins-jttqf" Jun 11 18:36:36.061691 ip-10-0-141-55 kubenswrapper[2578]: I0611 18:36:36.061653 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/8b02eb7c-e526-4079-b139-e46f4626d3e5-system-cni-dir\") pod \"multus-zlzks\" (UID: \"8b02eb7c-e526-4079-b139-e46f4626d3e5\") " pod="openshift-multus/multus-zlzks" Jun 11 18:36:36.061691 ip-10-0-141-55 kubenswrapper[2578]: I0611 18:36:36.061675 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/8b02eb7c-e526-4079-b139-e46f4626d3e5-hostroot\") pod \"multus-zlzks\" (UID: \"8b02eb7c-e526-4079-b139-e46f4626d3e5\") " pod="openshift-multus/multus-zlzks" Jun 11 18:36:36.061691 ip-10-0-141-55 kubenswrapper[2578]: I0611 18:36:36.061697 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/8b02eb7c-e526-4079-b139-e46f4626d3e5-multus-cni-dir\") pod \"multus-zlzks\" (UID: \"8b02eb7c-e526-4079-b139-e46f4626d3e5\") " pod="openshift-multus/multus-zlzks" Jun 11 18:36:36.062448 ip-10-0-141-55 kubenswrapper[2578]: I0611 18:36:36.061719 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/8b02eb7c-e526-4079-b139-e46f4626d3e5-host-var-lib-cni-multus\") pod \"multus-zlzks\" (UID: \"8b02eb7c-e526-4079-b139-e46f4626d3e5\") " pod="openshift-multus/multus-zlzks" Jun 11 18:36:36.062448 ip-10-0-141-55 kubenswrapper[2578]: I0611 18:36:36.061741 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/8b02eb7c-e526-4079-b139-e46f4626d3e5-host-run-multus-certs\") pod \"multus-zlzks\" (UID: \"8b02eb7c-e526-4079-b139-e46f4626d3e5\") " pod="openshift-multus/multus-zlzks" Jun 11 18:36:36.062448 ip-10-0-141-55 kubenswrapper[2578]: I0611 18:36:36.062322 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"kube-root-ca.crt\"" Jun 11 18:36:36.062579 ip-10-0-141-55 kubenswrapper[2578]: I0611 18:36:36.062493 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"openshift-service-ca.crt\"" Jun 11 18:36:36.062700 ip-10-0-141-55 kubenswrapper[2578]: I0611 18:36:36.062673 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"image-registry-certificates\"" Jun 11 18:36:36.062975 ip-10-0-141-55 kubenswrapper[2578]: I0611 18:36:36.062955 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"node-ca-dockercfg-p8pjz\"" Jun 11 18:36:36.071479 ip-10-0-141-55 kubenswrapper[2578]: I0611 18:36:36.071459 2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-multus/network-metrics-daemon-x5mvk"] Jun 11 18:36:36.071655 ip-10-0-141-55 kubenswrapper[2578]: I0611 18:36:36.071641 2578 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jun 11 18:36:36.073457 ip-10-0-141-55 kubenswrapper[2578]: I0611 18:36:36.073041 2578 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-141-55.ec2.internal" event="NodeHasSufficientMemory" Jun 11 18:36:36.073457 ip-10-0-141-55 kubenswrapper[2578]: I0611 18:36:36.073067 2578 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-141-55.ec2.internal" event="NodeHasNoDiskPressure" Jun 11 18:36:36.073457 ip-10-0-141-55 kubenswrapper[2578]: I0611 18:36:36.073085 2578 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-141-55.ec2.internal" event="NodeHasSufficientPID" Jun 11 18:36:36.075986 ip-10-0-141-55 kubenswrapper[2578]: I0611 18:36:36.075965 2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-2qbtj"] Jun 11 18:36:36.076179 ip-10-0-141-55 kubenswrapper[2578]: I0611 18:36:36.076166 2578 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jun 11 18:36:36.076363 ip-10-0-141-55 kubenswrapper[2578]: I0611 18:36:36.076350 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-x5mvk" Jun 11 18:36:36.076407 ip-10-0-141-55 kubenswrapper[2578]: I0611 18:36:36.076380 2578 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jun 11 18:36:36.077143 ip-10-0-141-55 kubenswrapper[2578]: I0611 18:36:36.077129 2578 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-141-55.ec2.internal" event="NodeHasSufficientMemory" Jun 11 18:36:36.077218 ip-10-0-141-55 kubenswrapper[2578]: I0611 18:36:36.077153 2578 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-141-55.ec2.internal" event="NodeHasNoDiskPressure" Jun 11 18:36:36.077218 ip-10-0-141-55 kubenswrapper[2578]: I0611 18:36:36.077164 2578 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-141-55.ec2.internal" event="NodeHasSufficientPID" Jun 11 18:36:36.077502 ip-10-0-141-55 kubenswrapper[2578]: I0611 18:36:36.077485 2578 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-141-55.ec2.internal" event="NodeHasSufficientMemory" Jun 11 18:36:36.077600 ip-10-0-141-55 kubenswrapper[2578]: I0611 18:36:36.077512 2578 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-141-55.ec2.internal" event="NodeHasNoDiskPressure" Jun 11 18:36:36.077600 ip-10-0-141-55 kubenswrapper[2578]: I0611 18:36:36.077526 2578 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-141-55.ec2.internal" event="NodeHasSufficientPID" Jun 11 18:36:36.077708 ip-10-0-141-55 kubenswrapper[2578]: E0611 18:36:36.077626 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-x5mvk" podUID="1257ce19-745b-4d56-b701-9fecd0879315" Jun 11 18:36:36.078389 ip-10-0-141-55 kubenswrapper[2578]: I0611 18:36:36.078373 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-2qbtj" Jun 11 18:36:36.078467 ip-10-0-141-55 kubenswrapper[2578]: I0611 18:36:36.078408 2578 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jun 11 18:36:36.079123 ip-10-0-141-55 kubenswrapper[2578]: I0611 18:36:36.079107 2578 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-141-55.ec2.internal" event="NodeHasSufficientMemory" Jun 11 18:36:36.079206 ip-10-0-141-55 kubenswrapper[2578]: I0611 18:36:36.079133 2578 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-141-55.ec2.internal" event="NodeHasNoDiskPressure" Jun 11 18:36:36.079206 ip-10-0-141-55 kubenswrapper[2578]: I0611 18:36:36.079150 2578 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-141-55.ec2.internal" event="NodeHasSufficientPID" Jun 11 18:36:36.081737 ip-10-0-141-55 kubenswrapper[2578]: I0611 18:36:36.081719 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-metrics-serving-cert\"" Jun 11 18:36:36.081837 ip-10-0-141-55 kubenswrapper[2578]: I0611 18:36:36.081788 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-sa-dockercfg-x9g2h\"" Jun 11 18:36:36.081914 ip-10-0-141-55 kubenswrapper[2578]: I0611 18:36:36.081877 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"openshift-service-ca.crt\"" Jun 11 18:36:36.082102 ip-10-0-141-55 kubenswrapper[2578]: I0611 18:36:36.081963 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"kube-root-ca.crt\"" Jun 11 18:36:36.097785 ip-10-0-141-55 kubenswrapper[2578]: I0611 18:36:36.097761 2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-cluster-node-tuning-operator/tuned-9ld8n"] Jun 11 18:36:36.097947 ip-10-0-141-55 kubenswrapper[2578]: I0611 18:36:36.097928 2578 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jun 11 18:36:36.098614 ip-10-0-141-55 kubenswrapper[2578]: E0611 18:36:36.098591 2578 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-141-55.ec2.internal\" not found" Jun 11 18:36:36.098891 ip-10-0-141-55 kubenswrapper[2578]: I0611 18:36:36.098875 2578 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-141-55.ec2.internal" event="NodeHasSufficientMemory" Jun 11 18:36:36.098960 ip-10-0-141-55 kubenswrapper[2578]: I0611 18:36:36.098905 2578 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-141-55.ec2.internal" event="NodeHasNoDiskPressure" Jun 11 18:36:36.098960 ip-10-0-141-55 kubenswrapper[2578]: I0611 18:36:36.098919 2578 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-141-55.ec2.internal" event="NodeHasSufficientPID" Jun 11 18:36:36.100367 ip-10-0-141-55 kubenswrapper[2578]: I0611 18:36:36.100347 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-9ld8n" Jun 11 18:36:36.100460 ip-10-0-141-55 kubenswrapper[2578]: I0611 18:36:36.100383 2578 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jun 11 18:36:36.101791 ip-10-0-141-55 kubenswrapper[2578]: I0611 18:36:36.101770 2578 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-141-55.ec2.internal" event="NodeHasSufficientMemory" Jun 11 18:36:36.101888 ip-10-0-141-55 kubenswrapper[2578]: I0611 18:36:36.101816 2578 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-141-55.ec2.internal" event="NodeHasNoDiskPressure" Jun 11 18:36:36.101888 ip-10-0-141-55 kubenswrapper[2578]: I0611 18:36:36.101835 2578 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-141-55.ec2.internal" event="NodeHasSufficientPID" Jun 11 18:36:36.103127 ip-10-0-141-55 kubenswrapper[2578]: I0611 18:36:36.103107 2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ovn-kubernetes/ovnkube-node-vcdjb"] Jun 11 18:36:36.104008 ip-10-0-141-55 kubenswrapper[2578]: I0611 18:36:36.103991 2578 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jun 11 18:36:36.105111 ip-10-0-141-55 kubenswrapper[2578]: I0611 18:36:36.105091 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"openshift-service-ca.crt\"" Jun 11 18:36:36.105212 ip-10-0-141-55 kubenswrapper[2578]: I0611 18:36:36.105113 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"kube-root-ca.crt\"" Jun 11 18:36:36.105373 ip-10-0-141-55 kubenswrapper[2578]: I0611 18:36:36.105353 2578 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-141-55.ec2.internal" event="NodeHasSufficientMemory" Jun 11 18:36:36.105448 ip-10-0-141-55 kubenswrapper[2578]: I0611 18:36:36.105394 2578 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-141-55.ec2.internal" event="NodeHasNoDiskPressure" Jun 11 18:36:36.105448 ip-10-0-141-55 kubenswrapper[2578]: I0611 18:36:36.105411 2578 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-141-55.ec2.internal" event="NodeHasSufficientPID" Jun 11 18:36:36.105448 ip-10-0-141-55 kubenswrapper[2578]: I0611 18:36:36.105430 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"tuned-dockercfg-7rwn4\"" Jun 11 18:36:36.107295 ip-10-0-141-55 kubenswrapper[2578]: I0611 18:36:36.107134 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-vcdjb" Jun 11 18:36:36.107295 ip-10-0-141-55 kubenswrapper[2578]: I0611 18:36:36.107174 2578 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jun 11 18:36:36.108103 ip-10-0-141-55 kubenswrapper[2578]: I0611 18:36:36.108085 2578 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-141-55.ec2.internal" event="NodeHasSufficientMemory" Jun 11 18:36:36.108212 ip-10-0-141-55 kubenswrapper[2578]: I0611 18:36:36.108120 2578 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-141-55.ec2.internal" event="NodeHasNoDiskPressure" Jun 11 18:36:36.108212 ip-10-0-141-55 kubenswrapper[2578]: I0611 18:36:36.108135 2578 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-141-55.ec2.internal" event="NodeHasSufficientPID" Jun 11 18:36:36.110797 ip-10-0-141-55 kubenswrapper[2578]: I0611 18:36:36.110777 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-node-metrics-cert\"" Jun 11 18:36:36.110965 ip-10-0-141-55 kubenswrapper[2578]: I0611 18:36:36.110947 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"env-overrides\"" Jun 11 18:36:36.111098 ip-10-0-141-55 kubenswrapper[2578]: I0611 18:36:36.111057 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-script-lib\"" Jun 11 18:36:36.111325 ip-10-0-141-55 kubenswrapper[2578]: I0611 18:36:36.111232 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-kubernetes-node-dockercfg-mp6bv\"" Jun 11 18:36:36.111401 ip-10-0-141-55 kubenswrapper[2578]: I0611 18:36:36.111330 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"kube-root-ca.crt\"" Jun 11 18:36:36.111457 ip-10-0-141-55 kubenswrapper[2578]: I0611 18:36:36.111424 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-config\"" Jun 11 18:36:36.111516 ip-10-0-141-55 kubenswrapper[2578]: I0611 18:36:36.111467 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"openshift-service-ca.crt\"" Jun 11 18:36:36.118730 ip-10-0-141-55 kubenswrapper[2578]: I0611 18:36:36.118357 2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-dns/node-resolver-m7sgm"] Jun 11 18:36:36.118730 ip-10-0-141-55 kubenswrapper[2578]: I0611 18:36:36.118588 2578 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jun 11 18:36:36.119445 ip-10-0-141-55 kubenswrapper[2578]: I0611 18:36:36.119425 2578 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-141-55.ec2.internal" event="NodeHasSufficientMemory" Jun 11 18:36:36.119520 ip-10-0-141-55 kubenswrapper[2578]: I0611 18:36:36.119454 2578 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-141-55.ec2.internal" event="NodeHasNoDiskPressure" Jun 11 18:36:36.119520 ip-10-0-141-55 kubenswrapper[2578]: I0611 18:36:36.119469 2578 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-141-55.ec2.internal" event="NodeHasSufficientPID" Jun 11 18:36:36.120785 ip-10-0-141-55 kubenswrapper[2578]: I0611 18:36:36.120757 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-m7sgm" Jun 11 18:36:36.120873 ip-10-0-141-55 kubenswrapper[2578]: I0611 18:36:36.120832 2578 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jun 11 18:36:36.121775 ip-10-0-141-55 kubenswrapper[2578]: I0611 18:36:36.121761 2578 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-141-55.ec2.internal" event="NodeHasSufficientMemory" Jun 11 18:36:36.121876 ip-10-0-141-55 kubenswrapper[2578]: I0611 18:36:36.121788 2578 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-141-55.ec2.internal" event="NodeHasNoDiskPressure" Jun 11 18:36:36.121876 ip-10-0-141-55 kubenswrapper[2578]: I0611 18:36:36.121803 2578 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-141-55.ec2.internal" event="NodeHasSufficientPID" Jun 11 18:36:36.124941 ip-10-0-141-55 kubenswrapper[2578]: I0611 18:36:36.124919 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"kube-root-ca.crt\"" Jun 11 18:36:36.125181 ip-10-0-141-55 kubenswrapper[2578]: I0611 18:36:36.125165 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"node-resolver-dockercfg-9hmdm\"" Jun 11 18:36:36.125370 ip-10-0-141-55 kubenswrapper[2578]: I0611 18:36:36.125353 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"openshift-service-ca.crt\"" Jun 11 18:36:36.137086 ip-10-0-141-55 kubenswrapper[2578]: I0611 18:36:36.137061 2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kube-system/global-pull-secret-syncer-hffw7"] Jun 11 18:36:36.137304 ip-10-0-141-55 kubenswrapper[2578]: I0611 18:36:36.137291 2578 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jun 11 18:36:36.138160 ip-10-0-141-55 kubenswrapper[2578]: I0611 18:36:36.138141 2578 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-141-55.ec2.internal" event="NodeHasSufficientMemory" Jun 11 18:36:36.138247 ip-10-0-141-55 kubenswrapper[2578]: I0611 18:36:36.138176 2578 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-141-55.ec2.internal" event="NodeHasNoDiskPressure" Jun 11 18:36:36.138247 ip-10-0-141-55 kubenswrapper[2578]: I0611 18:36:36.138191 2578 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-141-55.ec2.internal" event="NodeHasSufficientPID" Jun 11 18:36:36.138414 ip-10-0-141-55 kubenswrapper[2578]: I0611 18:36:36.138395 2578 predicate.go:218] "Predicate failed on Pod" pod="kube-system/global-pull-secret-syncer-hffw7" err="Predicate NodeAffinity failed: node(s) didn't match Pod's node affinity/selector" Jun 11 18:36:36.138482 ip-10-0-141-55 kubenswrapper[2578]: I0611 18:36:36.138417 2578 allocation_manager.go:702] "Pod admission denied" podUID="617db869-ee36-4a71-b38e-fd0576c57c9a" pod="kube-system/global-pull-secret-syncer-hffw7" reason="NodeAffinity" message="Predicate NodeAffinity failed: node(s) didn't match Pod's node affinity/selector" Jun 11 18:36:36.162404 ip-10-0-141-55 kubenswrapper[2578]: I0611 18:36:36.162374 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-kb75r\" (UniqueName: \"kubernetes.io/projected/2cc00ed7-ab6f-4086-ae9c-d5394da96541-kube-api-access-kb75r\") pod \"node-ca-qc45v\" (UID: \"2cc00ed7-ab6f-4086-ae9c-d5394da96541\") " pod="openshift-image-registry/node-ca-qc45v" Jun 11 18:36:36.162530 ip-10-0-141-55 kubenswrapper[2578]: I0611 18:36:36.162413 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/50f4744a-788a-47dd-8fa7-321eaaad1b53-lib-modules\") pod \"tuned-9ld8n\" (UID: \"50f4744a-788a-47dd-8fa7-321eaaad1b53\") " pod="openshift-cluster-node-tuning-operator/tuned-9ld8n" Jun 11 18:36:36.162530 ip-10-0-141-55 kubenswrapper[2578]: I0611 18:36:36.162435 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/984d8be7-df73-433d-8804-d740a26ef757-etc-openvswitch\") pod \"ovnkube-node-vcdjb\" (UID: \"984d8be7-df73-433d-8804-d740a26ef757\") " pod="openshift-ovn-kubernetes/ovnkube-node-vcdjb" Jun 11 18:36:36.162530 ip-10-0-141-55 kubenswrapper[2578]: I0611 18:36:36.162454 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/984d8be7-df73-433d-8804-d740a26ef757-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-vcdjb\" (UID: \"984d8be7-df73-433d-8804-d740a26ef757\") " pod="openshift-ovn-kubernetes/ovnkube-node-vcdjb" Jun 11 18:36:36.162530 ip-10-0-141-55 kubenswrapper[2578]: I0611 18:36:36.162479 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/984d8be7-df73-433d-8804-d740a26ef757-ovnkube-config\") pod \"ovnkube-node-vcdjb\" (UID: \"984d8be7-df73-433d-8804-d740a26ef757\") " pod="openshift-ovn-kubernetes/ovnkube-node-vcdjb" Jun 11 18:36:36.162530 ip-10-0-141-55 kubenswrapper[2578]: I0611 18:36:36.162506 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-kf5bh\" (UniqueName: \"kubernetes.io/projected/418a2cf3-d8f2-412c-8365-ba9c61004229-kube-api-access-kf5bh\") pod \"iptables-alerter-kkqxh\" (UID: \"418a2cf3-d8f2-412c-8365-ba9c61004229\") " pod="openshift-network-operator/iptables-alerter-kkqxh" Jun 11 18:36:36.162530 ip-10-0-141-55 kubenswrapper[2578]: I0611 18:36:36.162525 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/50f4744a-788a-47dd-8fa7-321eaaad1b53-etc-modprobe-d\") pod \"tuned-9ld8n\" (UID: \"50f4744a-788a-47dd-8fa7-321eaaad1b53\") " pod="openshift-cluster-node-tuning-operator/tuned-9ld8n" Jun 11 18:36:36.162867 ip-10-0-141-55 kubenswrapper[2578]: I0611 18:36:36.162549 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/50f4744a-788a-47dd-8fa7-321eaaad1b53-var-lib-kubelet\") pod \"tuned-9ld8n\" (UID: \"50f4744a-788a-47dd-8fa7-321eaaad1b53\") " pod="openshift-cluster-node-tuning-operator/tuned-9ld8n" Jun 11 18:36:36.162867 ip-10-0-141-55 kubenswrapper[2578]: I0611 18:36:36.162590 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/cd01660e-add6-419b-8f21-9dbd7c1efd86-os-release\") pod \"multus-additional-cni-plugins-jttqf\" (UID: \"cd01660e-add6-419b-8f21-9dbd7c1efd86\") " pod="openshift-multus/multus-additional-cni-plugins-jttqf" Jun 11 18:36:36.162867 ip-10-0-141-55 kubenswrapper[2578]: I0611 18:36:36.162616 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/8b02eb7c-e526-4079-b139-e46f4626d3e5-os-release\") pod \"multus-zlzks\" (UID: \"8b02eb7c-e526-4079-b139-e46f4626d3e5\") " pod="openshift-multus/multus-zlzks" Jun 11 18:36:36.162867 ip-10-0-141-55 kubenswrapper[2578]: I0611 18:36:36.162643 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/8b02eb7c-e526-4079-b139-e46f4626d3e5-host-var-lib-cni-bin\") pod \"multus-zlzks\" (UID: \"8b02eb7c-e526-4079-b139-e46f4626d3e5\") " pod="openshift-multus/multus-zlzks" Jun 11 18:36:36.162867 ip-10-0-141-55 kubenswrapper[2578]: I0611 18:36:36.162667 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/8b02eb7c-e526-4079-b139-e46f4626d3e5-etc-kubernetes\") pod \"multus-zlzks\" (UID: \"8b02eb7c-e526-4079-b139-e46f4626d3e5\") " pod="openshift-multus/multus-zlzks" Jun 11 18:36:36.162867 ip-10-0-141-55 kubenswrapper[2578]: I0611 18:36:36.162689 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/2cc00ed7-ab6f-4086-ae9c-d5394da96541-host\") pod \"node-ca-qc45v\" (UID: \"2cc00ed7-ab6f-4086-ae9c-d5394da96541\") " pod="openshift-image-registry/node-ca-qc45v" Jun 11 18:36:36.162867 ip-10-0-141-55 kubenswrapper[2578]: I0611 18:36:36.162713 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/617db869-ee36-4a71-b38e-fd0576c57c9a-original-pull-secret\") pod \"global-pull-secret-syncer-hffw7\" (UID: \"617db869-ee36-4a71-b38e-fd0576c57c9a\") " pod="kube-system/global-pull-secret-syncer-hffw7" Jun 11 18:36:36.162867 ip-10-0-141-55 kubenswrapper[2578]: I0611 18:36:36.162757 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/1257ce19-745b-4d56-b701-9fecd0879315-metrics-certs\") pod \"network-metrics-daemon-x5mvk\" (UID: \"1257ce19-745b-4d56-b701-9fecd0879315\") " pod="openshift-multus/network-metrics-daemon-x5mvk" Jun 11 18:36:36.162867 ip-10-0-141-55 kubenswrapper[2578]: I0611 18:36:36.162788 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/8b02eb7c-e526-4079-b139-e46f4626d3e5-host-var-lib-cni-bin\") pod \"multus-zlzks\" (UID: \"8b02eb7c-e526-4079-b139-e46f4626d3e5\") " pod="openshift-multus/multus-zlzks" Jun 11 18:36:36.162867 ip-10-0-141-55 kubenswrapper[2578]: I0611 18:36:36.162795 2578 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jun 11 18:36:36.162867 ip-10-0-141-55 kubenswrapper[2578]: I0611 18:36:36.162815 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/cd01660e-add6-419b-8f21-9dbd7c1efd86-os-release\") pod \"multus-additional-cni-plugins-jttqf\" (UID: \"cd01660e-add6-419b-8f21-9dbd7c1efd86\") " pod="openshift-multus/multus-additional-cni-plugins-jttqf" Jun 11 18:36:36.162867 ip-10-0-141-55 kubenswrapper[2578]: I0611 18:36:36.162797 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/cd01660e-add6-419b-8f21-9dbd7c1efd86-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-jttqf\" (UID: \"cd01660e-add6-419b-8f21-9dbd7c1efd86\") " pod="openshift-multus/multus-additional-cni-plugins-jttqf" Jun 11 18:36:36.162867 ip-10-0-141-55 kubenswrapper[2578]: I0611 18:36:36.162856 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/8b02eb7c-e526-4079-b139-e46f4626d3e5-etc-kubernetes\") pod \"multus-zlzks\" (UID: \"8b02eb7c-e526-4079-b139-e46f4626d3e5\") " pod="openshift-multus/multus-zlzks" Jun 11 18:36:36.163466 ip-10-0-141-55 kubenswrapper[2578]: I0611 18:36:36.162876 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/418a2cf3-d8f2-412c-8365-ba9c61004229-host-slash\") pod \"iptables-alerter-kkqxh\" (UID: \"418a2cf3-d8f2-412c-8365-ba9c61004229\") " pod="openshift-network-operator/iptables-alerter-kkqxh" Jun 11 18:36:36.163466 ip-10-0-141-55 kubenswrapper[2578]: I0611 18:36:36.162849 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/8b02eb7c-e526-4079-b139-e46f4626d3e5-os-release\") pod \"multus-zlzks\" (UID: \"8b02eb7c-e526-4079-b139-e46f4626d3e5\") " pod="openshift-multus/multus-zlzks" Jun 11 18:36:36.163466 ip-10-0-141-55 kubenswrapper[2578]: I0611 18:36:36.162923 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/50f4744a-788a-47dd-8fa7-321eaaad1b53-etc-sysctl-conf\") pod \"tuned-9ld8n\" (UID: \"50f4744a-788a-47dd-8fa7-321eaaad1b53\") " pod="openshift-cluster-node-tuning-operator/tuned-9ld8n" Jun 11 18:36:36.163466 ip-10-0-141-55 kubenswrapper[2578]: I0611 18:36:36.162974 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/418a2cf3-d8f2-412c-8365-ba9c61004229-host-slash\") pod \"iptables-alerter-kkqxh\" (UID: \"418a2cf3-d8f2-412c-8365-ba9c61004229\") " pod="openshift-network-operator/iptables-alerter-kkqxh" Jun 11 18:36:36.163466 ip-10-0-141-55 kubenswrapper[2578]: I0611 18:36:36.163033 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/50f4744a-788a-47dd-8fa7-321eaaad1b53-run\") pod \"tuned-9ld8n\" (UID: \"50f4744a-788a-47dd-8fa7-321eaaad1b53\") " pod="openshift-cluster-node-tuning-operator/tuned-9ld8n" Jun 11 18:36:36.163466 ip-10-0-141-55 kubenswrapper[2578]: I0611 18:36:36.163069 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/50f4744a-788a-47dd-8fa7-321eaaad1b53-sys\") pod \"tuned-9ld8n\" (UID: \"50f4744a-788a-47dd-8fa7-321eaaad1b53\") " pod="openshift-cluster-node-tuning-operator/tuned-9ld8n" Jun 11 18:36:36.163466 ip-10-0-141-55 kubenswrapper[2578]: I0611 18:36:36.163094 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/984d8be7-df73-433d-8804-d740a26ef757-systemd-units\") pod \"ovnkube-node-vcdjb\" (UID: \"984d8be7-df73-433d-8804-d740a26ef757\") " pod="openshift-ovn-kubernetes/ovnkube-node-vcdjb" Jun 11 18:36:36.163466 ip-10-0-141-55 kubenswrapper[2578]: I0611 18:36:36.163119 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/984d8be7-df73-433d-8804-d740a26ef757-host-slash\") pod \"ovnkube-node-vcdjb\" (UID: \"984d8be7-df73-433d-8804-d740a26ef757\") " pod="openshift-ovn-kubernetes/ovnkube-node-vcdjb" Jun 11 18:36:36.163466 ip-10-0-141-55 kubenswrapper[2578]: I0611 18:36:36.163156 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-bq4lj\" (UniqueName: \"kubernetes.io/projected/8b02eb7c-e526-4079-b139-e46f4626d3e5-kube-api-access-bq4lj\") pod \"multus-zlzks\" (UID: \"8b02eb7c-e526-4079-b139-e46f4626d3e5\") " pod="openshift-multus/multus-zlzks" Jun 11 18:36:36.163466 ip-10-0-141-55 kubenswrapper[2578]: I0611 18:36:36.163188 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/418a2cf3-d8f2-412c-8365-ba9c61004229-iptables-alerter-script\") pod \"iptables-alerter-kkqxh\" (UID: \"418a2cf3-d8f2-412c-8365-ba9c61004229\") " pod="openshift-network-operator/iptables-alerter-kkqxh" Jun 11 18:36:36.163466 ip-10-0-141-55 kubenswrapper[2578]: I0611 18:36:36.163216 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5kr5p\" (UniqueName: \"kubernetes.io/projected/1257ce19-745b-4d56-b701-9fecd0879315-kube-api-access-5kr5p\") pod \"network-metrics-daemon-x5mvk\" (UID: \"1257ce19-745b-4d56-b701-9fecd0879315\") " pod="openshift-multus/network-metrics-daemon-x5mvk" Jun 11 18:36:36.163466 ip-10-0-141-55 kubenswrapper[2578]: I0611 18:36:36.163246 2578 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jun 11 18:36:36.163466 ip-10-0-141-55 kubenswrapper[2578]: I0611 18:36:36.163244 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/d6c0b02b-24e5-4d14-a5bc-07c631277c13-device-dir\") pod \"aws-ebs-csi-driver-node-2qbtj\" (UID: \"d6c0b02b-24e5-4d14-a5bc-07c631277c13\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-2qbtj" Jun 11 18:36:36.163466 ip-10-0-141-55 kubenswrapper[2578]: I0611 18:36:36.163331 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/984d8be7-df73-433d-8804-d740a26ef757-host-run-netns\") pod \"ovnkube-node-vcdjb\" (UID: \"984d8be7-df73-433d-8804-d740a26ef757\") " pod="openshift-ovn-kubernetes/ovnkube-node-vcdjb" Jun 11 18:36:36.163466 ip-10-0-141-55 kubenswrapper[2578]: I0611 18:36:36.163371 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6b444\" (UniqueName: \"kubernetes.io/projected/cd01660e-add6-419b-8f21-9dbd7c1efd86-kube-api-access-6b444\") pod \"multus-additional-cni-plugins-jttqf\" (UID: \"cd01660e-add6-419b-8f21-9dbd7c1efd86\") " pod="openshift-multus/multus-additional-cni-plugins-jttqf" Jun 11 18:36:36.163466 ip-10-0-141-55 kubenswrapper[2578]: I0611 18:36:36.163429 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/d6c0b02b-24e5-4d14-a5bc-07c631277c13-kubelet-dir\") pod \"aws-ebs-csi-driver-node-2qbtj\" (UID: \"d6c0b02b-24e5-4d14-a5bc-07c631277c13\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-2qbtj" Jun 11 18:36:36.163466 ip-10-0-141-55 kubenswrapper[2578]: I0611 18:36:36.163429 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/cd01660e-add6-419b-8f21-9dbd7c1efd86-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-jttqf\" (UID: \"cd01660e-add6-419b-8f21-9dbd7c1efd86\") " pod="openshift-multus/multus-additional-cni-plugins-jttqf" Jun 11 18:36:36.164296 ip-10-0-141-55 kubenswrapper[2578]: I0611 18:36:36.163456 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/d6c0b02b-24e5-4d14-a5bc-07c631277c13-socket-dir\") pod \"aws-ebs-csi-driver-node-2qbtj\" (UID: \"d6c0b02b-24e5-4d14-a5bc-07c631277c13\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-2qbtj" Jun 11 18:36:36.164296 ip-10-0-141-55 kubenswrapper[2578]: I0611 18:36:36.163496 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/d6c0b02b-24e5-4d14-a5bc-07c631277c13-etc-selinux\") pod \"aws-ebs-csi-driver-node-2qbtj\" (UID: \"d6c0b02b-24e5-4d14-a5bc-07c631277c13\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-2qbtj" Jun 11 18:36:36.164296 ip-10-0-141-55 kubenswrapper[2578]: I0611 18:36:36.163506 2578 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jun 11 18:36:36.164296 ip-10-0-141-55 kubenswrapper[2578]: I0611 18:36:36.163532 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/984d8be7-df73-433d-8804-d740a26ef757-run-ovn\") pod \"ovnkube-node-vcdjb\" (UID: \"984d8be7-df73-433d-8804-d740a26ef757\") " pod="openshift-ovn-kubernetes/ovnkube-node-vcdjb" Jun 11 18:36:36.164296 ip-10-0-141-55 kubenswrapper[2578]: I0611 18:36:36.163574 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/8b02eb7c-e526-4079-b139-e46f4626d3e5-host-var-lib-cni-multus\") pod \"multus-zlzks\" (UID: \"8b02eb7c-e526-4079-b139-e46f4626d3e5\") " pod="openshift-multus/multus-zlzks" Jun 11 18:36:36.164296 ip-10-0-141-55 kubenswrapper[2578]: I0611 18:36:36.163614 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/e6233099-5000-4135-a876-b35ae68d8198-hosts-file\") pod \"node-resolver-m7sgm\" (UID: \"e6233099-5000-4135-a876-b35ae68d8198\") " pod="openshift-dns/node-resolver-m7sgm" Jun 11 18:36:36.164296 ip-10-0-141-55 kubenswrapper[2578]: I0611 18:36:36.163648 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ljtsv\" (UniqueName: \"kubernetes.io/projected/e6233099-5000-4135-a876-b35ae68d8198-kube-api-access-ljtsv\") pod \"node-resolver-m7sgm\" (UID: \"e6233099-5000-4135-a876-b35ae68d8198\") " pod="openshift-dns/node-resolver-m7sgm" Jun 11 18:36:36.164296 ip-10-0-141-55 kubenswrapper[2578]: I0611 18:36:36.163691 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/984d8be7-df73-433d-8804-d740a26ef757-node-log\") pod \"ovnkube-node-vcdjb\" (UID: \"984d8be7-df73-433d-8804-d740a26ef757\") " pod="openshift-ovn-kubernetes/ovnkube-node-vcdjb" Jun 11 18:36:36.164296 ip-10-0-141-55 kubenswrapper[2578]: I0611 18:36:36.163732 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/cd01660e-add6-419b-8f21-9dbd7c1efd86-tuning-conf-dir\") pod \"multus-additional-cni-plugins-jttqf\" (UID: \"cd01660e-add6-419b-8f21-9dbd7c1efd86\") " pod="openshift-multus/multus-additional-cni-plugins-jttqf" Jun 11 18:36:36.164296 ip-10-0-141-55 kubenswrapper[2578]: I0611 18:36:36.163740 2578 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-141-55.ec2.internal" event="NodeHasSufficientMemory" Jun 11 18:36:36.164296 ip-10-0-141-55 kubenswrapper[2578]: I0611 18:36:36.163745 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/8b02eb7c-e526-4079-b139-e46f4626d3e5-host-var-lib-cni-multus\") pod \"multus-zlzks\" (UID: \"8b02eb7c-e526-4079-b139-e46f4626d3e5\") " pod="openshift-multus/multus-zlzks" Jun 11 18:36:36.164296 ip-10-0-141-55 kubenswrapper[2578]: I0611 18:36:36.163750 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/418a2cf3-d8f2-412c-8365-ba9c61004229-iptables-alerter-script\") pod \"iptables-alerter-kkqxh\" (UID: \"418a2cf3-d8f2-412c-8365-ba9c61004229\") " pod="openshift-network-operator/iptables-alerter-kkqxh" Jun 11 18:36:36.164296 ip-10-0-141-55 kubenswrapper[2578]: I0611 18:36:36.163767 2578 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-141-55.ec2.internal" event="NodeHasNoDiskPressure" Jun 11 18:36:36.164296 ip-10-0-141-55 kubenswrapper[2578]: I0611 18:36:36.163778 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/8b02eb7c-e526-4079-b139-e46f4626d3e5-multus-daemon-config\") pod \"multus-zlzks\" (UID: \"8b02eb7c-e526-4079-b139-e46f4626d3e5\") " pod="openshift-multus/multus-zlzks" Jun 11 18:36:36.164296 ip-10-0-141-55 kubenswrapper[2578]: I0611 18:36:36.163784 2578 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-141-55.ec2.internal" event="NodeHasSufficientPID" Jun 11 18:36:36.164296 ip-10-0-141-55 kubenswrapper[2578]: I0611 18:36:36.163869 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/cd01660e-add6-419b-8f21-9dbd7c1efd86-tuning-conf-dir\") pod \"multus-additional-cni-plugins-jttqf\" (UID: \"cd01660e-add6-419b-8f21-9dbd7c1efd86\") " pod="openshift-multus/multus-additional-cni-plugins-jttqf" Jun 11 18:36:36.164296 ip-10-0-141-55 kubenswrapper[2578]: I0611 18:36:36.163918 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/2cc00ed7-ab6f-4086-ae9c-d5394da96541-serviceca\") pod \"node-ca-qc45v\" (UID: \"2cc00ed7-ab6f-4086-ae9c-d5394da96541\") " pod="openshift-image-registry/node-ca-qc45v" Jun 11 18:36:36.164296 ip-10-0-141-55 kubenswrapper[2578]: I0611 18:36:36.163947 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/617db869-ee36-4a71-b38e-fd0576c57c9a-dbus\") pod \"global-pull-secret-syncer-hffw7\" (UID: \"617db869-ee36-4a71-b38e-fd0576c57c9a\") " pod="kube-system/global-pull-secret-syncer-hffw7" Jun 11 18:36:36.164296 ip-10-0-141-55 kubenswrapper[2578]: I0611 18:36:36.163981 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/d6c0b02b-24e5-4d14-a5bc-07c631277c13-sys-fs\") pod \"aws-ebs-csi-driver-node-2qbtj\" (UID: \"d6c0b02b-24e5-4d14-a5bc-07c631277c13\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-2qbtj" Jun 11 18:36:36.165132 ip-10-0-141-55 kubenswrapper[2578]: I0611 18:36:36.164004 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/50f4744a-788a-47dd-8fa7-321eaaad1b53-host\") pod \"tuned-9ld8n\" (UID: \"50f4744a-788a-47dd-8fa7-321eaaad1b53\") " pod="openshift-cluster-node-tuning-operator/tuned-9ld8n" Jun 11 18:36:36.165132 ip-10-0-141-55 kubenswrapper[2578]: I0611 18:36:36.164026 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/50f4744a-788a-47dd-8fa7-321eaaad1b53-tmp\") pod \"tuned-9ld8n\" (UID: \"50f4744a-788a-47dd-8fa7-321eaaad1b53\") " pod="openshift-cluster-node-tuning-operator/tuned-9ld8n" Jun 11 18:36:36.165132 ip-10-0-141-55 kubenswrapper[2578]: I0611 18:36:36.164061 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/0cc2bcd7-3d68-4ebb-9ab5-4529e5485a69-agent-certs\") pod \"konnectivity-agent-ffv42\" (UID: \"0cc2bcd7-3d68-4ebb-9ab5-4529e5485a69\") " pod="kube-system/konnectivity-agent-ffv42" Jun 11 18:36:36.165132 ip-10-0-141-55 kubenswrapper[2578]: I0611 18:36:36.164070 2578 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-141-55.ec2.internal" event="NodeHasSufficientMemory" Jun 11 18:36:36.165132 ip-10-0-141-55 kubenswrapper[2578]: I0611 18:36:36.164089 2578 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-141-55.ec2.internal" event="NodeHasNoDiskPressure" Jun 11 18:36:36.165132 ip-10-0-141-55 kubenswrapper[2578]: I0611 18:36:36.164125 2578 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-141-55.ec2.internal" event="NodeHasSufficientPID" Jun 11 18:36:36.165132 ip-10-0-141-55 kubenswrapper[2578]: I0611 18:36:36.164156 2578 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jun 11 18:36:36.165132 ip-10-0-141-55 kubenswrapper[2578]: I0611 18:36:36.164089 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/d6c0b02b-24e5-4d14-a5bc-07c631277c13-registration-dir\") pod \"aws-ebs-csi-driver-node-2qbtj\" (UID: \"d6c0b02b-24e5-4d14-a5bc-07c631277c13\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-2qbtj" Jun 11 18:36:36.165132 ip-10-0-141-55 kubenswrapper[2578]: I0611 18:36:36.164332 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/50f4744a-788a-47dd-8fa7-321eaaad1b53-etc-sysconfig\") pod \"tuned-9ld8n\" (UID: \"50f4744a-788a-47dd-8fa7-321eaaad1b53\") " pod="openshift-cluster-node-tuning-operator/tuned-9ld8n" Jun 11 18:36:36.165132 ip-10-0-141-55 kubenswrapper[2578]: I0611 18:36:36.164366 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/50f4744a-788a-47dd-8fa7-321eaaad1b53-etc-kubernetes\") pod \"tuned-9ld8n\" (UID: \"50f4744a-788a-47dd-8fa7-321eaaad1b53\") " pod="openshift-cluster-node-tuning-operator/tuned-9ld8n" Jun 11 18:36:36.165132 ip-10-0-141-55 kubenswrapper[2578]: I0611 18:36:36.164391 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/50f4744a-788a-47dd-8fa7-321eaaad1b53-etc-systemd\") pod \"tuned-9ld8n\" (UID: \"50f4744a-788a-47dd-8fa7-321eaaad1b53\") " pod="openshift-cluster-node-tuning-operator/tuned-9ld8n" Jun 11 18:36:36.165132 ip-10-0-141-55 kubenswrapper[2578]: I0611 18:36:36.164427 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/984d8be7-df73-433d-8804-d740a26ef757-run-systemd\") pod \"ovnkube-node-vcdjb\" (UID: \"984d8be7-df73-433d-8804-d740a26ef757\") " pod="openshift-ovn-kubernetes/ovnkube-node-vcdjb" Jun 11 18:36:36.165132 ip-10-0-141-55 kubenswrapper[2578]: I0611 18:36:36.164452 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/984d8be7-df73-433d-8804-d740a26ef757-log-socket\") pod \"ovnkube-node-vcdjb\" (UID: \"984d8be7-df73-433d-8804-d740a26ef757\") " pod="openshift-ovn-kubernetes/ovnkube-node-vcdjb" Jun 11 18:36:36.165132 ip-10-0-141-55 kubenswrapper[2578]: I0611 18:36:36.164490 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-gfg8q\" (UniqueName: \"kubernetes.io/projected/984d8be7-df73-433d-8804-d740a26ef757-kube-api-access-gfg8q\") pod \"ovnkube-node-vcdjb\" (UID: \"984d8be7-df73-433d-8804-d740a26ef757\") " pod="openshift-ovn-kubernetes/ovnkube-node-vcdjb" Jun 11 18:36:36.165132 ip-10-0-141-55 kubenswrapper[2578]: I0611 18:36:36.164522 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/cd01660e-add6-419b-8f21-9dbd7c1efd86-cnibin\") pod \"multus-additional-cni-plugins-jttqf\" (UID: \"cd01660e-add6-419b-8f21-9dbd7c1efd86\") " pod="openshift-multus/multus-additional-cni-plugins-jttqf" Jun 11 18:36:36.165132 ip-10-0-141-55 kubenswrapper[2578]: I0611 18:36:36.164526 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/8b02eb7c-e526-4079-b139-e46f4626d3e5-multus-daemon-config\") pod \"multus-zlzks\" (UID: \"8b02eb7c-e526-4079-b139-e46f4626d3e5\") " pod="openshift-multus/multus-zlzks" Jun 11 18:36:36.165132 ip-10-0-141-55 kubenswrapper[2578]: I0611 18:36:36.164571 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/8b02eb7c-e526-4079-b139-e46f4626d3e5-multus-socket-dir-parent\") pod \"multus-zlzks\" (UID: \"8b02eb7c-e526-4079-b139-e46f4626d3e5\") " pod="openshift-multus/multus-zlzks" Jun 11 18:36:36.165132 ip-10-0-141-55 kubenswrapper[2578]: I0611 18:36:36.164610 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/cd01660e-add6-419b-8f21-9dbd7c1efd86-cnibin\") pod \"multus-additional-cni-plugins-jttqf\" (UID: \"cd01660e-add6-419b-8f21-9dbd7c1efd86\") " pod="openshift-multus/multus-additional-cni-plugins-jttqf" Jun 11 18:36:36.165132 ip-10-0-141-55 kubenswrapper[2578]: I0611 18:36:36.164697 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/8b02eb7c-e526-4079-b139-e46f4626d3e5-multus-socket-dir-parent\") pod \"multus-zlzks\" (UID: \"8b02eb7c-e526-4079-b139-e46f4626d3e5\") " pod="openshift-multus/multus-zlzks" Jun 11 18:36:36.166053 ip-10-0-141-55 kubenswrapper[2578]: I0611 18:36:36.164734 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/8b02eb7c-e526-4079-b139-e46f4626d3e5-host-run-k8s-cni-cncf-io\") pod \"multus-zlzks\" (UID: \"8b02eb7c-e526-4079-b139-e46f4626d3e5\") " pod="openshift-multus/multus-zlzks" Jun 11 18:36:36.166053 ip-10-0-141-55 kubenswrapper[2578]: I0611 18:36:36.164761 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/8b02eb7c-e526-4079-b139-e46f4626d3e5-host-run-netns\") pod \"multus-zlzks\" (UID: \"8b02eb7c-e526-4079-b139-e46f4626d3e5\") " pod="openshift-multus/multus-zlzks" Jun 11 18:36:36.166053 ip-10-0-141-55 kubenswrapper[2578]: I0611 18:36:36.164788 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-c4ths\" (UniqueName: \"kubernetes.io/projected/04686d4c-5c3d-49ac-9b61-09e80f5e4dff-kube-api-access-c4ths\") pod \"network-check-target-hjkh2\" (UID: \"04686d4c-5c3d-49ac-9b61-09e80f5e4dff\") " pod="openshift-network-diagnostics/network-check-target-hjkh2" Jun 11 18:36:36.166053 ip-10-0-141-55 kubenswrapper[2578]: I0611 18:36:36.164816 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/50f4744a-788a-47dd-8fa7-321eaaad1b53-etc-sysctl-d\") pod \"tuned-9ld8n\" (UID: \"50f4744a-788a-47dd-8fa7-321eaaad1b53\") " pod="openshift-cluster-node-tuning-operator/tuned-9ld8n" Jun 11 18:36:36.166053 ip-10-0-141-55 kubenswrapper[2578]: I0611 18:36:36.164841 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/984d8be7-df73-433d-8804-d740a26ef757-var-lib-openvswitch\") pod \"ovnkube-node-vcdjb\" (UID: \"984d8be7-df73-433d-8804-d740a26ef757\") " pod="openshift-ovn-kubernetes/ovnkube-node-vcdjb" Jun 11 18:36:36.166053 ip-10-0-141-55 kubenswrapper[2578]: I0611 18:36:36.164870 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/984d8be7-df73-433d-8804-d740a26ef757-host-cni-netd\") pod \"ovnkube-node-vcdjb\" (UID: \"984d8be7-df73-433d-8804-d740a26ef757\") " pod="openshift-ovn-kubernetes/ovnkube-node-vcdjb" Jun 11 18:36:36.166053 ip-10-0-141-55 kubenswrapper[2578]: I0611 18:36:36.164881 2578 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-141-55.ec2.internal" event="NodeHasSufficientMemory" Jun 11 18:36:36.166053 ip-10-0-141-55 kubenswrapper[2578]: I0611 18:36:36.164894 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/984d8be7-df73-433d-8804-d740a26ef757-run-openvswitch\") pod \"ovnkube-node-vcdjb\" (UID: \"984d8be7-df73-433d-8804-d740a26ef757\") " pod="openshift-ovn-kubernetes/ovnkube-node-vcdjb" Jun 11 18:36:36.166053 ip-10-0-141-55 kubenswrapper[2578]: I0611 18:36:36.164906 2578 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-141-55.ec2.internal" event="NodeHasNoDiskPressure" Jun 11 18:36:36.166053 ip-10-0-141-55 kubenswrapper[2578]: I0611 18:36:36.164921 2578 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-141-55.ec2.internal" event="NodeHasSufficientPID" Jun 11 18:36:36.166053 ip-10-0-141-55 kubenswrapper[2578]: I0611 18:36:36.164924 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/cd01660e-add6-419b-8f21-9dbd7c1efd86-system-cni-dir\") pod \"multus-additional-cni-plugins-jttqf\" (UID: \"cd01660e-add6-419b-8f21-9dbd7c1efd86\") " pod="openshift-multus/multus-additional-cni-plugins-jttqf" Jun 11 18:36:36.166053 ip-10-0-141-55 kubenswrapper[2578]: I0611 18:36:36.164949 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/8b02eb7c-e526-4079-b139-e46f4626d3e5-cnibin\") pod \"multus-zlzks\" (UID: \"8b02eb7c-e526-4079-b139-e46f4626d3e5\") " pod="openshift-multus/multus-zlzks" Jun 11 18:36:36.166053 ip-10-0-141-55 kubenswrapper[2578]: I0611 18:36:36.164977 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/8b02eb7c-e526-4079-b139-e46f4626d3e5-host-var-lib-kubelet\") pod \"multus-zlzks\" (UID: \"8b02eb7c-e526-4079-b139-e46f4626d3e5\") " pod="openshift-multus/multus-zlzks" Jun 11 18:36:36.166053 ip-10-0-141-55 kubenswrapper[2578]: I0611 18:36:36.164980 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/8b02eb7c-e526-4079-b139-e46f4626d3e5-host-run-k8s-cni-cncf-io\") pod \"multus-zlzks\" (UID: \"8b02eb7c-e526-4079-b139-e46f4626d3e5\") " pod="openshift-multus/multus-zlzks" Jun 11 18:36:36.166053 ip-10-0-141-55 kubenswrapper[2578]: I0611 18:36:36.165004 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/0cc2bcd7-3d68-4ebb-9ab5-4529e5485a69-konnectivity-ca\") pod \"konnectivity-agent-ffv42\" (UID: \"0cc2bcd7-3d68-4ebb-9ab5-4529e5485a69\") " pod="kube-system/konnectivity-agent-ffv42" Jun 11 18:36:36.166053 ip-10-0-141-55 kubenswrapper[2578]: I0611 18:36:36.165020 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/8b02eb7c-e526-4079-b139-e46f4626d3e5-host-run-netns\") pod \"multus-zlzks\" (UID: \"8b02eb7c-e526-4079-b139-e46f4626d3e5\") " pod="openshift-multus/multus-zlzks" Jun 11 18:36:36.166053 ip-10-0-141-55 kubenswrapper[2578]: I0611 18:36:36.165028 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/e6233099-5000-4135-a876-b35ae68d8198-tmp-dir\") pod \"node-resolver-m7sgm\" (UID: \"e6233099-5000-4135-a876-b35ae68d8198\") " pod="openshift-dns/node-resolver-m7sgm" Jun 11 18:36:36.166053 ip-10-0-141-55 kubenswrapper[2578]: I0611 18:36:36.165058 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-z5h69\" (UniqueName: \"kubernetes.io/projected/d6c0b02b-24e5-4d14-a5bc-07c631277c13-kube-api-access-z5h69\") pod \"aws-ebs-csi-driver-node-2qbtj\" (UID: \"d6c0b02b-24e5-4d14-a5bc-07c631277c13\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-2qbtj" Jun 11 18:36:36.166053 ip-10-0-141-55 kubenswrapper[2578]: I0611 18:36:36.165087 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/50f4744a-788a-47dd-8fa7-321eaaad1b53-etc-tuned\") pod \"tuned-9ld8n\" (UID: \"50f4744a-788a-47dd-8fa7-321eaaad1b53\") " pod="openshift-cluster-node-tuning-operator/tuned-9ld8n" Jun 11 18:36:36.166959 ip-10-0-141-55 kubenswrapper[2578]: I0611 18:36:36.165095 2578 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-141-55.ec2.internal" event="NodeHasSufficientMemory" Jun 11 18:36:36.166959 ip-10-0-141-55 kubenswrapper[2578]: I0611 18:36:36.165114 2578 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-141-55.ec2.internal" event="NodeHasNoDiskPressure" Jun 11 18:36:36.166959 ip-10-0-141-55 kubenswrapper[2578]: I0611 18:36:36.165126 2578 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-141-55.ec2.internal" event="NodeHasSufficientPID" Jun 11 18:36:36.166959 ip-10-0-141-55 kubenswrapper[2578]: I0611 18:36:36.165115 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/cd01660e-add6-419b-8f21-9dbd7c1efd86-cni-binary-copy\") pod \"multus-additional-cni-plugins-jttqf\" (UID: \"cd01660e-add6-419b-8f21-9dbd7c1efd86\") " pod="openshift-multus/multus-additional-cni-plugins-jttqf" Jun 11 18:36:36.166959 ip-10-0-141-55 kubenswrapper[2578]: I0611 18:36:36.165168 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/cd01660e-add6-419b-8f21-9dbd7c1efd86-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-jttqf\" (UID: \"cd01660e-add6-419b-8f21-9dbd7c1efd86\") " pod="openshift-multus/multus-additional-cni-plugins-jttqf" Jun 11 18:36:36.166959 ip-10-0-141-55 kubenswrapper[2578]: I0611 18:36:36.165194 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/8b02eb7c-e526-4079-b139-e46f4626d3e5-system-cni-dir\") pod \"multus-zlzks\" (UID: \"8b02eb7c-e526-4079-b139-e46f4626d3e5\") " pod="openshift-multus/multus-zlzks" Jun 11 18:36:36.166959 ip-10-0-141-55 kubenswrapper[2578]: I0611 18:36:36.165219 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/8b02eb7c-e526-4079-b139-e46f4626d3e5-hostroot\") pod \"multus-zlzks\" (UID: \"8b02eb7c-e526-4079-b139-e46f4626d3e5\") " pod="openshift-multus/multus-zlzks" Jun 11 18:36:36.166959 ip-10-0-141-55 kubenswrapper[2578]: I0611 18:36:36.165239 2578 swap_util.go:74] "error creating dir to test if tmpfs noswap is enabled. Assuming not supported" mount path="" error="stat /var/lib/kubelet/plugins/kubernetes.io/empty-dir: no such file or directory" Jun 11 18:36:36.166959 ip-10-0-141-55 kubenswrapper[2578]: I0611 18:36:36.165359 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/cd01660e-add6-419b-8f21-9dbd7c1efd86-system-cni-dir\") pod \"multus-additional-cni-plugins-jttqf\" (UID: \"cd01660e-add6-419b-8f21-9dbd7c1efd86\") " pod="openshift-multus/multus-additional-cni-plugins-jttqf" Jun 11 18:36:36.166959 ip-10-0-141-55 kubenswrapper[2578]: I0611 18:36:36.165398 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/8b02eb7c-e526-4079-b139-e46f4626d3e5-cnibin\") pod \"multus-zlzks\" (UID: \"8b02eb7c-e526-4079-b139-e46f4626d3e5\") " pod="openshift-multus/multus-zlzks" Jun 11 18:36:36.166959 ip-10-0-141-55 kubenswrapper[2578]: I0611 18:36:36.164955 2578 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jun 11 18:36:36.166959 ip-10-0-141-55 kubenswrapper[2578]: I0611 18:36:36.165541 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/8b02eb7c-e526-4079-b139-e46f4626d3e5-host-var-lib-kubelet\") pod \"multus-zlzks\" (UID: \"8b02eb7c-e526-4079-b139-e46f4626d3e5\") " pod="openshift-multus/multus-zlzks" Jun 11 18:36:36.166959 ip-10-0-141-55 kubenswrapper[2578]: I0611 18:36:36.165984 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/cd01660e-add6-419b-8f21-9dbd7c1efd86-cni-binary-copy\") pod \"multus-additional-cni-plugins-jttqf\" (UID: \"cd01660e-add6-419b-8f21-9dbd7c1efd86\") " pod="openshift-multus/multus-additional-cni-plugins-jttqf" Jun 11 18:36:36.166959 ip-10-0-141-55 kubenswrapper[2578]: I0611 18:36:36.166074 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/0cc2bcd7-3d68-4ebb-9ab5-4529e5485a69-konnectivity-ca\") pod \"konnectivity-agent-ffv42\" (UID: \"0cc2bcd7-3d68-4ebb-9ab5-4529e5485a69\") " pod="kube-system/konnectivity-agent-ffv42" Jun 11 18:36:36.166959 ip-10-0-141-55 kubenswrapper[2578]: I0611 18:36:36.166258 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/8b02eb7c-e526-4079-b139-e46f4626d3e5-system-cni-dir\") pod \"multus-zlzks\" (UID: \"8b02eb7c-e526-4079-b139-e46f4626d3e5\") " pod="openshift-multus/multus-zlzks" Jun 11 18:36:36.166959 ip-10-0-141-55 kubenswrapper[2578]: I0611 18:36:36.166258 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/8b02eb7c-e526-4079-b139-e46f4626d3e5-hostroot\") pod \"multus-zlzks\" (UID: \"8b02eb7c-e526-4079-b139-e46f4626d3e5\") " pod="openshift-multus/multus-zlzks" Jun 11 18:36:36.166959 ip-10-0-141-55 kubenswrapper[2578]: I0611 18:36:36.165243 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/984d8be7-df73-433d-8804-d740a26ef757-host-kubelet\") pod \"ovnkube-node-vcdjb\" (UID: \"984d8be7-df73-433d-8804-d740a26ef757\") " pod="openshift-ovn-kubernetes/ovnkube-node-vcdjb" Jun 11 18:36:36.166959 ip-10-0-141-55 kubenswrapper[2578]: I0611 18:36:36.166314 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/984d8be7-df73-433d-8804-d740a26ef757-host-run-ovn-kubernetes\") pod \"ovnkube-node-vcdjb\" (UID: \"984d8be7-df73-433d-8804-d740a26ef757\") " pod="openshift-ovn-kubernetes/ovnkube-node-vcdjb" Jun 11 18:36:36.166959 ip-10-0-141-55 kubenswrapper[2578]: I0611 18:36:36.166342 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/984d8be7-df73-433d-8804-d740a26ef757-ovn-node-metrics-cert\") pod \"ovnkube-node-vcdjb\" (UID: \"984d8be7-df73-433d-8804-d740a26ef757\") " pod="openshift-ovn-kubernetes/ovnkube-node-vcdjb" Jun 11 18:36:36.166959 ip-10-0-141-55 kubenswrapper[2578]: I0611 18:36:36.166369 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/8b02eb7c-e526-4079-b139-e46f4626d3e5-multus-cni-dir\") pod \"multus-zlzks\" (UID: \"8b02eb7c-e526-4079-b139-e46f4626d3e5\") " pod="openshift-multus/multus-zlzks" Jun 11 18:36:36.167883 ip-10-0-141-55 kubenswrapper[2578]: I0611 18:36:36.166395 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/8b02eb7c-e526-4079-b139-e46f4626d3e5-host-run-multus-certs\") pod \"multus-zlzks\" (UID: \"8b02eb7c-e526-4079-b139-e46f4626d3e5\") " pod="openshift-multus/multus-zlzks" Jun 11 18:36:36.167883 ip-10-0-141-55 kubenswrapper[2578]: I0611 18:36:36.166437 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/617db869-ee36-4a71-b38e-fd0576c57c9a-kubelet-config\") pod \"global-pull-secret-syncer-hffw7\" (UID: \"617db869-ee36-4a71-b38e-fd0576c57c9a\") " pod="kube-system/global-pull-secret-syncer-hffw7" Jun 11 18:36:36.167883 ip-10-0-141-55 kubenswrapper[2578]: I0611 18:36:36.166481 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/8b02eb7c-e526-4079-b139-e46f4626d3e5-host-run-multus-certs\") pod \"multus-zlzks\" (UID: \"8b02eb7c-e526-4079-b139-e46f4626d3e5\") " pod="openshift-multus/multus-zlzks" Jun 11 18:36:36.167883 ip-10-0-141-55 kubenswrapper[2578]: I0611 18:36:36.166505 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jbfvc\" (UniqueName: \"kubernetes.io/projected/50f4744a-788a-47dd-8fa7-321eaaad1b53-kube-api-access-jbfvc\") pod \"tuned-9ld8n\" (UID: \"50f4744a-788a-47dd-8fa7-321eaaad1b53\") " pod="openshift-cluster-node-tuning-operator/tuned-9ld8n" Jun 11 18:36:36.167883 ip-10-0-141-55 kubenswrapper[2578]: I0611 18:36:36.166537 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/8b02eb7c-e526-4079-b139-e46f4626d3e5-multus-cni-dir\") pod \"multus-zlzks\" (UID: \"8b02eb7c-e526-4079-b139-e46f4626d3e5\") " pod="openshift-multus/multus-zlzks" Jun 11 18:36:36.167883 ip-10-0-141-55 kubenswrapper[2578]: I0611 18:36:36.166538 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/984d8be7-df73-433d-8804-d740a26ef757-ovnkube-script-lib\") pod \"ovnkube-node-vcdjb\" (UID: \"984d8be7-df73-433d-8804-d740a26ef757\") " pod="openshift-ovn-kubernetes/ovnkube-node-vcdjb" Jun 11 18:36:36.167883 ip-10-0-141-55 kubenswrapper[2578]: I0611 18:36:36.166588 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/8b02eb7c-e526-4079-b139-e46f4626d3e5-cni-binary-copy\") pod \"multus-zlzks\" (UID: \"8b02eb7c-e526-4079-b139-e46f4626d3e5\") " pod="openshift-multus/multus-zlzks" Jun 11 18:36:36.167883 ip-10-0-141-55 kubenswrapper[2578]: I0611 18:36:36.166597 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/cd01660e-add6-419b-8f21-9dbd7c1efd86-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-jttqf\" (UID: \"cd01660e-add6-419b-8f21-9dbd7c1efd86\") " pod="openshift-multus/multus-additional-cni-plugins-jttqf" Jun 11 18:36:36.167883 ip-10-0-141-55 kubenswrapper[2578]: I0611 18:36:36.166612 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/8b02eb7c-e526-4079-b139-e46f4626d3e5-multus-conf-dir\") pod \"multus-zlzks\" (UID: \"8b02eb7c-e526-4079-b139-e46f4626d3e5\") " pod="openshift-multus/multus-zlzks" Jun 11 18:36:36.167883 ip-10-0-141-55 kubenswrapper[2578]: I0611 18:36:36.166647 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/8b02eb7c-e526-4079-b139-e46f4626d3e5-multus-conf-dir\") pod \"multus-zlzks\" (UID: \"8b02eb7c-e526-4079-b139-e46f4626d3e5\") " pod="openshift-multus/multus-zlzks" Jun 11 18:36:36.167883 ip-10-0-141-55 kubenswrapper[2578]: I0611 18:36:36.166665 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/984d8be7-df73-433d-8804-d740a26ef757-host-cni-bin\") pod \"ovnkube-node-vcdjb\" (UID: \"984d8be7-df73-433d-8804-d740a26ef757\") " pod="openshift-ovn-kubernetes/ovnkube-node-vcdjb" Jun 11 18:36:36.167883 ip-10-0-141-55 kubenswrapper[2578]: I0611 18:36:36.166697 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/984d8be7-df73-433d-8804-d740a26ef757-env-overrides\") pod \"ovnkube-node-vcdjb\" (UID: \"984d8be7-df73-433d-8804-d740a26ef757\") " pod="openshift-ovn-kubernetes/ovnkube-node-vcdjb" Jun 11 18:36:36.167883 ip-10-0-141-55 kubenswrapper[2578]: I0611 18:36:36.167024 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/8b02eb7c-e526-4079-b139-e46f4626d3e5-cni-binary-copy\") pod \"multus-zlzks\" (UID: \"8b02eb7c-e526-4079-b139-e46f4626d3e5\") " pod="openshift-multus/multus-zlzks" Jun 11 18:36:36.167883 ip-10-0-141-55 kubenswrapper[2578]: I0611 18:36:36.167365 2578 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-141-55.ec2.internal" event="NodeHasSufficientMemory" Jun 11 18:36:36.167883 ip-10-0-141-55 kubenswrapper[2578]: I0611 18:36:36.167389 2578 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-141-55.ec2.internal" event="NodeHasNoDiskPressure" Jun 11 18:36:36.167883 ip-10-0-141-55 kubenswrapper[2578]: I0611 18:36:36.167400 2578 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-141-55.ec2.internal" event="NodeHasSufficientPID" Jun 11 18:36:36.168605 ip-10-0-141-55 kubenswrapper[2578]: I0611 18:36:36.168587 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/0cc2bcd7-3d68-4ebb-9ab5-4529e5485a69-agent-certs\") pod \"konnectivity-agent-ffv42\" (UID: \"0cc2bcd7-3d68-4ebb-9ab5-4529e5485a69\") " pod="kube-system/konnectivity-agent-ffv42" Jun 11 18:36:36.173159 ip-10-0-141-55 kubenswrapper[2578]: I0611 18:36:36.173136 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-bq4lj\" (UniqueName: \"kubernetes.io/projected/8b02eb7c-e526-4079-b139-e46f4626d3e5-kube-api-access-bq4lj\") pod \"multus-zlzks\" (UID: \"8b02eb7c-e526-4079-b139-e46f4626d3e5\") " pod="openshift-multus/multus-zlzks" Jun 11 18:36:36.173281 ip-10-0-141-55 kubenswrapper[2578]: I0611 18:36:36.173206 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-6b444\" (UniqueName: \"kubernetes.io/projected/cd01660e-add6-419b-8f21-9dbd7c1efd86-kube-api-access-6b444\") pod \"multus-additional-cni-plugins-jttqf\" (UID: \"cd01660e-add6-419b-8f21-9dbd7c1efd86\") " pod="openshift-multus/multus-additional-cni-plugins-jttqf" Jun 11 18:36:36.173540 ip-10-0-141-55 kubenswrapper[2578]: E0611 18:36:36.173525 2578 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jun 11 18:36:36.173632 ip-10-0-141-55 kubenswrapper[2578]: E0611 18:36:36.173547 2578 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jun 11 18:36:36.173632 ip-10-0-141-55 kubenswrapper[2578]: E0611 18:36:36.173573 2578 projected.go:196] Error preparing data for projected volume kube-api-access-c4ths for pod openshift-network-diagnostics/network-check-target-hjkh2: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 11 18:36:36.173726 ip-10-0-141-55 kubenswrapper[2578]: E0611 18:36:36.173636 2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/04686d4c-5c3d-49ac-9b61-09e80f5e4dff-kube-api-access-c4ths podName:04686d4c-5c3d-49ac-9b61-09e80f5e4dff nodeName:}" failed. No retries permitted until 2026-06-11 18:36:36.673611891 +0000 UTC m=+2.628286491 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-api-access-c4ths" (UniqueName: "kubernetes.io/projected/04686d4c-5c3d-49ac-9b61-09e80f5e4dff-kube-api-access-c4ths") pod "network-check-target-hjkh2" (UID: "04686d4c-5c3d-49ac-9b61-09e80f5e4dff") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 11 18:36:36.174258 ip-10-0-141-55 kubenswrapper[2578]: I0611 18:36:36.174235 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-kf5bh\" (UniqueName: \"kubernetes.io/projected/418a2cf3-d8f2-412c-8365-ba9c61004229-kube-api-access-kf5bh\") pod \"iptables-alerter-kkqxh\" (UID: \"418a2cf3-d8f2-412c-8365-ba9c61004229\") " pod="openshift-network-operator/iptables-alerter-kkqxh" Jun 11 18:36:36.198761 ip-10-0-141-55 kubenswrapper[2578]: E0611 18:36:36.198720 2578 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-141-55.ec2.internal\" not found" Jun 11 18:36:36.207198 ip-10-0-141-55 kubenswrapper[2578]: I0611 18:36:36.207133 2578 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kube-apiserver-client-kubelet" expiration="2028-06-10 18:31:35 +0000 UTC" deadline="2028-01-12 06:34:14.993849103 +0000 UTC" Jun 11 18:36:36.207198 ip-10-0-141-55 kubenswrapper[2578]: I0611 18:36:36.207196 2578 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kube-apiserver-client-kubelet" sleep="13907h57m38.786657854s" Jun 11 18:36:36.255426 ip-10-0-141-55 kubenswrapper[2578]: I0611 18:36:36.255332 2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/global-pull-secret-syncer-hffw7" podStartSLOduration=0.255316398 podStartE2EDuration="255.316398ms" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-11 18:36:36 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-11 18:36:36.255050713 +0000 UTC m=+2.209725320" watchObservedRunningTime="2026-06-11 18:36:36.255316398 +0000 UTC m=+2.209991003" Jun 11 18:36:36.267339 ip-10-0-141-55 kubenswrapper[2578]: I0611 18:36:36.267311 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/617db869-ee36-4a71-b38e-fd0576c57c9a-kubelet-config\") pod \"global-pull-secret-syncer-hffw7\" (UID: \"617db869-ee36-4a71-b38e-fd0576c57c9a\") " pod="kube-system/global-pull-secret-syncer-hffw7" Jun 11 18:36:36.267500 ip-10-0-141-55 kubenswrapper[2578]: I0611 18:36:36.267349 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jbfvc\" (UniqueName: \"kubernetes.io/projected/50f4744a-788a-47dd-8fa7-321eaaad1b53-kube-api-access-jbfvc\") pod \"tuned-9ld8n\" (UID: \"50f4744a-788a-47dd-8fa7-321eaaad1b53\") " pod="openshift-cluster-node-tuning-operator/tuned-9ld8n" Jun 11 18:36:36.267500 ip-10-0-141-55 kubenswrapper[2578]: I0611 18:36:36.267380 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/984d8be7-df73-433d-8804-d740a26ef757-ovnkube-script-lib\") pod \"ovnkube-node-vcdjb\" (UID: \"984d8be7-df73-433d-8804-d740a26ef757\") " pod="openshift-ovn-kubernetes/ovnkube-node-vcdjb" Jun 11 18:36:36.267500 ip-10-0-141-55 kubenswrapper[2578]: I0611 18:36:36.267402 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/984d8be7-df73-433d-8804-d740a26ef757-host-cni-bin\") pod \"ovnkube-node-vcdjb\" (UID: \"984d8be7-df73-433d-8804-d740a26ef757\") " pod="openshift-ovn-kubernetes/ovnkube-node-vcdjb" Jun 11 18:36:36.267500 ip-10-0-141-55 kubenswrapper[2578]: I0611 18:36:36.267425 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/984d8be7-df73-433d-8804-d740a26ef757-env-overrides\") pod \"ovnkube-node-vcdjb\" (UID: \"984d8be7-df73-433d-8804-d740a26ef757\") " pod="openshift-ovn-kubernetes/ovnkube-node-vcdjb" Jun 11 18:36:36.267500 ip-10-0-141-55 kubenswrapper[2578]: I0611 18:36:36.267447 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-kb75r\" (UniqueName: \"kubernetes.io/projected/2cc00ed7-ab6f-4086-ae9c-d5394da96541-kube-api-access-kb75r\") pod \"node-ca-qc45v\" (UID: \"2cc00ed7-ab6f-4086-ae9c-d5394da96541\") " pod="openshift-image-registry/node-ca-qc45v" Jun 11 18:36:36.267500 ip-10-0-141-55 kubenswrapper[2578]: I0611 18:36:36.267455 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/617db869-ee36-4a71-b38e-fd0576c57c9a-kubelet-config\") pod \"global-pull-secret-syncer-hffw7\" (UID: \"617db869-ee36-4a71-b38e-fd0576c57c9a\") " pod="kube-system/global-pull-secret-syncer-hffw7" Jun 11 18:36:36.267500 ip-10-0-141-55 kubenswrapper[2578]: I0611 18:36:36.267467 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/50f4744a-788a-47dd-8fa7-321eaaad1b53-lib-modules\") pod \"tuned-9ld8n\" (UID: \"50f4744a-788a-47dd-8fa7-321eaaad1b53\") " pod="openshift-cluster-node-tuning-operator/tuned-9ld8n" Jun 11 18:36:36.267500 ip-10-0-141-55 kubenswrapper[2578]: I0611 18:36:36.267461 2578 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jun 11 18:36:36.267500 ip-10-0-141-55 kubenswrapper[2578]: I0611 18:36:36.267488 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/984d8be7-df73-433d-8804-d740a26ef757-etc-openvswitch\") pod \"ovnkube-node-vcdjb\" (UID: \"984d8be7-df73-433d-8804-d740a26ef757\") " pod="openshift-ovn-kubernetes/ovnkube-node-vcdjb" Jun 11 18:36:36.267994 ip-10-0-141-55 kubenswrapper[2578]: I0611 18:36:36.267520 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/984d8be7-df73-433d-8804-d740a26ef757-host-cni-bin\") pod \"ovnkube-node-vcdjb\" (UID: \"984d8be7-df73-433d-8804-d740a26ef757\") " pod="openshift-ovn-kubernetes/ovnkube-node-vcdjb" Jun 11 18:36:36.267994 ip-10-0-141-55 kubenswrapper[2578]: I0611 18:36:36.267516 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/984d8be7-df73-433d-8804-d740a26ef757-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-vcdjb\" (UID: \"984d8be7-df73-433d-8804-d740a26ef757\") " pod="openshift-ovn-kubernetes/ovnkube-node-vcdjb" Jun 11 18:36:36.267994 ip-10-0-141-55 kubenswrapper[2578]: I0611 18:36:36.267536 2578 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jun 11 18:36:36.267994 ip-10-0-141-55 kubenswrapper[2578]: I0611 18:36:36.267576 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/984d8be7-df73-433d-8804-d740a26ef757-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-vcdjb\" (UID: \"984d8be7-df73-433d-8804-d740a26ef757\") " pod="openshift-ovn-kubernetes/ovnkube-node-vcdjb" Jun 11 18:36:36.267994 ip-10-0-141-55 kubenswrapper[2578]: I0611 18:36:36.267578 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/984d8be7-df73-433d-8804-d740a26ef757-ovnkube-config\") pod \"ovnkube-node-vcdjb\" (UID: \"984d8be7-df73-433d-8804-d740a26ef757\") " pod="openshift-ovn-kubernetes/ovnkube-node-vcdjb" Jun 11 18:36:36.267994 ip-10-0-141-55 kubenswrapper[2578]: I0611 18:36:36.267624 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/50f4744a-788a-47dd-8fa7-321eaaad1b53-etc-modprobe-d\") pod \"tuned-9ld8n\" (UID: \"50f4744a-788a-47dd-8fa7-321eaaad1b53\") " pod="openshift-cluster-node-tuning-operator/tuned-9ld8n" Jun 11 18:36:36.267994 ip-10-0-141-55 kubenswrapper[2578]: I0611 18:36:36.267688 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/984d8be7-df73-433d-8804-d740a26ef757-etc-openvswitch\") pod \"ovnkube-node-vcdjb\" (UID: \"984d8be7-df73-433d-8804-d740a26ef757\") " pod="openshift-ovn-kubernetes/ovnkube-node-vcdjb" Jun 11 18:36:36.267994 ip-10-0-141-55 kubenswrapper[2578]: I0611 18:36:36.267752 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/50f4744a-788a-47dd-8fa7-321eaaad1b53-var-lib-kubelet\") pod \"tuned-9ld8n\" (UID: \"50f4744a-788a-47dd-8fa7-321eaaad1b53\") " pod="openshift-cluster-node-tuning-operator/tuned-9ld8n" Jun 11 18:36:36.267994 ip-10-0-141-55 kubenswrapper[2578]: I0611 18:36:36.267771 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/50f4744a-788a-47dd-8fa7-321eaaad1b53-lib-modules\") pod \"tuned-9ld8n\" (UID: \"50f4744a-788a-47dd-8fa7-321eaaad1b53\") " pod="openshift-cluster-node-tuning-operator/tuned-9ld8n" Jun 11 18:36:36.267994 ip-10-0-141-55 kubenswrapper[2578]: I0611 18:36:36.267798 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/2cc00ed7-ab6f-4086-ae9c-d5394da96541-host\") pod \"node-ca-qc45v\" (UID: \"2cc00ed7-ab6f-4086-ae9c-d5394da96541\") " pod="openshift-image-registry/node-ca-qc45v" Jun 11 18:36:36.267994 ip-10-0-141-55 kubenswrapper[2578]: I0611 18:36:36.267810 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/50f4744a-788a-47dd-8fa7-321eaaad1b53-etc-modprobe-d\") pod \"tuned-9ld8n\" (UID: \"50f4744a-788a-47dd-8fa7-321eaaad1b53\") " pod="openshift-cluster-node-tuning-operator/tuned-9ld8n" Jun 11 18:36:36.267994 ip-10-0-141-55 kubenswrapper[2578]: I0611 18:36:36.267827 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/617db869-ee36-4a71-b38e-fd0576c57c9a-original-pull-secret\") pod \"global-pull-secret-syncer-hffw7\" (UID: \"617db869-ee36-4a71-b38e-fd0576c57c9a\") " pod="kube-system/global-pull-secret-syncer-hffw7" Jun 11 18:36:36.267994 ip-10-0-141-55 kubenswrapper[2578]: I0611 18:36:36.267857 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/1257ce19-745b-4d56-b701-9fecd0879315-metrics-certs\") pod \"network-metrics-daemon-x5mvk\" (UID: \"1257ce19-745b-4d56-b701-9fecd0879315\") " pod="openshift-multus/network-metrics-daemon-x5mvk" Jun 11 18:36:36.267994 ip-10-0-141-55 kubenswrapper[2578]: I0611 18:36:36.267883 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/50f4744a-788a-47dd-8fa7-321eaaad1b53-etc-sysctl-conf\") pod \"tuned-9ld8n\" (UID: \"50f4744a-788a-47dd-8fa7-321eaaad1b53\") " pod="openshift-cluster-node-tuning-operator/tuned-9ld8n" Jun 11 18:36:36.267994 ip-10-0-141-55 kubenswrapper[2578]: I0611 18:36:36.267906 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/50f4744a-788a-47dd-8fa7-321eaaad1b53-run\") pod \"tuned-9ld8n\" (UID: \"50f4744a-788a-47dd-8fa7-321eaaad1b53\") " pod="openshift-cluster-node-tuning-operator/tuned-9ld8n" Jun 11 18:36:36.267994 ip-10-0-141-55 kubenswrapper[2578]: I0611 18:36:36.267913 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/50f4744a-788a-47dd-8fa7-321eaaad1b53-var-lib-kubelet\") pod \"tuned-9ld8n\" (UID: \"50f4744a-788a-47dd-8fa7-321eaaad1b53\") " pod="openshift-cluster-node-tuning-operator/tuned-9ld8n" Jun 11 18:36:36.267994 ip-10-0-141-55 kubenswrapper[2578]: I0611 18:36:36.267928 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/50f4744a-788a-47dd-8fa7-321eaaad1b53-sys\") pod \"tuned-9ld8n\" (UID: \"50f4744a-788a-47dd-8fa7-321eaaad1b53\") " pod="openshift-cluster-node-tuning-operator/tuned-9ld8n" Jun 11 18:36:36.268729 ip-10-0-141-55 kubenswrapper[2578]: I0611 18:36:36.268203 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/2cc00ed7-ab6f-4086-ae9c-d5394da96541-host\") pod \"node-ca-qc45v\" (UID: \"2cc00ed7-ab6f-4086-ae9c-d5394da96541\") " pod="openshift-image-registry/node-ca-qc45v" Jun 11 18:36:36.268729 ip-10-0-141-55 kubenswrapper[2578]: I0611 18:36:36.268328 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/50f4744a-788a-47dd-8fa7-321eaaad1b53-sys\") pod \"tuned-9ld8n\" (UID: \"50f4744a-788a-47dd-8fa7-321eaaad1b53\") " pod="openshift-cluster-node-tuning-operator/tuned-9ld8n" Jun 11 18:36:36.268729 ip-10-0-141-55 kubenswrapper[2578]: I0611 18:36:36.268462 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/984d8be7-df73-433d-8804-d740a26ef757-ovnkube-script-lib\") pod \"ovnkube-node-vcdjb\" (UID: \"984d8be7-df73-433d-8804-d740a26ef757\") " pod="openshift-ovn-kubernetes/ovnkube-node-vcdjb" Jun 11 18:36:36.268729 ip-10-0-141-55 kubenswrapper[2578]: I0611 18:36:36.268581 2578 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jun 11 18:36:36.268729 ip-10-0-141-55 kubenswrapper[2578]: I0611 18:36:36.268587 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/50f4744a-788a-47dd-8fa7-321eaaad1b53-etc-sysctl-conf\") pod \"tuned-9ld8n\" (UID: \"50f4744a-788a-47dd-8fa7-321eaaad1b53\") " pod="openshift-cluster-node-tuning-operator/tuned-9ld8n" Jun 11 18:36:36.268729 ip-10-0-141-55 kubenswrapper[2578]: I0611 18:36:36.268633 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run\" (UniqueName: \"kubernetes.io/host-path/50f4744a-788a-47dd-8fa7-321eaaad1b53-run\") pod \"tuned-9ld8n\" (UID: \"50f4744a-788a-47dd-8fa7-321eaaad1b53\") " pod="openshift-cluster-node-tuning-operator/tuned-9ld8n" Jun 11 18:36:36.268729 ip-10-0-141-55 kubenswrapper[2578]: I0611 18:36:36.268670 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/984d8be7-df73-433d-8804-d740a26ef757-systemd-units\") pod \"ovnkube-node-vcdjb\" (UID: \"984d8be7-df73-433d-8804-d740a26ef757\") " pod="openshift-ovn-kubernetes/ovnkube-node-vcdjb" Jun 11 18:36:36.268729 ip-10-0-141-55 kubenswrapper[2578]: I0611 18:36:36.268679 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/984d8be7-df73-433d-8804-d740a26ef757-env-overrides\") pod \"ovnkube-node-vcdjb\" (UID: \"984d8be7-df73-433d-8804-d740a26ef757\") " pod="openshift-ovn-kubernetes/ovnkube-node-vcdjb" Jun 11 18:36:36.268729 ip-10-0-141-55 kubenswrapper[2578]: I0611 18:36:36.268707 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/984d8be7-df73-433d-8804-d740a26ef757-host-slash\") pod \"ovnkube-node-vcdjb\" (UID: \"984d8be7-df73-433d-8804-d740a26ef757\") " pod="openshift-ovn-kubernetes/ovnkube-node-vcdjb" Jun 11 18:36:36.268729 ip-10-0-141-55 kubenswrapper[2578]: I0611 18:36:36.268708 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/984d8be7-df73-433d-8804-d740a26ef757-ovnkube-config\") pod \"ovnkube-node-vcdjb\" (UID: \"984d8be7-df73-433d-8804-d740a26ef757\") " pod="openshift-ovn-kubernetes/ovnkube-node-vcdjb" Jun 11 18:36:36.269205 ip-10-0-141-55 kubenswrapper[2578]: I0611 18:36:36.268743 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/984d8be7-df73-433d-8804-d740a26ef757-systemd-units\") pod \"ovnkube-node-vcdjb\" (UID: \"984d8be7-df73-433d-8804-d740a26ef757\") " pod="openshift-ovn-kubernetes/ovnkube-node-vcdjb" Jun 11 18:36:36.269205 ip-10-0-141-55 kubenswrapper[2578]: I0611 18:36:36.268758 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/984d8be7-df73-433d-8804-d740a26ef757-host-slash\") pod \"ovnkube-node-vcdjb\" (UID: \"984d8be7-df73-433d-8804-d740a26ef757\") " pod="openshift-ovn-kubernetes/ovnkube-node-vcdjb" Jun 11 18:36:36.269205 ip-10-0-141-55 kubenswrapper[2578]: I0611 18:36:36.268798 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5kr5p\" (UniqueName: \"kubernetes.io/projected/1257ce19-745b-4d56-b701-9fecd0879315-kube-api-access-5kr5p\") pod \"network-metrics-daemon-x5mvk\" (UID: \"1257ce19-745b-4d56-b701-9fecd0879315\") " pod="openshift-multus/network-metrics-daemon-x5mvk" Jun 11 18:36:36.269205 ip-10-0-141-55 kubenswrapper[2578]: I0611 18:36:36.268824 2578 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jun 11 18:36:36.269205 ip-10-0-141-55 kubenswrapper[2578]: I0611 18:36:36.268831 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/d6c0b02b-24e5-4d14-a5bc-07c631277c13-device-dir\") pod \"aws-ebs-csi-driver-node-2qbtj\" (UID: \"d6c0b02b-24e5-4d14-a5bc-07c631277c13\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-2qbtj" Jun 11 18:36:36.269205 ip-10-0-141-55 kubenswrapper[2578]: I0611 18:36:36.268863 2578 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jun 11 18:36:36.269205 ip-10-0-141-55 kubenswrapper[2578]: I0611 18:36:36.268867 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/984d8be7-df73-433d-8804-d740a26ef757-host-run-netns\") pod \"ovnkube-node-vcdjb\" (UID: \"984d8be7-df73-433d-8804-d740a26ef757\") " pod="openshift-ovn-kubernetes/ovnkube-node-vcdjb" Jun 11 18:36:36.269205 ip-10-0-141-55 kubenswrapper[2578]: I0611 18:36:36.268921 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/984d8be7-df73-433d-8804-d740a26ef757-host-run-netns\") pod \"ovnkube-node-vcdjb\" (UID: \"984d8be7-df73-433d-8804-d740a26ef757\") " pod="openshift-ovn-kubernetes/ovnkube-node-vcdjb" Jun 11 18:36:36.269205 ip-10-0-141-55 kubenswrapper[2578]: I0611 18:36:36.268923 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/d6c0b02b-24e5-4d14-a5bc-07c631277c13-kubelet-dir\") pod \"aws-ebs-csi-driver-node-2qbtj\" (UID: \"d6c0b02b-24e5-4d14-a5bc-07c631277c13\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-2qbtj" Jun 11 18:36:36.269205 ip-10-0-141-55 kubenswrapper[2578]: I0611 18:36:36.268959 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/d6c0b02b-24e5-4d14-a5bc-07c631277c13-socket-dir\") pod \"aws-ebs-csi-driver-node-2qbtj\" (UID: \"d6c0b02b-24e5-4d14-a5bc-07c631277c13\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-2qbtj" Jun 11 18:36:36.269205 ip-10-0-141-55 kubenswrapper[2578]: I0611 18:36:36.268997 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/d6c0b02b-24e5-4d14-a5bc-07c631277c13-etc-selinux\") pod \"aws-ebs-csi-driver-node-2qbtj\" (UID: \"d6c0b02b-24e5-4d14-a5bc-07c631277c13\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-2qbtj" Jun 11 18:36:36.269205 ip-10-0-141-55 kubenswrapper[2578]: I0611 18:36:36.269005 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/d6c0b02b-24e5-4d14-a5bc-07c631277c13-kubelet-dir\") pod \"aws-ebs-csi-driver-node-2qbtj\" (UID: \"d6c0b02b-24e5-4d14-a5bc-07c631277c13\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-2qbtj" Jun 11 18:36:36.269205 ip-10-0-141-55 kubenswrapper[2578]: I0611 18:36:36.268926 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/d6c0b02b-24e5-4d14-a5bc-07c631277c13-device-dir\") pod \"aws-ebs-csi-driver-node-2qbtj\" (UID: \"d6c0b02b-24e5-4d14-a5bc-07c631277c13\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-2qbtj" Jun 11 18:36:36.269205 ip-10-0-141-55 kubenswrapper[2578]: I0611 18:36:36.269109 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/984d8be7-df73-433d-8804-d740a26ef757-run-ovn\") pod \"ovnkube-node-vcdjb\" (UID: \"984d8be7-df73-433d-8804-d740a26ef757\") " pod="openshift-ovn-kubernetes/ovnkube-node-vcdjb" Jun 11 18:36:36.269205 ip-10-0-141-55 kubenswrapper[2578]: I0611 18:36:36.269118 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/d6c0b02b-24e5-4d14-a5bc-07c631277c13-socket-dir\") pod \"aws-ebs-csi-driver-node-2qbtj\" (UID: \"d6c0b02b-24e5-4d14-a5bc-07c631277c13\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-2qbtj" Jun 11 18:36:36.269205 ip-10-0-141-55 kubenswrapper[2578]: I0611 18:36:36.269149 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/e6233099-5000-4135-a876-b35ae68d8198-hosts-file\") pod \"node-resolver-m7sgm\" (UID: \"e6233099-5000-4135-a876-b35ae68d8198\") " pod="openshift-dns/node-resolver-m7sgm" Jun 11 18:36:36.269986 ip-10-0-141-55 kubenswrapper[2578]: I0611 18:36:36.269239 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/d6c0b02b-24e5-4d14-a5bc-07c631277c13-etc-selinux\") pod \"aws-ebs-csi-driver-node-2qbtj\" (UID: \"d6c0b02b-24e5-4d14-a5bc-07c631277c13\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-2qbtj" Jun 11 18:36:36.269986 ip-10-0-141-55 kubenswrapper[2578]: I0611 18:36:36.269267 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/e6233099-5000-4135-a876-b35ae68d8198-hosts-file\") pod \"node-resolver-m7sgm\" (UID: \"e6233099-5000-4135-a876-b35ae68d8198\") " pod="openshift-dns/node-resolver-m7sgm" Jun 11 18:36:36.269986 ip-10-0-141-55 kubenswrapper[2578]: I0611 18:36:36.269279 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ljtsv\" (UniqueName: \"kubernetes.io/projected/e6233099-5000-4135-a876-b35ae68d8198-kube-api-access-ljtsv\") pod \"node-resolver-m7sgm\" (UID: \"e6233099-5000-4135-a876-b35ae68d8198\") " pod="openshift-dns/node-resolver-m7sgm" Jun 11 18:36:36.269986 ip-10-0-141-55 kubenswrapper[2578]: I0611 18:36:36.269322 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/984d8be7-df73-433d-8804-d740a26ef757-node-log\") pod \"ovnkube-node-vcdjb\" (UID: \"984d8be7-df73-433d-8804-d740a26ef757\") " pod="openshift-ovn-kubernetes/ovnkube-node-vcdjb" Jun 11 18:36:36.269986 ip-10-0-141-55 kubenswrapper[2578]: I0611 18:36:36.269345 2578 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jun 11 18:36:36.269986 ip-10-0-141-55 kubenswrapper[2578]: I0611 18:36:36.269353 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/2cc00ed7-ab6f-4086-ae9c-d5394da96541-serviceca\") pod \"node-ca-qc45v\" (UID: \"2cc00ed7-ab6f-4086-ae9c-d5394da96541\") " pod="openshift-image-registry/node-ca-qc45v" Jun 11 18:36:36.269986 ip-10-0-141-55 kubenswrapper[2578]: I0611 18:36:36.269384 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/617db869-ee36-4a71-b38e-fd0576c57c9a-dbus\") pod \"global-pull-secret-syncer-hffw7\" (UID: \"617db869-ee36-4a71-b38e-fd0576c57c9a\") " pod="kube-system/global-pull-secret-syncer-hffw7" Jun 11 18:36:36.269986 ip-10-0-141-55 kubenswrapper[2578]: I0611 18:36:36.269419 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/d6c0b02b-24e5-4d14-a5bc-07c631277c13-sys-fs\") pod \"aws-ebs-csi-driver-node-2qbtj\" (UID: \"d6c0b02b-24e5-4d14-a5bc-07c631277c13\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-2qbtj" Jun 11 18:36:36.269986 ip-10-0-141-55 kubenswrapper[2578]: I0611 18:36:36.269452 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/50f4744a-788a-47dd-8fa7-321eaaad1b53-host\") pod \"tuned-9ld8n\" (UID: \"50f4744a-788a-47dd-8fa7-321eaaad1b53\") " pod="openshift-cluster-node-tuning-operator/tuned-9ld8n" Jun 11 18:36:36.269986 ip-10-0-141-55 kubenswrapper[2578]: I0611 18:36:36.269477 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/50f4744a-788a-47dd-8fa7-321eaaad1b53-tmp\") pod \"tuned-9ld8n\" (UID: \"50f4744a-788a-47dd-8fa7-321eaaad1b53\") " pod="openshift-cluster-node-tuning-operator/tuned-9ld8n" Jun 11 18:36:36.269986 ip-10-0-141-55 kubenswrapper[2578]: I0611 18:36:36.269510 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/d6c0b02b-24e5-4d14-a5bc-07c631277c13-registration-dir\") pod \"aws-ebs-csi-driver-node-2qbtj\" (UID: \"d6c0b02b-24e5-4d14-a5bc-07c631277c13\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-2qbtj" Jun 11 18:36:36.269986 ip-10-0-141-55 kubenswrapper[2578]: I0611 18:36:36.269543 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/50f4744a-788a-47dd-8fa7-321eaaad1b53-etc-sysconfig\") pod \"tuned-9ld8n\" (UID: \"50f4744a-788a-47dd-8fa7-321eaaad1b53\") " pod="openshift-cluster-node-tuning-operator/tuned-9ld8n" Jun 11 18:36:36.269986 ip-10-0-141-55 kubenswrapper[2578]: I0611 18:36:36.269592 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/50f4744a-788a-47dd-8fa7-321eaaad1b53-etc-kubernetes\") pod \"tuned-9ld8n\" (UID: \"50f4744a-788a-47dd-8fa7-321eaaad1b53\") " pod="openshift-cluster-node-tuning-operator/tuned-9ld8n" Jun 11 18:36:36.269986 ip-10-0-141-55 kubenswrapper[2578]: I0611 18:36:36.269623 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/50f4744a-788a-47dd-8fa7-321eaaad1b53-etc-systemd\") pod \"tuned-9ld8n\" (UID: \"50f4744a-788a-47dd-8fa7-321eaaad1b53\") " pod="openshift-cluster-node-tuning-operator/tuned-9ld8n" Jun 11 18:36:36.269986 ip-10-0-141-55 kubenswrapper[2578]: I0611 18:36:36.269651 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/984d8be7-df73-433d-8804-d740a26ef757-run-systemd\") pod \"ovnkube-node-vcdjb\" (UID: \"984d8be7-df73-433d-8804-d740a26ef757\") " pod="openshift-ovn-kubernetes/ovnkube-node-vcdjb" Jun 11 18:36:36.269986 ip-10-0-141-55 kubenswrapper[2578]: I0611 18:36:36.269685 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/984d8be7-df73-433d-8804-d740a26ef757-log-socket\") pod \"ovnkube-node-vcdjb\" (UID: \"984d8be7-df73-433d-8804-d740a26ef757\") " pod="openshift-ovn-kubernetes/ovnkube-node-vcdjb" Jun 11 18:36:36.269986 ip-10-0-141-55 kubenswrapper[2578]: I0611 18:36:36.269718 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-gfg8q\" (UniqueName: \"kubernetes.io/projected/984d8be7-df73-433d-8804-d740a26ef757-kube-api-access-gfg8q\") pod \"ovnkube-node-vcdjb\" (UID: \"984d8be7-df73-433d-8804-d740a26ef757\") " pod="openshift-ovn-kubernetes/ovnkube-node-vcdjb" Jun 11 18:36:36.269986 ip-10-0-141-55 kubenswrapper[2578]: I0611 18:36:36.269772 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/50f4744a-788a-47dd-8fa7-321eaaad1b53-etc-sysctl-d\") pod \"tuned-9ld8n\" (UID: \"50f4744a-788a-47dd-8fa7-321eaaad1b53\") " pod="openshift-cluster-node-tuning-operator/tuned-9ld8n" Jun 11 18:36:36.270764 ip-10-0-141-55 kubenswrapper[2578]: I0611 18:36:36.269804 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/984d8be7-df73-433d-8804-d740a26ef757-var-lib-openvswitch\") pod \"ovnkube-node-vcdjb\" (UID: \"984d8be7-df73-433d-8804-d740a26ef757\") " pod="openshift-ovn-kubernetes/ovnkube-node-vcdjb" Jun 11 18:36:36.270764 ip-10-0-141-55 kubenswrapper[2578]: I0611 18:36:36.269813 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/d6c0b02b-24e5-4d14-a5bc-07c631277c13-registration-dir\") pod \"aws-ebs-csi-driver-node-2qbtj\" (UID: \"d6c0b02b-24e5-4d14-a5bc-07c631277c13\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-2qbtj" Jun 11 18:36:36.270764 ip-10-0-141-55 kubenswrapper[2578]: I0611 18:36:36.269853 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/984d8be7-df73-433d-8804-d740a26ef757-host-cni-netd\") pod \"ovnkube-node-vcdjb\" (UID: \"984d8be7-df73-433d-8804-d740a26ef757\") " pod="openshift-ovn-kubernetes/ovnkube-node-vcdjb" Jun 11 18:36:36.270764 ip-10-0-141-55 kubenswrapper[2578]: I0611 18:36:36.269897 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/984d8be7-df73-433d-8804-d740a26ef757-run-openvswitch\") pod \"ovnkube-node-vcdjb\" (UID: \"984d8be7-df73-433d-8804-d740a26ef757\") " pod="openshift-ovn-kubernetes/ovnkube-node-vcdjb" Jun 11 18:36:36.270764 ip-10-0-141-55 kubenswrapper[2578]: I0611 18:36:36.269914 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/2cc00ed7-ab6f-4086-ae9c-d5394da96541-serviceca\") pod \"node-ca-qc45v\" (UID: \"2cc00ed7-ab6f-4086-ae9c-d5394da96541\") " pod="openshift-image-registry/node-ca-qc45v" Jun 11 18:36:36.270764 ip-10-0-141-55 kubenswrapper[2578]: I0611 18:36:36.269931 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/e6233099-5000-4135-a876-b35ae68d8198-tmp-dir\") pod \"node-resolver-m7sgm\" (UID: \"e6233099-5000-4135-a876-b35ae68d8198\") " pod="openshift-dns/node-resolver-m7sgm" Jun 11 18:36:36.270764 ip-10-0-141-55 kubenswrapper[2578]: I0611 18:36:36.269942 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/617db869-ee36-4a71-b38e-fd0576c57c9a-dbus\") pod \"global-pull-secret-syncer-hffw7\" (UID: \"617db869-ee36-4a71-b38e-fd0576c57c9a\") " pod="kube-system/global-pull-secret-syncer-hffw7" Jun 11 18:36:36.270764 ip-10-0-141-55 kubenswrapper[2578]: I0611 18:36:36.269983 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/984d8be7-df73-433d-8804-d740a26ef757-run-ovn\") pod \"ovnkube-node-vcdjb\" (UID: \"984d8be7-df73-433d-8804-d740a26ef757\") " pod="openshift-ovn-kubernetes/ovnkube-node-vcdjb" Jun 11 18:36:36.270764 ip-10-0-141-55 kubenswrapper[2578]: I0611 18:36:36.270002 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/50f4744a-788a-47dd-8fa7-321eaaad1b53-host\") pod \"tuned-9ld8n\" (UID: \"50f4744a-788a-47dd-8fa7-321eaaad1b53\") " pod="openshift-cluster-node-tuning-operator/tuned-9ld8n" Jun 11 18:36:36.270764 ip-10-0-141-55 kubenswrapper[2578]: I0611 18:36:36.270033 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/50f4744a-788a-47dd-8fa7-321eaaad1b53-etc-kubernetes\") pod \"tuned-9ld8n\" (UID: \"50f4744a-788a-47dd-8fa7-321eaaad1b53\") " pod="openshift-cluster-node-tuning-operator/tuned-9ld8n" Jun 11 18:36:36.270764 ip-10-0-141-55 kubenswrapper[2578]: I0611 18:36:36.270047 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/984d8be7-df73-433d-8804-d740a26ef757-node-log\") pod \"ovnkube-node-vcdjb\" (UID: \"984d8be7-df73-433d-8804-d740a26ef757\") " pod="openshift-ovn-kubernetes/ovnkube-node-vcdjb" Jun 11 18:36:36.270764 ip-10-0-141-55 kubenswrapper[2578]: I0611 18:36:36.270059 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/d6c0b02b-24e5-4d14-a5bc-07c631277c13-sys-fs\") pod \"aws-ebs-csi-driver-node-2qbtj\" (UID: \"d6c0b02b-24e5-4d14-a5bc-07c631277c13\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-2qbtj" Jun 11 18:36:36.270764 ip-10-0-141-55 kubenswrapper[2578]: I0611 18:36:36.270110 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/984d8be7-df73-433d-8804-d740a26ef757-run-systemd\") pod \"ovnkube-node-vcdjb\" (UID: \"984d8be7-df73-433d-8804-d740a26ef757\") " pod="openshift-ovn-kubernetes/ovnkube-node-vcdjb" Jun 11 18:36:36.270764 ip-10-0-141-55 kubenswrapper[2578]: I0611 18:36:36.270114 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/984d8be7-df73-433d-8804-d740a26ef757-var-lib-openvswitch\") pod \"ovnkube-node-vcdjb\" (UID: \"984d8be7-df73-433d-8804-d740a26ef757\") " pod="openshift-ovn-kubernetes/ovnkube-node-vcdjb" Jun 11 18:36:36.270764 ip-10-0-141-55 kubenswrapper[2578]: I0611 18:36:36.270122 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/984d8be7-df73-433d-8804-d740a26ef757-host-cni-netd\") pod \"ovnkube-node-vcdjb\" (UID: \"984d8be7-df73-433d-8804-d740a26ef757\") " pod="openshift-ovn-kubernetes/ovnkube-node-vcdjb" Jun 11 18:36:36.270764 ip-10-0-141-55 kubenswrapper[2578]: I0611 18:36:36.270171 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/984d8be7-df73-433d-8804-d740a26ef757-log-socket\") pod \"ovnkube-node-vcdjb\" (UID: \"984d8be7-df73-433d-8804-d740a26ef757\") " pod="openshift-ovn-kubernetes/ovnkube-node-vcdjb" Jun 11 18:36:36.270764 ip-10-0-141-55 kubenswrapper[2578]: I0611 18:36:36.270189 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/50f4744a-788a-47dd-8fa7-321eaaad1b53-etc-systemd\") pod \"tuned-9ld8n\" (UID: \"50f4744a-788a-47dd-8fa7-321eaaad1b53\") " pod="openshift-cluster-node-tuning-operator/tuned-9ld8n" Jun 11 18:36:36.270764 ip-10-0-141-55 kubenswrapper[2578]: I0611 18:36:36.270240 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/984d8be7-df73-433d-8804-d740a26ef757-run-openvswitch\") pod \"ovnkube-node-vcdjb\" (UID: \"984d8be7-df73-433d-8804-d740a26ef757\") " pod="openshift-ovn-kubernetes/ovnkube-node-vcdjb" Jun 11 18:36:36.271645 ip-10-0-141-55 kubenswrapper[2578]: I0611 18:36:36.270282 2578 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jun 11 18:36:36.271645 ip-10-0-141-55 kubenswrapper[2578]: I0611 18:36:36.270314 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/50f4744a-788a-47dd-8fa7-321eaaad1b53-etc-sysctl-d\") pod \"tuned-9ld8n\" (UID: \"50f4744a-788a-47dd-8fa7-321eaaad1b53\") " pod="openshift-cluster-node-tuning-operator/tuned-9ld8n" Jun 11 18:36:36.271645 ip-10-0-141-55 kubenswrapper[2578]: I0611 18:36:36.270323 2578 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jun 11 18:36:36.271645 ip-10-0-141-55 kubenswrapper[2578]: I0611 18:36:36.270350 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-z5h69\" (UniqueName: \"kubernetes.io/projected/d6c0b02b-24e5-4d14-a5bc-07c631277c13-kube-api-access-z5h69\") pod \"aws-ebs-csi-driver-node-2qbtj\" (UID: \"d6c0b02b-24e5-4d14-a5bc-07c631277c13\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-2qbtj" Jun 11 18:36:36.271645 ip-10-0-141-55 kubenswrapper[2578]: I0611 18:36:36.270365 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/50f4744a-788a-47dd-8fa7-321eaaad1b53-etc-sysconfig\") pod \"tuned-9ld8n\" (UID: \"50f4744a-788a-47dd-8fa7-321eaaad1b53\") " pod="openshift-cluster-node-tuning-operator/tuned-9ld8n" Jun 11 18:36:36.271645 ip-10-0-141-55 kubenswrapper[2578]: I0611 18:36:36.270373 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/e6233099-5000-4135-a876-b35ae68d8198-tmp-dir\") pod \"node-resolver-m7sgm\" (UID: \"e6233099-5000-4135-a876-b35ae68d8198\") " pod="openshift-dns/node-resolver-m7sgm" Jun 11 18:36:36.271645 ip-10-0-141-55 kubenswrapper[2578]: I0611 18:36:36.270382 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/50f4744a-788a-47dd-8fa7-321eaaad1b53-etc-tuned\") pod \"tuned-9ld8n\" (UID: \"50f4744a-788a-47dd-8fa7-321eaaad1b53\") " pod="openshift-cluster-node-tuning-operator/tuned-9ld8n" Jun 11 18:36:36.271645 ip-10-0-141-55 kubenswrapper[2578]: I0611 18:36:36.270417 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/984d8be7-df73-433d-8804-d740a26ef757-host-kubelet\") pod \"ovnkube-node-vcdjb\" (UID: \"984d8be7-df73-433d-8804-d740a26ef757\") " pod="openshift-ovn-kubernetes/ovnkube-node-vcdjb" Jun 11 18:36:36.271645 ip-10-0-141-55 kubenswrapper[2578]: I0611 18:36:36.270430 2578 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jun 11 18:36:36.271645 ip-10-0-141-55 kubenswrapper[2578]: I0611 18:36:36.270445 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/984d8be7-df73-433d-8804-d740a26ef757-host-run-ovn-kubernetes\") pod \"ovnkube-node-vcdjb\" (UID: \"984d8be7-df73-433d-8804-d740a26ef757\") " pod="openshift-ovn-kubernetes/ovnkube-node-vcdjb" Jun 11 18:36:36.271645 ip-10-0-141-55 kubenswrapper[2578]: I0611 18:36:36.270471 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/984d8be7-df73-433d-8804-d740a26ef757-ovn-node-metrics-cert\") pod \"ovnkube-node-vcdjb\" (UID: \"984d8be7-df73-433d-8804-d740a26ef757\") " pod="openshift-ovn-kubernetes/ovnkube-node-vcdjb" Jun 11 18:36:36.271645 ip-10-0-141-55 kubenswrapper[2578]: I0611 18:36:36.270488 2578 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jun 11 18:36:36.271645 ip-10-0-141-55 kubenswrapper[2578]: I0611 18:36:36.270504 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/984d8be7-df73-433d-8804-d740a26ef757-host-kubelet\") pod \"ovnkube-node-vcdjb\" (UID: \"984d8be7-df73-433d-8804-d740a26ef757\") " pod="openshift-ovn-kubernetes/ovnkube-node-vcdjb" Jun 11 18:36:36.271645 ip-10-0-141-55 kubenswrapper[2578]: I0611 18:36:36.270547 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/984d8be7-df73-433d-8804-d740a26ef757-host-run-ovn-kubernetes\") pod \"ovnkube-node-vcdjb\" (UID: \"984d8be7-df73-433d-8804-d740a26ef757\") " pod="openshift-ovn-kubernetes/ovnkube-node-vcdjb" Jun 11 18:36:36.271645 ip-10-0-141-55 kubenswrapper[2578]: I0611 18:36:36.270590 2578 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jun 11 18:36:36.272651 ip-10-0-141-55 kubenswrapper[2578]: I0611 18:36:36.272445 2578 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-141-55.ec2.internal" event="NodeHasSufficientMemory" Jun 11 18:36:36.272651 ip-10-0-141-55 kubenswrapper[2578]: I0611 18:36:36.272457 2578 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-141-55.ec2.internal" event="NodeHasSufficientMemory" Jun 11 18:36:36.272651 ip-10-0-141-55 kubenswrapper[2578]: I0611 18:36:36.272471 2578 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-141-55.ec2.internal" event="NodeHasSufficientMemory" Jun 11 18:36:36.272651 ip-10-0-141-55 kubenswrapper[2578]: I0611 18:36:36.272483 2578 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-141-55.ec2.internal" event="NodeHasNoDiskPressure" Jun 11 18:36:36.272651 ip-10-0-141-55 kubenswrapper[2578]: I0611 18:36:36.272491 2578 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-141-55.ec2.internal" event="NodeHasSufficientMemory" Jun 11 18:36:36.272651 ip-10-0-141-55 kubenswrapper[2578]: I0611 18:36:36.272498 2578 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-141-55.ec2.internal" event="NodeHasSufficientPID" Jun 11 18:36:36.272651 ip-10-0-141-55 kubenswrapper[2578]: I0611 18:36:36.272481 2578 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-141-55.ec2.internal" event="NodeHasSufficientMemory" Jun 11 18:36:36.272651 ip-10-0-141-55 kubenswrapper[2578]: I0611 18:36:36.272511 2578 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-141-55.ec2.internal" event="NodeHasNoDiskPressure" Jun 11 18:36:36.272651 ip-10-0-141-55 kubenswrapper[2578]: I0611 18:36:36.272513 2578 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-141-55.ec2.internal" event="NodeHasSufficientMemory" Jun 11 18:36:36.272651 ip-10-0-141-55 kubenswrapper[2578]: I0611 18:36:36.272523 2578 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-141-55.ec2.internal" event="NodeHasSufficientMemory" Jun 11 18:36:36.272651 ip-10-0-141-55 kubenswrapper[2578]: I0611 18:36:36.272534 2578 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-141-55.ec2.internal" event="NodeHasNoDiskPressure" Jun 11 18:36:36.272651 ip-10-0-141-55 kubenswrapper[2578]: I0611 18:36:36.272547 2578 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-141-55.ec2.internal" event="NodeHasNoDiskPressure" Jun 11 18:36:36.272651 ip-10-0-141-55 kubenswrapper[2578]: I0611 18:36:36.272550 2578 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-141-55.ec2.internal" event="NodeHasSufficientPID" Jun 11 18:36:36.272651 ip-10-0-141-55 kubenswrapper[2578]: I0611 18:36:36.272575 2578 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-141-55.ec2.internal" event="NodeHasSufficientMemory" Jun 11 18:36:36.272651 ip-10-0-141-55 kubenswrapper[2578]: I0611 18:36:36.272580 2578 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-141-55.ec2.internal" event="NodeHasSufficientMemory" Jun 11 18:36:36.272651 ip-10-0-141-55 kubenswrapper[2578]: I0611 18:36:36.272593 2578 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-141-55.ec2.internal" event="NodeHasNoDiskPressure" Jun 11 18:36:36.272651 ip-10-0-141-55 kubenswrapper[2578]: I0611 18:36:36.272597 2578 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-141-55.ec2.internal" event="NodeHasNoDiskPressure" Jun 11 18:36:36.272651 ip-10-0-141-55 kubenswrapper[2578]: I0611 18:36:36.272496 2578 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-141-55.ec2.internal" event="NodeHasNoDiskPressure" Jun 11 18:36:36.272651 ip-10-0-141-55 kubenswrapper[2578]: I0611 18:36:36.272606 2578 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-141-55.ec2.internal" event="NodeHasSufficientPID" Jun 11 18:36:36.272651 ip-10-0-141-55 kubenswrapper[2578]: I0611 18:36:36.272610 2578 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-141-55.ec2.internal" event="NodeHasSufficientPID" Jun 11 18:36:36.272651 ip-10-0-141-55 kubenswrapper[2578]: I0611 18:36:36.272615 2578 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-141-55.ec2.internal" event="NodeHasSufficientPID" Jun 11 18:36:36.273596 ip-10-0-141-55 kubenswrapper[2578]: I0611 18:36:36.272578 2578 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-141-55.ec2.internal" event="NodeHasSufficientPID" Jun 11 18:36:36.273596 ip-10-0-141-55 kubenswrapper[2578]: I0611 18:36:36.272525 2578 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-141-55.ec2.internal" event="NodeHasSufficientPID" Jun 11 18:36:36.273596 ip-10-0-141-55 kubenswrapper[2578]: I0611 18:36:36.272478 2578 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-141-55.ec2.internal" event="NodeHasNoDiskPressure" Jun 11 18:36:36.273596 ip-10-0-141-55 kubenswrapper[2578]: I0611 18:36:36.272820 2578 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-141-55.ec2.internal" event="NodeHasSufficientPID" Jun 11 18:36:36.273596 ip-10-0-141-55 kubenswrapper[2578]: I0611 18:36:36.272940 2578 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-141-55.ec2.internal" event="NodeHasSufficientMemory" Jun 11 18:36:36.273596 ip-10-0-141-55 kubenswrapper[2578]: I0611 18:36:36.272961 2578 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-141-55.ec2.internal" event="NodeHasNoDiskPressure" Jun 11 18:36:36.273596 ip-10-0-141-55 kubenswrapper[2578]: I0611 18:36:36.272976 2578 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-141-55.ec2.internal" event="NodeHasSufficientPID" Jun 11 18:36:36.273596 ip-10-0-141-55 kubenswrapper[2578]: I0611 18:36:36.272451 2578 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-141-55.ec2.internal" event="NodeHasSufficientMemory" Jun 11 18:36:36.273596 ip-10-0-141-55 kubenswrapper[2578]: I0611 18:36:36.273064 2578 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-141-55.ec2.internal" event="NodeHasNoDiskPressure" Jun 11 18:36:36.273596 ip-10-0-141-55 kubenswrapper[2578]: I0611 18:36:36.273079 2578 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-141-55.ec2.internal" event="NodeHasSufficientPID" Jun 11 18:36:36.273596 ip-10-0-141-55 kubenswrapper[2578]: E0611 18:36:36.273078 2578 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jun 11 18:36:36.273596 ip-10-0-141-55 kubenswrapper[2578]: E0611 18:36:36.273224 2578 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jun 11 18:36:36.273596 ip-10-0-141-55 kubenswrapper[2578]: I0611 18:36:36.272517 2578 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-141-55.ec2.internal" event="NodeHasNoDiskPressure" Jun 11 18:36:36.273596 ip-10-0-141-55 kubenswrapper[2578]: I0611 18:36:36.273256 2578 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-141-55.ec2.internal" event="NodeHasSufficientPID" Jun 11 18:36:36.273596 ip-10-0-141-55 kubenswrapper[2578]: E0611 18:36:36.273227 2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/617db869-ee36-4a71-b38e-fd0576c57c9a-original-pull-secret podName:617db869-ee36-4a71-b38e-fd0576c57c9a nodeName:}" failed. No retries permitted until 2026-06-11 18:36:36.773207729 +0000 UTC m=+2.727882342 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/617db869-ee36-4a71-b38e-fd0576c57c9a-original-pull-secret") pod "global-pull-secret-syncer-hffw7" (UID: "617db869-ee36-4a71-b38e-fd0576c57c9a") : object "kube-system"/"original-pull-secret" not registered Jun 11 18:36:36.273596 ip-10-0-141-55 kubenswrapper[2578]: E0611 18:36:36.273287 2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/1257ce19-745b-4d56-b701-9fecd0879315-metrics-certs podName:1257ce19-745b-4d56-b701-9fecd0879315 nodeName:}" failed. No retries permitted until 2026-06-11 18:36:36.773270438 +0000 UTC m=+2.727945023 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/1257ce19-745b-4d56-b701-9fecd0879315-metrics-certs") pod "network-metrics-daemon-x5mvk" (UID: "1257ce19-745b-4d56-b701-9fecd0879315") : object "openshift-multus"/"metrics-daemon-secret" not registered Jun 11 18:36:36.275488 ip-10-0-141-55 kubenswrapper[2578]: I0611 18:36:36.275465 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/984d8be7-df73-433d-8804-d740a26ef757-ovn-node-metrics-cert\") pod \"ovnkube-node-vcdjb\" (UID: \"984d8be7-df73-433d-8804-d740a26ef757\") " pod="openshift-ovn-kubernetes/ovnkube-node-vcdjb" Jun 11 18:36:36.275629 ip-10-0-141-55 kubenswrapper[2578]: I0611 18:36:36.275474 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/50f4744a-788a-47dd-8fa7-321eaaad1b53-etc-tuned\") pod \"tuned-9ld8n\" (UID: \"50f4744a-788a-47dd-8fa7-321eaaad1b53\") " pod="openshift-cluster-node-tuning-operator/tuned-9ld8n" Jun 11 18:36:36.275629 ip-10-0-141-55 kubenswrapper[2578]: I0611 18:36:36.275522 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/50f4744a-788a-47dd-8fa7-321eaaad1b53-tmp\") pod \"tuned-9ld8n\" (UID: \"50f4744a-788a-47dd-8fa7-321eaaad1b53\") " pod="openshift-cluster-node-tuning-operator/tuned-9ld8n" Jun 11 18:36:36.283686 ip-10-0-141-55 kubenswrapper[2578]: I0611 18:36:36.283663 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-jbfvc\" (UniqueName: \"kubernetes.io/projected/50f4744a-788a-47dd-8fa7-321eaaad1b53-kube-api-access-jbfvc\") pod \"tuned-9ld8n\" (UID: \"50f4744a-788a-47dd-8fa7-321eaaad1b53\") " pod="openshift-cluster-node-tuning-operator/tuned-9ld8n" Jun 11 18:36:36.283829 ip-10-0-141-55 kubenswrapper[2578]: I0611 18:36:36.283755 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-z5h69\" (UniqueName: \"kubernetes.io/projected/d6c0b02b-24e5-4d14-a5bc-07c631277c13-kube-api-access-z5h69\") pod \"aws-ebs-csi-driver-node-2qbtj\" (UID: \"d6c0b02b-24e5-4d14-a5bc-07c631277c13\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-2qbtj" Jun 11 18:36:36.284429 ip-10-0-141-55 kubenswrapper[2578]: I0611 18:36:36.284411 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-ljtsv\" (UniqueName: \"kubernetes.io/projected/e6233099-5000-4135-a876-b35ae68d8198-kube-api-access-ljtsv\") pod \"node-resolver-m7sgm\" (UID: \"e6233099-5000-4135-a876-b35ae68d8198\") " pod="openshift-dns/node-resolver-m7sgm" Jun 11 18:36:36.284545 ip-10-0-141-55 kubenswrapper[2578]: I0611 18:36:36.284517 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-kb75r\" (UniqueName: \"kubernetes.io/projected/2cc00ed7-ab6f-4086-ae9c-d5394da96541-kube-api-access-kb75r\") pod \"node-ca-qc45v\" (UID: \"2cc00ed7-ab6f-4086-ae9c-d5394da96541\") " pod="openshift-image-registry/node-ca-qc45v" Jun 11 18:36:36.284648 ip-10-0-141-55 kubenswrapper[2578]: I0611 18:36:36.284527 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-5kr5p\" (UniqueName: \"kubernetes.io/projected/1257ce19-745b-4d56-b701-9fecd0879315-kube-api-access-5kr5p\") pod \"network-metrics-daemon-x5mvk\" (UID: \"1257ce19-745b-4d56-b701-9fecd0879315\") " pod="openshift-multus/network-metrics-daemon-x5mvk" Jun 11 18:36:36.284803 ip-10-0-141-55 kubenswrapper[2578]: I0611 18:36:36.284785 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-gfg8q\" (UniqueName: \"kubernetes.io/projected/984d8be7-df73-433d-8804-d740a26ef757-kube-api-access-gfg8q\") pod \"ovnkube-node-vcdjb\" (UID: \"984d8be7-df73-433d-8804-d740a26ef757\") " pod="openshift-ovn-kubernetes/ovnkube-node-vcdjb" Jun 11 18:36:36.299586 ip-10-0-141-55 kubenswrapper[2578]: E0611 18:36:36.299564 2578 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-141-55.ec2.internal\" not found" Jun 11 18:36:36.328867 ip-10-0-141-55 kubenswrapper[2578]: I0611 18:36:36.328847 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-jttqf" Jun 11 18:36:36.333496 ip-10-0-141-55 kubenswrapper[2578]: I0611 18:36:36.333477 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-zlzks" Jun 11 18:36:36.350177 ip-10-0-141-55 kubenswrapper[2578]: I0611 18:36:36.350153 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-ffv42" Jun 11 18:36:36.368803 ip-10-0-141-55 kubenswrapper[2578]: I0611 18:36:36.368777 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-kkqxh" Jun 11 18:36:36.376421 ip-10-0-141-55 kubenswrapper[2578]: I0611 18:36:36.376402 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-qc45v" Jun 11 18:36:36.388886 ip-10-0-141-55 kubenswrapper[2578]: I0611 18:36:36.388865 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-2qbtj" Jun 11 18:36:36.400279 ip-10-0-141-55 kubenswrapper[2578]: E0611 18:36:36.400259 2578 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-141-55.ec2.internal\" not found" Jun 11 18:36:36.415694 ip-10-0-141-55 kubenswrapper[2578]: I0611 18:36:36.415673 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-9ld8n" Jun 11 18:36:36.422133 ip-10-0-141-55 kubenswrapper[2578]: I0611 18:36:36.422117 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-vcdjb" Jun 11 18:36:36.432525 ip-10-0-141-55 kubenswrapper[2578]: I0611 18:36:36.432510 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-m7sgm" Jun 11 18:36:36.472357 ip-10-0-141-55 kubenswrapper[2578]: I0611 18:36:36.472330 2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/617db869-ee36-4a71-b38e-fd0576c57c9a-kubelet-config\") pod \"617db869-ee36-4a71-b38e-fd0576c57c9a\" (UID: \"617db869-ee36-4a71-b38e-fd0576c57c9a\") " Jun 11 18:36:36.472480 ip-10-0-141-55 kubenswrapper[2578]: I0611 18:36:36.472366 2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/617db869-ee36-4a71-b38e-fd0576c57c9a-dbus\") pod \"617db869-ee36-4a71-b38e-fd0576c57c9a\" (UID: \"617db869-ee36-4a71-b38e-fd0576c57c9a\") " Jun 11 18:36:36.472480 ip-10-0-141-55 kubenswrapper[2578]: I0611 18:36:36.472440 2578 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/host-path/617db869-ee36-4a71-b38e-fd0576c57c9a-kubelet-config" (OuterVolumeSpecName: "kubelet-config") pod "617db869-ee36-4a71-b38e-fd0576c57c9a" (UID: "617db869-ee36-4a71-b38e-fd0576c57c9a"). InnerVolumeSpecName "kubelet-config". PluginName "kubernetes.io/host-path", VolumeGIDValue "" Jun 11 18:36:36.472618 ip-10-0-141-55 kubenswrapper[2578]: I0611 18:36:36.472482 2578 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/host-path/617db869-ee36-4a71-b38e-fd0576c57c9a-dbus" (OuterVolumeSpecName: "dbus") pod "617db869-ee36-4a71-b38e-fd0576c57c9a" (UID: "617db869-ee36-4a71-b38e-fd0576c57c9a"). InnerVolumeSpecName "dbus". PluginName "kubernetes.io/host-path", VolumeGIDValue "" Jun 11 18:36:36.472618 ip-10-0-141-55 kubenswrapper[2578]: I0611 18:36:36.472575 2578 reconciler_common.go:299] "Volume detached for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/617db869-ee36-4a71-b38e-fd0576c57c9a-kubelet-config\") on node \"ip-10-0-141-55.ec2.internal\" DevicePath \"\"" Jun 11 18:36:36.472618 ip-10-0-141-55 kubenswrapper[2578]: I0611 18:36:36.472591 2578 reconciler_common.go:299] "Volume detached for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/617db869-ee36-4a71-b38e-fd0576c57c9a-dbus\") on node \"ip-10-0-141-55.ec2.internal\" DevicePath \"\"" Jun 11 18:36:36.501394 ip-10-0-141-55 kubenswrapper[2578]: E0611 18:36:36.501359 2578 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-141-55.ec2.internal\" not found" Jun 11 18:36:36.602022 ip-10-0-141-55 kubenswrapper[2578]: E0611 18:36:36.601951 2578 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-141-55.ec2.internal\" not found" Jun 11 18:36:36.702854 ip-10-0-141-55 kubenswrapper[2578]: E0611 18:36:36.702823 2578 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-141-55.ec2.internal\" not found" Jun 11 18:36:36.774740 ip-10-0-141-55 kubenswrapper[2578]: I0611 18:36:36.774696 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/617db869-ee36-4a71-b38e-fd0576c57c9a-original-pull-secret\") pod \"global-pull-secret-syncer-hffw7\" (UID: \"617db869-ee36-4a71-b38e-fd0576c57c9a\") " pod="kube-system/global-pull-secret-syncer-hffw7" Jun 11 18:36:36.774915 ip-10-0-141-55 kubenswrapper[2578]: I0611 18:36:36.774750 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/1257ce19-745b-4d56-b701-9fecd0879315-metrics-certs\") pod \"network-metrics-daemon-x5mvk\" (UID: \"1257ce19-745b-4d56-b701-9fecd0879315\") " pod="openshift-multus/network-metrics-daemon-x5mvk" Jun 11 18:36:36.774915 ip-10-0-141-55 kubenswrapper[2578]: I0611 18:36:36.774802 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-c4ths\" (UniqueName: \"kubernetes.io/projected/04686d4c-5c3d-49ac-9b61-09e80f5e4dff-kube-api-access-c4ths\") pod \"network-check-target-hjkh2\" (UID: \"04686d4c-5c3d-49ac-9b61-09e80f5e4dff\") " pod="openshift-network-diagnostics/network-check-target-hjkh2" Jun 11 18:36:36.774915 ip-10-0-141-55 kubenswrapper[2578]: I0611 18:36:36.774864 2578 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jun 11 18:36:36.774915 ip-10-0-141-55 kubenswrapper[2578]: I0611 18:36:36.774904 2578 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jun 11 18:36:36.775122 ip-10-0-141-55 kubenswrapper[2578]: I0611 18:36:36.774906 2578 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jun 11 18:36:36.775939 ip-10-0-141-55 kubenswrapper[2578]: I0611 18:36:36.775919 2578 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-141-55.ec2.internal" event="NodeHasSufficientMemory" Jun 11 18:36:36.776060 ip-10-0-141-55 kubenswrapper[2578]: I0611 18:36:36.775950 2578 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-141-55.ec2.internal" event="NodeHasNoDiskPressure" Jun 11 18:36:36.776060 ip-10-0-141-55 kubenswrapper[2578]: I0611 18:36:36.775966 2578 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-141-55.ec2.internal" event="NodeHasSufficientPID" Jun 11 18:36:36.776060 ip-10-0-141-55 kubenswrapper[2578]: I0611 18:36:36.775919 2578 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-141-55.ec2.internal" event="NodeHasSufficientMemory" Jun 11 18:36:36.776060 ip-10-0-141-55 kubenswrapper[2578]: I0611 18:36:36.776035 2578 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-141-55.ec2.internal" event="NodeHasNoDiskPressure" Jun 11 18:36:36.776060 ip-10-0-141-55 kubenswrapper[2578]: I0611 18:36:36.776050 2578 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-141-55.ec2.internal" event="NodeHasSufficientPID" Jun 11 18:36:36.776243 ip-10-0-141-55 kubenswrapper[2578]: E0611 18:36:36.776092 2578 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jun 11 18:36:36.776243 ip-10-0-141-55 kubenswrapper[2578]: I0611 18:36:36.775919 2578 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-141-55.ec2.internal" event="NodeHasSufficientMemory" Jun 11 18:36:36.776243 ip-10-0-141-55 kubenswrapper[2578]: I0611 18:36:36.776139 2578 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-141-55.ec2.internal" event="NodeHasNoDiskPressure" Jun 11 18:36:36.776243 ip-10-0-141-55 kubenswrapper[2578]: I0611 18:36:36.776151 2578 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-141-55.ec2.internal" event="NodeHasSufficientPID" Jun 11 18:36:36.776243 ip-10-0-141-55 kubenswrapper[2578]: E0611 18:36:36.776152 2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/617db869-ee36-4a71-b38e-fd0576c57c9a-original-pull-secret podName:617db869-ee36-4a71-b38e-fd0576c57c9a nodeName:}" failed. No retries permitted until 2026-06-11 18:36:37.776132236 +0000 UTC m=+3.730806825 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/617db869-ee36-4a71-b38e-fd0576c57c9a-original-pull-secret") pod "global-pull-secret-syncer-hffw7" (UID: "617db869-ee36-4a71-b38e-fd0576c57c9a") : object "kube-system"/"original-pull-secret" not registered Jun 11 18:36:36.776243 ip-10-0-141-55 kubenswrapper[2578]: E0611 18:36:36.776178 2578 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jun 11 18:36:36.776243 ip-10-0-141-55 kubenswrapper[2578]: E0611 18:36:36.776193 2578 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jun 11 18:36:36.776243 ip-10-0-141-55 kubenswrapper[2578]: E0611 18:36:36.776204 2578 projected.go:196] Error preparing data for projected volume kube-api-access-c4ths for pod openshift-network-diagnostics/network-check-target-hjkh2: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 11 18:36:36.776243 ip-10-0-141-55 kubenswrapper[2578]: E0611 18:36:36.776228 2578 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jun 11 18:36:36.776535 ip-10-0-141-55 kubenswrapper[2578]: E0611 18:36:36.776260 2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/04686d4c-5c3d-49ac-9b61-09e80f5e4dff-kube-api-access-c4ths podName:04686d4c-5c3d-49ac-9b61-09e80f5e4dff nodeName:}" failed. No retries permitted until 2026-06-11 18:36:37.776242843 +0000 UTC m=+3.730917427 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-api-access-c4ths" (UniqueName: "kubernetes.io/projected/04686d4c-5c3d-49ac-9b61-09e80f5e4dff-kube-api-access-c4ths") pod "network-check-target-hjkh2" (UID: "04686d4c-5c3d-49ac-9b61-09e80f5e4dff") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 11 18:36:36.776535 ip-10-0-141-55 kubenswrapper[2578]: E0611 18:36:36.776281 2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/1257ce19-745b-4d56-b701-9fecd0879315-metrics-certs podName:1257ce19-745b-4d56-b701-9fecd0879315 nodeName:}" failed. No retries permitted until 2026-06-11 18:36:37.776270189 +0000 UTC m=+3.730944779 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/1257ce19-745b-4d56-b701-9fecd0879315-metrics-certs") pod "network-metrics-daemon-x5mvk" (UID: "1257ce19-745b-4d56-b701-9fecd0879315") : object "openshift-multus"/"metrics-daemon-secret" not registered Jun 11 18:36:36.803613 ip-10-0-141-55 kubenswrapper[2578]: E0611 18:36:36.803586 2578 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-141-55.ec2.internal\" not found" Jun 11 18:36:36.904324 ip-10-0-141-55 kubenswrapper[2578]: E0611 18:36:36.904241 2578 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-141-55.ec2.internal\" not found" Jun 11 18:36:37.004841 ip-10-0-141-55 kubenswrapper[2578]: E0611 18:36:37.004809 2578 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-141-55.ec2.internal\" not found" Jun 11 18:36:37.106385 ip-10-0-141-55 kubenswrapper[2578]: E0611 18:36:37.106346 2578 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-141-55.ec2.internal\" not found" Jun 11 18:36:37.146025 ip-10-0-141-55 kubenswrapper[2578]: W0611 18:36:37.145998 2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod418a2cf3_d8f2_412c_8365_ba9c61004229.slice/crio-c2d8932e7db2f2f0ae66a47a16c7e2bb075f79d31f17ead507bc70ac82e46b0e WatchSource:0}: Error finding container c2d8932e7db2f2f0ae66a47a16c7e2bb075f79d31f17ead507bc70ac82e46b0e: Status 404 returned error can't find the container with id c2d8932e7db2f2f0ae66a47a16c7e2bb075f79d31f17ead507bc70ac82e46b0e Jun 11 18:36:37.148284 ip-10-0-141-55 kubenswrapper[2578]: W0611 18:36:37.148243 2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podcd01660e_add6_419b_8f21_9dbd7c1efd86.slice/crio-ab120e8d266298b00ccc8879ee87cb975e391852261fa4e97dbef202130033f3 WatchSource:0}: Error finding container ab120e8d266298b00ccc8879ee87cb975e391852261fa4e97dbef202130033f3: Status 404 returned error can't find the container with id ab120e8d266298b00ccc8879ee87cb975e391852261fa4e97dbef202130033f3 Jun 11 18:36:37.152246 ip-10-0-141-55 kubenswrapper[2578]: W0611 18:36:37.152222 2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0cc2bcd7_3d68_4ebb_9ab5_4529e5485a69.slice/crio-e29eda13d79a37d301f5049d738f015d9b09fadbd5758b7db570143d6b2c692d WatchSource:0}: Error finding container e29eda13d79a37d301f5049d738f015d9b09fadbd5758b7db570143d6b2c692d: Status 404 returned error can't find the container with id e29eda13d79a37d301f5049d738f015d9b09fadbd5758b7db570143d6b2c692d Jun 11 18:36:37.152466 ip-10-0-141-55 kubenswrapper[2578]: W0611 18:36:37.152429 2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd6c0b02b_24e5_4d14_a5bc_07c631277c13.slice/crio-f8ce70d1f738fa163ef6ee3e8c116b4bcd97ff1d3fe7403987bd552cb8fc71e4 WatchSource:0}: Error finding container f8ce70d1f738fa163ef6ee3e8c116b4bcd97ff1d3fe7403987bd552cb8fc71e4: Status 404 returned error can't find the container with id f8ce70d1f738fa163ef6ee3e8c116b4bcd97ff1d3fe7403987bd552cb8fc71e4 Jun 11 18:36:37.153097 ip-10-0-141-55 kubenswrapper[2578]: W0611 18:36:37.153064 2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod984d8be7_df73_433d_8804_d740a26ef757.slice/crio-056ef913de8089463bbff49f7432ff72a263eb40c40b19e79db38d31d7731a56 WatchSource:0}: Error finding container 056ef913de8089463bbff49f7432ff72a263eb40c40b19e79db38d31d7731a56: Status 404 returned error can't find the container with id 056ef913de8089463bbff49f7432ff72a263eb40c40b19e79db38d31d7731a56 Jun 11 18:36:37.154499 ip-10-0-141-55 kubenswrapper[2578]: W0611 18:36:37.154440 2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2cc00ed7_ab6f_4086_ae9c_d5394da96541.slice/crio-51715855b412b6a68d80db25f89d0fc2979f3d5162002dd26d3c937d9653a32d WatchSource:0}: Error finding container 51715855b412b6a68d80db25f89d0fc2979f3d5162002dd26d3c937d9653a32d: Status 404 returned error can't find the container with id 51715855b412b6a68d80db25f89d0fc2979f3d5162002dd26d3c937d9653a32d Jun 11 18:36:37.155407 ip-10-0-141-55 kubenswrapper[2578]: W0611 18:36:37.155387 2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode6233099_5000_4135_a876_b35ae68d8198.slice/crio-80d4b765428580b76c207c6f9ec70dc4f43a76376b5a0e0487a6131bcba52700 WatchSource:0}: Error finding container 80d4b765428580b76c207c6f9ec70dc4f43a76376b5a0e0487a6131bcba52700: Status 404 returned error can't find the container with id 80d4b765428580b76c207c6f9ec70dc4f43a76376b5a0e0487a6131bcba52700 Jun 11 18:36:37.156603 ip-10-0-141-55 kubenswrapper[2578]: W0611 18:36:37.156574 2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8b02eb7c_e526_4079_b139_e46f4626d3e5.slice/crio-1e46c02eae75bc4c38872291367810b1788db264dde153fef67210652b84336d WatchSource:0}: Error finding container 1e46c02eae75bc4c38872291367810b1788db264dde153fef67210652b84336d: Status 404 returned error can't find the container with id 1e46c02eae75bc4c38872291367810b1788db264dde153fef67210652b84336d Jun 11 18:36:37.157260 ip-10-0-141-55 kubenswrapper[2578]: W0611 18:36:37.156949 2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod50f4744a_788a_47dd_8fa7_321eaaad1b53.slice/crio-7f22bef0966fe26e3d9f7c4138c86d10def71fe0c84fb679011c38fe7a63812c WatchSource:0}: Error finding container 7f22bef0966fe26e3d9f7c4138c86d10def71fe0c84fb679011c38fe7a63812c: Status 404 returned error can't find the container with id 7f22bef0966fe26e3d9f7c4138c86d10def71fe0c84fb679011c38fe7a63812c Jun 11 18:36:37.171922 ip-10-0-141-55 kubenswrapper[2578]: I0611 18:36:37.171902 2578 reflector.go:439] "Caches populated" type="*v1.Service" reflector="k8s.io/client-go/informers/factory.go:160" Jun 11 18:36:37.206578 ip-10-0-141-55 kubenswrapper[2578]: E0611 18:36:37.206419 2578 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-141-55.ec2.internal\" not found" Jun 11 18:36:37.306995 ip-10-0-141-55 kubenswrapper[2578]: E0611 18:36:37.306962 2578 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-141-55.ec2.internal\" not found" Jun 11 18:36:37.407409 ip-10-0-141-55 kubenswrapper[2578]: E0611 18:36:37.407389 2578 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-141-55.ec2.internal\" not found" Jun 11 18:36:37.415712 ip-10-0-141-55 kubenswrapper[2578]: I0611 18:36:37.415694 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-hjkh2" Jun 11 18:36:37.415793 ip-10-0-141-55 kubenswrapper[2578]: I0611 18:36:37.415730 2578 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jun 11 18:36:37.416571 ip-10-0-141-55 kubenswrapper[2578]: I0611 18:36:37.416534 2578 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-141-55.ec2.internal" event="NodeHasSufficientMemory" Jun 11 18:36:37.416647 ip-10-0-141-55 kubenswrapper[2578]: I0611 18:36:37.416591 2578 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-141-55.ec2.internal" event="NodeHasNoDiskPressure" Jun 11 18:36:37.416647 ip-10-0-141-55 kubenswrapper[2578]: I0611 18:36:37.416607 2578 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-141-55.ec2.internal" event="NodeHasSufficientPID" Jun 11 18:36:37.416786 ip-10-0-141-55 kubenswrapper[2578]: E0611 18:36:37.416768 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-hjkh2" podUID="04686d4c-5c3d-49ac-9b61-09e80f5e4dff" Jun 11 18:36:37.424594 ip-10-0-141-55 kubenswrapper[2578]: I0611 18:36:37.424531 2578 generic.go:356] "Generic (PLEG): container finished" podID="a7e51dec29aa10b42d4127d190b80186" containerID="9cf83f0f0c4d269284c1ed5502a64a5122fbbdba4d0e0de8286ba1083a23a197" exitCode=0 Jun 11 18:36:37.424676 ip-10-0-141-55 kubenswrapper[2578]: I0611 18:36:37.424590 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-141-55.ec2.internal" event={"ID":"a7e51dec29aa10b42d4127d190b80186","Type":"ContainerDied","Data":"9cf83f0f0c4d269284c1ed5502a64a5122fbbdba4d0e0de8286ba1083a23a197"} Jun 11 18:36:37.424676 ip-10-0-141-55 kubenswrapper[2578]: I0611 18:36:37.424635 2578 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jun 11 18:36:37.425260 ip-10-0-141-55 kubenswrapper[2578]: I0611 18:36:37.425245 2578 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-141-55.ec2.internal" event="NodeHasSufficientMemory" Jun 11 18:36:37.425260 ip-10-0-141-55 kubenswrapper[2578]: I0611 18:36:37.425270 2578 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-141-55.ec2.internal" event="NodeHasNoDiskPressure" Jun 11 18:36:37.425384 ip-10-0-141-55 kubenswrapper[2578]: I0611 18:36:37.425285 2578 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-141-55.ec2.internal" event="NodeHasSufficientPID" Jun 11 18:36:37.425516 ip-10-0-141-55 kubenswrapper[2578]: E0611 18:36:37.425500 2578 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-141-55.ec2.internal\" not found" node="ip-10-0-141-55.ec2.internal" Jun 11 18:36:37.426055 ip-10-0-141-55 kubenswrapper[2578]: I0611 18:36:37.426037 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-141-55.ec2.internal" event={"ID":"668e0dfb5ee3fc6875806e2b3acb31d7","Type":"ContainerStarted","Data":"4bfdca6597f052415234c5f47bac8ca1c6a37f7815c03c7b4ad7bdea9b4d14a9"} Jun 11 18:36:37.426124 ip-10-0-141-55 kubenswrapper[2578]: I0611 18:36:37.426060 2578 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jun 11 18:36:37.426743 ip-10-0-141-55 kubenswrapper[2578]: I0611 18:36:37.426719 2578 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-141-55.ec2.internal" event="NodeHasSufficientMemory" Jun 11 18:36:37.426821 ip-10-0-141-55 kubenswrapper[2578]: I0611 18:36:37.426753 2578 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-141-55.ec2.internal" event="NodeHasNoDiskPressure" Jun 11 18:36:37.426821 ip-10-0-141-55 kubenswrapper[2578]: I0611 18:36:37.426767 2578 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-141-55.ec2.internal" event="NodeHasSufficientPID" Jun 11 18:36:37.426980 ip-10-0-141-55 kubenswrapper[2578]: E0611 18:36:37.426967 2578 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-141-55.ec2.internal\" not found" node="ip-10-0-141-55.ec2.internal" Jun 11 18:36:37.427308 ip-10-0-141-55 kubenswrapper[2578]: I0611 18:36:37.427286 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-zlzks" event={"ID":"8b02eb7c-e526-4079-b139-e46f4626d3e5","Type":"ContainerStarted","Data":"1e46c02eae75bc4c38872291367810b1788db264dde153fef67210652b84336d"} Jun 11 18:36:37.430312 ip-10-0-141-55 kubenswrapper[2578]: I0611 18:36:37.430292 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-qc45v" event={"ID":"2cc00ed7-ab6f-4086-ae9c-d5394da96541","Type":"ContainerStarted","Data":"51715855b412b6a68d80db25f89d0fc2979f3d5162002dd26d3c937d9653a32d"} Jun 11 18:36:37.431591 ip-10-0-141-55 kubenswrapper[2578]: I0611 18:36:37.431572 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-vcdjb" event={"ID":"984d8be7-df73-433d-8804-d740a26ef757","Type":"ContainerStarted","Data":"056ef913de8089463bbff49f7432ff72a263eb40c40b19e79db38d31d7731a56"} Jun 11 18:36:37.432635 ip-10-0-141-55 kubenswrapper[2578]: I0611 18:36:37.432616 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-2qbtj" event={"ID":"d6c0b02b-24e5-4d14-a5bc-07c631277c13","Type":"ContainerStarted","Data":"f8ce70d1f738fa163ef6ee3e8c116b4bcd97ff1d3fe7403987bd552cb8fc71e4"} Jun 11 18:36:37.433663 ip-10-0-141-55 kubenswrapper[2578]: I0611 18:36:37.433643 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-ffv42" event={"ID":"0cc2bcd7-3d68-4ebb-9ab5-4529e5485a69","Type":"ContainerStarted","Data":"e29eda13d79a37d301f5049d738f015d9b09fadbd5758b7db570143d6b2c692d"} Jun 11 18:36:37.434690 ip-10-0-141-55 kubenswrapper[2578]: I0611 18:36:37.434669 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-9ld8n" event={"ID":"50f4744a-788a-47dd-8fa7-321eaaad1b53","Type":"ContainerStarted","Data":"7f22bef0966fe26e3d9f7c4138c86d10def71fe0c84fb679011c38fe7a63812c"} Jun 11 18:36:37.435876 ip-10-0-141-55 kubenswrapper[2578]: I0611 18:36:37.435850 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-m7sgm" event={"ID":"e6233099-5000-4135-a876-b35ae68d8198","Type":"ContainerStarted","Data":"80d4b765428580b76c207c6f9ec70dc4f43a76376b5a0e0487a6131bcba52700"} Jun 11 18:36:37.436946 ip-10-0-141-55 kubenswrapper[2578]: I0611 18:36:37.436925 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-jttqf" event={"ID":"cd01660e-add6-419b-8f21-9dbd7c1efd86","Type":"ContainerStarted","Data":"ab120e8d266298b00ccc8879ee87cb975e391852261fa4e97dbef202130033f3"} Jun 11 18:36:37.437822 ip-10-0-141-55 kubenswrapper[2578]: I0611 18:36:37.437801 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-kkqxh" event={"ID":"418a2cf3-d8f2-412c-8365-ba9c61004229","Type":"ContainerStarted","Data":"c2d8932e7db2f2f0ae66a47a16c7e2bb075f79d31f17ead507bc70ac82e46b0e"} Jun 11 18:36:37.508011 ip-10-0-141-55 kubenswrapper[2578]: E0611 18:36:37.507973 2578 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-141-55.ec2.internal\" not found" Jun 11 18:36:37.608120 ip-10-0-141-55 kubenswrapper[2578]: E0611 18:36:37.608085 2578 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-141-55.ec2.internal\" not found" Jun 11 18:36:37.709265 ip-10-0-141-55 kubenswrapper[2578]: E0611 18:36:37.709166 2578 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-141-55.ec2.internal\" not found" Jun 11 18:36:37.784804 ip-10-0-141-55 kubenswrapper[2578]: I0611 18:36:37.784226 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-c4ths\" (UniqueName: \"kubernetes.io/projected/04686d4c-5c3d-49ac-9b61-09e80f5e4dff-kube-api-access-c4ths\") pod \"network-check-target-hjkh2\" (UID: \"04686d4c-5c3d-49ac-9b61-09e80f5e4dff\") " pod="openshift-network-diagnostics/network-check-target-hjkh2" Jun 11 18:36:37.784804 ip-10-0-141-55 kubenswrapper[2578]: I0611 18:36:37.784299 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/617db869-ee36-4a71-b38e-fd0576c57c9a-original-pull-secret\") pod \"global-pull-secret-syncer-hffw7\" (UID: \"617db869-ee36-4a71-b38e-fd0576c57c9a\") " pod="kube-system/global-pull-secret-syncer-hffw7" Jun 11 18:36:37.784804 ip-10-0-141-55 kubenswrapper[2578]: I0611 18:36:37.784330 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/1257ce19-745b-4d56-b701-9fecd0879315-metrics-certs\") pod \"network-metrics-daemon-x5mvk\" (UID: \"1257ce19-745b-4d56-b701-9fecd0879315\") " pod="openshift-multus/network-metrics-daemon-x5mvk" Jun 11 18:36:37.784804 ip-10-0-141-55 kubenswrapper[2578]: I0611 18:36:37.784437 2578 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jun 11 18:36:37.784804 ip-10-0-141-55 kubenswrapper[2578]: I0611 18:36:37.784537 2578 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jun 11 18:36:37.784804 ip-10-0-141-55 kubenswrapper[2578]: I0611 18:36:37.784605 2578 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jun 11 18:36:37.789084 ip-10-0-141-55 kubenswrapper[2578]: I0611 18:36:37.787777 2578 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-141-55.ec2.internal" event="NodeHasSufficientMemory" Jun 11 18:36:37.789084 ip-10-0-141-55 kubenswrapper[2578]: I0611 18:36:37.787814 2578 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-141-55.ec2.internal" event="NodeHasNoDiskPressure" Jun 11 18:36:37.789084 ip-10-0-141-55 kubenswrapper[2578]: I0611 18:36:37.787837 2578 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-141-55.ec2.internal" event="NodeHasSufficientPID" Jun 11 18:36:37.789084 ip-10-0-141-55 kubenswrapper[2578]: E0611 18:36:37.787965 2578 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jun 11 18:36:37.789084 ip-10-0-141-55 kubenswrapper[2578]: E0611 18:36:37.788017 2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/1257ce19-745b-4d56-b701-9fecd0879315-metrics-certs podName:1257ce19-745b-4d56-b701-9fecd0879315 nodeName:}" failed. No retries permitted until 2026-06-11 18:36:39.787997489 +0000 UTC m=+5.742672077 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/1257ce19-745b-4d56-b701-9fecd0879315-metrics-certs") pod "network-metrics-daemon-x5mvk" (UID: "1257ce19-745b-4d56-b701-9fecd0879315") : object "openshift-multus"/"metrics-daemon-secret" not registered Jun 11 18:36:37.789084 ip-10-0-141-55 kubenswrapper[2578]: I0611 18:36:37.788622 2578 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-141-55.ec2.internal" event="NodeHasSufficientMemory" Jun 11 18:36:37.789084 ip-10-0-141-55 kubenswrapper[2578]: I0611 18:36:37.788647 2578 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-141-55.ec2.internal" event="NodeHasNoDiskPressure" Jun 11 18:36:37.789084 ip-10-0-141-55 kubenswrapper[2578]: I0611 18:36:37.788661 2578 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-141-55.ec2.internal" event="NodeHasSufficientPID" Jun 11 18:36:37.789084 ip-10-0-141-55 kubenswrapper[2578]: E0611 18:36:37.788787 2578 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jun 11 18:36:37.789084 ip-10-0-141-55 kubenswrapper[2578]: E0611 18:36:37.788804 2578 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jun 11 18:36:37.789084 ip-10-0-141-55 kubenswrapper[2578]: E0611 18:36:37.788816 2578 projected.go:196] Error preparing data for projected volume kube-api-access-c4ths for pod openshift-network-diagnostics/network-check-target-hjkh2: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 11 18:36:37.789084 ip-10-0-141-55 kubenswrapper[2578]: E0611 18:36:37.788857 2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/04686d4c-5c3d-49ac-9b61-09e80f5e4dff-kube-api-access-c4ths podName:04686d4c-5c3d-49ac-9b61-09e80f5e4dff nodeName:}" failed. No retries permitted until 2026-06-11 18:36:39.78884228 +0000 UTC m=+5.743516880 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-api-access-c4ths" (UniqueName: "kubernetes.io/projected/04686d4c-5c3d-49ac-9b61-09e80f5e4dff-kube-api-access-c4ths") pod "network-check-target-hjkh2" (UID: "04686d4c-5c3d-49ac-9b61-09e80f5e4dff") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 11 18:36:37.789084 ip-10-0-141-55 kubenswrapper[2578]: I0611 18:36:37.788913 2578 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-141-55.ec2.internal" event="NodeHasSufficientMemory" Jun 11 18:36:37.789084 ip-10-0-141-55 kubenswrapper[2578]: I0611 18:36:37.788929 2578 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-141-55.ec2.internal" event="NodeHasNoDiskPressure" Jun 11 18:36:37.789084 ip-10-0-141-55 kubenswrapper[2578]: I0611 18:36:37.788941 2578 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-141-55.ec2.internal" event="NodeHasSufficientPID" Jun 11 18:36:37.789084 ip-10-0-141-55 kubenswrapper[2578]: E0611 18:36:37.789015 2578 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jun 11 18:36:37.789084 ip-10-0-141-55 kubenswrapper[2578]: E0611 18:36:37.789047 2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/617db869-ee36-4a71-b38e-fd0576c57c9a-original-pull-secret podName:617db869-ee36-4a71-b38e-fd0576c57c9a nodeName:}" failed. No retries permitted until 2026-06-11 18:36:39.789035519 +0000 UTC m=+5.743710105 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/617db869-ee36-4a71-b38e-fd0576c57c9a-original-pull-secret") pod "global-pull-secret-syncer-hffw7" (UID: "617db869-ee36-4a71-b38e-fd0576c57c9a") : object "kube-system"/"original-pull-secret" not registered Jun 11 18:36:37.810061 ip-10-0-141-55 kubenswrapper[2578]: E0611 18:36:37.810019 2578 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-141-55.ec2.internal\" not found" Jun 11 18:36:37.910153 ip-10-0-141-55 kubenswrapper[2578]: E0611 18:36:37.910097 2578 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-141-55.ec2.internal\" not found" Jun 11 18:36:38.010305 ip-10-0-141-55 kubenswrapper[2578]: E0611 18:36:38.010220 2578 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-141-55.ec2.internal\" not found" Jun 11 18:36:38.110811 ip-10-0-141-55 kubenswrapper[2578]: E0611 18:36:38.110774 2578 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-141-55.ec2.internal\" not found" Jun 11 18:36:38.211168 ip-10-0-141-55 kubenswrapper[2578]: E0611 18:36:38.211136 2578 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-141-55.ec2.internal\" not found" Jun 11 18:36:38.304157 ip-10-0-141-55 kubenswrapper[2578]: I0611 18:36:38.304080 2578 reflector.go:439] "Caches populated" type="*v1.Node" reflector="k8s.io/client-go/informers/factory.go:160" Jun 11 18:36:38.349585 ip-10-0-141-55 kubenswrapper[2578]: I0611 18:36:38.349327 2578 kubelet.go:3248] "Creating a mirror pod for static pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-141-55.ec2.internal" Jun 11 18:36:38.350039 ip-10-0-141-55 kubenswrapper[2578]: I0611 18:36:38.349599 2578 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kubelet-serving" Jun 11 18:36:38.363063 ip-10-0-141-55 kubenswrapper[2578]: I0611 18:36:38.362200 2578 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]" Jun 11 18:36:38.363063 ip-10-0-141-55 kubenswrapper[2578]: I0611 18:36:38.362290 2578 kubelet.go:3248] "Creating a mirror pod for static pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-141-55.ec2.internal" Jun 11 18:36:38.363063 ip-10-0-141-55 kubenswrapper[2578]: I0611 18:36:38.362971 2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-141-55.ec2.internal"] Jun 11 18:36:38.364674 ip-10-0-141-55 kubenswrapper[2578]: I0611 18:36:38.364650 2578 reflector.go:439] "Caches populated" logger="kubernetes.io/kubelet-serving" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162" Jun 11 18:36:38.371079 ip-10-0-141-55 kubenswrapper[2578]: I0611 18:36:38.370931 2578 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]" Jun 11 18:36:38.371915 ip-10-0-141-55 kubenswrapper[2578]: I0611 18:36:38.371896 2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kube-system/kube-apiserver-proxy-ip-10-0-141-55.ec2.internal"] Jun 11 18:36:38.385045 ip-10-0-141-55 kubenswrapper[2578]: I0611 18:36:38.385025 2578 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kubelet-serving" csr="csr-p4dmf" Jun 11 18:36:38.391896 ip-10-0-141-55 kubenswrapper[2578]: I0611 18:36:38.391486 2578 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kubelet-serving" csr="csr-p4dmf" Jun 11 18:36:38.416933 ip-10-0-141-55 kubenswrapper[2578]: I0611 18:36:38.416462 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-x5mvk" Jun 11 18:36:38.416933 ip-10-0-141-55 kubenswrapper[2578]: E0611 18:36:38.416610 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-x5mvk" podUID="1257ce19-745b-4d56-b701-9fecd0879315" Jun 11 18:36:38.466131 ip-10-0-141-55 kubenswrapper[2578]: I0611 18:36:38.466103 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-machine-config-operator_kube-rbac-proxy-crio-ip-10-0-141-55.ec2.internal_a7e51dec29aa10b42d4127d190b80186/kube-rbac-proxy-crio/0.log" Jun 11 18:36:38.467335 ip-10-0-141-55 kubenswrapper[2578]: I0611 18:36:38.467305 2578 generic.go:356] "Generic (PLEG): container finished" podID="a7e51dec29aa10b42d4127d190b80186" containerID="13abfbf8cd9855336aa8927e2c4388ea735dae65987d3ac22274f35400f37e9c" exitCode=1 Jun 11 18:36:38.467472 ip-10-0-141-55 kubenswrapper[2578]: I0611 18:36:38.467450 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-141-55.ec2.internal" event={"ID":"a7e51dec29aa10b42d4127d190b80186","Type":"ContainerDied","Data":"13abfbf8cd9855336aa8927e2c4388ea735dae65987d3ac22274f35400f37e9c"} Jun 11 18:36:38.467656 ip-10-0-141-55 kubenswrapper[2578]: I0611 18:36:38.467630 2578 kubelet.go:3248] "Creating a mirror pod for static pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-141-55.ec2.internal" Jun 11 18:36:38.467748 ip-10-0-141-55 kubenswrapper[2578]: I0611 18:36:38.467732 2578 kubelet.go:3248] "Creating a mirror pod for static pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-141-55.ec2.internal" Jun 11 18:36:38.477708 ip-10-0-141-55 kubenswrapper[2578]: I0611 18:36:38.477688 2578 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]" Jun 11 18:36:38.477827 ip-10-0-141-55 kubenswrapper[2578]: E0611 18:36:38.477739 2578 kubelet.go:3250] "Failed creating a mirror pod" err="pods \"kube-apiserver-proxy-ip-10-0-141-55.ec2.internal\" already exists" pod="kube-system/kube-apiserver-proxy-ip-10-0-141-55.ec2.internal" Jun 11 18:36:38.478270 ip-10-0-141-55 kubenswrapper[2578]: I0611 18:36:38.478253 2578 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]" Jun 11 18:36:38.478356 ip-10-0-141-55 kubenswrapper[2578]: E0611 18:36:38.478294 2578 kubelet.go:3250] "Failed creating a mirror pod" err="pods \"kube-rbac-proxy-crio-ip-10-0-141-55.ec2.internal\" already exists" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-141-55.ec2.internal" Jun 11 18:36:38.478413 ip-10-0-141-55 kubenswrapper[2578]: I0611 18:36:38.478373 2578 scope.go:117] "RemoveContainer" containerID="13abfbf8cd9855336aa8927e2c4388ea735dae65987d3ac22274f35400f37e9c" Jun 11 18:36:39.394190 ip-10-0-141-55 kubenswrapper[2578]: I0611 18:36:39.394118 2578 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-06-10 18:31:38 +0000 UTC" deadline="2027-11-28 15:26:08.146817854 +0000 UTC" Jun 11 18:36:39.394190 ip-10-0-141-55 kubenswrapper[2578]: I0611 18:36:39.394169 2578 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="12836h49m28.752653633s" Jun 11 18:36:39.415959 ip-10-0-141-55 kubenswrapper[2578]: I0611 18:36:39.415928 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-hjkh2" Jun 11 18:36:39.416111 ip-10-0-141-55 kubenswrapper[2578]: E0611 18:36:39.416058 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-hjkh2" podUID="04686d4c-5c3d-49ac-9b61-09e80f5e4dff" Jun 11 18:36:39.488442 ip-10-0-141-55 kubenswrapper[2578]: I0611 18:36:39.488324 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-machine-config-operator_kube-rbac-proxy-crio-ip-10-0-141-55.ec2.internal_a7e51dec29aa10b42d4127d190b80186/kube-rbac-proxy-crio/0.log" Jun 11 18:36:39.493770 ip-10-0-141-55 kubenswrapper[2578]: I0611 18:36:39.493692 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-141-55.ec2.internal" event={"ID":"a7e51dec29aa10b42d4127d190b80186","Type":"ContainerStarted","Data":"c5775bb3c9b7835c75126ffaa2dc009555290c9d6696a45e20e426e30dfbedbd"} Jun 11 18:36:39.510602 ip-10-0-141-55 kubenswrapper[2578]: I0611 18:36:39.510536 2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/kube-apiserver-proxy-ip-10-0-141-55.ec2.internal" podStartSLOduration=1.51051718 podStartE2EDuration="1.51051718s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-11 18:36:38 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-11 18:36:38.501672276 +0000 UTC m=+4.456346883" watchObservedRunningTime="2026-06-11 18:36:39.51051718 +0000 UTC m=+5.465191787" Jun 11 18:36:39.800684 ip-10-0-141-55 kubenswrapper[2578]: I0611 18:36:39.800608 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-c4ths\" (UniqueName: \"kubernetes.io/projected/04686d4c-5c3d-49ac-9b61-09e80f5e4dff-kube-api-access-c4ths\") pod \"network-check-target-hjkh2\" (UID: \"04686d4c-5c3d-49ac-9b61-09e80f5e4dff\") " pod="openshift-network-diagnostics/network-check-target-hjkh2" Jun 11 18:36:39.800684 ip-10-0-141-55 kubenswrapper[2578]: I0611 18:36:39.800672 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/617db869-ee36-4a71-b38e-fd0576c57c9a-original-pull-secret\") pod \"global-pull-secret-syncer-hffw7\" (UID: \"617db869-ee36-4a71-b38e-fd0576c57c9a\") " pod="kube-system/global-pull-secret-syncer-hffw7" Jun 11 18:36:39.800882 ip-10-0-141-55 kubenswrapper[2578]: I0611 18:36:39.800701 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/1257ce19-745b-4d56-b701-9fecd0879315-metrics-certs\") pod \"network-metrics-daemon-x5mvk\" (UID: \"1257ce19-745b-4d56-b701-9fecd0879315\") " pod="openshift-multus/network-metrics-daemon-x5mvk" Jun 11 18:36:39.800882 ip-10-0-141-55 kubenswrapper[2578]: E0611 18:36:39.800856 2578 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jun 11 18:36:39.800983 ip-10-0-141-55 kubenswrapper[2578]: E0611 18:36:39.800912 2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/1257ce19-745b-4d56-b701-9fecd0879315-metrics-certs podName:1257ce19-745b-4d56-b701-9fecd0879315 nodeName:}" failed. No retries permitted until 2026-06-11 18:36:43.800895468 +0000 UTC m=+9.755570056 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/1257ce19-745b-4d56-b701-9fecd0879315-metrics-certs") pod "network-metrics-daemon-x5mvk" (UID: "1257ce19-745b-4d56-b701-9fecd0879315") : object "openshift-multus"/"metrics-daemon-secret" not registered Jun 11 18:36:39.801285 ip-10-0-141-55 kubenswrapper[2578]: E0611 18:36:39.801267 2578 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jun 11 18:36:39.801375 ip-10-0-141-55 kubenswrapper[2578]: E0611 18:36:39.801310 2578 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jun 11 18:36:39.801375 ip-10-0-141-55 kubenswrapper[2578]: E0611 18:36:39.801327 2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/617db869-ee36-4a71-b38e-fd0576c57c9a-original-pull-secret podName:617db869-ee36-4a71-b38e-fd0576c57c9a nodeName:}" failed. No retries permitted until 2026-06-11 18:36:43.801310642 +0000 UTC m=+9.755985227 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/617db869-ee36-4a71-b38e-fd0576c57c9a-original-pull-secret") pod "global-pull-secret-syncer-hffw7" (UID: "617db869-ee36-4a71-b38e-fd0576c57c9a") : object "kube-system"/"original-pull-secret" not registered Jun 11 18:36:39.801375 ip-10-0-141-55 kubenswrapper[2578]: E0611 18:36:39.801331 2578 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jun 11 18:36:39.801375 ip-10-0-141-55 kubenswrapper[2578]: E0611 18:36:39.801347 2578 projected.go:196] Error preparing data for projected volume kube-api-access-c4ths for pod openshift-network-diagnostics/network-check-target-hjkh2: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 11 18:36:39.801585 ip-10-0-141-55 kubenswrapper[2578]: E0611 18:36:39.801389 2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/04686d4c-5c3d-49ac-9b61-09e80f5e4dff-kube-api-access-c4ths podName:04686d4c-5c3d-49ac-9b61-09e80f5e4dff nodeName:}" failed. No retries permitted until 2026-06-11 18:36:43.801375343 +0000 UTC m=+9.756049932 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-api-access-c4ths" (UniqueName: "kubernetes.io/projected/04686d4c-5c3d-49ac-9b61-09e80f5e4dff-kube-api-access-c4ths") pod "network-check-target-hjkh2" (UID: "04686d4c-5c3d-49ac-9b61-09e80f5e4dff") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 11 18:36:40.395408 ip-10-0-141-55 kubenswrapper[2578]: I0611 18:36:40.395361 2578 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-06-10 18:31:38 +0000 UTC" deadline="2027-11-13 01:10:18.889568151 +0000 UTC" Jun 11 18:36:40.395408 ip-10-0-141-55 kubenswrapper[2578]: I0611 18:36:40.395407 2578 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="12462h33m38.494167365s" Jun 11 18:36:40.415745 ip-10-0-141-55 kubenswrapper[2578]: I0611 18:36:40.415694 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-x5mvk" Jun 11 18:36:40.416008 ip-10-0-141-55 kubenswrapper[2578]: E0611 18:36:40.415829 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-x5mvk" podUID="1257ce19-745b-4d56-b701-9fecd0879315" Jun 11 18:36:41.415374 ip-10-0-141-55 kubenswrapper[2578]: I0611 18:36:41.415344 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-hjkh2" Jun 11 18:36:41.415851 ip-10-0-141-55 kubenswrapper[2578]: E0611 18:36:41.415469 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-hjkh2" podUID="04686d4c-5c3d-49ac-9b61-09e80f5e4dff" Jun 11 18:36:42.416330 ip-10-0-141-55 kubenswrapper[2578]: I0611 18:36:42.416300 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-x5mvk" Jun 11 18:36:42.416772 ip-10-0-141-55 kubenswrapper[2578]: E0611 18:36:42.416442 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-x5mvk" podUID="1257ce19-745b-4d56-b701-9fecd0879315" Jun 11 18:36:43.415821 ip-10-0-141-55 kubenswrapper[2578]: I0611 18:36:43.415788 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-hjkh2" Jun 11 18:36:43.415956 ip-10-0-141-55 kubenswrapper[2578]: E0611 18:36:43.415906 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-hjkh2" podUID="04686d4c-5c3d-49ac-9b61-09e80f5e4dff" Jun 11 18:36:43.830833 ip-10-0-141-55 kubenswrapper[2578]: I0611 18:36:43.830711 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/617db869-ee36-4a71-b38e-fd0576c57c9a-original-pull-secret\") pod \"global-pull-secret-syncer-hffw7\" (UID: \"617db869-ee36-4a71-b38e-fd0576c57c9a\") " pod="kube-system/global-pull-secret-syncer-hffw7" Jun 11 18:36:43.830833 ip-10-0-141-55 kubenswrapper[2578]: I0611 18:36:43.830762 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/1257ce19-745b-4d56-b701-9fecd0879315-metrics-certs\") pod \"network-metrics-daemon-x5mvk\" (UID: \"1257ce19-745b-4d56-b701-9fecd0879315\") " pod="openshift-multus/network-metrics-daemon-x5mvk" Jun 11 18:36:43.830833 ip-10-0-141-55 kubenswrapper[2578]: I0611 18:36:43.830811 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-c4ths\" (UniqueName: \"kubernetes.io/projected/04686d4c-5c3d-49ac-9b61-09e80f5e4dff-kube-api-access-c4ths\") pod \"network-check-target-hjkh2\" (UID: \"04686d4c-5c3d-49ac-9b61-09e80f5e4dff\") " pod="openshift-network-diagnostics/network-check-target-hjkh2" Jun 11 18:36:43.831366 ip-10-0-141-55 kubenswrapper[2578]: E0611 18:36:43.830958 2578 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jun 11 18:36:43.831366 ip-10-0-141-55 kubenswrapper[2578]: E0611 18:36:43.830982 2578 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jun 11 18:36:43.831366 ip-10-0-141-55 kubenswrapper[2578]: E0611 18:36:43.830993 2578 projected.go:196] Error preparing data for projected volume kube-api-access-c4ths for pod openshift-network-diagnostics/network-check-target-hjkh2: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 11 18:36:43.831366 ip-10-0-141-55 kubenswrapper[2578]: E0611 18:36:43.831052 2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/04686d4c-5c3d-49ac-9b61-09e80f5e4dff-kube-api-access-c4ths podName:04686d4c-5c3d-49ac-9b61-09e80f5e4dff nodeName:}" failed. No retries permitted until 2026-06-11 18:36:51.831033766 +0000 UTC m=+17.785708369 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-api-access-c4ths" (UniqueName: "kubernetes.io/projected/04686d4c-5c3d-49ac-9b61-09e80f5e4dff-kube-api-access-c4ths") pod "network-check-target-hjkh2" (UID: "04686d4c-5c3d-49ac-9b61-09e80f5e4dff") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 11 18:36:43.831366 ip-10-0-141-55 kubenswrapper[2578]: E0611 18:36:43.831353 2578 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jun 11 18:36:43.831639 ip-10-0-141-55 kubenswrapper[2578]: E0611 18:36:43.831428 2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/1257ce19-745b-4d56-b701-9fecd0879315-metrics-certs podName:1257ce19-745b-4d56-b701-9fecd0879315 nodeName:}" failed. No retries permitted until 2026-06-11 18:36:51.831410476 +0000 UTC m=+17.786085062 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/1257ce19-745b-4d56-b701-9fecd0879315-metrics-certs") pod "network-metrics-daemon-x5mvk" (UID: "1257ce19-745b-4d56-b701-9fecd0879315") : object "openshift-multus"/"metrics-daemon-secret" not registered Jun 11 18:36:43.831639 ip-10-0-141-55 kubenswrapper[2578]: E0611 18:36:43.831452 2578 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jun 11 18:36:43.831639 ip-10-0-141-55 kubenswrapper[2578]: E0611 18:36:43.831505 2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/617db869-ee36-4a71-b38e-fd0576c57c9a-original-pull-secret podName:617db869-ee36-4a71-b38e-fd0576c57c9a nodeName:}" failed. No retries permitted until 2026-06-11 18:36:51.831489889 +0000 UTC m=+17.786164475 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/617db869-ee36-4a71-b38e-fd0576c57c9a-original-pull-secret") pod "global-pull-secret-syncer-hffw7" (UID: "617db869-ee36-4a71-b38e-fd0576c57c9a") : object "kube-system"/"original-pull-secret" not registered Jun 11 18:36:44.416698 ip-10-0-141-55 kubenswrapper[2578]: I0611 18:36:44.416522 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-x5mvk" Jun 11 18:36:44.416698 ip-10-0-141-55 kubenswrapper[2578]: E0611 18:36:44.416663 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-x5mvk" podUID="1257ce19-745b-4d56-b701-9fecd0879315" Jun 11 18:36:44.430232 ip-10-0-141-55 kubenswrapper[2578]: I0611 18:36:44.430171 2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-141-55.ec2.internal" podStartSLOduration=6.430152493 podStartE2EDuration="6.430152493s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-11 18:36:38 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-11 18:36:39.511344189 +0000 UTC m=+5.466018796" watchObservedRunningTime="2026-06-11 18:36:44.430152493 +0000 UTC m=+10.384827186" Jun 11 18:36:44.441654 ip-10-0-141-55 kubenswrapper[2578]: I0611 18:36:44.441625 2578 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kube-system/global-pull-secret-syncer-hffw7"] Jun 11 18:36:44.441798 ip-10-0-141-55 kubenswrapper[2578]: I0611 18:36:44.441739 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-hffw7" Jun 11 18:36:44.445413 ip-10-0-141-55 kubenswrapper[2578]: I0611 18:36:44.445389 2578 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kube-system/global-pull-secret-syncer-hffw7"] Jun 11 18:36:44.447883 ip-10-0-141-55 kubenswrapper[2578]: E0611 18:36:44.447849 2578 status_manager.go:1018] "Failed to get status for pod" err="pods \"global-pull-secret-syncer-hffw7\" is forbidden: User \"system:node:ip-10-0-141-55.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kube-system\": no relationship found between node 'ip-10-0-141-55.ec2.internal' and this object" podUID="617db869-ee36-4a71-b38e-fd0576c57c9a" pod="kube-system/global-pull-secret-syncer-hffw7" Jun 11 18:36:44.470287 ip-10-0-141-55 kubenswrapper[2578]: I0611 18:36:44.470255 2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kube-system/global-pull-secret-syncer-lvmjk"] Jun 11 18:36:44.476573 ip-10-0-141-55 kubenswrapper[2578]: I0611 18:36:44.476538 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-lvmjk" Jun 11 18:36:44.476724 ip-10-0-141-55 kubenswrapper[2578]: E0611 18:36:44.476694 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-lvmjk" podUID="1261112f-ce68-462a-a73e-fa1942159096" Jun 11 18:36:44.478989 ip-10-0-141-55 kubenswrapper[2578]: E0611 18:36:44.478948 2578 status_manager.go:1018] "Failed to get status for pod" err="pods \"global-pull-secret-syncer-hffw7\" is forbidden: User \"system:node:ip-10-0-141-55.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kube-system\": no relationship found between node 'ip-10-0-141-55.ec2.internal' and this object" podUID="617db869-ee36-4a71-b38e-fd0576c57c9a" pod="kube-system/global-pull-secret-syncer-hffw7" Jun 11 18:36:44.535998 ip-10-0-141-55 kubenswrapper[2578]: I0611 18:36:44.535577 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/1261112f-ce68-462a-a73e-fa1942159096-kubelet-config\") pod \"global-pull-secret-syncer-lvmjk\" (UID: \"1261112f-ce68-462a-a73e-fa1942159096\") " pod="kube-system/global-pull-secret-syncer-lvmjk" Jun 11 18:36:44.536217 ip-10-0-141-55 kubenswrapper[2578]: I0611 18:36:44.536195 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/1261112f-ce68-462a-a73e-fa1942159096-dbus\") pod \"global-pull-secret-syncer-lvmjk\" (UID: \"1261112f-ce68-462a-a73e-fa1942159096\") " pod="kube-system/global-pull-secret-syncer-lvmjk" Jun 11 18:36:44.536267 ip-10-0-141-55 kubenswrapper[2578]: I0611 18:36:44.536254 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/1261112f-ce68-462a-a73e-fa1942159096-original-pull-secret\") pod \"global-pull-secret-syncer-lvmjk\" (UID: \"1261112f-ce68-462a-a73e-fa1942159096\") " pod="kube-system/global-pull-secret-syncer-lvmjk" Jun 11 18:36:44.536315 ip-10-0-141-55 kubenswrapper[2578]: I0611 18:36:44.536302 2578 reconciler_common.go:299] "Volume detached for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/617db869-ee36-4a71-b38e-fd0576c57c9a-original-pull-secret\") on node \"ip-10-0-141-55.ec2.internal\" DevicePath \"\"" Jun 11 18:36:44.636805 ip-10-0-141-55 kubenswrapper[2578]: I0611 18:36:44.636765 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/1261112f-ce68-462a-a73e-fa1942159096-kubelet-config\") pod \"global-pull-secret-syncer-lvmjk\" (UID: \"1261112f-ce68-462a-a73e-fa1942159096\") " pod="kube-system/global-pull-secret-syncer-lvmjk" Jun 11 18:36:44.636990 ip-10-0-141-55 kubenswrapper[2578]: I0611 18:36:44.636822 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/1261112f-ce68-462a-a73e-fa1942159096-dbus\") pod \"global-pull-secret-syncer-lvmjk\" (UID: \"1261112f-ce68-462a-a73e-fa1942159096\") " pod="kube-system/global-pull-secret-syncer-lvmjk" Jun 11 18:36:44.636990 ip-10-0-141-55 kubenswrapper[2578]: I0611 18:36:44.636849 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/1261112f-ce68-462a-a73e-fa1942159096-original-pull-secret\") pod \"global-pull-secret-syncer-lvmjk\" (UID: \"1261112f-ce68-462a-a73e-fa1942159096\") " pod="kube-system/global-pull-secret-syncer-lvmjk" Jun 11 18:36:44.636990 ip-10-0-141-55 kubenswrapper[2578]: I0611 18:36:44.636921 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/1261112f-ce68-462a-a73e-fa1942159096-kubelet-config\") pod \"global-pull-secret-syncer-lvmjk\" (UID: \"1261112f-ce68-462a-a73e-fa1942159096\") " pod="kube-system/global-pull-secret-syncer-lvmjk" Jun 11 18:36:44.636990 ip-10-0-141-55 kubenswrapper[2578]: I0611 18:36:44.636930 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/1261112f-ce68-462a-a73e-fa1942159096-dbus\") pod \"global-pull-secret-syncer-lvmjk\" (UID: \"1261112f-ce68-462a-a73e-fa1942159096\") " pod="kube-system/global-pull-secret-syncer-lvmjk" Jun 11 18:36:44.636990 ip-10-0-141-55 kubenswrapper[2578]: E0611 18:36:44.636975 2578 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jun 11 18:36:44.637205 ip-10-0-141-55 kubenswrapper[2578]: E0611 18:36:44.637032 2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/1261112f-ce68-462a-a73e-fa1942159096-original-pull-secret podName:1261112f-ce68-462a-a73e-fa1942159096 nodeName:}" failed. No retries permitted until 2026-06-11 18:36:45.137014568 +0000 UTC m=+11.091689151 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/1261112f-ce68-462a-a73e-fa1942159096-original-pull-secret") pod "global-pull-secret-syncer-lvmjk" (UID: "1261112f-ce68-462a-a73e-fa1942159096") : object "kube-system"/"original-pull-secret" not registered Jun 11 18:36:45.141656 ip-10-0-141-55 kubenswrapper[2578]: I0611 18:36:45.141616 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/1261112f-ce68-462a-a73e-fa1942159096-original-pull-secret\") pod \"global-pull-secret-syncer-lvmjk\" (UID: \"1261112f-ce68-462a-a73e-fa1942159096\") " pod="kube-system/global-pull-secret-syncer-lvmjk" Jun 11 18:36:45.142115 ip-10-0-141-55 kubenswrapper[2578]: E0611 18:36:45.141752 2578 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jun 11 18:36:45.142115 ip-10-0-141-55 kubenswrapper[2578]: E0611 18:36:45.141824 2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/1261112f-ce68-462a-a73e-fa1942159096-original-pull-secret podName:1261112f-ce68-462a-a73e-fa1942159096 nodeName:}" failed. No retries permitted until 2026-06-11 18:36:46.141806511 +0000 UTC m=+12.096481099 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/1261112f-ce68-462a-a73e-fa1942159096-original-pull-secret") pod "global-pull-secret-syncer-lvmjk" (UID: "1261112f-ce68-462a-a73e-fa1942159096") : object "kube-system"/"original-pull-secret" not registered Jun 11 18:36:45.415721 ip-10-0-141-55 kubenswrapper[2578]: I0611 18:36:45.415643 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-hjkh2" Jun 11 18:36:45.415882 ip-10-0-141-55 kubenswrapper[2578]: E0611 18:36:45.415779 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-hjkh2" podUID="04686d4c-5c3d-49ac-9b61-09e80f5e4dff" Jun 11 18:36:46.150374 ip-10-0-141-55 kubenswrapper[2578]: I0611 18:36:46.150338 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/1261112f-ce68-462a-a73e-fa1942159096-original-pull-secret\") pod \"global-pull-secret-syncer-lvmjk\" (UID: \"1261112f-ce68-462a-a73e-fa1942159096\") " pod="kube-system/global-pull-secret-syncer-lvmjk" Jun 11 18:36:46.150768 ip-10-0-141-55 kubenswrapper[2578]: E0611 18:36:46.150493 2578 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jun 11 18:36:46.150768 ip-10-0-141-55 kubenswrapper[2578]: E0611 18:36:46.150571 2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/1261112f-ce68-462a-a73e-fa1942159096-original-pull-secret podName:1261112f-ce68-462a-a73e-fa1942159096 nodeName:}" failed. No retries permitted until 2026-06-11 18:36:48.150540916 +0000 UTC m=+14.105215500 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/1261112f-ce68-462a-a73e-fa1942159096-original-pull-secret") pod "global-pull-secret-syncer-lvmjk" (UID: "1261112f-ce68-462a-a73e-fa1942159096") : object "kube-system"/"original-pull-secret" not registered Jun 11 18:36:46.415334 ip-10-0-141-55 kubenswrapper[2578]: I0611 18:36:46.415259 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-lvmjk" Jun 11 18:36:46.415486 ip-10-0-141-55 kubenswrapper[2578]: I0611 18:36:46.415269 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-x5mvk" Jun 11 18:36:46.415486 ip-10-0-141-55 kubenswrapper[2578]: E0611 18:36:46.415422 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-lvmjk" podUID="1261112f-ce68-462a-a73e-fa1942159096" Jun 11 18:36:46.415636 ip-10-0-141-55 kubenswrapper[2578]: E0611 18:36:46.415537 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-x5mvk" podUID="1257ce19-745b-4d56-b701-9fecd0879315" Jun 11 18:36:47.416241 ip-10-0-141-55 kubenswrapper[2578]: I0611 18:36:47.415949 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-hjkh2" Jun 11 18:36:47.416709 ip-10-0-141-55 kubenswrapper[2578]: E0611 18:36:47.416296 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-hjkh2" podUID="04686d4c-5c3d-49ac-9b61-09e80f5e4dff" Jun 11 18:36:47.510932 ip-10-0-141-55 kubenswrapper[2578]: I0611 18:36:47.510641 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-qc45v" event={"ID":"2cc00ed7-ab6f-4086-ae9c-d5394da96541","Type":"ContainerStarted","Data":"284a51dc6e31a0f3c4eeb4ed6bfd5512f37ffc4cb55740002ebc56986961ddf4"} Jun 11 18:36:47.512435 ip-10-0-141-55 kubenswrapper[2578]: I0611 18:36:47.512408 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-2qbtj" event={"ID":"d6c0b02b-24e5-4d14-a5bc-07c631277c13","Type":"ContainerStarted","Data":"48aea9d56dc47b3026f1b6194ab31de4d93677ea4e4a2cc0f595f6341e898ac4"} Jun 11 18:36:47.514216 ip-10-0-141-55 kubenswrapper[2578]: I0611 18:36:47.514191 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-ffv42" event={"ID":"0cc2bcd7-3d68-4ebb-9ab5-4529e5485a69","Type":"ContainerStarted","Data":"8140a9571bd2f8fe83c0ab37de08106dd8dda77412e099c261f15fa0dbca97f6"} Jun 11 18:36:47.516027 ip-10-0-141-55 kubenswrapper[2578]: I0611 18:36:47.516006 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-9ld8n" event={"ID":"50f4744a-788a-47dd-8fa7-321eaaad1b53","Type":"ContainerStarted","Data":"14f8362507a7633d26c6b83b56e436af1024cd665a945b1da66560f802b341f0"} Jun 11 18:36:47.517623 ip-10-0-141-55 kubenswrapper[2578]: I0611 18:36:47.517580 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-m7sgm" event={"ID":"e6233099-5000-4135-a876-b35ae68d8198","Type":"ContainerStarted","Data":"5abbcd2fb69e710731d2d2361520c1b960168a3c8cb69be551a9f399da79cbcb"} Jun 11 18:36:47.519318 ip-10-0-141-55 kubenswrapper[2578]: I0611 18:36:47.519294 2578 generic.go:356] "Generic (PLEG): container finished" podID="cd01660e-add6-419b-8f21-9dbd7c1efd86" containerID="8071aafb14ba3d317ee20aee5a902be63c369573b991afb6ef2c669bae529454" exitCode=0 Jun 11 18:36:47.519409 ip-10-0-141-55 kubenswrapper[2578]: I0611 18:36:47.519340 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-jttqf" event={"ID":"cd01660e-add6-419b-8f21-9dbd7c1efd86","Type":"ContainerDied","Data":"8071aafb14ba3d317ee20aee5a902be63c369573b991afb6ef2c669bae529454"} Jun 11 18:36:47.526765 ip-10-0-141-55 kubenswrapper[2578]: I0611 18:36:47.526714 2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/node-ca-qc45v" podStartSLOduration=2.2125271619999998 podStartE2EDuration="11.526697226s" totalImagesPullingTime="9.314170064s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-11 18:36:36 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-11 18:36:47.526276167 +0000 UTC m=+13.480950773" watchObservedRunningTime="2026-06-11 18:36:47.526697226 +0000 UTC m=+13.481371835" Jun 11 18:36:47.561452 ip-10-0-141-55 kubenswrapper[2578]: I0611 18:36:47.561405 2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/konnectivity-agent-ffv42" podStartSLOduration=2.2492837039999998 podStartE2EDuration="11.561388761s" totalImagesPullingTime="9.312105057s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-11 18:36:36 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-11 18:36:47.560864751 +0000 UTC m=+13.515539369" watchObservedRunningTime="2026-06-11 18:36:47.561388761 +0000 UTC m=+13.516063373" Jun 11 18:36:47.578300 ip-10-0-141-55 kubenswrapper[2578]: I0611 18:36:47.578251 2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-node-tuning-operator/tuned-9ld8n" podStartSLOduration=2.195755163 podStartE2EDuration="11.578237452s" totalImagesPullingTime="9.382482289s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-11 18:36:36 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-11 18:36:47.577792929 +0000 UTC m=+13.532467556" watchObservedRunningTime="2026-06-11 18:36:47.578237452 +0000 UTC m=+13.532912101" Jun 11 18:36:47.593372 ip-10-0-141-55 kubenswrapper[2578]: I0611 18:36:47.593323 2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/node-resolver-m7sgm" podStartSLOduration=2.253740003 podStartE2EDuration="11.593306685s" totalImagesPullingTime="9.339566682s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-11 18:36:36 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-11 18:36:47.593172377 +0000 UTC m=+13.547847006" watchObservedRunningTime="2026-06-11 18:36:47.593306685 +0000 UTC m=+13.547981301" Jun 11 18:36:48.034346 ip-10-0-141-55 kubenswrapper[2578]: I0611 18:36:48.034309 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ffv42_0cc2bcd7-3d68-4ebb-9ab5-4529e5485a69/konnectivity-agent/0.log" limit=1024 Jun 11 18:36:48.115753 ip-10-0-141-55 kubenswrapper[2578]: I0611 18:36:48.115700 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ffv42_0cc2bcd7-3d68-4ebb-9ab5-4529e5485a69/konnectivity-agent/0.log" limit=1024 Jun 11 18:36:48.167741 ip-10-0-141-55 kubenswrapper[2578]: I0611 18:36:48.167680 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/1261112f-ce68-462a-a73e-fa1942159096-original-pull-secret\") pod \"global-pull-secret-syncer-lvmjk\" (UID: \"1261112f-ce68-462a-a73e-fa1942159096\") " pod="kube-system/global-pull-secret-syncer-lvmjk" Jun 11 18:36:48.167913 ip-10-0-141-55 kubenswrapper[2578]: E0611 18:36:48.167849 2578 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jun 11 18:36:48.167966 ip-10-0-141-55 kubenswrapper[2578]: E0611 18:36:48.167924 2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/1261112f-ce68-462a-a73e-fa1942159096-original-pull-secret podName:1261112f-ce68-462a-a73e-fa1942159096 nodeName:}" failed. No retries permitted until 2026-06-11 18:36:52.167903425 +0000 UTC m=+18.122578013 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/1261112f-ce68-462a-a73e-fa1942159096-original-pull-secret") pod "global-pull-secret-syncer-lvmjk" (UID: "1261112f-ce68-462a-a73e-fa1942159096") : object "kube-system"/"original-pull-secret" not registered Jun 11 18:36:48.415638 ip-10-0-141-55 kubenswrapper[2578]: I0611 18:36:48.415589 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-x5mvk" Jun 11 18:36:48.415917 ip-10-0-141-55 kubenswrapper[2578]: E0611 18:36:48.415730 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-x5mvk" podUID="1257ce19-745b-4d56-b701-9fecd0879315" Jun 11 18:36:48.416090 ip-10-0-141-55 kubenswrapper[2578]: I0611 18:36:48.416004 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-lvmjk" Jun 11 18:36:48.416181 ip-10-0-141-55 kubenswrapper[2578]: E0611 18:36:48.416111 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-lvmjk" podUID="1261112f-ce68-462a-a73e-fa1942159096" Jun 11 18:36:48.523235 ip-10-0-141-55 kubenswrapper[2578]: I0611 18:36:48.523149 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-kkqxh" event={"ID":"418a2cf3-d8f2-412c-8365-ba9c61004229","Type":"ContainerStarted","Data":"d7ba1a241ab2bfa925349c20599a04b2b40b0307c06f995ff788ca735219c7b4"} Jun 11 18:36:48.539463 ip-10-0-141-55 kubenswrapper[2578]: I0611 18:36:48.539388 2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-operator/iptables-alerter-kkqxh" podStartSLOduration=3.216782047 podStartE2EDuration="12.539370667s" totalImagesPullingTime="9.32258862s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-11 18:36:36 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-11 18:36:48.53859864 +0000 UTC m=+14.493273273" watchObservedRunningTime="2026-06-11 18:36:48.539370667 +0000 UTC m=+14.494045273" Jun 11 18:36:48.684572 ip-10-0-141-55 kubenswrapper[2578]: I0611 18:36:48.682475 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ffv42_0cc2bcd7-3d68-4ebb-9ab5-4529e5485a69/konnectivity-agent/0.log" limit=1024 Jun 11 18:36:48.763381 ip-10-0-141-55 kubenswrapper[2578]: I0611 18:36:48.763342 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ffv42_0cc2bcd7-3d68-4ebb-9ab5-4529e5485a69/konnectivity-agent/0.log" limit=1024 Jun 11 18:36:49.307416 ip-10-0-141-55 kubenswrapper[2578]: I0611 18:36:49.307390 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-m7sgm_e6233099-5000-4135-a876-b35ae68d8198/dns-node-resolver/0.log" Jun 11 18:36:49.415308 ip-10-0-141-55 kubenswrapper[2578]: I0611 18:36:49.415278 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-hjkh2" Jun 11 18:36:49.415456 ip-10-0-141-55 kubenswrapper[2578]: E0611 18:36:49.415399 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-hjkh2" podUID="04686d4c-5c3d-49ac-9b61-09e80f5e4dff" Jun 11 18:36:49.644591 ip-10-0-141-55 kubenswrapper[2578]: I0611 18:36:49.644543 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ffv42_0cc2bcd7-3d68-4ebb-9ab5-4529e5485a69/konnectivity-agent/0.log" limit=1024 Jun 11 18:36:49.745534 ip-10-0-141-55 kubenswrapper[2578]: I0611 18:36:49.745493 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ffv42_0cc2bcd7-3d68-4ebb-9ab5-4529e5485a69/konnectivity-agent/0.log" limit=1024 Jun 11 18:36:50.308140 ip-10-0-141-55 kubenswrapper[2578]: I0611 18:36:50.308114 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-qc45v_2cc00ed7-ab6f-4086-ae9c-d5394da96541/node-ca/0.log" Jun 11 18:36:50.415283 ip-10-0-141-55 kubenswrapper[2578]: I0611 18:36:50.415250 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-lvmjk" Jun 11 18:36:50.415465 ip-10-0-141-55 kubenswrapper[2578]: I0611 18:36:50.415385 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-x5mvk" Jun 11 18:36:50.415465 ip-10-0-141-55 kubenswrapper[2578]: E0611 18:36:50.415388 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-lvmjk" podUID="1261112f-ce68-462a-a73e-fa1942159096" Jun 11 18:36:50.415600 ip-10-0-141-55 kubenswrapper[2578]: E0611 18:36:50.415501 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-x5mvk" podUID="1257ce19-745b-4d56-b701-9fecd0879315" Jun 11 18:36:50.415998 ip-10-0-141-55 kubenswrapper[2578]: I0611 18:36:50.415973 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ffv42_0cc2bcd7-3d68-4ebb-9ab5-4529e5485a69/konnectivity-agent/0.log" limit=1024 Jun 11 18:36:50.515414 ip-10-0-141-55 kubenswrapper[2578]: I0611 18:36:50.515380 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ffv42_0cc2bcd7-3d68-4ebb-9ab5-4529e5485a69/konnectivity-agent/0.log" limit=1024 Jun 11 18:36:50.616853 ip-10-0-141-55 kubenswrapper[2578]: I0611 18:36:50.616826 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ffv42_0cc2bcd7-3d68-4ebb-9ab5-4529e5485a69/konnectivity-agent/0.log" limit=1024 Jun 11 18:36:50.716621 ip-10-0-141-55 kubenswrapper[2578]: I0611 18:36:50.716458 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ffv42_0cc2bcd7-3d68-4ebb-9ab5-4529e5485a69/konnectivity-agent/0.log" limit=1024 Jun 11 18:36:51.313771 ip-10-0-141-55 kubenswrapper[2578]: I0611 18:36:51.313744 2578 plugin_watcher.go:194] "Adding socket path or updating timestamp to desired state cache" path="/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock" Jun 11 18:36:51.415638 ip-10-0-141-55 kubenswrapper[2578]: I0611 18:36:51.415598 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-hjkh2" Jun 11 18:36:51.415824 ip-10-0-141-55 kubenswrapper[2578]: I0611 18:36:51.415594 2578 reconciler.go:161] "OperationExecutor.RegisterPlugin started" plugin={"SocketPath":"/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock","Timestamp":"2026-06-11T18:36:51.313767409Z","UUID":"3cbb38b6-1be2-4024-a100-35103654327b","Handler":null,"Name":"","Endpoint":""} Jun 11 18:36:51.415824 ip-10-0-141-55 kubenswrapper[2578]: E0611 18:36:51.415712 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-hjkh2" podUID="04686d4c-5c3d-49ac-9b61-09e80f5e4dff" Jun 11 18:36:51.417727 ip-10-0-141-55 kubenswrapper[2578]: I0611 18:36:51.417703 2578 csi_plugin.go:106] kubernetes.io/csi: Trying to validate a new CSI Driver with name: ebs.csi.aws.com endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock versions: 1.0.0 Jun 11 18:36:51.417854 ip-10-0-141-55 kubenswrapper[2578]: I0611 18:36:51.417743 2578 csi_plugin.go:119] kubernetes.io/csi: Register new plugin with name: ebs.csi.aws.com at endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock Jun 11 18:36:51.531152 ip-10-0-141-55 kubenswrapper[2578]: I0611 18:36:51.531066 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-zlzks" event={"ID":"8b02eb7c-e526-4079-b139-e46f4626d3e5","Type":"ContainerStarted","Data":"d47245024fd40ef777b8c970594b20f9157cad092f8705c9c013016927c84ecb"} Jun 11 18:36:51.533494 ip-10-0-141-55 kubenswrapper[2578]: I0611 18:36:51.533463 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-2qbtj" event={"ID":"d6c0b02b-24e5-4d14-a5bc-07c631277c13","Type":"ContainerStarted","Data":"0e7b1c83a3e02d2cf26d42a49ea0cc036eaafc3f71de26ae3f7f366c376ecbad"} Jun 11 18:36:51.539392 ip-10-0-141-55 kubenswrapper[2578]: I0611 18:36:51.539362 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ffv42_0cc2bcd7-3d68-4ebb-9ab5-4529e5485a69/konnectivity-agent/0.log" limit=1024 Jun 11 18:36:51.554032 ip-10-0-141-55 kubenswrapper[2578]: I0611 18:36:51.553991 2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-zlzks" podStartSLOduration=3.046303245 podStartE2EDuration="16.553976718s" totalImagesPullingTime="13.507673473s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-11 18:36:35 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-11 18:36:51.553238397 +0000 UTC m=+17.507913045" watchObservedRunningTime="2026-06-11 18:36:51.553976718 +0000 UTC m=+17.508651328" Jun 11 18:36:51.632343 ip-10-0-141-55 kubenswrapper[2578]: I0611 18:36:51.632307 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ffv42_0cc2bcd7-3d68-4ebb-9ab5-4529e5485a69/konnectivity-agent/0.log" limit=1024 Jun 11 18:36:51.732746 ip-10-0-141-55 kubenswrapper[2578]: I0611 18:36:51.732713 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ffv42_0cc2bcd7-3d68-4ebb-9ab5-4529e5485a69/konnectivity-agent/0.log" limit=1024 Jun 11 18:36:51.832455 ip-10-0-141-55 kubenswrapper[2578]: I0611 18:36:51.832267 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ffv42_0cc2bcd7-3d68-4ebb-9ab5-4529e5485a69/konnectivity-agent/0.log" limit=1024 Jun 11 18:36:51.893543 ip-10-0-141-55 kubenswrapper[2578]: I0611 18:36:51.891310 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ffv42_0cc2bcd7-3d68-4ebb-9ab5-4529e5485a69/konnectivity-agent/0.log" limit=1024 Jun 11 18:36:51.895180 ip-10-0-141-55 kubenswrapper[2578]: I0611 18:36:51.895150 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-c4ths\" (UniqueName: \"kubernetes.io/projected/04686d4c-5c3d-49ac-9b61-09e80f5e4dff-kube-api-access-c4ths\") pod \"network-check-target-hjkh2\" (UID: \"04686d4c-5c3d-49ac-9b61-09e80f5e4dff\") " pod="openshift-network-diagnostics/network-check-target-hjkh2" Jun 11 18:36:51.895316 ip-10-0-141-55 kubenswrapper[2578]: I0611 18:36:51.895224 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/1257ce19-745b-4d56-b701-9fecd0879315-metrics-certs\") pod \"network-metrics-daemon-x5mvk\" (UID: \"1257ce19-745b-4d56-b701-9fecd0879315\") " pod="openshift-multus/network-metrics-daemon-x5mvk" Jun 11 18:36:51.895374 ip-10-0-141-55 kubenswrapper[2578]: E0611 18:36:51.895322 2578 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jun 11 18:36:51.895374 ip-10-0-141-55 kubenswrapper[2578]: E0611 18:36:51.895324 2578 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jun 11 18:36:51.895374 ip-10-0-141-55 kubenswrapper[2578]: E0611 18:36:51.895351 2578 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jun 11 18:36:51.895374 ip-10-0-141-55 kubenswrapper[2578]: E0611 18:36:51.895364 2578 projected.go:196] Error preparing data for projected volume kube-api-access-c4ths for pod openshift-network-diagnostics/network-check-target-hjkh2: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 11 18:36:51.895584 ip-10-0-141-55 kubenswrapper[2578]: E0611 18:36:51.895383 2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/1257ce19-745b-4d56-b701-9fecd0879315-metrics-certs podName:1257ce19-745b-4d56-b701-9fecd0879315 nodeName:}" failed. No retries permitted until 2026-06-11 18:37:07.895364555 +0000 UTC m=+33.850039145 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/1257ce19-745b-4d56-b701-9fecd0879315-metrics-certs") pod "network-metrics-daemon-x5mvk" (UID: "1257ce19-745b-4d56-b701-9fecd0879315") : object "openshift-multus"/"metrics-daemon-secret" not registered Jun 11 18:36:51.895584 ip-10-0-141-55 kubenswrapper[2578]: E0611 18:36:51.895415 2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/04686d4c-5c3d-49ac-9b61-09e80f5e4dff-kube-api-access-c4ths podName:04686d4c-5c3d-49ac-9b61-09e80f5e4dff nodeName:}" failed. No retries permitted until 2026-06-11 18:37:07.895399254 +0000 UTC m=+33.850073852 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "kube-api-access-c4ths" (UniqueName: "kubernetes.io/projected/04686d4c-5c3d-49ac-9b61-09e80f5e4dff-kube-api-access-c4ths") pod "network-check-target-hjkh2" (UID: "04686d4c-5c3d-49ac-9b61-09e80f5e4dff") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 11 18:36:52.058997 ip-10-0-141-55 kubenswrapper[2578]: I0611 18:36:52.058943 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ffv42_0cc2bcd7-3d68-4ebb-9ab5-4529e5485a69/konnectivity-agent/0.log" limit=1024 Jun 11 18:36:52.197655 ip-10-0-141-55 kubenswrapper[2578]: I0611 18:36:52.197618 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/1261112f-ce68-462a-a73e-fa1942159096-original-pull-secret\") pod \"global-pull-secret-syncer-lvmjk\" (UID: \"1261112f-ce68-462a-a73e-fa1942159096\") " pod="kube-system/global-pull-secret-syncer-lvmjk" Jun 11 18:36:52.197796 ip-10-0-141-55 kubenswrapper[2578]: E0611 18:36:52.197751 2578 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jun 11 18:36:52.197857 ip-10-0-141-55 kubenswrapper[2578]: E0611 18:36:52.197822 2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/1261112f-ce68-462a-a73e-fa1942159096-original-pull-secret podName:1261112f-ce68-462a-a73e-fa1942159096 nodeName:}" failed. No retries permitted until 2026-06-11 18:37:00.19780389 +0000 UTC m=+26.152478475 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/1261112f-ce68-462a-a73e-fa1942159096-original-pull-secret") pod "global-pull-secret-syncer-lvmjk" (UID: "1261112f-ce68-462a-a73e-fa1942159096") : object "kube-system"/"original-pull-secret" not registered Jun 11 18:36:52.207979 ip-10-0-141-55 kubenswrapper[2578]: I0611 18:36:52.207941 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ffv42_0cc2bcd7-3d68-4ebb-9ab5-4529e5485a69/konnectivity-agent/0.log" limit=1024 Jun 11 18:36:52.331983 ip-10-0-141-55 kubenswrapper[2578]: I0611 18:36:52.331954 2578 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="kube-system/konnectivity-agent-ffv42" Jun 11 18:36:52.332772 ip-10-0-141-55 kubenswrapper[2578]: I0611 18:36:52.332754 2578 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="kube-system/konnectivity-agent-ffv42" Jun 11 18:36:52.415667 ip-10-0-141-55 kubenswrapper[2578]: I0611 18:36:52.415639 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-lvmjk" Jun 11 18:36:52.415794 ip-10-0-141-55 kubenswrapper[2578]: E0611 18:36:52.415736 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-lvmjk" podUID="1261112f-ce68-462a-a73e-fa1942159096" Jun 11 18:36:52.415794 ip-10-0-141-55 kubenswrapper[2578]: I0611 18:36:52.415775 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-x5mvk" Jun 11 18:36:52.415888 ip-10-0-141-55 kubenswrapper[2578]: E0611 18:36:52.415869 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-x5mvk" podUID="1257ce19-745b-4d56-b701-9fecd0879315" Jun 11 18:36:52.538113 ip-10-0-141-55 kubenswrapper[2578]: I0611 18:36:52.538024 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-2qbtj" event={"ID":"d6c0b02b-24e5-4d14-a5bc-07c631277c13","Type":"ContainerStarted","Data":"25f66e9427e4d6eb3ef386c3f65f1a56fe13b61085a996fd1ab5cacdbccd3327"} Jun 11 18:36:52.538333 ip-10-0-141-55 kubenswrapper[2578]: I0611 18:36:52.538303 2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kube-system/konnectivity-agent-ffv42" Jun 11 18:36:52.538798 ip-10-0-141-55 kubenswrapper[2578]: I0611 18:36:52.538778 2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kube-system/konnectivity-agent-ffv42" Jun 11 18:36:52.560852 ip-10-0-141-55 kubenswrapper[2578]: I0611 18:36:52.560813 2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-2qbtj" podStartSLOduration=1.7735270459999999 podStartE2EDuration="16.560801095s" totalImagesPullingTime="14.787274049s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-11 18:36:36 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-11 18:36:52.560725305 +0000 UTC m=+18.515399910" watchObservedRunningTime="2026-06-11 18:36:52.560801095 +0000 UTC m=+18.515475701" Jun 11 18:36:52.627030 ip-10-0-141-55 kubenswrapper[2578]: I0611 18:36:52.627000 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ffv42_0cc2bcd7-3d68-4ebb-9ab5-4529e5485a69/konnectivity-agent/0.log" limit=1024 Jun 11 18:36:53.256706 ip-10-0-141-55 kubenswrapper[2578]: I0611 18:36:53.256674 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ffv42_0cc2bcd7-3d68-4ebb-9ab5-4529e5485a69/konnectivity-agent/0.log" limit=1024 Jun 11 18:36:53.415352 ip-10-0-141-55 kubenswrapper[2578]: I0611 18:36:53.415302 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-hjkh2" Jun 11 18:36:53.415533 ip-10-0-141-55 kubenswrapper[2578]: E0611 18:36:53.415418 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-hjkh2" podUID="04686d4c-5c3d-49ac-9b61-09e80f5e4dff" Jun 11 18:36:53.477515 ip-10-0-141-55 kubenswrapper[2578]: I0611 18:36:53.477485 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ffv42_0cc2bcd7-3d68-4ebb-9ab5-4529e5485a69/konnectivity-agent/0.log" limit=1024 Jun 11 18:36:53.576483 ip-10-0-141-55 kubenswrapper[2578]: I0611 18:36:53.576401 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ffv42_0cc2bcd7-3d68-4ebb-9ab5-4529e5485a69/konnectivity-agent/0.log" limit=1024 Jun 11 18:36:53.811237 ip-10-0-141-55 kubenswrapper[2578]: I0611 18:36:53.811200 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ffv42_0cc2bcd7-3d68-4ebb-9ab5-4529e5485a69/konnectivity-agent/0.log" limit=1024 Jun 11 18:36:54.026657 ip-10-0-141-55 kubenswrapper[2578]: I0611 18:36:54.026623 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ffv42_0cc2bcd7-3d68-4ebb-9ab5-4529e5485a69/konnectivity-agent/0.log" limit=1024 Jun 11 18:36:54.293095 ip-10-0-141-55 kubenswrapper[2578]: I0611 18:36:54.293016 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ffv42_0cc2bcd7-3d68-4ebb-9ab5-4529e5485a69/konnectivity-agent/0.log" limit=1024 Jun 11 18:36:54.394188 ip-10-0-141-55 kubenswrapper[2578]: I0611 18:36:54.394156 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ffv42_0cc2bcd7-3d68-4ebb-9ab5-4529e5485a69/konnectivity-agent/0.log" limit=1024 Jun 11 18:36:54.417779 ip-10-0-141-55 kubenswrapper[2578]: I0611 18:36:54.417755 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-lvmjk" Jun 11 18:36:54.417914 ip-10-0-141-55 kubenswrapper[2578]: I0611 18:36:54.417758 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-x5mvk" Jun 11 18:36:54.417914 ip-10-0-141-55 kubenswrapper[2578]: E0611 18:36:54.417839 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-lvmjk" podUID="1261112f-ce68-462a-a73e-fa1942159096" Jun 11 18:36:54.417992 ip-10-0-141-55 kubenswrapper[2578]: E0611 18:36:54.417928 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-x5mvk" podUID="1257ce19-745b-4d56-b701-9fecd0879315" Jun 11 18:36:54.622989 ip-10-0-141-55 kubenswrapper[2578]: I0611 18:36:54.622958 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ffv42_0cc2bcd7-3d68-4ebb-9ab5-4529e5485a69/konnectivity-agent/0.log" limit=1024 Jun 11 18:36:55.013382 ip-10-0-141-55 kubenswrapper[2578]: I0611 18:36:55.013295 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ffv42_0cc2bcd7-3d68-4ebb-9ab5-4529e5485a69/konnectivity-agent/0.log" limit=1024 Jun 11 18:36:55.215879 ip-10-0-141-55 kubenswrapper[2578]: I0611 18:36:55.215843 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ffv42_0cc2bcd7-3d68-4ebb-9ab5-4529e5485a69/konnectivity-agent/0.log" limit=1024 Jun 11 18:36:55.316886 ip-10-0-141-55 kubenswrapper[2578]: I0611 18:36:55.316772 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ffv42_0cc2bcd7-3d68-4ebb-9ab5-4529e5485a69/konnectivity-agent/0.log" limit=1024 Jun 11 18:36:55.415413 ip-10-0-141-55 kubenswrapper[2578]: I0611 18:36:55.415381 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-hjkh2" Jun 11 18:36:55.415614 ip-10-0-141-55 kubenswrapper[2578]: E0611 18:36:55.415497 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-hjkh2" podUID="04686d4c-5c3d-49ac-9b61-09e80f5e4dff" Jun 11 18:36:55.803342 ip-10-0-141-55 kubenswrapper[2578]: I0611 18:36:55.803307 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ffv42_0cc2bcd7-3d68-4ebb-9ab5-4529e5485a69/konnectivity-agent/0.log" limit=1024 Jun 11 18:36:55.921465 ip-10-0-141-55 kubenswrapper[2578]: I0611 18:36:55.921424 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ffv42_0cc2bcd7-3d68-4ebb-9ab5-4529e5485a69/konnectivity-agent/0.log" limit=1024 Jun 11 18:36:56.409154 ip-10-0-141-55 kubenswrapper[2578]: I0611 18:36:56.409117 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ffv42_0cc2bcd7-3d68-4ebb-9ab5-4529e5485a69/konnectivity-agent/0.log" limit=1024 Jun 11 18:36:56.416226 ip-10-0-141-55 kubenswrapper[2578]: I0611 18:36:56.416199 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-lvmjk" Jun 11 18:36:56.416364 ip-10-0-141-55 kubenswrapper[2578]: E0611 18:36:56.416319 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-lvmjk" podUID="1261112f-ce68-462a-a73e-fa1942159096" Jun 11 18:36:56.416429 ip-10-0-141-55 kubenswrapper[2578]: I0611 18:36:56.416385 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-x5mvk" Jun 11 18:36:56.416504 ip-10-0-141-55 kubenswrapper[2578]: E0611 18:36:56.416484 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-x5mvk" podUID="1257ce19-745b-4d56-b701-9fecd0879315" Jun 11 18:36:56.503573 ip-10-0-141-55 kubenswrapper[2578]: I0611 18:36:56.503525 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ffv42_0cc2bcd7-3d68-4ebb-9ab5-4529e5485a69/konnectivity-agent/0.log" limit=1024 Jun 11 18:36:56.604229 ip-10-0-141-55 kubenswrapper[2578]: I0611 18:36:56.604196 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ffv42_0cc2bcd7-3d68-4ebb-9ab5-4529e5485a69/konnectivity-agent/0.log" limit=1024 Jun 11 18:36:57.009100 ip-10-0-141-55 kubenswrapper[2578]: I0611 18:36:57.009061 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ffv42_0cc2bcd7-3d68-4ebb-9ab5-4529e5485a69/konnectivity-agent/0.log" limit=1024 Jun 11 18:36:57.109168 ip-10-0-141-55 kubenswrapper[2578]: I0611 18:36:57.109132 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ffv42_0cc2bcd7-3d68-4ebb-9ab5-4529e5485a69/konnectivity-agent/0.log" limit=1024 Jun 11 18:36:57.219676 ip-10-0-141-55 kubenswrapper[2578]: I0611 18:36:57.219641 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ffv42_0cc2bcd7-3d68-4ebb-9ab5-4529e5485a69/konnectivity-agent/0.log" limit=1024 Jun 11 18:36:57.318870 ip-10-0-141-55 kubenswrapper[2578]: I0611 18:36:57.318801 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ffv42_0cc2bcd7-3d68-4ebb-9ab5-4529e5485a69/konnectivity-agent/0.log" limit=1024 Jun 11 18:36:57.404742 ip-10-0-141-55 kubenswrapper[2578]: I0611 18:36:57.404710 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ffv42_0cc2bcd7-3d68-4ebb-9ab5-4529e5485a69/konnectivity-agent/0.log" limit=1024 Jun 11 18:36:57.415628 ip-10-0-141-55 kubenswrapper[2578]: I0611 18:36:57.415600 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-hjkh2" Jun 11 18:36:57.416025 ip-10-0-141-55 kubenswrapper[2578]: E0611 18:36:57.415763 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-hjkh2" podUID="04686d4c-5c3d-49ac-9b61-09e80f5e4dff" Jun 11 18:36:57.552192 ip-10-0-141-55 kubenswrapper[2578]: I0611 18:36:57.552109 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-jttqf" event={"ID":"cd01660e-add6-419b-8f21-9dbd7c1efd86","Type":"ContainerStarted","Data":"c2bdba595dde9e2f6e1976b83e8f5c7e385f931ba4ef8b2e273d4212a52220e2"} Jun 11 18:36:57.606183 ip-10-0-141-55 kubenswrapper[2578]: I0611 18:36:57.606142 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ffv42_0cc2bcd7-3d68-4ebb-9ab5-4529e5485a69/konnectivity-agent/0.log" limit=1024 Jun 11 18:36:58.415548 ip-10-0-141-55 kubenswrapper[2578]: I0611 18:36:58.415520 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-lvmjk" Jun 11 18:36:58.415753 ip-10-0-141-55 kubenswrapper[2578]: E0611 18:36:58.415653 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-lvmjk" podUID="1261112f-ce68-462a-a73e-fa1942159096" Jun 11 18:36:58.415753 ip-10-0-141-55 kubenswrapper[2578]: I0611 18:36:58.415742 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-x5mvk" Jun 11 18:36:58.416128 ip-10-0-141-55 kubenswrapper[2578]: E0611 18:36:58.415867 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-x5mvk" podUID="1257ce19-745b-4d56-b701-9fecd0879315" Jun 11 18:36:59.416245 ip-10-0-141-55 kubenswrapper[2578]: I0611 18:36:59.416218 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-hjkh2" Jun 11 18:36:59.416723 ip-10-0-141-55 kubenswrapper[2578]: E0611 18:36:59.416332 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-hjkh2" podUID="04686d4c-5c3d-49ac-9b61-09e80f5e4dff" Jun 11 18:37:00.256992 ip-10-0-141-55 kubenswrapper[2578]: I0611 18:37:00.256960 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/1261112f-ce68-462a-a73e-fa1942159096-original-pull-secret\") pod \"global-pull-secret-syncer-lvmjk\" (UID: \"1261112f-ce68-462a-a73e-fa1942159096\") " pod="kube-system/global-pull-secret-syncer-lvmjk" Jun 11 18:37:00.257164 ip-10-0-141-55 kubenswrapper[2578]: E0611 18:37:00.257121 2578 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jun 11 18:37:00.257218 ip-10-0-141-55 kubenswrapper[2578]: E0611 18:37:00.257188 2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/1261112f-ce68-462a-a73e-fa1942159096-original-pull-secret podName:1261112f-ce68-462a-a73e-fa1942159096 nodeName:}" failed. No retries permitted until 2026-06-11 18:37:16.257169683 +0000 UTC m=+42.211844270 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/1261112f-ce68-462a-a73e-fa1942159096-original-pull-secret") pod "global-pull-secret-syncer-lvmjk" (UID: "1261112f-ce68-462a-a73e-fa1942159096") : object "kube-system"/"original-pull-secret" not registered Jun 11 18:37:00.415910 ip-10-0-141-55 kubenswrapper[2578]: I0611 18:37:00.415868 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-lvmjk" Jun 11 18:37:00.416084 ip-10-0-141-55 kubenswrapper[2578]: E0611 18:37:00.415999 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-lvmjk" podUID="1261112f-ce68-462a-a73e-fa1942159096" Jun 11 18:37:00.416084 ip-10-0-141-55 kubenswrapper[2578]: I0611 18:37:00.416057 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-x5mvk" Jun 11 18:37:00.416239 ip-10-0-141-55 kubenswrapper[2578]: E0611 18:37:00.416186 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-x5mvk" podUID="1257ce19-745b-4d56-b701-9fecd0879315" Jun 11 18:37:01.415320 ip-10-0-141-55 kubenswrapper[2578]: I0611 18:37:01.415285 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-hjkh2" Jun 11 18:37:01.415689 ip-10-0-141-55 kubenswrapper[2578]: E0611 18:37:01.415395 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-hjkh2" podUID="04686d4c-5c3d-49ac-9b61-09e80f5e4dff" Jun 11 18:37:01.562376 ip-10-0-141-55 kubenswrapper[2578]: I0611 18:37:01.562342 2578 generic.go:356] "Generic (PLEG): container finished" podID="cd01660e-add6-419b-8f21-9dbd7c1efd86" containerID="c2bdba595dde9e2f6e1976b83e8f5c7e385f931ba4ef8b2e273d4212a52220e2" exitCode=0 Jun 11 18:37:01.562529 ip-10-0-141-55 kubenswrapper[2578]: I0611 18:37:01.562392 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-jttqf" event={"ID":"cd01660e-add6-419b-8f21-9dbd7c1efd86","Type":"ContainerDied","Data":"c2bdba595dde9e2f6e1976b83e8f5c7e385f931ba4ef8b2e273d4212a52220e2"} Jun 11 18:37:02.415533 ip-10-0-141-55 kubenswrapper[2578]: I0611 18:37:02.415347 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-x5mvk" Jun 11 18:37:02.416228 ip-10-0-141-55 kubenswrapper[2578]: I0611 18:37:02.415359 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-lvmjk" Jun 11 18:37:02.416228 ip-10-0-141-55 kubenswrapper[2578]: E0611 18:37:02.415652 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-x5mvk" podUID="1257ce19-745b-4d56-b701-9fecd0879315" Jun 11 18:37:02.416228 ip-10-0-141-55 kubenswrapper[2578]: E0611 18:37:02.415694 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-lvmjk" podUID="1261112f-ce68-462a-a73e-fa1942159096" Jun 11 18:37:02.566316 ip-10-0-141-55 kubenswrapper[2578]: I0611 18:37:02.566287 2578 generic.go:356] "Generic (PLEG): container finished" podID="cd01660e-add6-419b-8f21-9dbd7c1efd86" containerID="59079162d976a0ae394dc0a9165ff804bdd79f0ef0a3dfd8fe717d86de345d10" exitCode=0 Jun 11 18:37:02.566448 ip-10-0-141-55 kubenswrapper[2578]: I0611 18:37:02.566359 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-jttqf" event={"ID":"cd01660e-add6-419b-8f21-9dbd7c1efd86","Type":"ContainerDied","Data":"59079162d976a0ae394dc0a9165ff804bdd79f0ef0a3dfd8fe717d86de345d10"} Jun 11 18:37:02.569408 ip-10-0-141-55 kubenswrapper[2578]: I0611 18:37:02.569386 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-vcdjb" event={"ID":"984d8be7-df73-433d-8804-d740a26ef757","Type":"ContainerStarted","Data":"5e4bbbc41f52d0d6fd1f552fe111fe6575db38b433067739cbf55107b2543854"} Jun 11 18:37:02.569498 ip-10-0-141-55 kubenswrapper[2578]: I0611 18:37:02.569443 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-vcdjb" event={"ID":"984d8be7-df73-433d-8804-d740a26ef757","Type":"ContainerStarted","Data":"e98edb95a7995ee5e0f811a10cc3c346bfb24b2ae50359fd9a5fe0535de30e0b"} Jun 11 18:37:02.569498 ip-10-0-141-55 kubenswrapper[2578]: I0611 18:37:02.569472 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-vcdjb" event={"ID":"984d8be7-df73-433d-8804-d740a26ef757","Type":"ContainerStarted","Data":"3d0b4598bae39e23606dbd9ae0b3547a40552ff0352f0a133caa7996eb6cf0c7"} Jun 11 18:37:02.569601 ip-10-0-141-55 kubenswrapper[2578]: I0611 18:37:02.569509 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-vcdjb" event={"ID":"984d8be7-df73-433d-8804-d740a26ef757","Type":"ContainerStarted","Data":"fb04edef0592d59d09d6b13746478318429196f4e600ee7d60ead20c12acef95"} Jun 11 18:37:02.569601 ip-10-0-141-55 kubenswrapper[2578]: I0611 18:37:02.569543 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-vcdjb" event={"ID":"984d8be7-df73-433d-8804-d740a26ef757","Type":"ContainerStarted","Data":"e4b0b5a1c2be46eb2690fbd100c43ecb475651143e3d2d34ecff28921850865a"} Jun 11 18:37:02.569601 ip-10-0-141-55 kubenswrapper[2578]: I0611 18:37:02.569593 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-vcdjb" event={"ID":"984d8be7-df73-433d-8804-d740a26ef757","Type":"ContainerStarted","Data":"84c0f26897ac12201c6999834876b9a72fbbae7d188b55d663c531c5d8465959"} Jun 11 18:37:03.415898 ip-10-0-141-55 kubenswrapper[2578]: I0611 18:37:03.415863 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-hjkh2" Jun 11 18:37:03.416347 ip-10-0-141-55 kubenswrapper[2578]: E0611 18:37:03.415983 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-hjkh2" podUID="04686d4c-5c3d-49ac-9b61-09e80f5e4dff" Jun 11 18:37:04.416101 ip-10-0-141-55 kubenswrapper[2578]: I0611 18:37:04.416062 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-lvmjk" Jun 11 18:37:04.416613 ip-10-0-141-55 kubenswrapper[2578]: E0611 18:37:04.416164 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-lvmjk" podUID="1261112f-ce68-462a-a73e-fa1942159096" Jun 11 18:37:04.416613 ip-10-0-141-55 kubenswrapper[2578]: I0611 18:37:04.416178 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-x5mvk" Jun 11 18:37:04.416613 ip-10-0-141-55 kubenswrapper[2578]: E0611 18:37:04.416268 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-x5mvk" podUID="1257ce19-745b-4d56-b701-9fecd0879315" Jun 11 18:37:04.577019 ip-10-0-141-55 kubenswrapper[2578]: I0611 18:37:04.576924 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-vcdjb" event={"ID":"984d8be7-df73-433d-8804-d740a26ef757","Type":"ContainerStarted","Data":"917b5fc6ca4fd63c39b81520cf36fbff84081dec8279707dc4c21547ca770e4f"} Jun 11 18:37:04.579319 ip-10-0-141-55 kubenswrapper[2578]: I0611 18:37:04.579292 2578 generic.go:356] "Generic (PLEG): container finished" podID="cd01660e-add6-419b-8f21-9dbd7c1efd86" containerID="a4d808b9e06e7211f05cc9d0f9bb86f0c6484279b3fa0775053461c6a6052e0b" exitCode=0 Jun 11 18:37:04.579454 ip-10-0-141-55 kubenswrapper[2578]: I0611 18:37:04.579331 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-jttqf" event={"ID":"cd01660e-add6-419b-8f21-9dbd7c1efd86","Type":"ContainerDied","Data":"a4d808b9e06e7211f05cc9d0f9bb86f0c6484279b3fa0775053461c6a6052e0b"} Jun 11 18:37:05.416045 ip-10-0-141-55 kubenswrapper[2578]: I0611 18:37:05.416014 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-hjkh2" Jun 11 18:37:05.416208 ip-10-0-141-55 kubenswrapper[2578]: E0611 18:37:05.416105 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-hjkh2" podUID="04686d4c-5c3d-49ac-9b61-09e80f5e4dff" Jun 11 18:37:06.416078 ip-10-0-141-55 kubenswrapper[2578]: I0611 18:37:06.415952 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-lvmjk" Jun 11 18:37:06.416195 ip-10-0-141-55 kubenswrapper[2578]: I0611 18:37:06.416030 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-x5mvk" Jun 11 18:37:06.416195 ip-10-0-141-55 kubenswrapper[2578]: E0611 18:37:06.416171 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-lvmjk" podUID="1261112f-ce68-462a-a73e-fa1942159096" Jun 11 18:37:06.416538 ip-10-0-141-55 kubenswrapper[2578]: E0611 18:37:06.416225 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-x5mvk" podUID="1257ce19-745b-4d56-b701-9fecd0879315" Jun 11 18:37:06.588280 ip-10-0-141-55 kubenswrapper[2578]: I0611 18:37:06.588245 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-vcdjb" event={"ID":"984d8be7-df73-433d-8804-d740a26ef757","Type":"ContainerStarted","Data":"c8db5efb5190031764f430fcd2b0b193e2fc467c271373a330e78775c7380281"} Jun 11 18:37:06.588653 ip-10-0-141-55 kubenswrapper[2578]: I0611 18:37:06.588617 2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-vcdjb" Jun 11 18:37:06.606690 ip-10-0-141-55 kubenswrapper[2578]: I0611 18:37:06.606666 2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-vcdjb" Jun 11 18:37:06.614800 ip-10-0-141-55 kubenswrapper[2578]: I0611 18:37:06.614759 2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ovn-kubernetes/ovnkube-node-vcdjb" podStartSLOduration=5.877084314 podStartE2EDuration="30.614744753s" totalImagesPullingTime="24.737660439s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-11 18:36:36 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-11 18:37:06.613484475 +0000 UTC m=+32.568159081" watchObservedRunningTime="2026-06-11 18:37:06.614744753 +0000 UTC m=+32.569419356" Jun 11 18:37:07.415784 ip-10-0-141-55 kubenswrapper[2578]: I0611 18:37:07.415747 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-hjkh2" Jun 11 18:37:07.415979 ip-10-0-141-55 kubenswrapper[2578]: E0611 18:37:07.415879 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-hjkh2" podUID="04686d4c-5c3d-49ac-9b61-09e80f5e4dff" Jun 11 18:37:07.590987 ip-10-0-141-55 kubenswrapper[2578]: I0611 18:37:07.590957 2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-vcdjb" Jun 11 18:37:07.591506 ip-10-0-141-55 kubenswrapper[2578]: I0611 18:37:07.591025 2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-vcdjb" Jun 11 18:37:07.607902 ip-10-0-141-55 kubenswrapper[2578]: I0611 18:37:07.607876 2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-vcdjb" Jun 11 18:37:07.912845 ip-10-0-141-55 kubenswrapper[2578]: I0611 18:37:07.912803 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-c4ths\" (UniqueName: \"kubernetes.io/projected/04686d4c-5c3d-49ac-9b61-09e80f5e4dff-kube-api-access-c4ths\") pod \"network-check-target-hjkh2\" (UID: \"04686d4c-5c3d-49ac-9b61-09e80f5e4dff\") " pod="openshift-network-diagnostics/network-check-target-hjkh2" Jun 11 18:37:07.913019 ip-10-0-141-55 kubenswrapper[2578]: I0611 18:37:07.912861 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/1257ce19-745b-4d56-b701-9fecd0879315-metrics-certs\") pod \"network-metrics-daemon-x5mvk\" (UID: \"1257ce19-745b-4d56-b701-9fecd0879315\") " pod="openshift-multus/network-metrics-daemon-x5mvk" Jun 11 18:37:07.913019 ip-10-0-141-55 kubenswrapper[2578]: E0611 18:37:07.912981 2578 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jun 11 18:37:07.913019 ip-10-0-141-55 kubenswrapper[2578]: E0611 18:37:07.913005 2578 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jun 11 18:37:07.913122 ip-10-0-141-55 kubenswrapper[2578]: E0611 18:37:07.913005 2578 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jun 11 18:37:07.913122 ip-10-0-141-55 kubenswrapper[2578]: E0611 18:37:07.913089 2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/1257ce19-745b-4d56-b701-9fecd0879315-metrics-certs podName:1257ce19-745b-4d56-b701-9fecd0879315 nodeName:}" failed. No retries permitted until 2026-06-11 18:37:39.913071957 +0000 UTC m=+65.867746545 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/1257ce19-745b-4d56-b701-9fecd0879315-metrics-certs") pod "network-metrics-daemon-x5mvk" (UID: "1257ce19-745b-4d56-b701-9fecd0879315") : object "openshift-multus"/"metrics-daemon-secret" not registered Jun 11 18:37:07.913122 ip-10-0-141-55 kubenswrapper[2578]: E0611 18:37:07.913020 2578 projected.go:196] Error preparing data for projected volume kube-api-access-c4ths for pod openshift-network-diagnostics/network-check-target-hjkh2: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 11 18:37:07.913217 ip-10-0-141-55 kubenswrapper[2578]: E0611 18:37:07.913162 2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/04686d4c-5c3d-49ac-9b61-09e80f5e4dff-kube-api-access-c4ths podName:04686d4c-5c3d-49ac-9b61-09e80f5e4dff nodeName:}" failed. No retries permitted until 2026-06-11 18:37:39.91314826 +0000 UTC m=+65.867822848 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "kube-api-access-c4ths" (UniqueName: "kubernetes.io/projected/04686d4c-5c3d-49ac-9b61-09e80f5e4dff-kube-api-access-c4ths") pod "network-check-target-hjkh2" (UID: "04686d4c-5c3d-49ac-9b61-09e80f5e4dff") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 11 18:37:08.416085 ip-10-0-141-55 kubenswrapper[2578]: I0611 18:37:08.416050 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-x5mvk" Jun 11 18:37:08.416085 ip-10-0-141-55 kubenswrapper[2578]: I0611 18:37:08.416088 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-lvmjk" Jun 11 18:37:08.416420 ip-10-0-141-55 kubenswrapper[2578]: E0611 18:37:08.416190 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-x5mvk" podUID="1257ce19-745b-4d56-b701-9fecd0879315" Jun 11 18:37:08.416420 ip-10-0-141-55 kubenswrapper[2578]: E0611 18:37:08.416341 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-lvmjk" podUID="1261112f-ce68-462a-a73e-fa1942159096" Jun 11 18:37:09.415740 ip-10-0-141-55 kubenswrapper[2578]: I0611 18:37:09.415710 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-hjkh2" Jun 11 18:37:09.416212 ip-10-0-141-55 kubenswrapper[2578]: E0611 18:37:09.415840 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-hjkh2" podUID="04686d4c-5c3d-49ac-9b61-09e80f5e4dff" Jun 11 18:37:10.415318 ip-10-0-141-55 kubenswrapper[2578]: I0611 18:37:10.415259 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-x5mvk" Jun 11 18:37:10.415477 ip-10-0-141-55 kubenswrapper[2578]: E0611 18:37:10.415373 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-x5mvk" podUID="1257ce19-745b-4d56-b701-9fecd0879315" Jun 11 18:37:10.415477 ip-10-0-141-55 kubenswrapper[2578]: I0611 18:37:10.415419 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-lvmjk" Jun 11 18:37:10.415566 ip-10-0-141-55 kubenswrapper[2578]: E0611 18:37:10.415501 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-lvmjk" podUID="1261112f-ce68-462a-a73e-fa1942159096" Jun 11 18:37:10.602499 ip-10-0-141-55 kubenswrapper[2578]: I0611 18:37:10.602462 2578 generic.go:356] "Generic (PLEG): container finished" podID="cd01660e-add6-419b-8f21-9dbd7c1efd86" containerID="a3a5e0164ac53175652d70ef5bf493e97284fddf8e32677772e116d476a5a338" exitCode=0 Jun 11 18:37:10.602891 ip-10-0-141-55 kubenswrapper[2578]: I0611 18:37:10.602506 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-jttqf" event={"ID":"cd01660e-add6-419b-8f21-9dbd7c1efd86","Type":"ContainerDied","Data":"a3a5e0164ac53175652d70ef5bf493e97284fddf8e32677772e116d476a5a338"} Jun 11 18:37:11.415675 ip-10-0-141-55 kubenswrapper[2578]: I0611 18:37:11.415648 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-hjkh2" Jun 11 18:37:11.415835 ip-10-0-141-55 kubenswrapper[2578]: E0611 18:37:11.415737 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-hjkh2" podUID="04686d4c-5c3d-49ac-9b61-09e80f5e4dff" Jun 11 18:37:11.607608 ip-10-0-141-55 kubenswrapper[2578]: I0611 18:37:11.607575 2578 generic.go:356] "Generic (PLEG): container finished" podID="cd01660e-add6-419b-8f21-9dbd7c1efd86" containerID="9fe3b0aa31e053496b43ae5c5ec8e6a891a837ea41f98697792fac8914a1af4d" exitCode=0 Jun 11 18:37:11.608061 ip-10-0-141-55 kubenswrapper[2578]: I0611 18:37:11.607648 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-jttqf" event={"ID":"cd01660e-add6-419b-8f21-9dbd7c1efd86","Type":"ContainerDied","Data":"9fe3b0aa31e053496b43ae5c5ec8e6a891a837ea41f98697792fac8914a1af4d"} Jun 11 18:37:12.415220 ip-10-0-141-55 kubenswrapper[2578]: I0611 18:37:12.415182 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-x5mvk" Jun 11 18:37:12.415407 ip-10-0-141-55 kubenswrapper[2578]: E0611 18:37:12.415295 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-x5mvk" podUID="1257ce19-745b-4d56-b701-9fecd0879315" Jun 11 18:37:12.415407 ip-10-0-141-55 kubenswrapper[2578]: I0611 18:37:12.415346 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-lvmjk" Jun 11 18:37:12.415535 ip-10-0-141-55 kubenswrapper[2578]: E0611 18:37:12.415432 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-lvmjk" podUID="1261112f-ce68-462a-a73e-fa1942159096" Jun 11 18:37:12.612418 ip-10-0-141-55 kubenswrapper[2578]: I0611 18:37:12.612384 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-jttqf" event={"ID":"cd01660e-add6-419b-8f21-9dbd7c1efd86","Type":"ContainerStarted","Data":"40459fe57a2db030699bcd553b88327ee431348597e47155bd2241d0285a8c63"} Jun 11 18:37:12.637736 ip-10-0-141-55 kubenswrapper[2578]: I0611 18:37:12.637693 2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-additional-cni-plugins-jttqf" podStartSLOduration=11.412694617 podStartE2EDuration="37.637680285s" totalImagesPullingTime="26.224985668s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-11 18:36:35 +0000 UTC" imagePullSessionsCount=5 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-11 18:37:12.637459818 +0000 UTC m=+38.592134449" watchObservedRunningTime="2026-06-11 18:37:12.637680285 +0000 UTC m=+38.592354891" Jun 11 18:37:13.415998 ip-10-0-141-55 kubenswrapper[2578]: I0611 18:37:13.415961 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-hjkh2" Jun 11 18:37:13.416175 ip-10-0-141-55 kubenswrapper[2578]: E0611 18:37:13.416062 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-hjkh2" podUID="04686d4c-5c3d-49ac-9b61-09e80f5e4dff" Jun 11 18:37:14.416071 ip-10-0-141-55 kubenswrapper[2578]: I0611 18:37:14.416039 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-lvmjk" Jun 11 18:37:14.416543 ip-10-0-141-55 kubenswrapper[2578]: E0611 18:37:14.416125 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-lvmjk" podUID="1261112f-ce68-462a-a73e-fa1942159096" Jun 11 18:37:14.416543 ip-10-0-141-55 kubenswrapper[2578]: I0611 18:37:14.416146 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-x5mvk" Jun 11 18:37:14.416543 ip-10-0-141-55 kubenswrapper[2578]: E0611 18:37:14.416252 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-x5mvk" podUID="1257ce19-745b-4d56-b701-9fecd0879315" Jun 11 18:37:15.415449 ip-10-0-141-55 kubenswrapper[2578]: I0611 18:37:15.415268 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-hjkh2" Jun 11 18:37:15.415612 ip-10-0-141-55 kubenswrapper[2578]: E0611 18:37:15.415518 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-hjkh2" podUID="04686d4c-5c3d-49ac-9b61-09e80f5e4dff" Jun 11 18:37:16.279949 ip-10-0-141-55 kubenswrapper[2578]: I0611 18:37:16.279919 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/1261112f-ce68-462a-a73e-fa1942159096-original-pull-secret\") pod \"global-pull-secret-syncer-lvmjk\" (UID: \"1261112f-ce68-462a-a73e-fa1942159096\") " pod="kube-system/global-pull-secret-syncer-lvmjk" Jun 11 18:37:16.280324 ip-10-0-141-55 kubenswrapper[2578]: E0611 18:37:16.280015 2578 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jun 11 18:37:16.280324 ip-10-0-141-55 kubenswrapper[2578]: E0611 18:37:16.280061 2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/1261112f-ce68-462a-a73e-fa1942159096-original-pull-secret podName:1261112f-ce68-462a-a73e-fa1942159096 nodeName:}" failed. No retries permitted until 2026-06-11 18:37:48.280049004 +0000 UTC m=+74.234723589 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/1261112f-ce68-462a-a73e-fa1942159096-original-pull-secret") pod "global-pull-secret-syncer-lvmjk" (UID: "1261112f-ce68-462a-a73e-fa1942159096") : object "kube-system"/"original-pull-secret" not registered Jun 11 18:37:16.415736 ip-10-0-141-55 kubenswrapper[2578]: I0611 18:37:16.415706 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-x5mvk" Jun 11 18:37:16.415935 ip-10-0-141-55 kubenswrapper[2578]: E0611 18:37:16.415819 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-x5mvk" podUID="1257ce19-745b-4d56-b701-9fecd0879315" Jun 11 18:37:16.415935 ip-10-0-141-55 kubenswrapper[2578]: I0611 18:37:16.415919 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-lvmjk" Jun 11 18:37:16.416066 ip-10-0-141-55 kubenswrapper[2578]: E0611 18:37:16.416043 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-lvmjk" podUID="1261112f-ce68-462a-a73e-fa1942159096" Jun 11 18:37:17.417767 ip-10-0-141-55 kubenswrapper[2578]: I0611 18:37:17.415446 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-hjkh2" Jun 11 18:37:17.417767 ip-10-0-141-55 kubenswrapper[2578]: E0611 18:37:17.415622 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-hjkh2" podUID="04686d4c-5c3d-49ac-9b61-09e80f5e4dff" Jun 11 18:37:18.416252 ip-10-0-141-55 kubenswrapper[2578]: I0611 18:37:18.416217 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-x5mvk" Jun 11 18:37:18.416503 ip-10-0-141-55 kubenswrapper[2578]: E0611 18:37:18.416319 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-x5mvk" podUID="1257ce19-745b-4d56-b701-9fecd0879315" Jun 11 18:37:18.416503 ip-10-0-141-55 kubenswrapper[2578]: I0611 18:37:18.416374 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-lvmjk" Jun 11 18:37:18.416503 ip-10-0-141-55 kubenswrapper[2578]: E0611 18:37:18.416449 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-lvmjk" podUID="1261112f-ce68-462a-a73e-fa1942159096" Jun 11 18:37:19.416089 ip-10-0-141-55 kubenswrapper[2578]: I0611 18:37:19.416063 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-hjkh2" Jun 11 18:37:19.416463 ip-10-0-141-55 kubenswrapper[2578]: E0611 18:37:19.416153 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-hjkh2" podUID="04686d4c-5c3d-49ac-9b61-09e80f5e4dff" Jun 11 18:37:20.415950 ip-10-0-141-55 kubenswrapper[2578]: I0611 18:37:20.415910 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-x5mvk" Jun 11 18:37:20.415950 ip-10-0-141-55 kubenswrapper[2578]: I0611 18:37:20.415943 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-lvmjk" Jun 11 18:37:20.416409 ip-10-0-141-55 kubenswrapper[2578]: E0611 18:37:20.416070 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-x5mvk" podUID="1257ce19-745b-4d56-b701-9fecd0879315" Jun 11 18:37:20.416409 ip-10-0-141-55 kubenswrapper[2578]: E0611 18:37:20.416172 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-lvmjk" podUID="1261112f-ce68-462a-a73e-fa1942159096" Jun 11 18:37:21.415208 ip-10-0-141-55 kubenswrapper[2578]: I0611 18:37:21.415175 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-hjkh2" Jun 11 18:37:21.415388 ip-10-0-141-55 kubenswrapper[2578]: E0611 18:37:21.415282 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-hjkh2" podUID="04686d4c-5c3d-49ac-9b61-09e80f5e4dff" Jun 11 18:37:22.416064 ip-10-0-141-55 kubenswrapper[2578]: I0611 18:37:22.416028 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-x5mvk" Jun 11 18:37:22.416448 ip-10-0-141-55 kubenswrapper[2578]: E0611 18:37:22.416145 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-x5mvk" podUID="1257ce19-745b-4d56-b701-9fecd0879315" Jun 11 18:37:22.416448 ip-10-0-141-55 kubenswrapper[2578]: I0611 18:37:22.416200 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-lvmjk" Jun 11 18:37:22.416448 ip-10-0-141-55 kubenswrapper[2578]: E0611 18:37:22.416278 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-lvmjk" podUID="1261112f-ce68-462a-a73e-fa1942159096" Jun 11 18:37:23.415448 ip-10-0-141-55 kubenswrapper[2578]: I0611 18:37:23.415416 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-hjkh2" Jun 11 18:37:23.415645 ip-10-0-141-55 kubenswrapper[2578]: E0611 18:37:23.415516 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-hjkh2" podUID="04686d4c-5c3d-49ac-9b61-09e80f5e4dff" Jun 11 18:37:24.416265 ip-10-0-141-55 kubenswrapper[2578]: I0611 18:37:24.416226 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-x5mvk" Jun 11 18:37:24.416793 ip-10-0-141-55 kubenswrapper[2578]: I0611 18:37:24.416270 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-lvmjk" Jun 11 18:37:24.416793 ip-10-0-141-55 kubenswrapper[2578]: E0611 18:37:24.416337 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-x5mvk" podUID="1257ce19-745b-4d56-b701-9fecd0879315" Jun 11 18:37:24.416793 ip-10-0-141-55 kubenswrapper[2578]: E0611 18:37:24.416444 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-lvmjk" podUID="1261112f-ce68-462a-a73e-fa1942159096" Jun 11 18:37:25.415920 ip-10-0-141-55 kubenswrapper[2578]: I0611 18:37:25.415886 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-hjkh2" Jun 11 18:37:25.416124 ip-10-0-141-55 kubenswrapper[2578]: E0611 18:37:25.415985 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-hjkh2" podUID="04686d4c-5c3d-49ac-9b61-09e80f5e4dff" Jun 11 18:37:26.415802 ip-10-0-141-55 kubenswrapper[2578]: I0611 18:37:26.415769 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-x5mvk" Jun 11 18:37:26.416182 ip-10-0-141-55 kubenswrapper[2578]: E0611 18:37:26.415876 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-x5mvk" podUID="1257ce19-745b-4d56-b701-9fecd0879315" Jun 11 18:37:26.416182 ip-10-0-141-55 kubenswrapper[2578]: I0611 18:37:26.415929 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-lvmjk" Jun 11 18:37:26.416182 ip-10-0-141-55 kubenswrapper[2578]: E0611 18:37:26.416011 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-lvmjk" podUID="1261112f-ce68-462a-a73e-fa1942159096" Jun 11 18:37:27.416059 ip-10-0-141-55 kubenswrapper[2578]: I0611 18:37:27.416027 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-hjkh2" Jun 11 18:37:27.416439 ip-10-0-141-55 kubenswrapper[2578]: E0611 18:37:27.416128 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-hjkh2" podUID="04686d4c-5c3d-49ac-9b61-09e80f5e4dff" Jun 11 18:37:28.416006 ip-10-0-141-55 kubenswrapper[2578]: I0611 18:37:28.415980 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-lvmjk" Jun 11 18:37:28.416178 ip-10-0-141-55 kubenswrapper[2578]: E0611 18:37:28.416078 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-lvmjk" podUID="1261112f-ce68-462a-a73e-fa1942159096" Jun 11 18:37:28.416178 ip-10-0-141-55 kubenswrapper[2578]: I0611 18:37:28.416152 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-x5mvk" Jun 11 18:37:28.416477 ip-10-0-141-55 kubenswrapper[2578]: E0611 18:37:28.416242 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-x5mvk" podUID="1257ce19-745b-4d56-b701-9fecd0879315" Jun 11 18:37:29.415912 ip-10-0-141-55 kubenswrapper[2578]: I0611 18:37:29.415885 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-hjkh2" Jun 11 18:37:29.416055 ip-10-0-141-55 kubenswrapper[2578]: E0611 18:37:29.415987 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-hjkh2" podUID="04686d4c-5c3d-49ac-9b61-09e80f5e4dff" Jun 11 18:37:29.563626 ip-10-0-141-55 kubenswrapper[2578]: I0611 18:37:29.563593 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-hjkh2"] Jun 11 18:37:29.567969 ip-10-0-141-55 kubenswrapper[2578]: I0611 18:37:29.567944 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-lvmjk"] Jun 11 18:37:29.568207 ip-10-0-141-55 kubenswrapper[2578]: I0611 18:37:29.568193 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-lvmjk" Jun 11 18:37:29.568423 ip-10-0-141-55 kubenswrapper[2578]: E0611 18:37:29.568394 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-lvmjk" podUID="1261112f-ce68-462a-a73e-fa1942159096" Jun 11 18:37:29.568566 ip-10-0-141-55 kubenswrapper[2578]: I0611 18:37:29.568535 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-x5mvk"] Jun 11 18:37:29.568646 ip-10-0-141-55 kubenswrapper[2578]: I0611 18:37:29.568630 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-x5mvk" Jun 11 18:37:29.568747 ip-10-0-141-55 kubenswrapper[2578]: E0611 18:37:29.568732 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-x5mvk" podUID="1257ce19-745b-4d56-b701-9fecd0879315" Jun 11 18:37:29.653490 ip-10-0-141-55 kubenswrapper[2578]: I0611 18:37:29.653459 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-hjkh2" Jun 11 18:37:29.653674 ip-10-0-141-55 kubenswrapper[2578]: E0611 18:37:29.653583 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-hjkh2" podUID="04686d4c-5c3d-49ac-9b61-09e80f5e4dff" Jun 11 18:37:31.415431 ip-10-0-141-55 kubenswrapper[2578]: I0611 18:37:31.415398 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-x5mvk" Jun 11 18:37:31.415976 ip-10-0-141-55 kubenswrapper[2578]: I0611 18:37:31.415399 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-hjkh2" Jun 11 18:37:31.415976 ip-10-0-141-55 kubenswrapper[2578]: E0611 18:37:31.415500 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-x5mvk" podUID="1257ce19-745b-4d56-b701-9fecd0879315" Jun 11 18:37:31.415976 ip-10-0-141-55 kubenswrapper[2578]: I0611 18:37:31.415531 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-lvmjk" Jun 11 18:37:31.415976 ip-10-0-141-55 kubenswrapper[2578]: E0611 18:37:31.415673 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-hjkh2" podUID="04686d4c-5c3d-49ac-9b61-09e80f5e4dff" Jun 11 18:37:31.415976 ip-10-0-141-55 kubenswrapper[2578]: E0611 18:37:31.415779 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-lvmjk" podUID="1261112f-ce68-462a-a73e-fa1942159096" Jun 11 18:37:33.416217 ip-10-0-141-55 kubenswrapper[2578]: I0611 18:37:33.416188 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-hjkh2" Jun 11 18:37:33.416217 ip-10-0-141-55 kubenswrapper[2578]: I0611 18:37:33.416218 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-x5mvk" Jun 11 18:37:33.416217 ip-10-0-141-55 kubenswrapper[2578]: I0611 18:37:33.416228 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-lvmjk" Jun 11 18:37:33.416708 ip-10-0-141-55 kubenswrapper[2578]: E0611 18:37:33.416311 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-hjkh2" podUID="04686d4c-5c3d-49ac-9b61-09e80f5e4dff" Jun 11 18:37:33.416708 ip-10-0-141-55 kubenswrapper[2578]: E0611 18:37:33.416438 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-lvmjk" podUID="1261112f-ce68-462a-a73e-fa1942159096" Jun 11 18:37:33.416708 ip-10-0-141-55 kubenswrapper[2578]: E0611 18:37:33.416517 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-x5mvk" podUID="1257ce19-745b-4d56-b701-9fecd0879315" Jun 11 18:37:33.416963 ip-10-0-141-55 kubenswrapper[2578]: I0611 18:37:33.416945 2578 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-141-55.ec2.internal" event="NodeReady" Jun 11 18:37:33.417089 ip-10-0-141-55 kubenswrapper[2578]: I0611 18:37:33.417078 2578 kubelet_node_status.go:489] "Fast updating node status as it just became ready" Jun 11 18:37:33.466612 ip-10-0-141-55 kubenswrapper[2578]: I0611 18:37:33.466585 2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-dns/dns-default-ng7mz"] Jun 11 18:37:33.468882 ip-10-0-141-55 kubenswrapper[2578]: I0611 18:37:33.468861 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-ng7mz" Jun 11 18:37:33.471698 ip-10-0-141-55 kubenswrapper[2578]: I0611 18:37:33.471516 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"dns-default\"" Jun 11 18:37:33.471806 ip-10-0-141-55 kubenswrapper[2578]: I0611 18:37:33.471543 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-nhg9x\"" Jun 11 18:37:33.471806 ip-10-0-141-55 kubenswrapper[2578]: I0611 18:37:33.471626 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-default-metrics-tls\"" Jun 11 18:37:33.481184 ip-10-0-141-55 kubenswrapper[2578]: I0611 18:37:33.481164 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-ng7mz"] Jun 11 18:37:33.490365 ip-10-0-141-55 kubenswrapper[2578]: I0611 18:37:33.490344 2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-insights/insights-runtime-extractor-v8f8j"] Jun 11 18:37:33.492825 ip-10-0-141-55 kubenswrapper[2578]: I0611 18:37:33.492804 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-v8f8j" Jun 11 18:37:33.495921 ip-10-0-141-55 kubenswrapper[2578]: I0611 18:37:33.495887 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-tls\"" Jun 11 18:37:33.496024 ip-10-0-141-55 kubenswrapper[2578]: I0611 18:37:33.495940 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"openshift-service-ca.crt\"" Jun 11 18:37:33.496024 ip-10-0-141-55 kubenswrapper[2578]: I0611 18:37:33.495968 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-sa-dockercfg-rbv24\"" Jun 11 18:37:33.496221 ip-10-0-141-55 kubenswrapper[2578]: I0611 18:37:33.496203 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-root-ca.crt\"" Jun 11 18:37:33.496301 ip-10-0-141-55 kubenswrapper[2578]: I0611 18:37:33.496287 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-rbac-proxy\"" Jun 11 18:37:33.505900 ip-10-0-141-55 kubenswrapper[2578]: I0611 18:37:33.505882 2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress-canary/ingress-canary-9vvns"] Jun 11 18:37:33.506344 ip-10-0-141-55 kubenswrapper[2578]: I0611 18:37:33.506323 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/a52171ba-7228-43ac-8a94-65e91fec2043-metrics-tls\") pod \"dns-default-ng7mz\" (UID: \"a52171ba-7228-43ac-8a94-65e91fec2043\") " pod="openshift-dns/dns-default-ng7mz" Jun 11 18:37:33.506436 ip-10-0-141-55 kubenswrapper[2578]: I0611 18:37:33.506368 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/a52171ba-7228-43ac-8a94-65e91fec2043-config-volume\") pod \"dns-default-ng7mz\" (UID: \"a52171ba-7228-43ac-8a94-65e91fec2043\") " pod="openshift-dns/dns-default-ng7mz" Jun 11 18:37:33.506436 ip-10-0-141-55 kubenswrapper[2578]: I0611 18:37:33.506394 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/a52171ba-7228-43ac-8a94-65e91fec2043-tmp-dir\") pod \"dns-default-ng7mz\" (UID: \"a52171ba-7228-43ac-8a94-65e91fec2043\") " pod="openshift-dns/dns-default-ng7mz" Jun 11 18:37:33.506543 ip-10-0-141-55 kubenswrapper[2578]: I0611 18:37:33.506504 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8544l\" (UniqueName: \"kubernetes.io/projected/a52171ba-7228-43ac-8a94-65e91fec2043-kube-api-access-8544l\") pod \"dns-default-ng7mz\" (UID: \"a52171ba-7228-43ac-8a94-65e91fec2043\") " pod="openshift-dns/dns-default-ng7mz" Jun 11 18:37:33.508169 ip-10-0-141-55 kubenswrapper[2578]: I0611 18:37:33.508153 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-9vvns" Jun 11 18:37:33.513388 ip-10-0-141-55 kubenswrapper[2578]: I0611 18:37:33.513370 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"canary-serving-cert\"" Jun 11 18:37:33.513689 ip-10-0-141-55 kubenswrapper[2578]: I0611 18:37:33.513668 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"kube-root-ca.crt\"" Jun 11 18:37:33.513989 ip-10-0-141-55 kubenswrapper[2578]: I0611 18:37:33.513674 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"openshift-service-ca.crt\"" Jun 11 18:37:33.514641 ip-10-0-141-55 kubenswrapper[2578]: I0611 18:37:33.514621 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-v8f8j"] Jun 11 18:37:33.516943 ip-10-0-141-55 kubenswrapper[2578]: I0611 18:37:33.516923 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"default-dockercfg-nsdln\"" Jun 11 18:37:33.533569 ip-10-0-141-55 kubenswrapper[2578]: I0611 18:37:33.533525 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-9vvns"] Jun 11 18:37:33.607622 ip-10-0-141-55 kubenswrapper[2578]: I0611 18:37:33.607595 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/a52171ba-7228-43ac-8a94-65e91fec2043-config-volume\") pod \"dns-default-ng7mz\" (UID: \"a52171ba-7228-43ac-8a94-65e91fec2043\") " pod="openshift-dns/dns-default-ng7mz" Jun 11 18:37:33.607755 ip-10-0-141-55 kubenswrapper[2578]: I0611 18:37:33.607710 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/86d2dc5a-8200-4c9e-be7e-1cc5ed11905b-data-volume\") pod \"insights-runtime-extractor-v8f8j\" (UID: \"86d2dc5a-8200-4c9e-be7e-1cc5ed11905b\") " pod="openshift-insights/insights-runtime-extractor-v8f8j" Jun 11 18:37:33.607755 ip-10-0-141-55 kubenswrapper[2578]: I0611 18:37:33.607745 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ghctn\" (UniqueName: \"kubernetes.io/projected/21df7fc9-da9c-4882-917c-2e16d262dd11-kube-api-access-ghctn\") pod \"ingress-canary-9vvns\" (UID: \"21df7fc9-da9c-4882-917c-2e16d262dd11\") " pod="openshift-ingress-canary/ingress-canary-9vvns" Jun 11 18:37:33.607823 ip-10-0-141-55 kubenswrapper[2578]: I0611 18:37:33.607762 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/21df7fc9-da9c-4882-917c-2e16d262dd11-cert\") pod \"ingress-canary-9vvns\" (UID: \"21df7fc9-da9c-4882-917c-2e16d262dd11\") " pod="openshift-ingress-canary/ingress-canary-9vvns" Jun 11 18:37:33.607823 ip-10-0-141-55 kubenswrapper[2578]: I0611 18:37:33.607786 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/86d2dc5a-8200-4c9e-be7e-1cc5ed11905b-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-v8f8j\" (UID: \"86d2dc5a-8200-4c9e-be7e-1cc5ed11905b\") " pod="openshift-insights/insights-runtime-extractor-v8f8j" Jun 11 18:37:33.607823 ip-10-0-141-55 kubenswrapper[2578]: I0611 18:37:33.607817 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/a52171ba-7228-43ac-8a94-65e91fec2043-tmp-dir\") pod \"dns-default-ng7mz\" (UID: \"a52171ba-7228-43ac-8a94-65e91fec2043\") " pod="openshift-dns/dns-default-ng7mz" Jun 11 18:37:33.607917 ip-10-0-141-55 kubenswrapper[2578]: I0611 18:37:33.607882 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8544l\" (UniqueName: \"kubernetes.io/projected/a52171ba-7228-43ac-8a94-65e91fec2043-kube-api-access-8544l\") pod \"dns-default-ng7mz\" (UID: \"a52171ba-7228-43ac-8a94-65e91fec2043\") " pod="openshift-dns/dns-default-ng7mz" Jun 11 18:37:33.607917 ip-10-0-141-55 kubenswrapper[2578]: I0611 18:37:33.607910 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/86d2dc5a-8200-4c9e-be7e-1cc5ed11905b-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-v8f8j\" (UID: \"86d2dc5a-8200-4c9e-be7e-1cc5ed11905b\") " pod="openshift-insights/insights-runtime-extractor-v8f8j" Jun 11 18:37:33.608014 ip-10-0-141-55 kubenswrapper[2578]: I0611 18:37:33.607929 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-bp6vc\" (UniqueName: \"kubernetes.io/projected/86d2dc5a-8200-4c9e-be7e-1cc5ed11905b-kube-api-access-bp6vc\") pod \"insights-runtime-extractor-v8f8j\" (UID: \"86d2dc5a-8200-4c9e-be7e-1cc5ed11905b\") " pod="openshift-insights/insights-runtime-extractor-v8f8j" Jun 11 18:37:33.608014 ip-10-0-141-55 kubenswrapper[2578]: I0611 18:37:33.607976 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/a52171ba-7228-43ac-8a94-65e91fec2043-metrics-tls\") pod \"dns-default-ng7mz\" (UID: \"a52171ba-7228-43ac-8a94-65e91fec2043\") " pod="openshift-dns/dns-default-ng7mz" Jun 11 18:37:33.608014 ip-10-0-141-55 kubenswrapper[2578]: I0611 18:37:33.607995 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/86d2dc5a-8200-4c9e-be7e-1cc5ed11905b-crio-socket\") pod \"insights-runtime-extractor-v8f8j\" (UID: \"86d2dc5a-8200-4c9e-be7e-1cc5ed11905b\") " pod="openshift-insights/insights-runtime-extractor-v8f8j" Jun 11 18:37:33.608163 ip-10-0-141-55 kubenswrapper[2578]: I0611 18:37:33.608116 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/a52171ba-7228-43ac-8a94-65e91fec2043-tmp-dir\") pod \"dns-default-ng7mz\" (UID: \"a52171ba-7228-43ac-8a94-65e91fec2043\") " pod="openshift-dns/dns-default-ng7mz" Jun 11 18:37:33.608163 ip-10-0-141-55 kubenswrapper[2578]: I0611 18:37:33.608145 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/a52171ba-7228-43ac-8a94-65e91fec2043-config-volume\") pod \"dns-default-ng7mz\" (UID: \"a52171ba-7228-43ac-8a94-65e91fec2043\") " pod="openshift-dns/dns-default-ng7mz" Jun 11 18:37:33.612049 ip-10-0-141-55 kubenswrapper[2578]: I0611 18:37:33.612021 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/a52171ba-7228-43ac-8a94-65e91fec2043-metrics-tls\") pod \"dns-default-ng7mz\" (UID: \"a52171ba-7228-43ac-8a94-65e91fec2043\") " pod="openshift-dns/dns-default-ng7mz" Jun 11 18:37:33.616414 ip-10-0-141-55 kubenswrapper[2578]: I0611 18:37:33.616387 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-8544l\" (UniqueName: \"kubernetes.io/projected/a52171ba-7228-43ac-8a94-65e91fec2043-kube-api-access-8544l\") pod \"dns-default-ng7mz\" (UID: \"a52171ba-7228-43ac-8a94-65e91fec2043\") " pod="openshift-dns/dns-default-ng7mz" Jun 11 18:37:33.709357 ip-10-0-141-55 kubenswrapper[2578]: I0611 18:37:33.709256 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/86d2dc5a-8200-4c9e-be7e-1cc5ed11905b-data-volume\") pod \"insights-runtime-extractor-v8f8j\" (UID: \"86d2dc5a-8200-4c9e-be7e-1cc5ed11905b\") " pod="openshift-insights/insights-runtime-extractor-v8f8j" Jun 11 18:37:33.709357 ip-10-0-141-55 kubenswrapper[2578]: I0611 18:37:33.709303 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ghctn\" (UniqueName: \"kubernetes.io/projected/21df7fc9-da9c-4882-917c-2e16d262dd11-kube-api-access-ghctn\") pod \"ingress-canary-9vvns\" (UID: \"21df7fc9-da9c-4882-917c-2e16d262dd11\") " pod="openshift-ingress-canary/ingress-canary-9vvns" Jun 11 18:37:33.709357 ip-10-0-141-55 kubenswrapper[2578]: I0611 18:37:33.709321 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/21df7fc9-da9c-4882-917c-2e16d262dd11-cert\") pod \"ingress-canary-9vvns\" (UID: \"21df7fc9-da9c-4882-917c-2e16d262dd11\") " pod="openshift-ingress-canary/ingress-canary-9vvns" Jun 11 18:37:33.709357 ip-10-0-141-55 kubenswrapper[2578]: I0611 18:37:33.709348 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/86d2dc5a-8200-4c9e-be7e-1cc5ed11905b-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-v8f8j\" (UID: \"86d2dc5a-8200-4c9e-be7e-1cc5ed11905b\") " pod="openshift-insights/insights-runtime-extractor-v8f8j" Jun 11 18:37:33.709698 ip-10-0-141-55 kubenswrapper[2578]: I0611 18:37:33.709400 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/86d2dc5a-8200-4c9e-be7e-1cc5ed11905b-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-v8f8j\" (UID: \"86d2dc5a-8200-4c9e-be7e-1cc5ed11905b\") " pod="openshift-insights/insights-runtime-extractor-v8f8j" Jun 11 18:37:33.709698 ip-10-0-141-55 kubenswrapper[2578]: I0611 18:37:33.709425 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-bp6vc\" (UniqueName: \"kubernetes.io/projected/86d2dc5a-8200-4c9e-be7e-1cc5ed11905b-kube-api-access-bp6vc\") pod \"insights-runtime-extractor-v8f8j\" (UID: \"86d2dc5a-8200-4c9e-be7e-1cc5ed11905b\") " pod="openshift-insights/insights-runtime-extractor-v8f8j" Jun 11 18:37:33.709698 ip-10-0-141-55 kubenswrapper[2578]: I0611 18:37:33.709467 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/86d2dc5a-8200-4c9e-be7e-1cc5ed11905b-crio-socket\") pod \"insights-runtime-extractor-v8f8j\" (UID: \"86d2dc5a-8200-4c9e-be7e-1cc5ed11905b\") " pod="openshift-insights/insights-runtime-extractor-v8f8j" Jun 11 18:37:33.709698 ip-10-0-141-55 kubenswrapper[2578]: I0611 18:37:33.709651 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/86d2dc5a-8200-4c9e-be7e-1cc5ed11905b-data-volume\") pod \"insights-runtime-extractor-v8f8j\" (UID: \"86d2dc5a-8200-4c9e-be7e-1cc5ed11905b\") " pod="openshift-insights/insights-runtime-extractor-v8f8j" Jun 11 18:37:33.709698 ip-10-0-141-55 kubenswrapper[2578]: I0611 18:37:33.709683 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/86d2dc5a-8200-4c9e-be7e-1cc5ed11905b-crio-socket\") pod \"insights-runtime-extractor-v8f8j\" (UID: \"86d2dc5a-8200-4c9e-be7e-1cc5ed11905b\") " pod="openshift-insights/insights-runtime-extractor-v8f8j" Jun 11 18:37:33.710025 ip-10-0-141-55 kubenswrapper[2578]: I0611 18:37:33.710004 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/86d2dc5a-8200-4c9e-be7e-1cc5ed11905b-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-v8f8j\" (UID: \"86d2dc5a-8200-4c9e-be7e-1cc5ed11905b\") " pod="openshift-insights/insights-runtime-extractor-v8f8j" Jun 11 18:37:33.711698 ip-10-0-141-55 kubenswrapper[2578]: I0611 18:37:33.711672 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/86d2dc5a-8200-4c9e-be7e-1cc5ed11905b-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-v8f8j\" (UID: \"86d2dc5a-8200-4c9e-be7e-1cc5ed11905b\") " pod="openshift-insights/insights-runtime-extractor-v8f8j" Jun 11 18:37:33.711798 ip-10-0-141-55 kubenswrapper[2578]: I0611 18:37:33.711778 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/21df7fc9-da9c-4882-917c-2e16d262dd11-cert\") pod \"ingress-canary-9vvns\" (UID: \"21df7fc9-da9c-4882-917c-2e16d262dd11\") " pod="openshift-ingress-canary/ingress-canary-9vvns" Jun 11 18:37:33.718054 ip-10-0-141-55 kubenswrapper[2578]: I0611 18:37:33.718029 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-bp6vc\" (UniqueName: \"kubernetes.io/projected/86d2dc5a-8200-4c9e-be7e-1cc5ed11905b-kube-api-access-bp6vc\") pod \"insights-runtime-extractor-v8f8j\" (UID: \"86d2dc5a-8200-4c9e-be7e-1cc5ed11905b\") " pod="openshift-insights/insights-runtime-extractor-v8f8j" Jun 11 18:37:33.718286 ip-10-0-141-55 kubenswrapper[2578]: I0611 18:37:33.718269 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-ghctn\" (UniqueName: \"kubernetes.io/projected/21df7fc9-da9c-4882-917c-2e16d262dd11-kube-api-access-ghctn\") pod \"ingress-canary-9vvns\" (UID: \"21df7fc9-da9c-4882-917c-2e16d262dd11\") " pod="openshift-ingress-canary/ingress-canary-9vvns" Jun 11 18:37:33.779149 ip-10-0-141-55 kubenswrapper[2578]: I0611 18:37:33.779117 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-ng7mz" Jun 11 18:37:33.800743 ip-10-0-141-55 kubenswrapper[2578]: I0611 18:37:33.800713 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-v8f8j" Jun 11 18:37:33.816914 ip-10-0-141-55 kubenswrapper[2578]: I0611 18:37:33.816849 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-9vvns" Jun 11 18:37:33.938279 ip-10-0-141-55 kubenswrapper[2578]: I0611 18:37:33.938229 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-ng7mz"] Jun 11 18:37:33.941018 ip-10-0-141-55 kubenswrapper[2578]: W0611 18:37:33.940993 2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda52171ba_7228_43ac_8a94_65e91fec2043.slice/crio-74a1caf3378237088f7e3176a23de2dc84231b2611f817d3905d633641afcac5 WatchSource:0}: Error finding container 74a1caf3378237088f7e3176a23de2dc84231b2611f817d3905d633641afcac5: Status 404 returned error can't find the container with id 74a1caf3378237088f7e3176a23de2dc84231b2611f817d3905d633641afcac5 Jun 11 18:37:33.954454 ip-10-0-141-55 kubenswrapper[2578]: I0611 18:37:33.954429 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-v8f8j"] Jun 11 18:37:33.956971 ip-10-0-141-55 kubenswrapper[2578]: W0611 18:37:33.956838 2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod86d2dc5a_8200_4c9e_be7e_1cc5ed11905b.slice/crio-f7491c416e58e283b5a5a4ce9cfb39517950e94197b11130f879c8b3333b7702 WatchSource:0}: Error finding container f7491c416e58e283b5a5a4ce9cfb39517950e94197b11130f879c8b3333b7702: Status 404 returned error can't find the container with id f7491c416e58e283b5a5a4ce9cfb39517950e94197b11130f879c8b3333b7702 Jun 11 18:37:33.957369 ip-10-0-141-55 kubenswrapper[2578]: I0611 18:37:33.957349 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-9vvns"] Jun 11 18:37:33.960460 ip-10-0-141-55 kubenswrapper[2578]: W0611 18:37:33.960440 2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod21df7fc9_da9c_4882_917c_2e16d262dd11.slice/crio-175623b52f613f916f6609919aa86f50840f3a59203d197e301207cfa2372b9b WatchSource:0}: Error finding container 175623b52f613f916f6609919aa86f50840f3a59203d197e301207cfa2372b9b: Status 404 returned error can't find the container with id 175623b52f613f916f6609919aa86f50840f3a59203d197e301207cfa2372b9b Jun 11 18:37:34.680180 ip-10-0-141-55 kubenswrapper[2578]: I0611 18:37:34.680042 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-v8f8j" event={"ID":"86d2dc5a-8200-4c9e-be7e-1cc5ed11905b","Type":"ContainerStarted","Data":"f7491c416e58e283b5a5a4ce9cfb39517950e94197b11130f879c8b3333b7702"} Jun 11 18:37:34.684667 ip-10-0-141-55 kubenswrapper[2578]: I0611 18:37:34.684635 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-ng7mz" event={"ID":"a52171ba-7228-43ac-8a94-65e91fec2043","Type":"ContainerStarted","Data":"74a1caf3378237088f7e3176a23de2dc84231b2611f817d3905d633641afcac5"} Jun 11 18:37:34.686216 ip-10-0-141-55 kubenswrapper[2578]: I0611 18:37:34.686190 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-9vvns" event={"ID":"21df7fc9-da9c-4882-917c-2e16d262dd11","Type":"ContainerStarted","Data":"175623b52f613f916f6609919aa86f50840f3a59203d197e301207cfa2372b9b"} Jun 11 18:37:35.415722 ip-10-0-141-55 kubenswrapper[2578]: I0611 18:37:35.415493 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-hjkh2" Jun 11 18:37:35.415903 ip-10-0-141-55 kubenswrapper[2578]: I0611 18:37:35.415493 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-x5mvk" Jun 11 18:37:35.416397 ip-10-0-141-55 kubenswrapper[2578]: I0611 18:37:35.415531 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-lvmjk" Jun 11 18:37:35.420056 ip-10-0-141-55 kubenswrapper[2578]: I0611 18:37:35.420037 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-qf6vw\"" Jun 11 18:37:35.420155 ip-10-0-141-55 kubenswrapper[2578]: I0611 18:37:35.420133 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\"" Jun 11 18:37:35.420505 ip-10-0-141-55 kubenswrapper[2578]: I0611 18:37:35.420264 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-ptdz8\"" Jun 11 18:37:35.420505 ip-10-0-141-55 kubenswrapper[2578]: I0611 18:37:35.420277 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\"" Jun 11 18:37:35.420505 ip-10-0-141-55 kubenswrapper[2578]: I0611 18:37:35.420323 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\"" Jun 11 18:37:35.420505 ip-10-0-141-55 kubenswrapper[2578]: I0611 18:37:35.420328 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\"" Jun 11 18:37:38.698572 ip-10-0-141-55 kubenswrapper[2578]: I0611 18:37:38.698526 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-v8f8j" event={"ID":"86d2dc5a-8200-4c9e-be7e-1cc5ed11905b","Type":"ContainerStarted","Data":"c9c18d57e7173870a8f377db662e50db2a3aaf4835e48d65a594d1550d1aa770"} Jun 11 18:37:38.700336 ip-10-0-141-55 kubenswrapper[2578]: I0611 18:37:38.700309 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-ng7mz" event={"ID":"a52171ba-7228-43ac-8a94-65e91fec2043","Type":"ContainerStarted","Data":"9d7d4f03473d12c2dcabb204f14b8634af742a675db1bbda407c27db82728d35"} Jun 11 18:37:38.700483 ip-10-0-141-55 kubenswrapper[2578]: I0611 18:37:38.700354 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-ng7mz" event={"ID":"a52171ba-7228-43ac-8a94-65e91fec2043","Type":"ContainerStarted","Data":"987eceeb1b10a12c5c8b1bb9d15033ee2e2b1f73c283bcd8542d95ce9fb399bc"} Jun 11 18:37:38.700483 ip-10-0-141-55 kubenswrapper[2578]: I0611 18:37:38.700399 2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-dns/dns-default-ng7mz" Jun 11 18:37:38.701603 ip-10-0-141-55 kubenswrapper[2578]: I0611 18:37:38.701580 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-9vvns" event={"ID":"21df7fc9-da9c-4882-917c-2e16d262dd11","Type":"ContainerStarted","Data":"bc79222f573ea9cdb59c691c3199275405b45828cfca00631b853e80fd64ca3f"} Jun 11 18:37:38.723366 ip-10-0-141-55 kubenswrapper[2578]: I0611 18:37:38.723319 2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/dns-default-ng7mz" podStartSLOduration=1.416426789 podStartE2EDuration="5.723307116s" totalImagesPullingTime="4.306880327s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-11 18:37:33 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-11 18:37:38.722939215 +0000 UTC m=+64.677613821" watchObservedRunningTime="2026-06-11 18:37:38.723307116 +0000 UTC m=+64.677981722" Jun 11 18:37:38.743381 ip-10-0-141-55 kubenswrapper[2578]: I0611 18:37:38.743339 2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress-canary/ingress-canary-9vvns" podStartSLOduration=1.455681969 podStartE2EDuration="5.743323668s" totalImagesPullingTime="4.287641699s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-11 18:37:33 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-11 18:37:38.742526669 +0000 UTC m=+64.697201275" watchObservedRunningTime="2026-06-11 18:37:38.743323668 +0000 UTC m=+64.697998275" Jun 11 18:37:39.129674 ip-10-0-141-55 kubenswrapper[2578]: I0611 18:37:39.129651 2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/prometheus-operator-864fcfc6f9-nnbkp"] Jun 11 18:37:39.132345 ip-10-0-141-55 kubenswrapper[2578]: I0611 18:37:39.132323 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-864fcfc6f9-nnbkp" Jun 11 18:37:39.135194 ip-10-0-141-55 kubenswrapper[2578]: I0611 18:37:39.135176 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-kube-rbac-proxy-config\"" Jun 11 18:37:39.135290 ip-10-0-141-55 kubenswrapper[2578]: I0611 18:37:39.135243 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kube-root-ca.crt\"" Jun 11 18:37:39.136382 ip-10-0-141-55 kubenswrapper[2578]: I0611 18:37:39.136345 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"metrics-client-ca\"" Jun 11 18:37:39.136382 ip-10-0-141-55 kubenswrapper[2578]: I0611 18:37:39.136359 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"openshift-service-ca.crt\"" Jun 11 18:37:39.136382 ip-10-0-141-55 kubenswrapper[2578]: I0611 18:37:39.136378 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-tls\"" Jun 11 18:37:39.136634 ip-10-0-141-55 kubenswrapper[2578]: I0611 18:37:39.136402 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-dockercfg-8np7h\"" Jun 11 18:37:39.141346 ip-10-0-141-55 kubenswrapper[2578]: I0611 18:37:39.141324 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-864fcfc6f9-nnbkp"] Jun 11 18:37:39.257008 ip-10-0-141-55 kubenswrapper[2578]: I0611 18:37:39.256976 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/e04c3379-71cd-4cb1-aec0-0f708f2ebf54-metrics-client-ca\") pod \"prometheus-operator-864fcfc6f9-nnbkp\" (UID: \"e04c3379-71cd-4cb1-aec0-0f708f2ebf54\") " pod="openshift-monitoring/prometheus-operator-864fcfc6f9-nnbkp" Jun 11 18:37:39.257008 ip-10-0-141-55 kubenswrapper[2578]: I0611 18:37:39.257011 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-operator-tls\" (UniqueName: \"kubernetes.io/secret/e04c3379-71cd-4cb1-aec0-0f708f2ebf54-prometheus-operator-tls\") pod \"prometheus-operator-864fcfc6f9-nnbkp\" (UID: \"e04c3379-71cd-4cb1-aec0-0f708f2ebf54\") " pod="openshift-monitoring/prometheus-operator-864fcfc6f9-nnbkp" Jun 11 18:37:39.257205 ip-10-0-141-55 kubenswrapper[2578]: I0611 18:37:39.257040 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-operator-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/e04c3379-71cd-4cb1-aec0-0f708f2ebf54-prometheus-operator-kube-rbac-proxy-config\") pod \"prometheus-operator-864fcfc6f9-nnbkp\" (UID: \"e04c3379-71cd-4cb1-aec0-0f708f2ebf54\") " pod="openshift-monitoring/prometheus-operator-864fcfc6f9-nnbkp" Jun 11 18:37:39.257205 ip-10-0-141-55 kubenswrapper[2578]: I0611 18:37:39.257080 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mkzkc\" (UniqueName: \"kubernetes.io/projected/e04c3379-71cd-4cb1-aec0-0f708f2ebf54-kube-api-access-mkzkc\") pod \"prometheus-operator-864fcfc6f9-nnbkp\" (UID: \"e04c3379-71cd-4cb1-aec0-0f708f2ebf54\") " pod="openshift-monitoring/prometheus-operator-864fcfc6f9-nnbkp" Jun 11 18:37:39.358012 ip-10-0-141-55 kubenswrapper[2578]: I0611 18:37:39.357978 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-operator-tls\" (UniqueName: \"kubernetes.io/secret/e04c3379-71cd-4cb1-aec0-0f708f2ebf54-prometheus-operator-tls\") pod \"prometheus-operator-864fcfc6f9-nnbkp\" (UID: \"e04c3379-71cd-4cb1-aec0-0f708f2ebf54\") " pod="openshift-monitoring/prometheus-operator-864fcfc6f9-nnbkp" Jun 11 18:37:39.358142 ip-10-0-141-55 kubenswrapper[2578]: I0611 18:37:39.358024 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-operator-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/e04c3379-71cd-4cb1-aec0-0f708f2ebf54-prometheus-operator-kube-rbac-proxy-config\") pod \"prometheus-operator-864fcfc6f9-nnbkp\" (UID: \"e04c3379-71cd-4cb1-aec0-0f708f2ebf54\") " pod="openshift-monitoring/prometheus-operator-864fcfc6f9-nnbkp" Jun 11 18:37:39.358142 ip-10-0-141-55 kubenswrapper[2578]: I0611 18:37:39.358054 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mkzkc\" (UniqueName: \"kubernetes.io/projected/e04c3379-71cd-4cb1-aec0-0f708f2ebf54-kube-api-access-mkzkc\") pod \"prometheus-operator-864fcfc6f9-nnbkp\" (UID: \"e04c3379-71cd-4cb1-aec0-0f708f2ebf54\") " pod="openshift-monitoring/prometheus-operator-864fcfc6f9-nnbkp" Jun 11 18:37:39.358142 ip-10-0-141-55 kubenswrapper[2578]: I0611 18:37:39.358128 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/e04c3379-71cd-4cb1-aec0-0f708f2ebf54-metrics-client-ca\") pod \"prometheus-operator-864fcfc6f9-nnbkp\" (UID: \"e04c3379-71cd-4cb1-aec0-0f708f2ebf54\") " pod="openshift-monitoring/prometheus-operator-864fcfc6f9-nnbkp" Jun 11 18:37:39.358249 ip-10-0-141-55 kubenswrapper[2578]: E0611 18:37:39.358188 2578 secret.go:189] Couldn't get secret openshift-monitoring/prometheus-operator-tls: secret "prometheus-operator-tls" not found Jun 11 18:37:39.358283 ip-10-0-141-55 kubenswrapper[2578]: E0611 18:37:39.358260 2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e04c3379-71cd-4cb1-aec0-0f708f2ebf54-prometheus-operator-tls podName:e04c3379-71cd-4cb1-aec0-0f708f2ebf54 nodeName:}" failed. No retries permitted until 2026-06-11 18:37:39.858238205 +0000 UTC m=+65.812912794 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "prometheus-operator-tls" (UniqueName: "kubernetes.io/secret/e04c3379-71cd-4cb1-aec0-0f708f2ebf54-prometheus-operator-tls") pod "prometheus-operator-864fcfc6f9-nnbkp" (UID: "e04c3379-71cd-4cb1-aec0-0f708f2ebf54") : secret "prometheus-operator-tls" not found Jun 11 18:37:39.358775 ip-10-0-141-55 kubenswrapper[2578]: I0611 18:37:39.358748 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/e04c3379-71cd-4cb1-aec0-0f708f2ebf54-metrics-client-ca\") pod \"prometheus-operator-864fcfc6f9-nnbkp\" (UID: \"e04c3379-71cd-4cb1-aec0-0f708f2ebf54\") " pod="openshift-monitoring/prometheus-operator-864fcfc6f9-nnbkp" Jun 11 18:37:39.361259 ip-10-0-141-55 kubenswrapper[2578]: I0611 18:37:39.361241 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-operator-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/e04c3379-71cd-4cb1-aec0-0f708f2ebf54-prometheus-operator-kube-rbac-proxy-config\") pod \"prometheus-operator-864fcfc6f9-nnbkp\" (UID: \"e04c3379-71cd-4cb1-aec0-0f708f2ebf54\") " pod="openshift-monitoring/prometheus-operator-864fcfc6f9-nnbkp" Jun 11 18:37:39.369050 ip-10-0-141-55 kubenswrapper[2578]: I0611 18:37:39.369022 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-mkzkc\" (UniqueName: \"kubernetes.io/projected/e04c3379-71cd-4cb1-aec0-0f708f2ebf54-kube-api-access-mkzkc\") pod \"prometheus-operator-864fcfc6f9-nnbkp\" (UID: \"e04c3379-71cd-4cb1-aec0-0f708f2ebf54\") " pod="openshift-monitoring/prometheus-operator-864fcfc6f9-nnbkp" Jun 11 18:37:39.605702 ip-10-0-141-55 kubenswrapper[2578]: I0611 18:37:39.605677 2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-vcdjb" Jun 11 18:37:39.707194 ip-10-0-141-55 kubenswrapper[2578]: I0611 18:37:39.707057 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-v8f8j" event={"ID":"86d2dc5a-8200-4c9e-be7e-1cc5ed11905b","Type":"ContainerStarted","Data":"507f080061cf0120b21bb76bbdf9f2c4d1bf74f65cd9dff1812e91dc85d66323"} Jun 11 18:37:39.862279 ip-10-0-141-55 kubenswrapper[2578]: I0611 18:37:39.862240 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-operator-tls\" (UniqueName: \"kubernetes.io/secret/e04c3379-71cd-4cb1-aec0-0f708f2ebf54-prometheus-operator-tls\") pod \"prometheus-operator-864fcfc6f9-nnbkp\" (UID: \"e04c3379-71cd-4cb1-aec0-0f708f2ebf54\") " pod="openshift-monitoring/prometheus-operator-864fcfc6f9-nnbkp" Jun 11 18:37:39.862438 ip-10-0-141-55 kubenswrapper[2578]: E0611 18:37:39.862420 2578 secret.go:189] Couldn't get secret openshift-monitoring/prometheus-operator-tls: secret "prometheus-operator-tls" not found Jun 11 18:37:39.862524 ip-10-0-141-55 kubenswrapper[2578]: E0611 18:37:39.862512 2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e04c3379-71cd-4cb1-aec0-0f708f2ebf54-prometheus-operator-tls podName:e04c3379-71cd-4cb1-aec0-0f708f2ebf54 nodeName:}" failed. No retries permitted until 2026-06-11 18:37:40.862490843 +0000 UTC m=+66.817165440 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "prometheus-operator-tls" (UniqueName: "kubernetes.io/secret/e04c3379-71cd-4cb1-aec0-0f708f2ebf54-prometheus-operator-tls") pod "prometheus-operator-864fcfc6f9-nnbkp" (UID: "e04c3379-71cd-4cb1-aec0-0f708f2ebf54") : secret "prometheus-operator-tls" not found Jun 11 18:37:39.963267 ip-10-0-141-55 kubenswrapper[2578]: I0611 18:37:39.963183 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-c4ths\" (UniqueName: \"kubernetes.io/projected/04686d4c-5c3d-49ac-9b61-09e80f5e4dff-kube-api-access-c4ths\") pod \"network-check-target-hjkh2\" (UID: \"04686d4c-5c3d-49ac-9b61-09e80f5e4dff\") " pod="openshift-network-diagnostics/network-check-target-hjkh2" Jun 11 18:37:39.963430 ip-10-0-141-55 kubenswrapper[2578]: I0611 18:37:39.963278 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/1257ce19-745b-4d56-b701-9fecd0879315-metrics-certs\") pod \"network-metrics-daemon-x5mvk\" (UID: \"1257ce19-745b-4d56-b701-9fecd0879315\") " pod="openshift-multus/network-metrics-daemon-x5mvk" Jun 11 18:37:39.965826 ip-10-0-141-55 kubenswrapper[2578]: I0611 18:37:39.965801 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/1257ce19-745b-4d56-b701-9fecd0879315-metrics-certs\") pod \"network-metrics-daemon-x5mvk\" (UID: \"1257ce19-745b-4d56-b701-9fecd0879315\") " pod="openshift-multus/network-metrics-daemon-x5mvk" Jun 11 18:37:39.966157 ip-10-0-141-55 kubenswrapper[2578]: I0611 18:37:39.966136 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-c4ths\" (UniqueName: \"kubernetes.io/projected/04686d4c-5c3d-49ac-9b61-09e80f5e4dff-kube-api-access-c4ths\") pod \"network-check-target-hjkh2\" (UID: \"04686d4c-5c3d-49ac-9b61-09e80f5e4dff\") " pod="openshift-network-diagnostics/network-check-target-hjkh2" Jun 11 18:37:40.228750 ip-10-0-141-55 kubenswrapper[2578]: I0611 18:37:40.228671 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-hjkh2" Jun 11 18:37:40.235600 ip-10-0-141-55 kubenswrapper[2578]: I0611 18:37:40.235576 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-x5mvk" Jun 11 18:37:40.870826 ip-10-0-141-55 kubenswrapper[2578]: I0611 18:37:40.870769 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-operator-tls\" (UniqueName: \"kubernetes.io/secret/e04c3379-71cd-4cb1-aec0-0f708f2ebf54-prometheus-operator-tls\") pod \"prometheus-operator-864fcfc6f9-nnbkp\" (UID: \"e04c3379-71cd-4cb1-aec0-0f708f2ebf54\") " pod="openshift-monitoring/prometheus-operator-864fcfc6f9-nnbkp" Jun 11 18:37:40.885600 ip-10-0-141-55 kubenswrapper[2578]: I0611 18:37:40.885519 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-operator-tls\" (UniqueName: \"kubernetes.io/secret/e04c3379-71cd-4cb1-aec0-0f708f2ebf54-prometheus-operator-tls\") pod \"prometheus-operator-864fcfc6f9-nnbkp\" (UID: \"e04c3379-71cd-4cb1-aec0-0f708f2ebf54\") " pod="openshift-monitoring/prometheus-operator-864fcfc6f9-nnbkp" Jun 11 18:37:40.941113 ip-10-0-141-55 kubenswrapper[2578]: I0611 18:37:40.941085 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-864fcfc6f9-nnbkp" Jun 11 18:37:40.953787 ip-10-0-141-55 kubenswrapper[2578]: I0611 18:37:40.953716 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-hjkh2"] Jun 11 18:37:40.957519 ip-10-0-141-55 kubenswrapper[2578]: W0611 18:37:40.957481 2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod04686d4c_5c3d_49ac_9b61_09e80f5e4dff.slice/crio-4fb2fd86260baaad3d84725bd5490b6c917ffef30b436ebe19ce80562e83b45a WatchSource:0}: Error finding container 4fb2fd86260baaad3d84725bd5490b6c917ffef30b436ebe19ce80562e83b45a: Status 404 returned error can't find the container with id 4fb2fd86260baaad3d84725bd5490b6c917ffef30b436ebe19ce80562e83b45a Jun 11 18:37:40.970505 ip-10-0-141-55 kubenswrapper[2578]: I0611 18:37:40.970462 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-x5mvk"] Jun 11 18:37:40.972295 ip-10-0-141-55 kubenswrapper[2578]: W0611 18:37:40.972275 2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1257ce19_745b_4d56_b701_9fecd0879315.slice/crio-e86e88b58abc2d38db2cf191d00f814040964240c34498a61c308fae0637e765 WatchSource:0}: Error finding container e86e88b58abc2d38db2cf191d00f814040964240c34498a61c308fae0637e765: Status 404 returned error can't find the container with id e86e88b58abc2d38db2cf191d00f814040964240c34498a61c308fae0637e765 Jun 11 18:37:41.066450 ip-10-0-141-55 kubenswrapper[2578]: I0611 18:37:41.066373 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-864fcfc6f9-nnbkp"] Jun 11 18:37:41.068906 ip-10-0-141-55 kubenswrapper[2578]: W0611 18:37:41.068878 2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode04c3379_71cd_4cb1_aec0_0f708f2ebf54.slice/crio-80cb4458bff1a4bc37146e0946b3238e75363c312755a260d0b7656d3fed940a WatchSource:0}: Error finding container 80cb4458bff1a4bc37146e0946b3238e75363c312755a260d0b7656d3fed940a: Status 404 returned error can't find the container with id 80cb4458bff1a4bc37146e0946b3238e75363c312755a260d0b7656d3fed940a Jun 11 18:37:41.724234 ip-10-0-141-55 kubenswrapper[2578]: I0611 18:37:41.724192 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-864fcfc6f9-nnbkp" event={"ID":"e04c3379-71cd-4cb1-aec0-0f708f2ebf54","Type":"ContainerStarted","Data":"80cb4458bff1a4bc37146e0946b3238e75363c312755a260d0b7656d3fed940a"} Jun 11 18:37:41.727471 ip-10-0-141-55 kubenswrapper[2578]: I0611 18:37:41.726705 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-v8f8j" event={"ID":"86d2dc5a-8200-4c9e-be7e-1cc5ed11905b","Type":"ContainerStarted","Data":"30f74d15224c0c00591af0dee144410ebc4435d1b48e9e428c0f47e585ed37bb"} Jun 11 18:37:41.729512 ip-10-0-141-55 kubenswrapper[2578]: I0611 18:37:41.729450 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-x5mvk" event={"ID":"1257ce19-745b-4d56-b701-9fecd0879315","Type":"ContainerStarted","Data":"e86e88b58abc2d38db2cf191d00f814040964240c34498a61c308fae0637e765"} Jun 11 18:37:41.731707 ip-10-0-141-55 kubenswrapper[2578]: I0611 18:37:41.731686 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-hjkh2" event={"ID":"04686d4c-5c3d-49ac-9b61-09e80f5e4dff","Type":"ContainerStarted","Data":"4fb2fd86260baaad3d84725bd5490b6c917ffef30b436ebe19ce80562e83b45a"} Jun 11 18:37:41.745895 ip-10-0-141-55 kubenswrapper[2578]: I0611 18:37:41.745823 2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-insights/insights-runtime-extractor-v8f8j" podStartSLOduration=1.991589049 podStartE2EDuration="8.745809523s" totalImagesPullingTime="6.754220474s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-11 18:37:33 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-11 18:37:41.744201973 +0000 UTC m=+67.698876580" watchObservedRunningTime="2026-06-11 18:37:41.745809523 +0000 UTC m=+67.700484129" Jun 11 18:37:42.737729 ip-10-0-141-55 kubenswrapper[2578]: I0611 18:37:42.737676 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-864fcfc6f9-nnbkp" event={"ID":"e04c3379-71cd-4cb1-aec0-0f708f2ebf54","Type":"ContainerStarted","Data":"b20912d3ac09ee3ea5711d38a6711210f81f7d950c3002493e5dfa394d7fbb81"} Jun 11 18:37:42.738204 ip-10-0-141-55 kubenswrapper[2578]: I0611 18:37:42.737749 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-864fcfc6f9-nnbkp" event={"ID":"e04c3379-71cd-4cb1-aec0-0f708f2ebf54","Type":"ContainerStarted","Data":"7dc4e8adfe5ed7b1297f0c7953ce4cd7a41da59828e356ce3dbf8c97241919a9"} Jun 11 18:37:42.739605 ip-10-0-141-55 kubenswrapper[2578]: I0611 18:37:42.739535 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-x5mvk" event={"ID":"1257ce19-745b-4d56-b701-9fecd0879315","Type":"ContainerStarted","Data":"2dc027a5ee391a2be5b704d6bedac6aeb4eb9790002a051d3af83f06220ecefe"} Jun 11 18:37:42.739725 ip-10-0-141-55 kubenswrapper[2578]: I0611 18:37:42.739614 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-x5mvk" event={"ID":"1257ce19-745b-4d56-b701-9fecd0879315","Type":"ContainerStarted","Data":"79b1f44fbb376e455419651835d5df50c59f27eda705da2af2610bb8ddef6a2b"} Jun 11 18:37:42.756050 ip-10-0-141-55 kubenswrapper[2578]: I0611 18:37:42.755992 2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/prometheus-operator-864fcfc6f9-nnbkp" podStartSLOduration=2.478295013 podStartE2EDuration="3.755974492s" totalImagesPullingTime="1.277679479s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-11 18:37:39 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-11 18:37:42.75505629 +0000 UTC m=+68.709730897" watchObservedRunningTime="2026-06-11 18:37:42.755974492 +0000 UTC m=+68.710649098" Jun 11 18:37:42.773267 ip-10-0-141-55 kubenswrapper[2578]: I0611 18:37:42.773207 2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/network-metrics-daemon-x5mvk" podStartSLOduration=65.402583957 podStartE2EDuration="1m6.773185083s" totalImagesPullingTime="1.370601126s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-11 18:36:36 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-11 18:37:42.771970321 +0000 UTC m=+68.726644953" watchObservedRunningTime="2026-06-11 18:37:42.773185083 +0000 UTC m=+68.727859690" Jun 11 18:37:44.632115 ip-10-0-141-55 kubenswrapper[2578]: I0611 18:37:44.632078 2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/node-exporter-fxcnz"] Jun 11 18:37:44.635127 ip-10-0-141-55 kubenswrapper[2578]: I0611 18:37:44.635107 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-fxcnz" Jun 11 18:37:44.638268 ip-10-0-141-55 kubenswrapper[2578]: I0611 18:37:44.638249 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-kube-rbac-proxy-config\"" Jun 11 18:37:44.638740 ip-10-0-141-55 kubenswrapper[2578]: I0611 18:37:44.638721 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-dockercfg-qjvwn\"" Jun 11 18:37:44.638833 ip-10-0-141-55 kubenswrapper[2578]: I0611 18:37:44.638758 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-tls\"" Jun 11 18:37:44.638833 ip-10-0-141-55 kubenswrapper[2578]: I0611 18:37:44.638799 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"node-exporter-accelerators-collector-config\"" Jun 11 18:37:44.703208 ip-10-0-141-55 kubenswrapper[2578]: I0611 18:37:44.703174 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/8e255ea1-3909-4ec6-9fe2-e88d89db28a2-node-exporter-textfile\") pod \"node-exporter-fxcnz\" (UID: \"8e255ea1-3909-4ec6-9fe2-e88d89db28a2\") " pod="openshift-monitoring/node-exporter-fxcnz" Jun 11 18:37:44.703366 ip-10-0-141-55 kubenswrapper[2578]: I0611 18:37:44.703228 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-drxzf\" (UniqueName: \"kubernetes.io/projected/8e255ea1-3909-4ec6-9fe2-e88d89db28a2-kube-api-access-drxzf\") pod \"node-exporter-fxcnz\" (UID: \"8e255ea1-3909-4ec6-9fe2-e88d89db28a2\") " pod="openshift-monitoring/node-exporter-fxcnz" Jun 11 18:37:44.703366 ip-10-0-141-55 kubenswrapper[2578]: I0611 18:37:44.703253 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/8e255ea1-3909-4ec6-9fe2-e88d89db28a2-sys\") pod \"node-exporter-fxcnz\" (UID: \"8e255ea1-3909-4ec6-9fe2-e88d89db28a2\") " pod="openshift-monitoring/node-exporter-fxcnz" Jun 11 18:37:44.703366 ip-10-0-141-55 kubenswrapper[2578]: I0611 18:37:44.703271 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/8e255ea1-3909-4ec6-9fe2-e88d89db28a2-node-exporter-accelerators-collector-config\") pod \"node-exporter-fxcnz\" (UID: \"8e255ea1-3909-4ec6-9fe2-e88d89db28a2\") " pod="openshift-monitoring/node-exporter-fxcnz" Jun 11 18:37:44.703366 ip-10-0-141-55 kubenswrapper[2578]: I0611 18:37:44.703321 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/8e255ea1-3909-4ec6-9fe2-e88d89db28a2-metrics-client-ca\") pod \"node-exporter-fxcnz\" (UID: \"8e255ea1-3909-4ec6-9fe2-e88d89db28a2\") " pod="openshift-monitoring/node-exporter-fxcnz" Jun 11 18:37:44.703366 ip-10-0-141-55 kubenswrapper[2578]: I0611 18:37:44.703347 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/8e255ea1-3909-4ec6-9fe2-e88d89db28a2-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-fxcnz\" (UID: \"8e255ea1-3909-4ec6-9fe2-e88d89db28a2\") " pod="openshift-monitoring/node-exporter-fxcnz" Jun 11 18:37:44.703533 ip-10-0-141-55 kubenswrapper[2578]: I0611 18:37:44.703409 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/8e255ea1-3909-4ec6-9fe2-e88d89db28a2-node-exporter-tls\") pod \"node-exporter-fxcnz\" (UID: \"8e255ea1-3909-4ec6-9fe2-e88d89db28a2\") " pod="openshift-monitoring/node-exporter-fxcnz" Jun 11 18:37:44.703533 ip-10-0-141-55 kubenswrapper[2578]: I0611 18:37:44.703425 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/8e255ea1-3909-4ec6-9fe2-e88d89db28a2-node-exporter-wtmp\") pod \"node-exporter-fxcnz\" (UID: \"8e255ea1-3909-4ec6-9fe2-e88d89db28a2\") " pod="openshift-monitoring/node-exporter-fxcnz" Jun 11 18:37:44.703533 ip-10-0-141-55 kubenswrapper[2578]: I0611 18:37:44.703446 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/8e255ea1-3909-4ec6-9fe2-e88d89db28a2-root\") pod \"node-exporter-fxcnz\" (UID: \"8e255ea1-3909-4ec6-9fe2-e88d89db28a2\") " pod="openshift-monitoring/node-exporter-fxcnz" Jun 11 18:37:44.748123 ip-10-0-141-55 kubenswrapper[2578]: I0611 18:37:44.748087 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-hjkh2" event={"ID":"04686d4c-5c3d-49ac-9b61-09e80f5e4dff","Type":"ContainerStarted","Data":"15334da191f79f0d3356ae6f27b0940fd94cea0ccfdcc211ff12829a3d99c12c"} Jun 11 18:37:44.748281 ip-10-0-141-55 kubenswrapper[2578]: I0611 18:37:44.748231 2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-network-diagnostics/network-check-target-hjkh2" Jun 11 18:37:44.765476 ip-10-0-141-55 kubenswrapper[2578]: I0611 18:37:44.765427 2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-diagnostics/network-check-target-hjkh2" podStartSLOduration=65.51095376 podStartE2EDuration="1m8.765412632s" totalImagesPullingTime="3.254458872s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-11 18:36:36 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-11 18:37:44.765087782 +0000 UTC m=+70.719762410" watchObservedRunningTime="2026-06-11 18:37:44.765412632 +0000 UTC m=+70.720087238" Jun 11 18:37:44.804835 ip-10-0-141-55 kubenswrapper[2578]: I0611 18:37:44.804803 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/8e255ea1-3909-4ec6-9fe2-e88d89db28a2-node-exporter-tls\") pod \"node-exporter-fxcnz\" (UID: \"8e255ea1-3909-4ec6-9fe2-e88d89db28a2\") " pod="openshift-monitoring/node-exporter-fxcnz" Jun 11 18:37:44.804835 ip-10-0-141-55 kubenswrapper[2578]: I0611 18:37:44.804835 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/8e255ea1-3909-4ec6-9fe2-e88d89db28a2-node-exporter-wtmp\") pod \"node-exporter-fxcnz\" (UID: \"8e255ea1-3909-4ec6-9fe2-e88d89db28a2\") " pod="openshift-monitoring/node-exporter-fxcnz" Jun 11 18:37:44.805056 ip-10-0-141-55 kubenswrapper[2578]: I0611 18:37:44.804855 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/8e255ea1-3909-4ec6-9fe2-e88d89db28a2-root\") pod \"node-exporter-fxcnz\" (UID: \"8e255ea1-3909-4ec6-9fe2-e88d89db28a2\") " pod="openshift-monitoring/node-exporter-fxcnz" Jun 11 18:37:44.805056 ip-10-0-141-55 kubenswrapper[2578]: I0611 18:37:44.804894 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/8e255ea1-3909-4ec6-9fe2-e88d89db28a2-node-exporter-textfile\") pod \"node-exporter-fxcnz\" (UID: \"8e255ea1-3909-4ec6-9fe2-e88d89db28a2\") " pod="openshift-monitoring/node-exporter-fxcnz" Jun 11 18:37:44.805056 ip-10-0-141-55 kubenswrapper[2578]: E0611 18:37:44.804950 2578 secret.go:189] Couldn't get secret openshift-monitoring/node-exporter-tls: secret "node-exporter-tls" not found Jun 11 18:37:44.805056 ip-10-0-141-55 kubenswrapper[2578]: I0611 18:37:44.804992 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-drxzf\" (UniqueName: \"kubernetes.io/projected/8e255ea1-3909-4ec6-9fe2-e88d89db28a2-kube-api-access-drxzf\") pod \"node-exporter-fxcnz\" (UID: \"8e255ea1-3909-4ec6-9fe2-e88d89db28a2\") " pod="openshift-monitoring/node-exporter-fxcnz" Jun 11 18:37:44.805056 ip-10-0-141-55 kubenswrapper[2578]: E0611 18:37:44.805012 2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/8e255ea1-3909-4ec6-9fe2-e88d89db28a2-node-exporter-tls podName:8e255ea1-3909-4ec6-9fe2-e88d89db28a2 nodeName:}" failed. No retries permitted until 2026-06-11 18:37:45.304996643 +0000 UTC m=+71.259671232 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "node-exporter-tls" (UniqueName: "kubernetes.io/secret/8e255ea1-3909-4ec6-9fe2-e88d89db28a2-node-exporter-tls") pod "node-exporter-fxcnz" (UID: "8e255ea1-3909-4ec6-9fe2-e88d89db28a2") : secret "node-exporter-tls" not found Jun 11 18:37:44.805056 ip-10-0-141-55 kubenswrapper[2578]: I0611 18:37:44.805040 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/8e255ea1-3909-4ec6-9fe2-e88d89db28a2-sys\") pod \"node-exporter-fxcnz\" (UID: \"8e255ea1-3909-4ec6-9fe2-e88d89db28a2\") " pod="openshift-monitoring/node-exporter-fxcnz" Jun 11 18:37:44.805056 ip-10-0-141-55 kubenswrapper[2578]: I0611 18:37:44.805009 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/8e255ea1-3909-4ec6-9fe2-e88d89db28a2-node-exporter-wtmp\") pod \"node-exporter-fxcnz\" (UID: \"8e255ea1-3909-4ec6-9fe2-e88d89db28a2\") " pod="openshift-monitoring/node-exporter-fxcnz" Jun 11 18:37:44.805351 ip-10-0-141-55 kubenswrapper[2578]: I0611 18:37:44.805067 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/8e255ea1-3909-4ec6-9fe2-e88d89db28a2-node-exporter-accelerators-collector-config\") pod \"node-exporter-fxcnz\" (UID: \"8e255ea1-3909-4ec6-9fe2-e88d89db28a2\") " pod="openshift-monitoring/node-exporter-fxcnz" Jun 11 18:37:44.805351 ip-10-0-141-55 kubenswrapper[2578]: I0611 18:37:44.804951 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"root\" (UniqueName: \"kubernetes.io/host-path/8e255ea1-3909-4ec6-9fe2-e88d89db28a2-root\") pod \"node-exporter-fxcnz\" (UID: \"8e255ea1-3909-4ec6-9fe2-e88d89db28a2\") " pod="openshift-monitoring/node-exporter-fxcnz" Jun 11 18:37:44.805351 ip-10-0-141-55 kubenswrapper[2578]: I0611 18:37:44.805106 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/8e255ea1-3909-4ec6-9fe2-e88d89db28a2-metrics-client-ca\") pod \"node-exporter-fxcnz\" (UID: \"8e255ea1-3909-4ec6-9fe2-e88d89db28a2\") " pod="openshift-monitoring/node-exporter-fxcnz" Jun 11 18:37:44.805351 ip-10-0-141-55 kubenswrapper[2578]: I0611 18:37:44.805110 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/8e255ea1-3909-4ec6-9fe2-e88d89db28a2-sys\") pod \"node-exporter-fxcnz\" (UID: \"8e255ea1-3909-4ec6-9fe2-e88d89db28a2\") " pod="openshift-monitoring/node-exporter-fxcnz" Jun 11 18:37:44.805351 ip-10-0-141-55 kubenswrapper[2578]: I0611 18:37:44.805127 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/8e255ea1-3909-4ec6-9fe2-e88d89db28a2-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-fxcnz\" (UID: \"8e255ea1-3909-4ec6-9fe2-e88d89db28a2\") " pod="openshift-monitoring/node-exporter-fxcnz" Jun 11 18:37:44.805351 ip-10-0-141-55 kubenswrapper[2578]: I0611 18:37:44.805243 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/8e255ea1-3909-4ec6-9fe2-e88d89db28a2-node-exporter-textfile\") pod \"node-exporter-fxcnz\" (UID: \"8e255ea1-3909-4ec6-9fe2-e88d89db28a2\") " pod="openshift-monitoring/node-exporter-fxcnz" Jun 11 18:37:44.805637 ip-10-0-141-55 kubenswrapper[2578]: I0611 18:37:44.805598 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/8e255ea1-3909-4ec6-9fe2-e88d89db28a2-node-exporter-accelerators-collector-config\") pod \"node-exporter-fxcnz\" (UID: \"8e255ea1-3909-4ec6-9fe2-e88d89db28a2\") " pod="openshift-monitoring/node-exporter-fxcnz" Jun 11 18:37:44.805637 ip-10-0-141-55 kubenswrapper[2578]: I0611 18:37:44.805614 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/8e255ea1-3909-4ec6-9fe2-e88d89db28a2-metrics-client-ca\") pod \"node-exporter-fxcnz\" (UID: \"8e255ea1-3909-4ec6-9fe2-e88d89db28a2\") " pod="openshift-monitoring/node-exporter-fxcnz" Jun 11 18:37:44.807376 ip-10-0-141-55 kubenswrapper[2578]: I0611 18:37:44.807357 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/8e255ea1-3909-4ec6-9fe2-e88d89db28a2-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-fxcnz\" (UID: \"8e255ea1-3909-4ec6-9fe2-e88d89db28a2\") " pod="openshift-monitoring/node-exporter-fxcnz" Jun 11 18:37:44.813849 ip-10-0-141-55 kubenswrapper[2578]: I0611 18:37:44.813816 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-drxzf\" (UniqueName: \"kubernetes.io/projected/8e255ea1-3909-4ec6-9fe2-e88d89db28a2-kube-api-access-drxzf\") pod \"node-exporter-fxcnz\" (UID: \"8e255ea1-3909-4ec6-9fe2-e88d89db28a2\") " pod="openshift-monitoring/node-exporter-fxcnz" Jun 11 18:37:45.309412 ip-10-0-141-55 kubenswrapper[2578]: I0611 18:37:45.309382 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/8e255ea1-3909-4ec6-9fe2-e88d89db28a2-node-exporter-tls\") pod \"node-exporter-fxcnz\" (UID: \"8e255ea1-3909-4ec6-9fe2-e88d89db28a2\") " pod="openshift-monitoring/node-exporter-fxcnz" Jun 11 18:37:45.311692 ip-10-0-141-55 kubenswrapper[2578]: I0611 18:37:45.311669 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/8e255ea1-3909-4ec6-9fe2-e88d89db28a2-node-exporter-tls\") pod \"node-exporter-fxcnz\" (UID: \"8e255ea1-3909-4ec6-9fe2-e88d89db28a2\") " pod="openshift-monitoring/node-exporter-fxcnz" Jun 11 18:37:45.543711 ip-10-0-141-55 kubenswrapper[2578]: I0611 18:37:45.543675 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-fxcnz" Jun 11 18:37:45.556416 ip-10-0-141-55 kubenswrapper[2578]: W0611 18:37:45.556387 2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8e255ea1_3909_4ec6_9fe2_e88d89db28a2.slice/crio-cfa5264621a0cf66b249b979146fe0c1c1681f948e10b5420e71ce5fc83eb6e1 WatchSource:0}: Error finding container cfa5264621a0cf66b249b979146fe0c1c1681f948e10b5420e71ce5fc83eb6e1: Status 404 returned error can't find the container with id cfa5264621a0cf66b249b979146fe0c1c1681f948e10b5420e71ce5fc83eb6e1 Jun 11 18:37:45.752257 ip-10-0-141-55 kubenswrapper[2578]: I0611 18:37:45.752221 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-fxcnz" event={"ID":"8e255ea1-3909-4ec6-9fe2-e88d89db28a2","Type":"ContainerStarted","Data":"cfa5264621a0cf66b249b979146fe0c1c1681f948e10b5420e71ce5fc83eb6e1"} Jun 11 18:37:46.576165 ip-10-0-141-55 kubenswrapper[2578]: I0611 18:37:46.576136 2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/thanos-querier-bcb865f69-qv4v2"] Jun 11 18:37:46.580449 ip-10-0-141-55 kubenswrapper[2578]: I0611 18:37:46.580431 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/thanos-querier-bcb865f69-qv4v2" Jun 11 18:37:46.583714 ip-10-0-141-55 kubenswrapper[2578]: I0611 18:37:46.583694 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy-web\"" Jun 11 18:37:46.583821 ip-10-0-141-55 kubenswrapper[2578]: I0611 18:37:46.583694 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy-metrics\"" Jun 11 18:37:46.583821 ip-10-0-141-55 kubenswrapper[2578]: I0611 18:37:46.583701 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy-rules\"" Jun 11 18:37:46.583985 ip-10-0-141-55 kubenswrapper[2578]: I0611 18:37:46.583970 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy\"" Jun 11 18:37:46.584142 ip-10-0-141-55 kubenswrapper[2578]: I0611 18:37:46.584126 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-tls\"" Jun 11 18:37:46.584831 ip-10-0-141-55 kubenswrapper[2578]: I0611 18:37:46.584819 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-dockercfg-k5rtl\"" Jun 11 18:37:46.584900 ip-10-0-141-55 kubenswrapper[2578]: I0611 18:37:46.584843 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-grpc-tls-7l9ncarrb1gdv\"" Jun 11 18:37:46.594389 ip-10-0-141-55 kubenswrapper[2578]: I0611 18:37:46.594371 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/thanos-querier-bcb865f69-qv4v2"] Jun 11 18:37:46.718229 ip-10-0-141-55 kubenswrapper[2578]: I0611 18:37:46.718204 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-248wj\" (UniqueName: \"kubernetes.io/projected/c3bd3e23-7aab-4949-b28b-2e4d00c32c5c-kube-api-access-248wj\") pod \"thanos-querier-bcb865f69-qv4v2\" (UID: \"c3bd3e23-7aab-4949-b28b-2e4d00c32c5c\") " pod="openshift-monitoring/thanos-querier-bcb865f69-qv4v2" Jun 11 18:37:46.718342 ip-10-0-141-55 kubenswrapper[2578]: I0611 18:37:46.718236 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/c3bd3e23-7aab-4949-b28b-2e4d00c32c5c-secret-thanos-querier-kube-rbac-proxy-web\") pod \"thanos-querier-bcb865f69-qv4v2\" (UID: \"c3bd3e23-7aab-4949-b28b-2e4d00c32c5c\") " pod="openshift-monitoring/thanos-querier-bcb865f69-qv4v2" Jun 11 18:37:46.718342 ip-10-0-141-55 kubenswrapper[2578]: I0611 18:37:46.718259 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-metrics\" (UniqueName: \"kubernetes.io/secret/c3bd3e23-7aab-4949-b28b-2e4d00c32c5c-secret-thanos-querier-kube-rbac-proxy-metrics\") pod \"thanos-querier-bcb865f69-qv4v2\" (UID: \"c3bd3e23-7aab-4949-b28b-2e4d00c32c5c\") " pod="openshift-monitoring/thanos-querier-bcb865f69-qv4v2" Jun 11 18:37:46.718342 ip-10-0-141-55 kubenswrapper[2578]: I0611 18:37:46.718285 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-rules\" (UniqueName: \"kubernetes.io/secret/c3bd3e23-7aab-4949-b28b-2e4d00c32c5c-secret-thanos-querier-kube-rbac-proxy-rules\") pod \"thanos-querier-bcb865f69-qv4v2\" (UID: \"c3bd3e23-7aab-4949-b28b-2e4d00c32c5c\") " pod="openshift-monitoring/thanos-querier-bcb865f69-qv4v2" Jun 11 18:37:46.718440 ip-10-0-141-55 kubenswrapper[2578]: I0611 18:37:46.718351 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/c3bd3e23-7aab-4949-b28b-2e4d00c32c5c-metrics-client-ca\") pod \"thanos-querier-bcb865f69-qv4v2\" (UID: \"c3bd3e23-7aab-4949-b28b-2e4d00c32c5c\") " pod="openshift-monitoring/thanos-querier-bcb865f69-qv4v2" Jun 11 18:37:46.718440 ip-10-0-141-55 kubenswrapper[2578]: I0611 18:37:46.718404 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/c3bd3e23-7aab-4949-b28b-2e4d00c32c5c-secret-thanos-querier-kube-rbac-proxy\") pod \"thanos-querier-bcb865f69-qv4v2\" (UID: \"c3bd3e23-7aab-4949-b28b-2e4d00c32c5c\") " pod="openshift-monitoring/thanos-querier-bcb865f69-qv4v2" Jun 11 18:37:46.718502 ip-10-0-141-55 kubenswrapper[2578]: I0611 18:37:46.718441 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-tls\" (UniqueName: \"kubernetes.io/secret/c3bd3e23-7aab-4949-b28b-2e4d00c32c5c-secret-thanos-querier-tls\") pod \"thanos-querier-bcb865f69-qv4v2\" (UID: \"c3bd3e23-7aab-4949-b28b-2e4d00c32c5c\") " pod="openshift-monitoring/thanos-querier-bcb865f69-qv4v2" Jun 11 18:37:46.718502 ip-10-0-141-55 kubenswrapper[2578]: I0611 18:37:46.718475 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/c3bd3e23-7aab-4949-b28b-2e4d00c32c5c-secret-grpc-tls\") pod \"thanos-querier-bcb865f69-qv4v2\" (UID: \"c3bd3e23-7aab-4949-b28b-2e4d00c32c5c\") " pod="openshift-monitoring/thanos-querier-bcb865f69-qv4v2" Jun 11 18:37:46.757489 ip-10-0-141-55 kubenswrapper[2578]: I0611 18:37:46.757459 2578 generic.go:356] "Generic (PLEG): container finished" podID="8e255ea1-3909-4ec6-9fe2-e88d89db28a2" containerID="1f49bd27ec03b8f91bbbe1f54c26f9527f353706cdaab536c0cc48255f8f4bda" exitCode=0 Jun 11 18:37:46.757899 ip-10-0-141-55 kubenswrapper[2578]: I0611 18:37:46.757496 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-fxcnz" event={"ID":"8e255ea1-3909-4ec6-9fe2-e88d89db28a2","Type":"ContainerDied","Data":"1f49bd27ec03b8f91bbbe1f54c26f9527f353706cdaab536c0cc48255f8f4bda"} Jun 11 18:37:46.819179 ip-10-0-141-55 kubenswrapper[2578]: I0611 18:37:46.819154 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/c3bd3e23-7aab-4949-b28b-2e4d00c32c5c-secret-thanos-querier-kube-rbac-proxy\") pod \"thanos-querier-bcb865f69-qv4v2\" (UID: \"c3bd3e23-7aab-4949-b28b-2e4d00c32c5c\") " pod="openshift-monitoring/thanos-querier-bcb865f69-qv4v2" Jun 11 18:37:46.819292 ip-10-0-141-55 kubenswrapper[2578]: I0611 18:37:46.819183 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-tls\" (UniqueName: \"kubernetes.io/secret/c3bd3e23-7aab-4949-b28b-2e4d00c32c5c-secret-thanos-querier-tls\") pod \"thanos-querier-bcb865f69-qv4v2\" (UID: \"c3bd3e23-7aab-4949-b28b-2e4d00c32c5c\") " pod="openshift-monitoring/thanos-querier-bcb865f69-qv4v2" Jun 11 18:37:46.819292 ip-10-0-141-55 kubenswrapper[2578]: I0611 18:37:46.819259 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/c3bd3e23-7aab-4949-b28b-2e4d00c32c5c-secret-grpc-tls\") pod \"thanos-querier-bcb865f69-qv4v2\" (UID: \"c3bd3e23-7aab-4949-b28b-2e4d00c32c5c\") " pod="openshift-monitoring/thanos-querier-bcb865f69-qv4v2" Jun 11 18:37:46.819411 ip-10-0-141-55 kubenswrapper[2578]: I0611 18:37:46.819314 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-248wj\" (UniqueName: \"kubernetes.io/projected/c3bd3e23-7aab-4949-b28b-2e4d00c32c5c-kube-api-access-248wj\") pod \"thanos-querier-bcb865f69-qv4v2\" (UID: \"c3bd3e23-7aab-4949-b28b-2e4d00c32c5c\") " pod="openshift-monitoring/thanos-querier-bcb865f69-qv4v2" Jun 11 18:37:46.819411 ip-10-0-141-55 kubenswrapper[2578]: I0611 18:37:46.819342 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/c3bd3e23-7aab-4949-b28b-2e4d00c32c5c-secret-thanos-querier-kube-rbac-proxy-web\") pod \"thanos-querier-bcb865f69-qv4v2\" (UID: \"c3bd3e23-7aab-4949-b28b-2e4d00c32c5c\") " pod="openshift-monitoring/thanos-querier-bcb865f69-qv4v2" Jun 11 18:37:46.819835 ip-10-0-141-55 kubenswrapper[2578]: I0611 18:37:46.819808 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-metrics\" (UniqueName: \"kubernetes.io/secret/c3bd3e23-7aab-4949-b28b-2e4d00c32c5c-secret-thanos-querier-kube-rbac-proxy-metrics\") pod \"thanos-querier-bcb865f69-qv4v2\" (UID: \"c3bd3e23-7aab-4949-b28b-2e4d00c32c5c\") " pod="openshift-monitoring/thanos-querier-bcb865f69-qv4v2" Jun 11 18:37:46.819925 ip-10-0-141-55 kubenswrapper[2578]: I0611 18:37:46.819908 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-rules\" (UniqueName: \"kubernetes.io/secret/c3bd3e23-7aab-4949-b28b-2e4d00c32c5c-secret-thanos-querier-kube-rbac-proxy-rules\") pod \"thanos-querier-bcb865f69-qv4v2\" (UID: \"c3bd3e23-7aab-4949-b28b-2e4d00c32c5c\") " pod="openshift-monitoring/thanos-querier-bcb865f69-qv4v2" Jun 11 18:37:46.819976 ip-10-0-141-55 kubenswrapper[2578]: I0611 18:37:46.819942 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/c3bd3e23-7aab-4949-b28b-2e4d00c32c5c-metrics-client-ca\") pod \"thanos-querier-bcb865f69-qv4v2\" (UID: \"c3bd3e23-7aab-4949-b28b-2e4d00c32c5c\") " pod="openshift-monitoring/thanos-querier-bcb865f69-qv4v2" Jun 11 18:37:46.820780 ip-10-0-141-55 kubenswrapper[2578]: I0611 18:37:46.820757 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/c3bd3e23-7aab-4949-b28b-2e4d00c32c5c-metrics-client-ca\") pod \"thanos-querier-bcb865f69-qv4v2\" (UID: \"c3bd3e23-7aab-4949-b28b-2e4d00c32c5c\") " pod="openshift-monitoring/thanos-querier-bcb865f69-qv4v2" Jun 11 18:37:46.822525 ip-10-0-141-55 kubenswrapper[2578]: I0611 18:37:46.822459 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy-metrics\" (UniqueName: \"kubernetes.io/secret/c3bd3e23-7aab-4949-b28b-2e4d00c32c5c-secret-thanos-querier-kube-rbac-proxy-metrics\") pod \"thanos-querier-bcb865f69-qv4v2\" (UID: \"c3bd3e23-7aab-4949-b28b-2e4d00c32c5c\") " pod="openshift-monitoring/thanos-querier-bcb865f69-qv4v2" Jun 11 18:37:46.823046 ip-10-0-141-55 kubenswrapper[2578]: I0611 18:37:46.822642 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-tls\" (UniqueName: \"kubernetes.io/secret/c3bd3e23-7aab-4949-b28b-2e4d00c32c5c-secret-thanos-querier-tls\") pod \"thanos-querier-bcb865f69-qv4v2\" (UID: \"c3bd3e23-7aab-4949-b28b-2e4d00c32c5c\") " pod="openshift-monitoring/thanos-querier-bcb865f69-qv4v2" Jun 11 18:37:46.823046 ip-10-0-141-55 kubenswrapper[2578]: I0611 18:37:46.822998 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/c3bd3e23-7aab-4949-b28b-2e4d00c32c5c-secret-thanos-querier-kube-rbac-proxy-web\") pod \"thanos-querier-bcb865f69-qv4v2\" (UID: \"c3bd3e23-7aab-4949-b28b-2e4d00c32c5c\") " pod="openshift-monitoring/thanos-querier-bcb865f69-qv4v2" Jun 11 18:37:46.823184 ip-10-0-141-55 kubenswrapper[2578]: I0611 18:37:46.823118 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/c3bd3e23-7aab-4949-b28b-2e4d00c32c5c-secret-thanos-querier-kube-rbac-proxy\") pod \"thanos-querier-bcb865f69-qv4v2\" (UID: \"c3bd3e23-7aab-4949-b28b-2e4d00c32c5c\") " pod="openshift-monitoring/thanos-querier-bcb865f69-qv4v2" Jun 11 18:37:46.823225 ip-10-0-141-55 kubenswrapper[2578]: I0611 18:37:46.823182 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy-rules\" (UniqueName: \"kubernetes.io/secret/c3bd3e23-7aab-4949-b28b-2e4d00c32c5c-secret-thanos-querier-kube-rbac-proxy-rules\") pod \"thanos-querier-bcb865f69-qv4v2\" (UID: \"c3bd3e23-7aab-4949-b28b-2e4d00c32c5c\") " pod="openshift-monitoring/thanos-querier-bcb865f69-qv4v2" Jun 11 18:37:46.823361 ip-10-0-141-55 kubenswrapper[2578]: I0611 18:37:46.823337 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/c3bd3e23-7aab-4949-b28b-2e4d00c32c5c-secret-grpc-tls\") pod \"thanos-querier-bcb865f69-qv4v2\" (UID: \"c3bd3e23-7aab-4949-b28b-2e4d00c32c5c\") " pod="openshift-monitoring/thanos-querier-bcb865f69-qv4v2" Jun 11 18:37:46.828625 ip-10-0-141-55 kubenswrapper[2578]: I0611 18:37:46.828530 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-248wj\" (UniqueName: \"kubernetes.io/projected/c3bd3e23-7aab-4949-b28b-2e4d00c32c5c-kube-api-access-248wj\") pod \"thanos-querier-bcb865f69-qv4v2\" (UID: \"c3bd3e23-7aab-4949-b28b-2e4d00c32c5c\") " pod="openshift-monitoring/thanos-querier-bcb865f69-qv4v2" Jun 11 18:37:46.902727 ip-10-0-141-55 kubenswrapper[2578]: I0611 18:37:46.902690 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/thanos-querier-bcb865f69-qv4v2" Jun 11 18:37:47.032628 ip-10-0-141-55 kubenswrapper[2578]: I0611 18:37:47.032604 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/thanos-querier-bcb865f69-qv4v2"] Jun 11 18:37:47.034465 ip-10-0-141-55 kubenswrapper[2578]: W0611 18:37:47.034439 2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc3bd3e23_7aab_4949_b28b_2e4d00c32c5c.slice/crio-8f0acf330a529c47e47778482d45d8ab44a11c1c347bd59e48675db8cb51bc44 WatchSource:0}: Error finding container 8f0acf330a529c47e47778482d45d8ab44a11c1c347bd59e48675db8cb51bc44: Status 404 returned error can't find the container with id 8f0acf330a529c47e47778482d45d8ab44a11c1c347bd59e48675db8cb51bc44 Jun 11 18:37:47.763009 ip-10-0-141-55 kubenswrapper[2578]: I0611 18:37:47.762962 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-bcb865f69-qv4v2" event={"ID":"c3bd3e23-7aab-4949-b28b-2e4d00c32c5c","Type":"ContainerStarted","Data":"8f0acf330a529c47e47778482d45d8ab44a11c1c347bd59e48675db8cb51bc44"} Jun 11 18:37:47.765288 ip-10-0-141-55 kubenswrapper[2578]: I0611 18:37:47.765262 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-fxcnz" event={"ID":"8e255ea1-3909-4ec6-9fe2-e88d89db28a2","Type":"ContainerStarted","Data":"872369f740a355df0d2e438409ad468092a8ce487ddb8750c682c246f152da4b"} Jun 11 18:37:47.765398 ip-10-0-141-55 kubenswrapper[2578]: I0611 18:37:47.765308 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-fxcnz" event={"ID":"8e255ea1-3909-4ec6-9fe2-e88d89db28a2","Type":"ContainerStarted","Data":"7e271c589dd0961e06e1ab9f821e74be1229d3c0bf9cdb003660a63087a92eb5"} Jun 11 18:37:47.792063 ip-10-0-141-55 kubenswrapper[2578]: I0611 18:37:47.792007 2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/node-exporter-fxcnz" podStartSLOduration=2.7329772869999998 podStartE2EDuration="3.791989325s" totalImagesPullingTime="994.846447ms" totalInitContainerRuntime="64.165591ms" isStatefulPod=true podCreationTimestamp="2026-06-11 18:37:44 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-11 18:37:47.791623405 +0000 UTC m=+73.746298030" watchObservedRunningTime="2026-06-11 18:37:47.791989325 +0000 UTC m=+73.746663930" Jun 11 18:37:48.333485 ip-10-0-141-55 kubenswrapper[2578]: I0611 18:37:48.333443 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/1261112f-ce68-462a-a73e-fa1942159096-original-pull-secret\") pod \"global-pull-secret-syncer-lvmjk\" (UID: \"1261112f-ce68-462a-a73e-fa1942159096\") " pod="kube-system/global-pull-secret-syncer-lvmjk" Jun 11 18:37:48.336148 ip-10-0-141-55 kubenswrapper[2578]: I0611 18:37:48.336124 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/1261112f-ce68-462a-a73e-fa1942159096-original-pull-secret\") pod \"global-pull-secret-syncer-lvmjk\" (UID: \"1261112f-ce68-462a-a73e-fa1942159096\") " pod="kube-system/global-pull-secret-syncer-lvmjk" Jun 11 18:37:48.343095 ip-10-0-141-55 kubenswrapper[2578]: I0611 18:37:48.343070 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-lvmjk" Jun 11 18:37:48.480813 ip-10-0-141-55 kubenswrapper[2578]: I0611 18:37:48.480750 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-lvmjk"] Jun 11 18:37:48.482882 ip-10-0-141-55 kubenswrapper[2578]: W0611 18:37:48.482855 2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1261112f_ce68_462a_a73e_fa1942159096.slice/crio-e758a3ec563f7ecaa032560d3d6d5e69ed3758d7eb223659b261f6962be7c4c0 WatchSource:0}: Error finding container e758a3ec563f7ecaa032560d3d6d5e69ed3758d7eb223659b261f6962be7c4c0: Status 404 returned error can't find the container with id e758a3ec563f7ecaa032560d3d6d5e69ed3758d7eb223659b261f6962be7c4c0 Jun 11 18:37:48.709949 ip-10-0-141-55 kubenswrapper[2578]: I0611 18:37:48.709912 2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-dns/dns-default-ng7mz" Jun 11 18:37:48.771336 ip-10-0-141-55 kubenswrapper[2578]: I0611 18:37:48.771299 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-lvmjk" event={"ID":"1261112f-ce68-462a-a73e-fa1942159096","Type":"ContainerStarted","Data":"e758a3ec563f7ecaa032560d3d6d5e69ed3758d7eb223659b261f6962be7c4c0"} Jun 11 18:37:49.296814 ip-10-0-141-55 kubenswrapper[2578]: I0611 18:37:49.296790 2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-689cb4cc55-dljj8"] Jun 11 18:37:49.301175 ip-10-0-141-55 kubenswrapper[2578]: I0611 18:37:49.301154 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-689cb4cc55-dljj8" Jun 11 18:37:49.304790 ip-10-0-141-55 kubenswrapper[2578]: I0611 18:37:49.304624 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"service-ca\"" Jun 11 18:37:49.304790 ip-10-0-141-55 kubenswrapper[2578]: I0611 18:37:49.304624 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-oauth-config\"" Jun 11 18:37:49.304790 ip-10-0-141-55 kubenswrapper[2578]: I0611 18:37:49.304768 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"openshift-service-ca.crt\"" Jun 11 18:37:49.304790 ip-10-0-141-55 kubenswrapper[2578]: I0611 18:37:49.304789 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"console-config\"" Jun 11 18:37:49.306064 ip-10-0-141-55 kubenswrapper[2578]: I0611 18:37:49.306047 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"kube-root-ca.crt\"" Jun 11 18:37:49.306156 ip-10-0-141-55 kubenswrapper[2578]: I0611 18:37:49.306074 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"oauth-serving-cert\"" Jun 11 18:37:49.306156 ip-10-0-141-55 kubenswrapper[2578]: I0611 18:37:49.306139 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-dockercfg-h4xrm\"" Jun 11 18:37:49.306305 ip-10-0-141-55 kubenswrapper[2578]: I0611 18:37:49.306285 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-serving-cert\"" Jun 11 18:37:49.311996 ip-10-0-141-55 kubenswrapper[2578]: I0611 18:37:49.311979 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"trusted-ca-bundle\"" Jun 11 18:37:49.323934 ip-10-0-141-55 kubenswrapper[2578]: I0611 18:37:49.323912 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-689cb4cc55-dljj8"] Jun 11 18:37:49.442969 ip-10-0-141-55 kubenswrapper[2578]: I0611 18:37:49.442928 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/51a9a536-9b7f-4a1f-b015-6153ead725cc-console-config\") pod \"console-689cb4cc55-dljj8\" (UID: \"51a9a536-9b7f-4a1f-b015-6153ead725cc\") " pod="openshift-console/console-689cb4cc55-dljj8" Jun 11 18:37:49.443123 ip-10-0-141-55 kubenswrapper[2578]: I0611 18:37:49.442977 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/51a9a536-9b7f-4a1f-b015-6153ead725cc-trusted-ca-bundle\") pod \"console-689cb4cc55-dljj8\" (UID: \"51a9a536-9b7f-4a1f-b015-6153ead725cc\") " pod="openshift-console/console-689cb4cc55-dljj8" Jun 11 18:37:49.443123 ip-10-0-141-55 kubenswrapper[2578]: I0611 18:37:49.443041 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/51a9a536-9b7f-4a1f-b015-6153ead725cc-console-oauth-config\") pod \"console-689cb4cc55-dljj8\" (UID: \"51a9a536-9b7f-4a1f-b015-6153ead725cc\") " pod="openshift-console/console-689cb4cc55-dljj8" Jun 11 18:37:49.443123 ip-10-0-141-55 kubenswrapper[2578]: I0611 18:37:49.443067 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/51a9a536-9b7f-4a1f-b015-6153ead725cc-service-ca\") pod \"console-689cb4cc55-dljj8\" (UID: \"51a9a536-9b7f-4a1f-b015-6153ead725cc\") " pod="openshift-console/console-689cb4cc55-dljj8" Jun 11 18:37:49.443123 ip-10-0-141-55 kubenswrapper[2578]: I0611 18:37:49.443091 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/51a9a536-9b7f-4a1f-b015-6153ead725cc-console-serving-cert\") pod \"console-689cb4cc55-dljj8\" (UID: \"51a9a536-9b7f-4a1f-b015-6153ead725cc\") " pod="openshift-console/console-689cb4cc55-dljj8" Jun 11 18:37:49.443343 ip-10-0-141-55 kubenswrapper[2578]: I0611 18:37:49.443151 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/51a9a536-9b7f-4a1f-b015-6153ead725cc-oauth-serving-cert\") pod \"console-689cb4cc55-dljj8\" (UID: \"51a9a536-9b7f-4a1f-b015-6153ead725cc\") " pod="openshift-console/console-689cb4cc55-dljj8" Jun 11 18:37:49.443343 ip-10-0-141-55 kubenswrapper[2578]: I0611 18:37:49.443185 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5jlbg\" (UniqueName: \"kubernetes.io/projected/51a9a536-9b7f-4a1f-b015-6153ead725cc-kube-api-access-5jlbg\") pod \"console-689cb4cc55-dljj8\" (UID: \"51a9a536-9b7f-4a1f-b015-6153ead725cc\") " pod="openshift-console/console-689cb4cc55-dljj8" Jun 11 18:37:49.544344 ip-10-0-141-55 kubenswrapper[2578]: I0611 18:37:49.544256 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/51a9a536-9b7f-4a1f-b015-6153ead725cc-console-config\") pod \"console-689cb4cc55-dljj8\" (UID: \"51a9a536-9b7f-4a1f-b015-6153ead725cc\") " pod="openshift-console/console-689cb4cc55-dljj8" Jun 11 18:37:49.544344 ip-10-0-141-55 kubenswrapper[2578]: I0611 18:37:49.544296 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/51a9a536-9b7f-4a1f-b015-6153ead725cc-trusted-ca-bundle\") pod \"console-689cb4cc55-dljj8\" (UID: \"51a9a536-9b7f-4a1f-b015-6153ead725cc\") " pod="openshift-console/console-689cb4cc55-dljj8" Jun 11 18:37:49.544344 ip-10-0-141-55 kubenswrapper[2578]: I0611 18:37:49.544322 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/51a9a536-9b7f-4a1f-b015-6153ead725cc-console-oauth-config\") pod \"console-689cb4cc55-dljj8\" (UID: \"51a9a536-9b7f-4a1f-b015-6153ead725cc\") " pod="openshift-console/console-689cb4cc55-dljj8" Jun 11 18:37:49.544653 ip-10-0-141-55 kubenswrapper[2578]: I0611 18:37:49.544463 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/51a9a536-9b7f-4a1f-b015-6153ead725cc-service-ca\") pod \"console-689cb4cc55-dljj8\" (UID: \"51a9a536-9b7f-4a1f-b015-6153ead725cc\") " pod="openshift-console/console-689cb4cc55-dljj8" Jun 11 18:37:49.544653 ip-10-0-141-55 kubenswrapper[2578]: I0611 18:37:49.544533 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/51a9a536-9b7f-4a1f-b015-6153ead725cc-console-serving-cert\") pod \"console-689cb4cc55-dljj8\" (UID: \"51a9a536-9b7f-4a1f-b015-6153ead725cc\") " pod="openshift-console/console-689cb4cc55-dljj8" Jun 11 18:37:49.544653 ip-10-0-141-55 kubenswrapper[2578]: I0611 18:37:49.544597 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/51a9a536-9b7f-4a1f-b015-6153ead725cc-oauth-serving-cert\") pod \"console-689cb4cc55-dljj8\" (UID: \"51a9a536-9b7f-4a1f-b015-6153ead725cc\") " pod="openshift-console/console-689cb4cc55-dljj8" Jun 11 18:37:49.544791 ip-10-0-141-55 kubenswrapper[2578]: I0611 18:37:49.544660 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5jlbg\" (UniqueName: \"kubernetes.io/projected/51a9a536-9b7f-4a1f-b015-6153ead725cc-kube-api-access-5jlbg\") pod \"console-689cb4cc55-dljj8\" (UID: \"51a9a536-9b7f-4a1f-b015-6153ead725cc\") " pod="openshift-console/console-689cb4cc55-dljj8" Jun 11 18:37:49.545171 ip-10-0-141-55 kubenswrapper[2578]: I0611 18:37:49.545141 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/51a9a536-9b7f-4a1f-b015-6153ead725cc-console-config\") pod \"console-689cb4cc55-dljj8\" (UID: \"51a9a536-9b7f-4a1f-b015-6153ead725cc\") " pod="openshift-console/console-689cb4cc55-dljj8" Jun 11 18:37:49.545390 ip-10-0-141-55 kubenswrapper[2578]: I0611 18:37:49.545348 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/51a9a536-9b7f-4a1f-b015-6153ead725cc-service-ca\") pod \"console-689cb4cc55-dljj8\" (UID: \"51a9a536-9b7f-4a1f-b015-6153ead725cc\") " pod="openshift-console/console-689cb4cc55-dljj8" Jun 11 18:37:49.545517 ip-10-0-141-55 kubenswrapper[2578]: I0611 18:37:49.545494 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/51a9a536-9b7f-4a1f-b015-6153ead725cc-oauth-serving-cert\") pod \"console-689cb4cc55-dljj8\" (UID: \"51a9a536-9b7f-4a1f-b015-6153ead725cc\") " pod="openshift-console/console-689cb4cc55-dljj8" Jun 11 18:37:49.545864 ip-10-0-141-55 kubenswrapper[2578]: I0611 18:37:49.545844 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/51a9a536-9b7f-4a1f-b015-6153ead725cc-trusted-ca-bundle\") pod \"console-689cb4cc55-dljj8\" (UID: \"51a9a536-9b7f-4a1f-b015-6153ead725cc\") " pod="openshift-console/console-689cb4cc55-dljj8" Jun 11 18:37:49.547392 ip-10-0-141-55 kubenswrapper[2578]: I0611 18:37:49.547369 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/51a9a536-9b7f-4a1f-b015-6153ead725cc-console-oauth-config\") pod \"console-689cb4cc55-dljj8\" (UID: \"51a9a536-9b7f-4a1f-b015-6153ead725cc\") " pod="openshift-console/console-689cb4cc55-dljj8" Jun 11 18:37:49.547589 ip-10-0-141-55 kubenswrapper[2578]: I0611 18:37:49.547570 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/51a9a536-9b7f-4a1f-b015-6153ead725cc-console-serving-cert\") pod \"console-689cb4cc55-dljj8\" (UID: \"51a9a536-9b7f-4a1f-b015-6153ead725cc\") " pod="openshift-console/console-689cb4cc55-dljj8" Jun 11 18:37:49.553539 ip-10-0-141-55 kubenswrapper[2578]: I0611 18:37:49.553515 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-5jlbg\" (UniqueName: \"kubernetes.io/projected/51a9a536-9b7f-4a1f-b015-6153ead725cc-kube-api-access-5jlbg\") pod \"console-689cb4cc55-dljj8\" (UID: \"51a9a536-9b7f-4a1f-b015-6153ead725cc\") " pod="openshift-console/console-689cb4cc55-dljj8" Jun 11 18:37:49.621311 ip-10-0-141-55 kubenswrapper[2578]: I0611 18:37:49.621262 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-689cb4cc55-dljj8" Jun 11 18:37:49.763879 ip-10-0-141-55 kubenswrapper[2578]: I0611 18:37:49.763841 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-689cb4cc55-dljj8"] Jun 11 18:37:49.768922 ip-10-0-141-55 kubenswrapper[2578]: W0611 18:37:49.768891 2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod51a9a536_9b7f_4a1f_b015_6153ead725cc.slice/crio-7f6ff5b52d9dd14f9308b3b80b4851515546b361062c484ae63faa536e19cbc9 WatchSource:0}: Error finding container 7f6ff5b52d9dd14f9308b3b80b4851515546b361062c484ae63faa536e19cbc9: Status 404 returned error can't find the container with id 7f6ff5b52d9dd14f9308b3b80b4851515546b361062c484ae63faa536e19cbc9 Jun 11 18:37:49.775991 ip-10-0-141-55 kubenswrapper[2578]: I0611 18:37:49.775965 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-689cb4cc55-dljj8" event={"ID":"51a9a536-9b7f-4a1f-b015-6153ead725cc","Type":"ContainerStarted","Data":"7f6ff5b52d9dd14f9308b3b80b4851515546b361062c484ae63faa536e19cbc9"} Jun 11 18:37:49.778349 ip-10-0-141-55 kubenswrapper[2578]: I0611 18:37:49.778328 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-bcb865f69-qv4v2" event={"ID":"c3bd3e23-7aab-4949-b28b-2e4d00c32c5c","Type":"ContainerStarted","Data":"0fd43bc872bb3a32ad0f1757168f1623159fb48bf4571583e343450f15729ae9"} Jun 11 18:37:49.778451 ip-10-0-141-55 kubenswrapper[2578]: I0611 18:37:49.778391 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-bcb865f69-qv4v2" event={"ID":"c3bd3e23-7aab-4949-b28b-2e4d00c32c5c","Type":"ContainerStarted","Data":"f3b9b50e82605ba2f66eb7f28606ce1d53bf92c1d2e13252356537b9cdbd8b38"} Jun 11 18:37:49.778451 ip-10-0-141-55 kubenswrapper[2578]: I0611 18:37:49.778420 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-bcb865f69-qv4v2" event={"ID":"c3bd3e23-7aab-4949-b28b-2e4d00c32c5c","Type":"ContainerStarted","Data":"125fa068beedae69082ddfcf640f604ccc2080e4c8cecd545330c8384734c296"} Jun 11 18:37:49.860929 ip-10-0-141-55 kubenswrapper[2578]: I0611 18:37:49.860899 2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/telemeter-client-567cb5cd6-2rxfr"] Jun 11 18:37:49.865345 ip-10-0-141-55 kubenswrapper[2578]: I0611 18:37:49.865329 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/telemeter-client-567cb5cd6-2rxfr" Jun 11 18:37:49.868302 ip-10-0-141-55 kubenswrapper[2578]: I0611 18:37:49.868280 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client-kube-rbac-proxy-config\"" Jun 11 18:37:49.868543 ip-10-0-141-55 kubenswrapper[2578]: I0611 18:37:49.868529 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"federate-client-certs\"" Jun 11 18:37:49.869163 ip-10-0-141-55 kubenswrapper[2578]: I0611 18:37:49.869147 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client\"" Jun 11 18:37:49.869249 ip-10-0-141-55 kubenswrapper[2578]: I0611 18:37:49.869188 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client-dockercfg-shlwj\"" Jun 11 18:37:49.869249 ip-10-0-141-55 kubenswrapper[2578]: I0611 18:37:49.869199 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"telemeter-client-serving-certs-ca-bundle\"" Jun 11 18:37:49.869350 ip-10-0-141-55 kubenswrapper[2578]: I0611 18:37:49.869280 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client-tls\"" Jun 11 18:37:49.874854 ip-10-0-141-55 kubenswrapper[2578]: I0611 18:37:49.874831 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"telemeter-trusted-ca-bundle-8i12ta5c71j38\"" Jun 11 18:37:49.877545 ip-10-0-141-55 kubenswrapper[2578]: I0611 18:37:49.877525 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/telemeter-client-567cb5cd6-2rxfr"] Jun 11 18:37:49.948348 ip-10-0-141-55 kubenswrapper[2578]: I0611 18:37:49.948320 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"telemeter-client-tls\" (UniqueName: \"kubernetes.io/secret/da96e762-324d-459a-a284-f17631f4fa24-telemeter-client-tls\") pod \"telemeter-client-567cb5cd6-2rxfr\" (UID: \"da96e762-324d-459a-a284-f17631f4fa24\") " pod="openshift-monitoring/telemeter-client-567cb5cd6-2rxfr" Jun 11 18:37:49.948462 ip-10-0-141-55 kubenswrapper[2578]: I0611 18:37:49.948357 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-nq59q\" (UniqueName: \"kubernetes.io/projected/da96e762-324d-459a-a284-f17631f4fa24-kube-api-access-nq59q\") pod \"telemeter-client-567cb5cd6-2rxfr\" (UID: \"da96e762-324d-459a-a284-f17631f4fa24\") " pod="openshift-monitoring/telemeter-client-567cb5cd6-2rxfr" Jun 11 18:37:49.948462 ip-10-0-141-55 kubenswrapper[2578]: I0611 18:37:49.948381 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/da96e762-324d-459a-a284-f17631f4fa24-serving-certs-ca-bundle\") pod \"telemeter-client-567cb5cd6-2rxfr\" (UID: \"da96e762-324d-459a-a284-f17631f4fa24\") " pod="openshift-monitoring/telemeter-client-567cb5cd6-2rxfr" Jun 11 18:37:49.948462 ip-10-0-141-55 kubenswrapper[2578]: I0611 18:37:49.948411 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-telemeter-client\" (UniqueName: \"kubernetes.io/secret/da96e762-324d-459a-a284-f17631f4fa24-secret-telemeter-client\") pod \"telemeter-client-567cb5cd6-2rxfr\" (UID: \"da96e762-324d-459a-a284-f17631f4fa24\") " pod="openshift-monitoring/telemeter-client-567cb5cd6-2rxfr" Jun 11 18:37:49.948609 ip-10-0-141-55 kubenswrapper[2578]: I0611 18:37:49.948472 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"federate-client-tls\" (UniqueName: \"kubernetes.io/secret/da96e762-324d-459a-a284-f17631f4fa24-federate-client-tls\") pod \"telemeter-client-567cb5cd6-2rxfr\" (UID: \"da96e762-324d-459a-a284-f17631f4fa24\") " pod="openshift-monitoring/telemeter-client-567cb5cd6-2rxfr" Jun 11 18:37:49.948609 ip-10-0-141-55 kubenswrapper[2578]: I0611 18:37:49.948509 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-telemeter-client-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/da96e762-324d-459a-a284-f17631f4fa24-secret-telemeter-client-kube-rbac-proxy-config\") pod \"telemeter-client-567cb5cd6-2rxfr\" (UID: \"da96e762-324d-459a-a284-f17631f4fa24\") " pod="openshift-monitoring/telemeter-client-567cb5cd6-2rxfr" Jun 11 18:37:49.948609 ip-10-0-141-55 kubenswrapper[2578]: I0611 18:37:49.948528 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/da96e762-324d-459a-a284-f17631f4fa24-metrics-client-ca\") pod \"telemeter-client-567cb5cd6-2rxfr\" (UID: \"da96e762-324d-459a-a284-f17631f4fa24\") " pod="openshift-monitoring/telemeter-client-567cb5cd6-2rxfr" Jun 11 18:37:49.948609 ip-10-0-141-55 kubenswrapper[2578]: I0611 18:37:49.948591 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"telemeter-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/da96e762-324d-459a-a284-f17631f4fa24-telemeter-trusted-ca-bundle\") pod \"telemeter-client-567cb5cd6-2rxfr\" (UID: \"da96e762-324d-459a-a284-f17631f4fa24\") " pod="openshift-monitoring/telemeter-client-567cb5cd6-2rxfr" Jun 11 18:37:50.049528 ip-10-0-141-55 kubenswrapper[2578]: I0611 18:37:50.049487 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"telemeter-client-tls\" (UniqueName: \"kubernetes.io/secret/da96e762-324d-459a-a284-f17631f4fa24-telemeter-client-tls\") pod \"telemeter-client-567cb5cd6-2rxfr\" (UID: \"da96e762-324d-459a-a284-f17631f4fa24\") " pod="openshift-monitoring/telemeter-client-567cb5cd6-2rxfr" Jun 11 18:37:50.049699 ip-10-0-141-55 kubenswrapper[2578]: I0611 18:37:50.049570 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-nq59q\" (UniqueName: \"kubernetes.io/projected/da96e762-324d-459a-a284-f17631f4fa24-kube-api-access-nq59q\") pod \"telemeter-client-567cb5cd6-2rxfr\" (UID: \"da96e762-324d-459a-a284-f17631f4fa24\") " pod="openshift-monitoring/telemeter-client-567cb5cd6-2rxfr" Jun 11 18:37:50.049699 ip-10-0-141-55 kubenswrapper[2578]: I0611 18:37:50.049609 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/da96e762-324d-459a-a284-f17631f4fa24-serving-certs-ca-bundle\") pod \"telemeter-client-567cb5cd6-2rxfr\" (UID: \"da96e762-324d-459a-a284-f17631f4fa24\") " pod="openshift-monitoring/telemeter-client-567cb5cd6-2rxfr" Jun 11 18:37:50.049699 ip-10-0-141-55 kubenswrapper[2578]: I0611 18:37:50.049639 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-telemeter-client\" (UniqueName: \"kubernetes.io/secret/da96e762-324d-459a-a284-f17631f4fa24-secret-telemeter-client\") pod \"telemeter-client-567cb5cd6-2rxfr\" (UID: \"da96e762-324d-459a-a284-f17631f4fa24\") " pod="openshift-monitoring/telemeter-client-567cb5cd6-2rxfr" Jun 11 18:37:50.049699 ip-10-0-141-55 kubenswrapper[2578]: I0611 18:37:50.049673 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"federate-client-tls\" (UniqueName: \"kubernetes.io/secret/da96e762-324d-459a-a284-f17631f4fa24-federate-client-tls\") pod \"telemeter-client-567cb5cd6-2rxfr\" (UID: \"da96e762-324d-459a-a284-f17631f4fa24\") " pod="openshift-monitoring/telemeter-client-567cb5cd6-2rxfr" Jun 11 18:37:50.049969 ip-10-0-141-55 kubenswrapper[2578]: I0611 18:37:50.049753 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-telemeter-client-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/da96e762-324d-459a-a284-f17631f4fa24-secret-telemeter-client-kube-rbac-proxy-config\") pod \"telemeter-client-567cb5cd6-2rxfr\" (UID: \"da96e762-324d-459a-a284-f17631f4fa24\") " pod="openshift-monitoring/telemeter-client-567cb5cd6-2rxfr" Jun 11 18:37:50.049969 ip-10-0-141-55 kubenswrapper[2578]: I0611 18:37:50.049784 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/da96e762-324d-459a-a284-f17631f4fa24-metrics-client-ca\") pod \"telemeter-client-567cb5cd6-2rxfr\" (UID: \"da96e762-324d-459a-a284-f17631f4fa24\") " pod="openshift-monitoring/telemeter-client-567cb5cd6-2rxfr" Jun 11 18:37:50.049969 ip-10-0-141-55 kubenswrapper[2578]: I0611 18:37:50.049828 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"telemeter-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/da96e762-324d-459a-a284-f17631f4fa24-telemeter-trusted-ca-bundle\") pod \"telemeter-client-567cb5cd6-2rxfr\" (UID: \"da96e762-324d-459a-a284-f17631f4fa24\") " pod="openshift-monitoring/telemeter-client-567cb5cd6-2rxfr" Jun 11 18:37:50.050853 ip-10-0-141-55 kubenswrapper[2578]: I0611 18:37:50.050823 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"telemeter-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/da96e762-324d-459a-a284-f17631f4fa24-telemeter-trusted-ca-bundle\") pod \"telemeter-client-567cb5cd6-2rxfr\" (UID: \"da96e762-324d-459a-a284-f17631f4fa24\") " pod="openshift-monitoring/telemeter-client-567cb5cd6-2rxfr" Jun 11 18:37:50.051945 ip-10-0-141-55 kubenswrapper[2578]: I0611 18:37:50.051434 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/da96e762-324d-459a-a284-f17631f4fa24-serving-certs-ca-bundle\") pod \"telemeter-client-567cb5cd6-2rxfr\" (UID: \"da96e762-324d-459a-a284-f17631f4fa24\") " pod="openshift-monitoring/telemeter-client-567cb5cd6-2rxfr" Jun 11 18:37:50.051945 ip-10-0-141-55 kubenswrapper[2578]: I0611 18:37:50.051909 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/da96e762-324d-459a-a284-f17631f4fa24-metrics-client-ca\") pod \"telemeter-client-567cb5cd6-2rxfr\" (UID: \"da96e762-324d-459a-a284-f17631f4fa24\") " pod="openshift-monitoring/telemeter-client-567cb5cd6-2rxfr" Jun 11 18:37:50.052764 ip-10-0-141-55 kubenswrapper[2578]: I0611 18:37:50.052740 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"telemeter-client-tls\" (UniqueName: \"kubernetes.io/secret/da96e762-324d-459a-a284-f17631f4fa24-telemeter-client-tls\") pod \"telemeter-client-567cb5cd6-2rxfr\" (UID: \"da96e762-324d-459a-a284-f17631f4fa24\") " pod="openshift-monitoring/telemeter-client-567cb5cd6-2rxfr" Jun 11 18:37:50.052764 ip-10-0-141-55 kubenswrapper[2578]: I0611 18:37:50.052762 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"federate-client-tls\" (UniqueName: \"kubernetes.io/secret/da96e762-324d-459a-a284-f17631f4fa24-federate-client-tls\") pod \"telemeter-client-567cb5cd6-2rxfr\" (UID: \"da96e762-324d-459a-a284-f17631f4fa24\") " pod="openshift-monitoring/telemeter-client-567cb5cd6-2rxfr" Jun 11 18:37:50.053142 ip-10-0-141-55 kubenswrapper[2578]: I0611 18:37:50.053115 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-telemeter-client\" (UniqueName: \"kubernetes.io/secret/da96e762-324d-459a-a284-f17631f4fa24-secret-telemeter-client\") pod \"telemeter-client-567cb5cd6-2rxfr\" (UID: \"da96e762-324d-459a-a284-f17631f4fa24\") " pod="openshift-monitoring/telemeter-client-567cb5cd6-2rxfr" Jun 11 18:37:50.053477 ip-10-0-141-55 kubenswrapper[2578]: I0611 18:37:50.053437 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-telemeter-client-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/da96e762-324d-459a-a284-f17631f4fa24-secret-telemeter-client-kube-rbac-proxy-config\") pod \"telemeter-client-567cb5cd6-2rxfr\" (UID: \"da96e762-324d-459a-a284-f17631f4fa24\") " pod="openshift-monitoring/telemeter-client-567cb5cd6-2rxfr" Jun 11 18:37:50.059344 ip-10-0-141-55 kubenswrapper[2578]: I0611 18:37:50.059316 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-nq59q\" (UniqueName: \"kubernetes.io/projected/da96e762-324d-459a-a284-f17631f4fa24-kube-api-access-nq59q\") pod \"telemeter-client-567cb5cd6-2rxfr\" (UID: \"da96e762-324d-459a-a284-f17631f4fa24\") " pod="openshift-monitoring/telemeter-client-567cb5cd6-2rxfr" Jun 11 18:37:50.175586 ip-10-0-141-55 kubenswrapper[2578]: I0611 18:37:50.175472 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/telemeter-client-567cb5cd6-2rxfr" Jun 11 18:37:50.408798 ip-10-0-141-55 kubenswrapper[2578]: I0611 18:37:50.408770 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/telemeter-client-567cb5cd6-2rxfr"] Jun 11 18:37:50.416250 ip-10-0-141-55 kubenswrapper[2578]: W0611 18:37:50.416219 2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podda96e762_324d_459a_a284_f17631f4fa24.slice/crio-def75674d5fedefcd311040767b5d1cf125bfcbb24374269b15b056825e7216a WatchSource:0}: Error finding container def75674d5fedefcd311040767b5d1cf125bfcbb24374269b15b056825e7216a: Status 404 returned error can't find the container with id def75674d5fedefcd311040767b5d1cf125bfcbb24374269b15b056825e7216a Jun 11 18:37:50.787582 ip-10-0-141-55 kubenswrapper[2578]: I0611 18:37:50.787228 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-bcb865f69-qv4v2" event={"ID":"c3bd3e23-7aab-4949-b28b-2e4d00c32c5c","Type":"ContainerStarted","Data":"822797ce77eda0716e98b1ca4ca5ee47deec5c4631e95690d1824f681a6cd78f"} Jun 11 18:37:50.787582 ip-10-0-141-55 kubenswrapper[2578]: I0611 18:37:50.787323 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-bcb865f69-qv4v2" event={"ID":"c3bd3e23-7aab-4949-b28b-2e4d00c32c5c","Type":"ContainerStarted","Data":"e0c1eefa43a058bd9f8d73927a9debb28f1310d2a49343d1cf00109473a1112e"} Jun 11 18:37:50.787582 ip-10-0-141-55 kubenswrapper[2578]: I0611 18:37:50.787388 2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/thanos-querier-bcb865f69-qv4v2" Jun 11 18:37:50.787582 ip-10-0-141-55 kubenswrapper[2578]: I0611 18:37:50.787431 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-bcb865f69-qv4v2" event={"ID":"c3bd3e23-7aab-4949-b28b-2e4d00c32c5c","Type":"ContainerStarted","Data":"acc15978ee777c9baff495860cb18f171a5a4799d356e6d28f5cb1a193100397"} Jun 11 18:37:50.789063 ip-10-0-141-55 kubenswrapper[2578]: I0611 18:37:50.789035 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-567cb5cd6-2rxfr" event={"ID":"da96e762-324d-459a-a284-f17631f4fa24","Type":"ContainerStarted","Data":"def75674d5fedefcd311040767b5d1cf125bfcbb24374269b15b056825e7216a"} Jun 11 18:37:50.811662 ip-10-0-141-55 kubenswrapper[2578]: I0611 18:37:50.810334 2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/thanos-querier-bcb865f69-qv4v2" podStartSLOduration=1.7249663499999999 podStartE2EDuration="4.810315871s" totalImagesPullingTime="3.085349521s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-11 18:37:46 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-11 18:37:50.809703182 +0000 UTC m=+76.764377813" watchObservedRunningTime="2026-06-11 18:37:50.810315871 +0000 UTC m=+76.764990478" Jun 11 18:37:55.815256 ip-10-0-141-55 kubenswrapper[2578]: I0611 18:37:55.815223 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-567cb5cd6-2rxfr" event={"ID":"da96e762-324d-459a-a284-f17631f4fa24","Type":"ContainerStarted","Data":"878df0d682070ea3676c9efe30b069782dff71a44bba00b3155c6a4c62a313e6"} Jun 11 18:37:55.816490 ip-10-0-141-55 kubenswrapper[2578]: I0611 18:37:55.816459 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-lvmjk" event={"ID":"1261112f-ce68-462a-a73e-fa1942159096","Type":"ContainerStarted","Data":"fb8f7a6b8fd6d7cb727ea664b1464bcc9155f3660d4811550c8f587e3c29d53f"} Jun 11 18:37:55.817797 ip-10-0-141-55 kubenswrapper[2578]: I0611 18:37:55.817772 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-689cb4cc55-dljj8" event={"ID":"51a9a536-9b7f-4a1f-b015-6153ead725cc","Type":"ContainerStarted","Data":"fc3d4d6563e49aa195a6a70ca5e5371902574241cd48d110032e9ab6c0ebe4f3"} Jun 11 18:37:55.834433 ip-10-0-141-55 kubenswrapper[2578]: I0611 18:37:55.834393 2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/global-pull-secret-syncer-lvmjk" podStartSLOduration=65.570257658 podStartE2EDuration="1m11.834378353s" totalImagesPullingTime="6.264120695s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-11 18:36:44 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-11 18:37:55.833870914 +0000 UTC m=+81.788545520" watchObservedRunningTime="2026-06-11 18:37:55.834378353 +0000 UTC m=+81.789052937" Jun 11 18:37:55.854754 ip-10-0-141-55 kubenswrapper[2578]: I0611 18:37:55.854710 2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-689cb4cc55-dljj8" podStartSLOduration=1.8878172069999999 podStartE2EDuration="6.854694172s" totalImagesPullingTime="4.966876965s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-11 18:37:49 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-11 18:37:55.854118513 +0000 UTC m=+81.808793144" watchObservedRunningTime="2026-06-11 18:37:55.854694172 +0000 UTC m=+81.809368777" Jun 11 18:37:56.799100 ip-10-0-141-55 kubenswrapper[2578]: I0611 18:37:56.799074 2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/thanos-querier-bcb865f69-qv4v2" Jun 11 18:37:56.823377 ip-10-0-141-55 kubenswrapper[2578]: I0611 18:37:56.823340 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-567cb5cd6-2rxfr" event={"ID":"da96e762-324d-459a-a284-f17631f4fa24","Type":"ContainerStarted","Data":"4bbdc70598088ca2712b3b038cb38aebe18d16abec1042f6d949a1873f95cc7a"} Jun 11 18:37:56.823791 ip-10-0-141-55 kubenswrapper[2578]: I0611 18:37:56.823406 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-567cb5cd6-2rxfr" event={"ID":"da96e762-324d-459a-a284-f17631f4fa24","Type":"ContainerStarted","Data":"85ef0fab2700550485e8da52c86f6f826f8c1cf275c74ecabc1badd00635cbfb"} Jun 11 18:37:56.845309 ip-10-0-141-55 kubenswrapper[2578]: I0611 18:37:56.845254 2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/telemeter-client-567cb5cd6-2rxfr" podStartSLOduration=2.567572496 podStartE2EDuration="7.845233228s" totalImagesPullingTime="5.277660732s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-11 18:37:49 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-11 18:37:56.844491823 +0000 UTC m=+82.799166448" watchObservedRunningTime="2026-06-11 18:37:56.845233228 +0000 UTC m=+82.799907835" Jun 11 18:37:57.590626 ip-10-0-141-55 kubenswrapper[2578]: I0611 18:37:57.590585 2578 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-689cb4cc55-dljj8"] Jun 11 18:37:57.621286 ip-10-0-141-55 kubenswrapper[2578]: I0611 18:37:57.621254 2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-8f5c787f4-fpn4z"] Jun 11 18:37:57.624433 ip-10-0-141-55 kubenswrapper[2578]: I0611 18:37:57.624411 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-8f5c787f4-fpn4z" Jun 11 18:37:57.638292 ip-10-0-141-55 kubenswrapper[2578]: I0611 18:37:57.638267 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-8f5c787f4-fpn4z"] Jun 11 18:37:57.720331 ip-10-0-141-55 kubenswrapper[2578]: I0611 18:37:57.720296 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/fe67d9f0-a7af-4244-9ca3-1e7494dc46a6-console-serving-cert\") pod \"console-8f5c787f4-fpn4z\" (UID: \"fe67d9f0-a7af-4244-9ca3-1e7494dc46a6\") " pod="openshift-console/console-8f5c787f4-fpn4z" Jun 11 18:37:57.720525 ip-10-0-141-55 kubenswrapper[2578]: I0611 18:37:57.720337 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/fe67d9f0-a7af-4244-9ca3-1e7494dc46a6-trusted-ca-bundle\") pod \"console-8f5c787f4-fpn4z\" (UID: \"fe67d9f0-a7af-4244-9ca3-1e7494dc46a6\") " pod="openshift-console/console-8f5c787f4-fpn4z" Jun 11 18:37:57.720525 ip-10-0-141-55 kubenswrapper[2578]: I0611 18:37:57.720393 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/fe67d9f0-a7af-4244-9ca3-1e7494dc46a6-service-ca\") pod \"console-8f5c787f4-fpn4z\" (UID: \"fe67d9f0-a7af-4244-9ca3-1e7494dc46a6\") " pod="openshift-console/console-8f5c787f4-fpn4z" Jun 11 18:37:57.720525 ip-10-0-141-55 kubenswrapper[2578]: I0611 18:37:57.720410 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-fn4vt\" (UniqueName: \"kubernetes.io/projected/fe67d9f0-a7af-4244-9ca3-1e7494dc46a6-kube-api-access-fn4vt\") pod \"console-8f5c787f4-fpn4z\" (UID: \"fe67d9f0-a7af-4244-9ca3-1e7494dc46a6\") " pod="openshift-console/console-8f5c787f4-fpn4z" Jun 11 18:37:57.720525 ip-10-0-141-55 kubenswrapper[2578]: I0611 18:37:57.720437 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/fe67d9f0-a7af-4244-9ca3-1e7494dc46a6-oauth-serving-cert\") pod \"console-8f5c787f4-fpn4z\" (UID: \"fe67d9f0-a7af-4244-9ca3-1e7494dc46a6\") " pod="openshift-console/console-8f5c787f4-fpn4z" Jun 11 18:37:57.720525 ip-10-0-141-55 kubenswrapper[2578]: I0611 18:37:57.720459 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/fe67d9f0-a7af-4244-9ca3-1e7494dc46a6-console-config\") pod \"console-8f5c787f4-fpn4z\" (UID: \"fe67d9f0-a7af-4244-9ca3-1e7494dc46a6\") " pod="openshift-console/console-8f5c787f4-fpn4z" Jun 11 18:37:57.720525 ip-10-0-141-55 kubenswrapper[2578]: I0611 18:37:57.720482 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/fe67d9f0-a7af-4244-9ca3-1e7494dc46a6-console-oauth-config\") pod \"console-8f5c787f4-fpn4z\" (UID: \"fe67d9f0-a7af-4244-9ca3-1e7494dc46a6\") " pod="openshift-console/console-8f5c787f4-fpn4z" Jun 11 18:37:57.821220 ip-10-0-141-55 kubenswrapper[2578]: I0611 18:37:57.821182 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/fe67d9f0-a7af-4244-9ca3-1e7494dc46a6-service-ca\") pod \"console-8f5c787f4-fpn4z\" (UID: \"fe67d9f0-a7af-4244-9ca3-1e7494dc46a6\") " pod="openshift-console/console-8f5c787f4-fpn4z" Jun 11 18:37:57.821386 ip-10-0-141-55 kubenswrapper[2578]: I0611 18:37:57.821231 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-fn4vt\" (UniqueName: \"kubernetes.io/projected/fe67d9f0-a7af-4244-9ca3-1e7494dc46a6-kube-api-access-fn4vt\") pod \"console-8f5c787f4-fpn4z\" (UID: \"fe67d9f0-a7af-4244-9ca3-1e7494dc46a6\") " pod="openshift-console/console-8f5c787f4-fpn4z" Jun 11 18:37:57.821386 ip-10-0-141-55 kubenswrapper[2578]: I0611 18:37:57.821268 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/fe67d9f0-a7af-4244-9ca3-1e7494dc46a6-oauth-serving-cert\") pod \"console-8f5c787f4-fpn4z\" (UID: \"fe67d9f0-a7af-4244-9ca3-1e7494dc46a6\") " pod="openshift-console/console-8f5c787f4-fpn4z" Jun 11 18:37:57.821386 ip-10-0-141-55 kubenswrapper[2578]: I0611 18:37:57.821297 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/fe67d9f0-a7af-4244-9ca3-1e7494dc46a6-console-config\") pod \"console-8f5c787f4-fpn4z\" (UID: \"fe67d9f0-a7af-4244-9ca3-1e7494dc46a6\") " pod="openshift-console/console-8f5c787f4-fpn4z" Jun 11 18:37:57.821386 ip-10-0-141-55 kubenswrapper[2578]: I0611 18:37:57.821329 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/fe67d9f0-a7af-4244-9ca3-1e7494dc46a6-console-oauth-config\") pod \"console-8f5c787f4-fpn4z\" (UID: \"fe67d9f0-a7af-4244-9ca3-1e7494dc46a6\") " pod="openshift-console/console-8f5c787f4-fpn4z" Jun 11 18:37:57.821679 ip-10-0-141-55 kubenswrapper[2578]: I0611 18:37:57.821395 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/fe67d9f0-a7af-4244-9ca3-1e7494dc46a6-console-serving-cert\") pod \"console-8f5c787f4-fpn4z\" (UID: \"fe67d9f0-a7af-4244-9ca3-1e7494dc46a6\") " pod="openshift-console/console-8f5c787f4-fpn4z" Jun 11 18:37:57.821679 ip-10-0-141-55 kubenswrapper[2578]: I0611 18:37:57.821437 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/fe67d9f0-a7af-4244-9ca3-1e7494dc46a6-trusted-ca-bundle\") pod \"console-8f5c787f4-fpn4z\" (UID: \"fe67d9f0-a7af-4244-9ca3-1e7494dc46a6\") " pod="openshift-console/console-8f5c787f4-fpn4z" Jun 11 18:37:57.822294 ip-10-0-141-55 kubenswrapper[2578]: I0611 18:37:57.822266 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/fe67d9f0-a7af-4244-9ca3-1e7494dc46a6-service-ca\") pod \"console-8f5c787f4-fpn4z\" (UID: \"fe67d9f0-a7af-4244-9ca3-1e7494dc46a6\") " pod="openshift-console/console-8f5c787f4-fpn4z" Jun 11 18:37:57.822433 ip-10-0-141-55 kubenswrapper[2578]: I0611 18:37:57.822292 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/fe67d9f0-a7af-4244-9ca3-1e7494dc46a6-oauth-serving-cert\") pod \"console-8f5c787f4-fpn4z\" (UID: \"fe67d9f0-a7af-4244-9ca3-1e7494dc46a6\") " pod="openshift-console/console-8f5c787f4-fpn4z" Jun 11 18:37:57.822433 ip-10-0-141-55 kubenswrapper[2578]: I0611 18:37:57.822319 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/fe67d9f0-a7af-4244-9ca3-1e7494dc46a6-console-config\") pod \"console-8f5c787f4-fpn4z\" (UID: \"fe67d9f0-a7af-4244-9ca3-1e7494dc46a6\") " pod="openshift-console/console-8f5c787f4-fpn4z" Jun 11 18:37:57.822695 ip-10-0-141-55 kubenswrapper[2578]: I0611 18:37:57.822647 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/fe67d9f0-a7af-4244-9ca3-1e7494dc46a6-trusted-ca-bundle\") pod \"console-8f5c787f4-fpn4z\" (UID: \"fe67d9f0-a7af-4244-9ca3-1e7494dc46a6\") " pod="openshift-console/console-8f5c787f4-fpn4z" Jun 11 18:37:57.824940 ip-10-0-141-55 kubenswrapper[2578]: I0611 18:37:57.824910 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/fe67d9f0-a7af-4244-9ca3-1e7494dc46a6-console-oauth-config\") pod \"console-8f5c787f4-fpn4z\" (UID: \"fe67d9f0-a7af-4244-9ca3-1e7494dc46a6\") " pod="openshift-console/console-8f5c787f4-fpn4z" Jun 11 18:37:57.825425 ip-10-0-141-55 kubenswrapper[2578]: I0611 18:37:57.825400 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/fe67d9f0-a7af-4244-9ca3-1e7494dc46a6-console-serving-cert\") pod \"console-8f5c787f4-fpn4z\" (UID: \"fe67d9f0-a7af-4244-9ca3-1e7494dc46a6\") " pod="openshift-console/console-8f5c787f4-fpn4z" Jun 11 18:37:57.830906 ip-10-0-141-55 kubenswrapper[2578]: I0611 18:37:57.830880 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-fn4vt\" (UniqueName: \"kubernetes.io/projected/fe67d9f0-a7af-4244-9ca3-1e7494dc46a6-kube-api-access-fn4vt\") pod \"console-8f5c787f4-fpn4z\" (UID: \"fe67d9f0-a7af-4244-9ca3-1e7494dc46a6\") " pod="openshift-console/console-8f5c787f4-fpn4z" Jun 11 18:37:57.935975 ip-10-0-141-55 kubenswrapper[2578]: I0611 18:37:57.935942 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-8f5c787f4-fpn4z" Jun 11 18:37:58.084444 ip-10-0-141-55 kubenswrapper[2578]: I0611 18:37:58.084413 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-8f5c787f4-fpn4z"] Jun 11 18:37:58.834112 ip-10-0-141-55 kubenswrapper[2578]: I0611 18:37:58.834077 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-8f5c787f4-fpn4z" event={"ID":"fe67d9f0-a7af-4244-9ca3-1e7494dc46a6","Type":"ContainerStarted","Data":"a4a198bd9ae8aad52bf94b282e3dca526433d5480a55bd42c4740e34d0a8c994"} Jun 11 18:37:58.834468 ip-10-0-141-55 kubenswrapper[2578]: I0611 18:37:58.834130 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-8f5c787f4-fpn4z" event={"ID":"fe67d9f0-a7af-4244-9ca3-1e7494dc46a6","Type":"ContainerStarted","Data":"77c70436f815831b428b5ce912c4d688f452ebaef45093229581437dc191bd27"} Jun 11 18:37:58.855881 ip-10-0-141-55 kubenswrapper[2578]: I0611 18:37:58.855829 2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-8f5c787f4-fpn4z" podStartSLOduration=1.855814965 podStartE2EDuration="1.855814965s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-11 18:37:57 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-11 18:37:58.854625102 +0000 UTC m=+84.809299723" watchObservedRunningTime="2026-06-11 18:37:58.855814965 +0000 UTC m=+84.810489572" Jun 11 18:37:59.622352 ip-10-0-141-55 kubenswrapper[2578]: I0611 18:37:59.622315 2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-689cb4cc55-dljj8" Jun 11 18:38:07.936361 ip-10-0-141-55 kubenswrapper[2578]: I0611 18:38:07.936318 2578 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-8f5c787f4-fpn4z" Jun 11 18:38:07.936835 ip-10-0-141-55 kubenswrapper[2578]: I0611 18:38:07.936394 2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-8f5c787f4-fpn4z" Jun 11 18:38:07.941336 ip-10-0-141-55 kubenswrapper[2578]: I0611 18:38:07.941315 2578 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-8f5c787f4-fpn4z" Jun 11 18:38:08.873965 ip-10-0-141-55 kubenswrapper[2578]: I0611 18:38:08.873933 2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-8f5c787f4-fpn4z" Jun 11 18:38:15.755267 ip-10-0-141-55 kubenswrapper[2578]: I0611 18:38:15.755238 2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-network-diagnostics/network-check-target-hjkh2" Jun 11 18:38:22.851422 ip-10-0-141-55 kubenswrapper[2578]: I0611 18:38:22.851352 2578 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-console/console-689cb4cc55-dljj8" podUID="51a9a536-9b7f-4a1f-b015-6153ead725cc" containerName="console" containerID="cri-o://fc3d4d6563e49aa195a6a70ca5e5371902574241cd48d110032e9ab6c0ebe4f3" gracePeriod=15 Jun 11 18:38:23.152284 ip-10-0-141-55 kubenswrapper[2578]: I0611 18:38:23.152253 2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-689cb4cc55-dljj8" Jun 11 18:38:23.208888 ip-10-0-141-55 kubenswrapper[2578]: I0611 18:38:23.208857 2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/51a9a536-9b7f-4a1f-b015-6153ead725cc-console-oauth-config\") pod \"51a9a536-9b7f-4a1f-b015-6153ead725cc\" (UID: \"51a9a536-9b7f-4a1f-b015-6153ead725cc\") " Jun 11 18:38:23.209039 ip-10-0-141-55 kubenswrapper[2578]: I0611 18:38:23.208897 2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-5jlbg\" (UniqueName: \"kubernetes.io/projected/51a9a536-9b7f-4a1f-b015-6153ead725cc-kube-api-access-5jlbg\") pod \"51a9a536-9b7f-4a1f-b015-6153ead725cc\" (UID: \"51a9a536-9b7f-4a1f-b015-6153ead725cc\") " Jun 11 18:38:23.209039 ip-10-0-141-55 kubenswrapper[2578]: I0611 18:38:23.208922 2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/51a9a536-9b7f-4a1f-b015-6153ead725cc-console-config\") pod \"51a9a536-9b7f-4a1f-b015-6153ead725cc\" (UID: \"51a9a536-9b7f-4a1f-b015-6153ead725cc\") " Jun 11 18:38:23.209039 ip-10-0-141-55 kubenswrapper[2578]: I0611 18:38:23.208937 2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/51a9a536-9b7f-4a1f-b015-6153ead725cc-console-serving-cert\") pod \"51a9a536-9b7f-4a1f-b015-6153ead725cc\" (UID: \"51a9a536-9b7f-4a1f-b015-6153ead725cc\") " Jun 11 18:38:23.209039 ip-10-0-141-55 kubenswrapper[2578]: I0611 18:38:23.208952 2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/51a9a536-9b7f-4a1f-b015-6153ead725cc-service-ca\") pod \"51a9a536-9b7f-4a1f-b015-6153ead725cc\" (UID: \"51a9a536-9b7f-4a1f-b015-6153ead725cc\") " Jun 11 18:38:23.209039 ip-10-0-141-55 kubenswrapper[2578]: I0611 18:38:23.208978 2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/51a9a536-9b7f-4a1f-b015-6153ead725cc-trusted-ca-bundle\") pod \"51a9a536-9b7f-4a1f-b015-6153ead725cc\" (UID: \"51a9a536-9b7f-4a1f-b015-6153ead725cc\") " Jun 11 18:38:23.209330 ip-10-0-141-55 kubenswrapper[2578]: I0611 18:38:23.209045 2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/51a9a536-9b7f-4a1f-b015-6153ead725cc-oauth-serving-cert\") pod \"51a9a536-9b7f-4a1f-b015-6153ead725cc\" (UID: \"51a9a536-9b7f-4a1f-b015-6153ead725cc\") " Jun 11 18:38:23.209397 ip-10-0-141-55 kubenswrapper[2578]: I0611 18:38:23.209338 2578 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/51a9a536-9b7f-4a1f-b015-6153ead725cc-console-config" (OuterVolumeSpecName: "console-config") pod "51a9a536-9b7f-4a1f-b015-6153ead725cc" (UID: "51a9a536-9b7f-4a1f-b015-6153ead725cc"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 11 18:38:23.209455 ip-10-0-141-55 kubenswrapper[2578]: I0611 18:38:23.209426 2578 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/51a9a536-9b7f-4a1f-b015-6153ead725cc-service-ca" (OuterVolumeSpecName: "service-ca") pod "51a9a536-9b7f-4a1f-b015-6153ead725cc" (UID: "51a9a536-9b7f-4a1f-b015-6153ead725cc"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 11 18:38:23.209506 ip-10-0-141-55 kubenswrapper[2578]: I0611 18:38:23.209450 2578 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/51a9a536-9b7f-4a1f-b015-6153ead725cc-trusted-ca-bundle" (OuterVolumeSpecName: "trusted-ca-bundle") pod "51a9a536-9b7f-4a1f-b015-6153ead725cc" (UID: "51a9a536-9b7f-4a1f-b015-6153ead725cc"). InnerVolumeSpecName "trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 11 18:38:23.209580 ip-10-0-141-55 kubenswrapper[2578]: I0611 18:38:23.209533 2578 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/51a9a536-9b7f-4a1f-b015-6153ead725cc-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "51a9a536-9b7f-4a1f-b015-6153ead725cc" (UID: "51a9a536-9b7f-4a1f-b015-6153ead725cc"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 11 18:38:23.211189 ip-10-0-141-55 kubenswrapper[2578]: I0611 18:38:23.211158 2578 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/51a9a536-9b7f-4a1f-b015-6153ead725cc-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "51a9a536-9b7f-4a1f-b015-6153ead725cc" (UID: "51a9a536-9b7f-4a1f-b015-6153ead725cc"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 11 18:38:23.211189 ip-10-0-141-55 kubenswrapper[2578]: I0611 18:38:23.211175 2578 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/51a9a536-9b7f-4a1f-b015-6153ead725cc-kube-api-access-5jlbg" (OuterVolumeSpecName: "kube-api-access-5jlbg") pod "51a9a536-9b7f-4a1f-b015-6153ead725cc" (UID: "51a9a536-9b7f-4a1f-b015-6153ead725cc"). InnerVolumeSpecName "kube-api-access-5jlbg". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 11 18:38:23.211319 ip-10-0-141-55 kubenswrapper[2578]: I0611 18:38:23.211190 2578 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/51a9a536-9b7f-4a1f-b015-6153ead725cc-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "51a9a536-9b7f-4a1f-b015-6153ead725cc" (UID: "51a9a536-9b7f-4a1f-b015-6153ead725cc"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 11 18:38:23.310096 ip-10-0-141-55 kubenswrapper[2578]: I0611 18:38:23.310069 2578 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/51a9a536-9b7f-4a1f-b015-6153ead725cc-oauth-serving-cert\") on node \"ip-10-0-141-55.ec2.internal\" DevicePath \"\"" Jun 11 18:38:23.310096 ip-10-0-141-55 kubenswrapper[2578]: I0611 18:38:23.310092 2578 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/51a9a536-9b7f-4a1f-b015-6153ead725cc-console-oauth-config\") on node \"ip-10-0-141-55.ec2.internal\" DevicePath \"\"" Jun 11 18:38:23.310096 ip-10-0-141-55 kubenswrapper[2578]: I0611 18:38:23.310101 2578 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-5jlbg\" (UniqueName: \"kubernetes.io/projected/51a9a536-9b7f-4a1f-b015-6153ead725cc-kube-api-access-5jlbg\") on node \"ip-10-0-141-55.ec2.internal\" DevicePath \"\"" Jun 11 18:38:23.310292 ip-10-0-141-55 kubenswrapper[2578]: I0611 18:38:23.310111 2578 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/51a9a536-9b7f-4a1f-b015-6153ead725cc-console-config\") on node \"ip-10-0-141-55.ec2.internal\" DevicePath \"\"" Jun 11 18:38:23.310292 ip-10-0-141-55 kubenswrapper[2578]: I0611 18:38:23.310120 2578 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/51a9a536-9b7f-4a1f-b015-6153ead725cc-console-serving-cert\") on node \"ip-10-0-141-55.ec2.internal\" DevicePath \"\"" Jun 11 18:38:23.310292 ip-10-0-141-55 kubenswrapper[2578]: I0611 18:38:23.310128 2578 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/51a9a536-9b7f-4a1f-b015-6153ead725cc-service-ca\") on node \"ip-10-0-141-55.ec2.internal\" DevicePath \"\"" Jun 11 18:38:23.310292 ip-10-0-141-55 kubenswrapper[2578]: I0611 18:38:23.310136 2578 reconciler_common.go:299] "Volume detached for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/51a9a536-9b7f-4a1f-b015-6153ead725cc-trusted-ca-bundle\") on node \"ip-10-0-141-55.ec2.internal\" DevicePath \"\"" Jun 11 18:38:23.923687 ip-10-0-141-55 kubenswrapper[2578]: I0611 18:38:23.923648 2578 generic.go:356] "Generic (PLEG): container finished" podID="51a9a536-9b7f-4a1f-b015-6153ead725cc" containerID="fc3d4d6563e49aa195a6a70ca5e5371902574241cd48d110032e9ab6c0ebe4f3" exitCode=0 Jun 11 18:38:23.924166 ip-10-0-141-55 kubenswrapper[2578]: I0611 18:38:23.923697 2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-689cb4cc55-dljj8" Jun 11 18:38:23.924166 ip-10-0-141-55 kubenswrapper[2578]: I0611 18:38:23.923729 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-689cb4cc55-dljj8" event={"ID":"51a9a536-9b7f-4a1f-b015-6153ead725cc","Type":"ContainerDied","Data":"fc3d4d6563e49aa195a6a70ca5e5371902574241cd48d110032e9ab6c0ebe4f3"} Jun 11 18:38:23.924166 ip-10-0-141-55 kubenswrapper[2578]: I0611 18:38:23.923780 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-689cb4cc55-dljj8" event={"ID":"51a9a536-9b7f-4a1f-b015-6153ead725cc","Type":"ContainerDied","Data":"7f6ff5b52d9dd14f9308b3b80b4851515546b361062c484ae63faa536e19cbc9"} Jun 11 18:38:23.924166 ip-10-0-141-55 kubenswrapper[2578]: I0611 18:38:23.923799 2578 scope.go:117] "RemoveContainer" containerID="fc3d4d6563e49aa195a6a70ca5e5371902574241cd48d110032e9ab6c0ebe4f3" Jun 11 18:38:23.932022 ip-10-0-141-55 kubenswrapper[2578]: I0611 18:38:23.932008 2578 scope.go:117] "RemoveContainer" containerID="fc3d4d6563e49aa195a6a70ca5e5371902574241cd48d110032e9ab6c0ebe4f3" Jun 11 18:38:23.932275 ip-10-0-141-55 kubenswrapper[2578]: E0611 18:38:23.932258 2578 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"fc3d4d6563e49aa195a6a70ca5e5371902574241cd48d110032e9ab6c0ebe4f3\": container with ID starting with fc3d4d6563e49aa195a6a70ca5e5371902574241cd48d110032e9ab6c0ebe4f3 not found: ID does not exist" containerID="fc3d4d6563e49aa195a6a70ca5e5371902574241cd48d110032e9ab6c0ebe4f3" Jun 11 18:38:23.932319 ip-10-0-141-55 kubenswrapper[2578]: I0611 18:38:23.932281 2578 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"fc3d4d6563e49aa195a6a70ca5e5371902574241cd48d110032e9ab6c0ebe4f3"} err="failed to get container status \"fc3d4d6563e49aa195a6a70ca5e5371902574241cd48d110032e9ab6c0ebe4f3\": rpc error: code = NotFound desc = could not find container \"fc3d4d6563e49aa195a6a70ca5e5371902574241cd48d110032e9ab6c0ebe4f3\": container with ID starting with fc3d4d6563e49aa195a6a70ca5e5371902574241cd48d110032e9ab6c0ebe4f3 not found: ID does not exist" Jun 11 18:38:23.944974 ip-10-0-141-55 kubenswrapper[2578]: I0611 18:38:23.944953 2578 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-689cb4cc55-dljj8"] Jun 11 18:38:23.948300 ip-10-0-141-55 kubenswrapper[2578]: I0611 18:38:23.948280 2578 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-689cb4cc55-dljj8"] Jun 11 18:38:24.421951 ip-10-0-141-55 kubenswrapper[2578]: I0611 18:38:24.421917 2578 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="51a9a536-9b7f-4a1f-b015-6153ead725cc" path="/var/lib/kubelet/pods/51a9a536-9b7f-4a1f-b015-6153ead725cc/volumes" Jun 11 18:39:06.647542 ip-10-0-141-55 kubenswrapper[2578]: I0611 18:39:06.647511 2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Jun 11 18:39:06.648089 ip-10-0-141-55 kubenswrapper[2578]: I0611 18:39:06.647784 2578 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="51a9a536-9b7f-4a1f-b015-6153ead725cc" containerName="console" Jun 11 18:39:06.648089 ip-10-0-141-55 kubenswrapper[2578]: I0611 18:39:06.647797 2578 state_mem.go:107] "Deleted CPUSet assignment" podUID="51a9a536-9b7f-4a1f-b015-6153ead725cc" containerName="console" Jun 11 18:39:06.648089 ip-10-0-141-55 kubenswrapper[2578]: I0611 18:39:06.647851 2578 memory_manager.go:368] "RemoveStaleState removing state" podUID="51a9a536-9b7f-4a1f-b015-6153ead725cc" containerName="console" Jun 11 18:39:06.653337 ip-10-0-141-55 kubenswrapper[2578]: I0611 18:39:06.653315 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0" Jun 11 18:39:06.656084 ip-10-0-141-55 kubenswrapper[2578]: I0611 18:39:06.656061 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-web-config\"" Jun 11 18:39:06.656239 ip-10-0-141-55 kubenswrapper[2578]: I0611 18:39:06.656222 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-cluster-tls-config\"" Jun 11 18:39:06.656307 ip-10-0-141-55 kubenswrapper[2578]: I0611 18:39:06.656270 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-generated\"" Jun 11 18:39:06.657683 ip-10-0-141-55 kubenswrapper[2578]: I0611 18:39:06.657667 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-tls\"" Jun 11 18:39:06.657801 ip-10-0-141-55 kubenswrapper[2578]: I0611 18:39:06.657758 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy\"" Jun 11 18:39:06.657801 ip-10-0-141-55 kubenswrapper[2578]: I0611 18:39:06.657793 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy-web\"" Jun 11 18:39:06.657919 ip-10-0-141-55 kubenswrapper[2578]: I0611 18:39:06.657845 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-dockercfg-rsm52\"" Jun 11 18:39:06.657919 ip-10-0-141-55 kubenswrapper[2578]: I0611 18:39:06.657867 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-tls-assets-0\"" Jun 11 18:39:06.658019 ip-10-0-141-55 kubenswrapper[2578]: I0611 18:39:06.657939 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy-metric\"" Jun 11 18:39:06.662091 ip-10-0-141-55 kubenswrapper[2578]: I0611 18:39:06.662049 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"alertmanager-trusted-ca-bundle\"" Jun 11 18:39:06.664973 ip-10-0-141-55 kubenswrapper[2578]: I0611 18:39:06.664954 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Jun 11 18:39:06.740362 ip-10-0-141-55 kubenswrapper[2578]: I0611 18:39:06.740327 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/214e4501-6a30-4593-9a84-8cc0f0fe6a21-config-out\") pod \"alertmanager-main-0\" (UID: \"214e4501-6a30-4593-9a84-8cc0f0fe6a21\") " pod="openshift-monitoring/alertmanager-main-0" Jun 11 18:39:06.740520 ip-10-0-141-55 kubenswrapper[2578]: I0611 18:39:06.740369 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/214e4501-6a30-4593-9a84-8cc0f0fe6a21-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"214e4501-6a30-4593-9a84-8cc0f0fe6a21\") " pod="openshift-monitoring/alertmanager-main-0" Jun 11 18:39:06.740520 ip-10-0-141-55 kubenswrapper[2578]: I0611 18:39:06.740398 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/214e4501-6a30-4593-9a84-8cc0f0fe6a21-config-volume\") pod \"alertmanager-main-0\" (UID: \"214e4501-6a30-4593-9a84-8cc0f0fe6a21\") " pod="openshift-monitoring/alertmanager-main-0" Jun 11 18:39:06.740520 ip-10-0-141-55 kubenswrapper[2578]: I0611 18:39:06.740430 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/214e4501-6a30-4593-9a84-8cc0f0fe6a21-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"214e4501-6a30-4593-9a84-8cc0f0fe6a21\") " pod="openshift-monitoring/alertmanager-main-0" Jun 11 18:39:06.740520 ip-10-0-141-55 kubenswrapper[2578]: I0611 18:39:06.740453 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/214e4501-6a30-4593-9a84-8cc0f0fe6a21-web-config\") pod \"alertmanager-main-0\" (UID: \"214e4501-6a30-4593-9a84-8cc0f0fe6a21\") " pod="openshift-monitoring/alertmanager-main-0" Jun 11 18:39:06.740520 ip-10-0-141-55 kubenswrapper[2578]: I0611 18:39:06.740486 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-sz87d\" (UniqueName: \"kubernetes.io/projected/214e4501-6a30-4593-9a84-8cc0f0fe6a21-kube-api-access-sz87d\") pod \"alertmanager-main-0\" (UID: \"214e4501-6a30-4593-9a84-8cc0f0fe6a21\") " pod="openshift-monitoring/alertmanager-main-0" Jun 11 18:39:06.740520 ip-10-0-141-55 kubenswrapper[2578]: I0611 18:39:06.740510 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/214e4501-6a30-4593-9a84-8cc0f0fe6a21-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"214e4501-6a30-4593-9a84-8cc0f0fe6a21\") " pod="openshift-monitoring/alertmanager-main-0" Jun 11 18:39:06.740748 ip-10-0-141-55 kubenswrapper[2578]: I0611 18:39:06.740531 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/214e4501-6a30-4593-9a84-8cc0f0fe6a21-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"214e4501-6a30-4593-9a84-8cc0f0fe6a21\") " pod="openshift-monitoring/alertmanager-main-0" Jun 11 18:39:06.740748 ip-10-0-141-55 kubenswrapper[2578]: I0611 18:39:06.740551 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/214e4501-6a30-4593-9a84-8cc0f0fe6a21-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"214e4501-6a30-4593-9a84-8cc0f0fe6a21\") " pod="openshift-monitoring/alertmanager-main-0" Jun 11 18:39:06.740748 ip-10-0-141-55 kubenswrapper[2578]: I0611 18:39:06.740613 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/214e4501-6a30-4593-9a84-8cc0f0fe6a21-tls-assets\") pod \"alertmanager-main-0\" (UID: \"214e4501-6a30-4593-9a84-8cc0f0fe6a21\") " pod="openshift-monitoring/alertmanager-main-0" Jun 11 18:39:06.740748 ip-10-0-141-55 kubenswrapper[2578]: I0611 18:39:06.740637 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/214e4501-6a30-4593-9a84-8cc0f0fe6a21-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"214e4501-6a30-4593-9a84-8cc0f0fe6a21\") " pod="openshift-monitoring/alertmanager-main-0" Jun 11 18:39:06.740748 ip-10-0-141-55 kubenswrapper[2578]: I0611 18:39:06.740654 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/214e4501-6a30-4593-9a84-8cc0f0fe6a21-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"214e4501-6a30-4593-9a84-8cc0f0fe6a21\") " pod="openshift-monitoring/alertmanager-main-0" Jun 11 18:39:06.740748 ip-10-0-141-55 kubenswrapper[2578]: I0611 18:39:06.740673 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/214e4501-6a30-4593-9a84-8cc0f0fe6a21-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"214e4501-6a30-4593-9a84-8cc0f0fe6a21\") " pod="openshift-monitoring/alertmanager-main-0" Jun 11 18:39:06.841260 ip-10-0-141-55 kubenswrapper[2578]: I0611 18:39:06.841225 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/214e4501-6a30-4593-9a84-8cc0f0fe6a21-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"214e4501-6a30-4593-9a84-8cc0f0fe6a21\") " pod="openshift-monitoring/alertmanager-main-0" Jun 11 18:39:06.841260 ip-10-0-141-55 kubenswrapper[2578]: I0611 18:39:06.841259 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/214e4501-6a30-4593-9a84-8cc0f0fe6a21-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"214e4501-6a30-4593-9a84-8cc0f0fe6a21\") " pod="openshift-monitoring/alertmanager-main-0" Jun 11 18:39:06.841484 ip-10-0-141-55 kubenswrapper[2578]: I0611 18:39:06.841285 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/214e4501-6a30-4593-9a84-8cc0f0fe6a21-tls-assets\") pod \"alertmanager-main-0\" (UID: \"214e4501-6a30-4593-9a84-8cc0f0fe6a21\") " pod="openshift-monitoring/alertmanager-main-0" Jun 11 18:39:06.841484 ip-10-0-141-55 kubenswrapper[2578]: I0611 18:39:06.841305 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/214e4501-6a30-4593-9a84-8cc0f0fe6a21-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"214e4501-6a30-4593-9a84-8cc0f0fe6a21\") " pod="openshift-monitoring/alertmanager-main-0" Jun 11 18:39:06.841484 ip-10-0-141-55 kubenswrapper[2578]: I0611 18:39:06.841321 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/214e4501-6a30-4593-9a84-8cc0f0fe6a21-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"214e4501-6a30-4593-9a84-8cc0f0fe6a21\") " pod="openshift-monitoring/alertmanager-main-0" Jun 11 18:39:06.841484 ip-10-0-141-55 kubenswrapper[2578]: I0611 18:39:06.841347 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/214e4501-6a30-4593-9a84-8cc0f0fe6a21-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"214e4501-6a30-4593-9a84-8cc0f0fe6a21\") " pod="openshift-monitoring/alertmanager-main-0" Jun 11 18:39:06.841484 ip-10-0-141-55 kubenswrapper[2578]: I0611 18:39:06.841374 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/214e4501-6a30-4593-9a84-8cc0f0fe6a21-config-out\") pod \"alertmanager-main-0\" (UID: \"214e4501-6a30-4593-9a84-8cc0f0fe6a21\") " pod="openshift-monitoring/alertmanager-main-0" Jun 11 18:39:06.841484 ip-10-0-141-55 kubenswrapper[2578]: I0611 18:39:06.841416 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/214e4501-6a30-4593-9a84-8cc0f0fe6a21-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"214e4501-6a30-4593-9a84-8cc0f0fe6a21\") " pod="openshift-monitoring/alertmanager-main-0" Jun 11 18:39:06.841484 ip-10-0-141-55 kubenswrapper[2578]: I0611 18:39:06.841453 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/214e4501-6a30-4593-9a84-8cc0f0fe6a21-config-volume\") pod \"alertmanager-main-0\" (UID: \"214e4501-6a30-4593-9a84-8cc0f0fe6a21\") " pod="openshift-monitoring/alertmanager-main-0" Jun 11 18:39:06.841839 ip-10-0-141-55 kubenswrapper[2578]: I0611 18:39:06.841487 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/214e4501-6a30-4593-9a84-8cc0f0fe6a21-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"214e4501-6a30-4593-9a84-8cc0f0fe6a21\") " pod="openshift-monitoring/alertmanager-main-0" Jun 11 18:39:06.841839 ip-10-0-141-55 kubenswrapper[2578]: I0611 18:39:06.841521 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/214e4501-6a30-4593-9a84-8cc0f0fe6a21-web-config\") pod \"alertmanager-main-0\" (UID: \"214e4501-6a30-4593-9a84-8cc0f0fe6a21\") " pod="openshift-monitoring/alertmanager-main-0" Jun 11 18:39:06.841839 ip-10-0-141-55 kubenswrapper[2578]: I0611 18:39:06.841594 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-sz87d\" (UniqueName: \"kubernetes.io/projected/214e4501-6a30-4593-9a84-8cc0f0fe6a21-kube-api-access-sz87d\") pod \"alertmanager-main-0\" (UID: \"214e4501-6a30-4593-9a84-8cc0f0fe6a21\") " pod="openshift-monitoring/alertmanager-main-0" Jun 11 18:39:06.841839 ip-10-0-141-55 kubenswrapper[2578]: I0611 18:39:06.841633 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/214e4501-6a30-4593-9a84-8cc0f0fe6a21-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"214e4501-6a30-4593-9a84-8cc0f0fe6a21\") " pod="openshift-monitoring/alertmanager-main-0" Jun 11 18:39:06.842099 ip-10-0-141-55 kubenswrapper[2578]: I0611 18:39:06.842072 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/214e4501-6a30-4593-9a84-8cc0f0fe6a21-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"214e4501-6a30-4593-9a84-8cc0f0fe6a21\") " pod="openshift-monitoring/alertmanager-main-0" Jun 11 18:39:06.842211 ip-10-0-141-55 kubenswrapper[2578]: I0611 18:39:06.842189 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/214e4501-6a30-4593-9a84-8cc0f0fe6a21-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"214e4501-6a30-4593-9a84-8cc0f0fe6a21\") " pod="openshift-monitoring/alertmanager-main-0" Jun 11 18:39:06.842970 ip-10-0-141-55 kubenswrapper[2578]: I0611 18:39:06.842945 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/214e4501-6a30-4593-9a84-8cc0f0fe6a21-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"214e4501-6a30-4593-9a84-8cc0f0fe6a21\") " pod="openshift-monitoring/alertmanager-main-0" Jun 11 18:39:06.844492 ip-10-0-141-55 kubenswrapper[2578]: I0611 18:39:06.844464 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/214e4501-6a30-4593-9a84-8cc0f0fe6a21-tls-assets\") pod \"alertmanager-main-0\" (UID: \"214e4501-6a30-4593-9a84-8cc0f0fe6a21\") " pod="openshift-monitoring/alertmanager-main-0" Jun 11 18:39:06.844616 ip-10-0-141-55 kubenswrapper[2578]: I0611 18:39:06.844525 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/214e4501-6a30-4593-9a84-8cc0f0fe6a21-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"214e4501-6a30-4593-9a84-8cc0f0fe6a21\") " pod="openshift-monitoring/alertmanager-main-0" Jun 11 18:39:06.844779 ip-10-0-141-55 kubenswrapper[2578]: I0611 18:39:06.844735 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/214e4501-6a30-4593-9a84-8cc0f0fe6a21-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"214e4501-6a30-4593-9a84-8cc0f0fe6a21\") " pod="openshift-monitoring/alertmanager-main-0" Jun 11 18:39:06.844885 ip-10-0-141-55 kubenswrapper[2578]: I0611 18:39:06.844802 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/214e4501-6a30-4593-9a84-8cc0f0fe6a21-web-config\") pod \"alertmanager-main-0\" (UID: \"214e4501-6a30-4593-9a84-8cc0f0fe6a21\") " pod="openshift-monitoring/alertmanager-main-0" Jun 11 18:39:06.845166 ip-10-0-141-55 kubenswrapper[2578]: I0611 18:39:06.845137 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/214e4501-6a30-4593-9a84-8cc0f0fe6a21-config-out\") pod \"alertmanager-main-0\" (UID: \"214e4501-6a30-4593-9a84-8cc0f0fe6a21\") " pod="openshift-monitoring/alertmanager-main-0" Jun 11 18:39:06.845166 ip-10-0-141-55 kubenswrapper[2578]: I0611 18:39:06.845159 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/214e4501-6a30-4593-9a84-8cc0f0fe6a21-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"214e4501-6a30-4593-9a84-8cc0f0fe6a21\") " pod="openshift-monitoring/alertmanager-main-0" Jun 11 18:39:06.845423 ip-10-0-141-55 kubenswrapper[2578]: I0611 18:39:06.845402 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/214e4501-6a30-4593-9a84-8cc0f0fe6a21-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"214e4501-6a30-4593-9a84-8cc0f0fe6a21\") " pod="openshift-monitoring/alertmanager-main-0" Jun 11 18:39:06.845980 ip-10-0-141-55 kubenswrapper[2578]: I0611 18:39:06.845961 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/214e4501-6a30-4593-9a84-8cc0f0fe6a21-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"214e4501-6a30-4593-9a84-8cc0f0fe6a21\") " pod="openshift-monitoring/alertmanager-main-0" Jun 11 18:39:06.846398 ip-10-0-141-55 kubenswrapper[2578]: I0611 18:39:06.846377 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/214e4501-6a30-4593-9a84-8cc0f0fe6a21-config-volume\") pod \"alertmanager-main-0\" (UID: \"214e4501-6a30-4593-9a84-8cc0f0fe6a21\") " pod="openshift-monitoring/alertmanager-main-0" Jun 11 18:39:06.851415 ip-10-0-141-55 kubenswrapper[2578]: I0611 18:39:06.851394 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-sz87d\" (UniqueName: \"kubernetes.io/projected/214e4501-6a30-4593-9a84-8cc0f0fe6a21-kube-api-access-sz87d\") pod \"alertmanager-main-0\" (UID: \"214e4501-6a30-4593-9a84-8cc0f0fe6a21\") " pod="openshift-monitoring/alertmanager-main-0" Jun 11 18:39:06.963239 ip-10-0-141-55 kubenswrapper[2578]: I0611 18:39:06.963143 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0" Jun 11 18:39:07.095470 ip-10-0-141-55 kubenswrapper[2578]: I0611 18:39:07.095439 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Jun 11 18:39:07.098409 ip-10-0-141-55 kubenswrapper[2578]: W0611 18:39:07.098376 2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod214e4501_6a30_4593_9a84_8cc0f0fe6a21.slice/crio-2cc40bfc1e542bf2ef7fd6b53ced9bbc61ada81395f6bb78f0f37a257b27224e WatchSource:0}: Error finding container 2cc40bfc1e542bf2ef7fd6b53ced9bbc61ada81395f6bb78f0f37a257b27224e: Status 404 returned error can't find the container with id 2cc40bfc1e542bf2ef7fd6b53ced9bbc61ada81395f6bb78f0f37a257b27224e Jun 11 18:39:08.074900 ip-10-0-141-55 kubenswrapper[2578]: I0611 18:39:08.074867 2578 generic.go:356] "Generic (PLEG): container finished" podID="214e4501-6a30-4593-9a84-8cc0f0fe6a21" containerID="59471a22d155e6b658af12afcf53ea7ae13e68f4e33bff354618905e52cf221d" exitCode=0 Jun 11 18:39:08.075270 ip-10-0-141-55 kubenswrapper[2578]: I0611 18:39:08.074956 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"214e4501-6a30-4593-9a84-8cc0f0fe6a21","Type":"ContainerDied","Data":"59471a22d155e6b658af12afcf53ea7ae13e68f4e33bff354618905e52cf221d"} Jun 11 18:39:08.075270 ip-10-0-141-55 kubenswrapper[2578]: I0611 18:39:08.075038 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"214e4501-6a30-4593-9a84-8cc0f0fe6a21","Type":"ContainerStarted","Data":"2cc40bfc1e542bf2ef7fd6b53ced9bbc61ada81395f6bb78f0f37a257b27224e"} Jun 11 18:39:09.424666 ip-10-0-141-55 kubenswrapper[2578]: I0611 18:39:09.424630 2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-787746448-bq45m"] Jun 11 18:39:09.429110 ip-10-0-141-55 kubenswrapper[2578]: I0611 18:39:09.429086 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-787746448-bq45m" Jun 11 18:39:09.440064 ip-10-0-141-55 kubenswrapper[2578]: I0611 18:39:09.440015 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-787746448-bq45m"] Jun 11 18:39:09.566154 ip-10-0-141-55 kubenswrapper[2578]: I0611 18:39:09.566111 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/61cd963d-bb28-4867-953b-08557c6e2a36-console-serving-cert\") pod \"console-787746448-bq45m\" (UID: \"61cd963d-bb28-4867-953b-08557c6e2a36\") " pod="openshift-console/console-787746448-bq45m" Jun 11 18:39:09.566370 ip-10-0-141-55 kubenswrapper[2578]: I0611 18:39:09.566266 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9thv6\" (UniqueName: \"kubernetes.io/projected/61cd963d-bb28-4867-953b-08557c6e2a36-kube-api-access-9thv6\") pod \"console-787746448-bq45m\" (UID: \"61cd963d-bb28-4867-953b-08557c6e2a36\") " pod="openshift-console/console-787746448-bq45m" Jun 11 18:39:09.566370 ip-10-0-141-55 kubenswrapper[2578]: I0611 18:39:09.566321 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/61cd963d-bb28-4867-953b-08557c6e2a36-console-oauth-config\") pod \"console-787746448-bq45m\" (UID: \"61cd963d-bb28-4867-953b-08557c6e2a36\") " pod="openshift-console/console-787746448-bq45m" Jun 11 18:39:09.566370 ip-10-0-141-55 kubenswrapper[2578]: I0611 18:39:09.566346 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/61cd963d-bb28-4867-953b-08557c6e2a36-console-config\") pod \"console-787746448-bq45m\" (UID: \"61cd963d-bb28-4867-953b-08557c6e2a36\") " pod="openshift-console/console-787746448-bq45m" Jun 11 18:39:09.566647 ip-10-0-141-55 kubenswrapper[2578]: I0611 18:39:09.566626 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/61cd963d-bb28-4867-953b-08557c6e2a36-service-ca\") pod \"console-787746448-bq45m\" (UID: \"61cd963d-bb28-4867-953b-08557c6e2a36\") " pod="openshift-console/console-787746448-bq45m" Jun 11 18:39:09.566733 ip-10-0-141-55 kubenswrapper[2578]: I0611 18:39:09.566663 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/61cd963d-bb28-4867-953b-08557c6e2a36-oauth-serving-cert\") pod \"console-787746448-bq45m\" (UID: \"61cd963d-bb28-4867-953b-08557c6e2a36\") " pod="openshift-console/console-787746448-bq45m" Jun 11 18:39:09.566789 ip-10-0-141-55 kubenswrapper[2578]: I0611 18:39:09.566743 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/61cd963d-bb28-4867-953b-08557c6e2a36-trusted-ca-bundle\") pod \"console-787746448-bq45m\" (UID: \"61cd963d-bb28-4867-953b-08557c6e2a36\") " pod="openshift-console/console-787746448-bq45m" Jun 11 18:39:09.667882 ip-10-0-141-55 kubenswrapper[2578]: I0611 18:39:09.667854 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/61cd963d-bb28-4867-953b-08557c6e2a36-console-serving-cert\") pod \"console-787746448-bq45m\" (UID: \"61cd963d-bb28-4867-953b-08557c6e2a36\") " pod="openshift-console/console-787746448-bq45m" Jun 11 18:39:09.668009 ip-10-0-141-55 kubenswrapper[2578]: I0611 18:39:09.667889 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9thv6\" (UniqueName: \"kubernetes.io/projected/61cd963d-bb28-4867-953b-08557c6e2a36-kube-api-access-9thv6\") pod \"console-787746448-bq45m\" (UID: \"61cd963d-bb28-4867-953b-08557c6e2a36\") " pod="openshift-console/console-787746448-bq45m" Jun 11 18:39:09.668009 ip-10-0-141-55 kubenswrapper[2578]: I0611 18:39:09.667907 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/61cd963d-bb28-4867-953b-08557c6e2a36-console-oauth-config\") pod \"console-787746448-bq45m\" (UID: \"61cd963d-bb28-4867-953b-08557c6e2a36\") " pod="openshift-console/console-787746448-bq45m" Jun 11 18:39:09.668009 ip-10-0-141-55 kubenswrapper[2578]: I0611 18:39:09.667923 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/61cd963d-bb28-4867-953b-08557c6e2a36-console-config\") pod \"console-787746448-bq45m\" (UID: \"61cd963d-bb28-4867-953b-08557c6e2a36\") " pod="openshift-console/console-787746448-bq45m" Jun 11 18:39:09.668171 ip-10-0-141-55 kubenswrapper[2578]: I0611 18:39:09.668061 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/61cd963d-bb28-4867-953b-08557c6e2a36-service-ca\") pod \"console-787746448-bq45m\" (UID: \"61cd963d-bb28-4867-953b-08557c6e2a36\") " pod="openshift-console/console-787746448-bq45m" Jun 11 18:39:09.668171 ip-10-0-141-55 kubenswrapper[2578]: I0611 18:39:09.668097 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/61cd963d-bb28-4867-953b-08557c6e2a36-oauth-serving-cert\") pod \"console-787746448-bq45m\" (UID: \"61cd963d-bb28-4867-953b-08557c6e2a36\") " pod="openshift-console/console-787746448-bq45m" Jun 11 18:39:09.668171 ip-10-0-141-55 kubenswrapper[2578]: I0611 18:39:09.668130 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/61cd963d-bb28-4867-953b-08557c6e2a36-trusted-ca-bundle\") pod \"console-787746448-bq45m\" (UID: \"61cd963d-bb28-4867-953b-08557c6e2a36\") " pod="openshift-console/console-787746448-bq45m" Jun 11 18:39:09.668704 ip-10-0-141-55 kubenswrapper[2578]: I0611 18:39:09.668678 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/61cd963d-bb28-4867-953b-08557c6e2a36-console-config\") pod \"console-787746448-bq45m\" (UID: \"61cd963d-bb28-4867-953b-08557c6e2a36\") " pod="openshift-console/console-787746448-bq45m" Jun 11 18:39:09.669063 ip-10-0-141-55 kubenswrapper[2578]: I0611 18:39:09.669039 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/61cd963d-bb28-4867-953b-08557c6e2a36-service-ca\") pod \"console-787746448-bq45m\" (UID: \"61cd963d-bb28-4867-953b-08557c6e2a36\") " pod="openshift-console/console-787746448-bq45m" Jun 11 18:39:09.669206 ip-10-0-141-55 kubenswrapper[2578]: I0611 18:39:09.669148 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/61cd963d-bb28-4867-953b-08557c6e2a36-trusted-ca-bundle\") pod \"console-787746448-bq45m\" (UID: \"61cd963d-bb28-4867-953b-08557c6e2a36\") " pod="openshift-console/console-787746448-bq45m" Jun 11 18:39:09.669516 ip-10-0-141-55 kubenswrapper[2578]: I0611 18:39:09.669493 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/61cd963d-bb28-4867-953b-08557c6e2a36-oauth-serving-cert\") pod \"console-787746448-bq45m\" (UID: \"61cd963d-bb28-4867-953b-08557c6e2a36\") " pod="openshift-console/console-787746448-bq45m" Jun 11 18:39:09.670436 ip-10-0-141-55 kubenswrapper[2578]: I0611 18:39:09.670408 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/61cd963d-bb28-4867-953b-08557c6e2a36-console-oauth-config\") pod \"console-787746448-bq45m\" (UID: \"61cd963d-bb28-4867-953b-08557c6e2a36\") " pod="openshift-console/console-787746448-bq45m" Jun 11 18:39:09.670594 ip-10-0-141-55 kubenswrapper[2578]: I0611 18:39:09.670575 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/61cd963d-bb28-4867-953b-08557c6e2a36-console-serving-cert\") pod \"console-787746448-bq45m\" (UID: \"61cd963d-bb28-4867-953b-08557c6e2a36\") " pod="openshift-console/console-787746448-bq45m" Jun 11 18:39:09.676150 ip-10-0-141-55 kubenswrapper[2578]: I0611 18:39:09.676098 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-9thv6\" (UniqueName: \"kubernetes.io/projected/61cd963d-bb28-4867-953b-08557c6e2a36-kube-api-access-9thv6\") pod \"console-787746448-bq45m\" (UID: \"61cd963d-bb28-4867-953b-08557c6e2a36\") " pod="openshift-console/console-787746448-bq45m" Jun 11 18:39:09.742693 ip-10-0-141-55 kubenswrapper[2578]: I0611 18:39:09.742668 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-787746448-bq45m" Jun 11 18:39:09.875889 ip-10-0-141-55 kubenswrapper[2578]: I0611 18:39:09.875863 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-787746448-bq45m"] Jun 11 18:39:09.878547 ip-10-0-141-55 kubenswrapper[2578]: W0611 18:39:09.878521 2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod61cd963d_bb28_4867_953b_08557c6e2a36.slice/crio-cff9f57e4527bcac2d7d52e902b887a420bf04093188d9e0e99af5632e942bf0 WatchSource:0}: Error finding container cff9f57e4527bcac2d7d52e902b887a420bf04093188d9e0e99af5632e942bf0: Status 404 returned error can't find the container with id cff9f57e4527bcac2d7d52e902b887a420bf04093188d9e0e99af5632e942bf0 Jun 11 18:39:10.088941 ip-10-0-141-55 kubenswrapper[2578]: I0611 18:39:10.088903 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"214e4501-6a30-4593-9a84-8cc0f0fe6a21","Type":"ContainerStarted","Data":"673e48f8f3059885d86848d34ce7b9d5f674f9b3a10626a28daa8f7058dad8e3"} Jun 11 18:39:10.089121 ip-10-0-141-55 kubenswrapper[2578]: I0611 18:39:10.089014 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"214e4501-6a30-4593-9a84-8cc0f0fe6a21","Type":"ContainerStarted","Data":"f7e1d91032175b68cc5f0575f4d5938025b03bab2193e8097a6059b4b0636483"} Jun 11 18:39:10.089121 ip-10-0-141-55 kubenswrapper[2578]: I0611 18:39:10.089059 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"214e4501-6a30-4593-9a84-8cc0f0fe6a21","Type":"ContainerStarted","Data":"e20b0b9edbd32fb33aae653cdeefeac1154414a3058b3de88344072ab1561f48"} Jun 11 18:39:10.089121 ip-10-0-141-55 kubenswrapper[2578]: I0611 18:39:10.089095 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"214e4501-6a30-4593-9a84-8cc0f0fe6a21","Type":"ContainerStarted","Data":"61e4f9dca18d66d37a03fac2b560e1bd875093ebc1a373862ecf7e3a634caa1d"} Jun 11 18:39:10.089338 ip-10-0-141-55 kubenswrapper[2578]: I0611 18:39:10.089129 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"214e4501-6a30-4593-9a84-8cc0f0fe6a21","Type":"ContainerStarted","Data":"090813b0deb794232a48480ea5560222fba45628a77271e859762028871ad795"} Jun 11 18:39:10.089338 ip-10-0-141-55 kubenswrapper[2578]: I0611 18:39:10.089184 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"214e4501-6a30-4593-9a84-8cc0f0fe6a21","Type":"ContainerStarted","Data":"06c7d16f090a86289d3feda460a01c8d83c52b258fcc68570b78e583c00aa2e9"} Jun 11 18:39:10.090401 ip-10-0-141-55 kubenswrapper[2578]: I0611 18:39:10.090369 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-787746448-bq45m" event={"ID":"61cd963d-bb28-4867-953b-08557c6e2a36","Type":"ContainerStarted","Data":"65da68c994baf54733fb44c8dd9307e4b0c9fd90068f49c139a592e6ddae5fea"} Jun 11 18:39:10.090508 ip-10-0-141-55 kubenswrapper[2578]: I0611 18:39:10.090407 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-787746448-bq45m" event={"ID":"61cd963d-bb28-4867-953b-08557c6e2a36","Type":"ContainerStarted","Data":"cff9f57e4527bcac2d7d52e902b887a420bf04093188d9e0e99af5632e942bf0"} Jun 11 18:39:10.115064 ip-10-0-141-55 kubenswrapper[2578]: I0611 18:39:10.115021 2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/alertmanager-main-0" podStartSLOduration=2.5328072390000003 podStartE2EDuration="4.115008268s" totalImagesPullingTime="1.566856247s" totalInitContainerRuntime="15.344782ms" isStatefulPod=false podCreationTimestamp="2026-06-11 18:39:06 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-11 18:39:10.113772011 +0000 UTC m=+156.068446634" watchObservedRunningTime="2026-06-11 18:39:10.115008268 +0000 UTC m=+156.069682908" Jun 11 18:39:10.131890 ip-10-0-141-55 kubenswrapper[2578]: I0611 18:39:10.131848 2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-787746448-bq45m" podStartSLOduration=1.131834765 podStartE2EDuration="1.131834765s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-11 18:39:09 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-11 18:39:10.130655256 +0000 UTC m=+156.085329897" watchObservedRunningTime="2026-06-11 18:39:10.131834765 +0000 UTC m=+156.086509371" Jun 11 18:39:19.743202 ip-10-0-141-55 kubenswrapper[2578]: I0611 18:39:19.743125 2578 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-787746448-bq45m" Jun 11 18:39:19.743202 ip-10-0-141-55 kubenswrapper[2578]: I0611 18:39:19.743202 2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-787746448-bq45m" Jun 11 18:39:19.747809 ip-10-0-141-55 kubenswrapper[2578]: I0611 18:39:19.747786 2578 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-787746448-bq45m" Jun 11 18:39:20.131631 ip-10-0-141-55 kubenswrapper[2578]: I0611 18:39:20.131606 2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-787746448-bq45m" Jun 11 18:39:20.179224 ip-10-0-141-55 kubenswrapper[2578]: I0611 18:39:20.179194 2578 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-8f5c787f4-fpn4z"] Jun 11 18:39:45.204075 ip-10-0-141-55 kubenswrapper[2578]: I0611 18:39:45.204010 2578 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-console/console-8f5c787f4-fpn4z" podUID="fe67d9f0-a7af-4244-9ca3-1e7494dc46a6" containerName="console" containerID="cri-o://a4a198bd9ae8aad52bf94b282e3dca526433d5480a55bd42c4740e34d0a8c994" gracePeriod=15 Jun 11 18:39:45.448255 ip-10-0-141-55 kubenswrapper[2578]: I0611 18:39:45.448230 2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-8f5c787f4-fpn4z" Jun 11 18:39:45.539056 ip-10-0-141-55 kubenswrapper[2578]: I0611 18:39:45.538971 2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/fe67d9f0-a7af-4244-9ca3-1e7494dc46a6-console-oauth-config\") pod \"fe67d9f0-a7af-4244-9ca3-1e7494dc46a6\" (UID: \"fe67d9f0-a7af-4244-9ca3-1e7494dc46a6\") " Jun 11 18:39:45.539056 ip-10-0-141-55 kubenswrapper[2578]: I0611 18:39:45.539037 2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/fe67d9f0-a7af-4244-9ca3-1e7494dc46a6-trusted-ca-bundle\") pod \"fe67d9f0-a7af-4244-9ca3-1e7494dc46a6\" (UID: \"fe67d9f0-a7af-4244-9ca3-1e7494dc46a6\") " Jun 11 18:39:45.539279 ip-10-0-141-55 kubenswrapper[2578]: I0611 18:39:45.539082 2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/fe67d9f0-a7af-4244-9ca3-1e7494dc46a6-service-ca\") pod \"fe67d9f0-a7af-4244-9ca3-1e7494dc46a6\" (UID: \"fe67d9f0-a7af-4244-9ca3-1e7494dc46a6\") " Jun 11 18:39:45.539279 ip-10-0-141-55 kubenswrapper[2578]: I0611 18:39:45.539108 2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/fe67d9f0-a7af-4244-9ca3-1e7494dc46a6-oauth-serving-cert\") pod \"fe67d9f0-a7af-4244-9ca3-1e7494dc46a6\" (UID: \"fe67d9f0-a7af-4244-9ca3-1e7494dc46a6\") " Jun 11 18:39:45.539279 ip-10-0-141-55 kubenswrapper[2578]: I0611 18:39:45.539146 2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-fn4vt\" (UniqueName: \"kubernetes.io/projected/fe67d9f0-a7af-4244-9ca3-1e7494dc46a6-kube-api-access-fn4vt\") pod \"fe67d9f0-a7af-4244-9ca3-1e7494dc46a6\" (UID: \"fe67d9f0-a7af-4244-9ca3-1e7494dc46a6\") " Jun 11 18:39:45.539279 ip-10-0-141-55 kubenswrapper[2578]: I0611 18:39:45.539185 2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/fe67d9f0-a7af-4244-9ca3-1e7494dc46a6-console-serving-cert\") pod \"fe67d9f0-a7af-4244-9ca3-1e7494dc46a6\" (UID: \"fe67d9f0-a7af-4244-9ca3-1e7494dc46a6\") " Jun 11 18:39:45.539279 ip-10-0-141-55 kubenswrapper[2578]: I0611 18:39:45.539223 2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/fe67d9f0-a7af-4244-9ca3-1e7494dc46a6-console-config\") pod \"fe67d9f0-a7af-4244-9ca3-1e7494dc46a6\" (UID: \"fe67d9f0-a7af-4244-9ca3-1e7494dc46a6\") " Jun 11 18:39:45.539524 ip-10-0-141-55 kubenswrapper[2578]: I0611 18:39:45.539492 2578 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/fe67d9f0-a7af-4244-9ca3-1e7494dc46a6-service-ca" (OuterVolumeSpecName: "service-ca") pod "fe67d9f0-a7af-4244-9ca3-1e7494dc46a6" (UID: "fe67d9f0-a7af-4244-9ca3-1e7494dc46a6"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 11 18:39:45.539615 ip-10-0-141-55 kubenswrapper[2578]: I0611 18:39:45.539539 2578 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/fe67d9f0-a7af-4244-9ca3-1e7494dc46a6-trusted-ca-bundle" (OuterVolumeSpecName: "trusted-ca-bundle") pod "fe67d9f0-a7af-4244-9ca3-1e7494dc46a6" (UID: "fe67d9f0-a7af-4244-9ca3-1e7494dc46a6"). InnerVolumeSpecName "trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 11 18:39:45.539678 ip-10-0-141-55 kubenswrapper[2578]: I0611 18:39:45.539605 2578 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/fe67d9f0-a7af-4244-9ca3-1e7494dc46a6-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "fe67d9f0-a7af-4244-9ca3-1e7494dc46a6" (UID: "fe67d9f0-a7af-4244-9ca3-1e7494dc46a6"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 11 18:39:45.539814 ip-10-0-141-55 kubenswrapper[2578]: I0611 18:39:45.539790 2578 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/fe67d9f0-a7af-4244-9ca3-1e7494dc46a6-console-config" (OuterVolumeSpecName: "console-config") pod "fe67d9f0-a7af-4244-9ca3-1e7494dc46a6" (UID: "fe67d9f0-a7af-4244-9ca3-1e7494dc46a6"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 11 18:39:45.541227 ip-10-0-141-55 kubenswrapper[2578]: I0611 18:39:45.541204 2578 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/fe67d9f0-a7af-4244-9ca3-1e7494dc46a6-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "fe67d9f0-a7af-4244-9ca3-1e7494dc46a6" (UID: "fe67d9f0-a7af-4244-9ca3-1e7494dc46a6"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 11 18:39:45.541337 ip-10-0-141-55 kubenswrapper[2578]: I0611 18:39:45.541200 2578 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/fe67d9f0-a7af-4244-9ca3-1e7494dc46a6-kube-api-access-fn4vt" (OuterVolumeSpecName: "kube-api-access-fn4vt") pod "fe67d9f0-a7af-4244-9ca3-1e7494dc46a6" (UID: "fe67d9f0-a7af-4244-9ca3-1e7494dc46a6"). InnerVolumeSpecName "kube-api-access-fn4vt". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 11 18:39:45.541337 ip-10-0-141-55 kubenswrapper[2578]: I0611 18:39:45.541259 2578 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/fe67d9f0-a7af-4244-9ca3-1e7494dc46a6-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "fe67d9f0-a7af-4244-9ca3-1e7494dc46a6" (UID: "fe67d9f0-a7af-4244-9ca3-1e7494dc46a6"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 11 18:39:45.640803 ip-10-0-141-55 kubenswrapper[2578]: I0611 18:39:45.640769 2578 reconciler_common.go:299] "Volume detached for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/fe67d9f0-a7af-4244-9ca3-1e7494dc46a6-trusted-ca-bundle\") on node \"ip-10-0-141-55.ec2.internal\" DevicePath \"\"" Jun 11 18:39:45.640803 ip-10-0-141-55 kubenswrapper[2578]: I0611 18:39:45.640799 2578 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/fe67d9f0-a7af-4244-9ca3-1e7494dc46a6-service-ca\") on node \"ip-10-0-141-55.ec2.internal\" DevicePath \"\"" Jun 11 18:39:45.640992 ip-10-0-141-55 kubenswrapper[2578]: I0611 18:39:45.640813 2578 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/fe67d9f0-a7af-4244-9ca3-1e7494dc46a6-oauth-serving-cert\") on node \"ip-10-0-141-55.ec2.internal\" DevicePath \"\"" Jun 11 18:39:45.640992 ip-10-0-141-55 kubenswrapper[2578]: I0611 18:39:45.640822 2578 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-fn4vt\" (UniqueName: \"kubernetes.io/projected/fe67d9f0-a7af-4244-9ca3-1e7494dc46a6-kube-api-access-fn4vt\") on node \"ip-10-0-141-55.ec2.internal\" DevicePath \"\"" Jun 11 18:39:45.640992 ip-10-0-141-55 kubenswrapper[2578]: I0611 18:39:45.640831 2578 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/fe67d9f0-a7af-4244-9ca3-1e7494dc46a6-console-serving-cert\") on node \"ip-10-0-141-55.ec2.internal\" DevicePath \"\"" Jun 11 18:39:45.640992 ip-10-0-141-55 kubenswrapper[2578]: I0611 18:39:45.640840 2578 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/fe67d9f0-a7af-4244-9ca3-1e7494dc46a6-console-config\") on node \"ip-10-0-141-55.ec2.internal\" DevicePath \"\"" Jun 11 18:39:45.640992 ip-10-0-141-55 kubenswrapper[2578]: I0611 18:39:45.640848 2578 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/fe67d9f0-a7af-4244-9ca3-1e7494dc46a6-console-oauth-config\") on node \"ip-10-0-141-55.ec2.internal\" DevicePath \"\"" Jun 11 18:39:46.221580 ip-10-0-141-55 kubenswrapper[2578]: I0611 18:39:46.221518 2578 generic.go:356] "Generic (PLEG): container finished" podID="fe67d9f0-a7af-4244-9ca3-1e7494dc46a6" containerID="a4a198bd9ae8aad52bf94b282e3dca526433d5480a55bd42c4740e34d0a8c994" exitCode=0 Jun 11 18:39:46.221951 ip-10-0-141-55 kubenswrapper[2578]: I0611 18:39:46.221587 2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-8f5c787f4-fpn4z" Jun 11 18:39:46.221951 ip-10-0-141-55 kubenswrapper[2578]: I0611 18:39:46.221608 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-8f5c787f4-fpn4z" event={"ID":"fe67d9f0-a7af-4244-9ca3-1e7494dc46a6","Type":"ContainerDied","Data":"a4a198bd9ae8aad52bf94b282e3dca526433d5480a55bd42c4740e34d0a8c994"} Jun 11 18:39:46.221951 ip-10-0-141-55 kubenswrapper[2578]: I0611 18:39:46.221665 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-8f5c787f4-fpn4z" event={"ID":"fe67d9f0-a7af-4244-9ca3-1e7494dc46a6","Type":"ContainerDied","Data":"77c70436f815831b428b5ce912c4d688f452ebaef45093229581437dc191bd27"} Jun 11 18:39:46.221951 ip-10-0-141-55 kubenswrapper[2578]: I0611 18:39:46.221692 2578 scope.go:117] "RemoveContainer" containerID="a4a198bd9ae8aad52bf94b282e3dca526433d5480a55bd42c4740e34d0a8c994" Jun 11 18:39:46.229873 ip-10-0-141-55 kubenswrapper[2578]: I0611 18:39:46.229859 2578 scope.go:117] "RemoveContainer" containerID="a4a198bd9ae8aad52bf94b282e3dca526433d5480a55bd42c4740e34d0a8c994" Jun 11 18:39:46.230137 ip-10-0-141-55 kubenswrapper[2578]: E0611 18:39:46.230116 2578 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"a4a198bd9ae8aad52bf94b282e3dca526433d5480a55bd42c4740e34d0a8c994\": container with ID starting with a4a198bd9ae8aad52bf94b282e3dca526433d5480a55bd42c4740e34d0a8c994 not found: ID does not exist" containerID="a4a198bd9ae8aad52bf94b282e3dca526433d5480a55bd42c4740e34d0a8c994" Jun 11 18:39:46.230176 ip-10-0-141-55 kubenswrapper[2578]: I0611 18:39:46.230144 2578 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"a4a198bd9ae8aad52bf94b282e3dca526433d5480a55bd42c4740e34d0a8c994"} err="failed to get container status \"a4a198bd9ae8aad52bf94b282e3dca526433d5480a55bd42c4740e34d0a8c994\": rpc error: code = NotFound desc = could not find container \"a4a198bd9ae8aad52bf94b282e3dca526433d5480a55bd42c4740e34d0a8c994\": container with ID starting with a4a198bd9ae8aad52bf94b282e3dca526433d5480a55bd42c4740e34d0a8c994 not found: ID does not exist" Jun 11 18:39:46.242057 ip-10-0-141-55 kubenswrapper[2578]: I0611 18:39:46.242037 2578 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-8f5c787f4-fpn4z"] Jun 11 18:39:46.247877 ip-10-0-141-55 kubenswrapper[2578]: I0611 18:39:46.247858 2578 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-8f5c787f4-fpn4z"] Jun 11 18:39:46.420199 ip-10-0-141-55 kubenswrapper[2578]: I0611 18:39:46.420163 2578 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="fe67d9f0-a7af-4244-9ca3-1e7494dc46a6" path="/var/lib/kubelet/pods/fe67d9f0-a7af-4244-9ca3-1e7494dc46a6/volumes" Jun 11 18:40:16.153128 ip-10-0-141-55 kubenswrapper[2578]: I0611 18:40:16.153097 2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dsk2fw"] Jun 11 18:40:16.153601 ip-10-0-141-55 kubenswrapper[2578]: I0611 18:40:16.153397 2578 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="fe67d9f0-a7af-4244-9ca3-1e7494dc46a6" containerName="console" Jun 11 18:40:16.153601 ip-10-0-141-55 kubenswrapper[2578]: I0611 18:40:16.153407 2578 state_mem.go:107] "Deleted CPUSet assignment" podUID="fe67d9f0-a7af-4244-9ca3-1e7494dc46a6" containerName="console" Jun 11 18:40:16.153601 ip-10-0-141-55 kubenswrapper[2578]: I0611 18:40:16.153460 2578 memory_manager.go:368] "RemoveStaleState removing state" podUID="fe67d9f0-a7af-4244-9ca3-1e7494dc46a6" containerName="console" Jun 11 18:40:16.156740 ip-10-0-141-55 kubenswrapper[2578]: I0611 18:40:16.156724 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dsk2fw" Jun 11 18:40:16.159701 ip-10-0-141-55 kubenswrapper[2578]: I0611 18:40:16.159676 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"openshift-service-ca.crt\"" Jun 11 18:40:16.160877 ip-10-0-141-55 kubenswrapper[2578]: I0611 18:40:16.160853 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"kube-root-ca.crt\"" Jun 11 18:40:16.160996 ip-10-0-141-55 kubenswrapper[2578]: I0611 18:40:16.160912 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-marketplace\"/\"default-dockercfg-nkxdk\"" Jun 11 18:40:16.165630 ip-10-0-141-55 kubenswrapper[2578]: I0611 18:40:16.165607 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dsk2fw"] Jun 11 18:40:16.294049 ip-10-0-141-55 kubenswrapper[2578]: I0611 18:40:16.294016 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/fbb03638-37d4-41a9-ad18-dc85479bb9dd-util\") pod \"2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dsk2fw\" (UID: \"fbb03638-37d4-41a9-ad18-dc85479bb9dd\") " pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dsk2fw" Jun 11 18:40:16.294215 ip-10-0-141-55 kubenswrapper[2578]: I0611 18:40:16.294091 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/fbb03638-37d4-41a9-ad18-dc85479bb9dd-bundle\") pod \"2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dsk2fw\" (UID: \"fbb03638-37d4-41a9-ad18-dc85479bb9dd\") " pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dsk2fw" Jun 11 18:40:16.294215 ip-10-0-141-55 kubenswrapper[2578]: I0611 18:40:16.294139 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-q7zqs\" (UniqueName: \"kubernetes.io/projected/fbb03638-37d4-41a9-ad18-dc85479bb9dd-kube-api-access-q7zqs\") pod \"2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dsk2fw\" (UID: \"fbb03638-37d4-41a9-ad18-dc85479bb9dd\") " pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dsk2fw" Jun 11 18:40:16.395198 ip-10-0-141-55 kubenswrapper[2578]: I0611 18:40:16.395167 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/fbb03638-37d4-41a9-ad18-dc85479bb9dd-bundle\") pod \"2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dsk2fw\" (UID: \"fbb03638-37d4-41a9-ad18-dc85479bb9dd\") " pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dsk2fw" Jun 11 18:40:16.395361 ip-10-0-141-55 kubenswrapper[2578]: I0611 18:40:16.395206 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-q7zqs\" (UniqueName: \"kubernetes.io/projected/fbb03638-37d4-41a9-ad18-dc85479bb9dd-kube-api-access-q7zqs\") pod \"2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dsk2fw\" (UID: \"fbb03638-37d4-41a9-ad18-dc85479bb9dd\") " pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dsk2fw" Jun 11 18:40:16.395361 ip-10-0-141-55 kubenswrapper[2578]: I0611 18:40:16.395272 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/fbb03638-37d4-41a9-ad18-dc85479bb9dd-util\") pod \"2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dsk2fw\" (UID: \"fbb03638-37d4-41a9-ad18-dc85479bb9dd\") " pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dsk2fw" Jun 11 18:40:16.395542 ip-10-0-141-55 kubenswrapper[2578]: I0611 18:40:16.395521 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/fbb03638-37d4-41a9-ad18-dc85479bb9dd-bundle\") pod \"2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dsk2fw\" (UID: \"fbb03638-37d4-41a9-ad18-dc85479bb9dd\") " pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dsk2fw" Jun 11 18:40:16.395631 ip-10-0-141-55 kubenswrapper[2578]: I0611 18:40:16.395611 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/fbb03638-37d4-41a9-ad18-dc85479bb9dd-util\") pod \"2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dsk2fw\" (UID: \"fbb03638-37d4-41a9-ad18-dc85479bb9dd\") " pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dsk2fw" Jun 11 18:40:16.405520 ip-10-0-141-55 kubenswrapper[2578]: I0611 18:40:16.405461 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-q7zqs\" (UniqueName: \"kubernetes.io/projected/fbb03638-37d4-41a9-ad18-dc85479bb9dd-kube-api-access-q7zqs\") pod \"2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dsk2fw\" (UID: \"fbb03638-37d4-41a9-ad18-dc85479bb9dd\") " pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dsk2fw" Jun 11 18:40:16.466102 ip-10-0-141-55 kubenswrapper[2578]: I0611 18:40:16.466066 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dsk2fw" Jun 11 18:40:16.588687 ip-10-0-141-55 kubenswrapper[2578]: I0611 18:40:16.588615 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dsk2fw"] Jun 11 18:40:16.591211 ip-10-0-141-55 kubenswrapper[2578]: W0611 18:40:16.591180 2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podfbb03638_37d4_41a9_ad18_dc85479bb9dd.slice/crio-334d6f09c9df1e834cbcd81692d5f5a6adc158e54bf2e47063cb98fef3641ad1 WatchSource:0}: Error finding container 334d6f09c9df1e834cbcd81692d5f5a6adc158e54bf2e47063cb98fef3641ad1: Status 404 returned error can't find the container with id 334d6f09c9df1e834cbcd81692d5f5a6adc158e54bf2e47063cb98fef3641ad1 Jun 11 18:40:17.334668 ip-10-0-141-55 kubenswrapper[2578]: I0611 18:40:17.334625 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dsk2fw" event={"ID":"fbb03638-37d4-41a9-ad18-dc85479bb9dd","Type":"ContainerStarted","Data":"334d6f09c9df1e834cbcd81692d5f5a6adc158e54bf2e47063cb98fef3641ad1"} Jun 11 18:40:24.364943 ip-10-0-141-55 kubenswrapper[2578]: I0611 18:40:24.364908 2578 generic.go:356] "Generic (PLEG): container finished" podID="fbb03638-37d4-41a9-ad18-dc85479bb9dd" containerID="6b8a947e5282f83ad6aab42fccc88364d564a32934f98b286451145ddee9de42" exitCode=0 Jun 11 18:40:24.365332 ip-10-0-141-55 kubenswrapper[2578]: I0611 18:40:24.364990 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dsk2fw" event={"ID":"fbb03638-37d4-41a9-ad18-dc85479bb9dd","Type":"ContainerDied","Data":"6b8a947e5282f83ad6aab42fccc88364d564a32934f98b286451145ddee9de42"} Jun 11 18:40:27.379603 ip-10-0-141-55 kubenswrapper[2578]: I0611 18:40:27.379549 2578 generic.go:356] "Generic (PLEG): container finished" podID="fbb03638-37d4-41a9-ad18-dc85479bb9dd" containerID="faecff6b2cc31c8cb50375e97200cb871788f773fdae706aae0424b6d5644f5c" exitCode=0 Jun 11 18:40:27.379987 ip-10-0-141-55 kubenswrapper[2578]: I0611 18:40:27.379657 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dsk2fw" event={"ID":"fbb03638-37d4-41a9-ad18-dc85479bb9dd","Type":"ContainerDied","Data":"faecff6b2cc31c8cb50375e97200cb871788f773fdae706aae0424b6d5644f5c"} Jun 11 18:40:36.415078 ip-10-0-141-55 kubenswrapper[2578]: I0611 18:40:36.415044 2578 generic.go:356] "Generic (PLEG): container finished" podID="fbb03638-37d4-41a9-ad18-dc85479bb9dd" containerID="53f7552e4057a0f122090956d71544f5aee3c6233364a7d16dbf98a9f550c6bb" exitCode=0 Jun 11 18:40:36.415449 ip-10-0-141-55 kubenswrapper[2578]: I0611 18:40:36.415096 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dsk2fw" event={"ID":"fbb03638-37d4-41a9-ad18-dc85479bb9dd","Type":"ContainerDied","Data":"53f7552e4057a0f122090956d71544f5aee3c6233364a7d16dbf98a9f550c6bb"} Jun 11 18:40:37.540795 ip-10-0-141-55 kubenswrapper[2578]: I0611 18:40:37.540755 2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dsk2fw" Jun 11 18:40:37.681424 ip-10-0-141-55 kubenswrapper[2578]: I0611 18:40:37.681337 2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/fbb03638-37d4-41a9-ad18-dc85479bb9dd-bundle\") pod \"fbb03638-37d4-41a9-ad18-dc85479bb9dd\" (UID: \"fbb03638-37d4-41a9-ad18-dc85479bb9dd\") " Jun 11 18:40:37.681424 ip-10-0-141-55 kubenswrapper[2578]: I0611 18:40:37.681385 2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-q7zqs\" (UniqueName: \"kubernetes.io/projected/fbb03638-37d4-41a9-ad18-dc85479bb9dd-kube-api-access-q7zqs\") pod \"fbb03638-37d4-41a9-ad18-dc85479bb9dd\" (UID: \"fbb03638-37d4-41a9-ad18-dc85479bb9dd\") " Jun 11 18:40:37.681424 ip-10-0-141-55 kubenswrapper[2578]: I0611 18:40:37.681418 2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/fbb03638-37d4-41a9-ad18-dc85479bb9dd-util\") pod \"fbb03638-37d4-41a9-ad18-dc85479bb9dd\" (UID: \"fbb03638-37d4-41a9-ad18-dc85479bb9dd\") " Jun 11 18:40:37.682222 ip-10-0-141-55 kubenswrapper[2578]: I0611 18:40:37.682193 2578 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/fbb03638-37d4-41a9-ad18-dc85479bb9dd-bundle" (OuterVolumeSpecName: "bundle") pod "fbb03638-37d4-41a9-ad18-dc85479bb9dd" (UID: "fbb03638-37d4-41a9-ad18-dc85479bb9dd"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 11 18:40:37.683650 ip-10-0-141-55 kubenswrapper[2578]: I0611 18:40:37.683615 2578 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/fbb03638-37d4-41a9-ad18-dc85479bb9dd-kube-api-access-q7zqs" (OuterVolumeSpecName: "kube-api-access-q7zqs") pod "fbb03638-37d4-41a9-ad18-dc85479bb9dd" (UID: "fbb03638-37d4-41a9-ad18-dc85479bb9dd"). InnerVolumeSpecName "kube-api-access-q7zqs". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 11 18:40:37.686067 ip-10-0-141-55 kubenswrapper[2578]: I0611 18:40:37.686047 2578 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/fbb03638-37d4-41a9-ad18-dc85479bb9dd-util" (OuterVolumeSpecName: "util") pod "fbb03638-37d4-41a9-ad18-dc85479bb9dd" (UID: "fbb03638-37d4-41a9-ad18-dc85479bb9dd"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 11 18:40:37.782844 ip-10-0-141-55 kubenswrapper[2578]: I0611 18:40:37.782803 2578 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-q7zqs\" (UniqueName: \"kubernetes.io/projected/fbb03638-37d4-41a9-ad18-dc85479bb9dd-kube-api-access-q7zqs\") on node \"ip-10-0-141-55.ec2.internal\" DevicePath \"\"" Jun 11 18:40:37.782844 ip-10-0-141-55 kubenswrapper[2578]: I0611 18:40:37.782836 2578 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/fbb03638-37d4-41a9-ad18-dc85479bb9dd-util\") on node \"ip-10-0-141-55.ec2.internal\" DevicePath \"\"" Jun 11 18:40:37.782844 ip-10-0-141-55 kubenswrapper[2578]: I0611 18:40:37.782846 2578 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/fbb03638-37d4-41a9-ad18-dc85479bb9dd-bundle\") on node \"ip-10-0-141-55.ec2.internal\" DevicePath \"\"" Jun 11 18:40:38.423051 ip-10-0-141-55 kubenswrapper[2578]: I0611 18:40:38.423019 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dsk2fw" event={"ID":"fbb03638-37d4-41a9-ad18-dc85479bb9dd","Type":"ContainerDied","Data":"334d6f09c9df1e834cbcd81692d5f5a6adc158e54bf2e47063cb98fef3641ad1"} Jun 11 18:40:38.423211 ip-10-0-141-55 kubenswrapper[2578]: I0611 18:40:38.423067 2578 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="334d6f09c9df1e834cbcd81692d5f5a6adc158e54bf2e47063cb98fef3641ad1" Jun 11 18:40:38.423211 ip-10-0-141-55 kubenswrapper[2578]: I0611 18:40:38.423029 2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dsk2fw" Jun 11 18:40:43.944140 ip-10-0-141-55 kubenswrapper[2578]: I0611 18:40:43.944104 2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["cert-manager-operator/cert-manager-operator-controller-manager-57757f7cfc-85rfj"] Jun 11 18:40:43.944495 ip-10-0-141-55 kubenswrapper[2578]: I0611 18:40:43.944376 2578 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="fbb03638-37d4-41a9-ad18-dc85479bb9dd" containerName="extract" Jun 11 18:40:43.944495 ip-10-0-141-55 kubenswrapper[2578]: I0611 18:40:43.944386 2578 state_mem.go:107] "Deleted CPUSet assignment" podUID="fbb03638-37d4-41a9-ad18-dc85479bb9dd" containerName="extract" Jun 11 18:40:43.944495 ip-10-0-141-55 kubenswrapper[2578]: I0611 18:40:43.944402 2578 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="fbb03638-37d4-41a9-ad18-dc85479bb9dd" containerName="pull" Jun 11 18:40:43.944495 ip-10-0-141-55 kubenswrapper[2578]: I0611 18:40:43.944407 2578 state_mem.go:107] "Deleted CPUSet assignment" podUID="fbb03638-37d4-41a9-ad18-dc85479bb9dd" containerName="pull" Jun 11 18:40:43.944495 ip-10-0-141-55 kubenswrapper[2578]: I0611 18:40:43.944421 2578 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="fbb03638-37d4-41a9-ad18-dc85479bb9dd" containerName="util" Jun 11 18:40:43.944495 ip-10-0-141-55 kubenswrapper[2578]: I0611 18:40:43.944426 2578 state_mem.go:107] "Deleted CPUSet assignment" podUID="fbb03638-37d4-41a9-ad18-dc85479bb9dd" containerName="util" Jun 11 18:40:43.944495 ip-10-0-141-55 kubenswrapper[2578]: I0611 18:40:43.944484 2578 memory_manager.go:368] "RemoveStaleState removing state" podUID="fbb03638-37d4-41a9-ad18-dc85479bb9dd" containerName="extract" Jun 11 18:40:43.949583 ip-10-0-141-55 kubenswrapper[2578]: I0611 18:40:43.949548 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager-operator/cert-manager-operator-controller-manager-57757f7cfc-85rfj" Jun 11 18:40:43.952883 ip-10-0-141-55 kubenswrapper[2578]: I0611 18:40:43.952861 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager-operator\"/\"kube-root-ca.crt\"" Jun 11 18:40:43.953137 ip-10-0-141-55 kubenswrapper[2578]: I0611 18:40:43.953123 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"cert-manager-operator\"/\"cert-manager-operator-controller-manager-dockercfg-zt2vd\"" Jun 11 18:40:43.953190 ip-10-0-141-55 kubenswrapper[2578]: I0611 18:40:43.953126 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager-operator\"/\"openshift-service-ca.crt\"" Jun 11 18:40:43.960828 ip-10-0-141-55 kubenswrapper[2578]: I0611 18:40:43.960807 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager-operator/cert-manager-operator-controller-manager-57757f7cfc-85rfj"] Jun 11 18:40:44.037641 ip-10-0-141-55 kubenswrapper[2578]: I0611 18:40:44.037607 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/7005d612-6696-4689-b76e-3a9e920974cb-tmp\") pod \"cert-manager-operator-controller-manager-57757f7cfc-85rfj\" (UID: \"7005d612-6696-4689-b76e-3a9e920974cb\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-57757f7cfc-85rfj" Jun 11 18:40:44.037805 ip-10-0-141-55 kubenswrapper[2578]: I0611 18:40:44.037658 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-f6n86\" (UniqueName: \"kubernetes.io/projected/7005d612-6696-4689-b76e-3a9e920974cb-kube-api-access-f6n86\") pod \"cert-manager-operator-controller-manager-57757f7cfc-85rfj\" (UID: \"7005d612-6696-4689-b76e-3a9e920974cb\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-57757f7cfc-85rfj" Jun 11 18:40:44.138873 ip-10-0-141-55 kubenswrapper[2578]: I0611 18:40:44.138840 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-f6n86\" (UniqueName: \"kubernetes.io/projected/7005d612-6696-4689-b76e-3a9e920974cb-kube-api-access-f6n86\") pod \"cert-manager-operator-controller-manager-57757f7cfc-85rfj\" (UID: \"7005d612-6696-4689-b76e-3a9e920974cb\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-57757f7cfc-85rfj" Jun 11 18:40:44.139018 ip-10-0-141-55 kubenswrapper[2578]: I0611 18:40:44.138899 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/7005d612-6696-4689-b76e-3a9e920974cb-tmp\") pod \"cert-manager-operator-controller-manager-57757f7cfc-85rfj\" (UID: \"7005d612-6696-4689-b76e-3a9e920974cb\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-57757f7cfc-85rfj" Jun 11 18:40:44.139225 ip-10-0-141-55 kubenswrapper[2578]: I0611 18:40:44.139209 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/7005d612-6696-4689-b76e-3a9e920974cb-tmp\") pod \"cert-manager-operator-controller-manager-57757f7cfc-85rfj\" (UID: \"7005d612-6696-4689-b76e-3a9e920974cb\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-57757f7cfc-85rfj" Jun 11 18:40:44.149328 ip-10-0-141-55 kubenswrapper[2578]: I0611 18:40:44.149296 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-f6n86\" (UniqueName: \"kubernetes.io/projected/7005d612-6696-4689-b76e-3a9e920974cb-kube-api-access-f6n86\") pod \"cert-manager-operator-controller-manager-57757f7cfc-85rfj\" (UID: \"7005d612-6696-4689-b76e-3a9e920974cb\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-57757f7cfc-85rfj" Jun 11 18:40:44.258575 ip-10-0-141-55 kubenswrapper[2578]: I0611 18:40:44.258479 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager-operator/cert-manager-operator-controller-manager-57757f7cfc-85rfj" Jun 11 18:40:44.390807 ip-10-0-141-55 kubenswrapper[2578]: I0611 18:40:44.390785 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager-operator/cert-manager-operator-controller-manager-57757f7cfc-85rfj"] Jun 11 18:40:44.392865 ip-10-0-141-55 kubenswrapper[2578]: W0611 18:40:44.392827 2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7005d612_6696_4689_b76e_3a9e920974cb.slice/crio-51b91b5b304a5eac7c16311dc91efe0a6931409b7c5a0e16b4ec3830e349244a WatchSource:0}: Error finding container 51b91b5b304a5eac7c16311dc91efe0a6931409b7c5a0e16b4ec3830e349244a: Status 404 returned error can't find the container with id 51b91b5b304a5eac7c16311dc91efe0a6931409b7c5a0e16b4ec3830e349244a Jun 11 18:40:44.444546 ip-10-0-141-55 kubenswrapper[2578]: I0611 18:40:44.444513 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager-operator/cert-manager-operator-controller-manager-57757f7cfc-85rfj" event={"ID":"7005d612-6696-4689-b76e-3a9e920974cb","Type":"ContainerStarted","Data":"51b91b5b304a5eac7c16311dc91efe0a6931409b7c5a0e16b4ec3830e349244a"} Jun 11 18:40:47.455911 ip-10-0-141-55 kubenswrapper[2578]: I0611 18:40:47.455830 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager-operator/cert-manager-operator-controller-manager-57757f7cfc-85rfj" event={"ID":"7005d612-6696-4689-b76e-3a9e920974cb","Type":"ContainerStarted","Data":"133a27eb7ff682e12f9b47d7fbfa85ba6b7c9983bb7d08e3cc2c8e44f8f095d4"} Jun 11 18:40:47.478307 ip-10-0-141-55 kubenswrapper[2578]: I0611 18:40:47.478255 2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="cert-manager-operator/cert-manager-operator-controller-manager-57757f7cfc-85rfj" podStartSLOduration=2.4365200209999998 podStartE2EDuration="4.478240531s" totalImagesPullingTime="2.04172051s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-11 18:40:43 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-11 18:40:47.476137742 +0000 UTC m=+253.430812347" watchObservedRunningTime="2026-06-11 18:40:47.478240531 +0000 UTC m=+253.432915136" Jun 11 18:40:48.471389 ip-10-0-141-55 kubenswrapper[2578]: I0611 18:40:48.471355 2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fcnhtf"] Jun 11 18:40:48.474499 ip-10-0-141-55 kubenswrapper[2578]: I0611 18:40:48.474482 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fcnhtf" Jun 11 18:40:48.477265 ip-10-0-141-55 kubenswrapper[2578]: I0611 18:40:48.477245 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"openshift-service-ca.crt\"" Jun 11 18:40:48.477376 ip-10-0-141-55 kubenswrapper[2578]: I0611 18:40:48.477302 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-marketplace\"/\"default-dockercfg-nkxdk\"" Jun 11 18:40:48.478739 ip-10-0-141-55 kubenswrapper[2578]: I0611 18:40:48.478722 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"kube-root-ca.crt\"" Jun 11 18:40:48.484612 ip-10-0-141-55 kubenswrapper[2578]: I0611 18:40:48.484594 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fcnhtf"] Jun 11 18:40:48.575691 ip-10-0-141-55 kubenswrapper[2578]: I0611 18:40:48.575657 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/5c5928f5-2625-4dda-ba19-7e2ea3fa3753-util\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fcnhtf\" (UID: \"5c5928f5-2625-4dda-ba19-7e2ea3fa3753\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fcnhtf" Jun 11 18:40:48.575691 ip-10-0-141-55 kubenswrapper[2578]: I0611 18:40:48.575694 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/5c5928f5-2625-4dda-ba19-7e2ea3fa3753-bundle\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fcnhtf\" (UID: \"5c5928f5-2625-4dda-ba19-7e2ea3fa3753\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fcnhtf" Jun 11 18:40:48.575954 ip-10-0-141-55 kubenswrapper[2578]: I0611 18:40:48.575854 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ths79\" (UniqueName: \"kubernetes.io/projected/5c5928f5-2625-4dda-ba19-7e2ea3fa3753-kube-api-access-ths79\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fcnhtf\" (UID: \"5c5928f5-2625-4dda-ba19-7e2ea3fa3753\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fcnhtf" Jun 11 18:40:48.676960 ip-10-0-141-55 kubenswrapper[2578]: I0611 18:40:48.676924 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ths79\" (UniqueName: \"kubernetes.io/projected/5c5928f5-2625-4dda-ba19-7e2ea3fa3753-kube-api-access-ths79\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fcnhtf\" (UID: \"5c5928f5-2625-4dda-ba19-7e2ea3fa3753\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fcnhtf" Jun 11 18:40:48.677144 ip-10-0-141-55 kubenswrapper[2578]: I0611 18:40:48.676991 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/5c5928f5-2625-4dda-ba19-7e2ea3fa3753-util\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fcnhtf\" (UID: \"5c5928f5-2625-4dda-ba19-7e2ea3fa3753\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fcnhtf" Jun 11 18:40:48.677144 ip-10-0-141-55 kubenswrapper[2578]: I0611 18:40:48.677015 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/5c5928f5-2625-4dda-ba19-7e2ea3fa3753-bundle\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fcnhtf\" (UID: \"5c5928f5-2625-4dda-ba19-7e2ea3fa3753\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fcnhtf" Jun 11 18:40:48.677323 ip-10-0-141-55 kubenswrapper[2578]: I0611 18:40:48.677307 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/5c5928f5-2625-4dda-ba19-7e2ea3fa3753-bundle\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fcnhtf\" (UID: \"5c5928f5-2625-4dda-ba19-7e2ea3fa3753\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fcnhtf" Jun 11 18:40:48.677379 ip-10-0-141-55 kubenswrapper[2578]: I0611 18:40:48.677348 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/5c5928f5-2625-4dda-ba19-7e2ea3fa3753-util\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fcnhtf\" (UID: \"5c5928f5-2625-4dda-ba19-7e2ea3fa3753\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fcnhtf" Jun 11 18:40:48.686441 ip-10-0-141-55 kubenswrapper[2578]: I0611 18:40:48.686412 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-ths79\" (UniqueName: \"kubernetes.io/projected/5c5928f5-2625-4dda-ba19-7e2ea3fa3753-kube-api-access-ths79\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fcnhtf\" (UID: \"5c5928f5-2625-4dda-ba19-7e2ea3fa3753\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fcnhtf" Jun 11 18:40:48.783833 ip-10-0-141-55 kubenswrapper[2578]: I0611 18:40:48.783754 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fcnhtf" Jun 11 18:40:48.913410 ip-10-0-141-55 kubenswrapper[2578]: I0611 18:40:48.913379 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fcnhtf"] Jun 11 18:40:48.916612 ip-10-0-141-55 kubenswrapper[2578]: W0611 18:40:48.916579 2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5c5928f5_2625_4dda_ba19_7e2ea3fa3753.slice/crio-a29e1b0fbd9be51632586f0fa65d01b12c638e209eaa496c05061c37f9271c0f WatchSource:0}: Error finding container a29e1b0fbd9be51632586f0fa65d01b12c638e209eaa496c05061c37f9271c0f: Status 404 returned error can't find the container with id a29e1b0fbd9be51632586f0fa65d01b12c638e209eaa496c05061c37f9271c0f Jun 11 18:40:48.949630 ip-10-0-141-55 kubenswrapper[2578]: I0611 18:40:48.946114 2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["cert-manager/cert-manager-webhook-7dc76cbb94-pbrqp"] Jun 11 18:40:48.950501 ip-10-0-141-55 kubenswrapper[2578]: I0611 18:40:48.950471 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-webhook-7dc76cbb94-pbrqp" Jun 11 18:40:48.953541 ip-10-0-141-55 kubenswrapper[2578]: I0611 18:40:48.953517 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager\"/\"kube-root-ca.crt\"" Jun 11 18:40:48.953649 ip-10-0-141-55 kubenswrapper[2578]: I0611 18:40:48.953599 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"cert-manager\"/\"cert-manager-webhook-dockercfg-7v2sq\"" Jun 11 18:40:48.953649 ip-10-0-141-55 kubenswrapper[2578]: I0611 18:40:48.953610 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager\"/\"openshift-service-ca.crt\"" Jun 11 18:40:48.957955 ip-10-0-141-55 kubenswrapper[2578]: I0611 18:40:48.957934 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-webhook-7dc76cbb94-pbrqp"] Jun 11 18:40:49.080581 ip-10-0-141-55 kubenswrapper[2578]: I0611 18:40:49.080471 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/4bcba2b4-10c8-4136-bb53-113e70e936b0-bound-sa-token\") pod \"cert-manager-webhook-7dc76cbb94-pbrqp\" (UID: \"4bcba2b4-10c8-4136-bb53-113e70e936b0\") " pod="cert-manager/cert-manager-webhook-7dc76cbb94-pbrqp" Jun 11 18:40:49.080734 ip-10-0-141-55 kubenswrapper[2578]: I0611 18:40:49.080579 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-g7hb4\" (UniqueName: \"kubernetes.io/projected/4bcba2b4-10c8-4136-bb53-113e70e936b0-kube-api-access-g7hb4\") pod \"cert-manager-webhook-7dc76cbb94-pbrqp\" (UID: \"4bcba2b4-10c8-4136-bb53-113e70e936b0\") " pod="cert-manager/cert-manager-webhook-7dc76cbb94-pbrqp" Jun 11 18:40:49.181868 ip-10-0-141-55 kubenswrapper[2578]: I0611 18:40:49.181831 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-g7hb4\" (UniqueName: \"kubernetes.io/projected/4bcba2b4-10c8-4136-bb53-113e70e936b0-kube-api-access-g7hb4\") pod \"cert-manager-webhook-7dc76cbb94-pbrqp\" (UID: \"4bcba2b4-10c8-4136-bb53-113e70e936b0\") " pod="cert-manager/cert-manager-webhook-7dc76cbb94-pbrqp" Jun 11 18:40:49.182040 ip-10-0-141-55 kubenswrapper[2578]: I0611 18:40:49.181884 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/4bcba2b4-10c8-4136-bb53-113e70e936b0-bound-sa-token\") pod \"cert-manager-webhook-7dc76cbb94-pbrqp\" (UID: \"4bcba2b4-10c8-4136-bb53-113e70e936b0\") " pod="cert-manager/cert-manager-webhook-7dc76cbb94-pbrqp" Jun 11 18:40:49.191767 ip-10-0-141-55 kubenswrapper[2578]: I0611 18:40:49.191744 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/4bcba2b4-10c8-4136-bb53-113e70e936b0-bound-sa-token\") pod \"cert-manager-webhook-7dc76cbb94-pbrqp\" (UID: \"4bcba2b4-10c8-4136-bb53-113e70e936b0\") " pod="cert-manager/cert-manager-webhook-7dc76cbb94-pbrqp" Jun 11 18:40:49.191874 ip-10-0-141-55 kubenswrapper[2578]: I0611 18:40:49.191823 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-g7hb4\" (UniqueName: \"kubernetes.io/projected/4bcba2b4-10c8-4136-bb53-113e70e936b0-kube-api-access-g7hb4\") pod \"cert-manager-webhook-7dc76cbb94-pbrqp\" (UID: \"4bcba2b4-10c8-4136-bb53-113e70e936b0\") " pod="cert-manager/cert-manager-webhook-7dc76cbb94-pbrqp" Jun 11 18:40:49.272953 ip-10-0-141-55 kubenswrapper[2578]: I0611 18:40:49.272927 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-webhook-7dc76cbb94-pbrqp" Jun 11 18:40:49.398726 ip-10-0-141-55 kubenswrapper[2578]: I0611 18:40:49.398698 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-webhook-7dc76cbb94-pbrqp"] Jun 11 18:40:49.400880 ip-10-0-141-55 kubenswrapper[2578]: W0611 18:40:49.400850 2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod4bcba2b4_10c8_4136_bb53_113e70e936b0.slice/crio-5986b13358d837ef3276d57763817988203c5f21e4f7e826468a58a7ededeb58 WatchSource:0}: Error finding container 5986b13358d837ef3276d57763817988203c5f21e4f7e826468a58a7ededeb58: Status 404 returned error can't find the container with id 5986b13358d837ef3276d57763817988203c5f21e4f7e826468a58a7ededeb58 Jun 11 18:40:49.464479 ip-10-0-141-55 kubenswrapper[2578]: I0611 18:40:49.464439 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-webhook-7dc76cbb94-pbrqp" event={"ID":"4bcba2b4-10c8-4136-bb53-113e70e936b0","Type":"ContainerStarted","Data":"5986b13358d837ef3276d57763817988203c5f21e4f7e826468a58a7ededeb58"} Jun 11 18:40:49.465786 ip-10-0-141-55 kubenswrapper[2578]: I0611 18:40:49.465763 2578 generic.go:356] "Generic (PLEG): container finished" podID="5c5928f5-2625-4dda-ba19-7e2ea3fa3753" containerID="e6fff1283aa54454f7c446a439a0fe11f7905bc67bf0d54d57227255f74133fd" exitCode=0 Jun 11 18:40:49.465875 ip-10-0-141-55 kubenswrapper[2578]: I0611 18:40:49.465852 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fcnhtf" event={"ID":"5c5928f5-2625-4dda-ba19-7e2ea3fa3753","Type":"ContainerDied","Data":"e6fff1283aa54454f7c446a439a0fe11f7905bc67bf0d54d57227255f74133fd"} Jun 11 18:40:49.465915 ip-10-0-141-55 kubenswrapper[2578]: I0611 18:40:49.465900 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fcnhtf" event={"ID":"5c5928f5-2625-4dda-ba19-7e2ea3fa3753","Type":"ContainerStarted","Data":"a29e1b0fbd9be51632586f0fa65d01b12c638e209eaa496c05061c37f9271c0f"} Jun 11 18:40:52.481137 ip-10-0-141-55 kubenswrapper[2578]: I0611 18:40:52.481102 2578 generic.go:356] "Generic (PLEG): container finished" podID="5c5928f5-2625-4dda-ba19-7e2ea3fa3753" containerID="1ee4b4282ab34e514bbf784d211681cf50a1c1b5cd303cb5cbd8f9878555d85a" exitCode=0 Jun 11 18:40:52.481635 ip-10-0-141-55 kubenswrapper[2578]: I0611 18:40:52.481181 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fcnhtf" event={"ID":"5c5928f5-2625-4dda-ba19-7e2ea3fa3753","Type":"ContainerDied","Data":"1ee4b4282ab34e514bbf784d211681cf50a1c1b5cd303cb5cbd8f9878555d85a"} Jun 11 18:40:53.487601 ip-10-0-141-55 kubenswrapper[2578]: I0611 18:40:53.487547 2578 generic.go:356] "Generic (PLEG): container finished" podID="5c5928f5-2625-4dda-ba19-7e2ea3fa3753" containerID="6b66e97ee26cd07a2311c10036550f4146fcce638e0887ce63e155619ff4a17c" exitCode=0 Jun 11 18:40:53.487601 ip-10-0-141-55 kubenswrapper[2578]: I0611 18:40:53.487590 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fcnhtf" event={"ID":"5c5928f5-2625-4dda-ba19-7e2ea3fa3753","Type":"ContainerDied","Data":"6b66e97ee26cd07a2311c10036550f4146fcce638e0887ce63e155619ff4a17c"} Jun 11 18:40:53.489174 ip-10-0-141-55 kubenswrapper[2578]: I0611 18:40:53.489141 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-webhook-7dc76cbb94-pbrqp" event={"ID":"4bcba2b4-10c8-4136-bb53-113e70e936b0","Type":"ContainerStarted","Data":"8937ea6aba39d1b3e6249e7b906644a530b0e208b300b7b143db6bf024f19ece"} Jun 11 18:40:53.489313 ip-10-0-141-55 kubenswrapper[2578]: I0611 18:40:53.489291 2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="cert-manager/cert-manager-webhook-7dc76cbb94-pbrqp" Jun 11 18:40:53.525067 ip-10-0-141-55 kubenswrapper[2578]: I0611 18:40:53.525016 2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="cert-manager/cert-manager-webhook-7dc76cbb94-pbrqp" podStartSLOduration=2.267122334 podStartE2EDuration="5.525002516s" totalImagesPullingTime="3.257880182s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-11 18:40:48 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-11 18:40:53.52358781 +0000 UTC m=+259.478262416" watchObservedRunningTime="2026-06-11 18:40:53.525002516 +0000 UTC m=+259.479677122" Jun 11 18:40:54.612743 ip-10-0-141-55 kubenswrapper[2578]: I0611 18:40:54.612719 2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fcnhtf" Jun 11 18:40:54.727417 ip-10-0-141-55 kubenswrapper[2578]: I0611 18:40:54.727384 2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/5c5928f5-2625-4dda-ba19-7e2ea3fa3753-bundle\") pod \"5c5928f5-2625-4dda-ba19-7e2ea3fa3753\" (UID: \"5c5928f5-2625-4dda-ba19-7e2ea3fa3753\") " Jun 11 18:40:54.727603 ip-10-0-141-55 kubenswrapper[2578]: I0611 18:40:54.727433 2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/5c5928f5-2625-4dda-ba19-7e2ea3fa3753-util\") pod \"5c5928f5-2625-4dda-ba19-7e2ea3fa3753\" (UID: \"5c5928f5-2625-4dda-ba19-7e2ea3fa3753\") " Jun 11 18:40:54.727603 ip-10-0-141-55 kubenswrapper[2578]: I0611 18:40:54.727481 2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-ths79\" (UniqueName: \"kubernetes.io/projected/5c5928f5-2625-4dda-ba19-7e2ea3fa3753-kube-api-access-ths79\") pod \"5c5928f5-2625-4dda-ba19-7e2ea3fa3753\" (UID: \"5c5928f5-2625-4dda-ba19-7e2ea3fa3753\") " Jun 11 18:40:54.727841 ip-10-0-141-55 kubenswrapper[2578]: I0611 18:40:54.727819 2578 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/5c5928f5-2625-4dda-ba19-7e2ea3fa3753-bundle" (OuterVolumeSpecName: "bundle") pod "5c5928f5-2625-4dda-ba19-7e2ea3fa3753" (UID: "5c5928f5-2625-4dda-ba19-7e2ea3fa3753"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 11 18:40:54.729565 ip-10-0-141-55 kubenswrapper[2578]: I0611 18:40:54.729538 2578 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/5c5928f5-2625-4dda-ba19-7e2ea3fa3753-kube-api-access-ths79" (OuterVolumeSpecName: "kube-api-access-ths79") pod "5c5928f5-2625-4dda-ba19-7e2ea3fa3753" (UID: "5c5928f5-2625-4dda-ba19-7e2ea3fa3753"). InnerVolumeSpecName "kube-api-access-ths79". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 11 18:40:54.734016 ip-10-0-141-55 kubenswrapper[2578]: I0611 18:40:54.733984 2578 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/5c5928f5-2625-4dda-ba19-7e2ea3fa3753-util" (OuterVolumeSpecName: "util") pod "5c5928f5-2625-4dda-ba19-7e2ea3fa3753" (UID: "5c5928f5-2625-4dda-ba19-7e2ea3fa3753"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 11 18:40:54.828477 ip-10-0-141-55 kubenswrapper[2578]: I0611 18:40:54.828386 2578 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-ths79\" (UniqueName: \"kubernetes.io/projected/5c5928f5-2625-4dda-ba19-7e2ea3fa3753-kube-api-access-ths79\") on node \"ip-10-0-141-55.ec2.internal\" DevicePath \"\"" Jun 11 18:40:54.828477 ip-10-0-141-55 kubenswrapper[2578]: I0611 18:40:54.828418 2578 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/5c5928f5-2625-4dda-ba19-7e2ea3fa3753-bundle\") on node \"ip-10-0-141-55.ec2.internal\" DevicePath \"\"" Jun 11 18:40:54.828477 ip-10-0-141-55 kubenswrapper[2578]: I0611 18:40:54.828427 2578 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/5c5928f5-2625-4dda-ba19-7e2ea3fa3753-util\") on node \"ip-10-0-141-55.ec2.internal\" DevicePath \"\"" Jun 11 18:40:55.498930 ip-10-0-141-55 kubenswrapper[2578]: I0611 18:40:55.498896 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fcnhtf" event={"ID":"5c5928f5-2625-4dda-ba19-7e2ea3fa3753","Type":"ContainerDied","Data":"a29e1b0fbd9be51632586f0fa65d01b12c638e209eaa496c05061c37f9271c0f"} Jun 11 18:40:55.498930 ip-10-0-141-55 kubenswrapper[2578]: I0611 18:40:55.498945 2578 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="a29e1b0fbd9be51632586f0fa65d01b12c638e209eaa496c05061c37f9271c0f" Jun 11 18:40:55.499138 ip-10-0-141-55 kubenswrapper[2578]: I0611 18:40:55.498944 2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fcnhtf" Jun 11 18:40:59.496085 ip-10-0-141-55 kubenswrapper[2578]: I0611 18:40:59.496060 2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="cert-manager/cert-manager-webhook-7dc76cbb94-pbrqp" Jun 11 18:41:00.384215 ip-10-0-141-55 kubenswrapper[2578]: I0611 18:41:00.384159 2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-lws-operator/openshift-lws-operator-fd8ccff4c-bfhnm"] Jun 11 18:41:00.384477 ip-10-0-141-55 kubenswrapper[2578]: I0611 18:41:00.384465 2578 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="5c5928f5-2625-4dda-ba19-7e2ea3fa3753" containerName="pull" Jun 11 18:41:00.384522 ip-10-0-141-55 kubenswrapper[2578]: I0611 18:41:00.384479 2578 state_mem.go:107] "Deleted CPUSet assignment" podUID="5c5928f5-2625-4dda-ba19-7e2ea3fa3753" containerName="pull" Jun 11 18:41:00.384522 ip-10-0-141-55 kubenswrapper[2578]: I0611 18:41:00.384491 2578 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="5c5928f5-2625-4dda-ba19-7e2ea3fa3753" containerName="extract" Jun 11 18:41:00.384522 ip-10-0-141-55 kubenswrapper[2578]: I0611 18:41:00.384496 2578 state_mem.go:107] "Deleted CPUSet assignment" podUID="5c5928f5-2625-4dda-ba19-7e2ea3fa3753" containerName="extract" Jun 11 18:41:00.384522 ip-10-0-141-55 kubenswrapper[2578]: I0611 18:41:00.384511 2578 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="5c5928f5-2625-4dda-ba19-7e2ea3fa3753" containerName="util" Jun 11 18:41:00.384522 ip-10-0-141-55 kubenswrapper[2578]: I0611 18:41:00.384517 2578 state_mem.go:107] "Deleted CPUSet assignment" podUID="5c5928f5-2625-4dda-ba19-7e2ea3fa3753" containerName="util" Jun 11 18:41:00.384687 ip-10-0-141-55 kubenswrapper[2578]: I0611 18:41:00.384581 2578 memory_manager.go:368] "RemoveStaleState removing state" podUID="5c5928f5-2625-4dda-ba19-7e2ea3fa3753" containerName="extract" Jun 11 18:41:00.388390 ip-10-0-141-55 kubenswrapper[2578]: I0611 18:41:00.388376 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-bfhnm" Jun 11 18:41:00.391464 ip-10-0-141-55 kubenswrapper[2578]: I0611 18:41:00.391443 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"kube-root-ca.crt\"" Jun 11 18:41:00.392687 ip-10-0-141-55 kubenswrapper[2578]: I0611 18:41:00.392662 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"openshift-service-ca.crt\"" Jun 11 18:41:00.392687 ip-10-0-141-55 kubenswrapper[2578]: I0611 18:41:00.392682 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"openshift-lws-operator-dockercfg-6l592\"" Jun 11 18:41:00.397360 ip-10-0-141-55 kubenswrapper[2578]: I0611 18:41:00.397335 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/openshift-lws-operator-fd8ccff4c-bfhnm"] Jun 11 18:41:00.578474 ip-10-0-141-55 kubenswrapper[2578]: I0611 18:41:00.578434 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/a140623e-2799-47c1-8da5-8a66081ef6e6-tmp\") pod \"openshift-lws-operator-fd8ccff4c-bfhnm\" (UID: \"a140623e-2799-47c1-8da5-8a66081ef6e6\") " pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-bfhnm" Jun 11 18:41:00.578875 ip-10-0-141-55 kubenswrapper[2578]: I0611 18:41:00.578487 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6kp2t\" (UniqueName: \"kubernetes.io/projected/a140623e-2799-47c1-8da5-8a66081ef6e6-kube-api-access-6kp2t\") pod \"openshift-lws-operator-fd8ccff4c-bfhnm\" (UID: \"a140623e-2799-47c1-8da5-8a66081ef6e6\") " pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-bfhnm" Jun 11 18:41:00.679327 ip-10-0-141-55 kubenswrapper[2578]: I0611 18:41:00.679247 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/a140623e-2799-47c1-8da5-8a66081ef6e6-tmp\") pod \"openshift-lws-operator-fd8ccff4c-bfhnm\" (UID: \"a140623e-2799-47c1-8da5-8a66081ef6e6\") " pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-bfhnm" Jun 11 18:41:00.679327 ip-10-0-141-55 kubenswrapper[2578]: I0611 18:41:00.679291 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6kp2t\" (UniqueName: \"kubernetes.io/projected/a140623e-2799-47c1-8da5-8a66081ef6e6-kube-api-access-6kp2t\") pod \"openshift-lws-operator-fd8ccff4c-bfhnm\" (UID: \"a140623e-2799-47c1-8da5-8a66081ef6e6\") " pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-bfhnm" Jun 11 18:41:00.679605 ip-10-0-141-55 kubenswrapper[2578]: I0611 18:41:00.679587 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/a140623e-2799-47c1-8da5-8a66081ef6e6-tmp\") pod \"openshift-lws-operator-fd8ccff4c-bfhnm\" (UID: \"a140623e-2799-47c1-8da5-8a66081ef6e6\") " pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-bfhnm" Jun 11 18:41:00.687673 ip-10-0-141-55 kubenswrapper[2578]: I0611 18:41:00.687647 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-6kp2t\" (UniqueName: \"kubernetes.io/projected/a140623e-2799-47c1-8da5-8a66081ef6e6-kube-api-access-6kp2t\") pod \"openshift-lws-operator-fd8ccff4c-bfhnm\" (UID: \"a140623e-2799-47c1-8da5-8a66081ef6e6\") " pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-bfhnm" Jun 11 18:41:00.698481 ip-10-0-141-55 kubenswrapper[2578]: I0611 18:41:00.698460 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-bfhnm" Jun 11 18:41:00.824470 ip-10-0-141-55 kubenswrapper[2578]: I0611 18:41:00.824444 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/openshift-lws-operator-fd8ccff4c-bfhnm"] Jun 11 18:41:00.826353 ip-10-0-141-55 kubenswrapper[2578]: W0611 18:41:00.826328 2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-poda140623e_2799_47c1_8da5_8a66081ef6e6.slice/crio-8a02ed794dadeaf4e80f808e6f0e416a44ca8b761f915cc17619adefc666b168 WatchSource:0}: Error finding container 8a02ed794dadeaf4e80f808e6f0e416a44ca8b761f915cc17619adefc666b168: Status 404 returned error can't find the container with id 8a02ed794dadeaf4e80f808e6f0e416a44ca8b761f915cc17619adefc666b168 Jun 11 18:41:01.524267 ip-10-0-141-55 kubenswrapper[2578]: I0611 18:41:01.524231 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-bfhnm" event={"ID":"a140623e-2799-47c1-8da5-8a66081ef6e6","Type":"ContainerStarted","Data":"8a02ed794dadeaf4e80f808e6f0e416a44ca8b761f915cc17619adefc666b168"} Jun 11 18:41:04.538277 ip-10-0-141-55 kubenswrapper[2578]: I0611 18:41:04.538241 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-bfhnm" event={"ID":"a140623e-2799-47c1-8da5-8a66081ef6e6","Type":"ContainerStarted","Data":"c2b4ab3d7914b087c6ba976f6a8055dce35a811a4ade7b3263b0bfbe055d62bd"} Jun 11 18:41:04.559223 ip-10-0-141-55 kubenswrapper[2578]: I0611 18:41:04.559162 2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-bfhnm" podStartSLOduration=1.881910266 podStartE2EDuration="4.559147829s" totalImagesPullingTime="2.677237563s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-11 18:41:00 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-11 18:41:04.557871057 +0000 UTC m=+270.512545664" watchObservedRunningTime="2026-06-11 18:41:04.559147829 +0000 UTC m=+270.513822435" Jun 11 18:41:06.833212 ip-10-0-141-55 kubenswrapper[2578]: I0611 18:41:06.833172 2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-marketplace/410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cdwgfqb"] Jun 11 18:41:06.857306 ip-10-0-141-55 kubenswrapper[2578]: I0611 18:41:06.857273 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cdwgfqb"] Jun 11 18:41:06.857471 ip-10-0-141-55 kubenswrapper[2578]: I0611 18:41:06.857420 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cdwgfqb" Jun 11 18:41:06.860425 ip-10-0-141-55 kubenswrapper[2578]: I0611 18:41:06.860401 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"kube-root-ca.crt\"" Jun 11 18:41:06.861792 ip-10-0-141-55 kubenswrapper[2578]: I0611 18:41:06.861771 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-marketplace\"/\"default-dockercfg-nkxdk\"" Jun 11 18:41:06.861893 ip-10-0-141-55 kubenswrapper[2578]: I0611 18:41:06.861816 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"openshift-service-ca.crt\"" Jun 11 18:41:06.926392 ip-10-0-141-55 kubenswrapper[2578]: I0611 18:41:06.926355 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/845a389b-0770-4298-aaff-87b138cdaf82-util\") pod \"410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cdwgfqb\" (UID: \"845a389b-0770-4298-aaff-87b138cdaf82\") " pod="openshift-marketplace/410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cdwgfqb" Jun 11 18:41:06.926611 ip-10-0-141-55 kubenswrapper[2578]: I0611 18:41:06.926411 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-lsb4b\" (UniqueName: \"kubernetes.io/projected/845a389b-0770-4298-aaff-87b138cdaf82-kube-api-access-lsb4b\") pod \"410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cdwgfqb\" (UID: \"845a389b-0770-4298-aaff-87b138cdaf82\") " pod="openshift-marketplace/410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cdwgfqb" Jun 11 18:41:06.926611 ip-10-0-141-55 kubenswrapper[2578]: I0611 18:41:06.926493 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/845a389b-0770-4298-aaff-87b138cdaf82-bundle\") pod \"410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cdwgfqb\" (UID: \"845a389b-0770-4298-aaff-87b138cdaf82\") " pod="openshift-marketplace/410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cdwgfqb" Jun 11 18:41:07.027373 ip-10-0-141-55 kubenswrapper[2578]: I0611 18:41:07.027335 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/845a389b-0770-4298-aaff-87b138cdaf82-bundle\") pod \"410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cdwgfqb\" (UID: \"845a389b-0770-4298-aaff-87b138cdaf82\") " pod="openshift-marketplace/410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cdwgfqb" Jun 11 18:41:07.027537 ip-10-0-141-55 kubenswrapper[2578]: I0611 18:41:07.027380 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/845a389b-0770-4298-aaff-87b138cdaf82-util\") pod \"410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cdwgfqb\" (UID: \"845a389b-0770-4298-aaff-87b138cdaf82\") " pod="openshift-marketplace/410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cdwgfqb" Jun 11 18:41:07.027537 ip-10-0-141-55 kubenswrapper[2578]: I0611 18:41:07.027438 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-lsb4b\" (UniqueName: \"kubernetes.io/projected/845a389b-0770-4298-aaff-87b138cdaf82-kube-api-access-lsb4b\") pod \"410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cdwgfqb\" (UID: \"845a389b-0770-4298-aaff-87b138cdaf82\") " pod="openshift-marketplace/410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cdwgfqb" Jun 11 18:41:07.027729 ip-10-0-141-55 kubenswrapper[2578]: I0611 18:41:07.027708 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/845a389b-0770-4298-aaff-87b138cdaf82-bundle\") pod \"410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cdwgfqb\" (UID: \"845a389b-0770-4298-aaff-87b138cdaf82\") " pod="openshift-marketplace/410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cdwgfqb" Jun 11 18:41:07.027782 ip-10-0-141-55 kubenswrapper[2578]: I0611 18:41:07.027742 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/845a389b-0770-4298-aaff-87b138cdaf82-util\") pod \"410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cdwgfqb\" (UID: \"845a389b-0770-4298-aaff-87b138cdaf82\") " pod="openshift-marketplace/410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cdwgfqb" Jun 11 18:41:07.036503 ip-10-0-141-55 kubenswrapper[2578]: I0611 18:41:07.036480 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-lsb4b\" (UniqueName: \"kubernetes.io/projected/845a389b-0770-4298-aaff-87b138cdaf82-kube-api-access-lsb4b\") pod \"410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cdwgfqb\" (UID: \"845a389b-0770-4298-aaff-87b138cdaf82\") " pod="openshift-marketplace/410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cdwgfqb" Jun 11 18:41:07.166675 ip-10-0-141-55 kubenswrapper[2578]: I0611 18:41:07.166627 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cdwgfqb" Jun 11 18:41:07.312954 ip-10-0-141-55 kubenswrapper[2578]: I0611 18:41:07.312932 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cdwgfqb"] Jun 11 18:41:07.314704 ip-10-0-141-55 kubenswrapper[2578]: W0611 18:41:07.314675 2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod845a389b_0770_4298_aaff_87b138cdaf82.slice/crio-50570a1da5e885ae0019d987ec1ddf5df942ba65155a275f794fdbdff62e7799 WatchSource:0}: Error finding container 50570a1da5e885ae0019d987ec1ddf5df942ba65155a275f794fdbdff62e7799: Status 404 returned error can't find the container with id 50570a1da5e885ae0019d987ec1ddf5df942ba65155a275f794fdbdff62e7799 Jun 11 18:41:07.556084 ip-10-0-141-55 kubenswrapper[2578]: I0611 18:41:07.556050 2578 generic.go:356] "Generic (PLEG): container finished" podID="845a389b-0770-4298-aaff-87b138cdaf82" containerID="aaf2856849471640731330257678d27712e5198751c8e51ddd7e68aedfa15960" exitCode=0 Jun 11 18:41:07.556225 ip-10-0-141-55 kubenswrapper[2578]: I0611 18:41:07.556120 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cdwgfqb" event={"ID":"845a389b-0770-4298-aaff-87b138cdaf82","Type":"ContainerDied","Data":"aaf2856849471640731330257678d27712e5198751c8e51ddd7e68aedfa15960"} Jun 11 18:41:07.556225 ip-10-0-141-55 kubenswrapper[2578]: I0611 18:41:07.556157 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cdwgfqb" event={"ID":"845a389b-0770-4298-aaff-87b138cdaf82","Type":"ContainerStarted","Data":"50570a1da5e885ae0019d987ec1ddf5df942ba65155a275f794fdbdff62e7799"} Jun 11 18:41:08.562390 ip-10-0-141-55 kubenswrapper[2578]: I0611 18:41:08.562355 2578 generic.go:356] "Generic (PLEG): container finished" podID="845a389b-0770-4298-aaff-87b138cdaf82" containerID="7e29d223e7bfc185b676be6332e8a64b94d4b9175a0ad44bf565e081594d778d" exitCode=0 Jun 11 18:41:08.562808 ip-10-0-141-55 kubenswrapper[2578]: I0611 18:41:08.562433 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cdwgfqb" event={"ID":"845a389b-0770-4298-aaff-87b138cdaf82","Type":"ContainerDied","Data":"7e29d223e7bfc185b676be6332e8a64b94d4b9175a0ad44bf565e081594d778d"} Jun 11 18:41:09.568420 ip-10-0-141-55 kubenswrapper[2578]: I0611 18:41:09.568383 2578 generic.go:356] "Generic (PLEG): container finished" podID="845a389b-0770-4298-aaff-87b138cdaf82" containerID="74501ebc752c8467549f2b0f8f9cfac4df3a29300874905c7b140a4f307c41a6" exitCode=0 Jun 11 18:41:09.568822 ip-10-0-141-55 kubenswrapper[2578]: I0611 18:41:09.568435 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cdwgfqb" event={"ID":"845a389b-0770-4298-aaff-87b138cdaf82","Type":"ContainerDied","Data":"74501ebc752c8467549f2b0f8f9cfac4df3a29300874905c7b140a4f307c41a6"} Jun 11 18:41:10.696732 ip-10-0-141-55 kubenswrapper[2578]: I0611 18:41:10.696707 2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cdwgfqb" Jun 11 18:41:10.757825 ip-10-0-141-55 kubenswrapper[2578]: I0611 18:41:10.757789 2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/845a389b-0770-4298-aaff-87b138cdaf82-util\") pod \"845a389b-0770-4298-aaff-87b138cdaf82\" (UID: \"845a389b-0770-4298-aaff-87b138cdaf82\") " Jun 11 18:41:10.758017 ip-10-0-141-55 kubenswrapper[2578]: I0611 18:41:10.757854 2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-lsb4b\" (UniqueName: \"kubernetes.io/projected/845a389b-0770-4298-aaff-87b138cdaf82-kube-api-access-lsb4b\") pod \"845a389b-0770-4298-aaff-87b138cdaf82\" (UID: \"845a389b-0770-4298-aaff-87b138cdaf82\") " Jun 11 18:41:10.758017 ip-10-0-141-55 kubenswrapper[2578]: I0611 18:41:10.757898 2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/845a389b-0770-4298-aaff-87b138cdaf82-bundle\") pod \"845a389b-0770-4298-aaff-87b138cdaf82\" (UID: \"845a389b-0770-4298-aaff-87b138cdaf82\") " Jun 11 18:41:10.758660 ip-10-0-141-55 kubenswrapper[2578]: I0611 18:41:10.758625 2578 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/845a389b-0770-4298-aaff-87b138cdaf82-bundle" (OuterVolumeSpecName: "bundle") pod "845a389b-0770-4298-aaff-87b138cdaf82" (UID: "845a389b-0770-4298-aaff-87b138cdaf82"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 11 18:41:10.759959 ip-10-0-141-55 kubenswrapper[2578]: I0611 18:41:10.759931 2578 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/845a389b-0770-4298-aaff-87b138cdaf82-kube-api-access-lsb4b" (OuterVolumeSpecName: "kube-api-access-lsb4b") pod "845a389b-0770-4298-aaff-87b138cdaf82" (UID: "845a389b-0770-4298-aaff-87b138cdaf82"). InnerVolumeSpecName "kube-api-access-lsb4b". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 11 18:41:10.763203 ip-10-0-141-55 kubenswrapper[2578]: I0611 18:41:10.763166 2578 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/845a389b-0770-4298-aaff-87b138cdaf82-util" (OuterVolumeSpecName: "util") pod "845a389b-0770-4298-aaff-87b138cdaf82" (UID: "845a389b-0770-4298-aaff-87b138cdaf82"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 11 18:41:10.858837 ip-10-0-141-55 kubenswrapper[2578]: I0611 18:41:10.858810 2578 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/845a389b-0770-4298-aaff-87b138cdaf82-util\") on node \"ip-10-0-141-55.ec2.internal\" DevicePath \"\"" Jun 11 18:41:10.858837 ip-10-0-141-55 kubenswrapper[2578]: I0611 18:41:10.858836 2578 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-lsb4b\" (UniqueName: \"kubernetes.io/projected/845a389b-0770-4298-aaff-87b138cdaf82-kube-api-access-lsb4b\") on node \"ip-10-0-141-55.ec2.internal\" DevicePath \"\"" Jun 11 18:41:10.859016 ip-10-0-141-55 kubenswrapper[2578]: I0611 18:41:10.858847 2578 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/845a389b-0770-4298-aaff-87b138cdaf82-bundle\") on node \"ip-10-0-141-55.ec2.internal\" DevicePath \"\"" Jun 11 18:41:11.578221 ip-10-0-141-55 kubenswrapper[2578]: I0611 18:41:11.578196 2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cdwgfqb" Jun 11 18:41:11.578408 ip-10-0-141-55 kubenswrapper[2578]: I0611 18:41:11.578189 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cdwgfqb" event={"ID":"845a389b-0770-4298-aaff-87b138cdaf82","Type":"ContainerDied","Data":"50570a1da5e885ae0019d987ec1ddf5df942ba65155a275f794fdbdff62e7799"} Jun 11 18:41:11.578408 ip-10-0-141-55 kubenswrapper[2578]: I0611 18:41:11.578312 2578 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="50570a1da5e885ae0019d987ec1ddf5df942ba65155a275f794fdbdff62e7799" Jun 11 18:41:22.083698 ip-10-0-141-55 kubenswrapper[2578]: I0611 18:41:22.083663 2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-54d5cbc44f-ttbpm"] Jun 11 18:41:22.084064 ip-10-0-141-55 kubenswrapper[2578]: I0611 18:41:22.083948 2578 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="845a389b-0770-4298-aaff-87b138cdaf82" containerName="extract" Jun 11 18:41:22.084064 ip-10-0-141-55 kubenswrapper[2578]: I0611 18:41:22.083958 2578 state_mem.go:107] "Deleted CPUSet assignment" podUID="845a389b-0770-4298-aaff-87b138cdaf82" containerName="extract" Jun 11 18:41:22.084064 ip-10-0-141-55 kubenswrapper[2578]: I0611 18:41:22.083970 2578 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="845a389b-0770-4298-aaff-87b138cdaf82" containerName="util" Jun 11 18:41:22.084064 ip-10-0-141-55 kubenswrapper[2578]: I0611 18:41:22.083977 2578 state_mem.go:107] "Deleted CPUSet assignment" podUID="845a389b-0770-4298-aaff-87b138cdaf82" containerName="util" Jun 11 18:41:22.084064 ip-10-0-141-55 kubenswrapper[2578]: I0611 18:41:22.083985 2578 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="845a389b-0770-4298-aaff-87b138cdaf82" containerName="pull" Jun 11 18:41:22.084064 ip-10-0-141-55 kubenswrapper[2578]: I0611 18:41:22.083990 2578 state_mem.go:107] "Deleted CPUSet assignment" podUID="845a389b-0770-4298-aaff-87b138cdaf82" containerName="pull" Jun 11 18:41:22.084064 ip-10-0-141-55 kubenswrapper[2578]: I0611 18:41:22.084051 2578 memory_manager.go:368] "RemoveStaleState removing state" podUID="845a389b-0770-4298-aaff-87b138cdaf82" containerName="extract" Jun 11 18:41:22.087113 ip-10-0-141-55 kubenswrapper[2578]: I0611 18:41:22.087093 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-54d5cbc44f-ttbpm" Jun 11 18:41:22.090291 ip-10-0-141-55 kubenswrapper[2578]: I0611 18:41:22.090258 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-dockercfg-d7tvg\"" Jun 11 18:41:22.090477 ip-10-0-141-55 kubenswrapper[2578]: I0611 18:41:22.090459 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"kube-root-ca.crt\"" Jun 11 18:41:22.090574 ip-10-0-141-55 kubenswrapper[2578]: I0611 18:41:22.090499 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-service-cert\"" Jun 11 18:41:22.090574 ip-10-0-141-55 kubenswrapper[2578]: I0611 18:41:22.090529 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-webhook-cert\"" Jun 11 18:41:22.090705 ip-10-0-141-55 kubenswrapper[2578]: I0611 18:41:22.090628 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"openshift-service-ca.crt\"" Jun 11 18:41:22.101855 ip-10-0-141-55 kubenswrapper[2578]: I0611 18:41:22.101834 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-54d5cbc44f-ttbpm"] Jun 11 18:41:22.150350 ip-10-0-141-55 kubenswrapper[2578]: I0611 18:41:22.150327 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/b0ce062c-09e7-4207-a0d6-f703e6ec7df1-webhook-cert\") pod \"opendatahub-operator-controller-manager-54d5cbc44f-ttbpm\" (UID: \"b0ce062c-09e7-4207-a0d6-f703e6ec7df1\") " pod="opendatahub/opendatahub-operator-controller-manager-54d5cbc44f-ttbpm" Jun 11 18:41:22.150488 ip-10-0-141-55 kubenswrapper[2578]: I0611 18:41:22.150390 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6rspk\" (UniqueName: \"kubernetes.io/projected/b0ce062c-09e7-4207-a0d6-f703e6ec7df1-kube-api-access-6rspk\") pod \"opendatahub-operator-controller-manager-54d5cbc44f-ttbpm\" (UID: \"b0ce062c-09e7-4207-a0d6-f703e6ec7df1\") " pod="opendatahub/opendatahub-operator-controller-manager-54d5cbc44f-ttbpm" Jun 11 18:41:22.150488 ip-10-0-141-55 kubenswrapper[2578]: I0611 18:41:22.150472 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/b0ce062c-09e7-4207-a0d6-f703e6ec7df1-apiservice-cert\") pod \"opendatahub-operator-controller-manager-54d5cbc44f-ttbpm\" (UID: \"b0ce062c-09e7-4207-a0d6-f703e6ec7df1\") " pod="opendatahub/opendatahub-operator-controller-manager-54d5cbc44f-ttbpm" Jun 11 18:41:22.150579 ip-10-0-141-55 kubenswrapper[2578]: I0611 18:41:22.150515 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/b0ce062c-09e7-4207-a0d6-f703e6ec7df1-manifests\") pod \"opendatahub-operator-controller-manager-54d5cbc44f-ttbpm\" (UID: \"b0ce062c-09e7-4207-a0d6-f703e6ec7df1\") " pod="opendatahub/opendatahub-operator-controller-manager-54d5cbc44f-ttbpm" Jun 11 18:41:22.150579 ip-10-0-141-55 kubenswrapper[2578]: I0611 18:41:22.150533 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/b0ce062c-09e7-4207-a0d6-f703e6ec7df1-tmp\") pod \"opendatahub-operator-controller-manager-54d5cbc44f-ttbpm\" (UID: \"b0ce062c-09e7-4207-a0d6-f703e6ec7df1\") " pod="opendatahub/opendatahub-operator-controller-manager-54d5cbc44f-ttbpm" Jun 11 18:41:22.251507 ip-10-0-141-55 kubenswrapper[2578]: I0611 18:41:22.251475 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/b0ce062c-09e7-4207-a0d6-f703e6ec7df1-manifests\") pod \"opendatahub-operator-controller-manager-54d5cbc44f-ttbpm\" (UID: \"b0ce062c-09e7-4207-a0d6-f703e6ec7df1\") " pod="opendatahub/opendatahub-operator-controller-manager-54d5cbc44f-ttbpm" Jun 11 18:41:22.251507 ip-10-0-141-55 kubenswrapper[2578]: I0611 18:41:22.251505 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/b0ce062c-09e7-4207-a0d6-f703e6ec7df1-tmp\") pod \"opendatahub-operator-controller-manager-54d5cbc44f-ttbpm\" (UID: \"b0ce062c-09e7-4207-a0d6-f703e6ec7df1\") " pod="opendatahub/opendatahub-operator-controller-manager-54d5cbc44f-ttbpm" Jun 11 18:41:22.251723 ip-10-0-141-55 kubenswrapper[2578]: I0611 18:41:22.251525 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/b0ce062c-09e7-4207-a0d6-f703e6ec7df1-webhook-cert\") pod \"opendatahub-operator-controller-manager-54d5cbc44f-ttbpm\" (UID: \"b0ce062c-09e7-4207-a0d6-f703e6ec7df1\") " pod="opendatahub/opendatahub-operator-controller-manager-54d5cbc44f-ttbpm" Jun 11 18:41:22.251723 ip-10-0-141-55 kubenswrapper[2578]: I0611 18:41:22.251594 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6rspk\" (UniqueName: \"kubernetes.io/projected/b0ce062c-09e7-4207-a0d6-f703e6ec7df1-kube-api-access-6rspk\") pod \"opendatahub-operator-controller-manager-54d5cbc44f-ttbpm\" (UID: \"b0ce062c-09e7-4207-a0d6-f703e6ec7df1\") " pod="opendatahub/opendatahub-operator-controller-manager-54d5cbc44f-ttbpm" Jun 11 18:41:22.251723 ip-10-0-141-55 kubenswrapper[2578]: I0611 18:41:22.251645 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/b0ce062c-09e7-4207-a0d6-f703e6ec7df1-apiservice-cert\") pod \"opendatahub-operator-controller-manager-54d5cbc44f-ttbpm\" (UID: \"b0ce062c-09e7-4207-a0d6-f703e6ec7df1\") " pod="opendatahub/opendatahub-operator-controller-manager-54d5cbc44f-ttbpm" Jun 11 18:41:22.251895 ip-10-0-141-55 kubenswrapper[2578]: I0611 18:41:22.251873 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/b0ce062c-09e7-4207-a0d6-f703e6ec7df1-manifests\") pod \"opendatahub-operator-controller-manager-54d5cbc44f-ttbpm\" (UID: \"b0ce062c-09e7-4207-a0d6-f703e6ec7df1\") " pod="opendatahub/opendatahub-operator-controller-manager-54d5cbc44f-ttbpm" Jun 11 18:41:22.253843 ip-10-0-141-55 kubenswrapper[2578]: I0611 18:41:22.253817 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/b0ce062c-09e7-4207-a0d6-f703e6ec7df1-tmp\") pod \"opendatahub-operator-controller-manager-54d5cbc44f-ttbpm\" (UID: \"b0ce062c-09e7-4207-a0d6-f703e6ec7df1\") " pod="opendatahub/opendatahub-operator-controller-manager-54d5cbc44f-ttbpm" Jun 11 18:41:22.254060 ip-10-0-141-55 kubenswrapper[2578]: I0611 18:41:22.254044 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/b0ce062c-09e7-4207-a0d6-f703e6ec7df1-webhook-cert\") pod \"opendatahub-operator-controller-manager-54d5cbc44f-ttbpm\" (UID: \"b0ce062c-09e7-4207-a0d6-f703e6ec7df1\") " pod="opendatahub/opendatahub-operator-controller-manager-54d5cbc44f-ttbpm" Jun 11 18:41:22.254105 ip-10-0-141-55 kubenswrapper[2578]: I0611 18:41:22.254043 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/b0ce062c-09e7-4207-a0d6-f703e6ec7df1-apiservice-cert\") pod \"opendatahub-operator-controller-manager-54d5cbc44f-ttbpm\" (UID: \"b0ce062c-09e7-4207-a0d6-f703e6ec7df1\") " pod="opendatahub/opendatahub-operator-controller-manager-54d5cbc44f-ttbpm" Jun 11 18:41:22.261471 ip-10-0-141-55 kubenswrapper[2578]: I0611 18:41:22.261449 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-6rspk\" (UniqueName: \"kubernetes.io/projected/b0ce062c-09e7-4207-a0d6-f703e6ec7df1-kube-api-access-6rspk\") pod \"opendatahub-operator-controller-manager-54d5cbc44f-ttbpm\" (UID: \"b0ce062c-09e7-4207-a0d6-f703e6ec7df1\") " pod="opendatahub/opendatahub-operator-controller-manager-54d5cbc44f-ttbpm" Jun 11 18:41:22.396981 ip-10-0-141-55 kubenswrapper[2578]: I0611 18:41:22.396935 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-54d5cbc44f-ttbpm" Jun 11 18:41:22.535760 ip-10-0-141-55 kubenswrapper[2578]: I0611 18:41:22.535734 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-54d5cbc44f-ttbpm"] Jun 11 18:41:22.537641 ip-10-0-141-55 kubenswrapper[2578]: W0611 18:41:22.537610 2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb0ce062c_09e7_4207_a0d6_f703e6ec7df1.slice/crio-de4f50922634085e402d82952dae6f6a6c4005e355ed4bc2fd00ab060b69cfac WatchSource:0}: Error finding container de4f50922634085e402d82952dae6f6a6c4005e355ed4bc2fd00ab060b69cfac: Status 404 returned error can't find the container with id de4f50922634085e402d82952dae6f6a6c4005e355ed4bc2fd00ab060b69cfac Jun 11 18:41:22.626593 ip-10-0-141-55 kubenswrapper[2578]: I0611 18:41:22.626535 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-54d5cbc44f-ttbpm" event={"ID":"b0ce062c-09e7-4207-a0d6-f703e6ec7df1","Type":"ContainerStarted","Data":"de4f50922634085e402d82952dae6f6a6c4005e355ed4bc2fd00ab060b69cfac"} Jun 11 18:41:25.643335 ip-10-0-141-55 kubenswrapper[2578]: I0611 18:41:25.643300 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-54d5cbc44f-ttbpm" event={"ID":"b0ce062c-09e7-4207-a0d6-f703e6ec7df1","Type":"ContainerStarted","Data":"5b0e2ec2c85ae92414029d587ba9adf8bba9d97120822c1bc6708fd962b4cc55"} Jun 11 18:41:26.649951 ip-10-0-141-55 kubenswrapper[2578]: I0611 18:41:26.649918 2578 generic.go:356] "Generic (PLEG): container finished" podID="b0ce062c-09e7-4207-a0d6-f703e6ec7df1" containerID="5b0e2ec2c85ae92414029d587ba9adf8bba9d97120822c1bc6708fd962b4cc55" exitCode=0 Jun 11 18:41:26.650378 ip-10-0-141-55 kubenswrapper[2578]: I0611 18:41:26.650009 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-54d5cbc44f-ttbpm" event={"ID":"b0ce062c-09e7-4207-a0d6-f703e6ec7df1","Type":"ContainerDied","Data":"5b0e2ec2c85ae92414029d587ba9adf8bba9d97120822c1bc6708fd962b4cc55"} Jun 11 18:41:27.657409 ip-10-0-141-55 kubenswrapper[2578]: I0611 18:41:27.657371 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-54d5cbc44f-ttbpm" event={"ID":"b0ce062c-09e7-4207-a0d6-f703e6ec7df1","Type":"ContainerStarted","Data":"3bf8b42b03fb3be6858f5307c31557dc7e7ee6bfc7e1df2168209bd43c814734"} Jun 11 18:41:27.657898 ip-10-0-141-55 kubenswrapper[2578]: I0611 18:41:27.657462 2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/opendatahub-operator-controller-manager-54d5cbc44f-ttbpm" Jun 11 18:41:27.683319 ip-10-0-141-55 kubenswrapper[2578]: I0611 18:41:27.683270 2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/opendatahub-operator-controller-manager-54d5cbc44f-ttbpm" podStartSLOduration=1.646094462 podStartE2EDuration="5.683255736s" totalImagesPullingTime="3.042546614s" totalInitContainerRuntime="994.61466ms" isStatefulPod=false podCreationTimestamp="2026-06-11 18:41:22 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-11 18:41:27.680940705 +0000 UTC m=+293.635615333" watchObservedRunningTime="2026-06-11 18:41:27.683255736 +0000 UTC m=+293.637930343" Jun 11 18:41:34.387580 ip-10-0-141-55 kubenswrapper[2578]: I0611 18:41:34.387536 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-machine-config-operator_kube-rbac-proxy-crio-ip-10-0-141-55.ec2.internal_a7e51dec29aa10b42d4127d190b80186/kube-rbac-proxy-crio/0.log" Jun 11 18:41:34.388007 ip-10-0-141-55 kubenswrapper[2578]: I0611 18:41:34.387617 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-machine-config-operator_kube-rbac-proxy-crio-ip-10-0-141-55.ec2.internal_a7e51dec29aa10b42d4127d190b80186/kube-rbac-proxy-crio/0.log" Jun 11 18:41:34.389801 ip-10-0-141-55 kubenswrapper[2578]: I0611 18:41:34.389782 2578 kubelet.go:1648] "Image garbage collection succeeded" Jun 11 18:41:38.663277 ip-10-0-141-55 kubenswrapper[2578]: I0611 18:41:38.663249 2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/opendatahub-operator-controller-manager-54d5cbc44f-ttbpm" Jun 11 18:41:39.784096 ip-10-0-141-55 kubenswrapper[2578]: I0611 18:41:39.784064 2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-lws-operator/lws-controller-manager-657f978cc6-sk67r"] Jun 11 18:41:39.786143 ip-10-0-141-55 kubenswrapper[2578]: I0611 18:41:39.786124 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/lws-controller-manager-657f978cc6-sk67r" Jun 11 18:41:39.789382 ip-10-0-141-55 kubenswrapper[2578]: I0611 18:41:39.789362 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"lws-controller-manager-dockercfg-9rpv8\"" Jun 11 18:41:39.790600 ip-10-0-141-55 kubenswrapper[2578]: I0611 18:41:39.790580 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"metrics-server-cert\"" Jun 11 18:41:39.790719 ip-10-0-141-55 kubenswrapper[2578]: I0611 18:41:39.790581 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"lws-manager-config\"" Jun 11 18:41:39.790719 ip-10-0-141-55 kubenswrapper[2578]: I0611 18:41:39.790671 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"webhook-server-cert\"" Jun 11 18:41:39.796398 ip-10-0-141-55 kubenswrapper[2578]: I0611 18:41:39.796373 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/lws-controller-manager-657f978cc6-sk67r"] Jun 11 18:41:39.906783 ip-10-0-141-55 kubenswrapper[2578]: I0611 18:41:39.906749 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/81fabc78-06f8-4b80-8e14-53ac8f24db4a-manager-config\") pod \"lws-controller-manager-657f978cc6-sk67r\" (UID: \"81fabc78-06f8-4b80-8e14-53ac8f24db4a\") " pod="openshift-lws-operator/lws-controller-manager-657f978cc6-sk67r" Jun 11 18:41:39.906939 ip-10-0-141-55 kubenswrapper[2578]: I0611 18:41:39.906802 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/81fabc78-06f8-4b80-8e14-53ac8f24db4a-metrics-cert\") pod \"lws-controller-manager-657f978cc6-sk67r\" (UID: \"81fabc78-06f8-4b80-8e14-53ac8f24db4a\") " pod="openshift-lws-operator/lws-controller-manager-657f978cc6-sk67r" Jun 11 18:41:39.906939 ip-10-0-141-55 kubenswrapper[2578]: I0611 18:41:39.906875 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zkvmn\" (UniqueName: \"kubernetes.io/projected/81fabc78-06f8-4b80-8e14-53ac8f24db4a-kube-api-access-zkvmn\") pod \"lws-controller-manager-657f978cc6-sk67r\" (UID: \"81fabc78-06f8-4b80-8e14-53ac8f24db4a\") " pod="openshift-lws-operator/lws-controller-manager-657f978cc6-sk67r" Jun 11 18:41:39.907015 ip-10-0-141-55 kubenswrapper[2578]: I0611 18:41:39.906951 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/81fabc78-06f8-4b80-8e14-53ac8f24db4a-cert\") pod \"lws-controller-manager-657f978cc6-sk67r\" (UID: \"81fabc78-06f8-4b80-8e14-53ac8f24db4a\") " pod="openshift-lws-operator/lws-controller-manager-657f978cc6-sk67r" Jun 11 18:41:40.008075 ip-10-0-141-55 kubenswrapper[2578]: I0611 18:41:40.008036 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/81fabc78-06f8-4b80-8e14-53ac8f24db4a-manager-config\") pod \"lws-controller-manager-657f978cc6-sk67r\" (UID: \"81fabc78-06f8-4b80-8e14-53ac8f24db4a\") " pod="openshift-lws-operator/lws-controller-manager-657f978cc6-sk67r" Jun 11 18:41:40.008245 ip-10-0-141-55 kubenswrapper[2578]: I0611 18:41:40.008087 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/81fabc78-06f8-4b80-8e14-53ac8f24db4a-metrics-cert\") pod \"lws-controller-manager-657f978cc6-sk67r\" (UID: \"81fabc78-06f8-4b80-8e14-53ac8f24db4a\") " pod="openshift-lws-operator/lws-controller-manager-657f978cc6-sk67r" Jun 11 18:41:40.008245 ip-10-0-141-55 kubenswrapper[2578]: I0611 18:41:40.008195 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zkvmn\" (UniqueName: \"kubernetes.io/projected/81fabc78-06f8-4b80-8e14-53ac8f24db4a-kube-api-access-zkvmn\") pod \"lws-controller-manager-657f978cc6-sk67r\" (UID: \"81fabc78-06f8-4b80-8e14-53ac8f24db4a\") " pod="openshift-lws-operator/lws-controller-manager-657f978cc6-sk67r" Jun 11 18:41:40.008324 ip-10-0-141-55 kubenswrapper[2578]: I0611 18:41:40.008274 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/81fabc78-06f8-4b80-8e14-53ac8f24db4a-cert\") pod \"lws-controller-manager-657f978cc6-sk67r\" (UID: \"81fabc78-06f8-4b80-8e14-53ac8f24db4a\") " pod="openshift-lws-operator/lws-controller-manager-657f978cc6-sk67r" Jun 11 18:41:40.008844 ip-10-0-141-55 kubenswrapper[2578]: I0611 18:41:40.008818 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/81fabc78-06f8-4b80-8e14-53ac8f24db4a-manager-config\") pod \"lws-controller-manager-657f978cc6-sk67r\" (UID: \"81fabc78-06f8-4b80-8e14-53ac8f24db4a\") " pod="openshift-lws-operator/lws-controller-manager-657f978cc6-sk67r" Jun 11 18:41:40.010737 ip-10-0-141-55 kubenswrapper[2578]: I0611 18:41:40.010713 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/81fabc78-06f8-4b80-8e14-53ac8f24db4a-cert\") pod \"lws-controller-manager-657f978cc6-sk67r\" (UID: \"81fabc78-06f8-4b80-8e14-53ac8f24db4a\") " pod="openshift-lws-operator/lws-controller-manager-657f978cc6-sk67r" Jun 11 18:41:40.010840 ip-10-0-141-55 kubenswrapper[2578]: I0611 18:41:40.010713 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/81fabc78-06f8-4b80-8e14-53ac8f24db4a-metrics-cert\") pod \"lws-controller-manager-657f978cc6-sk67r\" (UID: \"81fabc78-06f8-4b80-8e14-53ac8f24db4a\") " pod="openshift-lws-operator/lws-controller-manager-657f978cc6-sk67r" Jun 11 18:41:40.019398 ip-10-0-141-55 kubenswrapper[2578]: I0611 18:41:40.019368 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-zkvmn\" (UniqueName: \"kubernetes.io/projected/81fabc78-06f8-4b80-8e14-53ac8f24db4a-kube-api-access-zkvmn\") pod \"lws-controller-manager-657f978cc6-sk67r\" (UID: \"81fabc78-06f8-4b80-8e14-53ac8f24db4a\") " pod="openshift-lws-operator/lws-controller-manager-657f978cc6-sk67r" Jun 11 18:41:40.095908 ip-10-0-141-55 kubenswrapper[2578]: I0611 18:41:40.095880 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/lws-controller-manager-657f978cc6-sk67r" Jun 11 18:41:40.234938 ip-10-0-141-55 kubenswrapper[2578]: I0611 18:41:40.234911 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/lws-controller-manager-657f978cc6-sk67r"] Jun 11 18:41:40.236380 ip-10-0-141-55 kubenswrapper[2578]: W0611 18:41:40.236349 2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod81fabc78_06f8_4b80_8e14_53ac8f24db4a.slice/crio-ef2de67efe5e1974112770b2d04c026c2d841f95d2dee97b8c218f79e0c2d333 WatchSource:0}: Error finding container ef2de67efe5e1974112770b2d04c026c2d841f95d2dee97b8c218f79e0c2d333: Status 404 returned error can't find the container with id ef2de67efe5e1974112770b2d04c026c2d841f95d2dee97b8c218f79e0c2d333 Jun 11 18:41:40.238480 ip-10-0-141-55 kubenswrapper[2578]: I0611 18:41:40.238464 2578 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jun 11 18:41:40.714530 ip-10-0-141-55 kubenswrapper[2578]: I0611 18:41:40.714497 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/lws-controller-manager-657f978cc6-sk67r" event={"ID":"81fabc78-06f8-4b80-8e14-53ac8f24db4a","Type":"ContainerStarted","Data":"ef2de67efe5e1974112770b2d04c026c2d841f95d2dee97b8c218f79e0c2d333"} Jun 11 18:41:41.305578 ip-10-0-141-55 kubenswrapper[2578]: I0611 18:41:41.305507 2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/kube-auth-proxy-8d878499b-k8tfk"] Jun 11 18:41:41.308629 ip-10-0-141-55 kubenswrapper[2578]: I0611 18:41:41.308544 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/kube-auth-proxy-8d878499b-k8tfk" Jun 11 18:41:41.316120 ip-10-0-141-55 kubenswrapper[2578]: I0611 18:41:41.316096 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-tls\"" Jun 11 18:41:41.316787 ip-10-0-141-55 kubenswrapper[2578]: I0611 18:41:41.316604 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-service-ca.crt\"" Jun 11 18:41:41.317415 ip-10-0-141-55 kubenswrapper[2578]: I0611 18:41:41.317389 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-creds\"" Jun 11 18:41:41.317415 ip-10-0-141-55 kubenswrapper[2578]: I0611 18:41:41.317407 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"kube-root-ca.crt\"" Jun 11 18:41:41.317579 ip-10-0-141-55 kubenswrapper[2578]: I0611 18:41:41.317445 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-dockercfg-qs28d\"" Jun 11 18:41:41.361056 ip-10-0-141-55 kubenswrapper[2578]: I0611 18:41:41.361019 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/kube-auth-proxy-8d878499b-k8tfk"] Jun 11 18:41:41.418464 ip-10-0-141-55 kubenswrapper[2578]: I0611 18:41:41.418440 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-dwk6s\" (UniqueName: \"kubernetes.io/projected/c4e1c6dc-8b90-4c4b-9894-fa0dea9de119-kube-api-access-dwk6s\") pod \"kube-auth-proxy-8d878499b-k8tfk\" (UID: \"c4e1c6dc-8b90-4c4b-9894-fa0dea9de119\") " pod="openshift-ingress/kube-auth-proxy-8d878499b-k8tfk" Jun 11 18:41:41.418571 ip-10-0-141-55 kubenswrapper[2578]: I0611 18:41:41.418496 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/c4e1c6dc-8b90-4c4b-9894-fa0dea9de119-tls-certs\") pod \"kube-auth-proxy-8d878499b-k8tfk\" (UID: \"c4e1c6dc-8b90-4c4b-9894-fa0dea9de119\") " pod="openshift-ingress/kube-auth-proxy-8d878499b-k8tfk" Jun 11 18:41:41.418644 ip-10-0-141-55 kubenswrapper[2578]: I0611 18:41:41.418614 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/c4e1c6dc-8b90-4c4b-9894-fa0dea9de119-tmp\") pod \"kube-auth-proxy-8d878499b-k8tfk\" (UID: \"c4e1c6dc-8b90-4c4b-9894-fa0dea9de119\") " pod="openshift-ingress/kube-auth-proxy-8d878499b-k8tfk" Jun 11 18:41:41.519761 ip-10-0-141-55 kubenswrapper[2578]: I0611 18:41:41.519718 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-dwk6s\" (UniqueName: \"kubernetes.io/projected/c4e1c6dc-8b90-4c4b-9894-fa0dea9de119-kube-api-access-dwk6s\") pod \"kube-auth-proxy-8d878499b-k8tfk\" (UID: \"c4e1c6dc-8b90-4c4b-9894-fa0dea9de119\") " pod="openshift-ingress/kube-auth-proxy-8d878499b-k8tfk" Jun 11 18:41:41.519954 ip-10-0-141-55 kubenswrapper[2578]: I0611 18:41:41.519804 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/c4e1c6dc-8b90-4c4b-9894-fa0dea9de119-tls-certs\") pod \"kube-auth-proxy-8d878499b-k8tfk\" (UID: \"c4e1c6dc-8b90-4c4b-9894-fa0dea9de119\") " pod="openshift-ingress/kube-auth-proxy-8d878499b-k8tfk" Jun 11 18:41:41.519954 ip-10-0-141-55 kubenswrapper[2578]: I0611 18:41:41.519845 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/c4e1c6dc-8b90-4c4b-9894-fa0dea9de119-tmp\") pod \"kube-auth-proxy-8d878499b-k8tfk\" (UID: \"c4e1c6dc-8b90-4c4b-9894-fa0dea9de119\") " pod="openshift-ingress/kube-auth-proxy-8d878499b-k8tfk" Jun 11 18:41:41.522108 ip-10-0-141-55 kubenswrapper[2578]: I0611 18:41:41.522073 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/c4e1c6dc-8b90-4c4b-9894-fa0dea9de119-tmp\") pod \"kube-auth-proxy-8d878499b-k8tfk\" (UID: \"c4e1c6dc-8b90-4c4b-9894-fa0dea9de119\") " pod="openshift-ingress/kube-auth-proxy-8d878499b-k8tfk" Jun 11 18:41:41.522221 ip-10-0-141-55 kubenswrapper[2578]: I0611 18:41:41.522187 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/c4e1c6dc-8b90-4c4b-9894-fa0dea9de119-tls-certs\") pod \"kube-auth-proxy-8d878499b-k8tfk\" (UID: \"c4e1c6dc-8b90-4c4b-9894-fa0dea9de119\") " pod="openshift-ingress/kube-auth-proxy-8d878499b-k8tfk" Jun 11 18:41:41.545212 ip-10-0-141-55 kubenswrapper[2578]: I0611 18:41:41.545173 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-dwk6s\" (UniqueName: \"kubernetes.io/projected/c4e1c6dc-8b90-4c4b-9894-fa0dea9de119-kube-api-access-dwk6s\") pod \"kube-auth-proxy-8d878499b-k8tfk\" (UID: \"c4e1c6dc-8b90-4c4b-9894-fa0dea9de119\") " pod="openshift-ingress/kube-auth-proxy-8d878499b-k8tfk" Jun 11 18:41:41.620951 ip-10-0-141-55 kubenswrapper[2578]: I0611 18:41:41.620923 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/kube-auth-proxy-8d878499b-k8tfk" Jun 11 18:41:41.721090 ip-10-0-141-55 kubenswrapper[2578]: I0611 18:41:41.721039 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/lws-controller-manager-657f978cc6-sk67r" event={"ID":"81fabc78-06f8-4b80-8e14-53ac8f24db4a","Type":"ContainerStarted","Data":"5f66582b81e4e4357b99204cb552691f3a3f753e6a0e1d7ae24b0f456a8de580"} Jun 11 18:41:41.721532 ip-10-0-141-55 kubenswrapper[2578]: I0611 18:41:41.721257 2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-lws-operator/lws-controller-manager-657f978cc6-sk67r" Jun 11 18:41:41.748244 ip-10-0-141-55 kubenswrapper[2578]: I0611 18:41:41.748196 2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-lws-operator/lws-controller-manager-657f978cc6-sk67r" podStartSLOduration=1.623408309 podStartE2EDuration="2.748176693s" totalImagesPullingTime="1.124768384s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-11 18:41:39 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-11 18:41:41.748072455 +0000 UTC m=+307.702747095" watchObservedRunningTime="2026-06-11 18:41:41.748176693 +0000 UTC m=+307.702851301" Jun 11 18:41:41.795246 ip-10-0-141-55 kubenswrapper[2578]: I0611 18:41:41.795209 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/kube-auth-proxy-8d878499b-k8tfk"] Jun 11 18:41:41.799063 ip-10-0-141-55 kubenswrapper[2578]: W0611 18:41:41.799027 2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc4e1c6dc_8b90_4c4b_9894_fa0dea9de119.slice/crio-bc005e504cf807d37ac8cbda3f8ee2b10e512a263a188087eb462686f2856249 WatchSource:0}: Error finding container bc005e504cf807d37ac8cbda3f8ee2b10e512a263a188087eb462686f2856249: Status 404 returned error can't find the container with id bc005e504cf807d37ac8cbda3f8ee2b10e512a263a188087eb462686f2856249 Jun 11 18:41:42.729093 ip-10-0-141-55 kubenswrapper[2578]: I0611 18:41:42.729012 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/kube-auth-proxy-8d878499b-k8tfk" event={"ID":"c4e1c6dc-8b90-4c4b-9894-fa0dea9de119","Type":"ContainerStarted","Data":"bc005e504cf807d37ac8cbda3f8ee2b10e512a263a188087eb462686f2856249"} Jun 11 18:41:43.836366 ip-10-0-141-55 kubenswrapper[2578]: I0611 18:41:43.836335 2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-marketplace/4258531154569488b4b06856545cf53ed48b82e88ddd64b4ce22efab06h7cx8"] Jun 11 18:41:43.842247 ip-10-0-141-55 kubenswrapper[2578]: I0611 18:41:43.842215 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/4258531154569488b4b06856545cf53ed48b82e88ddd64b4ce22efab06h7cx8" Jun 11 18:41:43.845357 ip-10-0-141-55 kubenswrapper[2578]: I0611 18:41:43.845331 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"openshift-service-ca.crt\"" Jun 11 18:41:43.845481 ip-10-0-141-55 kubenswrapper[2578]: I0611 18:41:43.845336 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-marketplace\"/\"default-dockercfg-nkxdk\"" Jun 11 18:41:43.847722 ip-10-0-141-55 kubenswrapper[2578]: I0611 18:41:43.845841 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"kube-root-ca.crt\"" Jun 11 18:41:43.852041 ip-10-0-141-55 kubenswrapper[2578]: I0611 18:41:43.852015 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/4258531154569488b4b06856545cf53ed48b82e88ddd64b4ce22efab06h7cx8"] Jun 11 18:41:43.940065 ip-10-0-141-55 kubenswrapper[2578]: I0611 18:41:43.940015 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6bvcb\" (UniqueName: \"kubernetes.io/projected/358bf262-c134-4c0b-92e8-9135ad0a4366-kube-api-access-6bvcb\") pod \"4258531154569488b4b06856545cf53ed48b82e88ddd64b4ce22efab06h7cx8\" (UID: \"358bf262-c134-4c0b-92e8-9135ad0a4366\") " pod="openshift-marketplace/4258531154569488b4b06856545cf53ed48b82e88ddd64b4ce22efab06h7cx8" Jun 11 18:41:43.940254 ip-10-0-141-55 kubenswrapper[2578]: I0611 18:41:43.940076 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/358bf262-c134-4c0b-92e8-9135ad0a4366-bundle\") pod \"4258531154569488b4b06856545cf53ed48b82e88ddd64b4ce22efab06h7cx8\" (UID: \"358bf262-c134-4c0b-92e8-9135ad0a4366\") " pod="openshift-marketplace/4258531154569488b4b06856545cf53ed48b82e88ddd64b4ce22efab06h7cx8" Jun 11 18:41:43.940254 ip-10-0-141-55 kubenswrapper[2578]: I0611 18:41:43.940111 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/358bf262-c134-4c0b-92e8-9135ad0a4366-util\") pod \"4258531154569488b4b06856545cf53ed48b82e88ddd64b4ce22efab06h7cx8\" (UID: \"358bf262-c134-4c0b-92e8-9135ad0a4366\") " pod="openshift-marketplace/4258531154569488b4b06856545cf53ed48b82e88ddd64b4ce22efab06h7cx8" Jun 11 18:41:44.041491 ip-10-0-141-55 kubenswrapper[2578]: I0611 18:41:44.041452 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6bvcb\" (UniqueName: \"kubernetes.io/projected/358bf262-c134-4c0b-92e8-9135ad0a4366-kube-api-access-6bvcb\") pod \"4258531154569488b4b06856545cf53ed48b82e88ddd64b4ce22efab06h7cx8\" (UID: \"358bf262-c134-4c0b-92e8-9135ad0a4366\") " pod="openshift-marketplace/4258531154569488b4b06856545cf53ed48b82e88ddd64b4ce22efab06h7cx8" Jun 11 18:41:44.041695 ip-10-0-141-55 kubenswrapper[2578]: I0611 18:41:44.041505 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/358bf262-c134-4c0b-92e8-9135ad0a4366-bundle\") pod \"4258531154569488b4b06856545cf53ed48b82e88ddd64b4ce22efab06h7cx8\" (UID: \"358bf262-c134-4c0b-92e8-9135ad0a4366\") " pod="openshift-marketplace/4258531154569488b4b06856545cf53ed48b82e88ddd64b4ce22efab06h7cx8" Jun 11 18:41:44.041695 ip-10-0-141-55 kubenswrapper[2578]: I0611 18:41:44.041541 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/358bf262-c134-4c0b-92e8-9135ad0a4366-util\") pod \"4258531154569488b4b06856545cf53ed48b82e88ddd64b4ce22efab06h7cx8\" (UID: \"358bf262-c134-4c0b-92e8-9135ad0a4366\") " pod="openshift-marketplace/4258531154569488b4b06856545cf53ed48b82e88ddd64b4ce22efab06h7cx8" Jun 11 18:41:44.042009 ip-10-0-141-55 kubenswrapper[2578]: I0611 18:41:44.041972 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/358bf262-c134-4c0b-92e8-9135ad0a4366-bundle\") pod \"4258531154569488b4b06856545cf53ed48b82e88ddd64b4ce22efab06h7cx8\" (UID: \"358bf262-c134-4c0b-92e8-9135ad0a4366\") " pod="openshift-marketplace/4258531154569488b4b06856545cf53ed48b82e88ddd64b4ce22efab06h7cx8" Jun 11 18:41:44.042009 ip-10-0-141-55 kubenswrapper[2578]: I0611 18:41:44.041987 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/358bf262-c134-4c0b-92e8-9135ad0a4366-util\") pod \"4258531154569488b4b06856545cf53ed48b82e88ddd64b4ce22efab06h7cx8\" (UID: \"358bf262-c134-4c0b-92e8-9135ad0a4366\") " pod="openshift-marketplace/4258531154569488b4b06856545cf53ed48b82e88ddd64b4ce22efab06h7cx8" Jun 11 18:41:44.050903 ip-10-0-141-55 kubenswrapper[2578]: I0611 18:41:44.050872 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-6bvcb\" (UniqueName: \"kubernetes.io/projected/358bf262-c134-4c0b-92e8-9135ad0a4366-kube-api-access-6bvcb\") pod \"4258531154569488b4b06856545cf53ed48b82e88ddd64b4ce22efab06h7cx8\" (UID: \"358bf262-c134-4c0b-92e8-9135ad0a4366\") " pod="openshift-marketplace/4258531154569488b4b06856545cf53ed48b82e88ddd64b4ce22efab06h7cx8" Jun 11 18:41:44.163399 ip-10-0-141-55 kubenswrapper[2578]: I0611 18:41:44.163358 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/4258531154569488b4b06856545cf53ed48b82e88ddd64b4ce22efab06h7cx8" Jun 11 18:41:45.120502 ip-10-0-141-55 kubenswrapper[2578]: I0611 18:41:45.120470 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/4258531154569488b4b06856545cf53ed48b82e88ddd64b4ce22efab06h7cx8"] Jun 11 18:41:45.124637 ip-10-0-141-55 kubenswrapper[2578]: W0611 18:41:45.124607 2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod358bf262_c134_4c0b_92e8_9135ad0a4366.slice/crio-b491fca4e1bf483d20f6cd1f6591f53b984d05ba325f04b8c94e4346d0d635ce WatchSource:0}: Error finding container b491fca4e1bf483d20f6cd1f6591f53b984d05ba325f04b8c94e4346d0d635ce: Status 404 returned error can't find the container with id b491fca4e1bf483d20f6cd1f6591f53b984d05ba325f04b8c94e4346d0d635ce Jun 11 18:41:45.747655 ip-10-0-141-55 kubenswrapper[2578]: I0611 18:41:45.747604 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/kube-auth-proxy-8d878499b-k8tfk" event={"ID":"c4e1c6dc-8b90-4c4b-9894-fa0dea9de119","Type":"ContainerStarted","Data":"d7d4778d43b8b586e63b405ad8aa2f577cf435026c87c3125bd99aac68130b91"} Jun 11 18:41:45.749255 ip-10-0-141-55 kubenswrapper[2578]: I0611 18:41:45.749230 2578 generic.go:356] "Generic (PLEG): container finished" podID="358bf262-c134-4c0b-92e8-9135ad0a4366" containerID="63d32589f2c7df876a2591f336ae2246d6b2bdcb0e7efa61ee1b0c4335aa3f8c" exitCode=0 Jun 11 18:41:45.749400 ip-10-0-141-55 kubenswrapper[2578]: I0611 18:41:45.749286 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/4258531154569488b4b06856545cf53ed48b82e88ddd64b4ce22efab06h7cx8" event={"ID":"358bf262-c134-4c0b-92e8-9135ad0a4366","Type":"ContainerDied","Data":"63d32589f2c7df876a2591f336ae2246d6b2bdcb0e7efa61ee1b0c4335aa3f8c"} Jun 11 18:41:45.749400 ip-10-0-141-55 kubenswrapper[2578]: I0611 18:41:45.749331 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/4258531154569488b4b06856545cf53ed48b82e88ddd64b4ce22efab06h7cx8" event={"ID":"358bf262-c134-4c0b-92e8-9135ad0a4366","Type":"ContainerStarted","Data":"b491fca4e1bf483d20f6cd1f6591f53b984d05ba325f04b8c94e4346d0d635ce"} Jun 11 18:41:45.765708 ip-10-0-141-55 kubenswrapper[2578]: I0611 18:41:45.765664 2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/kube-auth-proxy-8d878499b-k8tfk" podStartSLOduration=1.5554960530000002 podStartE2EDuration="4.765645688s" totalImagesPullingTime="3.210149635s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-11 18:41:41 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-11 18:41:45.764356656 +0000 UTC m=+311.719031283" watchObservedRunningTime="2026-06-11 18:41:45.765645688 +0000 UTC m=+311.720320293" Jun 11 18:41:47.760094 ip-10-0-141-55 kubenswrapper[2578]: I0611 18:41:47.760058 2578 generic.go:356] "Generic (PLEG): container finished" podID="358bf262-c134-4c0b-92e8-9135ad0a4366" containerID="f6bfd7263d55902525b978230511f90b94ed9cf28e4813df8c9c3c71017ff1f7" exitCode=0 Jun 11 18:41:47.760503 ip-10-0-141-55 kubenswrapper[2578]: I0611 18:41:47.760126 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/4258531154569488b4b06856545cf53ed48b82e88ddd64b4ce22efab06h7cx8" event={"ID":"358bf262-c134-4c0b-92e8-9135ad0a4366","Type":"ContainerDied","Data":"f6bfd7263d55902525b978230511f90b94ed9cf28e4813df8c9c3c71017ff1f7"} Jun 11 18:41:48.766842 ip-10-0-141-55 kubenswrapper[2578]: I0611 18:41:48.766810 2578 generic.go:356] "Generic (PLEG): container finished" podID="358bf262-c134-4c0b-92e8-9135ad0a4366" containerID="deec894145627add5fffa91c291b9cea69ed1ba79dae031794659233fa99026a" exitCode=0 Jun 11 18:41:48.767260 ip-10-0-141-55 kubenswrapper[2578]: I0611 18:41:48.766870 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/4258531154569488b4b06856545cf53ed48b82e88ddd64b4ce22efab06h7cx8" event={"ID":"358bf262-c134-4c0b-92e8-9135ad0a4366","Type":"ContainerDied","Data":"deec894145627add5fffa91c291b9cea69ed1ba79dae031794659233fa99026a"} Jun 11 18:41:49.890885 ip-10-0-141-55 kubenswrapper[2578]: I0611 18:41:49.890860 2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/4258531154569488b4b06856545cf53ed48b82e88ddd64b4ce22efab06h7cx8" Jun 11 18:41:49.996422 ip-10-0-141-55 kubenswrapper[2578]: I0611 18:41:49.996389 2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/358bf262-c134-4c0b-92e8-9135ad0a4366-bundle\") pod \"358bf262-c134-4c0b-92e8-9135ad0a4366\" (UID: \"358bf262-c134-4c0b-92e8-9135ad0a4366\") " Jun 11 18:41:49.996422 ip-10-0-141-55 kubenswrapper[2578]: I0611 18:41:49.996429 2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/358bf262-c134-4c0b-92e8-9135ad0a4366-util\") pod \"358bf262-c134-4c0b-92e8-9135ad0a4366\" (UID: \"358bf262-c134-4c0b-92e8-9135ad0a4366\") " Jun 11 18:41:49.996703 ip-10-0-141-55 kubenswrapper[2578]: I0611 18:41:49.996453 2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-6bvcb\" (UniqueName: \"kubernetes.io/projected/358bf262-c134-4c0b-92e8-9135ad0a4366-kube-api-access-6bvcb\") pod \"358bf262-c134-4c0b-92e8-9135ad0a4366\" (UID: \"358bf262-c134-4c0b-92e8-9135ad0a4366\") " Jun 11 18:41:49.997319 ip-10-0-141-55 kubenswrapper[2578]: I0611 18:41:49.997288 2578 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/358bf262-c134-4c0b-92e8-9135ad0a4366-bundle" (OuterVolumeSpecName: "bundle") pod "358bf262-c134-4c0b-92e8-9135ad0a4366" (UID: "358bf262-c134-4c0b-92e8-9135ad0a4366"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 11 18:41:49.998591 ip-10-0-141-55 kubenswrapper[2578]: I0611 18:41:49.998550 2578 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/358bf262-c134-4c0b-92e8-9135ad0a4366-kube-api-access-6bvcb" (OuterVolumeSpecName: "kube-api-access-6bvcb") pod "358bf262-c134-4c0b-92e8-9135ad0a4366" (UID: "358bf262-c134-4c0b-92e8-9135ad0a4366"). InnerVolumeSpecName "kube-api-access-6bvcb". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 11 18:41:50.001905 ip-10-0-141-55 kubenswrapper[2578]: I0611 18:41:50.001883 2578 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/358bf262-c134-4c0b-92e8-9135ad0a4366-util" (OuterVolumeSpecName: "util") pod "358bf262-c134-4c0b-92e8-9135ad0a4366" (UID: "358bf262-c134-4c0b-92e8-9135ad0a4366"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 11 18:41:50.097039 ip-10-0-141-55 kubenswrapper[2578]: I0611 18:41:50.097018 2578 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/358bf262-c134-4c0b-92e8-9135ad0a4366-bundle\") on node \"ip-10-0-141-55.ec2.internal\" DevicePath \"\"" Jun 11 18:41:50.097039 ip-10-0-141-55 kubenswrapper[2578]: I0611 18:41:50.097039 2578 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/358bf262-c134-4c0b-92e8-9135ad0a4366-util\") on node \"ip-10-0-141-55.ec2.internal\" DevicePath \"\"" Jun 11 18:41:50.097189 ip-10-0-141-55 kubenswrapper[2578]: I0611 18:41:50.097048 2578 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-6bvcb\" (UniqueName: \"kubernetes.io/projected/358bf262-c134-4c0b-92e8-9135ad0a4366-kube-api-access-6bvcb\") on node \"ip-10-0-141-55.ec2.internal\" DevicePath \"\"" Jun 11 18:41:50.777761 ip-10-0-141-55 kubenswrapper[2578]: I0611 18:41:50.777671 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/4258531154569488b4b06856545cf53ed48b82e88ddd64b4ce22efab06h7cx8" event={"ID":"358bf262-c134-4c0b-92e8-9135ad0a4366","Type":"ContainerDied","Data":"b491fca4e1bf483d20f6cd1f6591f53b984d05ba325f04b8c94e4346d0d635ce"} Jun 11 18:41:50.777761 ip-10-0-141-55 kubenswrapper[2578]: I0611 18:41:50.777716 2578 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="b491fca4e1bf483d20f6cd1f6591f53b984d05ba325f04b8c94e4346d0d635ce" Jun 11 18:41:50.777761 ip-10-0-141-55 kubenswrapper[2578]: I0611 18:41:50.777721 2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/4258531154569488b4b06856545cf53ed48b82e88ddd64b4ce22efab06h7cx8" Jun 11 18:41:52.731207 ip-10-0-141-55 kubenswrapper[2578]: I0611 18:41:52.731178 2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-lws-operator/lws-controller-manager-657f978cc6-sk67r" Jun 11 18:41:58.753379 ip-10-0-141-55 kubenswrapper[2578]: I0611 18:41:58.753338 2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762anv9mq"] Jun 11 18:41:58.753777 ip-10-0-141-55 kubenswrapper[2578]: I0611 18:41:58.753693 2578 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="358bf262-c134-4c0b-92e8-9135ad0a4366" containerName="util" Jun 11 18:41:58.753777 ip-10-0-141-55 kubenswrapper[2578]: I0611 18:41:58.753707 2578 state_mem.go:107] "Deleted CPUSet assignment" podUID="358bf262-c134-4c0b-92e8-9135ad0a4366" containerName="util" Jun 11 18:41:58.753777 ip-10-0-141-55 kubenswrapper[2578]: I0611 18:41:58.753717 2578 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="358bf262-c134-4c0b-92e8-9135ad0a4366" containerName="pull" Jun 11 18:41:58.753777 ip-10-0-141-55 kubenswrapper[2578]: I0611 18:41:58.753723 2578 state_mem.go:107] "Deleted CPUSet assignment" podUID="358bf262-c134-4c0b-92e8-9135ad0a4366" containerName="pull" Jun 11 18:41:58.753777 ip-10-0-141-55 kubenswrapper[2578]: I0611 18:41:58.753732 2578 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="358bf262-c134-4c0b-92e8-9135ad0a4366" containerName="extract" Jun 11 18:41:58.753777 ip-10-0-141-55 kubenswrapper[2578]: I0611 18:41:58.753738 2578 state_mem.go:107] "Deleted CPUSet assignment" podUID="358bf262-c134-4c0b-92e8-9135ad0a4366" containerName="extract" Jun 11 18:41:58.753959 ip-10-0-141-55 kubenswrapper[2578]: I0611 18:41:58.753787 2578 memory_manager.go:368] "RemoveStaleState removing state" podUID="358bf262-c134-4c0b-92e8-9135ad0a4366" containerName="extract" Jun 11 18:41:58.760259 ip-10-0-141-55 kubenswrapper[2578]: I0611 18:41:58.760239 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762anv9mq" Jun 11 18:41:58.764583 ip-10-0-141-55 kubenswrapper[2578]: I0611 18:41:58.764549 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-marketplace\"/\"default-dockercfg-nkxdk\"" Jun 11 18:41:58.765664 ip-10-0-141-55 kubenswrapper[2578]: I0611 18:41:58.765643 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"kube-root-ca.crt\"" Jun 11 18:41:58.765757 ip-10-0-141-55 kubenswrapper[2578]: I0611 18:41:58.765663 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"openshift-service-ca.crt\"" Jun 11 18:41:58.773835 ip-10-0-141-55 kubenswrapper[2578]: I0611 18:41:58.773811 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762anv9mq"] Jun 11 18:41:58.864786 ip-10-0-141-55 kubenswrapper[2578]: I0611 18:41:58.864748 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/f1962285-2c82-4d22-ac80-a7337fa5d5d7-util\") pod \"c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762anv9mq\" (UID: \"f1962285-2c82-4d22-ac80-a7337fa5d5d7\") " pod="openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762anv9mq" Jun 11 18:41:58.864786 ip-10-0-141-55 kubenswrapper[2578]: I0611 18:41:58.864784 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9lstj\" (UniqueName: \"kubernetes.io/projected/f1962285-2c82-4d22-ac80-a7337fa5d5d7-kube-api-access-9lstj\") pod \"c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762anv9mq\" (UID: \"f1962285-2c82-4d22-ac80-a7337fa5d5d7\") " pod="openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762anv9mq" Jun 11 18:41:58.865016 ip-10-0-141-55 kubenswrapper[2578]: I0611 18:41:58.864813 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/f1962285-2c82-4d22-ac80-a7337fa5d5d7-bundle\") pod \"c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762anv9mq\" (UID: \"f1962285-2c82-4d22-ac80-a7337fa5d5d7\") " pod="openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762anv9mq" Jun 11 18:41:58.966138 ip-10-0-141-55 kubenswrapper[2578]: I0611 18:41:58.966097 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/f1962285-2c82-4d22-ac80-a7337fa5d5d7-util\") pod \"c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762anv9mq\" (UID: \"f1962285-2c82-4d22-ac80-a7337fa5d5d7\") " pod="openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762anv9mq" Jun 11 18:41:58.966138 ip-10-0-141-55 kubenswrapper[2578]: I0611 18:41:58.966140 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9lstj\" (UniqueName: \"kubernetes.io/projected/f1962285-2c82-4d22-ac80-a7337fa5d5d7-kube-api-access-9lstj\") pod \"c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762anv9mq\" (UID: \"f1962285-2c82-4d22-ac80-a7337fa5d5d7\") " pod="openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762anv9mq" Jun 11 18:41:58.966404 ip-10-0-141-55 kubenswrapper[2578]: I0611 18:41:58.966167 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/f1962285-2c82-4d22-ac80-a7337fa5d5d7-bundle\") pod \"c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762anv9mq\" (UID: \"f1962285-2c82-4d22-ac80-a7337fa5d5d7\") " pod="openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762anv9mq" Jun 11 18:41:58.966507 ip-10-0-141-55 kubenswrapper[2578]: I0611 18:41:58.966487 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/f1962285-2c82-4d22-ac80-a7337fa5d5d7-util\") pod \"c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762anv9mq\" (UID: \"f1962285-2c82-4d22-ac80-a7337fa5d5d7\") " pod="openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762anv9mq" Jun 11 18:41:58.966569 ip-10-0-141-55 kubenswrapper[2578]: I0611 18:41:58.966507 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/f1962285-2c82-4d22-ac80-a7337fa5d5d7-bundle\") pod \"c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762anv9mq\" (UID: \"f1962285-2c82-4d22-ac80-a7337fa5d5d7\") " pod="openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762anv9mq" Jun 11 18:41:58.976789 ip-10-0-141-55 kubenswrapper[2578]: I0611 18:41:58.976766 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-9lstj\" (UniqueName: \"kubernetes.io/projected/f1962285-2c82-4d22-ac80-a7337fa5d5d7-kube-api-access-9lstj\") pod \"c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762anv9mq\" (UID: \"f1962285-2c82-4d22-ac80-a7337fa5d5d7\") " pod="openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762anv9mq" Jun 11 18:41:59.069511 ip-10-0-141-55 kubenswrapper[2578]: I0611 18:41:59.069435 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762anv9mq" Jun 11 18:41:59.209726 ip-10-0-141-55 kubenswrapper[2578]: I0611 18:41:59.209702 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762anv9mq"] Jun 11 18:41:59.211036 ip-10-0-141-55 kubenswrapper[2578]: W0611 18:41:59.211001 2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf1962285_2c82_4d22_ac80_a7337fa5d5d7.slice/crio-af3f73cc5714d1b51fef9dfe1c41b34423723d2f99ef9cb10371ab3a6d5028e8 WatchSource:0}: Error finding container af3f73cc5714d1b51fef9dfe1c41b34423723d2f99ef9cb10371ab3a6d5028e8: Status 404 returned error can't find the container with id af3f73cc5714d1b51fef9dfe1c41b34423723d2f99ef9cb10371ab3a6d5028e8 Jun 11 18:41:59.820658 ip-10-0-141-55 kubenswrapper[2578]: I0611 18:41:59.820614 2578 generic.go:356] "Generic (PLEG): container finished" podID="f1962285-2c82-4d22-ac80-a7337fa5d5d7" containerID="144ec6c5f72f3a2d9b9e4a9e29072a31c3ae764a9be8ccad30aca3670f6151ab" exitCode=0 Jun 11 18:41:59.821047 ip-10-0-141-55 kubenswrapper[2578]: I0611 18:41:59.820721 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762anv9mq" event={"ID":"f1962285-2c82-4d22-ac80-a7337fa5d5d7","Type":"ContainerDied","Data":"144ec6c5f72f3a2d9b9e4a9e29072a31c3ae764a9be8ccad30aca3670f6151ab"} Jun 11 18:41:59.821047 ip-10-0-141-55 kubenswrapper[2578]: I0611 18:41:59.820790 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762anv9mq" event={"ID":"f1962285-2c82-4d22-ac80-a7337fa5d5d7","Type":"ContainerStarted","Data":"af3f73cc5714d1b51fef9dfe1c41b34423723d2f99ef9cb10371ab3a6d5028e8"} Jun 11 18:42:05.850321 ip-10-0-141-55 kubenswrapper[2578]: I0611 18:42:05.850287 2578 generic.go:356] "Generic (PLEG): container finished" podID="f1962285-2c82-4d22-ac80-a7337fa5d5d7" containerID="7a5f14b5c57128badd3eed33829cd8c903d53ba83d051fed541303636e2393c3" exitCode=0 Jun 11 18:42:05.850674 ip-10-0-141-55 kubenswrapper[2578]: I0611 18:42:05.850368 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762anv9mq" event={"ID":"f1962285-2c82-4d22-ac80-a7337fa5d5d7","Type":"ContainerDied","Data":"7a5f14b5c57128badd3eed33829cd8c903d53ba83d051fed541303636e2393c3"} Jun 11 18:42:06.856626 ip-10-0-141-55 kubenswrapper[2578]: I0611 18:42:06.856592 2578 generic.go:356] "Generic (PLEG): container finished" podID="f1962285-2c82-4d22-ac80-a7337fa5d5d7" containerID="6c8d3751a806976e2fdd4e6c8957b616c5eb5efd7f68c88b7018e1f30e51b497" exitCode=0 Jun 11 18:42:06.856999 ip-10-0-141-55 kubenswrapper[2578]: I0611 18:42:06.856683 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762anv9mq" event={"ID":"f1962285-2c82-4d22-ac80-a7337fa5d5d7","Type":"ContainerDied","Data":"6c8d3751a806976e2fdd4e6c8957b616c5eb5efd7f68c88b7018e1f30e51b497"} Jun 11 18:42:07.984051 ip-10-0-141-55 kubenswrapper[2578]: I0611 18:42:07.984029 2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762anv9mq" Jun 11 18:42:08.046663 ip-10-0-141-55 kubenswrapper[2578]: I0611 18:42:08.046631 2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-9lstj\" (UniqueName: \"kubernetes.io/projected/f1962285-2c82-4d22-ac80-a7337fa5d5d7-kube-api-access-9lstj\") pod \"f1962285-2c82-4d22-ac80-a7337fa5d5d7\" (UID: \"f1962285-2c82-4d22-ac80-a7337fa5d5d7\") " Jun 11 18:42:08.046814 ip-10-0-141-55 kubenswrapper[2578]: I0611 18:42:08.046690 2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/f1962285-2c82-4d22-ac80-a7337fa5d5d7-bundle\") pod \"f1962285-2c82-4d22-ac80-a7337fa5d5d7\" (UID: \"f1962285-2c82-4d22-ac80-a7337fa5d5d7\") " Jun 11 18:42:08.046814 ip-10-0-141-55 kubenswrapper[2578]: I0611 18:42:08.046728 2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/f1962285-2c82-4d22-ac80-a7337fa5d5d7-util\") pod \"f1962285-2c82-4d22-ac80-a7337fa5d5d7\" (UID: \"f1962285-2c82-4d22-ac80-a7337fa5d5d7\") " Jun 11 18:42:08.047950 ip-10-0-141-55 kubenswrapper[2578]: I0611 18:42:08.047917 2578 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/f1962285-2c82-4d22-ac80-a7337fa5d5d7-bundle" (OuterVolumeSpecName: "bundle") pod "f1962285-2c82-4d22-ac80-a7337fa5d5d7" (UID: "f1962285-2c82-4d22-ac80-a7337fa5d5d7"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 11 18:42:08.048745 ip-10-0-141-55 kubenswrapper[2578]: I0611 18:42:08.048721 2578 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/f1962285-2c82-4d22-ac80-a7337fa5d5d7-kube-api-access-9lstj" (OuterVolumeSpecName: "kube-api-access-9lstj") pod "f1962285-2c82-4d22-ac80-a7337fa5d5d7" (UID: "f1962285-2c82-4d22-ac80-a7337fa5d5d7"). InnerVolumeSpecName "kube-api-access-9lstj". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 11 18:42:08.052075 ip-10-0-141-55 kubenswrapper[2578]: I0611 18:42:08.052048 2578 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/f1962285-2c82-4d22-ac80-a7337fa5d5d7-util" (OuterVolumeSpecName: "util") pod "f1962285-2c82-4d22-ac80-a7337fa5d5d7" (UID: "f1962285-2c82-4d22-ac80-a7337fa5d5d7"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 11 18:42:08.147282 ip-10-0-141-55 kubenswrapper[2578]: I0611 18:42:08.147200 2578 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-9lstj\" (UniqueName: \"kubernetes.io/projected/f1962285-2c82-4d22-ac80-a7337fa5d5d7-kube-api-access-9lstj\") on node \"ip-10-0-141-55.ec2.internal\" DevicePath \"\"" Jun 11 18:42:08.147282 ip-10-0-141-55 kubenswrapper[2578]: I0611 18:42:08.147230 2578 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/f1962285-2c82-4d22-ac80-a7337fa5d5d7-bundle\") on node \"ip-10-0-141-55.ec2.internal\" DevicePath \"\"" Jun 11 18:42:08.147282 ip-10-0-141-55 kubenswrapper[2578]: I0611 18:42:08.147238 2578 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/f1962285-2c82-4d22-ac80-a7337fa5d5d7-util\") on node \"ip-10-0-141-55.ec2.internal\" DevicePath \"\"" Jun 11 18:42:08.867381 ip-10-0-141-55 kubenswrapper[2578]: I0611 18:42:08.867354 2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762anv9mq" Jun 11 18:42:08.867601 ip-10-0-141-55 kubenswrapper[2578]: I0611 18:42:08.867354 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762anv9mq" event={"ID":"f1962285-2c82-4d22-ac80-a7337fa5d5d7","Type":"ContainerDied","Data":"af3f73cc5714d1b51fef9dfe1c41b34423723d2f99ef9cb10371ab3a6d5028e8"} Jun 11 18:42:08.867601 ip-10-0-141-55 kubenswrapper[2578]: I0611 18:42:08.867475 2578 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="af3f73cc5714d1b51fef9dfe1c41b34423723d2f99ef9cb10371ab3a6d5028e8" Jun 11 18:42:19.373098 ip-10-0-141-55 kubenswrapper[2578]: I0611 18:42:19.373022 2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/dashboard-redirect-78fd5d586f-cg4dx"] Jun 11 18:42:19.373512 ip-10-0-141-55 kubenswrapper[2578]: I0611 18:42:19.373349 2578 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="f1962285-2c82-4d22-ac80-a7337fa5d5d7" containerName="util" Jun 11 18:42:19.373512 ip-10-0-141-55 kubenswrapper[2578]: I0611 18:42:19.373360 2578 state_mem.go:107] "Deleted CPUSet assignment" podUID="f1962285-2c82-4d22-ac80-a7337fa5d5d7" containerName="util" Jun 11 18:42:19.373512 ip-10-0-141-55 kubenswrapper[2578]: I0611 18:42:19.373375 2578 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="f1962285-2c82-4d22-ac80-a7337fa5d5d7" containerName="pull" Jun 11 18:42:19.373512 ip-10-0-141-55 kubenswrapper[2578]: I0611 18:42:19.373381 2578 state_mem.go:107] "Deleted CPUSet assignment" podUID="f1962285-2c82-4d22-ac80-a7337fa5d5d7" containerName="pull" Jun 11 18:42:19.373512 ip-10-0-141-55 kubenswrapper[2578]: I0611 18:42:19.373390 2578 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="f1962285-2c82-4d22-ac80-a7337fa5d5d7" containerName="extract" Jun 11 18:42:19.373512 ip-10-0-141-55 kubenswrapper[2578]: I0611 18:42:19.373396 2578 state_mem.go:107] "Deleted CPUSet assignment" podUID="f1962285-2c82-4d22-ac80-a7337fa5d5d7" containerName="extract" Jun 11 18:42:19.373512 ip-10-0-141-55 kubenswrapper[2578]: I0611 18:42:19.373454 2578 memory_manager.go:368] "RemoveStaleState removing state" podUID="f1962285-2c82-4d22-ac80-a7337fa5d5d7" containerName="extract" Jun 11 18:42:19.376272 ip-10-0-141-55 kubenswrapper[2578]: I0611 18:42:19.376254 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/dashboard-redirect-78fd5d586f-cg4dx" Jun 11 18:42:19.379320 ip-10-0-141-55 kubenswrapper[2578]: I0611 18:42:19.379297 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"default-dockercfg-8n27r\"" Jun 11 18:42:19.379441 ip-10-0-141-55 kubenswrapper[2578]: I0611 18:42:19.379394 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"dashboard-redirect-config\"" Jun 11 18:42:19.387954 ip-10-0-141-55 kubenswrapper[2578]: I0611 18:42:19.387927 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/dashboard-redirect-78fd5d586f-cg4dx"] Jun 11 18:42:19.446654 ip-10-0-141-55 kubenswrapper[2578]: I0611 18:42:19.446620 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"redirect-config\" (UniqueName: \"kubernetes.io/configmap/9be949e1-93c3-496c-8b74-35e870ec6390-redirect-config\") pod \"dashboard-redirect-78fd5d586f-cg4dx\" (UID: \"9be949e1-93c3-496c-8b74-35e870ec6390\") " pod="opendatahub/dashboard-redirect-78fd5d586f-cg4dx" Jun 11 18:42:19.446816 ip-10-0-141-55 kubenswrapper[2578]: I0611 18:42:19.446661 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hnw4f\" (UniqueName: \"kubernetes.io/projected/9be949e1-93c3-496c-8b74-35e870ec6390-kube-api-access-hnw4f\") pod \"dashboard-redirect-78fd5d586f-cg4dx\" (UID: \"9be949e1-93c3-496c-8b74-35e870ec6390\") " pod="opendatahub/dashboard-redirect-78fd5d586f-cg4dx" Jun 11 18:42:19.547797 ip-10-0-141-55 kubenswrapper[2578]: I0611 18:42:19.547760 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"redirect-config\" (UniqueName: \"kubernetes.io/configmap/9be949e1-93c3-496c-8b74-35e870ec6390-redirect-config\") pod \"dashboard-redirect-78fd5d586f-cg4dx\" (UID: \"9be949e1-93c3-496c-8b74-35e870ec6390\") " pod="opendatahub/dashboard-redirect-78fd5d586f-cg4dx" Jun 11 18:42:19.547977 ip-10-0-141-55 kubenswrapper[2578]: I0611 18:42:19.547812 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hnw4f\" (UniqueName: \"kubernetes.io/projected/9be949e1-93c3-496c-8b74-35e870ec6390-kube-api-access-hnw4f\") pod \"dashboard-redirect-78fd5d586f-cg4dx\" (UID: \"9be949e1-93c3-496c-8b74-35e870ec6390\") " pod="opendatahub/dashboard-redirect-78fd5d586f-cg4dx" Jun 11 18:42:19.548498 ip-10-0-141-55 kubenswrapper[2578]: I0611 18:42:19.548480 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"redirect-config\" (UniqueName: \"kubernetes.io/configmap/9be949e1-93c3-496c-8b74-35e870ec6390-redirect-config\") pod \"dashboard-redirect-78fd5d586f-cg4dx\" (UID: \"9be949e1-93c3-496c-8b74-35e870ec6390\") " pod="opendatahub/dashboard-redirect-78fd5d586f-cg4dx" Jun 11 18:42:19.557151 ip-10-0-141-55 kubenswrapper[2578]: I0611 18:42:19.557121 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-hnw4f\" (UniqueName: \"kubernetes.io/projected/9be949e1-93c3-496c-8b74-35e870ec6390-kube-api-access-hnw4f\") pod \"dashboard-redirect-78fd5d586f-cg4dx\" (UID: \"9be949e1-93c3-496c-8b74-35e870ec6390\") " pod="opendatahub/dashboard-redirect-78fd5d586f-cg4dx" Jun 11 18:42:19.686808 ip-10-0-141-55 kubenswrapper[2578]: I0611 18:42:19.686729 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/dashboard-redirect-78fd5d586f-cg4dx" Jun 11 18:42:19.816508 ip-10-0-141-55 kubenswrapper[2578]: I0611 18:42:19.816485 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/dashboard-redirect-78fd5d586f-cg4dx"] Jun 11 18:42:19.818726 ip-10-0-141-55 kubenswrapper[2578]: W0611 18:42:19.818687 2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9be949e1_93c3_496c_8b74_35e870ec6390.slice/crio-bec691a54203cc7c3d5e0ca3b62ba0cf4366f1b4e6bd1a88c0a0ecf384d73f3c WatchSource:0}: Error finding container bec691a54203cc7c3d5e0ca3b62ba0cf4366f1b4e6bd1a88c0a0ecf384d73f3c: Status 404 returned error can't find the container with id bec691a54203cc7c3d5e0ca3b62ba0cf4366f1b4e6bd1a88c0a0ecf384d73f3c Jun 11 18:42:19.927620 ip-10-0-141-55 kubenswrapper[2578]: I0611 18:42:19.927588 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/dashboard-redirect-78fd5d586f-cg4dx" event={"ID":"9be949e1-93c3-496c-8b74-35e870ec6390","Type":"ContainerStarted","Data":"bec691a54203cc7c3d5e0ca3b62ba0cf4366f1b4e6bd1a88c0a0ecf384d73f3c"} Jun 11 18:42:22.944773 ip-10-0-141-55 kubenswrapper[2578]: I0611 18:42:22.944737 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/dashboard-redirect-78fd5d586f-cg4dx" event={"ID":"9be949e1-93c3-496c-8b74-35e870ec6390","Type":"ContainerStarted","Data":"297119e55614068217af7f813f0c8df03404cac6dde71db7888d3cc8ab46c4e8"} Jun 11 18:42:54.121413 ip-10-0-141-55 kubenswrapper[2578]: I0611 18:42:54.121360 2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/dashboard-redirect-78fd5d586f-cg4dx" podStartSLOduration=32.940415143 podStartE2EDuration="35.12134455s" totalImagesPullingTime="2.180929407s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-11 18:42:19 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-11 18:42:22.959977927 +0000 UTC m=+348.914652532" watchObservedRunningTime="2026-06-11 18:42:54.12134455 +0000 UTC m=+380.076019567" Jun 11 18:42:54.121990 ip-10-0-141-55 kubenswrapper[2578]: I0611 18:42:54.121971 2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1w9pgw"] Jun 11 18:42:54.134275 ip-10-0-141-55 kubenswrapper[2578]: I0611 18:42:54.134253 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1w9pgw" Jun 11 18:42:54.135440 ip-10-0-141-55 kubenswrapper[2578]: I0611 18:42:54.135413 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1w9pgw"] Jun 11 18:42:54.138355 ip-10-0-141-55 kubenswrapper[2578]: I0611 18:42:54.138335 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"openshift-service-ca.crt\"" Jun 11 18:42:54.139637 ip-10-0-141-55 kubenswrapper[2578]: I0611 18:42:54.139615 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"default-dockercfg-pz7qv\"" Jun 11 18:42:54.139744 ip-10-0-141-55 kubenswrapper[2578]: I0611 18:42:54.139615 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"kube-root-ca.crt\"" Jun 11 18:42:54.233291 ip-10-0-141-55 kubenswrapper[2578]: I0611 18:42:54.233256 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/b1b597f0-6693-4514-9cd6-464df054726c-bundle\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1w9pgw\" (UID: \"b1b597f0-6693-4514-9cd6-464df054726c\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1w9pgw" Jun 11 18:42:54.233459 ip-10-0-141-55 kubenswrapper[2578]: I0611 18:42:54.233303 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2j6jd\" (UniqueName: \"kubernetes.io/projected/b1b597f0-6693-4514-9cd6-464df054726c-kube-api-access-2j6jd\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1w9pgw\" (UID: \"b1b597f0-6693-4514-9cd6-464df054726c\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1w9pgw" Jun 11 18:42:54.233459 ip-10-0-141-55 kubenswrapper[2578]: I0611 18:42:54.233376 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/b1b597f0-6693-4514-9cd6-464df054726c-util\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1w9pgw\" (UID: \"b1b597f0-6693-4514-9cd6-464df054726c\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1w9pgw" Jun 11 18:42:54.333944 ip-10-0-141-55 kubenswrapper[2578]: I0611 18:42:54.333895 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2j6jd\" (UniqueName: \"kubernetes.io/projected/b1b597f0-6693-4514-9cd6-464df054726c-kube-api-access-2j6jd\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1w9pgw\" (UID: \"b1b597f0-6693-4514-9cd6-464df054726c\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1w9pgw" Jun 11 18:42:54.333944 ip-10-0-141-55 kubenswrapper[2578]: I0611 18:42:54.333951 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/b1b597f0-6693-4514-9cd6-464df054726c-util\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1w9pgw\" (UID: \"b1b597f0-6693-4514-9cd6-464df054726c\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1w9pgw" Jun 11 18:42:54.334182 ip-10-0-141-55 kubenswrapper[2578]: I0611 18:42:54.334001 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/b1b597f0-6693-4514-9cd6-464df054726c-bundle\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1w9pgw\" (UID: \"b1b597f0-6693-4514-9cd6-464df054726c\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1w9pgw" Jun 11 18:42:54.334394 ip-10-0-141-55 kubenswrapper[2578]: I0611 18:42:54.334373 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/b1b597f0-6693-4514-9cd6-464df054726c-bundle\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1w9pgw\" (UID: \"b1b597f0-6693-4514-9cd6-464df054726c\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1w9pgw" Jun 11 18:42:54.334479 ip-10-0-141-55 kubenswrapper[2578]: I0611 18:42:54.334428 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/b1b597f0-6693-4514-9cd6-464df054726c-util\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1w9pgw\" (UID: \"b1b597f0-6693-4514-9cd6-464df054726c\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1w9pgw" Jun 11 18:42:54.342771 ip-10-0-141-55 kubenswrapper[2578]: I0611 18:42:54.342748 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-2j6jd\" (UniqueName: \"kubernetes.io/projected/b1b597f0-6693-4514-9cd6-464df054726c-kube-api-access-2j6jd\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1w9pgw\" (UID: \"b1b597f0-6693-4514-9cd6-464df054726c\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1w9pgw" Jun 11 18:42:54.444842 ip-10-0-141-55 kubenswrapper[2578]: I0611 18:42:54.444758 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1w9pgw" Jun 11 18:42:54.576198 ip-10-0-141-55 kubenswrapper[2578]: I0611 18:42:54.576166 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1w9pgw"] Jun 11 18:42:54.577639 ip-10-0-141-55 kubenswrapper[2578]: W0611 18:42:54.577612 2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb1b597f0_6693_4514_9cd6_464df054726c.slice/crio-7e5a76e8247ac5711a81f13c6bce588ab6dc16dbc7fd18ddffa9d6d56466badd WatchSource:0}: Error finding container 7e5a76e8247ac5711a81f13c6bce588ab6dc16dbc7fd18ddffa9d6d56466badd: Status 404 returned error can't find the container with id 7e5a76e8247ac5711a81f13c6bce588ab6dc16dbc7fd18ddffa9d6d56466badd Jun 11 18:42:54.711982 ip-10-0-141-55 kubenswrapper[2578]: I0611 18:42:54.711923 2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73qt599"] Jun 11 18:42:54.715391 ip-10-0-141-55 kubenswrapper[2578]: I0611 18:42:54.715375 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73qt599" Jun 11 18:42:54.724288 ip-10-0-141-55 kubenswrapper[2578]: I0611 18:42:54.724261 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73qt599"] Jun 11 18:42:54.737401 ip-10-0-141-55 kubenswrapper[2578]: I0611 18:42:54.737375 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/8e28f713-1aee-425d-990d-dd7fe5f647d2-util\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73qt599\" (UID: \"8e28f713-1aee-425d-990d-dd7fe5f647d2\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73qt599" Jun 11 18:42:54.737547 ip-10-0-141-55 kubenswrapper[2578]: I0611 18:42:54.737426 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/8e28f713-1aee-425d-990d-dd7fe5f647d2-bundle\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73qt599\" (UID: \"8e28f713-1aee-425d-990d-dd7fe5f647d2\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73qt599" Jun 11 18:42:54.737646 ip-10-0-141-55 kubenswrapper[2578]: I0611 18:42:54.737537 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-tvz88\" (UniqueName: \"kubernetes.io/projected/8e28f713-1aee-425d-990d-dd7fe5f647d2-kube-api-access-tvz88\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73qt599\" (UID: \"8e28f713-1aee-425d-990d-dd7fe5f647d2\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73qt599" Jun 11 18:42:54.838021 ip-10-0-141-55 kubenswrapper[2578]: I0611 18:42:54.837972 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/8e28f713-1aee-425d-990d-dd7fe5f647d2-util\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73qt599\" (UID: \"8e28f713-1aee-425d-990d-dd7fe5f647d2\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73qt599" Jun 11 18:42:54.838226 ip-10-0-141-55 kubenswrapper[2578]: I0611 18:42:54.838039 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/8e28f713-1aee-425d-990d-dd7fe5f647d2-bundle\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73qt599\" (UID: \"8e28f713-1aee-425d-990d-dd7fe5f647d2\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73qt599" Jun 11 18:42:54.838226 ip-10-0-141-55 kubenswrapper[2578]: I0611 18:42:54.838087 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-tvz88\" (UniqueName: \"kubernetes.io/projected/8e28f713-1aee-425d-990d-dd7fe5f647d2-kube-api-access-tvz88\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73qt599\" (UID: \"8e28f713-1aee-425d-990d-dd7fe5f647d2\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73qt599" Jun 11 18:42:54.838435 ip-10-0-141-55 kubenswrapper[2578]: I0611 18:42:54.838412 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/8e28f713-1aee-425d-990d-dd7fe5f647d2-util\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73qt599\" (UID: \"8e28f713-1aee-425d-990d-dd7fe5f647d2\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73qt599" Jun 11 18:42:54.838504 ip-10-0-141-55 kubenswrapper[2578]: I0611 18:42:54.838447 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/8e28f713-1aee-425d-990d-dd7fe5f647d2-bundle\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73qt599\" (UID: \"8e28f713-1aee-425d-990d-dd7fe5f647d2\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73qt599" Jun 11 18:42:54.847314 ip-10-0-141-55 kubenswrapper[2578]: I0611 18:42:54.847293 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-tvz88\" (UniqueName: \"kubernetes.io/projected/8e28f713-1aee-425d-990d-dd7fe5f647d2-kube-api-access-tvz88\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73qt599\" (UID: \"8e28f713-1aee-425d-990d-dd7fe5f647d2\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73qt599" Jun 11 18:42:55.041998 ip-10-0-141-55 kubenswrapper[2578]: I0611 18:42:55.041909 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73qt599" Jun 11 18:42:55.099636 ip-10-0-141-55 kubenswrapper[2578]: I0611 18:42:55.099608 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1w9pgw" event={"ID":"b1b597f0-6693-4514-9cd6-464df054726c","Type":"ContainerDied","Data":"e09091d941450b0d25a52a79afb8c7f5ce7f8bb86ad16f9a1bfab95ae6f4593d"} Jun 11 18:42:55.099772 ip-10-0-141-55 kubenswrapper[2578]: I0611 18:42:55.099543 2578 generic.go:356] "Generic (PLEG): container finished" podID="b1b597f0-6693-4514-9cd6-464df054726c" containerID="e09091d941450b0d25a52a79afb8c7f5ce7f8bb86ad16f9a1bfab95ae6f4593d" exitCode=0 Jun 11 18:42:55.099833 ip-10-0-141-55 kubenswrapper[2578]: I0611 18:42:55.099778 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1w9pgw" event={"ID":"b1b597f0-6693-4514-9cd6-464df054726c","Type":"ContainerStarted","Data":"7e5a76e8247ac5711a81f13c6bce588ab6dc16dbc7fd18ddffa9d6d56466badd"} Jun 11 18:42:55.170077 ip-10-0-141-55 kubenswrapper[2578]: I0611 18:42:55.170049 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73qt599"] Jun 11 18:42:55.171882 ip-10-0-141-55 kubenswrapper[2578]: W0611 18:42:55.171857 2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8e28f713_1aee_425d_990d_dd7fe5f647d2.slice/crio-33b293158e888ad9d71ea58b191daf4b78134017a20b4be7fc6d6babe74ac29b WatchSource:0}: Error finding container 33b293158e888ad9d71ea58b191daf4b78134017a20b4be7fc6d6babe74ac29b: Status 404 returned error can't find the container with id 33b293158e888ad9d71ea58b191daf4b78134017a20b4be7fc6d6babe74ac29b Jun 11 18:42:55.313310 ip-10-0-141-55 kubenswrapper[2578]: I0611 18:42:55.313242 2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759g8tx8"] Jun 11 18:42:55.316614 ip-10-0-141-55 kubenswrapper[2578]: I0611 18:42:55.316597 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759g8tx8" Jun 11 18:42:55.328283 ip-10-0-141-55 kubenswrapper[2578]: I0611 18:42:55.328263 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759g8tx8"] Jun 11 18:42:55.343093 ip-10-0-141-55 kubenswrapper[2578]: I0611 18:42:55.343075 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/f5edd135-d5c9-491d-927e-f4b0e470cc8e-bundle\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759g8tx8\" (UID: \"f5edd135-d5c9-491d-927e-f4b0e470cc8e\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759g8tx8" Jun 11 18:42:55.343186 ip-10-0-141-55 kubenswrapper[2578]: I0611 18:42:55.343120 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/f5edd135-d5c9-491d-927e-f4b0e470cc8e-util\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759g8tx8\" (UID: \"f5edd135-d5c9-491d-927e-f4b0e470cc8e\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759g8tx8" Jun 11 18:42:55.343226 ip-10-0-141-55 kubenswrapper[2578]: I0611 18:42:55.343193 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-gzkb2\" (UniqueName: \"kubernetes.io/projected/f5edd135-d5c9-491d-927e-f4b0e470cc8e-kube-api-access-gzkb2\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759g8tx8\" (UID: \"f5edd135-d5c9-491d-927e-f4b0e470cc8e\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759g8tx8" Jun 11 18:42:55.443921 ip-10-0-141-55 kubenswrapper[2578]: I0611 18:42:55.443889 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-gzkb2\" (UniqueName: \"kubernetes.io/projected/f5edd135-d5c9-491d-927e-f4b0e470cc8e-kube-api-access-gzkb2\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759g8tx8\" (UID: \"f5edd135-d5c9-491d-927e-f4b0e470cc8e\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759g8tx8" Jun 11 18:42:55.444121 ip-10-0-141-55 kubenswrapper[2578]: I0611 18:42:55.443943 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/f5edd135-d5c9-491d-927e-f4b0e470cc8e-bundle\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759g8tx8\" (UID: \"f5edd135-d5c9-491d-927e-f4b0e470cc8e\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759g8tx8" Jun 11 18:42:55.444189 ip-10-0-141-55 kubenswrapper[2578]: I0611 18:42:55.444160 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/f5edd135-d5c9-491d-927e-f4b0e470cc8e-util\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759g8tx8\" (UID: \"f5edd135-d5c9-491d-927e-f4b0e470cc8e\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759g8tx8" Jun 11 18:42:55.444380 ip-10-0-141-55 kubenswrapper[2578]: I0611 18:42:55.444361 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/f5edd135-d5c9-491d-927e-f4b0e470cc8e-bundle\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759g8tx8\" (UID: \"f5edd135-d5c9-491d-927e-f4b0e470cc8e\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759g8tx8" Jun 11 18:42:55.444428 ip-10-0-141-55 kubenswrapper[2578]: I0611 18:42:55.444410 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/f5edd135-d5c9-491d-927e-f4b0e470cc8e-util\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759g8tx8\" (UID: \"f5edd135-d5c9-491d-927e-f4b0e470cc8e\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759g8tx8" Jun 11 18:42:55.453326 ip-10-0-141-55 kubenswrapper[2578]: I0611 18:42:55.453298 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-gzkb2\" (UniqueName: \"kubernetes.io/projected/f5edd135-d5c9-491d-927e-f4b0e470cc8e-kube-api-access-gzkb2\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759g8tx8\" (UID: \"f5edd135-d5c9-491d-927e-f4b0e470cc8e\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759g8tx8" Jun 11 18:42:55.639675 ip-10-0-141-55 kubenswrapper[2578]: I0611 18:42:55.639541 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759g8tx8" Jun 11 18:42:55.856174 ip-10-0-141-55 kubenswrapper[2578]: I0611 18:42:55.856143 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759g8tx8"] Jun 11 18:42:55.857824 ip-10-0-141-55 kubenswrapper[2578]: W0611 18:42:55.857792 2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf5edd135_d5c9_491d_927e_f4b0e470cc8e.slice/crio-274296d75493092a619e34554fce260474f9ecf357993eb0af0858be1009b4a8 WatchSource:0}: Error finding container 274296d75493092a619e34554fce260474f9ecf357993eb0af0858be1009b4a8: Status 404 returned error can't find the container with id 274296d75493092a619e34554fce260474f9ecf357993eb0af0858be1009b4a8 Jun 11 18:42:55.913047 ip-10-0-141-55 kubenswrapper[2578]: I0611 18:42:55.912998 2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0bnhll"] Jun 11 18:42:55.916789 ip-10-0-141-55 kubenswrapper[2578]: I0611 18:42:55.916773 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0bnhll" Jun 11 18:42:55.925006 ip-10-0-141-55 kubenswrapper[2578]: I0611 18:42:55.924978 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0bnhll"] Jun 11 18:42:55.948292 ip-10-0-141-55 kubenswrapper[2578]: I0611 18:42:55.948268 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/b13ea5a7-e0a4-4e89-9334-14d43479be6c-bundle\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0bnhll\" (UID: \"b13ea5a7-e0a4-4e89-9334-14d43479be6c\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0bnhll" Jun 11 18:42:55.948396 ip-10-0-141-55 kubenswrapper[2578]: I0611 18:42:55.948359 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/b13ea5a7-e0a4-4e89-9334-14d43479be6c-util\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0bnhll\" (UID: \"b13ea5a7-e0a4-4e89-9334-14d43479be6c\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0bnhll" Jun 11 18:42:55.948396 ip-10-0-141-55 kubenswrapper[2578]: I0611 18:42:55.948385 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ns76f\" (UniqueName: \"kubernetes.io/projected/b13ea5a7-e0a4-4e89-9334-14d43479be6c-kube-api-access-ns76f\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0bnhll\" (UID: \"b13ea5a7-e0a4-4e89-9334-14d43479be6c\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0bnhll" Jun 11 18:42:56.048887 ip-10-0-141-55 kubenswrapper[2578]: I0611 18:42:56.048861 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/b13ea5a7-e0a4-4e89-9334-14d43479be6c-bundle\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0bnhll\" (UID: \"b13ea5a7-e0a4-4e89-9334-14d43479be6c\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0bnhll" Jun 11 18:42:56.049031 ip-10-0-141-55 kubenswrapper[2578]: I0611 18:42:56.048916 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/b13ea5a7-e0a4-4e89-9334-14d43479be6c-util\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0bnhll\" (UID: \"b13ea5a7-e0a4-4e89-9334-14d43479be6c\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0bnhll" Jun 11 18:42:56.049031 ip-10-0-141-55 kubenswrapper[2578]: I0611 18:42:56.048937 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ns76f\" (UniqueName: \"kubernetes.io/projected/b13ea5a7-e0a4-4e89-9334-14d43479be6c-kube-api-access-ns76f\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0bnhll\" (UID: \"b13ea5a7-e0a4-4e89-9334-14d43479be6c\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0bnhll" Jun 11 18:42:56.049316 ip-10-0-141-55 kubenswrapper[2578]: I0611 18:42:56.049284 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/b13ea5a7-e0a4-4e89-9334-14d43479be6c-bundle\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0bnhll\" (UID: \"b13ea5a7-e0a4-4e89-9334-14d43479be6c\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0bnhll" Jun 11 18:42:56.049352 ip-10-0-141-55 kubenswrapper[2578]: I0611 18:42:56.049306 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/b13ea5a7-e0a4-4e89-9334-14d43479be6c-util\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0bnhll\" (UID: \"b13ea5a7-e0a4-4e89-9334-14d43479be6c\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0bnhll" Jun 11 18:42:56.057424 ip-10-0-141-55 kubenswrapper[2578]: I0611 18:42:56.057394 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-ns76f\" (UniqueName: \"kubernetes.io/projected/b13ea5a7-e0a4-4e89-9334-14d43479be6c-kube-api-access-ns76f\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0bnhll\" (UID: \"b13ea5a7-e0a4-4e89-9334-14d43479be6c\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0bnhll" Jun 11 18:42:56.110694 ip-10-0-141-55 kubenswrapper[2578]: I0611 18:42:56.110661 2578 generic.go:356] "Generic (PLEG): container finished" podID="b1b597f0-6693-4514-9cd6-464df054726c" containerID="99a42f65b3e1212f9a12b7bb9bc2911a4222df7b24db1599012b874f135326d2" exitCode=0 Jun 11 18:42:56.110840 ip-10-0-141-55 kubenswrapper[2578]: I0611 18:42:56.110751 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1w9pgw" event={"ID":"b1b597f0-6693-4514-9cd6-464df054726c","Type":"ContainerDied","Data":"99a42f65b3e1212f9a12b7bb9bc2911a4222df7b24db1599012b874f135326d2"} Jun 11 18:42:56.112414 ip-10-0-141-55 kubenswrapper[2578]: I0611 18:42:56.112385 2578 generic.go:356] "Generic (PLEG): container finished" podID="f5edd135-d5c9-491d-927e-f4b0e470cc8e" containerID="2ab3e1534c46730d4836ef99aaedb0c5d3b92320c1040d18c35ed12480f214de" exitCode=0 Jun 11 18:42:56.112505 ip-10-0-141-55 kubenswrapper[2578]: I0611 18:42:56.112436 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759g8tx8" event={"ID":"f5edd135-d5c9-491d-927e-f4b0e470cc8e","Type":"ContainerDied","Data":"2ab3e1534c46730d4836ef99aaedb0c5d3b92320c1040d18c35ed12480f214de"} Jun 11 18:42:56.112505 ip-10-0-141-55 kubenswrapper[2578]: I0611 18:42:56.112490 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759g8tx8" event={"ID":"f5edd135-d5c9-491d-927e-f4b0e470cc8e","Type":"ContainerStarted","Data":"274296d75493092a619e34554fce260474f9ecf357993eb0af0858be1009b4a8"} Jun 11 18:42:56.113899 ip-10-0-141-55 kubenswrapper[2578]: I0611 18:42:56.113876 2578 generic.go:356] "Generic (PLEG): container finished" podID="8e28f713-1aee-425d-990d-dd7fe5f647d2" containerID="ba78afbbf3dd88576e152dfeee337545b89bc98e8c2ea3a24f5358441ea39319" exitCode=0 Jun 11 18:42:56.114040 ip-10-0-141-55 kubenswrapper[2578]: I0611 18:42:56.113902 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73qt599" event={"ID":"8e28f713-1aee-425d-990d-dd7fe5f647d2","Type":"ContainerDied","Data":"ba78afbbf3dd88576e152dfeee337545b89bc98e8c2ea3a24f5358441ea39319"} Jun 11 18:42:56.114040 ip-10-0-141-55 kubenswrapper[2578]: I0611 18:42:56.113941 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73qt599" event={"ID":"8e28f713-1aee-425d-990d-dd7fe5f647d2","Type":"ContainerStarted","Data":"33b293158e888ad9d71ea58b191daf4b78134017a20b4be7fc6d6babe74ac29b"} Jun 11 18:42:56.234269 ip-10-0-141-55 kubenswrapper[2578]: I0611 18:42:56.234214 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0bnhll" Jun 11 18:42:56.358963 ip-10-0-141-55 kubenswrapper[2578]: I0611 18:42:56.358937 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0bnhll"] Jun 11 18:42:56.360312 ip-10-0-141-55 kubenswrapper[2578]: W0611 18:42:56.360286 2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb13ea5a7_e0a4_4e89_9334_14d43479be6c.slice/crio-546f6348b9ba993540400af31a64dfbade7b70816cf133b9a76a0eb6cf241522 WatchSource:0}: Error finding container 546f6348b9ba993540400af31a64dfbade7b70816cf133b9a76a0eb6cf241522: Status 404 returned error can't find the container with id 546f6348b9ba993540400af31a64dfbade7b70816cf133b9a76a0eb6cf241522 Jun 11 18:42:57.121299 ip-10-0-141-55 kubenswrapper[2578]: I0611 18:42:57.121209 2578 generic.go:356] "Generic (PLEG): container finished" podID="8e28f713-1aee-425d-990d-dd7fe5f647d2" containerID="f9efea319a25db2de911286adeb92db2accc79c80339407a95f2c90d47188da6" exitCode=0 Jun 11 18:42:57.121299 ip-10-0-141-55 kubenswrapper[2578]: I0611 18:42:57.121257 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73qt599" event={"ID":"8e28f713-1aee-425d-990d-dd7fe5f647d2","Type":"ContainerDied","Data":"f9efea319a25db2de911286adeb92db2accc79c80339407a95f2c90d47188da6"} Jun 11 18:42:57.123370 ip-10-0-141-55 kubenswrapper[2578]: I0611 18:42:57.123345 2578 generic.go:356] "Generic (PLEG): container finished" podID="b1b597f0-6693-4514-9cd6-464df054726c" containerID="7f21de8d59dcf6de576b66d0100095cf36bd79e2283dcac0972ca9a8a75a441f" exitCode=0 Jun 11 18:42:57.123487 ip-10-0-141-55 kubenswrapper[2578]: I0611 18:42:57.123407 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1w9pgw" event={"ID":"b1b597f0-6693-4514-9cd6-464df054726c","Type":"ContainerDied","Data":"7f21de8d59dcf6de576b66d0100095cf36bd79e2283dcac0972ca9a8a75a441f"} Jun 11 18:42:57.124870 ip-10-0-141-55 kubenswrapper[2578]: I0611 18:42:57.124837 2578 generic.go:356] "Generic (PLEG): container finished" podID="b13ea5a7-e0a4-4e89-9334-14d43479be6c" containerID="aaa6585b2f0490069780d674a767c1b9eb9b32ddef967cdb27d33d0faacbf8e4" exitCode=0 Jun 11 18:42:57.125019 ip-10-0-141-55 kubenswrapper[2578]: I0611 18:42:57.124915 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0bnhll" event={"ID":"b13ea5a7-e0a4-4e89-9334-14d43479be6c","Type":"ContainerDied","Data":"aaa6585b2f0490069780d674a767c1b9eb9b32ddef967cdb27d33d0faacbf8e4"} Jun 11 18:42:57.125019 ip-10-0-141-55 kubenswrapper[2578]: I0611 18:42:57.124954 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0bnhll" event={"ID":"b13ea5a7-e0a4-4e89-9334-14d43479be6c","Type":"ContainerStarted","Data":"546f6348b9ba993540400af31a64dfbade7b70816cf133b9a76a0eb6cf241522"} Jun 11 18:42:57.126913 ip-10-0-141-55 kubenswrapper[2578]: I0611 18:42:57.126896 2578 generic.go:356] "Generic (PLEG): container finished" podID="f5edd135-d5c9-491d-927e-f4b0e470cc8e" containerID="80b24f21f86476d3ca18056dadbf2edb8adf5230f1909732415973bd25f60256" exitCode=0 Jun 11 18:42:57.127002 ip-10-0-141-55 kubenswrapper[2578]: I0611 18:42:57.126946 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759g8tx8" event={"ID":"f5edd135-d5c9-491d-927e-f4b0e470cc8e","Type":"ContainerDied","Data":"80b24f21f86476d3ca18056dadbf2edb8adf5230f1909732415973bd25f60256"} Jun 11 18:42:58.134261 ip-10-0-141-55 kubenswrapper[2578]: I0611 18:42:58.134230 2578 generic.go:356] "Generic (PLEG): container finished" podID="8e28f713-1aee-425d-990d-dd7fe5f647d2" containerID="b2ae3632aae1e60f8db44a9dbd600e8edd222853eb2d91b007fa064910816094" exitCode=0 Jun 11 18:42:58.134713 ip-10-0-141-55 kubenswrapper[2578]: I0611 18:42:58.134314 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73qt599" event={"ID":"8e28f713-1aee-425d-990d-dd7fe5f647d2","Type":"ContainerDied","Data":"b2ae3632aae1e60f8db44a9dbd600e8edd222853eb2d91b007fa064910816094"} Jun 11 18:42:58.136110 ip-10-0-141-55 kubenswrapper[2578]: I0611 18:42:58.136089 2578 generic.go:356] "Generic (PLEG): container finished" podID="b13ea5a7-e0a4-4e89-9334-14d43479be6c" containerID="536ad5de3ecd416431c4a39946918f2469fdf2f890eec1616f0d2cdaa73897a9" exitCode=0 Jun 11 18:42:58.136216 ip-10-0-141-55 kubenswrapper[2578]: I0611 18:42:58.136155 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0bnhll" event={"ID":"b13ea5a7-e0a4-4e89-9334-14d43479be6c","Type":"ContainerDied","Data":"536ad5de3ecd416431c4a39946918f2469fdf2f890eec1616f0d2cdaa73897a9"} Jun 11 18:42:58.138246 ip-10-0-141-55 kubenswrapper[2578]: I0611 18:42:58.138228 2578 generic.go:356] "Generic (PLEG): container finished" podID="f5edd135-d5c9-491d-927e-f4b0e470cc8e" containerID="1af9b2a0e63db035d48d6c75dd5acc75349edd56166dc17fc4acd68f1029fc52" exitCode=0 Jun 11 18:42:58.138326 ip-10-0-141-55 kubenswrapper[2578]: I0611 18:42:58.138313 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759g8tx8" event={"ID":"f5edd135-d5c9-491d-927e-f4b0e470cc8e","Type":"ContainerDied","Data":"1af9b2a0e63db035d48d6c75dd5acc75349edd56166dc17fc4acd68f1029fc52"} Jun 11 18:42:58.267335 ip-10-0-141-55 kubenswrapper[2578]: I0611 18:42:58.267308 2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1w9pgw" Jun 11 18:42:58.370467 ip-10-0-141-55 kubenswrapper[2578]: I0611 18:42:58.370442 2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-2j6jd\" (UniqueName: \"kubernetes.io/projected/b1b597f0-6693-4514-9cd6-464df054726c-kube-api-access-2j6jd\") pod \"b1b597f0-6693-4514-9cd6-464df054726c\" (UID: \"b1b597f0-6693-4514-9cd6-464df054726c\") " Jun 11 18:42:58.370626 ip-10-0-141-55 kubenswrapper[2578]: I0611 18:42:58.370481 2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/b1b597f0-6693-4514-9cd6-464df054726c-util\") pod \"b1b597f0-6693-4514-9cd6-464df054726c\" (UID: \"b1b597f0-6693-4514-9cd6-464df054726c\") " Jun 11 18:42:58.370626 ip-10-0-141-55 kubenswrapper[2578]: I0611 18:42:58.370520 2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/b1b597f0-6693-4514-9cd6-464df054726c-bundle\") pod \"b1b597f0-6693-4514-9cd6-464df054726c\" (UID: \"b1b597f0-6693-4514-9cd6-464df054726c\") " Jun 11 18:42:58.371081 ip-10-0-141-55 kubenswrapper[2578]: I0611 18:42:58.371053 2578 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/b1b597f0-6693-4514-9cd6-464df054726c-bundle" (OuterVolumeSpecName: "bundle") pod "b1b597f0-6693-4514-9cd6-464df054726c" (UID: "b1b597f0-6693-4514-9cd6-464df054726c"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 11 18:42:58.372648 ip-10-0-141-55 kubenswrapper[2578]: I0611 18:42:58.372624 2578 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/b1b597f0-6693-4514-9cd6-464df054726c-kube-api-access-2j6jd" (OuterVolumeSpecName: "kube-api-access-2j6jd") pod "b1b597f0-6693-4514-9cd6-464df054726c" (UID: "b1b597f0-6693-4514-9cd6-464df054726c"). InnerVolumeSpecName "kube-api-access-2j6jd". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 11 18:42:58.375480 ip-10-0-141-55 kubenswrapper[2578]: I0611 18:42:58.375459 2578 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/b1b597f0-6693-4514-9cd6-464df054726c-util" (OuterVolumeSpecName: "util") pod "b1b597f0-6693-4514-9cd6-464df054726c" (UID: "b1b597f0-6693-4514-9cd6-464df054726c"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 11 18:42:58.471070 ip-10-0-141-55 kubenswrapper[2578]: I0611 18:42:58.471039 2578 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-2j6jd\" (UniqueName: \"kubernetes.io/projected/b1b597f0-6693-4514-9cd6-464df054726c-kube-api-access-2j6jd\") on node \"ip-10-0-141-55.ec2.internal\" DevicePath \"\"" Jun 11 18:42:58.471070 ip-10-0-141-55 kubenswrapper[2578]: I0611 18:42:58.471065 2578 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/b1b597f0-6693-4514-9cd6-464df054726c-util\") on node \"ip-10-0-141-55.ec2.internal\" DevicePath \"\"" Jun 11 18:42:58.471070 ip-10-0-141-55 kubenswrapper[2578]: I0611 18:42:58.471075 2578 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/b1b597f0-6693-4514-9cd6-464df054726c-bundle\") on node \"ip-10-0-141-55.ec2.internal\" DevicePath \"\"" Jun 11 18:42:59.144877 ip-10-0-141-55 kubenswrapper[2578]: I0611 18:42:59.144843 2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1w9pgw" Jun 11 18:42:59.145281 ip-10-0-141-55 kubenswrapper[2578]: I0611 18:42:59.144837 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1w9pgw" event={"ID":"b1b597f0-6693-4514-9cd6-464df054726c","Type":"ContainerDied","Data":"7e5a76e8247ac5711a81f13c6bce588ab6dc16dbc7fd18ddffa9d6d56466badd"} Jun 11 18:42:59.145281 ip-10-0-141-55 kubenswrapper[2578]: I0611 18:42:59.144999 2578 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="7e5a76e8247ac5711a81f13c6bce588ab6dc16dbc7fd18ddffa9d6d56466badd" Jun 11 18:42:59.147101 ip-10-0-141-55 kubenswrapper[2578]: I0611 18:42:59.147074 2578 generic.go:356] "Generic (PLEG): container finished" podID="b13ea5a7-e0a4-4e89-9334-14d43479be6c" containerID="79ddd3b1d06238e7db495e2b8d08adaa488cb9855830a415bbca90600dcda661" exitCode=0 Jun 11 18:42:59.147216 ip-10-0-141-55 kubenswrapper[2578]: I0611 18:42:59.147104 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0bnhll" event={"ID":"b13ea5a7-e0a4-4e89-9334-14d43479be6c","Type":"ContainerDied","Data":"79ddd3b1d06238e7db495e2b8d08adaa488cb9855830a415bbca90600dcda661"} Jun 11 18:42:59.290950 ip-10-0-141-55 kubenswrapper[2578]: I0611 18:42:59.290927 2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73qt599" Jun 11 18:42:59.293072 ip-10-0-141-55 kubenswrapper[2578]: I0611 18:42:59.293057 2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759g8tx8" Jun 11 18:42:59.379942 ip-10-0-141-55 kubenswrapper[2578]: I0611 18:42:59.379909 2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/f5edd135-d5c9-491d-927e-f4b0e470cc8e-util\") pod \"f5edd135-d5c9-491d-927e-f4b0e470cc8e\" (UID: \"f5edd135-d5c9-491d-927e-f4b0e470cc8e\") " Jun 11 18:42:59.380122 ip-10-0-141-55 kubenswrapper[2578]: I0611 18:42:59.379958 2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/8e28f713-1aee-425d-990d-dd7fe5f647d2-bundle\") pod \"8e28f713-1aee-425d-990d-dd7fe5f647d2\" (UID: \"8e28f713-1aee-425d-990d-dd7fe5f647d2\") " Jun 11 18:42:59.380122 ip-10-0-141-55 kubenswrapper[2578]: I0611 18:42:59.380090 2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-gzkb2\" (UniqueName: \"kubernetes.io/projected/f5edd135-d5c9-491d-927e-f4b0e470cc8e-kube-api-access-gzkb2\") pod \"f5edd135-d5c9-491d-927e-f4b0e470cc8e\" (UID: \"f5edd135-d5c9-491d-927e-f4b0e470cc8e\") " Jun 11 18:42:59.380193 ip-10-0-141-55 kubenswrapper[2578]: I0611 18:42:59.380123 2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/f5edd135-d5c9-491d-927e-f4b0e470cc8e-bundle\") pod \"f5edd135-d5c9-491d-927e-f4b0e470cc8e\" (UID: \"f5edd135-d5c9-491d-927e-f4b0e470cc8e\") " Jun 11 18:42:59.380193 ip-10-0-141-55 kubenswrapper[2578]: I0611 18:42:59.380145 2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-tvz88\" (UniqueName: \"kubernetes.io/projected/8e28f713-1aee-425d-990d-dd7fe5f647d2-kube-api-access-tvz88\") pod \"8e28f713-1aee-425d-990d-dd7fe5f647d2\" (UID: \"8e28f713-1aee-425d-990d-dd7fe5f647d2\") " Jun 11 18:42:59.380193 ip-10-0-141-55 kubenswrapper[2578]: I0611 18:42:59.380182 2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/8e28f713-1aee-425d-990d-dd7fe5f647d2-util\") pod \"8e28f713-1aee-425d-990d-dd7fe5f647d2\" (UID: \"8e28f713-1aee-425d-990d-dd7fe5f647d2\") " Jun 11 18:42:59.380648 ip-10-0-141-55 kubenswrapper[2578]: I0611 18:42:59.380616 2578 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/f5edd135-d5c9-491d-927e-f4b0e470cc8e-bundle" (OuterVolumeSpecName: "bundle") pod "f5edd135-d5c9-491d-927e-f4b0e470cc8e" (UID: "f5edd135-d5c9-491d-927e-f4b0e470cc8e"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 11 18:42:59.380792 ip-10-0-141-55 kubenswrapper[2578]: I0611 18:42:59.380703 2578 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/8e28f713-1aee-425d-990d-dd7fe5f647d2-bundle" (OuterVolumeSpecName: "bundle") pod "8e28f713-1aee-425d-990d-dd7fe5f647d2" (UID: "8e28f713-1aee-425d-990d-dd7fe5f647d2"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 11 18:42:59.382299 ip-10-0-141-55 kubenswrapper[2578]: I0611 18:42:59.382276 2578 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/f5edd135-d5c9-491d-927e-f4b0e470cc8e-kube-api-access-gzkb2" (OuterVolumeSpecName: "kube-api-access-gzkb2") pod "f5edd135-d5c9-491d-927e-f4b0e470cc8e" (UID: "f5edd135-d5c9-491d-927e-f4b0e470cc8e"). InnerVolumeSpecName "kube-api-access-gzkb2". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 11 18:42:59.382596 ip-10-0-141-55 kubenswrapper[2578]: I0611 18:42:59.382539 2578 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/8e28f713-1aee-425d-990d-dd7fe5f647d2-kube-api-access-tvz88" (OuterVolumeSpecName: "kube-api-access-tvz88") pod "8e28f713-1aee-425d-990d-dd7fe5f647d2" (UID: "8e28f713-1aee-425d-990d-dd7fe5f647d2"). InnerVolumeSpecName "kube-api-access-tvz88". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 11 18:42:59.385987 ip-10-0-141-55 kubenswrapper[2578]: I0611 18:42:59.385963 2578 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/f5edd135-d5c9-491d-927e-f4b0e470cc8e-util" (OuterVolumeSpecName: "util") pod "f5edd135-d5c9-491d-927e-f4b0e470cc8e" (UID: "f5edd135-d5c9-491d-927e-f4b0e470cc8e"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 11 18:42:59.386546 ip-10-0-141-55 kubenswrapper[2578]: I0611 18:42:59.386526 2578 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/8e28f713-1aee-425d-990d-dd7fe5f647d2-util" (OuterVolumeSpecName: "util") pod "8e28f713-1aee-425d-990d-dd7fe5f647d2" (UID: "8e28f713-1aee-425d-990d-dd7fe5f647d2"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 11 18:42:59.481948 ip-10-0-141-55 kubenswrapper[2578]: I0611 18:42:59.481792 2578 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/8e28f713-1aee-425d-990d-dd7fe5f647d2-util\") on node \"ip-10-0-141-55.ec2.internal\" DevicePath \"\"" Jun 11 18:42:59.481948 ip-10-0-141-55 kubenswrapper[2578]: I0611 18:42:59.481824 2578 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/f5edd135-d5c9-491d-927e-f4b0e470cc8e-util\") on node \"ip-10-0-141-55.ec2.internal\" DevicePath \"\"" Jun 11 18:42:59.481948 ip-10-0-141-55 kubenswrapper[2578]: I0611 18:42:59.481838 2578 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/8e28f713-1aee-425d-990d-dd7fe5f647d2-bundle\") on node \"ip-10-0-141-55.ec2.internal\" DevicePath \"\"" Jun 11 18:42:59.481948 ip-10-0-141-55 kubenswrapper[2578]: I0611 18:42:59.481860 2578 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-gzkb2\" (UniqueName: \"kubernetes.io/projected/f5edd135-d5c9-491d-927e-f4b0e470cc8e-kube-api-access-gzkb2\") on node \"ip-10-0-141-55.ec2.internal\" DevicePath \"\"" Jun 11 18:42:59.481948 ip-10-0-141-55 kubenswrapper[2578]: I0611 18:42:59.481885 2578 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/f5edd135-d5c9-491d-927e-f4b0e470cc8e-bundle\") on node \"ip-10-0-141-55.ec2.internal\" DevicePath \"\"" Jun 11 18:42:59.481948 ip-10-0-141-55 kubenswrapper[2578]: I0611 18:42:59.481897 2578 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-tvz88\" (UniqueName: \"kubernetes.io/projected/8e28f713-1aee-425d-990d-dd7fe5f647d2-kube-api-access-tvz88\") on node \"ip-10-0-141-55.ec2.internal\" DevicePath \"\"" Jun 11 18:43:00.154804 ip-10-0-141-55 kubenswrapper[2578]: I0611 18:43:00.154775 2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73qt599" Jun 11 18:43:00.154804 ip-10-0-141-55 kubenswrapper[2578]: I0611 18:43:00.154799 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73qt599" event={"ID":"8e28f713-1aee-425d-990d-dd7fe5f647d2","Type":"ContainerDied","Data":"33b293158e888ad9d71ea58b191daf4b78134017a20b4be7fc6d6babe74ac29b"} Jun 11 18:43:00.155440 ip-10-0-141-55 kubenswrapper[2578]: I0611 18:43:00.154846 2578 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="33b293158e888ad9d71ea58b191daf4b78134017a20b4be7fc6d6babe74ac29b" Jun 11 18:43:00.156620 ip-10-0-141-55 kubenswrapper[2578]: I0611 18:43:00.156587 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759g8tx8" event={"ID":"f5edd135-d5c9-491d-927e-f4b0e470cc8e","Type":"ContainerDied","Data":"274296d75493092a619e34554fce260474f9ecf357993eb0af0858be1009b4a8"} Jun 11 18:43:00.156620 ip-10-0-141-55 kubenswrapper[2578]: I0611 18:43:00.156617 2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759g8tx8" Jun 11 18:43:00.156814 ip-10-0-141-55 kubenswrapper[2578]: I0611 18:43:00.156636 2578 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="274296d75493092a619e34554fce260474f9ecf357993eb0af0858be1009b4a8" Jun 11 18:43:00.287288 ip-10-0-141-55 kubenswrapper[2578]: I0611 18:43:00.287260 2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0bnhll" Jun 11 18:43:00.388457 ip-10-0-141-55 kubenswrapper[2578]: I0611 18:43:00.388422 2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-ns76f\" (UniqueName: \"kubernetes.io/projected/b13ea5a7-e0a4-4e89-9334-14d43479be6c-kube-api-access-ns76f\") pod \"b13ea5a7-e0a4-4e89-9334-14d43479be6c\" (UID: \"b13ea5a7-e0a4-4e89-9334-14d43479be6c\") " Jun 11 18:43:00.388669 ip-10-0-141-55 kubenswrapper[2578]: I0611 18:43:00.388475 2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/b13ea5a7-e0a4-4e89-9334-14d43479be6c-bundle\") pod \"b13ea5a7-e0a4-4e89-9334-14d43479be6c\" (UID: \"b13ea5a7-e0a4-4e89-9334-14d43479be6c\") " Jun 11 18:43:00.388669 ip-10-0-141-55 kubenswrapper[2578]: I0611 18:43:00.388508 2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/b13ea5a7-e0a4-4e89-9334-14d43479be6c-util\") pod \"b13ea5a7-e0a4-4e89-9334-14d43479be6c\" (UID: \"b13ea5a7-e0a4-4e89-9334-14d43479be6c\") " Jun 11 18:43:00.388973 ip-10-0-141-55 kubenswrapper[2578]: I0611 18:43:00.388941 2578 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/b13ea5a7-e0a4-4e89-9334-14d43479be6c-bundle" (OuterVolumeSpecName: "bundle") pod "b13ea5a7-e0a4-4e89-9334-14d43479be6c" (UID: "b13ea5a7-e0a4-4e89-9334-14d43479be6c"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 11 18:43:00.390543 ip-10-0-141-55 kubenswrapper[2578]: I0611 18:43:00.390520 2578 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/b13ea5a7-e0a4-4e89-9334-14d43479be6c-kube-api-access-ns76f" (OuterVolumeSpecName: "kube-api-access-ns76f") pod "b13ea5a7-e0a4-4e89-9334-14d43479be6c" (UID: "b13ea5a7-e0a4-4e89-9334-14d43479be6c"). InnerVolumeSpecName "kube-api-access-ns76f". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 11 18:43:00.396428 ip-10-0-141-55 kubenswrapper[2578]: I0611 18:43:00.396404 2578 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/b13ea5a7-e0a4-4e89-9334-14d43479be6c-util" (OuterVolumeSpecName: "util") pod "b13ea5a7-e0a4-4e89-9334-14d43479be6c" (UID: "b13ea5a7-e0a4-4e89-9334-14d43479be6c"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 11 18:43:00.490074 ip-10-0-141-55 kubenswrapper[2578]: I0611 18:43:00.490043 2578 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-ns76f\" (UniqueName: \"kubernetes.io/projected/b13ea5a7-e0a4-4e89-9334-14d43479be6c-kube-api-access-ns76f\") on node \"ip-10-0-141-55.ec2.internal\" DevicePath \"\"" Jun 11 18:43:00.490074 ip-10-0-141-55 kubenswrapper[2578]: I0611 18:43:00.490068 2578 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/b13ea5a7-e0a4-4e89-9334-14d43479be6c-bundle\") on node \"ip-10-0-141-55.ec2.internal\" DevicePath \"\"" Jun 11 18:43:00.490074 ip-10-0-141-55 kubenswrapper[2578]: I0611 18:43:00.490077 2578 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/b13ea5a7-e0a4-4e89-9334-14d43479be6c-util\") on node \"ip-10-0-141-55.ec2.internal\" DevicePath \"\"" Jun 11 18:43:01.084908 ip-10-0-141-55 kubenswrapper[2578]: I0611 18:43:01.084872 2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-76fb865d89-2szwd"] Jun 11 18:43:01.085184 ip-10-0-141-55 kubenswrapper[2578]: I0611 18:43:01.085173 2578 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="f5edd135-d5c9-491d-927e-f4b0e470cc8e" containerName="util" Jun 11 18:43:01.085237 ip-10-0-141-55 kubenswrapper[2578]: I0611 18:43:01.085186 2578 state_mem.go:107] "Deleted CPUSet assignment" podUID="f5edd135-d5c9-491d-927e-f4b0e470cc8e" containerName="util" Jun 11 18:43:01.085237 ip-10-0-141-55 kubenswrapper[2578]: I0611 18:43:01.085195 2578 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="8e28f713-1aee-425d-990d-dd7fe5f647d2" containerName="extract" Jun 11 18:43:01.085237 ip-10-0-141-55 kubenswrapper[2578]: I0611 18:43:01.085200 2578 state_mem.go:107] "Deleted CPUSet assignment" podUID="8e28f713-1aee-425d-990d-dd7fe5f647d2" containerName="extract" Jun 11 18:43:01.085237 ip-10-0-141-55 kubenswrapper[2578]: I0611 18:43:01.085209 2578 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="8e28f713-1aee-425d-990d-dd7fe5f647d2" containerName="util" Jun 11 18:43:01.085237 ip-10-0-141-55 kubenswrapper[2578]: I0611 18:43:01.085215 2578 state_mem.go:107] "Deleted CPUSet assignment" podUID="8e28f713-1aee-425d-990d-dd7fe5f647d2" containerName="util" Jun 11 18:43:01.085237 ip-10-0-141-55 kubenswrapper[2578]: I0611 18:43:01.085221 2578 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="b1b597f0-6693-4514-9cd6-464df054726c" containerName="pull" Jun 11 18:43:01.085237 ip-10-0-141-55 kubenswrapper[2578]: I0611 18:43:01.085226 2578 state_mem.go:107] "Deleted CPUSet assignment" podUID="b1b597f0-6693-4514-9cd6-464df054726c" containerName="pull" Jun 11 18:43:01.085237 ip-10-0-141-55 kubenswrapper[2578]: I0611 18:43:01.085236 2578 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="b13ea5a7-e0a4-4e89-9334-14d43479be6c" containerName="extract" Jun 11 18:43:01.085476 ip-10-0-141-55 kubenswrapper[2578]: I0611 18:43:01.085243 2578 state_mem.go:107] "Deleted CPUSet assignment" podUID="b13ea5a7-e0a4-4e89-9334-14d43479be6c" containerName="extract" Jun 11 18:43:01.085476 ip-10-0-141-55 kubenswrapper[2578]: I0611 18:43:01.085255 2578 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="f5edd135-d5c9-491d-927e-f4b0e470cc8e" containerName="pull" Jun 11 18:43:01.085476 ip-10-0-141-55 kubenswrapper[2578]: I0611 18:43:01.085260 2578 state_mem.go:107] "Deleted CPUSet assignment" podUID="f5edd135-d5c9-491d-927e-f4b0e470cc8e" containerName="pull" Jun 11 18:43:01.085476 ip-10-0-141-55 kubenswrapper[2578]: I0611 18:43:01.085267 2578 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="b1b597f0-6693-4514-9cd6-464df054726c" containerName="extract" Jun 11 18:43:01.085476 ip-10-0-141-55 kubenswrapper[2578]: I0611 18:43:01.085272 2578 state_mem.go:107] "Deleted CPUSet assignment" podUID="b1b597f0-6693-4514-9cd6-464df054726c" containerName="extract" Jun 11 18:43:01.085476 ip-10-0-141-55 kubenswrapper[2578]: I0611 18:43:01.085278 2578 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="b13ea5a7-e0a4-4e89-9334-14d43479be6c" containerName="pull" Jun 11 18:43:01.085476 ip-10-0-141-55 kubenswrapper[2578]: I0611 18:43:01.085283 2578 state_mem.go:107] "Deleted CPUSet assignment" podUID="b13ea5a7-e0a4-4e89-9334-14d43479be6c" containerName="pull" Jun 11 18:43:01.085476 ip-10-0-141-55 kubenswrapper[2578]: I0611 18:43:01.085289 2578 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="f5edd135-d5c9-491d-927e-f4b0e470cc8e" containerName="extract" Jun 11 18:43:01.085476 ip-10-0-141-55 kubenswrapper[2578]: I0611 18:43:01.085294 2578 state_mem.go:107] "Deleted CPUSet assignment" podUID="f5edd135-d5c9-491d-927e-f4b0e470cc8e" containerName="extract" Jun 11 18:43:01.085476 ip-10-0-141-55 kubenswrapper[2578]: I0611 18:43:01.085303 2578 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="b13ea5a7-e0a4-4e89-9334-14d43479be6c" containerName="util" Jun 11 18:43:01.085476 ip-10-0-141-55 kubenswrapper[2578]: I0611 18:43:01.085308 2578 state_mem.go:107] "Deleted CPUSet assignment" podUID="b13ea5a7-e0a4-4e89-9334-14d43479be6c" containerName="util" Jun 11 18:43:01.085476 ip-10-0-141-55 kubenswrapper[2578]: I0611 18:43:01.085314 2578 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="8e28f713-1aee-425d-990d-dd7fe5f647d2" containerName="pull" Jun 11 18:43:01.085476 ip-10-0-141-55 kubenswrapper[2578]: I0611 18:43:01.085319 2578 state_mem.go:107] "Deleted CPUSet assignment" podUID="8e28f713-1aee-425d-990d-dd7fe5f647d2" containerName="pull" Jun 11 18:43:01.085476 ip-10-0-141-55 kubenswrapper[2578]: I0611 18:43:01.085325 2578 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="b1b597f0-6693-4514-9cd6-464df054726c" containerName="util" Jun 11 18:43:01.085476 ip-10-0-141-55 kubenswrapper[2578]: I0611 18:43:01.085329 2578 state_mem.go:107] "Deleted CPUSet assignment" podUID="b1b597f0-6693-4514-9cd6-464df054726c" containerName="util" Jun 11 18:43:01.085476 ip-10-0-141-55 kubenswrapper[2578]: I0611 18:43:01.085373 2578 memory_manager.go:368] "RemoveStaleState removing state" podUID="f5edd135-d5c9-491d-927e-f4b0e470cc8e" containerName="extract" Jun 11 18:43:01.085476 ip-10-0-141-55 kubenswrapper[2578]: I0611 18:43:01.085380 2578 memory_manager.go:368] "RemoveStaleState removing state" podUID="b13ea5a7-e0a4-4e89-9334-14d43479be6c" containerName="extract" Jun 11 18:43:01.085476 ip-10-0-141-55 kubenswrapper[2578]: I0611 18:43:01.085388 2578 memory_manager.go:368] "RemoveStaleState removing state" podUID="8e28f713-1aee-425d-990d-dd7fe5f647d2" containerName="extract" Jun 11 18:43:01.085476 ip-10-0-141-55 kubenswrapper[2578]: I0611 18:43:01.085395 2578 memory_manager.go:368] "RemoveStaleState removing state" podUID="b1b597f0-6693-4514-9cd6-464df054726c" containerName="extract" Jun 11 18:43:01.088431 ip-10-0-141-55 kubenswrapper[2578]: I0611 18:43:01.088415 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-76fb865d89-2szwd" Jun 11 18:43:01.101833 ip-10-0-141-55 kubenswrapper[2578]: I0611 18:43:01.101806 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-76fb865d89-2szwd"] Jun 11 18:43:01.163143 ip-10-0-141-55 kubenswrapper[2578]: I0611 18:43:01.163122 2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0bnhll" Jun 11 18:43:01.163537 ip-10-0-141-55 kubenswrapper[2578]: I0611 18:43:01.163118 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0bnhll" event={"ID":"b13ea5a7-e0a4-4e89-9334-14d43479be6c","Type":"ContainerDied","Data":"546f6348b9ba993540400af31a64dfbade7b70816cf133b9a76a0eb6cf241522"} Jun 11 18:43:01.163537 ip-10-0-141-55 kubenswrapper[2578]: I0611 18:43:01.163228 2578 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="546f6348b9ba993540400af31a64dfbade7b70816cf133b9a76a0eb6cf241522" Jun 11 18:43:01.196381 ip-10-0-141-55 kubenswrapper[2578]: I0611 18:43:01.196354 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/37720503-e6f4-4926-bc3a-421c6bb2734f-oauth-serving-cert\") pod \"console-76fb865d89-2szwd\" (UID: \"37720503-e6f4-4926-bc3a-421c6bb2734f\") " pod="openshift-console/console-76fb865d89-2szwd" Jun 11 18:43:01.196495 ip-10-0-141-55 kubenswrapper[2578]: I0611 18:43:01.196387 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/37720503-e6f4-4926-bc3a-421c6bb2734f-trusted-ca-bundle\") pod \"console-76fb865d89-2szwd\" (UID: \"37720503-e6f4-4926-bc3a-421c6bb2734f\") " pod="openshift-console/console-76fb865d89-2szwd" Jun 11 18:43:01.196495 ip-10-0-141-55 kubenswrapper[2578]: I0611 18:43:01.196409 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/37720503-e6f4-4926-bc3a-421c6bb2734f-console-config\") pod \"console-76fb865d89-2szwd\" (UID: \"37720503-e6f4-4926-bc3a-421c6bb2734f\") " pod="openshift-console/console-76fb865d89-2szwd" Jun 11 18:43:01.196495 ip-10-0-141-55 kubenswrapper[2578]: I0611 18:43:01.196470 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/37720503-e6f4-4926-bc3a-421c6bb2734f-console-serving-cert\") pod \"console-76fb865d89-2szwd\" (UID: \"37720503-e6f4-4926-bc3a-421c6bb2734f\") " pod="openshift-console/console-76fb865d89-2szwd" Jun 11 18:43:01.196641 ip-10-0-141-55 kubenswrapper[2578]: I0611 18:43:01.196525 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/37720503-e6f4-4926-bc3a-421c6bb2734f-console-oauth-config\") pod \"console-76fb865d89-2szwd\" (UID: \"37720503-e6f4-4926-bc3a-421c6bb2734f\") " pod="openshift-console/console-76fb865d89-2szwd" Jun 11 18:43:01.196641 ip-10-0-141-55 kubenswrapper[2578]: I0611 18:43:01.196547 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-nsd8z\" (UniqueName: \"kubernetes.io/projected/37720503-e6f4-4926-bc3a-421c6bb2734f-kube-api-access-nsd8z\") pod \"console-76fb865d89-2szwd\" (UID: \"37720503-e6f4-4926-bc3a-421c6bb2734f\") " pod="openshift-console/console-76fb865d89-2szwd" Jun 11 18:43:01.196641 ip-10-0-141-55 kubenswrapper[2578]: I0611 18:43:01.196591 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/37720503-e6f4-4926-bc3a-421c6bb2734f-service-ca\") pod \"console-76fb865d89-2szwd\" (UID: \"37720503-e6f4-4926-bc3a-421c6bb2734f\") " pod="openshift-console/console-76fb865d89-2szwd" Jun 11 18:43:01.297252 ip-10-0-141-55 kubenswrapper[2578]: I0611 18:43:01.297220 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/37720503-e6f4-4926-bc3a-421c6bb2734f-oauth-serving-cert\") pod \"console-76fb865d89-2szwd\" (UID: \"37720503-e6f4-4926-bc3a-421c6bb2734f\") " pod="openshift-console/console-76fb865d89-2szwd" Jun 11 18:43:01.297409 ip-10-0-141-55 kubenswrapper[2578]: I0611 18:43:01.297257 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/37720503-e6f4-4926-bc3a-421c6bb2734f-trusted-ca-bundle\") pod \"console-76fb865d89-2szwd\" (UID: \"37720503-e6f4-4926-bc3a-421c6bb2734f\") " pod="openshift-console/console-76fb865d89-2szwd" Jun 11 18:43:01.297409 ip-10-0-141-55 kubenswrapper[2578]: I0611 18:43:01.297283 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/37720503-e6f4-4926-bc3a-421c6bb2734f-console-config\") pod \"console-76fb865d89-2szwd\" (UID: \"37720503-e6f4-4926-bc3a-421c6bb2734f\") " pod="openshift-console/console-76fb865d89-2szwd" Jun 11 18:43:01.297409 ip-10-0-141-55 kubenswrapper[2578]: I0611 18:43:01.297325 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/37720503-e6f4-4926-bc3a-421c6bb2734f-console-serving-cert\") pod \"console-76fb865d89-2szwd\" (UID: \"37720503-e6f4-4926-bc3a-421c6bb2734f\") " pod="openshift-console/console-76fb865d89-2szwd" Jun 11 18:43:01.297409 ip-10-0-141-55 kubenswrapper[2578]: I0611 18:43:01.297356 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/37720503-e6f4-4926-bc3a-421c6bb2734f-console-oauth-config\") pod \"console-76fb865d89-2szwd\" (UID: \"37720503-e6f4-4926-bc3a-421c6bb2734f\") " pod="openshift-console/console-76fb865d89-2szwd" Jun 11 18:43:01.297409 ip-10-0-141-55 kubenswrapper[2578]: I0611 18:43:01.297385 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-nsd8z\" (UniqueName: \"kubernetes.io/projected/37720503-e6f4-4926-bc3a-421c6bb2734f-kube-api-access-nsd8z\") pod \"console-76fb865d89-2szwd\" (UID: \"37720503-e6f4-4926-bc3a-421c6bb2734f\") " pod="openshift-console/console-76fb865d89-2szwd" Jun 11 18:43:01.297686 ip-10-0-141-55 kubenswrapper[2578]: I0611 18:43:01.297504 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/37720503-e6f4-4926-bc3a-421c6bb2734f-service-ca\") pod \"console-76fb865d89-2szwd\" (UID: \"37720503-e6f4-4926-bc3a-421c6bb2734f\") " pod="openshift-console/console-76fb865d89-2szwd" Jun 11 18:43:01.298092 ip-10-0-141-55 kubenswrapper[2578]: I0611 18:43:01.298072 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/37720503-e6f4-4926-bc3a-421c6bb2734f-console-config\") pod \"console-76fb865d89-2szwd\" (UID: \"37720503-e6f4-4926-bc3a-421c6bb2734f\") " pod="openshift-console/console-76fb865d89-2szwd" Jun 11 18:43:01.298092 ip-10-0-141-55 kubenswrapper[2578]: I0611 18:43:01.298086 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/37720503-e6f4-4926-bc3a-421c6bb2734f-oauth-serving-cert\") pod \"console-76fb865d89-2szwd\" (UID: \"37720503-e6f4-4926-bc3a-421c6bb2734f\") " pod="openshift-console/console-76fb865d89-2szwd" Jun 11 18:43:01.298242 ip-10-0-141-55 kubenswrapper[2578]: I0611 18:43:01.298157 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/37720503-e6f4-4926-bc3a-421c6bb2734f-trusted-ca-bundle\") pod \"console-76fb865d89-2szwd\" (UID: \"37720503-e6f4-4926-bc3a-421c6bb2734f\") " pod="openshift-console/console-76fb865d89-2szwd" Jun 11 18:43:01.298302 ip-10-0-141-55 kubenswrapper[2578]: I0611 18:43:01.298260 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/37720503-e6f4-4926-bc3a-421c6bb2734f-service-ca\") pod \"console-76fb865d89-2szwd\" (UID: \"37720503-e6f4-4926-bc3a-421c6bb2734f\") " pod="openshift-console/console-76fb865d89-2szwd" Jun 11 18:43:01.299792 ip-10-0-141-55 kubenswrapper[2578]: I0611 18:43:01.299775 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/37720503-e6f4-4926-bc3a-421c6bb2734f-console-oauth-config\") pod \"console-76fb865d89-2szwd\" (UID: \"37720503-e6f4-4926-bc3a-421c6bb2734f\") " pod="openshift-console/console-76fb865d89-2szwd" Jun 11 18:43:01.299875 ip-10-0-141-55 kubenswrapper[2578]: I0611 18:43:01.299866 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/37720503-e6f4-4926-bc3a-421c6bb2734f-console-serving-cert\") pod \"console-76fb865d89-2szwd\" (UID: \"37720503-e6f4-4926-bc3a-421c6bb2734f\") " pod="openshift-console/console-76fb865d89-2szwd" Jun 11 18:43:01.306328 ip-10-0-141-55 kubenswrapper[2578]: I0611 18:43:01.306308 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-nsd8z\" (UniqueName: \"kubernetes.io/projected/37720503-e6f4-4926-bc3a-421c6bb2734f-kube-api-access-nsd8z\") pod \"console-76fb865d89-2szwd\" (UID: \"37720503-e6f4-4926-bc3a-421c6bb2734f\") " pod="openshift-console/console-76fb865d89-2szwd" Jun 11 18:43:01.397737 ip-10-0-141-55 kubenswrapper[2578]: I0611 18:43:01.397712 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-76fb865d89-2szwd" Jun 11 18:43:01.527025 ip-10-0-141-55 kubenswrapper[2578]: I0611 18:43:01.526997 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-76fb865d89-2szwd"] Jun 11 18:43:01.528700 ip-10-0-141-55 kubenswrapper[2578]: W0611 18:43:01.528672 2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod37720503_e6f4_4926_bc3a_421c6bb2734f.slice/crio-10ac046ceae1aeff650c08b95d971533a400260fc50c7946d7baf26d4616f785 WatchSource:0}: Error finding container 10ac046ceae1aeff650c08b95d971533a400260fc50c7946d7baf26d4616f785: Status 404 returned error can't find the container with id 10ac046ceae1aeff650c08b95d971533a400260fc50c7946d7baf26d4616f785 Jun 11 18:43:02.169805 ip-10-0-141-55 kubenswrapper[2578]: I0611 18:43:02.169763 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-76fb865d89-2szwd" event={"ID":"37720503-e6f4-4926-bc3a-421c6bb2734f","Type":"ContainerStarted","Data":"da1a8ebf0f60732a328c3f4aa5b29a715ab064a6820de7726366ca04987cd62e"} Jun 11 18:43:02.170246 ip-10-0-141-55 kubenswrapper[2578]: I0611 18:43:02.169840 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-76fb865d89-2szwd" event={"ID":"37720503-e6f4-4926-bc3a-421c6bb2734f","Type":"ContainerStarted","Data":"10ac046ceae1aeff650c08b95d971533a400260fc50c7946d7baf26d4616f785"} Jun 11 18:43:02.193579 ip-10-0-141-55 kubenswrapper[2578]: I0611 18:43:02.193507 2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-76fb865d89-2szwd" podStartSLOduration=1.193492729 podStartE2EDuration="1.193492729s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-11 18:43:01 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-11 18:43:02.19234572 +0000 UTC m=+388.147020347" watchObservedRunningTime="2026-06-11 18:43:02.193492729 +0000 UTC m=+388.148167337" Jun 11 18:43:11.398018 ip-10-0-141-55 kubenswrapper[2578]: I0611 18:43:11.397975 2578 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-76fb865d89-2szwd" Jun 11 18:43:11.398498 ip-10-0-141-55 kubenswrapper[2578]: I0611 18:43:11.398048 2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-76fb865d89-2szwd" Jun 11 18:43:11.402531 ip-10-0-141-55 kubenswrapper[2578]: I0611 18:43:11.402509 2578 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-76fb865d89-2szwd" Jun 11 18:43:12.224853 ip-10-0-141-55 kubenswrapper[2578]: I0611 18:43:12.224825 2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-76fb865d89-2szwd" Jun 11 18:43:12.274412 ip-10-0-141-55 kubenswrapper[2578]: I0611 18:43:12.274382 2578 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-787746448-bq45m"] Jun 11 18:43:22.803945 ip-10-0-141-55 kubenswrapper[2578]: I0611 18:43:22.803909 2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-dvv7c"] Jun 11 18:43:22.807263 ip-10-0-141-55 kubenswrapper[2578]: I0611 18:43:22.807245 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-dvv7c" Jun 11 18:43:22.810108 ip-10-0-141-55 kubenswrapper[2578]: I0611 18:43:22.810091 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"kube-root-ca.crt\"" Jun 11 18:43:22.810228 ip-10-0-141-55 kubenswrapper[2578]: I0611 18:43:22.810127 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"kuadrant-operator-controller-manager-dockercfg-4xmkb\"" Jun 11 18:43:22.810322 ip-10-0-141-55 kubenswrapper[2578]: I0611 18:43:22.810310 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"openshift-service-ca.crt\"" Jun 11 18:43:22.821683 ip-10-0-141-55 kubenswrapper[2578]: I0611 18:43:22.821662 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-dvv7c"] Jun 11 18:43:22.884484 ip-10-0-141-55 kubenswrapper[2578]: I0611 18:43:22.884451 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/5f254fd0-550b-4b8f-ab14-0bb3fba9e405-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-8684c9ff49-dvv7c\" (UID: \"5f254fd0-550b-4b8f-ab14-0bb3fba9e405\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-dvv7c" Jun 11 18:43:22.884666 ip-10-0-141-55 kubenswrapper[2578]: I0611 18:43:22.884501 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-lpcwz\" (UniqueName: \"kubernetes.io/projected/5f254fd0-550b-4b8f-ab14-0bb3fba9e405-kube-api-access-lpcwz\") pod \"kuadrant-operator-controller-manager-8684c9ff49-dvv7c\" (UID: \"5f254fd0-550b-4b8f-ab14-0bb3fba9e405\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-dvv7c" Jun 11 18:43:22.985120 ip-10-0-141-55 kubenswrapper[2578]: I0611 18:43:22.985086 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-lpcwz\" (UniqueName: \"kubernetes.io/projected/5f254fd0-550b-4b8f-ab14-0bb3fba9e405-kube-api-access-lpcwz\") pod \"kuadrant-operator-controller-manager-8684c9ff49-dvv7c\" (UID: \"5f254fd0-550b-4b8f-ab14-0bb3fba9e405\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-dvv7c" Jun 11 18:43:22.985296 ip-10-0-141-55 kubenswrapper[2578]: I0611 18:43:22.985190 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/5f254fd0-550b-4b8f-ab14-0bb3fba9e405-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-8684c9ff49-dvv7c\" (UID: \"5f254fd0-550b-4b8f-ab14-0bb3fba9e405\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-dvv7c" Jun 11 18:43:22.985594 ip-10-0-141-55 kubenswrapper[2578]: I0611 18:43:22.985547 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/5f254fd0-550b-4b8f-ab14-0bb3fba9e405-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-8684c9ff49-dvv7c\" (UID: \"5f254fd0-550b-4b8f-ab14-0bb3fba9e405\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-dvv7c" Jun 11 18:43:22.995300 ip-10-0-141-55 kubenswrapper[2578]: I0611 18:43:22.995279 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-lpcwz\" (UniqueName: \"kubernetes.io/projected/5f254fd0-550b-4b8f-ab14-0bb3fba9e405-kube-api-access-lpcwz\") pod \"kuadrant-operator-controller-manager-8684c9ff49-dvv7c\" (UID: \"5f254fd0-550b-4b8f-ab14-0bb3fba9e405\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-dvv7c" Jun 11 18:43:23.117856 ip-10-0-141-55 kubenswrapper[2578]: I0611 18:43:23.117817 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-dvv7c" Jun 11 18:43:23.251057 ip-10-0-141-55 kubenswrapper[2578]: I0611 18:43:23.251029 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-dvv7c"] Jun 11 18:43:23.252496 ip-10-0-141-55 kubenswrapper[2578]: W0611 18:43:23.252462 2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5f254fd0_550b_4b8f_ab14_0bb3fba9e405.slice/crio-cdd5226a16a14fd96de0e99616e7456ff502b35a7874ac244b70ed143bb81aef WatchSource:0}: Error finding container cdd5226a16a14fd96de0e99616e7456ff502b35a7874ac244b70ed143bb81aef: Status 404 returned error can't find the container with id cdd5226a16a14fd96de0e99616e7456ff502b35a7874ac244b70ed143bb81aef Jun 11 18:43:23.280405 ip-10-0-141-55 kubenswrapper[2578]: I0611 18:43:23.280373 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-dvv7c" event={"ID":"5f254fd0-550b-4b8f-ab14-0bb3fba9e405","Type":"ContainerStarted","Data":"cdd5226a16a14fd96de0e99616e7456ff502b35a7874ac244b70ed143bb81aef"} Jun 11 18:43:31.325533 ip-10-0-141-55 kubenswrapper[2578]: I0611 18:43:31.325498 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-dvv7c" event={"ID":"5f254fd0-550b-4b8f-ab14-0bb3fba9e405","Type":"ContainerStarted","Data":"6c5b7dafa476e1bd0563e5790bf06f59e6ac3b65dcaaef95e6724ded7220f70f"} Jun 11 18:43:31.326043 ip-10-0-141-55 kubenswrapper[2578]: I0611 18:43:31.325602 2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-dvv7c" Jun 11 18:43:31.355674 ip-10-0-141-55 kubenswrapper[2578]: I0611 18:43:31.355620 2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-dvv7c" podStartSLOduration=2.305734184 podStartE2EDuration="9.355603571s" totalImagesPullingTime="7.049869387s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-11 18:43:22 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-11 18:43:31.355266257 +0000 UTC m=+417.309940885" watchObservedRunningTime="2026-06-11 18:43:31.355603571 +0000 UTC m=+417.310278236" Jun 11 18:43:33.378897 ip-10-0-141-55 kubenswrapper[2578]: I0611 18:43:33.378860 2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-console-plugin-66b5774985-898xf"] Jun 11 18:43:33.382477 ip-10-0-141-55 kubenswrapper[2578]: I0611 18:43:33.382456 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-console-plugin-66b5774985-898xf" Jun 11 18:43:33.385372 ip-10-0-141-55 kubenswrapper[2578]: I0611 18:43:33.385350 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"default-dockercfg-pz7qv\"" Jun 11 18:43:33.385494 ip-10-0-141-55 kubenswrapper[2578]: I0611 18:43:33.385350 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"kuadrant-console-nginx-conf\"" Jun 11 18:43:33.385494 ip-10-0-141-55 kubenswrapper[2578]: I0611 18:43:33.385350 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"plugin-serving-cert\"" Jun 11 18:43:33.391366 ip-10-0-141-55 kubenswrapper[2578]: I0611 18:43:33.391346 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-console-plugin-66b5774985-898xf"] Jun 11 18:43:33.576707 ip-10-0-141-55 kubenswrapper[2578]: I0611 18:43:33.576669 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugin-serving-cert\" (UniqueName: \"kubernetes.io/secret/f18861ba-f841-41cc-8089-ce4e585910a0-plugin-serving-cert\") pod \"kuadrant-console-plugin-66b5774985-898xf\" (UID: \"f18861ba-f841-41cc-8089-ce4e585910a0\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-898xf" Jun 11 18:43:33.576873 ip-10-0-141-55 kubenswrapper[2578]: I0611 18:43:33.576789 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/f18861ba-f841-41cc-8089-ce4e585910a0-nginx-conf\") pod \"kuadrant-console-plugin-66b5774985-898xf\" (UID: \"f18861ba-f841-41cc-8089-ce4e585910a0\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-898xf" Jun 11 18:43:33.576873 ip-10-0-141-55 kubenswrapper[2578]: I0611 18:43:33.576867 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mf84k\" (UniqueName: \"kubernetes.io/projected/f18861ba-f841-41cc-8089-ce4e585910a0-kube-api-access-mf84k\") pod \"kuadrant-console-plugin-66b5774985-898xf\" (UID: \"f18861ba-f841-41cc-8089-ce4e585910a0\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-898xf" Jun 11 18:43:33.677763 ip-10-0-141-55 kubenswrapper[2578]: I0611 18:43:33.677680 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/f18861ba-f841-41cc-8089-ce4e585910a0-nginx-conf\") pod \"kuadrant-console-plugin-66b5774985-898xf\" (UID: \"f18861ba-f841-41cc-8089-ce4e585910a0\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-898xf" Jun 11 18:43:33.677763 ip-10-0-141-55 kubenswrapper[2578]: I0611 18:43:33.677747 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mf84k\" (UniqueName: \"kubernetes.io/projected/f18861ba-f841-41cc-8089-ce4e585910a0-kube-api-access-mf84k\") pod \"kuadrant-console-plugin-66b5774985-898xf\" (UID: \"f18861ba-f841-41cc-8089-ce4e585910a0\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-898xf" Jun 11 18:43:33.677948 ip-10-0-141-55 kubenswrapper[2578]: I0611 18:43:33.677786 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugin-serving-cert\" (UniqueName: \"kubernetes.io/secret/f18861ba-f841-41cc-8089-ce4e585910a0-plugin-serving-cert\") pod \"kuadrant-console-plugin-66b5774985-898xf\" (UID: \"f18861ba-f841-41cc-8089-ce4e585910a0\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-898xf" Jun 11 18:43:33.678456 ip-10-0-141-55 kubenswrapper[2578]: I0611 18:43:33.678427 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/f18861ba-f841-41cc-8089-ce4e585910a0-nginx-conf\") pod \"kuadrant-console-plugin-66b5774985-898xf\" (UID: \"f18861ba-f841-41cc-8089-ce4e585910a0\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-898xf" Jun 11 18:43:33.680173 ip-10-0-141-55 kubenswrapper[2578]: I0611 18:43:33.680142 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"plugin-serving-cert\" (UniqueName: \"kubernetes.io/secret/f18861ba-f841-41cc-8089-ce4e585910a0-plugin-serving-cert\") pod \"kuadrant-console-plugin-66b5774985-898xf\" (UID: \"f18861ba-f841-41cc-8089-ce4e585910a0\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-898xf" Jun 11 18:43:33.687664 ip-10-0-141-55 kubenswrapper[2578]: I0611 18:43:33.687633 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-mf84k\" (UniqueName: \"kubernetes.io/projected/f18861ba-f841-41cc-8089-ce4e585910a0-kube-api-access-mf84k\") pod \"kuadrant-console-plugin-66b5774985-898xf\" (UID: \"f18861ba-f841-41cc-8089-ce4e585910a0\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-898xf" Jun 11 18:43:33.692646 ip-10-0-141-55 kubenswrapper[2578]: I0611 18:43:33.692627 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-console-plugin-66b5774985-898xf" Jun 11 18:43:33.825039 ip-10-0-141-55 kubenswrapper[2578]: I0611 18:43:33.824998 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-console-plugin-66b5774985-898xf"] Jun 11 18:43:33.826887 ip-10-0-141-55 kubenswrapper[2578]: W0611 18:43:33.826860 2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podf18861ba_f841_41cc_8089_ce4e585910a0.slice/crio-0630730c0cfa403858d2d70374201eb33ad37bdf33c244ab9900d4052200dc62 WatchSource:0}: Error finding container 0630730c0cfa403858d2d70374201eb33ad37bdf33c244ab9900d4052200dc62: Status 404 returned error can't find the container with id 0630730c0cfa403858d2d70374201eb33ad37bdf33c244ab9900d4052200dc62 Jun 11 18:43:34.343134 ip-10-0-141-55 kubenswrapper[2578]: I0611 18:43:34.343102 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-console-plugin-66b5774985-898xf" event={"ID":"f18861ba-f841-41cc-8089-ce4e585910a0","Type":"ContainerStarted","Data":"0630730c0cfa403858d2d70374201eb33ad37bdf33c244ab9900d4052200dc62"} Jun 11 18:43:37.294164 ip-10-0-141-55 kubenswrapper[2578]: I0611 18:43:37.294090 2578 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-console/console-787746448-bq45m" podUID="61cd963d-bb28-4867-953b-08557c6e2a36" containerName="console" containerID="cri-o://65da68c994baf54733fb44c8dd9307e4b0c9fd90068f49c139a592e6ddae5fea" gracePeriod=15 Jun 11 18:43:37.572548 ip-10-0-141-55 kubenswrapper[2578]: I0611 18:43:37.572521 2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-787746448-bq45m" Jun 11 18:43:37.615044 ip-10-0-141-55 kubenswrapper[2578]: I0611 18:43:37.615004 2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/61cd963d-bb28-4867-953b-08557c6e2a36-oauth-serving-cert\") pod \"61cd963d-bb28-4867-953b-08557c6e2a36\" (UID: \"61cd963d-bb28-4867-953b-08557c6e2a36\") " Jun 11 18:43:37.615271 ip-10-0-141-55 kubenswrapper[2578]: I0611 18:43:37.615081 2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/61cd963d-bb28-4867-953b-08557c6e2a36-console-serving-cert\") pod \"61cd963d-bb28-4867-953b-08557c6e2a36\" (UID: \"61cd963d-bb28-4867-953b-08557c6e2a36\") " Jun 11 18:43:37.615271 ip-10-0-141-55 kubenswrapper[2578]: I0611 18:43:37.615108 2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/61cd963d-bb28-4867-953b-08557c6e2a36-console-config\") pod \"61cd963d-bb28-4867-953b-08557c6e2a36\" (UID: \"61cd963d-bb28-4867-953b-08557c6e2a36\") " Jun 11 18:43:37.615271 ip-10-0-141-55 kubenswrapper[2578]: I0611 18:43:37.615143 2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/61cd963d-bb28-4867-953b-08557c6e2a36-trusted-ca-bundle\") pod \"61cd963d-bb28-4867-953b-08557c6e2a36\" (UID: \"61cd963d-bb28-4867-953b-08557c6e2a36\") " Jun 11 18:43:37.615271 ip-10-0-141-55 kubenswrapper[2578]: I0611 18:43:37.615173 2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/61cd963d-bb28-4867-953b-08557c6e2a36-console-oauth-config\") pod \"61cd963d-bb28-4867-953b-08557c6e2a36\" (UID: \"61cd963d-bb28-4867-953b-08557c6e2a36\") " Jun 11 18:43:37.615271 ip-10-0-141-55 kubenswrapper[2578]: I0611 18:43:37.615211 2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-9thv6\" (UniqueName: \"kubernetes.io/projected/61cd963d-bb28-4867-953b-08557c6e2a36-kube-api-access-9thv6\") pod \"61cd963d-bb28-4867-953b-08557c6e2a36\" (UID: \"61cd963d-bb28-4867-953b-08557c6e2a36\") " Jun 11 18:43:37.615571 ip-10-0-141-55 kubenswrapper[2578]: I0611 18:43:37.615369 2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/61cd963d-bb28-4867-953b-08557c6e2a36-service-ca\") pod \"61cd963d-bb28-4867-953b-08557c6e2a36\" (UID: \"61cd963d-bb28-4867-953b-08557c6e2a36\") " Jun 11 18:43:37.615571 ip-10-0-141-55 kubenswrapper[2578]: I0611 18:43:37.615451 2578 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/61cd963d-bb28-4867-953b-08557c6e2a36-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "61cd963d-bb28-4867-953b-08557c6e2a36" (UID: "61cd963d-bb28-4867-953b-08557c6e2a36"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 11 18:43:37.615845 ip-10-0-141-55 kubenswrapper[2578]: I0611 18:43:37.615822 2578 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/61cd963d-bb28-4867-953b-08557c6e2a36-oauth-serving-cert\") on node \"ip-10-0-141-55.ec2.internal\" DevicePath \"\"" Jun 11 18:43:37.616327 ip-10-0-141-55 kubenswrapper[2578]: I0611 18:43:37.616303 2578 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/61cd963d-bb28-4867-953b-08557c6e2a36-trusted-ca-bundle" (OuterVolumeSpecName: "trusted-ca-bundle") pod "61cd963d-bb28-4867-953b-08557c6e2a36" (UID: "61cd963d-bb28-4867-953b-08557c6e2a36"). InnerVolumeSpecName "trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 11 18:43:37.616725 ip-10-0-141-55 kubenswrapper[2578]: I0611 18:43:37.616676 2578 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/61cd963d-bb28-4867-953b-08557c6e2a36-service-ca" (OuterVolumeSpecName: "service-ca") pod "61cd963d-bb28-4867-953b-08557c6e2a36" (UID: "61cd963d-bb28-4867-953b-08557c6e2a36"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 11 18:43:37.616813 ip-10-0-141-55 kubenswrapper[2578]: I0611 18:43:37.616748 2578 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/61cd963d-bb28-4867-953b-08557c6e2a36-console-config" (OuterVolumeSpecName: "console-config") pod "61cd963d-bb28-4867-953b-08557c6e2a36" (UID: "61cd963d-bb28-4867-953b-08557c6e2a36"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 11 18:43:37.618295 ip-10-0-141-55 kubenswrapper[2578]: I0611 18:43:37.618272 2578 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/61cd963d-bb28-4867-953b-08557c6e2a36-kube-api-access-9thv6" (OuterVolumeSpecName: "kube-api-access-9thv6") pod "61cd963d-bb28-4867-953b-08557c6e2a36" (UID: "61cd963d-bb28-4867-953b-08557c6e2a36"). InnerVolumeSpecName "kube-api-access-9thv6". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 11 18:43:37.618457 ip-10-0-141-55 kubenswrapper[2578]: I0611 18:43:37.618430 2578 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/61cd963d-bb28-4867-953b-08557c6e2a36-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "61cd963d-bb28-4867-953b-08557c6e2a36" (UID: "61cd963d-bb28-4867-953b-08557c6e2a36"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 11 18:43:37.618530 ip-10-0-141-55 kubenswrapper[2578]: I0611 18:43:37.618477 2578 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/61cd963d-bb28-4867-953b-08557c6e2a36-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "61cd963d-bb28-4867-953b-08557c6e2a36" (UID: "61cd963d-bb28-4867-953b-08557c6e2a36"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 11 18:43:37.717318 ip-10-0-141-55 kubenswrapper[2578]: I0611 18:43:37.717283 2578 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/61cd963d-bb28-4867-953b-08557c6e2a36-service-ca\") on node \"ip-10-0-141-55.ec2.internal\" DevicePath \"\"" Jun 11 18:43:37.717318 ip-10-0-141-55 kubenswrapper[2578]: I0611 18:43:37.717311 2578 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/61cd963d-bb28-4867-953b-08557c6e2a36-console-serving-cert\") on node \"ip-10-0-141-55.ec2.internal\" DevicePath \"\"" Jun 11 18:43:37.717318 ip-10-0-141-55 kubenswrapper[2578]: I0611 18:43:37.717322 2578 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/61cd963d-bb28-4867-953b-08557c6e2a36-console-config\") on node \"ip-10-0-141-55.ec2.internal\" DevicePath \"\"" Jun 11 18:43:37.717542 ip-10-0-141-55 kubenswrapper[2578]: I0611 18:43:37.717331 2578 reconciler_common.go:299] "Volume detached for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/61cd963d-bb28-4867-953b-08557c6e2a36-trusted-ca-bundle\") on node \"ip-10-0-141-55.ec2.internal\" DevicePath \"\"" Jun 11 18:43:37.717542 ip-10-0-141-55 kubenswrapper[2578]: I0611 18:43:37.717339 2578 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/61cd963d-bb28-4867-953b-08557c6e2a36-console-oauth-config\") on node \"ip-10-0-141-55.ec2.internal\" DevicePath \"\"" Jun 11 18:43:37.717542 ip-10-0-141-55 kubenswrapper[2578]: I0611 18:43:37.717348 2578 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-9thv6\" (UniqueName: \"kubernetes.io/projected/61cd963d-bb28-4867-953b-08557c6e2a36-kube-api-access-9thv6\") on node \"ip-10-0-141-55.ec2.internal\" DevicePath \"\"" Jun 11 18:43:38.368763 ip-10-0-141-55 kubenswrapper[2578]: I0611 18:43:38.368722 2578 generic.go:356] "Generic (PLEG): container finished" podID="61cd963d-bb28-4867-953b-08557c6e2a36" containerID="65da68c994baf54733fb44c8dd9307e4b0c9fd90068f49c139a592e6ddae5fea" exitCode=0 Jun 11 18:43:38.369242 ip-10-0-141-55 kubenswrapper[2578]: I0611 18:43:38.368764 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-787746448-bq45m" event={"ID":"61cd963d-bb28-4867-953b-08557c6e2a36","Type":"ContainerDied","Data":"65da68c994baf54733fb44c8dd9307e4b0c9fd90068f49c139a592e6ddae5fea"} Jun 11 18:43:38.369242 ip-10-0-141-55 kubenswrapper[2578]: I0611 18:43:38.368837 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-787746448-bq45m" event={"ID":"61cd963d-bb28-4867-953b-08557c6e2a36","Type":"ContainerDied","Data":"cff9f57e4527bcac2d7d52e902b887a420bf04093188d9e0e99af5632e942bf0"} Jun 11 18:43:38.369242 ip-10-0-141-55 kubenswrapper[2578]: I0611 18:43:38.368868 2578 scope.go:117] "RemoveContainer" containerID="65da68c994baf54733fb44c8dd9307e4b0c9fd90068f49c139a592e6ddae5fea" Jun 11 18:43:38.369242 ip-10-0-141-55 kubenswrapper[2578]: I0611 18:43:38.368776 2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-787746448-bq45m" Jun 11 18:43:38.398311 ip-10-0-141-55 kubenswrapper[2578]: I0611 18:43:38.398280 2578 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-787746448-bq45m"] Jun 11 18:43:38.403545 ip-10-0-141-55 kubenswrapper[2578]: I0611 18:43:38.403519 2578 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-787746448-bq45m"] Jun 11 18:43:38.425537 ip-10-0-141-55 kubenswrapper[2578]: I0611 18:43:38.425500 2578 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="61cd963d-bb28-4867-953b-08557c6e2a36" path="/var/lib/kubelet/pods/61cd963d-bb28-4867-953b-08557c6e2a36/volumes" Jun 11 18:43:40.009586 ip-10-0-141-55 kubenswrapper[2578]: I0611 18:43:40.009387 2578 scope.go:117] "RemoveContainer" containerID="65da68c994baf54733fb44c8dd9307e4b0c9fd90068f49c139a592e6ddae5fea" Jun 11 18:43:40.009854 ip-10-0-141-55 kubenswrapper[2578]: E0611 18:43:40.009716 2578 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"65da68c994baf54733fb44c8dd9307e4b0c9fd90068f49c139a592e6ddae5fea\": container with ID starting with 65da68c994baf54733fb44c8dd9307e4b0c9fd90068f49c139a592e6ddae5fea not found: ID does not exist" containerID="65da68c994baf54733fb44c8dd9307e4b0c9fd90068f49c139a592e6ddae5fea" Jun 11 18:43:40.009854 ip-10-0-141-55 kubenswrapper[2578]: I0611 18:43:40.009744 2578 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"65da68c994baf54733fb44c8dd9307e4b0c9fd90068f49c139a592e6ddae5fea"} err="failed to get container status \"65da68c994baf54733fb44c8dd9307e4b0c9fd90068f49c139a592e6ddae5fea\": rpc error: code = NotFound desc = could not find container \"65da68c994baf54733fb44c8dd9307e4b0c9fd90068f49c139a592e6ddae5fea\": container with ID starting with 65da68c994baf54733fb44c8dd9307e4b0c9fd90068f49c139a592e6ddae5fea not found: ID does not exist" Jun 11 18:43:42.332692 ip-10-0-141-55 kubenswrapper[2578]: I0611 18:43:42.332662 2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-dvv7c" Jun 11 18:43:44.156835 ip-10-0-141-55 kubenswrapper[2578]: I0611 18:43:44.156795 2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-rs256"] Jun 11 18:43:44.157295 ip-10-0-141-55 kubenswrapper[2578]: I0611 18:43:44.157279 2578 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="61cd963d-bb28-4867-953b-08557c6e2a36" containerName="console" Jun 11 18:43:44.157353 ip-10-0-141-55 kubenswrapper[2578]: I0611 18:43:44.157297 2578 state_mem.go:107] "Deleted CPUSet assignment" podUID="61cd963d-bb28-4867-953b-08557c6e2a36" containerName="console" Jun 11 18:43:44.157390 ip-10-0-141-55 kubenswrapper[2578]: I0611 18:43:44.157384 2578 memory_manager.go:368] "RemoveStaleState removing state" podUID="61cd963d-bb28-4867-953b-08557c6e2a36" containerName="console" Jun 11 18:43:44.167274 ip-10-0-141-55 kubenswrapper[2578]: I0611 18:43:44.167243 2578 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-dvv7c"] Jun 11 18:43:44.167423 ip-10-0-141-55 kubenswrapper[2578]: I0611 18:43:44.167368 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-rs256" Jun 11 18:43:44.167687 ip-10-0-141-55 kubenswrapper[2578]: I0611 18:43:44.167658 2578 kuberuntime_container.go:872] "Killing container with a grace period" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-dvv7c" podUID="5f254fd0-550b-4b8f-ab14-0bb3fba9e405" containerName="manager" containerID="cri-o://6c5b7dafa476e1bd0563e5790bf06f59e6ac3b65dcaaef95e6724ded7220f70f" gracePeriod=2 Jun 11 18:43:44.184529 ip-10-0-141-55 kubenswrapper[2578]: I0611 18:43:44.184497 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-rs256"] Jun 11 18:43:44.187915 ip-10-0-141-55 kubenswrapper[2578]: I0611 18:43:44.187885 2578 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-dvv7c"] Jun 11 18:43:44.202035 ip-10-0-141-55 kubenswrapper[2578]: I0611 18:43:44.201714 2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-5d7rm"] Jun 11 18:43:44.202465 ip-10-0-141-55 kubenswrapper[2578]: E0611 18:43:44.202402 2578 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-8684c9ff49-dvv7c\" is forbidden: User \"system:node:ip-10-0-141-55.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-141-55.ec2.internal' and this object" podUID="5f254fd0-550b-4b8f-ab14-0bb3fba9e405" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-dvv7c" Jun 11 18:43:44.202895 ip-10-0-141-55 kubenswrapper[2578]: I0611 18:43:44.202861 2578 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="5f254fd0-550b-4b8f-ab14-0bb3fba9e405" containerName="manager" Jun 11 18:43:44.202895 ip-10-0-141-55 kubenswrapper[2578]: I0611 18:43:44.202889 2578 state_mem.go:107] "Deleted CPUSet assignment" podUID="5f254fd0-550b-4b8f-ab14-0bb3fba9e405" containerName="manager" Jun 11 18:43:44.203046 ip-10-0-141-55 kubenswrapper[2578]: I0611 18:43:44.203013 2578 memory_manager.go:368] "RemoveStaleState removing state" podUID="5f254fd0-550b-4b8f-ab14-0bb3fba9e405" containerName="manager" Jun 11 18:43:44.206390 ip-10-0-141-55 kubenswrapper[2578]: I0611 18:43:44.206369 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-5d7rm" Jun 11 18:43:44.221252 ip-10-0-141-55 kubenswrapper[2578]: I0611 18:43:44.221216 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-5d7rm"] Jun 11 18:43:44.232957 ip-10-0-141-55 kubenswrapper[2578]: E0611 18:43:44.232923 2578 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-8684c9ff49-dvv7c\" is forbidden: User \"system:node:ip-10-0-141-55.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-141-55.ec2.internal' and this object" podUID="5f254fd0-550b-4b8f-ab14-0bb3fba9e405" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-dvv7c" Jun 11 18:43:44.280520 ip-10-0-141-55 kubenswrapper[2578]: I0611 18:43:44.280485 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/7ba0fe4a-35aa-4c67-bb54-ba2f56fb2dc3-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-55467d9f7-rs256\" (UID: \"7ba0fe4a-35aa-4c67-bb54-ba2f56fb2dc3\") " pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-rs256" Jun 11 18:43:44.280696 ip-10-0-141-55 kubenswrapper[2578]: I0611 18:43:44.280634 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/d18786aa-2ca9-4296-a723-70a2848b693a-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-8684c9ff49-5d7rm\" (UID: \"d18786aa-2ca9-4296-a723-70a2848b693a\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-5d7rm" Jun 11 18:43:44.280696 ip-10-0-141-55 kubenswrapper[2578]: I0611 18:43:44.280666 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-s7lzl\" (UniqueName: \"kubernetes.io/projected/d18786aa-2ca9-4296-a723-70a2848b693a-kube-api-access-s7lzl\") pod \"kuadrant-operator-controller-manager-8684c9ff49-5d7rm\" (UID: \"d18786aa-2ca9-4296-a723-70a2848b693a\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-5d7rm" Jun 11 18:43:44.280696 ip-10-0-141-55 kubenswrapper[2578]: I0611 18:43:44.280686 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5k4v9\" (UniqueName: \"kubernetes.io/projected/7ba0fe4a-35aa-4c67-bb54-ba2f56fb2dc3-kube-api-access-5k4v9\") pod \"kuadrant-operator-controller-manager-55467d9f7-rs256\" (UID: \"7ba0fe4a-35aa-4c67-bb54-ba2f56fb2dc3\") " pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-rs256" Jun 11 18:43:44.381660 ip-10-0-141-55 kubenswrapper[2578]: I0611 18:43:44.381616 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/7ba0fe4a-35aa-4c67-bb54-ba2f56fb2dc3-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-55467d9f7-rs256\" (UID: \"7ba0fe4a-35aa-4c67-bb54-ba2f56fb2dc3\") " pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-rs256" Jun 11 18:43:44.381838 ip-10-0-141-55 kubenswrapper[2578]: I0611 18:43:44.381732 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/d18786aa-2ca9-4296-a723-70a2848b693a-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-8684c9ff49-5d7rm\" (UID: \"d18786aa-2ca9-4296-a723-70a2848b693a\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-5d7rm" Jun 11 18:43:44.381838 ip-10-0-141-55 kubenswrapper[2578]: I0611 18:43:44.381757 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-s7lzl\" (UniqueName: \"kubernetes.io/projected/d18786aa-2ca9-4296-a723-70a2848b693a-kube-api-access-s7lzl\") pod \"kuadrant-operator-controller-manager-8684c9ff49-5d7rm\" (UID: \"d18786aa-2ca9-4296-a723-70a2848b693a\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-5d7rm" Jun 11 18:43:44.381838 ip-10-0-141-55 kubenswrapper[2578]: I0611 18:43:44.381774 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5k4v9\" (UniqueName: \"kubernetes.io/projected/7ba0fe4a-35aa-4c67-bb54-ba2f56fb2dc3-kube-api-access-5k4v9\") pod \"kuadrant-operator-controller-manager-55467d9f7-rs256\" (UID: \"7ba0fe4a-35aa-4c67-bb54-ba2f56fb2dc3\") " pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-rs256" Jun 11 18:43:44.382024 ip-10-0-141-55 kubenswrapper[2578]: I0611 18:43:44.381999 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/7ba0fe4a-35aa-4c67-bb54-ba2f56fb2dc3-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-55467d9f7-rs256\" (UID: \"7ba0fe4a-35aa-4c67-bb54-ba2f56fb2dc3\") " pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-rs256" Jun 11 18:43:44.382104 ip-10-0-141-55 kubenswrapper[2578]: I0611 18:43:44.382086 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/d18786aa-2ca9-4296-a723-70a2848b693a-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-8684c9ff49-5d7rm\" (UID: \"d18786aa-2ca9-4296-a723-70a2848b693a\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-5d7rm" Jun 11 18:43:44.399570 ip-10-0-141-55 kubenswrapper[2578]: I0611 18:43:44.399522 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-5k4v9\" (UniqueName: \"kubernetes.io/projected/7ba0fe4a-35aa-4c67-bb54-ba2f56fb2dc3-kube-api-access-5k4v9\") pod \"kuadrant-operator-controller-manager-55467d9f7-rs256\" (UID: \"7ba0fe4a-35aa-4c67-bb54-ba2f56fb2dc3\") " pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-rs256" Jun 11 18:43:44.402829 ip-10-0-141-55 kubenswrapper[2578]: I0611 18:43:44.402805 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-s7lzl\" (UniqueName: \"kubernetes.io/projected/d18786aa-2ca9-4296-a723-70a2848b693a-kube-api-access-s7lzl\") pod \"kuadrant-operator-controller-manager-8684c9ff49-5d7rm\" (UID: \"d18786aa-2ca9-4296-a723-70a2848b693a\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-5d7rm" Jun 11 18:43:44.421993 ip-10-0-141-55 kubenswrapper[2578]: E0611 18:43:44.421909 2578 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-8684c9ff49-dvv7c\" is forbidden: User \"system:node:ip-10-0-141-55.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-141-55.ec2.internal' and this object" podUID="5f254fd0-550b-4b8f-ab14-0bb3fba9e405" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-dvv7c" Jun 11 18:43:44.482700 ip-10-0-141-55 kubenswrapper[2578]: I0611 18:43:44.482655 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-rs256" Jun 11 18:43:44.553037 ip-10-0-141-55 kubenswrapper[2578]: I0611 18:43:44.553001 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-5d7rm" Jun 11 18:43:57.437829 ip-10-0-141-55 kubenswrapper[2578]: I0611 18:43:57.437796 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-5d7rm"] Jun 11 18:43:57.438652 ip-10-0-141-55 kubenswrapper[2578]: W0611 18:43:57.438625 2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd18786aa_2ca9_4296_a723_70a2848b693a.slice/crio-c096db7e59ec5187d9ba5179fd10399a6649c05ead17765c7075ff066c979ffe WatchSource:0}: Error finding container c096db7e59ec5187d9ba5179fd10399a6649c05ead17765c7075ff066c979ffe: Status 404 returned error can't find the container with id c096db7e59ec5187d9ba5179fd10399a6649c05ead17765c7075ff066c979ffe Jun 11 18:43:57.457402 ip-10-0-141-55 kubenswrapper[2578]: I0611 18:43:57.457381 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-rs256"] Jun 11 18:43:57.481809 ip-10-0-141-55 kubenswrapper[2578]: I0611 18:43:57.481782 2578 generic.go:356] "Generic (PLEG): container finished" podID="5f254fd0-550b-4b8f-ab14-0bb3fba9e405" containerID="6c5b7dafa476e1bd0563e5790bf06f59e6ac3b65dcaaef95e6724ded7220f70f" exitCode=0 Jun 11 18:43:57.483131 ip-10-0-141-55 kubenswrapper[2578]: I0611 18:43:57.483100 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-5d7rm" event={"ID":"d18786aa-2ca9-4296-a723-70a2848b693a","Type":"ContainerStarted","Data":"c096db7e59ec5187d9ba5179fd10399a6649c05ead17765c7075ff066c979ffe"} Jun 11 18:43:57.643206 ip-10-0-141-55 kubenswrapper[2578]: W0611 18:43:57.643170 2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7ba0fe4a_35aa_4c67_bb54_ba2f56fb2dc3.slice/crio-ed9bc817f07be983c8a57fe11515a462da1a101261cc908a7aa9f36fdc413392 WatchSource:0}: Error finding container ed9bc817f07be983c8a57fe11515a462da1a101261cc908a7aa9f36fdc413392: Status 404 returned error can't find the container with id ed9bc817f07be983c8a57fe11515a462da1a101261cc908a7aa9f36fdc413392 Jun 11 18:43:57.683509 ip-10-0-141-55 kubenswrapper[2578]: I0611 18:43:57.681752 2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-dvv7c" Jun 11 18:43:57.684433 ip-10-0-141-55 kubenswrapper[2578]: E0611 18:43:57.684406 2578 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-8684c9ff49-dvv7c\" is forbidden: User \"system:node:ip-10-0-141-55.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-141-55.ec2.internal' and this object" podUID="5f254fd0-550b-4b8f-ab14-0bb3fba9e405" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-dvv7c" Jun 11 18:43:57.803645 ip-10-0-141-55 kubenswrapper[2578]: I0611 18:43:57.803619 2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/5f254fd0-550b-4b8f-ab14-0bb3fba9e405-extensions-socket-volume\") pod \"5f254fd0-550b-4b8f-ab14-0bb3fba9e405\" (UID: \"5f254fd0-550b-4b8f-ab14-0bb3fba9e405\") " Jun 11 18:43:57.803774 ip-10-0-141-55 kubenswrapper[2578]: I0611 18:43:57.803680 2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-lpcwz\" (UniqueName: \"kubernetes.io/projected/5f254fd0-550b-4b8f-ab14-0bb3fba9e405-kube-api-access-lpcwz\") pod \"5f254fd0-550b-4b8f-ab14-0bb3fba9e405\" (UID: \"5f254fd0-550b-4b8f-ab14-0bb3fba9e405\") " Jun 11 18:43:57.804021 ip-10-0-141-55 kubenswrapper[2578]: I0611 18:43:57.803997 2578 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/5f254fd0-550b-4b8f-ab14-0bb3fba9e405-extensions-socket-volume" (OuterVolumeSpecName: "extensions-socket-volume") pod "5f254fd0-550b-4b8f-ab14-0bb3fba9e405" (UID: "5f254fd0-550b-4b8f-ab14-0bb3fba9e405"). InnerVolumeSpecName "extensions-socket-volume". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 11 18:43:57.805478 ip-10-0-141-55 kubenswrapper[2578]: I0611 18:43:57.805461 2578 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/5f254fd0-550b-4b8f-ab14-0bb3fba9e405-kube-api-access-lpcwz" (OuterVolumeSpecName: "kube-api-access-lpcwz") pod "5f254fd0-550b-4b8f-ab14-0bb3fba9e405" (UID: "5f254fd0-550b-4b8f-ab14-0bb3fba9e405"). InnerVolumeSpecName "kube-api-access-lpcwz". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 11 18:43:57.905305 ip-10-0-141-55 kubenswrapper[2578]: I0611 18:43:57.905234 2578 reconciler_common.go:299] "Volume detached for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/5f254fd0-550b-4b8f-ab14-0bb3fba9e405-extensions-socket-volume\") on node \"ip-10-0-141-55.ec2.internal\" DevicePath \"\"" Jun 11 18:43:57.905305 ip-10-0-141-55 kubenswrapper[2578]: I0611 18:43:57.905260 2578 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-lpcwz\" (UniqueName: \"kubernetes.io/projected/5f254fd0-550b-4b8f-ab14-0bb3fba9e405-kube-api-access-lpcwz\") on node \"ip-10-0-141-55.ec2.internal\" DevicePath \"\"" Jun 11 18:43:58.421708 ip-10-0-141-55 kubenswrapper[2578]: I0611 18:43:58.421679 2578 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="5f254fd0-550b-4b8f-ab14-0bb3fba9e405" path="/var/lib/kubelet/pods/5f254fd0-550b-4b8f-ab14-0bb3fba9e405/volumes" Jun 11 18:43:58.489767 ip-10-0-141-55 kubenswrapper[2578]: I0611 18:43:58.489730 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-console-plugin-66b5774985-898xf" event={"ID":"f18861ba-f841-41cc-8089-ce4e585910a0","Type":"ContainerStarted","Data":"c16da9e8d3a7c11d51ab0650bcf1604b3d827c60f887e33284843c4e5a58b2ff"} Jun 11 18:43:58.491361 ip-10-0-141-55 kubenswrapper[2578]: I0611 18:43:58.491334 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-5d7rm" event={"ID":"d18786aa-2ca9-4296-a723-70a2848b693a","Type":"ContainerStarted","Data":"dbb5329f22d0a97f7769da3fc1841035291c5c1e0afa0b707cabea3b3ad689ee"} Jun 11 18:43:58.491503 ip-10-0-141-55 kubenswrapper[2578]: I0611 18:43:58.491418 2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-5d7rm" Jun 11 18:43:58.492743 ip-10-0-141-55 kubenswrapper[2578]: I0611 18:43:58.492724 2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-dvv7c" Jun 11 18:43:58.492942 ip-10-0-141-55 kubenswrapper[2578]: I0611 18:43:58.492726 2578 scope.go:117] "RemoveContainer" containerID="6c5b7dafa476e1bd0563e5790bf06f59e6ac3b65dcaaef95e6724ded7220f70f" Jun 11 18:43:58.494495 ip-10-0-141-55 kubenswrapper[2578]: I0611 18:43:58.494462 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-rs256" event={"ID":"7ba0fe4a-35aa-4c67-bb54-ba2f56fb2dc3","Type":"ContainerStarted","Data":"aeb5d07f4e0f0b6d7b0c95100984025e4f82e960808e5d0e16d51a47ce3c4b1d"} Jun 11 18:43:58.494630 ip-10-0-141-55 kubenswrapper[2578]: I0611 18:43:58.494506 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-rs256" event={"ID":"7ba0fe4a-35aa-4c67-bb54-ba2f56fb2dc3","Type":"ContainerStarted","Data":"ed9bc817f07be983c8a57fe11515a462da1a101261cc908a7aa9f36fdc413392"} Jun 11 18:43:58.494630 ip-10-0-141-55 kubenswrapper[2578]: I0611 18:43:58.494571 2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-rs256" Jun 11 18:43:58.508165 ip-10-0-141-55 kubenswrapper[2578]: I0611 18:43:58.508126 2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-console-plugin-66b5774985-898xf" podStartSLOduration=1.624211058 podStartE2EDuration="25.508113836s" totalImagesPullingTime="23.883902778s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-11 18:43:33 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-11 18:43:58.506450974 +0000 UTC m=+444.461125604" watchObservedRunningTime="2026-06-11 18:43:58.508113836 +0000 UTC m=+444.462788441" Jun 11 18:43:58.528984 ip-10-0-141-55 kubenswrapper[2578]: I0611 18:43:58.528941 2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-5d7rm" podStartSLOduration=14.528926662 podStartE2EDuration="14.528926662s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-11 18:43:44 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-11 18:43:58.527998551 +0000 UTC m=+444.482673154" watchObservedRunningTime="2026-06-11 18:43:58.528926662 +0000 UTC m=+444.483601269" Jun 11 18:43:58.553741 ip-10-0-141-55 kubenswrapper[2578]: E0611 18:43:58.553659 2578 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-8684c9ff49-dvv7c\" is forbidden: User \"system:node:ip-10-0-141-55.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-141-55.ec2.internal' and this object" podUID="5f254fd0-550b-4b8f-ab14-0bb3fba9e405" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-dvv7c" Jun 11 18:43:58.553872 ip-10-0-141-55 kubenswrapper[2578]: I0611 18:43:58.553844 2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-rs256" podStartSLOduration=14.553832744 podStartE2EDuration="14.553832744s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-11 18:43:44 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-11 18:43:58.551442979 +0000 UTC m=+444.506117586" watchObservedRunningTime="2026-06-11 18:43:58.553832744 +0000 UTC m=+444.508507380" Jun 11 18:44:09.502186 ip-10-0-141-55 kubenswrapper[2578]: I0611 18:44:09.502151 2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-5d7rm" Jun 11 18:44:09.502696 ip-10-0-141-55 kubenswrapper[2578]: I0611 18:44:09.502232 2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-rs256" Jun 11 18:44:09.593076 ip-10-0-141-55 kubenswrapper[2578]: I0611 18:44:09.593038 2578 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-5d7rm"] Jun 11 18:44:09.593255 ip-10-0-141-55 kubenswrapper[2578]: I0611 18:44:09.593231 2578 kuberuntime_container.go:872] "Killing container with a grace period" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-5d7rm" podUID="d18786aa-2ca9-4296-a723-70a2848b693a" containerName="manager" containerID="cri-o://dbb5329f22d0a97f7769da3fc1841035291c5c1e0afa0b707cabea3b3ad689ee" gracePeriod=10 Jun 11 18:44:09.819773 ip-10-0-141-55 kubenswrapper[2578]: I0611 18:44:09.819741 2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-86878c769f-r6dkr"] Jun 11 18:44:09.823467 ip-10-0-141-55 kubenswrapper[2578]: I0611 18:44:09.823445 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-r6dkr" Jun 11 18:44:09.835820 ip-10-0-141-55 kubenswrapper[2578]: I0611 18:44:09.835790 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-86878c769f-r6dkr"] Jun 11 18:44:09.843491 ip-10-0-141-55 kubenswrapper[2578]: I0611 18:44:09.843469 2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-5d7rm" Jun 11 18:44:10.013745 ip-10-0-141-55 kubenswrapper[2578]: I0611 18:44:10.013654 2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-s7lzl\" (UniqueName: \"kubernetes.io/projected/d18786aa-2ca9-4296-a723-70a2848b693a-kube-api-access-s7lzl\") pod \"d18786aa-2ca9-4296-a723-70a2848b693a\" (UID: \"d18786aa-2ca9-4296-a723-70a2848b693a\") " Jun 11 18:44:10.013745 ip-10-0-141-55 kubenswrapper[2578]: I0611 18:44:10.013702 2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/d18786aa-2ca9-4296-a723-70a2848b693a-extensions-socket-volume\") pod \"d18786aa-2ca9-4296-a723-70a2848b693a\" (UID: \"d18786aa-2ca9-4296-a723-70a2848b693a\") " Jun 11 18:44:10.013986 ip-10-0-141-55 kubenswrapper[2578]: I0611 18:44:10.013829 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/6b3e7e16-3ceb-4029-93ee-e9cbf68ce171-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-86878c769f-r6dkr\" (UID: \"6b3e7e16-3ceb-4029-93ee-e9cbf68ce171\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-r6dkr" Jun 11 18:44:10.013986 ip-10-0-141-55 kubenswrapper[2578]: I0611 18:44:10.013867 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-pvv9x\" (UniqueName: \"kubernetes.io/projected/6b3e7e16-3ceb-4029-93ee-e9cbf68ce171-kube-api-access-pvv9x\") pod \"kuadrant-operator-controller-manager-86878c769f-r6dkr\" (UID: \"6b3e7e16-3ceb-4029-93ee-e9cbf68ce171\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-r6dkr" Jun 11 18:44:10.014101 ip-10-0-141-55 kubenswrapper[2578]: I0611 18:44:10.014076 2578 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/d18786aa-2ca9-4296-a723-70a2848b693a-extensions-socket-volume" (OuterVolumeSpecName: "extensions-socket-volume") pod "d18786aa-2ca9-4296-a723-70a2848b693a" (UID: "d18786aa-2ca9-4296-a723-70a2848b693a"). InnerVolumeSpecName "extensions-socket-volume". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 11 18:44:10.015769 ip-10-0-141-55 kubenswrapper[2578]: I0611 18:44:10.015747 2578 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/d18786aa-2ca9-4296-a723-70a2848b693a-kube-api-access-s7lzl" (OuterVolumeSpecName: "kube-api-access-s7lzl") pod "d18786aa-2ca9-4296-a723-70a2848b693a" (UID: "d18786aa-2ca9-4296-a723-70a2848b693a"). InnerVolumeSpecName "kube-api-access-s7lzl". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 11 18:44:10.115365 ip-10-0-141-55 kubenswrapper[2578]: I0611 18:44:10.115329 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-pvv9x\" (UniqueName: \"kubernetes.io/projected/6b3e7e16-3ceb-4029-93ee-e9cbf68ce171-kube-api-access-pvv9x\") pod \"kuadrant-operator-controller-manager-86878c769f-r6dkr\" (UID: \"6b3e7e16-3ceb-4029-93ee-e9cbf68ce171\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-r6dkr" Jun 11 18:44:10.115593 ip-10-0-141-55 kubenswrapper[2578]: I0611 18:44:10.115434 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/6b3e7e16-3ceb-4029-93ee-e9cbf68ce171-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-86878c769f-r6dkr\" (UID: \"6b3e7e16-3ceb-4029-93ee-e9cbf68ce171\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-r6dkr" Jun 11 18:44:10.115593 ip-10-0-141-55 kubenswrapper[2578]: I0611 18:44:10.115476 2578 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-s7lzl\" (UniqueName: \"kubernetes.io/projected/d18786aa-2ca9-4296-a723-70a2848b693a-kube-api-access-s7lzl\") on node \"ip-10-0-141-55.ec2.internal\" DevicePath \"\"" Jun 11 18:44:10.115593 ip-10-0-141-55 kubenswrapper[2578]: I0611 18:44:10.115490 2578 reconciler_common.go:299] "Volume detached for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/d18786aa-2ca9-4296-a723-70a2848b693a-extensions-socket-volume\") on node \"ip-10-0-141-55.ec2.internal\" DevicePath \"\"" Jun 11 18:44:10.115843 ip-10-0-141-55 kubenswrapper[2578]: I0611 18:44:10.115825 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/6b3e7e16-3ceb-4029-93ee-e9cbf68ce171-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-86878c769f-r6dkr\" (UID: \"6b3e7e16-3ceb-4029-93ee-e9cbf68ce171\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-r6dkr" Jun 11 18:44:10.127401 ip-10-0-141-55 kubenswrapper[2578]: I0611 18:44:10.127379 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-pvv9x\" (UniqueName: \"kubernetes.io/projected/6b3e7e16-3ceb-4029-93ee-e9cbf68ce171-kube-api-access-pvv9x\") pod \"kuadrant-operator-controller-manager-86878c769f-r6dkr\" (UID: \"6b3e7e16-3ceb-4029-93ee-e9cbf68ce171\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-r6dkr" Jun 11 18:44:10.149264 ip-10-0-141-55 kubenswrapper[2578]: I0611 18:44:10.149230 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-r6dkr" Jun 11 18:44:10.282650 ip-10-0-141-55 kubenswrapper[2578]: I0611 18:44:10.282620 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-86878c769f-r6dkr"] Jun 11 18:44:10.283735 ip-10-0-141-55 kubenswrapper[2578]: W0611 18:44:10.283711 2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6b3e7e16_3ceb_4029_93ee_e9cbf68ce171.slice/crio-a75c8b44e9219ef53bcea8afd914f84721e4f5705f5f98125d062bfee10e2482 WatchSource:0}: Error finding container a75c8b44e9219ef53bcea8afd914f84721e4f5705f5f98125d062bfee10e2482: Status 404 returned error can't find the container with id a75c8b44e9219ef53bcea8afd914f84721e4f5705f5f98125d062bfee10e2482 Jun 11 18:44:10.558945 ip-10-0-141-55 kubenswrapper[2578]: I0611 18:44:10.558856 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-r6dkr" event={"ID":"6b3e7e16-3ceb-4029-93ee-e9cbf68ce171","Type":"ContainerStarted","Data":"635c2aa8c7b5835f211233dca2689ac97c15336384d5a9e6d73420934955a393"} Jun 11 18:44:10.558945 ip-10-0-141-55 kubenswrapper[2578]: I0611 18:44:10.558905 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-r6dkr" event={"ID":"6b3e7e16-3ceb-4029-93ee-e9cbf68ce171","Type":"ContainerStarted","Data":"a75c8b44e9219ef53bcea8afd914f84721e4f5705f5f98125d062bfee10e2482"} Jun 11 18:44:10.559391 ip-10-0-141-55 kubenswrapper[2578]: I0611 18:44:10.558952 2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-r6dkr" Jun 11 18:44:10.560281 ip-10-0-141-55 kubenswrapper[2578]: I0611 18:44:10.560258 2578 generic.go:356] "Generic (PLEG): container finished" podID="d18786aa-2ca9-4296-a723-70a2848b693a" containerID="dbb5329f22d0a97f7769da3fc1841035291c5c1e0afa0b707cabea3b3ad689ee" exitCode=0 Jun 11 18:44:10.560391 ip-10-0-141-55 kubenswrapper[2578]: I0611 18:44:10.560292 2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-5d7rm" Jun 11 18:44:10.560391 ip-10-0-141-55 kubenswrapper[2578]: I0611 18:44:10.560306 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-5d7rm" event={"ID":"d18786aa-2ca9-4296-a723-70a2848b693a","Type":"ContainerDied","Data":"dbb5329f22d0a97f7769da3fc1841035291c5c1e0afa0b707cabea3b3ad689ee"} Jun 11 18:44:10.560391 ip-10-0-141-55 kubenswrapper[2578]: I0611 18:44:10.560345 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-5d7rm" event={"ID":"d18786aa-2ca9-4296-a723-70a2848b693a","Type":"ContainerDied","Data":"c096db7e59ec5187d9ba5179fd10399a6649c05ead17765c7075ff066c979ffe"} Jun 11 18:44:10.560391 ip-10-0-141-55 kubenswrapper[2578]: I0611 18:44:10.560365 2578 scope.go:117] "RemoveContainer" containerID="dbb5329f22d0a97f7769da3fc1841035291c5c1e0afa0b707cabea3b3ad689ee" Jun 11 18:44:10.569187 ip-10-0-141-55 kubenswrapper[2578]: I0611 18:44:10.569170 2578 scope.go:117] "RemoveContainer" containerID="dbb5329f22d0a97f7769da3fc1841035291c5c1e0afa0b707cabea3b3ad689ee" Jun 11 18:44:10.569458 ip-10-0-141-55 kubenswrapper[2578]: E0611 18:44:10.569440 2578 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"dbb5329f22d0a97f7769da3fc1841035291c5c1e0afa0b707cabea3b3ad689ee\": container with ID starting with dbb5329f22d0a97f7769da3fc1841035291c5c1e0afa0b707cabea3b3ad689ee not found: ID does not exist" containerID="dbb5329f22d0a97f7769da3fc1841035291c5c1e0afa0b707cabea3b3ad689ee" Jun 11 18:44:10.569515 ip-10-0-141-55 kubenswrapper[2578]: I0611 18:44:10.569467 2578 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"dbb5329f22d0a97f7769da3fc1841035291c5c1e0afa0b707cabea3b3ad689ee"} err="failed to get container status \"dbb5329f22d0a97f7769da3fc1841035291c5c1e0afa0b707cabea3b3ad689ee\": rpc error: code = NotFound desc = could not find container \"dbb5329f22d0a97f7769da3fc1841035291c5c1e0afa0b707cabea3b3ad689ee\": container with ID starting with dbb5329f22d0a97f7769da3fc1841035291c5c1e0afa0b707cabea3b3ad689ee not found: ID does not exist" Jun 11 18:44:10.583473 ip-10-0-141-55 kubenswrapper[2578]: I0611 18:44:10.583433 2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-r6dkr" podStartSLOduration=1.583415456 podStartE2EDuration="1.583415456s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-11 18:44:09 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-11 18:44:10.581377198 +0000 UTC m=+456.536051829" watchObservedRunningTime="2026-06-11 18:44:10.583415456 +0000 UTC m=+456.538090063" Jun 11 18:44:10.598807 ip-10-0-141-55 kubenswrapper[2578]: I0611 18:44:10.598782 2578 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-5d7rm"] Jun 11 18:44:10.603729 ip-10-0-141-55 kubenswrapper[2578]: I0611 18:44:10.603709 2578 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-5d7rm"] Jun 11 18:44:12.421976 ip-10-0-141-55 kubenswrapper[2578]: I0611 18:44:12.421927 2578 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="d18786aa-2ca9-4296-a723-70a2848b693a" path="/var/lib/kubelet/pods/d18786aa-2ca9-4296-a723-70a2848b693a/volumes" Jun 11 18:44:21.568046 ip-10-0-141-55 kubenswrapper[2578]: I0611 18:44:21.568015 2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-r6dkr" Jun 11 18:44:21.620762 ip-10-0-141-55 kubenswrapper[2578]: I0611 18:44:21.620729 2578 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-rs256"] Jun 11 18:44:21.621026 ip-10-0-141-55 kubenswrapper[2578]: I0611 18:44:21.620999 2578 kuberuntime_container.go:872] "Killing container with a grace period" pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-rs256" podUID="7ba0fe4a-35aa-4c67-bb54-ba2f56fb2dc3" containerName="manager" containerID="cri-o://aeb5d07f4e0f0b6d7b0c95100984025e4f82e960808e5d0e16d51a47ce3c4b1d" gracePeriod=10 Jun 11 18:44:21.861039 ip-10-0-141-55 kubenswrapper[2578]: I0611 18:44:21.861015 2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-rs256" Jun 11 18:44:21.901542 ip-10-0-141-55 kubenswrapper[2578]: I0611 18:44:21.901514 2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-5k4v9\" (UniqueName: \"kubernetes.io/projected/7ba0fe4a-35aa-4c67-bb54-ba2f56fb2dc3-kube-api-access-5k4v9\") pod \"7ba0fe4a-35aa-4c67-bb54-ba2f56fb2dc3\" (UID: \"7ba0fe4a-35aa-4c67-bb54-ba2f56fb2dc3\") " Jun 11 18:44:21.901708 ip-10-0-141-55 kubenswrapper[2578]: I0611 18:44:21.901573 2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/7ba0fe4a-35aa-4c67-bb54-ba2f56fb2dc3-extensions-socket-volume\") pod \"7ba0fe4a-35aa-4c67-bb54-ba2f56fb2dc3\" (UID: \"7ba0fe4a-35aa-4c67-bb54-ba2f56fb2dc3\") " Jun 11 18:44:21.902000 ip-10-0-141-55 kubenswrapper[2578]: I0611 18:44:21.901979 2578 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/7ba0fe4a-35aa-4c67-bb54-ba2f56fb2dc3-extensions-socket-volume" (OuterVolumeSpecName: "extensions-socket-volume") pod "7ba0fe4a-35aa-4c67-bb54-ba2f56fb2dc3" (UID: "7ba0fe4a-35aa-4c67-bb54-ba2f56fb2dc3"). InnerVolumeSpecName "extensions-socket-volume". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 11 18:44:21.903483 ip-10-0-141-55 kubenswrapper[2578]: I0611 18:44:21.903462 2578 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/7ba0fe4a-35aa-4c67-bb54-ba2f56fb2dc3-kube-api-access-5k4v9" (OuterVolumeSpecName: "kube-api-access-5k4v9") pod "7ba0fe4a-35aa-4c67-bb54-ba2f56fb2dc3" (UID: "7ba0fe4a-35aa-4c67-bb54-ba2f56fb2dc3"). InnerVolumeSpecName "kube-api-access-5k4v9". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 11 18:44:22.002876 ip-10-0-141-55 kubenswrapper[2578]: I0611 18:44:22.002837 2578 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-5k4v9\" (UniqueName: \"kubernetes.io/projected/7ba0fe4a-35aa-4c67-bb54-ba2f56fb2dc3-kube-api-access-5k4v9\") on node \"ip-10-0-141-55.ec2.internal\" DevicePath \"\"" Jun 11 18:44:22.002876 ip-10-0-141-55 kubenswrapper[2578]: I0611 18:44:22.002866 2578 reconciler_common.go:299] "Volume detached for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/7ba0fe4a-35aa-4c67-bb54-ba2f56fb2dc3-extensions-socket-volume\") on node \"ip-10-0-141-55.ec2.internal\" DevicePath \"\"" Jun 11 18:44:22.628253 ip-10-0-141-55 kubenswrapper[2578]: I0611 18:44:22.628211 2578 generic.go:356] "Generic (PLEG): container finished" podID="7ba0fe4a-35aa-4c67-bb54-ba2f56fb2dc3" containerID="aeb5d07f4e0f0b6d7b0c95100984025e4f82e960808e5d0e16d51a47ce3c4b1d" exitCode=0 Jun 11 18:44:22.628253 ip-10-0-141-55 kubenswrapper[2578]: I0611 18:44:22.628255 2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-rs256" Jun 11 18:44:22.628738 ip-10-0-141-55 kubenswrapper[2578]: I0611 18:44:22.628294 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-rs256" event={"ID":"7ba0fe4a-35aa-4c67-bb54-ba2f56fb2dc3","Type":"ContainerDied","Data":"aeb5d07f4e0f0b6d7b0c95100984025e4f82e960808e5d0e16d51a47ce3c4b1d"} Jun 11 18:44:22.628738 ip-10-0-141-55 kubenswrapper[2578]: I0611 18:44:22.628350 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-rs256" event={"ID":"7ba0fe4a-35aa-4c67-bb54-ba2f56fb2dc3","Type":"ContainerDied","Data":"ed9bc817f07be983c8a57fe11515a462da1a101261cc908a7aa9f36fdc413392"} Jun 11 18:44:22.628738 ip-10-0-141-55 kubenswrapper[2578]: I0611 18:44:22.628379 2578 scope.go:117] "RemoveContainer" containerID="aeb5d07f4e0f0b6d7b0c95100984025e4f82e960808e5d0e16d51a47ce3c4b1d" Jun 11 18:44:22.637349 ip-10-0-141-55 kubenswrapper[2578]: I0611 18:44:22.637323 2578 scope.go:117] "RemoveContainer" containerID="aeb5d07f4e0f0b6d7b0c95100984025e4f82e960808e5d0e16d51a47ce3c4b1d" Jun 11 18:44:22.637699 ip-10-0-141-55 kubenswrapper[2578]: E0611 18:44:22.637675 2578 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"aeb5d07f4e0f0b6d7b0c95100984025e4f82e960808e5d0e16d51a47ce3c4b1d\": container with ID starting with aeb5d07f4e0f0b6d7b0c95100984025e4f82e960808e5d0e16d51a47ce3c4b1d not found: ID does not exist" containerID="aeb5d07f4e0f0b6d7b0c95100984025e4f82e960808e5d0e16d51a47ce3c4b1d" Jun 11 18:44:22.637763 ip-10-0-141-55 kubenswrapper[2578]: I0611 18:44:22.637709 2578 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"aeb5d07f4e0f0b6d7b0c95100984025e4f82e960808e5d0e16d51a47ce3c4b1d"} err="failed to get container status \"aeb5d07f4e0f0b6d7b0c95100984025e4f82e960808e5d0e16d51a47ce3c4b1d\": rpc error: code = NotFound desc = could not find container \"aeb5d07f4e0f0b6d7b0c95100984025e4f82e960808e5d0e16d51a47ce3c4b1d\": container with ID starting with aeb5d07f4e0f0b6d7b0c95100984025e4f82e960808e5d0e16d51a47ce3c4b1d not found: ID does not exist" Jun 11 18:44:22.655466 ip-10-0-141-55 kubenswrapper[2578]: I0611 18:44:22.655433 2578 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-rs256"] Jun 11 18:44:22.662851 ip-10-0-141-55 kubenswrapper[2578]: I0611 18:44:22.662822 2578 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-rs256"] Jun 11 18:44:24.420616 ip-10-0-141-55 kubenswrapper[2578]: I0611 18:44:24.420580 2578 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="7ba0fe4a-35aa-4c67-bb54-ba2f56fb2dc3" path="/var/lib/kubelet/pods/7ba0fe4a-35aa-4c67-bb54-ba2f56fb2dc3/volumes" Jun 11 18:44:41.315237 ip-10-0-141-55 kubenswrapper[2578]: I0611 18:44:41.315201 2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-58cd955675-k2zm4"] Jun 11 18:44:41.315734 ip-10-0-141-55 kubenswrapper[2578]: I0611 18:44:41.315534 2578 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="d18786aa-2ca9-4296-a723-70a2848b693a" containerName="manager" Jun 11 18:44:41.315734 ip-10-0-141-55 kubenswrapper[2578]: I0611 18:44:41.315545 2578 state_mem.go:107] "Deleted CPUSet assignment" podUID="d18786aa-2ca9-4296-a723-70a2848b693a" containerName="manager" Jun 11 18:44:41.315734 ip-10-0-141-55 kubenswrapper[2578]: I0611 18:44:41.315567 2578 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="7ba0fe4a-35aa-4c67-bb54-ba2f56fb2dc3" containerName="manager" Jun 11 18:44:41.315734 ip-10-0-141-55 kubenswrapper[2578]: I0611 18:44:41.315573 2578 state_mem.go:107] "Deleted CPUSet assignment" podUID="7ba0fe4a-35aa-4c67-bb54-ba2f56fb2dc3" containerName="manager" Jun 11 18:44:41.315734 ip-10-0-141-55 kubenswrapper[2578]: I0611 18:44:41.315618 2578 memory_manager.go:368] "RemoveStaleState removing state" podUID="d18786aa-2ca9-4296-a723-70a2848b693a" containerName="manager" Jun 11 18:44:41.315734 ip-10-0-141-55 kubenswrapper[2578]: I0611 18:44:41.315626 2578 memory_manager.go:368] "RemoveStaleState removing state" podUID="7ba0fe4a-35aa-4c67-bb54-ba2f56fb2dc3" containerName="manager" Jun 11 18:44:41.390447 ip-10-0-141-55 kubenswrapper[2578]: I0611 18:44:41.390408 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-58cd955675-k2zm4"] Jun 11 18:44:41.390628 ip-10-0-141-55 kubenswrapper[2578]: I0611 18:44:41.390501 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-58cd955675-k2zm4" Jun 11 18:44:41.393290 ip-10-0-141-55 kubenswrapper[2578]: I0611 18:44:41.393262 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"authorino-authorino-dockercfg-nwp55\"" Jun 11 18:44:41.450026 ip-10-0-141-55 kubenswrapper[2578]: I0611 18:44:41.449998 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hmxfb\" (UniqueName: \"kubernetes.io/projected/2c60d55f-3be5-4ded-b15c-e9ecee47a28e-kube-api-access-hmxfb\") pod \"authorino-58cd955675-k2zm4\" (UID: \"2c60d55f-3be5-4ded-b15c-e9ecee47a28e\") " pod="kuadrant-system/authorino-58cd955675-k2zm4" Jun 11 18:44:41.551141 ip-10-0-141-55 kubenswrapper[2578]: I0611 18:44:41.551105 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hmxfb\" (UniqueName: \"kubernetes.io/projected/2c60d55f-3be5-4ded-b15c-e9ecee47a28e-kube-api-access-hmxfb\") pod \"authorino-58cd955675-k2zm4\" (UID: \"2c60d55f-3be5-4ded-b15c-e9ecee47a28e\") " pod="kuadrant-system/authorino-58cd955675-k2zm4" Jun 11 18:44:41.559426 ip-10-0-141-55 kubenswrapper[2578]: I0611 18:44:41.559395 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-hmxfb\" (UniqueName: \"kubernetes.io/projected/2c60d55f-3be5-4ded-b15c-e9ecee47a28e-kube-api-access-hmxfb\") pod \"authorino-58cd955675-k2zm4\" (UID: \"2c60d55f-3be5-4ded-b15c-e9ecee47a28e\") " pod="kuadrant-system/authorino-58cd955675-k2zm4" Jun 11 18:44:41.692046 ip-10-0-141-55 kubenswrapper[2578]: I0611 18:44:41.692012 2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-75d556bd77-lzc8z"] Jun 11 18:44:41.695895 ip-10-0-141-55 kubenswrapper[2578]: I0611 18:44:41.695876 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-75d556bd77-lzc8z" Jun 11 18:44:41.699698 ip-10-0-141-55 kubenswrapper[2578]: I0611 18:44:41.699669 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-58cd955675-k2zm4" Jun 11 18:44:41.704173 ip-10-0-141-55 kubenswrapper[2578]: I0611 18:44:41.704148 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-75d556bd77-lzc8z"] Jun 11 18:44:41.754144 ip-10-0-141-55 kubenswrapper[2578]: I0611 18:44:41.753362 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-tqpjx\" (UniqueName: \"kubernetes.io/projected/37262dbc-35c5-4d26-b169-c7acfc04eeda-kube-api-access-tqpjx\") pod \"authorino-75d556bd77-lzc8z\" (UID: \"37262dbc-35c5-4d26-b169-c7acfc04eeda\") " pod="kuadrant-system/authorino-75d556bd77-lzc8z" Jun 11 18:44:41.833200 ip-10-0-141-55 kubenswrapper[2578]: I0611 18:44:41.833022 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-58cd955675-k2zm4"] Jun 11 18:44:41.835852 ip-10-0-141-55 kubenswrapper[2578]: W0611 18:44:41.835825 2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod2c60d55f_3be5_4ded_b15c_e9ecee47a28e.slice/crio-e83865fa950523efd3b75117e01d68ed9456b0f2b659e893c9ae8d0cb3a816b9 WatchSource:0}: Error finding container e83865fa950523efd3b75117e01d68ed9456b0f2b659e893c9ae8d0cb3a816b9: Status 404 returned error can't find the container with id e83865fa950523efd3b75117e01d68ed9456b0f2b659e893c9ae8d0cb3a816b9 Jun 11 18:44:41.854052 ip-10-0-141-55 kubenswrapper[2578]: I0611 18:44:41.854029 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-tqpjx\" (UniqueName: \"kubernetes.io/projected/37262dbc-35c5-4d26-b169-c7acfc04eeda-kube-api-access-tqpjx\") pod \"authorino-75d556bd77-lzc8z\" (UID: \"37262dbc-35c5-4d26-b169-c7acfc04eeda\") " pod="kuadrant-system/authorino-75d556bd77-lzc8z" Jun 11 18:44:41.862333 ip-10-0-141-55 kubenswrapper[2578]: I0611 18:44:41.862315 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-tqpjx\" (UniqueName: \"kubernetes.io/projected/37262dbc-35c5-4d26-b169-c7acfc04eeda-kube-api-access-tqpjx\") pod \"authorino-75d556bd77-lzc8z\" (UID: \"37262dbc-35c5-4d26-b169-c7acfc04eeda\") " pod="kuadrant-system/authorino-75d556bd77-lzc8z" Jun 11 18:44:42.007101 ip-10-0-141-55 kubenswrapper[2578]: I0611 18:44:42.007011 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-75d556bd77-lzc8z" Jun 11 18:44:42.131815 ip-10-0-141-55 kubenswrapper[2578]: I0611 18:44:42.131787 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-75d556bd77-lzc8z"] Jun 11 18:44:42.133181 ip-10-0-141-55 kubenswrapper[2578]: W0611 18:44:42.133151 2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod37262dbc_35c5_4d26_b169_c7acfc04eeda.slice/crio-4ea2808503bc5c945b9f6594f79ca047d57cfa75c98630977d5f2ff3aed4ab7f WatchSource:0}: Error finding container 4ea2808503bc5c945b9f6594f79ca047d57cfa75c98630977d5f2ff3aed4ab7f: Status 404 returned error can't find the container with id 4ea2808503bc5c945b9f6594f79ca047d57cfa75c98630977d5f2ff3aed4ab7f Jun 11 18:44:42.750899 ip-10-0-141-55 kubenswrapper[2578]: I0611 18:44:42.750840 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-58cd955675-k2zm4" event={"ID":"2c60d55f-3be5-4ded-b15c-e9ecee47a28e","Type":"ContainerStarted","Data":"e83865fa950523efd3b75117e01d68ed9456b0f2b659e893c9ae8d0cb3a816b9"} Jun 11 18:44:42.755053 ip-10-0-141-55 kubenswrapper[2578]: I0611 18:44:42.754971 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-75d556bd77-lzc8z" event={"ID":"37262dbc-35c5-4d26-b169-c7acfc04eeda","Type":"ContainerStarted","Data":"4ea2808503bc5c945b9f6594f79ca047d57cfa75c98630977d5f2ff3aed4ab7f"} Jun 11 18:44:45.775132 ip-10-0-141-55 kubenswrapper[2578]: I0611 18:44:45.775090 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-58cd955675-k2zm4" event={"ID":"2c60d55f-3be5-4ded-b15c-e9ecee47a28e","Type":"ContainerStarted","Data":"8eebfdd833e3c3c26d50f0c3fcc077e14625d41b707902790f0a3593b7913f69"} Jun 11 18:44:45.776604 ip-10-0-141-55 kubenswrapper[2578]: I0611 18:44:45.776579 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-75d556bd77-lzc8z" event={"ID":"37262dbc-35c5-4d26-b169-c7acfc04eeda","Type":"ContainerStarted","Data":"d7c5bdd28a0f914c4f6d5ee7a329aae4944da264c7320078828b10749df60c95"} Jun 11 18:44:45.790643 ip-10-0-141-55 kubenswrapper[2578]: I0611 18:44:45.790597 2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/authorino-58cd955675-k2zm4" podStartSLOduration=1.297431612 podStartE2EDuration="4.79058396s" totalImagesPullingTime="3.493152348s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-11 18:44:41 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-11 18:44:45.789878092 +0000 UTC m=+491.744552710" watchObservedRunningTime="2026-06-11 18:44:45.79058396 +0000 UTC m=+491.745258561" Jun 11 18:44:45.805041 ip-10-0-141-55 kubenswrapper[2578]: I0611 18:44:45.804983 2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/authorino-75d556bd77-lzc8z" podStartSLOduration=1.597972413 podStartE2EDuration="4.804965832s" totalImagesPullingTime="3.206993419s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-11 18:44:41 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-11 18:44:45.803010497 +0000 UTC m=+491.757685103" watchObservedRunningTime="2026-06-11 18:44:45.804965832 +0000 UTC m=+491.759640438" Jun 11 18:44:45.828266 ip-10-0-141-55 kubenswrapper[2578]: I0611 18:44:45.828237 2578 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-58cd955675-k2zm4"] Jun 11 18:44:47.788760 ip-10-0-141-55 kubenswrapper[2578]: I0611 18:44:47.788722 2578 kuberuntime_container.go:872] "Killing container with a grace period" pod="kuadrant-system/authorino-58cd955675-k2zm4" podUID="2c60d55f-3be5-4ded-b15c-e9ecee47a28e" containerName="authorino" containerID="cri-o://8eebfdd833e3c3c26d50f0c3fcc077e14625d41b707902790f0a3593b7913f69" gracePeriod=30 Jun 11 18:44:48.024395 ip-10-0-141-55 kubenswrapper[2578]: I0611 18:44:48.024371 2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-58cd955675-k2zm4" Jun 11 18:44:48.108962 ip-10-0-141-55 kubenswrapper[2578]: I0611 18:44:48.108918 2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-hmxfb\" (UniqueName: \"kubernetes.io/projected/2c60d55f-3be5-4ded-b15c-e9ecee47a28e-kube-api-access-hmxfb\") pod \"2c60d55f-3be5-4ded-b15c-e9ecee47a28e\" (UID: \"2c60d55f-3be5-4ded-b15c-e9ecee47a28e\") " Jun 11 18:44:48.111020 ip-10-0-141-55 kubenswrapper[2578]: I0611 18:44:48.110985 2578 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/2c60d55f-3be5-4ded-b15c-e9ecee47a28e-kube-api-access-hmxfb" (OuterVolumeSpecName: "kube-api-access-hmxfb") pod "2c60d55f-3be5-4ded-b15c-e9ecee47a28e" (UID: "2c60d55f-3be5-4ded-b15c-e9ecee47a28e"). InnerVolumeSpecName "kube-api-access-hmxfb". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 11 18:44:48.209550 ip-10-0-141-55 kubenswrapper[2578]: I0611 18:44:48.209512 2578 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-hmxfb\" (UniqueName: \"kubernetes.io/projected/2c60d55f-3be5-4ded-b15c-e9ecee47a28e-kube-api-access-hmxfb\") on node \"ip-10-0-141-55.ec2.internal\" DevicePath \"\"" Jun 11 18:44:48.794797 ip-10-0-141-55 kubenswrapper[2578]: I0611 18:44:48.794713 2578 generic.go:356] "Generic (PLEG): container finished" podID="2c60d55f-3be5-4ded-b15c-e9ecee47a28e" containerID="8eebfdd833e3c3c26d50f0c3fcc077e14625d41b707902790f0a3593b7913f69" exitCode=0 Jun 11 18:44:48.794797 ip-10-0-141-55 kubenswrapper[2578]: I0611 18:44:48.794754 2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-58cd955675-k2zm4" Jun 11 18:44:48.795230 ip-10-0-141-55 kubenswrapper[2578]: I0611 18:44:48.794790 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-58cd955675-k2zm4" event={"ID":"2c60d55f-3be5-4ded-b15c-e9ecee47a28e","Type":"ContainerDied","Data":"8eebfdd833e3c3c26d50f0c3fcc077e14625d41b707902790f0a3593b7913f69"} Jun 11 18:44:48.795230 ip-10-0-141-55 kubenswrapper[2578]: I0611 18:44:48.794830 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-58cd955675-k2zm4" event={"ID":"2c60d55f-3be5-4ded-b15c-e9ecee47a28e","Type":"ContainerDied","Data":"e83865fa950523efd3b75117e01d68ed9456b0f2b659e893c9ae8d0cb3a816b9"} Jun 11 18:44:48.795230 ip-10-0-141-55 kubenswrapper[2578]: I0611 18:44:48.794846 2578 scope.go:117] "RemoveContainer" containerID="8eebfdd833e3c3c26d50f0c3fcc077e14625d41b707902790f0a3593b7913f69" Jun 11 18:44:48.807452 ip-10-0-141-55 kubenswrapper[2578]: I0611 18:44:48.807424 2578 scope.go:117] "RemoveContainer" containerID="8eebfdd833e3c3c26d50f0c3fcc077e14625d41b707902790f0a3593b7913f69" Jun 11 18:44:48.807836 ip-10-0-141-55 kubenswrapper[2578]: E0611 18:44:48.807805 2578 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"8eebfdd833e3c3c26d50f0c3fcc077e14625d41b707902790f0a3593b7913f69\": container with ID starting with 8eebfdd833e3c3c26d50f0c3fcc077e14625d41b707902790f0a3593b7913f69 not found: ID does not exist" containerID="8eebfdd833e3c3c26d50f0c3fcc077e14625d41b707902790f0a3593b7913f69" Jun 11 18:44:48.807914 ip-10-0-141-55 kubenswrapper[2578]: I0611 18:44:48.807854 2578 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"8eebfdd833e3c3c26d50f0c3fcc077e14625d41b707902790f0a3593b7913f69"} err="failed to get container status \"8eebfdd833e3c3c26d50f0c3fcc077e14625d41b707902790f0a3593b7913f69\": rpc error: code = NotFound desc = could not find container \"8eebfdd833e3c3c26d50f0c3fcc077e14625d41b707902790f0a3593b7913f69\": container with ID starting with 8eebfdd833e3c3c26d50f0c3fcc077e14625d41b707902790f0a3593b7913f69 not found: ID does not exist" Jun 11 18:44:48.817220 ip-10-0-141-55 kubenswrapper[2578]: I0611 18:44:48.817196 2578 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-58cd955675-k2zm4"] Jun 11 18:44:48.821236 ip-10-0-141-55 kubenswrapper[2578]: I0611 18:44:48.821214 2578 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/authorino-58cd955675-k2zm4"] Jun 11 18:44:50.420352 ip-10-0-141-55 kubenswrapper[2578]: I0611 18:44:50.420318 2578 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="2c60d55f-3be5-4ded-b15c-e9ecee47a28e" path="/var/lib/kubelet/pods/2c60d55f-3be5-4ded-b15c-e9ecee47a28e/volumes" Jun 11 18:45:16.953946 ip-10-0-141-55 kubenswrapper[2578]: I0611 18:45:16.953898 2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-marketplace/0228a3cc79630676fae641e6a38dab1752e85a08a4a9edc59ccf0da748rdnqq"] Jun 11 18:45:16.954582 ip-10-0-141-55 kubenswrapper[2578]: I0611 18:45:16.954418 2578 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="2c60d55f-3be5-4ded-b15c-e9ecee47a28e" containerName="authorino" Jun 11 18:45:16.954582 ip-10-0-141-55 kubenswrapper[2578]: I0611 18:45:16.954438 2578 state_mem.go:107] "Deleted CPUSet assignment" podUID="2c60d55f-3be5-4ded-b15c-e9ecee47a28e" containerName="authorino" Jun 11 18:45:16.954582 ip-10-0-141-55 kubenswrapper[2578]: I0611 18:45:16.954525 2578 memory_manager.go:368] "RemoveStaleState removing state" podUID="2c60d55f-3be5-4ded-b15c-e9ecee47a28e" containerName="authorino" Jun 11 18:45:16.961380 ip-10-0-141-55 kubenswrapper[2578]: I0611 18:45:16.961357 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/0228a3cc79630676fae641e6a38dab1752e85a08a4a9edc59ccf0da748rdnqq" Jun 11 18:45:16.964520 ip-10-0-141-55 kubenswrapper[2578]: I0611 18:45:16.964496 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"kube-root-ca.crt\"" Jun 11 18:45:16.964520 ip-10-0-141-55 kubenswrapper[2578]: I0611 18:45:16.964506 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"openshift-service-ca.crt\"" Jun 11 18:45:16.965174 ip-10-0-141-55 kubenswrapper[2578]: I0611 18:45:16.965151 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/0228a3cc79630676fae641e6a38dab1752e85a08a4a9edc59ccf0da748rdnqq"] Jun 11 18:45:16.965677 ip-10-0-141-55 kubenswrapper[2578]: I0611 18:45:16.965660 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-marketplace\"/\"default-dockercfg-nkxdk\"" Jun 11 18:45:17.058930 ip-10-0-141-55 kubenswrapper[2578]: I0611 18:45:17.058893 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/69c5147e-1445-4ab8-8c7c-430354b6d17d-util\") pod \"0228a3cc79630676fae641e6a38dab1752e85a08a4a9edc59ccf0da748rdnqq\" (UID: \"69c5147e-1445-4ab8-8c7c-430354b6d17d\") " pod="openshift-marketplace/0228a3cc79630676fae641e6a38dab1752e85a08a4a9edc59ccf0da748rdnqq" Jun 11 18:45:17.059125 ip-10-0-141-55 kubenswrapper[2578]: I0611 18:45:17.058972 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/69c5147e-1445-4ab8-8c7c-430354b6d17d-bundle\") pod \"0228a3cc79630676fae641e6a38dab1752e85a08a4a9edc59ccf0da748rdnqq\" (UID: \"69c5147e-1445-4ab8-8c7c-430354b6d17d\") " pod="openshift-marketplace/0228a3cc79630676fae641e6a38dab1752e85a08a4a9edc59ccf0da748rdnqq" Jun 11 18:45:17.059125 ip-10-0-141-55 kubenswrapper[2578]: I0611 18:45:17.059009 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-x7gqt\" (UniqueName: \"kubernetes.io/projected/69c5147e-1445-4ab8-8c7c-430354b6d17d-kube-api-access-x7gqt\") pod \"0228a3cc79630676fae641e6a38dab1752e85a08a4a9edc59ccf0da748rdnqq\" (UID: \"69c5147e-1445-4ab8-8c7c-430354b6d17d\") " pod="openshift-marketplace/0228a3cc79630676fae641e6a38dab1752e85a08a4a9edc59ccf0da748rdnqq" Jun 11 18:45:17.159730 ip-10-0-141-55 kubenswrapper[2578]: I0611 18:45:17.159651 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-x7gqt\" (UniqueName: \"kubernetes.io/projected/69c5147e-1445-4ab8-8c7c-430354b6d17d-kube-api-access-x7gqt\") pod \"0228a3cc79630676fae641e6a38dab1752e85a08a4a9edc59ccf0da748rdnqq\" (UID: \"69c5147e-1445-4ab8-8c7c-430354b6d17d\") " pod="openshift-marketplace/0228a3cc79630676fae641e6a38dab1752e85a08a4a9edc59ccf0da748rdnqq" Jun 11 18:45:17.159730 ip-10-0-141-55 kubenswrapper[2578]: I0611 18:45:17.159713 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/69c5147e-1445-4ab8-8c7c-430354b6d17d-util\") pod \"0228a3cc79630676fae641e6a38dab1752e85a08a4a9edc59ccf0da748rdnqq\" (UID: \"69c5147e-1445-4ab8-8c7c-430354b6d17d\") " pod="openshift-marketplace/0228a3cc79630676fae641e6a38dab1752e85a08a4a9edc59ccf0da748rdnqq" Jun 11 18:45:17.159984 ip-10-0-141-55 kubenswrapper[2578]: I0611 18:45:17.159795 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/69c5147e-1445-4ab8-8c7c-430354b6d17d-bundle\") pod \"0228a3cc79630676fae641e6a38dab1752e85a08a4a9edc59ccf0da748rdnqq\" (UID: \"69c5147e-1445-4ab8-8c7c-430354b6d17d\") " pod="openshift-marketplace/0228a3cc79630676fae641e6a38dab1752e85a08a4a9edc59ccf0da748rdnqq" Jun 11 18:45:17.160125 ip-10-0-141-55 kubenswrapper[2578]: I0611 18:45:17.160105 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/69c5147e-1445-4ab8-8c7c-430354b6d17d-util\") pod \"0228a3cc79630676fae641e6a38dab1752e85a08a4a9edc59ccf0da748rdnqq\" (UID: \"69c5147e-1445-4ab8-8c7c-430354b6d17d\") " pod="openshift-marketplace/0228a3cc79630676fae641e6a38dab1752e85a08a4a9edc59ccf0da748rdnqq" Jun 11 18:45:17.160183 ip-10-0-141-55 kubenswrapper[2578]: I0611 18:45:17.160166 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/69c5147e-1445-4ab8-8c7c-430354b6d17d-bundle\") pod \"0228a3cc79630676fae641e6a38dab1752e85a08a4a9edc59ccf0da748rdnqq\" (UID: \"69c5147e-1445-4ab8-8c7c-430354b6d17d\") " pod="openshift-marketplace/0228a3cc79630676fae641e6a38dab1752e85a08a4a9edc59ccf0da748rdnqq" Jun 11 18:45:17.169449 ip-10-0-141-55 kubenswrapper[2578]: I0611 18:45:17.169421 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-x7gqt\" (UniqueName: \"kubernetes.io/projected/69c5147e-1445-4ab8-8c7c-430354b6d17d-kube-api-access-x7gqt\") pod \"0228a3cc79630676fae641e6a38dab1752e85a08a4a9edc59ccf0da748rdnqq\" (UID: \"69c5147e-1445-4ab8-8c7c-430354b6d17d\") " pod="openshift-marketplace/0228a3cc79630676fae641e6a38dab1752e85a08a4a9edc59ccf0da748rdnqq" Jun 11 18:45:17.272580 ip-10-0-141-55 kubenswrapper[2578]: I0611 18:45:17.272455 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/0228a3cc79630676fae641e6a38dab1752e85a08a4a9edc59ccf0da748rdnqq" Jun 11 18:45:17.403055 ip-10-0-141-55 kubenswrapper[2578]: I0611 18:45:17.403029 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/0228a3cc79630676fae641e6a38dab1752e85a08a4a9edc59ccf0da748rdnqq"] Jun 11 18:45:17.404631 ip-10-0-141-55 kubenswrapper[2578]: W0611 18:45:17.404601 2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod69c5147e_1445_4ab8_8c7c_430354b6d17d.slice/crio-f3b0924364a18cd5ffde11d2a880b1f063607e328c84577d3e4f1abbea805ca7 WatchSource:0}: Error finding container f3b0924364a18cd5ffde11d2a880b1f063607e328c84577d3e4f1abbea805ca7: Status 404 returned error can't find the container with id f3b0924364a18cd5ffde11d2a880b1f063607e328c84577d3e4f1abbea805ca7 Jun 11 18:45:17.951124 ip-10-0-141-55 kubenswrapper[2578]: I0611 18:45:17.951086 2578 generic.go:356] "Generic (PLEG): container finished" podID="69c5147e-1445-4ab8-8c7c-430354b6d17d" containerID="5c80681e0b0aab780fc62252f392c87e9051b79e36fe0cdd23a0146189d25781" exitCode=0 Jun 11 18:45:17.951334 ip-10-0-141-55 kubenswrapper[2578]: I0611 18:45:17.951173 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/0228a3cc79630676fae641e6a38dab1752e85a08a4a9edc59ccf0da748rdnqq" event={"ID":"69c5147e-1445-4ab8-8c7c-430354b6d17d","Type":"ContainerDied","Data":"5c80681e0b0aab780fc62252f392c87e9051b79e36fe0cdd23a0146189d25781"} Jun 11 18:45:17.951334 ip-10-0-141-55 kubenswrapper[2578]: I0611 18:45:17.951214 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/0228a3cc79630676fae641e6a38dab1752e85a08a4a9edc59ccf0da748rdnqq" event={"ID":"69c5147e-1445-4ab8-8c7c-430354b6d17d","Type":"ContainerStarted","Data":"f3b0924364a18cd5ffde11d2a880b1f063607e328c84577d3e4f1abbea805ca7"} Jun 11 18:45:18.958474 ip-10-0-141-55 kubenswrapper[2578]: I0611 18:45:18.958382 2578 generic.go:356] "Generic (PLEG): container finished" podID="69c5147e-1445-4ab8-8c7c-430354b6d17d" containerID="1dec07727c9fcd04448e8f51a9f0acbddb4c045a08d2742a1797d600e0a18a9e" exitCode=0 Jun 11 18:45:18.958474 ip-10-0-141-55 kubenswrapper[2578]: I0611 18:45:18.958463 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/0228a3cc79630676fae641e6a38dab1752e85a08a4a9edc59ccf0da748rdnqq" event={"ID":"69c5147e-1445-4ab8-8c7c-430354b6d17d","Type":"ContainerDied","Data":"1dec07727c9fcd04448e8f51a9f0acbddb4c045a08d2742a1797d600e0a18a9e"} Jun 11 18:45:19.965844 ip-10-0-141-55 kubenswrapper[2578]: I0611 18:45:19.965807 2578 generic.go:356] "Generic (PLEG): container finished" podID="69c5147e-1445-4ab8-8c7c-430354b6d17d" containerID="355b15baa07c7d7546b537a38d90bd10105b79b1386a20afada4b00e207c5801" exitCode=0 Jun 11 18:45:19.966243 ip-10-0-141-55 kubenswrapper[2578]: I0611 18:45:19.965857 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/0228a3cc79630676fae641e6a38dab1752e85a08a4a9edc59ccf0da748rdnqq" event={"ID":"69c5147e-1445-4ab8-8c7c-430354b6d17d","Type":"ContainerDied","Data":"355b15baa07c7d7546b537a38d90bd10105b79b1386a20afada4b00e207c5801"} Jun 11 18:45:21.097074 ip-10-0-141-55 kubenswrapper[2578]: I0611 18:45:21.097052 2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/0228a3cc79630676fae641e6a38dab1752e85a08a4a9edc59ccf0da748rdnqq" Jun 11 18:45:21.107688 ip-10-0-141-55 kubenswrapper[2578]: I0611 18:45:21.107664 2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/69c5147e-1445-4ab8-8c7c-430354b6d17d-util\") pod \"69c5147e-1445-4ab8-8c7c-430354b6d17d\" (UID: \"69c5147e-1445-4ab8-8c7c-430354b6d17d\") " Jun 11 18:45:21.107805 ip-10-0-141-55 kubenswrapper[2578]: I0611 18:45:21.107699 2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-x7gqt\" (UniqueName: \"kubernetes.io/projected/69c5147e-1445-4ab8-8c7c-430354b6d17d-kube-api-access-x7gqt\") pod \"69c5147e-1445-4ab8-8c7c-430354b6d17d\" (UID: \"69c5147e-1445-4ab8-8c7c-430354b6d17d\") " Jun 11 18:45:21.107805 ip-10-0-141-55 kubenswrapper[2578]: I0611 18:45:21.107763 2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/69c5147e-1445-4ab8-8c7c-430354b6d17d-bundle\") pod \"69c5147e-1445-4ab8-8c7c-430354b6d17d\" (UID: \"69c5147e-1445-4ab8-8c7c-430354b6d17d\") " Jun 11 18:45:21.108194 ip-10-0-141-55 kubenswrapper[2578]: I0611 18:45:21.108172 2578 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/69c5147e-1445-4ab8-8c7c-430354b6d17d-bundle" (OuterVolumeSpecName: "bundle") pod "69c5147e-1445-4ab8-8c7c-430354b6d17d" (UID: "69c5147e-1445-4ab8-8c7c-430354b6d17d"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 11 18:45:21.109735 ip-10-0-141-55 kubenswrapper[2578]: I0611 18:45:21.109712 2578 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/69c5147e-1445-4ab8-8c7c-430354b6d17d-kube-api-access-x7gqt" (OuterVolumeSpecName: "kube-api-access-x7gqt") pod "69c5147e-1445-4ab8-8c7c-430354b6d17d" (UID: "69c5147e-1445-4ab8-8c7c-430354b6d17d"). InnerVolumeSpecName "kube-api-access-x7gqt". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 11 18:45:21.113641 ip-10-0-141-55 kubenswrapper[2578]: I0611 18:45:21.113602 2578 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/69c5147e-1445-4ab8-8c7c-430354b6d17d-util" (OuterVolumeSpecName: "util") pod "69c5147e-1445-4ab8-8c7c-430354b6d17d" (UID: "69c5147e-1445-4ab8-8c7c-430354b6d17d"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 11 18:45:21.209067 ip-10-0-141-55 kubenswrapper[2578]: I0611 18:45:21.209028 2578 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/69c5147e-1445-4ab8-8c7c-430354b6d17d-util\") on node \"ip-10-0-141-55.ec2.internal\" DevicePath \"\"" Jun 11 18:45:21.209067 ip-10-0-141-55 kubenswrapper[2578]: I0611 18:45:21.209061 2578 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-x7gqt\" (UniqueName: \"kubernetes.io/projected/69c5147e-1445-4ab8-8c7c-430354b6d17d-kube-api-access-x7gqt\") on node \"ip-10-0-141-55.ec2.internal\" DevicePath \"\"" Jun 11 18:45:21.209067 ip-10-0-141-55 kubenswrapper[2578]: I0611 18:45:21.209074 2578 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/69c5147e-1445-4ab8-8c7c-430354b6d17d-bundle\") on node \"ip-10-0-141-55.ec2.internal\" DevicePath \"\"" Jun 11 18:45:21.977779 ip-10-0-141-55 kubenswrapper[2578]: I0611 18:45:21.977748 2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/0228a3cc79630676fae641e6a38dab1752e85a08a4a9edc59ccf0da748rdnqq" Jun 11 18:45:21.977779 ip-10-0-141-55 kubenswrapper[2578]: I0611 18:45:21.977768 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/0228a3cc79630676fae641e6a38dab1752e85a08a4a9edc59ccf0da748rdnqq" event={"ID":"69c5147e-1445-4ab8-8c7c-430354b6d17d","Type":"ContainerDied","Data":"f3b0924364a18cd5ffde11d2a880b1f063607e328c84577d3e4f1abbea805ca7"} Jun 11 18:45:21.977998 ip-10-0-141-55 kubenswrapper[2578]: I0611 18:45:21.977807 2578 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="f3b0924364a18cd5ffde11d2a880b1f063607e328c84577d3e4f1abbea805ca7" Jun 11 18:45:41.159370 ip-10-0-141-55 kubenswrapper[2578]: I0611 18:45:41.159335 2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["keycloak-system/maas-keycloak-0"] Jun 11 18:45:41.159800 ip-10-0-141-55 kubenswrapper[2578]: I0611 18:45:41.159715 2578 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="69c5147e-1445-4ab8-8c7c-430354b6d17d" containerName="util" Jun 11 18:45:41.159800 ip-10-0-141-55 kubenswrapper[2578]: I0611 18:45:41.159727 2578 state_mem.go:107] "Deleted CPUSet assignment" podUID="69c5147e-1445-4ab8-8c7c-430354b6d17d" containerName="util" Jun 11 18:45:41.159800 ip-10-0-141-55 kubenswrapper[2578]: I0611 18:45:41.159740 2578 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="69c5147e-1445-4ab8-8c7c-430354b6d17d" containerName="pull" Jun 11 18:45:41.159800 ip-10-0-141-55 kubenswrapper[2578]: I0611 18:45:41.159745 2578 state_mem.go:107] "Deleted CPUSet assignment" podUID="69c5147e-1445-4ab8-8c7c-430354b6d17d" containerName="pull" Jun 11 18:45:41.159800 ip-10-0-141-55 kubenswrapper[2578]: I0611 18:45:41.159752 2578 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="69c5147e-1445-4ab8-8c7c-430354b6d17d" containerName="extract" Jun 11 18:45:41.159800 ip-10-0-141-55 kubenswrapper[2578]: I0611 18:45:41.159757 2578 state_mem.go:107] "Deleted CPUSet assignment" podUID="69c5147e-1445-4ab8-8c7c-430354b6d17d" containerName="extract" Jun 11 18:45:41.159992 ip-10-0-141-55 kubenswrapper[2578]: I0611 18:45:41.159825 2578 memory_manager.go:368] "RemoveStaleState removing state" podUID="69c5147e-1445-4ab8-8c7c-430354b6d17d" containerName="extract" Jun 11 18:45:41.164051 ip-10-0-141-55 kubenswrapper[2578]: I0611 18:45:41.164034 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="keycloak-system/maas-keycloak-0" Jun 11 18:45:41.166788 ip-10-0-141-55 kubenswrapper[2578]: I0611 18:45:41.166762 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"keycloak-system\"/\"default-dockercfg-6svgs\"" Jun 11 18:45:41.166788 ip-10-0-141-55 kubenswrapper[2578]: I0611 18:45:41.166790 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"keycloak-system\"/\"maas-keycloak-initial-admin\"" Jun 11 18:45:41.167008 ip-10-0-141-55 kubenswrapper[2578]: I0611 18:45:41.166762 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"keycloak-system\"/\"openshift-service-ca.crt\"" Jun 11 18:45:41.168358 ip-10-0-141-55 kubenswrapper[2578]: I0611 18:45:41.168306 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"keycloak-system\"/\"kube-root-ca.crt\"" Jun 11 18:45:41.171904 ip-10-0-141-55 kubenswrapper[2578]: I0611 18:45:41.171882 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["keycloak-system/maas-keycloak-0"] Jun 11 18:45:41.283325 ip-10-0-141-55 kubenswrapper[2578]: I0611 18:45:41.283289 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xdn78\" (UniqueName: \"kubernetes.io/projected/1e4abbfb-b49f-47f6-948a-97782f8bcfb6-kube-api-access-xdn78\") pod \"maas-keycloak-0\" (UID: \"1e4abbfb-b49f-47f6-948a-97782f8bcfb6\") " pod="keycloak-system/maas-keycloak-0" Jun 11 18:45:41.384423 ip-10-0-141-55 kubenswrapper[2578]: I0611 18:45:41.384390 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xdn78\" (UniqueName: \"kubernetes.io/projected/1e4abbfb-b49f-47f6-948a-97782f8bcfb6-kube-api-access-xdn78\") pod \"maas-keycloak-0\" (UID: \"1e4abbfb-b49f-47f6-948a-97782f8bcfb6\") " pod="keycloak-system/maas-keycloak-0" Jun 11 18:45:41.393374 ip-10-0-141-55 kubenswrapper[2578]: I0611 18:45:41.393349 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-xdn78\" (UniqueName: \"kubernetes.io/projected/1e4abbfb-b49f-47f6-948a-97782f8bcfb6-kube-api-access-xdn78\") pod \"maas-keycloak-0\" (UID: \"1e4abbfb-b49f-47f6-948a-97782f8bcfb6\") " pod="keycloak-system/maas-keycloak-0" Jun 11 18:45:41.474849 ip-10-0-141-55 kubenswrapper[2578]: I0611 18:45:41.474766 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="keycloak-system/maas-keycloak-0" Jun 11 18:45:41.608933 ip-10-0-141-55 kubenswrapper[2578]: I0611 18:45:41.608907 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["keycloak-system/maas-keycloak-0"] Jun 11 18:45:41.611602 ip-10-0-141-55 kubenswrapper[2578]: W0611 18:45:41.611540 2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1e4abbfb_b49f_47f6_948a_97782f8bcfb6.slice/crio-4497d4e24da5644a71d0f4e13ebafec91c42a3dbdac63525755e4aa64cd1c87a WatchSource:0}: Error finding container 4497d4e24da5644a71d0f4e13ebafec91c42a3dbdac63525755e4aa64cd1c87a: Status 404 returned error can't find the container with id 4497d4e24da5644a71d0f4e13ebafec91c42a3dbdac63525755e4aa64cd1c87a Jun 11 18:45:42.088718 ip-10-0-141-55 kubenswrapper[2578]: I0611 18:45:42.088678 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="keycloak-system/maas-keycloak-0" event={"ID":"1e4abbfb-b49f-47f6-948a-97782f8bcfb6","Type":"ContainerStarted","Data":"4497d4e24da5644a71d0f4e13ebafec91c42a3dbdac63525755e4aa64cd1c87a"} Jun 11 18:45:47.123686 ip-10-0-141-55 kubenswrapper[2578]: I0611 18:45:47.123651 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="keycloak-system/maas-keycloak-0" event={"ID":"1e4abbfb-b49f-47f6-948a-97782f8bcfb6","Type":"ContainerStarted","Data":"4ddc0df3e7527b47e3519222ff42c8cf3c50f81fb789a37ab30606c2f4967a41"} Jun 11 18:45:47.143208 ip-10-0-141-55 kubenswrapper[2578]: I0611 18:45:47.143145 2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="keycloak-system/maas-keycloak-0" podStartSLOduration=1.6962093249999999 podStartE2EDuration="6.143125622s" totalImagesPullingTime="4.446916297s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-11 18:45:41 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-11 18:45:47.142347959 +0000 UTC m=+553.097022578" watchObservedRunningTime="2026-06-11 18:45:47.143125622 +0000 UTC m=+553.097800231" Jun 11 18:45:47.475049 ip-10-0-141-55 kubenswrapper[2578]: I0611 18:45:47.474950 2578 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="keycloak-system/maas-keycloak-0" Jun 11 18:45:47.476662 ip-10-0-141-55 kubenswrapper[2578]: I0611 18:45:47.476613 2578 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="1e4abbfb-b49f-47f6-948a-97782f8bcfb6" containerName="keycloak" probeResult="failure" output="Get \"http://10.134.0.41:9000/health/started\": dial tcp 10.134.0.41:9000: connect: connection refused" Jun 11 18:45:48.476173 ip-10-0-141-55 kubenswrapper[2578]: I0611 18:45:48.476113 2578 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="1e4abbfb-b49f-47f6-948a-97782f8bcfb6" containerName="keycloak" probeResult="failure" output="Get \"http://10.134.0.41:9000/health/started\": dial tcp 10.134.0.41:9000: connect: connection refused" Jun 11 18:45:49.476227 ip-10-0-141-55 kubenswrapper[2578]: I0611 18:45:49.476173 2578 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="1e4abbfb-b49f-47f6-948a-97782f8bcfb6" containerName="keycloak" probeResult="failure" output="Get \"http://10.134.0.41:9000/health/started\": dial tcp 10.134.0.41:9000: connect: connection refused" Jun 11 18:45:50.475299 ip-10-0-141-55 kubenswrapper[2578]: I0611 18:45:50.475249 2578 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="1e4abbfb-b49f-47f6-948a-97782f8bcfb6" containerName="keycloak" probeResult="failure" output="Get \"http://10.134.0.41:9000/health/started\": dial tcp 10.134.0.41:9000: connect: connection refused" Jun 11 18:45:51.476602 ip-10-0-141-55 kubenswrapper[2578]: I0611 18:45:51.475851 2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="keycloak-system/maas-keycloak-0" Jun 11 18:45:51.476602 ip-10-0-141-55 kubenswrapper[2578]: I0611 18:45:51.476189 2578 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="1e4abbfb-b49f-47f6-948a-97782f8bcfb6" containerName="keycloak" probeResult="failure" output="Get \"http://10.134.0.41:9000/health/started\": dial tcp 10.134.0.41:9000: connect: connection refused" Jun 11 18:45:52.475295 ip-10-0-141-55 kubenswrapper[2578]: I0611 18:45:52.475238 2578 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="1e4abbfb-b49f-47f6-948a-97782f8bcfb6" containerName="keycloak" probeResult="failure" output="Get \"http://10.134.0.41:9000/health/started\": dial tcp 10.134.0.41:9000: connect: connection refused" Jun 11 18:45:53.476227 ip-10-0-141-55 kubenswrapper[2578]: I0611 18:45:53.476178 2578 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="1e4abbfb-b49f-47f6-948a-97782f8bcfb6" containerName="keycloak" probeResult="failure" output="Get \"http://10.134.0.41:9000/health/started\": dial tcp 10.134.0.41:9000: connect: connection refused" Jun 11 18:45:54.476081 ip-10-0-141-55 kubenswrapper[2578]: I0611 18:45:54.476027 2578 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="1e4abbfb-b49f-47f6-948a-97782f8bcfb6" containerName="keycloak" probeResult="failure" output="Get \"http://10.134.0.41:9000/health/started\": dial tcp 10.134.0.41:9000: connect: connection refused" Jun 11 18:45:55.475570 ip-10-0-141-55 kubenswrapper[2578]: I0611 18:45:55.475503 2578 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="1e4abbfb-b49f-47f6-948a-97782f8bcfb6" containerName="keycloak" probeResult="failure" output="Get \"http://10.134.0.41:9000/health/started\": dial tcp 10.134.0.41:9000: connect: connection refused" Jun 11 18:45:56.476211 ip-10-0-141-55 kubenswrapper[2578]: I0611 18:45:56.476159 2578 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="1e4abbfb-b49f-47f6-948a-97782f8bcfb6" containerName="keycloak" probeResult="failure" output="Get \"http://10.134.0.41:9000/health/started\": dial tcp 10.134.0.41:9000: connect: connection refused" Jun 11 18:45:57.475406 ip-10-0-141-55 kubenswrapper[2578]: I0611 18:45:57.475361 2578 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="1e4abbfb-b49f-47f6-948a-97782f8bcfb6" containerName="keycloak" probeResult="failure" output="Get \"http://10.134.0.41:9000/health/started\": dial tcp 10.134.0.41:9000: connect: connection refused" Jun 11 18:45:58.475409 ip-10-0-141-55 kubenswrapper[2578]: I0611 18:45:58.475361 2578 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="1e4abbfb-b49f-47f6-948a-97782f8bcfb6" containerName="keycloak" probeResult="failure" output="Get \"http://10.134.0.41:9000/health/started\": dial tcp 10.134.0.41:9000: connect: connection refused" Jun 11 18:45:59.601904 ip-10-0-141-55 kubenswrapper[2578]: I0611 18:45:59.601857 2578 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="keycloak-system/maas-keycloak-0" Jun 11 18:45:59.622409 ip-10-0-141-55 kubenswrapper[2578]: I0611 18:45:59.622366 2578 prober.go:120] "Probe failed" probeType="Readiness" pod="keycloak-system/maas-keycloak-0" podUID="1e4abbfb-b49f-47f6-948a-97782f8bcfb6" containerName="keycloak" probeResult="failure" output="HTTP probe failed with statuscode: 503" Jun 11 18:46:09.608502 ip-10-0-141-55 kubenswrapper[2578]: I0611 18:46:09.608470 2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="keycloak-system/maas-keycloak-0" Jun 11 18:46:10.551492 ip-10-0-141-55 kubenswrapper[2578]: I0611 18:46:10.551450 2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-5d4b67c446-x9q82"] Jun 11 18:46:10.562367 ip-10-0-141-55 kubenswrapper[2578]: I0611 18:46:10.562342 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-5d4b67c446-x9q82"] Jun 11 18:46:10.562618 ip-10-0-141-55 kubenswrapper[2578]: I0611 18:46:10.562435 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-5d4b67c446-x9q82" Jun 11 18:46:10.654122 ip-10-0-141-55 kubenswrapper[2578]: I0611 18:46:10.654092 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-24gkn\" (UniqueName: \"kubernetes.io/projected/392b630a-6f33-4f8d-bdca-c68a1b5887ac-kube-api-access-24gkn\") pod \"authorino-5d4b67c446-x9q82\" (UID: \"392b630a-6f33-4f8d-bdca-c68a1b5887ac\") " pod="kuadrant-system/authorino-5d4b67c446-x9q82" Jun 11 18:46:10.755316 ip-10-0-141-55 kubenswrapper[2578]: I0611 18:46:10.755282 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-24gkn\" (UniqueName: \"kubernetes.io/projected/392b630a-6f33-4f8d-bdca-c68a1b5887ac-kube-api-access-24gkn\") pod \"authorino-5d4b67c446-x9q82\" (UID: \"392b630a-6f33-4f8d-bdca-c68a1b5887ac\") " pod="kuadrant-system/authorino-5d4b67c446-x9q82" Jun 11 18:46:10.765280 ip-10-0-141-55 kubenswrapper[2578]: I0611 18:46:10.765248 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-24gkn\" (UniqueName: \"kubernetes.io/projected/392b630a-6f33-4f8d-bdca-c68a1b5887ac-kube-api-access-24gkn\") pod \"authorino-5d4b67c446-x9q82\" (UID: \"392b630a-6f33-4f8d-bdca-c68a1b5887ac\") " pod="kuadrant-system/authorino-5d4b67c446-x9q82" Jun 11 18:46:10.817815 ip-10-0-141-55 kubenswrapper[2578]: I0611 18:46:10.817741 2578 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-5d4b67c446-x9q82"] Jun 11 18:46:10.818000 ip-10-0-141-55 kubenswrapper[2578]: I0611 18:46:10.817988 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-5d4b67c446-x9q82" Jun 11 18:46:10.848010 ip-10-0-141-55 kubenswrapper[2578]: I0611 18:46:10.847978 2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-5b896b6599-6j4v2"] Jun 11 18:46:10.851706 ip-10-0-141-55 kubenswrapper[2578]: I0611 18:46:10.851689 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-5b896b6599-6j4v2" Jun 11 18:46:10.860679 ip-10-0-141-55 kubenswrapper[2578]: I0611 18:46:10.860652 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-5b896b6599-6j4v2"] Jun 11 18:46:10.949627 ip-10-0-141-55 kubenswrapper[2578]: I0611 18:46:10.949603 2578 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-5d4b67c446-x9q82"] Jun 11 18:46:10.951229 ip-10-0-141-55 kubenswrapper[2578]: W0611 18:46:10.951189 2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod392b630a_6f33_4f8d_bdca_c68a1b5887ac.slice/crio-3180f347794a91be5adfad16b67746c6ecd0f948b9cf4dd80e104f352c345645 WatchSource:0}: Error finding container 3180f347794a91be5adfad16b67746c6ecd0f948b9cf4dd80e104f352c345645: Status 404 returned error can't find the container with id 3180f347794a91be5adfad16b67746c6ecd0f948b9cf4dd80e104f352c345645 Jun 11 18:46:10.956527 ip-10-0-141-55 kubenswrapper[2578]: I0611 18:46:10.956498 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-g62l6\" (UniqueName: \"kubernetes.io/projected/50ac7c0d-dc5d-4b3f-b27c-ba2eda340b2c-kube-api-access-g62l6\") pod \"authorino-5b896b6599-6j4v2\" (UID: \"50ac7c0d-dc5d-4b3f-b27c-ba2eda340b2c\") " pod="kuadrant-system/authorino-5b896b6599-6j4v2" Jun 11 18:46:11.057010 ip-10-0-141-55 kubenswrapper[2578]: I0611 18:46:11.056974 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-g62l6\" (UniqueName: \"kubernetes.io/projected/50ac7c0d-dc5d-4b3f-b27c-ba2eda340b2c-kube-api-access-g62l6\") pod \"authorino-5b896b6599-6j4v2\" (UID: \"50ac7c0d-dc5d-4b3f-b27c-ba2eda340b2c\") " pod="kuadrant-system/authorino-5b896b6599-6j4v2" Jun 11 18:46:11.072871 ip-10-0-141-55 kubenswrapper[2578]: I0611 18:46:11.072804 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-g62l6\" (UniqueName: \"kubernetes.io/projected/50ac7c0d-dc5d-4b3f-b27c-ba2eda340b2c-kube-api-access-g62l6\") pod \"authorino-5b896b6599-6j4v2\" (UID: \"50ac7c0d-dc5d-4b3f-b27c-ba2eda340b2c\") " pod="kuadrant-system/authorino-5b896b6599-6j4v2" Jun 11 18:46:11.079267 ip-10-0-141-55 kubenswrapper[2578]: I0611 18:46:11.079236 2578 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-5b896b6599-6j4v2"] Jun 11 18:46:11.079568 ip-10-0-141-55 kubenswrapper[2578]: I0611 18:46:11.079541 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-5b896b6599-6j4v2" Jun 11 18:46:11.106909 ip-10-0-141-55 kubenswrapper[2578]: I0611 18:46:11.106869 2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-54888c5999-h78z9"] Jun 11 18:46:11.111065 ip-10-0-141-55 kubenswrapper[2578]: I0611 18:46:11.111043 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-54888c5999-h78z9" Jun 11 18:46:11.113813 ip-10-0-141-55 kubenswrapper[2578]: I0611 18:46:11.113794 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"authorino-server-cert\"" Jun 11 18:46:11.121276 ip-10-0-141-55 kubenswrapper[2578]: I0611 18:46:11.121254 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-54888c5999-h78z9"] Jun 11 18:46:11.158242 ip-10-0-141-55 kubenswrapper[2578]: I0611 18:46:11.158214 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-pjg4s\" (UniqueName: \"kubernetes.io/projected/e5d97ad0-c7bc-417c-9d4e-3244bb8376eb-kube-api-access-pjg4s\") pod \"authorino-54888c5999-h78z9\" (UID: \"e5d97ad0-c7bc-417c-9d4e-3244bb8376eb\") " pod="kuadrant-system/authorino-54888c5999-h78z9" Jun 11 18:46:11.158389 ip-10-0-141-55 kubenswrapper[2578]: I0611 18:46:11.158298 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/e5d97ad0-c7bc-417c-9d4e-3244bb8376eb-tls-cert\") pod \"authorino-54888c5999-h78z9\" (UID: \"e5d97ad0-c7bc-417c-9d4e-3244bb8376eb\") " pod="kuadrant-system/authorino-54888c5999-h78z9" Jun 11 18:46:11.216662 ip-10-0-141-55 kubenswrapper[2578]: I0611 18:46:11.216637 2578 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-5b896b6599-6j4v2"] Jun 11 18:46:11.217432 ip-10-0-141-55 kubenswrapper[2578]: W0611 18:46:11.217404 2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod50ac7c0d_dc5d_4b3f_b27c_ba2eda340b2c.slice/crio-a8f560616c3dd9632108c9bde9e7bb21685693365cdaf72e242b0b5e1519cf8a WatchSource:0}: Error finding container a8f560616c3dd9632108c9bde9e7bb21685693365cdaf72e242b0b5e1519cf8a: Status 404 returned error can't find the container with id a8f560616c3dd9632108c9bde9e7bb21685693365cdaf72e242b0b5e1519cf8a Jun 11 18:46:11.259228 ip-10-0-141-55 kubenswrapper[2578]: I0611 18:46:11.259201 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/e5d97ad0-c7bc-417c-9d4e-3244bb8376eb-tls-cert\") pod \"authorino-54888c5999-h78z9\" (UID: \"e5d97ad0-c7bc-417c-9d4e-3244bb8376eb\") " pod="kuadrant-system/authorino-54888c5999-h78z9" Jun 11 18:46:11.259370 ip-10-0-141-55 kubenswrapper[2578]: I0611 18:46:11.259265 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-pjg4s\" (UniqueName: \"kubernetes.io/projected/e5d97ad0-c7bc-417c-9d4e-3244bb8376eb-kube-api-access-pjg4s\") pod \"authorino-54888c5999-h78z9\" (UID: \"e5d97ad0-c7bc-417c-9d4e-3244bb8376eb\") " pod="kuadrant-system/authorino-54888c5999-h78z9" Jun 11 18:46:11.261714 ip-10-0-141-55 kubenswrapper[2578]: I0611 18:46:11.261694 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/e5d97ad0-c7bc-417c-9d4e-3244bb8376eb-tls-cert\") pod \"authorino-54888c5999-h78z9\" (UID: \"e5d97ad0-c7bc-417c-9d4e-3244bb8376eb\") " pod="kuadrant-system/authorino-54888c5999-h78z9" Jun 11 18:46:11.267437 ip-10-0-141-55 kubenswrapper[2578]: I0611 18:46:11.267419 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-pjg4s\" (UniqueName: \"kubernetes.io/projected/e5d97ad0-c7bc-417c-9d4e-3244bb8376eb-kube-api-access-pjg4s\") pod \"authorino-54888c5999-h78z9\" (UID: \"e5d97ad0-c7bc-417c-9d4e-3244bb8376eb\") " pod="kuadrant-system/authorino-54888c5999-h78z9" Jun 11 18:46:11.299997 ip-10-0-141-55 kubenswrapper[2578]: I0611 18:46:11.299969 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-5b896b6599-6j4v2" event={"ID":"50ac7c0d-dc5d-4b3f-b27c-ba2eda340b2c","Type":"ContainerStarted","Data":"a8f560616c3dd9632108c9bde9e7bb21685693365cdaf72e242b0b5e1519cf8a"} Jun 11 18:46:11.301154 ip-10-0-141-55 kubenswrapper[2578]: I0611 18:46:11.301133 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-5d4b67c446-x9q82" event={"ID":"392b630a-6f33-4f8d-bdca-c68a1b5887ac","Type":"ContainerStarted","Data":"3180f347794a91be5adfad16b67746c6ecd0f948b9cf4dd80e104f352c345645"} Jun 11 18:46:11.422022 ip-10-0-141-55 kubenswrapper[2578]: I0611 18:46:11.421993 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-54888c5999-h78z9" Jun 11 18:46:11.548649 ip-10-0-141-55 kubenswrapper[2578]: I0611 18:46:11.548621 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-54888c5999-h78z9"] Jun 11 18:46:11.549245 ip-10-0-141-55 kubenswrapper[2578]: W0611 18:46:11.549207 2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pode5d97ad0_c7bc_417c_9d4e_3244bb8376eb.slice/crio-90b9b2cd82b65e598906549b490fdfd523d037cae654aed1f9856cae542339d2 WatchSource:0}: Error finding container 90b9b2cd82b65e598906549b490fdfd523d037cae654aed1f9856cae542339d2: Status 404 returned error can't find the container with id 90b9b2cd82b65e598906549b490fdfd523d037cae654aed1f9856cae542339d2 Jun 11 18:46:12.307889 ip-10-0-141-55 kubenswrapper[2578]: I0611 18:46:12.307855 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-5b896b6599-6j4v2" event={"ID":"50ac7c0d-dc5d-4b3f-b27c-ba2eda340b2c","Type":"ContainerStarted","Data":"7dc54d6fd5bf3f88ac2836c4b93d14421288316acedfc4e4bc1f850ac9502c4a"} Jun 11 18:46:12.308348 ip-10-0-141-55 kubenswrapper[2578]: I0611 18:46:12.307922 2578 kuberuntime_container.go:872] "Killing container with a grace period" pod="kuadrant-system/authorino-5b896b6599-6j4v2" podUID="50ac7c0d-dc5d-4b3f-b27c-ba2eda340b2c" containerName="authorino" containerID="cri-o://7dc54d6fd5bf3f88ac2836c4b93d14421288316acedfc4e4bc1f850ac9502c4a" gracePeriod=30 Jun 11 18:46:12.309289 ip-10-0-141-55 kubenswrapper[2578]: I0611 18:46:12.309265 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-5d4b67c446-x9q82" event={"ID":"392b630a-6f33-4f8d-bdca-c68a1b5887ac","Type":"ContainerStarted","Data":"642962871a36d83d698a6d485f5e6a7432bee0197fe45bc42a55e07aee9a70f9"} Jun 11 18:46:12.309442 ip-10-0-141-55 kubenswrapper[2578]: I0611 18:46:12.309343 2578 kuberuntime_container.go:872] "Killing container with a grace period" pod="kuadrant-system/authorino-5d4b67c446-x9q82" podUID="392b630a-6f33-4f8d-bdca-c68a1b5887ac" containerName="authorino" containerID="cri-o://642962871a36d83d698a6d485f5e6a7432bee0197fe45bc42a55e07aee9a70f9" gracePeriod=30 Jun 11 18:46:12.311055 ip-10-0-141-55 kubenswrapper[2578]: I0611 18:46:12.311031 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-54888c5999-h78z9" event={"ID":"e5d97ad0-c7bc-417c-9d4e-3244bb8376eb","Type":"ContainerStarted","Data":"964ce21b74bd46021d596d71b9cc6cd7382b4da82f7befe0e03d9a9bbdf984a1"} Jun 11 18:46:12.311188 ip-10-0-141-55 kubenswrapper[2578]: I0611 18:46:12.311076 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-54888c5999-h78z9" event={"ID":"e5d97ad0-c7bc-417c-9d4e-3244bb8376eb","Type":"ContainerStarted","Data":"90b9b2cd82b65e598906549b490fdfd523d037cae654aed1f9856cae542339d2"} Jun 11 18:46:12.324049 ip-10-0-141-55 kubenswrapper[2578]: I0611 18:46:12.324007 2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/authorino-5b896b6599-6j4v2" podStartSLOduration=1.948611268 podStartE2EDuration="2.323994771s" totalImagesPullingTime="375.383503ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-11 18:46:10 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-11 18:46:12.322923455 +0000 UTC m=+578.277598062" watchObservedRunningTime="2026-06-11 18:46:12.323994771 +0000 UTC m=+578.278669398" Jun 11 18:46:12.338695 ip-10-0-141-55 kubenswrapper[2578]: I0611 18:46:12.338658 2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/authorino-54888c5999-h78z9" podStartSLOduration=0.798337273 podStartE2EDuration="1.338645836s" totalImagesPullingTime="540.308563ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-11 18:46:11 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-11 18:46:12.337626413 +0000 UTC m=+578.292301020" watchObservedRunningTime="2026-06-11 18:46:12.338645836 +0000 UTC m=+578.293320441" Jun 11 18:46:12.354050 ip-10-0-141-55 kubenswrapper[2578]: I0611 18:46:12.354001 2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/authorino-5d4b67c446-x9q82" podStartSLOduration=1.7755482919999999 podStartE2EDuration="2.353984371s" totalImagesPullingTime="578.436079ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-11 18:46:10 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-11 18:46:12.352366354 +0000 UTC m=+578.307040962" watchObservedRunningTime="2026-06-11 18:46:12.353984371 +0000 UTC m=+578.308658980" Jun 11 18:46:12.366280 ip-10-0-141-55 kubenswrapper[2578]: I0611 18:46:12.366256 2578 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-75d556bd77-lzc8z"] Jun 11 18:46:12.366456 ip-10-0-141-55 kubenswrapper[2578]: I0611 18:46:12.366436 2578 kuberuntime_container.go:872] "Killing container with a grace period" pod="kuadrant-system/authorino-75d556bd77-lzc8z" podUID="37262dbc-35c5-4d26-b169-c7acfc04eeda" containerName="authorino" containerID="cri-o://d7c5bdd28a0f914c4f6d5ee7a329aae4944da264c7320078828b10749df60c95" gracePeriod=30 Jun 11 18:46:12.605500 ip-10-0-141-55 kubenswrapper[2578]: I0611 18:46:12.605438 2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-5b896b6599-6j4v2" Jun 11 18:46:12.644139 ip-10-0-141-55 kubenswrapper[2578]: I0611 18:46:12.644110 2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-5d4b67c446-x9q82" Jun 11 18:46:12.647421 ip-10-0-141-55 kubenswrapper[2578]: I0611 18:46:12.647400 2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-75d556bd77-lzc8z" Jun 11 18:46:12.671887 ip-10-0-141-55 kubenswrapper[2578]: I0611 18:46:12.671851 2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-g62l6\" (UniqueName: \"kubernetes.io/projected/50ac7c0d-dc5d-4b3f-b27c-ba2eda340b2c-kube-api-access-g62l6\") pod \"50ac7c0d-dc5d-4b3f-b27c-ba2eda340b2c\" (UID: \"50ac7c0d-dc5d-4b3f-b27c-ba2eda340b2c\") " Jun 11 18:46:12.672129 ip-10-0-141-55 kubenswrapper[2578]: I0611 18:46:12.671943 2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-24gkn\" (UniqueName: \"kubernetes.io/projected/392b630a-6f33-4f8d-bdca-c68a1b5887ac-kube-api-access-24gkn\") pod \"392b630a-6f33-4f8d-bdca-c68a1b5887ac\" (UID: \"392b630a-6f33-4f8d-bdca-c68a1b5887ac\") " Jun 11 18:46:12.672129 ip-10-0-141-55 kubenswrapper[2578]: I0611 18:46:12.671979 2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-tqpjx\" (UniqueName: \"kubernetes.io/projected/37262dbc-35c5-4d26-b169-c7acfc04eeda-kube-api-access-tqpjx\") pod \"37262dbc-35c5-4d26-b169-c7acfc04eeda\" (UID: \"37262dbc-35c5-4d26-b169-c7acfc04eeda\") " Jun 11 18:46:12.674617 ip-10-0-141-55 kubenswrapper[2578]: I0611 18:46:12.674581 2578 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/50ac7c0d-dc5d-4b3f-b27c-ba2eda340b2c-kube-api-access-g62l6" (OuterVolumeSpecName: "kube-api-access-g62l6") pod "50ac7c0d-dc5d-4b3f-b27c-ba2eda340b2c" (UID: "50ac7c0d-dc5d-4b3f-b27c-ba2eda340b2c"). InnerVolumeSpecName "kube-api-access-g62l6". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 11 18:46:12.674755 ip-10-0-141-55 kubenswrapper[2578]: I0611 18:46:12.674625 2578 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/37262dbc-35c5-4d26-b169-c7acfc04eeda-kube-api-access-tqpjx" (OuterVolumeSpecName: "kube-api-access-tqpjx") pod "37262dbc-35c5-4d26-b169-c7acfc04eeda" (UID: "37262dbc-35c5-4d26-b169-c7acfc04eeda"). InnerVolumeSpecName "kube-api-access-tqpjx". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 11 18:46:12.675159 ip-10-0-141-55 kubenswrapper[2578]: I0611 18:46:12.675133 2578 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/392b630a-6f33-4f8d-bdca-c68a1b5887ac-kube-api-access-24gkn" (OuterVolumeSpecName: "kube-api-access-24gkn") pod "392b630a-6f33-4f8d-bdca-c68a1b5887ac" (UID: "392b630a-6f33-4f8d-bdca-c68a1b5887ac"). InnerVolumeSpecName "kube-api-access-24gkn". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 11 18:46:12.772659 ip-10-0-141-55 kubenswrapper[2578]: I0611 18:46:12.772636 2578 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-tqpjx\" (UniqueName: \"kubernetes.io/projected/37262dbc-35c5-4d26-b169-c7acfc04eeda-kube-api-access-tqpjx\") on node \"ip-10-0-141-55.ec2.internal\" DevicePath \"\"" Jun 11 18:46:12.772768 ip-10-0-141-55 kubenswrapper[2578]: I0611 18:46:12.772660 2578 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-g62l6\" (UniqueName: \"kubernetes.io/projected/50ac7c0d-dc5d-4b3f-b27c-ba2eda340b2c-kube-api-access-g62l6\") on node \"ip-10-0-141-55.ec2.internal\" DevicePath \"\"" Jun 11 18:46:12.772768 ip-10-0-141-55 kubenswrapper[2578]: I0611 18:46:12.772673 2578 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-24gkn\" (UniqueName: \"kubernetes.io/projected/392b630a-6f33-4f8d-bdca-c68a1b5887ac-kube-api-access-24gkn\") on node \"ip-10-0-141-55.ec2.internal\" DevicePath \"\"" Jun 11 18:46:13.318321 ip-10-0-141-55 kubenswrapper[2578]: I0611 18:46:13.318285 2578 generic.go:356] "Generic (PLEG): container finished" podID="37262dbc-35c5-4d26-b169-c7acfc04eeda" containerID="d7c5bdd28a0f914c4f6d5ee7a329aae4944da264c7320078828b10749df60c95" exitCode=0 Jun 11 18:46:13.318795 ip-10-0-141-55 kubenswrapper[2578]: I0611 18:46:13.318338 2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-75d556bd77-lzc8z" Jun 11 18:46:13.318795 ip-10-0-141-55 kubenswrapper[2578]: I0611 18:46:13.318379 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-75d556bd77-lzc8z" event={"ID":"37262dbc-35c5-4d26-b169-c7acfc04eeda","Type":"ContainerDied","Data":"d7c5bdd28a0f914c4f6d5ee7a329aae4944da264c7320078828b10749df60c95"} Jun 11 18:46:13.318795 ip-10-0-141-55 kubenswrapper[2578]: I0611 18:46:13.318419 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-75d556bd77-lzc8z" event={"ID":"37262dbc-35c5-4d26-b169-c7acfc04eeda","Type":"ContainerDied","Data":"4ea2808503bc5c945b9f6594f79ca047d57cfa75c98630977d5f2ff3aed4ab7f"} Jun 11 18:46:13.318795 ip-10-0-141-55 kubenswrapper[2578]: I0611 18:46:13.318440 2578 scope.go:117] "RemoveContainer" containerID="d7c5bdd28a0f914c4f6d5ee7a329aae4944da264c7320078828b10749df60c95" Jun 11 18:46:13.319751 ip-10-0-141-55 kubenswrapper[2578]: I0611 18:46:13.319732 2578 generic.go:356] "Generic (PLEG): container finished" podID="50ac7c0d-dc5d-4b3f-b27c-ba2eda340b2c" containerID="7dc54d6fd5bf3f88ac2836c4b93d14421288316acedfc4e4bc1f850ac9502c4a" exitCode=0 Jun 11 18:46:13.319835 ip-10-0-141-55 kubenswrapper[2578]: I0611 18:46:13.319798 2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-5b896b6599-6j4v2" Jun 11 18:46:13.319835 ip-10-0-141-55 kubenswrapper[2578]: I0611 18:46:13.319801 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-5b896b6599-6j4v2" event={"ID":"50ac7c0d-dc5d-4b3f-b27c-ba2eda340b2c","Type":"ContainerDied","Data":"7dc54d6fd5bf3f88ac2836c4b93d14421288316acedfc4e4bc1f850ac9502c4a"} Jun 11 18:46:13.319835 ip-10-0-141-55 kubenswrapper[2578]: I0611 18:46:13.319831 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-5b896b6599-6j4v2" event={"ID":"50ac7c0d-dc5d-4b3f-b27c-ba2eda340b2c","Type":"ContainerDied","Data":"a8f560616c3dd9632108c9bde9e7bb21685693365cdaf72e242b0b5e1519cf8a"} Jun 11 18:46:13.321136 ip-10-0-141-55 kubenswrapper[2578]: I0611 18:46:13.321114 2578 generic.go:356] "Generic (PLEG): container finished" podID="392b630a-6f33-4f8d-bdca-c68a1b5887ac" containerID="642962871a36d83d698a6d485f5e6a7432bee0197fe45bc42a55e07aee9a70f9" exitCode=0 Jun 11 18:46:13.321245 ip-10-0-141-55 kubenswrapper[2578]: I0611 18:46:13.321152 2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-5d4b67c446-x9q82" Jun 11 18:46:13.321245 ip-10-0-141-55 kubenswrapper[2578]: I0611 18:46:13.321200 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-5d4b67c446-x9q82" event={"ID":"392b630a-6f33-4f8d-bdca-c68a1b5887ac","Type":"ContainerDied","Data":"642962871a36d83d698a6d485f5e6a7432bee0197fe45bc42a55e07aee9a70f9"} Jun 11 18:46:13.321245 ip-10-0-141-55 kubenswrapper[2578]: I0611 18:46:13.321235 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-5d4b67c446-x9q82" event={"ID":"392b630a-6f33-4f8d-bdca-c68a1b5887ac","Type":"ContainerDied","Data":"3180f347794a91be5adfad16b67746c6ecd0f948b9cf4dd80e104f352c345645"} Jun 11 18:46:13.329627 ip-10-0-141-55 kubenswrapper[2578]: I0611 18:46:13.329610 2578 scope.go:117] "RemoveContainer" containerID="d7c5bdd28a0f914c4f6d5ee7a329aae4944da264c7320078828b10749df60c95" Jun 11 18:46:13.329981 ip-10-0-141-55 kubenswrapper[2578]: E0611 18:46:13.329886 2578 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"d7c5bdd28a0f914c4f6d5ee7a329aae4944da264c7320078828b10749df60c95\": container with ID starting with d7c5bdd28a0f914c4f6d5ee7a329aae4944da264c7320078828b10749df60c95 not found: ID does not exist" containerID="d7c5bdd28a0f914c4f6d5ee7a329aae4944da264c7320078828b10749df60c95" Jun 11 18:46:13.329981 ip-10-0-141-55 kubenswrapper[2578]: I0611 18:46:13.329921 2578 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"d7c5bdd28a0f914c4f6d5ee7a329aae4944da264c7320078828b10749df60c95"} err="failed to get container status \"d7c5bdd28a0f914c4f6d5ee7a329aae4944da264c7320078828b10749df60c95\": rpc error: code = NotFound desc = could not find container \"d7c5bdd28a0f914c4f6d5ee7a329aae4944da264c7320078828b10749df60c95\": container with ID starting with d7c5bdd28a0f914c4f6d5ee7a329aae4944da264c7320078828b10749df60c95 not found: ID does not exist" Jun 11 18:46:13.329981 ip-10-0-141-55 kubenswrapper[2578]: I0611 18:46:13.329952 2578 scope.go:117] "RemoveContainer" containerID="7dc54d6fd5bf3f88ac2836c4b93d14421288316acedfc4e4bc1f850ac9502c4a" Jun 11 18:46:13.338518 ip-10-0-141-55 kubenswrapper[2578]: I0611 18:46:13.338502 2578 scope.go:117] "RemoveContainer" containerID="7dc54d6fd5bf3f88ac2836c4b93d14421288316acedfc4e4bc1f850ac9502c4a" Jun 11 18:46:13.338784 ip-10-0-141-55 kubenswrapper[2578]: E0611 18:46:13.338766 2578 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"7dc54d6fd5bf3f88ac2836c4b93d14421288316acedfc4e4bc1f850ac9502c4a\": container with ID starting with 7dc54d6fd5bf3f88ac2836c4b93d14421288316acedfc4e4bc1f850ac9502c4a not found: ID does not exist" containerID="7dc54d6fd5bf3f88ac2836c4b93d14421288316acedfc4e4bc1f850ac9502c4a" Jun 11 18:46:13.338875 ip-10-0-141-55 kubenswrapper[2578]: I0611 18:46:13.338794 2578 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"7dc54d6fd5bf3f88ac2836c4b93d14421288316acedfc4e4bc1f850ac9502c4a"} err="failed to get container status \"7dc54d6fd5bf3f88ac2836c4b93d14421288316acedfc4e4bc1f850ac9502c4a\": rpc error: code = NotFound desc = could not find container \"7dc54d6fd5bf3f88ac2836c4b93d14421288316acedfc4e4bc1f850ac9502c4a\": container with ID starting with 7dc54d6fd5bf3f88ac2836c4b93d14421288316acedfc4e4bc1f850ac9502c4a not found: ID does not exist" Jun 11 18:46:13.338875 ip-10-0-141-55 kubenswrapper[2578]: I0611 18:46:13.338817 2578 scope.go:117] "RemoveContainer" containerID="642962871a36d83d698a6d485f5e6a7432bee0197fe45bc42a55e07aee9a70f9" Jun 11 18:46:13.346403 ip-10-0-141-55 kubenswrapper[2578]: I0611 18:46:13.346330 2578 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-75d556bd77-lzc8z"] Jun 11 18:46:13.346476 ip-10-0-141-55 kubenswrapper[2578]: I0611 18:46:13.346409 2578 scope.go:117] "RemoveContainer" containerID="642962871a36d83d698a6d485f5e6a7432bee0197fe45bc42a55e07aee9a70f9" Jun 11 18:46:13.346712 ip-10-0-141-55 kubenswrapper[2578]: E0611 18:46:13.346695 2578 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"642962871a36d83d698a6d485f5e6a7432bee0197fe45bc42a55e07aee9a70f9\": container with ID starting with 642962871a36d83d698a6d485f5e6a7432bee0197fe45bc42a55e07aee9a70f9 not found: ID does not exist" containerID="642962871a36d83d698a6d485f5e6a7432bee0197fe45bc42a55e07aee9a70f9" Jun 11 18:46:13.346771 ip-10-0-141-55 kubenswrapper[2578]: I0611 18:46:13.346718 2578 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"642962871a36d83d698a6d485f5e6a7432bee0197fe45bc42a55e07aee9a70f9"} err="failed to get container status \"642962871a36d83d698a6d485f5e6a7432bee0197fe45bc42a55e07aee9a70f9\": rpc error: code = NotFound desc = could not find container \"642962871a36d83d698a6d485f5e6a7432bee0197fe45bc42a55e07aee9a70f9\": container with ID starting with 642962871a36d83d698a6d485f5e6a7432bee0197fe45bc42a55e07aee9a70f9 not found: ID does not exist" Jun 11 18:46:13.350100 ip-10-0-141-55 kubenswrapper[2578]: I0611 18:46:13.350079 2578 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/authorino-75d556bd77-lzc8z"] Jun 11 18:46:13.363134 ip-10-0-141-55 kubenswrapper[2578]: I0611 18:46:13.363113 2578 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-5d4b67c446-x9q82"] Jun 11 18:46:13.365117 ip-10-0-141-55 kubenswrapper[2578]: I0611 18:46:13.365092 2578 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/authorino-5d4b67c446-x9q82"] Jun 11 18:46:13.375658 ip-10-0-141-55 kubenswrapper[2578]: I0611 18:46:13.375635 2578 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-5b896b6599-6j4v2"] Jun 11 18:46:13.379828 ip-10-0-141-55 kubenswrapper[2578]: I0611 18:46:13.379805 2578 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/authorino-5b896b6599-6j4v2"] Jun 11 18:46:14.421888 ip-10-0-141-55 kubenswrapper[2578]: I0611 18:46:14.421859 2578 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="37262dbc-35c5-4d26-b169-c7acfc04eeda" path="/var/lib/kubelet/pods/37262dbc-35c5-4d26-b169-c7acfc04eeda/volumes" Jun 11 18:46:14.422287 ip-10-0-141-55 kubenswrapper[2578]: I0611 18:46:14.422217 2578 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="392b630a-6f33-4f8d-bdca-c68a1b5887ac" path="/var/lib/kubelet/pods/392b630a-6f33-4f8d-bdca-c68a1b5887ac/volumes" Jun 11 18:46:14.422493 ip-10-0-141-55 kubenswrapper[2578]: I0611 18:46:14.422480 2578 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="50ac7c0d-dc5d-4b3f-b27c-ba2eda340b2c" path="/var/lib/kubelet/pods/50ac7c0d-dc5d-4b3f-b27c-ba2eda340b2c/volumes" Jun 11 18:46:16.167195 ip-10-0-141-55 kubenswrapper[2578]: I0611 18:46:16.167162 2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/maas-controller-84bc9f556d-g44xj"] Jun 11 18:46:16.167582 ip-10-0-141-55 kubenswrapper[2578]: I0611 18:46:16.167495 2578 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="50ac7c0d-dc5d-4b3f-b27c-ba2eda340b2c" containerName="authorino" Jun 11 18:46:16.167582 ip-10-0-141-55 kubenswrapper[2578]: I0611 18:46:16.167506 2578 state_mem.go:107] "Deleted CPUSet assignment" podUID="50ac7c0d-dc5d-4b3f-b27c-ba2eda340b2c" containerName="authorino" Jun 11 18:46:16.167582 ip-10-0-141-55 kubenswrapper[2578]: I0611 18:46:16.167518 2578 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="37262dbc-35c5-4d26-b169-c7acfc04eeda" containerName="authorino" Jun 11 18:46:16.167582 ip-10-0-141-55 kubenswrapper[2578]: I0611 18:46:16.167525 2578 state_mem.go:107] "Deleted CPUSet assignment" podUID="37262dbc-35c5-4d26-b169-c7acfc04eeda" containerName="authorino" Jun 11 18:46:16.167964 ip-10-0-141-55 kubenswrapper[2578]: I0611 18:46:16.167675 2578 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="392b630a-6f33-4f8d-bdca-c68a1b5887ac" containerName="authorino" Jun 11 18:46:16.168136 ip-10-0-141-55 kubenswrapper[2578]: I0611 18:46:16.168123 2578 state_mem.go:107] "Deleted CPUSet assignment" podUID="392b630a-6f33-4f8d-bdca-c68a1b5887ac" containerName="authorino" Jun 11 18:46:16.168503 ip-10-0-141-55 kubenswrapper[2578]: I0611 18:46:16.168489 2578 memory_manager.go:368] "RemoveStaleState removing state" podUID="392b630a-6f33-4f8d-bdca-c68a1b5887ac" containerName="authorino" Jun 11 18:46:16.168627 ip-10-0-141-55 kubenswrapper[2578]: I0611 18:46:16.168616 2578 memory_manager.go:368] "RemoveStaleState removing state" podUID="50ac7c0d-dc5d-4b3f-b27c-ba2eda340b2c" containerName="authorino" Jun 11 18:46:16.168720 ip-10-0-141-55 kubenswrapper[2578]: I0611 18:46:16.168710 2578 memory_manager.go:368] "RemoveStaleState removing state" podUID="37262dbc-35c5-4d26-b169-c7acfc04eeda" containerName="authorino" Jun 11 18:46:16.176181 ip-10-0-141-55 kubenswrapper[2578]: I0611 18:46:16.176160 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-84bc9f556d-g44xj" Jun 11 18:46:16.182843 ip-10-0-141-55 kubenswrapper[2578]: I0611 18:46:16.182821 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-controller-dockercfg-wh8tx\"" Jun 11 18:46:16.183681 ip-10-0-141-55 kubenswrapper[2578]: I0611 18:46:16.183660 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-controller-webhook-cert\"" Jun 11 18:46:16.183806 ip-10-0-141-55 kubenswrapper[2578]: I0611 18:46:16.183759 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"maas-parameters\"" Jun 11 18:46:16.186272 ip-10-0-141-55 kubenswrapper[2578]: I0611 18:46:16.186245 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-84bc9f556d-g44xj"] Jun 11 18:46:16.199909 ip-10-0-141-55 kubenswrapper[2578]: I0611 18:46:16.199881 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/a7c0c1e7-050d-491c-bd7e-32437d32ec59-webhook-cert\") pod \"maas-controller-84bc9f556d-g44xj\" (UID: \"a7c0c1e7-050d-491c-bd7e-32437d32ec59\") " pod="opendatahub/maas-controller-84bc9f556d-g44xj" Jun 11 18:46:16.200039 ip-10-0-141-55 kubenswrapper[2578]: I0611 18:46:16.200000 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-29rhd\" (UniqueName: \"kubernetes.io/projected/a7c0c1e7-050d-491c-bd7e-32437d32ec59-kube-api-access-29rhd\") pod \"maas-controller-84bc9f556d-g44xj\" (UID: \"a7c0c1e7-050d-491c-bd7e-32437d32ec59\") " pod="opendatahub/maas-controller-84bc9f556d-g44xj" Jun 11 18:46:16.300661 ip-10-0-141-55 kubenswrapper[2578]: I0611 18:46:16.300625 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/a7c0c1e7-050d-491c-bd7e-32437d32ec59-webhook-cert\") pod \"maas-controller-84bc9f556d-g44xj\" (UID: \"a7c0c1e7-050d-491c-bd7e-32437d32ec59\") " pod="opendatahub/maas-controller-84bc9f556d-g44xj" Jun 11 18:46:16.300856 ip-10-0-141-55 kubenswrapper[2578]: E0611 18:46:16.300686 2578 secret.go:189] Couldn't get secret opendatahub/maas-controller-webhook-cert: secret "maas-controller-webhook-cert" not found Jun 11 18:46:16.300856 ip-10-0-141-55 kubenswrapper[2578]: I0611 18:46:16.300717 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-29rhd\" (UniqueName: \"kubernetes.io/projected/a7c0c1e7-050d-491c-bd7e-32437d32ec59-kube-api-access-29rhd\") pod \"maas-controller-84bc9f556d-g44xj\" (UID: \"a7c0c1e7-050d-491c-bd7e-32437d32ec59\") " pod="opendatahub/maas-controller-84bc9f556d-g44xj" Jun 11 18:46:16.300856 ip-10-0-141-55 kubenswrapper[2578]: E0611 18:46:16.300760 2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a7c0c1e7-050d-491c-bd7e-32437d32ec59-webhook-cert podName:a7c0c1e7-050d-491c-bd7e-32437d32ec59 nodeName:}" failed. No retries permitted until 2026-06-11 18:46:16.800741794 +0000 UTC m=+582.755416377 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "webhook-cert" (UniqueName: "kubernetes.io/secret/a7c0c1e7-050d-491c-bd7e-32437d32ec59-webhook-cert") pod "maas-controller-84bc9f556d-g44xj" (UID: "a7c0c1e7-050d-491c-bd7e-32437d32ec59") : secret "maas-controller-webhook-cert" not found Jun 11 18:46:16.310386 ip-10-0-141-55 kubenswrapper[2578]: I0611 18:46:16.310361 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-29rhd\" (UniqueName: \"kubernetes.io/projected/a7c0c1e7-050d-491c-bd7e-32437d32ec59-kube-api-access-29rhd\") pod \"maas-controller-84bc9f556d-g44xj\" (UID: \"a7c0c1e7-050d-491c-bd7e-32437d32ec59\") " pod="opendatahub/maas-controller-84bc9f556d-g44xj" Jun 11 18:46:16.351003 ip-10-0-141-55 kubenswrapper[2578]: I0611 18:46:16.350972 2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/maas-controller-758d4854d9-rjjb7"] Jun 11 18:46:16.354380 ip-10-0-141-55 kubenswrapper[2578]: I0611 18:46:16.354362 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-758d4854d9-rjjb7" Jun 11 18:46:16.363530 ip-10-0-141-55 kubenswrapper[2578]: I0611 18:46:16.363501 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-758d4854d9-rjjb7"] Jun 11 18:46:16.401372 ip-10-0-141-55 kubenswrapper[2578]: I0611 18:46:16.401345 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-55c5v\" (UniqueName: \"kubernetes.io/projected/2a3840a8-677f-4c1c-902b-0458e780e9b5-kube-api-access-55c5v\") pod \"maas-controller-758d4854d9-rjjb7\" (UID: \"2a3840a8-677f-4c1c-902b-0458e780e9b5\") " pod="opendatahub/maas-controller-758d4854d9-rjjb7" Jun 11 18:46:16.401480 ip-10-0-141-55 kubenswrapper[2578]: I0611 18:46:16.401460 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/2a3840a8-677f-4c1c-902b-0458e780e9b5-webhook-cert\") pod \"maas-controller-758d4854d9-rjjb7\" (UID: \"2a3840a8-677f-4c1c-902b-0458e780e9b5\") " pod="opendatahub/maas-controller-758d4854d9-rjjb7" Jun 11 18:46:16.502041 ip-10-0-141-55 kubenswrapper[2578]: I0611 18:46:16.501969 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/2a3840a8-677f-4c1c-902b-0458e780e9b5-webhook-cert\") pod \"maas-controller-758d4854d9-rjjb7\" (UID: \"2a3840a8-677f-4c1c-902b-0458e780e9b5\") " pod="opendatahub/maas-controller-758d4854d9-rjjb7" Jun 11 18:46:16.502041 ip-10-0-141-55 kubenswrapper[2578]: I0611 18:46:16.502022 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-55c5v\" (UniqueName: \"kubernetes.io/projected/2a3840a8-677f-4c1c-902b-0458e780e9b5-kube-api-access-55c5v\") pod \"maas-controller-758d4854d9-rjjb7\" (UID: \"2a3840a8-677f-4c1c-902b-0458e780e9b5\") " pod="opendatahub/maas-controller-758d4854d9-rjjb7" Jun 11 18:46:16.504348 ip-10-0-141-55 kubenswrapper[2578]: I0611 18:46:16.504325 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/2a3840a8-677f-4c1c-902b-0458e780e9b5-webhook-cert\") pod \"maas-controller-758d4854d9-rjjb7\" (UID: \"2a3840a8-677f-4c1c-902b-0458e780e9b5\") " pod="opendatahub/maas-controller-758d4854d9-rjjb7" Jun 11 18:46:16.510597 ip-10-0-141-55 kubenswrapper[2578]: I0611 18:46:16.510576 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-55c5v\" (UniqueName: \"kubernetes.io/projected/2a3840a8-677f-4c1c-902b-0458e780e9b5-kube-api-access-55c5v\") pod \"maas-controller-758d4854d9-rjjb7\" (UID: \"2a3840a8-677f-4c1c-902b-0458e780e9b5\") " pod="opendatahub/maas-controller-758d4854d9-rjjb7" Jun 11 18:46:16.666464 ip-10-0-141-55 kubenswrapper[2578]: I0611 18:46:16.666428 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-758d4854d9-rjjb7" Jun 11 18:46:16.796569 ip-10-0-141-55 kubenswrapper[2578]: I0611 18:46:16.796522 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-758d4854d9-rjjb7"] Jun 11 18:46:16.797763 ip-10-0-141-55 kubenswrapper[2578]: W0611 18:46:16.797737 2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2a3840a8_677f_4c1c_902b_0458e780e9b5.slice/crio-40d96d453fd4a65e96a512b26a43f101cd49b79796ed4d364974d77c83cd7930 WatchSource:0}: Error finding container 40d96d453fd4a65e96a512b26a43f101cd49b79796ed4d364974d77c83cd7930: Status 404 returned error can't find the container with id 40d96d453fd4a65e96a512b26a43f101cd49b79796ed4d364974d77c83cd7930 Jun 11 18:46:16.804766 ip-10-0-141-55 kubenswrapper[2578]: I0611 18:46:16.804736 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/a7c0c1e7-050d-491c-bd7e-32437d32ec59-webhook-cert\") pod \"maas-controller-84bc9f556d-g44xj\" (UID: \"a7c0c1e7-050d-491c-bd7e-32437d32ec59\") " pod="opendatahub/maas-controller-84bc9f556d-g44xj" Jun 11 18:46:16.806965 ip-10-0-141-55 kubenswrapper[2578]: I0611 18:46:16.806946 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/a7c0c1e7-050d-491c-bd7e-32437d32ec59-webhook-cert\") pod \"maas-controller-84bc9f556d-g44xj\" (UID: \"a7c0c1e7-050d-491c-bd7e-32437d32ec59\") " pod="opendatahub/maas-controller-84bc9f556d-g44xj" Jun 11 18:46:17.088368 ip-10-0-141-55 kubenswrapper[2578]: I0611 18:46:17.088277 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-84bc9f556d-g44xj" Jun 11 18:46:17.217957 ip-10-0-141-55 kubenswrapper[2578]: I0611 18:46:17.217925 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-84bc9f556d-g44xj"] Jun 11 18:46:17.219931 ip-10-0-141-55 kubenswrapper[2578]: W0611 18:46:17.219904 2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda7c0c1e7_050d_491c_bd7e_32437d32ec59.slice/crio-27adc960c8eb9a49baaf6711f840831c9b48ff9b2b6dfd9108acf94042ec3b09 WatchSource:0}: Error finding container 27adc960c8eb9a49baaf6711f840831c9b48ff9b2b6dfd9108acf94042ec3b09: Status 404 returned error can't find the container with id 27adc960c8eb9a49baaf6711f840831c9b48ff9b2b6dfd9108acf94042ec3b09 Jun 11 18:46:17.347540 ip-10-0-141-55 kubenswrapper[2578]: I0611 18:46:17.347496 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-758d4854d9-rjjb7" event={"ID":"2a3840a8-677f-4c1c-902b-0458e780e9b5","Type":"ContainerStarted","Data":"40d96d453fd4a65e96a512b26a43f101cd49b79796ed4d364974d77c83cd7930"} Jun 11 18:46:17.348815 ip-10-0-141-55 kubenswrapper[2578]: I0611 18:46:17.348788 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-84bc9f556d-g44xj" event={"ID":"a7c0c1e7-050d-491c-bd7e-32437d32ec59","Type":"ContainerStarted","Data":"27adc960c8eb9a49baaf6711f840831c9b48ff9b2b6dfd9108acf94042ec3b09"} Jun 11 18:46:20.371350 ip-10-0-141-55 kubenswrapper[2578]: I0611 18:46:20.371307 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-758d4854d9-rjjb7" event={"ID":"2a3840a8-677f-4c1c-902b-0458e780e9b5","Type":"ContainerStarted","Data":"419cc1edcc57b4dd711af3c93d896ab0bb6d1a7b55164c43d22c887eebed2a2c"} Jun 11 18:46:20.371860 ip-10-0-141-55 kubenswrapper[2578]: I0611 18:46:20.371525 2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/maas-controller-758d4854d9-rjjb7" Jun 11 18:46:20.372826 ip-10-0-141-55 kubenswrapper[2578]: I0611 18:46:20.372805 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-84bc9f556d-g44xj" event={"ID":"a7c0c1e7-050d-491c-bd7e-32437d32ec59","Type":"ContainerStarted","Data":"cd083b8a49169cc88a4aefab4899f5ca85a0d9c0d5d33a6ee4b454c38c492fef"} Jun 11 18:46:20.372942 ip-10-0-141-55 kubenswrapper[2578]: I0611 18:46:20.372850 2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/maas-controller-84bc9f556d-g44xj" Jun 11 18:46:20.390922 ip-10-0-141-55 kubenswrapper[2578]: I0611 18:46:20.390881 2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/maas-controller-758d4854d9-rjjb7" podStartSLOduration=1.831330831 podStartE2EDuration="4.390867748s" totalImagesPullingTime="2.559536917s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-11 18:46:16 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-11 18:46:20.38983422 +0000 UTC m=+586.344508838" watchObservedRunningTime="2026-06-11 18:46:20.390867748 +0000 UTC m=+586.345542401" Jun 11 18:46:20.409908 ip-10-0-141-55 kubenswrapper[2578]: I0611 18:46:20.409865 2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/maas-controller-84bc9f556d-g44xj" podStartSLOduration=2.261461329 podStartE2EDuration="4.409851392s" totalImagesPullingTime="2.148390063s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-11 18:46:16 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-11 18:46:20.40702146 +0000 UTC m=+586.361696066" watchObservedRunningTime="2026-06-11 18:46:20.409851392 +0000 UTC m=+586.364526038" Jun 11 18:46:31.383777 ip-10-0-141-55 kubenswrapper[2578]: I0611 18:46:31.383745 2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/maas-controller-84bc9f556d-g44xj" Jun 11 18:46:31.384165 ip-10-0-141-55 kubenswrapper[2578]: I0611 18:46:31.383816 2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/maas-controller-758d4854d9-rjjb7" Jun 11 18:46:31.451082 ip-10-0-141-55 kubenswrapper[2578]: I0611 18:46:31.451048 2578 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-controller-84bc9f556d-g44xj"] Jun 11 18:46:31.451263 ip-10-0-141-55 kubenswrapper[2578]: I0611 18:46:31.451232 2578 kuberuntime_container.go:872] "Killing container with a grace period" pod="opendatahub/maas-controller-84bc9f556d-g44xj" podUID="a7c0c1e7-050d-491c-bd7e-32437d32ec59" containerName="manager" containerID="cri-o://cd083b8a49169cc88a4aefab4899f5ca85a0d9c0d5d33a6ee4b454c38c492fef" gracePeriod=30 Jun 11 18:46:31.693073 ip-10-0-141-55 kubenswrapper[2578]: I0611 18:46:31.693046 2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-84bc9f556d-g44xj" Jun 11 18:46:31.842739 ip-10-0-141-55 kubenswrapper[2578]: I0611 18:46:31.842707 2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/a7c0c1e7-050d-491c-bd7e-32437d32ec59-webhook-cert\") pod \"a7c0c1e7-050d-491c-bd7e-32437d32ec59\" (UID: \"a7c0c1e7-050d-491c-bd7e-32437d32ec59\") " Jun 11 18:46:31.842914 ip-10-0-141-55 kubenswrapper[2578]: I0611 18:46:31.842776 2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-29rhd\" (UniqueName: \"kubernetes.io/projected/a7c0c1e7-050d-491c-bd7e-32437d32ec59-kube-api-access-29rhd\") pod \"a7c0c1e7-050d-491c-bd7e-32437d32ec59\" (UID: \"a7c0c1e7-050d-491c-bd7e-32437d32ec59\") " Jun 11 18:46:31.844921 ip-10-0-141-55 kubenswrapper[2578]: I0611 18:46:31.844890 2578 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/a7c0c1e7-050d-491c-bd7e-32437d32ec59-kube-api-access-29rhd" (OuterVolumeSpecName: "kube-api-access-29rhd") pod "a7c0c1e7-050d-491c-bd7e-32437d32ec59" (UID: "a7c0c1e7-050d-491c-bd7e-32437d32ec59"). InnerVolumeSpecName "kube-api-access-29rhd". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 11 18:46:31.844921 ip-10-0-141-55 kubenswrapper[2578]: I0611 18:46:31.844895 2578 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/a7c0c1e7-050d-491c-bd7e-32437d32ec59-webhook-cert" (OuterVolumeSpecName: "webhook-cert") pod "a7c0c1e7-050d-491c-bd7e-32437d32ec59" (UID: "a7c0c1e7-050d-491c-bd7e-32437d32ec59"). InnerVolumeSpecName "webhook-cert". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 11 18:46:31.943642 ip-10-0-141-55 kubenswrapper[2578]: I0611 18:46:31.943580 2578 reconciler_common.go:299] "Volume detached for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/a7c0c1e7-050d-491c-bd7e-32437d32ec59-webhook-cert\") on node \"ip-10-0-141-55.ec2.internal\" DevicePath \"\"" Jun 11 18:46:31.943642 ip-10-0-141-55 kubenswrapper[2578]: I0611 18:46:31.943602 2578 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-29rhd\" (UniqueName: \"kubernetes.io/projected/a7c0c1e7-050d-491c-bd7e-32437d32ec59-kube-api-access-29rhd\") on node \"ip-10-0-141-55.ec2.internal\" DevicePath \"\"" Jun 11 18:46:32.437073 ip-10-0-141-55 kubenswrapper[2578]: I0611 18:46:32.437041 2578 generic.go:356] "Generic (PLEG): container finished" podID="a7c0c1e7-050d-491c-bd7e-32437d32ec59" containerID="cd083b8a49169cc88a4aefab4899f5ca85a0d9c0d5d33a6ee4b454c38c492fef" exitCode=0 Jun 11 18:46:32.437458 ip-10-0-141-55 kubenswrapper[2578]: I0611 18:46:32.437095 2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-84bc9f556d-g44xj" Jun 11 18:46:32.437458 ip-10-0-141-55 kubenswrapper[2578]: I0611 18:46:32.437119 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-84bc9f556d-g44xj" event={"ID":"a7c0c1e7-050d-491c-bd7e-32437d32ec59","Type":"ContainerDied","Data":"cd083b8a49169cc88a4aefab4899f5ca85a0d9c0d5d33a6ee4b454c38c492fef"} Jun 11 18:46:32.437458 ip-10-0-141-55 kubenswrapper[2578]: I0611 18:46:32.437166 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-84bc9f556d-g44xj" event={"ID":"a7c0c1e7-050d-491c-bd7e-32437d32ec59","Type":"ContainerDied","Data":"27adc960c8eb9a49baaf6711f840831c9b48ff9b2b6dfd9108acf94042ec3b09"} Jun 11 18:46:32.437458 ip-10-0-141-55 kubenswrapper[2578]: I0611 18:46:32.437185 2578 scope.go:117] "RemoveContainer" containerID="cd083b8a49169cc88a4aefab4899f5ca85a0d9c0d5d33a6ee4b454c38c492fef" Jun 11 18:46:32.446013 ip-10-0-141-55 kubenswrapper[2578]: I0611 18:46:32.445994 2578 scope.go:117] "RemoveContainer" containerID="cd083b8a49169cc88a4aefab4899f5ca85a0d9c0d5d33a6ee4b454c38c492fef" Jun 11 18:46:32.446267 ip-10-0-141-55 kubenswrapper[2578]: E0611 18:46:32.446248 2578 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"cd083b8a49169cc88a4aefab4899f5ca85a0d9c0d5d33a6ee4b454c38c492fef\": container with ID starting with cd083b8a49169cc88a4aefab4899f5ca85a0d9c0d5d33a6ee4b454c38c492fef not found: ID does not exist" containerID="cd083b8a49169cc88a4aefab4899f5ca85a0d9c0d5d33a6ee4b454c38c492fef" Jun 11 18:46:32.446327 ip-10-0-141-55 kubenswrapper[2578]: I0611 18:46:32.446276 2578 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"cd083b8a49169cc88a4aefab4899f5ca85a0d9c0d5d33a6ee4b454c38c492fef"} err="failed to get container status \"cd083b8a49169cc88a4aefab4899f5ca85a0d9c0d5d33a6ee4b454c38c492fef\": rpc error: code = NotFound desc = could not find container \"cd083b8a49169cc88a4aefab4899f5ca85a0d9c0d5d33a6ee4b454c38c492fef\": container with ID starting with cd083b8a49169cc88a4aefab4899f5ca85a0d9c0d5d33a6ee4b454c38c492fef not found: ID does not exist" Jun 11 18:46:32.458313 ip-10-0-141-55 kubenswrapper[2578]: I0611 18:46:32.458291 2578 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-controller-84bc9f556d-g44xj"] Jun 11 18:46:32.467073 ip-10-0-141-55 kubenswrapper[2578]: I0611 18:46:32.467051 2578 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/maas-controller-84bc9f556d-g44xj"] Jun 11 18:46:34.421935 ip-10-0-141-55 kubenswrapper[2578]: I0611 18:46:34.421905 2578 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="a7c0c1e7-050d-491c-bd7e-32437d32ec59" path="/var/lib/kubelet/pods/a7c0c1e7-050d-491c-bd7e-32437d32ec59/volumes" Jun 11 18:46:34.424383 ip-10-0-141-55 kubenswrapper[2578]: I0611 18:46:34.424360 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-machine-config-operator_kube-rbac-proxy-crio-ip-10-0-141-55.ec2.internal_a7e51dec29aa10b42d4127d190b80186/kube-rbac-proxy-crio/0.log" Jun 11 18:46:34.425484 ip-10-0-141-55 kubenswrapper[2578]: I0611 18:46:34.425467 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-machine-config-operator_kube-rbac-proxy-crio-ip-10-0-141-55.ec2.internal_a7e51dec29aa10b42d4127d190b80186/kube-rbac-proxy-crio/0.log" Jun 11 18:46:50.606473 ip-10-0-141-55 kubenswrapper[2578]: I0611 18:46:50.606441 2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/maas-api-5fbdd69b95-9z84h"] Jun 11 18:46:50.606955 ip-10-0-141-55 kubenswrapper[2578]: I0611 18:46:50.606821 2578 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="a7c0c1e7-050d-491c-bd7e-32437d32ec59" containerName="manager" Jun 11 18:46:50.606955 ip-10-0-141-55 kubenswrapper[2578]: I0611 18:46:50.606835 2578 state_mem.go:107] "Deleted CPUSet assignment" podUID="a7c0c1e7-050d-491c-bd7e-32437d32ec59" containerName="manager" Jun 11 18:46:50.606955 ip-10-0-141-55 kubenswrapper[2578]: I0611 18:46:50.606914 2578 memory_manager.go:368] "RemoveStaleState removing state" podUID="a7c0c1e7-050d-491c-bd7e-32437d32ec59" containerName="manager" Jun 11 18:46:50.609851 ip-10-0-141-55 kubenswrapper[2578]: I0611 18:46:50.609829 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-5fbdd69b95-9z84h" Jun 11 18:46:50.612765 ip-10-0-141-55 kubenswrapper[2578]: I0611 18:46:50.612745 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-api-serving-cert\"" Jun 11 18:46:50.612881 ip-10-0-141-55 kubenswrapper[2578]: I0611 18:46:50.612775 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-api-dockercfg-s5864\"" Jun 11 18:46:50.626324 ip-10-0-141-55 kubenswrapper[2578]: I0611 18:46:50.626300 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-api-5fbdd69b95-9z84h"] Jun 11 18:46:50.702405 ip-10-0-141-55 kubenswrapper[2578]: I0611 18:46:50.702377 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/32e782da-c0d3-48a5-b102-ae25c55c6ba7-openshift-service-ca\") pod \"maas-api-5fbdd69b95-9z84h\" (UID: \"32e782da-c0d3-48a5-b102-ae25c55c6ba7\") " pod="opendatahub/maas-api-5fbdd69b95-9z84h" Jun 11 18:46:50.702614 ip-10-0-141-55 kubenswrapper[2578]: I0611 18:46:50.702430 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/32e782da-c0d3-48a5-b102-ae25c55c6ba7-maas-api-tls\") pod \"maas-api-5fbdd69b95-9z84h\" (UID: \"32e782da-c0d3-48a5-b102-ae25c55c6ba7\") " pod="opendatahub/maas-api-5fbdd69b95-9z84h" Jun 11 18:46:50.702614 ip-10-0-141-55 kubenswrapper[2578]: I0611 18:46:50.702499 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7q6tt\" (UniqueName: \"kubernetes.io/projected/32e782da-c0d3-48a5-b102-ae25c55c6ba7-kube-api-access-7q6tt\") pod \"maas-api-5fbdd69b95-9z84h\" (UID: \"32e782da-c0d3-48a5-b102-ae25c55c6ba7\") " pod="opendatahub/maas-api-5fbdd69b95-9z84h" Jun 11 18:46:50.803337 ip-10-0-141-55 kubenswrapper[2578]: I0611 18:46:50.803303 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7q6tt\" (UniqueName: \"kubernetes.io/projected/32e782da-c0d3-48a5-b102-ae25c55c6ba7-kube-api-access-7q6tt\") pod \"maas-api-5fbdd69b95-9z84h\" (UID: \"32e782da-c0d3-48a5-b102-ae25c55c6ba7\") " pod="opendatahub/maas-api-5fbdd69b95-9z84h" Jun 11 18:46:50.803503 ip-10-0-141-55 kubenswrapper[2578]: I0611 18:46:50.803352 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/32e782da-c0d3-48a5-b102-ae25c55c6ba7-openshift-service-ca\") pod \"maas-api-5fbdd69b95-9z84h\" (UID: \"32e782da-c0d3-48a5-b102-ae25c55c6ba7\") " pod="opendatahub/maas-api-5fbdd69b95-9z84h" Jun 11 18:46:50.803503 ip-10-0-141-55 kubenswrapper[2578]: I0611 18:46:50.803390 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/32e782da-c0d3-48a5-b102-ae25c55c6ba7-maas-api-tls\") pod \"maas-api-5fbdd69b95-9z84h\" (UID: \"32e782da-c0d3-48a5-b102-ae25c55c6ba7\") " pod="opendatahub/maas-api-5fbdd69b95-9z84h" Jun 11 18:46:50.804086 ip-10-0-141-55 kubenswrapper[2578]: I0611 18:46:50.804068 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/32e782da-c0d3-48a5-b102-ae25c55c6ba7-openshift-service-ca\") pod \"maas-api-5fbdd69b95-9z84h\" (UID: \"32e782da-c0d3-48a5-b102-ae25c55c6ba7\") " pod="opendatahub/maas-api-5fbdd69b95-9z84h" Jun 11 18:46:50.805772 ip-10-0-141-55 kubenswrapper[2578]: I0611 18:46:50.805755 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/32e782da-c0d3-48a5-b102-ae25c55c6ba7-maas-api-tls\") pod \"maas-api-5fbdd69b95-9z84h\" (UID: \"32e782da-c0d3-48a5-b102-ae25c55c6ba7\") " pod="opendatahub/maas-api-5fbdd69b95-9z84h" Jun 11 18:46:50.815413 ip-10-0-141-55 kubenswrapper[2578]: I0611 18:46:50.815391 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-7q6tt\" (UniqueName: \"kubernetes.io/projected/32e782da-c0d3-48a5-b102-ae25c55c6ba7-kube-api-access-7q6tt\") pod \"maas-api-5fbdd69b95-9z84h\" (UID: \"32e782da-c0d3-48a5-b102-ae25c55c6ba7\") " pod="opendatahub/maas-api-5fbdd69b95-9z84h" Jun 11 18:46:50.919869 ip-10-0-141-55 kubenswrapper[2578]: I0611 18:46:50.919777 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-5fbdd69b95-9z84h" Jun 11 18:46:51.068249 ip-10-0-141-55 kubenswrapper[2578]: I0611 18:46:51.068213 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-api-5fbdd69b95-9z84h"] Jun 11 18:46:51.069430 ip-10-0-141-55 kubenswrapper[2578]: W0611 18:46:51.069404 2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod32e782da_c0d3_48a5_b102_ae25c55c6ba7.slice/crio-163ca47615598ab1a44e0841cd8b6050f5436bc0232d07f6ae2d10144c0b16d4 WatchSource:0}: Error finding container 163ca47615598ab1a44e0841cd8b6050f5436bc0232d07f6ae2d10144c0b16d4: Status 404 returned error can't find the container with id 163ca47615598ab1a44e0841cd8b6050f5436bc0232d07f6ae2d10144c0b16d4 Jun 11 18:46:51.070993 ip-10-0-141-55 kubenswrapper[2578]: I0611 18:46:51.070976 2578 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jun 11 18:46:51.097469 ip-10-0-141-55 kubenswrapper[2578]: I0611 18:46:51.097437 2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-pre-processing-579785bc64-97648"] Jun 11 18:46:51.102483 ip-10-0-141-55 kubenswrapper[2578]: I0611 18:46:51.102459 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-579785bc64-97648" Jun 11 18:46:51.105147 ip-10-0-141-55 kubenswrapper[2578]: I0611 18:46:51.105125 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins\"" Jun 11 18:46:51.105264 ip-10-0-141-55 kubenswrapper[2578]: I0611 18:46:51.105128 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-dockercfg-7sslh\"" Jun 11 18:46:51.111038 ip-10-0-141-55 kubenswrapper[2578]: I0611 18:46:51.111013 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-579785bc64-97648"] Jun 11 18:46:51.206314 ip-10-0-141-55 kubenswrapper[2578]: I0611 18:46:51.206228 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-sc26x\" (UniqueName: \"kubernetes.io/projected/f92bab33-828e-44db-a9ff-5cab420fd035-kube-api-access-sc26x\") pod \"payload-pre-processing-579785bc64-97648\" (UID: \"f92bab33-828e-44db-a9ff-5cab420fd035\") " pod="openshift-ingress/payload-pre-processing-579785bc64-97648" Jun 11 18:46:51.307594 ip-10-0-141-55 kubenswrapper[2578]: I0611 18:46:51.307540 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-sc26x\" (UniqueName: \"kubernetes.io/projected/f92bab33-828e-44db-a9ff-5cab420fd035-kube-api-access-sc26x\") pod \"payload-pre-processing-579785bc64-97648\" (UID: \"f92bab33-828e-44db-a9ff-5cab420fd035\") " pod="openshift-ingress/payload-pre-processing-579785bc64-97648" Jun 11 18:46:51.321894 ip-10-0-141-55 kubenswrapper[2578]: I0611 18:46:51.321868 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-sc26x\" (UniqueName: \"kubernetes.io/projected/f92bab33-828e-44db-a9ff-5cab420fd035-kube-api-access-sc26x\") pod \"payload-pre-processing-579785bc64-97648\" (UID: \"f92bab33-828e-44db-a9ff-5cab420fd035\") " pod="openshift-ingress/payload-pre-processing-579785bc64-97648" Jun 11 18:46:51.415574 ip-10-0-141-55 kubenswrapper[2578]: I0611 18:46:51.415522 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-579785bc64-97648" Jun 11 18:46:51.537846 ip-10-0-141-55 kubenswrapper[2578]: I0611 18:46:51.537809 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-5fbdd69b95-9z84h" event={"ID":"32e782da-c0d3-48a5-b102-ae25c55c6ba7","Type":"ContainerStarted","Data":"163ca47615598ab1a44e0841cd8b6050f5436bc0232d07f6ae2d10144c0b16d4"} Jun 11 18:46:51.548777 ip-10-0-141-55 kubenswrapper[2578]: I0611 18:46:51.548750 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-579785bc64-97648"] Jun 11 18:46:51.550106 ip-10-0-141-55 kubenswrapper[2578]: W0611 18:46:51.550084 2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf92bab33_828e_44db_a9ff_5cab420fd035.slice/crio-86a85b6de9a7930d466e3513ecbe112b4f3e29ebd705b111976d6c942f32074e WatchSource:0}: Error finding container 86a85b6de9a7930d466e3513ecbe112b4f3e29ebd705b111976d6c942f32074e: Status 404 returned error can't find the container with id 86a85b6de9a7930d466e3513ecbe112b4f3e29ebd705b111976d6c942f32074e Jun 11 18:46:52.548605 ip-10-0-141-55 kubenswrapper[2578]: I0611 18:46:52.548500 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-579785bc64-97648" event={"ID":"f92bab33-828e-44db-a9ff-5cab420fd035","Type":"ContainerStarted","Data":"86a85b6de9a7930d466e3513ecbe112b4f3e29ebd705b111976d6c942f32074e"} Jun 11 18:46:53.556832 ip-10-0-141-55 kubenswrapper[2578]: I0611 18:46:53.556800 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-5fbdd69b95-9z84h" event={"ID":"32e782da-c0d3-48a5-b102-ae25c55c6ba7","Type":"ContainerStarted","Data":"70a2db31f49f8e134c4df84675876ee7e358c10b51f2d4733a851f3b00af5ac2"} Jun 11 18:46:53.557231 ip-10-0-141-55 kubenswrapper[2578]: I0611 18:46:53.556905 2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/maas-api-5fbdd69b95-9z84h" Jun 11 18:46:53.575128 ip-10-0-141-55 kubenswrapper[2578]: I0611 18:46:53.575066 2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/maas-api-5fbdd69b95-9z84h" podStartSLOduration=1.782018178 podStartE2EDuration="3.575046625s" totalImagesPullingTime="1.793028447s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-11 18:46:50 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-11 18:46:53.574077893 +0000 UTC m=+619.528752500" watchObservedRunningTime="2026-06-11 18:46:53.575046625 +0000 UTC m=+619.529721233" Jun 11 18:46:54.563762 ip-10-0-141-55 kubenswrapper[2578]: I0611 18:46:54.563719 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-579785bc64-97648" event={"ID":"f92bab33-828e-44db-a9ff-5cab420fd035","Type":"ContainerStarted","Data":"72c6f47d1dfea68758948a98aa11d2e34b2e0325f0730c1c3e303b6c41966e35"} Jun 11 18:46:54.564267 ip-10-0-141-55 kubenswrapper[2578]: I0611 18:46:54.564014 2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-pre-processing-579785bc64-97648" Jun 11 18:46:54.583280 ip-10-0-141-55 kubenswrapper[2578]: I0611 18:46:54.583176 2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-pre-processing-579785bc64-97648" podStartSLOduration=1.213933005 podStartE2EDuration="3.583160285s" totalImagesPullingTime="2.36922728s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-11 18:46:51 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-11 18:46:54.582116626 +0000 UTC m=+620.536791232" watchObservedRunningTime="2026-06-11 18:46:54.583160285 +0000 UTC m=+620.537834893" Jun 11 18:46:59.569565 ip-10-0-141-55 kubenswrapper[2578]: I0611 18:46:59.569523 2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/maas-api-5fbdd69b95-9z84h" Jun 11 18:47:05.572054 ip-10-0-141-55 kubenswrapper[2578]: I0611 18:47:05.572021 2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-pre-processing-579785bc64-97648" Jun 11 18:49:03.840905 ip-10-0-141-55 kubenswrapper[2578]: I0611 18:49:03.840872 2578 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["keycloak-system/maas-keycloak-0"] Jun 11 18:49:03.843338 ip-10-0-141-55 kubenswrapper[2578]: I0611 18:49:03.841649 2578 kuberuntime_container.go:872] "Killing container with a grace period" pod="keycloak-system/maas-keycloak-0" podUID="1e4abbfb-b49f-47f6-948a-97782f8bcfb6" containerName="keycloak" containerID="cri-o://4ddc0df3e7527b47e3519222ff42c8cf3c50f81fb789a37ab30606c2f4967a41" gracePeriod=30 Jun 11 18:49:05.891653 ip-10-0-141-55 kubenswrapper[2578]: I0611 18:49:05.891621 2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="keycloak-system/maas-keycloak-0" Jun 11 18:49:06.068147 ip-10-0-141-55 kubenswrapper[2578]: I0611 18:49:06.068043 2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-xdn78\" (UniqueName: \"kubernetes.io/projected/1e4abbfb-b49f-47f6-948a-97782f8bcfb6-kube-api-access-xdn78\") pod \"1e4abbfb-b49f-47f6-948a-97782f8bcfb6\" (UID: \"1e4abbfb-b49f-47f6-948a-97782f8bcfb6\") " Jun 11 18:49:06.070242 ip-10-0-141-55 kubenswrapper[2578]: I0611 18:49:06.070219 2578 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/1e4abbfb-b49f-47f6-948a-97782f8bcfb6-kube-api-access-xdn78" (OuterVolumeSpecName: "kube-api-access-xdn78") pod "1e4abbfb-b49f-47f6-948a-97782f8bcfb6" (UID: "1e4abbfb-b49f-47f6-948a-97782f8bcfb6"). InnerVolumeSpecName "kube-api-access-xdn78". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 11 18:49:06.169442 ip-10-0-141-55 kubenswrapper[2578]: I0611 18:49:06.169409 2578 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-xdn78\" (UniqueName: \"kubernetes.io/projected/1e4abbfb-b49f-47f6-948a-97782f8bcfb6-kube-api-access-xdn78\") on node \"ip-10-0-141-55.ec2.internal\" DevicePath \"\"" Jun 11 18:49:06.252809 ip-10-0-141-55 kubenswrapper[2578]: I0611 18:49:06.252775 2578 generic.go:356] "Generic (PLEG): container finished" podID="1e4abbfb-b49f-47f6-948a-97782f8bcfb6" containerID="4ddc0df3e7527b47e3519222ff42c8cf3c50f81fb789a37ab30606c2f4967a41" exitCode=143 Jun 11 18:49:06.253000 ip-10-0-141-55 kubenswrapper[2578]: I0611 18:49:06.252830 2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="keycloak-system/maas-keycloak-0" Jun 11 18:49:06.253000 ip-10-0-141-55 kubenswrapper[2578]: I0611 18:49:06.252857 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="keycloak-system/maas-keycloak-0" event={"ID":"1e4abbfb-b49f-47f6-948a-97782f8bcfb6","Type":"ContainerDied","Data":"4ddc0df3e7527b47e3519222ff42c8cf3c50f81fb789a37ab30606c2f4967a41"} Jun 11 18:49:06.253000 ip-10-0-141-55 kubenswrapper[2578]: I0611 18:49:06.252905 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="keycloak-system/maas-keycloak-0" event={"ID":"1e4abbfb-b49f-47f6-948a-97782f8bcfb6","Type":"ContainerDied","Data":"4497d4e24da5644a71d0f4e13ebafec91c42a3dbdac63525755e4aa64cd1c87a"} Jun 11 18:49:06.253000 ip-10-0-141-55 kubenswrapper[2578]: I0611 18:49:06.252928 2578 scope.go:117] "RemoveContainer" containerID="4ddc0df3e7527b47e3519222ff42c8cf3c50f81fb789a37ab30606c2f4967a41" Jun 11 18:49:06.264000 ip-10-0-141-55 kubenswrapper[2578]: I0611 18:49:06.263980 2578 scope.go:117] "RemoveContainer" containerID="4ddc0df3e7527b47e3519222ff42c8cf3c50f81fb789a37ab30606c2f4967a41" Jun 11 18:49:06.264284 ip-10-0-141-55 kubenswrapper[2578]: E0611 18:49:06.264263 2578 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"4ddc0df3e7527b47e3519222ff42c8cf3c50f81fb789a37ab30606c2f4967a41\": container with ID starting with 4ddc0df3e7527b47e3519222ff42c8cf3c50f81fb789a37ab30606c2f4967a41 not found: ID does not exist" containerID="4ddc0df3e7527b47e3519222ff42c8cf3c50f81fb789a37ab30606c2f4967a41" Jun 11 18:49:06.264380 ip-10-0-141-55 kubenswrapper[2578]: I0611 18:49:06.264291 2578 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"4ddc0df3e7527b47e3519222ff42c8cf3c50f81fb789a37ab30606c2f4967a41"} err="failed to get container status \"4ddc0df3e7527b47e3519222ff42c8cf3c50f81fb789a37ab30606c2f4967a41\": rpc error: code = NotFound desc = could not find container \"4ddc0df3e7527b47e3519222ff42c8cf3c50f81fb789a37ab30606c2f4967a41\": container with ID starting with 4ddc0df3e7527b47e3519222ff42c8cf3c50f81fb789a37ab30606c2f4967a41 not found: ID does not exist" Jun 11 18:49:06.277663 ip-10-0-141-55 kubenswrapper[2578]: I0611 18:49:06.277640 2578 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["keycloak-system/maas-keycloak-0"] Jun 11 18:49:06.281527 ip-10-0-141-55 kubenswrapper[2578]: I0611 18:49:06.281507 2578 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["keycloak-system/maas-keycloak-0"] Jun 11 18:49:06.312530 ip-10-0-141-55 kubenswrapper[2578]: I0611 18:49:06.312500 2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["keycloak-system/maas-keycloak-0"] Jun 11 18:49:06.312958 ip-10-0-141-55 kubenswrapper[2578]: I0611 18:49:06.312942 2578 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="1e4abbfb-b49f-47f6-948a-97782f8bcfb6" containerName="keycloak" Jun 11 18:49:06.313012 ip-10-0-141-55 kubenswrapper[2578]: I0611 18:49:06.312961 2578 state_mem.go:107] "Deleted CPUSet assignment" podUID="1e4abbfb-b49f-47f6-948a-97782f8bcfb6" containerName="keycloak" Jun 11 18:49:06.313049 ip-10-0-141-55 kubenswrapper[2578]: I0611 18:49:06.313040 2578 memory_manager.go:368] "RemoveStaleState removing state" podUID="1e4abbfb-b49f-47f6-948a-97782f8bcfb6" containerName="keycloak" Jun 11 18:49:06.317080 ip-10-0-141-55 kubenswrapper[2578]: I0611 18:49:06.317065 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="keycloak-system/maas-keycloak-0" Jun 11 18:49:06.320014 ip-10-0-141-55 kubenswrapper[2578]: I0611 18:49:06.319963 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"keycloak-system\"/\"openshift-service-ca.crt\"" Jun 11 18:49:06.320129 ip-10-0-141-55 kubenswrapper[2578]: I0611 18:49:06.320100 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"keycloak-system\"/\"maas-keycloak-initial-admin\"" Jun 11 18:49:06.320129 ip-10-0-141-55 kubenswrapper[2578]: I0611 18:49:06.320114 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"keycloak-system\"/\"kube-root-ca.crt\"" Jun 11 18:49:06.320250 ip-10-0-141-55 kubenswrapper[2578]: I0611 18:49:06.320177 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"keycloak-system\"/\"keycloak-test-realms\"" Jun 11 18:49:06.320250 ip-10-0-141-55 kubenswrapper[2578]: I0611 18:49:06.320185 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"keycloak-system\"/\"default-dockercfg-6svgs\"" Jun 11 18:49:06.328397 ip-10-0-141-55 kubenswrapper[2578]: I0611 18:49:06.328291 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["keycloak-system/maas-keycloak-0"] Jun 11 18:49:06.421367 ip-10-0-141-55 kubenswrapper[2578]: I0611 18:49:06.421336 2578 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="1e4abbfb-b49f-47f6-948a-97782f8bcfb6" path="/var/lib/kubelet/pods/1e4abbfb-b49f-47f6-948a-97782f8bcfb6/volumes" Jun 11 18:49:06.471838 ip-10-0-141-55 kubenswrapper[2578]: I0611 18:49:06.471809 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"test-realms\" (UniqueName: \"kubernetes.io/configmap/c959f97d-a7a5-48c7-85e5-7e01eb268359-test-realms\") pod \"maas-keycloak-0\" (UID: \"c959f97d-a7a5-48c7-85e5-7e01eb268359\") " pod="keycloak-system/maas-keycloak-0" Jun 11 18:49:06.471990 ip-10-0-141-55 kubenswrapper[2578]: I0611 18:49:06.471886 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mcqwx\" (UniqueName: \"kubernetes.io/projected/c959f97d-a7a5-48c7-85e5-7e01eb268359-kube-api-access-mcqwx\") pod \"maas-keycloak-0\" (UID: \"c959f97d-a7a5-48c7-85e5-7e01eb268359\") " pod="keycloak-system/maas-keycloak-0" Jun 11 18:49:06.572417 ip-10-0-141-55 kubenswrapper[2578]: I0611 18:49:06.572332 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"test-realms\" (UniqueName: \"kubernetes.io/configmap/c959f97d-a7a5-48c7-85e5-7e01eb268359-test-realms\") pod \"maas-keycloak-0\" (UID: \"c959f97d-a7a5-48c7-85e5-7e01eb268359\") " pod="keycloak-system/maas-keycloak-0" Jun 11 18:49:06.572588 ip-10-0-141-55 kubenswrapper[2578]: I0611 18:49:06.572469 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mcqwx\" (UniqueName: \"kubernetes.io/projected/c959f97d-a7a5-48c7-85e5-7e01eb268359-kube-api-access-mcqwx\") pod \"maas-keycloak-0\" (UID: \"c959f97d-a7a5-48c7-85e5-7e01eb268359\") " pod="keycloak-system/maas-keycloak-0" Jun 11 18:49:06.573023 ip-10-0-141-55 kubenswrapper[2578]: I0611 18:49:06.573003 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"test-realms\" (UniqueName: \"kubernetes.io/configmap/c959f97d-a7a5-48c7-85e5-7e01eb268359-test-realms\") pod \"maas-keycloak-0\" (UID: \"c959f97d-a7a5-48c7-85e5-7e01eb268359\") " pod="keycloak-system/maas-keycloak-0" Jun 11 18:49:06.582823 ip-10-0-141-55 kubenswrapper[2578]: I0611 18:49:06.582801 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-mcqwx\" (UniqueName: \"kubernetes.io/projected/c959f97d-a7a5-48c7-85e5-7e01eb268359-kube-api-access-mcqwx\") pod \"maas-keycloak-0\" (UID: \"c959f97d-a7a5-48c7-85e5-7e01eb268359\") " pod="keycloak-system/maas-keycloak-0" Jun 11 18:49:06.627700 ip-10-0-141-55 kubenswrapper[2578]: I0611 18:49:06.627664 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="keycloak-system/maas-keycloak-0" Jun 11 18:49:06.762503 ip-10-0-141-55 kubenswrapper[2578]: W0611 18:49:06.762470 2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc959f97d_a7a5_48c7_85e5_7e01eb268359.slice/crio-1a46840b88679960b347d9929026191180abda0c9f6b0f43dda86812874728b1 WatchSource:0}: Error finding container 1a46840b88679960b347d9929026191180abda0c9f6b0f43dda86812874728b1: Status 404 returned error can't find the container with id 1a46840b88679960b347d9929026191180abda0c9f6b0f43dda86812874728b1 Jun 11 18:49:06.763483 ip-10-0-141-55 kubenswrapper[2578]: I0611 18:49:06.763459 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["keycloak-system/maas-keycloak-0"] Jun 11 18:49:07.261084 ip-10-0-141-55 kubenswrapper[2578]: I0611 18:49:07.261052 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="keycloak-system/maas-keycloak-0" event={"ID":"c959f97d-a7a5-48c7-85e5-7e01eb268359","Type":"ContainerStarted","Data":"dde7dcaa056f2efaafab181753207d6f5112c1f504219ebce2bca8f9ed8eed68"} Jun 11 18:49:07.261582 ip-10-0-141-55 kubenswrapper[2578]: I0611 18:49:07.261098 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="keycloak-system/maas-keycloak-0" event={"ID":"c959f97d-a7a5-48c7-85e5-7e01eb268359","Type":"ContainerStarted","Data":"1a46840b88679960b347d9929026191180abda0c9f6b0f43dda86812874728b1"} Jun 11 18:49:07.279885 ip-10-0-141-55 kubenswrapper[2578]: I0611 18:49:07.279832 2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="keycloak-system/maas-keycloak-0" podStartSLOduration=0.942998257 podStartE2EDuration="1.279818001s" totalImagesPullingTime="336.819744ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-11 18:49:06 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-11 18:49:07.277696304 +0000 UTC m=+753.232370936" watchObservedRunningTime="2026-06-11 18:49:07.279818001 +0000 UTC m=+753.234492607" Jun 11 18:49:07.627961 ip-10-0-141-55 kubenswrapper[2578]: I0611 18:49:07.627860 2578 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="keycloak-system/maas-keycloak-0" Jun 11 18:49:07.629611 ip-10-0-141-55 kubenswrapper[2578]: I0611 18:49:07.629578 2578 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="c959f97d-a7a5-48c7-85e5-7e01eb268359" containerName="keycloak" probeResult="failure" output="Get \"http://10.134.0.49:9000/health/started\": dial tcp 10.134.0.49:9000: connect: connection refused" Jun 11 18:49:08.628908 ip-10-0-141-55 kubenswrapper[2578]: I0611 18:49:08.628848 2578 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="c959f97d-a7a5-48c7-85e5-7e01eb268359" containerName="keycloak" probeResult="failure" output="Get \"http://10.134.0.49:9000/health/started\": dial tcp 10.134.0.49:9000: connect: connection refused" Jun 11 18:49:09.629078 ip-10-0-141-55 kubenswrapper[2578]: I0611 18:49:09.629037 2578 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="c959f97d-a7a5-48c7-85e5-7e01eb268359" containerName="keycloak" probeResult="failure" output="Get \"http://10.134.0.49:9000/health/started\": dial tcp 10.134.0.49:9000: connect: connection refused" Jun 11 18:49:10.628811 ip-10-0-141-55 kubenswrapper[2578]: I0611 18:49:10.628756 2578 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="c959f97d-a7a5-48c7-85e5-7e01eb268359" containerName="keycloak" probeResult="failure" output="Get \"http://10.134.0.49:9000/health/started\": dial tcp 10.134.0.49:9000: connect: connection refused" Jun 11 18:49:11.628146 ip-10-0-141-55 kubenswrapper[2578]: I0611 18:49:11.628094 2578 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="c959f97d-a7a5-48c7-85e5-7e01eb268359" containerName="keycloak" probeResult="failure" output="Get \"http://10.134.0.49:9000/health/started\": dial tcp 10.134.0.49:9000: connect: connection refused" Jun 11 18:49:12.628828 ip-10-0-141-55 kubenswrapper[2578]: I0611 18:49:12.628772 2578 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="c959f97d-a7a5-48c7-85e5-7e01eb268359" containerName="keycloak" probeResult="failure" output="Get \"http://10.134.0.49:9000/health/started\": dial tcp 10.134.0.49:9000: connect: connection refused" Jun 11 18:49:13.628569 ip-10-0-141-55 kubenswrapper[2578]: I0611 18:49:13.628500 2578 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="c959f97d-a7a5-48c7-85e5-7e01eb268359" containerName="keycloak" probeResult="failure" output="Get \"http://10.134.0.49:9000/health/started\": dial tcp 10.134.0.49:9000: connect: connection refused" Jun 11 18:49:14.628088 ip-10-0-141-55 kubenswrapper[2578]: I0611 18:49:14.628044 2578 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="c959f97d-a7a5-48c7-85e5-7e01eb268359" containerName="keycloak" probeResult="failure" output="Get \"http://10.134.0.49:9000/health/started\": dial tcp 10.134.0.49:9000: connect: connection refused" Jun 11 18:49:15.628850 ip-10-0-141-55 kubenswrapper[2578]: I0611 18:49:15.628805 2578 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="c959f97d-a7a5-48c7-85e5-7e01eb268359" containerName="keycloak" probeResult="failure" output="Get \"http://10.134.0.49:9000/health/started\": dial tcp 10.134.0.49:9000: connect: connection refused" Jun 11 18:49:16.628291 ip-10-0-141-55 kubenswrapper[2578]: I0611 18:49:16.628250 2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="keycloak-system/maas-keycloak-0" Jun 11 18:49:16.628629 ip-10-0-141-55 kubenswrapper[2578]: I0611 18:49:16.628594 2578 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="c959f97d-a7a5-48c7-85e5-7e01eb268359" containerName="keycloak" probeResult="failure" output="Get \"http://10.134.0.49:9000/health/started\": dial tcp 10.134.0.49:9000: connect: connection refused" Jun 11 18:49:17.628328 ip-10-0-141-55 kubenswrapper[2578]: I0611 18:49:17.628280 2578 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="c959f97d-a7a5-48c7-85e5-7e01eb268359" containerName="keycloak" probeResult="failure" output="Get \"http://10.134.0.49:9000/health/started\": dial tcp 10.134.0.49:9000: connect: connection refused" Jun 11 18:49:18.628990 ip-10-0-141-55 kubenswrapper[2578]: I0611 18:49:18.628939 2578 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="c959f97d-a7a5-48c7-85e5-7e01eb268359" containerName="keycloak" probeResult="failure" output="Get \"http://10.134.0.49:9000/health/started\": dial tcp 10.134.0.49:9000: connect: connection refused" Jun 11 18:49:19.628024 ip-10-0-141-55 kubenswrapper[2578]: I0611 18:49:19.627982 2578 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="c959f97d-a7a5-48c7-85e5-7e01eb268359" containerName="keycloak" probeResult="failure" output="Get \"http://10.134.0.49:9000/health/started\": dial tcp 10.134.0.49:9000: connect: connection refused" Jun 11 18:49:20.750614 ip-10-0-141-55 kubenswrapper[2578]: I0611 18:49:20.750573 2578 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="keycloak-system/maas-keycloak-0" Jun 11 18:49:20.768271 ip-10-0-141-55 kubenswrapper[2578]: I0611 18:49:20.768220 2578 prober.go:120] "Probe failed" probeType="Readiness" pod="keycloak-system/maas-keycloak-0" podUID="c959f97d-a7a5-48c7-85e5-7e01eb268359" containerName="keycloak" probeResult="failure" output="HTTP probe failed with statuscode: 503" Jun 11 18:49:30.757225 ip-10-0-141-55 kubenswrapper[2578]: I0611 18:49:30.757190 2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="keycloak-system/maas-keycloak-0" Jun 11 18:49:41.522222 ip-10-0-141-55 kubenswrapper[2578]: I0611 18:49:41.522189 2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-5c7dd6cf47-g22r7"] Jun 11 18:49:41.526917 ip-10-0-141-55 kubenswrapper[2578]: I0611 18:49:41.526894 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-5c7dd6cf47-g22r7" Jun 11 18:49:41.531004 ip-10-0-141-55 kubenswrapper[2578]: I0611 18:49:41.530985 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"authorino-oidc-ca\"" Jun 11 18:49:41.536724 ip-10-0-141-55 kubenswrapper[2578]: I0611 18:49:41.536702 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-5c7dd6cf47-g22r7"] Jun 11 18:49:41.717274 ip-10-0-141-55 kubenswrapper[2578]: I0611 18:49:41.717237 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/b40073af-0dbb-4d58-b8d1-1f18dcdb7c8e-tls-cert\") pod \"authorino-5c7dd6cf47-g22r7\" (UID: \"b40073af-0dbb-4d58-b8d1-1f18dcdb7c8e\") " pod="kuadrant-system/authorino-5c7dd6cf47-g22r7" Jun 11 18:49:41.717446 ip-10-0-141-55 kubenswrapper[2578]: I0611 18:49:41.717290 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-bc8xl\" (UniqueName: \"kubernetes.io/projected/b40073af-0dbb-4d58-b8d1-1f18dcdb7c8e-kube-api-access-bc8xl\") pod \"authorino-5c7dd6cf47-g22r7\" (UID: \"b40073af-0dbb-4d58-b8d1-1f18dcdb7c8e\") " pod="kuadrant-system/authorino-5c7dd6cf47-g22r7" Jun 11 18:49:41.717446 ip-10-0-141-55 kubenswrapper[2578]: I0611 18:49:41.717358 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oidc-ca\" (UniqueName: \"kubernetes.io/configmap/b40073af-0dbb-4d58-b8d1-1f18dcdb7c8e-oidc-ca\") pod \"authorino-5c7dd6cf47-g22r7\" (UID: \"b40073af-0dbb-4d58-b8d1-1f18dcdb7c8e\") " pod="kuadrant-system/authorino-5c7dd6cf47-g22r7" Jun 11 18:49:41.818400 ip-10-0-141-55 kubenswrapper[2578]: I0611 18:49:41.818317 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oidc-ca\" (UniqueName: \"kubernetes.io/configmap/b40073af-0dbb-4d58-b8d1-1f18dcdb7c8e-oidc-ca\") pod \"authorino-5c7dd6cf47-g22r7\" (UID: \"b40073af-0dbb-4d58-b8d1-1f18dcdb7c8e\") " pod="kuadrant-system/authorino-5c7dd6cf47-g22r7" Jun 11 18:49:41.818400 ip-10-0-141-55 kubenswrapper[2578]: I0611 18:49:41.818365 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/b40073af-0dbb-4d58-b8d1-1f18dcdb7c8e-tls-cert\") pod \"authorino-5c7dd6cf47-g22r7\" (UID: \"b40073af-0dbb-4d58-b8d1-1f18dcdb7c8e\") " pod="kuadrant-system/authorino-5c7dd6cf47-g22r7" Jun 11 18:49:41.818631 ip-10-0-141-55 kubenswrapper[2578]: I0611 18:49:41.818405 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-bc8xl\" (UniqueName: \"kubernetes.io/projected/b40073af-0dbb-4d58-b8d1-1f18dcdb7c8e-kube-api-access-bc8xl\") pod \"authorino-5c7dd6cf47-g22r7\" (UID: \"b40073af-0dbb-4d58-b8d1-1f18dcdb7c8e\") " pod="kuadrant-system/authorino-5c7dd6cf47-g22r7" Jun 11 18:49:41.819066 ip-10-0-141-55 kubenswrapper[2578]: I0611 18:49:41.819043 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"oidc-ca\" (UniqueName: \"kubernetes.io/configmap/b40073af-0dbb-4d58-b8d1-1f18dcdb7c8e-oidc-ca\") pod \"authorino-5c7dd6cf47-g22r7\" (UID: \"b40073af-0dbb-4d58-b8d1-1f18dcdb7c8e\") " pod="kuadrant-system/authorino-5c7dd6cf47-g22r7" Jun 11 18:49:41.820845 ip-10-0-141-55 kubenswrapper[2578]: I0611 18:49:41.820824 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/b40073af-0dbb-4d58-b8d1-1f18dcdb7c8e-tls-cert\") pod \"authorino-5c7dd6cf47-g22r7\" (UID: \"b40073af-0dbb-4d58-b8d1-1f18dcdb7c8e\") " pod="kuadrant-system/authorino-5c7dd6cf47-g22r7" Jun 11 18:49:41.827946 ip-10-0-141-55 kubenswrapper[2578]: I0611 18:49:41.827923 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-bc8xl\" (UniqueName: \"kubernetes.io/projected/b40073af-0dbb-4d58-b8d1-1f18dcdb7c8e-kube-api-access-bc8xl\") pod \"authorino-5c7dd6cf47-g22r7\" (UID: \"b40073af-0dbb-4d58-b8d1-1f18dcdb7c8e\") " pod="kuadrant-system/authorino-5c7dd6cf47-g22r7" Jun 11 18:49:41.836724 ip-10-0-141-55 kubenswrapper[2578]: I0611 18:49:41.836704 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-5c7dd6cf47-g22r7" Jun 11 18:49:41.969475 ip-10-0-141-55 kubenswrapper[2578]: I0611 18:49:41.969442 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-5c7dd6cf47-g22r7"] Jun 11 18:49:41.971160 ip-10-0-141-55 kubenswrapper[2578]: W0611 18:49:41.971130 2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podb40073af_0dbb_4d58_b8d1_1f18dcdb7c8e.slice/crio-b196bd256871cc36c0d8fb6c9568f2359530053151836d2a00a4d8344c878bed WatchSource:0}: Error finding container b196bd256871cc36c0d8fb6c9568f2359530053151836d2a00a4d8344c878bed: Status 404 returned error can't find the container with id b196bd256871cc36c0d8fb6c9568f2359530053151836d2a00a4d8344c878bed Jun 11 18:49:42.494316 ip-10-0-141-55 kubenswrapper[2578]: I0611 18:49:42.494276 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-5c7dd6cf47-g22r7" event={"ID":"b40073af-0dbb-4d58-b8d1-1f18dcdb7c8e","Type":"ContainerStarted","Data":"09695b58e6ba8e824ac3ede0e84b5b5a6a8f0b46a6995082226650e4be508dcb"} Jun 11 18:49:42.494499 ip-10-0-141-55 kubenswrapper[2578]: I0611 18:49:42.494325 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-5c7dd6cf47-g22r7" event={"ID":"b40073af-0dbb-4d58-b8d1-1f18dcdb7c8e","Type":"ContainerStarted","Data":"b196bd256871cc36c0d8fb6c9568f2359530053151836d2a00a4d8344c878bed"} Jun 11 18:49:42.514398 ip-10-0-141-55 kubenswrapper[2578]: I0611 18:49:42.514339 2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/authorino-5c7dd6cf47-g22r7" podStartSLOduration=1.112438853 podStartE2EDuration="1.5143161s" totalImagesPullingTime="401.877247ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-11 18:49:41 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-11 18:49:42.511225701 +0000 UTC m=+788.465900308" watchObservedRunningTime="2026-06-11 18:49:42.5143161 +0000 UTC m=+788.468990707" Jun 11 18:49:42.540698 ip-10-0-141-55 kubenswrapper[2578]: I0611 18:49:42.540653 2578 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-54888c5999-h78z9"] Jun 11 18:49:42.541161 ip-10-0-141-55 kubenswrapper[2578]: I0611 18:49:42.540830 2578 kuberuntime_container.go:872] "Killing container with a grace period" pod="kuadrant-system/authorino-54888c5999-h78z9" podUID="e5d97ad0-c7bc-417c-9d4e-3244bb8376eb" containerName="authorino" containerID="cri-o://964ce21b74bd46021d596d71b9cc6cd7382b4da82f7befe0e03d9a9bbdf984a1" gracePeriod=30 Jun 11 18:49:42.777323 ip-10-0-141-55 kubenswrapper[2578]: I0611 18:49:42.777296 2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-54888c5999-h78z9" Jun 11 18:49:42.929267 ip-10-0-141-55 kubenswrapper[2578]: I0611 18:49:42.929183 2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/e5d97ad0-c7bc-417c-9d4e-3244bb8376eb-tls-cert\") pod \"e5d97ad0-c7bc-417c-9d4e-3244bb8376eb\" (UID: \"e5d97ad0-c7bc-417c-9d4e-3244bb8376eb\") " Jun 11 18:49:42.929410 ip-10-0-141-55 kubenswrapper[2578]: I0611 18:49:42.929279 2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-pjg4s\" (UniqueName: \"kubernetes.io/projected/e5d97ad0-c7bc-417c-9d4e-3244bb8376eb-kube-api-access-pjg4s\") pod \"e5d97ad0-c7bc-417c-9d4e-3244bb8376eb\" (UID: \"e5d97ad0-c7bc-417c-9d4e-3244bb8376eb\") " Jun 11 18:49:42.931246 ip-10-0-141-55 kubenswrapper[2578]: I0611 18:49:42.931218 2578 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/e5d97ad0-c7bc-417c-9d4e-3244bb8376eb-kube-api-access-pjg4s" (OuterVolumeSpecName: "kube-api-access-pjg4s") pod "e5d97ad0-c7bc-417c-9d4e-3244bb8376eb" (UID: "e5d97ad0-c7bc-417c-9d4e-3244bb8376eb"). InnerVolumeSpecName "kube-api-access-pjg4s". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 11 18:49:42.939426 ip-10-0-141-55 kubenswrapper[2578]: I0611 18:49:42.939402 2578 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/e5d97ad0-c7bc-417c-9d4e-3244bb8376eb-tls-cert" (OuterVolumeSpecName: "tls-cert") pod "e5d97ad0-c7bc-417c-9d4e-3244bb8376eb" (UID: "e5d97ad0-c7bc-417c-9d4e-3244bb8376eb"). InnerVolumeSpecName "tls-cert". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 11 18:49:43.030900 ip-10-0-141-55 kubenswrapper[2578]: I0611 18:49:43.030860 2578 reconciler_common.go:299] "Volume detached for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/e5d97ad0-c7bc-417c-9d4e-3244bb8376eb-tls-cert\") on node \"ip-10-0-141-55.ec2.internal\" DevicePath \"\"" Jun 11 18:49:43.030900 ip-10-0-141-55 kubenswrapper[2578]: I0611 18:49:43.030896 2578 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-pjg4s\" (UniqueName: \"kubernetes.io/projected/e5d97ad0-c7bc-417c-9d4e-3244bb8376eb-kube-api-access-pjg4s\") on node \"ip-10-0-141-55.ec2.internal\" DevicePath \"\"" Jun 11 18:49:43.500194 ip-10-0-141-55 kubenswrapper[2578]: I0611 18:49:43.500160 2578 generic.go:356] "Generic (PLEG): container finished" podID="e5d97ad0-c7bc-417c-9d4e-3244bb8376eb" containerID="964ce21b74bd46021d596d71b9cc6cd7382b4da82f7befe0e03d9a9bbdf984a1" exitCode=0 Jun 11 18:49:43.500375 ip-10-0-141-55 kubenswrapper[2578]: I0611 18:49:43.500205 2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-54888c5999-h78z9" Jun 11 18:49:43.500375 ip-10-0-141-55 kubenswrapper[2578]: I0611 18:49:43.500248 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-54888c5999-h78z9" event={"ID":"e5d97ad0-c7bc-417c-9d4e-3244bb8376eb","Type":"ContainerDied","Data":"964ce21b74bd46021d596d71b9cc6cd7382b4da82f7befe0e03d9a9bbdf984a1"} Jun 11 18:49:43.500375 ip-10-0-141-55 kubenswrapper[2578]: I0611 18:49:43.500297 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-54888c5999-h78z9" event={"ID":"e5d97ad0-c7bc-417c-9d4e-3244bb8376eb","Type":"ContainerDied","Data":"90b9b2cd82b65e598906549b490fdfd523d037cae654aed1f9856cae542339d2"} Jun 11 18:49:43.500375 ip-10-0-141-55 kubenswrapper[2578]: I0611 18:49:43.500320 2578 scope.go:117] "RemoveContainer" containerID="964ce21b74bd46021d596d71b9cc6cd7382b4da82f7befe0e03d9a9bbdf984a1" Jun 11 18:49:43.510005 ip-10-0-141-55 kubenswrapper[2578]: I0611 18:49:43.509989 2578 scope.go:117] "RemoveContainer" containerID="964ce21b74bd46021d596d71b9cc6cd7382b4da82f7befe0e03d9a9bbdf984a1" Jun 11 18:49:43.510246 ip-10-0-141-55 kubenswrapper[2578]: E0611 18:49:43.510228 2578 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"964ce21b74bd46021d596d71b9cc6cd7382b4da82f7befe0e03d9a9bbdf984a1\": container with ID starting with 964ce21b74bd46021d596d71b9cc6cd7382b4da82f7befe0e03d9a9bbdf984a1 not found: ID does not exist" containerID="964ce21b74bd46021d596d71b9cc6cd7382b4da82f7befe0e03d9a9bbdf984a1" Jun 11 18:49:43.510296 ip-10-0-141-55 kubenswrapper[2578]: I0611 18:49:43.510255 2578 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"964ce21b74bd46021d596d71b9cc6cd7382b4da82f7befe0e03d9a9bbdf984a1"} err="failed to get container status \"964ce21b74bd46021d596d71b9cc6cd7382b4da82f7befe0e03d9a9bbdf984a1\": rpc error: code = NotFound desc = could not find container \"964ce21b74bd46021d596d71b9cc6cd7382b4da82f7befe0e03d9a9bbdf984a1\": container with ID starting with 964ce21b74bd46021d596d71b9cc6cd7382b4da82f7befe0e03d9a9bbdf984a1 not found: ID does not exist" Jun 11 18:49:43.526859 ip-10-0-141-55 kubenswrapper[2578]: I0611 18:49:43.526838 2578 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-54888c5999-h78z9"] Jun 11 18:49:43.536137 ip-10-0-141-55 kubenswrapper[2578]: I0611 18:49:43.536115 2578 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/authorino-54888c5999-h78z9"] Jun 11 18:49:44.424125 ip-10-0-141-55 kubenswrapper[2578]: I0611 18:49:44.424082 2578 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="e5d97ad0-c7bc-417c-9d4e-3244bb8376eb" path="/var/lib/kubelet/pods/e5d97ad0-c7bc-417c-9d4e-3244bb8376eb/volumes" Jun 11 18:49:59.445185 ip-10-0-141-55 kubenswrapper[2578]: I0611 18:49:59.445153 2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/e2e-distinct-2-simulated-kserve-f5c55bdc-d5hwx"] Jun 11 18:49:59.445643 ip-10-0-141-55 kubenswrapper[2578]: I0611 18:49:59.445517 2578 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="e5d97ad0-c7bc-417c-9d4e-3244bb8376eb" containerName="authorino" Jun 11 18:49:59.445643 ip-10-0-141-55 kubenswrapper[2578]: I0611 18:49:59.445528 2578 state_mem.go:107] "Deleted CPUSet assignment" podUID="e5d97ad0-c7bc-417c-9d4e-3244bb8376eb" containerName="authorino" Jun 11 18:49:59.445643 ip-10-0-141-55 kubenswrapper[2578]: I0611 18:49:59.445602 2578 memory_manager.go:368] "RemoveStaleState removing state" podUID="e5d97ad0-c7bc-417c-9d4e-3244bb8376eb" containerName="authorino" Jun 11 18:49:59.449343 ip-10-0-141-55 kubenswrapper[2578]: I0611 18:49:59.449326 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-distinct-2-simulated-kserve-f5c55bdc-d5hwx" Jun 11 18:49:59.452241 ip-10-0-141-55 kubenswrapper[2578]: I0611 18:49:59.452222 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"llm\"/\"openshift-service-ca.crt\"" Jun 11 18:49:59.453502 ip-10-0-141-55 kubenswrapper[2578]: I0611 18:49:59.453482 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"llm\"/\"kube-root-ca.crt\"" Jun 11 18:49:59.453624 ip-10-0-141-55 kubenswrapper[2578]: I0611 18:49:59.453603 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"default-dockercfg-bxzds\"" Jun 11 18:49:59.453727 ip-10-0-141-55 kubenswrapper[2578]: I0611 18:49:59.453708 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"e2e-distinct-2-simulated-kserve-self-signed-certs\"" Jun 11 18:49:59.460462 ip-10-0-141-55 kubenswrapper[2578]: I0611 18:49:59.460440 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-distinct-2-simulated-kserve-f5c55bdc-d5hwx"] Jun 11 18:49:59.473865 ip-10-0-141-55 kubenswrapper[2578]: I0611 18:49:59.473837 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/d93bb87b-4abd-402b-903b-9d6eaeabffe0-kserve-provision-location\") pod \"e2e-distinct-2-simulated-kserve-f5c55bdc-d5hwx\" (UID: \"d93bb87b-4abd-402b-903b-9d6eaeabffe0\") " pod="llm/e2e-distinct-2-simulated-kserve-f5c55bdc-d5hwx" Jun 11 18:49:59.473993 ip-10-0-141-55 kubenswrapper[2578]: I0611 18:49:59.473893 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/d93bb87b-4abd-402b-903b-9d6eaeabffe0-tls-certs\") pod \"e2e-distinct-2-simulated-kserve-f5c55bdc-d5hwx\" (UID: \"d93bb87b-4abd-402b-903b-9d6eaeabffe0\") " pod="llm/e2e-distinct-2-simulated-kserve-f5c55bdc-d5hwx" Jun 11 18:49:59.474039 ip-10-0-141-55 kubenswrapper[2578]: I0611 18:49:59.473997 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/d93bb87b-4abd-402b-903b-9d6eaeabffe0-dshm\") pod \"e2e-distinct-2-simulated-kserve-f5c55bdc-d5hwx\" (UID: \"d93bb87b-4abd-402b-903b-9d6eaeabffe0\") " pod="llm/e2e-distinct-2-simulated-kserve-f5c55bdc-d5hwx" Jun 11 18:49:59.474039 ip-10-0-141-55 kubenswrapper[2578]: I0611 18:49:59.474022 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/d93bb87b-4abd-402b-903b-9d6eaeabffe0-model-cache\") pod \"e2e-distinct-2-simulated-kserve-f5c55bdc-d5hwx\" (UID: \"d93bb87b-4abd-402b-903b-9d6eaeabffe0\") " pod="llm/e2e-distinct-2-simulated-kserve-f5c55bdc-d5hwx" Jun 11 18:49:59.474106 ip-10-0-141-55 kubenswrapper[2578]: I0611 18:49:59.474058 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wzwpp\" (UniqueName: \"kubernetes.io/projected/d93bb87b-4abd-402b-903b-9d6eaeabffe0-kube-api-access-wzwpp\") pod \"e2e-distinct-2-simulated-kserve-f5c55bdc-d5hwx\" (UID: \"d93bb87b-4abd-402b-903b-9d6eaeabffe0\") " pod="llm/e2e-distinct-2-simulated-kserve-f5c55bdc-d5hwx" Jun 11 18:49:59.474106 ip-10-0-141-55 kubenswrapper[2578]: I0611 18:49:59.474093 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/d93bb87b-4abd-402b-903b-9d6eaeabffe0-home\") pod \"e2e-distinct-2-simulated-kserve-f5c55bdc-d5hwx\" (UID: \"d93bb87b-4abd-402b-903b-9d6eaeabffe0\") " pod="llm/e2e-distinct-2-simulated-kserve-f5c55bdc-d5hwx" Jun 11 18:49:59.575535 ip-10-0-141-55 kubenswrapper[2578]: I0611 18:49:59.575497 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/d93bb87b-4abd-402b-903b-9d6eaeabffe0-tls-certs\") pod \"e2e-distinct-2-simulated-kserve-f5c55bdc-d5hwx\" (UID: \"d93bb87b-4abd-402b-903b-9d6eaeabffe0\") " pod="llm/e2e-distinct-2-simulated-kserve-f5c55bdc-d5hwx" Jun 11 18:49:59.575755 ip-10-0-141-55 kubenswrapper[2578]: I0611 18:49:59.575581 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/d93bb87b-4abd-402b-903b-9d6eaeabffe0-dshm\") pod \"e2e-distinct-2-simulated-kserve-f5c55bdc-d5hwx\" (UID: \"d93bb87b-4abd-402b-903b-9d6eaeabffe0\") " pod="llm/e2e-distinct-2-simulated-kserve-f5c55bdc-d5hwx" Jun 11 18:49:59.575755 ip-10-0-141-55 kubenswrapper[2578]: I0611 18:49:59.575605 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/d93bb87b-4abd-402b-903b-9d6eaeabffe0-model-cache\") pod \"e2e-distinct-2-simulated-kserve-f5c55bdc-d5hwx\" (UID: \"d93bb87b-4abd-402b-903b-9d6eaeabffe0\") " pod="llm/e2e-distinct-2-simulated-kserve-f5c55bdc-d5hwx" Jun 11 18:49:59.575755 ip-10-0-141-55 kubenswrapper[2578]: I0611 18:49:59.575644 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wzwpp\" (UniqueName: \"kubernetes.io/projected/d93bb87b-4abd-402b-903b-9d6eaeabffe0-kube-api-access-wzwpp\") pod \"e2e-distinct-2-simulated-kserve-f5c55bdc-d5hwx\" (UID: \"d93bb87b-4abd-402b-903b-9d6eaeabffe0\") " pod="llm/e2e-distinct-2-simulated-kserve-f5c55bdc-d5hwx" Jun 11 18:49:59.575755 ip-10-0-141-55 kubenswrapper[2578]: I0611 18:49:59.575681 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/d93bb87b-4abd-402b-903b-9d6eaeabffe0-home\") pod \"e2e-distinct-2-simulated-kserve-f5c55bdc-d5hwx\" (UID: \"d93bb87b-4abd-402b-903b-9d6eaeabffe0\") " pod="llm/e2e-distinct-2-simulated-kserve-f5c55bdc-d5hwx" Jun 11 18:49:59.575994 ip-10-0-141-55 kubenswrapper[2578]: I0611 18:49:59.575759 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/d93bb87b-4abd-402b-903b-9d6eaeabffe0-kserve-provision-location\") pod \"e2e-distinct-2-simulated-kserve-f5c55bdc-d5hwx\" (UID: \"d93bb87b-4abd-402b-903b-9d6eaeabffe0\") " pod="llm/e2e-distinct-2-simulated-kserve-f5c55bdc-d5hwx" Jun 11 18:49:59.576127 ip-10-0-141-55 kubenswrapper[2578]: I0611 18:49:59.576104 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/d93bb87b-4abd-402b-903b-9d6eaeabffe0-model-cache\") pod \"e2e-distinct-2-simulated-kserve-f5c55bdc-d5hwx\" (UID: \"d93bb87b-4abd-402b-903b-9d6eaeabffe0\") " pod="llm/e2e-distinct-2-simulated-kserve-f5c55bdc-d5hwx" Jun 11 18:49:59.576198 ip-10-0-141-55 kubenswrapper[2578]: I0611 18:49:59.576131 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/d93bb87b-4abd-402b-903b-9d6eaeabffe0-home\") pod \"e2e-distinct-2-simulated-kserve-f5c55bdc-d5hwx\" (UID: \"d93bb87b-4abd-402b-903b-9d6eaeabffe0\") " pod="llm/e2e-distinct-2-simulated-kserve-f5c55bdc-d5hwx" Jun 11 18:49:59.576198 ip-10-0-141-55 kubenswrapper[2578]: I0611 18:49:59.576175 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/d93bb87b-4abd-402b-903b-9d6eaeabffe0-kserve-provision-location\") pod \"e2e-distinct-2-simulated-kserve-f5c55bdc-d5hwx\" (UID: \"d93bb87b-4abd-402b-903b-9d6eaeabffe0\") " pod="llm/e2e-distinct-2-simulated-kserve-f5c55bdc-d5hwx" Jun 11 18:49:59.578041 ip-10-0-141-55 kubenswrapper[2578]: I0611 18:49:59.578009 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/d93bb87b-4abd-402b-903b-9d6eaeabffe0-dshm\") pod \"e2e-distinct-2-simulated-kserve-f5c55bdc-d5hwx\" (UID: \"d93bb87b-4abd-402b-903b-9d6eaeabffe0\") " pod="llm/e2e-distinct-2-simulated-kserve-f5c55bdc-d5hwx" Jun 11 18:49:59.578359 ip-10-0-141-55 kubenswrapper[2578]: I0611 18:49:59.578339 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/d93bb87b-4abd-402b-903b-9d6eaeabffe0-tls-certs\") pod \"e2e-distinct-2-simulated-kserve-f5c55bdc-d5hwx\" (UID: \"d93bb87b-4abd-402b-903b-9d6eaeabffe0\") " pod="llm/e2e-distinct-2-simulated-kserve-f5c55bdc-d5hwx" Jun 11 18:49:59.583759 ip-10-0-141-55 kubenswrapper[2578]: I0611 18:49:59.583738 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-wzwpp\" (UniqueName: \"kubernetes.io/projected/d93bb87b-4abd-402b-903b-9d6eaeabffe0-kube-api-access-wzwpp\") pod \"e2e-distinct-2-simulated-kserve-f5c55bdc-d5hwx\" (UID: \"d93bb87b-4abd-402b-903b-9d6eaeabffe0\") " pod="llm/e2e-distinct-2-simulated-kserve-f5c55bdc-d5hwx" Jun 11 18:49:59.762499 ip-10-0-141-55 kubenswrapper[2578]: I0611 18:49:59.762414 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-distinct-2-simulated-kserve-f5c55bdc-d5hwx" Jun 11 18:49:59.921038 ip-10-0-141-55 kubenswrapper[2578]: I0611 18:49:59.920995 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-distinct-2-simulated-kserve-f5c55bdc-d5hwx"] Jun 11 18:49:59.921287 ip-10-0-141-55 kubenswrapper[2578]: W0611 18:49:59.921250 2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd93bb87b_4abd_402b_903b_9d6eaeabffe0.slice/crio-df82bc575acb9385bead5f58f83aea4a41213dc5505ad24bf83460c4fd54e73b WatchSource:0}: Error finding container df82bc575acb9385bead5f58f83aea4a41213dc5505ad24bf83460c4fd54e73b: Status 404 returned error can't find the container with id df82bc575acb9385bead5f58f83aea4a41213dc5505ad24bf83460c4fd54e73b Jun 11 18:50:00.605619 ip-10-0-141-55 kubenswrapper[2578]: I0611 18:50:00.605572 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-2-simulated-kserve-f5c55bdc-d5hwx" event={"ID":"d93bb87b-4abd-402b-903b-9d6eaeabffe0","Type":"ContainerStarted","Data":"df82bc575acb9385bead5f58f83aea4a41213dc5505ad24bf83460c4fd54e73b"} Jun 11 18:50:03.628276 ip-10-0-141-55 kubenswrapper[2578]: I0611 18:50:03.628196 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-2-simulated-kserve-f5c55bdc-d5hwx" event={"ID":"d93bb87b-4abd-402b-903b-9d6eaeabffe0","Type":"ContainerStarted","Data":"d47245ea7a770562941570809ded01ad2704aa2a63b4dd2cc01a4bf0b181f0c8"} Jun 11 18:50:14.056679 ip-10-0-141-55 kubenswrapper[2578]: I0611 18:50:14.056631 2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-6nmdv"] Jun 11 18:50:14.062268 ip-10-0-141-55 kubenswrapper[2578]: I0611 18:50:14.062246 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-6nmdv" Jun 11 18:50:14.065791 ip-10-0-141-55 kubenswrapper[2578]: I0611 18:50:14.065768 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"e2e-trlp-test-simulated-kserve-self-signed-certs\"" Jun 11 18:50:14.071712 ip-10-0-141-55 kubenswrapper[2578]: I0611 18:50:14.071688 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-6nmdv"] Jun 11 18:50:14.212719 ip-10-0-141-55 kubenswrapper[2578]: I0611 18:50:14.212681 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/eb0459ff-8f40-403d-aba4-b96b55b04cea-dshm\") pod \"e2e-trlp-test-simulated-kserve-68bb6c58d9-6nmdv\" (UID: \"eb0459ff-8f40-403d-aba4-b96b55b04cea\") " pod="llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-6nmdv" Jun 11 18:50:14.212719 ip-10-0-141-55 kubenswrapper[2578]: I0611 18:50:14.212716 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/eb0459ff-8f40-403d-aba4-b96b55b04cea-tls-certs\") pod \"e2e-trlp-test-simulated-kserve-68bb6c58d9-6nmdv\" (UID: \"eb0459ff-8f40-403d-aba4-b96b55b04cea\") " pod="llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-6nmdv" Jun 11 18:50:14.212976 ip-10-0-141-55 kubenswrapper[2578]: I0611 18:50:14.212803 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/eb0459ff-8f40-403d-aba4-b96b55b04cea-home\") pod \"e2e-trlp-test-simulated-kserve-68bb6c58d9-6nmdv\" (UID: \"eb0459ff-8f40-403d-aba4-b96b55b04cea\") " pod="llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-6nmdv" Jun 11 18:50:14.212976 ip-10-0-141-55 kubenswrapper[2578]: I0611 18:50:14.212823 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/eb0459ff-8f40-403d-aba4-b96b55b04cea-model-cache\") pod \"e2e-trlp-test-simulated-kserve-68bb6c58d9-6nmdv\" (UID: \"eb0459ff-8f40-403d-aba4-b96b55b04cea\") " pod="llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-6nmdv" Jun 11 18:50:14.212976 ip-10-0-141-55 kubenswrapper[2578]: I0611 18:50:14.212873 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/eb0459ff-8f40-403d-aba4-b96b55b04cea-kserve-provision-location\") pod \"e2e-trlp-test-simulated-kserve-68bb6c58d9-6nmdv\" (UID: \"eb0459ff-8f40-403d-aba4-b96b55b04cea\") " pod="llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-6nmdv" Jun 11 18:50:14.212976 ip-10-0-141-55 kubenswrapper[2578]: I0611 18:50:14.212897 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9fw96\" (UniqueName: \"kubernetes.io/projected/eb0459ff-8f40-403d-aba4-b96b55b04cea-kube-api-access-9fw96\") pod \"e2e-trlp-test-simulated-kserve-68bb6c58d9-6nmdv\" (UID: \"eb0459ff-8f40-403d-aba4-b96b55b04cea\") " pod="llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-6nmdv" Jun 11 18:50:14.314322 ip-10-0-141-55 kubenswrapper[2578]: I0611 18:50:14.314238 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/eb0459ff-8f40-403d-aba4-b96b55b04cea-home\") pod \"e2e-trlp-test-simulated-kserve-68bb6c58d9-6nmdv\" (UID: \"eb0459ff-8f40-403d-aba4-b96b55b04cea\") " pod="llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-6nmdv" Jun 11 18:50:14.314322 ip-10-0-141-55 kubenswrapper[2578]: I0611 18:50:14.314276 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/eb0459ff-8f40-403d-aba4-b96b55b04cea-model-cache\") pod \"e2e-trlp-test-simulated-kserve-68bb6c58d9-6nmdv\" (UID: \"eb0459ff-8f40-403d-aba4-b96b55b04cea\") " pod="llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-6nmdv" Jun 11 18:50:14.314322 ip-10-0-141-55 kubenswrapper[2578]: I0611 18:50:14.314314 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/eb0459ff-8f40-403d-aba4-b96b55b04cea-kserve-provision-location\") pod \"e2e-trlp-test-simulated-kserve-68bb6c58d9-6nmdv\" (UID: \"eb0459ff-8f40-403d-aba4-b96b55b04cea\") " pod="llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-6nmdv" Jun 11 18:50:14.314633 ip-10-0-141-55 kubenswrapper[2578]: I0611 18:50:14.314339 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9fw96\" (UniqueName: \"kubernetes.io/projected/eb0459ff-8f40-403d-aba4-b96b55b04cea-kube-api-access-9fw96\") pod \"e2e-trlp-test-simulated-kserve-68bb6c58d9-6nmdv\" (UID: \"eb0459ff-8f40-403d-aba4-b96b55b04cea\") " pod="llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-6nmdv" Jun 11 18:50:14.314633 ip-10-0-141-55 kubenswrapper[2578]: I0611 18:50:14.314376 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/eb0459ff-8f40-403d-aba4-b96b55b04cea-dshm\") pod \"e2e-trlp-test-simulated-kserve-68bb6c58d9-6nmdv\" (UID: \"eb0459ff-8f40-403d-aba4-b96b55b04cea\") " pod="llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-6nmdv" Jun 11 18:50:14.314633 ip-10-0-141-55 kubenswrapper[2578]: I0611 18:50:14.314396 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/eb0459ff-8f40-403d-aba4-b96b55b04cea-tls-certs\") pod \"e2e-trlp-test-simulated-kserve-68bb6c58d9-6nmdv\" (UID: \"eb0459ff-8f40-403d-aba4-b96b55b04cea\") " pod="llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-6nmdv" Jun 11 18:50:14.314800 ip-10-0-141-55 kubenswrapper[2578]: I0611 18:50:14.314749 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/eb0459ff-8f40-403d-aba4-b96b55b04cea-model-cache\") pod \"e2e-trlp-test-simulated-kserve-68bb6c58d9-6nmdv\" (UID: \"eb0459ff-8f40-403d-aba4-b96b55b04cea\") " pod="llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-6nmdv" Jun 11 18:50:14.314861 ip-10-0-141-55 kubenswrapper[2578]: I0611 18:50:14.314812 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/eb0459ff-8f40-403d-aba4-b96b55b04cea-kserve-provision-location\") pod \"e2e-trlp-test-simulated-kserve-68bb6c58d9-6nmdv\" (UID: \"eb0459ff-8f40-403d-aba4-b96b55b04cea\") " pod="llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-6nmdv" Jun 11 18:50:14.314861 ip-10-0-141-55 kubenswrapper[2578]: I0611 18:50:14.314824 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/eb0459ff-8f40-403d-aba4-b96b55b04cea-home\") pod \"e2e-trlp-test-simulated-kserve-68bb6c58d9-6nmdv\" (UID: \"eb0459ff-8f40-403d-aba4-b96b55b04cea\") " pod="llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-6nmdv" Jun 11 18:50:14.316720 ip-10-0-141-55 kubenswrapper[2578]: I0611 18:50:14.316700 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/eb0459ff-8f40-403d-aba4-b96b55b04cea-dshm\") pod \"e2e-trlp-test-simulated-kserve-68bb6c58d9-6nmdv\" (UID: \"eb0459ff-8f40-403d-aba4-b96b55b04cea\") " pod="llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-6nmdv" Jun 11 18:50:14.316951 ip-10-0-141-55 kubenswrapper[2578]: I0611 18:50:14.316934 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/eb0459ff-8f40-403d-aba4-b96b55b04cea-tls-certs\") pod \"e2e-trlp-test-simulated-kserve-68bb6c58d9-6nmdv\" (UID: \"eb0459ff-8f40-403d-aba4-b96b55b04cea\") " pod="llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-6nmdv" Jun 11 18:50:14.322682 ip-10-0-141-55 kubenswrapper[2578]: I0611 18:50:14.322665 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-9fw96\" (UniqueName: \"kubernetes.io/projected/eb0459ff-8f40-403d-aba4-b96b55b04cea-kube-api-access-9fw96\") pod \"e2e-trlp-test-simulated-kserve-68bb6c58d9-6nmdv\" (UID: \"eb0459ff-8f40-403d-aba4-b96b55b04cea\") " pod="llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-6nmdv" Jun 11 18:50:14.374111 ip-10-0-141-55 kubenswrapper[2578]: I0611 18:50:14.374078 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-6nmdv" Jun 11 18:50:14.516359 ip-10-0-141-55 kubenswrapper[2578]: I0611 18:50:14.516197 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-6nmdv"] Jun 11 18:50:14.687798 ip-10-0-141-55 kubenswrapper[2578]: I0611 18:50:14.687748 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-6nmdv" event={"ID":"eb0459ff-8f40-403d-aba4-b96b55b04cea","Type":"ContainerStarted","Data":"e63136e406022fdb53e92635903b87cbe3b0b80b1fea7420019da06f83489dba"} Jun 11 18:50:14.687987 ip-10-0-141-55 kubenswrapper[2578]: I0611 18:50:14.687825 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-6nmdv" event={"ID":"eb0459ff-8f40-403d-aba4-b96b55b04cea","Type":"ContainerStarted","Data":"48b5f61b5c3a458982d80ab41fceb7337a6775946ccb52287624bd52022c250b"} Jun 11 18:50:16.699028 ip-10-0-141-55 kubenswrapper[2578]: I0611 18:50:16.698994 2578 generic.go:356] "Generic (PLEG): container finished" podID="eb0459ff-8f40-403d-aba4-b96b55b04cea" containerID="e63136e406022fdb53e92635903b87cbe3b0b80b1fea7420019da06f83489dba" exitCode=0 Jun 11 18:50:16.699551 ip-10-0-141-55 kubenswrapper[2578]: I0611 18:50:16.699056 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-6nmdv" event={"ID":"eb0459ff-8f40-403d-aba4-b96b55b04cea","Type":"ContainerDied","Data":"e63136e406022fdb53e92635903b87cbe3b0b80b1fea7420019da06f83489dba"} Jun 11 18:50:18.713941 ip-10-0-141-55 kubenswrapper[2578]: I0611 18:50:18.713903 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-6nmdv" event={"ID":"eb0459ff-8f40-403d-aba4-b96b55b04cea","Type":"ContainerStarted","Data":"10658aba0bbc475eaf2dfc73438a62cb9283de81883fbc4d40529fcf581dca70"} Jun 11 18:50:18.736242 ip-10-0-141-55 kubenswrapper[2578]: I0611 18:50:18.736191 2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-6nmdv" podStartSLOduration=2.277963663 podStartE2EDuration="4.736176344s" totalImagesPullingTime="1.153493711s" totalInitContainerRuntime="1.30471897s" isStatefulPod=false podCreationTimestamp="2026-06-11 18:50:14 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-11 18:50:18.734301364 +0000 UTC m=+824.688975992" watchObservedRunningTime="2026-06-11 18:50:18.736176344 +0000 UTC m=+824.690850997" Jun 11 18:50:24.374371 ip-10-0-141-55 kubenswrapper[2578]: I0611 18:50:24.374332 2578 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-6nmdv" Jun 11 18:50:24.374902 ip-10-0-141-55 kubenswrapper[2578]: I0611 18:50:24.374405 2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-6nmdv" Jun 11 18:50:24.386920 ip-10-0-141-55 kubenswrapper[2578]: I0611 18:50:24.386897 2578 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-6nmdv" Jun 11 18:50:24.758883 ip-10-0-141-55 kubenswrapper[2578]: I0611 18:50:24.758796 2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-6nmdv" Jun 11 18:50:34.040196 ip-10-0-141-55 kubenswrapper[2578]: I0611 18:50:34.040145 2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477cr4mz7"] Jun 11 18:50:34.051395 ip-10-0-141-55 kubenswrapper[2578]: I0611 18:50:34.051370 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477cr4mz7" Jun 11 18:50:34.054617 ip-10-0-141-55 kubenswrapper[2578]: I0611 18:50:34.054591 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"e2e-unab60ef4d3a239b5143b412cab04acac3-kserve-self-signed-certs\"" Jun 11 18:50:34.055375 ip-10-0-141-55 kubenswrapper[2578]: I0611 18:50:34.055352 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477cr4mz7"] Jun 11 18:50:34.090387 ip-10-0-141-55 kubenswrapper[2578]: I0611 18:50:34.090351 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-bb627\" (UniqueName: \"kubernetes.io/projected/f4253fdb-d63f-4008-9767-bcb4fb110a34-kube-api-access-bb627\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477cr4mz7\" (UID: \"f4253fdb-d63f-4008-9767-bcb4fb110a34\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477cr4mz7" Jun 11 18:50:34.090585 ip-10-0-141-55 kubenswrapper[2578]: I0611 18:50:34.090411 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/f4253fdb-d63f-4008-9767-bcb4fb110a34-model-cache\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477cr4mz7\" (UID: \"f4253fdb-d63f-4008-9767-bcb4fb110a34\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477cr4mz7" Jun 11 18:50:34.090585 ip-10-0-141-55 kubenswrapper[2578]: I0611 18:50:34.090495 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/f4253fdb-d63f-4008-9767-bcb4fb110a34-tls-certs\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477cr4mz7\" (UID: \"f4253fdb-d63f-4008-9767-bcb4fb110a34\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477cr4mz7" Jun 11 18:50:34.090585 ip-10-0-141-55 kubenswrapper[2578]: I0611 18:50:34.090531 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/f4253fdb-d63f-4008-9767-bcb4fb110a34-home\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477cr4mz7\" (UID: \"f4253fdb-d63f-4008-9767-bcb4fb110a34\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477cr4mz7" Jun 11 18:50:34.090585 ip-10-0-141-55 kubenswrapper[2578]: I0611 18:50:34.090578 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/f4253fdb-d63f-4008-9767-bcb4fb110a34-dshm\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477cr4mz7\" (UID: \"f4253fdb-d63f-4008-9767-bcb4fb110a34\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477cr4mz7" Jun 11 18:50:34.090750 ip-10-0-141-55 kubenswrapper[2578]: I0611 18:50:34.090636 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/f4253fdb-d63f-4008-9767-bcb4fb110a34-kserve-provision-location\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477cr4mz7\" (UID: \"f4253fdb-d63f-4008-9767-bcb4fb110a34\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477cr4mz7" Jun 11 18:50:34.191187 ip-10-0-141-55 kubenswrapper[2578]: I0611 18:50:34.191143 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/f4253fdb-d63f-4008-9767-bcb4fb110a34-model-cache\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477cr4mz7\" (UID: \"f4253fdb-d63f-4008-9767-bcb4fb110a34\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477cr4mz7" Jun 11 18:50:34.191379 ip-10-0-141-55 kubenswrapper[2578]: I0611 18:50:34.191225 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/f4253fdb-d63f-4008-9767-bcb4fb110a34-tls-certs\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477cr4mz7\" (UID: \"f4253fdb-d63f-4008-9767-bcb4fb110a34\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477cr4mz7" Jun 11 18:50:34.191379 ip-10-0-141-55 kubenswrapper[2578]: I0611 18:50:34.191252 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/f4253fdb-d63f-4008-9767-bcb4fb110a34-home\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477cr4mz7\" (UID: \"f4253fdb-d63f-4008-9767-bcb4fb110a34\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477cr4mz7" Jun 11 18:50:34.191379 ip-10-0-141-55 kubenswrapper[2578]: I0611 18:50:34.191270 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/f4253fdb-d63f-4008-9767-bcb4fb110a34-dshm\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477cr4mz7\" (UID: \"f4253fdb-d63f-4008-9767-bcb4fb110a34\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477cr4mz7" Jun 11 18:50:34.191379 ip-10-0-141-55 kubenswrapper[2578]: I0611 18:50:34.191302 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/f4253fdb-d63f-4008-9767-bcb4fb110a34-kserve-provision-location\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477cr4mz7\" (UID: \"f4253fdb-d63f-4008-9767-bcb4fb110a34\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477cr4mz7" Jun 11 18:50:34.191379 ip-10-0-141-55 kubenswrapper[2578]: I0611 18:50:34.191365 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-bb627\" (UniqueName: \"kubernetes.io/projected/f4253fdb-d63f-4008-9767-bcb4fb110a34-kube-api-access-bb627\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477cr4mz7\" (UID: \"f4253fdb-d63f-4008-9767-bcb4fb110a34\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477cr4mz7" Jun 11 18:50:34.191696 ip-10-0-141-55 kubenswrapper[2578]: I0611 18:50:34.191670 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/f4253fdb-d63f-4008-9767-bcb4fb110a34-model-cache\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477cr4mz7\" (UID: \"f4253fdb-d63f-4008-9767-bcb4fb110a34\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477cr4mz7" Jun 11 18:50:34.191784 ip-10-0-141-55 kubenswrapper[2578]: I0611 18:50:34.191716 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/f4253fdb-d63f-4008-9767-bcb4fb110a34-home\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477cr4mz7\" (UID: \"f4253fdb-d63f-4008-9767-bcb4fb110a34\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477cr4mz7" Jun 11 18:50:34.191839 ip-10-0-141-55 kubenswrapper[2578]: I0611 18:50:34.191793 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/f4253fdb-d63f-4008-9767-bcb4fb110a34-kserve-provision-location\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477cr4mz7\" (UID: \"f4253fdb-d63f-4008-9767-bcb4fb110a34\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477cr4mz7" Jun 11 18:50:34.193614 ip-10-0-141-55 kubenswrapper[2578]: I0611 18:50:34.193591 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/f4253fdb-d63f-4008-9767-bcb4fb110a34-dshm\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477cr4mz7\" (UID: \"f4253fdb-d63f-4008-9767-bcb4fb110a34\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477cr4mz7" Jun 11 18:50:34.194006 ip-10-0-141-55 kubenswrapper[2578]: I0611 18:50:34.193984 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/f4253fdb-d63f-4008-9767-bcb4fb110a34-tls-certs\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477cr4mz7\" (UID: \"f4253fdb-d63f-4008-9767-bcb4fb110a34\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477cr4mz7" Jun 11 18:50:34.199376 ip-10-0-141-55 kubenswrapper[2578]: I0611 18:50:34.199352 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-bb627\" (UniqueName: \"kubernetes.io/projected/f4253fdb-d63f-4008-9767-bcb4fb110a34-kube-api-access-bb627\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477cr4mz7\" (UID: \"f4253fdb-d63f-4008-9767-bcb4fb110a34\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477cr4mz7" Jun 11 18:50:34.365456 ip-10-0-141-55 kubenswrapper[2578]: I0611 18:50:34.365422 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477cr4mz7" Jun 11 18:50:34.506597 ip-10-0-141-55 kubenswrapper[2578]: I0611 18:50:34.506566 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477cr4mz7"] Jun 11 18:50:34.506982 ip-10-0-141-55 kubenswrapper[2578]: W0611 18:50:34.506959 2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf4253fdb_d63f_4008_9767_bcb4fb110a34.slice/crio-b2f9dc70992b75789edd4816bad268a7b73fe6ec36a22bc9f833a284fa3b06c1 WatchSource:0}: Error finding container b2f9dc70992b75789edd4816bad268a7b73fe6ec36a22bc9f833a284fa3b06c1: Status 404 returned error can't find the container with id b2f9dc70992b75789edd4816bad268a7b73fe6ec36a22bc9f833a284fa3b06c1 Jun 11 18:50:34.804688 ip-10-0-141-55 kubenswrapper[2578]: I0611 18:50:34.804601 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477cr4mz7" event={"ID":"f4253fdb-d63f-4008-9767-bcb4fb110a34","Type":"ContainerStarted","Data":"1de07b2e15fd7747508c8dde21cbb29cae4ac0545bb34510f32e75af1a92de79"} Jun 11 18:50:34.804688 ip-10-0-141-55 kubenswrapper[2578]: I0611 18:50:34.804657 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477cr4mz7" event={"ID":"f4253fdb-d63f-4008-9767-bcb4fb110a34","Type":"ContainerStarted","Data":"b2f9dc70992b75789edd4816bad268a7b73fe6ec36a22bc9f833a284fa3b06c1"} Jun 11 18:51:34.461826 ip-10-0-141-55 kubenswrapper[2578]: I0611 18:51:34.461747 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-machine-config-operator_kube-rbac-proxy-crio-ip-10-0-141-55.ec2.internal_a7e51dec29aa10b42d4127d190b80186/kube-rbac-proxy-crio/0.log" Jun 11 18:51:34.464541 ip-10-0-141-55 kubenswrapper[2578]: I0611 18:51:34.464519 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-machine-config-operator_kube-rbac-proxy-crio-ip-10-0-141-55.ec2.internal_a7e51dec29aa10b42d4127d190b80186/kube-rbac-proxy-crio/0.log" Jun 11 18:52:26.416678 ip-10-0-141-55 kubenswrapper[2578]: I0611 18:52:26.416635 2578 generic.go:356] "Generic (PLEG): container finished" podID="f4253fdb-d63f-4008-9767-bcb4fb110a34" containerID="1de07b2e15fd7747508c8dde21cbb29cae4ac0545bb34510f32e75af1a92de79" exitCode=0 Jun 11 18:52:26.427952 ip-10-0-141-55 kubenswrapper[2578]: I0611 18:52:26.422540 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477cr4mz7" event={"ID":"f4253fdb-d63f-4008-9767-bcb4fb110a34","Type":"ContainerDied","Data":"1de07b2e15fd7747508c8dde21cbb29cae4ac0545bb34510f32e75af1a92de79"} Jun 11 18:52:26.427952 ip-10-0-141-55 kubenswrapper[2578]: I0611 18:52:26.423620 2578 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jun 11 18:52:27.424127 ip-10-0-141-55 kubenswrapper[2578]: I0611 18:52:27.424091 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477cr4mz7" event={"ID":"f4253fdb-d63f-4008-9767-bcb4fb110a34","Type":"ContainerStarted","Data":"ac7382066710b0aa3e6f42743ba9c017476dc60441954ef1fbb49b77173a7e94"} Jun 11 18:52:27.443986 ip-10-0-141-55 kubenswrapper[2578]: I0611 18:52:27.443934 2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477cr4mz7" podStartSLOduration=2.100164002 podStartE2EDuration="1m53.443919511s" totalImagesPullingTime="194.904431ms" totalInitContainerRuntime="1m51.148851078s" isStatefulPod=false podCreationTimestamp="2026-06-11 18:50:34 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-11 18:52:27.443748333 +0000 UTC m=+953.398422940" watchObservedRunningTime="2026-06-11 18:52:27.443919511 +0000 UTC m=+953.398594116" Jun 11 18:52:34.366305 ip-10-0-141-55 kubenswrapper[2578]: I0611 18:52:34.366266 2578 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477cr4mz7" Jun 11 18:52:34.366857 ip-10-0-141-55 kubenswrapper[2578]: I0611 18:52:34.366360 2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477cr4mz7" Jun 11 18:52:34.379228 ip-10-0-141-55 kubenswrapper[2578]: I0611 18:52:34.379204 2578 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477cr4mz7" Jun 11 18:52:34.476067 ip-10-0-141-55 kubenswrapper[2578]: I0611 18:52:34.476037 2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477cr4mz7" Jun 11 18:52:35.754887 ip-10-0-141-55 kubenswrapper[2578]: I0611 18:52:35.754857 2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-fcd8df8cd-lrvl8"] Jun 11 18:52:35.758398 ip-10-0-141-55 kubenswrapper[2578]: I0611 18:52:35.758381 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-fcd8df8cd-lrvl8" Jun 11 18:52:35.765596 ip-10-0-141-55 kubenswrapper[2578]: I0611 18:52:35.765569 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-fcd8df8cd-lrvl8"] Jun 11 18:52:35.916171 ip-10-0-141-55 kubenswrapper[2578]: I0611 18:52:35.916138 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oidc-ca\" (UniqueName: \"kubernetes.io/configmap/8e5fca77-a46e-43c9-bb4e-84723e09d6c0-oidc-ca\") pod \"authorino-fcd8df8cd-lrvl8\" (UID: \"8e5fca77-a46e-43c9-bb4e-84723e09d6c0\") " pod="kuadrant-system/authorino-fcd8df8cd-lrvl8" Jun 11 18:52:35.916342 ip-10-0-141-55 kubenswrapper[2578]: I0611 18:52:35.916190 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-b67w8\" (UniqueName: \"kubernetes.io/projected/8e5fca77-a46e-43c9-bb4e-84723e09d6c0-kube-api-access-b67w8\") pod \"authorino-fcd8df8cd-lrvl8\" (UID: \"8e5fca77-a46e-43c9-bb4e-84723e09d6c0\") " pod="kuadrant-system/authorino-fcd8df8cd-lrvl8" Jun 11 18:52:35.916342 ip-10-0-141-55 kubenswrapper[2578]: I0611 18:52:35.916242 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/8e5fca77-a46e-43c9-bb4e-84723e09d6c0-tls-cert\") pod \"authorino-fcd8df8cd-lrvl8\" (UID: \"8e5fca77-a46e-43c9-bb4e-84723e09d6c0\") " pod="kuadrant-system/authorino-fcd8df8cd-lrvl8" Jun 11 18:52:36.017201 ip-10-0-141-55 kubenswrapper[2578]: I0611 18:52:36.017108 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/8e5fca77-a46e-43c9-bb4e-84723e09d6c0-tls-cert\") pod \"authorino-fcd8df8cd-lrvl8\" (UID: \"8e5fca77-a46e-43c9-bb4e-84723e09d6c0\") " pod="kuadrant-system/authorino-fcd8df8cd-lrvl8" Jun 11 18:52:36.017201 ip-10-0-141-55 kubenswrapper[2578]: I0611 18:52:36.017207 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oidc-ca\" (UniqueName: \"kubernetes.io/configmap/8e5fca77-a46e-43c9-bb4e-84723e09d6c0-oidc-ca\") pod \"authorino-fcd8df8cd-lrvl8\" (UID: \"8e5fca77-a46e-43c9-bb4e-84723e09d6c0\") " pod="kuadrant-system/authorino-fcd8df8cd-lrvl8" Jun 11 18:52:36.017395 ip-10-0-141-55 kubenswrapper[2578]: I0611 18:52:36.017246 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-b67w8\" (UniqueName: \"kubernetes.io/projected/8e5fca77-a46e-43c9-bb4e-84723e09d6c0-kube-api-access-b67w8\") pod \"authorino-fcd8df8cd-lrvl8\" (UID: \"8e5fca77-a46e-43c9-bb4e-84723e09d6c0\") " pod="kuadrant-system/authorino-fcd8df8cd-lrvl8" Jun 11 18:52:36.017836 ip-10-0-141-55 kubenswrapper[2578]: I0611 18:52:36.017812 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"oidc-ca\" (UniqueName: \"kubernetes.io/configmap/8e5fca77-a46e-43c9-bb4e-84723e09d6c0-oidc-ca\") pod \"authorino-fcd8df8cd-lrvl8\" (UID: \"8e5fca77-a46e-43c9-bb4e-84723e09d6c0\") " pod="kuadrant-system/authorino-fcd8df8cd-lrvl8" Jun 11 18:52:36.019432 ip-10-0-141-55 kubenswrapper[2578]: I0611 18:52:36.019406 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/8e5fca77-a46e-43c9-bb4e-84723e09d6c0-tls-cert\") pod \"authorino-fcd8df8cd-lrvl8\" (UID: \"8e5fca77-a46e-43c9-bb4e-84723e09d6c0\") " pod="kuadrant-system/authorino-fcd8df8cd-lrvl8" Jun 11 18:52:36.024856 ip-10-0-141-55 kubenswrapper[2578]: I0611 18:52:36.024838 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-b67w8\" (UniqueName: \"kubernetes.io/projected/8e5fca77-a46e-43c9-bb4e-84723e09d6c0-kube-api-access-b67w8\") pod \"authorino-fcd8df8cd-lrvl8\" (UID: \"8e5fca77-a46e-43c9-bb4e-84723e09d6c0\") " pod="kuadrant-system/authorino-fcd8df8cd-lrvl8" Jun 11 18:52:36.068850 ip-10-0-141-55 kubenswrapper[2578]: I0611 18:52:36.068822 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-fcd8df8cd-lrvl8" Jun 11 18:52:36.199253 ip-10-0-141-55 kubenswrapper[2578]: I0611 18:52:36.198969 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-fcd8df8cd-lrvl8"] Jun 11 18:52:36.201481 ip-10-0-141-55 kubenswrapper[2578]: W0611 18:52:36.201447 2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod8e5fca77_a46e_43c9_bb4e_84723e09d6c0.slice/crio-58d10f58cddf0f1470bc08f20a5452d6bd4ee024fdce5cffff85bf6720252c5e WatchSource:0}: Error finding container 58d10f58cddf0f1470bc08f20a5452d6bd4ee024fdce5cffff85bf6720252c5e: Status 404 returned error can't find the container with id 58d10f58cddf0f1470bc08f20a5452d6bd4ee024fdce5cffff85bf6720252c5e Jun 11 18:52:36.477621 ip-10-0-141-55 kubenswrapper[2578]: I0611 18:52:36.477584 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-fcd8df8cd-lrvl8" event={"ID":"8e5fca77-a46e-43c9-bb4e-84723e09d6c0","Type":"ContainerStarted","Data":"58d10f58cddf0f1470bc08f20a5452d6bd4ee024fdce5cffff85bf6720252c5e"} Jun 11 18:52:37.485992 ip-10-0-141-55 kubenswrapper[2578]: I0611 18:52:37.485942 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-fcd8df8cd-lrvl8" event={"ID":"8e5fca77-a46e-43c9-bb4e-84723e09d6c0","Type":"ContainerStarted","Data":"edc4ab505bfe58d53c55dc1912198c1eb8e6735c81430e57414c87efb67eb936"} Jun 11 18:52:37.511953 ip-10-0-141-55 kubenswrapper[2578]: I0611 18:52:37.511888 2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/authorino-fcd8df8cd-lrvl8" podStartSLOduration=2.062736107 podStartE2EDuration="2.511866801s" totalImagesPullingTime="449.130694ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-11 18:52:35 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-11 18:52:37.506126816 +0000 UTC m=+963.460801526" watchObservedRunningTime="2026-06-11 18:52:37.511866801 +0000 UTC m=+963.466541408" Jun 11 18:52:37.539459 ip-10-0-141-55 kubenswrapper[2578]: I0611 18:52:37.539424 2578 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-5c7dd6cf47-g22r7"] Jun 11 18:52:37.539880 ip-10-0-141-55 kubenswrapper[2578]: I0611 18:52:37.539847 2578 kuberuntime_container.go:872] "Killing container with a grace period" pod="kuadrant-system/authorino-5c7dd6cf47-g22r7" podUID="b40073af-0dbb-4d58-b8d1-1f18dcdb7c8e" containerName="authorino" containerID="cri-o://09695b58e6ba8e824ac3ede0e84b5b5a6a8f0b46a6995082226650e4be508dcb" gracePeriod=30 Jun 11 18:52:37.815923 ip-10-0-141-55 kubenswrapper[2578]: I0611 18:52:37.815892 2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-5c7dd6cf47-g22r7" Jun 11 18:52:37.941997 ip-10-0-141-55 kubenswrapper[2578]: I0611 18:52:37.941943 2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-bc8xl\" (UniqueName: \"kubernetes.io/projected/b40073af-0dbb-4d58-b8d1-1f18dcdb7c8e-kube-api-access-bc8xl\") pod \"b40073af-0dbb-4d58-b8d1-1f18dcdb7c8e\" (UID: \"b40073af-0dbb-4d58-b8d1-1f18dcdb7c8e\") " Jun 11 18:52:37.942196 ip-10-0-141-55 kubenswrapper[2578]: I0611 18:52:37.942024 2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/b40073af-0dbb-4d58-b8d1-1f18dcdb7c8e-tls-cert\") pod \"b40073af-0dbb-4d58-b8d1-1f18dcdb7c8e\" (UID: \"b40073af-0dbb-4d58-b8d1-1f18dcdb7c8e\") " Jun 11 18:52:37.942196 ip-10-0-141-55 kubenswrapper[2578]: I0611 18:52:37.942090 2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"oidc-ca\" (UniqueName: \"kubernetes.io/configmap/b40073af-0dbb-4d58-b8d1-1f18dcdb7c8e-oidc-ca\") pod \"b40073af-0dbb-4d58-b8d1-1f18dcdb7c8e\" (UID: \"b40073af-0dbb-4d58-b8d1-1f18dcdb7c8e\") " Jun 11 18:52:37.944572 ip-10-0-141-55 kubenswrapper[2578]: I0611 18:52:37.944522 2578 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/b40073af-0dbb-4d58-b8d1-1f18dcdb7c8e-kube-api-access-bc8xl" (OuterVolumeSpecName: "kube-api-access-bc8xl") pod "b40073af-0dbb-4d58-b8d1-1f18dcdb7c8e" (UID: "b40073af-0dbb-4d58-b8d1-1f18dcdb7c8e"). InnerVolumeSpecName "kube-api-access-bc8xl". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 11 18:52:37.947348 ip-10-0-141-55 kubenswrapper[2578]: I0611 18:52:37.947319 2578 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/b40073af-0dbb-4d58-b8d1-1f18dcdb7c8e-oidc-ca" (OuterVolumeSpecName: "oidc-ca") pod "b40073af-0dbb-4d58-b8d1-1f18dcdb7c8e" (UID: "b40073af-0dbb-4d58-b8d1-1f18dcdb7c8e"). InnerVolumeSpecName "oidc-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 11 18:52:37.952722 ip-10-0-141-55 kubenswrapper[2578]: I0611 18:52:37.952693 2578 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/b40073af-0dbb-4d58-b8d1-1f18dcdb7c8e-tls-cert" (OuterVolumeSpecName: "tls-cert") pod "b40073af-0dbb-4d58-b8d1-1f18dcdb7c8e" (UID: "b40073af-0dbb-4d58-b8d1-1f18dcdb7c8e"). InnerVolumeSpecName "tls-cert". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 11 18:52:38.043587 ip-10-0-141-55 kubenswrapper[2578]: I0611 18:52:38.043473 2578 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-bc8xl\" (UniqueName: \"kubernetes.io/projected/b40073af-0dbb-4d58-b8d1-1f18dcdb7c8e-kube-api-access-bc8xl\") on node \"ip-10-0-141-55.ec2.internal\" DevicePath \"\"" Jun 11 18:52:38.043587 ip-10-0-141-55 kubenswrapper[2578]: I0611 18:52:38.043503 2578 reconciler_common.go:299] "Volume detached for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/b40073af-0dbb-4d58-b8d1-1f18dcdb7c8e-tls-cert\") on node \"ip-10-0-141-55.ec2.internal\" DevicePath \"\"" Jun 11 18:52:38.043587 ip-10-0-141-55 kubenswrapper[2578]: I0611 18:52:38.043513 2578 reconciler_common.go:299] "Volume detached for volume \"oidc-ca\" (UniqueName: \"kubernetes.io/configmap/b40073af-0dbb-4d58-b8d1-1f18dcdb7c8e-oidc-ca\") on node \"ip-10-0-141-55.ec2.internal\" DevicePath \"\"" Jun 11 18:52:38.493050 ip-10-0-141-55 kubenswrapper[2578]: I0611 18:52:38.493014 2578 generic.go:356] "Generic (PLEG): container finished" podID="b40073af-0dbb-4d58-b8d1-1f18dcdb7c8e" containerID="09695b58e6ba8e824ac3ede0e84b5b5a6a8f0b46a6995082226650e4be508dcb" exitCode=0 Jun 11 18:52:38.493525 ip-10-0-141-55 kubenswrapper[2578]: I0611 18:52:38.493056 2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-5c7dd6cf47-g22r7" Jun 11 18:52:38.493525 ip-10-0-141-55 kubenswrapper[2578]: I0611 18:52:38.493101 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-5c7dd6cf47-g22r7" event={"ID":"b40073af-0dbb-4d58-b8d1-1f18dcdb7c8e","Type":"ContainerDied","Data":"09695b58e6ba8e824ac3ede0e84b5b5a6a8f0b46a6995082226650e4be508dcb"} Jun 11 18:52:38.493525 ip-10-0-141-55 kubenswrapper[2578]: I0611 18:52:38.493147 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-5c7dd6cf47-g22r7" event={"ID":"b40073af-0dbb-4d58-b8d1-1f18dcdb7c8e","Type":"ContainerDied","Data":"b196bd256871cc36c0d8fb6c9568f2359530053151836d2a00a4d8344c878bed"} Jun 11 18:52:38.493525 ip-10-0-141-55 kubenswrapper[2578]: I0611 18:52:38.493170 2578 scope.go:117] "RemoveContainer" containerID="09695b58e6ba8e824ac3ede0e84b5b5a6a8f0b46a6995082226650e4be508dcb" Jun 11 18:52:38.502279 ip-10-0-141-55 kubenswrapper[2578]: I0611 18:52:38.502262 2578 scope.go:117] "RemoveContainer" containerID="09695b58e6ba8e824ac3ede0e84b5b5a6a8f0b46a6995082226650e4be508dcb" Jun 11 18:52:38.502546 ip-10-0-141-55 kubenswrapper[2578]: E0611 18:52:38.502527 2578 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"09695b58e6ba8e824ac3ede0e84b5b5a6a8f0b46a6995082226650e4be508dcb\": container with ID starting with 09695b58e6ba8e824ac3ede0e84b5b5a6a8f0b46a6995082226650e4be508dcb not found: ID does not exist" containerID="09695b58e6ba8e824ac3ede0e84b5b5a6a8f0b46a6995082226650e4be508dcb" Jun 11 18:52:38.502635 ip-10-0-141-55 kubenswrapper[2578]: I0611 18:52:38.502576 2578 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"09695b58e6ba8e824ac3ede0e84b5b5a6a8f0b46a6995082226650e4be508dcb"} err="failed to get container status \"09695b58e6ba8e824ac3ede0e84b5b5a6a8f0b46a6995082226650e4be508dcb\": rpc error: code = NotFound desc = could not find container \"09695b58e6ba8e824ac3ede0e84b5b5a6a8f0b46a6995082226650e4be508dcb\": container with ID starting with 09695b58e6ba8e824ac3ede0e84b5b5a6a8f0b46a6995082226650e4be508dcb not found: ID does not exist" Jun 11 18:52:38.510487 ip-10-0-141-55 kubenswrapper[2578]: I0611 18:52:38.510446 2578 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-5c7dd6cf47-g22r7"] Jun 11 18:52:38.514086 ip-10-0-141-55 kubenswrapper[2578]: I0611 18:52:38.514066 2578 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/authorino-5c7dd6cf47-g22r7"] Jun 11 18:52:40.421473 ip-10-0-141-55 kubenswrapper[2578]: I0611 18:52:40.421442 2578 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="b40073af-0dbb-4d58-b8d1-1f18dcdb7c8e" path="/var/lib/kubelet/pods/b40073af-0dbb-4d58-b8d1-1f18dcdb7c8e/volumes" Jun 11 18:54:06.614374 ip-10-0-141-55 kubenswrapper[2578]: I0611 18:54:06.614338 2578 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-controller-758d4854d9-rjjb7"] Jun 11 18:54:06.614842 ip-10-0-141-55 kubenswrapper[2578]: I0611 18:54:06.614621 2578 kuberuntime_container.go:872] "Killing container with a grace period" pod="opendatahub/maas-controller-758d4854d9-rjjb7" podUID="2a3840a8-677f-4c1c-902b-0458e780e9b5" containerName="manager" containerID="cri-o://419cc1edcc57b4dd711af3c93d896ab0bb6d1a7b55164c43d22c887eebed2a2c" gracePeriod=30 Jun 11 18:54:06.867940 ip-10-0-141-55 kubenswrapper[2578]: I0611 18:54:06.867880 2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-758d4854d9-rjjb7" Jun 11 18:54:06.942866 ip-10-0-141-55 kubenswrapper[2578]: I0611 18:54:06.942827 2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-55c5v\" (UniqueName: \"kubernetes.io/projected/2a3840a8-677f-4c1c-902b-0458e780e9b5-kube-api-access-55c5v\") pod \"2a3840a8-677f-4c1c-902b-0458e780e9b5\" (UID: \"2a3840a8-677f-4c1c-902b-0458e780e9b5\") " Jun 11 18:54:06.943045 ip-10-0-141-55 kubenswrapper[2578]: I0611 18:54:06.942873 2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/2a3840a8-677f-4c1c-902b-0458e780e9b5-webhook-cert\") pod \"2a3840a8-677f-4c1c-902b-0458e780e9b5\" (UID: \"2a3840a8-677f-4c1c-902b-0458e780e9b5\") " Jun 11 18:54:06.944923 ip-10-0-141-55 kubenswrapper[2578]: I0611 18:54:06.944902 2578 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/2a3840a8-677f-4c1c-902b-0458e780e9b5-kube-api-access-55c5v" (OuterVolumeSpecName: "kube-api-access-55c5v") pod "2a3840a8-677f-4c1c-902b-0458e780e9b5" (UID: "2a3840a8-677f-4c1c-902b-0458e780e9b5"). InnerVolumeSpecName "kube-api-access-55c5v". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 11 18:54:06.945032 ip-10-0-141-55 kubenswrapper[2578]: I0611 18:54:06.944920 2578 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/2a3840a8-677f-4c1c-902b-0458e780e9b5-webhook-cert" (OuterVolumeSpecName: "webhook-cert") pod "2a3840a8-677f-4c1c-902b-0458e780e9b5" (UID: "2a3840a8-677f-4c1c-902b-0458e780e9b5"). InnerVolumeSpecName "webhook-cert". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 11 18:54:06.997808 ip-10-0-141-55 kubenswrapper[2578]: I0611 18:54:06.997772 2578 generic.go:356] "Generic (PLEG): container finished" podID="2a3840a8-677f-4c1c-902b-0458e780e9b5" containerID="419cc1edcc57b4dd711af3c93d896ab0bb6d1a7b55164c43d22c887eebed2a2c" exitCode=0 Jun 11 18:54:06.998005 ip-10-0-141-55 kubenswrapper[2578]: I0611 18:54:06.997815 2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-758d4854d9-rjjb7" Jun 11 18:54:06.998005 ip-10-0-141-55 kubenswrapper[2578]: I0611 18:54:06.997856 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-758d4854d9-rjjb7" event={"ID":"2a3840a8-677f-4c1c-902b-0458e780e9b5","Type":"ContainerDied","Data":"419cc1edcc57b4dd711af3c93d896ab0bb6d1a7b55164c43d22c887eebed2a2c"} Jun 11 18:54:06.998005 ip-10-0-141-55 kubenswrapper[2578]: I0611 18:54:06.997911 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-758d4854d9-rjjb7" event={"ID":"2a3840a8-677f-4c1c-902b-0458e780e9b5","Type":"ContainerDied","Data":"40d96d453fd4a65e96a512b26a43f101cd49b79796ed4d364974d77c83cd7930"} Jun 11 18:54:06.998005 ip-10-0-141-55 kubenswrapper[2578]: I0611 18:54:06.997944 2578 scope.go:117] "RemoveContainer" containerID="419cc1edcc57b4dd711af3c93d896ab0bb6d1a7b55164c43d22c887eebed2a2c" Jun 11 18:54:07.007319 ip-10-0-141-55 kubenswrapper[2578]: I0611 18:54:07.007303 2578 scope.go:117] "RemoveContainer" containerID="419cc1edcc57b4dd711af3c93d896ab0bb6d1a7b55164c43d22c887eebed2a2c" Jun 11 18:54:07.007587 ip-10-0-141-55 kubenswrapper[2578]: E0611 18:54:07.007568 2578 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"419cc1edcc57b4dd711af3c93d896ab0bb6d1a7b55164c43d22c887eebed2a2c\": container with ID starting with 419cc1edcc57b4dd711af3c93d896ab0bb6d1a7b55164c43d22c887eebed2a2c not found: ID does not exist" containerID="419cc1edcc57b4dd711af3c93d896ab0bb6d1a7b55164c43d22c887eebed2a2c" Jun 11 18:54:07.007666 ip-10-0-141-55 kubenswrapper[2578]: I0611 18:54:07.007593 2578 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"419cc1edcc57b4dd711af3c93d896ab0bb6d1a7b55164c43d22c887eebed2a2c"} err="failed to get container status \"419cc1edcc57b4dd711af3c93d896ab0bb6d1a7b55164c43d22c887eebed2a2c\": rpc error: code = NotFound desc = could not find container \"419cc1edcc57b4dd711af3c93d896ab0bb6d1a7b55164c43d22c887eebed2a2c\": container with ID starting with 419cc1edcc57b4dd711af3c93d896ab0bb6d1a7b55164c43d22c887eebed2a2c not found: ID does not exist" Jun 11 18:54:07.019362 ip-10-0-141-55 kubenswrapper[2578]: I0611 18:54:07.019339 2578 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-controller-758d4854d9-rjjb7"] Jun 11 18:54:07.024824 ip-10-0-141-55 kubenswrapper[2578]: I0611 18:54:07.024797 2578 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/maas-controller-758d4854d9-rjjb7"] Jun 11 18:54:07.043646 ip-10-0-141-55 kubenswrapper[2578]: I0611 18:54:07.043625 2578 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-55c5v\" (UniqueName: \"kubernetes.io/projected/2a3840a8-677f-4c1c-902b-0458e780e9b5-kube-api-access-55c5v\") on node \"ip-10-0-141-55.ec2.internal\" DevicePath \"\"" Jun 11 18:54:07.043728 ip-10-0-141-55 kubenswrapper[2578]: I0611 18:54:07.043647 2578 reconciler_common.go:299] "Volume detached for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/2a3840a8-677f-4c1c-902b-0458e780e9b5-webhook-cert\") on node \"ip-10-0-141-55.ec2.internal\" DevicePath \"\"" Jun 11 18:54:07.838765 ip-10-0-141-55 kubenswrapper[2578]: I0611 18:54:07.838726 2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/maas-controller-758d4854d9-2vhk9"] Jun 11 18:54:07.839150 ip-10-0-141-55 kubenswrapper[2578]: I0611 18:54:07.839132 2578 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="b40073af-0dbb-4d58-b8d1-1f18dcdb7c8e" containerName="authorino" Jun 11 18:54:07.839150 ip-10-0-141-55 kubenswrapper[2578]: I0611 18:54:07.839144 2578 state_mem.go:107] "Deleted CPUSet assignment" podUID="b40073af-0dbb-4d58-b8d1-1f18dcdb7c8e" containerName="authorino" Jun 11 18:54:07.839223 ip-10-0-141-55 kubenswrapper[2578]: I0611 18:54:07.839161 2578 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="2a3840a8-677f-4c1c-902b-0458e780e9b5" containerName="manager" Jun 11 18:54:07.839223 ip-10-0-141-55 kubenswrapper[2578]: I0611 18:54:07.839167 2578 state_mem.go:107] "Deleted CPUSet assignment" podUID="2a3840a8-677f-4c1c-902b-0458e780e9b5" containerName="manager" Jun 11 18:54:07.839287 ip-10-0-141-55 kubenswrapper[2578]: I0611 18:54:07.839225 2578 memory_manager.go:368] "RemoveStaleState removing state" podUID="2a3840a8-677f-4c1c-902b-0458e780e9b5" containerName="manager" Jun 11 18:54:07.839287 ip-10-0-141-55 kubenswrapper[2578]: I0611 18:54:07.839234 2578 memory_manager.go:368] "RemoveStaleState removing state" podUID="b40073af-0dbb-4d58-b8d1-1f18dcdb7c8e" containerName="authorino" Jun 11 18:54:07.843584 ip-10-0-141-55 kubenswrapper[2578]: I0611 18:54:07.843547 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-758d4854d9-2vhk9" Jun 11 18:54:07.847822 ip-10-0-141-55 kubenswrapper[2578]: I0611 18:54:07.847792 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"maas-parameters\"" Jun 11 18:54:07.847822 ip-10-0-141-55 kubenswrapper[2578]: I0611 18:54:07.847801 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-controller-dockercfg-wh8tx\"" Jun 11 18:54:07.847822 ip-10-0-141-55 kubenswrapper[2578]: I0611 18:54:07.847816 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-controller-webhook-cert\"" Jun 11 18:54:07.849345 ip-10-0-141-55 kubenswrapper[2578]: I0611 18:54:07.849321 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/f22e9c48-5261-4919-a695-b065cd64e0b8-webhook-cert\") pod \"maas-controller-758d4854d9-2vhk9\" (UID: \"f22e9c48-5261-4919-a695-b065cd64e0b8\") " pod="opendatahub/maas-controller-758d4854d9-2vhk9" Jun 11 18:54:07.849463 ip-10-0-141-55 kubenswrapper[2578]: I0611 18:54:07.849432 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4pmwb\" (UniqueName: \"kubernetes.io/projected/f22e9c48-5261-4919-a695-b065cd64e0b8-kube-api-access-4pmwb\") pod \"maas-controller-758d4854d9-2vhk9\" (UID: \"f22e9c48-5261-4919-a695-b065cd64e0b8\") " pod="opendatahub/maas-controller-758d4854d9-2vhk9" Jun 11 18:54:07.853323 ip-10-0-141-55 kubenswrapper[2578]: I0611 18:54:07.853301 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-758d4854d9-2vhk9"] Jun 11 18:54:07.950538 ip-10-0-141-55 kubenswrapper[2578]: I0611 18:54:07.950497 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4pmwb\" (UniqueName: \"kubernetes.io/projected/f22e9c48-5261-4919-a695-b065cd64e0b8-kube-api-access-4pmwb\") pod \"maas-controller-758d4854d9-2vhk9\" (UID: \"f22e9c48-5261-4919-a695-b065cd64e0b8\") " pod="opendatahub/maas-controller-758d4854d9-2vhk9" Jun 11 18:54:07.950755 ip-10-0-141-55 kubenswrapper[2578]: I0611 18:54:07.950599 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/f22e9c48-5261-4919-a695-b065cd64e0b8-webhook-cert\") pod \"maas-controller-758d4854d9-2vhk9\" (UID: \"f22e9c48-5261-4919-a695-b065cd64e0b8\") " pod="opendatahub/maas-controller-758d4854d9-2vhk9" Jun 11 18:54:07.952974 ip-10-0-141-55 kubenswrapper[2578]: I0611 18:54:07.952948 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/f22e9c48-5261-4919-a695-b065cd64e0b8-webhook-cert\") pod \"maas-controller-758d4854d9-2vhk9\" (UID: \"f22e9c48-5261-4919-a695-b065cd64e0b8\") " pod="opendatahub/maas-controller-758d4854d9-2vhk9" Jun 11 18:54:07.958287 ip-10-0-141-55 kubenswrapper[2578]: I0611 18:54:07.958263 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-4pmwb\" (UniqueName: \"kubernetes.io/projected/f22e9c48-5261-4919-a695-b065cd64e0b8-kube-api-access-4pmwb\") pod \"maas-controller-758d4854d9-2vhk9\" (UID: \"f22e9c48-5261-4919-a695-b065cd64e0b8\") " pod="opendatahub/maas-controller-758d4854d9-2vhk9" Jun 11 18:54:08.155298 ip-10-0-141-55 kubenswrapper[2578]: I0611 18:54:08.155264 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-758d4854d9-2vhk9" Jun 11 18:54:08.287002 ip-10-0-141-55 kubenswrapper[2578]: I0611 18:54:08.286973 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-758d4854d9-2vhk9"] Jun 11 18:54:08.287944 ip-10-0-141-55 kubenswrapper[2578]: W0611 18:54:08.287909 2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf22e9c48_5261_4919_a695_b065cd64e0b8.slice/crio-c238a82b0107a83e33a9c386a881ddcdf04154768fab27c46bfb347c71143c5f WatchSource:0}: Error finding container c238a82b0107a83e33a9c386a881ddcdf04154768fab27c46bfb347c71143c5f: Status 404 returned error can't find the container with id c238a82b0107a83e33a9c386a881ddcdf04154768fab27c46bfb347c71143c5f Jun 11 18:54:08.422570 ip-10-0-141-55 kubenswrapper[2578]: I0611 18:54:08.422482 2578 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="2a3840a8-677f-4c1c-902b-0458e780e9b5" path="/var/lib/kubelet/pods/2a3840a8-677f-4c1c-902b-0458e780e9b5/volumes" Jun 11 18:54:09.011966 ip-10-0-141-55 kubenswrapper[2578]: I0611 18:54:09.011877 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-758d4854d9-2vhk9" event={"ID":"f22e9c48-5261-4919-a695-b065cd64e0b8","Type":"ContainerStarted","Data":"bdbd0ffbf7d9b3b9387650860d59b68b01cb97d2f648a19659842e79e9db3759"} Jun 11 18:54:09.011966 ip-10-0-141-55 kubenswrapper[2578]: I0611 18:54:09.011930 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-758d4854d9-2vhk9" event={"ID":"f22e9c48-5261-4919-a695-b065cd64e0b8","Type":"ContainerStarted","Data":"c238a82b0107a83e33a9c386a881ddcdf04154768fab27c46bfb347c71143c5f"} Jun 11 18:54:09.011966 ip-10-0-141-55 kubenswrapper[2578]: I0611 18:54:09.011953 2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/maas-controller-758d4854d9-2vhk9" Jun 11 18:54:09.029244 ip-10-0-141-55 kubenswrapper[2578]: I0611 18:54:09.029195 2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/maas-controller-758d4854d9-2vhk9" podStartSLOduration=1.5602600180000001 podStartE2EDuration="2.02917052s" totalImagesPullingTime="468.910502ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-11 18:54:07 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-11 18:54:09.027497731 +0000 UTC m=+1054.982172337" watchObservedRunningTime="2026-06-11 18:54:09.02917052 +0000 UTC m=+1054.983845139" Jun 11 18:54:20.023159 ip-10-0-141-55 kubenswrapper[2578]: I0611 18:54:20.023084 2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/maas-controller-758d4854d9-2vhk9" Jun 11 18:56:34.500960 ip-10-0-141-55 kubenswrapper[2578]: I0611 18:56:34.500929 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-machine-config-operator_kube-rbac-proxy-crio-ip-10-0-141-55.ec2.internal_a7e51dec29aa10b42d4127d190b80186/kube-rbac-proxy-crio/0.log" Jun 11 18:56:34.504164 ip-10-0-141-55 kubenswrapper[2578]: I0611 18:56:34.504142 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-machine-config-operator_kube-rbac-proxy-crio-ip-10-0-141-55.ec2.internal_a7e51dec29aa10b42d4127d190b80186/kube-rbac-proxy-crio/0.log" Jun 11 19:01:34.542178 ip-10-0-141-55 kubenswrapper[2578]: I0611 19:01:34.542148 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-machine-config-operator_kube-rbac-proxy-crio-ip-10-0-141-55.ec2.internal_a7e51dec29aa10b42d4127d190b80186/kube-rbac-proxy-crio/0.log" Jun 11 19:01:34.547695 ip-10-0-141-55 kubenswrapper[2578]: I0611 19:01:34.547671 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-machine-config-operator_kube-rbac-proxy-crio-ip-10-0-141-55.ec2.internal_a7e51dec29aa10b42d4127d190b80186/kube-rbac-proxy-crio/0.log" Jun 11 19:04:11.828604 ip-10-0-141-55 kubenswrapper[2578]: I0611 19:04:11.828565 2578 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-86878c769f-r6dkr"] Jun 11 19:04:11.830969 ip-10-0-141-55 kubenswrapper[2578]: I0611 19:04:11.828820 2578 kuberuntime_container.go:872] "Killing container with a grace period" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-r6dkr" podUID="6b3e7e16-3ceb-4029-93ee-e9cbf68ce171" containerName="manager" containerID="cri-o://635c2aa8c7b5835f211233dca2689ac97c15336384d5a9e6d73420934955a393" gracePeriod=10 Jun 11 19:04:12.081515 ip-10-0-141-55 kubenswrapper[2578]: I0611 19:04:12.081459 2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-r6dkr" Jun 11 19:04:12.129518 ip-10-0-141-55 kubenswrapper[2578]: I0611 19:04:12.129484 2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/6b3e7e16-3ceb-4029-93ee-e9cbf68ce171-extensions-socket-volume\") pod \"6b3e7e16-3ceb-4029-93ee-e9cbf68ce171\" (UID: \"6b3e7e16-3ceb-4029-93ee-e9cbf68ce171\") " Jun 11 19:04:12.129696 ip-10-0-141-55 kubenswrapper[2578]: I0611 19:04:12.129624 2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-pvv9x\" (UniqueName: \"kubernetes.io/projected/6b3e7e16-3ceb-4029-93ee-e9cbf68ce171-kube-api-access-pvv9x\") pod \"6b3e7e16-3ceb-4029-93ee-e9cbf68ce171\" (UID: \"6b3e7e16-3ceb-4029-93ee-e9cbf68ce171\") " Jun 11 19:04:12.129988 ip-10-0-141-55 kubenswrapper[2578]: I0611 19:04:12.129958 2578 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/6b3e7e16-3ceb-4029-93ee-e9cbf68ce171-extensions-socket-volume" (OuterVolumeSpecName: "extensions-socket-volume") pod "6b3e7e16-3ceb-4029-93ee-e9cbf68ce171" (UID: "6b3e7e16-3ceb-4029-93ee-e9cbf68ce171"). InnerVolumeSpecName "extensions-socket-volume". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 11 19:04:12.131611 ip-10-0-141-55 kubenswrapper[2578]: I0611 19:04:12.131586 2578 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/6b3e7e16-3ceb-4029-93ee-e9cbf68ce171-kube-api-access-pvv9x" (OuterVolumeSpecName: "kube-api-access-pvv9x") pod "6b3e7e16-3ceb-4029-93ee-e9cbf68ce171" (UID: "6b3e7e16-3ceb-4029-93ee-e9cbf68ce171"). InnerVolumeSpecName "kube-api-access-pvv9x". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 11 19:04:12.230877 ip-10-0-141-55 kubenswrapper[2578]: I0611 19:04:12.230844 2578 reconciler_common.go:299] "Volume detached for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/6b3e7e16-3ceb-4029-93ee-e9cbf68ce171-extensions-socket-volume\") on node \"ip-10-0-141-55.ec2.internal\" DevicePath \"\"" Jun 11 19:04:12.230877 ip-10-0-141-55 kubenswrapper[2578]: I0611 19:04:12.230870 2578 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-pvv9x\" (UniqueName: \"kubernetes.io/projected/6b3e7e16-3ceb-4029-93ee-e9cbf68ce171-kube-api-access-pvv9x\") on node \"ip-10-0-141-55.ec2.internal\" DevicePath \"\"" Jun 11 19:04:12.376910 ip-10-0-141-55 kubenswrapper[2578]: I0611 19:04:12.376881 2578 generic.go:356] "Generic (PLEG): container finished" podID="6b3e7e16-3ceb-4029-93ee-e9cbf68ce171" containerID="635c2aa8c7b5835f211233dca2689ac97c15336384d5a9e6d73420934955a393" exitCode=0 Jun 11 19:04:12.377082 ip-10-0-141-55 kubenswrapper[2578]: I0611 19:04:12.376931 2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-r6dkr" Jun 11 19:04:12.377082 ip-10-0-141-55 kubenswrapper[2578]: I0611 19:04:12.376956 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-r6dkr" event={"ID":"6b3e7e16-3ceb-4029-93ee-e9cbf68ce171","Type":"ContainerDied","Data":"635c2aa8c7b5835f211233dca2689ac97c15336384d5a9e6d73420934955a393"} Jun 11 19:04:12.377082 ip-10-0-141-55 kubenswrapper[2578]: I0611 19:04:12.377021 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-r6dkr" event={"ID":"6b3e7e16-3ceb-4029-93ee-e9cbf68ce171","Type":"ContainerDied","Data":"a75c8b44e9219ef53bcea8afd914f84721e4f5705f5f98125d062bfee10e2482"} Jun 11 19:04:12.377082 ip-10-0-141-55 kubenswrapper[2578]: I0611 19:04:12.377043 2578 scope.go:117] "RemoveContainer" containerID="635c2aa8c7b5835f211233dca2689ac97c15336384d5a9e6d73420934955a393" Jun 11 19:04:12.386547 ip-10-0-141-55 kubenswrapper[2578]: I0611 19:04:12.386531 2578 scope.go:117] "RemoveContainer" containerID="635c2aa8c7b5835f211233dca2689ac97c15336384d5a9e6d73420934955a393" Jun 11 19:04:12.386800 ip-10-0-141-55 kubenswrapper[2578]: E0611 19:04:12.386782 2578 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"635c2aa8c7b5835f211233dca2689ac97c15336384d5a9e6d73420934955a393\": container with ID starting with 635c2aa8c7b5835f211233dca2689ac97c15336384d5a9e6d73420934955a393 not found: ID does not exist" containerID="635c2aa8c7b5835f211233dca2689ac97c15336384d5a9e6d73420934955a393" Jun 11 19:04:12.386844 ip-10-0-141-55 kubenswrapper[2578]: I0611 19:04:12.386810 2578 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"635c2aa8c7b5835f211233dca2689ac97c15336384d5a9e6d73420934955a393"} err="failed to get container status \"635c2aa8c7b5835f211233dca2689ac97c15336384d5a9e6d73420934955a393\": rpc error: code = NotFound desc = could not find container \"635c2aa8c7b5835f211233dca2689ac97c15336384d5a9e6d73420934955a393\": container with ID starting with 635c2aa8c7b5835f211233dca2689ac97c15336384d5a9e6d73420934955a393 not found: ID does not exist" Jun 11 19:04:12.399451 ip-10-0-141-55 kubenswrapper[2578]: I0611 19:04:12.399428 2578 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-86878c769f-r6dkr"] Jun 11 19:04:12.403541 ip-10-0-141-55 kubenswrapper[2578]: I0611 19:04:12.403515 2578 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-86878c769f-r6dkr"] Jun 11 19:04:12.422286 ip-10-0-141-55 kubenswrapper[2578]: I0611 19:04:12.422265 2578 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="6b3e7e16-3ceb-4029-93ee-e9cbf68ce171" path="/var/lib/kubelet/pods/6b3e7e16-3ceb-4029-93ee-e9cbf68ce171/volumes" Jun 11 19:06:34.585065 ip-10-0-141-55 kubenswrapper[2578]: I0611 19:06:34.585036 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-machine-config-operator_kube-rbac-proxy-crio-ip-10-0-141-55.ec2.internal_a7e51dec29aa10b42d4127d190b80186/kube-rbac-proxy-crio/0.log" Jun 11 19:06:34.591137 ip-10-0-141-55 kubenswrapper[2578]: I0611 19:06:34.591114 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-machine-config-operator_kube-rbac-proxy-crio-ip-10-0-141-55.ec2.internal_a7e51dec29aa10b42d4127d190b80186/kube-rbac-proxy-crio/0.log" Jun 11 19:11:34.622758 ip-10-0-141-55 kubenswrapper[2578]: I0611 19:11:34.622730 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-machine-config-operator_kube-rbac-proxy-crio-ip-10-0-141-55.ec2.internal_a7e51dec29aa10b42d4127d190b80186/kube-rbac-proxy-crio/0.log" Jun 11 19:11:34.631701 ip-10-0-141-55 kubenswrapper[2578]: I0611 19:11:34.631678 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-machine-config-operator_kube-rbac-proxy-crio-ip-10-0-141-55.ec2.internal_a7e51dec29aa10b42d4127d190b80186/kube-rbac-proxy-crio/0.log" Jun 11 19:15:12.326334 ip-10-0-141-55 kubenswrapper[2578]: I0611 19:15:12.326302 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-fcd8df8cd-lrvl8_8e5fca77-a46e-43c9-bb4e-84723e09d6c0/authorino/0.log" Jun 11 19:15:17.433397 ip-10-0-141-55 kubenswrapper[2578]: I0611 19:15:17.433313 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_dashboard-redirect-78fd5d586f-cg4dx_9be949e1-93c3-496c-8b74-35e870ec6390/nginx/0.log" Jun 11 19:15:17.936190 ip-10-0-141-55 kubenswrapper[2578]: I0611 19:15:17.936161 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_maas-api-5fbdd69b95-9z84h_32e782da-c0d3-48a5-b102-ae25c55c6ba7/maas-api/0.log" Jun 11 19:15:18.327728 ip-10-0-141-55 kubenswrapper[2578]: I0611 19:15:18.327648 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_maas-controller-758d4854d9-2vhk9_f22e9c48-5261-4919-a695-b065cd64e0b8/manager/0.log" Jun 11 19:15:18.872578 ip-10-0-141-55 kubenswrapper[2578]: I0611 19:15:18.872526 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-54d5cbc44f-ttbpm_b0ce062c-09e7-4207-a0d6-f703e6ec7df1/copy-manifests/0.log" Jun 11 19:15:18.886718 ip-10-0-141-55 kubenswrapper[2578]: I0611 19:15:18.886690 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-54d5cbc44f-ttbpm_b0ce062c-09e7-4207-a0d6-f703e6ec7df1/manager/0.log" Jun 11 19:15:19.987270 ip-10-0-141-55 kubenswrapper[2578]: I0611 19:15:19.987237 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759g8tx8_f5edd135-d5c9-491d-927e-f4b0e470cc8e/util/0.log" Jun 11 19:15:20.000153 ip-10-0-141-55 kubenswrapper[2578]: I0611 19:15:20.000124 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759g8tx8_f5edd135-d5c9-491d-927e-f4b0e470cc8e/pull/0.log" Jun 11 19:15:20.007736 ip-10-0-141-55 kubenswrapper[2578]: I0611 19:15:20.007694 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759g8tx8_f5edd135-d5c9-491d-927e-f4b0e470cc8e/extract/0.log" Jun 11 19:15:20.134244 ip-10-0-141-55 kubenswrapper[2578]: I0611 19:15:20.134218 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0bnhll_b13ea5a7-e0a4-4e89-9334-14d43479be6c/util/0.log" Jun 11 19:15:20.149508 ip-10-0-141-55 kubenswrapper[2578]: I0611 19:15:20.149481 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0bnhll_b13ea5a7-e0a4-4e89-9334-14d43479be6c/pull/0.log" Jun 11 19:15:20.157914 ip-10-0-141-55 kubenswrapper[2578]: I0611 19:15:20.157898 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0bnhll_b13ea5a7-e0a4-4e89-9334-14d43479be6c/extract/0.log" Jun 11 19:15:20.282669 ip-10-0-141-55 kubenswrapper[2578]: I0611 19:15:20.282597 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73qt599_8e28f713-1aee-425d-990d-dd7fe5f647d2/util/0.log" Jun 11 19:15:20.292396 ip-10-0-141-55 kubenswrapper[2578]: I0611 19:15:20.292375 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73qt599_8e28f713-1aee-425d-990d-dd7fe5f647d2/pull/0.log" Jun 11 19:15:20.301666 ip-10-0-141-55 kubenswrapper[2578]: I0611 19:15:20.301648 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73qt599_8e28f713-1aee-425d-990d-dd7fe5f647d2/extract/0.log" Jun 11 19:15:20.429537 ip-10-0-141-55 kubenswrapper[2578]: I0611 19:15:20.429510 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1w9pgw_b1b597f0-6693-4514-9cd6-464df054726c/util/0.log" Jun 11 19:15:20.442993 ip-10-0-141-55 kubenswrapper[2578]: I0611 19:15:20.442972 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1w9pgw_b1b597f0-6693-4514-9cd6-464df054726c/pull/0.log" Jun 11 19:15:20.456767 ip-10-0-141-55 kubenswrapper[2578]: I0611 19:15:20.456746 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1w9pgw_b1b597f0-6693-4514-9cd6-464df054726c/extract/0.log" Jun 11 19:15:20.591979 ip-10-0-141-55 kubenswrapper[2578]: I0611 19:15:20.591899 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-fcd8df8cd-lrvl8_8e5fca77-a46e-43c9-bb4e-84723e09d6c0/authorino/0.log" Jun 11 19:15:21.008689 ip-10-0-141-55 kubenswrapper[2578]: I0611 19:15:21.008661 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-console-plugin-66b5774985-898xf_f18861ba-f841-41cc-8089-ce4e585910a0/kuadrant-console-plugin/0.log" Jun 11 19:15:22.339703 ip-10-0-141-55 kubenswrapper[2578]: I0611 19:15:22.339677 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-8d878499b-k8tfk_c4e1c6dc-8b90-4c4b-9894-fa0dea9de119/kube-auth-proxy/0.log" Jun 11 19:15:22.596705 ip-10-0-141-55 kubenswrapper[2578]: I0611 19:15:22.596677 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-pre-processing-579785bc64-97648_f92bab33-828e-44db-a9ff-5cab420fd035/payload-pre-processing/0.log" Jun 11 19:15:23.259906 ip-10-0-141-55 kubenswrapper[2578]: I0611 19:15:23.259858 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-distinct-2-simulated-kserve-f5c55bdc-d5hwx_d93bb87b-4abd-402b-903b-9d6eaeabffe0/storage-initializer/0.log" Jun 11 19:15:23.527889 ip-10-0-141-55 kubenswrapper[2578]: I0611 19:15:23.527814 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-trlp-test-simulated-kserve-68bb6c58d9-6nmdv_eb0459ff-8f40-403d-aba4-b96b55b04cea/storage-initializer/0.log" Jun 11 19:15:23.536430 ip-10-0-141-55 kubenswrapper[2578]: I0611 19:15:23.536406 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-trlp-test-simulated-kserve-68bb6c58d9-6nmdv_eb0459ff-8f40-403d-aba4-b96b55b04cea/main/0.log" Jun 11 19:15:23.673573 ip-10-0-141-55 kubenswrapper[2578]: I0611 19:15:23.673537 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477cr4mz7_f4253fdb-d63f-4008-9767-bcb4fb110a34/storage-initializer/0.log" Jun 11 19:15:23.688292 ip-10-0-141-55 kubenswrapper[2578]: I0611 19:15:23.688270 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477cr4mz7_f4253fdb-d63f-4008-9767-bcb4fb110a34/main/0.log" Jun 11 19:15:32.680306 ip-10-0-141-55 kubenswrapper[2578]: I0611 19:15:32.680270 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_global-pull-secret-syncer-lvmjk_1261112f-ce68-462a-a73e-fa1942159096/global-pull-secret-syncer/0.log" Jun 11 19:15:32.932818 ip-10-0-141-55 kubenswrapper[2578]: I0611 19:15:32.932734 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_konnectivity-agent-ffv42_0cc2bcd7-3d68-4ebb-9ab5-4529e5485a69/konnectivity-agent/0.log" Jun 11 19:15:33.170904 ip-10-0-141-55 kubenswrapper[2578]: I0611 19:15:33.170870 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_kube-apiserver-proxy-ip-10-0-141-55.ec2.internal_668e0dfb5ee3fc6875806e2b3acb31d7/haproxy/0.log" Jun 11 19:15:37.152003 ip-10-0-141-55 kubenswrapper[2578]: I0611 19:15:37.151974 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759g8tx8_f5edd135-d5c9-491d-927e-f4b0e470cc8e/extract/0.log" Jun 11 19:15:37.205483 ip-10-0-141-55 kubenswrapper[2578]: I0611 19:15:37.205457 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759g8tx8_f5edd135-d5c9-491d-927e-f4b0e470cc8e/util/0.log" Jun 11 19:15:37.248619 ip-10-0-141-55 kubenswrapper[2578]: I0611 19:15:37.248593 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759g8tx8_f5edd135-d5c9-491d-927e-f4b0e470cc8e/pull/0.log" Jun 11 19:15:37.306826 ip-10-0-141-55 kubenswrapper[2578]: I0611 19:15:37.306800 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0bnhll_b13ea5a7-e0a4-4e89-9334-14d43479be6c/extract/0.log" Jun 11 19:15:37.345406 ip-10-0-141-55 kubenswrapper[2578]: I0611 19:15:37.345379 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0bnhll_b13ea5a7-e0a4-4e89-9334-14d43479be6c/util/0.log" Jun 11 19:15:37.375219 ip-10-0-141-55 kubenswrapper[2578]: I0611 19:15:37.375192 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0bnhll_b13ea5a7-e0a4-4e89-9334-14d43479be6c/pull/0.log" Jun 11 19:15:37.437663 ip-10-0-141-55 kubenswrapper[2578]: I0611 19:15:37.437589 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73qt599_8e28f713-1aee-425d-990d-dd7fe5f647d2/extract/0.log" Jun 11 19:15:37.458447 ip-10-0-141-55 kubenswrapper[2578]: I0611 19:15:37.458424 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73qt599_8e28f713-1aee-425d-990d-dd7fe5f647d2/util/0.log" Jun 11 19:15:37.488278 ip-10-0-141-55 kubenswrapper[2578]: I0611 19:15:37.488255 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73qt599_8e28f713-1aee-425d-990d-dd7fe5f647d2/pull/0.log" Jun 11 19:15:37.557046 ip-10-0-141-55 kubenswrapper[2578]: I0611 19:15:37.557022 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1w9pgw_b1b597f0-6693-4514-9cd6-464df054726c/extract/0.log" Jun 11 19:15:37.594220 ip-10-0-141-55 kubenswrapper[2578]: I0611 19:15:37.594197 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1w9pgw_b1b597f0-6693-4514-9cd6-464df054726c/util/0.log" Jun 11 19:15:37.626513 ip-10-0-141-55 kubenswrapper[2578]: I0611 19:15:37.626490 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1w9pgw_b1b597f0-6693-4514-9cd6-464df054726c/pull/0.log" Jun 11 19:15:37.851429 ip-10-0-141-55 kubenswrapper[2578]: I0611 19:15:37.851403 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-fcd8df8cd-lrvl8_8e5fca77-a46e-43c9-bb4e-84723e09d6c0/authorino/0.log" Jun 11 19:15:37.958570 ip-10-0-141-55 kubenswrapper[2578]: I0611 19:15:37.958527 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-console-plugin-66b5774985-898xf_f18861ba-f841-41cc-8089-ce4e585910a0/kuadrant-console-plugin/0.log" Jun 11 19:15:39.789962 ip-10-0-141-55 kubenswrapper[2578]: I0611 19:15:39.789925 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_214e4501-6a30-4593-9a84-8cc0f0fe6a21/alertmanager/0.log" Jun 11 19:15:39.845633 ip-10-0-141-55 kubenswrapper[2578]: I0611 19:15:39.845598 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_214e4501-6a30-4593-9a84-8cc0f0fe6a21/config-reloader/0.log" Jun 11 19:15:39.911319 ip-10-0-141-55 kubenswrapper[2578]: I0611 19:15:39.911289 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_214e4501-6a30-4593-9a84-8cc0f0fe6a21/kube-rbac-proxy-web/0.log" Jun 11 19:15:39.947084 ip-10-0-141-55 kubenswrapper[2578]: I0611 19:15:39.947053 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_214e4501-6a30-4593-9a84-8cc0f0fe6a21/kube-rbac-proxy/0.log" Jun 11 19:15:40.001131 ip-10-0-141-55 kubenswrapper[2578]: I0611 19:15:40.001109 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_214e4501-6a30-4593-9a84-8cc0f0fe6a21/kube-rbac-proxy-metric/0.log" Jun 11 19:15:40.050159 ip-10-0-141-55 kubenswrapper[2578]: I0611 19:15:40.050092 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_214e4501-6a30-4593-9a84-8cc0f0fe6a21/prom-label-proxy/0.log" Jun 11 19:15:40.092872 ip-10-0-141-55 kubenswrapper[2578]: I0611 19:15:40.092843 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_214e4501-6a30-4593-9a84-8cc0f0fe6a21/init-config-reloader/0.log" Jun 11 19:15:40.685226 ip-10-0-141-55 kubenswrapper[2578]: I0611 19:15:40.685151 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-fxcnz_8e255ea1-3909-4ec6-9fe2-e88d89db28a2/node-exporter/0.log" Jun 11 19:15:40.753646 ip-10-0-141-55 kubenswrapper[2578]: I0611 19:15:40.753621 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-fxcnz_8e255ea1-3909-4ec6-9fe2-e88d89db28a2/kube-rbac-proxy/0.log" Jun 11 19:15:40.830516 ip-10-0-141-55 kubenswrapper[2578]: I0611 19:15:40.830490 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-fxcnz_8e255ea1-3909-4ec6-9fe2-e88d89db28a2/init-textfile/0.log" Jun 11 19:15:41.420449 ip-10-0-141-55 kubenswrapper[2578]: I0611 19:15:41.420371 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-operator-864fcfc6f9-nnbkp_e04c3379-71cd-4cb1-aec0-0f708f2ebf54/prometheus-operator/0.log" Jun 11 19:15:41.473470 ip-10-0-141-55 kubenswrapper[2578]: I0611 19:15:41.473442 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-operator-864fcfc6f9-nnbkp_e04c3379-71cd-4cb1-aec0-0f708f2ebf54/kube-rbac-proxy/0.log" Jun 11 19:15:41.585604 ip-10-0-141-55 kubenswrapper[2578]: I0611 19:15:41.585576 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_telemeter-client-567cb5cd6-2rxfr_da96e762-324d-459a-a284-f17631f4fa24/telemeter-client/0.log" Jun 11 19:15:41.638365 ip-10-0-141-55 kubenswrapper[2578]: I0611 19:15:41.638337 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_telemeter-client-567cb5cd6-2rxfr_da96e762-324d-459a-a284-f17631f4fa24/reload/0.log" Jun 11 19:15:41.692406 ip-10-0-141-55 kubenswrapper[2578]: I0611 19:15:41.692341 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_telemeter-client-567cb5cd6-2rxfr_da96e762-324d-459a-a284-f17631f4fa24/kube-rbac-proxy/0.log" Jun 11 19:15:41.745406 ip-10-0-141-55 kubenswrapper[2578]: I0611 19:15:41.745383 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-bcb865f69-qv4v2_c3bd3e23-7aab-4949-b28b-2e4d00c32c5c/thanos-query/0.log" Jun 11 19:15:41.791509 ip-10-0-141-55 kubenswrapper[2578]: I0611 19:15:41.791469 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-bcb865f69-qv4v2_c3bd3e23-7aab-4949-b28b-2e4d00c32c5c/kube-rbac-proxy-web/0.log" Jun 11 19:15:41.831377 ip-10-0-141-55 kubenswrapper[2578]: I0611 19:15:41.831354 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-bcb865f69-qv4v2_c3bd3e23-7aab-4949-b28b-2e4d00c32c5c/kube-rbac-proxy/0.log" Jun 11 19:15:41.870338 ip-10-0-141-55 kubenswrapper[2578]: I0611 19:15:41.870313 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-bcb865f69-qv4v2_c3bd3e23-7aab-4949-b28b-2e4d00c32c5c/prom-label-proxy/0.log" Jun 11 19:15:41.905689 ip-10-0-141-55 kubenswrapper[2578]: I0611 19:15:41.905663 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-bcb865f69-qv4v2_c3bd3e23-7aab-4949-b28b-2e4d00c32c5c/kube-rbac-proxy-rules/0.log" Jun 11 19:15:41.934429 ip-10-0-141-55 kubenswrapper[2578]: I0611 19:15:41.934409 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-bcb865f69-qv4v2_c3bd3e23-7aab-4949-b28b-2e4d00c32c5c/kube-rbac-proxy-metrics/0.log" Jun 11 19:15:44.447764 ip-10-0-141-55 kubenswrapper[2578]: I0611 19:15:44.447736 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console_console-76fb865d89-2szwd_37720503-e6f4-4926-bc3a-421c6bb2734f/console/0.log" Jun 11 19:15:44.523073 ip-10-0-141-55 kubenswrapper[2578]: I0611 19:15:44.523039 2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-must-gather-fwsb7/perf-node-gather-daemonset-bsjwj"] Jun 11 19:15:44.523495 ip-10-0-141-55 kubenswrapper[2578]: I0611 19:15:44.523479 2578 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="6b3e7e16-3ceb-4029-93ee-e9cbf68ce171" containerName="manager" Jun 11 19:15:44.523608 ip-10-0-141-55 kubenswrapper[2578]: I0611 19:15:44.523499 2578 state_mem.go:107] "Deleted CPUSet assignment" podUID="6b3e7e16-3ceb-4029-93ee-e9cbf68ce171" containerName="manager" Jun 11 19:15:44.523608 ip-10-0-141-55 kubenswrapper[2578]: I0611 19:15:44.523605 2578 memory_manager.go:368] "RemoveStaleState removing state" podUID="6b3e7e16-3ceb-4029-93ee-e9cbf68ce171" containerName="manager" Jun 11 19:15:44.526703 ip-10-0-141-55 kubenswrapper[2578]: I0611 19:15:44.526682 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-fwsb7/perf-node-gather-daemonset-bsjwj" Jun 11 19:15:44.529449 ip-10-0-141-55 kubenswrapper[2578]: I0611 19:15:44.529426 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-fwsb7\"/\"kube-root-ca.crt\"" Jun 11 19:15:44.530764 ip-10-0-141-55 kubenswrapper[2578]: I0611 19:15:44.530745 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-must-gather-fwsb7\"/\"default-dockercfg-74dfg\"" Jun 11 19:15:44.530894 ip-10-0-141-55 kubenswrapper[2578]: I0611 19:15:44.530781 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-fwsb7\"/\"openshift-service-ca.crt\"" Jun 11 19:15:44.535509 ip-10-0-141-55 kubenswrapper[2578]: I0611 19:15:44.535488 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-fwsb7/perf-node-gather-daemonset-bsjwj"] Jun 11 19:15:44.565846 ip-10-0-141-55 kubenswrapper[2578]: I0611 19:15:44.565816 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/7e097200-b4bb-4bc9-88cb-0680e486a110-sys\") pod \"perf-node-gather-daemonset-bsjwj\" (UID: \"7e097200-b4bb-4bc9-88cb-0680e486a110\") " pod="openshift-must-gather-fwsb7/perf-node-gather-daemonset-bsjwj" Jun 11 19:15:44.565993 ip-10-0-141-55 kubenswrapper[2578]: I0611 19:15:44.565892 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/7e097200-b4bb-4bc9-88cb-0680e486a110-proc\") pod \"perf-node-gather-daemonset-bsjwj\" (UID: \"7e097200-b4bb-4bc9-88cb-0680e486a110\") " pod="openshift-must-gather-fwsb7/perf-node-gather-daemonset-bsjwj" Jun 11 19:15:44.565993 ip-10-0-141-55 kubenswrapper[2578]: I0611 19:15:44.565960 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/7e097200-b4bb-4bc9-88cb-0680e486a110-lib-modules\") pod \"perf-node-gather-daemonset-bsjwj\" (UID: \"7e097200-b4bb-4bc9-88cb-0680e486a110\") " pod="openshift-must-gather-fwsb7/perf-node-gather-daemonset-bsjwj" Jun 11 19:15:44.566082 ip-10-0-141-55 kubenswrapper[2578]: I0611 19:15:44.566011 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/7e097200-b4bb-4bc9-88cb-0680e486a110-podres\") pod \"perf-node-gather-daemonset-bsjwj\" (UID: \"7e097200-b4bb-4bc9-88cb-0680e486a110\") " pod="openshift-must-gather-fwsb7/perf-node-gather-daemonset-bsjwj" Jun 11 19:15:44.566082 ip-10-0-141-55 kubenswrapper[2578]: I0611 19:15:44.566076 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-525rs\" (UniqueName: \"kubernetes.io/projected/7e097200-b4bb-4bc9-88cb-0680e486a110-kube-api-access-525rs\") pod \"perf-node-gather-daemonset-bsjwj\" (UID: \"7e097200-b4bb-4bc9-88cb-0680e486a110\") " pod="openshift-must-gather-fwsb7/perf-node-gather-daemonset-bsjwj" Jun 11 19:15:44.667046 ip-10-0-141-55 kubenswrapper[2578]: I0611 19:15:44.667013 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/7e097200-b4bb-4bc9-88cb-0680e486a110-podres\") pod \"perf-node-gather-daemonset-bsjwj\" (UID: \"7e097200-b4bb-4bc9-88cb-0680e486a110\") " pod="openshift-must-gather-fwsb7/perf-node-gather-daemonset-bsjwj" Jun 11 19:15:44.667256 ip-10-0-141-55 kubenswrapper[2578]: I0611 19:15:44.667081 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-525rs\" (UniqueName: \"kubernetes.io/projected/7e097200-b4bb-4bc9-88cb-0680e486a110-kube-api-access-525rs\") pod \"perf-node-gather-daemonset-bsjwj\" (UID: \"7e097200-b4bb-4bc9-88cb-0680e486a110\") " pod="openshift-must-gather-fwsb7/perf-node-gather-daemonset-bsjwj" Jun 11 19:15:44.667256 ip-10-0-141-55 kubenswrapper[2578]: I0611 19:15:44.667112 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/7e097200-b4bb-4bc9-88cb-0680e486a110-sys\") pod \"perf-node-gather-daemonset-bsjwj\" (UID: \"7e097200-b4bb-4bc9-88cb-0680e486a110\") " pod="openshift-must-gather-fwsb7/perf-node-gather-daemonset-bsjwj" Jun 11 19:15:44.667256 ip-10-0-141-55 kubenswrapper[2578]: I0611 19:15:44.667132 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/7e097200-b4bb-4bc9-88cb-0680e486a110-proc\") pod \"perf-node-gather-daemonset-bsjwj\" (UID: \"7e097200-b4bb-4bc9-88cb-0680e486a110\") " pod="openshift-must-gather-fwsb7/perf-node-gather-daemonset-bsjwj" Jun 11 19:15:44.667256 ip-10-0-141-55 kubenswrapper[2578]: I0611 19:15:44.667202 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/7e097200-b4bb-4bc9-88cb-0680e486a110-sys\") pod \"perf-node-gather-daemonset-bsjwj\" (UID: \"7e097200-b4bb-4bc9-88cb-0680e486a110\") " pod="openshift-must-gather-fwsb7/perf-node-gather-daemonset-bsjwj" Jun 11 19:15:44.667256 ip-10-0-141-55 kubenswrapper[2578]: I0611 19:15:44.667215 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/7e097200-b4bb-4bc9-88cb-0680e486a110-podres\") pod \"perf-node-gather-daemonset-bsjwj\" (UID: \"7e097200-b4bb-4bc9-88cb-0680e486a110\") " pod="openshift-must-gather-fwsb7/perf-node-gather-daemonset-bsjwj" Jun 11 19:15:44.667256 ip-10-0-141-55 kubenswrapper[2578]: I0611 19:15:44.667249 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/7e097200-b4bb-4bc9-88cb-0680e486a110-lib-modules\") pod \"perf-node-gather-daemonset-bsjwj\" (UID: \"7e097200-b4bb-4bc9-88cb-0680e486a110\") " pod="openshift-must-gather-fwsb7/perf-node-gather-daemonset-bsjwj" Jun 11 19:15:44.667510 ip-10-0-141-55 kubenswrapper[2578]: I0611 19:15:44.667285 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/7e097200-b4bb-4bc9-88cb-0680e486a110-proc\") pod \"perf-node-gather-daemonset-bsjwj\" (UID: \"7e097200-b4bb-4bc9-88cb-0680e486a110\") " pod="openshift-must-gather-fwsb7/perf-node-gather-daemonset-bsjwj" Jun 11 19:15:44.667510 ip-10-0-141-55 kubenswrapper[2578]: I0611 19:15:44.667377 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/7e097200-b4bb-4bc9-88cb-0680e486a110-lib-modules\") pod \"perf-node-gather-daemonset-bsjwj\" (UID: \"7e097200-b4bb-4bc9-88cb-0680e486a110\") " pod="openshift-must-gather-fwsb7/perf-node-gather-daemonset-bsjwj" Jun 11 19:15:44.676827 ip-10-0-141-55 kubenswrapper[2578]: I0611 19:15:44.676806 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-525rs\" (UniqueName: \"kubernetes.io/projected/7e097200-b4bb-4bc9-88cb-0680e486a110-kube-api-access-525rs\") pod \"perf-node-gather-daemonset-bsjwj\" (UID: \"7e097200-b4bb-4bc9-88cb-0680e486a110\") " pod="openshift-must-gather-fwsb7/perf-node-gather-daemonset-bsjwj" Jun 11 19:15:44.838125 ip-10-0-141-55 kubenswrapper[2578]: I0611 19:15:44.838027 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-fwsb7/perf-node-gather-daemonset-bsjwj" Jun 11 19:15:44.969219 ip-10-0-141-55 kubenswrapper[2578]: I0611 19:15:44.969190 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-fwsb7/perf-node-gather-daemonset-bsjwj"] Jun 11 19:15:44.971264 ip-10-0-141-55 kubenswrapper[2578]: W0611 19:15:44.971239 2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-pod7e097200_b4bb_4bc9_88cb_0680e486a110.slice/crio-01655278e0fd4af69d539fe3f68ddebf5b661da2fc9080d4910fcf76dd5f4c31 WatchSource:0}: Error finding container 01655278e0fd4af69d539fe3f68ddebf5b661da2fc9080d4910fcf76dd5f4c31: Status 404 returned error can't find the container with id 01655278e0fd4af69d539fe3f68ddebf5b661da2fc9080d4910fcf76dd5f4c31 Jun 11 19:15:45.130921 ip-10-0-141-55 kubenswrapper[2578]: I0611 19:15:45.130883 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-fwsb7/perf-node-gather-daemonset-bsjwj" event={"ID":"7e097200-b4bb-4bc9-88cb-0680e486a110","Type":"ContainerStarted","Data":"9ff31b2ca1917e512fe269e3c110ff3e5c4a43c64a749326fdebebec3a3f012c"} Jun 11 19:15:45.131105 ip-10-0-141-55 kubenswrapper[2578]: I0611 19:15:45.130945 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-fwsb7/perf-node-gather-daemonset-bsjwj" event={"ID":"7e097200-b4bb-4bc9-88cb-0680e486a110","Type":"ContainerStarted","Data":"01655278e0fd4af69d539fe3f68ddebf5b661da2fc9080d4910fcf76dd5f4c31"} Jun 11 19:15:45.131105 ip-10-0-141-55 kubenswrapper[2578]: I0611 19:15:45.130991 2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-must-gather-fwsb7/perf-node-gather-daemonset-bsjwj" Jun 11 19:15:46.347268 ip-10-0-141-55 kubenswrapper[2578]: I0611 19:15:46.347244 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-ng7mz_a52171ba-7228-43ac-8a94-65e91fec2043/dns/0.log" Jun 11 19:15:46.382726 ip-10-0-141-55 kubenswrapper[2578]: I0611 19:15:46.382698 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-ng7mz_a52171ba-7228-43ac-8a94-65e91fec2043/kube-rbac-proxy/0.log" Jun 11 19:15:46.523087 ip-10-0-141-55 kubenswrapper[2578]: I0611 19:15:46.523056 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-m7sgm_e6233099-5000-4135-a876-b35ae68d8198/dns-node-resolver/0.log" Jun 11 19:15:47.312430 ip-10-0-141-55 kubenswrapper[2578]: I0611 19:15:47.312401 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-qc45v_2cc00ed7-ab6f-4086-ae9c-d5394da96541/node-ca/0.log" Jun 11 19:15:48.639485 ip-10-0-141-55 kubenswrapper[2578]: I0611 19:15:48.639456 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-8d878499b-k8tfk_c4e1c6dc-8b90-4c4b-9894-fa0dea9de119/kube-auth-proxy/0.log" Jun 11 19:15:48.792080 ip-10-0-141-55 kubenswrapper[2578]: I0611 19:15:48.792048 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-pre-processing-579785bc64-97648_f92bab33-828e-44db-a9ff-5cab420fd035/payload-pre-processing/0.log" Jun 11 19:15:49.718451 ip-10-0-141-55 kubenswrapper[2578]: I0611 19:15:49.718421 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-9vvns_21df7fc9-da9c-4882-917c-2e16d262dd11/serve-healthcheck-canary/0.log" Jun 11 19:15:50.489627 ip-10-0-141-55 kubenswrapper[2578]: I0611 19:15:50.489601 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-v8f8j_86d2dc5a-8200-4c9e-be7e-1cc5ed11905b/kube-rbac-proxy/0.log" Jun 11 19:15:50.512872 ip-10-0-141-55 kubenswrapper[2578]: I0611 19:15:50.512845 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-v8f8j_86d2dc5a-8200-4c9e-be7e-1cc5ed11905b/exporter/0.log" Jun 11 19:15:50.536682 ip-10-0-141-55 kubenswrapper[2578]: I0611 19:15:50.536663 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-v8f8j_86d2dc5a-8200-4c9e-be7e-1cc5ed11905b/extractor/0.log" Jun 11 19:15:51.146227 ip-10-0-141-55 kubenswrapper[2578]: I0611 19:15:51.146199 2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-must-gather-fwsb7/perf-node-gather-daemonset-bsjwj" Jun 11 19:15:51.165793 ip-10-0-141-55 kubenswrapper[2578]: I0611 19:15:51.165745 2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-must-gather-fwsb7/perf-node-gather-daemonset-bsjwj" podStartSLOduration=7.165732587 podStartE2EDuration="7.165732587s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-11 19:15:44 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-11 19:15:45.146755507 +0000 UTC m=+2351.101430114" watchObservedRunningTime="2026-06-11 19:15:51.165732587 +0000 UTC m=+2357.120407192" Jun 11 19:15:52.924013 ip-10-0-141-55 kubenswrapper[2578]: I0611 19:15:52.923985 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_dashboard-redirect-78fd5d586f-cg4dx_9be949e1-93c3-496c-8b74-35e870ec6390/nginx/0.log" Jun 11 19:15:53.165840 ip-10-0-141-55 kubenswrapper[2578]: I0611 19:15:53.165806 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_maas-api-5fbdd69b95-9z84h_32e782da-c0d3-48a5-b102-ae25c55c6ba7/maas-api/0.log" Jun 11 19:15:53.305026 ip-10-0-141-55 kubenswrapper[2578]: I0611 19:15:53.304941 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_maas-controller-758d4854d9-2vhk9_f22e9c48-5261-4919-a695-b065cd64e0b8/manager/0.log" Jun 11 19:15:53.559430 ip-10-0-141-55 kubenswrapper[2578]: I0611 19:15:53.559353 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-54d5cbc44f-ttbpm_b0ce062c-09e7-4207-a0d6-f703e6ec7df1/manager/0.log" Jun 11 19:15:53.577948 ip-10-0-141-55 kubenswrapper[2578]: I0611 19:15:53.577921 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-54d5cbc44f-ttbpm_b0ce062c-09e7-4207-a0d6-f703e6ec7df1/copy-manifests/0.log" Jun 11 19:15:55.448514 ip-10-0-141-55 kubenswrapper[2578]: I0611 19:15:55.448483 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-lws-operator_lws-controller-manager-657f978cc6-sk67r_81fabc78-06f8-4b80-8e14-53ac8f24db4a/manager/0.log" Jun 11 19:15:55.490886 ip-10-0-141-55 kubenswrapper[2578]: I0611 19:15:55.490855 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-lws-operator_openshift-lws-operator-fd8ccff4c-bfhnm_a140623e-2799-47c1-8da5-8a66081ef6e6/openshift-lws-operator/0.log" Jun 11 19:15:57.906135 ip-10-0-141-55 kubenswrapper[2578]: I0611 19:15:57.906101 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-8d878499b-k8tfk_c4e1c6dc-8b90-4c4b-9894-fa0dea9de119/kube-auth-proxy/0.log" Jun 11 19:15:58.019156 ip-10-0-141-55 kubenswrapper[2578]: I0611 19:15:58.019123 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-pre-processing-579785bc64-97648_f92bab33-828e-44db-a9ff-5cab420fd035/payload-pre-processing/0.log" Jun 11 19:15:59.401033 ip-10-0-141-55 kubenswrapper[2578]: I0611 19:15:59.401002 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-8d878499b-k8tfk_c4e1c6dc-8b90-4c4b-9894-fa0dea9de119/kube-auth-proxy/0.log" Jun 11 19:15:59.523240 ip-10-0-141-55 kubenswrapper[2578]: I0611 19:15:59.523211 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-pre-processing-579785bc64-97648_f92bab33-828e-44db-a9ff-5cab420fd035/payload-pre-processing/0.log" Jun 11 19:16:01.596580 ip-10-0-141-55 kubenswrapper[2578]: I0611 19:16:01.596529 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-8d878499b-k8tfk_c4e1c6dc-8b90-4c4b-9894-fa0dea9de119/kube-auth-proxy/0.log" Jun 11 19:16:01.696981 ip-10-0-141-55 kubenswrapper[2578]: I0611 19:16:01.696953 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-pre-processing-579785bc64-97648_f92bab33-828e-44db-a9ff-5cab420fd035/payload-pre-processing/0.log"