Jun 09 17:33:15.784924 ip-10-0-143-124 systemd[1]: Starting Kubernetes Kubelet... Jun 09 17:33:16.171184 ip-10-0-143-124 kubenswrapper[2552]: Flag --container-runtime-endpoint has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Jun 09 17:33:16.171184 ip-10-0-143-124 kubenswrapper[2552]: Flag --minimum-container-ttl-duration has been deprecated, Use --eviction-hard or --eviction-soft instead. Will be removed in a future version. Jun 09 17:33:16.171184 ip-10-0-143-124 kubenswrapper[2552]: Flag --volume-plugin-dir has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Jun 09 17:33:16.171184 ip-10-0-143-124 kubenswrapper[2552]: Flag --pod-infra-container-image has been deprecated, will be removed in 1.35. Image garbage collector will get sandbox image information from CRI. Jun 09 17:33:16.171184 ip-10-0-143-124 kubenswrapper[2552]: Flag --system-reserved has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Jun 09 17:33:16.172854 ip-10-0-143-124 kubenswrapper[2552]: I0609 17:33:16.172759 2552 server.go:213] "--pod-infra-container-image will not be pruned by the image garbage collector in kubelet and should also be set in the remote runtime" Jun 09 17:33:16.178462 ip-10-0-143-124 kubenswrapper[2552]: W0609 17:33:16.178440 2552 feature_gate.go:328] unrecognized feature gate: EventTTL Jun 09 17:33:16.178462 ip-10-0-143-124 kubenswrapper[2552]: W0609 17:33:16.178458 2552 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jun 09 17:33:16.178462 ip-10-0-143-124 kubenswrapper[2552]: W0609 17:33:16.178463 2552 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jun 09 17:33:16.178462 ip-10-0-143-124 kubenswrapper[2552]: W0609 17:33:16.178467 2552 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jun 09 17:33:16.178721 ip-10-0-143-124 kubenswrapper[2552]: W0609 17:33:16.178472 2552 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jun 09 17:33:16.178721 ip-10-0-143-124 kubenswrapper[2552]: W0609 17:33:16.178477 2552 feature_gate.go:328] unrecognized feature gate: PinnedImages Jun 09 17:33:16.178721 ip-10-0-143-124 kubenswrapper[2552]: W0609 17:33:16.178481 2552 feature_gate.go:328] unrecognized feature gate: NewOLM Jun 09 17:33:16.178721 ip-10-0-143-124 kubenswrapper[2552]: W0609 17:33:16.178484 2552 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jun 09 17:33:16.178721 ip-10-0-143-124 kubenswrapper[2552]: W0609 17:33:16.178488 2552 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jun 09 17:33:16.178721 ip-10-0-143-124 kubenswrapper[2552]: W0609 17:33:16.178492 2552 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jun 09 17:33:16.178721 ip-10-0-143-124 kubenswrapper[2552]: W0609 17:33:16.178497 2552 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jun 09 17:33:16.178721 ip-10-0-143-124 kubenswrapper[2552]: W0609 17:33:16.178502 2552 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jun 09 17:33:16.178721 ip-10-0-143-124 kubenswrapper[2552]: W0609 17:33:16.178507 2552 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jun 09 17:33:16.178721 ip-10-0-143-124 kubenswrapper[2552]: W0609 17:33:16.178510 2552 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jun 09 17:33:16.178721 ip-10-0-143-124 kubenswrapper[2552]: W0609 17:33:16.178514 2552 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jun 09 17:33:16.178721 ip-10-0-143-124 kubenswrapper[2552]: W0609 17:33:16.178520 2552 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jun 09 17:33:16.178721 ip-10-0-143-124 kubenswrapper[2552]: W0609 17:33:16.178526 2552 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jun 09 17:33:16.178721 ip-10-0-143-124 kubenswrapper[2552]: W0609 17:33:16.178530 2552 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jun 09 17:33:16.178721 ip-10-0-143-124 kubenswrapper[2552]: W0609 17:33:16.178534 2552 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jun 09 17:33:16.178721 ip-10-0-143-124 kubenswrapper[2552]: W0609 17:33:16.178538 2552 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jun 09 17:33:16.178721 ip-10-0-143-124 kubenswrapper[2552]: W0609 17:33:16.178542 2552 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jun 09 17:33:16.178721 ip-10-0-143-124 kubenswrapper[2552]: W0609 17:33:16.178546 2552 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jun 09 17:33:16.178721 ip-10-0-143-124 kubenswrapper[2552]: W0609 17:33:16.178550 2552 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jun 09 17:33:16.178721 ip-10-0-143-124 kubenswrapper[2552]: W0609 17:33:16.178554 2552 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jun 09 17:33:16.179533 ip-10-0-143-124 kubenswrapper[2552]: W0609 17:33:16.178560 2552 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jun 09 17:33:16.179533 ip-10-0-143-124 kubenswrapper[2552]: W0609 17:33:16.178566 2552 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jun 09 17:33:16.179533 ip-10-0-143-124 kubenswrapper[2552]: W0609 17:33:16.178570 2552 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jun 09 17:33:16.179533 ip-10-0-143-124 kubenswrapper[2552]: W0609 17:33:16.178574 2552 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jun 09 17:33:16.179533 ip-10-0-143-124 kubenswrapper[2552]: W0609 17:33:16.178578 2552 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jun 09 17:33:16.179533 ip-10-0-143-124 kubenswrapper[2552]: W0609 17:33:16.178582 2552 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jun 09 17:33:16.179533 ip-10-0-143-124 kubenswrapper[2552]: W0609 17:33:16.178587 2552 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jun 09 17:33:16.179533 ip-10-0-143-124 kubenswrapper[2552]: W0609 17:33:16.178591 2552 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jun 09 17:33:16.179533 ip-10-0-143-124 kubenswrapper[2552]: W0609 17:33:16.178611 2552 feature_gate.go:328] unrecognized feature gate: OVNObservability Jun 09 17:33:16.179533 ip-10-0-143-124 kubenswrapper[2552]: W0609 17:33:16.178616 2552 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jun 09 17:33:16.179533 ip-10-0-143-124 kubenswrapper[2552]: W0609 17:33:16.178620 2552 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jun 09 17:33:16.179533 ip-10-0-143-124 kubenswrapper[2552]: W0609 17:33:16.178624 2552 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jun 09 17:33:16.179533 ip-10-0-143-124 kubenswrapper[2552]: W0609 17:33:16.178628 2552 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jun 09 17:33:16.179533 ip-10-0-143-124 kubenswrapper[2552]: W0609 17:33:16.178634 2552 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jun 09 17:33:16.179533 ip-10-0-143-124 kubenswrapper[2552]: W0609 17:33:16.178639 2552 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jun 09 17:33:16.179533 ip-10-0-143-124 kubenswrapper[2552]: W0609 17:33:16.178644 2552 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jun 09 17:33:16.179533 ip-10-0-143-124 kubenswrapper[2552]: W0609 17:33:16.178648 2552 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jun 09 17:33:16.179533 ip-10-0-143-124 kubenswrapper[2552]: W0609 17:33:16.178652 2552 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jun 09 17:33:16.179533 ip-10-0-143-124 kubenswrapper[2552]: W0609 17:33:16.178657 2552 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jun 09 17:33:16.180403 ip-10-0-143-124 kubenswrapper[2552]: W0609 17:33:16.178662 2552 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jun 09 17:33:16.180403 ip-10-0-143-124 kubenswrapper[2552]: W0609 17:33:16.178666 2552 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jun 09 17:33:16.180403 ip-10-0-143-124 kubenswrapper[2552]: W0609 17:33:16.178670 2552 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jun 09 17:33:16.180403 ip-10-0-143-124 kubenswrapper[2552]: W0609 17:33:16.178674 2552 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jun 09 17:33:16.180403 ip-10-0-143-124 kubenswrapper[2552]: W0609 17:33:16.178682 2552 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jun 09 17:33:16.180403 ip-10-0-143-124 kubenswrapper[2552]: W0609 17:33:16.178688 2552 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jun 09 17:33:16.180403 ip-10-0-143-124 kubenswrapper[2552]: W0609 17:33:16.178694 2552 feature_gate.go:328] unrecognized feature gate: SignatureStores Jun 09 17:33:16.180403 ip-10-0-143-124 kubenswrapper[2552]: W0609 17:33:16.178700 2552 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jun 09 17:33:16.180403 ip-10-0-143-124 kubenswrapper[2552]: W0609 17:33:16.178705 2552 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jun 09 17:33:16.180403 ip-10-0-143-124 kubenswrapper[2552]: W0609 17:33:16.178709 2552 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jun 09 17:33:16.180403 ip-10-0-143-124 kubenswrapper[2552]: W0609 17:33:16.178714 2552 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jun 09 17:33:16.180403 ip-10-0-143-124 kubenswrapper[2552]: W0609 17:33:16.178721 2552 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jun 09 17:33:16.180403 ip-10-0-143-124 kubenswrapper[2552]: W0609 17:33:16.178725 2552 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jun 09 17:33:16.180403 ip-10-0-143-124 kubenswrapper[2552]: W0609 17:33:16.178729 2552 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jun 09 17:33:16.180403 ip-10-0-143-124 kubenswrapper[2552]: W0609 17:33:16.178734 2552 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jun 09 17:33:16.180403 ip-10-0-143-124 kubenswrapper[2552]: W0609 17:33:16.178738 2552 feature_gate.go:328] unrecognized feature gate: DualReplica Jun 09 17:33:16.180403 ip-10-0-143-124 kubenswrapper[2552]: W0609 17:33:16.178742 2552 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jun 09 17:33:16.180403 ip-10-0-143-124 kubenswrapper[2552]: W0609 17:33:16.178746 2552 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jun 09 17:33:16.180403 ip-10-0-143-124 kubenswrapper[2552]: W0609 17:33:16.178750 2552 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jun 09 17:33:16.180403 ip-10-0-143-124 kubenswrapper[2552]: W0609 17:33:16.178754 2552 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jun 09 17:33:16.181261 ip-10-0-143-124 kubenswrapper[2552]: W0609 17:33:16.178759 2552 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jun 09 17:33:16.181261 ip-10-0-143-124 kubenswrapper[2552]: W0609 17:33:16.178763 2552 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jun 09 17:33:16.181261 ip-10-0-143-124 kubenswrapper[2552]: W0609 17:33:16.178768 2552 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jun 09 17:33:16.181261 ip-10-0-143-124 kubenswrapper[2552]: W0609 17:33:16.178772 2552 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jun 09 17:33:16.181261 ip-10-0-143-124 kubenswrapper[2552]: W0609 17:33:16.178777 2552 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jun 09 17:33:16.181261 ip-10-0-143-124 kubenswrapper[2552]: W0609 17:33:16.178782 2552 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jun 09 17:33:16.181261 ip-10-0-143-124 kubenswrapper[2552]: W0609 17:33:16.178787 2552 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jun 09 17:33:16.181261 ip-10-0-143-124 kubenswrapper[2552]: W0609 17:33:16.178791 2552 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jun 09 17:33:16.181261 ip-10-0-143-124 kubenswrapper[2552]: W0609 17:33:16.178796 2552 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jun 09 17:33:16.181261 ip-10-0-143-124 kubenswrapper[2552]: W0609 17:33:16.178801 2552 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jun 09 17:33:16.181261 ip-10-0-143-124 kubenswrapper[2552]: W0609 17:33:16.178805 2552 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jun 09 17:33:16.181261 ip-10-0-143-124 kubenswrapper[2552]: W0609 17:33:16.178810 2552 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jun 09 17:33:16.181261 ip-10-0-143-124 kubenswrapper[2552]: W0609 17:33:16.178814 2552 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jun 09 17:33:16.181261 ip-10-0-143-124 kubenswrapper[2552]: W0609 17:33:16.178818 2552 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jun 09 17:33:16.181261 ip-10-0-143-124 kubenswrapper[2552]: W0609 17:33:16.178822 2552 feature_gate.go:328] unrecognized feature gate: Example2 Jun 09 17:33:16.181261 ip-10-0-143-124 kubenswrapper[2552]: W0609 17:33:16.178826 2552 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jun 09 17:33:16.181261 ip-10-0-143-124 kubenswrapper[2552]: W0609 17:33:16.178832 2552 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jun 09 17:33:16.181261 ip-10-0-143-124 kubenswrapper[2552]: W0609 17:33:16.178836 2552 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jun 09 17:33:16.181261 ip-10-0-143-124 kubenswrapper[2552]: W0609 17:33:16.178840 2552 feature_gate.go:328] unrecognized feature gate: Example Jun 09 17:33:16.181261 ip-10-0-143-124 kubenswrapper[2552]: W0609 17:33:16.178844 2552 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jun 09 17:33:16.182127 ip-10-0-143-124 kubenswrapper[2552]: W0609 17:33:16.178849 2552 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jun 09 17:33:16.182127 ip-10-0-143-124 kubenswrapper[2552]: W0609 17:33:16.178853 2552 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jun 09 17:33:16.182127 ip-10-0-143-124 kubenswrapper[2552]: W0609 17:33:16.178857 2552 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jun 09 17:33:16.182127 ip-10-0-143-124 kubenswrapper[2552]: W0609 17:33:16.178862 2552 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jun 09 17:33:16.182127 ip-10-0-143-124 kubenswrapper[2552]: W0609 17:33:16.178866 2552 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jun 09 17:33:16.182127 ip-10-0-143-124 kubenswrapper[2552]: W0609 17:33:16.178870 2552 feature_gate.go:328] unrecognized feature gate: OSStreams Jun 09 17:33:16.182127 ip-10-0-143-124 kubenswrapper[2552]: W0609 17:33:16.178875 2552 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jun 09 17:33:16.182127 ip-10-0-143-124 kubenswrapper[2552]: W0609 17:33:16.178880 2552 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jun 09 17:33:16.182127 ip-10-0-143-124 kubenswrapper[2552]: W0609 17:33:16.178884 2552 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jun 09 17:33:16.182127 ip-10-0-143-124 kubenswrapper[2552]: W0609 17:33:16.178888 2552 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jun 09 17:33:16.182127 ip-10-0-143-124 kubenswrapper[2552]: W0609 17:33:16.178892 2552 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jun 09 17:33:16.182127 ip-10-0-143-124 kubenswrapper[2552]: W0609 17:33:16.178896 2552 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jun 09 17:33:16.182127 ip-10-0-143-124 kubenswrapper[2552]: W0609 17:33:16.178900 2552 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jun 09 17:33:16.182127 ip-10-0-143-124 kubenswrapper[2552]: W0609 17:33:16.178904 2552 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jun 09 17:33:16.182127 ip-10-0-143-124 kubenswrapper[2552]: W0609 17:33:16.178909 2552 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jun 09 17:33:16.182127 ip-10-0-143-124 kubenswrapper[2552]: W0609 17:33:16.178914 2552 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jun 09 17:33:16.182127 ip-10-0-143-124 kubenswrapper[2552]: W0609 17:33:16.180112 2552 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jun 09 17:33:16.182127 ip-10-0-143-124 kubenswrapper[2552]: W0609 17:33:16.180122 2552 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jun 09 17:33:16.182127 ip-10-0-143-124 kubenswrapper[2552]: W0609 17:33:16.180127 2552 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jun 09 17:33:16.182938 ip-10-0-143-124 kubenswrapper[2552]: W0609 17:33:16.180132 2552 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jun 09 17:33:16.182938 ip-10-0-143-124 kubenswrapper[2552]: W0609 17:33:16.180136 2552 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jun 09 17:33:16.182938 ip-10-0-143-124 kubenswrapper[2552]: W0609 17:33:16.180146 2552 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jun 09 17:33:16.182938 ip-10-0-143-124 kubenswrapper[2552]: W0609 17:33:16.180151 2552 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jun 09 17:33:16.182938 ip-10-0-143-124 kubenswrapper[2552]: W0609 17:33:16.180157 2552 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jun 09 17:33:16.182938 ip-10-0-143-124 kubenswrapper[2552]: W0609 17:33:16.180161 2552 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jun 09 17:33:16.182938 ip-10-0-143-124 kubenswrapper[2552]: W0609 17:33:16.180166 2552 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jun 09 17:33:16.182938 ip-10-0-143-124 kubenswrapper[2552]: W0609 17:33:16.180171 2552 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jun 09 17:33:16.182938 ip-10-0-143-124 kubenswrapper[2552]: W0609 17:33:16.180176 2552 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jun 09 17:33:16.182938 ip-10-0-143-124 kubenswrapper[2552]: W0609 17:33:16.180181 2552 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jun 09 17:33:16.182938 ip-10-0-143-124 kubenswrapper[2552]: W0609 17:33:16.180185 2552 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jun 09 17:33:16.182938 ip-10-0-143-124 kubenswrapper[2552]: W0609 17:33:16.180190 2552 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jun 09 17:33:16.182938 ip-10-0-143-124 kubenswrapper[2552]: W0609 17:33:16.180194 2552 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jun 09 17:33:16.182938 ip-10-0-143-124 kubenswrapper[2552]: W0609 17:33:16.180199 2552 feature_gate.go:328] unrecognized feature gate: DualReplica Jun 09 17:33:16.182938 ip-10-0-143-124 kubenswrapper[2552]: W0609 17:33:16.180203 2552 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jun 09 17:33:16.182938 ip-10-0-143-124 kubenswrapper[2552]: W0609 17:33:16.180207 2552 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jun 09 17:33:16.182938 ip-10-0-143-124 kubenswrapper[2552]: W0609 17:33:16.180212 2552 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jun 09 17:33:16.182938 ip-10-0-143-124 kubenswrapper[2552]: W0609 17:33:16.180216 2552 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jun 09 17:33:16.182938 ip-10-0-143-124 kubenswrapper[2552]: W0609 17:33:16.180220 2552 feature_gate.go:328] unrecognized feature gate: PinnedImages Jun 09 17:33:16.183644 ip-10-0-143-124 kubenswrapper[2552]: W0609 17:33:16.180224 2552 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jun 09 17:33:16.183644 ip-10-0-143-124 kubenswrapper[2552]: W0609 17:33:16.180228 2552 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jun 09 17:33:16.183644 ip-10-0-143-124 kubenswrapper[2552]: W0609 17:33:16.180232 2552 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jun 09 17:33:16.183644 ip-10-0-143-124 kubenswrapper[2552]: W0609 17:33:16.180237 2552 feature_gate.go:328] unrecognized feature gate: OSStreams Jun 09 17:33:16.183644 ip-10-0-143-124 kubenswrapper[2552]: W0609 17:33:16.180242 2552 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jun 09 17:33:16.183644 ip-10-0-143-124 kubenswrapper[2552]: W0609 17:33:16.180246 2552 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jun 09 17:33:16.183644 ip-10-0-143-124 kubenswrapper[2552]: W0609 17:33:16.180250 2552 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jun 09 17:33:16.183644 ip-10-0-143-124 kubenswrapper[2552]: W0609 17:33:16.180254 2552 feature_gate.go:328] unrecognized feature gate: NewOLM Jun 09 17:33:16.183644 ip-10-0-143-124 kubenswrapper[2552]: W0609 17:33:16.180258 2552 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jun 09 17:33:16.183644 ip-10-0-143-124 kubenswrapper[2552]: W0609 17:33:16.180263 2552 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jun 09 17:33:16.183644 ip-10-0-143-124 kubenswrapper[2552]: W0609 17:33:16.180267 2552 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jun 09 17:33:16.183644 ip-10-0-143-124 kubenswrapper[2552]: W0609 17:33:16.180271 2552 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jun 09 17:33:16.183644 ip-10-0-143-124 kubenswrapper[2552]: W0609 17:33:16.180275 2552 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jun 09 17:33:16.183644 ip-10-0-143-124 kubenswrapper[2552]: W0609 17:33:16.180279 2552 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jun 09 17:33:16.183644 ip-10-0-143-124 kubenswrapper[2552]: W0609 17:33:16.180283 2552 feature_gate.go:328] unrecognized feature gate: SignatureStores Jun 09 17:33:16.183644 ip-10-0-143-124 kubenswrapper[2552]: W0609 17:33:16.180289 2552 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jun 09 17:33:16.183644 ip-10-0-143-124 kubenswrapper[2552]: W0609 17:33:16.180295 2552 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jun 09 17:33:16.183644 ip-10-0-143-124 kubenswrapper[2552]: W0609 17:33:16.180301 2552 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jun 09 17:33:16.183644 ip-10-0-143-124 kubenswrapper[2552]: W0609 17:33:16.180305 2552 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jun 09 17:33:16.183644 ip-10-0-143-124 kubenswrapper[2552]: W0609 17:33:16.180311 2552 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jun 09 17:33:16.184233 ip-10-0-143-124 kubenswrapper[2552]: W0609 17:33:16.180316 2552 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jun 09 17:33:16.184233 ip-10-0-143-124 kubenswrapper[2552]: W0609 17:33:16.180321 2552 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jun 09 17:33:16.184233 ip-10-0-143-124 kubenswrapper[2552]: W0609 17:33:16.180325 2552 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jun 09 17:33:16.184233 ip-10-0-143-124 kubenswrapper[2552]: W0609 17:33:16.180330 2552 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jun 09 17:33:16.184233 ip-10-0-143-124 kubenswrapper[2552]: W0609 17:33:16.180334 2552 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jun 09 17:33:16.184233 ip-10-0-143-124 kubenswrapper[2552]: W0609 17:33:16.180339 2552 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jun 09 17:33:16.184233 ip-10-0-143-124 kubenswrapper[2552]: W0609 17:33:16.180343 2552 feature_gate.go:328] unrecognized feature gate: Example2 Jun 09 17:33:16.184233 ip-10-0-143-124 kubenswrapper[2552]: W0609 17:33:16.180347 2552 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jun 09 17:33:16.184233 ip-10-0-143-124 kubenswrapper[2552]: W0609 17:33:16.180352 2552 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jun 09 17:33:16.184233 ip-10-0-143-124 kubenswrapper[2552]: W0609 17:33:16.180356 2552 feature_gate.go:328] unrecognized feature gate: OVNObservability Jun 09 17:33:16.184233 ip-10-0-143-124 kubenswrapper[2552]: W0609 17:33:16.180360 2552 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jun 09 17:33:16.184233 ip-10-0-143-124 kubenswrapper[2552]: W0609 17:33:16.180364 2552 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jun 09 17:33:16.184233 ip-10-0-143-124 kubenswrapper[2552]: W0609 17:33:16.180368 2552 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jun 09 17:33:16.184233 ip-10-0-143-124 kubenswrapper[2552]: W0609 17:33:16.180373 2552 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jun 09 17:33:16.184233 ip-10-0-143-124 kubenswrapper[2552]: W0609 17:33:16.180377 2552 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jun 09 17:33:16.184233 ip-10-0-143-124 kubenswrapper[2552]: W0609 17:33:16.180381 2552 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jun 09 17:33:16.184233 ip-10-0-143-124 kubenswrapper[2552]: W0609 17:33:16.180386 2552 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jun 09 17:33:16.184233 ip-10-0-143-124 kubenswrapper[2552]: W0609 17:33:16.180390 2552 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jun 09 17:33:16.184233 ip-10-0-143-124 kubenswrapper[2552]: W0609 17:33:16.180394 2552 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jun 09 17:33:16.184233 ip-10-0-143-124 kubenswrapper[2552]: W0609 17:33:16.180398 2552 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jun 09 17:33:16.184851 ip-10-0-143-124 kubenswrapper[2552]: W0609 17:33:16.180402 2552 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jun 09 17:33:16.184851 ip-10-0-143-124 kubenswrapper[2552]: W0609 17:33:16.180407 2552 feature_gate.go:328] unrecognized feature gate: Example Jun 09 17:33:16.184851 ip-10-0-143-124 kubenswrapper[2552]: W0609 17:33:16.180410 2552 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jun 09 17:33:16.184851 ip-10-0-143-124 kubenswrapper[2552]: W0609 17:33:16.180414 2552 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jun 09 17:33:16.184851 ip-10-0-143-124 kubenswrapper[2552]: W0609 17:33:16.180419 2552 feature_gate.go:328] unrecognized feature gate: EventTTL Jun 09 17:33:16.184851 ip-10-0-143-124 kubenswrapper[2552]: W0609 17:33:16.180423 2552 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jun 09 17:33:16.184851 ip-10-0-143-124 kubenswrapper[2552]: W0609 17:33:16.180428 2552 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jun 09 17:33:16.184851 ip-10-0-143-124 kubenswrapper[2552]: W0609 17:33:16.180432 2552 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jun 09 17:33:16.184851 ip-10-0-143-124 kubenswrapper[2552]: W0609 17:33:16.180436 2552 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jun 09 17:33:16.184851 ip-10-0-143-124 kubenswrapper[2552]: W0609 17:33:16.180442 2552 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jun 09 17:33:16.184851 ip-10-0-143-124 kubenswrapper[2552]: W0609 17:33:16.180447 2552 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jun 09 17:33:16.184851 ip-10-0-143-124 kubenswrapper[2552]: W0609 17:33:16.180451 2552 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jun 09 17:33:16.184851 ip-10-0-143-124 kubenswrapper[2552]: W0609 17:33:16.180455 2552 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jun 09 17:33:16.184851 ip-10-0-143-124 kubenswrapper[2552]: W0609 17:33:16.180462 2552 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jun 09 17:33:16.184851 ip-10-0-143-124 kubenswrapper[2552]: W0609 17:33:16.180475 2552 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jun 09 17:33:16.184851 ip-10-0-143-124 kubenswrapper[2552]: W0609 17:33:16.180480 2552 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jun 09 17:33:16.184851 ip-10-0-143-124 kubenswrapper[2552]: W0609 17:33:16.180484 2552 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jun 09 17:33:16.184851 ip-10-0-143-124 kubenswrapper[2552]: W0609 17:33:16.180488 2552 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jun 09 17:33:16.184851 ip-10-0-143-124 kubenswrapper[2552]: W0609 17:33:16.180492 2552 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jun 09 17:33:16.184851 ip-10-0-143-124 kubenswrapper[2552]: W0609 17:33:16.180496 2552 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jun 09 17:33:16.185483 ip-10-0-143-124 kubenswrapper[2552]: W0609 17:33:16.180527 2552 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jun 09 17:33:16.185483 ip-10-0-143-124 kubenswrapper[2552]: W0609 17:33:16.180533 2552 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jun 09 17:33:16.185483 ip-10-0-143-124 kubenswrapper[2552]: W0609 17:33:16.180538 2552 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jun 09 17:33:16.185483 ip-10-0-143-124 kubenswrapper[2552]: W0609 17:33:16.180543 2552 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jun 09 17:33:16.185483 ip-10-0-143-124 kubenswrapper[2552]: W0609 17:33:16.180548 2552 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jun 09 17:33:16.185483 ip-10-0-143-124 kubenswrapper[2552]: W0609 17:33:16.180552 2552 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jun 09 17:33:16.185483 ip-10-0-143-124 kubenswrapper[2552]: W0609 17:33:16.180556 2552 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jun 09 17:33:16.185483 ip-10-0-143-124 kubenswrapper[2552]: W0609 17:33:16.180560 2552 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jun 09 17:33:16.185483 ip-10-0-143-124 kubenswrapper[2552]: W0609 17:33:16.180564 2552 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jun 09 17:33:16.185483 ip-10-0-143-124 kubenswrapper[2552]: W0609 17:33:16.180569 2552 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jun 09 17:33:16.185483 ip-10-0-143-124 kubenswrapper[2552]: W0609 17:33:16.180574 2552 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jun 09 17:33:16.185483 ip-10-0-143-124 kubenswrapper[2552]: W0609 17:33:16.180578 2552 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jun 09 17:33:16.185483 ip-10-0-143-124 kubenswrapper[2552]: W0609 17:33:16.180583 2552 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jun 09 17:33:16.185483 ip-10-0-143-124 kubenswrapper[2552]: W0609 17:33:16.180587 2552 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jun 09 17:33:16.185483 ip-10-0-143-124 kubenswrapper[2552]: W0609 17:33:16.180592 2552 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jun 09 17:33:16.185483 ip-10-0-143-124 kubenswrapper[2552]: W0609 17:33:16.180615 2552 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jun 09 17:33:16.185483 ip-10-0-143-124 kubenswrapper[2552]: W0609 17:33:16.180621 2552 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jun 09 17:33:16.185483 ip-10-0-143-124 kubenswrapper[2552]: W0609 17:33:16.181300 2552 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jun 09 17:33:16.185483 ip-10-0-143-124 kubenswrapper[2552]: W0609 17:33:16.181310 2552 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jun 09 17:33:16.185987 ip-10-0-143-124 kubenswrapper[2552]: W0609 17:33:16.181314 2552 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jun 09 17:33:16.185987 ip-10-0-143-124 kubenswrapper[2552]: W0609 17:33:16.181320 2552 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jun 09 17:33:16.185987 ip-10-0-143-124 kubenswrapper[2552]: W0609 17:33:16.181328 2552 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jun 09 17:33:16.185987 ip-10-0-143-124 kubenswrapper[2552]: W0609 17:33:16.181334 2552 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jun 09 17:33:16.185987 ip-10-0-143-124 kubenswrapper[2552]: W0609 17:33:16.181339 2552 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jun 09 17:33:16.185987 ip-10-0-143-124 kubenswrapper[2552]: W0609 17:33:16.181344 2552 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jun 09 17:33:16.185987 ip-10-0-143-124 kubenswrapper[2552]: W0609 17:33:16.181349 2552 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jun 09 17:33:16.185987 ip-10-0-143-124 kubenswrapper[2552]: W0609 17:33:16.181354 2552 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jun 09 17:33:16.185987 ip-10-0-143-124 kubenswrapper[2552]: W0609 17:33:16.181359 2552 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jun 09 17:33:16.185987 ip-10-0-143-124 kubenswrapper[2552]: W0609 17:33:16.181364 2552 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jun 09 17:33:16.185987 ip-10-0-143-124 kubenswrapper[2552]: W0609 17:33:16.181369 2552 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jun 09 17:33:16.185987 ip-10-0-143-124 kubenswrapper[2552]: W0609 17:33:16.181373 2552 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jun 09 17:33:16.185987 ip-10-0-143-124 kubenswrapper[2552]: W0609 17:33:16.181378 2552 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jun 09 17:33:16.185987 ip-10-0-143-124 kubenswrapper[2552]: W0609 17:33:16.181382 2552 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jun 09 17:33:16.185987 ip-10-0-143-124 kubenswrapper[2552]: W0609 17:33:16.181387 2552 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jun 09 17:33:16.185987 ip-10-0-143-124 kubenswrapper[2552]: W0609 17:33:16.181391 2552 feature_gate.go:328] unrecognized feature gate: DualReplica Jun 09 17:33:16.185987 ip-10-0-143-124 kubenswrapper[2552]: W0609 17:33:16.181395 2552 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jun 09 17:33:16.185987 ip-10-0-143-124 kubenswrapper[2552]: W0609 17:33:16.181399 2552 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jun 09 17:33:16.185987 ip-10-0-143-124 kubenswrapper[2552]: W0609 17:33:16.181404 2552 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jun 09 17:33:16.186517 ip-10-0-143-124 kubenswrapper[2552]: W0609 17:33:16.181408 2552 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jun 09 17:33:16.186517 ip-10-0-143-124 kubenswrapper[2552]: W0609 17:33:16.181412 2552 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jun 09 17:33:16.186517 ip-10-0-143-124 kubenswrapper[2552]: W0609 17:33:16.181416 2552 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jun 09 17:33:16.186517 ip-10-0-143-124 kubenswrapper[2552]: W0609 17:33:16.181420 2552 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jun 09 17:33:16.186517 ip-10-0-143-124 kubenswrapper[2552]: W0609 17:33:16.181424 2552 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jun 09 17:33:16.186517 ip-10-0-143-124 kubenswrapper[2552]: W0609 17:33:16.181428 2552 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jun 09 17:33:16.186517 ip-10-0-143-124 kubenswrapper[2552]: W0609 17:33:16.181433 2552 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jun 09 17:33:16.186517 ip-10-0-143-124 kubenswrapper[2552]: W0609 17:33:16.181437 2552 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jun 09 17:33:16.186517 ip-10-0-143-124 kubenswrapper[2552]: W0609 17:33:16.181443 2552 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jun 09 17:33:16.186517 ip-10-0-143-124 kubenswrapper[2552]: W0609 17:33:16.181448 2552 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jun 09 17:33:16.186517 ip-10-0-143-124 kubenswrapper[2552]: W0609 17:33:16.181454 2552 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jun 09 17:33:16.186517 ip-10-0-143-124 kubenswrapper[2552]: W0609 17:33:16.181459 2552 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jun 09 17:33:16.186517 ip-10-0-143-124 kubenswrapper[2552]: W0609 17:33:16.181463 2552 feature_gate.go:328] unrecognized feature gate: Example Jun 09 17:33:16.186517 ip-10-0-143-124 kubenswrapper[2552]: W0609 17:33:16.181468 2552 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jun 09 17:33:16.186517 ip-10-0-143-124 kubenswrapper[2552]: W0609 17:33:16.181472 2552 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jun 09 17:33:16.186517 ip-10-0-143-124 kubenswrapper[2552]: W0609 17:33:16.181476 2552 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jun 09 17:33:16.186517 ip-10-0-143-124 kubenswrapper[2552]: W0609 17:33:16.181481 2552 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jun 09 17:33:16.186517 ip-10-0-143-124 kubenswrapper[2552]: W0609 17:33:16.181486 2552 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jun 09 17:33:16.186517 ip-10-0-143-124 kubenswrapper[2552]: W0609 17:33:16.181490 2552 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jun 09 17:33:16.187049 ip-10-0-143-124 kubenswrapper[2552]: W0609 17:33:16.181494 2552 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jun 09 17:33:16.187049 ip-10-0-143-124 kubenswrapper[2552]: W0609 17:33:16.181498 2552 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jun 09 17:33:16.187049 ip-10-0-143-124 kubenswrapper[2552]: W0609 17:33:16.181502 2552 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jun 09 17:33:16.187049 ip-10-0-143-124 kubenswrapper[2552]: W0609 17:33:16.181507 2552 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jun 09 17:33:16.187049 ip-10-0-143-124 kubenswrapper[2552]: W0609 17:33:16.181511 2552 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jun 09 17:33:16.187049 ip-10-0-143-124 kubenswrapper[2552]: W0609 17:33:16.181515 2552 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jun 09 17:33:16.187049 ip-10-0-143-124 kubenswrapper[2552]: W0609 17:33:16.181519 2552 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jun 09 17:33:16.187049 ip-10-0-143-124 kubenswrapper[2552]: W0609 17:33:16.181523 2552 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jun 09 17:33:16.187049 ip-10-0-143-124 kubenswrapper[2552]: W0609 17:33:16.181527 2552 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jun 09 17:33:16.187049 ip-10-0-143-124 kubenswrapper[2552]: W0609 17:33:16.181531 2552 feature_gate.go:328] unrecognized feature gate: SignatureStores Jun 09 17:33:16.187049 ip-10-0-143-124 kubenswrapper[2552]: W0609 17:33:16.181535 2552 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jun 09 17:33:16.187049 ip-10-0-143-124 kubenswrapper[2552]: W0609 17:33:16.181540 2552 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jun 09 17:33:16.187049 ip-10-0-143-124 kubenswrapper[2552]: W0609 17:33:16.181544 2552 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jun 09 17:33:16.187049 ip-10-0-143-124 kubenswrapper[2552]: W0609 17:33:16.181549 2552 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jun 09 17:33:16.187049 ip-10-0-143-124 kubenswrapper[2552]: W0609 17:33:16.181553 2552 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jun 09 17:33:16.187049 ip-10-0-143-124 kubenswrapper[2552]: W0609 17:33:16.181557 2552 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jun 09 17:33:16.187049 ip-10-0-143-124 kubenswrapper[2552]: W0609 17:33:16.181561 2552 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jun 09 17:33:16.187049 ip-10-0-143-124 kubenswrapper[2552]: W0609 17:33:16.181565 2552 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jun 09 17:33:16.187049 ip-10-0-143-124 kubenswrapper[2552]: W0609 17:33:16.181575 2552 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jun 09 17:33:16.187049 ip-10-0-143-124 kubenswrapper[2552]: W0609 17:33:16.181580 2552 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jun 09 17:33:16.187547 ip-10-0-143-124 kubenswrapper[2552]: W0609 17:33:16.181583 2552 feature_gate.go:328] unrecognized feature gate: EventTTL Jun 09 17:33:16.187547 ip-10-0-143-124 kubenswrapper[2552]: W0609 17:33:16.181588 2552 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jun 09 17:33:16.187547 ip-10-0-143-124 kubenswrapper[2552]: W0609 17:33:16.181592 2552 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jun 09 17:33:16.187547 ip-10-0-143-124 kubenswrapper[2552]: W0609 17:33:16.181616 2552 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jun 09 17:33:16.187547 ip-10-0-143-124 kubenswrapper[2552]: W0609 17:33:16.181621 2552 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jun 09 17:33:16.187547 ip-10-0-143-124 kubenswrapper[2552]: W0609 17:33:16.181626 2552 feature_gate.go:328] unrecognized feature gate: NewOLM Jun 09 17:33:16.187547 ip-10-0-143-124 kubenswrapper[2552]: W0609 17:33:16.181630 2552 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jun 09 17:33:16.187547 ip-10-0-143-124 kubenswrapper[2552]: W0609 17:33:16.181634 2552 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jun 09 17:33:16.187547 ip-10-0-143-124 kubenswrapper[2552]: W0609 17:33:16.181638 2552 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jun 09 17:33:16.187547 ip-10-0-143-124 kubenswrapper[2552]: W0609 17:33:16.181642 2552 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jun 09 17:33:16.187547 ip-10-0-143-124 kubenswrapper[2552]: W0609 17:33:16.181647 2552 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jun 09 17:33:16.187547 ip-10-0-143-124 kubenswrapper[2552]: W0609 17:33:16.181651 2552 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jun 09 17:33:16.187547 ip-10-0-143-124 kubenswrapper[2552]: W0609 17:33:16.181656 2552 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jun 09 17:33:16.187547 ip-10-0-143-124 kubenswrapper[2552]: W0609 17:33:16.181660 2552 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jun 09 17:33:16.187547 ip-10-0-143-124 kubenswrapper[2552]: W0609 17:33:16.181664 2552 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jun 09 17:33:16.187547 ip-10-0-143-124 kubenswrapper[2552]: W0609 17:33:16.181668 2552 feature_gate.go:328] unrecognized feature gate: OVNObservability Jun 09 17:33:16.187547 ip-10-0-143-124 kubenswrapper[2552]: W0609 17:33:16.181672 2552 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jun 09 17:33:16.187547 ip-10-0-143-124 kubenswrapper[2552]: W0609 17:33:16.181676 2552 feature_gate.go:328] unrecognized feature gate: PinnedImages Jun 09 17:33:16.187547 ip-10-0-143-124 kubenswrapper[2552]: W0609 17:33:16.181680 2552 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jun 09 17:33:16.187547 ip-10-0-143-124 kubenswrapper[2552]: W0609 17:33:16.181684 2552 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jun 09 17:33:16.188048 ip-10-0-143-124 kubenswrapper[2552]: W0609 17:33:16.181689 2552 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jun 09 17:33:16.188048 ip-10-0-143-124 kubenswrapper[2552]: W0609 17:33:16.181693 2552 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jun 09 17:33:16.188048 ip-10-0-143-124 kubenswrapper[2552]: W0609 17:33:16.181697 2552 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jun 09 17:33:16.188048 ip-10-0-143-124 kubenswrapper[2552]: W0609 17:33:16.181703 2552 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jun 09 17:33:16.188048 ip-10-0-143-124 kubenswrapper[2552]: W0609 17:33:16.181707 2552 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jun 09 17:33:16.188048 ip-10-0-143-124 kubenswrapper[2552]: W0609 17:33:16.181711 2552 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jun 09 17:33:16.188048 ip-10-0-143-124 kubenswrapper[2552]: W0609 17:33:16.181716 2552 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jun 09 17:33:16.188048 ip-10-0-143-124 kubenswrapper[2552]: W0609 17:33:16.181720 2552 feature_gate.go:328] unrecognized feature gate: OSStreams Jun 09 17:33:16.188048 ip-10-0-143-124 kubenswrapper[2552]: W0609 17:33:16.181726 2552 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jun 09 17:33:16.188048 ip-10-0-143-124 kubenswrapper[2552]: W0609 17:33:16.181731 2552 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jun 09 17:33:16.188048 ip-10-0-143-124 kubenswrapper[2552]: W0609 17:33:16.181738 2552 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jun 09 17:33:16.188048 ip-10-0-143-124 kubenswrapper[2552]: W0609 17:33:16.181743 2552 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jun 09 17:33:16.188048 ip-10-0-143-124 kubenswrapper[2552]: W0609 17:33:16.181748 2552 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jun 09 17:33:16.188048 ip-10-0-143-124 kubenswrapper[2552]: W0609 17:33:16.181752 2552 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jun 09 17:33:16.188048 ip-10-0-143-124 kubenswrapper[2552]: W0609 17:33:16.181757 2552 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jun 09 17:33:16.188048 ip-10-0-143-124 kubenswrapper[2552]: W0609 17:33:16.181762 2552 feature_gate.go:328] unrecognized feature gate: Example2 Jun 09 17:33:16.188048 ip-10-0-143-124 kubenswrapper[2552]: W0609 17:33:16.181766 2552 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jun 09 17:33:16.188048 ip-10-0-143-124 kubenswrapper[2552]: W0609 17:33:16.181770 2552 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jun 09 17:33:16.188048 ip-10-0-143-124 kubenswrapper[2552]: W0609 17:33:16.181775 2552 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jun 09 17:33:16.188048 ip-10-0-143-124 kubenswrapper[2552]: I0609 17:33:16.181879 2552 flags.go:64] FLAG: --address="0.0.0.0" Jun 09 17:33:16.188542 ip-10-0-143-124 kubenswrapper[2552]: I0609 17:33:16.181897 2552 flags.go:64] FLAG: --allowed-unsafe-sysctls="[]" Jun 09 17:33:16.188542 ip-10-0-143-124 kubenswrapper[2552]: I0609 17:33:16.181906 2552 flags.go:64] FLAG: --anonymous-auth="true" Jun 09 17:33:16.188542 ip-10-0-143-124 kubenswrapper[2552]: I0609 17:33:16.181913 2552 flags.go:64] FLAG: --application-metrics-count-limit="100" Jun 09 17:33:16.188542 ip-10-0-143-124 kubenswrapper[2552]: I0609 17:33:16.181922 2552 flags.go:64] FLAG: --authentication-token-webhook="false" Jun 09 17:33:16.188542 ip-10-0-143-124 kubenswrapper[2552]: I0609 17:33:16.181928 2552 flags.go:64] FLAG: --authentication-token-webhook-cache-ttl="2m0s" Jun 09 17:33:16.188542 ip-10-0-143-124 kubenswrapper[2552]: I0609 17:33:16.181935 2552 flags.go:64] FLAG: --authorization-mode="AlwaysAllow" Jun 09 17:33:16.188542 ip-10-0-143-124 kubenswrapper[2552]: I0609 17:33:16.181942 2552 flags.go:64] FLAG: --authorization-webhook-cache-authorized-ttl="5m0s" Jun 09 17:33:16.188542 ip-10-0-143-124 kubenswrapper[2552]: I0609 17:33:16.181948 2552 flags.go:64] FLAG: --authorization-webhook-cache-unauthorized-ttl="30s" Jun 09 17:33:16.188542 ip-10-0-143-124 kubenswrapper[2552]: I0609 17:33:16.181953 2552 flags.go:64] FLAG: --boot-id-file="/proc/sys/kernel/random/boot_id" Jun 09 17:33:16.188542 ip-10-0-143-124 kubenswrapper[2552]: I0609 17:33:16.181958 2552 flags.go:64] FLAG: --bootstrap-kubeconfig="/etc/kubernetes/kubeconfig" Jun 09 17:33:16.188542 ip-10-0-143-124 kubenswrapper[2552]: I0609 17:33:16.181963 2552 flags.go:64] FLAG: --cert-dir="/var/lib/kubelet/pki" Jun 09 17:33:16.188542 ip-10-0-143-124 kubenswrapper[2552]: I0609 17:33:16.181968 2552 flags.go:64] FLAG: --cgroup-driver="cgroupfs" Jun 09 17:33:16.188542 ip-10-0-143-124 kubenswrapper[2552]: I0609 17:33:16.181973 2552 flags.go:64] FLAG: --cgroup-root="" Jun 09 17:33:16.188542 ip-10-0-143-124 kubenswrapper[2552]: I0609 17:33:16.181979 2552 flags.go:64] FLAG: --cgroups-per-qos="true" Jun 09 17:33:16.188542 ip-10-0-143-124 kubenswrapper[2552]: I0609 17:33:16.181984 2552 flags.go:64] FLAG: --client-ca-file="" Jun 09 17:33:16.188542 ip-10-0-143-124 kubenswrapper[2552]: I0609 17:33:16.181989 2552 flags.go:64] FLAG: --cloud-provider="external" Jun 09 17:33:16.188542 ip-10-0-143-124 kubenswrapper[2552]: I0609 17:33:16.181994 2552 flags.go:64] FLAG: --cluster-dns="[]" Jun 09 17:33:16.188542 ip-10-0-143-124 kubenswrapper[2552]: I0609 17:33:16.182000 2552 flags.go:64] FLAG: --cluster-domain="" Jun 09 17:33:16.188542 ip-10-0-143-124 kubenswrapper[2552]: I0609 17:33:16.182005 2552 flags.go:64] FLAG: --config="/etc/kubernetes/kubelet.conf" Jun 09 17:33:16.188542 ip-10-0-143-124 kubenswrapper[2552]: I0609 17:33:16.182010 2552 flags.go:64] FLAG: --config-dir="/etc/openshift/kubelet.conf.d" Jun 09 17:33:16.188542 ip-10-0-143-124 kubenswrapper[2552]: I0609 17:33:16.182016 2552 flags.go:64] FLAG: --container-hints="/etc/cadvisor/container_hints.json" Jun 09 17:33:16.188542 ip-10-0-143-124 kubenswrapper[2552]: I0609 17:33:16.182021 2552 flags.go:64] FLAG: --container-log-max-files="5" Jun 09 17:33:16.188542 ip-10-0-143-124 kubenswrapper[2552]: I0609 17:33:16.182029 2552 flags.go:64] FLAG: --container-log-max-size="10Mi" Jun 09 17:33:16.188542 ip-10-0-143-124 kubenswrapper[2552]: I0609 17:33:16.182034 2552 flags.go:64] FLAG: --container-runtime-endpoint="/var/run/crio/crio.sock" Jun 09 17:33:16.189135 ip-10-0-143-124 kubenswrapper[2552]: I0609 17:33:16.182039 2552 flags.go:64] FLAG: --containerd="/run/containerd/containerd.sock" Jun 09 17:33:16.189135 ip-10-0-143-124 kubenswrapper[2552]: I0609 17:33:16.182044 2552 flags.go:64] FLAG: --containerd-namespace="k8s.io" Jun 09 17:33:16.189135 ip-10-0-143-124 kubenswrapper[2552]: I0609 17:33:16.182049 2552 flags.go:64] FLAG: --contention-profiling="false" Jun 09 17:33:16.189135 ip-10-0-143-124 kubenswrapper[2552]: I0609 17:33:16.182054 2552 flags.go:64] FLAG: --cpu-cfs-quota="true" Jun 09 17:33:16.189135 ip-10-0-143-124 kubenswrapper[2552]: I0609 17:33:16.182059 2552 flags.go:64] FLAG: --cpu-cfs-quota-period="100ms" Jun 09 17:33:16.189135 ip-10-0-143-124 kubenswrapper[2552]: I0609 17:33:16.182064 2552 flags.go:64] FLAG: --cpu-manager-policy="none" Jun 09 17:33:16.189135 ip-10-0-143-124 kubenswrapper[2552]: I0609 17:33:16.182069 2552 flags.go:64] FLAG: --cpu-manager-policy-options="" Jun 09 17:33:16.189135 ip-10-0-143-124 kubenswrapper[2552]: I0609 17:33:16.182076 2552 flags.go:64] FLAG: --cpu-manager-reconcile-period="10s" Jun 09 17:33:16.189135 ip-10-0-143-124 kubenswrapper[2552]: I0609 17:33:16.182081 2552 flags.go:64] FLAG: --enable-controller-attach-detach="true" Jun 09 17:33:16.189135 ip-10-0-143-124 kubenswrapper[2552]: I0609 17:33:16.182085 2552 flags.go:64] FLAG: --enable-debugging-handlers="true" Jun 09 17:33:16.189135 ip-10-0-143-124 kubenswrapper[2552]: I0609 17:33:16.182090 2552 flags.go:64] FLAG: --enable-load-reader="false" Jun 09 17:33:16.189135 ip-10-0-143-124 kubenswrapper[2552]: I0609 17:33:16.182095 2552 flags.go:64] FLAG: --enable-server="true" Jun 09 17:33:16.189135 ip-10-0-143-124 kubenswrapper[2552]: I0609 17:33:16.182101 2552 flags.go:64] FLAG: --enforce-node-allocatable="[pods]" Jun 09 17:33:16.189135 ip-10-0-143-124 kubenswrapper[2552]: I0609 17:33:16.182107 2552 flags.go:64] FLAG: --event-burst="100" Jun 09 17:33:16.189135 ip-10-0-143-124 kubenswrapper[2552]: I0609 17:33:16.182112 2552 flags.go:64] FLAG: --event-qps="50" Jun 09 17:33:16.189135 ip-10-0-143-124 kubenswrapper[2552]: I0609 17:33:16.182117 2552 flags.go:64] FLAG: --event-storage-age-limit="default=0" Jun 09 17:33:16.189135 ip-10-0-143-124 kubenswrapper[2552]: I0609 17:33:16.182122 2552 flags.go:64] FLAG: --event-storage-event-limit="default=0" Jun 09 17:33:16.189135 ip-10-0-143-124 kubenswrapper[2552]: I0609 17:33:16.182127 2552 flags.go:64] FLAG: --eviction-hard="" Jun 09 17:33:16.189135 ip-10-0-143-124 kubenswrapper[2552]: I0609 17:33:16.182133 2552 flags.go:64] FLAG: --eviction-max-pod-grace-period="0" Jun 09 17:33:16.189135 ip-10-0-143-124 kubenswrapper[2552]: I0609 17:33:16.182137 2552 flags.go:64] FLAG: --eviction-minimum-reclaim="" Jun 09 17:33:16.189135 ip-10-0-143-124 kubenswrapper[2552]: I0609 17:33:16.182142 2552 flags.go:64] FLAG: --eviction-pressure-transition-period="5m0s" Jun 09 17:33:16.189135 ip-10-0-143-124 kubenswrapper[2552]: I0609 17:33:16.182147 2552 flags.go:64] FLAG: --eviction-soft="" Jun 09 17:33:16.189135 ip-10-0-143-124 kubenswrapper[2552]: I0609 17:33:16.182152 2552 flags.go:64] FLAG: --eviction-soft-grace-period="" Jun 09 17:33:16.189135 ip-10-0-143-124 kubenswrapper[2552]: I0609 17:33:16.182157 2552 flags.go:64] FLAG: --exit-on-lock-contention="false" Jun 09 17:33:16.189135 ip-10-0-143-124 kubenswrapper[2552]: I0609 17:33:16.182161 2552 flags.go:64] FLAG: --experimental-allocatable-ignore-eviction="false" Jun 09 17:33:16.190013 ip-10-0-143-124 kubenswrapper[2552]: I0609 17:33:16.182166 2552 flags.go:64] FLAG: --experimental-mounter-path="" Jun 09 17:33:16.190013 ip-10-0-143-124 kubenswrapper[2552]: I0609 17:33:16.182171 2552 flags.go:64] FLAG: --fail-cgroupv1="false" Jun 09 17:33:16.190013 ip-10-0-143-124 kubenswrapper[2552]: I0609 17:33:16.182176 2552 flags.go:64] FLAG: --fail-swap-on="true" Jun 09 17:33:16.190013 ip-10-0-143-124 kubenswrapper[2552]: I0609 17:33:16.182181 2552 flags.go:64] FLAG: --feature-gates="" Jun 09 17:33:16.190013 ip-10-0-143-124 kubenswrapper[2552]: I0609 17:33:16.182187 2552 flags.go:64] FLAG: --file-check-frequency="20s" Jun 09 17:33:16.190013 ip-10-0-143-124 kubenswrapper[2552]: I0609 17:33:16.182193 2552 flags.go:64] FLAG: --global-housekeeping-interval="1m0s" Jun 09 17:33:16.190013 ip-10-0-143-124 kubenswrapper[2552]: I0609 17:33:16.182199 2552 flags.go:64] FLAG: --hairpin-mode="promiscuous-bridge" Jun 09 17:33:16.190013 ip-10-0-143-124 kubenswrapper[2552]: I0609 17:33:16.182204 2552 flags.go:64] FLAG: --healthz-bind-address="127.0.0.1" Jun 09 17:33:16.190013 ip-10-0-143-124 kubenswrapper[2552]: I0609 17:33:16.182209 2552 flags.go:64] FLAG: --healthz-port="10248" Jun 09 17:33:16.190013 ip-10-0-143-124 kubenswrapper[2552]: I0609 17:33:16.182214 2552 flags.go:64] FLAG: --help="false" Jun 09 17:33:16.190013 ip-10-0-143-124 kubenswrapper[2552]: I0609 17:33:16.182221 2552 flags.go:64] FLAG: --hostname-override="ip-10-0-143-124.ec2.internal" Jun 09 17:33:16.190013 ip-10-0-143-124 kubenswrapper[2552]: I0609 17:33:16.182226 2552 flags.go:64] FLAG: --housekeeping-interval="10s" Jun 09 17:33:16.190013 ip-10-0-143-124 kubenswrapper[2552]: I0609 17:33:16.182231 2552 flags.go:64] FLAG: --http-check-frequency="20s" Jun 09 17:33:16.190013 ip-10-0-143-124 kubenswrapper[2552]: I0609 17:33:16.182235 2552 flags.go:64] FLAG: --image-credential-provider-bin-dir="/usr/libexec/kubelet-image-credential-provider-plugins" Jun 09 17:33:16.190013 ip-10-0-143-124 kubenswrapper[2552]: I0609 17:33:16.182241 2552 flags.go:64] FLAG: --image-credential-provider-config="/etc/kubernetes/credential-providers/ecr-credential-provider.yaml" Jun 09 17:33:16.190013 ip-10-0-143-124 kubenswrapper[2552]: I0609 17:33:16.182247 2552 flags.go:64] FLAG: --image-gc-high-threshold="85" Jun 09 17:33:16.190013 ip-10-0-143-124 kubenswrapper[2552]: I0609 17:33:16.182252 2552 flags.go:64] FLAG: --image-gc-low-threshold="80" Jun 09 17:33:16.190013 ip-10-0-143-124 kubenswrapper[2552]: I0609 17:33:16.182256 2552 flags.go:64] FLAG: --image-service-endpoint="" Jun 09 17:33:16.190013 ip-10-0-143-124 kubenswrapper[2552]: I0609 17:33:16.182261 2552 flags.go:64] FLAG: --kernel-memcg-notification="false" Jun 09 17:33:16.190013 ip-10-0-143-124 kubenswrapper[2552]: I0609 17:33:16.182266 2552 flags.go:64] FLAG: --kube-api-burst="100" Jun 09 17:33:16.190013 ip-10-0-143-124 kubenswrapper[2552]: I0609 17:33:16.182272 2552 flags.go:64] FLAG: --kube-api-content-type="application/vnd.kubernetes.protobuf" Jun 09 17:33:16.190013 ip-10-0-143-124 kubenswrapper[2552]: I0609 17:33:16.182277 2552 flags.go:64] FLAG: --kube-api-qps="50" Jun 09 17:33:16.190013 ip-10-0-143-124 kubenswrapper[2552]: I0609 17:33:16.182282 2552 flags.go:64] FLAG: --kube-reserved="" Jun 09 17:33:16.190013 ip-10-0-143-124 kubenswrapper[2552]: I0609 17:33:16.182287 2552 flags.go:64] FLAG: --kube-reserved-cgroup="" Jun 09 17:33:16.190629 ip-10-0-143-124 kubenswrapper[2552]: I0609 17:33:16.182291 2552 flags.go:64] FLAG: --kubeconfig="/var/lib/kubelet/kubeconfig" Jun 09 17:33:16.190629 ip-10-0-143-124 kubenswrapper[2552]: I0609 17:33:16.182296 2552 flags.go:64] FLAG: --kubelet-cgroups="" Jun 09 17:33:16.190629 ip-10-0-143-124 kubenswrapper[2552]: I0609 17:33:16.182301 2552 flags.go:64] FLAG: --local-storage-capacity-isolation="true" Jun 09 17:33:16.190629 ip-10-0-143-124 kubenswrapper[2552]: I0609 17:33:16.182305 2552 flags.go:64] FLAG: --lock-file="" Jun 09 17:33:16.190629 ip-10-0-143-124 kubenswrapper[2552]: I0609 17:33:16.182310 2552 flags.go:64] FLAG: --log-cadvisor-usage="false" Jun 09 17:33:16.190629 ip-10-0-143-124 kubenswrapper[2552]: I0609 17:33:16.182315 2552 flags.go:64] FLAG: --log-flush-frequency="5s" Jun 09 17:33:16.190629 ip-10-0-143-124 kubenswrapper[2552]: I0609 17:33:16.182320 2552 flags.go:64] FLAG: --log-json-info-buffer-size="0" Jun 09 17:33:16.190629 ip-10-0-143-124 kubenswrapper[2552]: I0609 17:33:16.182329 2552 flags.go:64] FLAG: --log-json-split-stream="false" Jun 09 17:33:16.190629 ip-10-0-143-124 kubenswrapper[2552]: I0609 17:33:16.182334 2552 flags.go:64] FLAG: --log-text-info-buffer-size="0" Jun 09 17:33:16.190629 ip-10-0-143-124 kubenswrapper[2552]: I0609 17:33:16.182338 2552 flags.go:64] FLAG: --log-text-split-stream="false" Jun 09 17:33:16.190629 ip-10-0-143-124 kubenswrapper[2552]: I0609 17:33:16.182343 2552 flags.go:64] FLAG: --logging-format="text" Jun 09 17:33:16.190629 ip-10-0-143-124 kubenswrapper[2552]: I0609 17:33:16.182348 2552 flags.go:64] FLAG: --machine-id-file="/etc/machine-id,/var/lib/dbus/machine-id" Jun 09 17:33:16.190629 ip-10-0-143-124 kubenswrapper[2552]: I0609 17:33:16.182353 2552 flags.go:64] FLAG: --make-iptables-util-chains="true" Jun 09 17:33:16.190629 ip-10-0-143-124 kubenswrapper[2552]: I0609 17:33:16.182360 2552 flags.go:64] FLAG: --manifest-url="" Jun 09 17:33:16.190629 ip-10-0-143-124 kubenswrapper[2552]: I0609 17:33:16.182365 2552 flags.go:64] FLAG: --manifest-url-header="" Jun 09 17:33:16.190629 ip-10-0-143-124 kubenswrapper[2552]: I0609 17:33:16.182372 2552 flags.go:64] FLAG: --max-housekeeping-interval="15s" Jun 09 17:33:16.190629 ip-10-0-143-124 kubenswrapper[2552]: I0609 17:33:16.182377 2552 flags.go:64] FLAG: --max-open-files="1000000" Jun 09 17:33:16.190629 ip-10-0-143-124 kubenswrapper[2552]: I0609 17:33:16.182384 2552 flags.go:64] FLAG: --max-pods="110" Jun 09 17:33:16.190629 ip-10-0-143-124 kubenswrapper[2552]: I0609 17:33:16.182390 2552 flags.go:64] FLAG: --maximum-dead-containers="-1" Jun 09 17:33:16.190629 ip-10-0-143-124 kubenswrapper[2552]: I0609 17:33:16.182395 2552 flags.go:64] FLAG: --maximum-dead-containers-per-container="1" Jun 09 17:33:16.190629 ip-10-0-143-124 kubenswrapper[2552]: I0609 17:33:16.182399 2552 flags.go:64] FLAG: --memory-manager-policy="None" Jun 09 17:33:16.190629 ip-10-0-143-124 kubenswrapper[2552]: I0609 17:33:16.182404 2552 flags.go:64] FLAG: --minimum-container-ttl-duration="6m0s" Jun 09 17:33:16.190629 ip-10-0-143-124 kubenswrapper[2552]: I0609 17:33:16.182409 2552 flags.go:64] FLAG: --minimum-image-ttl-duration="2m0s" Jun 09 17:33:16.190629 ip-10-0-143-124 kubenswrapper[2552]: I0609 17:33:16.182414 2552 flags.go:64] FLAG: --node-ip="0.0.0.0" Jun 09 17:33:16.190629 ip-10-0-143-124 kubenswrapper[2552]: I0609 17:33:16.182419 2552 flags.go:64] FLAG: --node-labels="node-role.kubernetes.io/worker=,node.openshift.io/os_id=rhel" Jun 09 17:33:16.191238 ip-10-0-143-124 kubenswrapper[2552]: I0609 17:33:16.182430 2552 flags.go:64] FLAG: --node-status-max-images="50" Jun 09 17:33:16.191238 ip-10-0-143-124 kubenswrapper[2552]: I0609 17:33:16.182435 2552 flags.go:64] FLAG: --node-status-update-frequency="10s" Jun 09 17:33:16.191238 ip-10-0-143-124 kubenswrapper[2552]: I0609 17:33:16.182440 2552 flags.go:64] FLAG: --oom-score-adj="-999" Jun 09 17:33:16.191238 ip-10-0-143-124 kubenswrapper[2552]: I0609 17:33:16.182445 2552 flags.go:64] FLAG: --pod-cidr="" Jun 09 17:33:16.191238 ip-10-0-143-124 kubenswrapper[2552]: I0609 17:33:16.182451 2552 flags.go:64] FLAG: --pod-infra-container-image="quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:746976bfb3a92b93dacc79c151b98fd4c932eef19c3e2c1516b14eebcac9184d" Jun 09 17:33:16.191238 ip-10-0-143-124 kubenswrapper[2552]: I0609 17:33:16.182460 2552 flags.go:64] FLAG: --pod-manifest-path="" Jun 09 17:33:16.191238 ip-10-0-143-124 kubenswrapper[2552]: I0609 17:33:16.182465 2552 flags.go:64] FLAG: --pod-max-pids="-1" Jun 09 17:33:16.191238 ip-10-0-143-124 kubenswrapper[2552]: I0609 17:33:16.182470 2552 flags.go:64] FLAG: --pods-per-core="0" Jun 09 17:33:16.191238 ip-10-0-143-124 kubenswrapper[2552]: I0609 17:33:16.182474 2552 flags.go:64] FLAG: --port="10250" Jun 09 17:33:16.191238 ip-10-0-143-124 kubenswrapper[2552]: I0609 17:33:16.182479 2552 flags.go:64] FLAG: --protect-kernel-defaults="false" Jun 09 17:33:16.191238 ip-10-0-143-124 kubenswrapper[2552]: I0609 17:33:16.182484 2552 flags.go:64] FLAG: --provider-id="aws:///us-east-1a/i-02a79161c837d1f8d" Jun 09 17:33:16.191238 ip-10-0-143-124 kubenswrapper[2552]: I0609 17:33:16.182489 2552 flags.go:64] FLAG: --qos-reserved="" Jun 09 17:33:16.191238 ip-10-0-143-124 kubenswrapper[2552]: I0609 17:33:16.182494 2552 flags.go:64] FLAG: --read-only-port="10255" Jun 09 17:33:16.191238 ip-10-0-143-124 kubenswrapper[2552]: I0609 17:33:16.182499 2552 flags.go:64] FLAG: --register-node="true" Jun 09 17:33:16.191238 ip-10-0-143-124 kubenswrapper[2552]: I0609 17:33:16.182503 2552 flags.go:64] FLAG: --register-with-taints="" Jun 09 17:33:16.191238 ip-10-0-143-124 kubenswrapper[2552]: I0609 17:33:16.182509 2552 flags.go:64] FLAG: --registry-burst="10" Jun 09 17:33:16.191238 ip-10-0-143-124 kubenswrapper[2552]: I0609 17:33:16.182514 2552 flags.go:64] FLAG: --registry-qps="5" Jun 09 17:33:16.191238 ip-10-0-143-124 kubenswrapper[2552]: I0609 17:33:16.182518 2552 flags.go:64] FLAG: --reserved-cpus="" Jun 09 17:33:16.191238 ip-10-0-143-124 kubenswrapper[2552]: I0609 17:33:16.182523 2552 flags.go:64] FLAG: --reserved-memory="" Jun 09 17:33:16.191238 ip-10-0-143-124 kubenswrapper[2552]: I0609 17:33:16.182529 2552 flags.go:64] FLAG: --resolv-conf="/etc/resolv.conf" Jun 09 17:33:16.191238 ip-10-0-143-124 kubenswrapper[2552]: I0609 17:33:16.182534 2552 flags.go:64] FLAG: --root-dir="/var/lib/kubelet" Jun 09 17:33:16.191238 ip-10-0-143-124 kubenswrapper[2552]: I0609 17:33:16.182541 2552 flags.go:64] FLAG: --rotate-certificates="false" Jun 09 17:33:16.191238 ip-10-0-143-124 kubenswrapper[2552]: I0609 17:33:16.182546 2552 flags.go:64] FLAG: --rotate-server-certificates="false" Jun 09 17:33:16.191238 ip-10-0-143-124 kubenswrapper[2552]: I0609 17:33:16.182551 2552 flags.go:64] FLAG: --runonce="false" Jun 09 17:33:16.191238 ip-10-0-143-124 kubenswrapper[2552]: I0609 17:33:16.182555 2552 flags.go:64] FLAG: --runtime-cgroups="/system.slice/crio.service" Jun 09 17:33:16.191872 ip-10-0-143-124 kubenswrapper[2552]: I0609 17:33:16.182562 2552 flags.go:64] FLAG: --runtime-request-timeout="2m0s" Jun 09 17:33:16.191872 ip-10-0-143-124 kubenswrapper[2552]: I0609 17:33:16.182567 2552 flags.go:64] FLAG: --seccomp-default="false" Jun 09 17:33:16.191872 ip-10-0-143-124 kubenswrapper[2552]: I0609 17:33:16.182572 2552 flags.go:64] FLAG: --serialize-image-pulls="true" Jun 09 17:33:16.191872 ip-10-0-143-124 kubenswrapper[2552]: I0609 17:33:16.182576 2552 flags.go:64] FLAG: --storage-driver-buffer-duration="1m0s" Jun 09 17:33:16.191872 ip-10-0-143-124 kubenswrapper[2552]: I0609 17:33:16.182581 2552 flags.go:64] FLAG: --storage-driver-db="cadvisor" Jun 09 17:33:16.191872 ip-10-0-143-124 kubenswrapper[2552]: I0609 17:33:16.182586 2552 flags.go:64] FLAG: --storage-driver-host="localhost:8086" Jun 09 17:33:16.191872 ip-10-0-143-124 kubenswrapper[2552]: I0609 17:33:16.182591 2552 flags.go:64] FLAG: --storage-driver-password="root" Jun 09 17:33:16.191872 ip-10-0-143-124 kubenswrapper[2552]: I0609 17:33:16.182612 2552 flags.go:64] FLAG: --storage-driver-secure="false" Jun 09 17:33:16.191872 ip-10-0-143-124 kubenswrapper[2552]: I0609 17:33:16.182617 2552 flags.go:64] FLAG: --storage-driver-table="stats" Jun 09 17:33:16.191872 ip-10-0-143-124 kubenswrapper[2552]: I0609 17:33:16.182622 2552 flags.go:64] FLAG: --storage-driver-user="root" Jun 09 17:33:16.191872 ip-10-0-143-124 kubenswrapper[2552]: I0609 17:33:16.182627 2552 flags.go:64] FLAG: --streaming-connection-idle-timeout="4h0m0s" Jun 09 17:33:16.191872 ip-10-0-143-124 kubenswrapper[2552]: I0609 17:33:16.182632 2552 flags.go:64] FLAG: --sync-frequency="1m0s" Jun 09 17:33:16.191872 ip-10-0-143-124 kubenswrapper[2552]: I0609 17:33:16.182645 2552 flags.go:64] FLAG: --system-cgroups="" Jun 09 17:33:16.191872 ip-10-0-143-124 kubenswrapper[2552]: I0609 17:33:16.182649 2552 flags.go:64] FLAG: --system-reserved="cpu=500m,ephemeral-storage=1Gi,memory=1Gi" Jun 09 17:33:16.191872 ip-10-0-143-124 kubenswrapper[2552]: I0609 17:33:16.182658 2552 flags.go:64] FLAG: --system-reserved-cgroup="" Jun 09 17:33:16.191872 ip-10-0-143-124 kubenswrapper[2552]: I0609 17:33:16.182663 2552 flags.go:64] FLAG: --tls-cert-file="" Jun 09 17:33:16.191872 ip-10-0-143-124 kubenswrapper[2552]: I0609 17:33:16.182668 2552 flags.go:64] FLAG: --tls-cipher-suites="[]" Jun 09 17:33:16.191872 ip-10-0-143-124 kubenswrapper[2552]: I0609 17:33:16.182675 2552 flags.go:64] FLAG: --tls-min-version="" Jun 09 17:33:16.191872 ip-10-0-143-124 kubenswrapper[2552]: I0609 17:33:16.182680 2552 flags.go:64] FLAG: --tls-private-key-file="" Jun 09 17:33:16.191872 ip-10-0-143-124 kubenswrapper[2552]: I0609 17:33:16.182684 2552 flags.go:64] FLAG: --topology-manager-policy="none" Jun 09 17:33:16.191872 ip-10-0-143-124 kubenswrapper[2552]: I0609 17:33:16.182689 2552 flags.go:64] FLAG: --topology-manager-policy-options="" Jun 09 17:33:16.191872 ip-10-0-143-124 kubenswrapper[2552]: I0609 17:33:16.182694 2552 flags.go:64] FLAG: --topology-manager-scope="container" Jun 09 17:33:16.191872 ip-10-0-143-124 kubenswrapper[2552]: I0609 17:33:16.182699 2552 flags.go:64] FLAG: --v="2" Jun 09 17:33:16.191872 ip-10-0-143-124 kubenswrapper[2552]: I0609 17:33:16.182706 2552 flags.go:64] FLAG: --version="false" Jun 09 17:33:16.191872 ip-10-0-143-124 kubenswrapper[2552]: I0609 17:33:16.182713 2552 flags.go:64] FLAG: --vmodule="" Jun 09 17:33:16.192485 ip-10-0-143-124 kubenswrapper[2552]: I0609 17:33:16.182719 2552 flags.go:64] FLAG: --volume-plugin-dir="/etc/kubernetes/kubelet-plugins/volume/exec" Jun 09 17:33:16.192485 ip-10-0-143-124 kubenswrapper[2552]: I0609 17:33:16.182724 2552 flags.go:64] FLAG: --volume-stats-agg-period="1m0s" Jun 09 17:33:16.192485 ip-10-0-143-124 kubenswrapper[2552]: W0609 17:33:16.182922 2552 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jun 09 17:33:16.192485 ip-10-0-143-124 kubenswrapper[2552]: W0609 17:33:16.182930 2552 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jun 09 17:33:16.192485 ip-10-0-143-124 kubenswrapper[2552]: W0609 17:33:16.182934 2552 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jun 09 17:33:16.192485 ip-10-0-143-124 kubenswrapper[2552]: W0609 17:33:16.182938 2552 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jun 09 17:33:16.192485 ip-10-0-143-124 kubenswrapper[2552]: W0609 17:33:16.182943 2552 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jun 09 17:33:16.192485 ip-10-0-143-124 kubenswrapper[2552]: W0609 17:33:16.182948 2552 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jun 09 17:33:16.192485 ip-10-0-143-124 kubenswrapper[2552]: W0609 17:33:16.182953 2552 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jun 09 17:33:16.192485 ip-10-0-143-124 kubenswrapper[2552]: W0609 17:33:16.182956 2552 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jun 09 17:33:16.192485 ip-10-0-143-124 kubenswrapper[2552]: W0609 17:33:16.182961 2552 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jun 09 17:33:16.192485 ip-10-0-143-124 kubenswrapper[2552]: W0609 17:33:16.182965 2552 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jun 09 17:33:16.192485 ip-10-0-143-124 kubenswrapper[2552]: W0609 17:33:16.182969 2552 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jun 09 17:33:16.192485 ip-10-0-143-124 kubenswrapper[2552]: W0609 17:33:16.182974 2552 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jun 09 17:33:16.192485 ip-10-0-143-124 kubenswrapper[2552]: W0609 17:33:16.182978 2552 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jun 09 17:33:16.192485 ip-10-0-143-124 kubenswrapper[2552]: W0609 17:33:16.182992 2552 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jun 09 17:33:16.192485 ip-10-0-143-124 kubenswrapper[2552]: W0609 17:33:16.182998 2552 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jun 09 17:33:16.192485 ip-10-0-143-124 kubenswrapper[2552]: W0609 17:33:16.183004 2552 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jun 09 17:33:16.192485 ip-10-0-143-124 kubenswrapper[2552]: W0609 17:33:16.183009 2552 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jun 09 17:33:16.192950 ip-10-0-143-124 kubenswrapper[2552]: W0609 17:33:16.183014 2552 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jun 09 17:33:16.192950 ip-10-0-143-124 kubenswrapper[2552]: W0609 17:33:16.183020 2552 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jun 09 17:33:16.192950 ip-10-0-143-124 kubenswrapper[2552]: W0609 17:33:16.183024 2552 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jun 09 17:33:16.192950 ip-10-0-143-124 kubenswrapper[2552]: W0609 17:33:16.183028 2552 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jun 09 17:33:16.192950 ip-10-0-143-124 kubenswrapper[2552]: W0609 17:33:16.183033 2552 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jun 09 17:33:16.192950 ip-10-0-143-124 kubenswrapper[2552]: W0609 17:33:16.183037 2552 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jun 09 17:33:16.192950 ip-10-0-143-124 kubenswrapper[2552]: W0609 17:33:16.183042 2552 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jun 09 17:33:16.192950 ip-10-0-143-124 kubenswrapper[2552]: W0609 17:33:16.183046 2552 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jun 09 17:33:16.192950 ip-10-0-143-124 kubenswrapper[2552]: W0609 17:33:16.183052 2552 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jun 09 17:33:16.192950 ip-10-0-143-124 kubenswrapper[2552]: W0609 17:33:16.183058 2552 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jun 09 17:33:16.192950 ip-10-0-143-124 kubenswrapper[2552]: W0609 17:33:16.183062 2552 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jun 09 17:33:16.192950 ip-10-0-143-124 kubenswrapper[2552]: W0609 17:33:16.183067 2552 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jun 09 17:33:16.192950 ip-10-0-143-124 kubenswrapper[2552]: W0609 17:33:16.183072 2552 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jun 09 17:33:16.192950 ip-10-0-143-124 kubenswrapper[2552]: W0609 17:33:16.183077 2552 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jun 09 17:33:16.192950 ip-10-0-143-124 kubenswrapper[2552]: W0609 17:33:16.183081 2552 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jun 09 17:33:16.192950 ip-10-0-143-124 kubenswrapper[2552]: W0609 17:33:16.183085 2552 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jun 09 17:33:16.192950 ip-10-0-143-124 kubenswrapper[2552]: W0609 17:33:16.183091 2552 feature_gate.go:328] unrecognized feature gate: Example Jun 09 17:33:16.192950 ip-10-0-143-124 kubenswrapper[2552]: W0609 17:33:16.183096 2552 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jun 09 17:33:16.192950 ip-10-0-143-124 kubenswrapper[2552]: W0609 17:33:16.183100 2552 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jun 09 17:33:16.193418 ip-10-0-143-124 kubenswrapper[2552]: W0609 17:33:16.183104 2552 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jun 09 17:33:16.193418 ip-10-0-143-124 kubenswrapper[2552]: W0609 17:33:16.183110 2552 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jun 09 17:33:16.193418 ip-10-0-143-124 kubenswrapper[2552]: W0609 17:33:16.183115 2552 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jun 09 17:33:16.193418 ip-10-0-143-124 kubenswrapper[2552]: W0609 17:33:16.183119 2552 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jun 09 17:33:16.193418 ip-10-0-143-124 kubenswrapper[2552]: W0609 17:33:16.183124 2552 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jun 09 17:33:16.193418 ip-10-0-143-124 kubenswrapper[2552]: W0609 17:33:16.183128 2552 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jun 09 17:33:16.193418 ip-10-0-143-124 kubenswrapper[2552]: W0609 17:33:16.183132 2552 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jun 09 17:33:16.193418 ip-10-0-143-124 kubenswrapper[2552]: W0609 17:33:16.183136 2552 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jun 09 17:33:16.193418 ip-10-0-143-124 kubenswrapper[2552]: W0609 17:33:16.183140 2552 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jun 09 17:33:16.193418 ip-10-0-143-124 kubenswrapper[2552]: W0609 17:33:16.183145 2552 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jun 09 17:33:16.193418 ip-10-0-143-124 kubenswrapper[2552]: W0609 17:33:16.183150 2552 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jun 09 17:33:16.193418 ip-10-0-143-124 kubenswrapper[2552]: W0609 17:33:16.183154 2552 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jun 09 17:33:16.193418 ip-10-0-143-124 kubenswrapper[2552]: W0609 17:33:16.183158 2552 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jun 09 17:33:16.193418 ip-10-0-143-124 kubenswrapper[2552]: W0609 17:33:16.183162 2552 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jun 09 17:33:16.193418 ip-10-0-143-124 kubenswrapper[2552]: W0609 17:33:16.183166 2552 feature_gate.go:328] unrecognized feature gate: SignatureStores Jun 09 17:33:16.193418 ip-10-0-143-124 kubenswrapper[2552]: W0609 17:33:16.183171 2552 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jun 09 17:33:16.193418 ip-10-0-143-124 kubenswrapper[2552]: W0609 17:33:16.183175 2552 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jun 09 17:33:16.193418 ip-10-0-143-124 kubenswrapper[2552]: W0609 17:33:16.183180 2552 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jun 09 17:33:16.193418 ip-10-0-143-124 kubenswrapper[2552]: W0609 17:33:16.183184 2552 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jun 09 17:33:16.193418 ip-10-0-143-124 kubenswrapper[2552]: W0609 17:33:16.183188 2552 feature_gate.go:328] unrecognized feature gate: EventTTL Jun 09 17:33:16.193993 ip-10-0-143-124 kubenswrapper[2552]: W0609 17:33:16.183192 2552 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jun 09 17:33:16.193993 ip-10-0-143-124 kubenswrapper[2552]: W0609 17:33:16.183196 2552 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jun 09 17:33:16.193993 ip-10-0-143-124 kubenswrapper[2552]: W0609 17:33:16.183201 2552 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jun 09 17:33:16.193993 ip-10-0-143-124 kubenswrapper[2552]: W0609 17:33:16.183205 2552 feature_gate.go:328] unrecognized feature gate: NewOLM Jun 09 17:33:16.193993 ip-10-0-143-124 kubenswrapper[2552]: W0609 17:33:16.183209 2552 feature_gate.go:328] unrecognized feature gate: DualReplica Jun 09 17:33:16.193993 ip-10-0-143-124 kubenswrapper[2552]: W0609 17:33:16.183214 2552 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jun 09 17:33:16.193993 ip-10-0-143-124 kubenswrapper[2552]: W0609 17:33:16.183218 2552 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jun 09 17:33:16.193993 ip-10-0-143-124 kubenswrapper[2552]: W0609 17:33:16.183222 2552 feature_gate.go:328] unrecognized feature gate: Example2 Jun 09 17:33:16.193993 ip-10-0-143-124 kubenswrapper[2552]: W0609 17:33:16.183226 2552 feature_gate.go:328] unrecognized feature gate: OSStreams Jun 09 17:33:16.193993 ip-10-0-143-124 kubenswrapper[2552]: W0609 17:33:16.183232 2552 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jun 09 17:33:16.193993 ip-10-0-143-124 kubenswrapper[2552]: W0609 17:33:16.183236 2552 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jun 09 17:33:16.193993 ip-10-0-143-124 kubenswrapper[2552]: W0609 17:33:16.183243 2552 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jun 09 17:33:16.193993 ip-10-0-143-124 kubenswrapper[2552]: W0609 17:33:16.183248 2552 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jun 09 17:33:16.193993 ip-10-0-143-124 kubenswrapper[2552]: W0609 17:33:16.183254 2552 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jun 09 17:33:16.193993 ip-10-0-143-124 kubenswrapper[2552]: W0609 17:33:16.183258 2552 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jun 09 17:33:16.193993 ip-10-0-143-124 kubenswrapper[2552]: W0609 17:33:16.183263 2552 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jun 09 17:33:16.193993 ip-10-0-143-124 kubenswrapper[2552]: W0609 17:33:16.183267 2552 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jun 09 17:33:16.193993 ip-10-0-143-124 kubenswrapper[2552]: W0609 17:33:16.183271 2552 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jun 09 17:33:16.193993 ip-10-0-143-124 kubenswrapper[2552]: W0609 17:33:16.183276 2552 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jun 09 17:33:16.193993 ip-10-0-143-124 kubenswrapper[2552]: W0609 17:33:16.183280 2552 feature_gate.go:328] unrecognized feature gate: OVNObservability Jun 09 17:33:16.194519 ip-10-0-143-124 kubenswrapper[2552]: W0609 17:33:16.183284 2552 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jun 09 17:33:16.194519 ip-10-0-143-124 kubenswrapper[2552]: W0609 17:33:16.183288 2552 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jun 09 17:33:16.194519 ip-10-0-143-124 kubenswrapper[2552]: W0609 17:33:16.183293 2552 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jun 09 17:33:16.194519 ip-10-0-143-124 kubenswrapper[2552]: W0609 17:33:16.183297 2552 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jun 09 17:33:16.194519 ip-10-0-143-124 kubenswrapper[2552]: W0609 17:33:16.183301 2552 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jun 09 17:33:16.194519 ip-10-0-143-124 kubenswrapper[2552]: W0609 17:33:16.183305 2552 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jun 09 17:33:16.194519 ip-10-0-143-124 kubenswrapper[2552]: W0609 17:33:16.183310 2552 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jun 09 17:33:16.194519 ip-10-0-143-124 kubenswrapper[2552]: W0609 17:33:16.183314 2552 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jun 09 17:33:16.194519 ip-10-0-143-124 kubenswrapper[2552]: W0609 17:33:16.183319 2552 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jun 09 17:33:16.194519 ip-10-0-143-124 kubenswrapper[2552]: W0609 17:33:16.183323 2552 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jun 09 17:33:16.194519 ip-10-0-143-124 kubenswrapper[2552]: W0609 17:33:16.183328 2552 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jun 09 17:33:16.194519 ip-10-0-143-124 kubenswrapper[2552]: W0609 17:33:16.183332 2552 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jun 09 17:33:16.194519 ip-10-0-143-124 kubenswrapper[2552]: W0609 17:33:16.183336 2552 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jun 09 17:33:16.194519 ip-10-0-143-124 kubenswrapper[2552]: W0609 17:33:16.183340 2552 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jun 09 17:33:16.194519 ip-10-0-143-124 kubenswrapper[2552]: W0609 17:33:16.183344 2552 feature_gate.go:328] unrecognized feature gate: PinnedImages Jun 09 17:33:16.194519 ip-10-0-143-124 kubenswrapper[2552]: W0609 17:33:16.183348 2552 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jun 09 17:33:16.194519 ip-10-0-143-124 kubenswrapper[2552]: W0609 17:33:16.183352 2552 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jun 09 17:33:16.194519 ip-10-0-143-124 kubenswrapper[2552]: W0609 17:33:16.183357 2552 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jun 09 17:33:16.194519 ip-10-0-143-124 kubenswrapper[2552]: W0609 17:33:16.183361 2552 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jun 09 17:33:16.194519 ip-10-0-143-124 kubenswrapper[2552]: W0609 17:33:16.183365 2552 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jun 09 17:33:16.195033 ip-10-0-143-124 kubenswrapper[2552]: W0609 17:33:16.183369 2552 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jun 09 17:33:16.195033 ip-10-0-143-124 kubenswrapper[2552]: W0609 17:33:16.183375 2552 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jun 09 17:33:16.195033 ip-10-0-143-124 kubenswrapper[2552]: W0609 17:33:16.183379 2552 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jun 09 17:33:16.195033 ip-10-0-143-124 kubenswrapper[2552]: I0609 17:33:16.184019 2552 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]} Jun 09 17:33:16.195033 ip-10-0-143-124 kubenswrapper[2552]: I0609 17:33:16.190874 2552 server.go:529] "Kubelet version" kubeletVersion="v1.34.8" Jun 09 17:33:16.195033 ip-10-0-143-124 kubenswrapper[2552]: I0609 17:33:16.190889 2552 server.go:531] "Golang settings" GOGC="" GOMAXPROCS="" GOTRACEBACK="" Jun 09 17:33:16.195033 ip-10-0-143-124 kubenswrapper[2552]: I0609 17:33:16.190910 2552 watchdog_linux.go:95] "Systemd watchdog is not enabled" Jun 09 17:33:16.195033 ip-10-0-143-124 kubenswrapper[2552]: I0609 17:33:16.190916 2552 watchdog_linux.go:137] "Systemd watchdog is not enabled or the interval is invalid, so health checking will not be started." Jun 09 17:33:16.195033 ip-10-0-143-124 kubenswrapper[2552]: W0609 17:33:16.190971 2552 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jun 09 17:33:16.195033 ip-10-0-143-124 kubenswrapper[2552]: W0609 17:33:16.190976 2552 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jun 09 17:33:16.195033 ip-10-0-143-124 kubenswrapper[2552]: W0609 17:33:16.190979 2552 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jun 09 17:33:16.195033 ip-10-0-143-124 kubenswrapper[2552]: W0609 17:33:16.190982 2552 feature_gate.go:328] unrecognized feature gate: EventTTL Jun 09 17:33:16.195033 ip-10-0-143-124 kubenswrapper[2552]: W0609 17:33:16.190985 2552 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jun 09 17:33:16.195033 ip-10-0-143-124 kubenswrapper[2552]: W0609 17:33:16.190988 2552 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jun 09 17:33:16.195033 ip-10-0-143-124 kubenswrapper[2552]: W0609 17:33:16.190990 2552 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jun 09 17:33:16.195410 ip-10-0-143-124 kubenswrapper[2552]: W0609 17:33:16.190993 2552 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jun 09 17:33:16.195410 ip-10-0-143-124 kubenswrapper[2552]: W0609 17:33:16.190996 2552 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jun 09 17:33:16.195410 ip-10-0-143-124 kubenswrapper[2552]: W0609 17:33:16.190998 2552 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jun 09 17:33:16.195410 ip-10-0-143-124 kubenswrapper[2552]: W0609 17:33:16.191001 2552 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jun 09 17:33:16.195410 ip-10-0-143-124 kubenswrapper[2552]: W0609 17:33:16.191004 2552 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jun 09 17:33:16.195410 ip-10-0-143-124 kubenswrapper[2552]: W0609 17:33:16.191006 2552 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jun 09 17:33:16.195410 ip-10-0-143-124 kubenswrapper[2552]: W0609 17:33:16.191009 2552 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jun 09 17:33:16.195410 ip-10-0-143-124 kubenswrapper[2552]: W0609 17:33:16.191012 2552 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jun 09 17:33:16.195410 ip-10-0-143-124 kubenswrapper[2552]: W0609 17:33:16.191015 2552 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jun 09 17:33:16.195410 ip-10-0-143-124 kubenswrapper[2552]: W0609 17:33:16.191017 2552 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jun 09 17:33:16.195410 ip-10-0-143-124 kubenswrapper[2552]: W0609 17:33:16.191021 2552 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jun 09 17:33:16.195410 ip-10-0-143-124 kubenswrapper[2552]: W0609 17:33:16.191025 2552 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jun 09 17:33:16.195410 ip-10-0-143-124 kubenswrapper[2552]: W0609 17:33:16.191028 2552 feature_gate.go:328] unrecognized feature gate: OVNObservability Jun 09 17:33:16.195410 ip-10-0-143-124 kubenswrapper[2552]: W0609 17:33:16.191031 2552 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jun 09 17:33:16.195410 ip-10-0-143-124 kubenswrapper[2552]: W0609 17:33:16.191034 2552 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jun 09 17:33:16.195410 ip-10-0-143-124 kubenswrapper[2552]: W0609 17:33:16.191037 2552 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jun 09 17:33:16.195410 ip-10-0-143-124 kubenswrapper[2552]: W0609 17:33:16.191039 2552 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jun 09 17:33:16.195410 ip-10-0-143-124 kubenswrapper[2552]: W0609 17:33:16.191042 2552 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jun 09 17:33:16.195410 ip-10-0-143-124 kubenswrapper[2552]: W0609 17:33:16.191045 2552 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jun 09 17:33:16.195894 ip-10-0-143-124 kubenswrapper[2552]: W0609 17:33:16.191047 2552 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jun 09 17:33:16.195894 ip-10-0-143-124 kubenswrapper[2552]: W0609 17:33:16.191050 2552 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jun 09 17:33:16.195894 ip-10-0-143-124 kubenswrapper[2552]: W0609 17:33:16.191052 2552 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jun 09 17:33:16.195894 ip-10-0-143-124 kubenswrapper[2552]: W0609 17:33:16.191056 2552 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jun 09 17:33:16.195894 ip-10-0-143-124 kubenswrapper[2552]: W0609 17:33:16.191059 2552 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jun 09 17:33:16.195894 ip-10-0-143-124 kubenswrapper[2552]: W0609 17:33:16.191062 2552 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jun 09 17:33:16.195894 ip-10-0-143-124 kubenswrapper[2552]: W0609 17:33:16.191064 2552 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jun 09 17:33:16.195894 ip-10-0-143-124 kubenswrapper[2552]: W0609 17:33:16.191067 2552 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jun 09 17:33:16.195894 ip-10-0-143-124 kubenswrapper[2552]: W0609 17:33:16.191070 2552 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jun 09 17:33:16.195894 ip-10-0-143-124 kubenswrapper[2552]: W0609 17:33:16.191072 2552 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jun 09 17:33:16.195894 ip-10-0-143-124 kubenswrapper[2552]: W0609 17:33:16.191075 2552 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jun 09 17:33:16.195894 ip-10-0-143-124 kubenswrapper[2552]: W0609 17:33:16.191078 2552 feature_gate.go:328] unrecognized feature gate: SignatureStores Jun 09 17:33:16.195894 ip-10-0-143-124 kubenswrapper[2552]: W0609 17:33:16.191080 2552 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jun 09 17:33:16.195894 ip-10-0-143-124 kubenswrapper[2552]: W0609 17:33:16.191083 2552 feature_gate.go:328] unrecognized feature gate: PinnedImages Jun 09 17:33:16.195894 ip-10-0-143-124 kubenswrapper[2552]: W0609 17:33:16.191086 2552 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jun 09 17:33:16.195894 ip-10-0-143-124 kubenswrapper[2552]: W0609 17:33:16.191089 2552 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jun 09 17:33:16.195894 ip-10-0-143-124 kubenswrapper[2552]: W0609 17:33:16.191091 2552 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jun 09 17:33:16.195894 ip-10-0-143-124 kubenswrapper[2552]: W0609 17:33:16.191094 2552 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jun 09 17:33:16.195894 ip-10-0-143-124 kubenswrapper[2552]: W0609 17:33:16.191096 2552 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jun 09 17:33:16.195894 ip-10-0-143-124 kubenswrapper[2552]: W0609 17:33:16.191099 2552 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jun 09 17:33:16.196641 ip-10-0-143-124 kubenswrapper[2552]: W0609 17:33:16.191102 2552 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jun 09 17:33:16.196641 ip-10-0-143-124 kubenswrapper[2552]: W0609 17:33:16.191104 2552 feature_gate.go:328] unrecognized feature gate: OSStreams Jun 09 17:33:16.196641 ip-10-0-143-124 kubenswrapper[2552]: W0609 17:33:16.191107 2552 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jun 09 17:33:16.196641 ip-10-0-143-124 kubenswrapper[2552]: W0609 17:33:16.191109 2552 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jun 09 17:33:16.196641 ip-10-0-143-124 kubenswrapper[2552]: W0609 17:33:16.191112 2552 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jun 09 17:33:16.196641 ip-10-0-143-124 kubenswrapper[2552]: W0609 17:33:16.191115 2552 feature_gate.go:328] unrecognized feature gate: DualReplica Jun 09 17:33:16.196641 ip-10-0-143-124 kubenswrapper[2552]: W0609 17:33:16.191118 2552 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jun 09 17:33:16.196641 ip-10-0-143-124 kubenswrapper[2552]: W0609 17:33:16.191120 2552 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jun 09 17:33:16.196641 ip-10-0-143-124 kubenswrapper[2552]: W0609 17:33:16.191123 2552 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jun 09 17:33:16.196641 ip-10-0-143-124 kubenswrapper[2552]: W0609 17:33:16.191125 2552 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jun 09 17:33:16.196641 ip-10-0-143-124 kubenswrapper[2552]: W0609 17:33:16.191128 2552 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jun 09 17:33:16.196641 ip-10-0-143-124 kubenswrapper[2552]: W0609 17:33:16.191131 2552 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jun 09 17:33:16.196641 ip-10-0-143-124 kubenswrapper[2552]: W0609 17:33:16.191133 2552 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jun 09 17:33:16.196641 ip-10-0-143-124 kubenswrapper[2552]: W0609 17:33:16.191136 2552 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jun 09 17:33:16.196641 ip-10-0-143-124 kubenswrapper[2552]: W0609 17:33:16.191138 2552 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jun 09 17:33:16.196641 ip-10-0-143-124 kubenswrapper[2552]: W0609 17:33:16.191142 2552 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jun 09 17:33:16.196641 ip-10-0-143-124 kubenswrapper[2552]: W0609 17:33:16.191145 2552 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jun 09 17:33:16.196641 ip-10-0-143-124 kubenswrapper[2552]: W0609 17:33:16.191148 2552 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jun 09 17:33:16.196641 ip-10-0-143-124 kubenswrapper[2552]: W0609 17:33:16.191150 2552 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jun 09 17:33:16.196641 ip-10-0-143-124 kubenswrapper[2552]: W0609 17:33:16.191153 2552 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jun 09 17:33:16.197426 ip-10-0-143-124 kubenswrapper[2552]: W0609 17:33:16.191155 2552 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jun 09 17:33:16.197426 ip-10-0-143-124 kubenswrapper[2552]: W0609 17:33:16.191158 2552 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jun 09 17:33:16.197426 ip-10-0-143-124 kubenswrapper[2552]: W0609 17:33:16.191161 2552 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jun 09 17:33:16.197426 ip-10-0-143-124 kubenswrapper[2552]: W0609 17:33:16.191164 2552 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jun 09 17:33:16.197426 ip-10-0-143-124 kubenswrapper[2552]: W0609 17:33:16.191168 2552 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jun 09 17:33:16.197426 ip-10-0-143-124 kubenswrapper[2552]: W0609 17:33:16.191171 2552 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jun 09 17:33:16.197426 ip-10-0-143-124 kubenswrapper[2552]: W0609 17:33:16.191173 2552 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jun 09 17:33:16.197426 ip-10-0-143-124 kubenswrapper[2552]: W0609 17:33:16.191176 2552 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jun 09 17:33:16.197426 ip-10-0-143-124 kubenswrapper[2552]: W0609 17:33:16.191178 2552 feature_gate.go:328] unrecognized feature gate: Example Jun 09 17:33:16.197426 ip-10-0-143-124 kubenswrapper[2552]: W0609 17:33:16.191181 2552 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jun 09 17:33:16.197426 ip-10-0-143-124 kubenswrapper[2552]: W0609 17:33:16.191184 2552 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jun 09 17:33:16.197426 ip-10-0-143-124 kubenswrapper[2552]: W0609 17:33:16.191186 2552 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jun 09 17:33:16.197426 ip-10-0-143-124 kubenswrapper[2552]: W0609 17:33:16.191189 2552 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jun 09 17:33:16.197426 ip-10-0-143-124 kubenswrapper[2552]: W0609 17:33:16.191192 2552 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jun 09 17:33:16.197426 ip-10-0-143-124 kubenswrapper[2552]: W0609 17:33:16.191194 2552 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jun 09 17:33:16.197426 ip-10-0-143-124 kubenswrapper[2552]: W0609 17:33:16.191197 2552 feature_gate.go:328] unrecognized feature gate: Example2 Jun 09 17:33:16.197426 ip-10-0-143-124 kubenswrapper[2552]: W0609 17:33:16.191199 2552 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jun 09 17:33:16.197426 ip-10-0-143-124 kubenswrapper[2552]: W0609 17:33:16.191202 2552 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jun 09 17:33:16.197426 ip-10-0-143-124 kubenswrapper[2552]: W0609 17:33:16.191204 2552 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jun 09 17:33:16.197926 ip-10-0-143-124 kubenswrapper[2552]: W0609 17:33:16.191207 2552 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jun 09 17:33:16.197926 ip-10-0-143-124 kubenswrapper[2552]: W0609 17:33:16.191209 2552 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jun 09 17:33:16.197926 ip-10-0-143-124 kubenswrapper[2552]: W0609 17:33:16.191212 2552 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jun 09 17:33:16.197926 ip-10-0-143-124 kubenswrapper[2552]: W0609 17:33:16.191214 2552 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jun 09 17:33:16.197926 ip-10-0-143-124 kubenswrapper[2552]: W0609 17:33:16.191217 2552 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jun 09 17:33:16.197926 ip-10-0-143-124 kubenswrapper[2552]: W0609 17:33:16.191220 2552 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jun 09 17:33:16.197926 ip-10-0-143-124 kubenswrapper[2552]: W0609 17:33:16.191222 2552 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jun 09 17:33:16.197926 ip-10-0-143-124 kubenswrapper[2552]: W0609 17:33:16.191225 2552 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jun 09 17:33:16.197926 ip-10-0-143-124 kubenswrapper[2552]: W0609 17:33:16.191229 2552 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jun 09 17:33:16.197926 ip-10-0-143-124 kubenswrapper[2552]: W0609 17:33:16.191231 2552 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jun 09 17:33:16.197926 ip-10-0-143-124 kubenswrapper[2552]: W0609 17:33:16.191236 2552 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jun 09 17:33:16.197926 ip-10-0-143-124 kubenswrapper[2552]: W0609 17:33:16.191239 2552 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jun 09 17:33:16.197926 ip-10-0-143-124 kubenswrapper[2552]: W0609 17:33:16.191242 2552 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jun 09 17:33:16.197926 ip-10-0-143-124 kubenswrapper[2552]: W0609 17:33:16.191245 2552 feature_gate.go:328] unrecognized feature gate: NewOLM Jun 09 17:33:16.197926 ip-10-0-143-124 kubenswrapper[2552]: I0609 17:33:16.191249 2552 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]} Jun 09 17:33:16.198377 ip-10-0-143-124 kubenswrapper[2552]: W0609 17:33:16.191363 2552 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jun 09 17:33:16.198377 ip-10-0-143-124 kubenswrapper[2552]: W0609 17:33:16.191368 2552 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jun 09 17:33:16.198377 ip-10-0-143-124 kubenswrapper[2552]: W0609 17:33:16.191371 2552 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jun 09 17:33:16.198377 ip-10-0-143-124 kubenswrapper[2552]: W0609 17:33:16.191374 2552 feature_gate.go:328] unrecognized feature gate: NewOLM Jun 09 17:33:16.198377 ip-10-0-143-124 kubenswrapper[2552]: W0609 17:33:16.191377 2552 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jun 09 17:33:16.198377 ip-10-0-143-124 kubenswrapper[2552]: W0609 17:33:16.191380 2552 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jun 09 17:33:16.198377 ip-10-0-143-124 kubenswrapper[2552]: W0609 17:33:16.191382 2552 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jun 09 17:33:16.198377 ip-10-0-143-124 kubenswrapper[2552]: W0609 17:33:16.191385 2552 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jun 09 17:33:16.198377 ip-10-0-143-124 kubenswrapper[2552]: W0609 17:33:16.191388 2552 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jun 09 17:33:16.198377 ip-10-0-143-124 kubenswrapper[2552]: W0609 17:33:16.191391 2552 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jun 09 17:33:16.198377 ip-10-0-143-124 kubenswrapper[2552]: W0609 17:33:16.191394 2552 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jun 09 17:33:16.198377 ip-10-0-143-124 kubenswrapper[2552]: W0609 17:33:16.191397 2552 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jun 09 17:33:16.198377 ip-10-0-143-124 kubenswrapper[2552]: W0609 17:33:16.191400 2552 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jun 09 17:33:16.198377 ip-10-0-143-124 kubenswrapper[2552]: W0609 17:33:16.191403 2552 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jun 09 17:33:16.198377 ip-10-0-143-124 kubenswrapper[2552]: W0609 17:33:16.191405 2552 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jun 09 17:33:16.198377 ip-10-0-143-124 kubenswrapper[2552]: W0609 17:33:16.191408 2552 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jun 09 17:33:16.198377 ip-10-0-143-124 kubenswrapper[2552]: W0609 17:33:16.191410 2552 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jun 09 17:33:16.198377 ip-10-0-143-124 kubenswrapper[2552]: W0609 17:33:16.191412 2552 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jun 09 17:33:16.198377 ip-10-0-143-124 kubenswrapper[2552]: W0609 17:33:16.191415 2552 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jun 09 17:33:16.198377 ip-10-0-143-124 kubenswrapper[2552]: W0609 17:33:16.191418 2552 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jun 09 17:33:16.198888 ip-10-0-143-124 kubenswrapper[2552]: W0609 17:33:16.191420 2552 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jun 09 17:33:16.198888 ip-10-0-143-124 kubenswrapper[2552]: W0609 17:33:16.191422 2552 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jun 09 17:33:16.198888 ip-10-0-143-124 kubenswrapper[2552]: W0609 17:33:16.191425 2552 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jun 09 17:33:16.198888 ip-10-0-143-124 kubenswrapper[2552]: W0609 17:33:16.191428 2552 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jun 09 17:33:16.198888 ip-10-0-143-124 kubenswrapper[2552]: W0609 17:33:16.191430 2552 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jun 09 17:33:16.198888 ip-10-0-143-124 kubenswrapper[2552]: W0609 17:33:16.191433 2552 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jun 09 17:33:16.198888 ip-10-0-143-124 kubenswrapper[2552]: W0609 17:33:16.191436 2552 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jun 09 17:33:16.198888 ip-10-0-143-124 kubenswrapper[2552]: W0609 17:33:16.191438 2552 feature_gate.go:328] unrecognized feature gate: PinnedImages Jun 09 17:33:16.198888 ip-10-0-143-124 kubenswrapper[2552]: W0609 17:33:16.191441 2552 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jun 09 17:33:16.198888 ip-10-0-143-124 kubenswrapper[2552]: W0609 17:33:16.191443 2552 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jun 09 17:33:16.198888 ip-10-0-143-124 kubenswrapper[2552]: W0609 17:33:16.191446 2552 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jun 09 17:33:16.198888 ip-10-0-143-124 kubenswrapper[2552]: W0609 17:33:16.191448 2552 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jun 09 17:33:16.198888 ip-10-0-143-124 kubenswrapper[2552]: W0609 17:33:16.191451 2552 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jun 09 17:33:16.198888 ip-10-0-143-124 kubenswrapper[2552]: W0609 17:33:16.191453 2552 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jun 09 17:33:16.198888 ip-10-0-143-124 kubenswrapper[2552]: W0609 17:33:16.191456 2552 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jun 09 17:33:16.198888 ip-10-0-143-124 kubenswrapper[2552]: W0609 17:33:16.191458 2552 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jun 09 17:33:16.198888 ip-10-0-143-124 kubenswrapper[2552]: W0609 17:33:16.191462 2552 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jun 09 17:33:16.198888 ip-10-0-143-124 kubenswrapper[2552]: W0609 17:33:16.191466 2552 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jun 09 17:33:16.198888 ip-10-0-143-124 kubenswrapper[2552]: W0609 17:33:16.191469 2552 feature_gate.go:328] unrecognized feature gate: OSStreams Jun 09 17:33:16.198888 ip-10-0-143-124 kubenswrapper[2552]: W0609 17:33:16.191472 2552 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jun 09 17:33:16.199577 ip-10-0-143-124 kubenswrapper[2552]: W0609 17:33:16.191475 2552 feature_gate.go:328] unrecognized feature gate: SignatureStores Jun 09 17:33:16.199577 ip-10-0-143-124 kubenswrapper[2552]: W0609 17:33:16.191477 2552 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jun 09 17:33:16.199577 ip-10-0-143-124 kubenswrapper[2552]: W0609 17:33:16.191481 2552 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jun 09 17:33:16.199577 ip-10-0-143-124 kubenswrapper[2552]: W0609 17:33:16.191484 2552 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jun 09 17:33:16.199577 ip-10-0-143-124 kubenswrapper[2552]: W0609 17:33:16.191487 2552 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jun 09 17:33:16.199577 ip-10-0-143-124 kubenswrapper[2552]: W0609 17:33:16.191489 2552 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jun 09 17:33:16.199577 ip-10-0-143-124 kubenswrapper[2552]: W0609 17:33:16.191492 2552 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jun 09 17:33:16.199577 ip-10-0-143-124 kubenswrapper[2552]: W0609 17:33:16.191495 2552 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jun 09 17:33:16.199577 ip-10-0-143-124 kubenswrapper[2552]: W0609 17:33:16.191498 2552 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jun 09 17:33:16.199577 ip-10-0-143-124 kubenswrapper[2552]: W0609 17:33:16.191501 2552 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jun 09 17:33:16.199577 ip-10-0-143-124 kubenswrapper[2552]: W0609 17:33:16.191503 2552 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jun 09 17:33:16.199577 ip-10-0-143-124 kubenswrapper[2552]: W0609 17:33:16.191506 2552 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jun 09 17:33:16.199577 ip-10-0-143-124 kubenswrapper[2552]: W0609 17:33:16.191508 2552 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jun 09 17:33:16.199577 ip-10-0-143-124 kubenswrapper[2552]: W0609 17:33:16.191511 2552 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jun 09 17:33:16.199577 ip-10-0-143-124 kubenswrapper[2552]: W0609 17:33:16.191514 2552 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jun 09 17:33:16.199577 ip-10-0-143-124 kubenswrapper[2552]: W0609 17:33:16.191516 2552 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jun 09 17:33:16.199577 ip-10-0-143-124 kubenswrapper[2552]: W0609 17:33:16.191519 2552 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jun 09 17:33:16.199577 ip-10-0-143-124 kubenswrapper[2552]: W0609 17:33:16.191522 2552 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jun 09 17:33:16.199577 ip-10-0-143-124 kubenswrapper[2552]: W0609 17:33:16.191524 2552 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jun 09 17:33:16.200125 ip-10-0-143-124 kubenswrapper[2552]: W0609 17:33:16.191527 2552 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jun 09 17:33:16.200125 ip-10-0-143-124 kubenswrapper[2552]: W0609 17:33:16.191529 2552 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jun 09 17:33:16.200125 ip-10-0-143-124 kubenswrapper[2552]: W0609 17:33:16.191533 2552 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jun 09 17:33:16.200125 ip-10-0-143-124 kubenswrapper[2552]: W0609 17:33:16.191535 2552 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jun 09 17:33:16.200125 ip-10-0-143-124 kubenswrapper[2552]: W0609 17:33:16.191538 2552 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jun 09 17:33:16.200125 ip-10-0-143-124 kubenswrapper[2552]: W0609 17:33:16.191540 2552 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jun 09 17:33:16.200125 ip-10-0-143-124 kubenswrapper[2552]: W0609 17:33:16.191543 2552 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jun 09 17:33:16.200125 ip-10-0-143-124 kubenswrapper[2552]: W0609 17:33:16.191545 2552 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jun 09 17:33:16.200125 ip-10-0-143-124 kubenswrapper[2552]: W0609 17:33:16.191548 2552 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jun 09 17:33:16.200125 ip-10-0-143-124 kubenswrapper[2552]: W0609 17:33:16.191550 2552 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jun 09 17:33:16.200125 ip-10-0-143-124 kubenswrapper[2552]: W0609 17:33:16.191553 2552 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jun 09 17:33:16.200125 ip-10-0-143-124 kubenswrapper[2552]: W0609 17:33:16.191555 2552 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jun 09 17:33:16.200125 ip-10-0-143-124 kubenswrapper[2552]: W0609 17:33:16.191558 2552 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jun 09 17:33:16.200125 ip-10-0-143-124 kubenswrapper[2552]: W0609 17:33:16.191560 2552 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jun 09 17:33:16.200125 ip-10-0-143-124 kubenswrapper[2552]: W0609 17:33:16.191563 2552 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jun 09 17:33:16.200125 ip-10-0-143-124 kubenswrapper[2552]: W0609 17:33:16.191566 2552 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jun 09 17:33:16.200125 ip-10-0-143-124 kubenswrapper[2552]: W0609 17:33:16.191568 2552 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jun 09 17:33:16.200125 ip-10-0-143-124 kubenswrapper[2552]: W0609 17:33:16.191571 2552 feature_gate.go:328] unrecognized feature gate: DualReplica Jun 09 17:33:16.200125 ip-10-0-143-124 kubenswrapper[2552]: W0609 17:33:16.191573 2552 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jun 09 17:33:16.200642 ip-10-0-143-124 kubenswrapper[2552]: W0609 17:33:16.191576 2552 feature_gate.go:328] unrecognized feature gate: OVNObservability Jun 09 17:33:16.200642 ip-10-0-143-124 kubenswrapper[2552]: W0609 17:33:16.191578 2552 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jun 09 17:33:16.200642 ip-10-0-143-124 kubenswrapper[2552]: W0609 17:33:16.191581 2552 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jun 09 17:33:16.200642 ip-10-0-143-124 kubenswrapper[2552]: W0609 17:33:16.191583 2552 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jun 09 17:33:16.200642 ip-10-0-143-124 kubenswrapper[2552]: W0609 17:33:16.191586 2552 feature_gate.go:328] unrecognized feature gate: Example2 Jun 09 17:33:16.200642 ip-10-0-143-124 kubenswrapper[2552]: W0609 17:33:16.191588 2552 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jun 09 17:33:16.200642 ip-10-0-143-124 kubenswrapper[2552]: W0609 17:33:16.191591 2552 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jun 09 17:33:16.200642 ip-10-0-143-124 kubenswrapper[2552]: W0609 17:33:16.191593 2552 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jun 09 17:33:16.200642 ip-10-0-143-124 kubenswrapper[2552]: W0609 17:33:16.191609 2552 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jun 09 17:33:16.200642 ip-10-0-143-124 kubenswrapper[2552]: W0609 17:33:16.191611 2552 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jun 09 17:33:16.200642 ip-10-0-143-124 kubenswrapper[2552]: W0609 17:33:16.191614 2552 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jun 09 17:33:16.200642 ip-10-0-143-124 kubenswrapper[2552]: W0609 17:33:16.191616 2552 feature_gate.go:328] unrecognized feature gate: Example Jun 09 17:33:16.200642 ip-10-0-143-124 kubenswrapper[2552]: W0609 17:33:16.191619 2552 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jun 09 17:33:16.200642 ip-10-0-143-124 kubenswrapper[2552]: W0609 17:33:16.191622 2552 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jun 09 17:33:16.200642 ip-10-0-143-124 kubenswrapper[2552]: W0609 17:33:16.191626 2552 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jun 09 17:33:16.200642 ip-10-0-143-124 kubenswrapper[2552]: W0609 17:33:16.191630 2552 feature_gate.go:328] unrecognized feature gate: EventTTL Jun 09 17:33:16.200642 ip-10-0-143-124 kubenswrapper[2552]: W0609 17:33:16.191633 2552 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jun 09 17:33:16.200642 ip-10-0-143-124 kubenswrapper[2552]: W0609 17:33:16.191636 2552 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jun 09 17:33:16.200642 ip-10-0-143-124 kubenswrapper[2552]: W0609 17:33:16.191638 2552 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jun 09 17:33:16.200642 ip-10-0-143-124 kubenswrapper[2552]: W0609 17:33:16.191641 2552 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jun 09 17:33:16.201135 ip-10-0-143-124 kubenswrapper[2552]: W0609 17:33:16.191643 2552 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jun 09 17:33:16.201135 ip-10-0-143-124 kubenswrapper[2552]: I0609 17:33:16.191648 2552 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]} Jun 09 17:33:16.201135 ip-10-0-143-124 kubenswrapper[2552]: I0609 17:33:16.191769 2552 server.go:962] "Client rotation is on, will bootstrap in background" Jun 09 17:33:16.201135 ip-10-0-143-124 kubenswrapper[2552]: I0609 17:33:16.193737 2552 bootstrap.go:101] "Use the bootstrap credentials to request a cert, and set kubeconfig to point to the certificate dir" Jun 09 17:33:16.201135 ip-10-0-143-124 kubenswrapper[2552]: I0609 17:33:16.195218 2552 server.go:1019] "Starting client certificate rotation" Jun 09 17:33:16.201135 ip-10-0-143-124 kubenswrapper[2552]: I0609 17:33:16.195317 2552 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kube-apiserver-client-kubelet" Jun 09 17:33:16.201135 ip-10-0-143-124 kubenswrapper[2552]: I0609 17:33:16.195364 2552 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kube-apiserver-client-kubelet" Jun 09 17:33:16.201135 ip-10-0-143-124 kubenswrapper[2552]: I0609 17:33:16.200035 2552 dynamic_cafile_content.go:123] "Loaded a new CA Bundle and Verifier" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt" Jun 09 17:33:16.202866 ip-10-0-143-124 kubenswrapper[2552]: I0609 17:33:16.202845 2552 dynamic_cafile_content.go:161] "Starting controller" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt" Jun 09 17:33:16.216508 ip-10-0-143-124 kubenswrapper[2552]: I0609 17:33:16.216488 2552 log.go:25] "Validated CRI v1 runtime API" Jun 09 17:33:16.219962 ip-10-0-143-124 kubenswrapper[2552]: I0609 17:33:16.219948 2552 log.go:25] "Validated CRI v1 image API" Jun 09 17:33:16.220905 ip-10-0-143-124 kubenswrapper[2552]: I0609 17:33:16.220888 2552 server.go:1429] "Using cgroup driver setting received from the CRI runtime" cgroupDriver="systemd" Jun 09 17:33:16.224890 ip-10-0-143-124 kubenswrapper[2552]: I0609 17:33:16.224876 2552 reflector.go:439] "Caches populated" logger="kubernetes.io/kube-apiserver-client-kubelet" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162" Jun 09 17:33:16.226521 ip-10-0-143-124 kubenswrapper[2552]: I0609 17:33:16.226502 2552 fs.go:135] Filesystem UUIDs: map[2eb6d725-1dad-450f-bbef-cd01f17d1571:/dev/nvme0n1p3 7B77-95E7:/dev/nvme0n1p2 e301f2b4-6637-4226-b5cd-a644efe357a2:/dev/nvme0n1p4] Jun 09 17:33:16.226570 ip-10-0-143-124 kubenswrapper[2552]: I0609 17:33:16.226522 2552 fs.go:136] Filesystem partitions: map[/dev/nvme0n1p3:{mountpoint:/boot major:259 minor:3 fsType:ext4 blockSize:0} /dev/nvme0n1p4:{mountpoint:/var major:259 minor:4 fsType:xfs blockSize:0} /dev/shm:{mountpoint:/dev/shm major:0 minor:22 fsType:tmpfs blockSize:0} /run:{mountpoint:/run major:0 minor:24 fsType:tmpfs blockSize:0} /tmp:{mountpoint:/tmp major:0 minor:31 fsType:tmpfs blockSize:0} composefs_0-33:{mountpoint:/ major:0 minor:33 fsType:overlay blockSize:0}] Jun 09 17:33:16.232171 ip-10-0-143-124 kubenswrapper[2552]: I0609 17:33:16.232070 2552 manager.go:216] Machine: {Timestamp:2026-06-09 17:33:16.230713599 +0000 UTC m=+0.330616264 CPUVendorID:GenuineIntel NumCores:8 NumPhysicalCores:4 NumSockets:1 CpuFrequency:3094860 MemoryCapacity:33164492800 SwapCapacity:0 MemoryByType:map[] NVMInfo:{MemoryModeCapacity:0 AppDirectModeCapacity:0 AvgPowerBudget:0} HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] MachineID:ec20d3b2bc8743ee86632199b81c4619 SystemUUID:ec20d3b2-bc87-43ee-8663-2199b81c4619 BootID:e4b52e51-86ea-4c6d-81a3-fd35c2f43af2 Filesystems:[{Device:/dev/nvme0n1p4 DeviceMajor:259 DeviceMinor:4 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:composefs_0-33 DeviceMajor:0 DeviceMinor:33 Capacity:6107136 Type:vfs Inodes:18446744073709551615 HasInodes:true} {Device:/tmp DeviceMajor:0 DeviceMinor:31 Capacity:16582246400 Type:vfs Inodes:1048576 HasInodes:true} {Device:/dev/nvme0n1p3 DeviceMajor:259 DeviceMinor:3 Capacity:366869504 Type:vfs Inodes:98304 HasInodes:true} {Device:/dev/shm DeviceMajor:0 DeviceMinor:22 Capacity:16582246400 Type:vfs Inodes:4048400 HasInodes:true} {Device:/run DeviceMajor:0 DeviceMinor:24 Capacity:6632898560 Type:vfs Inodes:819200 HasInodes:true}] DiskMap:map[259:0:{Name:nvme0n1 Major:259 Minor:0 Size:128849018880 Scheduler:none}] NetworkDevices:[{Name:br-ex MacAddress:02:51:b6:ad:2a:b5 Speed:0 Mtu:9001} {Name:ens5 MacAddress:02:51:b6:ad:2a:b5 Speed:0 Mtu:9001} {Name:ovs-system MacAddress:d6:3a:0f:c4:e7:a3 Speed:0 Mtu:1500}] Topology:[{Id:0 Memory:33164492800 HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] Cores:[{Id:0 Threads:[0 4] Caches:[{Id:0 Size:32768 Type:Data Level:1} {Id:0 Size:32768 Type:Instruction Level:1} {Id:0 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:1 Threads:[1 5] Caches:[{Id:1 Size:32768 Type:Data Level:1} {Id:1 Size:32768 Type:Instruction Level:1} {Id:1 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:2 Threads:[2 6] Caches:[{Id:2 Size:32768 Type:Data Level:1} {Id:2 Size:32768 Type:Instruction Level:1} {Id:2 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:3 Threads:[3 7] Caches:[{Id:3 Size:32768 Type:Data Level:1} {Id:3 Size:32768 Type:Instruction Level:1} {Id:3 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:}] Caches:[{Id:0 Size:37486592 Type:Unified Level:3}] Distances:[10]}] CloudProvider:Unknown InstanceType:Unknown InstanceID:None} Jun 09 17:33:16.232171 ip-10-0-143-124 kubenswrapper[2552]: I0609 17:33:16.232169 2552 manager_no_libpfm.go:29] cAdvisor is build without cgo and/or libpfm support. Perf event counters are not available. Jun 09 17:33:16.232273 ip-10-0-143-124 kubenswrapper[2552]: I0609 17:33:16.232245 2552 manager.go:232] Version: {KernelVersion:5.14.0-570.118.1.el9_6.x86_64 ContainerOsVersion:Red Hat Enterprise Linux CoreOS 9.6.20260602-0 (Plow) DockerVersion: DockerAPIVersion: CadvisorVersion: CadvisorRevision:} Jun 09 17:33:16.235516 ip-10-0-143-124 kubenswrapper[2552]: I0609 17:33:16.235495 2552 container_manager_linux.go:273] "Container manager verified user specified cgroup-root exists" cgroupRoot=[] Jun 09 17:33:16.235680 ip-10-0-143-124 kubenswrapper[2552]: I0609 17:33:16.235518 2552 container_manager_linux.go:278] "Creating Container Manager object based on Node Config" nodeConfig={"NodeName":"ip-10-0-143-124.ec2.internal","RuntimeCgroupsName":"/system.slice/crio.service","SystemCgroupsName":"/system.slice","KubeletCgroupsName":"","KubeletOOMScoreAdj":-999,"ContainerRuntime":"","CgroupsPerQOS":true,"CgroupRoot":"/","CgroupDriver":"systemd","KubeletRootDir":"/var/lib/kubelet","ProtectKernelDefaults":true,"KubeReservedCgroupName":"","SystemReservedCgroupName":"","ReservedSystemCPUs":{},"EnforceNodeAllocatable":{"pods":{}},"KubeReserved":null,"SystemReserved":{"cpu":"500m","ephemeral-storage":"1Gi","memory":"1Gi"},"HardEvictionThresholds":[{"Signal":"nodefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.15},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"memory.available","Operator":"LessThan","Value":{"Quantity":"100Mi","Percentage":0},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.1},"GracePeriod":0,"MinReclaim":null}],"QOSReserved":{},"CPUManagerPolicy":"none","CPUManagerPolicyOptions":null,"TopologyManagerScope":"container","CPUManagerReconcilePeriod":10000000000,"MemoryManagerPolicy":"None","MemoryManagerReservedMemory":null,"PodPidsLimit":4096,"EnforceCPULimits":true,"CPUCFSQuotaPeriod":100000000,"TopologyManagerPolicy":"none","TopologyManagerPolicyOptions":null,"CgroupVersion":2} Jun 09 17:33:16.236220 ip-10-0-143-124 kubenswrapper[2552]: I0609 17:33:16.236211 2552 topology_manager.go:138] "Creating topology manager with none policy" Jun 09 17:33:16.236252 ip-10-0-143-124 kubenswrapper[2552]: I0609 17:33:16.236223 2552 container_manager_linux.go:309] "Creating device plugin manager" Jun 09 17:33:16.236252 ip-10-0-143-124 kubenswrapper[2552]: I0609 17:33:16.236230 2552 manager.go:141] "Creating Device Plugin manager" path="/var/lib/kubelet/device-plugins/kubelet.sock" Jun 09 17:33:16.236897 ip-10-0-143-124 kubenswrapper[2552]: I0609 17:33:16.236886 2552 server.go:74] "Creating device plugin registration server" version="v1beta1" socket="/var/lib/kubelet/device-plugins/kubelet.sock" Jun 09 17:33:16.237834 ip-10-0-143-124 kubenswrapper[2552]: I0609 17:33:16.237824 2552 container_manager_linux.go:318] "Creating Dynamic Resource Allocation (DRA) manager" Jun 09 17:33:16.240936 ip-10-0-143-124 kubenswrapper[2552]: I0609 17:33:16.240925 2552 state_mem.go:36] "Initialized new in-memory state store" Jun 09 17:33:16.241047 ip-10-0-143-124 kubenswrapper[2552]: I0609 17:33:16.241038 2552 server.go:1240] "Using root directory" path="/var/lib/kubelet" Jun 09 17:33:16.241076 ip-10-0-143-124 kubenswrapper[2552]: I0609 17:33:16.241066 2552 kubelet.go:486] "Attempting to sync node with API server" Jun 09 17:33:16.241111 ip-10-0-143-124 kubenswrapper[2552]: I0609 17:33:16.241093 2552 kubelet.go:387] "Adding static pod path" path="/etc/kubernetes/manifests" Jun 09 17:33:16.241111 ip-10-0-143-124 kubenswrapper[2552]: I0609 17:33:16.241103 2552 file.go:69] "Watching path" path="/etc/kubernetes/manifests" Jun 09 17:33:16.241193 ip-10-0-143-124 kubenswrapper[2552]: I0609 17:33:16.241157 2552 kubelet.go:398] "Adding apiserver pod source" Jun 09 17:33:16.241193 ip-10-0-143-124 kubenswrapper[2552]: I0609 17:33:16.241166 2552 apiserver.go:42] "Waiting for node sync before watching apiserver pods" Jun 09 17:33:16.243782 ip-10-0-143-124 kubenswrapper[2552]: I0609 17:33:16.242638 2552 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking" Jun 09 17:33:16.243869 ip-10-0-143-124 kubenswrapper[2552]: I0609 17:33:16.243823 2552 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking" Jun 09 17:33:16.246423 ip-10-0-143-124 kubenswrapper[2552]: I0609 17:33:16.246406 2552 kuberuntime_manager.go:301] "Container runtime initialized" containerRuntime="cri-o" version="1.34.8-3.rhaos4.21.git91b4b0b.el9" apiVersion="v1" Jun 09 17:33:16.247726 ip-10-0-143-124 kubenswrapper[2552]: I0609 17:33:16.247714 2552 kubelet.go:960] "Not starting ClusterTrustBundle informer because we are in static kubelet mode or the ClusterTrustBundleProjection featuregate is disabled" Jun 09 17:33:16.247782 ip-10-0-143-124 kubenswrapper[2552]: I0609 17:33:16.247743 2552 kubelet.go:984] "Not starting PodCertificateRequest manager because we are in static kubelet mode or the PodCertificateProjection feature gate is disabled" Jun 09 17:33:16.249073 ip-10-0-143-124 kubenswrapper[2552]: I0609 17:33:16.249054 2552 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-7js2f" Jun 09 17:33:16.249529 ip-10-0-143-124 kubenswrapper[2552]: I0609 17:33:16.249517 2552 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/portworx-volume" Jun 09 17:33:16.249569 ip-10-0-143-124 kubenswrapper[2552]: I0609 17:33:16.249534 2552 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/empty-dir" Jun 09 17:33:16.249569 ip-10-0-143-124 kubenswrapper[2552]: I0609 17:33:16.249541 2552 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/git-repo" Jun 09 17:33:16.249569 ip-10-0-143-124 kubenswrapper[2552]: I0609 17:33:16.249546 2552 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/host-path" Jun 09 17:33:16.249569 ip-10-0-143-124 kubenswrapper[2552]: I0609 17:33:16.249556 2552 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/nfs" Jun 09 17:33:16.249569 ip-10-0-143-124 kubenswrapper[2552]: I0609 17:33:16.249562 2552 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/secret" Jun 09 17:33:16.249569 ip-10-0-143-124 kubenswrapper[2552]: I0609 17:33:16.249570 2552 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/iscsi" Jun 09 17:33:16.249745 ip-10-0-143-124 kubenswrapper[2552]: I0609 17:33:16.249576 2552 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/downward-api" Jun 09 17:33:16.249745 ip-10-0-143-124 kubenswrapper[2552]: I0609 17:33:16.249583 2552 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/fc" Jun 09 17:33:16.249745 ip-10-0-143-124 kubenswrapper[2552]: I0609 17:33:16.249588 2552 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/configmap" Jun 09 17:33:16.249745 ip-10-0-143-124 kubenswrapper[2552]: I0609 17:33:16.249613 2552 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/projected" Jun 09 17:33:16.249745 ip-10-0-143-124 kubenswrapper[2552]: I0609 17:33:16.249622 2552 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/local-volume" Jun 09 17:33:16.250362 ip-10-0-143-124 kubenswrapper[2552]: I0609 17:33:16.250352 2552 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/csi" Jun 09 17:33:16.250362 ip-10-0-143-124 kubenswrapper[2552]: I0609 17:33:16.250362 2552 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/image" Jun 09 17:33:16.251562 ip-10-0-143-124 kubenswrapper[2552]: E0609 17:33:16.251533 2552 reflector.go:205] "Failed to watch" err="failed to list *v1.Node: nodes \"ip-10-0-143-124.ec2.internal\" is forbidden: User \"system:anonymous\" cannot list resource \"nodes\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Node" Jun 09 17:33:16.251647 ip-10-0-143-124 kubenswrapper[2552]: E0609 17:33:16.251530 2552 reflector.go:205] "Failed to watch" err="failed to list *v1.Service: services is forbidden: User \"system:anonymous\" cannot list resource \"services\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Service" Jun 09 17:33:16.253495 ip-10-0-143-124 kubenswrapper[2552]: I0609 17:33:16.253482 2552 server.go:1268] "Started kubelet" Jun 09 17:33:16.253584 ip-10-0-143-124 kubenswrapper[2552]: I0609 17:33:16.253561 2552 server.go:180] "Starting to listen" address="0.0.0.0" port=10250 Jun 09 17:33:16.253655 ip-10-0-143-124 kubenswrapper[2552]: I0609 17:33:16.253565 2552 ratelimit.go:56] "Setting rate limiting for endpoint" service="podresources" qps=100 burstTokens=10 Jun 09 17:33:16.253689 ip-10-0-143-124 kubenswrapper[2552]: I0609 17:33:16.253653 2552 server_v1.go:49] "podresources" method="list" useActivePods=true Jun 09 17:33:16.254468 ip-10-0-143-124 kubenswrapper[2552]: I0609 17:33:16.254444 2552 csi_plugin.go:990] Failed to contact API server when waiting for CSINode publishing: csinodes.storage.k8s.io "ip-10-0-143-124.ec2.internal" is forbidden: User "system:anonymous" cannot get resource "csinodes" in API group "storage.k8s.io" at the cluster scope Jun 09 17:33:16.254646 ip-10-0-143-124 systemd[1]: Started Kubernetes Kubelet. Jun 09 17:33:16.255169 ip-10-0-143-124 kubenswrapper[2552]: I0609 17:33:16.255093 2552 server.go:310] "Adding debug handlers to kubelet server" Jun 09 17:33:16.256469 ip-10-0-143-124 kubenswrapper[2552]: I0609 17:33:16.255457 2552 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-7js2f" Jun 09 17:33:16.256672 ip-10-0-143-124 kubenswrapper[2552]: I0609 17:33:16.256651 2552 server.go:249] "Starting to serve the podresources API" endpoint="unix:/var/lib/kubelet/pod-resources/kubelet.sock" Jun 09 17:33:16.261534 ip-10-0-143-124 kubenswrapper[2552]: E0609 17:33:16.261514 2552 kubelet.go:1638] "Image garbage collection failed once. Stats initialization may not have completed yet" err="failed to get imageFs info: unable to find data in memory cache" Jun 09 17:33:16.261632 ip-10-0-143-124 kubenswrapper[2552]: E0609 17:33:16.260655 2552 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-143-124.ec2.internal.18b77a1234480448 default 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-143-124.ec2.internal,UID:ip-10-0-143-124.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:Starting,Message:Starting kubelet.,Source:EventSource{Component:kubelet,Host:ip-10-0-143-124.ec2.internal,},FirstTimestamp:2026-06-09 17:33:16.253455432 +0000 UTC m=+0.353358073,LastTimestamp:2026-06-09 17:33:16.253455432 +0000 UTC m=+0.353358073,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-143-124.ec2.internal,}" Jun 09 17:33:16.263320 ip-10-0-143-124 kubenswrapper[2552]: I0609 17:33:16.263299 2552 fs_resource_analyzer.go:67] "Starting FS ResourceAnalyzer" Jun 09 17:33:16.263418 ip-10-0-143-124 kubenswrapper[2552]: I0609 17:33:16.263325 2552 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kubelet-serving" Jun 09 17:33:16.263473 ip-10-0-143-124 kubenswrapper[2552]: E0609 17:33:16.263423 2552 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-143-124.ec2.internal\" not found" Jun 09 17:33:16.264217 ip-10-0-143-124 kubenswrapper[2552]: I0609 17:33:16.264052 2552 volume_manager.go:311] "The desired_state_of_world populator starts" Jun 09 17:33:16.264217 ip-10-0-143-124 kubenswrapper[2552]: I0609 17:33:16.264099 2552 volume_manager.go:313] "Starting Kubelet Volume Manager" Jun 09 17:33:16.264217 ip-10-0-143-124 kubenswrapper[2552]: I0609 17:33:16.264173 2552 desired_state_of_world_populator.go:146] "Desired state populator starts to run" Jun 09 17:33:16.264490 ip-10-0-143-124 kubenswrapper[2552]: I0609 17:33:16.264243 2552 reconstruct.go:97] "Volume reconstruction finished" Jun 09 17:33:16.264490 ip-10-0-143-124 kubenswrapper[2552]: I0609 17:33:16.264251 2552 reconciler.go:29] "Reconciler: start to sync state" Jun 09 17:33:16.264572 ip-10-0-143-124 kubenswrapper[2552]: I0609 17:33:16.264500 2552 factory.go:55] Registering systemd factory Jun 09 17:33:16.264572 ip-10-0-143-124 kubenswrapper[2552]: I0609 17:33:16.264517 2552 factory.go:223] Registration of the systemd container factory successfully Jun 09 17:33:16.264809 ip-10-0-143-124 kubenswrapper[2552]: I0609 17:33:16.264790 2552 factory.go:153] Registering CRI-O factory Jun 09 17:33:16.264809 ip-10-0-143-124 kubenswrapper[2552]: I0609 17:33:16.264810 2552 factory.go:223] Registration of the crio container factory successfully Jun 09 17:33:16.264944 ip-10-0-143-124 kubenswrapper[2552]: I0609 17:33:16.264876 2552 factory.go:221] Registration of the containerd container factory failed: unable to create containerd client: containerd: cannot unix dial containerd api service: dial unix /run/containerd/containerd.sock: connect: no such file or directory Jun 09 17:33:16.264944 ip-10-0-143-124 kubenswrapper[2552]: I0609 17:33:16.264900 2552 factory.go:103] Registering Raw factory Jun 09 17:33:16.264944 ip-10-0-143-124 kubenswrapper[2552]: I0609 17:33:16.264914 2552 manager.go:1196] Started watching for new ooms in manager Jun 09 17:33:16.265870 ip-10-0-143-124 kubenswrapper[2552]: I0609 17:33:16.265855 2552 manager.go:349] Starting recovery of all containers Jun 09 17:33:16.266775 ip-10-0-143-124 kubenswrapper[2552]: I0609 17:33:16.266756 2552 reflector.go:439] "Caches populated" type="*v1.CSIDriver" reflector="k8s.io/client-go/informers/factory.go:160" Jun 09 17:33:16.269529 ip-10-0-143-124 kubenswrapper[2552]: E0609 17:33:16.269497 2552 nodelease.go:49] "Failed to get node when trying to set owner ref to the node lease" err="nodes \"ip-10-0-143-124.ec2.internal\" not found" node="ip-10-0-143-124.ec2.internal" Jun 09 17:33:16.276813 ip-10-0-143-124 kubenswrapper[2552]: I0609 17:33:16.276699 2552 manager.go:354] Recovery completed Jun 09 17:33:16.281007 ip-10-0-143-124 kubenswrapper[2552]: I0609 17:33:16.280993 2552 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jun 09 17:33:16.282704 ip-10-0-143-124 kubenswrapper[2552]: I0609 17:33:16.282689 2552 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-143-124.ec2.internal" event="NodeHasSufficientMemory" Jun 09 17:33:16.282765 ip-10-0-143-124 kubenswrapper[2552]: I0609 17:33:16.282716 2552 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-143-124.ec2.internal" event="NodeHasNoDiskPressure" Jun 09 17:33:16.282765 ip-10-0-143-124 kubenswrapper[2552]: I0609 17:33:16.282727 2552 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-143-124.ec2.internal" event="NodeHasSufficientPID" Jun 09 17:33:16.283303 ip-10-0-143-124 kubenswrapper[2552]: I0609 17:33:16.283291 2552 cpu_manager.go:222] "Starting CPU manager" policy="none" Jun 09 17:33:16.283303 ip-10-0-143-124 kubenswrapper[2552]: I0609 17:33:16.283298 2552 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jun 09 17:33:16.283303 ip-10-0-143-124 kubenswrapper[2552]: I0609 17:33:16.283302 2552 cpu_manager.go:223] "Reconciling" reconcilePeriod="10s" Jun 09 17:33:16.283438 ip-10-0-143-124 kubenswrapper[2552]: I0609 17:33:16.283322 2552 state_mem.go:36] "Initialized new in-memory state store" Jun 09 17:33:16.283987 ip-10-0-143-124 kubenswrapper[2552]: I0609 17:33:16.283972 2552 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-143-124.ec2.internal" event="NodeHasSufficientMemory" Jun 09 17:33:16.284048 ip-10-0-143-124 kubenswrapper[2552]: I0609 17:33:16.283998 2552 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-143-124.ec2.internal" event="NodeHasNoDiskPressure" Jun 09 17:33:16.284048 ip-10-0-143-124 kubenswrapper[2552]: I0609 17:33:16.284008 2552 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-143-124.ec2.internal" event="NodeHasSufficientPID" Jun 09 17:33:16.284736 ip-10-0-143-124 kubenswrapper[2552]: I0609 17:33:16.284722 2552 policy_none.go:49] "None policy: Start" Jun 09 17:33:16.284799 ip-10-0-143-124 kubenswrapper[2552]: I0609 17:33:16.284741 2552 memory_manager.go:187] "Starting memorymanager" policy="None" Jun 09 17:33:16.284799 ip-10-0-143-124 kubenswrapper[2552]: I0609 17:33:16.284757 2552 state_mem.go:36] "Initializing new in-memory state store" logger="Memory Manager state checkpoint" Jun 09 17:33:16.286013 ip-10-0-143-124 kubenswrapper[2552]: I0609 17:33:16.286001 2552 policy_none.go:47] "Start" Jun 09 17:33:16.320292 ip-10-0-143-124 kubenswrapper[2552]: I0609 17:33:16.320268 2552 manager.go:337] "Starting Device Plugin manager" Jun 09 17:33:16.331948 ip-10-0-143-124 kubenswrapper[2552]: E0609 17:33:16.320305 2552 manager.go:513] "Failed to read data from checkpoint" err="checkpoint is not found" checkpoint="kubelet_internal_checkpoint" Jun 09 17:33:16.331948 ip-10-0-143-124 kubenswrapper[2552]: I0609 17:33:16.320319 2552 server.go:87] "Starting device plugin registration server" Jun 09 17:33:16.331948 ip-10-0-143-124 kubenswrapper[2552]: I0609 17:33:16.320558 2552 eviction_manager.go:189] "Eviction manager: starting control loop" Jun 09 17:33:16.331948 ip-10-0-143-124 kubenswrapper[2552]: I0609 17:33:16.320568 2552 container_log_manager.go:146] "Initializing container log rotate workers" workers=1 monitorPeriod="10s" Jun 09 17:33:16.331948 ip-10-0-143-124 kubenswrapper[2552]: I0609 17:33:16.320652 2552 plugin_watcher.go:51] "Plugin Watcher Start" path="/var/lib/kubelet/plugins_registry" Jun 09 17:33:16.331948 ip-10-0-143-124 kubenswrapper[2552]: I0609 17:33:16.320733 2552 plugin_manager.go:116] "The desired_state_of_world populator (plugin watcher) starts" Jun 09 17:33:16.331948 ip-10-0-143-124 kubenswrapper[2552]: I0609 17:33:16.320741 2552 plugin_manager.go:118] "Starting Kubelet Plugin Manager" Jun 09 17:33:16.331948 ip-10-0-143-124 kubenswrapper[2552]: E0609 17:33:16.321327 2552 eviction_manager.go:267] "eviction manager: failed to check if we have separate container filesystem. Ignoring." err="non-existent label \"crio-containers\"" Jun 09 17:33:16.331948 ip-10-0-143-124 kubenswrapper[2552]: E0609 17:33:16.321368 2552 eviction_manager.go:292] "Eviction manager: failed to get summary stats" err="failed to get node info: node \"ip-10-0-143-124.ec2.internal\" not found" Jun 09 17:33:16.331948 ip-10-0-143-124 kubenswrapper[2552]: I0609 17:33:16.329821 2552 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv4" Jun 09 17:33:16.331948 ip-10-0-143-124 kubenswrapper[2552]: I0609 17:33:16.330957 2552 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv6" Jun 09 17:33:16.331948 ip-10-0-143-124 kubenswrapper[2552]: I0609 17:33:16.330999 2552 status_manager.go:244] "Starting to sync pod status with apiserver" Jun 09 17:33:16.331948 ip-10-0-143-124 kubenswrapper[2552]: I0609 17:33:16.331022 2552 kubelet.go:2448] "Starting kubelet main sync loop" Jun 09 17:33:16.331948 ip-10-0-143-124 kubenswrapper[2552]: E0609 17:33:16.331061 2552 kubelet.go:2472] "Skipping pod synchronization" err="PLEG is not healthy: pleg has yet to be successful" Jun 09 17:33:16.332837 ip-10-0-143-124 kubenswrapper[2552]: I0609 17:33:16.332817 2552 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160" Jun 09 17:33:16.421437 ip-10-0-143-124 kubenswrapper[2552]: I0609 17:33:16.421382 2552 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jun 09 17:33:16.423359 ip-10-0-143-124 kubenswrapper[2552]: I0609 17:33:16.423342 2552 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-143-124.ec2.internal" event="NodeHasSufficientMemory" Jun 09 17:33:16.423441 ip-10-0-143-124 kubenswrapper[2552]: I0609 17:33:16.423378 2552 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-143-124.ec2.internal" event="NodeHasNoDiskPressure" Jun 09 17:33:16.423441 ip-10-0-143-124 kubenswrapper[2552]: I0609 17:33:16.423391 2552 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-143-124.ec2.internal" event="NodeHasSufficientPID" Jun 09 17:33:16.423441 ip-10-0-143-124 kubenswrapper[2552]: I0609 17:33:16.423414 2552 kubelet_node_status.go:78] "Attempting to register node" node="ip-10-0-143-124.ec2.internal" Jun 09 17:33:16.431420 ip-10-0-143-124 kubenswrapper[2552]: I0609 17:33:16.431402 2552 kubelet_node_status.go:81] "Successfully registered node" node="ip-10-0-143-124.ec2.internal" Jun 09 17:33:16.431469 ip-10-0-143-124 kubenswrapper[2552]: E0609 17:33:16.431424 2552 kubelet_node_status.go:536] "Error updating node status, will retry" err="error getting node \"ip-10-0-143-124.ec2.internal\": node \"ip-10-0-143-124.ec2.internal\" not found" Jun 09 17:33:16.431520 ip-10-0-143-124 kubenswrapper[2552]: I0609 17:33:16.431503 2552 kubelet.go:2535] "SyncLoop ADD" source="file" pods=["openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-143-124.ec2.internal","kube-system/kube-apiserver-proxy-ip-10-0-143-124.ec2.internal"] Jun 09 17:33:16.431568 ip-10-0-143-124 kubenswrapper[2552]: I0609 17:33:16.431560 2552 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jun 09 17:33:16.432940 ip-10-0-143-124 kubenswrapper[2552]: I0609 17:33:16.432918 2552 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-143-124.ec2.internal" event="NodeHasSufficientMemory" Jun 09 17:33:16.433006 ip-10-0-143-124 kubenswrapper[2552]: I0609 17:33:16.432943 2552 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-143-124.ec2.internal" event="NodeHasNoDiskPressure" Jun 09 17:33:16.433006 ip-10-0-143-124 kubenswrapper[2552]: I0609 17:33:16.432952 2552 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-143-124.ec2.internal" event="NodeHasSufficientPID" Jun 09 17:33:16.434226 ip-10-0-143-124 kubenswrapper[2552]: I0609 17:33:16.434214 2552 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jun 09 17:33:16.434337 ip-10-0-143-124 kubenswrapper[2552]: I0609 17:33:16.434317 2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-143-124.ec2.internal" Jun 09 17:33:16.434383 ip-10-0-143-124 kubenswrapper[2552]: I0609 17:33:16.434348 2552 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jun 09 17:33:16.434956 ip-10-0-143-124 kubenswrapper[2552]: I0609 17:33:16.434937 2552 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-143-124.ec2.internal" event="NodeHasSufficientMemory" Jun 09 17:33:16.435051 ip-10-0-143-124 kubenswrapper[2552]: I0609 17:33:16.434937 2552 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-143-124.ec2.internal" event="NodeHasSufficientMemory" Jun 09 17:33:16.435051 ip-10-0-143-124 kubenswrapper[2552]: I0609 17:33:16.434969 2552 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-143-124.ec2.internal" event="NodeHasNoDiskPressure" Jun 09 17:33:16.435051 ip-10-0-143-124 kubenswrapper[2552]: I0609 17:33:16.434980 2552 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-143-124.ec2.internal" event="NodeHasSufficientPID" Jun 09 17:33:16.435051 ip-10-0-143-124 kubenswrapper[2552]: I0609 17:33:16.434990 2552 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-143-124.ec2.internal" event="NodeHasNoDiskPressure" Jun 09 17:33:16.435051 ip-10-0-143-124 kubenswrapper[2552]: I0609 17:33:16.435007 2552 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-143-124.ec2.internal" event="NodeHasSufficientPID" Jun 09 17:33:16.436137 ip-10-0-143-124 kubenswrapper[2552]: I0609 17:33:16.436121 2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-143-124.ec2.internal" Jun 09 17:33:16.436228 ip-10-0-143-124 kubenswrapper[2552]: I0609 17:33:16.436150 2552 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jun 09 17:33:16.436828 ip-10-0-143-124 kubenswrapper[2552]: I0609 17:33:16.436808 2552 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-143-124.ec2.internal" event="NodeHasSufficientMemory" Jun 09 17:33:16.436905 ip-10-0-143-124 kubenswrapper[2552]: I0609 17:33:16.436843 2552 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-143-124.ec2.internal" event="NodeHasNoDiskPressure" Jun 09 17:33:16.436905 ip-10-0-143-124 kubenswrapper[2552]: I0609 17:33:16.436855 2552 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-143-124.ec2.internal" event="NodeHasSufficientPID" Jun 09 17:33:16.447693 ip-10-0-143-124 kubenswrapper[2552]: E0609 17:33:16.447673 2552 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-143-124.ec2.internal\" not found" Jun 09 17:33:16.449124 ip-10-0-143-124 kubenswrapper[2552]: E0609 17:33:16.449104 2552 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-143-124.ec2.internal\" not found" node="ip-10-0-143-124.ec2.internal" Jun 09 17:33:16.452845 ip-10-0-143-124 kubenswrapper[2552]: E0609 17:33:16.452830 2552 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-143-124.ec2.internal\" not found" node="ip-10-0-143-124.ec2.internal" Jun 09 17:33:16.465639 ip-10-0-143-124 kubenswrapper[2552]: I0609 17:33:16.465618 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/98d869758a762967dbb1a9629bfd5f10-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-143-124.ec2.internal\" (UID: \"98d869758a762967dbb1a9629bfd5f10\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-143-124.ec2.internal" Jun 09 17:33:16.465721 ip-10-0-143-124 kubenswrapper[2552]: I0609 17:33:16.465647 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/98d869758a762967dbb1a9629bfd5f10-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-143-124.ec2.internal\" (UID: \"98d869758a762967dbb1a9629bfd5f10\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-143-124.ec2.internal" Jun 09 17:33:16.465721 ip-10-0-143-124 kubenswrapper[2552]: I0609 17:33:16.465675 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/c6eab2ff3a3679dccbb6f4cc985d9ef6-config\") pod \"kube-apiserver-proxy-ip-10-0-143-124.ec2.internal\" (UID: \"c6eab2ff3a3679dccbb6f4cc985d9ef6\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-143-124.ec2.internal" Jun 09 17:33:16.547932 ip-10-0-143-124 kubenswrapper[2552]: E0609 17:33:16.547905 2552 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-143-124.ec2.internal\" not found" Jun 09 17:33:16.566209 ip-10-0-143-124 kubenswrapper[2552]: I0609 17:33:16.566181 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/98d869758a762967dbb1a9629bfd5f10-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-143-124.ec2.internal\" (UID: \"98d869758a762967dbb1a9629bfd5f10\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-143-124.ec2.internal" Jun 09 17:33:16.566328 ip-10-0-143-124 kubenswrapper[2552]: I0609 17:33:16.566216 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/c6eab2ff3a3679dccbb6f4cc985d9ef6-config\") pod \"kube-apiserver-proxy-ip-10-0-143-124.ec2.internal\" (UID: \"c6eab2ff3a3679dccbb6f4cc985d9ef6\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-143-124.ec2.internal" Jun 09 17:33:16.566328 ip-10-0-143-124 kubenswrapper[2552]: I0609 17:33:16.566240 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/98d869758a762967dbb1a9629bfd5f10-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-143-124.ec2.internal\" (UID: \"98d869758a762967dbb1a9629bfd5f10\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-143-124.ec2.internal" Jun 09 17:33:16.566328 ip-10-0-143-124 kubenswrapper[2552]: I0609 17:33:16.566274 2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/98d869758a762967dbb1a9629bfd5f10-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-143-124.ec2.internal\" (UID: \"98d869758a762967dbb1a9629bfd5f10\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-143-124.ec2.internal" Jun 09 17:33:16.566328 ip-10-0-143-124 kubenswrapper[2552]: I0609 17:33:16.566304 2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/host-path/c6eab2ff3a3679dccbb6f4cc985d9ef6-config\") pod \"kube-apiserver-proxy-ip-10-0-143-124.ec2.internal\" (UID: \"c6eab2ff3a3679dccbb6f4cc985d9ef6\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-143-124.ec2.internal" Jun 09 17:33:16.566328 ip-10-0-143-124 kubenswrapper[2552]: I0609 17:33:16.566315 2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/98d869758a762967dbb1a9629bfd5f10-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-143-124.ec2.internal\" (UID: \"98d869758a762967dbb1a9629bfd5f10\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-143-124.ec2.internal" Jun 09 17:33:16.648757 ip-10-0-143-124 kubenswrapper[2552]: E0609 17:33:16.648722 2552 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-143-124.ec2.internal\" not found" Jun 09 17:33:16.749540 ip-10-0-143-124 kubenswrapper[2552]: E0609 17:33:16.749519 2552 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-143-124.ec2.internal\" not found" Jun 09 17:33:16.752688 ip-10-0-143-124 kubenswrapper[2552]: I0609 17:33:16.752671 2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-143-124.ec2.internal" Jun 09 17:33:16.757209 ip-10-0-143-124 kubenswrapper[2552]: I0609 17:33:16.757194 2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-143-124.ec2.internal" Jun 09 17:33:16.850090 ip-10-0-143-124 kubenswrapper[2552]: E0609 17:33:16.850052 2552 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-143-124.ec2.internal\" not found" Jun 09 17:33:16.950641 ip-10-0-143-124 kubenswrapper[2552]: E0609 17:33:16.950591 2552 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-143-124.ec2.internal\" not found" Jun 09 17:33:17.051116 ip-10-0-143-124 kubenswrapper[2552]: E0609 17:33:17.051095 2552 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-143-124.ec2.internal\" not found" Jun 09 17:33:17.136412 ip-10-0-143-124 kubenswrapper[2552]: I0609 17:33:17.136382 2552 reflector.go:439] "Caches populated" type="*v1.Service" reflector="k8s.io/client-go/informers/factory.go:160" Jun 09 17:33:17.152202 ip-10-0-143-124 kubenswrapper[2552]: E0609 17:33:17.152174 2552 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-143-124.ec2.internal\" not found" Jun 09 17:33:17.194675 ip-10-0-143-124 kubenswrapper[2552]: I0609 17:33:17.194653 2552 transport.go:147] "Certificate rotation detected, shutting down client connections to start using new credentials" Jun 09 17:33:17.195203 ip-10-0-143-124 kubenswrapper[2552]: I0609 17:33:17.194779 2552 reflector.go:571] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.CSIDriver" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received" Jun 09 17:33:17.195203 ip-10-0-143-124 kubenswrapper[2552]: I0609 17:33:17.194823 2552 reflector.go:571] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Service" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received" Jun 09 17:33:17.195203 ip-10-0-143-124 kubenswrapper[2552]: I0609 17:33:17.194823 2552 reflector.go:571] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.RuntimeClass" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received" Jun 09 17:33:17.253223 ip-10-0-143-124 kubenswrapper[2552]: E0609 17:33:17.253195 2552 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-143-124.ec2.internal\" not found" Jun 09 17:33:17.261511 ip-10-0-143-124 kubenswrapper[2552]: I0609 17:33:17.261485 2552 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kube-apiserver-client-kubelet" expiration="2028-06-08 17:28:16 +0000 UTC" deadline="2028-03-03 17:24:55.566918668 +0000 UTC" Jun 09 17:33:17.261511 ip-10-0-143-124 kubenswrapper[2552]: I0609 17:33:17.261509 2552 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kube-apiserver-client-kubelet" sleep="15191h51m38.305412604s" Jun 09 17:33:17.353660 ip-10-0-143-124 kubenswrapper[2552]: E0609 17:33:17.353633 2552 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-143-124.ec2.internal\" not found" Jun 09 17:33:17.354426 ip-10-0-143-124 kubenswrapper[2552]: W0609 17:33:17.354397 2552 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc6eab2ff3a3679dccbb6f4cc985d9ef6.slice/crio-17338c6926b0bc19b1a9b6aa9c128ddf8134cbc429d38810c4191cd05a3061e1 WatchSource:0}: Error finding container 17338c6926b0bc19b1a9b6aa9c128ddf8134cbc429d38810c4191cd05a3061e1: Status 404 returned error can't find the container with id 17338c6926b0bc19b1a9b6aa9c128ddf8134cbc429d38810c4191cd05a3061e1 Jun 09 17:33:17.354822 ip-10-0-143-124 kubenswrapper[2552]: W0609 17:33:17.354808 2552 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod98d869758a762967dbb1a9629bfd5f10.slice/crio-85d76fa189b5b2ff77743bb44cb0fd3aa62d3c9d6043b3292096d0c90a8a10c8 WatchSource:0}: Error finding container 85d76fa189b5b2ff77743bb44cb0fd3aa62d3c9d6043b3292096d0c90a8a10c8: Status 404 returned error can't find the container with id 85d76fa189b5b2ff77743bb44cb0fd3aa62d3c9d6043b3292096d0c90a8a10c8 Jun 09 17:33:17.361789 ip-10-0-143-124 kubenswrapper[2552]: I0609 17:33:17.361775 2552 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jun 09 17:33:17.453928 ip-10-0-143-124 kubenswrapper[2552]: E0609 17:33:17.453900 2552 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-143-124.ec2.internal\" not found" Jun 09 17:33:17.554454 ip-10-0-143-124 kubenswrapper[2552]: E0609 17:33:17.554424 2552 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-143-124.ec2.internal\" not found" Jun 09 17:33:17.655055 ip-10-0-143-124 kubenswrapper[2552]: E0609 17:33:17.654983 2552 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-143-124.ec2.internal\" not found" Jun 09 17:33:17.755822 ip-10-0-143-124 kubenswrapper[2552]: E0609 17:33:17.755793 2552 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-143-124.ec2.internal\" not found" Jun 09 17:33:17.778555 ip-10-0-143-124 kubenswrapper[2552]: I0609 17:33:17.778530 2552 reflector.go:439] "Caches populated" type="*v1.Node" reflector="k8s.io/client-go/informers/factory.go:160" Jun 09 17:33:17.863582 ip-10-0-143-124 kubenswrapper[2552]: I0609 17:33:17.863550 2552 kubelet.go:3248] "Creating a mirror pod for static pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-143-124.ec2.internal" Jun 09 17:33:17.873671 ip-10-0-143-124 kubenswrapper[2552]: I0609 17:33:17.873644 2552 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]" Jun 09 17:33:17.874629 ip-10-0-143-124 kubenswrapper[2552]: I0609 17:33:17.874616 2552 kubelet.go:3248] "Creating a mirror pod for static pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-143-124.ec2.internal" Jun 09 17:33:17.880967 ip-10-0-143-124 kubenswrapper[2552]: I0609 17:33:17.880939 2552 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]" Jun 09 17:33:18.010903 ip-10-0-143-124 kubenswrapper[2552]: I0609 17:33:18.010876 2552 reflector.go:439] "Caches populated" type="*v1.CSIDriver" reflector="k8s.io/client-go/informers/factory.go:160" Jun 09 17:33:18.242485 ip-10-0-143-124 kubenswrapper[2552]: I0609 17:33:18.242453 2552 apiserver.go:52] "Watching apiserver" Jun 09 17:33:18.250512 ip-10-0-143-124 kubenswrapper[2552]: I0609 17:33:18.250486 2552 reflector.go:439] "Caches populated" type="*v1.Pod" reflector="pkg/kubelet/config/apiserver.go:66" Jun 09 17:33:18.250863 ip-10-0-143-124 kubenswrapper[2552]: I0609 17:33:18.250839 2552 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-cluster-node-tuning-operator/tuned-g5rgn","openshift-dns/node-resolver-qbd4p","openshift-image-registry/node-ca-tb8b5","openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-143-124.ec2.internal","openshift-multus/multus-additional-cni-plugins-s8d9p","openshift-multus/network-metrics-daemon-pvmnc","openshift-network-diagnostics/network-check-target-mpmvr","openshift-ovn-kubernetes/ovnkube-node-kwh69","kube-system/global-pull-secret-syncer-lt4n9","kube-system/konnectivity-agent-gctfs","kube-system/kube-apiserver-proxy-ip-10-0-143-124.ec2.internal","openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-9gqc8","openshift-multus/multus-n6545","openshift-network-operator/iptables-alerter-ddp2h"] Jun 09 17:33:18.252213 ip-10-0-143-124 kubenswrapper[2552]: I0609 17:33:18.252187 2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-gctfs" Jun 09 17:33:18.253507 ip-10-0-143-124 kubenswrapper[2552]: I0609 17:33:18.253245 2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-n6545" Jun 09 17:33:18.254503 ip-10-0-143-124 kubenswrapper[2552]: I0609 17:33:18.254480 2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-tb8b5" Jun 09 17:33:18.255244 ip-10-0-143-124 kubenswrapper[2552]: I0609 17:33:18.255038 2552 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"default-dockercfg-kr855\"" Jun 09 17:33:18.255244 ip-10-0-143-124 kubenswrapper[2552]: I0609 17:33:18.255048 2552 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"konnectivity-agent\"" Jun 09 17:33:18.255244 ip-10-0-143-124 kubenswrapper[2552]: I0609 17:33:18.255072 2552 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kube-system\"/\"konnectivity-ca-bundle\"" Jun 09 17:33:18.255765 ip-10-0-143-124 kubenswrapper[2552]: I0609 17:33:18.255727 2552 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"kube-root-ca.crt\"" Jun 09 17:33:18.255859 ip-10-0-143-124 kubenswrapper[2552]: I0609 17:33:18.255778 2552 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"openshift-service-ca.crt\"" Jun 09 17:33:18.255859 ip-10-0-143-124 kubenswrapper[2552]: I0609 17:33:18.255832 2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-ddp2h" Jun 09 17:33:18.256265 ip-10-0-143-124 kubenswrapper[2552]: I0609 17:33:18.256113 2552 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"multus-daemon-config\"" Jun 09 17:33:18.256265 ip-10-0-143-124 kubenswrapper[2552]: I0609 17:33:18.256172 2552 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"cni-copy-resources\"" Jun 09 17:33:18.256265 ip-10-0-143-124 kubenswrapper[2552]: I0609 17:33:18.256236 2552 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"default-dockercfg-mvbqc\"" Jun 09 17:33:18.256784 ip-10-0-143-124 kubenswrapper[2552]: I0609 17:33:18.256764 2552 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"image-registry-certificates\"" Jun 09 17:33:18.257222 ip-10-0-143-124 kubenswrapper[2552]: I0609 17:33:18.257202 2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-s8d9p" Jun 09 17:33:18.257683 ip-10-0-143-124 kubenswrapper[2552]: I0609 17:33:18.257666 2552 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"openshift-service-ca.crt\"" Jun 09 17:33:18.257772 ip-10-0-143-124 kubenswrapper[2552]: I0609 17:33:18.257692 2552 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"kube-root-ca.crt\"" Jun 09 17:33:18.257772 ip-10-0-143-124 kubenswrapper[2552]: I0609 17:33:18.257721 2552 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"node-ca-dockercfg-t7mpk\"" Jun 09 17:33:18.258466 ip-10-0-143-124 kubenswrapper[2552]: I0609 17:33:18.258449 2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-pvmnc" Jun 09 17:33:18.258568 ip-10-0-143-124 kubenswrapper[2552]: E0609 17:33:18.258543 2552 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-pvmnc" podUID="b817ed32-ca44-43a6-99cf-8cf86ffd8c05" Jun 09 17:33:18.259241 ip-10-0-143-124 kubenswrapper[2552]: I0609 17:33:18.259214 2552 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-script\"" Jun 09 17:33:18.259323 ip-10-0-143-124 kubenswrapper[2552]: I0609 17:33:18.259284 2552 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"kube-root-ca.crt\"" Jun 09 17:33:18.259381 ip-10-0-143-124 kubenswrapper[2552]: I0609 17:33:18.259335 2552 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-dockercfg-mqwzp\"" Jun 09 17:33:18.259912 ip-10-0-143-124 kubenswrapper[2552]: I0609 17:33:18.259891 2552 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"openshift-service-ca.crt\"" Jun 09 17:33:18.261311 ip-10-0-143-124 kubenswrapper[2552]: I0609 17:33:18.260337 2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-lt4n9" Jun 09 17:33:18.261311 ip-10-0-143-124 kubenswrapper[2552]: I0609 17:33:18.260378 2552 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"default-cni-sysctl-allowlist\"" Jun 09 17:33:18.261311 ip-10-0-143-124 kubenswrapper[2552]: E0609 17:33:18.260415 2552 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-lt4n9" podUID="a71cd181-3d23-4c4b-ac2f-e212dd9b5193" Jun 09 17:33:18.261311 ip-10-0-143-124 kubenswrapper[2552]: I0609 17:33:18.260521 2552 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"whereabouts-flatfile-config\"" Jun 09 17:33:18.261311 ip-10-0-143-124 kubenswrapper[2552]: I0609 17:33:18.260684 2552 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"multus-ancillary-tools-dockercfg-7d4mr\"" Jun 09 17:33:18.262233 ip-10-0-143-124 kubenswrapper[2552]: I0609 17:33:18.261974 2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-mpmvr" Jun 09 17:33:18.262233 ip-10-0-143-124 kubenswrapper[2552]: E0609 17:33:18.262049 2552 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-mpmvr" podUID="7755d1ba-506c-4a2d-829f-57beb748954e" Jun 09 17:33:18.264508 ip-10-0-143-124 kubenswrapper[2552]: I0609 17:33:18.264362 2552 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kubelet-serving" Jun 09 17:33:18.264611 ip-10-0-143-124 kubenswrapper[2552]: I0609 17:33:18.264585 2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-qbd4p" Jun 09 17:33:18.265915 ip-10-0-143-124 kubenswrapper[2552]: I0609 17:33:18.265894 2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-g5rgn" Jun 09 17:33:18.267063 ip-10-0-143-124 kubenswrapper[2552]: I0609 17:33:18.267044 2552 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"openshift-service-ca.crt\"" Jun 09 17:33:18.267161 ip-10-0-143-124 kubenswrapper[2552]: I0609 17:33:18.267062 2552 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"kube-root-ca.crt\"" Jun 09 17:33:18.267220 ip-10-0-143-124 kubenswrapper[2552]: I0609 17:33:18.267189 2552 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"node-resolver-dockercfg-vkplb\"" Jun 09 17:33:18.267527 ip-10-0-143-124 kubenswrapper[2552]: I0609 17:33:18.267499 2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-kwh69" Jun 09 17:33:18.268368 ip-10-0-143-124 kubenswrapper[2552]: I0609 17:33:18.268351 2552 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"openshift-service-ca.crt\"" Jun 09 17:33:18.268462 ip-10-0-143-124 kubenswrapper[2552]: I0609 17:33:18.268398 2552 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"kube-root-ca.crt\"" Jun 09 17:33:18.268672 ip-10-0-143-124 kubenswrapper[2552]: I0609 17:33:18.268654 2552 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"tuned-dockercfg-2ffkt\"" Jun 09 17:33:18.269149 ip-10-0-143-124 kubenswrapper[2552]: I0609 17:33:18.268896 2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-9gqc8" Jun 09 17:33:18.270160 ip-10-0-143-124 kubenswrapper[2552]: I0609 17:33:18.270143 2552 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-node-metrics-cert\"" Jun 09 17:33:18.270257 ip-10-0-143-124 kubenswrapper[2552]: I0609 17:33:18.270174 2552 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-config\"" Jun 09 17:33:18.270467 ip-10-0-143-124 kubenswrapper[2552]: I0609 17:33:18.270437 2552 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"openshift-service-ca.crt\"" Jun 09 17:33:18.270632 ip-10-0-143-124 kubenswrapper[2552]: I0609 17:33:18.270582 2552 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"kube-root-ca.crt\"" Jun 09 17:33:18.270722 ip-10-0-143-124 kubenswrapper[2552]: I0609 17:33:18.270649 2552 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"env-overrides\"" Jun 09 17:33:18.271243 ip-10-0-143-124 kubenswrapper[2552]: I0609 17:33:18.271225 2552 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-script-lib\"" Jun 09 17:33:18.271312 ip-10-0-143-124 kubenswrapper[2552]: I0609 17:33:18.271293 2552 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-kubernetes-node-dockercfg-g8f5n\"" Jun 09 17:33:18.271700 ip-10-0-143-124 kubenswrapper[2552]: I0609 17:33:18.271674 2552 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"kube-root-ca.crt\"" Jun 09 17:33:18.271913 ip-10-0-143-124 kubenswrapper[2552]: I0609 17:33:18.271896 2552 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"openshift-service-ca.crt\"" Jun 09 17:33:18.272036 ip-10-0-143-124 kubenswrapper[2552]: I0609 17:33:18.272014 2552 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-metrics-serving-cert\"" Jun 09 17:33:18.272036 ip-10-0-143-124 kubenswrapper[2552]: I0609 17:33:18.271977 2552 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-sa-dockercfg-45rm7\"" Jun 09 17:33:18.276231 ip-10-0-143-124 kubenswrapper[2552]: I0609 17:33:18.276212 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/df33c2c3-49d0-4236-996b-10cde5d3bc92-host-slash\") pod \"iptables-alerter-ddp2h\" (UID: \"df33c2c3-49d0-4236-996b-10cde5d3bc92\") " pod="openshift-network-operator/iptables-alerter-ddp2h" Jun 09 17:33:18.276323 ip-10-0-143-124 kubenswrapper[2552]: I0609 17:33:18.276245 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/57526948-94e0-40fd-b0bf-ada9cf355743-system-cni-dir\") pod \"multus-additional-cni-plugins-s8d9p\" (UID: \"57526948-94e0-40fd-b0bf-ada9cf355743\") " pod="openshift-multus/multus-additional-cni-plugins-s8d9p" Jun 09 17:33:18.276323 ip-10-0-143-124 kubenswrapper[2552]: I0609 17:33:18.276265 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/57526948-94e0-40fd-b0bf-ada9cf355743-tuning-conf-dir\") pod \"multus-additional-cni-plugins-s8d9p\" (UID: \"57526948-94e0-40fd-b0bf-ada9cf355743\") " pod="openshift-multus/multus-additional-cni-plugins-s8d9p" Jun 09 17:33:18.276323 ip-10-0-143-124 kubenswrapper[2552]: I0609 17:33:18.276314 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/99815f55-a516-4e96-bdb4-67bf609055f2-host-run-netns\") pod \"multus-n6545\" (UID: \"99815f55-a516-4e96-bdb4-67bf609055f2\") " pod="openshift-multus/multus-n6545" Jun 09 17:33:18.276488 ip-10-0-143-124 kubenswrapper[2552]: I0609 17:33:18.276345 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/b817ed32-ca44-43a6-99cf-8cf86ffd8c05-metrics-certs\") pod \"network-metrics-daemon-pvmnc\" (UID: \"b817ed32-ca44-43a6-99cf-8cf86ffd8c05\") " pod="openshift-multus/network-metrics-daemon-pvmnc" Jun 09 17:33:18.276488 ip-10-0-143-124 kubenswrapper[2552]: I0609 17:33:18.276383 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-lzhbc\" (UniqueName: \"kubernetes.io/projected/b817ed32-ca44-43a6-99cf-8cf86ffd8c05-kube-api-access-lzhbc\") pod \"network-metrics-daemon-pvmnc\" (UID: \"b817ed32-ca44-43a6-99cf-8cf86ffd8c05\") " pod="openshift-multus/network-metrics-daemon-pvmnc" Jun 09 17:33:18.276488 ip-10-0-143-124 kubenswrapper[2552]: I0609 17:33:18.276408 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/f077d86b-598b-4398-9376-2956816fa47d-hosts-file\") pod \"node-resolver-qbd4p\" (UID: \"f077d86b-598b-4398-9376-2956816fa47d\") " pod="openshift-dns/node-resolver-qbd4p" Jun 09 17:33:18.276488 ip-10-0-143-124 kubenswrapper[2552]: I0609 17:33:18.276424 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/a71cd181-3d23-4c4b-ac2f-e212dd9b5193-dbus\") pod \"global-pull-secret-syncer-lt4n9\" (UID: \"a71cd181-3d23-4c4b-ac2f-e212dd9b5193\") " pod="kube-system/global-pull-secret-syncer-lt4n9" Jun 09 17:33:18.276488 ip-10-0-143-124 kubenswrapper[2552]: I0609 17:33:18.276478 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/99815f55-a516-4e96-bdb4-67bf609055f2-host-var-lib-kubelet\") pod \"multus-n6545\" (UID: \"99815f55-a516-4e96-bdb4-67bf609055f2\") " pod="openshift-multus/multus-n6545" Jun 09 17:33:18.276754 ip-10-0-143-124 kubenswrapper[2552]: I0609 17:33:18.276500 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/99815f55-a516-4e96-bdb4-67bf609055f2-multus-daemon-config\") pod \"multus-n6545\" (UID: \"99815f55-a516-4e96-bdb4-67bf609055f2\") " pod="openshift-multus/multus-n6545" Jun 09 17:33:18.276754 ip-10-0-143-124 kubenswrapper[2552]: I0609 17:33:18.276524 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/2ef810f8-073d-4b45-ad02-2e098f31ed47-serviceca\") pod \"node-ca-tb8b5\" (UID: \"2ef810f8-073d-4b45-ad02-2e098f31ed47\") " pod="openshift-image-registry/node-ca-tb8b5" Jun 09 17:33:18.276754 ip-10-0-143-124 kubenswrapper[2552]: I0609 17:33:18.276569 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/f077d86b-598b-4398-9376-2956816fa47d-tmp-dir\") pod \"node-resolver-qbd4p\" (UID: \"f077d86b-598b-4398-9376-2956816fa47d\") " pod="openshift-dns/node-resolver-qbd4p" Jun 09 17:33:18.276754 ip-10-0-143-124 kubenswrapper[2552]: I0609 17:33:18.276625 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/57526948-94e0-40fd-b0bf-ada9cf355743-cni-binary-copy\") pod \"multus-additional-cni-plugins-s8d9p\" (UID: \"57526948-94e0-40fd-b0bf-ada9cf355743\") " pod="openshift-multus/multus-additional-cni-plugins-s8d9p" Jun 09 17:33:18.276754 ip-10-0-143-124 kubenswrapper[2552]: I0609 17:33:18.276656 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/57526948-94e0-40fd-b0bf-ada9cf355743-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-s8d9p\" (UID: \"57526948-94e0-40fd-b0bf-ada9cf355743\") " pod="openshift-multus/multus-additional-cni-plugins-s8d9p" Jun 09 17:33:18.276754 ip-10-0-143-124 kubenswrapper[2552]: I0609 17:33:18.276679 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/99815f55-a516-4e96-bdb4-67bf609055f2-host-run-multus-certs\") pod \"multus-n6545\" (UID: \"99815f55-a516-4e96-bdb4-67bf609055f2\") " pod="openshift-multus/multus-n6545" Jun 09 17:33:18.276754 ip-10-0-143-124 kubenswrapper[2552]: I0609 17:33:18.276702 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vvzhh\" (UniqueName: \"kubernetes.io/projected/7755d1ba-506c-4a2d-829f-57beb748954e-kube-api-access-vvzhh\") pod \"network-check-target-mpmvr\" (UID: \"7755d1ba-506c-4a2d-829f-57beb748954e\") " pod="openshift-network-diagnostics/network-check-target-mpmvr" Jun 09 17:33:18.276754 ip-10-0-143-124 kubenswrapper[2552]: I0609 17:33:18.276723 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/a71cd181-3d23-4c4b-ac2f-e212dd9b5193-original-pull-secret\") pod \"global-pull-secret-syncer-lt4n9\" (UID: \"a71cd181-3d23-4c4b-ac2f-e212dd9b5193\") " pod="kube-system/global-pull-secret-syncer-lt4n9" Jun 09 17:33:18.276754 ip-10-0-143-124 kubenswrapper[2552]: I0609 17:33:18.276738 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/8563ebab-ebdd-4d68-bce1-78d2a7f62992-konnectivity-ca\") pod \"konnectivity-agent-gctfs\" (UID: \"8563ebab-ebdd-4d68-bce1-78d2a7f62992\") " pod="kube-system/konnectivity-agent-gctfs" Jun 09 17:33:18.276754 ip-10-0-143-124 kubenswrapper[2552]: I0609 17:33:18.276747 2552 reflector.go:439] "Caches populated" logger="kubernetes.io/kubelet-serving" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162" Jun 09 17:33:18.277174 ip-10-0-143-124 kubenswrapper[2552]: I0609 17:33:18.276753 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/99815f55-a516-4e96-bdb4-67bf609055f2-host-run-k8s-cni-cncf-io\") pod \"multus-n6545\" (UID: \"99815f55-a516-4e96-bdb4-67bf609055f2\") " pod="openshift-multus/multus-n6545" Jun 09 17:33:18.277174 ip-10-0-143-124 kubenswrapper[2552]: I0609 17:33:18.276798 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/2ef810f8-073d-4b45-ad02-2e098f31ed47-host\") pod \"node-ca-tb8b5\" (UID: \"2ef810f8-073d-4b45-ad02-2e098f31ed47\") " pod="openshift-image-registry/node-ca-tb8b5" Jun 09 17:33:18.277174 ip-10-0-143-124 kubenswrapper[2552]: I0609 17:33:18.276822 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zqbvx\" (UniqueName: \"kubernetes.io/projected/2ef810f8-073d-4b45-ad02-2e098f31ed47-kube-api-access-zqbvx\") pod \"node-ca-tb8b5\" (UID: \"2ef810f8-073d-4b45-ad02-2e098f31ed47\") " pod="openshift-image-registry/node-ca-tb8b5" Jun 09 17:33:18.277174 ip-10-0-143-124 kubenswrapper[2552]: I0609 17:33:18.276839 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/57526948-94e0-40fd-b0bf-ada9cf355743-os-release\") pod \"multus-additional-cni-plugins-s8d9p\" (UID: \"57526948-94e0-40fd-b0bf-ada9cf355743\") " pod="openshift-multus/multus-additional-cni-plugins-s8d9p" Jun 09 17:33:18.277174 ip-10-0-143-124 kubenswrapper[2552]: I0609 17:33:18.276853 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/a71cd181-3d23-4c4b-ac2f-e212dd9b5193-kubelet-config\") pod \"global-pull-secret-syncer-lt4n9\" (UID: \"a71cd181-3d23-4c4b-ac2f-e212dd9b5193\") " pod="kube-system/global-pull-secret-syncer-lt4n9" Jun 09 17:33:18.277174 ip-10-0-143-124 kubenswrapper[2552]: I0609 17:33:18.276874 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/99815f55-a516-4e96-bdb4-67bf609055f2-os-release\") pod \"multus-n6545\" (UID: \"99815f55-a516-4e96-bdb4-67bf609055f2\") " pod="openshift-multus/multus-n6545" Jun 09 17:33:18.277174 ip-10-0-143-124 kubenswrapper[2552]: I0609 17:33:18.276895 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/99815f55-a516-4e96-bdb4-67bf609055f2-cni-binary-copy\") pod \"multus-n6545\" (UID: \"99815f55-a516-4e96-bdb4-67bf609055f2\") " pod="openshift-multus/multus-n6545" Jun 09 17:33:18.277174 ip-10-0-143-124 kubenswrapper[2552]: I0609 17:33:18.276914 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/99815f55-a516-4e96-bdb4-67bf609055f2-host-var-lib-cni-multus\") pod \"multus-n6545\" (UID: \"99815f55-a516-4e96-bdb4-67bf609055f2\") " pod="openshift-multus/multus-n6545" Jun 09 17:33:18.277174 ip-10-0-143-124 kubenswrapper[2552]: I0609 17:33:18.276934 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/99815f55-a516-4e96-bdb4-67bf609055f2-etc-kubernetes\") pod \"multus-n6545\" (UID: \"99815f55-a516-4e96-bdb4-67bf609055f2\") " pod="openshift-multus/multus-n6545" Jun 09 17:33:18.277174 ip-10-0-143-124 kubenswrapper[2552]: I0609 17:33:18.276965 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-gkvrw\" (UniqueName: \"kubernetes.io/projected/df33c2c3-49d0-4236-996b-10cde5d3bc92-kube-api-access-gkvrw\") pod \"iptables-alerter-ddp2h\" (UID: \"df33c2c3-49d0-4236-996b-10cde5d3bc92\") " pod="openshift-network-operator/iptables-alerter-ddp2h" Jun 09 17:33:18.277174 ip-10-0-143-124 kubenswrapper[2552]: I0609 17:33:18.277007 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/99815f55-a516-4e96-bdb4-67bf609055f2-multus-cni-dir\") pod \"multus-n6545\" (UID: \"99815f55-a516-4e96-bdb4-67bf609055f2\") " pod="openshift-multus/multus-n6545" Jun 09 17:33:18.277174 ip-10-0-143-124 kubenswrapper[2552]: I0609 17:33:18.277045 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/99815f55-a516-4e96-bdb4-67bf609055f2-multus-socket-dir-parent\") pod \"multus-n6545\" (UID: \"99815f55-a516-4e96-bdb4-67bf609055f2\") " pod="openshift-multus/multus-n6545" Jun 09 17:33:18.277174 ip-10-0-143-124 kubenswrapper[2552]: I0609 17:33:18.277073 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-pn9j9\" (UniqueName: \"kubernetes.io/projected/99815f55-a516-4e96-bdb4-67bf609055f2-kube-api-access-pn9j9\") pod \"multus-n6545\" (UID: \"99815f55-a516-4e96-bdb4-67bf609055f2\") " pod="openshift-multus/multus-n6545" Jun 09 17:33:18.277174 ip-10-0-143-124 kubenswrapper[2552]: I0609 17:33:18.277096 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xqbr2\" (UniqueName: \"kubernetes.io/projected/f077d86b-598b-4398-9376-2956816fa47d-kube-api-access-xqbr2\") pod \"node-resolver-qbd4p\" (UID: \"f077d86b-598b-4398-9376-2956816fa47d\") " pod="openshift-dns/node-resolver-qbd4p" Jun 09 17:33:18.277174 ip-10-0-143-124 kubenswrapper[2552]: I0609 17:33:18.277118 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/df33c2c3-49d0-4236-996b-10cde5d3bc92-iptables-alerter-script\") pod \"iptables-alerter-ddp2h\" (UID: \"df33c2c3-49d0-4236-996b-10cde5d3bc92\") " pod="openshift-network-operator/iptables-alerter-ddp2h" Jun 09 17:33:18.277174 ip-10-0-143-124 kubenswrapper[2552]: I0609 17:33:18.277140 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/57526948-94e0-40fd-b0bf-ada9cf355743-cnibin\") pod \"multus-additional-cni-plugins-s8d9p\" (UID: \"57526948-94e0-40fd-b0bf-ada9cf355743\") " pod="openshift-multus/multus-additional-cni-plugins-s8d9p" Jun 09 17:33:18.277854 ip-10-0-143-124 kubenswrapper[2552]: I0609 17:33:18.277163 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xkvk2\" (UniqueName: \"kubernetes.io/projected/57526948-94e0-40fd-b0bf-ada9cf355743-kube-api-access-xkvk2\") pod \"multus-additional-cni-plugins-s8d9p\" (UID: \"57526948-94e0-40fd-b0bf-ada9cf355743\") " pod="openshift-multus/multus-additional-cni-plugins-s8d9p" Jun 09 17:33:18.277854 ip-10-0-143-124 kubenswrapper[2552]: I0609 17:33:18.277200 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/8563ebab-ebdd-4d68-bce1-78d2a7f62992-agent-certs\") pod \"konnectivity-agent-gctfs\" (UID: \"8563ebab-ebdd-4d68-bce1-78d2a7f62992\") " pod="kube-system/konnectivity-agent-gctfs" Jun 09 17:33:18.277854 ip-10-0-143-124 kubenswrapper[2552]: I0609 17:33:18.277222 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/99815f55-a516-4e96-bdb4-67bf609055f2-system-cni-dir\") pod \"multus-n6545\" (UID: \"99815f55-a516-4e96-bdb4-67bf609055f2\") " pod="openshift-multus/multus-n6545" Jun 09 17:33:18.277854 ip-10-0-143-124 kubenswrapper[2552]: I0609 17:33:18.277243 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/99815f55-a516-4e96-bdb4-67bf609055f2-cnibin\") pod \"multus-n6545\" (UID: \"99815f55-a516-4e96-bdb4-67bf609055f2\") " pod="openshift-multus/multus-n6545" Jun 09 17:33:18.277854 ip-10-0-143-124 kubenswrapper[2552]: I0609 17:33:18.277267 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/57526948-94e0-40fd-b0bf-ada9cf355743-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-s8d9p\" (UID: \"57526948-94e0-40fd-b0bf-ada9cf355743\") " pod="openshift-multus/multus-additional-cni-plugins-s8d9p" Jun 09 17:33:18.277854 ip-10-0-143-124 kubenswrapper[2552]: I0609 17:33:18.277290 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/99815f55-a516-4e96-bdb4-67bf609055f2-host-var-lib-cni-bin\") pod \"multus-n6545\" (UID: \"99815f55-a516-4e96-bdb4-67bf609055f2\") " pod="openshift-multus/multus-n6545" Jun 09 17:33:18.277854 ip-10-0-143-124 kubenswrapper[2552]: I0609 17:33:18.277310 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/99815f55-a516-4e96-bdb4-67bf609055f2-hostroot\") pod \"multus-n6545\" (UID: \"99815f55-a516-4e96-bdb4-67bf609055f2\") " pod="openshift-multus/multus-n6545" Jun 09 17:33:18.277854 ip-10-0-143-124 kubenswrapper[2552]: I0609 17:33:18.277333 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/99815f55-a516-4e96-bdb4-67bf609055f2-multus-conf-dir\") pod \"multus-n6545\" (UID: \"99815f55-a516-4e96-bdb4-67bf609055f2\") " pod="openshift-multus/multus-n6545" Jun 09 17:33:18.295794 ip-10-0-143-124 kubenswrapper[2552]: I0609 17:33:18.295775 2552 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kubelet-serving" csr="csr-m4lqh" Jun 09 17:33:18.303668 ip-10-0-143-124 kubenswrapper[2552]: I0609 17:33:18.303651 2552 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kubelet-serving" csr="csr-m4lqh" Jun 09 17:33:18.335999 ip-10-0-143-124 kubenswrapper[2552]: I0609 17:33:18.335948 2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-143-124.ec2.internal" event={"ID":"c6eab2ff3a3679dccbb6f4cc985d9ef6","Type":"ContainerStarted","Data":"17338c6926b0bc19b1a9b6aa9c128ddf8134cbc429d38810c4191cd05a3061e1"} Jun 09 17:33:18.337016 ip-10-0-143-124 kubenswrapper[2552]: I0609 17:33:18.336996 2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-143-124.ec2.internal" event={"ID":"98d869758a762967dbb1a9629bfd5f10","Type":"ContainerStarted","Data":"85d76fa189b5b2ff77743bb44cb0fd3aa62d3c9d6043b3292096d0c90a8a10c8"} Jun 09 17:33:18.364877 ip-10-0-143-124 kubenswrapper[2552]: I0609 17:33:18.364852 2552 desired_state_of_world_populator.go:154] "Finished populating initial desired state of world" Jun 09 17:33:18.377871 ip-10-0-143-124 kubenswrapper[2552]: I0609 17:33:18.377837 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-p6r5f\" (UniqueName: \"kubernetes.io/projected/9aa08551-03ce-4c12-96d9-d6ca9bb43bf7-kube-api-access-p6r5f\") pod \"ovnkube-node-kwh69\" (UID: \"9aa08551-03ce-4c12-96d9-d6ca9bb43bf7\") " pod="openshift-ovn-kubernetes/ovnkube-node-kwh69" Jun 09 17:33:18.377991 ip-10-0-143-124 kubenswrapper[2552]: I0609 17:33:18.377880 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/8285b34c-bc55-44a2-b6c5-e2c2e4c6a660-registration-dir\") pod \"aws-ebs-csi-driver-node-9gqc8\" (UID: \"8285b34c-bc55-44a2-b6c5-e2c2e4c6a660\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-9gqc8" Jun 09 17:33:18.377991 ip-10-0-143-124 kubenswrapper[2552]: I0609 17:33:18.377931 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/a71cd181-3d23-4c4b-ac2f-e212dd9b5193-original-pull-secret\") pod \"global-pull-secret-syncer-lt4n9\" (UID: \"a71cd181-3d23-4c4b-ac2f-e212dd9b5193\") " pod="kube-system/global-pull-secret-syncer-lt4n9" Jun 09 17:33:18.377991 ip-10-0-143-124 kubenswrapper[2552]: I0609 17:33:18.377956 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/2ef810f8-073d-4b45-ad02-2e098f31ed47-host\") pod \"node-ca-tb8b5\" (UID: \"2ef810f8-073d-4b45-ad02-2e098f31ed47\") " pod="openshift-image-registry/node-ca-tb8b5" Jun 09 17:33:18.377991 ip-10-0-143-124 kubenswrapper[2552]: I0609 17:33:18.377978 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/e5f0d419-4644-4890-85e5-c300cbaee351-etc-sysctl-conf\") pod \"tuned-g5rgn\" (UID: \"e5f0d419-4644-4890-85e5-c300cbaee351\") " pod="openshift-cluster-node-tuning-operator/tuned-g5rgn" Jun 09 17:33:18.378198 ip-10-0-143-124 kubenswrapper[2552]: I0609 17:33:18.377999 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/9aa08551-03ce-4c12-96d9-d6ca9bb43bf7-etc-openvswitch\") pod \"ovnkube-node-kwh69\" (UID: \"9aa08551-03ce-4c12-96d9-d6ca9bb43bf7\") " pod="openshift-ovn-kubernetes/ovnkube-node-kwh69" Jun 09 17:33:18.378198 ip-10-0-143-124 kubenswrapper[2552]: I0609 17:33:18.378008 2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/2ef810f8-073d-4b45-ad02-2e098f31ed47-host\") pod \"node-ca-tb8b5\" (UID: \"2ef810f8-073d-4b45-ad02-2e098f31ed47\") " pod="openshift-image-registry/node-ca-tb8b5" Jun 09 17:33:18.378198 ip-10-0-143-124 kubenswrapper[2552]: I0609 17:33:18.378023 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/57526948-94e0-40fd-b0bf-ada9cf355743-os-release\") pod \"multus-additional-cni-plugins-s8d9p\" (UID: \"57526948-94e0-40fd-b0bf-ada9cf355743\") " pod="openshift-multus/multus-additional-cni-plugins-s8d9p" Jun 09 17:33:18.378198 ip-10-0-143-124 kubenswrapper[2552]: I0609 17:33:18.378090 2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/57526948-94e0-40fd-b0bf-ada9cf355743-os-release\") pod \"multus-additional-cni-plugins-s8d9p\" (UID: \"57526948-94e0-40fd-b0bf-ada9cf355743\") " pod="openshift-multus/multus-additional-cni-plugins-s8d9p" Jun 09 17:33:18.378198 ip-10-0-143-124 kubenswrapper[2552]: E0609 17:33:18.378120 2552 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jun 09 17:33:18.378198 ip-10-0-143-124 kubenswrapper[2552]: E0609 17:33:18.378184 2552 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a71cd181-3d23-4c4b-ac2f-e212dd9b5193-original-pull-secret podName:a71cd181-3d23-4c4b-ac2f-e212dd9b5193 nodeName:}" failed. No retries permitted until 2026-06-09 17:33:18.878162137 +0000 UTC m=+2.978064780 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/a71cd181-3d23-4c4b-ac2f-e212dd9b5193-original-pull-secret") pod "global-pull-secret-syncer-lt4n9" (UID: "a71cd181-3d23-4c4b-ac2f-e212dd9b5193") : object "kube-system"/"original-pull-secret" not registered Jun 09 17:33:18.378493 ip-10-0-143-124 kubenswrapper[2552]: I0609 17:33:18.378214 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/a71cd181-3d23-4c4b-ac2f-e212dd9b5193-kubelet-config\") pod \"global-pull-secret-syncer-lt4n9\" (UID: \"a71cd181-3d23-4c4b-ac2f-e212dd9b5193\") " pod="kube-system/global-pull-secret-syncer-lt4n9" Jun 09 17:33:18.378493 ip-10-0-143-124 kubenswrapper[2552]: I0609 17:33:18.378251 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/99815f55-a516-4e96-bdb4-67bf609055f2-os-release\") pod \"multus-n6545\" (UID: \"99815f55-a516-4e96-bdb4-67bf609055f2\") " pod="openshift-multus/multus-n6545" Jun 09 17:33:18.378493 ip-10-0-143-124 kubenswrapper[2552]: I0609 17:33:18.378278 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/9aa08551-03ce-4c12-96d9-d6ca9bb43bf7-node-log\") pod \"ovnkube-node-kwh69\" (UID: \"9aa08551-03ce-4c12-96d9-d6ca9bb43bf7\") " pod="openshift-ovn-kubernetes/ovnkube-node-kwh69" Jun 09 17:33:18.378493 ip-10-0-143-124 kubenswrapper[2552]: I0609 17:33:18.378301 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-pn9j9\" (UniqueName: \"kubernetes.io/projected/99815f55-a516-4e96-bdb4-67bf609055f2-kube-api-access-pn9j9\") pod \"multus-n6545\" (UID: \"99815f55-a516-4e96-bdb4-67bf609055f2\") " pod="openshift-multus/multus-n6545" Jun 09 17:33:18.378493 ip-10-0-143-124 kubenswrapper[2552]: I0609 17:33:18.378323 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xqbr2\" (UniqueName: \"kubernetes.io/projected/f077d86b-598b-4398-9376-2956816fa47d-kube-api-access-xqbr2\") pod \"node-resolver-qbd4p\" (UID: \"f077d86b-598b-4398-9376-2956816fa47d\") " pod="openshift-dns/node-resolver-qbd4p" Jun 09 17:33:18.378493 ip-10-0-143-124 kubenswrapper[2552]: I0609 17:33:18.378360 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/9aa08551-03ce-4c12-96d9-d6ca9bb43bf7-env-overrides\") pod \"ovnkube-node-kwh69\" (UID: \"9aa08551-03ce-4c12-96d9-d6ca9bb43bf7\") " pod="openshift-ovn-kubernetes/ovnkube-node-kwh69" Jun 09 17:33:18.378493 ip-10-0-143-124 kubenswrapper[2552]: I0609 17:33:18.378382 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/df33c2c3-49d0-4236-996b-10cde5d3bc92-iptables-alerter-script\") pod \"iptables-alerter-ddp2h\" (UID: \"df33c2c3-49d0-4236-996b-10cde5d3bc92\") " pod="openshift-network-operator/iptables-alerter-ddp2h" Jun 09 17:33:18.378493 ip-10-0-143-124 kubenswrapper[2552]: I0609 17:33:18.378414 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/57526948-94e0-40fd-b0bf-ada9cf355743-cnibin\") pod \"multus-additional-cni-plugins-s8d9p\" (UID: \"57526948-94e0-40fd-b0bf-ada9cf355743\") " pod="openshift-multus/multus-additional-cni-plugins-s8d9p" Jun 09 17:33:18.378493 ip-10-0-143-124 kubenswrapper[2552]: I0609 17:33:18.378421 2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/a71cd181-3d23-4c4b-ac2f-e212dd9b5193-kubelet-config\") pod \"global-pull-secret-syncer-lt4n9\" (UID: \"a71cd181-3d23-4c4b-ac2f-e212dd9b5193\") " pod="kube-system/global-pull-secret-syncer-lt4n9" Jun 09 17:33:18.378493 ip-10-0-143-124 kubenswrapper[2552]: I0609 17:33:18.378444 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xkvk2\" (UniqueName: \"kubernetes.io/projected/57526948-94e0-40fd-b0bf-ada9cf355743-kube-api-access-xkvk2\") pod \"multus-additional-cni-plugins-s8d9p\" (UID: \"57526948-94e0-40fd-b0bf-ada9cf355743\") " pod="openshift-multus/multus-additional-cni-plugins-s8d9p" Jun 09 17:33:18.378493 ip-10-0-143-124 kubenswrapper[2552]: I0609 17:33:18.378468 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/8563ebab-ebdd-4d68-bce1-78d2a7f62992-agent-certs\") pod \"konnectivity-agent-gctfs\" (UID: \"8563ebab-ebdd-4d68-bce1-78d2a7f62992\") " pod="kube-system/konnectivity-agent-gctfs" Jun 09 17:33:18.378493 ip-10-0-143-124 kubenswrapper[2552]: I0609 17:33:18.378482 2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/99815f55-a516-4e96-bdb4-67bf609055f2-os-release\") pod \"multus-n6545\" (UID: \"99815f55-a516-4e96-bdb4-67bf609055f2\") " pod="openshift-multus/multus-n6545" Jun 09 17:33:18.378493 ip-10-0-143-124 kubenswrapper[2552]: I0609 17:33:18.378490 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/99815f55-a516-4e96-bdb4-67bf609055f2-cnibin\") pod \"multus-n6545\" (UID: \"99815f55-a516-4e96-bdb4-67bf609055f2\") " pod="openshift-multus/multus-n6545" Jun 09 17:33:18.379294 ip-10-0-143-124 kubenswrapper[2552]: I0609 17:33:18.378513 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zg6kz\" (UniqueName: \"kubernetes.io/projected/e5f0d419-4644-4890-85e5-c300cbaee351-kube-api-access-zg6kz\") pod \"tuned-g5rgn\" (UID: \"e5f0d419-4644-4890-85e5-c300cbaee351\") " pod="openshift-cluster-node-tuning-operator/tuned-g5rgn" Jun 09 17:33:18.379294 ip-10-0-143-124 kubenswrapper[2552]: I0609 17:33:18.378537 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/9aa08551-03ce-4c12-96d9-d6ca9bb43bf7-systemd-units\") pod \"ovnkube-node-kwh69\" (UID: \"9aa08551-03ce-4c12-96d9-d6ca9bb43bf7\") " pod="openshift-ovn-kubernetes/ovnkube-node-kwh69" Jun 09 17:33:18.379294 ip-10-0-143-124 kubenswrapper[2552]: I0609 17:33:18.378560 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/9aa08551-03ce-4c12-96d9-d6ca9bb43bf7-var-lib-openvswitch\") pod \"ovnkube-node-kwh69\" (UID: \"9aa08551-03ce-4c12-96d9-d6ca9bb43bf7\") " pod="openshift-ovn-kubernetes/ovnkube-node-kwh69" Jun 09 17:33:18.379294 ip-10-0-143-124 kubenswrapper[2552]: I0609 17:33:18.378560 2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/57526948-94e0-40fd-b0bf-ada9cf355743-cnibin\") pod \"multus-additional-cni-plugins-s8d9p\" (UID: \"57526948-94e0-40fd-b0bf-ada9cf355743\") " pod="openshift-multus/multus-additional-cni-plugins-s8d9p" Jun 09 17:33:18.379294 ip-10-0-143-124 kubenswrapper[2552]: I0609 17:33:18.378584 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/99815f55-a516-4e96-bdb4-67bf609055f2-host-var-lib-cni-bin\") pod \"multus-n6545\" (UID: \"99815f55-a516-4e96-bdb4-67bf609055f2\") " pod="openshift-multus/multus-n6545" Jun 09 17:33:18.379294 ip-10-0-143-124 kubenswrapper[2552]: I0609 17:33:18.378632 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/99815f55-a516-4e96-bdb4-67bf609055f2-hostroot\") pod \"multus-n6545\" (UID: \"99815f55-a516-4e96-bdb4-67bf609055f2\") " pod="openshift-multus/multus-n6545" Jun 09 17:33:18.379294 ip-10-0-143-124 kubenswrapper[2552]: I0609 17:33:18.378661 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/9aa08551-03ce-4c12-96d9-d6ca9bb43bf7-host-run-netns\") pod \"ovnkube-node-kwh69\" (UID: \"9aa08551-03ce-4c12-96d9-d6ca9bb43bf7\") " pod="openshift-ovn-kubernetes/ovnkube-node-kwh69" Jun 09 17:33:18.379294 ip-10-0-143-124 kubenswrapper[2552]: I0609 17:33:18.378678 2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/99815f55-a516-4e96-bdb4-67bf609055f2-cnibin\") pod \"multus-n6545\" (UID: \"99815f55-a516-4e96-bdb4-67bf609055f2\") " pod="openshift-multus/multus-n6545" Jun 09 17:33:18.379294 ip-10-0-143-124 kubenswrapper[2552]: I0609 17:33:18.378685 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/9aa08551-03ce-4c12-96d9-d6ca9bb43bf7-host-cni-bin\") pod \"ovnkube-node-kwh69\" (UID: \"9aa08551-03ce-4c12-96d9-d6ca9bb43bf7\") " pod="openshift-ovn-kubernetes/ovnkube-node-kwh69" Jun 09 17:33:18.379294 ip-10-0-143-124 kubenswrapper[2552]: I0609 17:33:18.378731 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/9aa08551-03ce-4c12-96d9-d6ca9bb43bf7-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-kwh69\" (UID: \"9aa08551-03ce-4c12-96d9-d6ca9bb43bf7\") " pod="openshift-ovn-kubernetes/ovnkube-node-kwh69" Jun 09 17:33:18.379294 ip-10-0-143-124 kubenswrapper[2552]: I0609 17:33:18.378739 2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/99815f55-a516-4e96-bdb4-67bf609055f2-hostroot\") pod \"multus-n6545\" (UID: \"99815f55-a516-4e96-bdb4-67bf609055f2\") " pod="openshift-multus/multus-n6545" Jun 09 17:33:18.379294 ip-10-0-143-124 kubenswrapper[2552]: I0609 17:33:18.378760 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-q8zs5\" (UniqueName: \"kubernetes.io/projected/8285b34c-bc55-44a2-b6c5-e2c2e4c6a660-kube-api-access-q8zs5\") pod \"aws-ebs-csi-driver-node-9gqc8\" (UID: \"8285b34c-bc55-44a2-b6c5-e2c2e4c6a660\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-9gqc8" Jun 09 17:33:18.379294 ip-10-0-143-124 kubenswrapper[2552]: I0609 17:33:18.378795 2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/99815f55-a516-4e96-bdb4-67bf609055f2-host-var-lib-cni-bin\") pod \"multus-n6545\" (UID: \"99815f55-a516-4e96-bdb4-67bf609055f2\") " pod="openshift-multus/multus-n6545" Jun 09 17:33:18.379294 ip-10-0-143-124 kubenswrapper[2552]: I0609 17:33:18.378837 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/57526948-94e0-40fd-b0bf-ada9cf355743-system-cni-dir\") pod \"multus-additional-cni-plugins-s8d9p\" (UID: \"57526948-94e0-40fd-b0bf-ada9cf355743\") " pod="openshift-multus/multus-additional-cni-plugins-s8d9p" Jun 09 17:33:18.379294 ip-10-0-143-124 kubenswrapper[2552]: I0609 17:33:18.378894 2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/57526948-94e0-40fd-b0bf-ada9cf355743-system-cni-dir\") pod \"multus-additional-cni-plugins-s8d9p\" (UID: \"57526948-94e0-40fd-b0bf-ada9cf355743\") " pod="openshift-multus/multus-additional-cni-plugins-s8d9p" Jun 09 17:33:18.379294 ip-10-0-143-124 kubenswrapper[2552]: I0609 17:33:18.378928 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/57526948-94e0-40fd-b0bf-ada9cf355743-tuning-conf-dir\") pod \"multus-additional-cni-plugins-s8d9p\" (UID: \"57526948-94e0-40fd-b0bf-ada9cf355743\") " pod="openshift-multus/multus-additional-cni-plugins-s8d9p" Jun 09 17:33:18.379294 ip-10-0-143-124 kubenswrapper[2552]: I0609 17:33:18.378916 2552 swap_util.go:74] "error creating dir to test if tmpfs noswap is enabled. Assuming not supported" mount path="" error="stat /var/lib/kubelet/plugins/kubernetes.io/empty-dir: no such file or directory" Jun 09 17:33:18.379995 ip-10-0-143-124 kubenswrapper[2552]: I0609 17:33:18.379011 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/f077d86b-598b-4398-9376-2956816fa47d-hosts-file\") pod \"node-resolver-qbd4p\" (UID: \"f077d86b-598b-4398-9376-2956816fa47d\") " pod="openshift-dns/node-resolver-qbd4p" Jun 09 17:33:18.379995 ip-10-0-143-124 kubenswrapper[2552]: I0609 17:33:18.379056 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/e5f0d419-4644-4890-85e5-c300cbaee351-sys\") pod \"tuned-g5rgn\" (UID: \"e5f0d419-4644-4890-85e5-c300cbaee351\") " pod="openshift-cluster-node-tuning-operator/tuned-g5rgn" Jun 09 17:33:18.379995 ip-10-0-143-124 kubenswrapper[2552]: I0609 17:33:18.379081 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/9aa08551-03ce-4c12-96d9-d6ca9bb43bf7-host-kubelet\") pod \"ovnkube-node-kwh69\" (UID: \"9aa08551-03ce-4c12-96d9-d6ca9bb43bf7\") " pod="openshift-ovn-kubernetes/ovnkube-node-kwh69" Jun 09 17:33:18.379995 ip-10-0-143-124 kubenswrapper[2552]: I0609 17:33:18.379097 2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/57526948-94e0-40fd-b0bf-ada9cf355743-tuning-conf-dir\") pod \"multus-additional-cni-plugins-s8d9p\" (UID: \"57526948-94e0-40fd-b0bf-ada9cf355743\") " pod="openshift-multus/multus-additional-cni-plugins-s8d9p" Jun 09 17:33:18.379995 ip-10-0-143-124 kubenswrapper[2552]: I0609 17:33:18.379123 2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/df33c2c3-49d0-4236-996b-10cde5d3bc92-iptables-alerter-script\") pod \"iptables-alerter-ddp2h\" (UID: \"df33c2c3-49d0-4236-996b-10cde5d3bc92\") " pod="openshift-network-operator/iptables-alerter-ddp2h" Jun 09 17:33:18.379995 ip-10-0-143-124 kubenswrapper[2552]: I0609 17:33:18.379151 2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/f077d86b-598b-4398-9376-2956816fa47d-hosts-file\") pod \"node-resolver-qbd4p\" (UID: \"f077d86b-598b-4398-9376-2956816fa47d\") " pod="openshift-dns/node-resolver-qbd4p" Jun 09 17:33:18.379995 ip-10-0-143-124 kubenswrapper[2552]: I0609 17:33:18.379127 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/9aa08551-03ce-4c12-96d9-d6ca9bb43bf7-run-ovn\") pod \"ovnkube-node-kwh69\" (UID: \"9aa08551-03ce-4c12-96d9-d6ca9bb43bf7\") " pod="openshift-ovn-kubernetes/ovnkube-node-kwh69" Jun 09 17:33:18.379995 ip-10-0-143-124 kubenswrapper[2552]: I0609 17:33:18.379195 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/8285b34c-bc55-44a2-b6c5-e2c2e4c6a660-sys-fs\") pod \"aws-ebs-csi-driver-node-9gqc8\" (UID: \"8285b34c-bc55-44a2-b6c5-e2c2e4c6a660\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-9gqc8" Jun 09 17:33:18.379995 ip-10-0-143-124 kubenswrapper[2552]: I0609 17:33:18.379221 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/a71cd181-3d23-4c4b-ac2f-e212dd9b5193-dbus\") pod \"global-pull-secret-syncer-lt4n9\" (UID: \"a71cd181-3d23-4c4b-ac2f-e212dd9b5193\") " pod="kube-system/global-pull-secret-syncer-lt4n9" Jun 09 17:33:18.379995 ip-10-0-143-124 kubenswrapper[2552]: I0609 17:33:18.379259 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/2ef810f8-073d-4b45-ad02-2e098f31ed47-serviceca\") pod \"node-ca-tb8b5\" (UID: \"2ef810f8-073d-4b45-ad02-2e098f31ed47\") " pod="openshift-image-registry/node-ca-tb8b5" Jun 09 17:33:18.379995 ip-10-0-143-124 kubenswrapper[2552]: I0609 17:33:18.379284 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/57526948-94e0-40fd-b0bf-ada9cf355743-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-s8d9p\" (UID: \"57526948-94e0-40fd-b0bf-ada9cf355743\") " pod="openshift-multus/multus-additional-cni-plugins-s8d9p" Jun 09 17:33:18.379995 ip-10-0-143-124 kubenswrapper[2552]: I0609 17:33:18.379326 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/e5f0d419-4644-4890-85e5-c300cbaee351-etc-sysctl-d\") pod \"tuned-g5rgn\" (UID: \"e5f0d419-4644-4890-85e5-c300cbaee351\") " pod="openshift-cluster-node-tuning-operator/tuned-g5rgn" Jun 09 17:33:18.379995 ip-10-0-143-124 kubenswrapper[2552]: I0609 17:33:18.379347 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/e5f0d419-4644-4890-85e5-c300cbaee351-run\") pod \"tuned-g5rgn\" (UID: \"e5f0d419-4644-4890-85e5-c300cbaee351\") " pod="openshift-cluster-node-tuning-operator/tuned-g5rgn" Jun 09 17:33:18.379995 ip-10-0-143-124 kubenswrapper[2552]: I0609 17:33:18.379363 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/e5f0d419-4644-4890-85e5-c300cbaee351-tmp\") pod \"tuned-g5rgn\" (UID: \"e5f0d419-4644-4890-85e5-c300cbaee351\") " pod="openshift-cluster-node-tuning-operator/tuned-g5rgn" Jun 09 17:33:18.379995 ip-10-0-143-124 kubenswrapper[2552]: I0609 17:33:18.379383 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/9aa08551-03ce-4c12-96d9-d6ca9bb43bf7-ovnkube-config\") pod \"ovnkube-node-kwh69\" (UID: \"9aa08551-03ce-4c12-96d9-d6ca9bb43bf7\") " pod="openshift-ovn-kubernetes/ovnkube-node-kwh69" Jun 09 17:33:18.379995 ip-10-0-143-124 kubenswrapper[2552]: I0609 17:33:18.379405 2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/a71cd181-3d23-4c4b-ac2f-e212dd9b5193-dbus\") pod \"global-pull-secret-syncer-lt4n9\" (UID: \"a71cd181-3d23-4c4b-ac2f-e212dd9b5193\") " pod="kube-system/global-pull-secret-syncer-lt4n9" Jun 09 17:33:18.379995 ip-10-0-143-124 kubenswrapper[2552]: I0609 17:33:18.379407 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/8563ebab-ebdd-4d68-bce1-78d2a7f62992-konnectivity-ca\") pod \"konnectivity-agent-gctfs\" (UID: \"8563ebab-ebdd-4d68-bce1-78d2a7f62992\") " pod="kube-system/konnectivity-agent-gctfs" Jun 09 17:33:18.380710 ip-10-0-143-124 kubenswrapper[2552]: I0609 17:33:18.379450 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/99815f55-a516-4e96-bdb4-67bf609055f2-host-run-k8s-cni-cncf-io\") pod \"multus-n6545\" (UID: \"99815f55-a516-4e96-bdb4-67bf609055f2\") " pod="openshift-multus/multus-n6545" Jun 09 17:33:18.380710 ip-10-0-143-124 kubenswrapper[2552]: I0609 17:33:18.379475 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zqbvx\" (UniqueName: \"kubernetes.io/projected/2ef810f8-073d-4b45-ad02-2e098f31ed47-kube-api-access-zqbvx\") pod \"node-ca-tb8b5\" (UID: \"2ef810f8-073d-4b45-ad02-2e098f31ed47\") " pod="openshift-image-registry/node-ca-tb8b5" Jun 09 17:33:18.380710 ip-10-0-143-124 kubenswrapper[2552]: I0609 17:33:18.379499 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/e5f0d419-4644-4890-85e5-c300cbaee351-etc-tuned\") pod \"tuned-g5rgn\" (UID: \"e5f0d419-4644-4890-85e5-c300cbaee351\") " pod="openshift-cluster-node-tuning-operator/tuned-g5rgn" Jun 09 17:33:18.380710 ip-10-0-143-124 kubenswrapper[2552]: I0609 17:33:18.379505 2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/99815f55-a516-4e96-bdb4-67bf609055f2-host-run-k8s-cni-cncf-io\") pod \"multus-n6545\" (UID: \"99815f55-a516-4e96-bdb4-67bf609055f2\") " pod="openshift-multus/multus-n6545" Jun 09 17:33:18.380710 ip-10-0-143-124 kubenswrapper[2552]: I0609 17:33:18.379522 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/99815f55-a516-4e96-bdb4-67bf609055f2-cni-binary-copy\") pod \"multus-n6545\" (UID: \"99815f55-a516-4e96-bdb4-67bf609055f2\") " pod="openshift-multus/multus-n6545" Jun 09 17:33:18.380710 ip-10-0-143-124 kubenswrapper[2552]: I0609 17:33:18.379549 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/99815f55-a516-4e96-bdb4-67bf609055f2-host-var-lib-cni-multus\") pod \"multus-n6545\" (UID: \"99815f55-a516-4e96-bdb4-67bf609055f2\") " pod="openshift-multus/multus-n6545" Jun 09 17:33:18.380710 ip-10-0-143-124 kubenswrapper[2552]: I0609 17:33:18.379573 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/99815f55-a516-4e96-bdb4-67bf609055f2-etc-kubernetes\") pod \"multus-n6545\" (UID: \"99815f55-a516-4e96-bdb4-67bf609055f2\") " pod="openshift-multus/multus-n6545" Jun 09 17:33:18.380710 ip-10-0-143-124 kubenswrapper[2552]: I0609 17:33:18.379615 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/9aa08551-03ce-4c12-96d9-d6ca9bb43bf7-host-cni-netd\") pod \"ovnkube-node-kwh69\" (UID: \"9aa08551-03ce-4c12-96d9-d6ca9bb43bf7\") " pod="openshift-ovn-kubernetes/ovnkube-node-kwh69" Jun 09 17:33:18.380710 ip-10-0-143-124 kubenswrapper[2552]: I0609 17:33:18.379639 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/8285b34c-bc55-44a2-b6c5-e2c2e4c6a660-socket-dir\") pod \"aws-ebs-csi-driver-node-9gqc8\" (UID: \"8285b34c-bc55-44a2-b6c5-e2c2e4c6a660\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-9gqc8" Jun 09 17:33:18.380710 ip-10-0-143-124 kubenswrapper[2552]: I0609 17:33:18.379663 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-gkvrw\" (UniqueName: \"kubernetes.io/projected/df33c2c3-49d0-4236-996b-10cde5d3bc92-kube-api-access-gkvrw\") pod \"iptables-alerter-ddp2h\" (UID: \"df33c2c3-49d0-4236-996b-10cde5d3bc92\") " pod="openshift-network-operator/iptables-alerter-ddp2h" Jun 09 17:33:18.380710 ip-10-0-143-124 kubenswrapper[2552]: I0609 17:33:18.379687 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/99815f55-a516-4e96-bdb4-67bf609055f2-multus-cni-dir\") pod \"multus-n6545\" (UID: \"99815f55-a516-4e96-bdb4-67bf609055f2\") " pod="openshift-multus/multus-n6545" Jun 09 17:33:18.380710 ip-10-0-143-124 kubenswrapper[2552]: I0609 17:33:18.379709 2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/2ef810f8-073d-4b45-ad02-2e098f31ed47-serviceca\") pod \"node-ca-tb8b5\" (UID: \"2ef810f8-073d-4b45-ad02-2e098f31ed47\") " pod="openshift-image-registry/node-ca-tb8b5" Jun 09 17:33:18.380710 ip-10-0-143-124 kubenswrapper[2552]: I0609 17:33:18.379715 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/99815f55-a516-4e96-bdb4-67bf609055f2-multus-socket-dir-parent\") pod \"multus-n6545\" (UID: \"99815f55-a516-4e96-bdb4-67bf609055f2\") " pod="openshift-multus/multus-n6545" Jun 09 17:33:18.380710 ip-10-0-143-124 kubenswrapper[2552]: I0609 17:33:18.379742 2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/99815f55-a516-4e96-bdb4-67bf609055f2-etc-kubernetes\") pod \"multus-n6545\" (UID: \"99815f55-a516-4e96-bdb4-67bf609055f2\") " pod="openshift-multus/multus-n6545" Jun 09 17:33:18.380710 ip-10-0-143-124 kubenswrapper[2552]: I0609 17:33:18.379770 2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/99815f55-a516-4e96-bdb4-67bf609055f2-multus-socket-dir-parent\") pod \"multus-n6545\" (UID: \"99815f55-a516-4e96-bdb4-67bf609055f2\") " pod="openshift-multus/multus-n6545" Jun 09 17:33:18.380710 ip-10-0-143-124 kubenswrapper[2552]: I0609 17:33:18.379824 2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/99815f55-a516-4e96-bdb4-67bf609055f2-multus-cni-dir\") pod \"multus-n6545\" (UID: \"99815f55-a516-4e96-bdb4-67bf609055f2\") " pod="openshift-multus/multus-n6545" Jun 09 17:33:18.380710 ip-10-0-143-124 kubenswrapper[2552]: I0609 17:33:18.379885 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/e5f0d419-4644-4890-85e5-c300cbaee351-var-lib-kubelet\") pod \"tuned-g5rgn\" (UID: \"e5f0d419-4644-4890-85e5-c300cbaee351\") " pod="openshift-cluster-node-tuning-operator/tuned-g5rgn" Jun 09 17:33:18.381480 ip-10-0-143-124 kubenswrapper[2552]: I0609 17:33:18.379921 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/9aa08551-03ce-4c12-96d9-d6ca9bb43bf7-ovn-node-metrics-cert\") pod \"ovnkube-node-kwh69\" (UID: \"9aa08551-03ce-4c12-96d9-d6ca9bb43bf7\") " pod="openshift-ovn-kubernetes/ovnkube-node-kwh69" Jun 09 17:33:18.381480 ip-10-0-143-124 kubenswrapper[2552]: I0609 17:33:18.379947 2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/57526948-94e0-40fd-b0bf-ada9cf355743-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-s8d9p\" (UID: \"57526948-94e0-40fd-b0bf-ada9cf355743\") " pod="openshift-multus/multus-additional-cni-plugins-s8d9p" Jun 09 17:33:18.381480 ip-10-0-143-124 kubenswrapper[2552]: I0609 17:33:18.379966 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/99815f55-a516-4e96-bdb4-67bf609055f2-system-cni-dir\") pod \"multus-n6545\" (UID: \"99815f55-a516-4e96-bdb4-67bf609055f2\") " pod="openshift-multus/multus-n6545" Jun 09 17:33:18.381480 ip-10-0-143-124 kubenswrapper[2552]: I0609 17:33:18.379959 2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/8563ebab-ebdd-4d68-bce1-78d2a7f62992-konnectivity-ca\") pod \"konnectivity-agent-gctfs\" (UID: \"8563ebab-ebdd-4d68-bce1-78d2a7f62992\") " pod="kube-system/konnectivity-agent-gctfs" Jun 09 17:33:18.381480 ip-10-0-143-124 kubenswrapper[2552]: I0609 17:33:18.379995 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/e5f0d419-4644-4890-85e5-c300cbaee351-etc-modprobe-d\") pod \"tuned-g5rgn\" (UID: \"e5f0d419-4644-4890-85e5-c300cbaee351\") " pod="openshift-cluster-node-tuning-operator/tuned-g5rgn" Jun 09 17:33:18.381480 ip-10-0-143-124 kubenswrapper[2552]: I0609 17:33:18.380043 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/57526948-94e0-40fd-b0bf-ada9cf355743-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-s8d9p\" (UID: \"57526948-94e0-40fd-b0bf-ada9cf355743\") " pod="openshift-multus/multus-additional-cni-plugins-s8d9p" Jun 09 17:33:18.381480 ip-10-0-143-124 kubenswrapper[2552]: I0609 17:33:18.380029 2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/99815f55-a516-4e96-bdb4-67bf609055f2-system-cni-dir\") pod \"multus-n6545\" (UID: \"99815f55-a516-4e96-bdb4-67bf609055f2\") " pod="openshift-multus/multus-n6545" Jun 09 17:33:18.381480 ip-10-0-143-124 kubenswrapper[2552]: I0609 17:33:18.380083 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/99815f55-a516-4e96-bdb4-67bf609055f2-multus-conf-dir\") pod \"multus-n6545\" (UID: \"99815f55-a516-4e96-bdb4-67bf609055f2\") " pod="openshift-multus/multus-n6545" Jun 09 17:33:18.381480 ip-10-0-143-124 kubenswrapper[2552]: I0609 17:33:18.380105 2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/99815f55-a516-4e96-bdb4-67bf609055f2-host-var-lib-cni-multus\") pod \"multus-n6545\" (UID: \"99815f55-a516-4e96-bdb4-67bf609055f2\") " pod="openshift-multus/multus-n6545" Jun 09 17:33:18.381480 ip-10-0-143-124 kubenswrapper[2552]: I0609 17:33:18.380166 2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/99815f55-a516-4e96-bdb4-67bf609055f2-multus-conf-dir\") pod \"multus-n6545\" (UID: \"99815f55-a516-4e96-bdb4-67bf609055f2\") " pod="openshift-multus/multus-n6545" Jun 09 17:33:18.381480 ip-10-0-143-124 kubenswrapper[2552]: I0609 17:33:18.380167 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/e5f0d419-4644-4890-85e5-c300cbaee351-etc-systemd\") pod \"tuned-g5rgn\" (UID: \"e5f0d419-4644-4890-85e5-c300cbaee351\") " pod="openshift-cluster-node-tuning-operator/tuned-g5rgn" Jun 09 17:33:18.381480 ip-10-0-143-124 kubenswrapper[2552]: I0609 17:33:18.380210 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/e5f0d419-4644-4890-85e5-c300cbaee351-host\") pod \"tuned-g5rgn\" (UID: \"e5f0d419-4644-4890-85e5-c300cbaee351\") " pod="openshift-cluster-node-tuning-operator/tuned-g5rgn" Jun 09 17:33:18.381480 ip-10-0-143-124 kubenswrapper[2552]: I0609 17:33:18.380260 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/df33c2c3-49d0-4236-996b-10cde5d3bc92-host-slash\") pod \"iptables-alerter-ddp2h\" (UID: \"df33c2c3-49d0-4236-996b-10cde5d3bc92\") " pod="openshift-network-operator/iptables-alerter-ddp2h" Jun 09 17:33:18.381480 ip-10-0-143-124 kubenswrapper[2552]: I0609 17:33:18.380268 2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/99815f55-a516-4e96-bdb4-67bf609055f2-cni-binary-copy\") pod \"multus-n6545\" (UID: \"99815f55-a516-4e96-bdb4-67bf609055f2\") " pod="openshift-multus/multus-n6545" Jun 09 17:33:18.381480 ip-10-0-143-124 kubenswrapper[2552]: I0609 17:33:18.380284 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/99815f55-a516-4e96-bdb4-67bf609055f2-host-run-netns\") pod \"multus-n6545\" (UID: \"99815f55-a516-4e96-bdb4-67bf609055f2\") " pod="openshift-multus/multus-n6545" Jun 09 17:33:18.381480 ip-10-0-143-124 kubenswrapper[2552]: I0609 17:33:18.380308 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/b817ed32-ca44-43a6-99cf-8cf86ffd8c05-metrics-certs\") pod \"network-metrics-daemon-pvmnc\" (UID: \"b817ed32-ca44-43a6-99cf-8cf86ffd8c05\") " pod="openshift-multus/network-metrics-daemon-pvmnc" Jun 09 17:33:18.381480 ip-10-0-143-124 kubenswrapper[2552]: I0609 17:33:18.380324 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-lzhbc\" (UniqueName: \"kubernetes.io/projected/b817ed32-ca44-43a6-99cf-8cf86ffd8c05-kube-api-access-lzhbc\") pod \"network-metrics-daemon-pvmnc\" (UID: \"b817ed32-ca44-43a6-99cf-8cf86ffd8c05\") " pod="openshift-multus/network-metrics-daemon-pvmnc" Jun 09 17:33:18.382308 ip-10-0-143-124 kubenswrapper[2552]: I0609 17:33:18.380329 2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/df33c2c3-49d0-4236-996b-10cde5d3bc92-host-slash\") pod \"iptables-alerter-ddp2h\" (UID: \"df33c2c3-49d0-4236-996b-10cde5d3bc92\") " pod="openshift-network-operator/iptables-alerter-ddp2h" Jun 09 17:33:18.382308 ip-10-0-143-124 kubenswrapper[2552]: I0609 17:33:18.380342 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/9aa08551-03ce-4c12-96d9-d6ca9bb43bf7-run-openvswitch\") pod \"ovnkube-node-kwh69\" (UID: \"9aa08551-03ce-4c12-96d9-d6ca9bb43bf7\") " pod="openshift-ovn-kubernetes/ovnkube-node-kwh69" Jun 09 17:33:18.382308 ip-10-0-143-124 kubenswrapper[2552]: I0609 17:33:18.380359 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/8285b34c-bc55-44a2-b6c5-e2c2e4c6a660-kubelet-dir\") pod \"aws-ebs-csi-driver-node-9gqc8\" (UID: \"8285b34c-bc55-44a2-b6c5-e2c2e4c6a660\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-9gqc8" Jun 09 17:33:18.382308 ip-10-0-143-124 kubenswrapper[2552]: I0609 17:33:18.380356 2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/99815f55-a516-4e96-bdb4-67bf609055f2-host-run-netns\") pod \"multus-n6545\" (UID: \"99815f55-a516-4e96-bdb4-67bf609055f2\") " pod="openshift-multus/multus-n6545" Jun 09 17:33:18.382308 ip-10-0-143-124 kubenswrapper[2552]: I0609 17:33:18.380374 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/8285b34c-bc55-44a2-b6c5-e2c2e4c6a660-device-dir\") pod \"aws-ebs-csi-driver-node-9gqc8\" (UID: \"8285b34c-bc55-44a2-b6c5-e2c2e4c6a660\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-9gqc8" Jun 09 17:33:18.382308 ip-10-0-143-124 kubenswrapper[2552]: I0609 17:33:18.380389 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/8285b34c-bc55-44a2-b6c5-e2c2e4c6a660-etc-selinux\") pod \"aws-ebs-csi-driver-node-9gqc8\" (UID: \"8285b34c-bc55-44a2-b6c5-e2c2e4c6a660\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-9gqc8" Jun 09 17:33:18.382308 ip-10-0-143-124 kubenswrapper[2552]: E0609 17:33:18.380396 2552 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jun 09 17:33:18.382308 ip-10-0-143-124 kubenswrapper[2552]: I0609 17:33:18.380406 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/99815f55-a516-4e96-bdb4-67bf609055f2-host-var-lib-kubelet\") pod \"multus-n6545\" (UID: \"99815f55-a516-4e96-bdb4-67bf609055f2\") " pod="openshift-multus/multus-n6545" Jun 09 17:33:18.382308 ip-10-0-143-124 kubenswrapper[2552]: I0609 17:33:18.380424 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/99815f55-a516-4e96-bdb4-67bf609055f2-multus-daemon-config\") pod \"multus-n6545\" (UID: \"99815f55-a516-4e96-bdb4-67bf609055f2\") " pod="openshift-multus/multus-n6545" Jun 09 17:33:18.382308 ip-10-0-143-124 kubenswrapper[2552]: E0609 17:33:18.380461 2552 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b817ed32-ca44-43a6-99cf-8cf86ffd8c05-metrics-certs podName:b817ed32-ca44-43a6-99cf-8cf86ffd8c05 nodeName:}" failed. No retries permitted until 2026-06-09 17:33:18.880434779 +0000 UTC m=+2.980337419 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/b817ed32-ca44-43a6-99cf-8cf86ffd8c05-metrics-certs") pod "network-metrics-daemon-pvmnc" (UID: "b817ed32-ca44-43a6-99cf-8cf86ffd8c05") : object "openshift-multus"/"metrics-daemon-secret" not registered Jun 09 17:33:18.382308 ip-10-0-143-124 kubenswrapper[2552]: I0609 17:33:18.380480 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/f077d86b-598b-4398-9376-2956816fa47d-tmp-dir\") pod \"node-resolver-qbd4p\" (UID: \"f077d86b-598b-4398-9376-2956816fa47d\") " pod="openshift-dns/node-resolver-qbd4p" Jun 09 17:33:18.382308 ip-10-0-143-124 kubenswrapper[2552]: I0609 17:33:18.380509 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/e5f0d419-4644-4890-85e5-c300cbaee351-etc-kubernetes\") pod \"tuned-g5rgn\" (UID: \"e5f0d419-4644-4890-85e5-c300cbaee351\") " pod="openshift-cluster-node-tuning-operator/tuned-g5rgn" Jun 09 17:33:18.382308 ip-10-0-143-124 kubenswrapper[2552]: I0609 17:33:18.380534 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/e5f0d419-4644-4890-85e5-c300cbaee351-lib-modules\") pod \"tuned-g5rgn\" (UID: \"e5f0d419-4644-4890-85e5-c300cbaee351\") " pod="openshift-cluster-node-tuning-operator/tuned-g5rgn" Jun 09 17:33:18.382308 ip-10-0-143-124 kubenswrapper[2552]: I0609 17:33:18.380553 2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/57526948-94e0-40fd-b0bf-ada9cf355743-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-s8d9p\" (UID: \"57526948-94e0-40fd-b0bf-ada9cf355743\") " pod="openshift-multus/multus-additional-cni-plugins-s8d9p" Jun 09 17:33:18.382308 ip-10-0-143-124 kubenswrapper[2552]: I0609 17:33:18.380556 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/9aa08551-03ce-4c12-96d9-d6ca9bb43bf7-log-socket\") pod \"ovnkube-node-kwh69\" (UID: \"9aa08551-03ce-4c12-96d9-d6ca9bb43bf7\") " pod="openshift-ovn-kubernetes/ovnkube-node-kwh69" Jun 09 17:33:18.382308 ip-10-0-143-124 kubenswrapper[2552]: I0609 17:33:18.380615 2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/99815f55-a516-4e96-bdb4-67bf609055f2-host-var-lib-kubelet\") pod \"multus-n6545\" (UID: \"99815f55-a516-4e96-bdb4-67bf609055f2\") " pod="openshift-multus/multus-n6545" Jun 09 17:33:18.382308 ip-10-0-143-124 kubenswrapper[2552]: I0609 17:33:18.380618 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/9aa08551-03ce-4c12-96d9-d6ca9bb43bf7-host-run-ovn-kubernetes\") pod \"ovnkube-node-kwh69\" (UID: \"9aa08551-03ce-4c12-96d9-d6ca9bb43bf7\") " pod="openshift-ovn-kubernetes/ovnkube-node-kwh69" Jun 09 17:33:18.383167 ip-10-0-143-124 kubenswrapper[2552]: I0609 17:33:18.380652 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/9aa08551-03ce-4c12-96d9-d6ca9bb43bf7-ovnkube-script-lib\") pod \"ovnkube-node-kwh69\" (UID: \"9aa08551-03ce-4c12-96d9-d6ca9bb43bf7\") " pod="openshift-ovn-kubernetes/ovnkube-node-kwh69" Jun 09 17:33:18.383167 ip-10-0-143-124 kubenswrapper[2552]: I0609 17:33:18.380688 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/57526948-94e0-40fd-b0bf-ada9cf355743-cni-binary-copy\") pod \"multus-additional-cni-plugins-s8d9p\" (UID: \"57526948-94e0-40fd-b0bf-ada9cf355743\") " pod="openshift-multus/multus-additional-cni-plugins-s8d9p" Jun 09 17:33:18.383167 ip-10-0-143-124 kubenswrapper[2552]: I0609 17:33:18.380716 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/99815f55-a516-4e96-bdb4-67bf609055f2-host-run-multus-certs\") pod \"multus-n6545\" (UID: \"99815f55-a516-4e96-bdb4-67bf609055f2\") " pod="openshift-multus/multus-n6545" Jun 09 17:33:18.383167 ip-10-0-143-124 kubenswrapper[2552]: I0609 17:33:18.380742 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vvzhh\" (UniqueName: \"kubernetes.io/projected/7755d1ba-506c-4a2d-829f-57beb748954e-kube-api-access-vvzhh\") pod \"network-check-target-mpmvr\" (UID: \"7755d1ba-506c-4a2d-829f-57beb748954e\") " pod="openshift-network-diagnostics/network-check-target-mpmvr" Jun 09 17:33:18.383167 ip-10-0-143-124 kubenswrapper[2552]: I0609 17:33:18.380766 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/e5f0d419-4644-4890-85e5-c300cbaee351-etc-sysconfig\") pod \"tuned-g5rgn\" (UID: \"e5f0d419-4644-4890-85e5-c300cbaee351\") " pod="openshift-cluster-node-tuning-operator/tuned-g5rgn" Jun 09 17:33:18.383167 ip-10-0-143-124 kubenswrapper[2552]: I0609 17:33:18.380789 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/9aa08551-03ce-4c12-96d9-d6ca9bb43bf7-host-slash\") pod \"ovnkube-node-kwh69\" (UID: \"9aa08551-03ce-4c12-96d9-d6ca9bb43bf7\") " pod="openshift-ovn-kubernetes/ovnkube-node-kwh69" Jun 09 17:33:18.383167 ip-10-0-143-124 kubenswrapper[2552]: I0609 17:33:18.380812 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/9aa08551-03ce-4c12-96d9-d6ca9bb43bf7-run-systemd\") pod \"ovnkube-node-kwh69\" (UID: \"9aa08551-03ce-4c12-96d9-d6ca9bb43bf7\") " pod="openshift-ovn-kubernetes/ovnkube-node-kwh69" Jun 09 17:33:18.383167 ip-10-0-143-124 kubenswrapper[2552]: I0609 17:33:18.380845 2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/99815f55-a516-4e96-bdb4-67bf609055f2-multus-daemon-config\") pod \"multus-n6545\" (UID: \"99815f55-a516-4e96-bdb4-67bf609055f2\") " pod="openshift-multus/multus-n6545" Jun 09 17:33:18.383167 ip-10-0-143-124 kubenswrapper[2552]: I0609 17:33:18.380852 2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/f077d86b-598b-4398-9376-2956816fa47d-tmp-dir\") pod \"node-resolver-qbd4p\" (UID: \"f077d86b-598b-4398-9376-2956816fa47d\") " pod="openshift-dns/node-resolver-qbd4p" Jun 09 17:33:18.383167 ip-10-0-143-124 kubenswrapper[2552]: I0609 17:33:18.380941 2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/99815f55-a516-4e96-bdb4-67bf609055f2-host-run-multus-certs\") pod \"multus-n6545\" (UID: \"99815f55-a516-4e96-bdb4-67bf609055f2\") " pod="openshift-multus/multus-n6545" Jun 09 17:33:18.383167 ip-10-0-143-124 kubenswrapper[2552]: I0609 17:33:18.381180 2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/57526948-94e0-40fd-b0bf-ada9cf355743-cni-binary-copy\") pod \"multus-additional-cni-plugins-s8d9p\" (UID: \"57526948-94e0-40fd-b0bf-ada9cf355743\") " pod="openshift-multus/multus-additional-cni-plugins-s8d9p" Jun 09 17:33:18.383703 ip-10-0-143-124 kubenswrapper[2552]: I0609 17:33:18.383679 2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/8563ebab-ebdd-4d68-bce1-78d2a7f62992-agent-certs\") pod \"konnectivity-agent-gctfs\" (UID: \"8563ebab-ebdd-4d68-bce1-78d2a7f62992\") " pod="kube-system/konnectivity-agent-gctfs" Jun 09 17:33:18.387262 ip-10-0-143-124 kubenswrapper[2552]: E0609 17:33:18.387243 2552 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jun 09 17:33:18.387262 ip-10-0-143-124 kubenswrapper[2552]: E0609 17:33:18.387264 2552 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jun 09 17:33:18.387415 ip-10-0-143-124 kubenswrapper[2552]: E0609 17:33:18.387273 2552 projected.go:196] Error preparing data for projected volume kube-api-access-vvzhh for pod openshift-network-diagnostics/network-check-target-mpmvr: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 09 17:33:18.387415 ip-10-0-143-124 kubenswrapper[2552]: E0609 17:33:18.387330 2552 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/7755d1ba-506c-4a2d-829f-57beb748954e-kube-api-access-vvzhh podName:7755d1ba-506c-4a2d-829f-57beb748954e nodeName:}" failed. No retries permitted until 2026-06-09 17:33:18.887317083 +0000 UTC m=+2.987219711 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-api-access-vvzhh" (UniqueName: "kubernetes.io/projected/7755d1ba-506c-4a2d-829f-57beb748954e-kube-api-access-vvzhh") pod "network-check-target-mpmvr" (UID: "7755d1ba-506c-4a2d-829f-57beb748954e") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 09 17:33:18.389342 ip-10-0-143-124 kubenswrapper[2552]: I0609 17:33:18.389318 2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-pn9j9\" (UniqueName: \"kubernetes.io/projected/99815f55-a516-4e96-bdb4-67bf609055f2-kube-api-access-pn9j9\") pod \"multus-n6545\" (UID: \"99815f55-a516-4e96-bdb4-67bf609055f2\") " pod="openshift-multus/multus-n6545" Jun 09 17:33:18.390336 ip-10-0-143-124 kubenswrapper[2552]: I0609 17:33:18.390310 2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-zqbvx\" (UniqueName: \"kubernetes.io/projected/2ef810f8-073d-4b45-ad02-2e098f31ed47-kube-api-access-zqbvx\") pod \"node-ca-tb8b5\" (UID: \"2ef810f8-073d-4b45-ad02-2e098f31ed47\") " pod="openshift-image-registry/node-ca-tb8b5" Jun 09 17:33:18.390469 ip-10-0-143-124 kubenswrapper[2552]: I0609 17:33:18.390452 2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-xkvk2\" (UniqueName: \"kubernetes.io/projected/57526948-94e0-40fd-b0bf-ada9cf355743-kube-api-access-xkvk2\") pod \"multus-additional-cni-plugins-s8d9p\" (UID: \"57526948-94e0-40fd-b0bf-ada9cf355743\") " pod="openshift-multus/multus-additional-cni-plugins-s8d9p" Jun 09 17:33:18.390924 ip-10-0-143-124 kubenswrapper[2552]: I0609 17:33:18.390892 2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-xqbr2\" (UniqueName: \"kubernetes.io/projected/f077d86b-598b-4398-9376-2956816fa47d-kube-api-access-xqbr2\") pod \"node-resolver-qbd4p\" (UID: \"f077d86b-598b-4398-9376-2956816fa47d\") " pod="openshift-dns/node-resolver-qbd4p" Jun 09 17:33:18.391208 ip-10-0-143-124 kubenswrapper[2552]: I0609 17:33:18.391189 2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-gkvrw\" (UniqueName: \"kubernetes.io/projected/df33c2c3-49d0-4236-996b-10cde5d3bc92-kube-api-access-gkvrw\") pod \"iptables-alerter-ddp2h\" (UID: \"df33c2c3-49d0-4236-996b-10cde5d3bc92\") " pod="openshift-network-operator/iptables-alerter-ddp2h" Jun 09 17:33:18.391397 ip-10-0-143-124 kubenswrapper[2552]: I0609 17:33:18.391374 2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-lzhbc\" (UniqueName: \"kubernetes.io/projected/b817ed32-ca44-43a6-99cf-8cf86ffd8c05-kube-api-access-lzhbc\") pod \"network-metrics-daemon-pvmnc\" (UID: \"b817ed32-ca44-43a6-99cf-8cf86ffd8c05\") " pod="openshift-multus/network-metrics-daemon-pvmnc" Jun 09 17:33:18.481393 ip-10-0-143-124 kubenswrapper[2552]: I0609 17:33:18.481359 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/e5f0d419-4644-4890-85e5-c300cbaee351-etc-systemd\") pod \"tuned-g5rgn\" (UID: \"e5f0d419-4644-4890-85e5-c300cbaee351\") " pod="openshift-cluster-node-tuning-operator/tuned-g5rgn" Jun 09 17:33:18.481558 ip-10-0-143-124 kubenswrapper[2552]: I0609 17:33:18.481401 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/e5f0d419-4644-4890-85e5-c300cbaee351-host\") pod \"tuned-g5rgn\" (UID: \"e5f0d419-4644-4890-85e5-c300cbaee351\") " pod="openshift-cluster-node-tuning-operator/tuned-g5rgn" Jun 09 17:33:18.481558 ip-10-0-143-124 kubenswrapper[2552]: I0609 17:33:18.481439 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/9aa08551-03ce-4c12-96d9-d6ca9bb43bf7-run-openvswitch\") pod \"ovnkube-node-kwh69\" (UID: \"9aa08551-03ce-4c12-96d9-d6ca9bb43bf7\") " pod="openshift-ovn-kubernetes/ovnkube-node-kwh69" Jun 09 17:33:18.481558 ip-10-0-143-124 kubenswrapper[2552]: I0609 17:33:18.481462 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/8285b34c-bc55-44a2-b6c5-e2c2e4c6a660-kubelet-dir\") pod \"aws-ebs-csi-driver-node-9gqc8\" (UID: \"8285b34c-bc55-44a2-b6c5-e2c2e4c6a660\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-9gqc8" Jun 09 17:33:18.481558 ip-10-0-143-124 kubenswrapper[2552]: I0609 17:33:18.481475 2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/e5f0d419-4644-4890-85e5-c300cbaee351-etc-systemd\") pod \"tuned-g5rgn\" (UID: \"e5f0d419-4644-4890-85e5-c300cbaee351\") " pod="openshift-cluster-node-tuning-operator/tuned-g5rgn" Jun 09 17:33:18.481558 ip-10-0-143-124 kubenswrapper[2552]: I0609 17:33:18.481488 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/8285b34c-bc55-44a2-b6c5-e2c2e4c6a660-device-dir\") pod \"aws-ebs-csi-driver-node-9gqc8\" (UID: \"8285b34c-bc55-44a2-b6c5-e2c2e4c6a660\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-9gqc8" Jun 09 17:33:18.481558 ip-10-0-143-124 kubenswrapper[2552]: I0609 17:33:18.481520 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/8285b34c-bc55-44a2-b6c5-e2c2e4c6a660-etc-selinux\") pod \"aws-ebs-csi-driver-node-9gqc8\" (UID: \"8285b34c-bc55-44a2-b6c5-e2c2e4c6a660\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-9gqc8" Jun 09 17:33:18.481558 ip-10-0-143-124 kubenswrapper[2552]: I0609 17:33:18.481537 2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/8285b34c-bc55-44a2-b6c5-e2c2e4c6a660-device-dir\") pod \"aws-ebs-csi-driver-node-9gqc8\" (UID: \"8285b34c-bc55-44a2-b6c5-e2c2e4c6a660\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-9gqc8" Jun 09 17:33:18.481558 ip-10-0-143-124 kubenswrapper[2552]: I0609 17:33:18.481552 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/e5f0d419-4644-4890-85e5-c300cbaee351-etc-kubernetes\") pod \"tuned-g5rgn\" (UID: \"e5f0d419-4644-4890-85e5-c300cbaee351\") " pod="openshift-cluster-node-tuning-operator/tuned-g5rgn" Jun 09 17:33:18.481987 ip-10-0-143-124 kubenswrapper[2552]: I0609 17:33:18.481558 2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/9aa08551-03ce-4c12-96d9-d6ca9bb43bf7-run-openvswitch\") pod \"ovnkube-node-kwh69\" (UID: \"9aa08551-03ce-4c12-96d9-d6ca9bb43bf7\") " pod="openshift-ovn-kubernetes/ovnkube-node-kwh69" Jun 09 17:33:18.481987 ip-10-0-143-124 kubenswrapper[2552]: I0609 17:33:18.481587 2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/e5f0d419-4644-4890-85e5-c300cbaee351-host\") pod \"tuned-g5rgn\" (UID: \"e5f0d419-4644-4890-85e5-c300cbaee351\") " pod="openshift-cluster-node-tuning-operator/tuned-g5rgn" Jun 09 17:33:18.481987 ip-10-0-143-124 kubenswrapper[2552]: I0609 17:33:18.481586 2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/8285b34c-bc55-44a2-b6c5-e2c2e4c6a660-kubelet-dir\") pod \"aws-ebs-csi-driver-node-9gqc8\" (UID: \"8285b34c-bc55-44a2-b6c5-e2c2e4c6a660\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-9gqc8" Jun 09 17:33:18.481987 ip-10-0-143-124 kubenswrapper[2552]: I0609 17:33:18.481576 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/e5f0d419-4644-4890-85e5-c300cbaee351-lib-modules\") pod \"tuned-g5rgn\" (UID: \"e5f0d419-4644-4890-85e5-c300cbaee351\") " pod="openshift-cluster-node-tuning-operator/tuned-g5rgn" Jun 09 17:33:18.481987 ip-10-0-143-124 kubenswrapper[2552]: I0609 17:33:18.481637 2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/e5f0d419-4644-4890-85e5-c300cbaee351-etc-kubernetes\") pod \"tuned-g5rgn\" (UID: \"e5f0d419-4644-4890-85e5-c300cbaee351\") " pod="openshift-cluster-node-tuning-operator/tuned-g5rgn" Jun 09 17:33:18.481987 ip-10-0-143-124 kubenswrapper[2552]: I0609 17:33:18.481646 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/9aa08551-03ce-4c12-96d9-d6ca9bb43bf7-log-socket\") pod \"ovnkube-node-kwh69\" (UID: \"9aa08551-03ce-4c12-96d9-d6ca9bb43bf7\") " pod="openshift-ovn-kubernetes/ovnkube-node-kwh69" Jun 09 17:33:18.481987 ip-10-0-143-124 kubenswrapper[2552]: I0609 17:33:18.481670 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/9aa08551-03ce-4c12-96d9-d6ca9bb43bf7-host-run-ovn-kubernetes\") pod \"ovnkube-node-kwh69\" (UID: \"9aa08551-03ce-4c12-96d9-d6ca9bb43bf7\") " pod="openshift-ovn-kubernetes/ovnkube-node-kwh69" Jun 09 17:33:18.481987 ip-10-0-143-124 kubenswrapper[2552]: I0609 17:33:18.481693 2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/8285b34c-bc55-44a2-b6c5-e2c2e4c6a660-etc-selinux\") pod \"aws-ebs-csi-driver-node-9gqc8\" (UID: \"8285b34c-bc55-44a2-b6c5-e2c2e4c6a660\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-9gqc8" Jun 09 17:33:18.481987 ip-10-0-143-124 kubenswrapper[2552]: I0609 17:33:18.481704 2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/9aa08551-03ce-4c12-96d9-d6ca9bb43bf7-host-run-ovn-kubernetes\") pod \"ovnkube-node-kwh69\" (UID: \"9aa08551-03ce-4c12-96d9-d6ca9bb43bf7\") " pod="openshift-ovn-kubernetes/ovnkube-node-kwh69" Jun 09 17:33:18.481987 ip-10-0-143-124 kubenswrapper[2552]: I0609 17:33:18.481718 2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/9aa08551-03ce-4c12-96d9-d6ca9bb43bf7-log-socket\") pod \"ovnkube-node-kwh69\" (UID: \"9aa08551-03ce-4c12-96d9-d6ca9bb43bf7\") " pod="openshift-ovn-kubernetes/ovnkube-node-kwh69" Jun 09 17:33:18.481987 ip-10-0-143-124 kubenswrapper[2552]: I0609 17:33:18.481739 2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/e5f0d419-4644-4890-85e5-c300cbaee351-lib-modules\") pod \"tuned-g5rgn\" (UID: \"e5f0d419-4644-4890-85e5-c300cbaee351\") " pod="openshift-cluster-node-tuning-operator/tuned-g5rgn" Jun 09 17:33:18.481987 ip-10-0-143-124 kubenswrapper[2552]: I0609 17:33:18.481762 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/9aa08551-03ce-4c12-96d9-d6ca9bb43bf7-ovnkube-script-lib\") pod \"ovnkube-node-kwh69\" (UID: \"9aa08551-03ce-4c12-96d9-d6ca9bb43bf7\") " pod="openshift-ovn-kubernetes/ovnkube-node-kwh69" Jun 09 17:33:18.481987 ip-10-0-143-124 kubenswrapper[2552]: I0609 17:33:18.481804 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/e5f0d419-4644-4890-85e5-c300cbaee351-etc-sysconfig\") pod \"tuned-g5rgn\" (UID: \"e5f0d419-4644-4890-85e5-c300cbaee351\") " pod="openshift-cluster-node-tuning-operator/tuned-g5rgn" Jun 09 17:33:18.481987 ip-10-0-143-124 kubenswrapper[2552]: I0609 17:33:18.481825 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/9aa08551-03ce-4c12-96d9-d6ca9bb43bf7-host-slash\") pod \"ovnkube-node-kwh69\" (UID: \"9aa08551-03ce-4c12-96d9-d6ca9bb43bf7\") " pod="openshift-ovn-kubernetes/ovnkube-node-kwh69" Jun 09 17:33:18.481987 ip-10-0-143-124 kubenswrapper[2552]: I0609 17:33:18.481866 2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/9aa08551-03ce-4c12-96d9-d6ca9bb43bf7-host-slash\") pod \"ovnkube-node-kwh69\" (UID: \"9aa08551-03ce-4c12-96d9-d6ca9bb43bf7\") " pod="openshift-ovn-kubernetes/ovnkube-node-kwh69" Jun 09 17:33:18.481987 ip-10-0-143-124 kubenswrapper[2552]: I0609 17:33:18.481875 2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/e5f0d419-4644-4890-85e5-c300cbaee351-etc-sysconfig\") pod \"tuned-g5rgn\" (UID: \"e5f0d419-4644-4890-85e5-c300cbaee351\") " pod="openshift-cluster-node-tuning-operator/tuned-g5rgn" Jun 09 17:33:18.481987 ip-10-0-143-124 kubenswrapper[2552]: I0609 17:33:18.481894 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/9aa08551-03ce-4c12-96d9-d6ca9bb43bf7-run-systemd\") pod \"ovnkube-node-kwh69\" (UID: \"9aa08551-03ce-4c12-96d9-d6ca9bb43bf7\") " pod="openshift-ovn-kubernetes/ovnkube-node-kwh69" Jun 09 17:33:18.482760 ip-10-0-143-124 kubenswrapper[2552]: I0609 17:33:18.481915 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-p6r5f\" (UniqueName: \"kubernetes.io/projected/9aa08551-03ce-4c12-96d9-d6ca9bb43bf7-kube-api-access-p6r5f\") pod \"ovnkube-node-kwh69\" (UID: \"9aa08551-03ce-4c12-96d9-d6ca9bb43bf7\") " pod="openshift-ovn-kubernetes/ovnkube-node-kwh69" Jun 09 17:33:18.482760 ip-10-0-143-124 kubenswrapper[2552]: I0609 17:33:18.481929 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/8285b34c-bc55-44a2-b6c5-e2c2e4c6a660-registration-dir\") pod \"aws-ebs-csi-driver-node-9gqc8\" (UID: \"8285b34c-bc55-44a2-b6c5-e2c2e4c6a660\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-9gqc8" Jun 09 17:33:18.482760 ip-10-0-143-124 kubenswrapper[2552]: I0609 17:33:18.481979 2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/9aa08551-03ce-4c12-96d9-d6ca9bb43bf7-run-systemd\") pod \"ovnkube-node-kwh69\" (UID: \"9aa08551-03ce-4c12-96d9-d6ca9bb43bf7\") " pod="openshift-ovn-kubernetes/ovnkube-node-kwh69" Jun 09 17:33:18.482760 ip-10-0-143-124 kubenswrapper[2552]: I0609 17:33:18.482012 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/e5f0d419-4644-4890-85e5-c300cbaee351-etc-sysctl-conf\") pod \"tuned-g5rgn\" (UID: \"e5f0d419-4644-4890-85e5-c300cbaee351\") " pod="openshift-cluster-node-tuning-operator/tuned-g5rgn" Jun 09 17:33:18.482760 ip-10-0-143-124 kubenswrapper[2552]: I0609 17:33:18.482037 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/9aa08551-03ce-4c12-96d9-d6ca9bb43bf7-etc-openvswitch\") pod \"ovnkube-node-kwh69\" (UID: \"9aa08551-03ce-4c12-96d9-d6ca9bb43bf7\") " pod="openshift-ovn-kubernetes/ovnkube-node-kwh69" Jun 09 17:33:18.482760 ip-10-0-143-124 kubenswrapper[2552]: I0609 17:33:18.482064 2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/8285b34c-bc55-44a2-b6c5-e2c2e4c6a660-registration-dir\") pod \"aws-ebs-csi-driver-node-9gqc8\" (UID: \"8285b34c-bc55-44a2-b6c5-e2c2e4c6a660\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-9gqc8" Jun 09 17:33:18.482760 ip-10-0-143-124 kubenswrapper[2552]: I0609 17:33:18.482067 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/9aa08551-03ce-4c12-96d9-d6ca9bb43bf7-node-log\") pod \"ovnkube-node-kwh69\" (UID: \"9aa08551-03ce-4c12-96d9-d6ca9bb43bf7\") " pod="openshift-ovn-kubernetes/ovnkube-node-kwh69" Jun 09 17:33:18.482760 ip-10-0-143-124 kubenswrapper[2552]: I0609 17:33:18.482111 2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/9aa08551-03ce-4c12-96d9-d6ca9bb43bf7-etc-openvswitch\") pod \"ovnkube-node-kwh69\" (UID: \"9aa08551-03ce-4c12-96d9-d6ca9bb43bf7\") " pod="openshift-ovn-kubernetes/ovnkube-node-kwh69" Jun 09 17:33:18.482760 ip-10-0-143-124 kubenswrapper[2552]: I0609 17:33:18.482129 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/9aa08551-03ce-4c12-96d9-d6ca9bb43bf7-env-overrides\") pod \"ovnkube-node-kwh69\" (UID: \"9aa08551-03ce-4c12-96d9-d6ca9bb43bf7\") " pod="openshift-ovn-kubernetes/ovnkube-node-kwh69" Jun 09 17:33:18.482760 ip-10-0-143-124 kubenswrapper[2552]: I0609 17:33:18.482147 2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/9aa08551-03ce-4c12-96d9-d6ca9bb43bf7-node-log\") pod \"ovnkube-node-kwh69\" (UID: \"9aa08551-03ce-4c12-96d9-d6ca9bb43bf7\") " pod="openshift-ovn-kubernetes/ovnkube-node-kwh69" Jun 09 17:33:18.482760 ip-10-0-143-124 kubenswrapper[2552]: I0609 17:33:18.482157 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zg6kz\" (UniqueName: \"kubernetes.io/projected/e5f0d419-4644-4890-85e5-c300cbaee351-kube-api-access-zg6kz\") pod \"tuned-g5rgn\" (UID: \"e5f0d419-4644-4890-85e5-c300cbaee351\") " pod="openshift-cluster-node-tuning-operator/tuned-g5rgn" Jun 09 17:33:18.482760 ip-10-0-143-124 kubenswrapper[2552]: I0609 17:33:18.482180 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/9aa08551-03ce-4c12-96d9-d6ca9bb43bf7-systemd-units\") pod \"ovnkube-node-kwh69\" (UID: \"9aa08551-03ce-4c12-96d9-d6ca9bb43bf7\") " pod="openshift-ovn-kubernetes/ovnkube-node-kwh69" Jun 09 17:33:18.482760 ip-10-0-143-124 kubenswrapper[2552]: I0609 17:33:18.482180 2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/e5f0d419-4644-4890-85e5-c300cbaee351-etc-sysctl-conf\") pod \"tuned-g5rgn\" (UID: \"e5f0d419-4644-4890-85e5-c300cbaee351\") " pod="openshift-cluster-node-tuning-operator/tuned-g5rgn" Jun 09 17:33:18.482760 ip-10-0-143-124 kubenswrapper[2552]: I0609 17:33:18.482202 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/9aa08551-03ce-4c12-96d9-d6ca9bb43bf7-var-lib-openvswitch\") pod \"ovnkube-node-kwh69\" (UID: \"9aa08551-03ce-4c12-96d9-d6ca9bb43bf7\") " pod="openshift-ovn-kubernetes/ovnkube-node-kwh69" Jun 09 17:33:18.482760 ip-10-0-143-124 kubenswrapper[2552]: I0609 17:33:18.482227 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/9aa08551-03ce-4c12-96d9-d6ca9bb43bf7-host-run-netns\") pod \"ovnkube-node-kwh69\" (UID: \"9aa08551-03ce-4c12-96d9-d6ca9bb43bf7\") " pod="openshift-ovn-kubernetes/ovnkube-node-kwh69" Jun 09 17:33:18.482760 ip-10-0-143-124 kubenswrapper[2552]: I0609 17:33:18.482251 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/9aa08551-03ce-4c12-96d9-d6ca9bb43bf7-host-cni-bin\") pod \"ovnkube-node-kwh69\" (UID: \"9aa08551-03ce-4c12-96d9-d6ca9bb43bf7\") " pod="openshift-ovn-kubernetes/ovnkube-node-kwh69" Jun 09 17:33:18.482760 ip-10-0-143-124 kubenswrapper[2552]: I0609 17:33:18.482265 2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/9aa08551-03ce-4c12-96d9-d6ca9bb43bf7-systemd-units\") pod \"ovnkube-node-kwh69\" (UID: \"9aa08551-03ce-4c12-96d9-d6ca9bb43bf7\") " pod="openshift-ovn-kubernetes/ovnkube-node-kwh69" Jun 09 17:33:18.483557 ip-10-0-143-124 kubenswrapper[2552]: I0609 17:33:18.482274 2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/9aa08551-03ce-4c12-96d9-d6ca9bb43bf7-var-lib-openvswitch\") pod \"ovnkube-node-kwh69\" (UID: \"9aa08551-03ce-4c12-96d9-d6ca9bb43bf7\") " pod="openshift-ovn-kubernetes/ovnkube-node-kwh69" Jun 09 17:33:18.483557 ip-10-0-143-124 kubenswrapper[2552]: I0609 17:33:18.482314 2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/9aa08551-03ce-4c12-96d9-d6ca9bb43bf7-host-run-netns\") pod \"ovnkube-node-kwh69\" (UID: \"9aa08551-03ce-4c12-96d9-d6ca9bb43bf7\") " pod="openshift-ovn-kubernetes/ovnkube-node-kwh69" Jun 09 17:33:18.483557 ip-10-0-143-124 kubenswrapper[2552]: I0609 17:33:18.482320 2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/9aa08551-03ce-4c12-96d9-d6ca9bb43bf7-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-kwh69\" (UID: \"9aa08551-03ce-4c12-96d9-d6ca9bb43bf7\") " pod="openshift-ovn-kubernetes/ovnkube-node-kwh69" Jun 09 17:33:18.483557 ip-10-0-143-124 kubenswrapper[2552]: I0609 17:33:18.482333 2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/9aa08551-03ce-4c12-96d9-d6ca9bb43bf7-host-cni-bin\") pod \"ovnkube-node-kwh69\" (UID: \"9aa08551-03ce-4c12-96d9-d6ca9bb43bf7\") " pod="openshift-ovn-kubernetes/ovnkube-node-kwh69" Jun 09 17:33:18.483557 ip-10-0-143-124 kubenswrapper[2552]: I0609 17:33:18.482278 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/9aa08551-03ce-4c12-96d9-d6ca9bb43bf7-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-kwh69\" (UID: \"9aa08551-03ce-4c12-96d9-d6ca9bb43bf7\") " pod="openshift-ovn-kubernetes/ovnkube-node-kwh69" Jun 09 17:33:18.483557 ip-10-0-143-124 kubenswrapper[2552]: I0609 17:33:18.482375 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-q8zs5\" (UniqueName: \"kubernetes.io/projected/8285b34c-bc55-44a2-b6c5-e2c2e4c6a660-kube-api-access-q8zs5\") pod \"aws-ebs-csi-driver-node-9gqc8\" (UID: \"8285b34c-bc55-44a2-b6c5-e2c2e4c6a660\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-9gqc8" Jun 09 17:33:18.483557 ip-10-0-143-124 kubenswrapper[2552]: I0609 17:33:18.482381 2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/9aa08551-03ce-4c12-96d9-d6ca9bb43bf7-ovnkube-script-lib\") pod \"ovnkube-node-kwh69\" (UID: \"9aa08551-03ce-4c12-96d9-d6ca9bb43bf7\") " pod="openshift-ovn-kubernetes/ovnkube-node-kwh69" Jun 09 17:33:18.483557 ip-10-0-143-124 kubenswrapper[2552]: I0609 17:33:18.482407 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/e5f0d419-4644-4890-85e5-c300cbaee351-sys\") pod \"tuned-g5rgn\" (UID: \"e5f0d419-4644-4890-85e5-c300cbaee351\") " pod="openshift-cluster-node-tuning-operator/tuned-g5rgn" Jun 09 17:33:18.483557 ip-10-0-143-124 kubenswrapper[2552]: I0609 17:33:18.482431 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/9aa08551-03ce-4c12-96d9-d6ca9bb43bf7-host-kubelet\") pod \"ovnkube-node-kwh69\" (UID: \"9aa08551-03ce-4c12-96d9-d6ca9bb43bf7\") " pod="openshift-ovn-kubernetes/ovnkube-node-kwh69" Jun 09 17:33:18.483557 ip-10-0-143-124 kubenswrapper[2552]: I0609 17:33:18.482453 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/9aa08551-03ce-4c12-96d9-d6ca9bb43bf7-run-ovn\") pod \"ovnkube-node-kwh69\" (UID: \"9aa08551-03ce-4c12-96d9-d6ca9bb43bf7\") " pod="openshift-ovn-kubernetes/ovnkube-node-kwh69" Jun 09 17:33:18.483557 ip-10-0-143-124 kubenswrapper[2552]: I0609 17:33:18.482475 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/8285b34c-bc55-44a2-b6c5-e2c2e4c6a660-sys-fs\") pod \"aws-ebs-csi-driver-node-9gqc8\" (UID: \"8285b34c-bc55-44a2-b6c5-e2c2e4c6a660\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-9gqc8" Jun 09 17:33:18.483557 ip-10-0-143-124 kubenswrapper[2552]: I0609 17:33:18.482488 2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/9aa08551-03ce-4c12-96d9-d6ca9bb43bf7-env-overrides\") pod \"ovnkube-node-kwh69\" (UID: \"9aa08551-03ce-4c12-96d9-d6ca9bb43bf7\") " pod="openshift-ovn-kubernetes/ovnkube-node-kwh69" Jun 09 17:33:18.483557 ip-10-0-143-124 kubenswrapper[2552]: I0609 17:33:18.482502 2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/e5f0d419-4644-4890-85e5-c300cbaee351-sys\") pod \"tuned-g5rgn\" (UID: \"e5f0d419-4644-4890-85e5-c300cbaee351\") " pod="openshift-cluster-node-tuning-operator/tuned-g5rgn" Jun 09 17:33:18.483557 ip-10-0-143-124 kubenswrapper[2552]: I0609 17:33:18.482504 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/e5f0d419-4644-4890-85e5-c300cbaee351-etc-sysctl-d\") pod \"tuned-g5rgn\" (UID: \"e5f0d419-4644-4890-85e5-c300cbaee351\") " pod="openshift-cluster-node-tuning-operator/tuned-g5rgn" Jun 09 17:33:18.483557 ip-10-0-143-124 kubenswrapper[2552]: I0609 17:33:18.482543 2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/9aa08551-03ce-4c12-96d9-d6ca9bb43bf7-run-ovn\") pod \"ovnkube-node-kwh69\" (UID: \"9aa08551-03ce-4c12-96d9-d6ca9bb43bf7\") " pod="openshift-ovn-kubernetes/ovnkube-node-kwh69" Jun 09 17:33:18.483557 ip-10-0-143-124 kubenswrapper[2552]: I0609 17:33:18.482547 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/e5f0d419-4644-4890-85e5-c300cbaee351-run\") pod \"tuned-g5rgn\" (UID: \"e5f0d419-4644-4890-85e5-c300cbaee351\") " pod="openshift-cluster-node-tuning-operator/tuned-g5rgn" Jun 09 17:33:18.483557 ip-10-0-143-124 kubenswrapper[2552]: I0609 17:33:18.482559 2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/8285b34c-bc55-44a2-b6c5-e2c2e4c6a660-sys-fs\") pod \"aws-ebs-csi-driver-node-9gqc8\" (UID: \"8285b34c-bc55-44a2-b6c5-e2c2e4c6a660\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-9gqc8" Jun 09 17:33:18.484216 ip-10-0-143-124 kubenswrapper[2552]: I0609 17:33:18.482569 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/e5f0d419-4644-4890-85e5-c300cbaee351-tmp\") pod \"tuned-g5rgn\" (UID: \"e5f0d419-4644-4890-85e5-c300cbaee351\") " pod="openshift-cluster-node-tuning-operator/tuned-g5rgn" Jun 09 17:33:18.484216 ip-10-0-143-124 kubenswrapper[2552]: I0609 17:33:18.482520 2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/9aa08551-03ce-4c12-96d9-d6ca9bb43bf7-host-kubelet\") pod \"ovnkube-node-kwh69\" (UID: \"9aa08551-03ce-4c12-96d9-d6ca9bb43bf7\") " pod="openshift-ovn-kubernetes/ovnkube-node-kwh69" Jun 09 17:33:18.484216 ip-10-0-143-124 kubenswrapper[2552]: I0609 17:33:18.482593 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/9aa08551-03ce-4c12-96d9-d6ca9bb43bf7-ovnkube-config\") pod \"ovnkube-node-kwh69\" (UID: \"9aa08551-03ce-4c12-96d9-d6ca9bb43bf7\") " pod="openshift-ovn-kubernetes/ovnkube-node-kwh69" Jun 09 17:33:18.484216 ip-10-0-143-124 kubenswrapper[2552]: I0609 17:33:18.482636 2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run\" (UniqueName: \"kubernetes.io/host-path/e5f0d419-4644-4890-85e5-c300cbaee351-run\") pod \"tuned-g5rgn\" (UID: \"e5f0d419-4644-4890-85e5-c300cbaee351\") " pod="openshift-cluster-node-tuning-operator/tuned-g5rgn" Jun 09 17:33:18.484216 ip-10-0-143-124 kubenswrapper[2552]: I0609 17:33:18.482634 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/e5f0d419-4644-4890-85e5-c300cbaee351-etc-tuned\") pod \"tuned-g5rgn\" (UID: \"e5f0d419-4644-4890-85e5-c300cbaee351\") " pod="openshift-cluster-node-tuning-operator/tuned-g5rgn" Jun 09 17:33:18.484216 ip-10-0-143-124 kubenswrapper[2552]: I0609 17:33:18.482663 2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/e5f0d419-4644-4890-85e5-c300cbaee351-etc-sysctl-d\") pod \"tuned-g5rgn\" (UID: \"e5f0d419-4644-4890-85e5-c300cbaee351\") " pod="openshift-cluster-node-tuning-operator/tuned-g5rgn" Jun 09 17:33:18.484216 ip-10-0-143-124 kubenswrapper[2552]: I0609 17:33:18.482676 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/9aa08551-03ce-4c12-96d9-d6ca9bb43bf7-host-cni-netd\") pod \"ovnkube-node-kwh69\" (UID: \"9aa08551-03ce-4c12-96d9-d6ca9bb43bf7\") " pod="openshift-ovn-kubernetes/ovnkube-node-kwh69" Jun 09 17:33:18.484216 ip-10-0-143-124 kubenswrapper[2552]: I0609 17:33:18.482699 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/8285b34c-bc55-44a2-b6c5-e2c2e4c6a660-socket-dir\") pod \"aws-ebs-csi-driver-node-9gqc8\" (UID: \"8285b34c-bc55-44a2-b6c5-e2c2e4c6a660\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-9gqc8" Jun 09 17:33:18.484216 ip-10-0-143-124 kubenswrapper[2552]: I0609 17:33:18.482706 2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/9aa08551-03ce-4c12-96d9-d6ca9bb43bf7-host-cni-netd\") pod \"ovnkube-node-kwh69\" (UID: \"9aa08551-03ce-4c12-96d9-d6ca9bb43bf7\") " pod="openshift-ovn-kubernetes/ovnkube-node-kwh69" Jun 09 17:33:18.484216 ip-10-0-143-124 kubenswrapper[2552]: I0609 17:33:18.482735 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/e5f0d419-4644-4890-85e5-c300cbaee351-var-lib-kubelet\") pod \"tuned-g5rgn\" (UID: \"e5f0d419-4644-4890-85e5-c300cbaee351\") " pod="openshift-cluster-node-tuning-operator/tuned-g5rgn" Jun 09 17:33:18.484216 ip-10-0-143-124 kubenswrapper[2552]: I0609 17:33:18.482762 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/9aa08551-03ce-4c12-96d9-d6ca9bb43bf7-ovn-node-metrics-cert\") pod \"ovnkube-node-kwh69\" (UID: \"9aa08551-03ce-4c12-96d9-d6ca9bb43bf7\") " pod="openshift-ovn-kubernetes/ovnkube-node-kwh69" Jun 09 17:33:18.484216 ip-10-0-143-124 kubenswrapper[2552]: I0609 17:33:18.482788 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/e5f0d419-4644-4890-85e5-c300cbaee351-etc-modprobe-d\") pod \"tuned-g5rgn\" (UID: \"e5f0d419-4644-4890-85e5-c300cbaee351\") " pod="openshift-cluster-node-tuning-operator/tuned-g5rgn" Jun 09 17:33:18.484216 ip-10-0-143-124 kubenswrapper[2552]: I0609 17:33:18.482799 2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/8285b34c-bc55-44a2-b6c5-e2c2e4c6a660-socket-dir\") pod \"aws-ebs-csi-driver-node-9gqc8\" (UID: \"8285b34c-bc55-44a2-b6c5-e2c2e4c6a660\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-9gqc8" Jun 09 17:33:18.484216 ip-10-0-143-124 kubenswrapper[2552]: I0609 17:33:18.482904 2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/e5f0d419-4644-4890-85e5-c300cbaee351-etc-modprobe-d\") pod \"tuned-g5rgn\" (UID: \"e5f0d419-4644-4890-85e5-c300cbaee351\") " pod="openshift-cluster-node-tuning-operator/tuned-g5rgn" Jun 09 17:33:18.484216 ip-10-0-143-124 kubenswrapper[2552]: I0609 17:33:18.482949 2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/e5f0d419-4644-4890-85e5-c300cbaee351-var-lib-kubelet\") pod \"tuned-g5rgn\" (UID: \"e5f0d419-4644-4890-85e5-c300cbaee351\") " pod="openshift-cluster-node-tuning-operator/tuned-g5rgn" Jun 09 17:33:18.484216 ip-10-0-143-124 kubenswrapper[2552]: I0609 17:33:18.483102 2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/9aa08551-03ce-4c12-96d9-d6ca9bb43bf7-ovnkube-config\") pod \"ovnkube-node-kwh69\" (UID: \"9aa08551-03ce-4c12-96d9-d6ca9bb43bf7\") " pod="openshift-ovn-kubernetes/ovnkube-node-kwh69" Jun 09 17:33:18.485231 ip-10-0-143-124 kubenswrapper[2552]: I0609 17:33:18.485141 2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/e5f0d419-4644-4890-85e5-c300cbaee351-tmp\") pod \"tuned-g5rgn\" (UID: \"e5f0d419-4644-4890-85e5-c300cbaee351\") " pod="openshift-cluster-node-tuning-operator/tuned-g5rgn" Jun 09 17:33:18.485339 ip-10-0-143-124 kubenswrapper[2552]: I0609 17:33:18.485282 2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/e5f0d419-4644-4890-85e5-c300cbaee351-etc-tuned\") pod \"tuned-g5rgn\" (UID: \"e5f0d419-4644-4890-85e5-c300cbaee351\") " pod="openshift-cluster-node-tuning-operator/tuned-g5rgn" Jun 09 17:33:18.485339 ip-10-0-143-124 kubenswrapper[2552]: I0609 17:33:18.485282 2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/9aa08551-03ce-4c12-96d9-d6ca9bb43bf7-ovn-node-metrics-cert\") pod \"ovnkube-node-kwh69\" (UID: \"9aa08551-03ce-4c12-96d9-d6ca9bb43bf7\") " pod="openshift-ovn-kubernetes/ovnkube-node-kwh69" Jun 09 17:33:18.490804 ip-10-0-143-124 kubenswrapper[2552]: I0609 17:33:18.490777 2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-q8zs5\" (UniqueName: \"kubernetes.io/projected/8285b34c-bc55-44a2-b6c5-e2c2e4c6a660-kube-api-access-q8zs5\") pod \"aws-ebs-csi-driver-node-9gqc8\" (UID: \"8285b34c-bc55-44a2-b6c5-e2c2e4c6a660\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-9gqc8" Jun 09 17:33:18.491182 ip-10-0-143-124 kubenswrapper[2552]: I0609 17:33:18.491159 2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-p6r5f\" (UniqueName: \"kubernetes.io/projected/9aa08551-03ce-4c12-96d9-d6ca9bb43bf7-kube-api-access-p6r5f\") pod \"ovnkube-node-kwh69\" (UID: \"9aa08551-03ce-4c12-96d9-d6ca9bb43bf7\") " pod="openshift-ovn-kubernetes/ovnkube-node-kwh69" Jun 09 17:33:18.491367 ip-10-0-143-124 kubenswrapper[2552]: I0609 17:33:18.491347 2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-zg6kz\" (UniqueName: \"kubernetes.io/projected/e5f0d419-4644-4890-85e5-c300cbaee351-kube-api-access-zg6kz\") pod \"tuned-g5rgn\" (UID: \"e5f0d419-4644-4890-85e5-c300cbaee351\") " pod="openshift-cluster-node-tuning-operator/tuned-g5rgn" Jun 09 17:33:18.506249 ip-10-0-143-124 kubenswrapper[2552]: I0609 17:33:18.506227 2552 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160" Jun 09 17:33:18.565424 ip-10-0-143-124 kubenswrapper[2552]: I0609 17:33:18.565346 2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-gctfs" Jun 09 17:33:18.573478 ip-10-0-143-124 kubenswrapper[2552]: I0609 17:33:18.573454 2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-n6545" Jun 09 17:33:18.582340 ip-10-0-143-124 kubenswrapper[2552]: I0609 17:33:18.582317 2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-tb8b5" Jun 09 17:33:18.588325 ip-10-0-143-124 kubenswrapper[2552]: I0609 17:33:18.588300 2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-ddp2h" Jun 09 17:33:18.595136 ip-10-0-143-124 kubenswrapper[2552]: I0609 17:33:18.595117 2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-s8d9p" Jun 09 17:33:18.602804 ip-10-0-143-124 kubenswrapper[2552]: I0609 17:33:18.602787 2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-qbd4p" Jun 09 17:33:18.609380 ip-10-0-143-124 kubenswrapper[2552]: I0609 17:33:18.609363 2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-g5rgn" Jun 09 17:33:18.617156 ip-10-0-143-124 kubenswrapper[2552]: I0609 17:33:18.617137 2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-kwh69" Jun 09 17:33:18.622873 ip-10-0-143-124 kubenswrapper[2552]: I0609 17:33:18.622858 2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-9gqc8" Jun 09 17:33:18.885685 ip-10-0-143-124 kubenswrapper[2552]: I0609 17:33:18.885611 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/b817ed32-ca44-43a6-99cf-8cf86ffd8c05-metrics-certs\") pod \"network-metrics-daemon-pvmnc\" (UID: \"b817ed32-ca44-43a6-99cf-8cf86ffd8c05\") " pod="openshift-multus/network-metrics-daemon-pvmnc" Jun 09 17:33:18.885685 ip-10-0-143-124 kubenswrapper[2552]: I0609 17:33:18.885674 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/a71cd181-3d23-4c4b-ac2f-e212dd9b5193-original-pull-secret\") pod \"global-pull-secret-syncer-lt4n9\" (UID: \"a71cd181-3d23-4c4b-ac2f-e212dd9b5193\") " pod="kube-system/global-pull-secret-syncer-lt4n9" Jun 09 17:33:18.885904 ip-10-0-143-124 kubenswrapper[2552]: E0609 17:33:18.885748 2552 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jun 09 17:33:18.885904 ip-10-0-143-124 kubenswrapper[2552]: E0609 17:33:18.885785 2552 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jun 09 17:33:18.885904 ip-10-0-143-124 kubenswrapper[2552]: E0609 17:33:18.885816 2552 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b817ed32-ca44-43a6-99cf-8cf86ffd8c05-metrics-certs podName:b817ed32-ca44-43a6-99cf-8cf86ffd8c05 nodeName:}" failed. No retries permitted until 2026-06-09 17:33:19.885797363 +0000 UTC m=+3.985699994 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/b817ed32-ca44-43a6-99cf-8cf86ffd8c05-metrics-certs") pod "network-metrics-daemon-pvmnc" (UID: "b817ed32-ca44-43a6-99cf-8cf86ffd8c05") : object "openshift-multus"/"metrics-daemon-secret" not registered Jun 09 17:33:18.885904 ip-10-0-143-124 kubenswrapper[2552]: E0609 17:33:18.885836 2552 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a71cd181-3d23-4c4b-ac2f-e212dd9b5193-original-pull-secret podName:a71cd181-3d23-4c4b-ac2f-e212dd9b5193 nodeName:}" failed. No retries permitted until 2026-06-09 17:33:19.885827997 +0000 UTC m=+3.985730626 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/a71cd181-3d23-4c4b-ac2f-e212dd9b5193-original-pull-secret") pod "global-pull-secret-syncer-lt4n9" (UID: "a71cd181-3d23-4c4b-ac2f-e212dd9b5193") : object "kube-system"/"original-pull-secret" not registered Jun 09 17:33:18.986199 ip-10-0-143-124 kubenswrapper[2552]: I0609 17:33:18.986167 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vvzhh\" (UniqueName: \"kubernetes.io/projected/7755d1ba-506c-4a2d-829f-57beb748954e-kube-api-access-vvzhh\") pod \"network-check-target-mpmvr\" (UID: \"7755d1ba-506c-4a2d-829f-57beb748954e\") " pod="openshift-network-diagnostics/network-check-target-mpmvr" Jun 09 17:33:18.986370 ip-10-0-143-124 kubenswrapper[2552]: E0609 17:33:18.986353 2552 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jun 09 17:33:18.986432 ip-10-0-143-124 kubenswrapper[2552]: E0609 17:33:18.986378 2552 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jun 09 17:33:18.986432 ip-10-0-143-124 kubenswrapper[2552]: E0609 17:33:18.986389 2552 projected.go:196] Error preparing data for projected volume kube-api-access-vvzhh for pod openshift-network-diagnostics/network-check-target-mpmvr: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 09 17:33:18.986502 ip-10-0-143-124 kubenswrapper[2552]: E0609 17:33:18.986453 2552 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/7755d1ba-506c-4a2d-829f-57beb748954e-kube-api-access-vvzhh podName:7755d1ba-506c-4a2d-829f-57beb748954e nodeName:}" failed. No retries permitted until 2026-06-09 17:33:19.986432446 +0000 UTC m=+4.086335075 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-api-access-vvzhh" (UniqueName: "kubernetes.io/projected/7755d1ba-506c-4a2d-829f-57beb748954e-kube-api-access-vvzhh") pod "network-check-target-mpmvr" (UID: "7755d1ba-506c-4a2d-829f-57beb748954e") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 09 17:33:19.306546 ip-10-0-143-124 kubenswrapper[2552]: I0609 17:33:19.306485 2552 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-06-08 17:28:18 +0000 UTC" deadline="2027-11-05 13:58:23.514804527 +0000 UTC" Jun 09 17:33:19.306546 ip-10-0-143-124 kubenswrapper[2552]: I0609 17:33:19.306539 2552 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="12332h25m4.208271901s" Jun 09 17:33:19.452262 ip-10-0-143-124 kubenswrapper[2552]: W0609 17:33:19.452223 2552 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8285b34c_bc55_44a2_b6c5_e2c2e4c6a660.slice/crio-eaedcee9b64eeafa43f18ee3e573124b4253d6a948febd33a74a18643f27f7e0 WatchSource:0}: Error finding container eaedcee9b64eeafa43f18ee3e573124b4253d6a948febd33a74a18643f27f7e0: Status 404 returned error can't find the container with id eaedcee9b64eeafa43f18ee3e573124b4253d6a948febd33a74a18643f27f7e0 Jun 09 17:33:19.454427 ip-10-0-143-124 kubenswrapper[2552]: W0609 17:33:19.454397 2552 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod57526948_94e0_40fd_b0bf_ada9cf355743.slice/crio-e2a68c9131b1334b820888aa3eee4032e56b1dffbde3ca4cf11f613544a77812 WatchSource:0}: Error finding container e2a68c9131b1334b820888aa3eee4032e56b1dffbde3ca4cf11f613544a77812: Status 404 returned error can't find the container with id e2a68c9131b1334b820888aa3eee4032e56b1dffbde3ca4cf11f613544a77812 Jun 09 17:33:19.457252 ip-10-0-143-124 kubenswrapper[2552]: W0609 17:33:19.457225 2552 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod99815f55_a516_4e96_bdb4_67bf609055f2.slice/crio-c96bfe32edbb7c211109d586f47e8a4e323bd5f7c1f2bcd54571eaa03ab42df5 WatchSource:0}: Error finding container c96bfe32edbb7c211109d586f47e8a4e323bd5f7c1f2bcd54571eaa03ab42df5: Status 404 returned error can't find the container with id c96bfe32edbb7c211109d586f47e8a4e323bd5f7c1f2bcd54571eaa03ab42df5 Jun 09 17:33:19.459614 ip-10-0-143-124 kubenswrapper[2552]: W0609 17:33:19.459579 2552 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8563ebab_ebdd_4d68_bce1_78d2a7f62992.slice/crio-e23853449f7261ed4891b480991989526537fcef662f87120754a02fc3f69ac5 WatchSource:0}: Error finding container e23853449f7261ed4891b480991989526537fcef662f87120754a02fc3f69ac5: Status 404 returned error can't find the container with id e23853449f7261ed4891b480991989526537fcef662f87120754a02fc3f69ac5 Jun 09 17:33:19.460276 ip-10-0-143-124 kubenswrapper[2552]: W0609 17:33:19.460250 2552 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9aa08551_03ce_4c12_96d9_d6ca9bb43bf7.slice/crio-530f29dc51ae1c7da4f75d996bcd6d70e38f813e5941ced669c2f4d9fa684187 WatchSource:0}: Error finding container 530f29dc51ae1c7da4f75d996bcd6d70e38f813e5941ced669c2f4d9fa684187: Status 404 returned error can't find the container with id 530f29dc51ae1c7da4f75d996bcd6d70e38f813e5941ced669c2f4d9fa684187 Jun 09 17:33:19.461891 ip-10-0-143-124 kubenswrapper[2552]: W0609 17:33:19.461785 2552 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poddf33c2c3_49d0_4236_996b_10cde5d3bc92.slice/crio-cf6cae778f38e6de772844a2e9d76453d76cb6081b76e7b1607ebadb06e1ae1f WatchSource:0}: Error finding container cf6cae778f38e6de772844a2e9d76453d76cb6081b76e7b1607ebadb06e1ae1f: Status 404 returned error can't find the container with id cf6cae778f38e6de772844a2e9d76453d76cb6081b76e7b1607ebadb06e1ae1f Jun 09 17:33:19.462661 ip-10-0-143-124 kubenswrapper[2552]: W0609 17:33:19.462572 2552 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2ef810f8_073d_4b45_ad02_2e098f31ed47.slice/crio-8bad9d74851aef68b33af990ba56104db0e592b79e0ddb876ec9ae463eceda60 WatchSource:0}: Error finding container 8bad9d74851aef68b33af990ba56104db0e592b79e0ddb876ec9ae463eceda60: Status 404 returned error can't find the container with id 8bad9d74851aef68b33af990ba56104db0e592b79e0ddb876ec9ae463eceda60 Jun 09 17:33:19.463778 ip-10-0-143-124 kubenswrapper[2552]: W0609 17:33:19.463520 2552 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode5f0d419_4644_4890_85e5_c300cbaee351.slice/crio-e132690153bc1c983f437ba5c2be02d75dd421c5443583d0bcd8b0634cc46bac WatchSource:0}: Error finding container e132690153bc1c983f437ba5c2be02d75dd421c5443583d0bcd8b0634cc46bac: Status 404 returned error can't find the container with id e132690153bc1c983f437ba5c2be02d75dd421c5443583d0bcd8b0634cc46bac Jun 09 17:33:19.464729 ip-10-0-143-124 kubenswrapper[2552]: W0609 17:33:19.464705 2552 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf077d86b_598b_4398_9376_2956816fa47d.slice/crio-5137dd800755ef66ded5d3fe7eb993f3d2825f47bb3e67c7ebeecc52c16980c6 WatchSource:0}: Error finding container 5137dd800755ef66ded5d3fe7eb993f3d2825f47bb3e67c7ebeecc52c16980c6: Status 404 returned error can't find the container with id 5137dd800755ef66ded5d3fe7eb993f3d2825f47bb3e67c7ebeecc52c16980c6 Jun 09 17:33:19.894043 ip-10-0-143-124 kubenswrapper[2552]: I0609 17:33:19.893860 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/b817ed32-ca44-43a6-99cf-8cf86ffd8c05-metrics-certs\") pod \"network-metrics-daemon-pvmnc\" (UID: \"b817ed32-ca44-43a6-99cf-8cf86ffd8c05\") " pod="openshift-multus/network-metrics-daemon-pvmnc" Jun 09 17:33:19.894200 ip-10-0-143-124 kubenswrapper[2552]: I0609 17:33:19.894074 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/a71cd181-3d23-4c4b-ac2f-e212dd9b5193-original-pull-secret\") pod \"global-pull-secret-syncer-lt4n9\" (UID: \"a71cd181-3d23-4c4b-ac2f-e212dd9b5193\") " pod="kube-system/global-pull-secret-syncer-lt4n9" Jun 09 17:33:19.894200 ip-10-0-143-124 kubenswrapper[2552]: E0609 17:33:19.894188 2552 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jun 09 17:33:19.894318 ip-10-0-143-124 kubenswrapper[2552]: E0609 17:33:19.894243 2552 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a71cd181-3d23-4c4b-ac2f-e212dd9b5193-original-pull-secret podName:a71cd181-3d23-4c4b-ac2f-e212dd9b5193 nodeName:}" failed. No retries permitted until 2026-06-09 17:33:21.894225162 +0000 UTC m=+5.994127795 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/a71cd181-3d23-4c4b-ac2f-e212dd9b5193-original-pull-secret") pod "global-pull-secret-syncer-lt4n9" (UID: "a71cd181-3d23-4c4b-ac2f-e212dd9b5193") : object "kube-system"/"original-pull-secret" not registered Jun 09 17:33:19.894649 ip-10-0-143-124 kubenswrapper[2552]: E0609 17:33:19.894631 2552 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jun 09 17:33:19.894726 ip-10-0-143-124 kubenswrapper[2552]: E0609 17:33:19.894689 2552 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b817ed32-ca44-43a6-99cf-8cf86ffd8c05-metrics-certs podName:b817ed32-ca44-43a6-99cf-8cf86ffd8c05 nodeName:}" failed. No retries permitted until 2026-06-09 17:33:21.894671084 +0000 UTC m=+5.994573713 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/b817ed32-ca44-43a6-99cf-8cf86ffd8c05-metrics-certs") pod "network-metrics-daemon-pvmnc" (UID: "b817ed32-ca44-43a6-99cf-8cf86ffd8c05") : object "openshift-multus"/"metrics-daemon-secret" not registered Jun 09 17:33:19.995918 ip-10-0-143-124 kubenswrapper[2552]: I0609 17:33:19.995138 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vvzhh\" (UniqueName: \"kubernetes.io/projected/7755d1ba-506c-4a2d-829f-57beb748954e-kube-api-access-vvzhh\") pod \"network-check-target-mpmvr\" (UID: \"7755d1ba-506c-4a2d-829f-57beb748954e\") " pod="openshift-network-diagnostics/network-check-target-mpmvr" Jun 09 17:33:19.995918 ip-10-0-143-124 kubenswrapper[2552]: E0609 17:33:19.995308 2552 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jun 09 17:33:19.995918 ip-10-0-143-124 kubenswrapper[2552]: E0609 17:33:19.995327 2552 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jun 09 17:33:19.995918 ip-10-0-143-124 kubenswrapper[2552]: E0609 17:33:19.995340 2552 projected.go:196] Error preparing data for projected volume kube-api-access-vvzhh for pod openshift-network-diagnostics/network-check-target-mpmvr: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 09 17:33:19.995918 ip-10-0-143-124 kubenswrapper[2552]: E0609 17:33:19.995396 2552 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/7755d1ba-506c-4a2d-829f-57beb748954e-kube-api-access-vvzhh podName:7755d1ba-506c-4a2d-829f-57beb748954e nodeName:}" failed. No retries permitted until 2026-06-09 17:33:21.995377378 +0000 UTC m=+6.095280026 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-api-access-vvzhh" (UniqueName: "kubernetes.io/projected/7755d1ba-506c-4a2d-829f-57beb748954e-kube-api-access-vvzhh") pod "network-check-target-mpmvr" (UID: "7755d1ba-506c-4a2d-829f-57beb748954e") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 09 17:33:20.307103 ip-10-0-143-124 kubenswrapper[2552]: I0609 17:33:20.306986 2552 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-06-08 17:28:18 +0000 UTC" deadline="2028-03-04 08:41:44.489296098 +0000 UTC" Jun 09 17:33:20.307103 ip-10-0-143-124 kubenswrapper[2552]: I0609 17:33:20.307022 2552 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="15207h8m24.18227826s" Jun 09 17:33:20.332431 ip-10-0-143-124 kubenswrapper[2552]: I0609 17:33:20.331709 2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-lt4n9" Jun 09 17:33:20.332431 ip-10-0-143-124 kubenswrapper[2552]: I0609 17:33:20.331722 2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-pvmnc" Jun 09 17:33:20.332431 ip-10-0-143-124 kubenswrapper[2552]: I0609 17:33:20.331739 2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-mpmvr" Jun 09 17:33:20.332431 ip-10-0-143-124 kubenswrapper[2552]: E0609 17:33:20.331842 2552 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-lt4n9" podUID="a71cd181-3d23-4c4b-ac2f-e212dd9b5193" Jun 09 17:33:20.332431 ip-10-0-143-124 kubenswrapper[2552]: E0609 17:33:20.332268 2552 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-pvmnc" podUID="b817ed32-ca44-43a6-99cf-8cf86ffd8c05" Jun 09 17:33:20.332431 ip-10-0-143-124 kubenswrapper[2552]: E0609 17:33:20.332350 2552 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-mpmvr" podUID="7755d1ba-506c-4a2d-829f-57beb748954e" Jun 09 17:33:20.357891 ip-10-0-143-124 kubenswrapper[2552]: I0609 17:33:20.357857 2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-n6545" event={"ID":"99815f55-a516-4e96-bdb4-67bf609055f2","Type":"ContainerStarted","Data":"c96bfe32edbb7c211109d586f47e8a4e323bd5f7c1f2bcd54571eaa03ab42df5"} Jun 09 17:33:20.362614 ip-10-0-143-124 kubenswrapper[2552]: I0609 17:33:20.362576 2552 reflector.go:439] "Caches populated" type="*v1.Service" reflector="k8s.io/client-go/informers/factory.go:160" Jun 09 17:33:20.368564 ip-10-0-143-124 kubenswrapper[2552]: I0609 17:33:20.368469 2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-9gqc8" event={"ID":"8285b34c-bc55-44a2-b6c5-e2c2e4c6a660","Type":"ContainerStarted","Data":"eaedcee9b64eeafa43f18ee3e573124b4253d6a948febd33a74a18643f27f7e0"} Jun 09 17:33:20.383131 ip-10-0-143-124 kubenswrapper[2552]: I0609 17:33:20.383095 2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-143-124.ec2.internal" event={"ID":"c6eab2ff3a3679dccbb6f4cc985d9ef6","Type":"ContainerStarted","Data":"e9144fa27031871feb4cb9a1877ef7f8a182eb7101c24da12817fb355235a41f"} Jun 09 17:33:20.413846 ip-10-0-143-124 kubenswrapper[2552]: I0609 17:33:20.413785 2552 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/kube-apiserver-proxy-ip-10-0-143-124.ec2.internal" podStartSLOduration=3.413763241 podStartE2EDuration="3.413763241s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-09 17:33:17 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-09 17:33:20.412456007 +0000 UTC m=+4.512358658" watchObservedRunningTime="2026-06-09 17:33:20.413763241 +0000 UTC m=+4.513665892" Jun 09 17:33:20.414690 ip-10-0-143-124 kubenswrapper[2552]: I0609 17:33:20.414638 2552 generic.go:356] "Generic (PLEG): container finished" podID="98d869758a762967dbb1a9629bfd5f10" containerID="b832c6b8a6473c6447978fee2ccc134c23436d9b1edd86d9e722b6a4d4831c30" exitCode=0 Jun 09 17:33:20.414867 ip-10-0-143-124 kubenswrapper[2552]: I0609 17:33:20.414836 2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-143-124.ec2.internal" event={"ID":"98d869758a762967dbb1a9629bfd5f10","Type":"ContainerDied","Data":"b832c6b8a6473c6447978fee2ccc134c23436d9b1edd86d9e722b6a4d4831c30"} Jun 09 17:33:20.423867 ip-10-0-143-124 kubenswrapper[2552]: I0609 17:33:20.423797 2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-qbd4p" event={"ID":"f077d86b-598b-4398-9376-2956816fa47d","Type":"ContainerStarted","Data":"5137dd800755ef66ded5d3fe7eb993f3d2825f47bb3e67c7ebeecc52c16980c6"} Jun 09 17:33:20.447179 ip-10-0-143-124 kubenswrapper[2552]: I0609 17:33:20.447148 2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-kwh69" event={"ID":"9aa08551-03ce-4c12-96d9-d6ca9bb43bf7","Type":"ContainerStarted","Data":"530f29dc51ae1c7da4f75d996bcd6d70e38f813e5941ced669c2f4d9fa684187"} Jun 09 17:33:20.457919 ip-10-0-143-124 kubenswrapper[2552]: I0609 17:33:20.457867 2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-gctfs" event={"ID":"8563ebab-ebdd-4d68-bce1-78d2a7f62992","Type":"ContainerStarted","Data":"e23853449f7261ed4891b480991989526537fcef662f87120754a02fc3f69ac5"} Jun 09 17:33:20.464562 ip-10-0-143-124 kubenswrapper[2552]: I0609 17:33:20.464530 2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-s8d9p" event={"ID":"57526948-94e0-40fd-b0bf-ada9cf355743","Type":"ContainerStarted","Data":"e2a68c9131b1334b820888aa3eee4032e56b1dffbde3ca4cf11f613544a77812"} Jun 09 17:33:20.478333 ip-10-0-143-124 kubenswrapper[2552]: I0609 17:33:20.478267 2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-g5rgn" event={"ID":"e5f0d419-4644-4890-85e5-c300cbaee351","Type":"ContainerStarted","Data":"e132690153bc1c983f437ba5c2be02d75dd421c5443583d0bcd8b0634cc46bac"} Jun 09 17:33:20.489157 ip-10-0-143-124 kubenswrapper[2552]: I0609 17:33:20.489118 2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-tb8b5" event={"ID":"2ef810f8-073d-4b45-ad02-2e098f31ed47","Type":"ContainerStarted","Data":"8bad9d74851aef68b33af990ba56104db0e592b79e0ddb876ec9ae463eceda60"} Jun 09 17:33:20.495057 ip-10-0-143-124 kubenswrapper[2552]: I0609 17:33:20.495030 2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-ddp2h" event={"ID":"df33c2c3-49d0-4236-996b-10cde5d3bc92","Type":"ContainerStarted","Data":"cf6cae778f38e6de772844a2e9d76453d76cb6081b76e7b1607ebadb06e1ae1f"} Jun 09 17:33:21.517543 ip-10-0-143-124 kubenswrapper[2552]: I0609 17:33:21.517509 2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-143-124.ec2.internal" event={"ID":"98d869758a762967dbb1a9629bfd5f10","Type":"ContainerStarted","Data":"d6c6786ba395e1dfbc070e3dc01f1f2f55f671179474cb6ec8f2c2dadeed9078"} Jun 09 17:33:21.911300 ip-10-0-143-124 kubenswrapper[2552]: I0609 17:33:21.911215 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/b817ed32-ca44-43a6-99cf-8cf86ffd8c05-metrics-certs\") pod \"network-metrics-daemon-pvmnc\" (UID: \"b817ed32-ca44-43a6-99cf-8cf86ffd8c05\") " pod="openshift-multus/network-metrics-daemon-pvmnc" Jun 09 17:33:21.911300 ip-10-0-143-124 kubenswrapper[2552]: I0609 17:33:21.911291 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/a71cd181-3d23-4c4b-ac2f-e212dd9b5193-original-pull-secret\") pod \"global-pull-secret-syncer-lt4n9\" (UID: \"a71cd181-3d23-4c4b-ac2f-e212dd9b5193\") " pod="kube-system/global-pull-secret-syncer-lt4n9" Jun 09 17:33:21.911513 ip-10-0-143-124 kubenswrapper[2552]: E0609 17:33:21.911402 2552 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jun 09 17:33:21.911513 ip-10-0-143-124 kubenswrapper[2552]: E0609 17:33:21.911417 2552 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jun 09 17:33:21.911513 ip-10-0-143-124 kubenswrapper[2552]: E0609 17:33:21.911484 2552 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b817ed32-ca44-43a6-99cf-8cf86ffd8c05-metrics-certs podName:b817ed32-ca44-43a6-99cf-8cf86ffd8c05 nodeName:}" failed. No retries permitted until 2026-06-09 17:33:25.911464426 +0000 UTC m=+10.011367063 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/b817ed32-ca44-43a6-99cf-8cf86ffd8c05-metrics-certs") pod "network-metrics-daemon-pvmnc" (UID: "b817ed32-ca44-43a6-99cf-8cf86ffd8c05") : object "openshift-multus"/"metrics-daemon-secret" not registered Jun 09 17:33:21.911697 ip-10-0-143-124 kubenswrapper[2552]: E0609 17:33:21.911528 2552 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a71cd181-3d23-4c4b-ac2f-e212dd9b5193-original-pull-secret podName:a71cd181-3d23-4c4b-ac2f-e212dd9b5193 nodeName:}" failed. No retries permitted until 2026-06-09 17:33:25.911517592 +0000 UTC m=+10.011420227 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/a71cd181-3d23-4c4b-ac2f-e212dd9b5193-original-pull-secret") pod "global-pull-secret-syncer-lt4n9" (UID: "a71cd181-3d23-4c4b-ac2f-e212dd9b5193") : object "kube-system"/"original-pull-secret" not registered Jun 09 17:33:22.011719 ip-10-0-143-124 kubenswrapper[2552]: I0609 17:33:22.011683 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vvzhh\" (UniqueName: \"kubernetes.io/projected/7755d1ba-506c-4a2d-829f-57beb748954e-kube-api-access-vvzhh\") pod \"network-check-target-mpmvr\" (UID: \"7755d1ba-506c-4a2d-829f-57beb748954e\") " pod="openshift-network-diagnostics/network-check-target-mpmvr" Jun 09 17:33:22.011954 ip-10-0-143-124 kubenswrapper[2552]: E0609 17:33:22.011900 2552 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jun 09 17:33:22.011954 ip-10-0-143-124 kubenswrapper[2552]: E0609 17:33:22.011926 2552 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jun 09 17:33:22.011954 ip-10-0-143-124 kubenswrapper[2552]: E0609 17:33:22.011939 2552 projected.go:196] Error preparing data for projected volume kube-api-access-vvzhh for pod openshift-network-diagnostics/network-check-target-mpmvr: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 09 17:33:22.012111 ip-10-0-143-124 kubenswrapper[2552]: E0609 17:33:22.012000 2552 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/7755d1ba-506c-4a2d-829f-57beb748954e-kube-api-access-vvzhh podName:7755d1ba-506c-4a2d-829f-57beb748954e nodeName:}" failed. No retries permitted until 2026-06-09 17:33:26.01198158 +0000 UTC m=+10.111884209 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-api-access-vvzhh" (UniqueName: "kubernetes.io/projected/7755d1ba-506c-4a2d-829f-57beb748954e-kube-api-access-vvzhh") pod "network-check-target-mpmvr" (UID: "7755d1ba-506c-4a2d-829f-57beb748954e") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 09 17:33:22.332400 ip-10-0-143-124 kubenswrapper[2552]: I0609 17:33:22.331896 2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-pvmnc" Jun 09 17:33:22.332400 ip-10-0-143-124 kubenswrapper[2552]: I0609 17:33:22.331896 2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-mpmvr" Jun 09 17:33:22.332400 ip-10-0-143-124 kubenswrapper[2552]: E0609 17:33:22.332046 2552 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-pvmnc" podUID="b817ed32-ca44-43a6-99cf-8cf86ffd8c05" Jun 09 17:33:22.332400 ip-10-0-143-124 kubenswrapper[2552]: I0609 17:33:22.332066 2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-lt4n9" Jun 09 17:33:22.332400 ip-10-0-143-124 kubenswrapper[2552]: E0609 17:33:22.332169 2552 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-mpmvr" podUID="7755d1ba-506c-4a2d-829f-57beb748954e" Jun 09 17:33:22.332400 ip-10-0-143-124 kubenswrapper[2552]: E0609 17:33:22.332249 2552 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-lt4n9" podUID="a71cd181-3d23-4c4b-ac2f-e212dd9b5193" Jun 09 17:33:24.332018 ip-10-0-143-124 kubenswrapper[2552]: I0609 17:33:24.331936 2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-lt4n9" Jun 09 17:33:24.332018 ip-10-0-143-124 kubenswrapper[2552]: I0609 17:33:24.331954 2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-mpmvr" Jun 09 17:33:24.332645 ip-10-0-143-124 kubenswrapper[2552]: E0609 17:33:24.332087 2552 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-lt4n9" podUID="a71cd181-3d23-4c4b-ac2f-e212dd9b5193" Jun 09 17:33:24.332645 ip-10-0-143-124 kubenswrapper[2552]: I0609 17:33:24.332164 2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-pvmnc" Jun 09 17:33:24.332645 ip-10-0-143-124 kubenswrapper[2552]: E0609 17:33:24.332276 2552 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-pvmnc" podUID="b817ed32-ca44-43a6-99cf-8cf86ffd8c05" Jun 09 17:33:24.333033 ip-10-0-143-124 kubenswrapper[2552]: E0609 17:33:24.332517 2552 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-mpmvr" podUID="7755d1ba-506c-4a2d-829f-57beb748954e" Jun 09 17:33:25.947040 ip-10-0-143-124 kubenswrapper[2552]: I0609 17:33:25.946969 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/b817ed32-ca44-43a6-99cf-8cf86ffd8c05-metrics-certs\") pod \"network-metrics-daemon-pvmnc\" (UID: \"b817ed32-ca44-43a6-99cf-8cf86ffd8c05\") " pod="openshift-multus/network-metrics-daemon-pvmnc" Jun 09 17:33:25.947040 ip-10-0-143-124 kubenswrapper[2552]: I0609 17:33:25.947014 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/a71cd181-3d23-4c4b-ac2f-e212dd9b5193-original-pull-secret\") pod \"global-pull-secret-syncer-lt4n9\" (UID: \"a71cd181-3d23-4c4b-ac2f-e212dd9b5193\") " pod="kube-system/global-pull-secret-syncer-lt4n9" Jun 09 17:33:25.947508 ip-10-0-143-124 kubenswrapper[2552]: E0609 17:33:25.947113 2552 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jun 09 17:33:25.947508 ip-10-0-143-124 kubenswrapper[2552]: E0609 17:33:25.947158 2552 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a71cd181-3d23-4c4b-ac2f-e212dd9b5193-original-pull-secret podName:a71cd181-3d23-4c4b-ac2f-e212dd9b5193 nodeName:}" failed. No retries permitted until 2026-06-09 17:33:33.947145354 +0000 UTC m=+18.047047981 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/a71cd181-3d23-4c4b-ac2f-e212dd9b5193-original-pull-secret") pod "global-pull-secret-syncer-lt4n9" (UID: "a71cd181-3d23-4c4b-ac2f-e212dd9b5193") : object "kube-system"/"original-pull-secret" not registered Jun 09 17:33:25.947508 ip-10-0-143-124 kubenswrapper[2552]: E0609 17:33:25.947429 2552 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jun 09 17:33:25.947508 ip-10-0-143-124 kubenswrapper[2552]: E0609 17:33:25.947459 2552 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b817ed32-ca44-43a6-99cf-8cf86ffd8c05-metrics-certs podName:b817ed32-ca44-43a6-99cf-8cf86ffd8c05 nodeName:}" failed. No retries permitted until 2026-06-09 17:33:33.94744895 +0000 UTC m=+18.047351577 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/b817ed32-ca44-43a6-99cf-8cf86ffd8c05-metrics-certs") pod "network-metrics-daemon-pvmnc" (UID: "b817ed32-ca44-43a6-99cf-8cf86ffd8c05") : object "openshift-multus"/"metrics-daemon-secret" not registered Jun 09 17:33:26.048322 ip-10-0-143-124 kubenswrapper[2552]: I0609 17:33:26.048260 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vvzhh\" (UniqueName: \"kubernetes.io/projected/7755d1ba-506c-4a2d-829f-57beb748954e-kube-api-access-vvzhh\") pod \"network-check-target-mpmvr\" (UID: \"7755d1ba-506c-4a2d-829f-57beb748954e\") " pod="openshift-network-diagnostics/network-check-target-mpmvr" Jun 09 17:33:26.048511 ip-10-0-143-124 kubenswrapper[2552]: E0609 17:33:26.048472 2552 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jun 09 17:33:26.048511 ip-10-0-143-124 kubenswrapper[2552]: E0609 17:33:26.048491 2552 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jun 09 17:33:26.048511 ip-10-0-143-124 kubenswrapper[2552]: E0609 17:33:26.048503 2552 projected.go:196] Error preparing data for projected volume kube-api-access-vvzhh for pod openshift-network-diagnostics/network-check-target-mpmvr: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 09 17:33:26.048720 ip-10-0-143-124 kubenswrapper[2552]: E0609 17:33:26.048561 2552 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/7755d1ba-506c-4a2d-829f-57beb748954e-kube-api-access-vvzhh podName:7755d1ba-506c-4a2d-829f-57beb748954e nodeName:}" failed. No retries permitted until 2026-06-09 17:33:34.048542978 +0000 UTC m=+18.148445624 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-api-access-vvzhh" (UniqueName: "kubernetes.io/projected/7755d1ba-506c-4a2d-829f-57beb748954e-kube-api-access-vvzhh") pod "network-check-target-mpmvr" (UID: "7755d1ba-506c-4a2d-829f-57beb748954e") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 09 17:33:26.337197 ip-10-0-143-124 kubenswrapper[2552]: I0609 17:33:26.336766 2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-lt4n9" Jun 09 17:33:26.337197 ip-10-0-143-124 kubenswrapper[2552]: E0609 17:33:26.336879 2552 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-lt4n9" podUID="a71cd181-3d23-4c4b-ac2f-e212dd9b5193" Jun 09 17:33:26.337197 ip-10-0-143-124 kubenswrapper[2552]: I0609 17:33:26.336976 2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-pvmnc" Jun 09 17:33:26.337197 ip-10-0-143-124 kubenswrapper[2552]: E0609 17:33:26.337085 2552 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-pvmnc" podUID="b817ed32-ca44-43a6-99cf-8cf86ffd8c05" Jun 09 17:33:26.337197 ip-10-0-143-124 kubenswrapper[2552]: I0609 17:33:26.337113 2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-mpmvr" Jun 09 17:33:26.337197 ip-10-0-143-124 kubenswrapper[2552]: E0609 17:33:26.337181 2552 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-mpmvr" podUID="7755d1ba-506c-4a2d-829f-57beb748954e" Jun 09 17:33:28.331213 ip-10-0-143-124 kubenswrapper[2552]: I0609 17:33:28.331176 2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-pvmnc" Jun 09 17:33:28.331707 ip-10-0-143-124 kubenswrapper[2552]: E0609 17:33:28.331323 2552 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-pvmnc" podUID="b817ed32-ca44-43a6-99cf-8cf86ffd8c05" Jun 09 17:33:28.331707 ip-10-0-143-124 kubenswrapper[2552]: I0609 17:33:28.331671 2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-mpmvr" Jun 09 17:33:28.331707 ip-10-0-143-124 kubenswrapper[2552]: I0609 17:33:28.331697 2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-lt4n9" Jun 09 17:33:28.331874 ip-10-0-143-124 kubenswrapper[2552]: E0609 17:33:28.331772 2552 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-mpmvr" podUID="7755d1ba-506c-4a2d-829f-57beb748954e" Jun 09 17:33:28.331935 ip-10-0-143-124 kubenswrapper[2552]: E0609 17:33:28.331869 2552 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-lt4n9" podUID="a71cd181-3d23-4c4b-ac2f-e212dd9b5193" Jun 09 17:33:30.334908 ip-10-0-143-124 kubenswrapper[2552]: I0609 17:33:30.334874 2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-mpmvr" Jun 09 17:33:30.335327 ip-10-0-143-124 kubenswrapper[2552]: I0609 17:33:30.334986 2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-lt4n9" Jun 09 17:33:30.335327 ip-10-0-143-124 kubenswrapper[2552]: E0609 17:33:30.334996 2552 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-mpmvr" podUID="7755d1ba-506c-4a2d-829f-57beb748954e" Jun 09 17:33:30.335327 ip-10-0-143-124 kubenswrapper[2552]: I0609 17:33:30.335017 2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-pvmnc" Jun 09 17:33:30.335327 ip-10-0-143-124 kubenswrapper[2552]: E0609 17:33:30.335099 2552 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-lt4n9" podUID="a71cd181-3d23-4c4b-ac2f-e212dd9b5193" Jun 09 17:33:30.335327 ip-10-0-143-124 kubenswrapper[2552]: E0609 17:33:30.335196 2552 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-pvmnc" podUID="b817ed32-ca44-43a6-99cf-8cf86ffd8c05" Jun 09 17:33:32.332054 ip-10-0-143-124 kubenswrapper[2552]: I0609 17:33:32.332017 2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-pvmnc" Jun 09 17:33:32.332663 ip-10-0-143-124 kubenswrapper[2552]: I0609 17:33:32.332029 2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-mpmvr" Jun 09 17:33:32.332663 ip-10-0-143-124 kubenswrapper[2552]: E0609 17:33:32.332161 2552 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-pvmnc" podUID="b817ed32-ca44-43a6-99cf-8cf86ffd8c05" Jun 09 17:33:32.332663 ip-10-0-143-124 kubenswrapper[2552]: I0609 17:33:32.332029 2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-lt4n9" Jun 09 17:33:32.332663 ip-10-0-143-124 kubenswrapper[2552]: E0609 17:33:32.332229 2552 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-mpmvr" podUID="7755d1ba-506c-4a2d-829f-57beb748954e" Jun 09 17:33:32.332663 ip-10-0-143-124 kubenswrapper[2552]: E0609 17:33:32.332302 2552 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-lt4n9" podUID="a71cd181-3d23-4c4b-ac2f-e212dd9b5193" Jun 09 17:33:34.010650 ip-10-0-143-124 kubenswrapper[2552]: I0609 17:33:34.010608 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/a71cd181-3d23-4c4b-ac2f-e212dd9b5193-original-pull-secret\") pod \"global-pull-secret-syncer-lt4n9\" (UID: \"a71cd181-3d23-4c4b-ac2f-e212dd9b5193\") " pod="kube-system/global-pull-secret-syncer-lt4n9" Jun 09 17:33:34.011103 ip-10-0-143-124 kubenswrapper[2552]: I0609 17:33:34.010711 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/b817ed32-ca44-43a6-99cf-8cf86ffd8c05-metrics-certs\") pod \"network-metrics-daemon-pvmnc\" (UID: \"b817ed32-ca44-43a6-99cf-8cf86ffd8c05\") " pod="openshift-multus/network-metrics-daemon-pvmnc" Jun 09 17:33:34.011103 ip-10-0-143-124 kubenswrapper[2552]: E0609 17:33:34.010771 2552 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jun 09 17:33:34.011103 ip-10-0-143-124 kubenswrapper[2552]: E0609 17:33:34.010839 2552 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jun 09 17:33:34.011103 ip-10-0-143-124 kubenswrapper[2552]: E0609 17:33:34.010854 2552 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a71cd181-3d23-4c4b-ac2f-e212dd9b5193-original-pull-secret podName:a71cd181-3d23-4c4b-ac2f-e212dd9b5193 nodeName:}" failed. No retries permitted until 2026-06-09 17:33:50.010834509 +0000 UTC m=+34.110737147 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/a71cd181-3d23-4c4b-ac2f-e212dd9b5193-original-pull-secret") pod "global-pull-secret-syncer-lt4n9" (UID: "a71cd181-3d23-4c4b-ac2f-e212dd9b5193") : object "kube-system"/"original-pull-secret" not registered Jun 09 17:33:34.011103 ip-10-0-143-124 kubenswrapper[2552]: E0609 17:33:34.010894 2552 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b817ed32-ca44-43a6-99cf-8cf86ffd8c05-metrics-certs podName:b817ed32-ca44-43a6-99cf-8cf86ffd8c05 nodeName:}" failed. No retries permitted until 2026-06-09 17:33:50.010877706 +0000 UTC m=+34.110780335 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/b817ed32-ca44-43a6-99cf-8cf86ffd8c05-metrics-certs") pod "network-metrics-daemon-pvmnc" (UID: "b817ed32-ca44-43a6-99cf-8cf86ffd8c05") : object "openshift-multus"/"metrics-daemon-secret" not registered Jun 09 17:33:34.111396 ip-10-0-143-124 kubenswrapper[2552]: I0609 17:33:34.111360 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vvzhh\" (UniqueName: \"kubernetes.io/projected/7755d1ba-506c-4a2d-829f-57beb748954e-kube-api-access-vvzhh\") pod \"network-check-target-mpmvr\" (UID: \"7755d1ba-506c-4a2d-829f-57beb748954e\") " pod="openshift-network-diagnostics/network-check-target-mpmvr" Jun 09 17:33:34.111555 ip-10-0-143-124 kubenswrapper[2552]: E0609 17:33:34.111506 2552 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jun 09 17:33:34.111555 ip-10-0-143-124 kubenswrapper[2552]: E0609 17:33:34.111521 2552 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jun 09 17:33:34.111555 ip-10-0-143-124 kubenswrapper[2552]: E0609 17:33:34.111531 2552 projected.go:196] Error preparing data for projected volume kube-api-access-vvzhh for pod openshift-network-diagnostics/network-check-target-mpmvr: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 09 17:33:34.111698 ip-10-0-143-124 kubenswrapper[2552]: E0609 17:33:34.111586 2552 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/7755d1ba-506c-4a2d-829f-57beb748954e-kube-api-access-vvzhh podName:7755d1ba-506c-4a2d-829f-57beb748954e nodeName:}" failed. No retries permitted until 2026-06-09 17:33:50.111570827 +0000 UTC m=+34.211473457 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "kube-api-access-vvzhh" (UniqueName: "kubernetes.io/projected/7755d1ba-506c-4a2d-829f-57beb748954e-kube-api-access-vvzhh") pod "network-check-target-mpmvr" (UID: "7755d1ba-506c-4a2d-829f-57beb748954e") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 09 17:33:34.331837 ip-10-0-143-124 kubenswrapper[2552]: I0609 17:33:34.331700 2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-lt4n9" Jun 09 17:33:34.331837 ip-10-0-143-124 kubenswrapper[2552]: I0609 17:33:34.331723 2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-pvmnc" Jun 09 17:33:34.332101 ip-10-0-143-124 kubenswrapper[2552]: E0609 17:33:34.331839 2552 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-lt4n9" podUID="a71cd181-3d23-4c4b-ac2f-e212dd9b5193" Jun 09 17:33:34.332101 ip-10-0-143-124 kubenswrapper[2552]: I0609 17:33:34.331891 2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-mpmvr" Jun 09 17:33:34.332101 ip-10-0-143-124 kubenswrapper[2552]: E0609 17:33:34.331997 2552 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-pvmnc" podUID="b817ed32-ca44-43a6-99cf-8cf86ffd8c05" Jun 09 17:33:34.332217 ip-10-0-143-124 kubenswrapper[2552]: E0609 17:33:34.332100 2552 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-mpmvr" podUID="7755d1ba-506c-4a2d-829f-57beb748954e" Jun 09 17:33:36.332374 ip-10-0-143-124 kubenswrapper[2552]: I0609 17:33:36.332349 2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-lt4n9" Jun 09 17:33:36.332854 ip-10-0-143-124 kubenswrapper[2552]: E0609 17:33:36.332447 2552 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-lt4n9" podUID="a71cd181-3d23-4c4b-ac2f-e212dd9b5193" Jun 09 17:33:36.332854 ip-10-0-143-124 kubenswrapper[2552]: I0609 17:33:36.332545 2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-pvmnc" Jun 09 17:33:36.332854 ip-10-0-143-124 kubenswrapper[2552]: E0609 17:33:36.332662 2552 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-pvmnc" podUID="b817ed32-ca44-43a6-99cf-8cf86ffd8c05" Jun 09 17:33:36.332854 ip-10-0-143-124 kubenswrapper[2552]: I0609 17:33:36.332702 2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-mpmvr" Jun 09 17:33:36.332854 ip-10-0-143-124 kubenswrapper[2552]: E0609 17:33:36.332764 2552 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-mpmvr" podUID="7755d1ba-506c-4a2d-829f-57beb748954e" Jun 09 17:33:38.332670 ip-10-0-143-124 kubenswrapper[2552]: I0609 17:33:38.331904 2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-pvmnc" Jun 09 17:33:38.332670 ip-10-0-143-124 kubenswrapper[2552]: E0609 17:33:38.332254 2552 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-pvmnc" podUID="b817ed32-ca44-43a6-99cf-8cf86ffd8c05" Jun 09 17:33:38.332670 ip-10-0-143-124 kubenswrapper[2552]: I0609 17:33:38.332091 2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-mpmvr" Jun 09 17:33:38.332670 ip-10-0-143-124 kubenswrapper[2552]: E0609 17:33:38.332388 2552 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-mpmvr" podUID="7755d1ba-506c-4a2d-829f-57beb748954e" Jun 09 17:33:38.332670 ip-10-0-143-124 kubenswrapper[2552]: I0609 17:33:38.332464 2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-lt4n9" Jun 09 17:33:38.332670 ip-10-0-143-124 kubenswrapper[2552]: E0609 17:33:38.332565 2552 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-lt4n9" podUID="a71cd181-3d23-4c4b-ac2f-e212dd9b5193" Jun 09 17:33:38.553664 ip-10-0-143-124 kubenswrapper[2552]: I0609 17:33:38.553632 2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-n6545" event={"ID":"99815f55-a516-4e96-bdb4-67bf609055f2","Type":"ContainerStarted","Data":"1d803c0c217bc949b6649cebbbf93fe95948df2226dcf51ddb63e156fca85e11"} Jun 09 17:33:38.555337 ip-10-0-143-124 kubenswrapper[2552]: I0609 17:33:38.555307 2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-9gqc8" event={"ID":"8285b34c-bc55-44a2-b6c5-e2c2e4c6a660","Type":"ContainerStarted","Data":"b9da3bde4263812931725226a62f732ab0a6195463f854c52dec44164e47ac39"} Jun 09 17:33:38.557097 ip-10-0-143-124 kubenswrapper[2552]: I0609 17:33:38.557024 2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-qbd4p" event={"ID":"f077d86b-598b-4398-9376-2956816fa47d","Type":"ContainerStarted","Data":"3181df20a0746b8834572375ac0b5c484971f105534a9575fd5852344b3b8853"} Jun 09 17:33:38.558814 ip-10-0-143-124 kubenswrapper[2552]: I0609 17:33:38.558795 2552 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-kwh69_9aa08551-03ce-4c12-96d9-d6ca9bb43bf7/ovn-acl-logging/0.log" Jun 09 17:33:38.559203 ip-10-0-143-124 kubenswrapper[2552]: I0609 17:33:38.559174 2552 generic.go:356] "Generic (PLEG): container finished" podID="9aa08551-03ce-4c12-96d9-d6ca9bb43bf7" containerID="cf3523531dd03ee0ad063ef8baebaa46993075e573b5da5381f3292e5d5fc7f4" exitCode=1 Jun 09 17:33:38.559278 ip-10-0-143-124 kubenswrapper[2552]: I0609 17:33:38.559238 2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-kwh69" event={"ID":"9aa08551-03ce-4c12-96d9-d6ca9bb43bf7","Type":"ContainerDied","Data":"cf3523531dd03ee0ad063ef8baebaa46993075e573b5da5381f3292e5d5fc7f4"} Jun 09 17:33:38.559325 ip-10-0-143-124 kubenswrapper[2552]: I0609 17:33:38.559300 2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-kwh69" event={"ID":"9aa08551-03ce-4c12-96d9-d6ca9bb43bf7","Type":"ContainerStarted","Data":"df99a2d8ef997118c4df58ca815e74ac5a9bae119ff2be62630a5d89efaf449d"} Jun 09 17:33:38.560842 ip-10-0-143-124 kubenswrapper[2552]: I0609 17:33:38.560818 2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-gctfs" event={"ID":"8563ebab-ebdd-4d68-bce1-78d2a7f62992","Type":"ContainerStarted","Data":"728448d2e450fef20686783c2682015fd449f2e9250043c6acb34f298579331c"} Jun 09 17:33:38.562526 ip-10-0-143-124 kubenswrapper[2552]: I0609 17:33:38.562506 2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-s8d9p" event={"ID":"57526948-94e0-40fd-b0bf-ada9cf355743","Type":"ContainerStarted","Data":"7043ee16c236d6562b99ce954433d6eb010eaa9c1d06c373b31f65542c0d9b67"} Jun 09 17:33:38.564663 ip-10-0-143-124 kubenswrapper[2552]: I0609 17:33:38.564641 2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-g5rgn" event={"ID":"e5f0d419-4644-4890-85e5-c300cbaee351","Type":"ContainerStarted","Data":"8b0c063519138db3c71b3d4cef3702c37d1202594dc34a3e473201f85d3f6f7b"} Jun 09 17:33:38.566272 ip-10-0-143-124 kubenswrapper[2552]: I0609 17:33:38.566250 2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-tb8b5" event={"ID":"2ef810f8-073d-4b45-ad02-2e098f31ed47","Type":"ContainerStarted","Data":"9e2cdd7bb7a468e1159ea22742143138931902f874a7a843ce7c2068a681635a"} Jun 09 17:33:38.569026 ip-10-0-143-124 kubenswrapper[2552]: I0609 17:33:38.568979 2552 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-143-124.ec2.internal" podStartSLOduration=21.568963485 podStartE2EDuration="21.568963485s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-09 17:33:17 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-09 17:33:21.532281249 +0000 UTC m=+5.632183895" watchObservedRunningTime="2026-06-09 17:33:38.568963485 +0000 UTC m=+22.668866136" Jun 09 17:33:38.569721 ip-10-0-143-124 kubenswrapper[2552]: I0609 17:33:38.569686 2552 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-n6545" podStartSLOduration=3.852157485 podStartE2EDuration="22.569677748s" totalImagesPullingTime="18.717520263s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-09 17:33:16 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-09 17:33:38.568781618 +0000 UTC m=+22.668684292" watchObservedRunningTime="2026-06-09 17:33:38.569677748 +0000 UTC m=+22.669580399" Jun 09 17:33:38.582646 ip-10-0-143-124 kubenswrapper[2552]: I0609 17:33:38.582586 2552 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/konnectivity-agent-gctfs" podStartSLOduration=8.743855535 podStartE2EDuration="22.582573513s" totalImagesPullingTime="13.838717978s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-09 17:33:16 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-09 17:33:38.582160266 +0000 UTC m=+22.682062916" watchObservedRunningTime="2026-06-09 17:33:38.582573513 +0000 UTC m=+22.682476166" Jun 09 17:33:38.610991 ip-10-0-143-124 kubenswrapper[2552]: I0609 17:33:38.610941 2552 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/node-resolver-qbd4p" podStartSLOduration=3.9381693479999997 podStartE2EDuration="22.610923581s" totalImagesPullingTime="18.672754233s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-09 17:33:16 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-09 17:33:38.610201729 +0000 UTC m=+22.710104379" watchObservedRunningTime="2026-06-09 17:33:38.610923581 +0000 UTC m=+22.710826232" Jun 09 17:33:38.639463 ip-10-0-143-124 kubenswrapper[2552]: I0609 17:33:38.639425 2552 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-node-tuning-operator/tuned-g5rgn" podStartSLOduration=3.964150526 podStartE2EDuration="22.639412679s" totalImagesPullingTime="18.675262153s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-09 17:33:16 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-09 17:33:38.639254849 +0000 UTC m=+22.739157502" watchObservedRunningTime="2026-06-09 17:33:38.639412679 +0000 UTC m=+22.739315329" Jun 09 17:33:38.655820 ip-10-0-143-124 kubenswrapper[2552]: I0609 17:33:38.655784 2552 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/node-ca-tb8b5" podStartSLOduration=3.982925181 podStartE2EDuration="22.655765427s" totalImagesPullingTime="18.672840246s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-09 17:33:16 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-09 17:33:38.655042684 +0000 UTC m=+22.754945346" watchObservedRunningTime="2026-06-09 17:33:38.655765427 +0000 UTC m=+22.755668081" Jun 09 17:33:38.709479 ip-10-0-143-124 kubenswrapper[2552]: I0609 17:33:38.709349 2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gctfs_8563ebab-ebdd-4d68-bce1-78d2a7f62992/konnectivity-agent/0.log" limit=1024 Jun 09 17:33:38.788067 ip-10-0-143-124 kubenswrapper[2552]: I0609 17:33:38.788024 2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gctfs_8563ebab-ebdd-4d68-bce1-78d2a7f62992/konnectivity-agent/0.log" limit=1024 Jun 09 17:33:39.479524 ip-10-0-143-124 kubenswrapper[2552]: I0609 17:33:39.479455 2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gctfs_8563ebab-ebdd-4d68-bce1-78d2a7f62992/konnectivity-agent/0.log" limit=1024 Jun 09 17:33:39.532827 ip-10-0-143-124 kubenswrapper[2552]: I0609 17:33:39.532797 2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gctfs_8563ebab-ebdd-4d68-bce1-78d2a7f62992/konnectivity-agent/0.log" limit=1024 Jun 09 17:33:39.573632 ip-10-0-143-124 kubenswrapper[2552]: I0609 17:33:39.573591 2552 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-kwh69_9aa08551-03ce-4c12-96d9-d6ca9bb43bf7/ovn-acl-logging/0.log" Jun 09 17:33:39.574004 ip-10-0-143-124 kubenswrapper[2552]: I0609 17:33:39.573970 2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-kwh69" event={"ID":"9aa08551-03ce-4c12-96d9-d6ca9bb43bf7","Type":"ContainerStarted","Data":"360ee103d74e37e968fa6104da25e6a14a39bb51bfd7f171a3b90ff25f350b90"} Jun 09 17:33:39.574118 ip-10-0-143-124 kubenswrapper[2552]: I0609 17:33:39.574072 2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-kwh69" event={"ID":"9aa08551-03ce-4c12-96d9-d6ca9bb43bf7","Type":"ContainerStarted","Data":"8084ddadd5c36b684f1075e88d4548cadd40a54383b392d045c7d2dd5e9573b1"} Jun 09 17:33:39.574164 ip-10-0-143-124 kubenswrapper[2552]: I0609 17:33:39.574126 2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-kwh69" event={"ID":"9aa08551-03ce-4c12-96d9-d6ca9bb43bf7","Type":"ContainerStarted","Data":"1b5352ca4d9afc4d21ef30fd34193d6863256bbfdf68b4e2da32ecda9c4703ae"} Jun 09 17:33:39.574199 ip-10-0-143-124 kubenswrapper[2552]: I0609 17:33:39.574173 2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-kwh69" event={"ID":"9aa08551-03ce-4c12-96d9-d6ca9bb43bf7","Type":"ContainerStarted","Data":"b079f74bcd4c59f487d4482c82e0827b99b43d35d0398963584afbe71c7b3a20"} Jun 09 17:33:39.575783 ip-10-0-143-124 kubenswrapper[2552]: I0609 17:33:39.575758 2552 generic.go:356] "Generic (PLEG): container finished" podID="57526948-94e0-40fd-b0bf-ada9cf355743" containerID="7043ee16c236d6562b99ce954433d6eb010eaa9c1d06c373b31f65542c0d9b67" exitCode=0 Jun 09 17:33:39.575885 ip-10-0-143-124 kubenswrapper[2552]: I0609 17:33:39.575845 2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-s8d9p" event={"ID":"57526948-94e0-40fd-b0bf-ada9cf355743","Type":"ContainerDied","Data":"7043ee16c236d6562b99ce954433d6eb010eaa9c1d06c373b31f65542c0d9b67"} Jun 09 17:33:39.671831 ip-10-0-143-124 kubenswrapper[2552]: I0609 17:33:39.671807 2552 plugin_watcher.go:194] "Adding socket path or updating timestamp to desired state cache" path="/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock" Jun 09 17:33:40.331469 ip-10-0-143-124 kubenswrapper[2552]: I0609 17:33:40.331431 2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-lt4n9" Jun 09 17:33:40.331678 ip-10-0-143-124 kubenswrapper[2552]: E0609 17:33:40.331550 2552 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-lt4n9" podUID="a71cd181-3d23-4c4b-ac2f-e212dd9b5193" Jun 09 17:33:40.331749 ip-10-0-143-124 kubenswrapper[2552]: I0609 17:33:40.331719 2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-pvmnc" Jun 09 17:33:40.331838 ip-10-0-143-124 kubenswrapper[2552]: E0609 17:33:40.331816 2552 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-pvmnc" podUID="b817ed32-ca44-43a6-99cf-8cf86ffd8c05" Jun 09 17:33:40.331897 ip-10-0-143-124 kubenswrapper[2552]: I0609 17:33:40.331880 2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-mpmvr" Jun 09 17:33:40.331986 ip-10-0-143-124 kubenswrapper[2552]: E0609 17:33:40.331955 2552 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-mpmvr" podUID="7755d1ba-506c-4a2d-829f-57beb748954e" Jun 09 17:33:40.333028 ip-10-0-143-124 kubenswrapper[2552]: I0609 17:33:40.332941 2552 reconciler.go:161] "OperationExecutor.RegisterPlugin started" plugin={"SocketPath":"/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock","Timestamp":"2026-06-09T17:33:39.671825957Z","UUID":"5c95432c-4a79-4e3b-a090-824d6c3d614f","Handler":null,"Name":"","Endpoint":""} Jun 09 17:33:40.335046 ip-10-0-143-124 kubenswrapper[2552]: I0609 17:33:40.334883 2552 csi_plugin.go:106] kubernetes.io/csi: Trying to validate a new CSI Driver with name: ebs.csi.aws.com endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock versions: 1.0.0 Jun 09 17:33:40.335046 ip-10-0-143-124 kubenswrapper[2552]: I0609 17:33:40.334918 2552 csi_plugin.go:119] kubernetes.io/csi: Register new plugin with name: ebs.csi.aws.com at endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock Jun 09 17:33:40.580328 ip-10-0-143-124 kubenswrapper[2552]: I0609 17:33:40.580287 2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-ddp2h" event={"ID":"df33c2c3-49d0-4236-996b-10cde5d3bc92","Type":"ContainerStarted","Data":"7f518ffb1ab46542bd2781f0f6eeba7dd8d972719930baeca301ce0bbab85220"} Jun 09 17:33:40.582260 ip-10-0-143-124 kubenswrapper[2552]: I0609 17:33:40.582189 2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-9gqc8" event={"ID":"8285b34c-bc55-44a2-b6c5-e2c2e4c6a660","Type":"ContainerStarted","Data":"a79975f03d9dc64b208080f2aea4480a8f47b240ae4444e469fecaf1294c97e4"} Jun 09 17:33:40.596826 ip-10-0-143-124 kubenswrapper[2552]: I0609 17:33:40.596782 2552 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-operator/iptables-alerter-ddp2h" podStartSLOduration=5.921917143 podStartE2EDuration="24.596764331s" totalImagesPullingTime="18.674847188s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-09 17:33:16 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-09 17:33:40.596453951 +0000 UTC m=+24.696356602" watchObservedRunningTime="2026-06-09 17:33:40.596764331 +0000 UTC m=+24.696666982" Jun 09 17:33:40.720314 ip-10-0-143-124 kubenswrapper[2552]: I0609 17:33:40.720276 2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gctfs_8563ebab-ebdd-4d68-bce1-78d2a7f62992/konnectivity-agent/0.log" limit=1024 Jun 09 17:33:40.784057 ip-10-0-143-124 kubenswrapper[2552]: I0609 17:33:40.784022 2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gctfs_8563ebab-ebdd-4d68-bce1-78d2a7f62992/konnectivity-agent/0.log" limit=1024 Jun 09 17:33:41.586561 ip-10-0-143-124 kubenswrapper[2552]: I0609 17:33:41.586519 2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-9gqc8" event={"ID":"8285b34c-bc55-44a2-b6c5-e2c2e4c6a660","Type":"ContainerStarted","Data":"99fc23ad29691424f52d61dd823fad14f88e7cd3fce46f0f852c4bd8f47a7be0"} Jun 09 17:33:41.604394 ip-10-0-143-124 kubenswrapper[2552]: I0609 17:33:41.604342 2552 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-9gqc8" podStartSLOduration=4.927341623 podStartE2EDuration="25.604327511s" totalImagesPullingTime="20.676985888s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-09 17:33:16 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-09 17:33:41.603679524 +0000 UTC m=+25.703582176" watchObservedRunningTime="2026-06-09 17:33:41.604327511 +0000 UTC m=+25.704230161" Jun 09 17:33:42.331864 ip-10-0-143-124 kubenswrapper[2552]: I0609 17:33:42.331677 2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-pvmnc" Jun 09 17:33:42.332047 ip-10-0-143-124 kubenswrapper[2552]: I0609 17:33:42.331677 2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-mpmvr" Jun 09 17:33:42.332047 ip-10-0-143-124 kubenswrapper[2552]: E0609 17:33:42.331971 2552 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-pvmnc" podUID="b817ed32-ca44-43a6-99cf-8cf86ffd8c05" Jun 09 17:33:42.332047 ip-10-0-143-124 kubenswrapper[2552]: I0609 17:33:42.331677 2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-lt4n9" Jun 09 17:33:42.332199 ip-10-0-143-124 kubenswrapper[2552]: E0609 17:33:42.332055 2552 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-mpmvr" podUID="7755d1ba-506c-4a2d-829f-57beb748954e" Jun 09 17:33:42.332199 ip-10-0-143-124 kubenswrapper[2552]: E0609 17:33:42.332144 2552 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-lt4n9" podUID="a71cd181-3d23-4c4b-ac2f-e212dd9b5193" Jun 09 17:33:42.344745 ip-10-0-143-124 kubenswrapper[2552]: I0609 17:33:42.344724 2552 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="kube-system/konnectivity-agent-gctfs" Jun 09 17:33:42.345419 ip-10-0-143-124 kubenswrapper[2552]: I0609 17:33:42.345400 2552 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="kube-system/konnectivity-agent-gctfs" Jun 09 17:33:42.588622 ip-10-0-143-124 kubenswrapper[2552]: I0609 17:33:42.588551 2552 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kube-system/konnectivity-agent-gctfs" Jun 09 17:33:42.588914 ip-10-0-143-124 kubenswrapper[2552]: I0609 17:33:42.588804 2552 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kube-system/konnectivity-agent-gctfs" Jun 09 17:33:42.645578 ip-10-0-143-124 kubenswrapper[2552]: I0609 17:33:42.645545 2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gctfs_8563ebab-ebdd-4d68-bce1-78d2a7f62992/konnectivity-agent/0.log" limit=1024 Jun 09 17:33:43.592964 ip-10-0-143-124 kubenswrapper[2552]: I0609 17:33:43.592937 2552 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-kwh69_9aa08551-03ce-4c12-96d9-d6ca9bb43bf7/ovn-acl-logging/0.log" Jun 09 17:33:43.593400 ip-10-0-143-124 kubenswrapper[2552]: I0609 17:33:43.593262 2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-kwh69" event={"ID":"9aa08551-03ce-4c12-96d9-d6ca9bb43bf7","Type":"ContainerStarted","Data":"c91d762c07f4bc75c745f1417f3b63448a3c491e6f2501063dbb2472d46b9e88"} Jun 09 17:33:43.594703 ip-10-0-143-124 kubenswrapper[2552]: I0609 17:33:43.594678 2552 generic.go:356] "Generic (PLEG): container finished" podID="57526948-94e0-40fd-b0bf-ada9cf355743" containerID="a882886c4749c320227e6b3df1f71938ac5a8d9c507403c1be35c7bf0ae51c92" exitCode=0 Jun 09 17:33:43.594813 ip-10-0-143-124 kubenswrapper[2552]: I0609 17:33:43.594769 2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-s8d9p" event={"ID":"57526948-94e0-40fd-b0bf-ada9cf355743","Type":"ContainerDied","Data":"a882886c4749c320227e6b3df1f71938ac5a8d9c507403c1be35c7bf0ae51c92"} Jun 09 17:33:44.334660 ip-10-0-143-124 kubenswrapper[2552]: I0609 17:33:44.334632 2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-pvmnc" Jun 09 17:33:44.334832 ip-10-0-143-124 kubenswrapper[2552]: E0609 17:33:44.334742 2552 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-pvmnc" podUID="b817ed32-ca44-43a6-99cf-8cf86ffd8c05" Jun 09 17:33:44.334832 ip-10-0-143-124 kubenswrapper[2552]: I0609 17:33:44.334776 2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-mpmvr" Jun 09 17:33:44.334941 ip-10-0-143-124 kubenswrapper[2552]: E0609 17:33:44.334851 2552 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-mpmvr" podUID="7755d1ba-506c-4a2d-829f-57beb748954e" Jun 09 17:33:44.334941 ip-10-0-143-124 kubenswrapper[2552]: I0609 17:33:44.334889 2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-lt4n9" Jun 09 17:33:44.335023 ip-10-0-143-124 kubenswrapper[2552]: E0609 17:33:44.334980 2552 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-lt4n9" podUID="a71cd181-3d23-4c4b-ac2f-e212dd9b5193" Jun 09 17:33:44.433809 ip-10-0-143-124 kubenswrapper[2552]: I0609 17:33:44.433777 2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gctfs_8563ebab-ebdd-4d68-bce1-78d2a7f62992/konnectivity-agent/0.log" limit=1024 Jun 09 17:33:44.487743 ip-10-0-143-124 kubenswrapper[2552]: I0609 17:33:44.487715 2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gctfs_8563ebab-ebdd-4d68-bce1-78d2a7f62992/konnectivity-agent/0.log" limit=1024 Jun 09 17:33:45.602834 ip-10-0-143-124 kubenswrapper[2552]: I0609 17:33:45.602664 2552 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-kwh69_9aa08551-03ce-4c12-96d9-d6ca9bb43bf7/ovn-acl-logging/0.log" Jun 09 17:33:45.603588 ip-10-0-143-124 kubenswrapper[2552]: I0609 17:33:45.603193 2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-kwh69" event={"ID":"9aa08551-03ce-4c12-96d9-d6ca9bb43bf7","Type":"ContainerStarted","Data":"a15db6a1af20fa53a653508bcee1606fab9317b26aff0b4a8f4d3c515d664e3a"} Jun 09 17:33:45.603588 ip-10-0-143-124 kubenswrapper[2552]: I0609 17:33:45.603457 2552 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-kwh69" Jun 09 17:33:45.603588 ip-10-0-143-124 kubenswrapper[2552]: I0609 17:33:45.603524 2552 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-kwh69" Jun 09 17:33:45.603749 ip-10-0-143-124 kubenswrapper[2552]: I0609 17:33:45.603722 2552 scope.go:117] "RemoveContainer" containerID="cf3523531dd03ee0ad063ef8baebaa46993075e573b5da5381f3292e5d5fc7f4" Jun 09 17:33:45.605415 ip-10-0-143-124 kubenswrapper[2552]: I0609 17:33:45.605390 2552 generic.go:356] "Generic (PLEG): container finished" podID="57526948-94e0-40fd-b0bf-ada9cf355743" containerID="802b0b4000d19a736c5ee7c45ed951e40da47afcb4b81d8acea4c306ad5bbeff" exitCode=0 Jun 09 17:33:45.605537 ip-10-0-143-124 kubenswrapper[2552]: I0609 17:33:45.605422 2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-s8d9p" event={"ID":"57526948-94e0-40fd-b0bf-ada9cf355743","Type":"ContainerDied","Data":"802b0b4000d19a736c5ee7c45ed951e40da47afcb4b81d8acea4c306ad5bbeff"} Jun 09 17:33:45.620923 ip-10-0-143-124 kubenswrapper[2552]: I0609 17:33:45.620897 2552 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-kwh69" Jun 09 17:33:46.332857 ip-10-0-143-124 kubenswrapper[2552]: I0609 17:33:46.332822 2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-pvmnc" Jun 09 17:33:46.333012 ip-10-0-143-124 kubenswrapper[2552]: E0609 17:33:46.332914 2552 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-pvmnc" podUID="b817ed32-ca44-43a6-99cf-8cf86ffd8c05" Jun 09 17:33:46.333012 ip-10-0-143-124 kubenswrapper[2552]: I0609 17:33:46.332939 2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-mpmvr" Jun 09 17:33:46.333012 ip-10-0-143-124 kubenswrapper[2552]: I0609 17:33:46.332969 2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-lt4n9" Jun 09 17:33:46.333119 ip-10-0-143-124 kubenswrapper[2552]: E0609 17:33:46.333068 2552 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-mpmvr" podUID="7755d1ba-506c-4a2d-829f-57beb748954e" Jun 09 17:33:46.333174 ip-10-0-143-124 kubenswrapper[2552]: E0609 17:33:46.333153 2552 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-lt4n9" podUID="a71cd181-3d23-4c4b-ac2f-e212dd9b5193" Jun 09 17:33:46.611101 ip-10-0-143-124 kubenswrapper[2552]: I0609 17:33:46.611076 2552 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-kwh69_9aa08551-03ce-4c12-96d9-d6ca9bb43bf7/ovn-acl-logging/0.log" Jun 09 17:33:46.611454 ip-10-0-143-124 kubenswrapper[2552]: I0609 17:33:46.611428 2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-kwh69" event={"ID":"9aa08551-03ce-4c12-96d9-d6ca9bb43bf7","Type":"ContainerStarted","Data":"4db671922ecda56d884fd756ae829adc9e04e2644b66fdbd9bcbb20ba742160e"} Jun 09 17:33:46.611705 ip-10-0-143-124 kubenswrapper[2552]: I0609 17:33:46.611679 2552 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-kwh69" Jun 09 17:33:46.627055 ip-10-0-143-124 kubenswrapper[2552]: I0609 17:33:46.627032 2552 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-kwh69" Jun 09 17:33:46.638202 ip-10-0-143-124 kubenswrapper[2552]: I0609 17:33:46.638153 2552 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ovn-kubernetes/ovnkube-node-kwh69" podStartSLOduration=11.898908131 podStartE2EDuration="30.638138125s" totalImagesPullingTime="18.739229994s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-09 17:33:16 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-09 17:33:46.636635284 +0000 UTC m=+30.736537933" watchObservedRunningTime="2026-06-09 17:33:46.638138125 +0000 UTC m=+30.738040775" Jun 09 17:33:47.091798 ip-10-0-143-124 kubenswrapper[2552]: I0609 17:33:47.091758 2552 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-mpmvr"] Jun 09 17:33:47.091951 ip-10-0-143-124 kubenswrapper[2552]: I0609 17:33:47.091871 2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-mpmvr" Jun 09 17:33:47.091996 ip-10-0-143-124 kubenswrapper[2552]: E0609 17:33:47.091973 2552 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-mpmvr" podUID="7755d1ba-506c-4a2d-829f-57beb748954e" Jun 09 17:33:47.094387 ip-10-0-143-124 kubenswrapper[2552]: I0609 17:33:47.094357 2552 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-pvmnc"] Jun 09 17:33:47.094512 ip-10-0-143-124 kubenswrapper[2552]: I0609 17:33:47.094461 2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-pvmnc" Jun 09 17:33:47.094643 ip-10-0-143-124 kubenswrapper[2552]: E0609 17:33:47.094619 2552 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-pvmnc" podUID="b817ed32-ca44-43a6-99cf-8cf86ffd8c05" Jun 09 17:33:47.094992 ip-10-0-143-124 kubenswrapper[2552]: I0609 17:33:47.094971 2552 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-lt4n9"] Jun 09 17:33:47.095065 ip-10-0-143-124 kubenswrapper[2552]: I0609 17:33:47.095058 2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-lt4n9" Jun 09 17:33:47.095175 ip-10-0-143-124 kubenswrapper[2552]: E0609 17:33:47.095151 2552 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-lt4n9" podUID="a71cd181-3d23-4c4b-ac2f-e212dd9b5193" Jun 09 17:33:47.615933 ip-10-0-143-124 kubenswrapper[2552]: I0609 17:33:47.615901 2552 generic.go:356] "Generic (PLEG): container finished" podID="57526948-94e0-40fd-b0bf-ada9cf355743" containerID="6ca8635aaabe0dea9639f41c01fc460315fb7c8ef68e13707edd8a108afc2a98" exitCode=0 Jun 09 17:33:47.616287 ip-10-0-143-124 kubenswrapper[2552]: I0609 17:33:47.615970 2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-s8d9p" event={"ID":"57526948-94e0-40fd-b0bf-ada9cf355743","Type":"ContainerDied","Data":"6ca8635aaabe0dea9639f41c01fc460315fb7c8ef68e13707edd8a108afc2a98"} Jun 09 17:33:47.839187 ip-10-0-143-124 kubenswrapper[2552]: I0609 17:33:47.839109 2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gctfs_8563ebab-ebdd-4d68-bce1-78d2a7f62992/konnectivity-agent/0.log" limit=1024 Jun 09 17:33:47.890498 ip-10-0-143-124 kubenswrapper[2552]: I0609 17:33:47.890435 2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gctfs_8563ebab-ebdd-4d68-bce1-78d2a7f62992/konnectivity-agent/0.log" limit=1024 Jun 09 17:33:48.331578 ip-10-0-143-124 kubenswrapper[2552]: I0609 17:33:48.331545 2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-pvmnc" Jun 09 17:33:48.331784 ip-10-0-143-124 kubenswrapper[2552]: E0609 17:33:48.331686 2552 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-pvmnc" podUID="b817ed32-ca44-43a6-99cf-8cf86ffd8c05" Jun 09 17:33:48.732169 ip-10-0-143-124 kubenswrapper[2552]: I0609 17:33:48.732062 2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gctfs_8563ebab-ebdd-4d68-bce1-78d2a7f62992/konnectivity-agent/0.log" limit=1024 Jun 09 17:33:48.787227 ip-10-0-143-124 kubenswrapper[2552]: I0609 17:33:48.787192 2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gctfs_8563ebab-ebdd-4d68-bce1-78d2a7f62992/konnectivity-agent/0.log" limit=1024 Jun 09 17:33:49.331516 ip-10-0-143-124 kubenswrapper[2552]: I0609 17:33:49.331318 2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-lt4n9" Jun 09 17:33:49.331719 ip-10-0-143-124 kubenswrapper[2552]: I0609 17:33:49.331334 2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-mpmvr" Jun 09 17:33:49.331719 ip-10-0-143-124 kubenswrapper[2552]: E0609 17:33:49.331582 2552 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-lt4n9" podUID="a71cd181-3d23-4c4b-ac2f-e212dd9b5193" Jun 09 17:33:49.331719 ip-10-0-143-124 kubenswrapper[2552]: E0609 17:33:49.331692 2552 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-mpmvr" podUID="7755d1ba-506c-4a2d-829f-57beb748954e" Jun 09 17:33:50.032217 ip-10-0-143-124 kubenswrapper[2552]: I0609 17:33:50.032190 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/b817ed32-ca44-43a6-99cf-8cf86ffd8c05-metrics-certs\") pod \"network-metrics-daemon-pvmnc\" (UID: \"b817ed32-ca44-43a6-99cf-8cf86ffd8c05\") " pod="openshift-multus/network-metrics-daemon-pvmnc" Jun 09 17:33:50.032704 ip-10-0-143-124 kubenswrapper[2552]: I0609 17:33:50.032236 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/a71cd181-3d23-4c4b-ac2f-e212dd9b5193-original-pull-secret\") pod \"global-pull-secret-syncer-lt4n9\" (UID: \"a71cd181-3d23-4c4b-ac2f-e212dd9b5193\") " pod="kube-system/global-pull-secret-syncer-lt4n9" Jun 09 17:33:50.032704 ip-10-0-143-124 kubenswrapper[2552]: E0609 17:33:50.032336 2552 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jun 09 17:33:50.032704 ip-10-0-143-124 kubenswrapper[2552]: E0609 17:33:50.032389 2552 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a71cd181-3d23-4c4b-ac2f-e212dd9b5193-original-pull-secret podName:a71cd181-3d23-4c4b-ac2f-e212dd9b5193 nodeName:}" failed. No retries permitted until 2026-06-09 17:34:22.032375657 +0000 UTC m=+66.132278284 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/a71cd181-3d23-4c4b-ac2f-e212dd9b5193-original-pull-secret") pod "global-pull-secret-syncer-lt4n9" (UID: "a71cd181-3d23-4c4b-ac2f-e212dd9b5193") : object "kube-system"/"original-pull-secret" not registered Jun 09 17:33:50.032704 ip-10-0-143-124 kubenswrapper[2552]: E0609 17:33:50.032336 2552 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jun 09 17:33:50.032704 ip-10-0-143-124 kubenswrapper[2552]: E0609 17:33:50.032476 2552 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b817ed32-ca44-43a6-99cf-8cf86ffd8c05-metrics-certs podName:b817ed32-ca44-43a6-99cf-8cf86ffd8c05 nodeName:}" failed. No retries permitted until 2026-06-09 17:34:22.032461839 +0000 UTC m=+66.132364470 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/b817ed32-ca44-43a6-99cf-8cf86ffd8c05-metrics-certs") pod "network-metrics-daemon-pvmnc" (UID: "b817ed32-ca44-43a6-99cf-8cf86ffd8c05") : object "openshift-multus"/"metrics-daemon-secret" not registered Jun 09 17:33:50.133195 ip-10-0-143-124 kubenswrapper[2552]: I0609 17:33:50.133166 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vvzhh\" (UniqueName: \"kubernetes.io/projected/7755d1ba-506c-4a2d-829f-57beb748954e-kube-api-access-vvzhh\") pod \"network-check-target-mpmvr\" (UID: \"7755d1ba-506c-4a2d-829f-57beb748954e\") " pod="openshift-network-diagnostics/network-check-target-mpmvr" Jun 09 17:33:50.133374 ip-10-0-143-124 kubenswrapper[2552]: E0609 17:33:50.133282 2552 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jun 09 17:33:50.133374 ip-10-0-143-124 kubenswrapper[2552]: E0609 17:33:50.133300 2552 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jun 09 17:33:50.133374 ip-10-0-143-124 kubenswrapper[2552]: E0609 17:33:50.133313 2552 projected.go:196] Error preparing data for projected volume kube-api-access-vvzhh for pod openshift-network-diagnostics/network-check-target-mpmvr: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 09 17:33:50.133374 ip-10-0-143-124 kubenswrapper[2552]: E0609 17:33:50.133364 2552 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/7755d1ba-506c-4a2d-829f-57beb748954e-kube-api-access-vvzhh podName:7755d1ba-506c-4a2d-829f-57beb748954e nodeName:}" failed. No retries permitted until 2026-06-09 17:34:22.133351317 +0000 UTC m=+66.233253946 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "kube-api-access-vvzhh" (UniqueName: "kubernetes.io/projected/7755d1ba-506c-4a2d-829f-57beb748954e-kube-api-access-vvzhh") pod "network-check-target-mpmvr" (UID: "7755d1ba-506c-4a2d-829f-57beb748954e") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 09 17:33:50.335459 ip-10-0-143-124 kubenswrapper[2552]: I0609 17:33:50.335389 2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-pvmnc" Jun 09 17:33:50.335638 ip-10-0-143-124 kubenswrapper[2552]: E0609 17:33:50.335529 2552 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-pvmnc" podUID="b817ed32-ca44-43a6-99cf-8cf86ffd8c05" Jun 09 17:33:51.232945 ip-10-0-143-124 kubenswrapper[2552]: I0609 17:33:51.232860 2552 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-143-124.ec2.internal" event="NodeReady" Jun 09 17:33:51.233408 ip-10-0-143-124 kubenswrapper[2552]: I0609 17:33:51.233013 2552 kubelet_node_status.go:489] "Fast updating node status as it just became ready" Jun 09 17:33:51.275343 ip-10-0-143-124 kubenswrapper[2552]: I0609 17:33:51.275307 2552 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-dns/dns-default-bmg8n"] Jun 09 17:33:51.298889 ip-10-0-143-124 kubenswrapper[2552]: I0609 17:33:51.298865 2552 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress-canary/ingress-canary-w8w2r"] Jun 09 17:33:51.299050 ip-10-0-143-124 kubenswrapper[2552]: I0609 17:33:51.299003 2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-bmg8n" Jun 09 17:33:51.301361 ip-10-0-143-124 kubenswrapper[2552]: I0609 17:33:51.301251 2552 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-default-metrics-tls\"" Jun 09 17:33:51.301361 ip-10-0-143-124 kubenswrapper[2552]: I0609 17:33:51.301305 2552 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"dns-default\"" Jun 09 17:33:51.301536 ip-10-0-143-124 kubenswrapper[2552]: I0609 17:33:51.301437 2552 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-qt7rj\"" Jun 09 17:33:51.312796 ip-10-0-143-124 kubenswrapper[2552]: I0609 17:33:51.312773 2552 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-bmg8n"] Jun 09 17:33:51.312975 ip-10-0-143-124 kubenswrapper[2552]: I0609 17:33:51.312820 2552 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-w8w2r"] Jun 09 17:33:51.312975 ip-10-0-143-124 kubenswrapper[2552]: I0609 17:33:51.312900 2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-w8w2r" Jun 09 17:33:51.315273 ip-10-0-143-124 kubenswrapper[2552]: I0609 17:33:51.315250 2552 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"openshift-service-ca.crt\"" Jun 09 17:33:51.315691 ip-10-0-143-124 kubenswrapper[2552]: I0609 17:33:51.315622 2552 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"kube-root-ca.crt\"" Jun 09 17:33:51.315811 ip-10-0-143-124 kubenswrapper[2552]: I0609 17:33:51.315730 2552 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"canary-serving-cert\"" Jun 09 17:33:51.315811 ip-10-0-143-124 kubenswrapper[2552]: I0609 17:33:51.315732 2552 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"default-dockercfg-nfdgv\"" Jun 09 17:33:51.331560 ip-10-0-143-124 kubenswrapper[2552]: I0609 17:33:51.331537 2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-mpmvr" Jun 09 17:33:51.331699 ip-10-0-143-124 kubenswrapper[2552]: I0609 17:33:51.331539 2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-lt4n9" Jun 09 17:33:51.335071 ip-10-0-143-124 kubenswrapper[2552]: I0609 17:33:51.335051 2552 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\"" Jun 09 17:33:51.335178 ip-10-0-143-124 kubenswrapper[2552]: I0609 17:33:51.335135 2552 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\"" Jun 09 17:33:51.335178 ip-10-0-143-124 kubenswrapper[2552]: I0609 17:33:51.335141 2552 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\"" Jun 09 17:33:51.339648 ip-10-0-143-124 kubenswrapper[2552]: I0609 17:33:51.339492 2552 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-bw759\"" Jun 09 17:33:51.416043 ip-10-0-143-124 kubenswrapper[2552]: I0609 17:33:51.416006 2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gctfs_8563ebab-ebdd-4d68-bce1-78d2a7f62992/konnectivity-agent/0.log" limit=1024 Jun 09 17:33:51.444741 ip-10-0-143-124 kubenswrapper[2552]: I0609 17:33:51.444712 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-fmxqz\" (UniqueName: \"kubernetes.io/projected/3ed6274b-3981-436a-99bb-77b505c76d3d-kube-api-access-fmxqz\") pod \"dns-default-bmg8n\" (UID: \"3ed6274b-3981-436a-99bb-77b505c76d3d\") " pod="openshift-dns/dns-default-bmg8n" Jun 09 17:33:51.444935 ip-10-0-143-124 kubenswrapper[2552]: I0609 17:33:51.444749 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/389f25e7-e5ca-48dc-884b-a5046ab1dc6b-cert\") pod \"ingress-canary-w8w2r\" (UID: \"389f25e7-e5ca-48dc-884b-a5046ab1dc6b\") " pod="openshift-ingress-canary/ingress-canary-w8w2r" Jun 09 17:33:51.444935 ip-10-0-143-124 kubenswrapper[2552]: I0609 17:33:51.444832 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xv4g7\" (UniqueName: \"kubernetes.io/projected/389f25e7-e5ca-48dc-884b-a5046ab1dc6b-kube-api-access-xv4g7\") pod \"ingress-canary-w8w2r\" (UID: \"389f25e7-e5ca-48dc-884b-a5046ab1dc6b\") " pod="openshift-ingress-canary/ingress-canary-w8w2r" Jun 09 17:33:51.444935 ip-10-0-143-124 kubenswrapper[2552]: I0609 17:33:51.444856 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/3ed6274b-3981-436a-99bb-77b505c76d3d-metrics-tls\") pod \"dns-default-bmg8n\" (UID: \"3ed6274b-3981-436a-99bb-77b505c76d3d\") " pod="openshift-dns/dns-default-bmg8n" Jun 09 17:33:51.444935 ip-10-0-143-124 kubenswrapper[2552]: I0609 17:33:51.444873 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/3ed6274b-3981-436a-99bb-77b505c76d3d-config-volume\") pod \"dns-default-bmg8n\" (UID: \"3ed6274b-3981-436a-99bb-77b505c76d3d\") " pod="openshift-dns/dns-default-bmg8n" Jun 09 17:33:51.444935 ip-10-0-143-124 kubenswrapper[2552]: I0609 17:33:51.444914 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/3ed6274b-3981-436a-99bb-77b505c76d3d-tmp-dir\") pod \"dns-default-bmg8n\" (UID: \"3ed6274b-3981-436a-99bb-77b505c76d3d\") " pod="openshift-dns/dns-default-bmg8n" Jun 09 17:33:51.467793 ip-10-0-143-124 kubenswrapper[2552]: I0609 17:33:51.467752 2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gctfs_8563ebab-ebdd-4d68-bce1-78d2a7f62992/konnectivity-agent/0.log" limit=1024 Jun 09 17:33:51.545805 ip-10-0-143-124 kubenswrapper[2552]: I0609 17:33:51.545767 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-fmxqz\" (UniqueName: \"kubernetes.io/projected/3ed6274b-3981-436a-99bb-77b505c76d3d-kube-api-access-fmxqz\") pod \"dns-default-bmg8n\" (UID: \"3ed6274b-3981-436a-99bb-77b505c76d3d\") " pod="openshift-dns/dns-default-bmg8n" Jun 09 17:33:51.545805 ip-10-0-143-124 kubenswrapper[2552]: I0609 17:33:51.545823 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/389f25e7-e5ca-48dc-884b-a5046ab1dc6b-cert\") pod \"ingress-canary-w8w2r\" (UID: \"389f25e7-e5ca-48dc-884b-a5046ab1dc6b\") " pod="openshift-ingress-canary/ingress-canary-w8w2r" Jun 09 17:33:51.546051 ip-10-0-143-124 kubenswrapper[2552]: I0609 17:33:51.545882 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xv4g7\" (UniqueName: \"kubernetes.io/projected/389f25e7-e5ca-48dc-884b-a5046ab1dc6b-kube-api-access-xv4g7\") pod \"ingress-canary-w8w2r\" (UID: \"389f25e7-e5ca-48dc-884b-a5046ab1dc6b\") " pod="openshift-ingress-canary/ingress-canary-w8w2r" Jun 09 17:33:51.546051 ip-10-0-143-124 kubenswrapper[2552]: I0609 17:33:51.545905 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/3ed6274b-3981-436a-99bb-77b505c76d3d-metrics-tls\") pod \"dns-default-bmg8n\" (UID: \"3ed6274b-3981-436a-99bb-77b505c76d3d\") " pod="openshift-dns/dns-default-bmg8n" Jun 09 17:33:51.546051 ip-10-0-143-124 kubenswrapper[2552]: I0609 17:33:51.545930 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/3ed6274b-3981-436a-99bb-77b505c76d3d-config-volume\") pod \"dns-default-bmg8n\" (UID: \"3ed6274b-3981-436a-99bb-77b505c76d3d\") " pod="openshift-dns/dns-default-bmg8n" Jun 09 17:33:51.546051 ip-10-0-143-124 kubenswrapper[2552]: I0609 17:33:51.545986 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/3ed6274b-3981-436a-99bb-77b505c76d3d-tmp-dir\") pod \"dns-default-bmg8n\" (UID: \"3ed6274b-3981-436a-99bb-77b505c76d3d\") " pod="openshift-dns/dns-default-bmg8n" Jun 09 17:33:51.546051 ip-10-0-143-124 kubenswrapper[2552]: E0609 17:33:51.546021 2552 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jun 09 17:33:51.546294 ip-10-0-143-124 kubenswrapper[2552]: E0609 17:33:51.546080 2552 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/3ed6274b-3981-436a-99bb-77b505c76d3d-metrics-tls podName:3ed6274b-3981-436a-99bb-77b505c76d3d nodeName:}" failed. No retries permitted until 2026-06-09 17:33:52.046061691 +0000 UTC m=+36.145964336 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/3ed6274b-3981-436a-99bb-77b505c76d3d-metrics-tls") pod "dns-default-bmg8n" (UID: "3ed6274b-3981-436a-99bb-77b505c76d3d") : secret "dns-default-metrics-tls" not found Jun 09 17:33:51.546434 ip-10-0-143-124 kubenswrapper[2552]: I0609 17:33:51.546416 2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/3ed6274b-3981-436a-99bb-77b505c76d3d-tmp-dir\") pod \"dns-default-bmg8n\" (UID: \"3ed6274b-3981-436a-99bb-77b505c76d3d\") " pod="openshift-dns/dns-default-bmg8n" Jun 09 17:33:51.546738 ip-10-0-143-124 kubenswrapper[2552]: I0609 17:33:51.546712 2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/3ed6274b-3981-436a-99bb-77b505c76d3d-config-volume\") pod \"dns-default-bmg8n\" (UID: \"3ed6274b-3981-436a-99bb-77b505c76d3d\") " pod="openshift-dns/dns-default-bmg8n" Jun 09 17:33:51.550720 ip-10-0-143-124 kubenswrapper[2552]: I0609 17:33:51.550698 2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/389f25e7-e5ca-48dc-884b-a5046ab1dc6b-cert\") pod \"ingress-canary-w8w2r\" (UID: \"389f25e7-e5ca-48dc-884b-a5046ab1dc6b\") " pod="openshift-ingress-canary/ingress-canary-w8w2r" Jun 09 17:33:51.554346 ip-10-0-143-124 kubenswrapper[2552]: I0609 17:33:51.554323 2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-fmxqz\" (UniqueName: \"kubernetes.io/projected/3ed6274b-3981-436a-99bb-77b505c76d3d-kube-api-access-fmxqz\") pod \"dns-default-bmg8n\" (UID: \"3ed6274b-3981-436a-99bb-77b505c76d3d\") " pod="openshift-dns/dns-default-bmg8n" Jun 09 17:33:51.554766 ip-10-0-143-124 kubenswrapper[2552]: I0609 17:33:51.554741 2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-xv4g7\" (UniqueName: \"kubernetes.io/projected/389f25e7-e5ca-48dc-884b-a5046ab1dc6b-kube-api-access-xv4g7\") pod \"ingress-canary-w8w2r\" (UID: \"389f25e7-e5ca-48dc-884b-a5046ab1dc6b\") " pod="openshift-ingress-canary/ingress-canary-w8w2r" Jun 09 17:33:51.623689 ip-10-0-143-124 kubenswrapper[2552]: I0609 17:33:51.623652 2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-w8w2r" Jun 09 17:33:52.050849 ip-10-0-143-124 kubenswrapper[2552]: I0609 17:33:52.050815 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/3ed6274b-3981-436a-99bb-77b505c76d3d-metrics-tls\") pod \"dns-default-bmg8n\" (UID: \"3ed6274b-3981-436a-99bb-77b505c76d3d\") " pod="openshift-dns/dns-default-bmg8n" Jun 09 17:33:52.051035 ip-10-0-143-124 kubenswrapper[2552]: E0609 17:33:52.050995 2552 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jun 09 17:33:52.051095 ip-10-0-143-124 kubenswrapper[2552]: E0609 17:33:52.051077 2552 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/3ed6274b-3981-436a-99bb-77b505c76d3d-metrics-tls podName:3ed6274b-3981-436a-99bb-77b505c76d3d nodeName:}" failed. No retries permitted until 2026-06-09 17:33:53.051055882 +0000 UTC m=+37.150958526 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/3ed6274b-3981-436a-99bb-77b505c76d3d-metrics-tls") pod "dns-default-bmg8n" (UID: "3ed6274b-3981-436a-99bb-77b505c76d3d") : secret "dns-default-metrics-tls" not found Jun 09 17:33:52.335903 ip-10-0-143-124 kubenswrapper[2552]: I0609 17:33:52.335827 2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-pvmnc" Jun 09 17:33:52.338669 ip-10-0-143-124 kubenswrapper[2552]: I0609 17:33:52.338646 2552 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\"" Jun 09 17:33:52.338783 ip-10-0-143-124 kubenswrapper[2552]: I0609 17:33:52.338667 2552 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-w8x52\"" Jun 09 17:33:52.753795 ip-10-0-143-124 kubenswrapper[2552]: I0609 17:33:52.753773 2552 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-w8w2r"] Jun 09 17:33:52.757157 ip-10-0-143-124 kubenswrapper[2552]: W0609 17:33:52.757122 2552 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod389f25e7_e5ca_48dc_884b_a5046ab1dc6b.slice/crio-098023b6a3db6a7776dbd019d7a3987609d3547e65f9935ab72f1940ab81f7d2 WatchSource:0}: Error finding container 098023b6a3db6a7776dbd019d7a3987609d3547e65f9935ab72f1940ab81f7d2: Status 404 returned error can't find the container with id 098023b6a3db6a7776dbd019d7a3987609d3547e65f9935ab72f1940ab81f7d2 Jun 09 17:33:53.058532 ip-10-0-143-124 kubenswrapper[2552]: I0609 17:33:53.058505 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/3ed6274b-3981-436a-99bb-77b505c76d3d-metrics-tls\") pod \"dns-default-bmg8n\" (UID: \"3ed6274b-3981-436a-99bb-77b505c76d3d\") " pod="openshift-dns/dns-default-bmg8n" Jun 09 17:33:53.058716 ip-10-0-143-124 kubenswrapper[2552]: E0609 17:33:53.058630 2552 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jun 09 17:33:53.058716 ip-10-0-143-124 kubenswrapper[2552]: E0609 17:33:53.058684 2552 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/3ed6274b-3981-436a-99bb-77b505c76d3d-metrics-tls podName:3ed6274b-3981-436a-99bb-77b505c76d3d nodeName:}" failed. No retries permitted until 2026-06-09 17:33:55.05867011 +0000 UTC m=+39.158572738 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/3ed6274b-3981-436a-99bb-77b505c76d3d-metrics-tls") pod "dns-default-bmg8n" (UID: "3ed6274b-3981-436a-99bb-77b505c76d3d") : secret "dns-default-metrics-tls" not found Jun 09 17:33:53.635202 ip-10-0-143-124 kubenswrapper[2552]: I0609 17:33:53.634753 2552 generic.go:356] "Generic (PLEG): container finished" podID="57526948-94e0-40fd-b0bf-ada9cf355743" containerID="64f59ed1da2e34bd74f20a0b6f2e277ef809d3a92d76b995d17a4373dfc9b7e7" exitCode=0 Jun 09 17:33:53.635202 ip-10-0-143-124 kubenswrapper[2552]: I0609 17:33:53.634893 2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-s8d9p" event={"ID":"57526948-94e0-40fd-b0bf-ada9cf355743","Type":"ContainerDied","Data":"64f59ed1da2e34bd74f20a0b6f2e277ef809d3a92d76b995d17a4373dfc9b7e7"} Jun 09 17:33:53.638896 ip-10-0-143-124 kubenswrapper[2552]: I0609 17:33:53.638869 2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-w8w2r" event={"ID":"389f25e7-e5ca-48dc-884b-a5046ab1dc6b","Type":"ContainerStarted","Data":"098023b6a3db6a7776dbd019d7a3987609d3547e65f9935ab72f1940ab81f7d2"} Jun 09 17:33:54.645483 ip-10-0-143-124 kubenswrapper[2552]: I0609 17:33:54.645448 2552 generic.go:356] "Generic (PLEG): container finished" podID="57526948-94e0-40fd-b0bf-ada9cf355743" containerID="ef9fabdf9c1ed0a2b6f6ae6593f6bc00d7d71523ba03031575a7139cd94d98d7" exitCode=0 Jun 09 17:33:54.645976 ip-10-0-143-124 kubenswrapper[2552]: I0609 17:33:54.645510 2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-s8d9p" event={"ID":"57526948-94e0-40fd-b0bf-ada9cf355743","Type":"ContainerDied","Data":"ef9fabdf9c1ed0a2b6f6ae6593f6bc00d7d71523ba03031575a7139cd94d98d7"} Jun 09 17:33:55.074715 ip-10-0-143-124 kubenswrapper[2552]: I0609 17:33:55.074679 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/3ed6274b-3981-436a-99bb-77b505c76d3d-metrics-tls\") pod \"dns-default-bmg8n\" (UID: \"3ed6274b-3981-436a-99bb-77b505c76d3d\") " pod="openshift-dns/dns-default-bmg8n" Jun 09 17:33:55.074879 ip-10-0-143-124 kubenswrapper[2552]: E0609 17:33:55.074803 2552 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jun 09 17:33:55.074879 ip-10-0-143-124 kubenswrapper[2552]: E0609 17:33:55.074853 2552 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/3ed6274b-3981-436a-99bb-77b505c76d3d-metrics-tls podName:3ed6274b-3981-436a-99bb-77b505c76d3d nodeName:}" failed. No retries permitted until 2026-06-09 17:33:59.074840281 +0000 UTC m=+43.174742909 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/3ed6274b-3981-436a-99bb-77b505c76d3d-metrics-tls") pod "dns-default-bmg8n" (UID: "3ed6274b-3981-436a-99bb-77b505c76d3d") : secret "dns-default-metrics-tls" not found Jun 09 17:33:55.651038 ip-10-0-143-124 kubenswrapper[2552]: I0609 17:33:55.650997 2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-s8d9p" event={"ID":"57526948-94e0-40fd-b0bf-ada9cf355743","Type":"ContainerStarted","Data":"ebcf07d779e34fa69254f560bb563d63260e36886a3232cfc3345d73f83c70b6"} Jun 09 17:33:55.652343 ip-10-0-143-124 kubenswrapper[2552]: I0609 17:33:55.652321 2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-w8w2r" event={"ID":"389f25e7-e5ca-48dc-884b-a5046ab1dc6b","Type":"ContainerStarted","Data":"9dba72670470890d929c515190806c83818af04803b31e41983cf036878d581e"} Jun 09 17:33:55.673336 ip-10-0-143-124 kubenswrapper[2552]: I0609 17:33:55.673288 2552 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-additional-cni-plugins-s8d9p" podStartSLOduration=9.548078046 podStartE2EDuration="39.673275486s" totalImagesPullingTime="30.12519744s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-09 17:33:16 +0000 UTC" imagePullSessionsCount=5 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-09 17:33:55.671863119 +0000 UTC m=+39.771765768" watchObservedRunningTime="2026-06-09 17:33:55.673275486 +0000 UTC m=+39.773178135" Jun 09 17:33:55.688569 ip-10-0-143-124 kubenswrapper[2552]: I0609 17:33:55.688524 2552 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress-canary/ingress-canary-w8w2r" podStartSLOduration=2.692518154 podStartE2EDuration="4.688507686s" totalImagesPullingTime="1.995989532s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-09 17:33:51 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-09 17:33:55.688255714 +0000 UTC m=+39.788158364" watchObservedRunningTime="2026-06-09 17:33:55.688507686 +0000 UTC m=+39.788410337" Jun 09 17:33:55.801877 ip-10-0-143-124 kubenswrapper[2552]: I0609 17:33:55.801841 2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gctfs_8563ebab-ebdd-4d68-bce1-78d2a7f62992/konnectivity-agent/0.log" limit=1024 Jun 09 17:33:55.903485 ip-10-0-143-124 kubenswrapper[2552]: I0609 17:33:55.903388 2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gctfs_8563ebab-ebdd-4d68-bce1-78d2a7f62992/konnectivity-agent/0.log" limit=1024 Jun 09 17:33:55.962786 ip-10-0-143-124 kubenswrapper[2552]: I0609 17:33:55.962757 2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gctfs_8563ebab-ebdd-4d68-bce1-78d2a7f62992/konnectivity-agent/0.log" limit=1024 Jun 09 17:33:56.017879 ip-10-0-143-124 kubenswrapper[2552]: I0609 17:33:56.017848 2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gctfs_8563ebab-ebdd-4d68-bce1-78d2a7f62992/konnectivity-agent/0.log" limit=1024 Jun 09 17:33:59.105657 ip-10-0-143-124 kubenswrapper[2552]: I0609 17:33:59.105583 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/3ed6274b-3981-436a-99bb-77b505c76d3d-metrics-tls\") pod \"dns-default-bmg8n\" (UID: \"3ed6274b-3981-436a-99bb-77b505c76d3d\") " pod="openshift-dns/dns-default-bmg8n" Jun 09 17:33:59.106069 ip-10-0-143-124 kubenswrapper[2552]: E0609 17:33:59.105740 2552 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jun 09 17:33:59.106069 ip-10-0-143-124 kubenswrapper[2552]: E0609 17:33:59.105812 2552 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/3ed6274b-3981-436a-99bb-77b505c76d3d-metrics-tls podName:3ed6274b-3981-436a-99bb-77b505c76d3d nodeName:}" failed. No retries permitted until 2026-06-09 17:34:07.105794384 +0000 UTC m=+51.205697012 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/3ed6274b-3981-436a-99bb-77b505c76d3d-metrics-tls") pod "dns-default-bmg8n" (UID: "3ed6274b-3981-436a-99bb-77b505c76d3d") : secret "dns-default-metrics-tls" not found Jun 09 17:34:07.160149 ip-10-0-143-124 kubenswrapper[2552]: I0609 17:34:07.160111 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/3ed6274b-3981-436a-99bb-77b505c76d3d-metrics-tls\") pod \"dns-default-bmg8n\" (UID: \"3ed6274b-3981-436a-99bb-77b505c76d3d\") " pod="openshift-dns/dns-default-bmg8n" Jun 09 17:34:07.160832 ip-10-0-143-124 kubenswrapper[2552]: E0609 17:34:07.160285 2552 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jun 09 17:34:07.160832 ip-10-0-143-124 kubenswrapper[2552]: E0609 17:34:07.160372 2552 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/3ed6274b-3981-436a-99bb-77b505c76d3d-metrics-tls podName:3ed6274b-3981-436a-99bb-77b505c76d3d nodeName:}" failed. No retries permitted until 2026-06-09 17:34:23.16034826 +0000 UTC m=+67.260250905 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/3ed6274b-3981-436a-99bb-77b505c76d3d-metrics-tls") pod "dns-default-bmg8n" (UID: "3ed6274b-3981-436a-99bb-77b505c76d3d") : secret "dns-default-metrics-tls" not found Jun 09 17:34:08.703834 ip-10-0-143-124 kubenswrapper[2552]: I0609 17:34:08.703796 2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gctfs_8563ebab-ebdd-4d68-bce1-78d2a7f62992/konnectivity-agent/0.log" limit=1024 Jun 09 17:34:08.763631 ip-10-0-143-124 kubenswrapper[2552]: I0609 17:34:08.763577 2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gctfs_8563ebab-ebdd-4d68-bce1-78d2a7f62992/konnectivity-agent/0.log" limit=1024 Jun 09 17:34:12.539613 ip-10-0-143-124 kubenswrapper[2552]: I0609 17:34:12.539566 2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gctfs_8563ebab-ebdd-4d68-bce1-78d2a7f62992/konnectivity-agent/0.log" limit=1024 Jun 09 17:34:12.640547 ip-10-0-143-124 kubenswrapper[2552]: I0609 17:34:12.640502 2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gctfs_8563ebab-ebdd-4d68-bce1-78d2a7f62992/konnectivity-agent/0.log" limit=1024 Jun 09 17:34:18.629489 ip-10-0-143-124 kubenswrapper[2552]: I0609 17:34:18.629464 2552 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-kwh69" Jun 09 17:34:18.781838 ip-10-0-143-124 kubenswrapper[2552]: I0609 17:34:18.781801 2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gctfs_8563ebab-ebdd-4d68-bce1-78d2a7f62992/konnectivity-agent/0.log" limit=1024 Jun 09 17:34:18.847340 ip-10-0-143-124 kubenswrapper[2552]: I0609 17:34:18.847315 2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gctfs_8563ebab-ebdd-4d68-bce1-78d2a7f62992/konnectivity-agent/0.log" limit=1024 Jun 09 17:34:18.906786 ip-10-0-143-124 kubenswrapper[2552]: I0609 17:34:18.906711 2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gctfs_8563ebab-ebdd-4d68-bce1-78d2a7f62992/konnectivity-agent/0.log" limit=1024 Jun 09 17:34:22.057214 ip-10-0-143-124 kubenswrapper[2552]: I0609 17:34:22.057165 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/b817ed32-ca44-43a6-99cf-8cf86ffd8c05-metrics-certs\") pod \"network-metrics-daemon-pvmnc\" (UID: \"b817ed32-ca44-43a6-99cf-8cf86ffd8c05\") " pod="openshift-multus/network-metrics-daemon-pvmnc" Jun 09 17:34:22.057588 ip-10-0-143-124 kubenswrapper[2552]: I0609 17:34:22.057233 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/a71cd181-3d23-4c4b-ac2f-e212dd9b5193-original-pull-secret\") pod \"global-pull-secret-syncer-lt4n9\" (UID: \"a71cd181-3d23-4c4b-ac2f-e212dd9b5193\") " pod="kube-system/global-pull-secret-syncer-lt4n9" Jun 09 17:34:22.059871 ip-10-0-143-124 kubenswrapper[2552]: I0609 17:34:22.059848 2552 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\"" Jun 09 17:34:22.059913 ip-10-0-143-124 kubenswrapper[2552]: I0609 17:34:22.059848 2552 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\"" Jun 09 17:34:22.067968 ip-10-0-143-124 kubenswrapper[2552]: E0609 17:34:22.067951 2552 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: secret "metrics-daemon-secret" not found Jun 09 17:34:22.068012 ip-10-0-143-124 kubenswrapper[2552]: E0609 17:34:22.068008 2552 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b817ed32-ca44-43a6-99cf-8cf86ffd8c05-metrics-certs podName:b817ed32-ca44-43a6-99cf-8cf86ffd8c05 nodeName:}" failed. No retries permitted until 2026-06-09 17:35:26.06799373 +0000 UTC m=+130.167896360 (durationBeforeRetry 1m4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/b817ed32-ca44-43a6-99cf-8cf86ffd8c05-metrics-certs") pod "network-metrics-daemon-pvmnc" (UID: "b817ed32-ca44-43a6-99cf-8cf86ffd8c05") : secret "metrics-daemon-secret" not found Jun 09 17:34:22.071578 ip-10-0-143-124 kubenswrapper[2552]: I0609 17:34:22.071556 2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/a71cd181-3d23-4c4b-ac2f-e212dd9b5193-original-pull-secret\") pod \"global-pull-secret-syncer-lt4n9\" (UID: \"a71cd181-3d23-4c4b-ac2f-e212dd9b5193\") " pod="kube-system/global-pull-secret-syncer-lt4n9" Jun 09 17:34:22.158481 ip-10-0-143-124 kubenswrapper[2552]: I0609 17:34:22.158437 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vvzhh\" (UniqueName: \"kubernetes.io/projected/7755d1ba-506c-4a2d-829f-57beb748954e-kube-api-access-vvzhh\") pod \"network-check-target-mpmvr\" (UID: \"7755d1ba-506c-4a2d-829f-57beb748954e\") " pod="openshift-network-diagnostics/network-check-target-mpmvr" Jun 09 17:34:22.161050 ip-10-0-143-124 kubenswrapper[2552]: I0609 17:34:22.161036 2552 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\"" Jun 09 17:34:22.171302 ip-10-0-143-124 kubenswrapper[2552]: I0609 17:34:22.171284 2552 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\"" Jun 09 17:34:22.181428 ip-10-0-143-124 kubenswrapper[2552]: I0609 17:34:22.181402 2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-vvzhh\" (UniqueName: \"kubernetes.io/projected/7755d1ba-506c-4a2d-829f-57beb748954e-kube-api-access-vvzhh\") pod \"network-check-target-mpmvr\" (UID: \"7755d1ba-506c-4a2d-829f-57beb748954e\") " pod="openshift-network-diagnostics/network-check-target-mpmvr" Jun 09 17:34:22.244376 ip-10-0-143-124 kubenswrapper[2552]: I0609 17:34:22.244355 2552 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-bw759\"" Jun 09 17:34:22.247282 ip-10-0-143-124 kubenswrapper[2552]: I0609 17:34:22.247270 2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-lt4n9" Jun 09 17:34:22.252219 ip-10-0-143-124 kubenswrapper[2552]: I0609 17:34:22.252203 2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-mpmvr" Jun 09 17:34:22.383741 ip-10-0-143-124 kubenswrapper[2552]: I0609 17:34:22.383718 2552 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-mpmvr"] Jun 09 17:34:22.386612 ip-10-0-143-124 kubenswrapper[2552]: W0609 17:34:22.386574 2552 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7755d1ba_506c_4a2d_829f_57beb748954e.slice/crio-b81f4d7d8e7ca5bed950d78db74ea4aa21cc97ed3e843963447a743a2cf828b9 WatchSource:0}: Error finding container b81f4d7d8e7ca5bed950d78db74ea4aa21cc97ed3e843963447a743a2cf828b9: Status 404 returned error can't find the container with id b81f4d7d8e7ca5bed950d78db74ea4aa21cc97ed3e843963447a743a2cf828b9 Jun 09 17:34:22.394916 ip-10-0-143-124 kubenswrapper[2552]: I0609 17:34:22.394875 2552 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-lt4n9"] Jun 09 17:34:22.399015 ip-10-0-143-124 kubenswrapper[2552]: W0609 17:34:22.398988 2552 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda71cd181_3d23_4c4b_ac2f_e212dd9b5193.slice/crio-f07f02e6ee819ad1b5dc8bc43c9608a32ca872174f5ac803b41bf74d9c197595 WatchSource:0}: Error finding container f07f02e6ee819ad1b5dc8bc43c9608a32ca872174f5ac803b41bf74d9c197595: Status 404 returned error can't find the container with id f07f02e6ee819ad1b5dc8bc43c9608a32ca872174f5ac803b41bf74d9c197595 Jun 09 17:34:22.715098 ip-10-0-143-124 kubenswrapper[2552]: I0609 17:34:22.715021 2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-mpmvr" event={"ID":"7755d1ba-506c-4a2d-829f-57beb748954e","Type":"ContainerStarted","Data":"b81f4d7d8e7ca5bed950d78db74ea4aa21cc97ed3e843963447a743a2cf828b9"} Jun 09 17:34:22.715945 ip-10-0-143-124 kubenswrapper[2552]: I0609 17:34:22.715925 2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-lt4n9" event={"ID":"a71cd181-3d23-4c4b-ac2f-e212dd9b5193","Type":"ContainerStarted","Data":"f07f02e6ee819ad1b5dc8bc43c9608a32ca872174f5ac803b41bf74d9c197595"} Jun 09 17:34:23.164782 ip-10-0-143-124 kubenswrapper[2552]: I0609 17:34:23.164744 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/3ed6274b-3981-436a-99bb-77b505c76d3d-metrics-tls\") pod \"dns-default-bmg8n\" (UID: \"3ed6274b-3981-436a-99bb-77b505c76d3d\") " pod="openshift-dns/dns-default-bmg8n" Jun 09 17:34:23.165216 ip-10-0-143-124 kubenswrapper[2552]: E0609 17:34:23.164887 2552 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jun 09 17:34:23.165216 ip-10-0-143-124 kubenswrapper[2552]: E0609 17:34:23.164964 2552 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/3ed6274b-3981-436a-99bb-77b505c76d3d-metrics-tls podName:3ed6274b-3981-436a-99bb-77b505c76d3d nodeName:}" failed. No retries permitted until 2026-06-09 17:34:55.164943249 +0000 UTC m=+99.264845877 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/3ed6274b-3981-436a-99bb-77b505c76d3d-metrics-tls") pod "dns-default-bmg8n" (UID: "3ed6274b-3981-436a-99bb-77b505c76d3d") : secret "dns-default-metrics-tls" not found Jun 09 17:34:26.728730 ip-10-0-143-124 kubenswrapper[2552]: I0609 17:34:26.728693 2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-mpmvr" event={"ID":"7755d1ba-506c-4a2d-829f-57beb748954e","Type":"ContainerStarted","Data":"a6743e1989b15b40c5db2db9e48ffe2ca10be945af59cef8ea55e57adcb2fbae"} Jun 09 17:34:26.729222 ip-10-0-143-124 kubenswrapper[2552]: I0609 17:34:26.728909 2552 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-network-diagnostics/network-check-target-mpmvr" Jun 09 17:34:26.730263 ip-10-0-143-124 kubenswrapper[2552]: I0609 17:34:26.730236 2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-lt4n9" event={"ID":"a71cd181-3d23-4c4b-ac2f-e212dd9b5193","Type":"ContainerStarted","Data":"37aabc9e5d313131af8cda7e09fd10fa060cadc08ce3cc5aeab16229ebef3447"} Jun 09 17:34:26.745184 ip-10-0-143-124 kubenswrapper[2552]: I0609 17:34:26.745138 2552 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-diagnostics/network-check-target-mpmvr" podStartSLOduration=66.560554549 podStartE2EDuration="1m10.745125709s" totalImagesPullingTime="4.18457116s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-09 17:33:16 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-09 17:34:26.744057619 +0000 UTC m=+70.843960269" watchObservedRunningTime="2026-06-09 17:34:26.745125709 +0000 UTC m=+70.845028337" Jun 09 17:34:26.757995 ip-10-0-143-124 kubenswrapper[2552]: I0609 17:34:26.757955 2552 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/global-pull-secret-syncer-lt4n9" podStartSLOduration=66.584019015 podStartE2EDuration="1m10.757941589s" totalImagesPullingTime="4.173922574s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-09 17:33:16 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-09 17:34:26.757790071 +0000 UTC m=+70.857692734" watchObservedRunningTime="2026-06-09 17:34:26.757941589 +0000 UTC m=+70.857844256" Jun 09 17:34:55.183449 ip-10-0-143-124 kubenswrapper[2552]: I0609 17:34:55.183308 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/3ed6274b-3981-436a-99bb-77b505c76d3d-metrics-tls\") pod \"dns-default-bmg8n\" (UID: \"3ed6274b-3981-436a-99bb-77b505c76d3d\") " pod="openshift-dns/dns-default-bmg8n" Jun 09 17:34:55.183883 ip-10-0-143-124 kubenswrapper[2552]: E0609 17:34:55.183466 2552 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jun 09 17:34:55.183883 ip-10-0-143-124 kubenswrapper[2552]: E0609 17:34:55.183554 2552 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/3ed6274b-3981-436a-99bb-77b505c76d3d-metrics-tls podName:3ed6274b-3981-436a-99bb-77b505c76d3d nodeName:}" failed. No retries permitted until 2026-06-09 17:35:59.183533358 +0000 UTC m=+163.283435993 (durationBeforeRetry 1m4s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/3ed6274b-3981-436a-99bb-77b505c76d3d-metrics-tls") pod "dns-default-bmg8n" (UID: "3ed6274b-3981-436a-99bb-77b505c76d3d") : secret "dns-default-metrics-tls" not found Jun 09 17:34:57.735028 ip-10-0-143-124 kubenswrapper[2552]: I0609 17:34:57.734996 2552 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-network-diagnostics/network-check-target-mpmvr" Jun 09 17:35:19.585110 ip-10-0-143-124 kubenswrapper[2552]: I0609 17:35:19.585071 2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gctfs_8563ebab-ebdd-4d68-bce1-78d2a7f62992/konnectivity-agent/0.log" limit=1024 Jun 09 17:35:26.082802 ip-10-0-143-124 kubenswrapper[2552]: I0609 17:35:26.082765 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/b817ed32-ca44-43a6-99cf-8cf86ffd8c05-metrics-certs\") pod \"network-metrics-daemon-pvmnc\" (UID: \"b817ed32-ca44-43a6-99cf-8cf86ffd8c05\") " pod="openshift-multus/network-metrics-daemon-pvmnc" Jun 09 17:35:26.083185 ip-10-0-143-124 kubenswrapper[2552]: E0609 17:35:26.082878 2552 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: secret "metrics-daemon-secret" not found Jun 09 17:35:26.083185 ip-10-0-143-124 kubenswrapper[2552]: E0609 17:35:26.082940 2552 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b817ed32-ca44-43a6-99cf-8cf86ffd8c05-metrics-certs podName:b817ed32-ca44-43a6-99cf-8cf86ffd8c05 nodeName:}" failed. No retries permitted until 2026-06-09 17:37:28.082925994 +0000 UTC m=+252.182828625 (durationBeforeRetry 2m2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/b817ed32-ca44-43a6-99cf-8cf86ffd8c05-metrics-certs") pod "network-metrics-daemon-pvmnc" (UID: "b817ed32-ca44-43a6-99cf-8cf86ffd8c05") : secret "metrics-daemon-secret" not found Jun 09 17:35:46.958451 ip-10-0-143-124 kubenswrapper[2552]: I0609 17:35:46.958409 2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gctfs_8563ebab-ebdd-4d68-bce1-78d2a7f62992/konnectivity-agent/0.log" limit=1024 Jun 09 17:35:54.310109 ip-10-0-143-124 kubenswrapper[2552]: E0609 17:35:54.310060 2552 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[metrics-tls], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-dns/dns-default-bmg8n" podUID="3ed6274b-3981-436a-99bb-77b505c76d3d" Jun 09 17:35:54.938510 ip-10-0-143-124 kubenswrapper[2552]: I0609 17:35:54.938482 2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-bmg8n" Jun 09 17:35:55.345653 ip-10-0-143-124 kubenswrapper[2552]: E0609 17:35:55.345591 2552 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[metrics-certs], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-multus/network-metrics-daemon-pvmnc" podUID="b817ed32-ca44-43a6-99cf-8cf86ffd8c05" Jun 09 17:35:59.194263 ip-10-0-143-124 kubenswrapper[2552]: I0609 17:35:59.194214 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/3ed6274b-3981-436a-99bb-77b505c76d3d-metrics-tls\") pod \"dns-default-bmg8n\" (UID: \"3ed6274b-3981-436a-99bb-77b505c76d3d\") " pod="openshift-dns/dns-default-bmg8n" Jun 09 17:35:59.194676 ip-10-0-143-124 kubenswrapper[2552]: E0609 17:35:59.194364 2552 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jun 09 17:35:59.194676 ip-10-0-143-124 kubenswrapper[2552]: E0609 17:35:59.194446 2552 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/3ed6274b-3981-436a-99bb-77b505c76d3d-metrics-tls podName:3ed6274b-3981-436a-99bb-77b505c76d3d nodeName:}" failed. No retries permitted until 2026-06-09 17:38:01.194429367 +0000 UTC m=+285.294331994 (durationBeforeRetry 2m2s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/3ed6274b-3981-436a-99bb-77b505c76d3d-metrics-tls") pod "dns-default-bmg8n" (UID: "3ed6274b-3981-436a-99bb-77b505c76d3d") : secret "dns-default-metrics-tls" not found Jun 09 17:36:07.331571 ip-10-0-143-124 kubenswrapper[2552]: I0609 17:36:07.331499 2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-pvmnc" Jun 09 17:36:12.667410 ip-10-0-143-124 kubenswrapper[2552]: I0609 17:36:12.667374 2552 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-image-registry/image-registry-7df4944668-6mxtj"] Jun 09 17:36:12.669216 ip-10-0-143-124 kubenswrapper[2552]: I0609 17:36:12.669200 2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-7df4944668-6mxtj" Jun 09 17:36:12.674473 ip-10-0-143-124 kubenswrapper[2552]: I0609 17:36:12.674444 2552 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-insights/insights-operator-896549976-7z8hc"] Jun 09 17:36:12.675376 ip-10-0-143-124 kubenswrapper[2552]: I0609 17:36:12.675352 2552 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-tls\"" Jun 09 17:36:12.675498 ip-10-0-143-124 kubenswrapper[2552]: I0609 17:36:12.675477 2552 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"installation-pull-secrets\"" Jun 09 17:36:12.676295 ip-10-0-143-124 kubenswrapper[2552]: I0609 17:36:12.675990 2552 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"registry-dockercfg-svw84\"" Jun 09 17:36:12.676295 ip-10-0-143-124 kubenswrapper[2552]: I0609 17:36:12.676051 2552 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-private-configuration\"" Jun 09 17:36:12.676420 ip-10-0-143-124 kubenswrapper[2552]: I0609 17:36:12.676328 2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-operator-896549976-7z8hc" Jun 09 17:36:12.685659 ip-10-0-143-124 kubenswrapper[2552]: I0609 17:36:12.685640 2552 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"operator-dockercfg-g54q5\"" Jun 09 17:36:12.685766 ip-10-0-143-124 kubenswrapper[2552]: I0609 17:36:12.685693 2552 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-root-ca.crt\"" Jun 09 17:36:12.685766 ip-10-0-143-124 kubenswrapper[2552]: I0609 17:36:12.685761 2552 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"service-ca-bundle\"" Jun 09 17:36:12.685874 ip-10-0-143-124 kubenswrapper[2552]: I0609 17:36:12.685833 2552 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"openshift-service-ca.crt\"" Jun 09 17:36:12.685929 ip-10-0-143-124 kubenswrapper[2552]: I0609 17:36:12.685883 2552 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"openshift-insights-serving-cert\"" Jun 09 17:36:12.686047 ip-10-0-143-124 kubenswrapper[2552]: I0609 17:36:12.686030 2552 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"trusted-ca\"" Jun 09 17:36:12.686447 ip-10-0-143-124 kubenswrapper[2552]: I0609 17:36:12.686430 2552 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"trusted-ca-bundle\"" Jun 09 17:36:12.694963 ip-10-0-143-124 kubenswrapper[2552]: I0609 17:36:12.694941 2552 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-operator-896549976-7z8hc"] Jun 09 17:36:12.704633 ip-10-0-143-124 kubenswrapper[2552]: I0609 17:36:12.704612 2552 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-7df4944668-6mxtj"] Jun 09 17:36:12.707644 ip-10-0-143-124 kubenswrapper[2552]: I0609 17:36:12.707624 2552 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["open-cluster-management-agent-addon/klusterlet-addon-workmgr-5fd544f5d-htqlh"] Jun 09 17:36:12.709451 ip-10-0-143-124 kubenswrapper[2552]: I0609 17:36:12.709437 2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-5fd544f5d-htqlh" Jun 09 17:36:12.711980 ip-10-0-143-124 kubenswrapper[2552]: I0609 17:36:12.711962 2552 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"open-cluster-management-image-pull-credentials\"" Jun 09 17:36:12.712113 ip-10-0-143-124 kubenswrapper[2552]: I0609 17:36:12.712094 2552 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"open-cluster-management-agent-addon\"/\"openshift-service-ca.crt\"" Jun 09 17:36:12.712233 ip-10-0-143-124 kubenswrapper[2552]: I0609 17:36:12.712219 2552 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"work-manager-hub-kubeconfig\"" Jun 09 17:36:12.712298 ip-10-0-143-124 kubenswrapper[2552]: I0609 17:36:12.712220 2552 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"open-cluster-management-agent-addon\"/\"kube-root-ca.crt\"" Jun 09 17:36:12.720807 ip-10-0-143-124 kubenswrapper[2552]: I0609 17:36:12.720788 2552 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/klusterlet-addon-workmgr-5fd544f5d-htqlh"] Jun 09 17:36:12.758098 ip-10-0-143-124 kubenswrapper[2552]: I0609 17:36:12.758077 2552 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/cluster-monitoring-operator-74bbf69bbb-mxm64"] Jun 09 17:36:12.759906 ip-10-0-143-124 kubenswrapper[2552]: I0609 17:36:12.759890 2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/cluster-monitoring-operator-74bbf69bbb-mxm64" Jun 09 17:36:12.762965 ip-10-0-143-124 kubenswrapper[2552]: I0609 17:36:12.762948 2552 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"cluster-monitoring-operator-tls\"" Jun 09 17:36:12.763882 ip-10-0-143-124 kubenswrapper[2552]: I0609 17:36:12.763864 2552 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"telemetry-config\"" Jun 09 17:36:12.764081 ip-10-0-143-124 kubenswrapper[2552]: I0609 17:36:12.764066 2552 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"openshift-service-ca.crt\"" Jun 09 17:36:12.764336 ip-10-0-143-124 kubenswrapper[2552]: I0609 17:36:12.764314 2552 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"cluster-monitoring-operator-dockercfg-fs6gn\"" Jun 09 17:36:12.764563 ip-10-0-143-124 kubenswrapper[2552]: I0609 17:36:12.764453 2552 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kube-root-ca.crt\"" Jun 09 17:36:12.776196 ip-10-0-143-124 kubenswrapper[2552]: I0609 17:36:12.776175 2552 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/cluster-monitoring-operator-74bbf69bbb-mxm64"] Jun 09 17:36:12.782497 ip-10-0-143-124 kubenswrapper[2552]: I0609 17:36:12.782477 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/c12461c8-8309-43fb-8384-f20159a4324b-tmp\") pod \"insights-operator-896549976-7z8hc\" (UID: \"c12461c8-8309-43fb-8384-f20159a4324b\") " pod="openshift-insights/insights-operator-896549976-7z8hc" Jun 09 17:36:12.782583 ip-10-0-143-124 kubenswrapper[2552]: I0609 17:36:12.782507 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/2f51b34b-d7df-4f41-b046-a58499a5e16a-registry-certificates\") pod \"image-registry-7df4944668-6mxtj\" (UID: \"2f51b34b-d7df-4f41-b046-a58499a5e16a\") " pod="openshift-image-registry/image-registry-7df4944668-6mxtj" Jun 09 17:36:12.782583 ip-10-0-143-124 kubenswrapper[2552]: I0609 17:36:12.782525 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-r2ztd\" (UniqueName: \"kubernetes.io/projected/2f51b34b-d7df-4f41-b046-a58499a5e16a-kube-api-access-r2ztd\") pod \"image-registry-7df4944668-6mxtj\" (UID: \"2f51b34b-d7df-4f41-b046-a58499a5e16a\") " pod="openshift-image-registry/image-registry-7df4944668-6mxtj" Jun 09 17:36:12.782583 ip-10-0-143-124 kubenswrapper[2552]: I0609 17:36:12.782551 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/2f51b34b-d7df-4f41-b046-a58499a5e16a-trusted-ca\") pod \"image-registry-7df4944668-6mxtj\" (UID: \"2f51b34b-d7df-4f41-b046-a58499a5e16a\") " pod="openshift-image-registry/image-registry-7df4944668-6mxtj" Jun 09 17:36:12.782715 ip-10-0-143-124 kubenswrapper[2552]: I0609 17:36:12.782645 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/2f51b34b-d7df-4f41-b046-a58499a5e16a-image-registry-private-configuration\") pod \"image-registry-7df4944668-6mxtj\" (UID: \"2f51b34b-d7df-4f41-b046-a58499a5e16a\") " pod="openshift-image-registry/image-registry-7df4944668-6mxtj" Jun 09 17:36:12.782715 ip-10-0-143-124 kubenswrapper[2552]: I0609 17:36:12.782674 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/c12461c8-8309-43fb-8384-f20159a4324b-trusted-ca-bundle\") pod \"insights-operator-896549976-7z8hc\" (UID: \"c12461c8-8309-43fb-8384-f20159a4324b\") " pod="openshift-insights/insights-operator-896549976-7z8hc" Jun 09 17:36:12.782715 ip-10-0-143-124 kubenswrapper[2552]: I0609 17:36:12.782697 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/c12461c8-8309-43fb-8384-f20159a4324b-service-ca-bundle\") pod \"insights-operator-896549976-7z8hc\" (UID: \"c12461c8-8309-43fb-8384-f20159a4324b\") " pod="openshift-insights/insights-operator-896549976-7z8hc" Jun 09 17:36:12.782814 ip-10-0-143-124 kubenswrapper[2552]: I0609 17:36:12.782719 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/84271d52-884d-44c1-b362-59eed7dede95-tmp\") pod \"klusterlet-addon-workmgr-5fd544f5d-htqlh\" (UID: \"84271d52-884d-44c1-b362-59eed7dede95\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-5fd544f5d-htqlh" Jun 09 17:36:12.782814 ip-10-0-143-124 kubenswrapper[2552]: I0609 17:36:12.782734 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/2f51b34b-d7df-4f41-b046-a58499a5e16a-registry-tls\") pod \"image-registry-7df4944668-6mxtj\" (UID: \"2f51b34b-d7df-4f41-b046-a58499a5e16a\") " pod="openshift-image-registry/image-registry-7df4944668-6mxtj" Jun 09 17:36:12.782814 ip-10-0-143-124 kubenswrapper[2552]: I0609 17:36:12.782756 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"snapshots\" (UniqueName: \"kubernetes.io/empty-dir/c12461c8-8309-43fb-8384-f20159a4324b-snapshots\") pod \"insights-operator-896549976-7z8hc\" (UID: \"c12461c8-8309-43fb-8384-f20159a4324b\") " pod="openshift-insights/insights-operator-896549976-7z8hc" Jun 09 17:36:12.782814 ip-10-0-143-124 kubenswrapper[2552]: I0609 17:36:12.782778 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/2f51b34b-d7df-4f41-b046-a58499a5e16a-ca-trust-extracted\") pod \"image-registry-7df4944668-6mxtj\" (UID: \"2f51b34b-d7df-4f41-b046-a58499a5e16a\") " pod="openshift-image-registry/image-registry-7df4944668-6mxtj" Jun 09 17:36:12.782814 ip-10-0-143-124 kubenswrapper[2552]: I0609 17:36:12.782796 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-97nf9\" (UniqueName: \"kubernetes.io/projected/84271d52-884d-44c1-b362-59eed7dede95-kube-api-access-97nf9\") pod \"klusterlet-addon-workmgr-5fd544f5d-htqlh\" (UID: \"84271d52-884d-44c1-b362-59eed7dede95\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-5fd544f5d-htqlh" Jun 09 17:36:12.782814 ip-10-0-143-124 kubenswrapper[2552]: I0609 17:36:12.782811 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/c12461c8-8309-43fb-8384-f20159a4324b-serving-cert\") pod \"insights-operator-896549976-7z8hc\" (UID: \"c12461c8-8309-43fb-8384-f20159a4324b\") " pod="openshift-insights/insights-operator-896549976-7z8hc" Jun 09 17:36:12.783007 ip-10-0-143-124 kubenswrapper[2552]: I0609 17:36:12.782826 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mtq6r\" (UniqueName: \"kubernetes.io/projected/c12461c8-8309-43fb-8384-f20159a4324b-kube-api-access-mtq6r\") pod \"insights-operator-896549976-7z8hc\" (UID: \"c12461c8-8309-43fb-8384-f20159a4324b\") " pod="openshift-insights/insights-operator-896549976-7z8hc" Jun 09 17:36:12.783007 ip-10-0-143-124 kubenswrapper[2552]: I0609 17:36:12.782865 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"klusterlet-config\" (UniqueName: \"kubernetes.io/secret/84271d52-884d-44c1-b362-59eed7dede95-klusterlet-config\") pod \"klusterlet-addon-workmgr-5fd544f5d-htqlh\" (UID: \"84271d52-884d-44c1-b362-59eed7dede95\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-5fd544f5d-htqlh" Jun 09 17:36:12.783007 ip-10-0-143-124 kubenswrapper[2552]: I0609 17:36:12.782896 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/2f51b34b-d7df-4f41-b046-a58499a5e16a-installation-pull-secrets\") pod \"image-registry-7df4944668-6mxtj\" (UID: \"2f51b34b-d7df-4f41-b046-a58499a5e16a\") " pod="openshift-image-registry/image-registry-7df4944668-6mxtj" Jun 09 17:36:12.783007 ip-10-0-143-124 kubenswrapper[2552]: I0609 17:36:12.782950 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/2f51b34b-d7df-4f41-b046-a58499a5e16a-bound-sa-token\") pod \"image-registry-7df4944668-6mxtj\" (UID: \"2f51b34b-d7df-4f41-b046-a58499a5e16a\") " pod="openshift-image-registry/image-registry-7df4944668-6mxtj" Jun 09 17:36:12.879441 ip-10-0-143-124 kubenswrapper[2552]: I0609 17:36:12.879405 2552 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-cluster-samples-operator/cluster-samples-operator-854f8b96b6-9wjdx"] Jun 09 17:36:12.881258 ip-10-0-143-124 kubenswrapper[2552]: I0609 17:36:12.881243 2552 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-55bb7c4d49-7nmpt"] Jun 09 17:36:12.881378 ip-10-0-143-124 kubenswrapper[2552]: I0609 17:36:12.881360 2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-samples-operator/cluster-samples-operator-854f8b96b6-9wjdx" Jun 09 17:36:12.883018 ip-10-0-143-124 kubenswrapper[2552]: I0609 17:36:12.883001 2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-55bb7c4d49-7nmpt" Jun 09 17:36:12.883270 ip-10-0-143-124 kubenswrapper[2552]: I0609 17:36:12.883252 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/2f51b34b-d7df-4f41-b046-a58499a5e16a-registry-tls\") pod \"image-registry-7df4944668-6mxtj\" (UID: \"2f51b34b-d7df-4f41-b046-a58499a5e16a\") " pod="openshift-image-registry/image-registry-7df4944668-6mxtj" Jun 09 17:36:12.883357 ip-10-0-143-124 kubenswrapper[2552]: I0609 17:36:12.883284 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"snapshots\" (UniqueName: \"kubernetes.io/empty-dir/c12461c8-8309-43fb-8384-f20159a4324b-snapshots\") pod \"insights-operator-896549976-7z8hc\" (UID: \"c12461c8-8309-43fb-8384-f20159a4324b\") " pod="openshift-insights/insights-operator-896549976-7z8hc" Jun 09 17:36:12.883357 ip-10-0-143-124 kubenswrapper[2552]: I0609 17:36:12.883299 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/2f51b34b-d7df-4f41-b046-a58499a5e16a-ca-trust-extracted\") pod \"image-registry-7df4944668-6mxtj\" (UID: \"2f51b34b-d7df-4f41-b046-a58499a5e16a\") " pod="openshift-image-registry/image-registry-7df4944668-6mxtj" Jun 09 17:36:12.883357 ip-10-0-143-124 kubenswrapper[2552]: I0609 17:36:12.883320 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-97nf9\" (UniqueName: \"kubernetes.io/projected/84271d52-884d-44c1-b362-59eed7dede95-kube-api-access-97nf9\") pod \"klusterlet-addon-workmgr-5fd544f5d-htqlh\" (UID: \"84271d52-884d-44c1-b362-59eed7dede95\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-5fd544f5d-htqlh" Jun 09 17:36:12.883357 ip-10-0-143-124 kubenswrapper[2552]: I0609 17:36:12.883343 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/c12461c8-8309-43fb-8384-f20159a4324b-serving-cert\") pod \"insights-operator-896549976-7z8hc\" (UID: \"c12461c8-8309-43fb-8384-f20159a4324b\") " pod="openshift-insights/insights-operator-896549976-7z8hc" Jun 09 17:36:12.883569 ip-10-0-143-124 kubenswrapper[2552]: I0609 17:36:12.883365 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mtq6r\" (UniqueName: \"kubernetes.io/projected/c12461c8-8309-43fb-8384-f20159a4324b-kube-api-access-mtq6r\") pod \"insights-operator-896549976-7z8hc\" (UID: \"c12461c8-8309-43fb-8384-f20159a4324b\") " pod="openshift-insights/insights-operator-896549976-7z8hc" Jun 09 17:36:12.883569 ip-10-0-143-124 kubenswrapper[2552]: I0609 17:36:12.883390 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"klusterlet-config\" (UniqueName: \"kubernetes.io/secret/84271d52-884d-44c1-b362-59eed7dede95-klusterlet-config\") pod \"klusterlet-addon-workmgr-5fd544f5d-htqlh\" (UID: \"84271d52-884d-44c1-b362-59eed7dede95\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-5fd544f5d-htqlh" Jun 09 17:36:12.883569 ip-10-0-143-124 kubenswrapper[2552]: E0609 17:36:12.883409 2552 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jun 09 17:36:12.883569 ip-10-0-143-124 kubenswrapper[2552]: E0609 17:36:12.883428 2552 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-7df4944668-6mxtj: secret "image-registry-tls" not found Jun 09 17:36:12.883569 ip-10-0-143-124 kubenswrapper[2552]: I0609 17:36:12.883437 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/2f51b34b-d7df-4f41-b046-a58499a5e16a-installation-pull-secrets\") pod \"image-registry-7df4944668-6mxtj\" (UID: \"2f51b34b-d7df-4f41-b046-a58499a5e16a\") " pod="openshift-image-registry/image-registry-7df4944668-6mxtj" Jun 09 17:36:12.883569 ip-10-0-143-124 kubenswrapper[2552]: I0609 17:36:12.883468 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/2f51b34b-d7df-4f41-b046-a58499a5e16a-bound-sa-token\") pod \"image-registry-7df4944668-6mxtj\" (UID: \"2f51b34b-d7df-4f41-b046-a58499a5e16a\") " pod="openshift-image-registry/image-registry-7df4944668-6mxtj" Jun 09 17:36:12.883569 ip-10-0-143-124 kubenswrapper[2552]: E0609 17:36:12.883497 2552 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/2f51b34b-d7df-4f41-b046-a58499a5e16a-registry-tls podName:2f51b34b-d7df-4f41-b046-a58499a5e16a nodeName:}" failed. No retries permitted until 2026-06-09 17:36:13.383477675 +0000 UTC m=+177.483380318 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/2f51b34b-d7df-4f41-b046-a58499a5e16a-registry-tls") pod "image-registry-7df4944668-6mxtj" (UID: "2f51b34b-d7df-4f41-b046-a58499a5e16a") : secret "image-registry-tls" not found Jun 09 17:36:12.883569 ip-10-0-143-124 kubenswrapper[2552]: I0609 17:36:12.883540 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/c12461c8-8309-43fb-8384-f20159a4324b-tmp\") pod \"insights-operator-896549976-7z8hc\" (UID: \"c12461c8-8309-43fb-8384-f20159a4324b\") " pod="openshift-insights/insights-operator-896549976-7z8hc" Jun 09 17:36:12.884002 ip-10-0-143-124 kubenswrapper[2552]: I0609 17:36:12.883576 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/2f51b34b-d7df-4f41-b046-a58499a5e16a-registry-certificates\") pod \"image-registry-7df4944668-6mxtj\" (UID: \"2f51b34b-d7df-4f41-b046-a58499a5e16a\") " pod="openshift-image-registry/image-registry-7df4944668-6mxtj" Jun 09 17:36:12.884002 ip-10-0-143-124 kubenswrapper[2552]: I0609 17:36:12.883696 2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/2f51b34b-d7df-4f41-b046-a58499a5e16a-ca-trust-extracted\") pod \"image-registry-7df4944668-6mxtj\" (UID: \"2f51b34b-d7df-4f41-b046-a58499a5e16a\") " pod="openshift-image-registry/image-registry-7df4944668-6mxtj" Jun 09 17:36:12.884002 ip-10-0-143-124 kubenswrapper[2552]: I0609 17:36:12.883894 2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/c12461c8-8309-43fb-8384-f20159a4324b-tmp\") pod \"insights-operator-896549976-7z8hc\" (UID: \"c12461c8-8309-43fb-8384-f20159a4324b\") " pod="openshift-insights/insights-operator-896549976-7z8hc" Jun 09 17:36:12.884002 ip-10-0-143-124 kubenswrapper[2552]: I0609 17:36:12.883969 2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"snapshots\" (UniqueName: \"kubernetes.io/empty-dir/c12461c8-8309-43fb-8384-f20159a4324b-snapshots\") pod \"insights-operator-896549976-7z8hc\" (UID: \"c12461c8-8309-43fb-8384-f20159a4324b\") " pod="openshift-insights/insights-operator-896549976-7z8hc" Jun 09 17:36:12.884211 ip-10-0-143-124 kubenswrapper[2552]: I0609 17:36:12.884001 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-r2ztd\" (UniqueName: \"kubernetes.io/projected/2f51b34b-d7df-4f41-b046-a58499a5e16a-kube-api-access-r2ztd\") pod \"image-registry-7df4944668-6mxtj\" (UID: \"2f51b34b-d7df-4f41-b046-a58499a5e16a\") " pod="openshift-image-registry/image-registry-7df4944668-6mxtj" Jun 09 17:36:12.884211 ip-10-0-143-124 kubenswrapper[2552]: I0609 17:36:12.884046 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"telemetry-config\" (UniqueName: \"kubernetes.io/configmap/6a24035e-75a9-4ed0-a190-07948fdc748a-telemetry-config\") pod \"cluster-monitoring-operator-74bbf69bbb-mxm64\" (UID: \"6a24035e-75a9-4ed0-a190-07948fdc748a\") " pod="openshift-monitoring/cluster-monitoring-operator-74bbf69bbb-mxm64" Jun 09 17:36:12.884211 ip-10-0-143-124 kubenswrapper[2552]: I0609 17:36:12.884073 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-d46gz\" (UniqueName: \"kubernetes.io/projected/6a24035e-75a9-4ed0-a190-07948fdc748a-kube-api-access-d46gz\") pod \"cluster-monitoring-operator-74bbf69bbb-mxm64\" (UID: \"6a24035e-75a9-4ed0-a190-07948fdc748a\") " pod="openshift-monitoring/cluster-monitoring-operator-74bbf69bbb-mxm64" Jun 09 17:36:12.884211 ip-10-0-143-124 kubenswrapper[2552]: I0609 17:36:12.884105 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/2f51b34b-d7df-4f41-b046-a58499a5e16a-trusted-ca\") pod \"image-registry-7df4944668-6mxtj\" (UID: \"2f51b34b-d7df-4f41-b046-a58499a5e16a\") " pod="openshift-image-registry/image-registry-7df4944668-6mxtj" Jun 09 17:36:12.884211 ip-10-0-143-124 kubenswrapper[2552]: I0609 17:36:12.884170 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/2f51b34b-d7df-4f41-b046-a58499a5e16a-image-registry-private-configuration\") pod \"image-registry-7df4944668-6mxtj\" (UID: \"2f51b34b-d7df-4f41-b046-a58499a5e16a\") " pod="openshift-image-registry/image-registry-7df4944668-6mxtj" Jun 09 17:36:12.884455 ip-10-0-143-124 kubenswrapper[2552]: I0609 17:36:12.884212 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/6a24035e-75a9-4ed0-a190-07948fdc748a-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-74bbf69bbb-mxm64\" (UID: \"6a24035e-75a9-4ed0-a190-07948fdc748a\") " pod="openshift-monitoring/cluster-monitoring-operator-74bbf69bbb-mxm64" Jun 09 17:36:12.884455 ip-10-0-143-124 kubenswrapper[2552]: I0609 17:36:12.884278 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/c12461c8-8309-43fb-8384-f20159a4324b-trusted-ca-bundle\") pod \"insights-operator-896549976-7z8hc\" (UID: \"c12461c8-8309-43fb-8384-f20159a4324b\") " pod="openshift-insights/insights-operator-896549976-7z8hc" Jun 09 17:36:12.884455 ip-10-0-143-124 kubenswrapper[2552]: I0609 17:36:12.884370 2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/2f51b34b-d7df-4f41-b046-a58499a5e16a-registry-certificates\") pod \"image-registry-7df4944668-6mxtj\" (UID: \"2f51b34b-d7df-4f41-b046-a58499a5e16a\") " pod="openshift-image-registry/image-registry-7df4944668-6mxtj" Jun 09 17:36:12.884455 ip-10-0-143-124 kubenswrapper[2552]: I0609 17:36:12.884428 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/c12461c8-8309-43fb-8384-f20159a4324b-service-ca-bundle\") pod \"insights-operator-896549976-7z8hc\" (UID: \"c12461c8-8309-43fb-8384-f20159a4324b\") " pod="openshift-insights/insights-operator-896549976-7z8hc" Jun 09 17:36:12.885026 ip-10-0-143-124 kubenswrapper[2552]: I0609 17:36:12.885005 2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/c12461c8-8309-43fb-8384-f20159a4324b-service-ca-bundle\") pod \"insights-operator-896549976-7z8hc\" (UID: \"c12461c8-8309-43fb-8384-f20159a4324b\") " pod="openshift-insights/insights-operator-896549976-7z8hc" Jun 09 17:36:12.885201 ip-10-0-143-124 kubenswrapper[2552]: I0609 17:36:12.885183 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/84271d52-884d-44c1-b362-59eed7dede95-tmp\") pod \"klusterlet-addon-workmgr-5fd544f5d-htqlh\" (UID: \"84271d52-884d-44c1-b362-59eed7dede95\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-5fd544f5d-htqlh" Jun 09 17:36:12.885384 ip-10-0-143-124 kubenswrapper[2552]: I0609 17:36:12.885196 2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/2f51b34b-d7df-4f41-b046-a58499a5e16a-trusted-ca\") pod \"image-registry-7df4944668-6mxtj\" (UID: \"2f51b34b-d7df-4f41-b046-a58499a5e16a\") " pod="openshift-image-registry/image-registry-7df4944668-6mxtj" Jun 09 17:36:12.885490 ip-10-0-143-124 kubenswrapper[2552]: I0609 17:36:12.885274 2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/c12461c8-8309-43fb-8384-f20159a4324b-trusted-ca-bundle\") pod \"insights-operator-896549976-7z8hc\" (UID: \"c12461c8-8309-43fb-8384-f20159a4324b\") " pod="openshift-insights/insights-operator-896549976-7z8hc" Jun 09 17:36:12.885490 ip-10-0-143-124 kubenswrapper[2552]: I0609 17:36:12.885475 2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/84271d52-884d-44c1-b362-59eed7dede95-tmp\") pod \"klusterlet-addon-workmgr-5fd544f5d-htqlh\" (UID: \"84271d52-884d-44c1-b362-59eed7dede95\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-5fd544f5d-htqlh" Jun 09 17:36:12.885902 ip-10-0-143-124 kubenswrapper[2552]: I0609 17:36:12.885882 2552 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"serving-cert\"" Jun 09 17:36:12.886118 ip-10-0-143-124 kubenswrapper[2552]: I0609 17:36:12.886090 2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/c12461c8-8309-43fb-8384-f20159a4324b-serving-cert\") pod \"insights-operator-896549976-7z8hc\" (UID: \"c12461c8-8309-43fb-8384-f20159a4324b\") " pod="openshift-insights/insights-operator-896549976-7z8hc" Jun 09 17:36:12.886407 ip-10-0-143-124 kubenswrapper[2552]: I0609 17:36:12.886389 2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"klusterlet-config\" (UniqueName: \"kubernetes.io/secret/84271d52-884d-44c1-b362-59eed7dede95-klusterlet-config\") pod \"klusterlet-addon-workmgr-5fd544f5d-htqlh\" (UID: \"84271d52-884d-44c1-b362-59eed7dede95\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-5fd544f5d-htqlh" Jun 09 17:36:12.886498 ip-10-0-143-124 kubenswrapper[2552]: I0609 17:36:12.886478 2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/2f51b34b-d7df-4f41-b046-a58499a5e16a-installation-pull-secrets\") pod \"image-registry-7df4944668-6mxtj\" (UID: \"2f51b34b-d7df-4f41-b046-a58499a5e16a\") " pod="openshift-image-registry/image-registry-7df4944668-6mxtj" Jun 09 17:36:12.886747 ip-10-0-143-124 kubenswrapper[2552]: I0609 17:36:12.886731 2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/2f51b34b-d7df-4f41-b046-a58499a5e16a-image-registry-private-configuration\") pod \"image-registry-7df4944668-6mxtj\" (UID: \"2f51b34b-d7df-4f41-b046-a58499a5e16a\") " pod="openshift-image-registry/image-registry-7df4944668-6mxtj" Jun 09 17:36:12.887000 ip-10-0-143-124 kubenswrapper[2552]: I0609 17:36:12.886988 2552 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"openshift-service-ca.crt\"" Jun 09 17:36:12.887356 ip-10-0-143-124 kubenswrapper[2552]: I0609 17:36:12.887338 2552 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-samples-operator\"/\"samples-operator-tls\"" Jun 09 17:36:12.887426 ip-10-0-143-124 kubenswrapper[2552]: I0609 17:36:12.887348 2552 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"kube-root-ca.crt\"" Jun 09 17:36:12.887782 ip-10-0-143-124 kubenswrapper[2552]: I0609 17:36:12.887768 2552 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"config\"" Jun 09 17:36:12.887858 ip-10-0-143-124 kubenswrapper[2552]: I0609 17:36:12.887788 2552 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-samples-operator\"/\"kube-root-ca.crt\"" Jun 09 17:36:12.887858 ip-10-0-143-124 kubenswrapper[2552]: I0609 17:36:12.887847 2552 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-samples-operator\"/\"openshift-service-ca.crt\"" Jun 09 17:36:12.888494 ip-10-0-143-124 kubenswrapper[2552]: I0609 17:36:12.888481 2552 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-samples-operator\"/\"cluster-samples-operator-dockercfg-jqmk9\"" Jun 09 17:36:12.892171 ip-10-0-143-124 kubenswrapper[2552]: I0609 17:36:12.892154 2552 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"kube-storage-version-migrator-operator-dockercfg-nrzqc\"" Jun 09 17:36:12.908950 ip-10-0-143-124 kubenswrapper[2552]: I0609 17:36:12.908926 2552 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-cluster-samples-operator/cluster-samples-operator-854f8b96b6-9wjdx"] Jun 09 17:36:12.910311 ip-10-0-143-124 kubenswrapper[2552]: I0609 17:36:12.910287 2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-mtq6r\" (UniqueName: \"kubernetes.io/projected/c12461c8-8309-43fb-8384-f20159a4324b-kube-api-access-mtq6r\") pod \"insights-operator-896549976-7z8hc\" (UID: \"c12461c8-8309-43fb-8384-f20159a4324b\") " pod="openshift-insights/insights-operator-896549976-7z8hc" Jun 09 17:36:12.910679 ip-10-0-143-124 kubenswrapper[2552]: I0609 17:36:12.910658 2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-r2ztd\" (UniqueName: \"kubernetes.io/projected/2f51b34b-d7df-4f41-b046-a58499a5e16a-kube-api-access-r2ztd\") pod \"image-registry-7df4944668-6mxtj\" (UID: \"2f51b34b-d7df-4f41-b046-a58499a5e16a\") " pod="openshift-image-registry/image-registry-7df4944668-6mxtj" Jun 09 17:36:12.910970 ip-10-0-143-124 kubenswrapper[2552]: I0609 17:36:12.910954 2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/2f51b34b-d7df-4f41-b046-a58499a5e16a-bound-sa-token\") pod \"image-registry-7df4944668-6mxtj\" (UID: \"2f51b34b-d7df-4f41-b046-a58499a5e16a\") " pod="openshift-image-registry/image-registry-7df4944668-6mxtj" Jun 09 17:36:12.915954 ip-10-0-143-124 kubenswrapper[2552]: I0609 17:36:12.915930 2552 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-55bb7c4d49-7nmpt"] Jun 09 17:36:12.918242 ip-10-0-143-124 kubenswrapper[2552]: I0609 17:36:12.918188 2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-97nf9\" (UniqueName: \"kubernetes.io/projected/84271d52-884d-44c1-b362-59eed7dede95-kube-api-access-97nf9\") pod \"klusterlet-addon-workmgr-5fd544f5d-htqlh\" (UID: \"84271d52-884d-44c1-b362-59eed7dede95\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-5fd544f5d-htqlh" Jun 09 17:36:12.985036 ip-10-0-143-124 kubenswrapper[2552]: I0609 17:36:12.985015 2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-operator-896549976-7z8hc" Jun 09 17:36:12.986266 ip-10-0-143-124 kubenswrapper[2552]: I0609 17:36:12.986236 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9g8wz\" (UniqueName: \"kubernetes.io/projected/40c2e0b0-7384-4684-ae6a-1e0e458ff57d-kube-api-access-9g8wz\") pod \"cluster-samples-operator-854f8b96b6-9wjdx\" (UID: \"40c2e0b0-7384-4684-ae6a-1e0e458ff57d\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-854f8b96b6-9wjdx" Jun 09 17:36:12.986367 ip-10-0-143-124 kubenswrapper[2552]: I0609 17:36:12.986272 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"telemetry-config\" (UniqueName: \"kubernetes.io/configmap/6a24035e-75a9-4ed0-a190-07948fdc748a-telemetry-config\") pod \"cluster-monitoring-operator-74bbf69bbb-mxm64\" (UID: \"6a24035e-75a9-4ed0-a190-07948fdc748a\") " pod="openshift-monitoring/cluster-monitoring-operator-74bbf69bbb-mxm64" Jun 09 17:36:12.986367 ip-10-0-143-124 kubenswrapper[2552]: I0609 17:36:12.986307 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/6a24035e-75a9-4ed0-a190-07948fdc748a-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-74bbf69bbb-mxm64\" (UID: \"6a24035e-75a9-4ed0-a190-07948fdc748a\") " pod="openshift-monitoring/cluster-monitoring-operator-74bbf69bbb-mxm64" Jun 09 17:36:12.986443 ip-10-0-143-124 kubenswrapper[2552]: E0609 17:36:12.986421 2552 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found Jun 09 17:36:12.986488 ip-10-0-143-124 kubenswrapper[2552]: E0609 17:36:12.986478 2552 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/6a24035e-75a9-4ed0-a190-07948fdc748a-cluster-monitoring-operator-tls podName:6a24035e-75a9-4ed0-a190-07948fdc748a nodeName:}" failed. No retries permitted until 2026-06-09 17:36:13.486463029 +0000 UTC m=+177.586365658 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/6a24035e-75a9-4ed0-a190-07948fdc748a-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-74bbf69bbb-mxm64" (UID: "6a24035e-75a9-4ed0-a190-07948fdc748a") : secret "cluster-monitoring-operator-tls" not found Jun 09 17:36:12.986488 ip-10-0-143-124 kubenswrapper[2552]: I0609 17:36:12.986424 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/40c2e0b0-7384-4684-ae6a-1e0e458ff57d-samples-operator-tls\") pod \"cluster-samples-operator-854f8b96b6-9wjdx\" (UID: \"40c2e0b0-7384-4684-ae6a-1e0e458ff57d\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-854f8b96b6-9wjdx" Jun 09 17:36:12.986558 ip-10-0-143-124 kubenswrapper[2552]: I0609 17:36:12.986538 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/1b04f167-2855-4595-b910-313bea3fd061-serving-cert\") pod \"kube-storage-version-migrator-operator-55bb7c4d49-7nmpt\" (UID: \"1b04f167-2855-4595-b910-313bea3fd061\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-55bb7c4d49-7nmpt" Jun 09 17:36:12.986591 ip-10-0-143-124 kubenswrapper[2552]: I0609 17:36:12.986568 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-clrpl\" (UniqueName: \"kubernetes.io/projected/1b04f167-2855-4595-b910-313bea3fd061-kube-api-access-clrpl\") pod \"kube-storage-version-migrator-operator-55bb7c4d49-7nmpt\" (UID: \"1b04f167-2855-4595-b910-313bea3fd061\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-55bb7c4d49-7nmpt" Jun 09 17:36:12.986653 ip-10-0-143-124 kubenswrapper[2552]: I0609 17:36:12.986592 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/1b04f167-2855-4595-b910-313bea3fd061-config\") pod \"kube-storage-version-migrator-operator-55bb7c4d49-7nmpt\" (UID: \"1b04f167-2855-4595-b910-313bea3fd061\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-55bb7c4d49-7nmpt" Jun 09 17:36:12.986713 ip-10-0-143-124 kubenswrapper[2552]: I0609 17:36:12.986672 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-d46gz\" (UniqueName: \"kubernetes.io/projected/6a24035e-75a9-4ed0-a190-07948fdc748a-kube-api-access-d46gz\") pod \"cluster-monitoring-operator-74bbf69bbb-mxm64\" (UID: \"6a24035e-75a9-4ed0-a190-07948fdc748a\") " pod="openshift-monitoring/cluster-monitoring-operator-74bbf69bbb-mxm64" Jun 09 17:36:12.986847 ip-10-0-143-124 kubenswrapper[2552]: I0609 17:36:12.986827 2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"telemetry-config\" (UniqueName: \"kubernetes.io/configmap/6a24035e-75a9-4ed0-a190-07948fdc748a-telemetry-config\") pod \"cluster-monitoring-operator-74bbf69bbb-mxm64\" (UID: \"6a24035e-75a9-4ed0-a190-07948fdc748a\") " pod="openshift-monitoring/cluster-monitoring-operator-74bbf69bbb-mxm64" Jun 09 17:36:12.997065 ip-10-0-143-124 kubenswrapper[2552]: I0609 17:36:12.997044 2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-d46gz\" (UniqueName: \"kubernetes.io/projected/6a24035e-75a9-4ed0-a190-07948fdc748a-kube-api-access-d46gz\") pod \"cluster-monitoring-operator-74bbf69bbb-mxm64\" (UID: \"6a24035e-75a9-4ed0-a190-07948fdc748a\") " pod="openshift-monitoring/cluster-monitoring-operator-74bbf69bbb-mxm64" Jun 09 17:36:13.014722 ip-10-0-143-124 kubenswrapper[2552]: I0609 17:36:13.014682 2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gctfs_8563ebab-ebdd-4d68-bce1-78d2a7f62992/konnectivity-agent/0.log" limit=1024 Jun 09 17:36:13.018517 ip-10-0-143-124 kubenswrapper[2552]: I0609 17:36:13.018494 2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-5fd544f5d-htqlh" Jun 09 17:36:13.071794 ip-10-0-143-124 kubenswrapper[2552]: I0609 17:36:13.071704 2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gctfs_8563ebab-ebdd-4d68-bce1-78d2a7f62992/konnectivity-agent/0.log" limit=1024 Jun 09 17:36:13.087613 ip-10-0-143-124 kubenswrapper[2552]: I0609 17:36:13.087547 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9g8wz\" (UniqueName: \"kubernetes.io/projected/40c2e0b0-7384-4684-ae6a-1e0e458ff57d-kube-api-access-9g8wz\") pod \"cluster-samples-operator-854f8b96b6-9wjdx\" (UID: \"40c2e0b0-7384-4684-ae6a-1e0e458ff57d\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-854f8b96b6-9wjdx" Jun 09 17:36:13.087763 ip-10-0-143-124 kubenswrapper[2552]: I0609 17:36:13.087642 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/40c2e0b0-7384-4684-ae6a-1e0e458ff57d-samples-operator-tls\") pod \"cluster-samples-operator-854f8b96b6-9wjdx\" (UID: \"40c2e0b0-7384-4684-ae6a-1e0e458ff57d\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-854f8b96b6-9wjdx" Jun 09 17:36:13.087763 ip-10-0-143-124 kubenswrapper[2552]: I0609 17:36:13.087693 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/1b04f167-2855-4595-b910-313bea3fd061-serving-cert\") pod \"kube-storage-version-migrator-operator-55bb7c4d49-7nmpt\" (UID: \"1b04f167-2855-4595-b910-313bea3fd061\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-55bb7c4d49-7nmpt" Jun 09 17:36:13.087763 ip-10-0-143-124 kubenswrapper[2552]: I0609 17:36:13.087734 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-clrpl\" (UniqueName: \"kubernetes.io/projected/1b04f167-2855-4595-b910-313bea3fd061-kube-api-access-clrpl\") pod \"kube-storage-version-migrator-operator-55bb7c4d49-7nmpt\" (UID: \"1b04f167-2855-4595-b910-313bea3fd061\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-55bb7c4d49-7nmpt" Jun 09 17:36:13.087930 ip-10-0-143-124 kubenswrapper[2552]: I0609 17:36:13.087764 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/1b04f167-2855-4595-b910-313bea3fd061-config\") pod \"kube-storage-version-migrator-operator-55bb7c4d49-7nmpt\" (UID: \"1b04f167-2855-4595-b910-313bea3fd061\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-55bb7c4d49-7nmpt" Jun 09 17:36:13.088530 ip-10-0-143-124 kubenswrapper[2552]: E0609 17:36:13.088241 2552 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found Jun 09 17:36:13.088530 ip-10-0-143-124 kubenswrapper[2552]: E0609 17:36:13.088311 2552 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/40c2e0b0-7384-4684-ae6a-1e0e458ff57d-samples-operator-tls podName:40c2e0b0-7384-4684-ae6a-1e0e458ff57d nodeName:}" failed. No retries permitted until 2026-06-09 17:36:13.588291819 +0000 UTC m=+177.688194464 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/40c2e0b0-7384-4684-ae6a-1e0e458ff57d-samples-operator-tls") pod "cluster-samples-operator-854f8b96b6-9wjdx" (UID: "40c2e0b0-7384-4684-ae6a-1e0e458ff57d") : secret "samples-operator-tls" not found Jun 09 17:36:13.088949 ip-10-0-143-124 kubenswrapper[2552]: I0609 17:36:13.088899 2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/configmap/1b04f167-2855-4595-b910-313bea3fd061-config\") pod \"kube-storage-version-migrator-operator-55bb7c4d49-7nmpt\" (UID: \"1b04f167-2855-4595-b910-313bea3fd061\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-55bb7c4d49-7nmpt" Jun 09 17:36:13.091660 ip-10-0-143-124 kubenswrapper[2552]: I0609 17:36:13.091639 2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/1b04f167-2855-4595-b910-313bea3fd061-serving-cert\") pod \"kube-storage-version-migrator-operator-55bb7c4d49-7nmpt\" (UID: \"1b04f167-2855-4595-b910-313bea3fd061\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-55bb7c4d49-7nmpt" Jun 09 17:36:13.097404 ip-10-0-143-124 kubenswrapper[2552]: I0609 17:36:13.097380 2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-9g8wz\" (UniqueName: \"kubernetes.io/projected/40c2e0b0-7384-4684-ae6a-1e0e458ff57d-kube-api-access-9g8wz\") pod \"cluster-samples-operator-854f8b96b6-9wjdx\" (UID: \"40c2e0b0-7384-4684-ae6a-1e0e458ff57d\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-854f8b96b6-9wjdx" Jun 09 17:36:13.097558 ip-10-0-143-124 kubenswrapper[2552]: I0609 17:36:13.097541 2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-clrpl\" (UniqueName: \"kubernetes.io/projected/1b04f167-2855-4595-b910-313bea3fd061-kube-api-access-clrpl\") pod \"kube-storage-version-migrator-operator-55bb7c4d49-7nmpt\" (UID: \"1b04f167-2855-4595-b910-313bea3fd061\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-55bb7c4d49-7nmpt" Jun 09 17:36:13.116238 ip-10-0-143-124 kubenswrapper[2552]: I0609 17:36:13.116210 2552 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-operator-896549976-7z8hc"] Jun 09 17:36:13.119056 ip-10-0-143-124 kubenswrapper[2552]: W0609 17:36:13.119031 2552 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc12461c8_8309_43fb_8384_f20159a4324b.slice/crio-cfeed7bc391a29d0a84b70981e50466b573c2fc5d84b0d4b9a5a5ac5db9d7aaf WatchSource:0}: Error finding container cfeed7bc391a29d0a84b70981e50466b573c2fc5d84b0d4b9a5a5ac5db9d7aaf: Status 404 returned error can't find the container with id cfeed7bc391a29d0a84b70981e50466b573c2fc5d84b0d4b9a5a5ac5db9d7aaf Jun 09 17:36:13.154935 ip-10-0-143-124 kubenswrapper[2552]: I0609 17:36:13.154907 2552 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/klusterlet-addon-workmgr-5fd544f5d-htqlh"] Jun 09 17:36:13.157418 ip-10-0-143-124 kubenswrapper[2552]: W0609 17:36:13.157387 2552 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod84271d52_884d_44c1_b362_59eed7dede95.slice/crio-3e8ba22afa58f7a1f1e4b33bbf8943cbc2463ab0d6a56e4daff127f804975fba WatchSource:0}: Error finding container 3e8ba22afa58f7a1f1e4b33bbf8943cbc2463ab0d6a56e4daff127f804975fba: Status 404 returned error can't find the container with id 3e8ba22afa58f7a1f1e4b33bbf8943cbc2463ab0d6a56e4daff127f804975fba Jun 09 17:36:13.204857 ip-10-0-143-124 kubenswrapper[2552]: I0609 17:36:13.204801 2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-55bb7c4d49-7nmpt" Jun 09 17:36:13.321742 ip-10-0-143-124 kubenswrapper[2552]: I0609 17:36:13.321715 2552 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-55bb7c4d49-7nmpt"] Jun 09 17:36:13.325440 ip-10-0-143-124 kubenswrapper[2552]: W0609 17:36:13.325415 2552 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1b04f167_2855_4595_b910_313bea3fd061.slice/crio-6fa226f58c445fde73375a153ddaf5d8e1debd129c2d1ebce6a6f545c2baee11 WatchSource:0}: Error finding container 6fa226f58c445fde73375a153ddaf5d8e1debd129c2d1ebce6a6f545c2baee11: Status 404 returned error can't find the container with id 6fa226f58c445fde73375a153ddaf5d8e1debd129c2d1ebce6a6f545c2baee11 Jun 09 17:36:13.391228 ip-10-0-143-124 kubenswrapper[2552]: I0609 17:36:13.391198 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/2f51b34b-d7df-4f41-b046-a58499a5e16a-registry-tls\") pod \"image-registry-7df4944668-6mxtj\" (UID: \"2f51b34b-d7df-4f41-b046-a58499a5e16a\") " pod="openshift-image-registry/image-registry-7df4944668-6mxtj" Jun 09 17:36:13.391375 ip-10-0-143-124 kubenswrapper[2552]: E0609 17:36:13.391355 2552 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jun 09 17:36:13.391416 ip-10-0-143-124 kubenswrapper[2552]: E0609 17:36:13.391379 2552 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-7df4944668-6mxtj: secret "image-registry-tls" not found Jun 09 17:36:13.391449 ip-10-0-143-124 kubenswrapper[2552]: E0609 17:36:13.391436 2552 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/2f51b34b-d7df-4f41-b046-a58499a5e16a-registry-tls podName:2f51b34b-d7df-4f41-b046-a58499a5e16a nodeName:}" failed. No retries permitted until 2026-06-09 17:36:14.391420071 +0000 UTC m=+178.491322702 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/2f51b34b-d7df-4f41-b046-a58499a5e16a-registry-tls") pod "image-registry-7df4944668-6mxtj" (UID: "2f51b34b-d7df-4f41-b046-a58499a5e16a") : secret "image-registry-tls" not found Jun 09 17:36:13.492247 ip-10-0-143-124 kubenswrapper[2552]: I0609 17:36:13.492217 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/6a24035e-75a9-4ed0-a190-07948fdc748a-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-74bbf69bbb-mxm64\" (UID: \"6a24035e-75a9-4ed0-a190-07948fdc748a\") " pod="openshift-monitoring/cluster-monitoring-operator-74bbf69bbb-mxm64" Jun 09 17:36:13.492370 ip-10-0-143-124 kubenswrapper[2552]: E0609 17:36:13.492341 2552 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found Jun 09 17:36:13.492417 ip-10-0-143-124 kubenswrapper[2552]: E0609 17:36:13.492405 2552 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/6a24035e-75a9-4ed0-a190-07948fdc748a-cluster-monitoring-operator-tls podName:6a24035e-75a9-4ed0-a190-07948fdc748a nodeName:}" failed. No retries permitted until 2026-06-09 17:36:14.492384671 +0000 UTC m=+178.592287299 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/6a24035e-75a9-4ed0-a190-07948fdc748a-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-74bbf69bbb-mxm64" (UID: "6a24035e-75a9-4ed0-a190-07948fdc748a") : secret "cluster-monitoring-operator-tls" not found Jun 09 17:36:13.593041 ip-10-0-143-124 kubenswrapper[2552]: I0609 17:36:13.592999 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/40c2e0b0-7384-4684-ae6a-1e0e458ff57d-samples-operator-tls\") pod \"cluster-samples-operator-854f8b96b6-9wjdx\" (UID: \"40c2e0b0-7384-4684-ae6a-1e0e458ff57d\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-854f8b96b6-9wjdx" Jun 09 17:36:13.593174 ip-10-0-143-124 kubenswrapper[2552]: E0609 17:36:13.593145 2552 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found Jun 09 17:36:13.593216 ip-10-0-143-124 kubenswrapper[2552]: E0609 17:36:13.593198 2552 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/40c2e0b0-7384-4684-ae6a-1e0e458ff57d-samples-operator-tls podName:40c2e0b0-7384-4684-ae6a-1e0e458ff57d nodeName:}" failed. No retries permitted until 2026-06-09 17:36:14.593185033 +0000 UTC m=+178.693087661 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/40c2e0b0-7384-4684-ae6a-1e0e458ff57d-samples-operator-tls") pod "cluster-samples-operator-854f8b96b6-9wjdx" (UID: "40c2e0b0-7384-4684-ae6a-1e0e458ff57d") : secret "samples-operator-tls" not found Jun 09 17:36:13.983966 ip-10-0-143-124 kubenswrapper[2552]: I0609 17:36:13.983795 2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-5fd544f5d-htqlh" event={"ID":"84271d52-884d-44c1-b362-59eed7dede95","Type":"ContainerStarted","Data":"3e8ba22afa58f7a1f1e4b33bbf8943cbc2463ab0d6a56e4daff127f804975fba"} Jun 09 17:36:13.985750 ip-10-0-143-124 kubenswrapper[2552]: I0609 17:36:13.985684 2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-55bb7c4d49-7nmpt" event={"ID":"1b04f167-2855-4595-b910-313bea3fd061","Type":"ContainerStarted","Data":"6fa226f58c445fde73375a153ddaf5d8e1debd129c2d1ebce6a6f545c2baee11"} Jun 09 17:36:13.987072 ip-10-0-143-124 kubenswrapper[2552]: I0609 17:36:13.987024 2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-operator-896549976-7z8hc" event={"ID":"c12461c8-8309-43fb-8384-f20159a4324b","Type":"ContainerStarted","Data":"cfeed7bc391a29d0a84b70981e50466b573c2fc5d84b0d4b9a5a5ac5db9d7aaf"} Jun 09 17:36:14.400748 ip-10-0-143-124 kubenswrapper[2552]: I0609 17:36:14.400707 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/2f51b34b-d7df-4f41-b046-a58499a5e16a-registry-tls\") pod \"image-registry-7df4944668-6mxtj\" (UID: \"2f51b34b-d7df-4f41-b046-a58499a5e16a\") " pod="openshift-image-registry/image-registry-7df4944668-6mxtj" Jun 09 17:36:14.401058 ip-10-0-143-124 kubenswrapper[2552]: E0609 17:36:14.400871 2552 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jun 09 17:36:14.401058 ip-10-0-143-124 kubenswrapper[2552]: E0609 17:36:14.400894 2552 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-7df4944668-6mxtj: secret "image-registry-tls" not found Jun 09 17:36:14.401058 ip-10-0-143-124 kubenswrapper[2552]: E0609 17:36:14.400960 2552 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/2f51b34b-d7df-4f41-b046-a58499a5e16a-registry-tls podName:2f51b34b-d7df-4f41-b046-a58499a5e16a nodeName:}" failed. No retries permitted until 2026-06-09 17:36:16.40094166 +0000 UTC m=+180.500844301 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/2f51b34b-d7df-4f41-b046-a58499a5e16a-registry-tls") pod "image-registry-7df4944668-6mxtj" (UID: "2f51b34b-d7df-4f41-b046-a58499a5e16a") : secret "image-registry-tls" not found Jun 09 17:36:14.502171 ip-10-0-143-124 kubenswrapper[2552]: I0609 17:36:14.501401 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/6a24035e-75a9-4ed0-a190-07948fdc748a-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-74bbf69bbb-mxm64\" (UID: \"6a24035e-75a9-4ed0-a190-07948fdc748a\") " pod="openshift-monitoring/cluster-monitoring-operator-74bbf69bbb-mxm64" Jun 09 17:36:14.502171 ip-10-0-143-124 kubenswrapper[2552]: E0609 17:36:14.501764 2552 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found Jun 09 17:36:14.502171 ip-10-0-143-124 kubenswrapper[2552]: E0609 17:36:14.501825 2552 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/6a24035e-75a9-4ed0-a190-07948fdc748a-cluster-monitoring-operator-tls podName:6a24035e-75a9-4ed0-a190-07948fdc748a nodeName:}" failed. No retries permitted until 2026-06-09 17:36:16.501806299 +0000 UTC m=+180.601708934 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/6a24035e-75a9-4ed0-a190-07948fdc748a-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-74bbf69bbb-mxm64" (UID: "6a24035e-75a9-4ed0-a190-07948fdc748a") : secret "cluster-monitoring-operator-tls" not found Jun 09 17:36:14.602068 ip-10-0-143-124 kubenswrapper[2552]: I0609 17:36:14.601882 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/40c2e0b0-7384-4684-ae6a-1e0e458ff57d-samples-operator-tls\") pod \"cluster-samples-operator-854f8b96b6-9wjdx\" (UID: \"40c2e0b0-7384-4684-ae6a-1e0e458ff57d\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-854f8b96b6-9wjdx" Jun 09 17:36:14.602068 ip-10-0-143-124 kubenswrapper[2552]: E0609 17:36:14.602051 2552 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found Jun 09 17:36:14.602301 ip-10-0-143-124 kubenswrapper[2552]: E0609 17:36:14.602128 2552 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/40c2e0b0-7384-4684-ae6a-1e0e458ff57d-samples-operator-tls podName:40c2e0b0-7384-4684-ae6a-1e0e458ff57d nodeName:}" failed. No retries permitted until 2026-06-09 17:36:16.602105848 +0000 UTC m=+180.702008497 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/40c2e0b0-7384-4684-ae6a-1e0e458ff57d-samples-operator-tls") pod "cluster-samples-operator-854f8b96b6-9wjdx" (UID: "40c2e0b0-7384-4684-ae6a-1e0e458ff57d") : secret "samples-operator-tls" not found Jun 09 17:36:15.212829 ip-10-0-143-124 kubenswrapper[2552]: I0609 17:36:15.212744 2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gctfs_8563ebab-ebdd-4d68-bce1-78d2a7f62992/konnectivity-agent/0.log" limit=1024 Jun 09 17:36:15.271427 ip-10-0-143-124 kubenswrapper[2552]: I0609 17:36:15.271340 2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gctfs_8563ebab-ebdd-4d68-bce1-78d2a7f62992/konnectivity-agent/0.log" limit=1024 Jun 09 17:36:16.417925 ip-10-0-143-124 kubenswrapper[2552]: I0609 17:36:16.417885 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/2f51b34b-d7df-4f41-b046-a58499a5e16a-registry-tls\") pod \"image-registry-7df4944668-6mxtj\" (UID: \"2f51b34b-d7df-4f41-b046-a58499a5e16a\") " pod="openshift-image-registry/image-registry-7df4944668-6mxtj" Jun 09 17:36:16.418304 ip-10-0-143-124 kubenswrapper[2552]: E0609 17:36:16.418030 2552 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jun 09 17:36:16.418304 ip-10-0-143-124 kubenswrapper[2552]: E0609 17:36:16.418045 2552 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-7df4944668-6mxtj: secret "image-registry-tls" not found Jun 09 17:36:16.418304 ip-10-0-143-124 kubenswrapper[2552]: E0609 17:36:16.418107 2552 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/2f51b34b-d7df-4f41-b046-a58499a5e16a-registry-tls podName:2f51b34b-d7df-4f41-b046-a58499a5e16a nodeName:}" failed. No retries permitted until 2026-06-09 17:36:20.418088236 +0000 UTC m=+184.517990869 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/2f51b34b-d7df-4f41-b046-a58499a5e16a-registry-tls") pod "image-registry-7df4944668-6mxtj" (UID: "2f51b34b-d7df-4f41-b046-a58499a5e16a") : secret "image-registry-tls" not found Jun 09 17:36:16.519118 ip-10-0-143-124 kubenswrapper[2552]: I0609 17:36:16.519077 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/6a24035e-75a9-4ed0-a190-07948fdc748a-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-74bbf69bbb-mxm64\" (UID: \"6a24035e-75a9-4ed0-a190-07948fdc748a\") " pod="openshift-monitoring/cluster-monitoring-operator-74bbf69bbb-mxm64" Jun 09 17:36:16.519284 ip-10-0-143-124 kubenswrapper[2552]: E0609 17:36:16.519258 2552 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found Jun 09 17:36:16.519372 ip-10-0-143-124 kubenswrapper[2552]: E0609 17:36:16.519361 2552 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/6a24035e-75a9-4ed0-a190-07948fdc748a-cluster-monitoring-operator-tls podName:6a24035e-75a9-4ed0-a190-07948fdc748a nodeName:}" failed. No retries permitted until 2026-06-09 17:36:20.519337374 +0000 UTC m=+184.619240020 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/6a24035e-75a9-4ed0-a190-07948fdc748a-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-74bbf69bbb-mxm64" (UID: "6a24035e-75a9-4ed0-a190-07948fdc748a") : secret "cluster-monitoring-operator-tls" not found Jun 09 17:36:16.619893 ip-10-0-143-124 kubenswrapper[2552]: I0609 17:36:16.619863 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/40c2e0b0-7384-4684-ae6a-1e0e458ff57d-samples-operator-tls\") pod \"cluster-samples-operator-854f8b96b6-9wjdx\" (UID: \"40c2e0b0-7384-4684-ae6a-1e0e458ff57d\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-854f8b96b6-9wjdx" Jun 09 17:36:16.620065 ip-10-0-143-124 kubenswrapper[2552]: E0609 17:36:16.620044 2552 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found Jun 09 17:36:16.620140 ip-10-0-143-124 kubenswrapper[2552]: E0609 17:36:16.620129 2552 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/40c2e0b0-7384-4684-ae6a-1e0e458ff57d-samples-operator-tls podName:40c2e0b0-7384-4684-ae6a-1e0e458ff57d nodeName:}" failed. No retries permitted until 2026-06-09 17:36:20.620106848 +0000 UTC m=+184.720009493 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/40c2e0b0-7384-4684-ae6a-1e0e458ff57d-samples-operator-tls") pod "cluster-samples-operator-854f8b96b6-9wjdx" (UID: "40c2e0b0-7384-4684-ae6a-1e0e458ff57d") : secret "samples-operator-tls" not found Jun 09 17:36:18.302066 ip-10-0-143-124 kubenswrapper[2552]: I0609 17:36:18.302031 2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gctfs_8563ebab-ebdd-4d68-bce1-78d2a7f62992/konnectivity-agent/0.log" limit=1024 Jun 09 17:36:18.358003 ip-10-0-143-124 kubenswrapper[2552]: I0609 17:36:18.357972 2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gctfs_8563ebab-ebdd-4d68-bce1-78d2a7f62992/konnectivity-agent/0.log" limit=1024 Jun 09 17:36:18.768126 ip-10-0-143-124 kubenswrapper[2552]: I0609 17:36:18.768083 2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gctfs_8563ebab-ebdd-4d68-bce1-78d2a7f62992/konnectivity-agent/0.log" limit=1024 Jun 09 17:36:19.005193 ip-10-0-143-124 kubenswrapper[2552]: I0609 17:36:19.005159 2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-55bb7c4d49-7nmpt" event={"ID":"1b04f167-2855-4595-b910-313bea3fd061","Type":"ContainerStarted","Data":"838a41e53f9e114118b3231882930d37f61f36e382d94fd923e8d07be7c9dca8"} Jun 09 17:36:19.006671 ip-10-0-143-124 kubenswrapper[2552]: I0609 17:36:19.006637 2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-operator-896549976-7z8hc" event={"ID":"c12461c8-8309-43fb-8384-f20159a4324b","Type":"ContainerStarted","Data":"b131da530ce12486d3ba06a0da86663555afcda2b09ddd90c75aabaacc2dcf9f"} Jun 09 17:36:19.008063 ip-10-0-143-124 kubenswrapper[2552]: I0609 17:36:19.008036 2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-5fd544f5d-htqlh" event={"ID":"84271d52-884d-44c1-b362-59eed7dede95","Type":"ContainerStarted","Data":"cbb8ef81f757d7c3d75ce6491d7f5fe1711988c46c2e0c7725add3d6c3e8aef5"} Jun 09 17:36:19.008251 ip-10-0-143-124 kubenswrapper[2552]: I0609 17:36:19.008235 2552 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-5fd544f5d-htqlh" Jun 09 17:36:19.010034 ip-10-0-143-124 kubenswrapper[2552]: I0609 17:36:19.010011 2552 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-5fd544f5d-htqlh" Jun 09 17:36:19.017866 ip-10-0-143-124 kubenswrapper[2552]: I0609 17:36:19.017841 2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gctfs_8563ebab-ebdd-4d68-bce1-78d2a7f62992/konnectivity-agent/0.log" limit=1024 Jun 09 17:36:19.027547 ip-10-0-143-124 kubenswrapper[2552]: I0609 17:36:19.027467 2552 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-55bb7c4d49-7nmpt" podStartSLOduration=2.37175592 podStartE2EDuration="7.027450795s" totalImagesPullingTime="4.655694875s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-09 17:36:12 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-09 17:36:19.025899122 +0000 UTC m=+183.125801771" watchObservedRunningTime="2026-06-09 17:36:19.027450795 +0000 UTC m=+183.127353446" Jun 09 17:36:19.042391 ip-10-0-143-124 kubenswrapper[2552]: I0609 17:36:19.042348 2552 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-5fd544f5d-htqlh" podStartSLOduration=2.205265774 podStartE2EDuration="7.04233395s" totalImagesPullingTime="4.837068176s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-09 17:36:12 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-09 17:36:19.042036679 +0000 UTC m=+183.141939330" watchObservedRunningTime="2026-06-09 17:36:19.04233395 +0000 UTC m=+183.142236578" Jun 09 17:36:19.062423 ip-10-0-143-124 kubenswrapper[2552]: I0609 17:36:19.062384 2552 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-insights/insights-operator-896549976-7z8hc" podStartSLOduration=2.204037462 podStartE2EDuration="7.062369872s" totalImagesPullingTime="4.85833241s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-09 17:36:12 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-09 17:36:19.061200587 +0000 UTC m=+183.161103237" watchObservedRunningTime="2026-06-09 17:36:19.062369872 +0000 UTC m=+183.162272547" Jun 09 17:36:19.118176 ip-10-0-143-124 kubenswrapper[2552]: I0609 17:36:19.118143 2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gctfs_8563ebab-ebdd-4d68-bce1-78d2a7f62992/konnectivity-agent/0.log" limit=1024 Jun 09 17:36:19.219332 ip-10-0-143-124 kubenswrapper[2552]: I0609 17:36:19.219290 2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gctfs_8563ebab-ebdd-4d68-bce1-78d2a7f62992/konnectivity-agent/0.log" limit=1024 Jun 09 17:36:19.319803 ip-10-0-143-124 kubenswrapper[2552]: I0609 17:36:19.319709 2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gctfs_8563ebab-ebdd-4d68-bce1-78d2a7f62992/konnectivity-agent/0.log" limit=1024 Jun 09 17:36:19.671772 ip-10-0-143-124 kubenswrapper[2552]: I0609 17:36:19.671670 2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gctfs_8563ebab-ebdd-4d68-bce1-78d2a7f62992/konnectivity-agent/0.log" limit=1024 Jun 09 17:36:19.772993 ip-10-0-143-124 kubenswrapper[2552]: I0609 17:36:19.772957 2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gctfs_8563ebab-ebdd-4d68-bce1-78d2a7f62992/konnectivity-agent/0.log" limit=1024 Jun 09 17:36:20.159077 ip-10-0-143-124 kubenswrapper[2552]: I0609 17:36:20.159045 2552 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-kube-storage-version-migrator/migrator-955ffdf5f-lm9ds"] Jun 09 17:36:20.163357 ip-10-0-143-124 kubenswrapper[2552]: I0609 17:36:20.163335 2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-storage-version-migrator/migrator-955ffdf5f-lm9ds" Jun 09 17:36:20.165932 ip-10-0-143-124 kubenswrapper[2552]: I0609 17:36:20.165905 2552 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator\"/\"openshift-service-ca.crt\"" Jun 09 17:36:20.166036 ip-10-0-143-124 kubenswrapper[2552]: I0609 17:36:20.165990 2552 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator\"/\"kube-root-ca.crt\"" Jun 09 17:36:20.166920 ip-10-0-143-124 kubenswrapper[2552]: I0609 17:36:20.166906 2552 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-kube-storage-version-migrator\"/\"kube-storage-version-migrator-sa-dockercfg-t4s5m\"" Jun 09 17:36:20.172315 ip-10-0-143-124 kubenswrapper[2552]: I0609 17:36:20.172295 2552 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-kube-storage-version-migrator/migrator-955ffdf5f-lm9ds"] Jun 09 17:36:20.205102 ip-10-0-143-124 kubenswrapper[2552]: I0609 17:36:20.205073 2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gctfs_8563ebab-ebdd-4d68-bce1-78d2a7f62992/konnectivity-agent/0.log" limit=1024 Jun 09 17:36:20.268650 ip-10-0-143-124 kubenswrapper[2552]: I0609 17:36:20.268619 2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gctfs_8563ebab-ebdd-4d68-bce1-78d2a7f62992/konnectivity-agent/0.log" limit=1024 Jun 09 17:36:20.350840 ip-10-0-143-124 kubenswrapper[2552]: I0609 17:36:20.350804 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-dhftf\" (UniqueName: \"kubernetes.io/projected/b3e3cf1c-7ca7-4b77-ac16-dd2195e08e1e-kube-api-access-dhftf\") pod \"migrator-955ffdf5f-lm9ds\" (UID: \"b3e3cf1c-7ca7-4b77-ac16-dd2195e08e1e\") " pod="openshift-kube-storage-version-migrator/migrator-955ffdf5f-lm9ds" Jun 09 17:36:20.451769 ip-10-0-143-124 kubenswrapper[2552]: I0609 17:36:20.451694 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-dhftf\" (UniqueName: \"kubernetes.io/projected/b3e3cf1c-7ca7-4b77-ac16-dd2195e08e1e-kube-api-access-dhftf\") pod \"migrator-955ffdf5f-lm9ds\" (UID: \"b3e3cf1c-7ca7-4b77-ac16-dd2195e08e1e\") " pod="openshift-kube-storage-version-migrator/migrator-955ffdf5f-lm9ds" Jun 09 17:36:20.451769 ip-10-0-143-124 kubenswrapper[2552]: I0609 17:36:20.451754 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/2f51b34b-d7df-4f41-b046-a58499a5e16a-registry-tls\") pod \"image-registry-7df4944668-6mxtj\" (UID: \"2f51b34b-d7df-4f41-b046-a58499a5e16a\") " pod="openshift-image-registry/image-registry-7df4944668-6mxtj" Jun 09 17:36:20.451944 ip-10-0-143-124 kubenswrapper[2552]: E0609 17:36:20.451870 2552 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jun 09 17:36:20.451944 ip-10-0-143-124 kubenswrapper[2552]: E0609 17:36:20.451881 2552 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-7df4944668-6mxtj: secret "image-registry-tls" not found Jun 09 17:36:20.451944 ip-10-0-143-124 kubenswrapper[2552]: E0609 17:36:20.451941 2552 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/2f51b34b-d7df-4f41-b046-a58499a5e16a-registry-tls podName:2f51b34b-d7df-4f41-b046-a58499a5e16a nodeName:}" failed. No retries permitted until 2026-06-09 17:36:28.451924752 +0000 UTC m=+192.551827380 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/2f51b34b-d7df-4f41-b046-a58499a5e16a-registry-tls") pod "image-registry-7df4944668-6mxtj" (UID: "2f51b34b-d7df-4f41-b046-a58499a5e16a") : secret "image-registry-tls" not found Jun 09 17:36:20.460063 ip-10-0-143-124 kubenswrapper[2552]: I0609 17:36:20.460033 2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-dhftf\" (UniqueName: \"kubernetes.io/projected/b3e3cf1c-7ca7-4b77-ac16-dd2195e08e1e-kube-api-access-dhftf\") pod \"migrator-955ffdf5f-lm9ds\" (UID: \"b3e3cf1c-7ca7-4b77-ac16-dd2195e08e1e\") " pod="openshift-kube-storage-version-migrator/migrator-955ffdf5f-lm9ds" Jun 09 17:36:20.472953 ip-10-0-143-124 kubenswrapper[2552]: I0609 17:36:20.472931 2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-storage-version-migrator/migrator-955ffdf5f-lm9ds" Jun 09 17:36:20.552286 ip-10-0-143-124 kubenswrapper[2552]: I0609 17:36:20.552250 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/6a24035e-75a9-4ed0-a190-07948fdc748a-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-74bbf69bbb-mxm64\" (UID: \"6a24035e-75a9-4ed0-a190-07948fdc748a\") " pod="openshift-monitoring/cluster-monitoring-operator-74bbf69bbb-mxm64" Jun 09 17:36:20.552435 ip-10-0-143-124 kubenswrapper[2552]: E0609 17:36:20.552418 2552 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found Jun 09 17:36:20.552779 ip-10-0-143-124 kubenswrapper[2552]: E0609 17:36:20.552496 2552 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/6a24035e-75a9-4ed0-a190-07948fdc748a-cluster-monitoring-operator-tls podName:6a24035e-75a9-4ed0-a190-07948fdc748a nodeName:}" failed. No retries permitted until 2026-06-09 17:36:28.552475842 +0000 UTC m=+192.652378487 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/6a24035e-75a9-4ed0-a190-07948fdc748a-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-74bbf69bbb-mxm64" (UID: "6a24035e-75a9-4ed0-a190-07948fdc748a") : secret "cluster-monitoring-operator-tls" not found Jun 09 17:36:20.601483 ip-10-0-143-124 kubenswrapper[2552]: W0609 17:36:20.601455 2552 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb3e3cf1c_7ca7_4b77_ac16_dd2195e08e1e.slice/crio-28eb4d6a4eb07aaef2f867c282536e3c567531b7ae24fc6c1f73eb86d5c65c01 WatchSource:0}: Error finding container 28eb4d6a4eb07aaef2f867c282536e3c567531b7ae24fc6c1f73eb86d5c65c01: Status 404 returned error can't find the container with id 28eb4d6a4eb07aaef2f867c282536e3c567531b7ae24fc6c1f73eb86d5c65c01 Jun 09 17:36:20.602034 ip-10-0-143-124 kubenswrapper[2552]: I0609 17:36:20.602004 2552 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-kube-storage-version-migrator/migrator-955ffdf5f-lm9ds"] Jun 09 17:36:20.646038 ip-10-0-143-124 kubenswrapper[2552]: I0609 17:36:20.646003 2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gctfs_8563ebab-ebdd-4d68-bce1-78d2a7f62992/konnectivity-agent/0.log" limit=1024 Jun 09 17:36:20.653202 ip-10-0-143-124 kubenswrapper[2552]: I0609 17:36:20.653184 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/40c2e0b0-7384-4684-ae6a-1e0e458ff57d-samples-operator-tls\") pod \"cluster-samples-operator-854f8b96b6-9wjdx\" (UID: \"40c2e0b0-7384-4684-ae6a-1e0e458ff57d\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-854f8b96b6-9wjdx" Jun 09 17:36:20.653316 ip-10-0-143-124 kubenswrapper[2552]: E0609 17:36:20.653303 2552 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found Jun 09 17:36:20.653361 ip-10-0-143-124 kubenswrapper[2552]: E0609 17:36:20.653353 2552 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/40c2e0b0-7384-4684-ae6a-1e0e458ff57d-samples-operator-tls podName:40c2e0b0-7384-4684-ae6a-1e0e458ff57d nodeName:}" failed. No retries permitted until 2026-06-09 17:36:28.653339376 +0000 UTC m=+192.753242004 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/40c2e0b0-7384-4684-ae6a-1e0e458ff57d-samples-operator-tls") pod "cluster-samples-operator-854f8b96b6-9wjdx" (UID: "40c2e0b0-7384-4684-ae6a-1e0e458ff57d") : secret "samples-operator-tls" not found Jun 09 17:36:20.708614 ip-10-0-143-124 kubenswrapper[2552]: I0609 17:36:20.708525 2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gctfs_8563ebab-ebdd-4d68-bce1-78d2a7f62992/konnectivity-agent/0.log" limit=1024 Jun 09 17:36:21.014926 ip-10-0-143-124 kubenswrapper[2552]: I0609 17:36:21.014896 2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator/migrator-955ffdf5f-lm9ds" event={"ID":"b3e3cf1c-7ca7-4b77-ac16-dd2195e08e1e","Type":"ContainerStarted","Data":"28eb4d6a4eb07aaef2f867c282536e3c567531b7ae24fc6c1f73eb86d5c65c01"} Jun 09 17:36:21.590638 ip-10-0-143-124 kubenswrapper[2552]: I0609 17:36:21.590607 2552 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-qbd4p_f077d86b-598b-4398-9376-2956816fa47d/dns-node-resolver/0.log" Jun 09 17:36:21.617959 ip-10-0-143-124 kubenswrapper[2552]: I0609 17:36:21.617920 2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gctfs_8563ebab-ebdd-4d68-bce1-78d2a7f62992/konnectivity-agent/0.log" limit=1024 Jun 09 17:36:21.731790 ip-10-0-143-124 kubenswrapper[2552]: I0609 17:36:21.731751 2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gctfs_8563ebab-ebdd-4d68-bce1-78d2a7f62992/konnectivity-agent/0.log" limit=1024 Jun 09 17:36:21.919853 ip-10-0-143-124 kubenswrapper[2552]: I0609 17:36:21.919801 2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gctfs_8563ebab-ebdd-4d68-bce1-78d2a7f62992/konnectivity-agent/0.log" limit=1024 Jun 09 17:36:22.019488 ip-10-0-143-124 kubenswrapper[2552]: I0609 17:36:22.019460 2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gctfs_8563ebab-ebdd-4d68-bce1-78d2a7f62992/konnectivity-agent/0.log" limit=1024 Jun 09 17:36:22.019731 ip-10-0-143-124 kubenswrapper[2552]: I0609 17:36:22.019708 2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator/migrator-955ffdf5f-lm9ds" event={"ID":"b3e3cf1c-7ca7-4b77-ac16-dd2195e08e1e","Type":"ContainerStarted","Data":"b901979742915387a1a8cdaf29c6d39c53fb519d8cc6d28b50b9f48105b5b852"} Jun 09 17:36:22.019795 ip-10-0-143-124 kubenswrapper[2552]: I0609 17:36:22.019763 2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator/migrator-955ffdf5f-lm9ds" event={"ID":"b3e3cf1c-7ca7-4b77-ac16-dd2195e08e1e","Type":"ContainerStarted","Data":"e029d1fdee0c2de1569219ea5656b7a9fcac522c47b20d32e9a7fc19c7a52ca1"} Jun 09 17:36:22.039560 ip-10-0-143-124 kubenswrapper[2552]: I0609 17:36:22.039515 2552 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-kube-storage-version-migrator/migrator-955ffdf5f-lm9ds" podStartSLOduration=0.902033051 podStartE2EDuration="2.039500201s" totalImagesPullingTime="1.13746715s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-09 17:36:20 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-09 17:36:22.038181309 +0000 UTC m=+186.138083961" watchObservedRunningTime="2026-06-09 17:36:22.039500201 +0000 UTC m=+186.139402874" Jun 09 17:36:22.325257 ip-10-0-143-124 kubenswrapper[2552]: I0609 17:36:22.325223 2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gctfs_8563ebab-ebdd-4d68-bce1-78d2a7f62992/konnectivity-agent/0.log" limit=1024 Jun 09 17:36:22.425163 ip-10-0-143-124 kubenswrapper[2552]: I0609 17:36:22.425124 2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gctfs_8563ebab-ebdd-4d68-bce1-78d2a7f62992/konnectivity-agent/0.log" limit=1024 Jun 09 17:36:22.527242 ip-10-0-143-124 kubenswrapper[2552]: I0609 17:36:22.527208 2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gctfs_8563ebab-ebdd-4d68-bce1-78d2a7f62992/konnectivity-agent/0.log" limit=1024 Jun 09 17:36:22.590711 ip-10-0-143-124 kubenswrapper[2552]: I0609 17:36:22.590642 2552 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-tb8b5_2ef810f8-073d-4b45-ad02-2e098f31ed47/node-ca/0.log" Jun 09 17:36:22.625768 ip-10-0-143-124 kubenswrapper[2552]: I0609 17:36:22.625739 2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gctfs_8563ebab-ebdd-4d68-bce1-78d2a7f62992/konnectivity-agent/0.log" limit=1024 Jun 09 17:36:22.726657 ip-10-0-143-124 kubenswrapper[2552]: I0609 17:36:22.726626 2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gctfs_8563ebab-ebdd-4d68-bce1-78d2a7f62992/konnectivity-agent/0.log" limit=1024 Jun 09 17:36:23.021807 ip-10-0-143-124 kubenswrapper[2552]: I0609 17:36:23.021775 2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gctfs_8563ebab-ebdd-4d68-bce1-78d2a7f62992/konnectivity-agent/0.log" limit=1024 Jun 09 17:36:23.593419 ip-10-0-143-124 kubenswrapper[2552]: I0609 17:36:23.593386 2552 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-w8w2r_389f25e7-e5ca-48dc-884b-a5046ab1dc6b/serve-healthcheck-canary/0.log" Jun 09 17:36:24.031414 ip-10-0-143-124 kubenswrapper[2552]: I0609 17:36:24.031378 2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gctfs_8563ebab-ebdd-4d68-bce1-78d2a7f62992/konnectivity-agent/0.log" limit=1024 Jun 09 17:36:24.430659 ip-10-0-143-124 kubenswrapper[2552]: I0609 17:36:24.430558 2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gctfs_8563ebab-ebdd-4d68-bce1-78d2a7f62992/konnectivity-agent/0.log" limit=1024 Jun 09 17:36:24.625795 ip-10-0-143-124 kubenswrapper[2552]: I0609 17:36:24.625755 2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gctfs_8563ebab-ebdd-4d68-bce1-78d2a7f62992/konnectivity-agent/0.log" limit=1024 Jun 09 17:36:24.703464 ip-10-0-143-124 kubenswrapper[2552]: I0609 17:36:24.703386 2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gctfs_8563ebab-ebdd-4d68-bce1-78d2a7f62992/konnectivity-agent/0.log" limit=1024 Jun 09 17:36:24.817836 ip-10-0-143-124 kubenswrapper[2552]: I0609 17:36:24.817803 2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gctfs_8563ebab-ebdd-4d68-bce1-78d2a7f62992/konnectivity-agent/0.log" limit=1024 Jun 09 17:36:25.018710 ip-10-0-143-124 kubenswrapper[2552]: I0609 17:36:25.018678 2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gctfs_8563ebab-ebdd-4d68-bce1-78d2a7f62992/konnectivity-agent/0.log" limit=1024 Jun 09 17:36:25.820520 ip-10-0-143-124 kubenswrapper[2552]: I0609 17:36:25.820486 2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gctfs_8563ebab-ebdd-4d68-bce1-78d2a7f62992/konnectivity-agent/0.log" limit=1024 Jun 09 17:36:26.222802 ip-10-0-143-124 kubenswrapper[2552]: I0609 17:36:26.222722 2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gctfs_8563ebab-ebdd-4d68-bce1-78d2a7f62992/konnectivity-agent/0.log" limit=1024 Jun 09 17:36:26.277084 ip-10-0-143-124 kubenswrapper[2552]: I0609 17:36:26.277048 2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gctfs_8563ebab-ebdd-4d68-bce1-78d2a7f62992/konnectivity-agent/0.log" limit=1024 Jun 09 17:36:26.626261 ip-10-0-143-124 kubenswrapper[2552]: I0609 17:36:26.626226 2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gctfs_8563ebab-ebdd-4d68-bce1-78d2a7f62992/konnectivity-agent/0.log" limit=1024 Jun 09 17:36:26.683063 ip-10-0-143-124 kubenswrapper[2552]: I0609 17:36:26.683023 2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gctfs_8563ebab-ebdd-4d68-bce1-78d2a7f62992/konnectivity-agent/0.log" limit=1024 Jun 09 17:36:26.822964 ip-10-0-143-124 kubenswrapper[2552]: I0609 17:36:26.822928 2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gctfs_8563ebab-ebdd-4d68-bce1-78d2a7f62992/konnectivity-agent/0.log" limit=1024 Jun 09 17:36:27.220741 ip-10-0-143-124 kubenswrapper[2552]: I0609 17:36:27.220706 2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gctfs_8563ebab-ebdd-4d68-bce1-78d2a7f62992/konnectivity-agent/0.log" limit=1024 Jun 09 17:36:28.019760 ip-10-0-143-124 kubenswrapper[2552]: I0609 17:36:28.019715 2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gctfs_8563ebab-ebdd-4d68-bce1-78d2a7f62992/konnectivity-agent/0.log" limit=1024 Jun 09 17:36:28.225250 ip-10-0-143-124 kubenswrapper[2552]: I0609 17:36:28.225217 2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gctfs_8563ebab-ebdd-4d68-bce1-78d2a7f62992/konnectivity-agent/0.log" limit=1024 Jun 09 17:36:28.512830 ip-10-0-143-124 kubenswrapper[2552]: I0609 17:36:28.512791 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/2f51b34b-d7df-4f41-b046-a58499a5e16a-registry-tls\") pod \"image-registry-7df4944668-6mxtj\" (UID: \"2f51b34b-d7df-4f41-b046-a58499a5e16a\") " pod="openshift-image-registry/image-registry-7df4944668-6mxtj" Jun 09 17:36:28.515238 ip-10-0-143-124 kubenswrapper[2552]: I0609 17:36:28.515211 2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/2f51b34b-d7df-4f41-b046-a58499a5e16a-registry-tls\") pod \"image-registry-7df4944668-6mxtj\" (UID: \"2f51b34b-d7df-4f41-b046-a58499a5e16a\") " pod="openshift-image-registry/image-registry-7df4944668-6mxtj" Jun 09 17:36:28.581500 ip-10-0-143-124 kubenswrapper[2552]: I0609 17:36:28.581466 2552 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"registry-dockercfg-svw84\"" Jun 09 17:36:28.589759 ip-10-0-143-124 kubenswrapper[2552]: I0609 17:36:28.589740 2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-7df4944668-6mxtj" Jun 09 17:36:28.614017 ip-10-0-143-124 kubenswrapper[2552]: I0609 17:36:28.613974 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/6a24035e-75a9-4ed0-a190-07948fdc748a-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-74bbf69bbb-mxm64\" (UID: \"6a24035e-75a9-4ed0-a190-07948fdc748a\") " pod="openshift-monitoring/cluster-monitoring-operator-74bbf69bbb-mxm64" Jun 09 17:36:28.614138 ip-10-0-143-124 kubenswrapper[2552]: E0609 17:36:28.614117 2552 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found Jun 09 17:36:28.614201 ip-10-0-143-124 kubenswrapper[2552]: E0609 17:36:28.614184 2552 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/6a24035e-75a9-4ed0-a190-07948fdc748a-cluster-monitoring-operator-tls podName:6a24035e-75a9-4ed0-a190-07948fdc748a nodeName:}" failed. No retries permitted until 2026-06-09 17:36:44.614166617 +0000 UTC m=+208.714069245 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/6a24035e-75a9-4ed0-a190-07948fdc748a-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-74bbf69bbb-mxm64" (UID: "6a24035e-75a9-4ed0-a190-07948fdc748a") : secret "cluster-monitoring-operator-tls" not found Jun 09 17:36:28.624375 ip-10-0-143-124 kubenswrapper[2552]: I0609 17:36:28.624341 2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gctfs_8563ebab-ebdd-4d68-bce1-78d2a7f62992/konnectivity-agent/0.log" limit=1024 Jun 09 17:36:28.714448 ip-10-0-143-124 kubenswrapper[2552]: I0609 17:36:28.714369 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/40c2e0b0-7384-4684-ae6a-1e0e458ff57d-samples-operator-tls\") pod \"cluster-samples-operator-854f8b96b6-9wjdx\" (UID: \"40c2e0b0-7384-4684-ae6a-1e0e458ff57d\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-854f8b96b6-9wjdx" Jun 09 17:36:28.715391 ip-10-0-143-124 kubenswrapper[2552]: I0609 17:36:28.715363 2552 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-7df4944668-6mxtj"] Jun 09 17:36:28.716749 ip-10-0-143-124 kubenswrapper[2552]: I0609 17:36:28.716732 2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/40c2e0b0-7384-4684-ae6a-1e0e458ff57d-samples-operator-tls\") pod \"cluster-samples-operator-854f8b96b6-9wjdx\" (UID: \"40c2e0b0-7384-4684-ae6a-1e0e458ff57d\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-854f8b96b6-9wjdx" Jun 09 17:36:28.718463 ip-10-0-143-124 kubenswrapper[2552]: W0609 17:36:28.718417 2552 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2f51b34b_d7df_4f41_b046_a58499a5e16a.slice/crio-c3d5c70431c862a214272221136e73d5bd74ad068d3d9f35e293f1f7a18718b1 WatchSource:0}: Error finding container c3d5c70431c862a214272221136e73d5bd74ad068d3d9f35e293f1f7a18718b1: Status 404 returned error can't find the container with id c3d5c70431c862a214272221136e73d5bd74ad068d3d9f35e293f1f7a18718b1 Jun 09 17:36:28.801844 ip-10-0-143-124 kubenswrapper[2552]: I0609 17:36:28.801819 2552 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-samples-operator\"/\"cluster-samples-operator-dockercfg-jqmk9\"" Jun 09 17:36:28.809839 ip-10-0-143-124 kubenswrapper[2552]: I0609 17:36:28.809820 2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-samples-operator/cluster-samples-operator-854f8b96b6-9wjdx" Jun 09 17:36:28.818753 ip-10-0-143-124 kubenswrapper[2552]: I0609 17:36:28.818560 2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gctfs_8563ebab-ebdd-4d68-bce1-78d2a7f62992/konnectivity-agent/0.log" limit=1024 Jun 09 17:36:28.876049 ip-10-0-143-124 kubenswrapper[2552]: I0609 17:36:28.876012 2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gctfs_8563ebab-ebdd-4d68-bce1-78d2a7f62992/konnectivity-agent/0.log" limit=1024 Jun 09 17:36:28.930570 ip-10-0-143-124 kubenswrapper[2552]: I0609 17:36:28.930536 2552 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-cluster-samples-operator/cluster-samples-operator-854f8b96b6-9wjdx"] Jun 09 17:36:29.015809 ip-10-0-143-124 kubenswrapper[2552]: I0609 17:36:29.015776 2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gctfs_8563ebab-ebdd-4d68-bce1-78d2a7f62992/konnectivity-agent/0.log" limit=1024 Jun 09 17:36:29.042213 ip-10-0-143-124 kubenswrapper[2552]: I0609 17:36:29.042122 2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-7df4944668-6mxtj" event={"ID":"2f51b34b-d7df-4f41-b046-a58499a5e16a","Type":"ContainerStarted","Data":"ebf414d52e404541cfc6e436af32961dd4864fb2b729ad35fc3ebb0acdbf63e0"} Jun 09 17:36:29.042213 ip-10-0-143-124 kubenswrapper[2552]: I0609 17:36:29.042181 2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-7df4944668-6mxtj" event={"ID":"2f51b34b-d7df-4f41-b046-a58499a5e16a","Type":"ContainerStarted","Data":"c3d5c70431c862a214272221136e73d5bd74ad068d3d9f35e293f1f7a18718b1"} Jun 09 17:36:29.042684 ip-10-0-143-124 kubenswrapper[2552]: I0609 17:36:29.042242 2552 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-image-registry/image-registry-7df4944668-6mxtj" Jun 09 17:36:29.043330 ip-10-0-143-124 kubenswrapper[2552]: I0609 17:36:29.043307 2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-samples-operator/cluster-samples-operator-854f8b96b6-9wjdx" event={"ID":"40c2e0b0-7384-4684-ae6a-1e0e458ff57d","Type":"ContainerStarted","Data":"2ea7120f2b4066647fdf5f6f3acee7125fd577e505c77a65adf65bdde40d163a"} Jun 09 17:36:29.061049 ip-10-0-143-124 kubenswrapper[2552]: I0609 17:36:29.061004 2552 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/image-registry-7df4944668-6mxtj" podStartSLOduration=17.060991833 podStartE2EDuration="17.060991833s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-09 17:36:12 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-09 17:36:29.059492839 +0000 UTC m=+193.159395529" watchObservedRunningTime="2026-06-09 17:36:29.060991833 +0000 UTC m=+193.160894482" Jun 09 17:36:30.219015 ip-10-0-143-124 kubenswrapper[2552]: I0609 17:36:30.218976 2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gctfs_8563ebab-ebdd-4d68-bce1-78d2a7f62992/konnectivity-agent/0.log" limit=1024 Jun 09 17:36:30.431040 ip-10-0-143-124 kubenswrapper[2552]: I0609 17:36:30.431005 2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gctfs_8563ebab-ebdd-4d68-bce1-78d2a7f62992/konnectivity-agent/0.log" limit=1024 Jun 09 17:36:30.624592 ip-10-0-143-124 kubenswrapper[2552]: I0609 17:36:30.624551 2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gctfs_8563ebab-ebdd-4d68-bce1-78d2a7f62992/konnectivity-agent/0.log" limit=1024 Jun 09 17:36:30.829450 ip-10-0-143-124 kubenswrapper[2552]: I0609 17:36:30.829418 2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gctfs_8563ebab-ebdd-4d68-bce1-78d2a7f62992/konnectivity-agent/0.log" limit=1024 Jun 09 17:36:31.053050 ip-10-0-143-124 kubenswrapper[2552]: I0609 17:36:31.053016 2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-samples-operator/cluster-samples-operator-854f8b96b6-9wjdx" event={"ID":"40c2e0b0-7384-4684-ae6a-1e0e458ff57d","Type":"ContainerStarted","Data":"4f2baf0d8f859544d11d01df49cf4e86fc9af706674891175185f35257bb4967"} Jun 09 17:36:31.053213 ip-10-0-143-124 kubenswrapper[2552]: I0609 17:36:31.053067 2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-samples-operator/cluster-samples-operator-854f8b96b6-9wjdx" event={"ID":"40c2e0b0-7384-4684-ae6a-1e0e458ff57d","Type":"ContainerStarted","Data":"80c4d2bd13f94d57e4d62e56db9296506897fafacd44d2366a953439a6b02770"} Jun 09 17:36:31.072460 ip-10-0-143-124 kubenswrapper[2552]: I0609 17:36:31.072414 2552 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-samples-operator/cluster-samples-operator-854f8b96b6-9wjdx" podStartSLOduration=17.213203332 podStartE2EDuration="19.07239875s" totalImagesPullingTime="1.859195418s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-09 17:36:12 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-09 17:36:31.071155946 +0000 UTC m=+195.171058598" watchObservedRunningTime="2026-06-09 17:36:31.07239875 +0000 UTC m=+195.172301400" Jun 09 17:36:31.076798 ip-10-0-143-124 kubenswrapper[2552]: I0609 17:36:31.076760 2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gctfs_8563ebab-ebdd-4d68-bce1-78d2a7f62992/konnectivity-agent/0.log" limit=1024 Jun 09 17:36:31.877552 ip-10-0-143-124 kubenswrapper[2552]: I0609 17:36:31.877520 2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gctfs_8563ebab-ebdd-4d68-bce1-78d2a7f62992/konnectivity-agent/0.log" limit=1024 Jun 09 17:36:32.017005 ip-10-0-143-124 kubenswrapper[2552]: I0609 17:36:32.016971 2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gctfs_8563ebab-ebdd-4d68-bce1-78d2a7f62992/konnectivity-agent/0.log" limit=1024 Jun 09 17:36:32.224564 ip-10-0-143-124 kubenswrapper[2552]: I0609 17:36:32.224470 2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gctfs_8563ebab-ebdd-4d68-bce1-78d2a7f62992/konnectivity-agent/0.log" limit=1024 Jun 09 17:36:32.427517 ip-10-0-143-124 kubenswrapper[2552]: I0609 17:36:32.427484 2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gctfs_8563ebab-ebdd-4d68-bce1-78d2a7f62992/konnectivity-agent/0.log" limit=1024 Jun 09 17:36:32.616298 ip-10-0-143-124 kubenswrapper[2552]: I0609 17:36:32.616248 2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gctfs_8563ebab-ebdd-4d68-bce1-78d2a7f62992/konnectivity-agent/0.log" limit=1024 Jun 09 17:36:33.018157 ip-10-0-143-124 kubenswrapper[2552]: I0609 17:36:33.018124 2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gctfs_8563ebab-ebdd-4d68-bce1-78d2a7f62992/konnectivity-agent/0.log" limit=1024 Jun 09 17:36:33.309682 ip-10-0-143-124 kubenswrapper[2552]: I0609 17:36:33.309578 2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gctfs_8563ebab-ebdd-4d68-bce1-78d2a7f62992/konnectivity-agent/0.log" limit=1024 Jun 09 17:36:39.470554 ip-10-0-143-124 kubenswrapper[2552]: I0609 17:36:39.470496 2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gctfs_8563ebab-ebdd-4d68-bce1-78d2a7f62992/konnectivity-agent/0.log" limit=1024 Jun 09 17:36:39.569828 ip-10-0-143-124 kubenswrapper[2552]: I0609 17:36:39.569795 2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gctfs_8563ebab-ebdd-4d68-bce1-78d2a7f62992/konnectivity-agent/0.log" limit=1024 Jun 09 17:36:39.798423 ip-10-0-143-124 kubenswrapper[2552]: I0609 17:36:39.798387 2552 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-image-registry/image-registry-7df4944668-6mxtj"] Jun 09 17:36:39.858852 ip-10-0-143-124 kubenswrapper[2552]: I0609 17:36:39.858819 2552 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-image-registry/image-registry-cb9f4f84d-864t8"] Jun 09 17:36:39.862500 ip-10-0-143-124 kubenswrapper[2552]: I0609 17:36:39.862484 2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-cb9f4f84d-864t8" Jun 09 17:36:39.890244 ip-10-0-143-124 kubenswrapper[2552]: I0609 17:36:39.890218 2552 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-insights/insights-runtime-extractor-5m558"] Jun 09 17:36:39.892355 ip-10-0-143-124 kubenswrapper[2552]: I0609 17:36:39.892340 2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-5m558" Jun 09 17:36:39.892906 ip-10-0-143-124 kubenswrapper[2552]: I0609 17:36:39.892882 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/52bfbcd9-9374-4f7b-9bdc-6525c1e21821-bound-sa-token\") pod \"image-registry-cb9f4f84d-864t8\" (UID: \"52bfbcd9-9374-4f7b-9bdc-6525c1e21821\") " pod="openshift-image-registry/image-registry-cb9f4f84d-864t8" Jun 09 17:36:39.893016 ip-10-0-143-124 kubenswrapper[2552]: I0609 17:36:39.892974 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/52bfbcd9-9374-4f7b-9bdc-6525c1e21821-installation-pull-secrets\") pod \"image-registry-cb9f4f84d-864t8\" (UID: \"52bfbcd9-9374-4f7b-9bdc-6525c1e21821\") " pod="openshift-image-registry/image-registry-cb9f4f84d-864t8" Jun 09 17:36:39.893078 ip-10-0-143-124 kubenswrapper[2552]: I0609 17:36:39.893015 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7w4p6\" (UniqueName: \"kubernetes.io/projected/52bfbcd9-9374-4f7b-9bdc-6525c1e21821-kube-api-access-7w4p6\") pod \"image-registry-cb9f4f84d-864t8\" (UID: \"52bfbcd9-9374-4f7b-9bdc-6525c1e21821\") " pod="openshift-image-registry/image-registry-cb9f4f84d-864t8" Jun 09 17:36:39.893078 ip-10-0-143-124 kubenswrapper[2552]: I0609 17:36:39.893056 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/52bfbcd9-9374-4f7b-9bdc-6525c1e21821-registry-tls\") pod \"image-registry-cb9f4f84d-864t8\" (UID: \"52bfbcd9-9374-4f7b-9bdc-6525c1e21821\") " pod="openshift-image-registry/image-registry-cb9f4f84d-864t8" Jun 09 17:36:39.893182 ip-10-0-143-124 kubenswrapper[2552]: I0609 17:36:39.893102 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/52bfbcd9-9374-4f7b-9bdc-6525c1e21821-trusted-ca\") pod \"image-registry-cb9f4f84d-864t8\" (UID: \"52bfbcd9-9374-4f7b-9bdc-6525c1e21821\") " pod="openshift-image-registry/image-registry-cb9f4f84d-864t8" Jun 09 17:36:39.893182 ip-10-0-143-124 kubenswrapper[2552]: I0609 17:36:39.893153 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/52bfbcd9-9374-4f7b-9bdc-6525c1e21821-image-registry-private-configuration\") pod \"image-registry-cb9f4f84d-864t8\" (UID: \"52bfbcd9-9374-4f7b-9bdc-6525c1e21821\") " pod="openshift-image-registry/image-registry-cb9f4f84d-864t8" Jun 09 17:36:39.893267 ip-10-0-143-124 kubenswrapper[2552]: I0609 17:36:39.893191 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/52bfbcd9-9374-4f7b-9bdc-6525c1e21821-ca-trust-extracted\") pod \"image-registry-cb9f4f84d-864t8\" (UID: \"52bfbcd9-9374-4f7b-9bdc-6525c1e21821\") " pod="openshift-image-registry/image-registry-cb9f4f84d-864t8" Jun 09 17:36:39.893267 ip-10-0-143-124 kubenswrapper[2552]: I0609 17:36:39.893245 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/52bfbcd9-9374-4f7b-9bdc-6525c1e21821-registry-certificates\") pod \"image-registry-cb9f4f84d-864t8\" (UID: \"52bfbcd9-9374-4f7b-9bdc-6525c1e21821\") " pod="openshift-image-registry/image-registry-cb9f4f84d-864t8" Jun 09 17:36:39.894042 ip-10-0-143-124 kubenswrapper[2552]: I0609 17:36:39.894023 2552 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-cb9f4f84d-864t8"] Jun 09 17:36:39.896378 ip-10-0-143-124 kubenswrapper[2552]: I0609 17:36:39.896362 2552 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-rbac-proxy\"" Jun 09 17:36:39.896614 ip-10-0-143-124 kubenswrapper[2552]: I0609 17:36:39.896580 2552 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-tls\"" Jun 09 17:36:39.896846 ip-10-0-143-124 kubenswrapper[2552]: I0609 17:36:39.896827 2552 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-sa-dockercfg-hkzb9\"" Jun 09 17:36:39.905735 ip-10-0-143-124 kubenswrapper[2552]: I0609 17:36:39.905713 2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gctfs_8563ebab-ebdd-4d68-bce1-78d2a7f62992/konnectivity-agent/0.log" limit=1024 Jun 09 17:36:39.908305 ip-10-0-143-124 kubenswrapper[2552]: I0609 17:36:39.908285 2552 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-5m558"] Jun 09 17:36:39.994136 ip-10-0-143-124 kubenswrapper[2552]: I0609 17:36:39.994110 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/52bfbcd9-9374-4f7b-9bdc-6525c1e21821-trusted-ca\") pod \"image-registry-cb9f4f84d-864t8\" (UID: \"52bfbcd9-9374-4f7b-9bdc-6525c1e21821\") " pod="openshift-image-registry/image-registry-cb9f4f84d-864t8" Jun 09 17:36:39.994292 ip-10-0-143-124 kubenswrapper[2552]: I0609 17:36:39.994152 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-q4fl6\" (UniqueName: \"kubernetes.io/projected/3d6cff79-6280-46e2-93cf-304ec7fa1e33-kube-api-access-q4fl6\") pod \"insights-runtime-extractor-5m558\" (UID: \"3d6cff79-6280-46e2-93cf-304ec7fa1e33\") " pod="openshift-insights/insights-runtime-extractor-5m558" Jun 09 17:36:39.994292 ip-10-0-143-124 kubenswrapper[2552]: I0609 17:36:39.994181 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/3d6cff79-6280-46e2-93cf-304ec7fa1e33-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-5m558\" (UID: \"3d6cff79-6280-46e2-93cf-304ec7fa1e33\") " pod="openshift-insights/insights-runtime-extractor-5m558" Jun 09 17:36:39.994292 ip-10-0-143-124 kubenswrapper[2552]: I0609 17:36:39.994208 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/52bfbcd9-9374-4f7b-9bdc-6525c1e21821-image-registry-private-configuration\") pod \"image-registry-cb9f4f84d-864t8\" (UID: \"52bfbcd9-9374-4f7b-9bdc-6525c1e21821\") " pod="openshift-image-registry/image-registry-cb9f4f84d-864t8" Jun 09 17:36:39.994292 ip-10-0-143-124 kubenswrapper[2552]: I0609 17:36:39.994245 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/3d6cff79-6280-46e2-93cf-304ec7fa1e33-crio-socket\") pod \"insights-runtime-extractor-5m558\" (UID: \"3d6cff79-6280-46e2-93cf-304ec7fa1e33\") " pod="openshift-insights/insights-runtime-extractor-5m558" Jun 09 17:36:39.994292 ip-10-0-143-124 kubenswrapper[2552]: I0609 17:36:39.994280 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/52bfbcd9-9374-4f7b-9bdc-6525c1e21821-ca-trust-extracted\") pod \"image-registry-cb9f4f84d-864t8\" (UID: \"52bfbcd9-9374-4f7b-9bdc-6525c1e21821\") " pod="openshift-image-registry/image-registry-cb9f4f84d-864t8" Jun 09 17:36:39.994634 ip-10-0-143-124 kubenswrapper[2552]: I0609 17:36:39.994303 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/52bfbcd9-9374-4f7b-9bdc-6525c1e21821-registry-certificates\") pod \"image-registry-cb9f4f84d-864t8\" (UID: \"52bfbcd9-9374-4f7b-9bdc-6525c1e21821\") " pod="openshift-image-registry/image-registry-cb9f4f84d-864t8" Jun 09 17:36:39.994634 ip-10-0-143-124 kubenswrapper[2552]: I0609 17:36:39.994372 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/3d6cff79-6280-46e2-93cf-304ec7fa1e33-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-5m558\" (UID: \"3d6cff79-6280-46e2-93cf-304ec7fa1e33\") " pod="openshift-insights/insights-runtime-extractor-5m558" Jun 09 17:36:39.994634 ip-10-0-143-124 kubenswrapper[2552]: I0609 17:36:39.994441 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/52bfbcd9-9374-4f7b-9bdc-6525c1e21821-bound-sa-token\") pod \"image-registry-cb9f4f84d-864t8\" (UID: \"52bfbcd9-9374-4f7b-9bdc-6525c1e21821\") " pod="openshift-image-registry/image-registry-cb9f4f84d-864t8" Jun 09 17:36:39.994634 ip-10-0-143-124 kubenswrapper[2552]: I0609 17:36:39.994493 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/52bfbcd9-9374-4f7b-9bdc-6525c1e21821-installation-pull-secrets\") pod \"image-registry-cb9f4f84d-864t8\" (UID: \"52bfbcd9-9374-4f7b-9bdc-6525c1e21821\") " pod="openshift-image-registry/image-registry-cb9f4f84d-864t8" Jun 09 17:36:39.994634 ip-10-0-143-124 kubenswrapper[2552]: I0609 17:36:39.994527 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7w4p6\" (UniqueName: \"kubernetes.io/projected/52bfbcd9-9374-4f7b-9bdc-6525c1e21821-kube-api-access-7w4p6\") pod \"image-registry-cb9f4f84d-864t8\" (UID: \"52bfbcd9-9374-4f7b-9bdc-6525c1e21821\") " pod="openshift-image-registry/image-registry-cb9f4f84d-864t8" Jun 09 17:36:39.994634 ip-10-0-143-124 kubenswrapper[2552]: I0609 17:36:39.994566 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/52bfbcd9-9374-4f7b-9bdc-6525c1e21821-registry-tls\") pod \"image-registry-cb9f4f84d-864t8\" (UID: \"52bfbcd9-9374-4f7b-9bdc-6525c1e21821\") " pod="openshift-image-registry/image-registry-cb9f4f84d-864t8" Jun 09 17:36:39.994634 ip-10-0-143-124 kubenswrapper[2552]: I0609 17:36:39.994591 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/3d6cff79-6280-46e2-93cf-304ec7fa1e33-data-volume\") pod \"insights-runtime-extractor-5m558\" (UID: \"3d6cff79-6280-46e2-93cf-304ec7fa1e33\") " pod="openshift-insights/insights-runtime-extractor-5m558" Jun 09 17:36:39.995001 ip-10-0-143-124 kubenswrapper[2552]: I0609 17:36:39.994730 2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/52bfbcd9-9374-4f7b-9bdc-6525c1e21821-ca-trust-extracted\") pod \"image-registry-cb9f4f84d-864t8\" (UID: \"52bfbcd9-9374-4f7b-9bdc-6525c1e21821\") " pod="openshift-image-registry/image-registry-cb9f4f84d-864t8" Jun 09 17:36:39.995161 ip-10-0-143-124 kubenswrapper[2552]: I0609 17:36:39.995138 2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/52bfbcd9-9374-4f7b-9bdc-6525c1e21821-registry-certificates\") pod \"image-registry-cb9f4f84d-864t8\" (UID: \"52bfbcd9-9374-4f7b-9bdc-6525c1e21821\") " pod="openshift-image-registry/image-registry-cb9f4f84d-864t8" Jun 09 17:36:39.995224 ip-10-0-143-124 kubenswrapper[2552]: I0609 17:36:39.995147 2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/52bfbcd9-9374-4f7b-9bdc-6525c1e21821-trusted-ca\") pod \"image-registry-cb9f4f84d-864t8\" (UID: \"52bfbcd9-9374-4f7b-9bdc-6525c1e21821\") " pod="openshift-image-registry/image-registry-cb9f4f84d-864t8" Jun 09 17:36:39.996779 ip-10-0-143-124 kubenswrapper[2552]: I0609 17:36:39.996752 2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/52bfbcd9-9374-4f7b-9bdc-6525c1e21821-image-registry-private-configuration\") pod \"image-registry-cb9f4f84d-864t8\" (UID: \"52bfbcd9-9374-4f7b-9bdc-6525c1e21821\") " pod="openshift-image-registry/image-registry-cb9f4f84d-864t8" Jun 09 17:36:39.996884 ip-10-0-143-124 kubenswrapper[2552]: I0609 17:36:39.996811 2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/52bfbcd9-9374-4f7b-9bdc-6525c1e21821-installation-pull-secrets\") pod \"image-registry-cb9f4f84d-864t8\" (UID: \"52bfbcd9-9374-4f7b-9bdc-6525c1e21821\") " pod="openshift-image-registry/image-registry-cb9f4f84d-864t8" Jun 09 17:36:39.997023 ip-10-0-143-124 kubenswrapper[2552]: I0609 17:36:39.997001 2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/52bfbcd9-9374-4f7b-9bdc-6525c1e21821-registry-tls\") pod \"image-registry-cb9f4f84d-864t8\" (UID: \"52bfbcd9-9374-4f7b-9bdc-6525c1e21821\") " pod="openshift-image-registry/image-registry-cb9f4f84d-864t8" Jun 09 17:36:40.007725 ip-10-0-143-124 kubenswrapper[2552]: I0609 17:36:40.007702 2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-7w4p6\" (UniqueName: \"kubernetes.io/projected/52bfbcd9-9374-4f7b-9bdc-6525c1e21821-kube-api-access-7w4p6\") pod \"image-registry-cb9f4f84d-864t8\" (UID: \"52bfbcd9-9374-4f7b-9bdc-6525c1e21821\") " pod="openshift-image-registry/image-registry-cb9f4f84d-864t8" Jun 09 17:36:40.009214 ip-10-0-143-124 kubenswrapper[2552]: I0609 17:36:40.009192 2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/52bfbcd9-9374-4f7b-9bdc-6525c1e21821-bound-sa-token\") pod \"image-registry-cb9f4f84d-864t8\" (UID: \"52bfbcd9-9374-4f7b-9bdc-6525c1e21821\") " pod="openshift-image-registry/image-registry-cb9f4f84d-864t8" Jun 09 17:36:40.095501 ip-10-0-143-124 kubenswrapper[2552]: I0609 17:36:40.095413 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/3d6cff79-6280-46e2-93cf-304ec7fa1e33-crio-socket\") pod \"insights-runtime-extractor-5m558\" (UID: \"3d6cff79-6280-46e2-93cf-304ec7fa1e33\") " pod="openshift-insights/insights-runtime-extractor-5m558" Jun 09 17:36:40.095501 ip-10-0-143-124 kubenswrapper[2552]: I0609 17:36:40.095459 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/3d6cff79-6280-46e2-93cf-304ec7fa1e33-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-5m558\" (UID: \"3d6cff79-6280-46e2-93cf-304ec7fa1e33\") " pod="openshift-insights/insights-runtime-extractor-5m558" Jun 09 17:36:40.095749 ip-10-0-143-124 kubenswrapper[2552]: I0609 17:36:40.095549 2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/3d6cff79-6280-46e2-93cf-304ec7fa1e33-crio-socket\") pod \"insights-runtime-extractor-5m558\" (UID: \"3d6cff79-6280-46e2-93cf-304ec7fa1e33\") " pod="openshift-insights/insights-runtime-extractor-5m558" Jun 09 17:36:40.095749 ip-10-0-143-124 kubenswrapper[2552]: I0609 17:36:40.095661 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/3d6cff79-6280-46e2-93cf-304ec7fa1e33-data-volume\") pod \"insights-runtime-extractor-5m558\" (UID: \"3d6cff79-6280-46e2-93cf-304ec7fa1e33\") " pod="openshift-insights/insights-runtime-extractor-5m558" Jun 09 17:36:40.095749 ip-10-0-143-124 kubenswrapper[2552]: I0609 17:36:40.095705 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-q4fl6\" (UniqueName: \"kubernetes.io/projected/3d6cff79-6280-46e2-93cf-304ec7fa1e33-kube-api-access-q4fl6\") pod \"insights-runtime-extractor-5m558\" (UID: \"3d6cff79-6280-46e2-93cf-304ec7fa1e33\") " pod="openshift-insights/insights-runtime-extractor-5m558" Jun 09 17:36:40.095749 ip-10-0-143-124 kubenswrapper[2552]: I0609 17:36:40.095742 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/3d6cff79-6280-46e2-93cf-304ec7fa1e33-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-5m558\" (UID: \"3d6cff79-6280-46e2-93cf-304ec7fa1e33\") " pod="openshift-insights/insights-runtime-extractor-5m558" Jun 09 17:36:40.096010 ip-10-0-143-124 kubenswrapper[2552]: I0609 17:36:40.095988 2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/3d6cff79-6280-46e2-93cf-304ec7fa1e33-data-volume\") pod \"insights-runtime-extractor-5m558\" (UID: \"3d6cff79-6280-46e2-93cf-304ec7fa1e33\") " pod="openshift-insights/insights-runtime-extractor-5m558" Jun 09 17:36:40.096261 ip-10-0-143-124 kubenswrapper[2552]: I0609 17:36:40.096241 2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/3d6cff79-6280-46e2-93cf-304ec7fa1e33-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-5m558\" (UID: \"3d6cff79-6280-46e2-93cf-304ec7fa1e33\") " pod="openshift-insights/insights-runtime-extractor-5m558" Jun 09 17:36:40.097647 ip-10-0-143-124 kubenswrapper[2552]: I0609 17:36:40.097629 2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/3d6cff79-6280-46e2-93cf-304ec7fa1e33-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-5m558\" (UID: \"3d6cff79-6280-46e2-93cf-304ec7fa1e33\") " pod="openshift-insights/insights-runtime-extractor-5m558" Jun 09 17:36:40.106011 ip-10-0-143-124 kubenswrapper[2552]: I0609 17:36:40.105992 2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-q4fl6\" (UniqueName: \"kubernetes.io/projected/3d6cff79-6280-46e2-93cf-304ec7fa1e33-kube-api-access-q4fl6\") pod \"insights-runtime-extractor-5m558\" (UID: \"3d6cff79-6280-46e2-93cf-304ec7fa1e33\") " pod="openshift-insights/insights-runtime-extractor-5m558" Jun 09 17:36:40.171473 ip-10-0-143-124 kubenswrapper[2552]: I0609 17:36:40.171444 2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-cb9f4f84d-864t8" Jun 09 17:36:40.201266 ip-10-0-143-124 kubenswrapper[2552]: I0609 17:36:40.201245 2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-5m558" Jun 09 17:36:40.307263 ip-10-0-143-124 kubenswrapper[2552]: I0609 17:36:40.307233 2552 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-cb9f4f84d-864t8"] Jun 09 17:36:40.310354 ip-10-0-143-124 kubenswrapper[2552]: W0609 17:36:40.310321 2552 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod52bfbcd9_9374_4f7b_9bdc_6525c1e21821.slice/crio-20157ff31fab8ce098dfa7a41a95bffc1f7e69bbd5b18bf8bd7d25774a3c8ae8 WatchSource:0}: Error finding container 20157ff31fab8ce098dfa7a41a95bffc1f7e69bbd5b18bf8bd7d25774a3c8ae8: Status 404 returned error can't find the container with id 20157ff31fab8ce098dfa7a41a95bffc1f7e69bbd5b18bf8bd7d25774a3c8ae8 Jun 09 17:36:40.335521 ip-10-0-143-124 kubenswrapper[2552]: I0609 17:36:40.335496 2552 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-5m558"] Jun 09 17:36:40.335840 ip-10-0-143-124 kubenswrapper[2552]: W0609 17:36:40.335819 2552 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3d6cff79_6280_46e2_93cf_304ec7fa1e33.slice/crio-32885e5ca4fb76af88e6ccef7eb8e5fe70378d8ace4b54ffeb26cd0887769df3 WatchSource:0}: Error finding container 32885e5ca4fb76af88e6ccef7eb8e5fe70378d8ace4b54ffeb26cd0887769df3: Status 404 returned error can't find the container with id 32885e5ca4fb76af88e6ccef7eb8e5fe70378d8ace4b54ffeb26cd0887769df3 Jun 09 17:36:41.086353 ip-10-0-143-124 kubenswrapper[2552]: I0609 17:36:41.086324 2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-5m558" event={"ID":"3d6cff79-6280-46e2-93cf-304ec7fa1e33","Type":"ContainerStarted","Data":"c9022ab148ecaca8eb4bbaee80c946fe29ebed8b7026dc08f6a5ef122762b0a6"} Jun 09 17:36:41.086721 ip-10-0-143-124 kubenswrapper[2552]: I0609 17:36:41.086381 2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-5m558" event={"ID":"3d6cff79-6280-46e2-93cf-304ec7fa1e33","Type":"ContainerStarted","Data":"0e40b755121a2930e68eb54b5a43f296e8307af387839ebd09a1bf29ece11a75"} Jun 09 17:36:41.086721 ip-10-0-143-124 kubenswrapper[2552]: I0609 17:36:41.086404 2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-5m558" event={"ID":"3d6cff79-6280-46e2-93cf-304ec7fa1e33","Type":"ContainerStarted","Data":"32885e5ca4fb76af88e6ccef7eb8e5fe70378d8ace4b54ffeb26cd0887769df3"} Jun 09 17:36:41.087722 ip-10-0-143-124 kubenswrapper[2552]: I0609 17:36:41.087698 2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-cb9f4f84d-864t8" event={"ID":"52bfbcd9-9374-4f7b-9bdc-6525c1e21821","Type":"ContainerStarted","Data":"022ab088221b4e02f858f760c7cc30f4c68c1e8b2f5aa4fed715382461ec0345"} Jun 09 17:36:41.087821 ip-10-0-143-124 kubenswrapper[2552]: I0609 17:36:41.087739 2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-cb9f4f84d-864t8" event={"ID":"52bfbcd9-9374-4f7b-9bdc-6525c1e21821","Type":"ContainerStarted","Data":"20157ff31fab8ce098dfa7a41a95bffc1f7e69bbd5b18bf8bd7d25774a3c8ae8"} Jun 09 17:36:41.087866 ip-10-0-143-124 kubenswrapper[2552]: I0609 17:36:41.087829 2552 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-image-registry/image-registry-cb9f4f84d-864t8" Jun 09 17:36:41.111565 ip-10-0-143-124 kubenswrapper[2552]: I0609 17:36:41.111516 2552 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/image-registry-cb9f4f84d-864t8" podStartSLOduration=2.111500266 podStartE2EDuration="2.111500266s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-09 17:36:39 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-09 17:36:41.109775258 +0000 UTC m=+205.209677907" watchObservedRunningTime="2026-06-09 17:36:41.111500266 +0000 UTC m=+205.211402940" Jun 09 17:36:43.097592 ip-10-0-143-124 kubenswrapper[2552]: I0609 17:36:43.097553 2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-5m558" event={"ID":"3d6cff79-6280-46e2-93cf-304ec7fa1e33","Type":"ContainerStarted","Data":"83edb8050d73f35b52e0e181d658be7e55828ce66cf461404f180ceed07f636d"} Jun 09 17:36:44.286625 ip-10-0-143-124 kubenswrapper[2552]: I0609 17:36:44.286576 2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gctfs_8563ebab-ebdd-4d68-bce1-78d2a7f62992/konnectivity-agent/0.log" limit=1024 Jun 09 17:36:44.629903 ip-10-0-143-124 kubenswrapper[2552]: I0609 17:36:44.629801 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/6a24035e-75a9-4ed0-a190-07948fdc748a-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-74bbf69bbb-mxm64\" (UID: \"6a24035e-75a9-4ed0-a190-07948fdc748a\") " pod="openshift-monitoring/cluster-monitoring-operator-74bbf69bbb-mxm64" Jun 09 17:36:44.632190 ip-10-0-143-124 kubenswrapper[2552]: I0609 17:36:44.632170 2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/6a24035e-75a9-4ed0-a190-07948fdc748a-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-74bbf69bbb-mxm64\" (UID: \"6a24035e-75a9-4ed0-a190-07948fdc748a\") " pod="openshift-monitoring/cluster-monitoring-operator-74bbf69bbb-mxm64" Jun 09 17:36:44.873343 ip-10-0-143-124 kubenswrapper[2552]: I0609 17:36:44.873310 2552 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"cluster-monitoring-operator-dockercfg-fs6gn\"" Jun 09 17:36:44.881318 ip-10-0-143-124 kubenswrapper[2552]: I0609 17:36:44.881274 2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/cluster-monitoring-operator-74bbf69bbb-mxm64" Jun 09 17:36:45.019822 ip-10-0-143-124 kubenswrapper[2552]: I0609 17:36:45.019773 2552 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-insights/insights-runtime-extractor-5m558" podStartSLOduration=3.773317698 podStartE2EDuration="6.019754188s" totalImagesPullingTime="2.24643649s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-09 17:36:39 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-09 17:36:43.128727005 +0000 UTC m=+207.228629654" watchObservedRunningTime="2026-06-09 17:36:45.019754188 +0000 UTC m=+209.119656838" Jun 09 17:36:45.019974 ip-10-0-143-124 kubenswrapper[2552]: I0609 17:36:45.019916 2552 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/cluster-monitoring-operator-74bbf69bbb-mxm64"] Jun 09 17:36:45.023916 ip-10-0-143-124 kubenswrapper[2552]: W0609 17:36:45.023886 2552 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6a24035e_75a9_4ed0_a190_07948fdc748a.slice/crio-7ca4b16473d7bd3eba1f1cf5471a642ae2ed108200368b90729d98906b47ffe4 WatchSource:0}: Error finding container 7ca4b16473d7bd3eba1f1cf5471a642ae2ed108200368b90729d98906b47ffe4: Status 404 returned error can't find the container with id 7ca4b16473d7bd3eba1f1cf5471a642ae2ed108200368b90729d98906b47ffe4 Jun 09 17:36:45.105277 ip-10-0-143-124 kubenswrapper[2552]: I0609 17:36:45.105246 2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/cluster-monitoring-operator-74bbf69bbb-mxm64" event={"ID":"6a24035e-75a9-4ed0-a190-07948fdc748a","Type":"ContainerStarted","Data":"7ca4b16473d7bd3eba1f1cf5471a642ae2ed108200368b90729d98906b47ffe4"} Jun 09 17:36:46.124706 ip-10-0-143-124 kubenswrapper[2552]: I0609 17:36:46.124669 2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gctfs_8563ebab-ebdd-4d68-bce1-78d2a7f62992/konnectivity-agent/0.log" limit=1024 Jun 09 17:36:46.182091 ip-10-0-143-124 kubenswrapper[2552]: I0609 17:36:46.182057 2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gctfs_8563ebab-ebdd-4d68-bce1-78d2a7f62992/konnectivity-agent/0.log" limit=1024 Jun 09 17:36:47.066818 ip-10-0-143-124 kubenswrapper[2552]: I0609 17:36:47.066721 2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gctfs_8563ebab-ebdd-4d68-bce1-78d2a7f62992/konnectivity-agent/0.log" limit=1024 Jun 09 17:36:47.114276 ip-10-0-143-124 kubenswrapper[2552]: I0609 17:36:47.114242 2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/cluster-monitoring-operator-74bbf69bbb-mxm64" event={"ID":"6a24035e-75a9-4ed0-a190-07948fdc748a","Type":"ContainerStarted","Data":"2d21e5d39c3960b708bd9f9c5f595450fd5f734cb64585a94cfc435d4a3f7952"} Jun 09 17:36:47.138136 ip-10-0-143-124 kubenswrapper[2552]: I0609 17:36:47.138090 2552 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/cluster-monitoring-operator-74bbf69bbb-mxm64" podStartSLOduration=33.393432864 podStartE2EDuration="35.138065771s" totalImagesPullingTime="1.744632907s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-09 17:36:12 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-09 17:36:47.137041342 +0000 UTC m=+211.236944004" watchObservedRunningTime="2026-06-09 17:36:47.138065771 +0000 UTC m=+211.237968422" Jun 09 17:36:47.165895 ip-10-0-143-124 kubenswrapper[2552]: I0609 17:36:47.165867 2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gctfs_8563ebab-ebdd-4d68-bce1-78d2a7f62992/konnectivity-agent/0.log" limit=1024 Jun 09 17:36:47.240144 ip-10-0-143-124 kubenswrapper[2552]: I0609 17:36:47.240111 2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gctfs_8563ebab-ebdd-4d68-bce1-78d2a7f62992/konnectivity-agent/0.log" limit=1024 Jun 09 17:36:47.346592 ip-10-0-143-124 kubenswrapper[2552]: I0609 17:36:47.346514 2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gctfs_8563ebab-ebdd-4d68-bce1-78d2a7f62992/konnectivity-agent/0.log" limit=1024 Jun 09 17:36:49.805245 ip-10-0-143-124 kubenswrapper[2552]: I0609 17:36:49.805209 2552 patch_prober.go:28] interesting pod/image-registry-7df4944668-6mxtj container/registry namespace/openshift-image-registry: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body={"errors":[{"code":"UNAVAILABLE","message":"service unavailable","detail":"health check failed: please see /debug/health"}]} Jun 09 17:36:49.805656 ip-10-0-143-124 kubenswrapper[2552]: I0609 17:36:49.805263 2552 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-image-registry/image-registry-7df4944668-6mxtj" podUID="2f51b34b-d7df-4f41-b046-a58499a5e16a" containerName="registry" probeResult="failure" output="HTTP probe failed with statuscode: 503" Jun 09 17:36:50.263904 ip-10-0-143-124 kubenswrapper[2552]: I0609 17:36:50.263871 2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gctfs_8563ebab-ebdd-4d68-bce1-78d2a7f62992/konnectivity-agent/0.log" limit=1024 Jun 09 17:36:50.335986 ip-10-0-143-124 kubenswrapper[2552]: I0609 17:36:50.335943 2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gctfs_8563ebab-ebdd-4d68-bce1-78d2a7f62992/konnectivity-agent/0.log" limit=1024 Jun 09 17:36:50.480421 ip-10-0-143-124 kubenswrapper[2552]: I0609 17:36:50.480385 2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gctfs_8563ebab-ebdd-4d68-bce1-78d2a7f62992/konnectivity-agent/0.log" limit=1024 Jun 09 17:36:52.271222 ip-10-0-143-124 kubenswrapper[2552]: I0609 17:36:52.271188 2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gctfs_8563ebab-ebdd-4d68-bce1-78d2a7f62992/konnectivity-agent/0.log" limit=1024 Jun 09 17:36:54.409218 ip-10-0-143-124 kubenswrapper[2552]: I0609 17:36:54.409184 2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gctfs_8563ebab-ebdd-4d68-bce1-78d2a7f62992/konnectivity-agent/0.log" limit=1024 Jun 09 17:36:54.509504 ip-10-0-143-124 kubenswrapper[2552]: I0609 17:36:54.509468 2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gctfs_8563ebab-ebdd-4d68-bce1-78d2a7f62992/konnectivity-agent/0.log" limit=1024 Jun 09 17:36:54.611166 ip-10-0-143-124 kubenswrapper[2552]: I0609 17:36:54.611128 2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gctfs_8563ebab-ebdd-4d68-bce1-78d2a7f62992/konnectivity-agent/0.log" limit=1024 Jun 09 17:36:54.674592 ip-10-0-143-124 kubenswrapper[2552]: I0609 17:36:54.674523 2552 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/node-exporter-brwq7"] Jun 09 17:36:54.679175 ip-10-0-143-124 kubenswrapper[2552]: I0609 17:36:54.678491 2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-brwq7" Jun 09 17:36:54.684389 ip-10-0-143-124 kubenswrapper[2552]: I0609 17:36:54.684357 2552 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-kube-rbac-proxy-config\"" Jun 09 17:36:54.684513 ip-10-0-143-124 kubenswrapper[2552]: I0609 17:36:54.684417 2552 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-tls\"" Jun 09 17:36:54.684513 ip-10-0-143-124 kubenswrapper[2552]: I0609 17:36:54.684492 2552 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"metrics-client-ca\"" Jun 09 17:36:54.684860 ip-10-0-143-124 kubenswrapper[2552]: I0609 17:36:54.684844 2552 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"node-exporter-accelerators-collector-config\"" Jun 09 17:36:54.685745 ip-10-0-143-124 kubenswrapper[2552]: I0609 17:36:54.685450 2552 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-dockercfg-k4ngk\"" Jun 09 17:36:54.711017 ip-10-0-143-124 kubenswrapper[2552]: I0609 17:36:54.710992 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-549qk\" (UniqueName: \"kubernetes.io/projected/2839fcc7-c296-4ed6-bcc4-d5a3cdf99c72-kube-api-access-549qk\") pod \"node-exporter-brwq7\" (UID: \"2839fcc7-c296-4ed6-bcc4-d5a3cdf99c72\") " pod="openshift-monitoring/node-exporter-brwq7" Jun 09 17:36:54.711127 ip-10-0-143-124 kubenswrapper[2552]: I0609 17:36:54.711021 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/2839fcc7-c296-4ed6-bcc4-d5a3cdf99c72-sys\") pod \"node-exporter-brwq7\" (UID: \"2839fcc7-c296-4ed6-bcc4-d5a3cdf99c72\") " pod="openshift-monitoring/node-exporter-brwq7" Jun 09 17:36:54.711127 ip-10-0-143-124 kubenswrapper[2552]: I0609 17:36:54.711038 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/2839fcc7-c296-4ed6-bcc4-d5a3cdf99c72-root\") pod \"node-exporter-brwq7\" (UID: \"2839fcc7-c296-4ed6-bcc4-d5a3cdf99c72\") " pod="openshift-monitoring/node-exporter-brwq7" Jun 09 17:36:54.711127 ip-10-0-143-124 kubenswrapper[2552]: I0609 17:36:54.711057 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/2839fcc7-c296-4ed6-bcc4-d5a3cdf99c72-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-brwq7\" (UID: \"2839fcc7-c296-4ed6-bcc4-d5a3cdf99c72\") " pod="openshift-monitoring/node-exporter-brwq7" Jun 09 17:36:54.711282 ip-10-0-143-124 kubenswrapper[2552]: I0609 17:36:54.711144 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/2839fcc7-c296-4ed6-bcc4-d5a3cdf99c72-node-exporter-accelerators-collector-config\") pod \"node-exporter-brwq7\" (UID: \"2839fcc7-c296-4ed6-bcc4-d5a3cdf99c72\") " pod="openshift-monitoring/node-exporter-brwq7" Jun 09 17:36:54.711282 ip-10-0-143-124 kubenswrapper[2552]: I0609 17:36:54.711183 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/2839fcc7-c296-4ed6-bcc4-d5a3cdf99c72-metrics-client-ca\") pod \"node-exporter-brwq7\" (UID: \"2839fcc7-c296-4ed6-bcc4-d5a3cdf99c72\") " pod="openshift-monitoring/node-exporter-brwq7" Jun 09 17:36:54.711282 ip-10-0-143-124 kubenswrapper[2552]: I0609 17:36:54.711214 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/2839fcc7-c296-4ed6-bcc4-d5a3cdf99c72-node-exporter-textfile\") pod \"node-exporter-brwq7\" (UID: \"2839fcc7-c296-4ed6-bcc4-d5a3cdf99c72\") " pod="openshift-monitoring/node-exporter-brwq7" Jun 09 17:36:54.711282 ip-10-0-143-124 kubenswrapper[2552]: I0609 17:36:54.711265 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/2839fcc7-c296-4ed6-bcc4-d5a3cdf99c72-node-exporter-tls\") pod \"node-exporter-brwq7\" (UID: \"2839fcc7-c296-4ed6-bcc4-d5a3cdf99c72\") " pod="openshift-monitoring/node-exporter-brwq7" Jun 09 17:36:54.711409 ip-10-0-143-124 kubenswrapper[2552]: I0609 17:36:54.711316 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/2839fcc7-c296-4ed6-bcc4-d5a3cdf99c72-node-exporter-wtmp\") pod \"node-exporter-brwq7\" (UID: \"2839fcc7-c296-4ed6-bcc4-d5a3cdf99c72\") " pod="openshift-monitoring/node-exporter-brwq7" Jun 09 17:36:54.720878 ip-10-0-143-124 kubenswrapper[2552]: I0609 17:36:54.720853 2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gctfs_8563ebab-ebdd-4d68-bce1-78d2a7f62992/konnectivity-agent/0.log" limit=1024 Jun 09 17:36:54.812720 ip-10-0-143-124 kubenswrapper[2552]: I0609 17:36:54.812690 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-549qk\" (UniqueName: \"kubernetes.io/projected/2839fcc7-c296-4ed6-bcc4-d5a3cdf99c72-kube-api-access-549qk\") pod \"node-exporter-brwq7\" (UID: \"2839fcc7-c296-4ed6-bcc4-d5a3cdf99c72\") " pod="openshift-monitoring/node-exporter-brwq7" Jun 09 17:36:54.812720 ip-10-0-143-124 kubenswrapper[2552]: I0609 17:36:54.812722 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/2839fcc7-c296-4ed6-bcc4-d5a3cdf99c72-sys\") pod \"node-exporter-brwq7\" (UID: \"2839fcc7-c296-4ed6-bcc4-d5a3cdf99c72\") " pod="openshift-monitoring/node-exporter-brwq7" Jun 09 17:36:54.812902 ip-10-0-143-124 kubenswrapper[2552]: I0609 17:36:54.812740 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/2839fcc7-c296-4ed6-bcc4-d5a3cdf99c72-root\") pod \"node-exporter-brwq7\" (UID: \"2839fcc7-c296-4ed6-bcc4-d5a3cdf99c72\") " pod="openshift-monitoring/node-exporter-brwq7" Jun 09 17:36:54.812902 ip-10-0-143-124 kubenswrapper[2552]: I0609 17:36:54.812795 2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/2839fcc7-c296-4ed6-bcc4-d5a3cdf99c72-sys\") pod \"node-exporter-brwq7\" (UID: \"2839fcc7-c296-4ed6-bcc4-d5a3cdf99c72\") " pod="openshift-monitoring/node-exporter-brwq7" Jun 09 17:36:54.812902 ip-10-0-143-124 kubenswrapper[2552]: I0609 17:36:54.812822 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/2839fcc7-c296-4ed6-bcc4-d5a3cdf99c72-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-brwq7\" (UID: \"2839fcc7-c296-4ed6-bcc4-d5a3cdf99c72\") " pod="openshift-monitoring/node-exporter-brwq7" Jun 09 17:36:54.812902 ip-10-0-143-124 kubenswrapper[2552]: I0609 17:36:54.812851 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/2839fcc7-c296-4ed6-bcc4-d5a3cdf99c72-node-exporter-accelerators-collector-config\") pod \"node-exporter-brwq7\" (UID: \"2839fcc7-c296-4ed6-bcc4-d5a3cdf99c72\") " pod="openshift-monitoring/node-exporter-brwq7" Jun 09 17:36:54.812902 ip-10-0-143-124 kubenswrapper[2552]: I0609 17:36:54.812867 2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"root\" (UniqueName: \"kubernetes.io/host-path/2839fcc7-c296-4ed6-bcc4-d5a3cdf99c72-root\") pod \"node-exporter-brwq7\" (UID: \"2839fcc7-c296-4ed6-bcc4-d5a3cdf99c72\") " pod="openshift-monitoring/node-exporter-brwq7" Jun 09 17:36:54.812902 ip-10-0-143-124 kubenswrapper[2552]: I0609 17:36:54.812871 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/2839fcc7-c296-4ed6-bcc4-d5a3cdf99c72-metrics-client-ca\") pod \"node-exporter-brwq7\" (UID: \"2839fcc7-c296-4ed6-bcc4-d5a3cdf99c72\") " pod="openshift-monitoring/node-exporter-brwq7" Jun 09 17:36:54.813176 ip-10-0-143-124 kubenswrapper[2552]: I0609 17:36:54.812923 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/2839fcc7-c296-4ed6-bcc4-d5a3cdf99c72-node-exporter-textfile\") pod \"node-exporter-brwq7\" (UID: \"2839fcc7-c296-4ed6-bcc4-d5a3cdf99c72\") " pod="openshift-monitoring/node-exporter-brwq7" Jun 09 17:36:54.813176 ip-10-0-143-124 kubenswrapper[2552]: I0609 17:36:54.813023 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/2839fcc7-c296-4ed6-bcc4-d5a3cdf99c72-node-exporter-tls\") pod \"node-exporter-brwq7\" (UID: \"2839fcc7-c296-4ed6-bcc4-d5a3cdf99c72\") " pod="openshift-monitoring/node-exporter-brwq7" Jun 09 17:36:54.813176 ip-10-0-143-124 kubenswrapper[2552]: I0609 17:36:54.813081 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/2839fcc7-c296-4ed6-bcc4-d5a3cdf99c72-node-exporter-wtmp\") pod \"node-exporter-brwq7\" (UID: \"2839fcc7-c296-4ed6-bcc4-d5a3cdf99c72\") " pod="openshift-monitoring/node-exporter-brwq7" Jun 09 17:36:54.813176 ip-10-0-143-124 kubenswrapper[2552]: E0609 17:36:54.813160 2552 secret.go:189] Couldn't get secret openshift-monitoring/node-exporter-tls: secret "node-exporter-tls" not found Jun 09 17:36:54.813359 ip-10-0-143-124 kubenswrapper[2552]: I0609 17:36:54.813203 2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/2839fcc7-c296-4ed6-bcc4-d5a3cdf99c72-node-exporter-wtmp\") pod \"node-exporter-brwq7\" (UID: \"2839fcc7-c296-4ed6-bcc4-d5a3cdf99c72\") " pod="openshift-monitoring/node-exporter-brwq7" Jun 09 17:36:54.813359 ip-10-0-143-124 kubenswrapper[2552]: E0609 17:36:54.813229 2552 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/2839fcc7-c296-4ed6-bcc4-d5a3cdf99c72-node-exporter-tls podName:2839fcc7-c296-4ed6-bcc4-d5a3cdf99c72 nodeName:}" failed. No retries permitted until 2026-06-09 17:36:55.31320674 +0000 UTC m=+219.413109377 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "node-exporter-tls" (UniqueName: "kubernetes.io/secret/2839fcc7-c296-4ed6-bcc4-d5a3cdf99c72-node-exporter-tls") pod "node-exporter-brwq7" (UID: "2839fcc7-c296-4ed6-bcc4-d5a3cdf99c72") : secret "node-exporter-tls" not found Jun 09 17:36:54.813359 ip-10-0-143-124 kubenswrapper[2552]: I0609 17:36:54.813312 2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/2839fcc7-c296-4ed6-bcc4-d5a3cdf99c72-node-exporter-textfile\") pod \"node-exporter-brwq7\" (UID: \"2839fcc7-c296-4ed6-bcc4-d5a3cdf99c72\") " pod="openshift-monitoring/node-exporter-brwq7" Jun 09 17:36:54.813465 ip-10-0-143-124 kubenswrapper[2552]: I0609 17:36:54.813454 2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/2839fcc7-c296-4ed6-bcc4-d5a3cdf99c72-node-exporter-accelerators-collector-config\") pod \"node-exporter-brwq7\" (UID: \"2839fcc7-c296-4ed6-bcc4-d5a3cdf99c72\") " pod="openshift-monitoring/node-exporter-brwq7" Jun 09 17:36:54.813558 ip-10-0-143-124 kubenswrapper[2552]: I0609 17:36:54.813536 2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/2839fcc7-c296-4ed6-bcc4-d5a3cdf99c72-metrics-client-ca\") pod \"node-exporter-brwq7\" (UID: \"2839fcc7-c296-4ed6-bcc4-d5a3cdf99c72\") " pod="openshift-monitoring/node-exporter-brwq7" Jun 09 17:36:54.815325 ip-10-0-143-124 kubenswrapper[2552]: I0609 17:36:54.815305 2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/2839fcc7-c296-4ed6-bcc4-d5a3cdf99c72-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-brwq7\" (UID: \"2839fcc7-c296-4ed6-bcc4-d5a3cdf99c72\") " pod="openshift-monitoring/node-exporter-brwq7" Jun 09 17:36:54.823057 ip-10-0-143-124 kubenswrapper[2552]: I0609 17:36:54.823032 2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-549qk\" (UniqueName: \"kubernetes.io/projected/2839fcc7-c296-4ed6-bcc4-d5a3cdf99c72-kube-api-access-549qk\") pod \"node-exporter-brwq7\" (UID: \"2839fcc7-c296-4ed6-bcc4-d5a3cdf99c72\") " pod="openshift-monitoring/node-exporter-brwq7" Jun 09 17:36:54.848401 ip-10-0-143-124 kubenswrapper[2552]: I0609 17:36:54.848368 2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gctfs_8563ebab-ebdd-4d68-bce1-78d2a7f62992/konnectivity-agent/0.log" limit=1024 Jun 09 17:36:54.944810 ip-10-0-143-124 kubenswrapper[2552]: I0609 17:36:54.944715 2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gctfs_8563ebab-ebdd-4d68-bce1-78d2a7f62992/konnectivity-agent/0.log" limit=1024 Jun 09 17:36:55.045138 ip-10-0-143-124 kubenswrapper[2552]: I0609 17:36:55.045106 2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gctfs_8563ebab-ebdd-4d68-bce1-78d2a7f62992/konnectivity-agent/0.log" limit=1024 Jun 09 17:36:55.106059 ip-10-0-143-124 kubenswrapper[2552]: I0609 17:36:55.106022 2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gctfs_8563ebab-ebdd-4d68-bce1-78d2a7f62992/konnectivity-agent/0.log" limit=1024 Jun 09 17:36:55.316399 ip-10-0-143-124 kubenswrapper[2552]: I0609 17:36:55.316368 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/2839fcc7-c296-4ed6-bcc4-d5a3cdf99c72-node-exporter-tls\") pod \"node-exporter-brwq7\" (UID: \"2839fcc7-c296-4ed6-bcc4-d5a3cdf99c72\") " pod="openshift-monitoring/node-exporter-brwq7" Jun 09 17:36:55.318691 ip-10-0-143-124 kubenswrapper[2552]: I0609 17:36:55.318671 2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/2839fcc7-c296-4ed6-bcc4-d5a3cdf99c72-node-exporter-tls\") pod \"node-exporter-brwq7\" (UID: \"2839fcc7-c296-4ed6-bcc4-d5a3cdf99c72\") " pod="openshift-monitoring/node-exporter-brwq7" Jun 09 17:36:55.391307 ip-10-0-143-124 kubenswrapper[2552]: I0609 17:36:55.391278 2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gctfs_8563ebab-ebdd-4d68-bce1-78d2a7f62992/konnectivity-agent/0.log" limit=1024 Jun 09 17:36:55.588019 ip-10-0-143-124 kubenswrapper[2552]: I0609 17:36:55.587927 2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-brwq7" Jun 09 17:36:55.599310 ip-10-0-143-124 kubenswrapper[2552]: W0609 17:36:55.599278 2552 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2839fcc7_c296_4ed6_bcc4_d5a3cdf99c72.slice/crio-6ac5cbdab1ae2704d5efc3b72f9960940cdfce01286ae4da15bf41fcd4edf022 WatchSource:0}: Error finding container 6ac5cbdab1ae2704d5efc3b72f9960940cdfce01286ae4da15bf41fcd4edf022: Status 404 returned error can't find the container with id 6ac5cbdab1ae2704d5efc3b72f9960940cdfce01286ae4da15bf41fcd4edf022 Jun 09 17:36:55.630900 ip-10-0-143-124 kubenswrapper[2552]: I0609 17:36:55.630866 2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gctfs_8563ebab-ebdd-4d68-bce1-78d2a7f62992/konnectivity-agent/0.log" limit=1024 Jun 09 17:36:55.716237 ip-10-0-143-124 kubenswrapper[2552]: I0609 17:36:55.716194 2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gctfs_8563ebab-ebdd-4d68-bce1-78d2a7f62992/konnectivity-agent/0.log" limit=1024 Jun 09 17:36:55.843702 ip-10-0-143-124 kubenswrapper[2552]: I0609 17:36:55.843614 2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gctfs_8563ebab-ebdd-4d68-bce1-78d2a7f62992/konnectivity-agent/0.log" limit=1024 Jun 09 17:36:56.143953 ip-10-0-143-124 kubenswrapper[2552]: I0609 17:36:56.143868 2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-brwq7" event={"ID":"2839fcc7-c296-4ed6-bcc4-d5a3cdf99c72","Type":"ContainerStarted","Data":"6ac5cbdab1ae2704d5efc3b72f9960940cdfce01286ae4da15bf41fcd4edf022"} Jun 09 17:36:57.149173 ip-10-0-143-124 kubenswrapper[2552]: I0609 17:36:57.149135 2552 generic.go:356] "Generic (PLEG): container finished" podID="2839fcc7-c296-4ed6-bcc4-d5a3cdf99c72" containerID="31c0cb71dd953fb0b3b984238d94c54ce7c9b0478dee58c4357375055ee6b866" exitCode=0 Jun 09 17:36:57.149699 ip-10-0-143-124 kubenswrapper[2552]: I0609 17:36:57.149195 2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-brwq7" event={"ID":"2839fcc7-c296-4ed6-bcc4-d5a3cdf99c72","Type":"ContainerDied","Data":"31c0cb71dd953fb0b3b984238d94c54ce7c9b0478dee58c4357375055ee6b866"} Jun 09 17:36:57.573358 ip-10-0-143-124 kubenswrapper[2552]: I0609 17:36:57.573316 2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gctfs_8563ebab-ebdd-4d68-bce1-78d2a7f62992/konnectivity-agent/0.log" limit=1024 Jun 09 17:36:57.660499 ip-10-0-143-124 kubenswrapper[2552]: I0609 17:36:57.660436 2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gctfs_8563ebab-ebdd-4d68-bce1-78d2a7f62992/konnectivity-agent/0.log" limit=1024 Jun 09 17:36:57.807640 ip-10-0-143-124 kubenswrapper[2552]: I0609 17:36:57.807588 2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gctfs_8563ebab-ebdd-4d68-bce1-78d2a7f62992/konnectivity-agent/0.log" limit=1024 Jun 09 17:36:57.860626 ip-10-0-143-124 kubenswrapper[2552]: I0609 17:36:57.860514 2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gctfs_8563ebab-ebdd-4d68-bce1-78d2a7f62992/konnectivity-agent/0.log" limit=1024 Jun 09 17:36:58.154058 ip-10-0-143-124 kubenswrapper[2552]: I0609 17:36:58.153975 2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-brwq7" event={"ID":"2839fcc7-c296-4ed6-bcc4-d5a3cdf99c72","Type":"ContainerStarted","Data":"f183b04317179329761052af02aee78611487145ad3957a89b6d85fcf62438e2"} Jun 09 17:36:58.154058 ip-10-0-143-124 kubenswrapper[2552]: I0609 17:36:58.154026 2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-brwq7" event={"ID":"2839fcc7-c296-4ed6-bcc4-d5a3cdf99c72","Type":"ContainerStarted","Data":"91414fb319d1948f68ba97e83d0234aa946dc003fe395f2618eb523956293406"} Jun 09 17:36:58.175840 ip-10-0-143-124 kubenswrapper[2552]: I0609 17:36:58.175786 2552 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/node-exporter-brwq7" podStartSLOduration=3.303374814 podStartE2EDuration="4.175771899s" totalImagesPullingTime="809.673689ms" totalInitContainerRuntime="62.723396ms" isStatefulPod=true podCreationTimestamp="2026-06-09 17:36:54 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-09 17:36:58.174312919 +0000 UTC m=+222.274215568" watchObservedRunningTime="2026-06-09 17:36:58.175771899 +0000 UTC m=+222.275674549" Jun 09 17:36:59.429223 ip-10-0-143-124 kubenswrapper[2552]: I0609 17:36:59.429184 2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gctfs_8563ebab-ebdd-4d68-bce1-78d2a7f62992/konnectivity-agent/0.log" limit=1024 Jun 09 17:36:59.803263 ip-10-0-143-124 kubenswrapper[2552]: I0609 17:36:59.803224 2552 patch_prober.go:28] interesting pod/image-registry-7df4944668-6mxtj container/registry namespace/openshift-image-registry: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body={"errors":[{"code":"UNAVAILABLE","message":"service unavailable","detail":"health check failed: please see /debug/health"}]} Jun 09 17:36:59.803427 ip-10-0-143-124 kubenswrapper[2552]: I0609 17:36:59.803289 2552 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-image-registry/image-registry-7df4944668-6mxtj" podUID="2f51b34b-d7df-4f41-b046-a58499a5e16a" containerName="registry" probeResult="failure" output="HTTP probe failed with statuscode: 503" Jun 09 17:36:59.856317 ip-10-0-143-124 kubenswrapper[2552]: I0609 17:36:59.856276 2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gctfs_8563ebab-ebdd-4d68-bce1-78d2a7f62992/konnectivity-agent/0.log" limit=1024 Jun 09 17:37:00.176272 ip-10-0-143-124 kubenswrapper[2552]: I0609 17:37:00.176187 2552 patch_prober.go:28] interesting pod/image-registry-cb9f4f84d-864t8 container/registry namespace/openshift-image-registry: Liveness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body={"errors":[{"code":"UNAVAILABLE","message":"service unavailable","detail":"health check failed: please see /debug/health"}]} Jun 09 17:37:00.176272 ip-10-0-143-124 kubenswrapper[2552]: I0609 17:37:00.176246 2552 prober.go:120] "Probe failed" probeType="Liveness" pod="openshift-image-registry/image-registry-cb9f4f84d-864t8" podUID="52bfbcd9-9374-4f7b-9bdc-6525c1e21821" containerName="registry" probeResult="failure" output="HTTP probe failed with statuscode: 503" Jun 09 17:37:00.880187 ip-10-0-143-124 kubenswrapper[2552]: I0609 17:37:00.880149 2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gctfs_8563ebab-ebdd-4d68-bce1-78d2a7f62992/konnectivity-agent/0.log" limit=1024 Jun 09 17:37:02.097368 ip-10-0-143-124 kubenswrapper[2552]: I0609 17:37:02.097330 2552 patch_prober.go:28] interesting pod/image-registry-cb9f4f84d-864t8 container/registry namespace/openshift-image-registry: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body={"errors":[{"code":"UNAVAILABLE","message":"service unavailable","detail":"health check failed: please see /debug/health"}]} Jun 09 17:37:02.097825 ip-10-0-143-124 kubenswrapper[2552]: I0609 17:37:02.097388 2552 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-image-registry/image-registry-cb9f4f84d-864t8" podUID="52bfbcd9-9374-4f7b-9bdc-6525c1e21821" containerName="registry" probeResult="failure" output="HTTP probe failed with statuscode: 503" Jun 09 17:37:04.817469 ip-10-0-143-124 kubenswrapper[2552]: I0609 17:37:04.817423 2552 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-image-registry/image-registry-7df4944668-6mxtj" podUID="2f51b34b-d7df-4f41-b046-a58499a5e16a" containerName="registry" containerID="cri-o://ebf414d52e404541cfc6e436af32961dd4864fb2b729ad35fc3ebb0acdbf63e0" gracePeriod=30 Jun 09 17:37:05.061433 ip-10-0-143-124 kubenswrapper[2552]: I0609 17:37:05.061408 2552 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-7df4944668-6mxtj" Jun 09 17:37:05.178007 ip-10-0-143-124 kubenswrapper[2552]: I0609 17:37:05.177913 2552 generic.go:356] "Generic (PLEG): container finished" podID="2f51b34b-d7df-4f41-b046-a58499a5e16a" containerID="ebf414d52e404541cfc6e436af32961dd4864fb2b729ad35fc3ebb0acdbf63e0" exitCode=0 Jun 09 17:37:05.178007 ip-10-0-143-124 kubenswrapper[2552]: I0609 17:37:05.177960 2552 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-7df4944668-6mxtj" Jun 09 17:37:05.178007 ip-10-0-143-124 kubenswrapper[2552]: I0609 17:37:05.177963 2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-7df4944668-6mxtj" event={"ID":"2f51b34b-d7df-4f41-b046-a58499a5e16a","Type":"ContainerDied","Data":"ebf414d52e404541cfc6e436af32961dd4864fb2b729ad35fc3ebb0acdbf63e0"} Jun 09 17:37:05.178230 ip-10-0-143-124 kubenswrapper[2552]: I0609 17:37:05.178047 2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-7df4944668-6mxtj" event={"ID":"2f51b34b-d7df-4f41-b046-a58499a5e16a","Type":"ContainerDied","Data":"c3d5c70431c862a214272221136e73d5bd74ad068d3d9f35e293f1f7a18718b1"} Jun 09 17:37:05.178230 ip-10-0-143-124 kubenswrapper[2552]: I0609 17:37:05.178075 2552 scope.go:117] "RemoveContainer" containerID="ebf414d52e404541cfc6e436af32961dd4864fb2b729ad35fc3ebb0acdbf63e0" Jun 09 17:37:05.186806 ip-10-0-143-124 kubenswrapper[2552]: I0609 17:37:05.186785 2552 scope.go:117] "RemoveContainer" containerID="ebf414d52e404541cfc6e436af32961dd4864fb2b729ad35fc3ebb0acdbf63e0" Jun 09 17:37:05.187081 ip-10-0-143-124 kubenswrapper[2552]: E0609 17:37:05.187061 2552 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"ebf414d52e404541cfc6e436af32961dd4864fb2b729ad35fc3ebb0acdbf63e0\": container with ID starting with ebf414d52e404541cfc6e436af32961dd4864fb2b729ad35fc3ebb0acdbf63e0 not found: ID does not exist" containerID="ebf414d52e404541cfc6e436af32961dd4864fb2b729ad35fc3ebb0acdbf63e0" Jun 09 17:37:05.187154 ip-10-0-143-124 kubenswrapper[2552]: I0609 17:37:05.187094 2552 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"ebf414d52e404541cfc6e436af32961dd4864fb2b729ad35fc3ebb0acdbf63e0"} err="failed to get container status \"ebf414d52e404541cfc6e436af32961dd4864fb2b729ad35fc3ebb0acdbf63e0\": rpc error: code = NotFound desc = could not find container \"ebf414d52e404541cfc6e436af32961dd4864fb2b729ad35fc3ebb0acdbf63e0\": container with ID starting with ebf414d52e404541cfc6e436af32961dd4864fb2b729ad35fc3ebb0acdbf63e0 not found: ID does not exist" Jun 09 17:37:05.196331 ip-10-0-143-124 kubenswrapper[2552]: I0609 17:37:05.196309 2552 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/2f51b34b-d7df-4f41-b046-a58499a5e16a-installation-pull-secrets\") pod \"2f51b34b-d7df-4f41-b046-a58499a5e16a\" (UID: \"2f51b34b-d7df-4f41-b046-a58499a5e16a\") " Jun 09 17:37:05.196417 ip-10-0-143-124 kubenswrapper[2552]: I0609 17:37:05.196340 2552 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/2f51b34b-d7df-4f41-b046-a58499a5e16a-bound-sa-token\") pod \"2f51b34b-d7df-4f41-b046-a58499a5e16a\" (UID: \"2f51b34b-d7df-4f41-b046-a58499a5e16a\") " Jun 09 17:37:05.196417 ip-10-0-143-124 kubenswrapper[2552]: I0609 17:37:05.196370 2552 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/2f51b34b-d7df-4f41-b046-a58499a5e16a-image-registry-private-configuration\") pod \"2f51b34b-d7df-4f41-b046-a58499a5e16a\" (UID: \"2f51b34b-d7df-4f41-b046-a58499a5e16a\") " Jun 09 17:37:05.196626 ip-10-0-143-124 kubenswrapper[2552]: I0609 17:37:05.196584 2552 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/2f51b34b-d7df-4f41-b046-a58499a5e16a-trusted-ca\") pod \"2f51b34b-d7df-4f41-b046-a58499a5e16a\" (UID: \"2f51b34b-d7df-4f41-b046-a58499a5e16a\") " Jun 09 17:37:05.196761 ip-10-0-143-124 kubenswrapper[2552]: I0609 17:37:05.196660 2552 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/2f51b34b-d7df-4f41-b046-a58499a5e16a-ca-trust-extracted\") pod \"2f51b34b-d7df-4f41-b046-a58499a5e16a\" (UID: \"2f51b34b-d7df-4f41-b046-a58499a5e16a\") " Jun 09 17:37:05.196761 ip-10-0-143-124 kubenswrapper[2552]: I0609 17:37:05.196717 2552 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-r2ztd\" (UniqueName: \"kubernetes.io/projected/2f51b34b-d7df-4f41-b046-a58499a5e16a-kube-api-access-r2ztd\") pod \"2f51b34b-d7df-4f41-b046-a58499a5e16a\" (UID: \"2f51b34b-d7df-4f41-b046-a58499a5e16a\") " Jun 09 17:37:05.196761 ip-10-0-143-124 kubenswrapper[2552]: I0609 17:37:05.196747 2552 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/2f51b34b-d7df-4f41-b046-a58499a5e16a-registry-tls\") pod \"2f51b34b-d7df-4f41-b046-a58499a5e16a\" (UID: \"2f51b34b-d7df-4f41-b046-a58499a5e16a\") " Jun 09 17:37:05.196908 ip-10-0-143-124 kubenswrapper[2552]: I0609 17:37:05.196798 2552 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/2f51b34b-d7df-4f41-b046-a58499a5e16a-registry-certificates\") pod \"2f51b34b-d7df-4f41-b046-a58499a5e16a\" (UID: \"2f51b34b-d7df-4f41-b046-a58499a5e16a\") " Jun 09 17:37:05.197060 ip-10-0-143-124 kubenswrapper[2552]: I0609 17:37:05.197033 2552 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/2f51b34b-d7df-4f41-b046-a58499a5e16a-trusted-ca" (OuterVolumeSpecName: "trusted-ca") pod "2f51b34b-d7df-4f41-b046-a58499a5e16a" (UID: "2f51b34b-d7df-4f41-b046-a58499a5e16a"). InnerVolumeSpecName "trusted-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 09 17:37:05.197377 ip-10-0-143-124 kubenswrapper[2552]: I0609 17:37:05.197337 2552 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/2f51b34b-d7df-4f41-b046-a58499a5e16a-registry-certificates" (OuterVolumeSpecName: "registry-certificates") pod "2f51b34b-d7df-4f41-b046-a58499a5e16a" (UID: "2f51b34b-d7df-4f41-b046-a58499a5e16a"). InnerVolumeSpecName "registry-certificates". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 09 17:37:05.199082 ip-10-0-143-124 kubenswrapper[2552]: I0609 17:37:05.199049 2552 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/2f51b34b-d7df-4f41-b046-a58499a5e16a-kube-api-access-r2ztd" (OuterVolumeSpecName: "kube-api-access-r2ztd") pod "2f51b34b-d7df-4f41-b046-a58499a5e16a" (UID: "2f51b34b-d7df-4f41-b046-a58499a5e16a"). InnerVolumeSpecName "kube-api-access-r2ztd". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 09 17:37:05.199181 ip-10-0-143-124 kubenswrapper[2552]: I0609 17:37:05.199102 2552 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/2f51b34b-d7df-4f41-b046-a58499a5e16a-bound-sa-token" (OuterVolumeSpecName: "bound-sa-token") pod "2f51b34b-d7df-4f41-b046-a58499a5e16a" (UID: "2f51b34b-d7df-4f41-b046-a58499a5e16a"). InnerVolumeSpecName "bound-sa-token". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 09 17:37:05.199181 ip-10-0-143-124 kubenswrapper[2552]: I0609 17:37:05.199106 2552 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/2f51b34b-d7df-4f41-b046-a58499a5e16a-image-registry-private-configuration" (OuterVolumeSpecName: "image-registry-private-configuration") pod "2f51b34b-d7df-4f41-b046-a58499a5e16a" (UID: "2f51b34b-d7df-4f41-b046-a58499a5e16a"). InnerVolumeSpecName "image-registry-private-configuration". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 09 17:37:05.199181 ip-10-0-143-124 kubenswrapper[2552]: I0609 17:37:05.199159 2552 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/2f51b34b-d7df-4f41-b046-a58499a5e16a-installation-pull-secrets" (OuterVolumeSpecName: "installation-pull-secrets") pod "2f51b34b-d7df-4f41-b046-a58499a5e16a" (UID: "2f51b34b-d7df-4f41-b046-a58499a5e16a"). InnerVolumeSpecName "installation-pull-secrets". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 09 17:37:05.199490 ip-10-0-143-124 kubenswrapper[2552]: I0609 17:37:05.199472 2552 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/2f51b34b-d7df-4f41-b046-a58499a5e16a-registry-tls" (OuterVolumeSpecName: "registry-tls") pod "2f51b34b-d7df-4f41-b046-a58499a5e16a" (UID: "2f51b34b-d7df-4f41-b046-a58499a5e16a"). InnerVolumeSpecName "registry-tls". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 09 17:37:05.205283 ip-10-0-143-124 kubenswrapper[2552]: I0609 17:37:05.205256 2552 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/2f51b34b-d7df-4f41-b046-a58499a5e16a-ca-trust-extracted" (OuterVolumeSpecName: "ca-trust-extracted") pod "2f51b34b-d7df-4f41-b046-a58499a5e16a" (UID: "2f51b34b-d7df-4f41-b046-a58499a5e16a"). InnerVolumeSpecName "ca-trust-extracted". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 09 17:37:05.297319 ip-10-0-143-124 kubenswrapper[2552]: I0609 17:37:05.297281 2552 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-r2ztd\" (UniqueName: \"kubernetes.io/projected/2f51b34b-d7df-4f41-b046-a58499a5e16a-kube-api-access-r2ztd\") on node \"ip-10-0-143-124.ec2.internal\" DevicePath \"\"" Jun 09 17:37:05.297319 ip-10-0-143-124 kubenswrapper[2552]: I0609 17:37:05.297312 2552 reconciler_common.go:299] "Volume detached for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/2f51b34b-d7df-4f41-b046-a58499a5e16a-registry-tls\") on node \"ip-10-0-143-124.ec2.internal\" DevicePath \"\"" Jun 09 17:37:05.297319 ip-10-0-143-124 kubenswrapper[2552]: I0609 17:37:05.297322 2552 reconciler_common.go:299] "Volume detached for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/2f51b34b-d7df-4f41-b046-a58499a5e16a-registry-certificates\") on node \"ip-10-0-143-124.ec2.internal\" DevicePath \"\"" Jun 09 17:37:05.297539 ip-10-0-143-124 kubenswrapper[2552]: I0609 17:37:05.297332 2552 reconciler_common.go:299] "Volume detached for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/2f51b34b-d7df-4f41-b046-a58499a5e16a-installation-pull-secrets\") on node \"ip-10-0-143-124.ec2.internal\" DevicePath \"\"" Jun 09 17:37:05.297539 ip-10-0-143-124 kubenswrapper[2552]: I0609 17:37:05.297341 2552 reconciler_common.go:299] "Volume detached for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/2f51b34b-d7df-4f41-b046-a58499a5e16a-bound-sa-token\") on node \"ip-10-0-143-124.ec2.internal\" DevicePath \"\"" Jun 09 17:37:05.297539 ip-10-0-143-124 kubenswrapper[2552]: I0609 17:37:05.297349 2552 reconciler_common.go:299] "Volume detached for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/2f51b34b-d7df-4f41-b046-a58499a5e16a-image-registry-private-configuration\") on node \"ip-10-0-143-124.ec2.internal\" DevicePath \"\"" Jun 09 17:37:05.297539 ip-10-0-143-124 kubenswrapper[2552]: I0609 17:37:05.297358 2552 reconciler_common.go:299] "Volume detached for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/2f51b34b-d7df-4f41-b046-a58499a5e16a-trusted-ca\") on node \"ip-10-0-143-124.ec2.internal\" DevicePath \"\"" Jun 09 17:37:05.297539 ip-10-0-143-124 kubenswrapper[2552]: I0609 17:37:05.297367 2552 reconciler_common.go:299] "Volume detached for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/2f51b34b-d7df-4f41-b046-a58499a5e16a-ca-trust-extracted\") on node \"ip-10-0-143-124.ec2.internal\" DevicePath \"\"" Jun 09 17:37:05.498876 ip-10-0-143-124 kubenswrapper[2552]: I0609 17:37:05.498847 2552 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-image-registry/image-registry-7df4944668-6mxtj"] Jun 09 17:37:05.502555 ip-10-0-143-124 kubenswrapper[2552]: I0609 17:37:05.502531 2552 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-image-registry/image-registry-7df4944668-6mxtj"] Jun 09 17:37:06.336150 ip-10-0-143-124 kubenswrapper[2552]: I0609 17:37:06.336115 2552 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="2f51b34b-d7df-4f41-b046-a58499a5e16a" path="/var/lib/kubelet/pods/2f51b34b-d7df-4f41-b046-a58499a5e16a/volumes" Jun 09 17:37:09.455396 ip-10-0-143-124 kubenswrapper[2552]: I0609 17:37:09.455359 2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gctfs_8563ebab-ebdd-4d68-bce1-78d2a7f62992/konnectivity-agent/0.log" limit=1024 Jun 09 17:37:09.559213 ip-10-0-143-124 kubenswrapper[2552]: I0609 17:37:09.559182 2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gctfs_8563ebab-ebdd-4d68-bce1-78d2a7f62992/konnectivity-agent/0.log" limit=1024 Jun 09 17:37:10.176225 ip-10-0-143-124 kubenswrapper[2552]: I0609 17:37:10.176195 2552 patch_prober.go:28] interesting pod/image-registry-cb9f4f84d-864t8 container/registry namespace/openshift-image-registry: Liveness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body={"errors":[{"code":"UNAVAILABLE","message":"service unavailable","detail":"health check failed: please see /debug/health"}]} Jun 09 17:37:10.176422 ip-10-0-143-124 kubenswrapper[2552]: I0609 17:37:10.176251 2552 prober.go:120] "Probe failed" probeType="Liveness" pod="openshift-image-registry/image-registry-cb9f4f84d-864t8" podUID="52bfbcd9-9374-4f7b-9bdc-6525c1e21821" containerName="registry" probeResult="failure" output="HTTP probe failed with statuscode: 503" Jun 09 17:37:11.286009 ip-10-0-143-124 kubenswrapper[2552]: I0609 17:37:11.285968 2552 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/downloads-6657875f97-cljc7"] Jun 09 17:37:11.286553 ip-10-0-143-124 kubenswrapper[2552]: I0609 17:37:11.286249 2552 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="2f51b34b-d7df-4f41-b046-a58499a5e16a" containerName="registry" Jun 09 17:37:11.286553 ip-10-0-143-124 kubenswrapper[2552]: I0609 17:37:11.286263 2552 state_mem.go:107] "Deleted CPUSet assignment" podUID="2f51b34b-d7df-4f41-b046-a58499a5e16a" containerName="registry" Jun 09 17:37:11.286553 ip-10-0-143-124 kubenswrapper[2552]: I0609 17:37:11.286311 2552 memory_manager.go:368] "RemoveStaleState removing state" podUID="2f51b34b-d7df-4f41-b046-a58499a5e16a" containerName="registry" Jun 09 17:37:11.286737 ip-10-0-143-124 kubenswrapper[2552]: I0609 17:37:11.286694 2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gctfs_8563ebab-ebdd-4d68-bce1-78d2a7f62992/konnectivity-agent/0.log" limit=1024 Jun 09 17:37:11.290665 ip-10-0-143-124 kubenswrapper[2552]: I0609 17:37:11.290650 2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/downloads-6657875f97-cljc7" Jun 09 17:37:11.293330 ip-10-0-143-124 kubenswrapper[2552]: I0609 17:37:11.293312 2552 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"default-dockercfg-jbf5z\"" Jun 09 17:37:11.293552 ip-10-0-143-124 kubenswrapper[2552]: I0609 17:37:11.293532 2552 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"kube-root-ca.crt\"" Jun 09 17:37:11.293691 ip-10-0-143-124 kubenswrapper[2552]: I0609 17:37:11.293618 2552 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"openshift-service-ca.crt\"" Jun 09 17:37:11.297903 ip-10-0-143-124 kubenswrapper[2552]: I0609 17:37:11.297882 2552 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/downloads-6657875f97-cljc7"] Jun 09 17:37:11.345048 ip-10-0-143-124 kubenswrapper[2552]: I0609 17:37:11.345010 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-lp5jl\" (UniqueName: \"kubernetes.io/projected/3c2d3304-77d3-4fef-b40d-8933971fedda-kube-api-access-lp5jl\") pod \"downloads-6657875f97-cljc7\" (UID: \"3c2d3304-77d3-4fef-b40d-8933971fedda\") " pod="openshift-console/downloads-6657875f97-cljc7" Jun 09 17:37:11.379660 ip-10-0-143-124 kubenswrapper[2552]: I0609 17:37:11.379626 2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gctfs_8563ebab-ebdd-4d68-bce1-78d2a7f62992/konnectivity-agent/0.log" limit=1024 Jun 09 17:37:11.446149 ip-10-0-143-124 kubenswrapper[2552]: I0609 17:37:11.446110 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-lp5jl\" (UniqueName: \"kubernetes.io/projected/3c2d3304-77d3-4fef-b40d-8933971fedda-kube-api-access-lp5jl\") pod \"downloads-6657875f97-cljc7\" (UID: \"3c2d3304-77d3-4fef-b40d-8933971fedda\") " pod="openshift-console/downloads-6657875f97-cljc7" Jun 09 17:37:11.455096 ip-10-0-143-124 kubenswrapper[2552]: I0609 17:37:11.455064 2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-lp5jl\" (UniqueName: \"kubernetes.io/projected/3c2d3304-77d3-4fef-b40d-8933971fedda-kube-api-access-lp5jl\") pod \"downloads-6657875f97-cljc7\" (UID: \"3c2d3304-77d3-4fef-b40d-8933971fedda\") " pod="openshift-console/downloads-6657875f97-cljc7" Jun 09 17:37:11.579645 ip-10-0-143-124 kubenswrapper[2552]: I0609 17:37:11.579544 2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gctfs_8563ebab-ebdd-4d68-bce1-78d2a7f62992/konnectivity-agent/0.log" limit=1024 Jun 09 17:37:11.600339 ip-10-0-143-124 kubenswrapper[2552]: I0609 17:37:11.600312 2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/downloads-6657875f97-cljc7" Jun 09 17:37:11.726634 ip-10-0-143-124 kubenswrapper[2552]: I0609 17:37:11.726590 2552 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/downloads-6657875f97-cljc7"] Jun 09 17:37:11.729780 ip-10-0-143-124 kubenswrapper[2552]: W0609 17:37:11.729748 2552 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3c2d3304_77d3_4fef_b40d_8933971fedda.slice/crio-63af22d435104bdd5ffe8eba9fd82d9cea3aef768d9683a2d63bab86d3637866 WatchSource:0}: Error finding container 63af22d435104bdd5ffe8eba9fd82d9cea3aef768d9683a2d63bab86d3637866: Status 404 returned error can't find the container with id 63af22d435104bdd5ffe8eba9fd82d9cea3aef768d9683a2d63bab86d3637866 Jun 09 17:37:11.753358 ip-10-0-143-124 kubenswrapper[2552]: I0609 17:37:11.753331 2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gctfs_8563ebab-ebdd-4d68-bce1-78d2a7f62992/konnectivity-agent/0.log" limit=1024 Jun 09 17:37:11.816715 ip-10-0-143-124 kubenswrapper[2552]: I0609 17:37:11.816680 2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gctfs_8563ebab-ebdd-4d68-bce1-78d2a7f62992/konnectivity-agent/0.log" limit=1024 Jun 09 17:37:12.097473 ip-10-0-143-124 kubenswrapper[2552]: I0609 17:37:12.097435 2552 patch_prober.go:28] interesting pod/image-registry-cb9f4f84d-864t8 container/registry namespace/openshift-image-registry: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body={"errors":[{"code":"UNAVAILABLE","message":"service unavailable","detail":"health check failed: please see /debug/health"}]} Jun 09 17:37:12.097649 ip-10-0-143-124 kubenswrapper[2552]: I0609 17:37:12.097491 2552 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-image-registry/image-registry-cb9f4f84d-864t8" podUID="52bfbcd9-9374-4f7b-9bdc-6525c1e21821" containerName="registry" probeResult="failure" output="HTTP probe failed with statuscode: 503" Jun 09 17:37:12.150527 ip-10-0-143-124 kubenswrapper[2552]: I0609 17:37:12.150494 2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gctfs_8563ebab-ebdd-4d68-bce1-78d2a7f62992/konnectivity-agent/0.log" limit=1024 Jun 09 17:37:12.204808 ip-10-0-143-124 kubenswrapper[2552]: I0609 17:37:12.204778 2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/downloads-6657875f97-cljc7" event={"ID":"3c2d3304-77d3-4fef-b40d-8933971fedda","Type":"ContainerStarted","Data":"63af22d435104bdd5ffe8eba9fd82d9cea3aef768d9683a2d63bab86d3637866"} Jun 09 17:37:12.215885 ip-10-0-143-124 kubenswrapper[2552]: I0609 17:37:12.215861 2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gctfs_8563ebab-ebdd-4d68-bce1-78d2a7f62992/konnectivity-agent/0.log" limit=1024 Jun 09 17:37:12.965349 ip-10-0-143-124 kubenswrapper[2552]: I0609 17:37:12.965306 2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gctfs_8563ebab-ebdd-4d68-bce1-78d2a7f62992/konnectivity-agent/0.log" limit=1024 Jun 09 17:37:13.160710 ip-10-0-143-124 kubenswrapper[2552]: I0609 17:37:13.160676 2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gctfs_8563ebab-ebdd-4d68-bce1-78d2a7f62992/konnectivity-agent/0.log" limit=1024 Jun 09 17:37:13.261936 ip-10-0-143-124 kubenswrapper[2552]: I0609 17:37:13.261889 2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gctfs_8563ebab-ebdd-4d68-bce1-78d2a7f62992/konnectivity-agent/0.log" limit=1024 Jun 09 17:37:13.976909 ip-10-0-143-124 kubenswrapper[2552]: I0609 17:37:13.976868 2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gctfs_8563ebab-ebdd-4d68-bce1-78d2a7f62992/konnectivity-agent/0.log" limit=1024 Jun 09 17:37:14.078690 ip-10-0-143-124 kubenswrapper[2552]: I0609 17:37:14.078657 2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gctfs_8563ebab-ebdd-4d68-bce1-78d2a7f62992/konnectivity-agent/0.log" limit=1024 Jun 09 17:37:16.120677 ip-10-0-143-124 kubenswrapper[2552]: I0609 17:37:16.120630 2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gctfs_8563ebab-ebdd-4d68-bce1-78d2a7f62992/konnectivity-agent/0.log" limit=1024 Jun 09 17:37:16.176952 ip-10-0-143-124 kubenswrapper[2552]: I0609 17:37:16.176914 2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gctfs_8563ebab-ebdd-4d68-bce1-78d2a7f62992/konnectivity-agent/0.log" limit=1024 Jun 09 17:37:20.176302 ip-10-0-143-124 kubenswrapper[2552]: I0609 17:37:20.176270 2552 patch_prober.go:28] interesting pod/image-registry-cb9f4f84d-864t8 container/registry namespace/openshift-image-registry: Liveness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body={"errors":[{"code":"UNAVAILABLE","message":"service unavailable","detail":"health check failed: please see /debug/health"}]} Jun 09 17:37:20.176727 ip-10-0-143-124 kubenswrapper[2552]: I0609 17:37:20.176321 2552 prober.go:120] "Probe failed" probeType="Liveness" pod="openshift-image-registry/image-registry-cb9f4f84d-864t8" podUID="52bfbcd9-9374-4f7b-9bdc-6525c1e21821" containerName="registry" probeResult="failure" output="HTTP probe failed with statuscode: 503" Jun 09 17:37:20.176727 ip-10-0-143-124 kubenswrapper[2552]: I0609 17:37:20.176360 2552 kubelet.go:2654] "SyncLoop (probe)" probe="liveness" status="unhealthy" pod="openshift-image-registry/image-registry-cb9f4f84d-864t8" Jun 09 17:37:20.176829 ip-10-0-143-124 kubenswrapper[2552]: I0609 17:37:20.176810 2552 kuberuntime_manager.go:1192] "Message for Container of pod" containerName="registry" containerStatusID={"Type":"cri-o","ID":"022ab088221b4e02f858f760c7cc30f4c68c1e8b2f5aa4fed715382461ec0345"} pod="openshift-image-registry/image-registry-cb9f4f84d-864t8" containerMessage="Container registry failed liveness probe, will be restarted" Jun 09 17:37:20.180266 ip-10-0-143-124 kubenswrapper[2552]: I0609 17:37:20.180240 2552 patch_prober.go:28] interesting pod/image-registry-cb9f4f84d-864t8 container/registry namespace/openshift-image-registry: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body={"errors":[{"code":"UNAVAILABLE","message":"service unavailable","detail":"health check failed: please see /debug/health"}]} Jun 09 17:37:20.180391 ip-10-0-143-124 kubenswrapper[2552]: I0609 17:37:20.180289 2552 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-image-registry/image-registry-cb9f4f84d-864t8" podUID="52bfbcd9-9374-4f7b-9bdc-6525c1e21821" containerName="registry" probeResult="failure" output="HTTP probe failed with statuscode: 503" Jun 09 17:37:21.987759 ip-10-0-143-124 kubenswrapper[2552]: I0609 17:37:21.987725 2552 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-5c87578bc6-xp2v4"] Jun 09 17:37:21.996056 ip-10-0-143-124 kubenswrapper[2552]: I0609 17:37:21.996029 2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-5c87578bc6-xp2v4" Jun 09 17:37:21.999074 ip-10-0-143-124 kubenswrapper[2552]: I0609 17:37:21.999047 2552 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"service-ca\"" Jun 09 17:37:21.999271 ip-10-0-143-124 kubenswrapper[2552]: I0609 17:37:21.999246 2552 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"console-config\"" Jun 09 17:37:21.999393 ip-10-0-143-124 kubenswrapper[2552]: I0609 17:37:21.999324 2552 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-dockercfg-tvv8s\"" Jun 09 17:37:21.999665 ip-10-0-143-124 kubenswrapper[2552]: I0609 17:37:21.999643 2552 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-oauth-config\"" Jun 09 17:37:21.999749 ip-10-0-143-124 kubenswrapper[2552]: I0609 17:37:21.999661 2552 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-serving-cert\"" Jun 09 17:37:22.000130 ip-10-0-143-124 kubenswrapper[2552]: I0609 17:37:22.000113 2552 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"oauth-serving-cert\"" Jun 09 17:37:22.002459 ip-10-0-143-124 kubenswrapper[2552]: I0609 17:37:22.002438 2552 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-5c87578bc6-xp2v4"] Jun 09 17:37:22.144581 ip-10-0-143-124 kubenswrapper[2552]: I0609 17:37:22.144533 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/a19e2dd8-8f3d-4726-97eb-7fe9676d9925-console-serving-cert\") pod \"console-5c87578bc6-xp2v4\" (UID: \"a19e2dd8-8f3d-4726-97eb-7fe9676d9925\") " pod="openshift-console/console-5c87578bc6-xp2v4" Jun 09 17:37:22.144581 ip-10-0-143-124 kubenswrapper[2552]: I0609 17:37:22.144586 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/a19e2dd8-8f3d-4726-97eb-7fe9676d9925-console-config\") pod \"console-5c87578bc6-xp2v4\" (UID: \"a19e2dd8-8f3d-4726-97eb-7fe9676d9925\") " pod="openshift-console/console-5c87578bc6-xp2v4" Jun 09 17:37:22.144794 ip-10-0-143-124 kubenswrapper[2552]: I0609 17:37:22.144627 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-bdnff\" (UniqueName: \"kubernetes.io/projected/a19e2dd8-8f3d-4726-97eb-7fe9676d9925-kube-api-access-bdnff\") pod \"console-5c87578bc6-xp2v4\" (UID: \"a19e2dd8-8f3d-4726-97eb-7fe9676d9925\") " pod="openshift-console/console-5c87578bc6-xp2v4" Jun 09 17:37:22.144794 ip-10-0-143-124 kubenswrapper[2552]: I0609 17:37:22.144692 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/a19e2dd8-8f3d-4726-97eb-7fe9676d9925-oauth-serving-cert\") pod \"console-5c87578bc6-xp2v4\" (UID: \"a19e2dd8-8f3d-4726-97eb-7fe9676d9925\") " pod="openshift-console/console-5c87578bc6-xp2v4" Jun 09 17:37:22.144794 ip-10-0-143-124 kubenswrapper[2552]: I0609 17:37:22.144727 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/a19e2dd8-8f3d-4726-97eb-7fe9676d9925-console-oauth-config\") pod \"console-5c87578bc6-xp2v4\" (UID: \"a19e2dd8-8f3d-4726-97eb-7fe9676d9925\") " pod="openshift-console/console-5c87578bc6-xp2v4" Jun 09 17:37:22.144886 ip-10-0-143-124 kubenswrapper[2552]: I0609 17:37:22.144797 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/a19e2dd8-8f3d-4726-97eb-7fe9676d9925-service-ca\") pod \"console-5c87578bc6-xp2v4\" (UID: \"a19e2dd8-8f3d-4726-97eb-7fe9676d9925\") " pod="openshift-console/console-5c87578bc6-xp2v4" Jun 09 17:37:22.245639 ip-10-0-143-124 kubenswrapper[2552]: I0609 17:37:22.245593 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/a19e2dd8-8f3d-4726-97eb-7fe9676d9925-oauth-serving-cert\") pod \"console-5c87578bc6-xp2v4\" (UID: \"a19e2dd8-8f3d-4726-97eb-7fe9676d9925\") " pod="openshift-console/console-5c87578bc6-xp2v4" Jun 09 17:37:22.245817 ip-10-0-143-124 kubenswrapper[2552]: I0609 17:37:22.245656 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/a19e2dd8-8f3d-4726-97eb-7fe9676d9925-console-oauth-config\") pod \"console-5c87578bc6-xp2v4\" (UID: \"a19e2dd8-8f3d-4726-97eb-7fe9676d9925\") " pod="openshift-console/console-5c87578bc6-xp2v4" Jun 09 17:37:22.245817 ip-10-0-143-124 kubenswrapper[2552]: I0609 17:37:22.245714 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/a19e2dd8-8f3d-4726-97eb-7fe9676d9925-service-ca\") pod \"console-5c87578bc6-xp2v4\" (UID: \"a19e2dd8-8f3d-4726-97eb-7fe9676d9925\") " pod="openshift-console/console-5c87578bc6-xp2v4" Jun 09 17:37:22.245817 ip-10-0-143-124 kubenswrapper[2552]: I0609 17:37:22.245785 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/a19e2dd8-8f3d-4726-97eb-7fe9676d9925-console-serving-cert\") pod \"console-5c87578bc6-xp2v4\" (UID: \"a19e2dd8-8f3d-4726-97eb-7fe9676d9925\") " pod="openshift-console/console-5c87578bc6-xp2v4" Jun 09 17:37:22.245817 ip-10-0-143-124 kubenswrapper[2552]: I0609 17:37:22.245806 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/a19e2dd8-8f3d-4726-97eb-7fe9676d9925-console-config\") pod \"console-5c87578bc6-xp2v4\" (UID: \"a19e2dd8-8f3d-4726-97eb-7fe9676d9925\") " pod="openshift-console/console-5c87578bc6-xp2v4" Jun 09 17:37:22.246022 ip-10-0-143-124 kubenswrapper[2552]: I0609 17:37:22.245822 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-bdnff\" (UniqueName: \"kubernetes.io/projected/a19e2dd8-8f3d-4726-97eb-7fe9676d9925-kube-api-access-bdnff\") pod \"console-5c87578bc6-xp2v4\" (UID: \"a19e2dd8-8f3d-4726-97eb-7fe9676d9925\") " pod="openshift-console/console-5c87578bc6-xp2v4" Jun 09 17:37:22.246423 ip-10-0-143-124 kubenswrapper[2552]: I0609 17:37:22.246393 2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/a19e2dd8-8f3d-4726-97eb-7fe9676d9925-oauth-serving-cert\") pod \"console-5c87578bc6-xp2v4\" (UID: \"a19e2dd8-8f3d-4726-97eb-7fe9676d9925\") " pod="openshift-console/console-5c87578bc6-xp2v4" Jun 09 17:37:22.246740 ip-10-0-143-124 kubenswrapper[2552]: I0609 17:37:22.246721 2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/a19e2dd8-8f3d-4726-97eb-7fe9676d9925-service-ca\") pod \"console-5c87578bc6-xp2v4\" (UID: \"a19e2dd8-8f3d-4726-97eb-7fe9676d9925\") " pod="openshift-console/console-5c87578bc6-xp2v4" Jun 09 17:37:22.246828 ip-10-0-143-124 kubenswrapper[2552]: I0609 17:37:22.246805 2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/a19e2dd8-8f3d-4726-97eb-7fe9676d9925-console-config\") pod \"console-5c87578bc6-xp2v4\" (UID: \"a19e2dd8-8f3d-4726-97eb-7fe9676d9925\") " pod="openshift-console/console-5c87578bc6-xp2v4" Jun 09 17:37:22.248382 ip-10-0-143-124 kubenswrapper[2552]: I0609 17:37:22.248359 2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/a19e2dd8-8f3d-4726-97eb-7fe9676d9925-console-oauth-config\") pod \"console-5c87578bc6-xp2v4\" (UID: \"a19e2dd8-8f3d-4726-97eb-7fe9676d9925\") " pod="openshift-console/console-5c87578bc6-xp2v4" Jun 09 17:37:22.248516 ip-10-0-143-124 kubenswrapper[2552]: I0609 17:37:22.248484 2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/a19e2dd8-8f3d-4726-97eb-7fe9676d9925-console-serving-cert\") pod \"console-5c87578bc6-xp2v4\" (UID: \"a19e2dd8-8f3d-4726-97eb-7fe9676d9925\") " pod="openshift-console/console-5c87578bc6-xp2v4" Jun 09 17:37:22.255337 ip-10-0-143-124 kubenswrapper[2552]: I0609 17:37:22.255313 2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-bdnff\" (UniqueName: \"kubernetes.io/projected/a19e2dd8-8f3d-4726-97eb-7fe9676d9925-kube-api-access-bdnff\") pod \"console-5c87578bc6-xp2v4\" (UID: \"a19e2dd8-8f3d-4726-97eb-7fe9676d9925\") " pod="openshift-console/console-5c87578bc6-xp2v4" Jun 09 17:37:22.307817 ip-10-0-143-124 kubenswrapper[2552]: I0609 17:37:22.307784 2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-5c87578bc6-xp2v4" Jun 09 17:37:22.450307 ip-10-0-143-124 kubenswrapper[2552]: I0609 17:37:22.450275 2552 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-5c87578bc6-xp2v4"] Jun 09 17:37:22.453882 ip-10-0-143-124 kubenswrapper[2552]: W0609 17:37:22.453853 2552 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda19e2dd8_8f3d_4726_97eb_7fe9676d9925.slice/crio-4965e01eb2220d9053d404f281989236026b6f6044de5d01bc2614a1f8531b18 WatchSource:0}: Error finding container 4965e01eb2220d9053d404f281989236026b6f6044de5d01bc2614a1f8531b18: Status 404 returned error can't find the container with id 4965e01eb2220d9053d404f281989236026b6f6044de5d01bc2614a1f8531b18 Jun 09 17:37:23.189318 ip-10-0-143-124 kubenswrapper[2552]: I0609 17:37:23.189282 2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gctfs_8563ebab-ebdd-4d68-bce1-78d2a7f62992/konnectivity-agent/0.log" limit=1024 Jun 09 17:37:23.244654 ip-10-0-143-124 kubenswrapper[2552]: I0609 17:37:23.244616 2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-5c87578bc6-xp2v4" event={"ID":"a19e2dd8-8f3d-4726-97eb-7fe9676d9925","Type":"ContainerStarted","Data":"4965e01eb2220d9053d404f281989236026b6f6044de5d01bc2614a1f8531b18"} Jun 09 17:37:23.289758 ip-10-0-143-124 kubenswrapper[2552]: I0609 17:37:23.289720 2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gctfs_8563ebab-ebdd-4d68-bce1-78d2a7f62992/konnectivity-agent/0.log" limit=1024 Jun 09 17:37:23.389978 ip-10-0-143-124 kubenswrapper[2552]: I0609 17:37:23.389930 2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gctfs_8563ebab-ebdd-4d68-bce1-78d2a7f62992/konnectivity-agent/0.log" limit=1024 Jun 09 17:37:26.259092 ip-10-0-143-124 kubenswrapper[2552]: I0609 17:37:26.259052 2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-5c87578bc6-xp2v4" event={"ID":"a19e2dd8-8f3d-4726-97eb-7fe9676d9925","Type":"ContainerStarted","Data":"5789242418dabd56bba4db773cc7e587c80101788b62a5a061ce3603d7740c80"} Jun 09 17:37:26.277283 ip-10-0-143-124 kubenswrapper[2552]: I0609 17:37:26.277235 2552 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-5c87578bc6-xp2v4" podStartSLOduration=1.616498475 podStartE2EDuration="5.2772126s" totalImagesPullingTime="3.660714125s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-09 17:37:21 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-09 17:37:26.276063717 +0000 UTC m=+250.375966381" watchObservedRunningTime="2026-06-09 17:37:26.2772126 +0000 UTC m=+250.377115343" Jun 09 17:37:27.178998 ip-10-0-143-124 kubenswrapper[2552]: I0609 17:37:27.178951 2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gctfs_8563ebab-ebdd-4d68-bce1-78d2a7f62992/konnectivity-agent/0.log" limit=1024 Jun 09 17:37:28.095325 ip-10-0-143-124 kubenswrapper[2552]: I0609 17:37:28.095276 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/b817ed32-ca44-43a6-99cf-8cf86ffd8c05-metrics-certs\") pod \"network-metrics-daemon-pvmnc\" (UID: \"b817ed32-ca44-43a6-99cf-8cf86ffd8c05\") " pod="openshift-multus/network-metrics-daemon-pvmnc" Jun 09 17:37:28.098067 ip-10-0-143-124 kubenswrapper[2552]: I0609 17:37:28.098038 2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/b817ed32-ca44-43a6-99cf-8cf86ffd8c05-metrics-certs\") pod \"network-metrics-daemon-pvmnc\" (UID: \"b817ed32-ca44-43a6-99cf-8cf86ffd8c05\") " pod="openshift-multus/network-metrics-daemon-pvmnc" Jun 09 17:37:28.335331 ip-10-0-143-124 kubenswrapper[2552]: I0609 17:37:28.335297 2552 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-w8x52\"" Jun 09 17:37:28.342560 ip-10-0-143-124 kubenswrapper[2552]: I0609 17:37:28.342530 2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-pvmnc" Jun 09 17:37:30.182058 ip-10-0-143-124 kubenswrapper[2552]: I0609 17:37:30.182007 2552 patch_prober.go:28] interesting pod/image-registry-cb9f4f84d-864t8 container/registry namespace/openshift-image-registry: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body={"errors":[{"code":"UNAVAILABLE","message":"service unavailable","detail":"health check failed: please see /debug/health"}]} Jun 09 17:37:30.182481 ip-10-0-143-124 kubenswrapper[2552]: I0609 17:37:30.182072 2552 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-image-registry/image-registry-cb9f4f84d-864t8" podUID="52bfbcd9-9374-4f7b-9bdc-6525c1e21821" containerName="registry" probeResult="failure" output="HTTP probe failed with statuscode: 503" Jun 09 17:37:30.783430 ip-10-0-143-124 kubenswrapper[2552]: I0609 17:37:30.783347 2552 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-5b658b65bd-q5cg6"] Jun 09 17:37:30.786337 ip-10-0-143-124 kubenswrapper[2552]: I0609 17:37:30.786309 2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-5b658b65bd-q5cg6" Jun 09 17:37:30.796010 ip-10-0-143-124 kubenswrapper[2552]: I0609 17:37:30.795980 2552 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"trusted-ca-bundle\"" Jun 09 17:37:30.798176 ip-10-0-143-124 kubenswrapper[2552]: I0609 17:37:30.798151 2552 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-5b658b65bd-q5cg6"] Jun 09 17:37:30.816913 ip-10-0-143-124 kubenswrapper[2552]: I0609 17:37:30.816888 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/b2c04056-6f26-4eb7-88a6-13e3ded83702-oauth-serving-cert\") pod \"console-5b658b65bd-q5cg6\" (UID: \"b2c04056-6f26-4eb7-88a6-13e3ded83702\") " pod="openshift-console/console-5b658b65bd-q5cg6" Jun 09 17:37:30.817077 ip-10-0-143-124 kubenswrapper[2552]: I0609 17:37:30.816922 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2fgxw\" (UniqueName: \"kubernetes.io/projected/b2c04056-6f26-4eb7-88a6-13e3ded83702-kube-api-access-2fgxw\") pod \"console-5b658b65bd-q5cg6\" (UID: \"b2c04056-6f26-4eb7-88a6-13e3ded83702\") " pod="openshift-console/console-5b658b65bd-q5cg6" Jun 09 17:37:30.817077 ip-10-0-143-124 kubenswrapper[2552]: I0609 17:37:30.816989 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/b2c04056-6f26-4eb7-88a6-13e3ded83702-console-oauth-config\") pod \"console-5b658b65bd-q5cg6\" (UID: \"b2c04056-6f26-4eb7-88a6-13e3ded83702\") " pod="openshift-console/console-5b658b65bd-q5cg6" Jun 09 17:37:30.817077 ip-10-0-143-124 kubenswrapper[2552]: I0609 17:37:30.817025 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/b2c04056-6f26-4eb7-88a6-13e3ded83702-console-config\") pod \"console-5b658b65bd-q5cg6\" (UID: \"b2c04056-6f26-4eb7-88a6-13e3ded83702\") " pod="openshift-console/console-5b658b65bd-q5cg6" Jun 09 17:37:30.817077 ip-10-0-143-124 kubenswrapper[2552]: I0609 17:37:30.817053 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/b2c04056-6f26-4eb7-88a6-13e3ded83702-trusted-ca-bundle\") pod \"console-5b658b65bd-q5cg6\" (UID: \"b2c04056-6f26-4eb7-88a6-13e3ded83702\") " pod="openshift-console/console-5b658b65bd-q5cg6" Jun 09 17:37:30.817288 ip-10-0-143-124 kubenswrapper[2552]: I0609 17:37:30.817118 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/b2c04056-6f26-4eb7-88a6-13e3ded83702-console-serving-cert\") pod \"console-5b658b65bd-q5cg6\" (UID: \"b2c04056-6f26-4eb7-88a6-13e3ded83702\") " pod="openshift-console/console-5b658b65bd-q5cg6" Jun 09 17:37:30.817288 ip-10-0-143-124 kubenswrapper[2552]: I0609 17:37:30.817164 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/b2c04056-6f26-4eb7-88a6-13e3ded83702-service-ca\") pod \"console-5b658b65bd-q5cg6\" (UID: \"b2c04056-6f26-4eb7-88a6-13e3ded83702\") " pod="openshift-console/console-5b658b65bd-q5cg6" Jun 09 17:37:30.918252 ip-10-0-143-124 kubenswrapper[2552]: I0609 17:37:30.918210 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/b2c04056-6f26-4eb7-88a6-13e3ded83702-console-serving-cert\") pod \"console-5b658b65bd-q5cg6\" (UID: \"b2c04056-6f26-4eb7-88a6-13e3ded83702\") " pod="openshift-console/console-5b658b65bd-q5cg6" Jun 09 17:37:30.918252 ip-10-0-143-124 kubenswrapper[2552]: I0609 17:37:30.918258 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/b2c04056-6f26-4eb7-88a6-13e3ded83702-service-ca\") pod \"console-5b658b65bd-q5cg6\" (UID: \"b2c04056-6f26-4eb7-88a6-13e3ded83702\") " pod="openshift-console/console-5b658b65bd-q5cg6" Jun 09 17:37:30.918490 ip-10-0-143-124 kubenswrapper[2552]: I0609 17:37:30.918314 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/b2c04056-6f26-4eb7-88a6-13e3ded83702-oauth-serving-cert\") pod \"console-5b658b65bd-q5cg6\" (UID: \"b2c04056-6f26-4eb7-88a6-13e3ded83702\") " pod="openshift-console/console-5b658b65bd-q5cg6" Jun 09 17:37:30.918490 ip-10-0-143-124 kubenswrapper[2552]: I0609 17:37:30.918337 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2fgxw\" (UniqueName: \"kubernetes.io/projected/b2c04056-6f26-4eb7-88a6-13e3ded83702-kube-api-access-2fgxw\") pod \"console-5b658b65bd-q5cg6\" (UID: \"b2c04056-6f26-4eb7-88a6-13e3ded83702\") " pod="openshift-console/console-5b658b65bd-q5cg6" Jun 09 17:37:30.918490 ip-10-0-143-124 kubenswrapper[2552]: I0609 17:37:30.918389 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/b2c04056-6f26-4eb7-88a6-13e3ded83702-console-oauth-config\") pod \"console-5b658b65bd-q5cg6\" (UID: \"b2c04056-6f26-4eb7-88a6-13e3ded83702\") " pod="openshift-console/console-5b658b65bd-q5cg6" Jun 09 17:37:30.918490 ip-10-0-143-124 kubenswrapper[2552]: I0609 17:37:30.918422 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/b2c04056-6f26-4eb7-88a6-13e3ded83702-console-config\") pod \"console-5b658b65bd-q5cg6\" (UID: \"b2c04056-6f26-4eb7-88a6-13e3ded83702\") " pod="openshift-console/console-5b658b65bd-q5cg6" Jun 09 17:37:30.918490 ip-10-0-143-124 kubenswrapper[2552]: I0609 17:37:30.918448 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/b2c04056-6f26-4eb7-88a6-13e3ded83702-trusted-ca-bundle\") pod \"console-5b658b65bd-q5cg6\" (UID: \"b2c04056-6f26-4eb7-88a6-13e3ded83702\") " pod="openshift-console/console-5b658b65bd-q5cg6" Jun 09 17:37:30.919238 ip-10-0-143-124 kubenswrapper[2552]: I0609 17:37:30.919189 2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/b2c04056-6f26-4eb7-88a6-13e3ded83702-service-ca\") pod \"console-5b658b65bd-q5cg6\" (UID: \"b2c04056-6f26-4eb7-88a6-13e3ded83702\") " pod="openshift-console/console-5b658b65bd-q5cg6" Jun 09 17:37:30.919359 ip-10-0-143-124 kubenswrapper[2552]: I0609 17:37:30.919290 2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/b2c04056-6f26-4eb7-88a6-13e3ded83702-oauth-serving-cert\") pod \"console-5b658b65bd-q5cg6\" (UID: \"b2c04056-6f26-4eb7-88a6-13e3ded83702\") " pod="openshift-console/console-5b658b65bd-q5cg6" Jun 09 17:37:30.920434 ip-10-0-143-124 kubenswrapper[2552]: I0609 17:37:30.919808 2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/b2c04056-6f26-4eb7-88a6-13e3ded83702-trusted-ca-bundle\") pod \"console-5b658b65bd-q5cg6\" (UID: \"b2c04056-6f26-4eb7-88a6-13e3ded83702\") " pod="openshift-console/console-5b658b65bd-q5cg6" Jun 09 17:37:30.920434 ip-10-0-143-124 kubenswrapper[2552]: I0609 17:37:30.920390 2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/b2c04056-6f26-4eb7-88a6-13e3ded83702-console-config\") pod \"console-5b658b65bd-q5cg6\" (UID: \"b2c04056-6f26-4eb7-88a6-13e3ded83702\") " pod="openshift-console/console-5b658b65bd-q5cg6" Jun 09 17:37:30.921346 ip-10-0-143-124 kubenswrapper[2552]: I0609 17:37:30.921312 2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/b2c04056-6f26-4eb7-88a6-13e3ded83702-console-serving-cert\") pod \"console-5b658b65bd-q5cg6\" (UID: \"b2c04056-6f26-4eb7-88a6-13e3ded83702\") " pod="openshift-console/console-5b658b65bd-q5cg6" Jun 09 17:37:30.921518 ip-10-0-143-124 kubenswrapper[2552]: I0609 17:37:30.921495 2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/b2c04056-6f26-4eb7-88a6-13e3ded83702-console-oauth-config\") pod \"console-5b658b65bd-q5cg6\" (UID: \"b2c04056-6f26-4eb7-88a6-13e3ded83702\") " pod="openshift-console/console-5b658b65bd-q5cg6" Jun 09 17:37:30.928627 ip-10-0-143-124 kubenswrapper[2552]: I0609 17:37:30.928563 2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-2fgxw\" (UniqueName: \"kubernetes.io/projected/b2c04056-6f26-4eb7-88a6-13e3ded83702-kube-api-access-2fgxw\") pod \"console-5b658b65bd-q5cg6\" (UID: \"b2c04056-6f26-4eb7-88a6-13e3ded83702\") " pod="openshift-console/console-5b658b65bd-q5cg6" Jun 09 17:37:30.980004 ip-10-0-143-124 kubenswrapper[2552]: I0609 17:37:30.979967 2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gctfs_8563ebab-ebdd-4d68-bce1-78d2a7f62992/konnectivity-agent/0.log" limit=1024 Jun 09 17:37:31.037907 ip-10-0-143-124 kubenswrapper[2552]: I0609 17:37:31.037818 2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gctfs_8563ebab-ebdd-4d68-bce1-78d2a7f62992/konnectivity-agent/0.log" limit=1024 Jun 09 17:37:31.097302 ip-10-0-143-124 kubenswrapper[2552]: I0609 17:37:31.097268 2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-5b658b65bd-q5cg6" Jun 09 17:37:32.308526 ip-10-0-143-124 kubenswrapper[2552]: I0609 17:37:32.308491 2552 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-5c87578bc6-xp2v4" Jun 09 17:37:32.309012 ip-10-0-143-124 kubenswrapper[2552]: I0609 17:37:32.308876 2552 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-5c87578bc6-xp2v4" Jun 09 17:37:32.310330 ip-10-0-143-124 kubenswrapper[2552]: I0609 17:37:32.310303 2552 patch_prober.go:28] interesting pod/console-5c87578bc6-xp2v4 container/console namespace/openshift-console: Startup probe status=failure output="Get \"https://10.134.0.18:8443/health\": dial tcp 10.134.0.18:8443: connect: connection refused" start-of-body= Jun 09 17:37:32.310471 ip-10-0-143-124 kubenswrapper[2552]: I0609 17:37:32.310382 2552 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-console/console-5c87578bc6-xp2v4" podUID="a19e2dd8-8f3d-4726-97eb-7fe9676d9925" containerName="console" probeResult="failure" output="Get \"https://10.134.0.18:8443/health\": dial tcp 10.134.0.18:8443: connect: connection refused" Jun 09 17:37:33.339018 ip-10-0-143-124 kubenswrapper[2552]: I0609 17:37:33.338986 2552 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-5b658b65bd-q5cg6"] Jun 09 17:37:33.342682 ip-10-0-143-124 kubenswrapper[2552]: W0609 17:37:33.342659 2552 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb2c04056_6f26_4eb7_88a6_13e3ded83702.slice/crio-562bbc4fa782e0609237bc2e02f40ff80467819e0c9ac9169a7630dff5c0bf39 WatchSource:0}: Error finding container 562bbc4fa782e0609237bc2e02f40ff80467819e0c9ac9169a7630dff5c0bf39: Status 404 returned error can't find the container with id 562bbc4fa782e0609237bc2e02f40ff80467819e0c9ac9169a7630dff5c0bf39 Jun 09 17:37:33.367768 ip-10-0-143-124 kubenswrapper[2552]: I0609 17:37:33.367741 2552 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-pvmnc"] Jun 09 17:37:33.379612 ip-10-0-143-124 kubenswrapper[2552]: W0609 17:37:33.379571 2552 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb817ed32_ca44_43a6_99cf_8cf86ffd8c05.slice/crio-1f7b85320844cf213c5a0afc23d1d8f089b35ca078176154e3ae300b826da23b WatchSource:0}: Error finding container 1f7b85320844cf213c5a0afc23d1d8f089b35ca078176154e3ae300b826da23b: Status 404 returned error can't find the container with id 1f7b85320844cf213c5a0afc23d1d8f089b35ca078176154e3ae300b826da23b Jun 09 17:37:34.295828 ip-10-0-143-124 kubenswrapper[2552]: I0609 17:37:34.295794 2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/downloads-6657875f97-cljc7" event={"ID":"3c2d3304-77d3-4fef-b40d-8933971fedda","Type":"ContainerStarted","Data":"a77af922818786e396576813d97a0891cab3def35c3eaa8636d7855e765a1432"} Jun 09 17:37:34.296010 ip-10-0-143-124 kubenswrapper[2552]: I0609 17:37:34.295978 2552 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/downloads-6657875f97-cljc7" Jun 09 17:37:34.299069 ip-10-0-143-124 kubenswrapper[2552]: I0609 17:37:34.299038 2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-5b658b65bd-q5cg6" event={"ID":"b2c04056-6f26-4eb7-88a6-13e3ded83702","Type":"ContainerStarted","Data":"ac824bed8e84e6e986fe776b8be59a57be9ef1c721bb66c32574bb324d46e325"} Jun 09 17:37:34.299201 ip-10-0-143-124 kubenswrapper[2552]: I0609 17:37:34.299099 2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-5b658b65bd-q5cg6" event={"ID":"b2c04056-6f26-4eb7-88a6-13e3ded83702","Type":"ContainerStarted","Data":"562bbc4fa782e0609237bc2e02f40ff80467819e0c9ac9169a7630dff5c0bf39"} Jun 09 17:37:34.300502 ip-10-0-143-124 kubenswrapper[2552]: I0609 17:37:34.300470 2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-pvmnc" event={"ID":"b817ed32-ca44-43a6-99cf-8cf86ffd8c05","Type":"ContainerStarted","Data":"1f7b85320844cf213c5a0afc23d1d8f089b35ca078176154e3ae300b826da23b"} Jun 09 17:37:34.302253 ip-10-0-143-124 kubenswrapper[2552]: I0609 17:37:34.302209 2552 generic.go:356] "Generic (PLEG): container finished" podID="c12461c8-8309-43fb-8384-f20159a4324b" containerID="b131da530ce12486d3ba06a0da86663555afcda2b09ddd90c75aabaacc2dcf9f" exitCode=0 Jun 09 17:37:34.302381 ip-10-0-143-124 kubenswrapper[2552]: I0609 17:37:34.302258 2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-operator-896549976-7z8hc" event={"ID":"c12461c8-8309-43fb-8384-f20159a4324b","Type":"ContainerDied","Data":"b131da530ce12486d3ba06a0da86663555afcda2b09ddd90c75aabaacc2dcf9f"} Jun 09 17:37:34.302645 ip-10-0-143-124 kubenswrapper[2552]: I0609 17:37:34.302613 2552 scope.go:117] "RemoveContainer" containerID="b131da530ce12486d3ba06a0da86663555afcda2b09ddd90c75aabaacc2dcf9f" Jun 09 17:37:34.309808 ip-10-0-143-124 kubenswrapper[2552]: I0609 17:37:34.309787 2552 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/downloads-6657875f97-cljc7" Jun 09 17:37:34.315262 ip-10-0-143-124 kubenswrapper[2552]: I0609 17:37:34.315219 2552 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/downloads-6657875f97-cljc7" podStartSLOduration=1.763847138 podStartE2EDuration="23.315205511s" totalImagesPullingTime="21.551358373s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-09 17:37:11 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-09 17:37:34.313667936 +0000 UTC m=+258.413570590" watchObservedRunningTime="2026-06-09 17:37:34.315205511 +0000 UTC m=+258.415108160" Jun 09 17:37:35.315469 ip-10-0-143-124 kubenswrapper[2552]: I0609 17:37:35.315424 2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-operator-896549976-7z8hc" event={"ID":"c12461c8-8309-43fb-8384-f20159a4324b","Type":"ContainerStarted","Data":"6f13663618acce95945383d448c2d47397611dbb410c46125ed71f3563f21ca0"} Jun 09 17:37:35.319324 ip-10-0-143-124 kubenswrapper[2552]: I0609 17:37:35.319289 2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-pvmnc" event={"ID":"b817ed32-ca44-43a6-99cf-8cf86ffd8c05","Type":"ContainerStarted","Data":"df0933318fad76b4d49dc131a8281db875fe671f65405f9e3f7014526be56a78"} Jun 09 17:37:35.319461 ip-10-0-143-124 kubenswrapper[2552]: I0609 17:37:35.319341 2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-pvmnc" event={"ID":"b817ed32-ca44-43a6-99cf-8cf86ffd8c05","Type":"ContainerStarted","Data":"bf99c1b89706845073536f49af74dc6cee002fb84fd661017d39da549db64936"} Jun 09 17:37:35.336171 ip-10-0-143-124 kubenswrapper[2552]: I0609 17:37:35.336124 2552 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-5b658b65bd-q5cg6" podStartSLOduration=5.336108791 podStartE2EDuration="5.336108791s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-09 17:37:30 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-09 17:37:34.367973137 +0000 UTC m=+258.467875788" watchObservedRunningTime="2026-06-09 17:37:35.336108791 +0000 UTC m=+259.436011442" Jun 09 17:37:35.351102 ip-10-0-143-124 kubenswrapper[2552]: I0609 17:37:35.351043 2552 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/network-metrics-daemon-pvmnc" podStartSLOduration=258.393476341 podStartE2EDuration="4m19.351025316s" totalImagesPullingTime="957.548975ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-09 17:33:16 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-09 17:37:35.348954601 +0000 UTC m=+259.448857259" watchObservedRunningTime="2026-06-09 17:37:35.351025316 +0000 UTC m=+259.450927969" Jun 09 17:37:35.438314 ip-10-0-143-124 kubenswrapper[2552]: I0609 17:37:35.438274 2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gctfs_8563ebab-ebdd-4d68-bce1-78d2a7f62992/konnectivity-agent/0.log" limit=1024 Jun 09 17:37:35.502526 ip-10-0-143-124 kubenswrapper[2552]: I0609 17:37:35.502490 2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gctfs_8563ebab-ebdd-4d68-bce1-78d2a7f62992/konnectivity-agent/0.log" limit=1024 Jun 09 17:37:39.472705 ip-10-0-143-124 kubenswrapper[2552]: I0609 17:37:39.472662 2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gctfs_8563ebab-ebdd-4d68-bce1-78d2a7f62992/konnectivity-agent/0.log" limit=1024 Jun 09 17:37:39.574883 ip-10-0-143-124 kubenswrapper[2552]: I0609 17:37:39.574846 2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gctfs_8563ebab-ebdd-4d68-bce1-78d2a7f62992/konnectivity-agent/0.log" limit=1024 Jun 09 17:37:40.181402 ip-10-0-143-124 kubenswrapper[2552]: I0609 17:37:40.181363 2552 patch_prober.go:28] interesting pod/image-registry-cb9f4f84d-864t8 container/registry namespace/openshift-image-registry: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body={"errors":[{"code":"UNAVAILABLE","message":"service unavailable","detail":"health check failed: please see /debug/health"}]} Jun 09 17:37:40.181583 ip-10-0-143-124 kubenswrapper[2552]: I0609 17:37:40.181424 2552 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-image-registry/image-registry-cb9f4f84d-864t8" podUID="52bfbcd9-9374-4f7b-9bdc-6525c1e21821" containerName="registry" probeResult="failure" output="HTTP probe failed with statuscode: 503" Jun 09 17:37:41.097578 ip-10-0-143-124 kubenswrapper[2552]: I0609 17:37:41.097541 2552 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-5b658b65bd-q5cg6" Jun 09 17:37:41.098071 ip-10-0-143-124 kubenswrapper[2552]: I0609 17:37:41.097617 2552 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-5b658b65bd-q5cg6" Jun 09 17:37:41.099264 ip-10-0-143-124 kubenswrapper[2552]: I0609 17:37:41.099236 2552 patch_prober.go:28] interesting pod/console-5b658b65bd-q5cg6 container/console namespace/openshift-console: Startup probe status=failure output="Get \"https://10.134.0.19:8443/health\": dial tcp 10.134.0.19:8443: connect: connection refused" start-of-body= Jun 09 17:37:41.099399 ip-10-0-143-124 kubenswrapper[2552]: I0609 17:37:41.099287 2552 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-console/console-5b658b65bd-q5cg6" podUID="b2c04056-6f26-4eb7-88a6-13e3ded83702" containerName="console" probeResult="failure" output="Get \"https://10.134.0.19:8443/health\": dial tcp 10.134.0.19:8443: connect: connection refused" Jun 09 17:37:41.586976 ip-10-0-143-124 kubenswrapper[2552]: I0609 17:37:41.586933 2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gctfs_8563ebab-ebdd-4d68-bce1-78d2a7f62992/konnectivity-agent/0.log" limit=1024 Jun 09 17:37:41.649100 ip-10-0-143-124 kubenswrapper[2552]: I0609 17:37:41.649046 2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gctfs_8563ebab-ebdd-4d68-bce1-78d2a7f62992/konnectivity-agent/0.log" limit=1024 Jun 09 17:37:42.308806 ip-10-0-143-124 kubenswrapper[2552]: I0609 17:37:42.308764 2552 patch_prober.go:28] interesting pod/console-5c87578bc6-xp2v4 container/console namespace/openshift-console: Startup probe status=failure output="Get \"https://10.134.0.18:8443/health\": dial tcp 10.134.0.18:8443: connect: connection refused" start-of-body= Jun 09 17:37:42.309263 ip-10-0-143-124 kubenswrapper[2552]: I0609 17:37:42.308825 2552 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-console/console-5c87578bc6-xp2v4" podUID="a19e2dd8-8f3d-4726-97eb-7fe9676d9925" containerName="console" probeResult="failure" output="Get \"https://10.134.0.18:8443/health\": dial tcp 10.134.0.18:8443: connect: connection refused" Jun 09 17:37:45.195386 ip-10-0-143-124 kubenswrapper[2552]: I0609 17:37:45.195342 2552 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-image-registry/image-registry-cb9f4f84d-864t8" podUID="52bfbcd9-9374-4f7b-9bdc-6525c1e21821" containerName="registry" containerID="cri-o://022ab088221b4e02f858f760c7cc30f4c68c1e8b2f5aa4fed715382461ec0345" gracePeriod=30 Jun 09 17:37:46.359290 ip-10-0-143-124 kubenswrapper[2552]: I0609 17:37:46.359257 2552 generic.go:356] "Generic (PLEG): container finished" podID="52bfbcd9-9374-4f7b-9bdc-6525c1e21821" containerID="022ab088221b4e02f858f760c7cc30f4c68c1e8b2f5aa4fed715382461ec0345" exitCode=0 Jun 09 17:37:46.359648 ip-10-0-143-124 kubenswrapper[2552]: I0609 17:37:46.359330 2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-cb9f4f84d-864t8" event={"ID":"52bfbcd9-9374-4f7b-9bdc-6525c1e21821","Type":"ContainerDied","Data":"022ab088221b4e02f858f760c7cc30f4c68c1e8b2f5aa4fed715382461ec0345"} Jun 09 17:37:47.364639 ip-10-0-143-124 kubenswrapper[2552]: I0609 17:37:47.364591 2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-cb9f4f84d-864t8" event={"ID":"52bfbcd9-9374-4f7b-9bdc-6525c1e21821","Type":"ContainerStarted","Data":"3ed7f89e8f1fde99bcc74ce5e86fd0da58a8097755c99b7108ff8827a6d8705a"} Jun 09 17:37:47.365005 ip-10-0-143-124 kubenswrapper[2552]: I0609 17:37:47.364727 2552 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-image-registry/image-registry-cb9f4f84d-864t8" Jun 09 17:37:48.984510 ip-10-0-143-124 kubenswrapper[2552]: I0609 17:37:48.984417 2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gctfs_8563ebab-ebdd-4d68-bce1-78d2a7f62992/konnectivity-agent/0.log" limit=1024 Jun 09 17:37:49.043049 ip-10-0-143-124 kubenswrapper[2552]: I0609 17:37:49.043010 2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gctfs_8563ebab-ebdd-4d68-bce1-78d2a7f62992/konnectivity-agent/0.log" limit=1024 Jun 09 17:37:49.373092 ip-10-0-143-124 kubenswrapper[2552]: I0609 17:37:49.373062 2552 generic.go:356] "Generic (PLEG): container finished" podID="1b04f167-2855-4595-b910-313bea3fd061" containerID="838a41e53f9e114118b3231882930d37f61f36e382d94fd923e8d07be7c9dca8" exitCode=0 Jun 09 17:37:49.373257 ip-10-0-143-124 kubenswrapper[2552]: I0609 17:37:49.373117 2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-55bb7c4d49-7nmpt" event={"ID":"1b04f167-2855-4595-b910-313bea3fd061","Type":"ContainerDied","Data":"838a41e53f9e114118b3231882930d37f61f36e382d94fd923e8d07be7c9dca8"} Jun 09 17:37:49.373431 ip-10-0-143-124 kubenswrapper[2552]: I0609 17:37:49.373408 2552 scope.go:117] "RemoveContainer" containerID="838a41e53f9e114118b3231882930d37f61f36e382d94fd923e8d07be7c9dca8" Jun 09 17:37:50.377932 ip-10-0-143-124 kubenswrapper[2552]: I0609 17:37:50.377891 2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-55bb7c4d49-7nmpt" event={"ID":"1b04f167-2855-4595-b910-313bea3fd061","Type":"ContainerStarted","Data":"8b1d2750110bb8fc0a857951d8736eefd4fec8a95e0eca11a1ccfa98acea51de"} Jun 09 17:37:51.098330 ip-10-0-143-124 kubenswrapper[2552]: I0609 17:37:51.098289 2552 patch_prober.go:28] interesting pod/console-5b658b65bd-q5cg6 container/console namespace/openshift-console: Startup probe status=failure output="Get \"https://10.134.0.19:8443/health\": dial tcp 10.134.0.19:8443: connect: connection refused" start-of-body= Jun 09 17:37:51.098576 ip-10-0-143-124 kubenswrapper[2552]: I0609 17:37:51.098343 2552 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-console/console-5b658b65bd-q5cg6" podUID="b2c04056-6f26-4eb7-88a6-13e3ded83702" containerName="console" probeResult="failure" output="Get \"https://10.134.0.19:8443/health\": dial tcp 10.134.0.19:8443: connect: connection refused" Jun 09 17:37:52.308423 ip-10-0-143-124 kubenswrapper[2552]: I0609 17:37:52.308387 2552 patch_prober.go:28] interesting pod/console-5c87578bc6-xp2v4 container/console namespace/openshift-console: Startup probe status=failure output="Get \"https://10.134.0.18:8443/health\": dial tcp 10.134.0.18:8443: connect: connection refused" start-of-body= Jun 09 17:37:52.308826 ip-10-0-143-124 kubenswrapper[2552]: I0609 17:37:52.308442 2552 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-console/console-5c87578bc6-xp2v4" podUID="a19e2dd8-8f3d-4726-97eb-7fe9676d9925" containerName="console" probeResult="failure" output="Get \"https://10.134.0.18:8443/health\": dial tcp 10.134.0.18:8443: connect: connection refused" Jun 09 17:37:57.939705 ip-10-0-143-124 kubenswrapper[2552]: E0609 17:37:57.939661 2552 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[metrics-tls], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-dns/dns-default-bmg8n" podUID="3ed6274b-3981-436a-99bb-77b505c76d3d" Jun 09 17:37:58.406719 ip-10-0-143-124 kubenswrapper[2552]: I0609 17:37:58.406689 2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-bmg8n" Jun 09 17:37:58.531650 ip-10-0-143-124 kubenswrapper[2552]: I0609 17:37:58.531613 2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gctfs_8563ebab-ebdd-4d68-bce1-78d2a7f62992/konnectivity-agent/0.log" limit=1024 Jun 09 17:38:01.102013 ip-10-0-143-124 kubenswrapper[2552]: I0609 17:38:01.101978 2552 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-5b658b65bd-q5cg6" Jun 09 17:38:01.105723 ip-10-0-143-124 kubenswrapper[2552]: I0609 17:38:01.105690 2552 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-5b658b65bd-q5cg6" Jun 09 17:38:01.168327 ip-10-0-143-124 kubenswrapper[2552]: I0609 17:38:01.168293 2552 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-5c87578bc6-xp2v4"] Jun 09 17:38:01.279485 ip-10-0-143-124 kubenswrapper[2552]: I0609 17:38:01.279447 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/3ed6274b-3981-436a-99bb-77b505c76d3d-metrics-tls\") pod \"dns-default-bmg8n\" (UID: \"3ed6274b-3981-436a-99bb-77b505c76d3d\") " pod="openshift-dns/dns-default-bmg8n" Jun 09 17:38:01.281776 ip-10-0-143-124 kubenswrapper[2552]: I0609 17:38:01.281755 2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/3ed6274b-3981-436a-99bb-77b505c76d3d-metrics-tls\") pod \"dns-default-bmg8n\" (UID: \"3ed6274b-3981-436a-99bb-77b505c76d3d\") " pod="openshift-dns/dns-default-bmg8n" Jun 09 17:38:01.289917 ip-10-0-143-124 kubenswrapper[2552]: I0609 17:38:01.289893 2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gctfs_8563ebab-ebdd-4d68-bce1-78d2a7f62992/konnectivity-agent/0.log" limit=1024 Jun 09 17:38:01.385332 ip-10-0-143-124 kubenswrapper[2552]: I0609 17:38:01.385245 2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gctfs_8563ebab-ebdd-4d68-bce1-78d2a7f62992/konnectivity-agent/0.log" limit=1024 Jun 09 17:38:01.409804 ip-10-0-143-124 kubenswrapper[2552]: I0609 17:38:01.409780 2552 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-qt7rj\"" Jun 09 17:38:01.417273 ip-10-0-143-124 kubenswrapper[2552]: I0609 17:38:01.417256 2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-bmg8n" Jun 09 17:38:01.492573 ip-10-0-143-124 kubenswrapper[2552]: I0609 17:38:01.492526 2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gctfs_8563ebab-ebdd-4d68-bce1-78d2a7f62992/konnectivity-agent/0.log" limit=1024 Jun 09 17:38:01.573789 ip-10-0-143-124 kubenswrapper[2552]: I0609 17:38:01.573764 2552 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-bmg8n"] Jun 09 17:38:01.576269 ip-10-0-143-124 kubenswrapper[2552]: W0609 17:38:01.576236 2552 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3ed6274b_3981_436a_99bb_77b505c76d3d.slice/crio-1c5f6ac9c2a7af257e93e63972a05371f107a1c0681952d16f72483c4a060742 WatchSource:0}: Error finding container 1c5f6ac9c2a7af257e93e63972a05371f107a1c0681952d16f72483c4a060742: Status 404 returned error can't find the container with id 1c5f6ac9c2a7af257e93e63972a05371f107a1c0681952d16f72483c4a060742 Jun 09 17:38:01.623638 ip-10-0-143-124 kubenswrapper[2552]: I0609 17:38:01.623590 2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gctfs_8563ebab-ebdd-4d68-bce1-78d2a7f62992/konnectivity-agent/0.log" limit=1024 Jun 09 17:38:01.724209 ip-10-0-143-124 kubenswrapper[2552]: I0609 17:38:01.724138 2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gctfs_8563ebab-ebdd-4d68-bce1-78d2a7f62992/konnectivity-agent/0.log" limit=1024 Jun 09 17:38:01.824200 ip-10-0-143-124 kubenswrapper[2552]: I0609 17:38:01.824163 2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gctfs_8563ebab-ebdd-4d68-bce1-78d2a7f62992/konnectivity-agent/0.log" limit=1024 Jun 09 17:38:01.925170 ip-10-0-143-124 kubenswrapper[2552]: I0609 17:38:01.925140 2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gctfs_8563ebab-ebdd-4d68-bce1-78d2a7f62992/konnectivity-agent/0.log" limit=1024 Jun 09 17:38:01.983515 ip-10-0-143-124 kubenswrapper[2552]: I0609 17:38:01.983446 2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gctfs_8563ebab-ebdd-4d68-bce1-78d2a7f62992/konnectivity-agent/0.log" limit=1024 Jun 09 17:38:02.423095 ip-10-0-143-124 kubenswrapper[2552]: I0609 17:38:02.423060 2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-bmg8n" event={"ID":"3ed6274b-3981-436a-99bb-77b505c76d3d","Type":"ContainerStarted","Data":"1c5f6ac9c2a7af257e93e63972a05371f107a1c0681952d16f72483c4a060742"} Jun 09 17:38:04.436410 ip-10-0-143-124 kubenswrapper[2552]: I0609 17:38:04.436375 2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-bmg8n" event={"ID":"3ed6274b-3981-436a-99bb-77b505c76d3d","Type":"ContainerStarted","Data":"76a27b3d3647647b530605773c50cd19705c52dbc3df208efec4e4d31b02dfeb"} Jun 09 17:38:04.436830 ip-10-0-143-124 kubenswrapper[2552]: I0609 17:38:04.436453 2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-bmg8n" event={"ID":"3ed6274b-3981-436a-99bb-77b505c76d3d","Type":"ContainerStarted","Data":"b13cbfdae5816927664749575ce2257f3a4ac38be532685c1528d861783bb603"} Jun 09 17:38:04.436830 ip-10-0-143-124 kubenswrapper[2552]: I0609 17:38:04.436508 2552 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-dns/dns-default-bmg8n" Jun 09 17:38:04.455273 ip-10-0-143-124 kubenswrapper[2552]: I0609 17:38:04.455227 2552 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/dns-default-bmg8n" podStartSLOduration=251.508627666 podStartE2EDuration="4m13.455212383s" totalImagesPullingTime="1.946584717s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-09 17:33:51 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-09 17:38:04.454032523 +0000 UTC m=+288.553935184" watchObservedRunningTime="2026-06-09 17:38:04.455212383 +0000 UTC m=+288.555115033" Jun 09 17:38:08.372652 ip-10-0-143-124 kubenswrapper[2552]: I0609 17:38:08.372622 2552 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-image-registry/image-registry-cb9f4f84d-864t8" Jun 09 17:38:08.512613 ip-10-0-143-124 kubenswrapper[2552]: I0609 17:38:08.512544 2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gctfs_8563ebab-ebdd-4d68-bce1-78d2a7f62992/konnectivity-agent/0.log" limit=1024 Jun 09 17:38:08.567593 ip-10-0-143-124 kubenswrapper[2552]: I0609 17:38:08.567553 2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gctfs_8563ebab-ebdd-4d68-bce1-78d2a7f62992/konnectivity-agent/0.log" limit=1024 Jun 09 17:38:08.672198 ip-10-0-143-124 kubenswrapper[2552]: I0609 17:38:08.672124 2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gctfs_8563ebab-ebdd-4d68-bce1-78d2a7f62992/konnectivity-agent/0.log" limit=1024 Jun 09 17:38:08.737854 ip-10-0-143-124 kubenswrapper[2552]: I0609 17:38:08.737820 2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gctfs_8563ebab-ebdd-4d68-bce1-78d2a7f62992/konnectivity-agent/0.log" limit=1024 Jun 09 17:38:11.755331 ip-10-0-143-124 kubenswrapper[2552]: I0609 17:38:11.755271 2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gctfs_8563ebab-ebdd-4d68-bce1-78d2a7f62992/konnectivity-agent/0.log" limit=1024 Jun 09 17:38:11.858928 ip-10-0-143-124 kubenswrapper[2552]: I0609 17:38:11.858877 2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gctfs_8563ebab-ebdd-4d68-bce1-78d2a7f62992/konnectivity-agent/0.log" limit=1024 Jun 09 17:38:11.924237 ip-10-0-143-124 kubenswrapper[2552]: I0609 17:38:11.924204 2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gctfs_8563ebab-ebdd-4d68-bce1-78d2a7f62992/konnectivity-agent/0.log" limit=1024 Jun 09 17:38:13.900408 ip-10-0-143-124 kubenswrapper[2552]: I0609 17:38:13.900362 2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gctfs_8563ebab-ebdd-4d68-bce1-78d2a7f62992/konnectivity-agent/0.log" limit=1024 Jun 09 17:38:14.195898 ip-10-0-143-124 kubenswrapper[2552]: I0609 17:38:14.195793 2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gctfs_8563ebab-ebdd-4d68-bce1-78d2a7f62992/konnectivity-agent/0.log" limit=1024 Jun 09 17:38:14.254841 ip-10-0-143-124 kubenswrapper[2552]: I0609 17:38:14.254807 2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gctfs_8563ebab-ebdd-4d68-bce1-78d2a7f62992/konnectivity-agent/0.log" limit=1024 Jun 09 17:38:14.326637 ip-10-0-143-124 kubenswrapper[2552]: I0609 17:38:14.326584 2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gctfs_8563ebab-ebdd-4d68-bce1-78d2a7f62992/konnectivity-agent/0.log" limit=1024 Jun 09 17:38:14.441827 ip-10-0-143-124 kubenswrapper[2552]: I0609 17:38:14.441801 2552 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-dns/dns-default-bmg8n" Jun 09 17:38:16.281503 ip-10-0-143-124 kubenswrapper[2552]: I0609 17:38:16.281471 2552 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-kwh69_9aa08551-03ce-4c12-96d9-d6ca9bb43bf7/ovn-acl-logging/0.log" Jun 09 17:38:16.283847 ip-10-0-143-124 kubenswrapper[2552]: I0609 17:38:16.283810 2552 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-kwh69_9aa08551-03ce-4c12-96d9-d6ca9bb43bf7/ovn-acl-logging/0.log" Jun 09 17:38:16.289005 ip-10-0-143-124 kubenswrapper[2552]: I0609 17:38:16.288988 2552 kubelet.go:1648] "Image garbage collection succeeded" Jun 09 17:38:16.415531 ip-10-0-143-124 kubenswrapper[2552]: I0609 17:38:16.415386 2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gctfs_8563ebab-ebdd-4d68-bce1-78d2a7f62992/konnectivity-agent/0.log" limit=1024 Jun 09 17:38:16.478868 ip-10-0-143-124 kubenswrapper[2552]: I0609 17:38:16.471891 2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gctfs_8563ebab-ebdd-4d68-bce1-78d2a7f62992/konnectivity-agent/0.log" limit=1024 Jun 09 17:38:21.338705 ip-10-0-143-124 kubenswrapper[2552]: I0609 17:38:21.338661 2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gctfs_8563ebab-ebdd-4d68-bce1-78d2a7f62992/konnectivity-agent/0.log" limit=1024 Jun 09 17:38:21.442020 ip-10-0-143-124 kubenswrapper[2552]: I0609 17:38:21.441985 2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gctfs_8563ebab-ebdd-4d68-bce1-78d2a7f62992/konnectivity-agent/0.log" limit=1024 Jun 09 17:38:23.343865 ip-10-0-143-124 kubenswrapper[2552]: I0609 17:38:23.343832 2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gctfs_8563ebab-ebdd-4d68-bce1-78d2a7f62992/konnectivity-agent/0.log" limit=1024 Jun 09 17:38:23.443877 ip-10-0-143-124 kubenswrapper[2552]: I0609 17:38:23.443844 2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gctfs_8563ebab-ebdd-4d68-bce1-78d2a7f62992/konnectivity-agent/0.log" limit=1024 Jun 09 17:38:23.500052 ip-10-0-143-124 kubenswrapper[2552]: I0609 17:38:23.500022 2552 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-5887d4c556-42xfd"] Jun 09 17:38:23.502024 ip-10-0-143-124 kubenswrapper[2552]: I0609 17:38:23.502007 2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-5887d4c556-42xfd" Jun 09 17:38:23.514970 ip-10-0-143-124 kubenswrapper[2552]: I0609 17:38:23.514946 2552 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-5887d4c556-42xfd"] Jun 09 17:38:23.566775 ip-10-0-143-124 kubenswrapper[2552]: I0609 17:38:23.566743 2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gctfs_8563ebab-ebdd-4d68-bce1-78d2a7f62992/konnectivity-agent/0.log" limit=1024 Jun 09 17:38:23.569411 ip-10-0-143-124 kubenswrapper[2552]: I0609 17:38:23.569387 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/7de9f39c-bd0d-4436-9f85-2ec5f568a710-console-oauth-config\") pod \"console-5887d4c556-42xfd\" (UID: \"7de9f39c-bd0d-4436-9f85-2ec5f568a710\") " pod="openshift-console/console-5887d4c556-42xfd" Jun 09 17:38:23.569521 ip-10-0-143-124 kubenswrapper[2552]: I0609 17:38:23.569421 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/7de9f39c-bd0d-4436-9f85-2ec5f568a710-console-config\") pod \"console-5887d4c556-42xfd\" (UID: \"7de9f39c-bd0d-4436-9f85-2ec5f568a710\") " pod="openshift-console/console-5887d4c556-42xfd" Jun 09 17:38:23.569521 ip-10-0-143-124 kubenswrapper[2552]: I0609 17:38:23.569440 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/7de9f39c-bd0d-4436-9f85-2ec5f568a710-console-serving-cert\") pod \"console-5887d4c556-42xfd\" (UID: \"7de9f39c-bd0d-4436-9f85-2ec5f568a710\") " pod="openshift-console/console-5887d4c556-42xfd" Jun 09 17:38:23.569521 ip-10-0-143-124 kubenswrapper[2552]: I0609 17:38:23.569505 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/7de9f39c-bd0d-4436-9f85-2ec5f568a710-oauth-serving-cert\") pod \"console-5887d4c556-42xfd\" (UID: \"7de9f39c-bd0d-4436-9f85-2ec5f568a710\") " pod="openshift-console/console-5887d4c556-42xfd" Jun 09 17:38:23.569650 ip-10-0-143-124 kubenswrapper[2552]: I0609 17:38:23.569556 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-bvgl4\" (UniqueName: \"kubernetes.io/projected/7de9f39c-bd0d-4436-9f85-2ec5f568a710-kube-api-access-bvgl4\") pod \"console-5887d4c556-42xfd\" (UID: \"7de9f39c-bd0d-4436-9f85-2ec5f568a710\") " pod="openshift-console/console-5887d4c556-42xfd" Jun 09 17:38:23.569650 ip-10-0-143-124 kubenswrapper[2552]: I0609 17:38:23.569591 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/7de9f39c-bd0d-4436-9f85-2ec5f568a710-service-ca\") pod \"console-5887d4c556-42xfd\" (UID: \"7de9f39c-bd0d-4436-9f85-2ec5f568a710\") " pod="openshift-console/console-5887d4c556-42xfd" Jun 09 17:38:23.569650 ip-10-0-143-124 kubenswrapper[2552]: I0609 17:38:23.569637 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/7de9f39c-bd0d-4436-9f85-2ec5f568a710-trusted-ca-bundle\") pod \"console-5887d4c556-42xfd\" (UID: \"7de9f39c-bd0d-4436-9f85-2ec5f568a710\") " pod="openshift-console/console-5887d4c556-42xfd" Jun 09 17:38:23.624465 ip-10-0-143-124 kubenswrapper[2552]: I0609 17:38:23.624392 2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gctfs_8563ebab-ebdd-4d68-bce1-78d2a7f62992/konnectivity-agent/0.log" limit=1024 Jun 09 17:38:23.669989 ip-10-0-143-124 kubenswrapper[2552]: I0609 17:38:23.669956 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/7de9f39c-bd0d-4436-9f85-2ec5f568a710-console-oauth-config\") pod \"console-5887d4c556-42xfd\" (UID: \"7de9f39c-bd0d-4436-9f85-2ec5f568a710\") " pod="openshift-console/console-5887d4c556-42xfd" Jun 09 17:38:23.670135 ip-10-0-143-124 kubenswrapper[2552]: I0609 17:38:23.669995 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/7de9f39c-bd0d-4436-9f85-2ec5f568a710-console-config\") pod \"console-5887d4c556-42xfd\" (UID: \"7de9f39c-bd0d-4436-9f85-2ec5f568a710\") " pod="openshift-console/console-5887d4c556-42xfd" Jun 09 17:38:23.670135 ip-10-0-143-124 kubenswrapper[2552]: I0609 17:38:23.670017 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/7de9f39c-bd0d-4436-9f85-2ec5f568a710-console-serving-cert\") pod \"console-5887d4c556-42xfd\" (UID: \"7de9f39c-bd0d-4436-9f85-2ec5f568a710\") " pod="openshift-console/console-5887d4c556-42xfd" Jun 09 17:38:23.670135 ip-10-0-143-124 kubenswrapper[2552]: I0609 17:38:23.670050 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/7de9f39c-bd0d-4436-9f85-2ec5f568a710-oauth-serving-cert\") pod \"console-5887d4c556-42xfd\" (UID: \"7de9f39c-bd0d-4436-9f85-2ec5f568a710\") " pod="openshift-console/console-5887d4c556-42xfd" Jun 09 17:38:23.670135 ip-10-0-143-124 kubenswrapper[2552]: I0609 17:38:23.670091 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-bvgl4\" (UniqueName: \"kubernetes.io/projected/7de9f39c-bd0d-4436-9f85-2ec5f568a710-kube-api-access-bvgl4\") pod \"console-5887d4c556-42xfd\" (UID: \"7de9f39c-bd0d-4436-9f85-2ec5f568a710\") " pod="openshift-console/console-5887d4c556-42xfd" Jun 09 17:38:23.670338 ip-10-0-143-124 kubenswrapper[2552]: I0609 17:38:23.670143 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/7de9f39c-bd0d-4436-9f85-2ec5f568a710-service-ca\") pod \"console-5887d4c556-42xfd\" (UID: \"7de9f39c-bd0d-4436-9f85-2ec5f568a710\") " pod="openshift-console/console-5887d4c556-42xfd" Jun 09 17:38:23.670338 ip-10-0-143-124 kubenswrapper[2552]: I0609 17:38:23.670168 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/7de9f39c-bd0d-4436-9f85-2ec5f568a710-trusted-ca-bundle\") pod \"console-5887d4c556-42xfd\" (UID: \"7de9f39c-bd0d-4436-9f85-2ec5f568a710\") " pod="openshift-console/console-5887d4c556-42xfd" Jun 09 17:38:23.670802 ip-10-0-143-124 kubenswrapper[2552]: I0609 17:38:23.670776 2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/7de9f39c-bd0d-4436-9f85-2ec5f568a710-oauth-serving-cert\") pod \"console-5887d4c556-42xfd\" (UID: \"7de9f39c-bd0d-4436-9f85-2ec5f568a710\") " pod="openshift-console/console-5887d4c556-42xfd" Jun 09 17:38:23.670978 ip-10-0-143-124 kubenswrapper[2552]: I0609 17:38:23.670849 2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/7de9f39c-bd0d-4436-9f85-2ec5f568a710-console-config\") pod \"console-5887d4c556-42xfd\" (UID: \"7de9f39c-bd0d-4436-9f85-2ec5f568a710\") " pod="openshift-console/console-5887d4c556-42xfd" Jun 09 17:38:23.671047 ip-10-0-143-124 kubenswrapper[2552]: I0609 17:38:23.670994 2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/7de9f39c-bd0d-4436-9f85-2ec5f568a710-service-ca\") pod \"console-5887d4c556-42xfd\" (UID: \"7de9f39c-bd0d-4436-9f85-2ec5f568a710\") " pod="openshift-console/console-5887d4c556-42xfd" Jun 09 17:38:23.671165 ip-10-0-143-124 kubenswrapper[2552]: I0609 17:38:23.671145 2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/7de9f39c-bd0d-4436-9f85-2ec5f568a710-trusted-ca-bundle\") pod \"console-5887d4c556-42xfd\" (UID: \"7de9f39c-bd0d-4436-9f85-2ec5f568a710\") " pod="openshift-console/console-5887d4c556-42xfd" Jun 09 17:38:23.672482 ip-10-0-143-124 kubenswrapper[2552]: I0609 17:38:23.672454 2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/7de9f39c-bd0d-4436-9f85-2ec5f568a710-console-serving-cert\") pod \"console-5887d4c556-42xfd\" (UID: \"7de9f39c-bd0d-4436-9f85-2ec5f568a710\") " pod="openshift-console/console-5887d4c556-42xfd" Jun 09 17:38:23.672584 ip-10-0-143-124 kubenswrapper[2552]: I0609 17:38:23.672549 2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/7de9f39c-bd0d-4436-9f85-2ec5f568a710-console-oauth-config\") pod \"console-5887d4c556-42xfd\" (UID: \"7de9f39c-bd0d-4436-9f85-2ec5f568a710\") " pod="openshift-console/console-5887d4c556-42xfd" Jun 09 17:38:23.677836 ip-10-0-143-124 kubenswrapper[2552]: I0609 17:38:23.677816 2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-bvgl4\" (UniqueName: \"kubernetes.io/projected/7de9f39c-bd0d-4436-9f85-2ec5f568a710-kube-api-access-bvgl4\") pod \"console-5887d4c556-42xfd\" (UID: \"7de9f39c-bd0d-4436-9f85-2ec5f568a710\") " pod="openshift-console/console-5887d4c556-42xfd" Jun 09 17:38:23.693169 ip-10-0-143-124 kubenswrapper[2552]: I0609 17:38:23.693146 2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gctfs_8563ebab-ebdd-4d68-bce1-78d2a7f62992/konnectivity-agent/0.log" limit=1024 Jun 09 17:38:23.794136 ip-10-0-143-124 kubenswrapper[2552]: I0609 17:38:23.794103 2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gctfs_8563ebab-ebdd-4d68-bce1-78d2a7f62992/konnectivity-agent/0.log" limit=1024 Jun 09 17:38:23.811092 ip-10-0-143-124 kubenswrapper[2552]: I0609 17:38:23.811065 2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-5887d4c556-42xfd" Jun 09 17:38:23.938992 ip-10-0-143-124 kubenswrapper[2552]: I0609 17:38:23.938958 2552 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-5887d4c556-42xfd"] Jun 09 17:38:23.942175 ip-10-0-143-124 kubenswrapper[2552]: W0609 17:38:23.942145 2552 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7de9f39c_bd0d_4436_9f85_2ec5f568a710.slice/crio-2e65b27f7329e194f641cac9d51709dfad6a372b7d3df584c7f415521b6dbcd6 WatchSource:0}: Error finding container 2e65b27f7329e194f641cac9d51709dfad6a372b7d3df584c7f415521b6dbcd6: Status 404 returned error can't find the container with id 2e65b27f7329e194f641cac9d51709dfad6a372b7d3df584c7f415521b6dbcd6 Jun 09 17:38:24.295055 ip-10-0-143-124 kubenswrapper[2552]: I0609 17:38:24.295014 2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gctfs_8563ebab-ebdd-4d68-bce1-78d2a7f62992/konnectivity-agent/0.log" limit=1024 Jun 09 17:38:24.352702 ip-10-0-143-124 kubenswrapper[2552]: I0609 17:38:24.352665 2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gctfs_8563ebab-ebdd-4d68-bce1-78d2a7f62992/konnectivity-agent/0.log" limit=1024 Jun 09 17:38:24.510471 ip-10-0-143-124 kubenswrapper[2552]: I0609 17:38:24.510440 2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-5887d4c556-42xfd" event={"ID":"7de9f39c-bd0d-4436-9f85-2ec5f568a710","Type":"ContainerStarted","Data":"f4691883f0936cf3d2a9a855059d94bf7aadd47b0cf61f03ea1d07e34c5ec57c"} Jun 09 17:38:24.510661 ip-10-0-143-124 kubenswrapper[2552]: I0609 17:38:24.510489 2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-5887d4c556-42xfd" event={"ID":"7de9f39c-bd0d-4436-9f85-2ec5f568a710","Type":"ContainerStarted","Data":"2e65b27f7329e194f641cac9d51709dfad6a372b7d3df584c7f415521b6dbcd6"} Jun 09 17:38:24.529146 ip-10-0-143-124 kubenswrapper[2552]: I0609 17:38:24.529085 2552 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-5887d4c556-42xfd" podStartSLOduration=1.529070495 podStartE2EDuration="1.529070495s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-09 17:38:23 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-09 17:38:24.527731199 +0000 UTC m=+308.627633861" watchObservedRunningTime="2026-06-09 17:38:24.529070495 +0000 UTC m=+308.628973145" Jun 09 17:38:25.430734 ip-10-0-143-124 kubenswrapper[2552]: I0609 17:38:25.430700 2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gctfs_8563ebab-ebdd-4d68-bce1-78d2a7f62992/konnectivity-agent/0.log" limit=1024 Jun 09 17:38:25.530379 ip-10-0-143-124 kubenswrapper[2552]: I0609 17:38:25.530350 2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gctfs_8563ebab-ebdd-4d68-bce1-78d2a7f62992/konnectivity-agent/0.log" limit=1024 Jun 09 17:38:26.188690 ip-10-0-143-124 kubenswrapper[2552]: I0609 17:38:26.188649 2552 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-console/console-5c87578bc6-xp2v4" podUID="a19e2dd8-8f3d-4726-97eb-7fe9676d9925" containerName="console" containerID="cri-o://5789242418dabd56bba4db773cc7e587c80101788b62a5a061ce3603d7740c80" gracePeriod=15 Jun 09 17:38:26.416321 ip-10-0-143-124 kubenswrapper[2552]: I0609 17:38:26.416297 2552 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-5c87578bc6-xp2v4" Jun 09 17:38:26.490969 ip-10-0-143-124 kubenswrapper[2552]: I0609 17:38:26.490941 2552 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/a19e2dd8-8f3d-4726-97eb-7fe9676d9925-console-config\") pod \"a19e2dd8-8f3d-4726-97eb-7fe9676d9925\" (UID: \"a19e2dd8-8f3d-4726-97eb-7fe9676d9925\") " Jun 09 17:38:26.491408 ip-10-0-143-124 kubenswrapper[2552]: I0609 17:38:26.490978 2552 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/a19e2dd8-8f3d-4726-97eb-7fe9676d9925-oauth-serving-cert\") pod \"a19e2dd8-8f3d-4726-97eb-7fe9676d9925\" (UID: \"a19e2dd8-8f3d-4726-97eb-7fe9676d9925\") " Jun 09 17:38:26.491408 ip-10-0-143-124 kubenswrapper[2552]: I0609 17:38:26.491003 2552 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-bdnff\" (UniqueName: \"kubernetes.io/projected/a19e2dd8-8f3d-4726-97eb-7fe9676d9925-kube-api-access-bdnff\") pod \"a19e2dd8-8f3d-4726-97eb-7fe9676d9925\" (UID: \"a19e2dd8-8f3d-4726-97eb-7fe9676d9925\") " Jun 09 17:38:26.491408 ip-10-0-143-124 kubenswrapper[2552]: I0609 17:38:26.491021 2552 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/a19e2dd8-8f3d-4726-97eb-7fe9676d9925-service-ca\") pod \"a19e2dd8-8f3d-4726-97eb-7fe9676d9925\" (UID: \"a19e2dd8-8f3d-4726-97eb-7fe9676d9925\") " Jun 09 17:38:26.491408 ip-10-0-143-124 kubenswrapper[2552]: I0609 17:38:26.491046 2552 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/a19e2dd8-8f3d-4726-97eb-7fe9676d9925-console-serving-cert\") pod \"a19e2dd8-8f3d-4726-97eb-7fe9676d9925\" (UID: \"a19e2dd8-8f3d-4726-97eb-7fe9676d9925\") " Jun 09 17:38:26.491408 ip-10-0-143-124 kubenswrapper[2552]: I0609 17:38:26.491095 2552 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/a19e2dd8-8f3d-4726-97eb-7fe9676d9925-console-oauth-config\") pod \"a19e2dd8-8f3d-4726-97eb-7fe9676d9925\" (UID: \"a19e2dd8-8f3d-4726-97eb-7fe9676d9925\") " Jun 09 17:38:26.491628 ip-10-0-143-124 kubenswrapper[2552]: I0609 17:38:26.491411 2552 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/a19e2dd8-8f3d-4726-97eb-7fe9676d9925-console-config" (OuterVolumeSpecName: "console-config") pod "a19e2dd8-8f3d-4726-97eb-7fe9676d9925" (UID: "a19e2dd8-8f3d-4726-97eb-7fe9676d9925"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 09 17:38:26.491628 ip-10-0-143-124 kubenswrapper[2552]: I0609 17:38:26.491431 2552 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/a19e2dd8-8f3d-4726-97eb-7fe9676d9925-service-ca" (OuterVolumeSpecName: "service-ca") pod "a19e2dd8-8f3d-4726-97eb-7fe9676d9925" (UID: "a19e2dd8-8f3d-4726-97eb-7fe9676d9925"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 09 17:38:26.491628 ip-10-0-143-124 kubenswrapper[2552]: I0609 17:38:26.491415 2552 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/a19e2dd8-8f3d-4726-97eb-7fe9676d9925-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "a19e2dd8-8f3d-4726-97eb-7fe9676d9925" (UID: "a19e2dd8-8f3d-4726-97eb-7fe9676d9925"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 09 17:38:26.493387 ip-10-0-143-124 kubenswrapper[2552]: I0609 17:38:26.493360 2552 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/a19e2dd8-8f3d-4726-97eb-7fe9676d9925-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "a19e2dd8-8f3d-4726-97eb-7fe9676d9925" (UID: "a19e2dd8-8f3d-4726-97eb-7fe9676d9925"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 09 17:38:26.493616 ip-10-0-143-124 kubenswrapper[2552]: I0609 17:38:26.493568 2552 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/a19e2dd8-8f3d-4726-97eb-7fe9676d9925-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "a19e2dd8-8f3d-4726-97eb-7fe9676d9925" (UID: "a19e2dd8-8f3d-4726-97eb-7fe9676d9925"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 09 17:38:26.493616 ip-10-0-143-124 kubenswrapper[2552]: I0609 17:38:26.493570 2552 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/a19e2dd8-8f3d-4726-97eb-7fe9676d9925-kube-api-access-bdnff" (OuterVolumeSpecName: "kube-api-access-bdnff") pod "a19e2dd8-8f3d-4726-97eb-7fe9676d9925" (UID: "a19e2dd8-8f3d-4726-97eb-7fe9676d9925"). InnerVolumeSpecName "kube-api-access-bdnff". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 09 17:38:26.519031 ip-10-0-143-124 kubenswrapper[2552]: I0609 17:38:26.519004 2552 generic.go:356] "Generic (PLEG): container finished" podID="a19e2dd8-8f3d-4726-97eb-7fe9676d9925" containerID="5789242418dabd56bba4db773cc7e587c80101788b62a5a061ce3603d7740c80" exitCode=0 Jun 09 17:38:26.519136 ip-10-0-143-124 kubenswrapper[2552]: I0609 17:38:26.519050 2552 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-5c87578bc6-xp2v4" Jun 09 17:38:26.519136 ip-10-0-143-124 kubenswrapper[2552]: I0609 17:38:26.519089 2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-5c87578bc6-xp2v4" event={"ID":"a19e2dd8-8f3d-4726-97eb-7fe9676d9925","Type":"ContainerDied","Data":"5789242418dabd56bba4db773cc7e587c80101788b62a5a061ce3603d7740c80"} Jun 09 17:38:26.519209 ip-10-0-143-124 kubenswrapper[2552]: I0609 17:38:26.519136 2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-5c87578bc6-xp2v4" event={"ID":"a19e2dd8-8f3d-4726-97eb-7fe9676d9925","Type":"ContainerDied","Data":"4965e01eb2220d9053d404f281989236026b6f6044de5d01bc2614a1f8531b18"} Jun 09 17:38:26.519209 ip-10-0-143-124 kubenswrapper[2552]: I0609 17:38:26.519155 2552 scope.go:117] "RemoveContainer" containerID="5789242418dabd56bba4db773cc7e587c80101788b62a5a061ce3603d7740c80" Jun 09 17:38:26.527697 ip-10-0-143-124 kubenswrapper[2552]: I0609 17:38:26.527679 2552 scope.go:117] "RemoveContainer" containerID="5789242418dabd56bba4db773cc7e587c80101788b62a5a061ce3603d7740c80" Jun 09 17:38:26.527954 ip-10-0-143-124 kubenswrapper[2552]: E0609 17:38:26.527936 2552 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"5789242418dabd56bba4db773cc7e587c80101788b62a5a061ce3603d7740c80\": container with ID starting with 5789242418dabd56bba4db773cc7e587c80101788b62a5a061ce3603d7740c80 not found: ID does not exist" containerID="5789242418dabd56bba4db773cc7e587c80101788b62a5a061ce3603d7740c80" Jun 09 17:38:26.527991 ip-10-0-143-124 kubenswrapper[2552]: I0609 17:38:26.527963 2552 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"5789242418dabd56bba4db773cc7e587c80101788b62a5a061ce3603d7740c80"} err="failed to get container status \"5789242418dabd56bba4db773cc7e587c80101788b62a5a061ce3603d7740c80\": rpc error: code = NotFound desc = could not find container \"5789242418dabd56bba4db773cc7e587c80101788b62a5a061ce3603d7740c80\": container with ID starting with 5789242418dabd56bba4db773cc7e587c80101788b62a5a061ce3603d7740c80 not found: ID does not exist" Jun 09 17:38:26.539328 ip-10-0-143-124 kubenswrapper[2552]: I0609 17:38:26.539306 2552 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-5c87578bc6-xp2v4"] Jun 09 17:38:26.543817 ip-10-0-143-124 kubenswrapper[2552]: I0609 17:38:26.543794 2552 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-5c87578bc6-xp2v4"] Jun 09 17:38:26.592583 ip-10-0-143-124 kubenswrapper[2552]: I0609 17:38:26.592551 2552 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-bdnff\" (UniqueName: \"kubernetes.io/projected/a19e2dd8-8f3d-4726-97eb-7fe9676d9925-kube-api-access-bdnff\") on node \"ip-10-0-143-124.ec2.internal\" DevicePath \"\"" Jun 09 17:38:26.592583 ip-10-0-143-124 kubenswrapper[2552]: I0609 17:38:26.592581 2552 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/a19e2dd8-8f3d-4726-97eb-7fe9676d9925-service-ca\") on node \"ip-10-0-143-124.ec2.internal\" DevicePath \"\"" Jun 09 17:38:26.592757 ip-10-0-143-124 kubenswrapper[2552]: I0609 17:38:26.592619 2552 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/a19e2dd8-8f3d-4726-97eb-7fe9676d9925-console-serving-cert\") on node \"ip-10-0-143-124.ec2.internal\" DevicePath \"\"" Jun 09 17:38:26.592757 ip-10-0-143-124 kubenswrapper[2552]: I0609 17:38:26.592633 2552 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/a19e2dd8-8f3d-4726-97eb-7fe9676d9925-console-oauth-config\") on node \"ip-10-0-143-124.ec2.internal\" DevicePath \"\"" Jun 09 17:38:26.592757 ip-10-0-143-124 kubenswrapper[2552]: I0609 17:38:26.592671 2552 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/a19e2dd8-8f3d-4726-97eb-7fe9676d9925-console-config\") on node \"ip-10-0-143-124.ec2.internal\" DevicePath \"\"" Jun 09 17:38:26.592757 ip-10-0-143-124 kubenswrapper[2552]: I0609 17:38:26.592686 2552 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/a19e2dd8-8f3d-4726-97eb-7fe9676d9925-oauth-serving-cert\") on node \"ip-10-0-143-124.ec2.internal\" DevicePath \"\"" Jun 09 17:38:28.337002 ip-10-0-143-124 kubenswrapper[2552]: I0609 17:38:28.336968 2552 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="a19e2dd8-8f3d-4726-97eb-7fe9676d9925" path="/var/lib/kubelet/pods/a19e2dd8-8f3d-4726-97eb-7fe9676d9925/volumes" Jun 09 17:38:33.811761 ip-10-0-143-124 kubenswrapper[2552]: I0609 17:38:33.811724 2552 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-5887d4c556-42xfd" Jun 09 17:38:33.812141 ip-10-0-143-124 kubenswrapper[2552]: I0609 17:38:33.811787 2552 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-5887d4c556-42xfd" Jun 09 17:38:33.816532 ip-10-0-143-124 kubenswrapper[2552]: I0609 17:38:33.816510 2552 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-5887d4c556-42xfd" Jun 09 17:38:34.551016 ip-10-0-143-124 kubenswrapper[2552]: I0609 17:38:34.550986 2552 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-5887d4c556-42xfd" Jun 09 17:38:34.644419 ip-10-0-143-124 kubenswrapper[2552]: I0609 17:38:34.644385 2552 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-5b658b65bd-q5cg6"] Jun 09 17:38:34.845752 ip-10-0-143-124 kubenswrapper[2552]: I0609 17:38:34.845656 2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gctfs_8563ebab-ebdd-4d68-bce1-78d2a7f62992/konnectivity-agent/0.log" limit=1024 Jun 09 17:38:34.952823 ip-10-0-143-124 kubenswrapper[2552]: I0609 17:38:34.952785 2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gctfs_8563ebab-ebdd-4d68-bce1-78d2a7f62992/konnectivity-agent/0.log" limit=1024 Jun 09 17:38:39.475054 ip-10-0-143-124 kubenswrapper[2552]: I0609 17:38:39.475003 2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gctfs_8563ebab-ebdd-4d68-bce1-78d2a7f62992/konnectivity-agent/0.log" limit=1024 Jun 09 17:38:39.538651 ip-10-0-143-124 kubenswrapper[2552]: I0609 17:38:39.538613 2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gctfs_8563ebab-ebdd-4d68-bce1-78d2a7f62992/konnectivity-agent/0.log" limit=1024 Jun 09 17:38:57.833160 ip-10-0-143-124 kubenswrapper[2552]: I0609 17:38:57.833111 2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gctfs_8563ebab-ebdd-4d68-bce1-78d2a7f62992/konnectivity-agent/0.log" limit=1024 Jun 09 17:38:59.663077 ip-10-0-143-124 kubenswrapper[2552]: I0609 17:38:59.663041 2552 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-console/console-5b658b65bd-q5cg6" podUID="b2c04056-6f26-4eb7-88a6-13e3ded83702" containerName="console" containerID="cri-o://ac824bed8e84e6e986fe776b8be59a57be9ef1c721bb66c32574bb324d46e325" gracePeriod=15 Jun 09 17:38:59.859959 ip-10-0-143-124 kubenswrapper[2552]: I0609 17:38:59.859925 2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gctfs_8563ebab-ebdd-4d68-bce1-78d2a7f62992/konnectivity-agent/0.log" limit=1024 Jun 09 17:38:59.907713 ip-10-0-143-124 kubenswrapper[2552]: I0609 17:38:59.907689 2552 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-5b658b65bd-q5cg6" Jun 09 17:39:00.060146 ip-10-0-143-124 kubenswrapper[2552]: I0609 17:39:00.060110 2552 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/b2c04056-6f26-4eb7-88a6-13e3ded83702-trusted-ca-bundle\") pod \"b2c04056-6f26-4eb7-88a6-13e3ded83702\" (UID: \"b2c04056-6f26-4eb7-88a6-13e3ded83702\") " Jun 09 17:39:00.060312 ip-10-0-143-124 kubenswrapper[2552]: I0609 17:39:00.060163 2552 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/b2c04056-6f26-4eb7-88a6-13e3ded83702-console-config\") pod \"b2c04056-6f26-4eb7-88a6-13e3ded83702\" (UID: \"b2c04056-6f26-4eb7-88a6-13e3ded83702\") " Jun 09 17:39:00.060312 ip-10-0-143-124 kubenswrapper[2552]: I0609 17:39:00.060213 2552 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/b2c04056-6f26-4eb7-88a6-13e3ded83702-console-serving-cert\") pod \"b2c04056-6f26-4eb7-88a6-13e3ded83702\" (UID: \"b2c04056-6f26-4eb7-88a6-13e3ded83702\") " Jun 09 17:39:00.060312 ip-10-0-143-124 kubenswrapper[2552]: I0609 17:39:00.060251 2552 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/b2c04056-6f26-4eb7-88a6-13e3ded83702-oauth-serving-cert\") pod \"b2c04056-6f26-4eb7-88a6-13e3ded83702\" (UID: \"b2c04056-6f26-4eb7-88a6-13e3ded83702\") " Jun 09 17:39:00.060312 ip-10-0-143-124 kubenswrapper[2552]: I0609 17:39:00.060284 2552 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/b2c04056-6f26-4eb7-88a6-13e3ded83702-console-oauth-config\") pod \"b2c04056-6f26-4eb7-88a6-13e3ded83702\" (UID: \"b2c04056-6f26-4eb7-88a6-13e3ded83702\") " Jun 09 17:39:00.060464 ip-10-0-143-124 kubenswrapper[2552]: I0609 17:39:00.060324 2552 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-2fgxw\" (UniqueName: \"kubernetes.io/projected/b2c04056-6f26-4eb7-88a6-13e3ded83702-kube-api-access-2fgxw\") pod \"b2c04056-6f26-4eb7-88a6-13e3ded83702\" (UID: \"b2c04056-6f26-4eb7-88a6-13e3ded83702\") " Jun 09 17:39:00.060464 ip-10-0-143-124 kubenswrapper[2552]: I0609 17:39:00.060353 2552 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/b2c04056-6f26-4eb7-88a6-13e3ded83702-service-ca\") pod \"b2c04056-6f26-4eb7-88a6-13e3ded83702\" (UID: \"b2c04056-6f26-4eb7-88a6-13e3ded83702\") " Jun 09 17:39:00.060653 ip-10-0-143-124 kubenswrapper[2552]: I0609 17:39:00.060630 2552 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/b2c04056-6f26-4eb7-88a6-13e3ded83702-trusted-ca-bundle" (OuterVolumeSpecName: "trusted-ca-bundle") pod "b2c04056-6f26-4eb7-88a6-13e3ded83702" (UID: "b2c04056-6f26-4eb7-88a6-13e3ded83702"). InnerVolumeSpecName "trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 09 17:39:00.060742 ip-10-0-143-124 kubenswrapper[2552]: I0609 17:39:00.060665 2552 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/b2c04056-6f26-4eb7-88a6-13e3ded83702-console-config" (OuterVolumeSpecName: "console-config") pod "b2c04056-6f26-4eb7-88a6-13e3ded83702" (UID: "b2c04056-6f26-4eb7-88a6-13e3ded83702"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 09 17:39:00.060939 ip-10-0-143-124 kubenswrapper[2552]: I0609 17:39:00.060910 2552 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/b2c04056-6f26-4eb7-88a6-13e3ded83702-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "b2c04056-6f26-4eb7-88a6-13e3ded83702" (UID: "b2c04056-6f26-4eb7-88a6-13e3ded83702"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 09 17:39:00.060939 ip-10-0-143-124 kubenswrapper[2552]: I0609 17:39:00.060920 2552 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/b2c04056-6f26-4eb7-88a6-13e3ded83702-service-ca" (OuterVolumeSpecName: "service-ca") pod "b2c04056-6f26-4eb7-88a6-13e3ded83702" (UID: "b2c04056-6f26-4eb7-88a6-13e3ded83702"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 09 17:39:00.062503 ip-10-0-143-124 kubenswrapper[2552]: I0609 17:39:00.062468 2552 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/b2c04056-6f26-4eb7-88a6-13e3ded83702-kube-api-access-2fgxw" (OuterVolumeSpecName: "kube-api-access-2fgxw") pod "b2c04056-6f26-4eb7-88a6-13e3ded83702" (UID: "b2c04056-6f26-4eb7-88a6-13e3ded83702"). InnerVolumeSpecName "kube-api-access-2fgxw". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 09 17:39:00.062584 ip-10-0-143-124 kubenswrapper[2552]: I0609 17:39:00.062500 2552 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/b2c04056-6f26-4eb7-88a6-13e3ded83702-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "b2c04056-6f26-4eb7-88a6-13e3ded83702" (UID: "b2c04056-6f26-4eb7-88a6-13e3ded83702"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 09 17:39:00.062584 ip-10-0-143-124 kubenswrapper[2552]: I0609 17:39:00.062508 2552 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/b2c04056-6f26-4eb7-88a6-13e3ded83702-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "b2c04056-6f26-4eb7-88a6-13e3ded83702" (UID: "b2c04056-6f26-4eb7-88a6-13e3ded83702"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 09 17:39:00.161332 ip-10-0-143-124 kubenswrapper[2552]: I0609 17:39:00.161303 2552 reconciler_common.go:299] "Volume detached for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/b2c04056-6f26-4eb7-88a6-13e3ded83702-trusted-ca-bundle\") on node \"ip-10-0-143-124.ec2.internal\" DevicePath \"\"" Jun 09 17:39:00.161332 ip-10-0-143-124 kubenswrapper[2552]: I0609 17:39:00.161326 2552 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/b2c04056-6f26-4eb7-88a6-13e3ded83702-console-config\") on node \"ip-10-0-143-124.ec2.internal\" DevicePath \"\"" Jun 09 17:39:00.161332 ip-10-0-143-124 kubenswrapper[2552]: I0609 17:39:00.161336 2552 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/b2c04056-6f26-4eb7-88a6-13e3ded83702-console-serving-cert\") on node \"ip-10-0-143-124.ec2.internal\" DevicePath \"\"" Jun 09 17:39:00.161520 ip-10-0-143-124 kubenswrapper[2552]: I0609 17:39:00.161345 2552 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/b2c04056-6f26-4eb7-88a6-13e3ded83702-oauth-serving-cert\") on node \"ip-10-0-143-124.ec2.internal\" DevicePath \"\"" Jun 09 17:39:00.161520 ip-10-0-143-124 kubenswrapper[2552]: I0609 17:39:00.161354 2552 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/b2c04056-6f26-4eb7-88a6-13e3ded83702-console-oauth-config\") on node \"ip-10-0-143-124.ec2.internal\" DevicePath \"\"" Jun 09 17:39:00.161520 ip-10-0-143-124 kubenswrapper[2552]: I0609 17:39:00.161362 2552 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-2fgxw\" (UniqueName: \"kubernetes.io/projected/b2c04056-6f26-4eb7-88a6-13e3ded83702-kube-api-access-2fgxw\") on node \"ip-10-0-143-124.ec2.internal\" DevicePath \"\"" Jun 09 17:39:00.161520 ip-10-0-143-124 kubenswrapper[2552]: I0609 17:39:00.161371 2552 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/b2c04056-6f26-4eb7-88a6-13e3ded83702-service-ca\") on node \"ip-10-0-143-124.ec2.internal\" DevicePath \"\"" Jun 09 17:39:00.643653 ip-10-0-143-124 kubenswrapper[2552]: I0609 17:39:00.643521 2552 generic.go:356] "Generic (PLEG): container finished" podID="b2c04056-6f26-4eb7-88a6-13e3ded83702" containerID="ac824bed8e84e6e986fe776b8be59a57be9ef1c721bb66c32574bb324d46e325" exitCode=0 Jun 09 17:39:00.643653 ip-10-0-143-124 kubenswrapper[2552]: I0609 17:39:00.643559 2552 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-5b658b65bd-q5cg6" Jun 09 17:39:00.643653 ip-10-0-143-124 kubenswrapper[2552]: I0609 17:39:00.643622 2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-5b658b65bd-q5cg6" event={"ID":"b2c04056-6f26-4eb7-88a6-13e3ded83702","Type":"ContainerDied","Data":"ac824bed8e84e6e986fe776b8be59a57be9ef1c721bb66c32574bb324d46e325"} Jun 09 17:39:00.643867 ip-10-0-143-124 kubenswrapper[2552]: I0609 17:39:00.643668 2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-5b658b65bd-q5cg6" event={"ID":"b2c04056-6f26-4eb7-88a6-13e3ded83702","Type":"ContainerDied","Data":"562bbc4fa782e0609237bc2e02f40ff80467819e0c9ac9169a7630dff5c0bf39"} Jun 09 17:39:00.643867 ip-10-0-143-124 kubenswrapper[2552]: I0609 17:39:00.643686 2552 scope.go:117] "RemoveContainer" containerID="ac824bed8e84e6e986fe776b8be59a57be9ef1c721bb66c32574bb324d46e325" Jun 09 17:39:00.651247 ip-10-0-143-124 kubenswrapper[2552]: I0609 17:39:00.651230 2552 scope.go:117] "RemoveContainer" containerID="ac824bed8e84e6e986fe776b8be59a57be9ef1c721bb66c32574bb324d46e325" Jun 09 17:39:00.651494 ip-10-0-143-124 kubenswrapper[2552]: E0609 17:39:00.651477 2552 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"ac824bed8e84e6e986fe776b8be59a57be9ef1c721bb66c32574bb324d46e325\": container with ID starting with ac824bed8e84e6e986fe776b8be59a57be9ef1c721bb66c32574bb324d46e325 not found: ID does not exist" containerID="ac824bed8e84e6e986fe776b8be59a57be9ef1c721bb66c32574bb324d46e325" Jun 09 17:39:00.651632 ip-10-0-143-124 kubenswrapper[2552]: I0609 17:39:00.651499 2552 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"ac824bed8e84e6e986fe776b8be59a57be9ef1c721bb66c32574bb324d46e325"} err="failed to get container status \"ac824bed8e84e6e986fe776b8be59a57be9ef1c721bb66c32574bb324d46e325\": rpc error: code = NotFound desc = could not find container \"ac824bed8e84e6e986fe776b8be59a57be9ef1c721bb66c32574bb324d46e325\": container with ID starting with ac824bed8e84e6e986fe776b8be59a57be9ef1c721bb66c32574bb324d46e325 not found: ID does not exist" Jun 09 17:39:00.663501 ip-10-0-143-124 kubenswrapper[2552]: I0609 17:39:00.663481 2552 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-5b658b65bd-q5cg6"] Jun 09 17:39:00.667469 ip-10-0-143-124 kubenswrapper[2552]: I0609 17:39:00.667448 2552 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-5b658b65bd-q5cg6"] Jun 09 17:39:02.335740 ip-10-0-143-124 kubenswrapper[2552]: I0609 17:39:02.335709 2552 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="b2c04056-6f26-4eb7-88a6-13e3ded83702" path="/var/lib/kubelet/pods/b2c04056-6f26-4eb7-88a6-13e3ded83702/volumes" Jun 09 17:39:29.128288 ip-10-0-143-124 kubenswrapper[2552]: I0609 17:39:29.128250 2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gctfs_8563ebab-ebdd-4d68-bce1-78d2a7f62992/konnectivity-agent/0.log" limit=1024 Jun 09 17:39:29.189385 ip-10-0-143-124 kubenswrapper[2552]: I0609 17:39:29.189346 2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gctfs_8563ebab-ebdd-4d68-bce1-78d2a7f62992/konnectivity-agent/0.log" limit=1024 Jun 09 17:39:40.950240 ip-10-0-143-124 kubenswrapper[2552]: I0609 17:39:40.950207 2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gctfs_8563ebab-ebdd-4d68-bce1-78d2a7f62992/konnectivity-agent/0.log" limit=1024 Jun 09 17:39:41.050836 ip-10-0-143-124 kubenswrapper[2552]: I0609 17:39:41.050802 2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gctfs_8563ebab-ebdd-4d68-bce1-78d2a7f62992/konnectivity-agent/0.log" limit=1024 Jun 09 17:39:43.880657 ip-10-0-143-124 kubenswrapper[2552]: I0609 17:39:43.880619 2552 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-8697ccbf4b-qqwdj"] Jun 09 17:39:43.881019 ip-10-0-143-124 kubenswrapper[2552]: I0609 17:39:43.880897 2552 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="b2c04056-6f26-4eb7-88a6-13e3ded83702" containerName="console" Jun 09 17:39:43.881019 ip-10-0-143-124 kubenswrapper[2552]: I0609 17:39:43.880909 2552 state_mem.go:107] "Deleted CPUSet assignment" podUID="b2c04056-6f26-4eb7-88a6-13e3ded83702" containerName="console" Jun 09 17:39:43.881019 ip-10-0-143-124 kubenswrapper[2552]: I0609 17:39:43.880917 2552 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="a19e2dd8-8f3d-4726-97eb-7fe9676d9925" containerName="console" Jun 09 17:39:43.881019 ip-10-0-143-124 kubenswrapper[2552]: I0609 17:39:43.880923 2552 state_mem.go:107] "Deleted CPUSet assignment" podUID="a19e2dd8-8f3d-4726-97eb-7fe9676d9925" containerName="console" Jun 09 17:39:43.881019 ip-10-0-143-124 kubenswrapper[2552]: I0609 17:39:43.880964 2552 memory_manager.go:368] "RemoveStaleState removing state" podUID="b2c04056-6f26-4eb7-88a6-13e3ded83702" containerName="console" Jun 09 17:39:43.881019 ip-10-0-143-124 kubenswrapper[2552]: I0609 17:39:43.880973 2552 memory_manager.go:368] "RemoveStaleState removing state" podUID="a19e2dd8-8f3d-4726-97eb-7fe9676d9925" containerName="console" Jun 09 17:39:43.882792 ip-10-0-143-124 kubenswrapper[2552]: I0609 17:39:43.882775 2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-8697ccbf4b-qqwdj" Jun 09 17:39:43.893939 ip-10-0-143-124 kubenswrapper[2552]: I0609 17:39:43.893911 2552 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-8697ccbf4b-qqwdj"] Jun 09 17:39:43.941983 ip-10-0-143-124 kubenswrapper[2552]: I0609 17:39:43.941937 2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gctfs_8563ebab-ebdd-4d68-bce1-78d2a7f62992/konnectivity-agent/0.log" limit=1024 Jun 09 17:39:43.972114 ip-10-0-143-124 kubenswrapper[2552]: I0609 17:39:43.972087 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/fc1e95b3-4d3a-4153-9ffb-29bfeb4b6690-trusted-ca-bundle\") pod \"console-8697ccbf4b-qqwdj\" (UID: \"fc1e95b3-4d3a-4153-9ffb-29bfeb4b6690\") " pod="openshift-console/console-8697ccbf4b-qqwdj" Jun 09 17:39:43.972257 ip-10-0-143-124 kubenswrapper[2552]: I0609 17:39:43.972117 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-s7z5p\" (UniqueName: \"kubernetes.io/projected/fc1e95b3-4d3a-4153-9ffb-29bfeb4b6690-kube-api-access-s7z5p\") pod \"console-8697ccbf4b-qqwdj\" (UID: \"fc1e95b3-4d3a-4153-9ffb-29bfeb4b6690\") " pod="openshift-console/console-8697ccbf4b-qqwdj" Jun 09 17:39:43.972257 ip-10-0-143-124 kubenswrapper[2552]: I0609 17:39:43.972146 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/fc1e95b3-4d3a-4153-9ffb-29bfeb4b6690-service-ca\") pod \"console-8697ccbf4b-qqwdj\" (UID: \"fc1e95b3-4d3a-4153-9ffb-29bfeb4b6690\") " pod="openshift-console/console-8697ccbf4b-qqwdj" Jun 09 17:39:43.972257 ip-10-0-143-124 kubenswrapper[2552]: I0609 17:39:43.972181 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/fc1e95b3-4d3a-4153-9ffb-29bfeb4b6690-console-oauth-config\") pod \"console-8697ccbf4b-qqwdj\" (UID: \"fc1e95b3-4d3a-4153-9ffb-29bfeb4b6690\") " pod="openshift-console/console-8697ccbf4b-qqwdj" Jun 09 17:39:43.972415 ip-10-0-143-124 kubenswrapper[2552]: I0609 17:39:43.972257 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/fc1e95b3-4d3a-4153-9ffb-29bfeb4b6690-oauth-serving-cert\") pod \"console-8697ccbf4b-qqwdj\" (UID: \"fc1e95b3-4d3a-4153-9ffb-29bfeb4b6690\") " pod="openshift-console/console-8697ccbf4b-qqwdj" Jun 09 17:39:43.972415 ip-10-0-143-124 kubenswrapper[2552]: I0609 17:39:43.972312 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/fc1e95b3-4d3a-4153-9ffb-29bfeb4b6690-console-config\") pod \"console-8697ccbf4b-qqwdj\" (UID: \"fc1e95b3-4d3a-4153-9ffb-29bfeb4b6690\") " pod="openshift-console/console-8697ccbf4b-qqwdj" Jun 09 17:39:43.972415 ip-10-0-143-124 kubenswrapper[2552]: I0609 17:39:43.972363 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/fc1e95b3-4d3a-4153-9ffb-29bfeb4b6690-console-serving-cert\") pod \"console-8697ccbf4b-qqwdj\" (UID: \"fc1e95b3-4d3a-4153-9ffb-29bfeb4b6690\") " pod="openshift-console/console-8697ccbf4b-qqwdj" Jun 09 17:39:44.013569 ip-10-0-143-124 kubenswrapper[2552]: I0609 17:39:44.013534 2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gctfs_8563ebab-ebdd-4d68-bce1-78d2a7f62992/konnectivity-agent/0.log" limit=1024 Jun 09 17:39:44.073675 ip-10-0-143-124 kubenswrapper[2552]: I0609 17:39:44.073638 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/fc1e95b3-4d3a-4153-9ffb-29bfeb4b6690-service-ca\") pod \"console-8697ccbf4b-qqwdj\" (UID: \"fc1e95b3-4d3a-4153-9ffb-29bfeb4b6690\") " pod="openshift-console/console-8697ccbf4b-qqwdj" Jun 09 17:39:44.073834 ip-10-0-143-124 kubenswrapper[2552]: I0609 17:39:44.073686 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/fc1e95b3-4d3a-4153-9ffb-29bfeb4b6690-console-oauth-config\") pod \"console-8697ccbf4b-qqwdj\" (UID: \"fc1e95b3-4d3a-4153-9ffb-29bfeb4b6690\") " pod="openshift-console/console-8697ccbf4b-qqwdj" Jun 09 17:39:44.073834 ip-10-0-143-124 kubenswrapper[2552]: I0609 17:39:44.073718 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/fc1e95b3-4d3a-4153-9ffb-29bfeb4b6690-oauth-serving-cert\") pod \"console-8697ccbf4b-qqwdj\" (UID: \"fc1e95b3-4d3a-4153-9ffb-29bfeb4b6690\") " pod="openshift-console/console-8697ccbf4b-qqwdj" Jun 09 17:39:44.073834 ip-10-0-143-124 kubenswrapper[2552]: I0609 17:39:44.073761 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/fc1e95b3-4d3a-4153-9ffb-29bfeb4b6690-console-config\") pod \"console-8697ccbf4b-qqwdj\" (UID: \"fc1e95b3-4d3a-4153-9ffb-29bfeb4b6690\") " pod="openshift-console/console-8697ccbf4b-qqwdj" Jun 09 17:39:44.073834 ip-10-0-143-124 kubenswrapper[2552]: I0609 17:39:44.073789 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/fc1e95b3-4d3a-4153-9ffb-29bfeb4b6690-console-serving-cert\") pod \"console-8697ccbf4b-qqwdj\" (UID: \"fc1e95b3-4d3a-4153-9ffb-29bfeb4b6690\") " pod="openshift-console/console-8697ccbf4b-qqwdj" Jun 09 17:39:44.074039 ip-10-0-143-124 kubenswrapper[2552]: I0609 17:39:44.073851 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/fc1e95b3-4d3a-4153-9ffb-29bfeb4b6690-trusted-ca-bundle\") pod \"console-8697ccbf4b-qqwdj\" (UID: \"fc1e95b3-4d3a-4153-9ffb-29bfeb4b6690\") " pod="openshift-console/console-8697ccbf4b-qqwdj" Jun 09 17:39:44.074039 ip-10-0-143-124 kubenswrapper[2552]: I0609 17:39:44.073884 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-s7z5p\" (UniqueName: \"kubernetes.io/projected/fc1e95b3-4d3a-4153-9ffb-29bfeb4b6690-kube-api-access-s7z5p\") pod \"console-8697ccbf4b-qqwdj\" (UID: \"fc1e95b3-4d3a-4153-9ffb-29bfeb4b6690\") " pod="openshift-console/console-8697ccbf4b-qqwdj" Jun 09 17:39:44.074569 ip-10-0-143-124 kubenswrapper[2552]: I0609 17:39:44.074541 2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/fc1e95b3-4d3a-4153-9ffb-29bfeb4b6690-service-ca\") pod \"console-8697ccbf4b-qqwdj\" (UID: \"fc1e95b3-4d3a-4153-9ffb-29bfeb4b6690\") " pod="openshift-console/console-8697ccbf4b-qqwdj" Jun 09 17:39:44.074753 ip-10-0-143-124 kubenswrapper[2552]: I0609 17:39:44.074547 2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/fc1e95b3-4d3a-4153-9ffb-29bfeb4b6690-console-config\") pod \"console-8697ccbf4b-qqwdj\" (UID: \"fc1e95b3-4d3a-4153-9ffb-29bfeb4b6690\") " pod="openshift-console/console-8697ccbf4b-qqwdj" Jun 09 17:39:44.074753 ip-10-0-143-124 kubenswrapper[2552]: I0609 17:39:44.074663 2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/fc1e95b3-4d3a-4153-9ffb-29bfeb4b6690-trusted-ca-bundle\") pod \"console-8697ccbf4b-qqwdj\" (UID: \"fc1e95b3-4d3a-4153-9ffb-29bfeb4b6690\") " pod="openshift-console/console-8697ccbf4b-qqwdj" Jun 09 17:39:44.074753 ip-10-0-143-124 kubenswrapper[2552]: I0609 17:39:44.074705 2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/fc1e95b3-4d3a-4153-9ffb-29bfeb4b6690-oauth-serving-cert\") pod \"console-8697ccbf4b-qqwdj\" (UID: \"fc1e95b3-4d3a-4153-9ffb-29bfeb4b6690\") " pod="openshift-console/console-8697ccbf4b-qqwdj" Jun 09 17:39:44.076771 ip-10-0-143-124 kubenswrapper[2552]: I0609 17:39:44.076743 2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/fc1e95b3-4d3a-4153-9ffb-29bfeb4b6690-console-serving-cert\") pod \"console-8697ccbf4b-qqwdj\" (UID: \"fc1e95b3-4d3a-4153-9ffb-29bfeb4b6690\") " pod="openshift-console/console-8697ccbf4b-qqwdj" Jun 09 17:39:44.076860 ip-10-0-143-124 kubenswrapper[2552]: I0609 17:39:44.076839 2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/fc1e95b3-4d3a-4153-9ffb-29bfeb4b6690-console-oauth-config\") pod \"console-8697ccbf4b-qqwdj\" (UID: \"fc1e95b3-4d3a-4153-9ffb-29bfeb4b6690\") " pod="openshift-console/console-8697ccbf4b-qqwdj" Jun 09 17:39:44.082901 ip-10-0-143-124 kubenswrapper[2552]: I0609 17:39:44.082876 2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-s7z5p\" (UniqueName: \"kubernetes.io/projected/fc1e95b3-4d3a-4153-9ffb-29bfeb4b6690-kube-api-access-s7z5p\") pod \"console-8697ccbf4b-qqwdj\" (UID: \"fc1e95b3-4d3a-4153-9ffb-29bfeb4b6690\") " pod="openshift-console/console-8697ccbf4b-qqwdj" Jun 09 17:39:44.107125 ip-10-0-143-124 kubenswrapper[2552]: I0609 17:39:44.107094 2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gctfs_8563ebab-ebdd-4d68-bce1-78d2a7f62992/konnectivity-agent/0.log" limit=1024 Jun 09 17:39:44.168706 ip-10-0-143-124 kubenswrapper[2552]: I0609 17:39:44.168624 2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gctfs_8563ebab-ebdd-4d68-bce1-78d2a7f62992/konnectivity-agent/0.log" limit=1024 Jun 09 17:39:44.191677 ip-10-0-143-124 kubenswrapper[2552]: I0609 17:39:44.191656 2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-8697ccbf4b-qqwdj" Jun 09 17:39:44.317928 ip-10-0-143-124 kubenswrapper[2552]: I0609 17:39:44.317898 2552 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-8697ccbf4b-qqwdj"] Jun 09 17:39:44.321082 ip-10-0-143-124 kubenswrapper[2552]: W0609 17:39:44.321056 2552 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podfc1e95b3_4d3a_4153_9ffb_29bfeb4b6690.slice/crio-c58a867bc2dad339ee55bdeb3e5fe35a9f1587d296447c937ed39df3716e5e18 WatchSource:0}: Error finding container c58a867bc2dad339ee55bdeb3e5fe35a9f1587d296447c937ed39df3716e5e18: Status 404 returned error can't find the container with id c58a867bc2dad339ee55bdeb3e5fe35a9f1587d296447c937ed39df3716e5e18 Jun 09 17:39:44.686889 ip-10-0-143-124 kubenswrapper[2552]: I0609 17:39:44.686851 2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gctfs_8563ebab-ebdd-4d68-bce1-78d2a7f62992/konnectivity-agent/0.log" limit=1024 Jun 09 17:39:44.743815 ip-10-0-143-124 kubenswrapper[2552]: I0609 17:39:44.743779 2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gctfs_8563ebab-ebdd-4d68-bce1-78d2a7f62992/konnectivity-agent/0.log" limit=1024 Jun 09 17:39:44.798926 ip-10-0-143-124 kubenswrapper[2552]: I0609 17:39:44.798885 2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-8697ccbf4b-qqwdj" event={"ID":"fc1e95b3-4d3a-4153-9ffb-29bfeb4b6690","Type":"ContainerStarted","Data":"f87a46a9e86c6dae1c75cc6143d8ded19786df5cab087d7440c62d1f04baa187"} Jun 09 17:39:44.799094 ip-10-0-143-124 kubenswrapper[2552]: I0609 17:39:44.798939 2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-8697ccbf4b-qqwdj" event={"ID":"fc1e95b3-4d3a-4153-9ffb-29bfeb4b6690","Type":"ContainerStarted","Data":"c58a867bc2dad339ee55bdeb3e5fe35a9f1587d296447c937ed39df3716e5e18"} Jun 09 17:39:44.818768 ip-10-0-143-124 kubenswrapper[2552]: I0609 17:39:44.818719 2552 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-8697ccbf4b-qqwdj" podStartSLOduration=1.818702754 podStartE2EDuration="1.818702754s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-09 17:39:43 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-09 17:39:44.81736206 +0000 UTC m=+388.917264704" watchObservedRunningTime="2026-06-09 17:39:44.818702754 +0000 UTC m=+388.918605396" Jun 09 17:39:54.191795 ip-10-0-143-124 kubenswrapper[2552]: I0609 17:39:54.191761 2552 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-8697ccbf4b-qqwdj" Jun 09 17:39:54.192227 ip-10-0-143-124 kubenswrapper[2552]: I0609 17:39:54.192037 2552 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-8697ccbf4b-qqwdj" Jun 09 17:39:54.196470 ip-10-0-143-124 kubenswrapper[2552]: I0609 17:39:54.196449 2552 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-8697ccbf4b-qqwdj" Jun 09 17:39:54.475093 ip-10-0-143-124 kubenswrapper[2552]: I0609 17:39:54.475015 2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gctfs_8563ebab-ebdd-4d68-bce1-78d2a7f62992/konnectivity-agent/0.log" limit=1024 Jun 09 17:39:54.575400 ip-10-0-143-124 kubenswrapper[2552]: I0609 17:39:54.575365 2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gctfs_8563ebab-ebdd-4d68-bce1-78d2a7f62992/konnectivity-agent/0.log" limit=1024 Jun 09 17:39:54.783159 ip-10-0-143-124 kubenswrapper[2552]: I0609 17:39:54.783124 2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gctfs_8563ebab-ebdd-4d68-bce1-78d2a7f62992/konnectivity-agent/0.log" limit=1024 Jun 09 17:39:54.838318 ip-10-0-143-124 kubenswrapper[2552]: I0609 17:39:54.838295 2552 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-8697ccbf4b-qqwdj" Jun 09 17:39:54.888350 ip-10-0-143-124 kubenswrapper[2552]: I0609 17:39:54.888321 2552 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-5887d4c556-42xfd"] Jun 09 17:39:54.988023 ip-10-0-143-124 kubenswrapper[2552]: I0609 17:39:54.987985 2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gctfs_8563ebab-ebdd-4d68-bce1-78d2a7f62992/konnectivity-agent/0.log" limit=1024 Jun 09 17:39:55.038824 ip-10-0-143-124 kubenswrapper[2552]: I0609 17:39:55.038736 2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gctfs_8563ebab-ebdd-4d68-bce1-78d2a7f62992/konnectivity-agent/0.log" limit=1024 Jun 09 17:39:55.094858 ip-10-0-143-124 kubenswrapper[2552]: I0609 17:39:55.094823 2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gctfs_8563ebab-ebdd-4d68-bce1-78d2a7f62992/konnectivity-agent/0.log" limit=1024 Jun 09 17:40:14.847014 ip-10-0-143-124 kubenswrapper[2552]: I0609 17:40:14.846980 2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gctfs_8563ebab-ebdd-4d68-bce1-78d2a7f62992/konnectivity-agent/0.log" limit=1024 Jun 09 17:40:19.908243 ip-10-0-143-124 kubenswrapper[2552]: I0609 17:40:19.908197 2552 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-console/console-5887d4c556-42xfd" podUID="7de9f39c-bd0d-4436-9f85-2ec5f568a710" containerName="console" containerID="cri-o://f4691883f0936cf3d2a9a855059d94bf7aadd47b0cf61f03ea1d07e34c5ec57c" gracePeriod=15 Jun 09 17:40:20.154016 ip-10-0-143-124 kubenswrapper[2552]: I0609 17:40:20.153991 2552 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-5887d4c556-42xfd" Jun 09 17:40:20.249719 ip-10-0-143-124 kubenswrapper[2552]: I0609 17:40:20.249691 2552 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/7de9f39c-bd0d-4436-9f85-2ec5f568a710-console-serving-cert\") pod \"7de9f39c-bd0d-4436-9f85-2ec5f568a710\" (UID: \"7de9f39c-bd0d-4436-9f85-2ec5f568a710\") " Jun 09 17:40:20.249875 ip-10-0-143-124 kubenswrapper[2552]: I0609 17:40:20.249724 2552 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-bvgl4\" (UniqueName: \"kubernetes.io/projected/7de9f39c-bd0d-4436-9f85-2ec5f568a710-kube-api-access-bvgl4\") pod \"7de9f39c-bd0d-4436-9f85-2ec5f568a710\" (UID: \"7de9f39c-bd0d-4436-9f85-2ec5f568a710\") " Jun 09 17:40:20.249875 ip-10-0-143-124 kubenswrapper[2552]: I0609 17:40:20.249747 2552 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/7de9f39c-bd0d-4436-9f85-2ec5f568a710-oauth-serving-cert\") pod \"7de9f39c-bd0d-4436-9f85-2ec5f568a710\" (UID: \"7de9f39c-bd0d-4436-9f85-2ec5f568a710\") " Jun 09 17:40:20.249875 ip-10-0-143-124 kubenswrapper[2552]: I0609 17:40:20.249764 2552 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/7de9f39c-bd0d-4436-9f85-2ec5f568a710-console-config\") pod \"7de9f39c-bd0d-4436-9f85-2ec5f568a710\" (UID: \"7de9f39c-bd0d-4436-9f85-2ec5f568a710\") " Jun 09 17:40:20.249991 ip-10-0-143-124 kubenswrapper[2552]: I0609 17:40:20.249964 2552 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/7de9f39c-bd0d-4436-9f85-2ec5f568a710-console-oauth-config\") pod \"7de9f39c-bd0d-4436-9f85-2ec5f568a710\" (UID: \"7de9f39c-bd0d-4436-9f85-2ec5f568a710\") " Jun 09 17:40:20.250065 ip-10-0-143-124 kubenswrapper[2552]: I0609 17:40:20.250049 2552 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/7de9f39c-bd0d-4436-9f85-2ec5f568a710-trusted-ca-bundle\") pod \"7de9f39c-bd0d-4436-9f85-2ec5f568a710\" (UID: \"7de9f39c-bd0d-4436-9f85-2ec5f568a710\") " Jun 09 17:40:20.250119 ip-10-0-143-124 kubenswrapper[2552]: I0609 17:40:20.250083 2552 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/7de9f39c-bd0d-4436-9f85-2ec5f568a710-service-ca\") pod \"7de9f39c-bd0d-4436-9f85-2ec5f568a710\" (UID: \"7de9f39c-bd0d-4436-9f85-2ec5f568a710\") " Jun 09 17:40:20.250194 ip-10-0-143-124 kubenswrapper[2552]: I0609 17:40:20.250167 2552 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/7de9f39c-bd0d-4436-9f85-2ec5f568a710-console-config" (OuterVolumeSpecName: "console-config") pod "7de9f39c-bd0d-4436-9f85-2ec5f568a710" (UID: "7de9f39c-bd0d-4436-9f85-2ec5f568a710"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 09 17:40:20.250304 ip-10-0-143-124 kubenswrapper[2552]: I0609 17:40:20.250163 2552 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/7de9f39c-bd0d-4436-9f85-2ec5f568a710-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "7de9f39c-bd0d-4436-9f85-2ec5f568a710" (UID: "7de9f39c-bd0d-4436-9f85-2ec5f568a710"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 09 17:40:20.250471 ip-10-0-143-124 kubenswrapper[2552]: I0609 17:40:20.250441 2552 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/7de9f39c-bd0d-4436-9f85-2ec5f568a710-oauth-serving-cert\") on node \"ip-10-0-143-124.ec2.internal\" DevicePath \"\"" Jun 09 17:40:20.250471 ip-10-0-143-124 kubenswrapper[2552]: I0609 17:40:20.250465 2552 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/7de9f39c-bd0d-4436-9f85-2ec5f568a710-console-config\") on node \"ip-10-0-143-124.ec2.internal\" DevicePath \"\"" Jun 09 17:40:20.250576 ip-10-0-143-124 kubenswrapper[2552]: I0609 17:40:20.250465 2552 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/7de9f39c-bd0d-4436-9f85-2ec5f568a710-trusted-ca-bundle" (OuterVolumeSpecName: "trusted-ca-bundle") pod "7de9f39c-bd0d-4436-9f85-2ec5f568a710" (UID: "7de9f39c-bd0d-4436-9f85-2ec5f568a710"). InnerVolumeSpecName "trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 09 17:40:20.250576 ip-10-0-143-124 kubenswrapper[2552]: I0609 17:40:20.250478 2552 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/7de9f39c-bd0d-4436-9f85-2ec5f568a710-service-ca" (OuterVolumeSpecName: "service-ca") pod "7de9f39c-bd0d-4436-9f85-2ec5f568a710" (UID: "7de9f39c-bd0d-4436-9f85-2ec5f568a710"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 09 17:40:20.251891 ip-10-0-143-124 kubenswrapper[2552]: I0609 17:40:20.251862 2552 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/7de9f39c-bd0d-4436-9f85-2ec5f568a710-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "7de9f39c-bd0d-4436-9f85-2ec5f568a710" (UID: "7de9f39c-bd0d-4436-9f85-2ec5f568a710"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 09 17:40:20.251891 ip-10-0-143-124 kubenswrapper[2552]: I0609 17:40:20.251881 2552 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/7de9f39c-bd0d-4436-9f85-2ec5f568a710-kube-api-access-bvgl4" (OuterVolumeSpecName: "kube-api-access-bvgl4") pod "7de9f39c-bd0d-4436-9f85-2ec5f568a710" (UID: "7de9f39c-bd0d-4436-9f85-2ec5f568a710"). InnerVolumeSpecName "kube-api-access-bvgl4". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 09 17:40:20.252018 ip-10-0-143-124 kubenswrapper[2552]: I0609 17:40:20.251941 2552 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/7de9f39c-bd0d-4436-9f85-2ec5f568a710-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "7de9f39c-bd0d-4436-9f85-2ec5f568a710" (UID: "7de9f39c-bd0d-4436-9f85-2ec5f568a710"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 09 17:40:20.351331 ip-10-0-143-124 kubenswrapper[2552]: I0609 17:40:20.351300 2552 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/7de9f39c-bd0d-4436-9f85-2ec5f568a710-console-serving-cert\") on node \"ip-10-0-143-124.ec2.internal\" DevicePath \"\"" Jun 09 17:40:20.351331 ip-10-0-143-124 kubenswrapper[2552]: I0609 17:40:20.351329 2552 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-bvgl4\" (UniqueName: \"kubernetes.io/projected/7de9f39c-bd0d-4436-9f85-2ec5f568a710-kube-api-access-bvgl4\") on node \"ip-10-0-143-124.ec2.internal\" DevicePath \"\"" Jun 09 17:40:20.351504 ip-10-0-143-124 kubenswrapper[2552]: I0609 17:40:20.351342 2552 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/7de9f39c-bd0d-4436-9f85-2ec5f568a710-console-oauth-config\") on node \"ip-10-0-143-124.ec2.internal\" DevicePath \"\"" Jun 09 17:40:20.351504 ip-10-0-143-124 kubenswrapper[2552]: I0609 17:40:20.351353 2552 reconciler_common.go:299] "Volume detached for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/7de9f39c-bd0d-4436-9f85-2ec5f568a710-trusted-ca-bundle\") on node \"ip-10-0-143-124.ec2.internal\" DevicePath \"\"" Jun 09 17:40:20.351504 ip-10-0-143-124 kubenswrapper[2552]: I0609 17:40:20.351365 2552 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/7de9f39c-bd0d-4436-9f85-2ec5f568a710-service-ca\") on node \"ip-10-0-143-124.ec2.internal\" DevicePath \"\"" Jun 09 17:40:20.925970 ip-10-0-143-124 kubenswrapper[2552]: I0609 17:40:20.925930 2552 generic.go:356] "Generic (PLEG): container finished" podID="7de9f39c-bd0d-4436-9f85-2ec5f568a710" containerID="f4691883f0936cf3d2a9a855059d94bf7aadd47b0cf61f03ea1d07e34c5ec57c" exitCode=0 Jun 09 17:40:20.926425 ip-10-0-143-124 kubenswrapper[2552]: I0609 17:40:20.925983 2552 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-5887d4c556-42xfd" Jun 09 17:40:20.926425 ip-10-0-143-124 kubenswrapper[2552]: I0609 17:40:20.926008 2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-5887d4c556-42xfd" event={"ID":"7de9f39c-bd0d-4436-9f85-2ec5f568a710","Type":"ContainerDied","Data":"f4691883f0936cf3d2a9a855059d94bf7aadd47b0cf61f03ea1d07e34c5ec57c"} Jun 09 17:40:20.926425 ip-10-0-143-124 kubenswrapper[2552]: I0609 17:40:20.926051 2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-5887d4c556-42xfd" event={"ID":"7de9f39c-bd0d-4436-9f85-2ec5f568a710","Type":"ContainerDied","Data":"2e65b27f7329e194f641cac9d51709dfad6a372b7d3df584c7f415521b6dbcd6"} Jun 09 17:40:20.926425 ip-10-0-143-124 kubenswrapper[2552]: I0609 17:40:20.926075 2552 scope.go:117] "RemoveContainer" containerID="f4691883f0936cf3d2a9a855059d94bf7aadd47b0cf61f03ea1d07e34c5ec57c" Jun 09 17:40:20.933976 ip-10-0-143-124 kubenswrapper[2552]: I0609 17:40:20.933958 2552 scope.go:117] "RemoveContainer" containerID="f4691883f0936cf3d2a9a855059d94bf7aadd47b0cf61f03ea1d07e34c5ec57c" Jun 09 17:40:20.934218 ip-10-0-143-124 kubenswrapper[2552]: E0609 17:40:20.934200 2552 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"f4691883f0936cf3d2a9a855059d94bf7aadd47b0cf61f03ea1d07e34c5ec57c\": container with ID starting with f4691883f0936cf3d2a9a855059d94bf7aadd47b0cf61f03ea1d07e34c5ec57c not found: ID does not exist" containerID="f4691883f0936cf3d2a9a855059d94bf7aadd47b0cf61f03ea1d07e34c5ec57c" Jun 09 17:40:20.934278 ip-10-0-143-124 kubenswrapper[2552]: I0609 17:40:20.934231 2552 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"f4691883f0936cf3d2a9a855059d94bf7aadd47b0cf61f03ea1d07e34c5ec57c"} err="failed to get container status \"f4691883f0936cf3d2a9a855059d94bf7aadd47b0cf61f03ea1d07e34c5ec57c\": rpc error: code = NotFound desc = could not find container \"f4691883f0936cf3d2a9a855059d94bf7aadd47b0cf61f03ea1d07e34c5ec57c\": container with ID starting with f4691883f0936cf3d2a9a855059d94bf7aadd47b0cf61f03ea1d07e34c5ec57c not found: ID does not exist" Jun 09 17:40:20.941223 ip-10-0-143-124 kubenswrapper[2552]: I0609 17:40:20.941201 2552 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-5887d4c556-42xfd"] Jun 09 17:40:20.944845 ip-10-0-143-124 kubenswrapper[2552]: I0609 17:40:20.944828 2552 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-5887d4c556-42xfd"] Jun 09 17:40:22.336092 ip-10-0-143-124 kubenswrapper[2552]: I0609 17:40:22.336056 2552 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="7de9f39c-bd0d-4436-9f85-2ec5f568a710" path="/var/lib/kubelet/pods/7de9f39c-bd0d-4436-9f85-2ec5f568a710/volumes" Jun 09 17:40:26.618781 ip-10-0-143-124 kubenswrapper[2552]: I0609 17:40:26.618744 2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gctfs_8563ebab-ebdd-4d68-bce1-78d2a7f62992/konnectivity-agent/0.log" limit=1024 Jun 09 17:40:26.715449 ip-10-0-143-124 kubenswrapper[2552]: I0609 17:40:26.715416 2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gctfs_8563ebab-ebdd-4d68-bce1-78d2a7f62992/konnectivity-agent/0.log" limit=1024 Jun 09 17:40:27.233916 ip-10-0-143-124 kubenswrapper[2552]: I0609 17:40:27.233881 2552 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19d2gvt6"] Jun 09 17:40:27.234168 ip-10-0-143-124 kubenswrapper[2552]: I0609 17:40:27.234155 2552 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="7de9f39c-bd0d-4436-9f85-2ec5f568a710" containerName="console" Jun 09 17:40:27.234211 ip-10-0-143-124 kubenswrapper[2552]: I0609 17:40:27.234170 2552 state_mem.go:107] "Deleted CPUSet assignment" podUID="7de9f39c-bd0d-4436-9f85-2ec5f568a710" containerName="console" Jun 09 17:40:27.234244 ip-10-0-143-124 kubenswrapper[2552]: I0609 17:40:27.234234 2552 memory_manager.go:368] "RemoveStaleState removing state" podUID="7de9f39c-bd0d-4436-9f85-2ec5f568a710" containerName="console" Jun 09 17:40:27.237229 ip-10-0-143-124 kubenswrapper[2552]: I0609 17:40:27.237213 2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19d2gvt6" Jun 09 17:40:27.239879 ip-10-0-143-124 kubenswrapper[2552]: I0609 17:40:27.239850 2552 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"kube-root-ca.crt\"" Jun 09 17:40:27.239996 ip-10-0-143-124 kubenswrapper[2552]: I0609 17:40:27.239910 2552 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-marketplace\"/\"default-dockercfg-xcgzg\"" Jun 09 17:40:27.240843 ip-10-0-143-124 kubenswrapper[2552]: I0609 17:40:27.240824 2552 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"openshift-service-ca.crt\"" Jun 09 17:40:27.245965 ip-10-0-143-124 kubenswrapper[2552]: I0609 17:40:27.245945 2552 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19d2gvt6"] Jun 09 17:40:27.309583 ip-10-0-143-124 kubenswrapper[2552]: I0609 17:40:27.309556 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/f1686847-c402-491a-a73c-575fdbd6c593-util\") pod \"2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19d2gvt6\" (UID: \"f1686847-c402-491a-a73c-575fdbd6c593\") " pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19d2gvt6" Jun 09 17:40:27.309741 ip-10-0-143-124 kubenswrapper[2552]: I0609 17:40:27.309592 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/f1686847-c402-491a-a73c-575fdbd6c593-bundle\") pod \"2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19d2gvt6\" (UID: \"f1686847-c402-491a-a73c-575fdbd6c593\") " pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19d2gvt6" Jun 09 17:40:27.309741 ip-10-0-143-124 kubenswrapper[2552]: I0609 17:40:27.309662 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wsdz6\" (UniqueName: \"kubernetes.io/projected/f1686847-c402-491a-a73c-575fdbd6c593-kube-api-access-wsdz6\") pod \"2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19d2gvt6\" (UID: \"f1686847-c402-491a-a73c-575fdbd6c593\") " pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19d2gvt6" Jun 09 17:40:27.410763 ip-10-0-143-124 kubenswrapper[2552]: I0609 17:40:27.410717 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wsdz6\" (UniqueName: \"kubernetes.io/projected/f1686847-c402-491a-a73c-575fdbd6c593-kube-api-access-wsdz6\") pod \"2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19d2gvt6\" (UID: \"f1686847-c402-491a-a73c-575fdbd6c593\") " pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19d2gvt6" Jun 09 17:40:27.410911 ip-10-0-143-124 kubenswrapper[2552]: I0609 17:40:27.410875 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/f1686847-c402-491a-a73c-575fdbd6c593-util\") pod \"2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19d2gvt6\" (UID: \"f1686847-c402-491a-a73c-575fdbd6c593\") " pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19d2gvt6" Jun 09 17:40:27.410950 ip-10-0-143-124 kubenswrapper[2552]: I0609 17:40:27.410927 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/f1686847-c402-491a-a73c-575fdbd6c593-bundle\") pod \"2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19d2gvt6\" (UID: \"f1686847-c402-491a-a73c-575fdbd6c593\") " pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19d2gvt6" Jun 09 17:40:27.411223 ip-10-0-143-124 kubenswrapper[2552]: I0609 17:40:27.411207 2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/f1686847-c402-491a-a73c-575fdbd6c593-util\") pod \"2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19d2gvt6\" (UID: \"f1686847-c402-491a-a73c-575fdbd6c593\") " pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19d2gvt6" Jun 09 17:40:27.411264 ip-10-0-143-124 kubenswrapper[2552]: I0609 17:40:27.411237 2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/f1686847-c402-491a-a73c-575fdbd6c593-bundle\") pod \"2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19d2gvt6\" (UID: \"f1686847-c402-491a-a73c-575fdbd6c593\") " pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19d2gvt6" Jun 09 17:40:27.418808 ip-10-0-143-124 kubenswrapper[2552]: I0609 17:40:27.418787 2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-wsdz6\" (UniqueName: \"kubernetes.io/projected/f1686847-c402-491a-a73c-575fdbd6c593-kube-api-access-wsdz6\") pod \"2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19d2gvt6\" (UID: \"f1686847-c402-491a-a73c-575fdbd6c593\") " pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19d2gvt6" Jun 09 17:40:27.547068 ip-10-0-143-124 kubenswrapper[2552]: I0609 17:40:27.547043 2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19d2gvt6" Jun 09 17:40:27.669778 ip-10-0-143-124 kubenswrapper[2552]: I0609 17:40:27.669745 2552 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19d2gvt6"] Jun 09 17:40:27.680874 ip-10-0-143-124 kubenswrapper[2552]: I0609 17:40:27.680855 2552 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jun 09 17:40:27.953204 ip-10-0-143-124 kubenswrapper[2552]: I0609 17:40:27.953120 2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19d2gvt6" event={"ID":"f1686847-c402-491a-a73c-575fdbd6c593","Type":"ContainerStarted","Data":"bc9ae6db71921bab8d7d7e928906b63e1ffa1027ef7154026f0fd4e1c8d3dd88"} Jun 09 17:40:31.235284 ip-10-0-143-124 kubenswrapper[2552]: I0609 17:40:31.235191 2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gctfs_8563ebab-ebdd-4d68-bce1-78d2a7f62992/konnectivity-agent/0.log" limit=1024 Jun 09 17:40:31.335792 ip-10-0-143-124 kubenswrapper[2552]: I0609 17:40:31.335757 2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gctfs_8563ebab-ebdd-4d68-bce1-78d2a7f62992/konnectivity-agent/0.log" limit=1024 Jun 09 17:40:36.988084 ip-10-0-143-124 kubenswrapper[2552]: I0609 17:40:36.988043 2552 generic.go:356] "Generic (PLEG): container finished" podID="f1686847-c402-491a-a73c-575fdbd6c593" containerID="e861b9c086e8affc2e212457a28616d3308f5d717af9209629084c2246a8ea21" exitCode=0 Jun 09 17:40:36.988455 ip-10-0-143-124 kubenswrapper[2552]: I0609 17:40:36.988128 2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19d2gvt6" event={"ID":"f1686847-c402-491a-a73c-575fdbd6c593","Type":"ContainerDied","Data":"e861b9c086e8affc2e212457a28616d3308f5d717af9209629084c2246a8ea21"} Jun 09 17:40:38.997520 ip-10-0-143-124 kubenswrapper[2552]: I0609 17:40:38.997491 2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19d2gvt6" event={"ID":"f1686847-c402-491a-a73c-575fdbd6c593","Type":"ContainerStarted","Data":"7ff0bef624c6d2e203ef78f78f87dd2d82f4d0a34892dd3a1918346ae00cdbcd"} Jun 09 17:40:40.002906 ip-10-0-143-124 kubenswrapper[2552]: I0609 17:40:40.002871 2552 generic.go:356] "Generic (PLEG): container finished" podID="f1686847-c402-491a-a73c-575fdbd6c593" containerID="7ff0bef624c6d2e203ef78f78f87dd2d82f4d0a34892dd3a1918346ae00cdbcd" exitCode=0 Jun 09 17:40:40.003275 ip-10-0-143-124 kubenswrapper[2552]: I0609 17:40:40.002956 2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19d2gvt6" event={"ID":"f1686847-c402-491a-a73c-575fdbd6c593","Type":"ContainerDied","Data":"7ff0bef624c6d2e203ef78f78f87dd2d82f4d0a34892dd3a1918346ae00cdbcd"} Jun 09 17:40:48.045926 ip-10-0-143-124 kubenswrapper[2552]: I0609 17:40:48.045892 2552 generic.go:356] "Generic (PLEG): container finished" podID="f1686847-c402-491a-a73c-575fdbd6c593" containerID="f8737fb6ead2ccca826523a1d41da3cc6da733b342218de250f2cb0bc348f56a" exitCode=0 Jun 09 17:40:48.046336 ip-10-0-143-124 kubenswrapper[2552]: I0609 17:40:48.045938 2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19d2gvt6" event={"ID":"f1686847-c402-491a-a73c-575fdbd6c593","Type":"ContainerDied","Data":"f8737fb6ead2ccca826523a1d41da3cc6da733b342218de250f2cb0bc348f56a"} Jun 09 17:40:49.165676 ip-10-0-143-124 kubenswrapper[2552]: I0609 17:40:49.165653 2552 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19d2gvt6" Jun 09 17:40:49.184867 ip-10-0-143-124 kubenswrapper[2552]: I0609 17:40:49.184828 2552 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/f1686847-c402-491a-a73c-575fdbd6c593-bundle\") pod \"f1686847-c402-491a-a73c-575fdbd6c593\" (UID: \"f1686847-c402-491a-a73c-575fdbd6c593\") " Jun 09 17:40:49.185018 ip-10-0-143-124 kubenswrapper[2552]: I0609 17:40:49.184879 2552 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-wsdz6\" (UniqueName: \"kubernetes.io/projected/f1686847-c402-491a-a73c-575fdbd6c593-kube-api-access-wsdz6\") pod \"f1686847-c402-491a-a73c-575fdbd6c593\" (UID: \"f1686847-c402-491a-a73c-575fdbd6c593\") " Jun 09 17:40:49.185018 ip-10-0-143-124 kubenswrapper[2552]: I0609 17:40:49.184947 2552 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/f1686847-c402-491a-a73c-575fdbd6c593-util\") pod \"f1686847-c402-491a-a73c-575fdbd6c593\" (UID: \"f1686847-c402-491a-a73c-575fdbd6c593\") " Jun 09 17:40:49.185718 ip-10-0-143-124 kubenswrapper[2552]: I0609 17:40:49.185667 2552 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/f1686847-c402-491a-a73c-575fdbd6c593-bundle" (OuterVolumeSpecName: "bundle") pod "f1686847-c402-491a-a73c-575fdbd6c593" (UID: "f1686847-c402-491a-a73c-575fdbd6c593"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 09 17:40:49.187260 ip-10-0-143-124 kubenswrapper[2552]: I0609 17:40:49.187230 2552 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/f1686847-c402-491a-a73c-575fdbd6c593-kube-api-access-wsdz6" (OuterVolumeSpecName: "kube-api-access-wsdz6") pod "f1686847-c402-491a-a73c-575fdbd6c593" (UID: "f1686847-c402-491a-a73c-575fdbd6c593"). InnerVolumeSpecName "kube-api-access-wsdz6". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 09 17:40:49.191786 ip-10-0-143-124 kubenswrapper[2552]: I0609 17:40:49.191759 2552 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/f1686847-c402-491a-a73c-575fdbd6c593-util" (OuterVolumeSpecName: "util") pod "f1686847-c402-491a-a73c-575fdbd6c593" (UID: "f1686847-c402-491a-a73c-575fdbd6c593"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 09 17:40:49.285660 ip-10-0-143-124 kubenswrapper[2552]: I0609 17:40:49.285628 2552 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/f1686847-c402-491a-a73c-575fdbd6c593-util\") on node \"ip-10-0-143-124.ec2.internal\" DevicePath \"\"" Jun 09 17:40:49.285660 ip-10-0-143-124 kubenswrapper[2552]: I0609 17:40:49.285654 2552 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/f1686847-c402-491a-a73c-575fdbd6c593-bundle\") on node \"ip-10-0-143-124.ec2.internal\" DevicePath \"\"" Jun 09 17:40:49.285660 ip-10-0-143-124 kubenswrapper[2552]: I0609 17:40:49.285665 2552 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-wsdz6\" (UniqueName: \"kubernetes.io/projected/f1686847-c402-491a-a73c-575fdbd6c593-kube-api-access-wsdz6\") on node \"ip-10-0-143-124.ec2.internal\" DevicePath \"\"" Jun 09 17:40:50.054316 ip-10-0-143-124 kubenswrapper[2552]: I0609 17:40:50.054286 2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19d2gvt6" event={"ID":"f1686847-c402-491a-a73c-575fdbd6c593","Type":"ContainerDied","Data":"bc9ae6db71921bab8d7d7e928906b63e1ffa1027ef7154026f0fd4e1c8d3dd88"} Jun 09 17:40:50.054316 ip-10-0-143-124 kubenswrapper[2552]: I0609 17:40:50.054316 2552 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19d2gvt6" Jun 09 17:40:50.054512 ip-10-0-143-124 kubenswrapper[2552]: I0609 17:40:50.054333 2552 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="bc9ae6db71921bab8d7d7e928906b63e1ffa1027ef7154026f0fd4e1c8d3dd88" Jun 09 17:40:53.237256 ip-10-0-143-124 kubenswrapper[2552]: I0609 17:40:53.237203 2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gctfs_8563ebab-ebdd-4d68-bce1-78d2a7f62992/konnectivity-agent/0.log" limit=1024 Jun 09 17:40:54.086379 ip-10-0-143-124 kubenswrapper[2552]: I0609 17:40:54.086345 2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gctfs_8563ebab-ebdd-4d68-bce1-78d2a7f62992/konnectivity-agent/0.log" limit=1024 Jun 09 17:40:55.231315 ip-10-0-143-124 kubenswrapper[2552]: I0609 17:40:55.231278 2552 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["cert-manager-operator/cert-manager-operator-controller-manager-57757f7cfc-fkjmv"] Jun 09 17:40:55.231702 ip-10-0-143-124 kubenswrapper[2552]: I0609 17:40:55.231556 2552 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="f1686847-c402-491a-a73c-575fdbd6c593" containerName="pull" Jun 09 17:40:55.231702 ip-10-0-143-124 kubenswrapper[2552]: I0609 17:40:55.231566 2552 state_mem.go:107] "Deleted CPUSet assignment" podUID="f1686847-c402-491a-a73c-575fdbd6c593" containerName="pull" Jun 09 17:40:55.231702 ip-10-0-143-124 kubenswrapper[2552]: I0609 17:40:55.231580 2552 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="f1686847-c402-491a-a73c-575fdbd6c593" containerName="util" Jun 09 17:40:55.231702 ip-10-0-143-124 kubenswrapper[2552]: I0609 17:40:55.231585 2552 state_mem.go:107] "Deleted CPUSet assignment" podUID="f1686847-c402-491a-a73c-575fdbd6c593" containerName="util" Jun 09 17:40:55.231702 ip-10-0-143-124 kubenswrapper[2552]: I0609 17:40:55.231609 2552 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="f1686847-c402-491a-a73c-575fdbd6c593" containerName="extract" Jun 09 17:40:55.231702 ip-10-0-143-124 kubenswrapper[2552]: I0609 17:40:55.231615 2552 state_mem.go:107] "Deleted CPUSet assignment" podUID="f1686847-c402-491a-a73c-575fdbd6c593" containerName="extract" Jun 09 17:40:55.231702 ip-10-0-143-124 kubenswrapper[2552]: I0609 17:40:55.231662 2552 memory_manager.go:368] "RemoveStaleState removing state" podUID="f1686847-c402-491a-a73c-575fdbd6c593" containerName="extract" Jun 09 17:40:55.275987 ip-10-0-143-124 kubenswrapper[2552]: I0609 17:40:55.275960 2552 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager-operator/cert-manager-operator-controller-manager-57757f7cfc-fkjmv"] Jun 09 17:40:55.276125 ip-10-0-143-124 kubenswrapper[2552]: I0609 17:40:55.276054 2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager-operator/cert-manager-operator-controller-manager-57757f7cfc-fkjmv" Jun 09 17:40:55.281712 ip-10-0-143-124 kubenswrapper[2552]: I0609 17:40:55.281690 2552 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager-operator\"/\"kube-root-ca.crt\"" Jun 09 17:40:55.281978 ip-10-0-143-124 kubenswrapper[2552]: I0609 17:40:55.281961 2552 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"cert-manager-operator\"/\"cert-manager-operator-controller-manager-dockercfg-h6n7q\"" Jun 09 17:40:55.282224 ip-10-0-143-124 kubenswrapper[2552]: I0609 17:40:55.282202 2552 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager-operator\"/\"openshift-service-ca.crt\"" Jun 09 17:40:55.329666 ip-10-0-143-124 kubenswrapper[2552]: I0609 17:40:55.329636 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/cc2e5008-5a69-4acb-ab45-2462961748bc-tmp\") pod \"cert-manager-operator-controller-manager-57757f7cfc-fkjmv\" (UID: \"cc2e5008-5a69-4acb-ab45-2462961748bc\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-57757f7cfc-fkjmv" Jun 09 17:40:55.329776 ip-10-0-143-124 kubenswrapper[2552]: I0609 17:40:55.329688 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-k7mzb\" (UniqueName: \"kubernetes.io/projected/cc2e5008-5a69-4acb-ab45-2462961748bc-kube-api-access-k7mzb\") pod \"cert-manager-operator-controller-manager-57757f7cfc-fkjmv\" (UID: \"cc2e5008-5a69-4acb-ab45-2462961748bc\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-57757f7cfc-fkjmv" Jun 09 17:40:55.430662 ip-10-0-143-124 kubenswrapper[2552]: I0609 17:40:55.430626 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/cc2e5008-5a69-4acb-ab45-2462961748bc-tmp\") pod \"cert-manager-operator-controller-manager-57757f7cfc-fkjmv\" (UID: \"cc2e5008-5a69-4acb-ab45-2462961748bc\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-57757f7cfc-fkjmv" Jun 09 17:40:55.430793 ip-10-0-143-124 kubenswrapper[2552]: I0609 17:40:55.430672 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-k7mzb\" (UniqueName: \"kubernetes.io/projected/cc2e5008-5a69-4acb-ab45-2462961748bc-kube-api-access-k7mzb\") pod \"cert-manager-operator-controller-manager-57757f7cfc-fkjmv\" (UID: \"cc2e5008-5a69-4acb-ab45-2462961748bc\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-57757f7cfc-fkjmv" Jun 09 17:40:55.431039 ip-10-0-143-124 kubenswrapper[2552]: I0609 17:40:55.431014 2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/cc2e5008-5a69-4acb-ab45-2462961748bc-tmp\") pod \"cert-manager-operator-controller-manager-57757f7cfc-fkjmv\" (UID: \"cc2e5008-5a69-4acb-ab45-2462961748bc\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-57757f7cfc-fkjmv" Jun 09 17:40:55.439288 ip-10-0-143-124 kubenswrapper[2552]: I0609 17:40:55.439266 2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-k7mzb\" (UniqueName: \"kubernetes.io/projected/cc2e5008-5a69-4acb-ab45-2462961748bc-kube-api-access-k7mzb\") pod \"cert-manager-operator-controller-manager-57757f7cfc-fkjmv\" (UID: \"cc2e5008-5a69-4acb-ab45-2462961748bc\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-57757f7cfc-fkjmv" Jun 09 17:40:55.584648 ip-10-0-143-124 kubenswrapper[2552]: I0609 17:40:55.584618 2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager-operator/cert-manager-operator-controller-manager-57757f7cfc-fkjmv" Jun 09 17:40:55.731325 ip-10-0-143-124 kubenswrapper[2552]: I0609 17:40:55.731295 2552 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager-operator/cert-manager-operator-controller-manager-57757f7cfc-fkjmv"] Jun 09 17:40:55.735301 ip-10-0-143-124 kubenswrapper[2552]: W0609 17:40:55.735278 2552 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podcc2e5008_5a69_4acb_ab45_2462961748bc.slice/crio-0203a77a5e8d78a3b3ccec81fa8815ca0fcf32dcac08cca5d0a973efe65ffa0b WatchSource:0}: Error finding container 0203a77a5e8d78a3b3ccec81fa8815ca0fcf32dcac08cca5d0a973efe65ffa0b: Status 404 returned error can't find the container with id 0203a77a5e8d78a3b3ccec81fa8815ca0fcf32dcac08cca5d0a973efe65ffa0b Jun 09 17:40:56.078484 ip-10-0-143-124 kubenswrapper[2552]: I0609 17:40:56.078449 2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager-operator/cert-manager-operator-controller-manager-57757f7cfc-fkjmv" event={"ID":"cc2e5008-5a69-4acb-ab45-2462961748bc","Type":"ContainerStarted","Data":"0203a77a5e8d78a3b3ccec81fa8815ca0fcf32dcac08cca5d0a973efe65ffa0b"} Jun 09 17:40:56.843166 ip-10-0-143-124 kubenswrapper[2552]: I0609 17:40:56.843079 2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gctfs_8563ebab-ebdd-4d68-bce1-78d2a7f62992/konnectivity-agent/0.log" limit=1024 Jun 09 17:40:56.957161 ip-10-0-143-124 kubenswrapper[2552]: I0609 17:40:56.957128 2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gctfs_8563ebab-ebdd-4d68-bce1-78d2a7f62992/konnectivity-agent/0.log" limit=1024 Jun 09 17:41:00.075841 ip-10-0-143-124 kubenswrapper[2552]: I0609 17:41:00.075802 2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gctfs_8563ebab-ebdd-4d68-bce1-78d2a7f62992/konnectivity-agent/0.log" limit=1024 Jun 09 17:41:00.095748 ip-10-0-143-124 kubenswrapper[2552]: I0609 17:41:00.095711 2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager-operator/cert-manager-operator-controller-manager-57757f7cfc-fkjmv" event={"ID":"cc2e5008-5a69-4acb-ab45-2462961748bc","Type":"ContainerStarted","Data":"ad0c5b0dc0d17563537f2054f05ae2195fd15bb35c6982472c4af2ffb1802f30"} Jun 09 17:41:00.142150 ip-10-0-143-124 kubenswrapper[2552]: I0609 17:41:00.142100 2552 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="cert-manager-operator/cert-manager-operator-controller-manager-57757f7cfc-fkjmv" podStartSLOduration=1.517822562 podStartE2EDuration="5.142082111s" totalImagesPullingTime="3.624259549s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-09 17:40:55 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-09 17:41:00.1400776 +0000 UTC m=+464.239980251" watchObservedRunningTime="2026-06-09 17:41:00.142082111 +0000 UTC m=+464.241984762" Jun 09 17:41:00.192176 ip-10-0-143-124 kubenswrapper[2552]: I0609 17:41:00.192145 2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gctfs_8563ebab-ebdd-4d68-bce1-78d2a7f62992/konnectivity-agent/0.log" limit=1024 Jun 09 17:41:00.491652 ip-10-0-143-124 kubenswrapper[2552]: I0609 17:41:00.491622 2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gctfs_8563ebab-ebdd-4d68-bce1-78d2a7f62992/konnectivity-agent/0.log" limit=1024 Jun 09 17:41:00.603637 ip-10-0-143-124 kubenswrapper[2552]: I0609 17:41:00.603585 2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gctfs_8563ebab-ebdd-4d68-bce1-78d2a7f62992/konnectivity-agent/0.log" limit=1024 Jun 09 17:41:00.707637 ip-10-0-143-124 kubenswrapper[2552]: I0609 17:41:00.707581 2552 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fbfz57"] Jun 09 17:41:00.709975 ip-10-0-143-124 kubenswrapper[2552]: I0609 17:41:00.709958 2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fbfz57" Jun 09 17:41:00.712773 ip-10-0-143-124 kubenswrapper[2552]: I0609 17:41:00.712743 2552 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"openshift-service-ca.crt\"" Jun 09 17:41:00.712911 ip-10-0-143-124 kubenswrapper[2552]: I0609 17:41:00.712832 2552 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"kube-root-ca.crt\"" Jun 09 17:41:00.712911 ip-10-0-143-124 kubenswrapper[2552]: I0609 17:41:00.712862 2552 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-marketplace\"/\"default-dockercfg-xcgzg\"" Jun 09 17:41:00.725574 ip-10-0-143-124 kubenswrapper[2552]: I0609 17:41:00.725550 2552 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fbfz57"] Jun 09 17:41:00.768889 ip-10-0-143-124 kubenswrapper[2552]: I0609 17:41:00.768804 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/dec5ad63-ef45-4814-9cff-7b4a35a0d907-util\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fbfz57\" (UID: \"dec5ad63-ef45-4814-9cff-7b4a35a0d907\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fbfz57" Jun 09 17:41:00.768889 ip-10-0-143-124 kubenswrapper[2552]: I0609 17:41:00.768837 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7pgbm\" (UniqueName: \"kubernetes.io/projected/dec5ad63-ef45-4814-9cff-7b4a35a0d907-kube-api-access-7pgbm\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fbfz57\" (UID: \"dec5ad63-ef45-4814-9cff-7b4a35a0d907\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fbfz57" Jun 09 17:41:00.769115 ip-10-0-143-124 kubenswrapper[2552]: I0609 17:41:00.768938 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/dec5ad63-ef45-4814-9cff-7b4a35a0d907-bundle\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fbfz57\" (UID: \"dec5ad63-ef45-4814-9cff-7b4a35a0d907\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fbfz57" Jun 09 17:41:00.870075 ip-10-0-143-124 kubenswrapper[2552]: I0609 17:41:00.870038 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/dec5ad63-ef45-4814-9cff-7b4a35a0d907-util\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fbfz57\" (UID: \"dec5ad63-ef45-4814-9cff-7b4a35a0d907\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fbfz57" Jun 09 17:41:00.870075 ip-10-0-143-124 kubenswrapper[2552]: I0609 17:41:00.870074 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7pgbm\" (UniqueName: \"kubernetes.io/projected/dec5ad63-ef45-4814-9cff-7b4a35a0d907-kube-api-access-7pgbm\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fbfz57\" (UID: \"dec5ad63-ef45-4814-9cff-7b4a35a0d907\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fbfz57" Jun 09 17:41:00.870266 ip-10-0-143-124 kubenswrapper[2552]: I0609 17:41:00.870134 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/dec5ad63-ef45-4814-9cff-7b4a35a0d907-bundle\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fbfz57\" (UID: \"dec5ad63-ef45-4814-9cff-7b4a35a0d907\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fbfz57" Jun 09 17:41:00.870503 ip-10-0-143-124 kubenswrapper[2552]: I0609 17:41:00.870482 2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/dec5ad63-ef45-4814-9cff-7b4a35a0d907-util\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fbfz57\" (UID: \"dec5ad63-ef45-4814-9cff-7b4a35a0d907\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fbfz57" Jun 09 17:41:00.870503 ip-10-0-143-124 kubenswrapper[2552]: I0609 17:41:00.870496 2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/dec5ad63-ef45-4814-9cff-7b4a35a0d907-bundle\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fbfz57\" (UID: \"dec5ad63-ef45-4814-9cff-7b4a35a0d907\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fbfz57" Jun 09 17:41:00.884316 ip-10-0-143-124 kubenswrapper[2552]: I0609 17:41:00.884287 2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-7pgbm\" (UniqueName: \"kubernetes.io/projected/dec5ad63-ef45-4814-9cff-7b4a35a0d907-kube-api-access-7pgbm\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fbfz57\" (UID: \"dec5ad63-ef45-4814-9cff-7b4a35a0d907\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fbfz57" Jun 09 17:41:01.018415 ip-10-0-143-124 kubenswrapper[2552]: I0609 17:41:01.018385 2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fbfz57" Jun 09 17:41:01.146806 ip-10-0-143-124 kubenswrapper[2552]: I0609 17:41:01.146771 2552 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fbfz57"] Jun 09 17:41:01.149877 ip-10-0-143-124 kubenswrapper[2552]: W0609 17:41:01.149849 2552 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poddec5ad63_ef45_4814_9cff_7b4a35a0d907.slice/crio-c1e65c2ef514193b33053d1e08806ea370187c0f05d029a5bd8dbdcb1d16c207 WatchSource:0}: Error finding container c1e65c2ef514193b33053d1e08806ea370187c0f05d029a5bd8dbdcb1d16c207: Status 404 returned error can't find the container with id c1e65c2ef514193b33053d1e08806ea370187c0f05d029a5bd8dbdcb1d16c207 Jun 09 17:41:02.107330 ip-10-0-143-124 kubenswrapper[2552]: I0609 17:41:02.107294 2552 generic.go:356] "Generic (PLEG): container finished" podID="dec5ad63-ef45-4814-9cff-7b4a35a0d907" containerID="23229fab8daafecfa427470c971ac6377c35b4e40f64f461464cdca069ec57c7" exitCode=0 Jun 09 17:41:02.107484 ip-10-0-143-124 kubenswrapper[2552]: I0609 17:41:02.107349 2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fbfz57" event={"ID":"dec5ad63-ef45-4814-9cff-7b4a35a0d907","Type":"ContainerDied","Data":"23229fab8daafecfa427470c971ac6377c35b4e40f64f461464cdca069ec57c7"} Jun 09 17:41:02.107484 ip-10-0-143-124 kubenswrapper[2552]: I0609 17:41:02.107385 2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fbfz57" event={"ID":"dec5ad63-ef45-4814-9cff-7b4a35a0d907","Type":"ContainerStarted","Data":"c1e65c2ef514193b33053d1e08806ea370187c0f05d029a5bd8dbdcb1d16c207"} Jun 09 17:41:02.637082 ip-10-0-143-124 kubenswrapper[2552]: I0609 17:41:02.637037 2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gctfs_8563ebab-ebdd-4d68-bce1-78d2a7f62992/konnectivity-agent/0.log" limit=1024 Jun 09 17:41:02.737249 ip-10-0-143-124 kubenswrapper[2552]: I0609 17:41:02.737208 2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gctfs_8563ebab-ebdd-4d68-bce1-78d2a7f62992/konnectivity-agent/0.log" limit=1024 Jun 09 17:41:03.357193 ip-10-0-143-124 kubenswrapper[2552]: I0609 17:41:03.357147 2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gctfs_8563ebab-ebdd-4d68-bce1-78d2a7f62992/konnectivity-agent/0.log" limit=1024 Jun 09 17:41:03.731083 ip-10-0-143-124 kubenswrapper[2552]: I0609 17:41:03.731002 2552 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["cert-manager/cert-manager-cainjector-5d99449ffd-92lmw"] Jun 09 17:41:03.737286 ip-10-0-143-124 kubenswrapper[2552]: I0609 17:41:03.737265 2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-cainjector-5d99449ffd-92lmw" Jun 09 17:41:03.740201 ip-10-0-143-124 kubenswrapper[2552]: I0609 17:41:03.740173 2552 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager\"/\"kube-root-ca.crt\"" Jun 09 17:41:03.741070 ip-10-0-143-124 kubenswrapper[2552]: I0609 17:41:03.741049 2552 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"cert-manager\"/\"cert-manager-cainjector-dockercfg-w9z2j\"" Jun 09 17:41:03.741188 ip-10-0-143-124 kubenswrapper[2552]: I0609 17:41:03.741049 2552 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager\"/\"openshift-service-ca.crt\"" Jun 09 17:41:03.744135 ip-10-0-143-124 kubenswrapper[2552]: I0609 17:41:03.744094 2552 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-cainjector-5d99449ffd-92lmw"] Jun 09 17:41:03.795910 ip-10-0-143-124 kubenswrapper[2552]: I0609 17:41:03.795869 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/33aa1f2f-0dea-4d07-8e39-4bbf6e5e0f82-bound-sa-token\") pod \"cert-manager-cainjector-5d99449ffd-92lmw\" (UID: \"33aa1f2f-0dea-4d07-8e39-4bbf6e5e0f82\") " pod="cert-manager/cert-manager-cainjector-5d99449ffd-92lmw" Jun 09 17:41:03.795910 ip-10-0-143-124 kubenswrapper[2552]: I0609 17:41:03.795909 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-bt75r\" (UniqueName: \"kubernetes.io/projected/33aa1f2f-0dea-4d07-8e39-4bbf6e5e0f82-kube-api-access-bt75r\") pod \"cert-manager-cainjector-5d99449ffd-92lmw\" (UID: \"33aa1f2f-0dea-4d07-8e39-4bbf6e5e0f82\") " pod="cert-manager/cert-manager-cainjector-5d99449ffd-92lmw" Jun 09 17:41:03.896879 ip-10-0-143-124 kubenswrapper[2552]: I0609 17:41:03.896838 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/33aa1f2f-0dea-4d07-8e39-4bbf6e5e0f82-bound-sa-token\") pod \"cert-manager-cainjector-5d99449ffd-92lmw\" (UID: \"33aa1f2f-0dea-4d07-8e39-4bbf6e5e0f82\") " pod="cert-manager/cert-manager-cainjector-5d99449ffd-92lmw" Jun 09 17:41:03.897055 ip-10-0-143-124 kubenswrapper[2552]: I0609 17:41:03.896887 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-bt75r\" (UniqueName: \"kubernetes.io/projected/33aa1f2f-0dea-4d07-8e39-4bbf6e5e0f82-kube-api-access-bt75r\") pod \"cert-manager-cainjector-5d99449ffd-92lmw\" (UID: \"33aa1f2f-0dea-4d07-8e39-4bbf6e5e0f82\") " pod="cert-manager/cert-manager-cainjector-5d99449ffd-92lmw" Jun 09 17:41:03.911708 ip-10-0-143-124 kubenswrapper[2552]: I0609 17:41:03.911673 2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-bt75r\" (UniqueName: \"kubernetes.io/projected/33aa1f2f-0dea-4d07-8e39-4bbf6e5e0f82-kube-api-access-bt75r\") pod \"cert-manager-cainjector-5d99449ffd-92lmw\" (UID: \"33aa1f2f-0dea-4d07-8e39-4bbf6e5e0f82\") " pod="cert-manager/cert-manager-cainjector-5d99449ffd-92lmw" Jun 09 17:41:03.911849 ip-10-0-143-124 kubenswrapper[2552]: I0609 17:41:03.911757 2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/33aa1f2f-0dea-4d07-8e39-4bbf6e5e0f82-bound-sa-token\") pod \"cert-manager-cainjector-5d99449ffd-92lmw\" (UID: \"33aa1f2f-0dea-4d07-8e39-4bbf6e5e0f82\") " pod="cert-manager/cert-manager-cainjector-5d99449ffd-92lmw" Jun 09 17:41:03.960968 ip-10-0-143-124 kubenswrapper[2552]: I0609 17:41:03.960915 2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gctfs_8563ebab-ebdd-4d68-bce1-78d2a7f62992/konnectivity-agent/0.log" limit=1024 Jun 09 17:41:04.055844 ip-10-0-143-124 kubenswrapper[2552]: I0609 17:41:04.055815 2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-cainjector-5d99449ffd-92lmw" Jun 09 17:41:04.119492 ip-10-0-143-124 kubenswrapper[2552]: I0609 17:41:04.119014 2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fbfz57" event={"ID":"dec5ad63-ef45-4814-9cff-7b4a35a0d907","Type":"ContainerStarted","Data":"269a954e22c085baaf5334c9daff7895bd118e7251223bd86b4eeb180eed5d2f"} Jun 09 17:41:04.191895 ip-10-0-143-124 kubenswrapper[2552]: I0609 17:41:04.191852 2552 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-cainjector-5d99449ffd-92lmw"] Jun 09 17:41:04.194324 ip-10-0-143-124 kubenswrapper[2552]: W0609 17:41:04.194298 2552 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod33aa1f2f_0dea_4d07_8e39_4bbf6e5e0f82.slice/crio-b7e4530988b5394dab32e845f814520656b26f41e100bbfbe02c08bba96bf18b WatchSource:0}: Error finding container b7e4530988b5394dab32e845f814520656b26f41e100bbfbe02c08bba96bf18b: Status 404 returned error can't find the container with id b7e4530988b5394dab32e845f814520656b26f41e100bbfbe02c08bba96bf18b Jun 09 17:41:05.125682 ip-10-0-143-124 kubenswrapper[2552]: I0609 17:41:05.125645 2552 generic.go:356] "Generic (PLEG): container finished" podID="dec5ad63-ef45-4814-9cff-7b4a35a0d907" containerID="269a954e22c085baaf5334c9daff7895bd118e7251223bd86b4eeb180eed5d2f" exitCode=0 Jun 09 17:41:05.126115 ip-10-0-143-124 kubenswrapper[2552]: I0609 17:41:05.125743 2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fbfz57" event={"ID":"dec5ad63-ef45-4814-9cff-7b4a35a0d907","Type":"ContainerDied","Data":"269a954e22c085baaf5334c9daff7895bd118e7251223bd86b4eeb180eed5d2f"} Jun 09 17:41:05.127377 ip-10-0-143-124 kubenswrapper[2552]: I0609 17:41:05.127323 2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-cainjector-5d99449ffd-92lmw" event={"ID":"33aa1f2f-0dea-4d07-8e39-4bbf6e5e0f82","Type":"ContainerStarted","Data":"b7e4530988b5394dab32e845f814520656b26f41e100bbfbe02c08bba96bf18b"} Jun 09 17:41:06.134297 ip-10-0-143-124 kubenswrapper[2552]: I0609 17:41:06.134263 2552 generic.go:356] "Generic (PLEG): container finished" podID="dec5ad63-ef45-4814-9cff-7b4a35a0d907" containerID="5ee4eb887fc86a191d01e813e7ebae8ae5dd266487937592e5718cd2d89d5998" exitCode=0 Jun 09 17:41:06.134739 ip-10-0-143-124 kubenswrapper[2552]: I0609 17:41:06.134326 2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fbfz57" event={"ID":"dec5ad63-ef45-4814-9cff-7b4a35a0d907","Type":"ContainerDied","Data":"5ee4eb887fc86a191d01e813e7ebae8ae5dd266487937592e5718cd2d89d5998"} Jun 09 17:41:07.144380 ip-10-0-143-124 kubenswrapper[2552]: I0609 17:41:07.144339 2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-cainjector-5d99449ffd-92lmw" event={"ID":"33aa1f2f-0dea-4d07-8e39-4bbf6e5e0f82","Type":"ContainerStarted","Data":"42a94d32eb94077e6f8c395f3610ce80bc48f0ffefdf7b1b8a2d6c827ca8e46b"} Jun 09 17:41:07.161166 ip-10-0-143-124 kubenswrapper[2552]: I0609 17:41:07.161114 2552 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="cert-manager/cert-manager-cainjector-5d99449ffd-92lmw" podStartSLOduration=1.919950442 podStartE2EDuration="4.161098772s" totalImagesPullingTime="2.24114833s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-09 17:41:03 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-09 17:41:07.159835051 +0000 UTC m=+471.259737692" watchObservedRunningTime="2026-06-09 17:41:07.161098772 +0000 UTC m=+471.261001422" Jun 09 17:41:07.282574 ip-10-0-143-124 kubenswrapper[2552]: I0609 17:41:07.282547 2552 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fbfz57" Jun 09 17:41:07.325974 ip-10-0-143-124 kubenswrapper[2552]: I0609 17:41:07.325944 2552 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-7pgbm\" (UniqueName: \"kubernetes.io/projected/dec5ad63-ef45-4814-9cff-7b4a35a0d907-kube-api-access-7pgbm\") pod \"dec5ad63-ef45-4814-9cff-7b4a35a0d907\" (UID: \"dec5ad63-ef45-4814-9cff-7b4a35a0d907\") " Jun 09 17:41:07.326115 ip-10-0-143-124 kubenswrapper[2552]: I0609 17:41:07.325990 2552 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/dec5ad63-ef45-4814-9cff-7b4a35a0d907-bundle\") pod \"dec5ad63-ef45-4814-9cff-7b4a35a0d907\" (UID: \"dec5ad63-ef45-4814-9cff-7b4a35a0d907\") " Jun 09 17:41:07.326115 ip-10-0-143-124 kubenswrapper[2552]: I0609 17:41:07.326096 2552 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/dec5ad63-ef45-4814-9cff-7b4a35a0d907-util\") pod \"dec5ad63-ef45-4814-9cff-7b4a35a0d907\" (UID: \"dec5ad63-ef45-4814-9cff-7b4a35a0d907\") " Jun 09 17:41:07.326369 ip-10-0-143-124 kubenswrapper[2552]: I0609 17:41:07.326352 2552 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/dec5ad63-ef45-4814-9cff-7b4a35a0d907-bundle" (OuterVolumeSpecName: "bundle") pod "dec5ad63-ef45-4814-9cff-7b4a35a0d907" (UID: "dec5ad63-ef45-4814-9cff-7b4a35a0d907"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 09 17:41:07.328152 ip-10-0-143-124 kubenswrapper[2552]: I0609 17:41:07.328129 2552 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/dec5ad63-ef45-4814-9cff-7b4a35a0d907-kube-api-access-7pgbm" (OuterVolumeSpecName: "kube-api-access-7pgbm") pod "dec5ad63-ef45-4814-9cff-7b4a35a0d907" (UID: "dec5ad63-ef45-4814-9cff-7b4a35a0d907"). InnerVolumeSpecName "kube-api-access-7pgbm". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 09 17:41:07.330733 ip-10-0-143-124 kubenswrapper[2552]: I0609 17:41:07.330701 2552 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/dec5ad63-ef45-4814-9cff-7b4a35a0d907-util" (OuterVolumeSpecName: "util") pod "dec5ad63-ef45-4814-9cff-7b4a35a0d907" (UID: "dec5ad63-ef45-4814-9cff-7b4a35a0d907"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 09 17:41:07.427565 ip-10-0-143-124 kubenswrapper[2552]: I0609 17:41:07.427498 2552 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-7pgbm\" (UniqueName: \"kubernetes.io/projected/dec5ad63-ef45-4814-9cff-7b4a35a0d907-kube-api-access-7pgbm\") on node \"ip-10-0-143-124.ec2.internal\" DevicePath \"\"" Jun 09 17:41:07.427565 ip-10-0-143-124 kubenswrapper[2552]: I0609 17:41:07.427524 2552 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/dec5ad63-ef45-4814-9cff-7b4a35a0d907-bundle\") on node \"ip-10-0-143-124.ec2.internal\" DevicePath \"\"" Jun 09 17:41:07.427565 ip-10-0-143-124 kubenswrapper[2552]: I0609 17:41:07.427539 2552 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/dec5ad63-ef45-4814-9cff-7b4a35a0d907-util\") on node \"ip-10-0-143-124.ec2.internal\" DevicePath \"\"" Jun 09 17:41:08.149913 ip-10-0-143-124 kubenswrapper[2552]: I0609 17:41:08.149872 2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fbfz57" event={"ID":"dec5ad63-ef45-4814-9cff-7b4a35a0d907","Type":"ContainerDied","Data":"c1e65c2ef514193b33053d1e08806ea370187c0f05d029a5bd8dbdcb1d16c207"} Jun 09 17:41:08.149913 ip-10-0-143-124 kubenswrapper[2552]: I0609 17:41:08.149900 2552 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fbfz57" Jun 09 17:41:08.150327 ip-10-0-143-124 kubenswrapper[2552]: I0609 17:41:08.149935 2552 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="c1e65c2ef514193b33053d1e08806ea370187c0f05d029a5bd8dbdcb1d16c207" Jun 09 17:41:11.755806 ip-10-0-143-124 kubenswrapper[2552]: I0609 17:41:11.755767 2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gctfs_8563ebab-ebdd-4d68-bce1-78d2a7f62992/konnectivity-agent/0.log" limit=1024 Jun 09 17:41:12.519079 ip-10-0-143-124 kubenswrapper[2552]: I0609 17:41:12.519042 2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gctfs_8563ebab-ebdd-4d68-bce1-78d2a7f62992/konnectivity-agent/0.log" limit=1024 Jun 09 17:41:12.617122 ip-10-0-143-124 kubenswrapper[2552]: I0609 17:41:12.617094 2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gctfs_8563ebab-ebdd-4d68-bce1-78d2a7f62992/konnectivity-agent/0.log" limit=1024 Jun 09 17:41:13.293335 ip-10-0-143-124 kubenswrapper[2552]: I0609 17:41:13.293296 2552 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["cert-manager/cert-manager-59c77684cc-fvp2n"] Jun 09 17:41:13.293741 ip-10-0-143-124 kubenswrapper[2552]: I0609 17:41:13.293578 2552 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="dec5ad63-ef45-4814-9cff-7b4a35a0d907" containerName="pull" Jun 09 17:41:13.293741 ip-10-0-143-124 kubenswrapper[2552]: I0609 17:41:13.293589 2552 state_mem.go:107] "Deleted CPUSet assignment" podUID="dec5ad63-ef45-4814-9cff-7b4a35a0d907" containerName="pull" Jun 09 17:41:13.293741 ip-10-0-143-124 kubenswrapper[2552]: I0609 17:41:13.293615 2552 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="dec5ad63-ef45-4814-9cff-7b4a35a0d907" containerName="extract" Jun 09 17:41:13.293741 ip-10-0-143-124 kubenswrapper[2552]: I0609 17:41:13.293622 2552 state_mem.go:107] "Deleted CPUSet assignment" podUID="dec5ad63-ef45-4814-9cff-7b4a35a0d907" containerName="extract" Jun 09 17:41:13.293741 ip-10-0-143-124 kubenswrapper[2552]: I0609 17:41:13.293634 2552 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="dec5ad63-ef45-4814-9cff-7b4a35a0d907" containerName="util" Jun 09 17:41:13.293741 ip-10-0-143-124 kubenswrapper[2552]: I0609 17:41:13.293639 2552 state_mem.go:107] "Deleted CPUSet assignment" podUID="dec5ad63-ef45-4814-9cff-7b4a35a0d907" containerName="util" Jun 09 17:41:13.293741 ip-10-0-143-124 kubenswrapper[2552]: I0609 17:41:13.293711 2552 memory_manager.go:368] "RemoveStaleState removing state" podUID="dec5ad63-ef45-4814-9cff-7b4a35a0d907" containerName="extract" Jun 09 17:41:13.296982 ip-10-0-143-124 kubenswrapper[2552]: I0609 17:41:13.296966 2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-59c77684cc-fvp2n" Jun 09 17:41:13.301954 ip-10-0-143-124 kubenswrapper[2552]: I0609 17:41:13.301934 2552 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"cert-manager\"/\"cert-manager-dockercfg-2k8l5\"" Jun 09 17:41:13.320022 ip-10-0-143-124 kubenswrapper[2552]: I0609 17:41:13.319995 2552 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-59c77684cc-fvp2n"] Jun 09 17:41:13.375807 ip-10-0-143-124 kubenswrapper[2552]: I0609 17:41:13.375771 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/dcfe6918-000b-4bbe-b949-3fb6aa6d3657-bound-sa-token\") pod \"cert-manager-59c77684cc-fvp2n\" (UID: \"dcfe6918-000b-4bbe-b949-3fb6aa6d3657\") " pod="cert-manager/cert-manager-59c77684cc-fvp2n" Jun 09 17:41:13.375943 ip-10-0-143-124 kubenswrapper[2552]: I0609 17:41:13.375825 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-52484\" (UniqueName: \"kubernetes.io/projected/dcfe6918-000b-4bbe-b949-3fb6aa6d3657-kube-api-access-52484\") pod \"cert-manager-59c77684cc-fvp2n\" (UID: \"dcfe6918-000b-4bbe-b949-3fb6aa6d3657\") " pod="cert-manager/cert-manager-59c77684cc-fvp2n" Jun 09 17:41:13.476669 ip-10-0-143-124 kubenswrapper[2552]: I0609 17:41:13.476619 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/dcfe6918-000b-4bbe-b949-3fb6aa6d3657-bound-sa-token\") pod \"cert-manager-59c77684cc-fvp2n\" (UID: \"dcfe6918-000b-4bbe-b949-3fb6aa6d3657\") " pod="cert-manager/cert-manager-59c77684cc-fvp2n" Jun 09 17:41:13.476840 ip-10-0-143-124 kubenswrapper[2552]: I0609 17:41:13.476699 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-52484\" (UniqueName: \"kubernetes.io/projected/dcfe6918-000b-4bbe-b949-3fb6aa6d3657-kube-api-access-52484\") pod \"cert-manager-59c77684cc-fvp2n\" (UID: \"dcfe6918-000b-4bbe-b949-3fb6aa6d3657\") " pod="cert-manager/cert-manager-59c77684cc-fvp2n" Jun 09 17:41:13.486160 ip-10-0-143-124 kubenswrapper[2552]: I0609 17:41:13.486130 2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/dcfe6918-000b-4bbe-b949-3fb6aa6d3657-bound-sa-token\") pod \"cert-manager-59c77684cc-fvp2n\" (UID: \"dcfe6918-000b-4bbe-b949-3fb6aa6d3657\") " pod="cert-manager/cert-manager-59c77684cc-fvp2n" Jun 09 17:41:13.486303 ip-10-0-143-124 kubenswrapper[2552]: I0609 17:41:13.486283 2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-52484\" (UniqueName: \"kubernetes.io/projected/dcfe6918-000b-4bbe-b949-3fb6aa6d3657-kube-api-access-52484\") pod \"cert-manager-59c77684cc-fvp2n\" (UID: \"dcfe6918-000b-4bbe-b949-3fb6aa6d3657\") " pod="cert-manager/cert-manager-59c77684cc-fvp2n" Jun 09 17:41:13.606311 ip-10-0-143-124 kubenswrapper[2552]: I0609 17:41:13.606221 2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-59c77684cc-fvp2n" Jun 09 17:41:13.733951 ip-10-0-143-124 kubenswrapper[2552]: I0609 17:41:13.733925 2552 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-59c77684cc-fvp2n"] Jun 09 17:41:13.736321 ip-10-0-143-124 kubenswrapper[2552]: W0609 17:41:13.736297 2552 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-poddcfe6918_000b_4bbe_b949_3fb6aa6d3657.slice/crio-d51a024c4f5aac54ca0e461a2edeb2aa08148203f6cf813a4e78798db882004e WatchSource:0}: Error finding container d51a024c4f5aac54ca0e461a2edeb2aa08148203f6cf813a4e78798db882004e: Status 404 returned error can't find the container with id d51a024c4f5aac54ca0e461a2edeb2aa08148203f6cf813a4e78798db882004e Jun 09 17:41:14.177316 ip-10-0-143-124 kubenswrapper[2552]: I0609 17:41:14.177284 2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-59c77684cc-fvp2n" event={"ID":"dcfe6918-000b-4bbe-b949-3fb6aa6d3657","Type":"ContainerStarted","Data":"e0f35bc89ac627526030acf405e3e661ec44b7a28cba130afa8ccb6477b4e2ac"} Jun 09 17:41:14.177469 ip-10-0-143-124 kubenswrapper[2552]: I0609 17:41:14.177328 2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-59c77684cc-fvp2n" event={"ID":"dcfe6918-000b-4bbe-b949-3fb6aa6d3657","Type":"ContainerStarted","Data":"d51a024c4f5aac54ca0e461a2edeb2aa08148203f6cf813a4e78798db882004e"} Jun 09 17:41:14.193891 ip-10-0-143-124 kubenswrapper[2552]: I0609 17:41:14.193848 2552 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="cert-manager/cert-manager-59c77684cc-fvp2n" podStartSLOduration=1.193834149 podStartE2EDuration="1.193834149s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-09 17:41:13 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-09 17:41:14.19254171 +0000 UTC m=+478.292444361" watchObservedRunningTime="2026-06-09 17:41:14.193834149 +0000 UTC m=+478.293736799" Jun 09 17:41:19.127929 ip-10-0-143-124 kubenswrapper[2552]: I0609 17:41:19.127888 2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gctfs_8563ebab-ebdd-4d68-bce1-78d2a7f62992/konnectivity-agent/0.log" limit=1024 Jun 09 17:41:19.227881 ip-10-0-143-124 kubenswrapper[2552]: I0609 17:41:19.227846 2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gctfs_8563ebab-ebdd-4d68-bce1-78d2a7f62992/konnectivity-agent/0.log" limit=1024 Jun 09 17:41:20.735898 ip-10-0-143-124 kubenswrapper[2552]: I0609 17:41:20.735866 2552 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-marketplace/410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cdrmwhj"] Jun 09 17:41:20.739085 ip-10-0-143-124 kubenswrapper[2552]: I0609 17:41:20.739067 2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cdrmwhj" Jun 09 17:41:20.742073 ip-10-0-143-124 kubenswrapper[2552]: I0609 17:41:20.742050 2552 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"kube-root-ca.crt\"" Jun 09 17:41:20.742213 ip-10-0-143-124 kubenswrapper[2552]: I0609 17:41:20.742091 2552 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-marketplace\"/\"default-dockercfg-xcgzg\"" Jun 09 17:41:20.743295 ip-10-0-143-124 kubenswrapper[2552]: I0609 17:41:20.743273 2552 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"openshift-service-ca.crt\"" Jun 09 17:41:20.750904 ip-10-0-143-124 kubenswrapper[2552]: I0609 17:41:20.750884 2552 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cdrmwhj"] Jun 09 17:41:20.836072 ip-10-0-143-124 kubenswrapper[2552]: I0609 17:41:20.836035 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-nkjx7\" (UniqueName: \"kubernetes.io/projected/11b1177a-c680-44da-8e8c-1e7c23ce30ac-kube-api-access-nkjx7\") pod \"410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cdrmwhj\" (UID: \"11b1177a-c680-44da-8e8c-1e7c23ce30ac\") " pod="openshift-marketplace/410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cdrmwhj" Jun 09 17:41:20.836267 ip-10-0-143-124 kubenswrapper[2552]: I0609 17:41:20.836081 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/11b1177a-c680-44da-8e8c-1e7c23ce30ac-bundle\") pod \"410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cdrmwhj\" (UID: \"11b1177a-c680-44da-8e8c-1e7c23ce30ac\") " pod="openshift-marketplace/410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cdrmwhj" Jun 09 17:41:20.836267 ip-10-0-143-124 kubenswrapper[2552]: I0609 17:41:20.836100 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/11b1177a-c680-44da-8e8c-1e7c23ce30ac-util\") pod \"410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cdrmwhj\" (UID: \"11b1177a-c680-44da-8e8c-1e7c23ce30ac\") " pod="openshift-marketplace/410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cdrmwhj" Jun 09 17:41:20.936911 ip-10-0-143-124 kubenswrapper[2552]: I0609 17:41:20.936877 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-nkjx7\" (UniqueName: \"kubernetes.io/projected/11b1177a-c680-44da-8e8c-1e7c23ce30ac-kube-api-access-nkjx7\") pod \"410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cdrmwhj\" (UID: \"11b1177a-c680-44da-8e8c-1e7c23ce30ac\") " pod="openshift-marketplace/410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cdrmwhj" Jun 09 17:41:20.936911 ip-10-0-143-124 kubenswrapper[2552]: I0609 17:41:20.936919 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/11b1177a-c680-44da-8e8c-1e7c23ce30ac-bundle\") pod \"410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cdrmwhj\" (UID: \"11b1177a-c680-44da-8e8c-1e7c23ce30ac\") " pod="openshift-marketplace/410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cdrmwhj" Jun 09 17:41:20.937113 ip-10-0-143-124 kubenswrapper[2552]: I0609 17:41:20.936937 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/11b1177a-c680-44da-8e8c-1e7c23ce30ac-util\") pod \"410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cdrmwhj\" (UID: \"11b1177a-c680-44da-8e8c-1e7c23ce30ac\") " pod="openshift-marketplace/410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cdrmwhj" Jun 09 17:41:20.937236 ip-10-0-143-124 kubenswrapper[2552]: I0609 17:41:20.937221 2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/11b1177a-c680-44da-8e8c-1e7c23ce30ac-util\") pod \"410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cdrmwhj\" (UID: \"11b1177a-c680-44da-8e8c-1e7c23ce30ac\") " pod="openshift-marketplace/410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cdrmwhj" Jun 09 17:41:20.937290 ip-10-0-143-124 kubenswrapper[2552]: I0609 17:41:20.937270 2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/11b1177a-c680-44da-8e8c-1e7c23ce30ac-bundle\") pod \"410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cdrmwhj\" (UID: \"11b1177a-c680-44da-8e8c-1e7c23ce30ac\") " pod="openshift-marketplace/410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cdrmwhj" Jun 09 17:41:20.945421 ip-10-0-143-124 kubenswrapper[2552]: I0609 17:41:20.945396 2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-nkjx7\" (UniqueName: \"kubernetes.io/projected/11b1177a-c680-44da-8e8c-1e7c23ce30ac-kube-api-access-nkjx7\") pod \"410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cdrmwhj\" (UID: \"11b1177a-c680-44da-8e8c-1e7c23ce30ac\") " pod="openshift-marketplace/410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cdrmwhj" Jun 09 17:41:21.048777 ip-10-0-143-124 kubenswrapper[2552]: I0609 17:41:21.048742 2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cdrmwhj" Jun 09 17:41:21.172556 ip-10-0-143-124 kubenswrapper[2552]: I0609 17:41:21.172522 2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gctfs_8563ebab-ebdd-4d68-bce1-78d2a7f62992/konnectivity-agent/0.log" limit=1024 Jun 09 17:41:21.192301 ip-10-0-143-124 kubenswrapper[2552]: I0609 17:41:21.192192 2552 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cdrmwhj"] Jun 09 17:41:21.196043 ip-10-0-143-124 kubenswrapper[2552]: W0609 17:41:21.196017 2552 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod11b1177a_c680_44da_8e8c_1e7c23ce30ac.slice/crio-58063128082ecceb0cba175e3d1096b8cf3e9d7c76cbc80de8f4f84f1b9f0653 WatchSource:0}: Error finding container 58063128082ecceb0cba175e3d1096b8cf3e9d7c76cbc80de8f4f84f1b9f0653: Status 404 returned error can't find the container with id 58063128082ecceb0cba175e3d1096b8cf3e9d7c76cbc80de8f4f84f1b9f0653 Jun 09 17:41:21.207133 ip-10-0-143-124 kubenswrapper[2552]: I0609 17:41:21.207109 2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cdrmwhj" event={"ID":"11b1177a-c680-44da-8e8c-1e7c23ce30ac","Type":"ContainerStarted","Data":"58063128082ecceb0cba175e3d1096b8cf3e9d7c76cbc80de8f4f84f1b9f0653"} Jun 09 17:41:22.212465 ip-10-0-143-124 kubenswrapper[2552]: I0609 17:41:22.212376 2552 generic.go:356] "Generic (PLEG): container finished" podID="11b1177a-c680-44da-8e8c-1e7c23ce30ac" containerID="2ec19d200d61dc36676d6812cbada52b631178b056fa0db0499b73d892fb24fd" exitCode=0 Jun 09 17:41:22.212855 ip-10-0-143-124 kubenswrapper[2552]: I0609 17:41:22.212465 2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cdrmwhj" event={"ID":"11b1177a-c680-44da-8e8c-1e7c23ce30ac","Type":"ContainerDied","Data":"2ec19d200d61dc36676d6812cbada52b631178b056fa0db0499b73d892fb24fd"} Jun 09 17:41:23.218584 ip-10-0-143-124 kubenswrapper[2552]: I0609 17:41:23.218491 2552 generic.go:356] "Generic (PLEG): container finished" podID="11b1177a-c680-44da-8e8c-1e7c23ce30ac" containerID="b3995a8a10b8f74a56cd3bf46f14d9da9e596d0757bdfc95d099fb9eab5ae119" exitCode=0 Jun 09 17:41:23.218940 ip-10-0-143-124 kubenswrapper[2552]: I0609 17:41:23.218574 2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cdrmwhj" event={"ID":"11b1177a-c680-44da-8e8c-1e7c23ce30ac","Type":"ContainerDied","Data":"b3995a8a10b8f74a56cd3bf46f14d9da9e596d0757bdfc95d099fb9eab5ae119"} Jun 09 17:41:24.225251 ip-10-0-143-124 kubenswrapper[2552]: I0609 17:41:24.225215 2552 generic.go:356] "Generic (PLEG): container finished" podID="11b1177a-c680-44da-8e8c-1e7c23ce30ac" containerID="da3754e2ed308529625f5fa5825ca1d3edb0494d175f1c421517df7d7db63bfd" exitCode=0 Jun 09 17:41:24.225665 ip-10-0-143-124 kubenswrapper[2552]: I0609 17:41:24.225287 2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cdrmwhj" event={"ID":"11b1177a-c680-44da-8e8c-1e7c23ce30ac","Type":"ContainerDied","Data":"da3754e2ed308529625f5fa5825ca1d3edb0494d175f1c421517df7d7db63bfd"} Jun 09 17:41:25.349219 ip-10-0-143-124 kubenswrapper[2552]: I0609 17:41:25.349196 2552 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cdrmwhj" Jun 09 17:41:25.474213 ip-10-0-143-124 kubenswrapper[2552]: I0609 17:41:25.474182 2552 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-nkjx7\" (UniqueName: \"kubernetes.io/projected/11b1177a-c680-44da-8e8c-1e7c23ce30ac-kube-api-access-nkjx7\") pod \"11b1177a-c680-44da-8e8c-1e7c23ce30ac\" (UID: \"11b1177a-c680-44da-8e8c-1e7c23ce30ac\") " Jun 09 17:41:25.474358 ip-10-0-143-124 kubenswrapper[2552]: I0609 17:41:25.474231 2552 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/11b1177a-c680-44da-8e8c-1e7c23ce30ac-bundle\") pod \"11b1177a-c680-44da-8e8c-1e7c23ce30ac\" (UID: \"11b1177a-c680-44da-8e8c-1e7c23ce30ac\") " Jun 09 17:41:25.474358 ip-10-0-143-124 kubenswrapper[2552]: I0609 17:41:25.474308 2552 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/11b1177a-c680-44da-8e8c-1e7c23ce30ac-util\") pod \"11b1177a-c680-44da-8e8c-1e7c23ce30ac\" (UID: \"11b1177a-c680-44da-8e8c-1e7c23ce30ac\") " Jun 09 17:41:25.475153 ip-10-0-143-124 kubenswrapper[2552]: I0609 17:41:25.475126 2552 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/11b1177a-c680-44da-8e8c-1e7c23ce30ac-bundle" (OuterVolumeSpecName: "bundle") pod "11b1177a-c680-44da-8e8c-1e7c23ce30ac" (UID: "11b1177a-c680-44da-8e8c-1e7c23ce30ac"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 09 17:41:25.476271 ip-10-0-143-124 kubenswrapper[2552]: I0609 17:41:25.476248 2552 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/11b1177a-c680-44da-8e8c-1e7c23ce30ac-kube-api-access-nkjx7" (OuterVolumeSpecName: "kube-api-access-nkjx7") pod "11b1177a-c680-44da-8e8c-1e7c23ce30ac" (UID: "11b1177a-c680-44da-8e8c-1e7c23ce30ac"). InnerVolumeSpecName "kube-api-access-nkjx7". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 09 17:41:25.480348 ip-10-0-143-124 kubenswrapper[2552]: I0609 17:41:25.480324 2552 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/11b1177a-c680-44da-8e8c-1e7c23ce30ac-util" (OuterVolumeSpecName: "util") pod "11b1177a-c680-44da-8e8c-1e7c23ce30ac" (UID: "11b1177a-c680-44da-8e8c-1e7c23ce30ac"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 09 17:41:25.575303 ip-10-0-143-124 kubenswrapper[2552]: I0609 17:41:25.575268 2552 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-nkjx7\" (UniqueName: \"kubernetes.io/projected/11b1177a-c680-44da-8e8c-1e7c23ce30ac-kube-api-access-nkjx7\") on node \"ip-10-0-143-124.ec2.internal\" DevicePath \"\"" Jun 09 17:41:25.575303 ip-10-0-143-124 kubenswrapper[2552]: I0609 17:41:25.575295 2552 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/11b1177a-c680-44da-8e8c-1e7c23ce30ac-bundle\") on node \"ip-10-0-143-124.ec2.internal\" DevicePath \"\"" Jun 09 17:41:25.575303 ip-10-0-143-124 kubenswrapper[2552]: I0609 17:41:25.575306 2552 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/11b1177a-c680-44da-8e8c-1e7c23ce30ac-util\") on node \"ip-10-0-143-124.ec2.internal\" DevicePath \"\"" Jun 09 17:41:26.235033 ip-10-0-143-124 kubenswrapper[2552]: I0609 17:41:26.235000 2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cdrmwhj" event={"ID":"11b1177a-c680-44da-8e8c-1e7c23ce30ac","Type":"ContainerDied","Data":"58063128082ecceb0cba175e3d1096b8cf3e9d7c76cbc80de8f4f84f1b9f0653"} Jun 09 17:41:26.235197 ip-10-0-143-124 kubenswrapper[2552]: I0609 17:41:26.235052 2552 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="58063128082ecceb0cba175e3d1096b8cf3e9d7c76cbc80de8f4f84f1b9f0653" Jun 09 17:41:26.235197 ip-10-0-143-124 kubenswrapper[2552]: I0609 17:41:26.235014 2552 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cdrmwhj" Jun 09 17:41:36.471438 ip-10-0-143-124 kubenswrapper[2552]: I0609 17:41:36.471398 2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gctfs_8563ebab-ebdd-4d68-bce1-78d2a7f62992/konnectivity-agent/0.log" limit=1024 Jun 09 17:41:36.570950 ip-10-0-143-124 kubenswrapper[2552]: I0609 17:41:36.570913 2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gctfs_8563ebab-ebdd-4d68-bce1-78d2a7f62992/konnectivity-agent/0.log" limit=1024 Jun 09 17:41:37.076580 ip-10-0-143-124 kubenswrapper[2552]: I0609 17:41:37.076541 2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gctfs_8563ebab-ebdd-4d68-bce1-78d2a7f62992/konnectivity-agent/0.log" limit=1024 Jun 09 17:41:37.339930 ip-10-0-143-124 kubenswrapper[2552]: I0609 17:41:37.339844 2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gctfs_8563ebab-ebdd-4d68-bce1-78d2a7f62992/konnectivity-agent/0.log" limit=1024 Jun 09 17:41:37.435026 ip-10-0-143-124 kubenswrapper[2552]: I0609 17:41:37.434990 2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gctfs_8563ebab-ebdd-4d68-bce1-78d2a7f62992/konnectivity-agent/0.log" limit=1024 Jun 09 17:41:37.464548 ip-10-0-143-124 kubenswrapper[2552]: I0609 17:41:37.464513 2552 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-6f958f486-vmz6p"] Jun 09 17:41:37.464848 ip-10-0-143-124 kubenswrapper[2552]: I0609 17:41:37.464834 2552 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="11b1177a-c680-44da-8e8c-1e7c23ce30ac" containerName="pull" Jun 09 17:41:37.464902 ip-10-0-143-124 kubenswrapper[2552]: I0609 17:41:37.464852 2552 state_mem.go:107] "Deleted CPUSet assignment" podUID="11b1177a-c680-44da-8e8c-1e7c23ce30ac" containerName="pull" Jun 09 17:41:37.464902 ip-10-0-143-124 kubenswrapper[2552]: I0609 17:41:37.464863 2552 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="11b1177a-c680-44da-8e8c-1e7c23ce30ac" containerName="util" Jun 09 17:41:37.464902 ip-10-0-143-124 kubenswrapper[2552]: I0609 17:41:37.464869 2552 state_mem.go:107] "Deleted CPUSet assignment" podUID="11b1177a-c680-44da-8e8c-1e7c23ce30ac" containerName="util" Jun 09 17:41:37.464902 ip-10-0-143-124 kubenswrapper[2552]: I0609 17:41:37.464876 2552 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="11b1177a-c680-44da-8e8c-1e7c23ce30ac" containerName="extract" Jun 09 17:41:37.464902 ip-10-0-143-124 kubenswrapper[2552]: I0609 17:41:37.464882 2552 state_mem.go:107] "Deleted CPUSet assignment" podUID="11b1177a-c680-44da-8e8c-1e7c23ce30ac" containerName="extract" Jun 09 17:41:37.465049 ip-10-0-143-124 kubenswrapper[2552]: I0609 17:41:37.464941 2552 memory_manager.go:368] "RemoveStaleState removing state" podUID="11b1177a-c680-44da-8e8c-1e7c23ce30ac" containerName="extract" Jun 09 17:41:37.472422 ip-10-0-143-124 kubenswrapper[2552]: I0609 17:41:37.472400 2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-6f958f486-vmz6p" Jun 09 17:41:37.475133 ip-10-0-143-124 kubenswrapper[2552]: I0609 17:41:37.475102 2552 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-webhook-cert\"" Jun 09 17:41:37.475240 ip-10-0-143-124 kubenswrapper[2552]: I0609 17:41:37.475152 2552 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"openshift-service-ca.crt\"" Jun 09 17:41:37.475240 ip-10-0-143-124 kubenswrapper[2552]: I0609 17:41:37.475205 2552 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-dockercfg-fpxwt\"" Jun 09 17:41:37.475240 ip-10-0-143-124 kubenswrapper[2552]: I0609 17:41:37.475210 2552 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-service-cert\"" Jun 09 17:41:37.475451 ip-10-0-143-124 kubenswrapper[2552]: I0609 17:41:37.475436 2552 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"kube-root-ca.crt\"" Jun 09 17:41:37.476625 ip-10-0-143-124 kubenswrapper[2552]: I0609 17:41:37.476607 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jfdw2\" (UniqueName: \"kubernetes.io/projected/f91285d9-a18a-44eb-8272-c0ef9586564d-kube-api-access-jfdw2\") pod \"opendatahub-operator-controller-manager-6f958f486-vmz6p\" (UID: \"f91285d9-a18a-44eb-8272-c0ef9586564d\") " pod="opendatahub/opendatahub-operator-controller-manager-6f958f486-vmz6p" Jun 09 17:41:37.476708 ip-10-0-143-124 kubenswrapper[2552]: I0609 17:41:37.476646 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/f91285d9-a18a-44eb-8272-c0ef9586564d-manifests\") pod \"opendatahub-operator-controller-manager-6f958f486-vmz6p\" (UID: \"f91285d9-a18a-44eb-8272-c0ef9586564d\") " pod="opendatahub/opendatahub-operator-controller-manager-6f958f486-vmz6p" Jun 09 17:41:37.476708 ip-10-0-143-124 kubenswrapper[2552]: I0609 17:41:37.476693 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/f91285d9-a18a-44eb-8272-c0ef9586564d-webhook-cert\") pod \"opendatahub-operator-controller-manager-6f958f486-vmz6p\" (UID: \"f91285d9-a18a-44eb-8272-c0ef9586564d\") " pod="opendatahub/opendatahub-operator-controller-manager-6f958f486-vmz6p" Jun 09 17:41:37.476784 ip-10-0-143-124 kubenswrapper[2552]: I0609 17:41:37.476729 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/f91285d9-a18a-44eb-8272-c0ef9586564d-apiservice-cert\") pod \"opendatahub-operator-controller-manager-6f958f486-vmz6p\" (UID: \"f91285d9-a18a-44eb-8272-c0ef9586564d\") " pod="opendatahub/opendatahub-operator-controller-manager-6f958f486-vmz6p" Jun 09 17:41:37.476784 ip-10-0-143-124 kubenswrapper[2552]: I0609 17:41:37.476748 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/f91285d9-a18a-44eb-8272-c0ef9586564d-tmp\") pod \"opendatahub-operator-controller-manager-6f958f486-vmz6p\" (UID: \"f91285d9-a18a-44eb-8272-c0ef9586564d\") " pod="opendatahub/opendatahub-operator-controller-manager-6f958f486-vmz6p" Jun 09 17:41:37.486245 ip-10-0-143-124 kubenswrapper[2552]: I0609 17:41:37.486224 2552 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-6f958f486-vmz6p"] Jun 09 17:41:37.577082 ip-10-0-143-124 kubenswrapper[2552]: I0609 17:41:37.577051 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/f91285d9-a18a-44eb-8272-c0ef9586564d-apiservice-cert\") pod \"opendatahub-operator-controller-manager-6f958f486-vmz6p\" (UID: \"f91285d9-a18a-44eb-8272-c0ef9586564d\") " pod="opendatahub/opendatahub-operator-controller-manager-6f958f486-vmz6p" Jun 09 17:41:37.577082 ip-10-0-143-124 kubenswrapper[2552]: I0609 17:41:37.577087 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/f91285d9-a18a-44eb-8272-c0ef9586564d-tmp\") pod \"opendatahub-operator-controller-manager-6f958f486-vmz6p\" (UID: \"f91285d9-a18a-44eb-8272-c0ef9586564d\") " pod="opendatahub/opendatahub-operator-controller-manager-6f958f486-vmz6p" Jun 09 17:41:37.577328 ip-10-0-143-124 kubenswrapper[2552]: I0609 17:41:37.577124 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jfdw2\" (UniqueName: \"kubernetes.io/projected/f91285d9-a18a-44eb-8272-c0ef9586564d-kube-api-access-jfdw2\") pod \"opendatahub-operator-controller-manager-6f958f486-vmz6p\" (UID: \"f91285d9-a18a-44eb-8272-c0ef9586564d\") " pod="opendatahub/opendatahub-operator-controller-manager-6f958f486-vmz6p" Jun 09 17:41:37.577328 ip-10-0-143-124 kubenswrapper[2552]: I0609 17:41:37.577251 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/f91285d9-a18a-44eb-8272-c0ef9586564d-manifests\") pod \"opendatahub-operator-controller-manager-6f958f486-vmz6p\" (UID: \"f91285d9-a18a-44eb-8272-c0ef9586564d\") " pod="opendatahub/opendatahub-operator-controller-manager-6f958f486-vmz6p" Jun 09 17:41:37.577328 ip-10-0-143-124 kubenswrapper[2552]: I0609 17:41:37.577309 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/f91285d9-a18a-44eb-8272-c0ef9586564d-webhook-cert\") pod \"opendatahub-operator-controller-manager-6f958f486-vmz6p\" (UID: \"f91285d9-a18a-44eb-8272-c0ef9586564d\") " pod="opendatahub/opendatahub-operator-controller-manager-6f958f486-vmz6p" Jun 09 17:41:37.577584 ip-10-0-143-124 kubenswrapper[2552]: I0609 17:41:37.577565 2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/f91285d9-a18a-44eb-8272-c0ef9586564d-manifests\") pod \"opendatahub-operator-controller-manager-6f958f486-vmz6p\" (UID: \"f91285d9-a18a-44eb-8272-c0ef9586564d\") " pod="opendatahub/opendatahub-operator-controller-manager-6f958f486-vmz6p" Jun 09 17:41:37.579391 ip-10-0-143-124 kubenswrapper[2552]: I0609 17:41:37.579359 2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/f91285d9-a18a-44eb-8272-c0ef9586564d-tmp\") pod \"opendatahub-operator-controller-manager-6f958f486-vmz6p\" (UID: \"f91285d9-a18a-44eb-8272-c0ef9586564d\") " pod="opendatahub/opendatahub-operator-controller-manager-6f958f486-vmz6p" Jun 09 17:41:37.579555 ip-10-0-143-124 kubenswrapper[2552]: I0609 17:41:37.579535 2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/f91285d9-a18a-44eb-8272-c0ef9586564d-apiservice-cert\") pod \"opendatahub-operator-controller-manager-6f958f486-vmz6p\" (UID: \"f91285d9-a18a-44eb-8272-c0ef9586564d\") " pod="opendatahub/opendatahub-operator-controller-manager-6f958f486-vmz6p" Jun 09 17:41:37.579638 ip-10-0-143-124 kubenswrapper[2552]: I0609 17:41:37.579568 2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/f91285d9-a18a-44eb-8272-c0ef9586564d-webhook-cert\") pod \"opendatahub-operator-controller-manager-6f958f486-vmz6p\" (UID: \"f91285d9-a18a-44eb-8272-c0ef9586564d\") " pod="opendatahub/opendatahub-operator-controller-manager-6f958f486-vmz6p" Jun 09 17:41:37.595124 ip-10-0-143-124 kubenswrapper[2552]: I0609 17:41:37.595075 2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-jfdw2\" (UniqueName: \"kubernetes.io/projected/f91285d9-a18a-44eb-8272-c0ef9586564d-kube-api-access-jfdw2\") pod \"opendatahub-operator-controller-manager-6f958f486-vmz6p\" (UID: \"f91285d9-a18a-44eb-8272-c0ef9586564d\") " pod="opendatahub/opendatahub-operator-controller-manager-6f958f486-vmz6p" Jun 09 17:41:37.612055 ip-10-0-143-124 kubenswrapper[2552]: I0609 17:41:37.612026 2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gctfs_8563ebab-ebdd-4d68-bce1-78d2a7f62992/konnectivity-agent/0.log" limit=1024 Jun 09 17:41:37.712475 ip-10-0-143-124 kubenswrapper[2552]: I0609 17:41:37.712433 2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gctfs_8563ebab-ebdd-4d68-bce1-78d2a7f62992/konnectivity-agent/0.log" limit=1024 Jun 09 17:41:37.782349 ip-10-0-143-124 kubenswrapper[2552]: I0609 17:41:37.782317 2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-6f958f486-vmz6p" Jun 09 17:41:37.819455 ip-10-0-143-124 kubenswrapper[2552]: I0609 17:41:37.819397 2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gctfs_8563ebab-ebdd-4d68-bce1-78d2a7f62992/konnectivity-agent/0.log" limit=1024 Jun 09 17:41:37.922451 ip-10-0-143-124 kubenswrapper[2552]: I0609 17:41:37.922417 2552 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-6f958f486-vmz6p"] Jun 09 17:41:37.925934 ip-10-0-143-124 kubenswrapper[2552]: W0609 17:41:37.925903 2552 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf91285d9_a18a_44eb_8272_c0ef9586564d.slice/crio-8bf57df13fc0a8cfc3619dec732ef96f0aad5ef92c81056f87093deaf3fab041 WatchSource:0}: Error finding container 8bf57df13fc0a8cfc3619dec732ef96f0aad5ef92c81056f87093deaf3fab041: Status 404 returned error can't find the container with id 8bf57df13fc0a8cfc3619dec732ef96f0aad5ef92c81056f87093deaf3fab041 Jun 09 17:41:37.945160 ip-10-0-143-124 kubenswrapper[2552]: I0609 17:41:37.945133 2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gctfs_8563ebab-ebdd-4d68-bce1-78d2a7f62992/konnectivity-agent/0.log" limit=1024 Jun 09 17:41:38.044856 ip-10-0-143-124 kubenswrapper[2552]: I0609 17:41:38.044825 2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gctfs_8563ebab-ebdd-4d68-bce1-78d2a7f62992/konnectivity-agent/0.log" limit=1024 Jun 09 17:41:38.147220 ip-10-0-143-124 kubenswrapper[2552]: I0609 17:41:38.147127 2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gctfs_8563ebab-ebdd-4d68-bce1-78d2a7f62992/konnectivity-agent/0.log" limit=1024 Jun 09 17:41:38.285262 ip-10-0-143-124 kubenswrapper[2552]: I0609 17:41:38.285230 2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-6f958f486-vmz6p" event={"ID":"f91285d9-a18a-44eb-8272-c0ef9586564d","Type":"ContainerStarted","Data":"8bf57df13fc0a8cfc3619dec732ef96f0aad5ef92c81056f87093deaf3fab041"} Jun 09 17:41:41.301896 ip-10-0-143-124 kubenswrapper[2552]: I0609 17:41:41.301857 2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-6f958f486-vmz6p" event={"ID":"f91285d9-a18a-44eb-8272-c0ef9586564d","Type":"ContainerStarted","Data":"b80f5e249f3fc5cdaef9aded0267d922cd817ceaf007ddc7c0718f33aee2f9a4"} Jun 09 17:41:42.307670 ip-10-0-143-124 kubenswrapper[2552]: I0609 17:41:42.307628 2552 generic.go:356] "Generic (PLEG): container finished" podID="f91285d9-a18a-44eb-8272-c0ef9586564d" containerID="b80f5e249f3fc5cdaef9aded0267d922cd817ceaf007ddc7c0718f33aee2f9a4" exitCode=0 Jun 09 17:41:42.308055 ip-10-0-143-124 kubenswrapper[2552]: I0609 17:41:42.307720 2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-6f958f486-vmz6p" event={"ID":"f91285d9-a18a-44eb-8272-c0ef9586564d","Type":"ContainerDied","Data":"b80f5e249f3fc5cdaef9aded0267d922cd817ceaf007ddc7c0718f33aee2f9a4"} Jun 09 17:41:43.314579 ip-10-0-143-124 kubenswrapper[2552]: I0609 17:41:43.314548 2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-6f958f486-vmz6p" event={"ID":"f91285d9-a18a-44eb-8272-c0ef9586564d","Type":"ContainerStarted","Data":"e7c25210a019d2f6c5727d222b582c27d868daa1e667f498cd07fe2052e9e502"} Jun 09 17:41:43.314963 ip-10-0-143-124 kubenswrapper[2552]: I0609 17:41:43.314752 2552 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/opendatahub-operator-controller-manager-6f958f486-vmz6p" Jun 09 17:41:43.338924 ip-10-0-143-124 kubenswrapper[2552]: I0609 17:41:43.338862 2552 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/opendatahub-operator-controller-manager-6f958f486-vmz6p" podStartSLOduration=2.153488251 podStartE2EDuration="6.338843821s" totalImagesPullingTime="3.248976528s" totalInitContainerRuntime="936.379042ms" isStatefulPod=false podCreationTimestamp="2026-06-09 17:41:37 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-09 17:41:43.336476155 +0000 UTC m=+507.436378804" watchObservedRunningTime="2026-06-09 17:41:43.338843821 +0000 UTC m=+507.438746471" Jun 09 17:41:49.682145 ip-10-0-143-124 kubenswrapper[2552]: I0609 17:41:49.682107 2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gctfs_8563ebab-ebdd-4d68-bce1-78d2a7f62992/konnectivity-agent/0.log" limit=1024 Jun 09 17:41:49.782419 ip-10-0-143-124 kubenswrapper[2552]: I0609 17:41:49.782383 2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gctfs_8563ebab-ebdd-4d68-bce1-78d2a7f62992/konnectivity-agent/0.log" limit=1024 Jun 09 17:41:54.321589 ip-10-0-143-124 kubenswrapper[2552]: I0609 17:41:54.321557 2552 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/opendatahub-operator-controller-manager-6f958f486-vmz6p" Jun 09 17:41:56.121154 ip-10-0-143-124 kubenswrapper[2552]: I0609 17:41:56.121118 2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gctfs_8563ebab-ebdd-4d68-bce1-78d2a7f62992/konnectivity-agent/0.log" limit=1024 Jun 09 17:41:56.226193 ip-10-0-143-124 kubenswrapper[2552]: I0609 17:41:56.226162 2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gctfs_8563ebab-ebdd-4d68-bce1-78d2a7f62992/konnectivity-agent/0.log" limit=1024 Jun 09 17:41:56.684542 ip-10-0-143-124 kubenswrapper[2552]: I0609 17:41:56.684503 2552 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/odh-model-controller-6dc94f689f-mpvn5"] Jun 09 17:41:56.690134 ip-10-0-143-124 kubenswrapper[2552]: I0609 17:41:56.690112 2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/odh-model-controller-6dc94f689f-mpvn5" Jun 09 17:41:56.692733 ip-10-0-143-124 kubenswrapper[2552]: I0609 17:41:56.692696 2552 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"odh-model-controller-webhook-cert\"" Jun 09 17:41:56.693639 ip-10-0-143-124 kubenswrapper[2552]: I0609 17:41:56.693618 2552 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"odh-model-controller-dockercfg-dhm4d\"" Jun 09 17:41:56.698084 ip-10-0-143-124 kubenswrapper[2552]: I0609 17:41:56.698060 2552 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/odh-model-controller-6dc94f689f-mpvn5"] Jun 09 17:41:56.720887 ip-10-0-143-124 kubenswrapper[2552]: I0609 17:41:56.720857 2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gctfs_8563ebab-ebdd-4d68-bce1-78d2a7f62992/konnectivity-agent/0.log" limit=1024 Jun 09 17:41:56.727913 ip-10-0-143-124 kubenswrapper[2552]: I0609 17:41:56.727886 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/5c147dc2-9013-4b7b-8663-88517c65aed6-cert\") pod \"odh-model-controller-6dc94f689f-mpvn5\" (UID: \"5c147dc2-9013-4b7b-8663-88517c65aed6\") " pod="opendatahub/odh-model-controller-6dc94f689f-mpvn5" Jun 09 17:41:56.728014 ip-10-0-143-124 kubenswrapper[2552]: I0609 17:41:56.727948 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xqkl2\" (UniqueName: \"kubernetes.io/projected/5c147dc2-9013-4b7b-8663-88517c65aed6-kube-api-access-xqkl2\") pod \"odh-model-controller-6dc94f689f-mpvn5\" (UID: \"5c147dc2-9013-4b7b-8663-88517c65aed6\") " pod="opendatahub/odh-model-controller-6dc94f689f-mpvn5" Jun 09 17:41:56.815526 ip-10-0-143-124 kubenswrapper[2552]: I0609 17:41:56.815441 2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gctfs_8563ebab-ebdd-4d68-bce1-78d2a7f62992/konnectivity-agent/0.log" limit=1024 Jun 09 17:41:56.828996 ip-10-0-143-124 kubenswrapper[2552]: I0609 17:41:56.828963 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/5c147dc2-9013-4b7b-8663-88517c65aed6-cert\") pod \"odh-model-controller-6dc94f689f-mpvn5\" (UID: \"5c147dc2-9013-4b7b-8663-88517c65aed6\") " pod="opendatahub/odh-model-controller-6dc94f689f-mpvn5" Jun 09 17:41:56.829092 ip-10-0-143-124 kubenswrapper[2552]: I0609 17:41:56.829019 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xqkl2\" (UniqueName: \"kubernetes.io/projected/5c147dc2-9013-4b7b-8663-88517c65aed6-kube-api-access-xqkl2\") pod \"odh-model-controller-6dc94f689f-mpvn5\" (UID: \"5c147dc2-9013-4b7b-8663-88517c65aed6\") " pod="opendatahub/odh-model-controller-6dc94f689f-mpvn5" Jun 09 17:41:56.829127 ip-10-0-143-124 kubenswrapper[2552]: E0609 17:41:56.829102 2552 secret.go:189] Couldn't get secret opendatahub/odh-model-controller-webhook-cert: secret "odh-model-controller-webhook-cert" not found Jun 09 17:41:56.829181 ip-10-0-143-124 kubenswrapper[2552]: E0609 17:41:56.829170 2552 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/5c147dc2-9013-4b7b-8663-88517c65aed6-cert podName:5c147dc2-9013-4b7b-8663-88517c65aed6 nodeName:}" failed. No retries permitted until 2026-06-09 17:41:57.329154384 +0000 UTC m=+521.429057013 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/5c147dc2-9013-4b7b-8663-88517c65aed6-cert") pod "odh-model-controller-6dc94f689f-mpvn5" (UID: "5c147dc2-9013-4b7b-8663-88517c65aed6") : secret "odh-model-controller-webhook-cert" not found Jun 09 17:41:56.842209 ip-10-0-143-124 kubenswrapper[2552]: I0609 17:41:56.842185 2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-xqkl2\" (UniqueName: \"kubernetes.io/projected/5c147dc2-9013-4b7b-8663-88517c65aed6-kube-api-access-xqkl2\") pod \"odh-model-controller-6dc94f689f-mpvn5\" (UID: \"5c147dc2-9013-4b7b-8663-88517c65aed6\") " pod="opendatahub/odh-model-controller-6dc94f689f-mpvn5" Jun 09 17:41:57.069657 ip-10-0-143-124 kubenswrapper[2552]: I0609 17:41:57.069551 2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gctfs_8563ebab-ebdd-4d68-bce1-78d2a7f62992/konnectivity-agent/0.log" limit=1024 Jun 09 17:41:57.126441 ip-10-0-143-124 kubenswrapper[2552]: I0609 17:41:57.126406 2552 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/model-serving-api-5dd488fc48-hnszm"] Jun 09 17:41:57.128688 ip-10-0-143-124 kubenswrapper[2552]: I0609 17:41:57.128669 2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/model-serving-api-5dd488fc48-hnszm" Jun 09 17:41:57.131888 ip-10-0-143-124 kubenswrapper[2552]: I0609 17:41:57.131864 2552 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"model-serving-api-tls\"" Jun 09 17:41:57.131888 ip-10-0-143-124 kubenswrapper[2552]: I0609 17:41:57.131877 2552 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"model-serving-api-dockercfg-djj99\"" Jun 09 17:41:57.138949 ip-10-0-143-124 kubenswrapper[2552]: I0609 17:41:57.138928 2552 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/model-serving-api-5dd488fc48-hnszm"] Jun 09 17:41:57.231915 ip-10-0-143-124 kubenswrapper[2552]: I0609 17:41:57.231888 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/fe0acebb-1dc4-44f6-99ed-62a699d9fe1c-tls-certs\") pod \"model-serving-api-5dd488fc48-hnszm\" (UID: \"fe0acebb-1dc4-44f6-99ed-62a699d9fe1c\") " pod="opendatahub/model-serving-api-5dd488fc48-hnszm" Jun 09 17:41:57.232063 ip-10-0-143-124 kubenswrapper[2552]: I0609 17:41:57.231925 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-q8g6p\" (UniqueName: \"kubernetes.io/projected/fe0acebb-1dc4-44f6-99ed-62a699d9fe1c-kube-api-access-q8g6p\") pod \"model-serving-api-5dd488fc48-hnszm\" (UID: \"fe0acebb-1dc4-44f6-99ed-62a699d9fe1c\") " pod="opendatahub/model-serving-api-5dd488fc48-hnszm" Jun 09 17:41:57.333285 ip-10-0-143-124 kubenswrapper[2552]: I0609 17:41:57.333212 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-q8g6p\" (UniqueName: \"kubernetes.io/projected/fe0acebb-1dc4-44f6-99ed-62a699d9fe1c-kube-api-access-q8g6p\") pod \"model-serving-api-5dd488fc48-hnszm\" (UID: \"fe0acebb-1dc4-44f6-99ed-62a699d9fe1c\") " pod="opendatahub/model-serving-api-5dd488fc48-hnszm" Jun 09 17:41:57.333285 ip-10-0-143-124 kubenswrapper[2552]: I0609 17:41:57.333276 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/5c147dc2-9013-4b7b-8663-88517c65aed6-cert\") pod \"odh-model-controller-6dc94f689f-mpvn5\" (UID: \"5c147dc2-9013-4b7b-8663-88517c65aed6\") " pod="opendatahub/odh-model-controller-6dc94f689f-mpvn5" Jun 09 17:41:57.333460 ip-10-0-143-124 kubenswrapper[2552]: I0609 17:41:57.333294 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/fe0acebb-1dc4-44f6-99ed-62a699d9fe1c-tls-certs\") pod \"model-serving-api-5dd488fc48-hnszm\" (UID: \"fe0acebb-1dc4-44f6-99ed-62a699d9fe1c\") " pod="opendatahub/model-serving-api-5dd488fc48-hnszm" Jun 09 17:41:57.333460 ip-10-0-143-124 kubenswrapper[2552]: E0609 17:41:57.333390 2552 secret.go:189] Couldn't get secret opendatahub/model-serving-api-tls: secret "model-serving-api-tls" not found Jun 09 17:41:57.333460 ip-10-0-143-124 kubenswrapper[2552]: E0609 17:41:57.333406 2552 secret.go:189] Couldn't get secret opendatahub/odh-model-controller-webhook-cert: secret "odh-model-controller-webhook-cert" not found Jun 09 17:41:57.333460 ip-10-0-143-124 kubenswrapper[2552]: E0609 17:41:57.333443 2552 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/fe0acebb-1dc4-44f6-99ed-62a699d9fe1c-tls-certs podName:fe0acebb-1dc4-44f6-99ed-62a699d9fe1c nodeName:}" failed. No retries permitted until 2026-06-09 17:41:57.833427104 +0000 UTC m=+521.933329733 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "tls-certs" (UniqueName: "kubernetes.io/secret/fe0acebb-1dc4-44f6-99ed-62a699d9fe1c-tls-certs") pod "model-serving-api-5dd488fc48-hnszm" (UID: "fe0acebb-1dc4-44f6-99ed-62a699d9fe1c") : secret "model-serving-api-tls" not found Jun 09 17:41:57.333590 ip-10-0-143-124 kubenswrapper[2552]: E0609 17:41:57.333461 2552 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/5c147dc2-9013-4b7b-8663-88517c65aed6-cert podName:5c147dc2-9013-4b7b-8663-88517c65aed6 nodeName:}" failed. No retries permitted until 2026-06-09 17:41:58.33344834 +0000 UTC m=+522.433350971 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/5c147dc2-9013-4b7b-8663-88517c65aed6-cert") pod "odh-model-controller-6dc94f689f-mpvn5" (UID: "5c147dc2-9013-4b7b-8663-88517c65aed6") : secret "odh-model-controller-webhook-cert" not found Jun 09 17:41:57.341966 ip-10-0-143-124 kubenswrapper[2552]: I0609 17:41:57.341934 2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-q8g6p\" (UniqueName: \"kubernetes.io/projected/fe0acebb-1dc4-44f6-99ed-62a699d9fe1c-kube-api-access-q8g6p\") pod \"model-serving-api-5dd488fc48-hnszm\" (UID: \"fe0acebb-1dc4-44f6-99ed-62a699d9fe1c\") " pod="opendatahub/model-serving-api-5dd488fc48-hnszm" Jun 09 17:41:57.426221 ip-10-0-143-124 kubenswrapper[2552]: I0609 17:41:57.426194 2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gctfs_8563ebab-ebdd-4d68-bce1-78d2a7f62992/konnectivity-agent/0.log" limit=1024 Jun 09 17:41:57.531896 ip-10-0-143-124 kubenswrapper[2552]: I0609 17:41:57.531860 2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gctfs_8563ebab-ebdd-4d68-bce1-78d2a7f62992/konnectivity-agent/0.log" limit=1024 Jun 09 17:41:57.837733 ip-10-0-143-124 kubenswrapper[2552]: I0609 17:41:57.837694 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/fe0acebb-1dc4-44f6-99ed-62a699d9fe1c-tls-certs\") pod \"model-serving-api-5dd488fc48-hnszm\" (UID: \"fe0acebb-1dc4-44f6-99ed-62a699d9fe1c\") " pod="opendatahub/model-serving-api-5dd488fc48-hnszm" Jun 09 17:41:57.840179 ip-10-0-143-124 kubenswrapper[2552]: I0609 17:41:57.840155 2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/fe0acebb-1dc4-44f6-99ed-62a699d9fe1c-tls-certs\") pod \"model-serving-api-5dd488fc48-hnszm\" (UID: \"fe0acebb-1dc4-44f6-99ed-62a699d9fe1c\") " pod="opendatahub/model-serving-api-5dd488fc48-hnszm" Jun 09 17:41:58.039516 ip-10-0-143-124 kubenswrapper[2552]: I0609 17:41:58.039483 2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/model-serving-api-5dd488fc48-hnszm" Jun 09 17:41:58.341565 ip-10-0-143-124 kubenswrapper[2552]: I0609 17:41:58.341533 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/5c147dc2-9013-4b7b-8663-88517c65aed6-cert\") pod \"odh-model-controller-6dc94f689f-mpvn5\" (UID: \"5c147dc2-9013-4b7b-8663-88517c65aed6\") " pod="opendatahub/odh-model-controller-6dc94f689f-mpvn5" Jun 09 17:41:58.344021 ip-10-0-143-124 kubenswrapper[2552]: I0609 17:41:58.343997 2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/5c147dc2-9013-4b7b-8663-88517c65aed6-cert\") pod \"odh-model-controller-6dc94f689f-mpvn5\" (UID: \"5c147dc2-9013-4b7b-8663-88517c65aed6\") " pod="opendatahub/odh-model-controller-6dc94f689f-mpvn5" Jun 09 17:41:58.374276 ip-10-0-143-124 kubenswrapper[2552]: I0609 17:41:58.374250 2552 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/model-serving-api-5dd488fc48-hnszm"] Jun 09 17:41:58.376954 ip-10-0-143-124 kubenswrapper[2552]: W0609 17:41:58.376905 2552 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podfe0acebb_1dc4_44f6_99ed_62a699d9fe1c.slice/crio-2d2e27003c6dbe4c210090ed7e5391ba7ec49950a6bb8f5c5a1feada8a79b2f1 WatchSource:0}: Error finding container 2d2e27003c6dbe4c210090ed7e5391ba7ec49950a6bb8f5c5a1feada8a79b2f1: Status 404 returned error can't find the container with id 2d2e27003c6dbe4c210090ed7e5391ba7ec49950a6bb8f5c5a1feada8a79b2f1 Jun 09 17:41:58.502860 ip-10-0-143-124 kubenswrapper[2552]: I0609 17:41:58.502827 2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/odh-model-controller-6dc94f689f-mpvn5" Jun 09 17:41:58.632095 ip-10-0-143-124 kubenswrapper[2552]: I0609 17:41:58.631973 2552 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/odh-model-controller-6dc94f689f-mpvn5"] Jun 09 17:41:58.634140 ip-10-0-143-124 kubenswrapper[2552]: W0609 17:41:58.634113 2552 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5c147dc2_9013_4b7b_8663_88517c65aed6.slice/crio-b09115ca8f7b6ad354a0f2a89dc876816980427ac8547924dcb55fac7ff5fe9d WatchSource:0}: Error finding container b09115ca8f7b6ad354a0f2a89dc876816980427ac8547924dcb55fac7ff5fe9d: Status 404 returned error can't find the container with id b09115ca8f7b6ad354a0f2a89dc876816980427ac8547924dcb55fac7ff5fe9d Jun 09 17:41:59.388951 ip-10-0-143-124 kubenswrapper[2552]: I0609 17:41:59.388909 2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/model-serving-api-5dd488fc48-hnszm" event={"ID":"fe0acebb-1dc4-44f6-99ed-62a699d9fe1c","Type":"ContainerStarted","Data":"2d2e27003c6dbe4c210090ed7e5391ba7ec49950a6bb8f5c5a1feada8a79b2f1"} Jun 09 17:41:59.390563 ip-10-0-143-124 kubenswrapper[2552]: I0609 17:41:59.390504 2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/odh-model-controller-6dc94f689f-mpvn5" event={"ID":"5c147dc2-9013-4b7b-8663-88517c65aed6","Type":"ContainerStarted","Data":"b09115ca8f7b6ad354a0f2a89dc876816980427ac8547924dcb55fac7ff5fe9d"} Jun 09 17:42:02.405491 ip-10-0-143-124 kubenswrapper[2552]: I0609 17:42:02.405457 2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/model-serving-api-5dd488fc48-hnszm" event={"ID":"fe0acebb-1dc4-44f6-99ed-62a699d9fe1c","Type":"ContainerStarted","Data":"a24ad567e722b7f8dd9f200e2b48cb87a19b7a56062dab22596976ddcf3971b2"} Jun 09 17:42:02.405978 ip-10-0-143-124 kubenswrapper[2552]: I0609 17:42:02.405542 2552 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/model-serving-api-5dd488fc48-hnszm" Jun 09 17:42:02.407042 ip-10-0-143-124 kubenswrapper[2552]: I0609 17:42:02.407011 2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/odh-model-controller-6dc94f689f-mpvn5" event={"ID":"5c147dc2-9013-4b7b-8663-88517c65aed6","Type":"ContainerStarted","Data":"749946919c1453259494881ad5758522476c1fadc90c6680df0be984b2bb0ee6"} Jun 09 17:42:02.407158 ip-10-0-143-124 kubenswrapper[2552]: I0609 17:42:02.407149 2552 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/odh-model-controller-6dc94f689f-mpvn5" Jun 09 17:42:02.423663 ip-10-0-143-124 kubenswrapper[2552]: I0609 17:42:02.423620 2552 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/model-serving-api-5dd488fc48-hnszm" podStartSLOduration=1.6090409129999999 podStartE2EDuration="5.423589381s" totalImagesPullingTime="3.814548468s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-09 17:41:57 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-09 17:42:02.422043192 +0000 UTC m=+526.521945856" watchObservedRunningTime="2026-06-09 17:42:02.423589381 +0000 UTC m=+526.523492028" Jun 09 17:42:02.438854 ip-10-0-143-124 kubenswrapper[2552]: I0609 17:42:02.438808 2552 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/odh-model-controller-6dc94f689f-mpvn5" podStartSLOduration=2.840769265 podStartE2EDuration="6.43879491s" totalImagesPullingTime="3.598025645s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-09 17:41:56 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-09 17:42:02.437259491 +0000 UTC m=+526.537162155" watchObservedRunningTime="2026-06-09 17:42:02.43879491 +0000 UTC m=+526.538697559" Jun 09 17:42:06.032444 ip-10-0-143-124 kubenswrapper[2552]: I0609 17:42:06.032407 2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gctfs_8563ebab-ebdd-4d68-bce1-78d2a7f62992/konnectivity-agent/0.log" limit=1024 Jun 09 17:42:06.104408 ip-10-0-143-124 kubenswrapper[2552]: I0609 17:42:06.104378 2552 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/llmisvc-controller-manager-864bfd7bc9-jr926"] Jun 09 17:42:06.107833 ip-10-0-143-124 kubenswrapper[2552]: I0609 17:42:06.107807 2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/llmisvc-controller-manager-864bfd7bc9-jr926" Jun 09 17:42:06.110354 ip-10-0-143-124 kubenswrapper[2552]: I0609 17:42:06.110328 2552 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"llmisvc-webhook-server-cert\"" Jun 09 17:42:06.110860 ip-10-0-143-124 kubenswrapper[2552]: I0609 17:42:06.110837 2552 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"llmisvc-controller-manager-dockercfg-4dg8x\"" Jun 09 17:42:06.120041 ip-10-0-143-124 kubenswrapper[2552]: I0609 17:42:06.120014 2552 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/llmisvc-controller-manager-864bfd7bc9-jr926"] Jun 09 17:42:06.129969 ip-10-0-143-124 kubenswrapper[2552]: I0609 17:42:06.129946 2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gctfs_8563ebab-ebdd-4d68-bce1-78d2a7f62992/konnectivity-agent/0.log" limit=1024 Jun 09 17:42:06.214045 ip-10-0-143-124 kubenswrapper[2552]: I0609 17:42:06.214005 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-x25lq\" (UniqueName: \"kubernetes.io/projected/29a513a4-725e-400b-aa6b-459355eeb531-kube-api-access-x25lq\") pod \"llmisvc-controller-manager-864bfd7bc9-jr926\" (UID: \"29a513a4-725e-400b-aa6b-459355eeb531\") " pod="opendatahub/llmisvc-controller-manager-864bfd7bc9-jr926" Jun 09 17:42:06.214207 ip-10-0-143-124 kubenswrapper[2552]: I0609 17:42:06.214086 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/29a513a4-725e-400b-aa6b-459355eeb531-cert\") pod \"llmisvc-controller-manager-864bfd7bc9-jr926\" (UID: \"29a513a4-725e-400b-aa6b-459355eeb531\") " pod="opendatahub/llmisvc-controller-manager-864bfd7bc9-jr926" Jun 09 17:42:06.315300 ip-10-0-143-124 kubenswrapper[2552]: I0609 17:42:06.315208 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/29a513a4-725e-400b-aa6b-459355eeb531-cert\") pod \"llmisvc-controller-manager-864bfd7bc9-jr926\" (UID: \"29a513a4-725e-400b-aa6b-459355eeb531\") " pod="opendatahub/llmisvc-controller-manager-864bfd7bc9-jr926" Jun 09 17:42:06.315300 ip-10-0-143-124 kubenswrapper[2552]: I0609 17:42:06.315291 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-x25lq\" (UniqueName: \"kubernetes.io/projected/29a513a4-725e-400b-aa6b-459355eeb531-kube-api-access-x25lq\") pod \"llmisvc-controller-manager-864bfd7bc9-jr926\" (UID: \"29a513a4-725e-400b-aa6b-459355eeb531\") " pod="opendatahub/llmisvc-controller-manager-864bfd7bc9-jr926" Jun 09 17:42:06.315459 ip-10-0-143-124 kubenswrapper[2552]: E0609 17:42:06.315371 2552 secret.go:189] Couldn't get secret opendatahub/llmisvc-webhook-server-cert: secret "llmisvc-webhook-server-cert" not found Jun 09 17:42:06.315459 ip-10-0-143-124 kubenswrapper[2552]: E0609 17:42:06.315439 2552 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/29a513a4-725e-400b-aa6b-459355eeb531-cert podName:29a513a4-725e-400b-aa6b-459355eeb531 nodeName:}" failed. No retries permitted until 2026-06-09 17:42:06.815420139 +0000 UTC m=+530.915322776 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/29a513a4-725e-400b-aa6b-459355eeb531-cert") pod "llmisvc-controller-manager-864bfd7bc9-jr926" (UID: "29a513a4-725e-400b-aa6b-459355eeb531") : secret "llmisvc-webhook-server-cert" not found Jun 09 17:42:06.325664 ip-10-0-143-124 kubenswrapper[2552]: I0609 17:42:06.325636 2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-x25lq\" (UniqueName: \"kubernetes.io/projected/29a513a4-725e-400b-aa6b-459355eeb531-kube-api-access-x25lq\") pod \"llmisvc-controller-manager-864bfd7bc9-jr926\" (UID: \"29a513a4-725e-400b-aa6b-459355eeb531\") " pod="opendatahub/llmisvc-controller-manager-864bfd7bc9-jr926" Jun 09 17:42:06.513895 ip-10-0-143-124 kubenswrapper[2552]: I0609 17:42:06.513863 2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gctfs_8563ebab-ebdd-4d68-bce1-78d2a7f62992/konnectivity-agent/0.log" limit=1024 Jun 09 17:42:06.626730 ip-10-0-143-124 kubenswrapper[2552]: I0609 17:42:06.626637 2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gctfs_8563ebab-ebdd-4d68-bce1-78d2a7f62992/konnectivity-agent/0.log" limit=1024 Jun 09 17:42:06.820043 ip-10-0-143-124 kubenswrapper[2552]: I0609 17:42:06.820000 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/29a513a4-725e-400b-aa6b-459355eeb531-cert\") pod \"llmisvc-controller-manager-864bfd7bc9-jr926\" (UID: \"29a513a4-725e-400b-aa6b-459355eeb531\") " pod="opendatahub/llmisvc-controller-manager-864bfd7bc9-jr926" Jun 09 17:42:06.822376 ip-10-0-143-124 kubenswrapper[2552]: I0609 17:42:06.822345 2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/29a513a4-725e-400b-aa6b-459355eeb531-cert\") pod \"llmisvc-controller-manager-864bfd7bc9-jr926\" (UID: \"29a513a4-725e-400b-aa6b-459355eeb531\") " pod="opendatahub/llmisvc-controller-manager-864bfd7bc9-jr926" Jun 09 17:42:06.956018 ip-10-0-143-124 kubenswrapper[2552]: I0609 17:42:06.955921 2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gctfs_8563ebab-ebdd-4d68-bce1-78d2a7f62992/konnectivity-agent/0.log" limit=1024 Jun 09 17:42:07.017925 ip-10-0-143-124 kubenswrapper[2552]: I0609 17:42:07.017892 2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/llmisvc-controller-manager-864bfd7bc9-jr926" Jun 09 17:42:07.062375 ip-10-0-143-124 kubenswrapper[2552]: I0609 17:42:07.062333 2552 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/kube-auth-proxy-5b7fdf8456-ffzh6"] Jun 09 17:42:07.066078 ip-10-0-143-124 kubenswrapper[2552]: I0609 17:42:07.066054 2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/kube-auth-proxy-5b7fdf8456-ffzh6" Jun 09 17:42:07.069933 ip-10-0-143-124 kubenswrapper[2552]: I0609 17:42:07.069518 2552 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"kube-root-ca.crt\"" Jun 09 17:42:07.069933 ip-10-0-143-124 kubenswrapper[2552]: I0609 17:42:07.069641 2552 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-tls\"" Jun 09 17:42:07.069933 ip-10-0-143-124 kubenswrapper[2552]: I0609 17:42:07.069798 2552 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-service-ca.crt\"" Jun 09 17:42:07.070099 ip-10-0-143-124 kubenswrapper[2552]: I0609 17:42:07.070078 2552 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-creds\"" Jun 09 17:42:07.077708 ip-10-0-143-124 kubenswrapper[2552]: I0609 17:42:07.077634 2552 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/kube-auth-proxy-5b7fdf8456-ffzh6"] Jun 09 17:42:07.087942 ip-10-0-143-124 kubenswrapper[2552]: I0609 17:42:07.086064 2552 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-marketplace/4258531154569488b4b06856545cf53ed48b82e88ddd64b4ce22efab066vmk6"] Jun 09 17:42:07.088484 ip-10-0-143-124 kubenswrapper[2552]: I0609 17:42:07.088453 2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gctfs_8563ebab-ebdd-4d68-bce1-78d2a7f62992/konnectivity-agent/0.log" limit=1024 Jun 09 17:42:07.090107 ip-10-0-143-124 kubenswrapper[2552]: I0609 17:42:07.090084 2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/4258531154569488b4b06856545cf53ed48b82e88ddd64b4ce22efab066vmk6" Jun 09 17:42:07.092977 ip-10-0-143-124 kubenswrapper[2552]: I0609 17:42:07.092505 2552 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"kube-root-ca.crt\"" Jun 09 17:42:07.092977 ip-10-0-143-124 kubenswrapper[2552]: I0609 17:42:07.092591 2552 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"openshift-service-ca.crt\"" Jun 09 17:42:07.092977 ip-10-0-143-124 kubenswrapper[2552]: I0609 17:42:07.092657 2552 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-marketplace\"/\"default-dockercfg-xcgzg\"" Jun 09 17:42:07.106632 ip-10-0-143-124 kubenswrapper[2552]: I0609 17:42:07.106591 2552 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/4258531154569488b4b06856545cf53ed48b82e88ddd64b4ce22efab066vmk6"] Jun 09 17:42:07.167058 ip-10-0-143-124 kubenswrapper[2552]: I0609 17:42:07.167036 2552 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/llmisvc-controller-manager-864bfd7bc9-jr926"] Jun 09 17:42:07.169472 ip-10-0-143-124 kubenswrapper[2552]: W0609 17:42:07.169439 2552 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-pod29a513a4_725e_400b_aa6b_459355eeb531.slice/crio-1d7a07597ab51ae23391f97808846424ddd39dce98ca9b0d195533ad4dcc60ac WatchSource:0}: Error finding container 1d7a07597ab51ae23391f97808846424ddd39dce98ca9b0d195533ad4dcc60ac: Status 404 returned error can't find the container with id 1d7a07597ab51ae23391f97808846424ddd39dce98ca9b0d195533ad4dcc60ac Jun 09 17:42:07.222770 ip-10-0-143-124 kubenswrapper[2552]: I0609 17:42:07.222700 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/63ac4d0c-9970-4a44-bc7a-c59198751d42-bundle\") pod \"4258531154569488b4b06856545cf53ed48b82e88ddd64b4ce22efab066vmk6\" (UID: \"63ac4d0c-9970-4a44-bc7a-c59198751d42\") " pod="openshift-marketplace/4258531154569488b4b06856545cf53ed48b82e88ddd64b4ce22efab066vmk6" Jun 09 17:42:07.222770 ip-10-0-143-124 kubenswrapper[2552]: I0609 17:42:07.222739 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-cv7kr\" (UniqueName: \"kubernetes.io/projected/f7c52d7b-25dc-4686-9794-7dfaae7eed22-kube-api-access-cv7kr\") pod \"kube-auth-proxy-5b7fdf8456-ffzh6\" (UID: \"f7c52d7b-25dc-4686-9794-7dfaae7eed22\") " pod="openshift-ingress/kube-auth-proxy-5b7fdf8456-ffzh6" Jun 09 17:42:07.222770 ip-10-0-143-124 kubenswrapper[2552]: I0609 17:42:07.222763 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mzlhk\" (UniqueName: \"kubernetes.io/projected/63ac4d0c-9970-4a44-bc7a-c59198751d42-kube-api-access-mzlhk\") pod \"4258531154569488b4b06856545cf53ed48b82e88ddd64b4ce22efab066vmk6\" (UID: \"63ac4d0c-9970-4a44-bc7a-c59198751d42\") " pod="openshift-marketplace/4258531154569488b4b06856545cf53ed48b82e88ddd64b4ce22efab066vmk6" Jun 09 17:42:07.222957 ip-10-0-143-124 kubenswrapper[2552]: I0609 17:42:07.222848 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/f7c52d7b-25dc-4686-9794-7dfaae7eed22-tls-certs\") pod \"kube-auth-proxy-5b7fdf8456-ffzh6\" (UID: \"f7c52d7b-25dc-4686-9794-7dfaae7eed22\") " pod="openshift-ingress/kube-auth-proxy-5b7fdf8456-ffzh6" Jun 09 17:42:07.222957 ip-10-0-143-124 kubenswrapper[2552]: I0609 17:42:07.222887 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/f7c52d7b-25dc-4686-9794-7dfaae7eed22-tmp\") pod \"kube-auth-proxy-5b7fdf8456-ffzh6\" (UID: \"f7c52d7b-25dc-4686-9794-7dfaae7eed22\") " pod="openshift-ingress/kube-auth-proxy-5b7fdf8456-ffzh6" Jun 09 17:42:07.222957 ip-10-0-143-124 kubenswrapper[2552]: I0609 17:42:07.222919 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/63ac4d0c-9970-4a44-bc7a-c59198751d42-util\") pod \"4258531154569488b4b06856545cf53ed48b82e88ddd64b4ce22efab066vmk6\" (UID: \"63ac4d0c-9970-4a44-bc7a-c59198751d42\") " pod="openshift-marketplace/4258531154569488b4b06856545cf53ed48b82e88ddd64b4ce22efab066vmk6" Jun 09 17:42:07.245331 ip-10-0-143-124 kubenswrapper[2552]: I0609 17:42:07.245300 2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gctfs_8563ebab-ebdd-4d68-bce1-78d2a7f62992/konnectivity-agent/0.log" limit=1024 Jun 09 17:42:07.323893 ip-10-0-143-124 kubenswrapper[2552]: I0609 17:42:07.323865 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/63ac4d0c-9970-4a44-bc7a-c59198751d42-bundle\") pod \"4258531154569488b4b06856545cf53ed48b82e88ddd64b4ce22efab066vmk6\" (UID: \"63ac4d0c-9970-4a44-bc7a-c59198751d42\") " pod="openshift-marketplace/4258531154569488b4b06856545cf53ed48b82e88ddd64b4ce22efab066vmk6" Jun 09 17:42:07.324028 ip-10-0-143-124 kubenswrapper[2552]: I0609 17:42:07.323901 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-cv7kr\" (UniqueName: \"kubernetes.io/projected/f7c52d7b-25dc-4686-9794-7dfaae7eed22-kube-api-access-cv7kr\") pod \"kube-auth-proxy-5b7fdf8456-ffzh6\" (UID: \"f7c52d7b-25dc-4686-9794-7dfaae7eed22\") " pod="openshift-ingress/kube-auth-proxy-5b7fdf8456-ffzh6" Jun 09 17:42:07.324028 ip-10-0-143-124 kubenswrapper[2552]: I0609 17:42:07.323926 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mzlhk\" (UniqueName: \"kubernetes.io/projected/63ac4d0c-9970-4a44-bc7a-c59198751d42-kube-api-access-mzlhk\") pod \"4258531154569488b4b06856545cf53ed48b82e88ddd64b4ce22efab066vmk6\" (UID: \"63ac4d0c-9970-4a44-bc7a-c59198751d42\") " pod="openshift-marketplace/4258531154569488b4b06856545cf53ed48b82e88ddd64b4ce22efab066vmk6" Jun 09 17:42:07.324028 ip-10-0-143-124 kubenswrapper[2552]: I0609 17:42:07.323957 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/f7c52d7b-25dc-4686-9794-7dfaae7eed22-tls-certs\") pod \"kube-auth-proxy-5b7fdf8456-ffzh6\" (UID: \"f7c52d7b-25dc-4686-9794-7dfaae7eed22\") " pod="openshift-ingress/kube-auth-proxy-5b7fdf8456-ffzh6" Jun 09 17:42:07.324147 ip-10-0-143-124 kubenswrapper[2552]: I0609 17:42:07.324124 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/f7c52d7b-25dc-4686-9794-7dfaae7eed22-tmp\") pod \"kube-auth-proxy-5b7fdf8456-ffzh6\" (UID: \"f7c52d7b-25dc-4686-9794-7dfaae7eed22\") " pod="openshift-ingress/kube-auth-proxy-5b7fdf8456-ffzh6" Jun 09 17:42:07.324211 ip-10-0-143-124 kubenswrapper[2552]: I0609 17:42:07.324194 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/63ac4d0c-9970-4a44-bc7a-c59198751d42-util\") pod \"4258531154569488b4b06856545cf53ed48b82e88ddd64b4ce22efab066vmk6\" (UID: \"63ac4d0c-9970-4a44-bc7a-c59198751d42\") " pod="openshift-marketplace/4258531154569488b4b06856545cf53ed48b82e88ddd64b4ce22efab066vmk6" Jun 09 17:42:07.324295 ip-10-0-143-124 kubenswrapper[2552]: I0609 17:42:07.324274 2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/63ac4d0c-9970-4a44-bc7a-c59198751d42-bundle\") pod \"4258531154569488b4b06856545cf53ed48b82e88ddd64b4ce22efab066vmk6\" (UID: \"63ac4d0c-9970-4a44-bc7a-c59198751d42\") " pod="openshift-marketplace/4258531154569488b4b06856545cf53ed48b82e88ddd64b4ce22efab066vmk6" Jun 09 17:42:07.324426 ip-10-0-143-124 kubenswrapper[2552]: I0609 17:42:07.324410 2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/63ac4d0c-9970-4a44-bc7a-c59198751d42-util\") pod \"4258531154569488b4b06856545cf53ed48b82e88ddd64b4ce22efab066vmk6\" (UID: \"63ac4d0c-9970-4a44-bc7a-c59198751d42\") " pod="openshift-marketplace/4258531154569488b4b06856545cf53ed48b82e88ddd64b4ce22efab066vmk6" Jun 09 17:42:07.326217 ip-10-0-143-124 kubenswrapper[2552]: I0609 17:42:07.326194 2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/f7c52d7b-25dc-4686-9794-7dfaae7eed22-tmp\") pod \"kube-auth-proxy-5b7fdf8456-ffzh6\" (UID: \"f7c52d7b-25dc-4686-9794-7dfaae7eed22\") " pod="openshift-ingress/kube-auth-proxy-5b7fdf8456-ffzh6" Jun 09 17:42:07.326299 ip-10-0-143-124 kubenswrapper[2552]: I0609 17:42:07.326236 2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/f7c52d7b-25dc-4686-9794-7dfaae7eed22-tls-certs\") pod \"kube-auth-proxy-5b7fdf8456-ffzh6\" (UID: \"f7c52d7b-25dc-4686-9794-7dfaae7eed22\") " pod="openshift-ingress/kube-auth-proxy-5b7fdf8456-ffzh6" Jun 09 17:42:07.332873 ip-10-0-143-124 kubenswrapper[2552]: I0609 17:42:07.332848 2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-mzlhk\" (UniqueName: \"kubernetes.io/projected/63ac4d0c-9970-4a44-bc7a-c59198751d42-kube-api-access-mzlhk\") pod \"4258531154569488b4b06856545cf53ed48b82e88ddd64b4ce22efab066vmk6\" (UID: \"63ac4d0c-9970-4a44-bc7a-c59198751d42\") " pod="openshift-marketplace/4258531154569488b4b06856545cf53ed48b82e88ddd64b4ce22efab066vmk6" Jun 09 17:42:07.333275 ip-10-0-143-124 kubenswrapper[2552]: I0609 17:42:07.333258 2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-cv7kr\" (UniqueName: \"kubernetes.io/projected/f7c52d7b-25dc-4686-9794-7dfaae7eed22-kube-api-access-cv7kr\") pod \"kube-auth-proxy-5b7fdf8456-ffzh6\" (UID: \"f7c52d7b-25dc-4686-9794-7dfaae7eed22\") " pod="openshift-ingress/kube-auth-proxy-5b7fdf8456-ffzh6" Jun 09 17:42:07.336915 ip-10-0-143-124 kubenswrapper[2552]: I0609 17:42:07.336881 2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gctfs_8563ebab-ebdd-4d68-bce1-78d2a7f62992/konnectivity-agent/0.log" limit=1024 Jun 09 17:42:07.379143 ip-10-0-143-124 kubenswrapper[2552]: I0609 17:42:07.379123 2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/kube-auth-proxy-5b7fdf8456-ffzh6" Jun 09 17:42:07.401092 ip-10-0-143-124 kubenswrapper[2552]: I0609 17:42:07.401067 2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/4258531154569488b4b06856545cf53ed48b82e88ddd64b4ce22efab066vmk6" Jun 09 17:42:07.429449 ip-10-0-143-124 kubenswrapper[2552]: I0609 17:42:07.429416 2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/llmisvc-controller-manager-864bfd7bc9-jr926" event={"ID":"29a513a4-725e-400b-aa6b-459355eeb531","Type":"ContainerStarted","Data":"1d7a07597ab51ae23391f97808846424ddd39dce98ca9b0d195533ad4dcc60ac"} Jun 09 17:42:07.478271 ip-10-0-143-124 kubenswrapper[2552]: I0609 17:42:07.478165 2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gctfs_8563ebab-ebdd-4d68-bce1-78d2a7f62992/konnectivity-agent/0.log" limit=1024 Jun 09 17:42:07.538184 ip-10-0-143-124 kubenswrapper[2552]: I0609 17:42:07.538154 2552 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/kube-auth-proxy-5b7fdf8456-ffzh6"] Jun 09 17:42:07.541074 ip-10-0-143-124 kubenswrapper[2552]: W0609 17:42:07.541036 2552 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf7c52d7b_25dc_4686_9794_7dfaae7eed22.slice/crio-c70b78fad4b8b803ca43aa36c78301ffecc054477da09174bf51f7a1eb820231 WatchSource:0}: Error finding container c70b78fad4b8b803ca43aa36c78301ffecc054477da09174bf51f7a1eb820231: Status 404 returned error can't find the container with id c70b78fad4b8b803ca43aa36c78301ffecc054477da09174bf51f7a1eb820231 Jun 09 17:42:07.560281 ip-10-0-143-124 kubenswrapper[2552]: I0609 17:42:07.560260 2552 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/4258531154569488b4b06856545cf53ed48b82e88ddd64b4ce22efab066vmk6"] Jun 09 17:42:07.561652 ip-10-0-143-124 kubenswrapper[2552]: W0609 17:42:07.561627 2552 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod63ac4d0c_9970_4a44_bc7a_c59198751d42.slice/crio-ce0cea8eed8bb73b2cb11ea4b60899b69364ef1b8b5ac7cbb4f575f65a915812 WatchSource:0}: Error finding container ce0cea8eed8bb73b2cb11ea4b60899b69364ef1b8b5ac7cbb4f575f65a915812: Status 404 returned error can't find the container with id ce0cea8eed8bb73b2cb11ea4b60899b69364ef1b8b5ac7cbb4f575f65a915812 Jun 09 17:42:08.437170 ip-10-0-143-124 kubenswrapper[2552]: I0609 17:42:08.437132 2552 generic.go:356] "Generic (PLEG): container finished" podID="63ac4d0c-9970-4a44-bc7a-c59198751d42" containerID="50ca7ed5d08da3bd3b0bcd1cae463e6d99f3f42c562b64a94b5a7c84fe9705fa" exitCode=0 Jun 09 17:42:08.437633 ip-10-0-143-124 kubenswrapper[2552]: I0609 17:42:08.437229 2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/4258531154569488b4b06856545cf53ed48b82e88ddd64b4ce22efab066vmk6" event={"ID":"63ac4d0c-9970-4a44-bc7a-c59198751d42","Type":"ContainerDied","Data":"50ca7ed5d08da3bd3b0bcd1cae463e6d99f3f42c562b64a94b5a7c84fe9705fa"} Jun 09 17:42:08.437633 ip-10-0-143-124 kubenswrapper[2552]: I0609 17:42:08.437287 2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/4258531154569488b4b06856545cf53ed48b82e88ddd64b4ce22efab066vmk6" event={"ID":"63ac4d0c-9970-4a44-bc7a-c59198751d42","Type":"ContainerStarted","Data":"ce0cea8eed8bb73b2cb11ea4b60899b69364ef1b8b5ac7cbb4f575f65a915812"} Jun 09 17:42:08.439158 ip-10-0-143-124 kubenswrapper[2552]: I0609 17:42:08.439136 2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/kube-auth-proxy-5b7fdf8456-ffzh6" event={"ID":"f7c52d7b-25dc-4686-9794-7dfaae7eed22","Type":"ContainerStarted","Data":"c70b78fad4b8b803ca43aa36c78301ffecc054477da09174bf51f7a1eb820231"} Jun 09 17:42:09.447317 ip-10-0-143-124 kubenswrapper[2552]: I0609 17:42:09.447220 2552 generic.go:356] "Generic (PLEG): container finished" podID="63ac4d0c-9970-4a44-bc7a-c59198751d42" containerID="18d2cca41b520c369f14b80e923dbe42bafe5b162866bbca3d11980caf978a4e" exitCode=0 Jun 09 17:42:09.447781 ip-10-0-143-124 kubenswrapper[2552]: I0609 17:42:09.447313 2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/4258531154569488b4b06856545cf53ed48b82e88ddd64b4ce22efab066vmk6" event={"ID":"63ac4d0c-9970-4a44-bc7a-c59198751d42","Type":"ContainerDied","Data":"18d2cca41b520c369f14b80e923dbe42bafe5b162866bbca3d11980caf978a4e"} Jun 09 17:42:10.455186 ip-10-0-143-124 kubenswrapper[2552]: I0609 17:42:10.455151 2552 generic.go:356] "Generic (PLEG): container finished" podID="63ac4d0c-9970-4a44-bc7a-c59198751d42" containerID="f69a5433b1929750d028d76ddcaae6a58e6d5eb3a7cbe016f616a3bd93a75e60" exitCode=0 Jun 09 17:42:10.455622 ip-10-0-143-124 kubenswrapper[2552]: I0609 17:42:10.455202 2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/4258531154569488b4b06856545cf53ed48b82e88ddd64b4ce22efab066vmk6" event={"ID":"63ac4d0c-9970-4a44-bc7a-c59198751d42","Type":"ContainerDied","Data":"f69a5433b1929750d028d76ddcaae6a58e6d5eb3a7cbe016f616a3bd93a75e60"} Jun 09 17:42:11.460977 ip-10-0-143-124 kubenswrapper[2552]: I0609 17:42:11.460935 2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/kube-auth-proxy-5b7fdf8456-ffzh6" event={"ID":"f7c52d7b-25dc-4686-9794-7dfaae7eed22","Type":"ContainerStarted","Data":"a11e787566c38a0a9d383c3c60d0622cf560c257b110db0a942a86315dd683f8"} Jun 09 17:42:11.462468 ip-10-0-143-124 kubenswrapper[2552]: I0609 17:42:11.462440 2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/llmisvc-controller-manager-864bfd7bc9-jr926" event={"ID":"29a513a4-725e-400b-aa6b-459355eeb531","Type":"ContainerStarted","Data":"163b4be4af1cb6324a4c63d0cc05b6e3d61e3daacfd2d4b3b0356c3bffeb65d3"} Jun 09 17:42:11.462634 ip-10-0-143-124 kubenswrapper[2552]: I0609 17:42:11.462616 2552 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/llmisvc-controller-manager-864bfd7bc9-jr926" Jun 09 17:42:11.478875 ip-10-0-143-124 kubenswrapper[2552]: I0609 17:42:11.478817 2552 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/kube-auth-proxy-5b7fdf8456-ffzh6" podStartSLOduration=1.043886828 podStartE2EDuration="4.478795828s" totalImagesPullingTime="3.434909s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-09 17:42:07 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-09 17:42:11.476830375 +0000 UTC m=+535.576733026" watchObservedRunningTime="2026-06-09 17:42:11.478795828 +0000 UTC m=+535.578698478" Jun 09 17:42:11.495405 ip-10-0-143-124 kubenswrapper[2552]: I0609 17:42:11.494558 2552 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/llmisvc-controller-manager-864bfd7bc9-jr926" podStartSLOduration=1.685266338 podStartE2EDuration="5.494537364s" totalImagesPullingTime="3.809271026s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-09 17:42:06 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-09 17:42:11.492141571 +0000 UTC m=+535.592044223" watchObservedRunningTime="2026-06-09 17:42:11.494537364 +0000 UTC m=+535.594440014" Jun 09 17:42:11.602669 ip-10-0-143-124 kubenswrapper[2552]: I0609 17:42:11.602646 2552 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/4258531154569488b4b06856545cf53ed48b82e88ddd64b4ce22efab066vmk6" Jun 09 17:42:11.757426 ip-10-0-143-124 kubenswrapper[2552]: I0609 17:42:11.757395 2552 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/63ac4d0c-9970-4a44-bc7a-c59198751d42-bundle\") pod \"63ac4d0c-9970-4a44-bc7a-c59198751d42\" (UID: \"63ac4d0c-9970-4a44-bc7a-c59198751d42\") " Jun 09 17:42:11.757587 ip-10-0-143-124 kubenswrapper[2552]: I0609 17:42:11.757435 2552 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-mzlhk\" (UniqueName: \"kubernetes.io/projected/63ac4d0c-9970-4a44-bc7a-c59198751d42-kube-api-access-mzlhk\") pod \"63ac4d0c-9970-4a44-bc7a-c59198751d42\" (UID: \"63ac4d0c-9970-4a44-bc7a-c59198751d42\") " Jun 09 17:42:11.757587 ip-10-0-143-124 kubenswrapper[2552]: I0609 17:42:11.757490 2552 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/63ac4d0c-9970-4a44-bc7a-c59198751d42-util\") pod \"63ac4d0c-9970-4a44-bc7a-c59198751d42\" (UID: \"63ac4d0c-9970-4a44-bc7a-c59198751d42\") " Jun 09 17:42:11.758271 ip-10-0-143-124 kubenswrapper[2552]: I0609 17:42:11.758246 2552 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/63ac4d0c-9970-4a44-bc7a-c59198751d42-bundle" (OuterVolumeSpecName: "bundle") pod "63ac4d0c-9970-4a44-bc7a-c59198751d42" (UID: "63ac4d0c-9970-4a44-bc7a-c59198751d42"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 09 17:42:11.759575 ip-10-0-143-124 kubenswrapper[2552]: I0609 17:42:11.759544 2552 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/63ac4d0c-9970-4a44-bc7a-c59198751d42-kube-api-access-mzlhk" (OuterVolumeSpecName: "kube-api-access-mzlhk") pod "63ac4d0c-9970-4a44-bc7a-c59198751d42" (UID: "63ac4d0c-9970-4a44-bc7a-c59198751d42"). InnerVolumeSpecName "kube-api-access-mzlhk". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 09 17:42:11.763158 ip-10-0-143-124 kubenswrapper[2552]: I0609 17:42:11.763121 2552 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/63ac4d0c-9970-4a44-bc7a-c59198751d42-util" (OuterVolumeSpecName: "util") pod "63ac4d0c-9970-4a44-bc7a-c59198751d42" (UID: "63ac4d0c-9970-4a44-bc7a-c59198751d42"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 09 17:42:11.858721 ip-10-0-143-124 kubenswrapper[2552]: I0609 17:42:11.858688 2552 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/63ac4d0c-9970-4a44-bc7a-c59198751d42-util\") on node \"ip-10-0-143-124.ec2.internal\" DevicePath \"\"" Jun 09 17:42:11.858721 ip-10-0-143-124 kubenswrapper[2552]: I0609 17:42:11.858716 2552 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/63ac4d0c-9970-4a44-bc7a-c59198751d42-bundle\") on node \"ip-10-0-143-124.ec2.internal\" DevicePath \"\"" Jun 09 17:42:11.858721 ip-10-0-143-124 kubenswrapper[2552]: I0609 17:42:11.858726 2552 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-mzlhk\" (UniqueName: \"kubernetes.io/projected/63ac4d0c-9970-4a44-bc7a-c59198751d42-kube-api-access-mzlhk\") on node \"ip-10-0-143-124.ec2.internal\" DevicePath \"\"" Jun 09 17:42:12.468826 ip-10-0-143-124 kubenswrapper[2552]: I0609 17:42:12.468791 2552 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/4258531154569488b4b06856545cf53ed48b82e88ddd64b4ce22efab066vmk6" Jun 09 17:42:12.468826 ip-10-0-143-124 kubenswrapper[2552]: I0609 17:42:12.468822 2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/4258531154569488b4b06856545cf53ed48b82e88ddd64b4ce22efab066vmk6" event={"ID":"63ac4d0c-9970-4a44-bc7a-c59198751d42","Type":"ContainerDied","Data":"ce0cea8eed8bb73b2cb11ea4b60899b69364ef1b8b5ac7cbb4f575f65a915812"} Jun 09 17:42:12.469268 ip-10-0-143-124 kubenswrapper[2552]: I0609 17:42:12.468863 2552 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="ce0cea8eed8bb73b2cb11ea4b60899b69364ef1b8b5ac7cbb4f575f65a915812" Jun 09 17:42:13.414395 ip-10-0-143-124 kubenswrapper[2552]: I0609 17:42:13.414361 2552 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/odh-model-controller-6dc94f689f-mpvn5" Jun 09 17:42:13.416032 ip-10-0-143-124 kubenswrapper[2552]: I0609 17:42:13.416014 2552 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/model-serving-api-5dd488fc48-hnszm" Jun 09 17:42:19.892845 ip-10-0-143-124 kubenswrapper[2552]: I0609 17:42:19.892806 2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gctfs_8563ebab-ebdd-4d68-bce1-78d2a7f62992/konnectivity-agent/0.log" limit=1024 Jun 09 17:42:20.018447 ip-10-0-143-124 kubenswrapper[2552]: I0609 17:42:20.018410 2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gctfs_8563ebab-ebdd-4d68-bce1-78d2a7f62992/konnectivity-agent/0.log" limit=1024 Jun 09 17:42:21.024861 ip-10-0-143-124 kubenswrapper[2552]: I0609 17:42:21.024822 2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gctfs_8563ebab-ebdd-4d68-bce1-78d2a7f62992/konnectivity-agent/0.log" limit=1024 Jun 09 17:42:21.142390 ip-10-0-143-124 kubenswrapper[2552]: I0609 17:42:21.142361 2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gctfs_8563ebab-ebdd-4d68-bce1-78d2a7f62992/konnectivity-agent/0.log" limit=1024 Jun 09 17:42:21.334415 ip-10-0-143-124 kubenswrapper[2552]: I0609 17:42:21.334335 2552 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762amhczh"] Jun 09 17:42:21.334660 ip-10-0-143-124 kubenswrapper[2552]: I0609 17:42:21.334648 2552 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="63ac4d0c-9970-4a44-bc7a-c59198751d42" containerName="util" Jun 09 17:42:21.334711 ip-10-0-143-124 kubenswrapper[2552]: I0609 17:42:21.334662 2552 state_mem.go:107] "Deleted CPUSet assignment" podUID="63ac4d0c-9970-4a44-bc7a-c59198751d42" containerName="util" Jun 09 17:42:21.334711 ip-10-0-143-124 kubenswrapper[2552]: I0609 17:42:21.334672 2552 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="63ac4d0c-9970-4a44-bc7a-c59198751d42" containerName="pull" Jun 09 17:42:21.334711 ip-10-0-143-124 kubenswrapper[2552]: I0609 17:42:21.334678 2552 state_mem.go:107] "Deleted CPUSet assignment" podUID="63ac4d0c-9970-4a44-bc7a-c59198751d42" containerName="pull" Jun 09 17:42:21.334711 ip-10-0-143-124 kubenswrapper[2552]: I0609 17:42:21.334701 2552 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="63ac4d0c-9970-4a44-bc7a-c59198751d42" containerName="extract" Jun 09 17:42:21.334711 ip-10-0-143-124 kubenswrapper[2552]: I0609 17:42:21.334707 2552 state_mem.go:107] "Deleted CPUSet assignment" podUID="63ac4d0c-9970-4a44-bc7a-c59198751d42" containerName="extract" Jun 09 17:42:21.334861 ip-10-0-143-124 kubenswrapper[2552]: I0609 17:42:21.334760 2552 memory_manager.go:368] "RemoveStaleState removing state" podUID="63ac4d0c-9970-4a44-bc7a-c59198751d42" containerName="extract" Jun 09 17:42:21.341049 ip-10-0-143-124 kubenswrapper[2552]: I0609 17:42:21.341031 2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762amhczh" Jun 09 17:42:21.343908 ip-10-0-143-124 kubenswrapper[2552]: I0609 17:42:21.343889 2552 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"openshift-service-ca.crt\"" Jun 09 17:42:21.344120 ip-10-0-143-124 kubenswrapper[2552]: I0609 17:42:21.344107 2552 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-marketplace\"/\"default-dockercfg-xcgzg\"" Jun 09 17:42:21.345007 ip-10-0-143-124 kubenswrapper[2552]: I0609 17:42:21.344993 2552 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"kube-root-ca.crt\"" Jun 09 17:42:21.350791 ip-10-0-143-124 kubenswrapper[2552]: I0609 17:42:21.350768 2552 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762amhczh"] Jun 09 17:42:21.438067 ip-10-0-143-124 kubenswrapper[2552]: I0609 17:42:21.438029 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xz4js\" (UniqueName: \"kubernetes.io/projected/41709049-f258-405f-a492-86963a0219ed-kube-api-access-xz4js\") pod \"c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762amhczh\" (UID: \"41709049-f258-405f-a492-86963a0219ed\") " pod="openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762amhczh" Jun 09 17:42:21.438256 ip-10-0-143-124 kubenswrapper[2552]: I0609 17:42:21.438089 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/41709049-f258-405f-a492-86963a0219ed-util\") pod \"c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762amhczh\" (UID: \"41709049-f258-405f-a492-86963a0219ed\") " pod="openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762amhczh" Jun 09 17:42:21.438256 ip-10-0-143-124 kubenswrapper[2552]: I0609 17:42:21.438132 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/41709049-f258-405f-a492-86963a0219ed-bundle\") pod \"c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762amhczh\" (UID: \"41709049-f258-405f-a492-86963a0219ed\") " pod="openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762amhczh" Jun 09 17:42:21.539197 ip-10-0-143-124 kubenswrapper[2552]: I0609 17:42:21.539161 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/41709049-f258-405f-a492-86963a0219ed-bundle\") pod \"c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762amhczh\" (UID: \"41709049-f258-405f-a492-86963a0219ed\") " pod="openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762amhczh" Jun 09 17:42:21.539379 ip-10-0-143-124 kubenswrapper[2552]: I0609 17:42:21.539258 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xz4js\" (UniqueName: \"kubernetes.io/projected/41709049-f258-405f-a492-86963a0219ed-kube-api-access-xz4js\") pod \"c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762amhczh\" (UID: \"41709049-f258-405f-a492-86963a0219ed\") " pod="openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762amhczh" Jun 09 17:42:21.539379 ip-10-0-143-124 kubenswrapper[2552]: I0609 17:42:21.539304 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/41709049-f258-405f-a492-86963a0219ed-util\") pod \"c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762amhczh\" (UID: \"41709049-f258-405f-a492-86963a0219ed\") " pod="openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762amhczh" Jun 09 17:42:21.539632 ip-10-0-143-124 kubenswrapper[2552]: I0609 17:42:21.539590 2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/41709049-f258-405f-a492-86963a0219ed-bundle\") pod \"c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762amhczh\" (UID: \"41709049-f258-405f-a492-86963a0219ed\") " pod="openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762amhczh" Jun 09 17:42:21.539748 ip-10-0-143-124 kubenswrapper[2552]: I0609 17:42:21.539721 2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/41709049-f258-405f-a492-86963a0219ed-util\") pod \"c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762amhczh\" (UID: \"41709049-f258-405f-a492-86963a0219ed\") " pod="openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762amhczh" Jun 09 17:42:21.548697 ip-10-0-143-124 kubenswrapper[2552]: I0609 17:42:21.548677 2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-xz4js\" (UniqueName: \"kubernetes.io/projected/41709049-f258-405f-a492-86963a0219ed-kube-api-access-xz4js\") pod \"c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762amhczh\" (UID: \"41709049-f258-405f-a492-86963a0219ed\") " pod="openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762amhczh" Jun 09 17:42:21.650883 ip-10-0-143-124 kubenswrapper[2552]: I0609 17:42:21.650806 2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762amhczh" Jun 09 17:42:21.780155 ip-10-0-143-124 kubenswrapper[2552]: I0609 17:42:21.780124 2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gctfs_8563ebab-ebdd-4d68-bce1-78d2a7f62992/konnectivity-agent/0.log" limit=1024 Jun 09 17:42:21.795827 ip-10-0-143-124 kubenswrapper[2552]: I0609 17:42:21.795806 2552 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762amhczh"] Jun 09 17:42:21.797533 ip-10-0-143-124 kubenswrapper[2552]: W0609 17:42:21.797509 2552 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod41709049_f258_405f_a492_86963a0219ed.slice/crio-3331db86ba8f5f42a8b6ebb6f1b9c7382ba1288d207aff868e71328f52519dcc WatchSource:0}: Error finding container 3331db86ba8f5f42a8b6ebb6f1b9c7382ba1288d207aff868e71328f52519dcc: Status 404 returned error can't find the container with id 3331db86ba8f5f42a8b6ebb6f1b9c7382ba1288d207aff868e71328f52519dcc Jun 09 17:42:21.873970 ip-10-0-143-124 kubenswrapper[2552]: I0609 17:42:21.873939 2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gctfs_8563ebab-ebdd-4d68-bce1-78d2a7f62992/konnectivity-agent/0.log" limit=1024 Jun 09 17:42:22.403969 ip-10-0-143-124 kubenswrapper[2552]: I0609 17:42:22.403928 2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gctfs_8563ebab-ebdd-4d68-bce1-78d2a7f62992/konnectivity-agent/0.log" limit=1024 Jun 09 17:42:22.481587 ip-10-0-143-124 kubenswrapper[2552]: I0609 17:42:22.481554 2552 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-operators/servicemesh-operator3-57f65f65fb-qmxdg"] Jun 09 17:42:22.483689 ip-10-0-143-124 kubenswrapper[2552]: I0609 17:42:22.483674 2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-operators/servicemesh-operator3-57f65f65fb-qmxdg" Jun 09 17:42:22.486453 ip-10-0-143-124 kubenswrapper[2552]: I0609 17:42:22.486433 2552 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-operators\"/\"servicemesh-operator3-dockercfg-wbphp\"" Jun 09 17:42:22.486579 ip-10-0-143-124 kubenswrapper[2552]: I0609 17:42:22.486460 2552 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-operators\"/\"openshift-service-ca.crt\"" Jun 09 17:42:22.486689 ip-10-0-143-124 kubenswrapper[2552]: I0609 17:42:22.486676 2552 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-operators\"/\"kube-root-ca.crt\"" Jun 09 17:42:22.508156 ip-10-0-143-124 kubenswrapper[2552]: I0609 17:42:22.508118 2552 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-operators/servicemesh-operator3-57f65f65fb-qmxdg"] Jun 09 17:42:22.515063 ip-10-0-143-124 kubenswrapper[2552]: I0609 17:42:22.515037 2552 generic.go:356] "Generic (PLEG): container finished" podID="41709049-f258-405f-a492-86963a0219ed" containerID="ebe220d82552d1b266cb44d0ff3e07f452ee8457c007c0418579236dcdb35d27" exitCode=0 Jun 09 17:42:22.515209 ip-10-0-143-124 kubenswrapper[2552]: I0609 17:42:22.515106 2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762amhczh" event={"ID":"41709049-f258-405f-a492-86963a0219ed","Type":"ContainerDied","Data":"ebe220d82552d1b266cb44d0ff3e07f452ee8457c007c0418579236dcdb35d27"} Jun 09 17:42:22.515209 ip-10-0-143-124 kubenswrapper[2552]: I0609 17:42:22.515152 2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762amhczh" event={"ID":"41709049-f258-405f-a492-86963a0219ed","Type":"ContainerStarted","Data":"3331db86ba8f5f42a8b6ebb6f1b9c7382ba1288d207aff868e71328f52519dcc"} Jun 09 17:42:22.648944 ip-10-0-143-124 kubenswrapper[2552]: I0609 17:42:22.648907 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"operator-config\" (UniqueName: \"kubernetes.io/downward-api/4e96ecf7-6f96-4a40-884c-31b5046520fb-operator-config\") pod \"servicemesh-operator3-57f65f65fb-qmxdg\" (UID: \"4e96ecf7-6f96-4a40-884c-31b5046520fb\") " pod="openshift-operators/servicemesh-operator3-57f65f65fb-qmxdg" Jun 09 17:42:22.649122 ip-10-0-143-124 kubenswrapper[2552]: I0609 17:42:22.648974 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-lhq8b\" (UniqueName: \"kubernetes.io/projected/4e96ecf7-6f96-4a40-884c-31b5046520fb-kube-api-access-lhq8b\") pod \"servicemesh-operator3-57f65f65fb-qmxdg\" (UID: \"4e96ecf7-6f96-4a40-884c-31b5046520fb\") " pod="openshift-operators/servicemesh-operator3-57f65f65fb-qmxdg" Jun 09 17:42:22.749845 ip-10-0-143-124 kubenswrapper[2552]: I0609 17:42:22.749815 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-lhq8b\" (UniqueName: \"kubernetes.io/projected/4e96ecf7-6f96-4a40-884c-31b5046520fb-kube-api-access-lhq8b\") pod \"servicemesh-operator3-57f65f65fb-qmxdg\" (UID: \"4e96ecf7-6f96-4a40-884c-31b5046520fb\") " pod="openshift-operators/servicemesh-operator3-57f65f65fb-qmxdg" Jun 09 17:42:22.750010 ip-10-0-143-124 kubenswrapper[2552]: I0609 17:42:22.749902 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"operator-config\" (UniqueName: \"kubernetes.io/downward-api/4e96ecf7-6f96-4a40-884c-31b5046520fb-operator-config\") pod \"servicemesh-operator3-57f65f65fb-qmxdg\" (UID: \"4e96ecf7-6f96-4a40-884c-31b5046520fb\") " pod="openshift-operators/servicemesh-operator3-57f65f65fb-qmxdg" Jun 09 17:42:22.752397 ip-10-0-143-124 kubenswrapper[2552]: I0609 17:42:22.752373 2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"operator-config\" (UniqueName: \"kubernetes.io/downward-api/4e96ecf7-6f96-4a40-884c-31b5046520fb-operator-config\") pod \"servicemesh-operator3-57f65f65fb-qmxdg\" (UID: \"4e96ecf7-6f96-4a40-884c-31b5046520fb\") " pod="openshift-operators/servicemesh-operator3-57f65f65fb-qmxdg" Jun 09 17:42:22.759269 ip-10-0-143-124 kubenswrapper[2552]: I0609 17:42:22.759249 2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-lhq8b\" (UniqueName: \"kubernetes.io/projected/4e96ecf7-6f96-4a40-884c-31b5046520fb-kube-api-access-lhq8b\") pod \"servicemesh-operator3-57f65f65fb-qmxdg\" (UID: \"4e96ecf7-6f96-4a40-884c-31b5046520fb\") " pod="openshift-operators/servicemesh-operator3-57f65f65fb-qmxdg" Jun 09 17:42:22.793232 ip-10-0-143-124 kubenswrapper[2552]: I0609 17:42:22.793205 2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-operators/servicemesh-operator3-57f65f65fb-qmxdg" Jun 09 17:42:22.956504 ip-10-0-143-124 kubenswrapper[2552]: I0609 17:42:22.956437 2552 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-operators/servicemesh-operator3-57f65f65fb-qmxdg"] Jun 09 17:42:22.958576 ip-10-0-143-124 kubenswrapper[2552]: W0609 17:42:22.958547 2552 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4e96ecf7_6f96_4a40_884c_31b5046520fb.slice/crio-309cf55d585e1fa172e7b7fa0c1e259bcfceee78b5cfeffece5d5ef20e8f4b42 WatchSource:0}: Error finding container 309cf55d585e1fa172e7b7fa0c1e259bcfceee78b5cfeffece5d5ef20e8f4b42: Status 404 returned error can't find the container with id 309cf55d585e1fa172e7b7fa0c1e259bcfceee78b5cfeffece5d5ef20e8f4b42 Jun 09 17:42:23.522213 ip-10-0-143-124 kubenswrapper[2552]: I0609 17:42:23.522174 2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-operators/servicemesh-operator3-57f65f65fb-qmxdg" event={"ID":"4e96ecf7-6f96-4a40-884c-31b5046520fb","Type":"ContainerStarted","Data":"309cf55d585e1fa172e7b7fa0c1e259bcfceee78b5cfeffece5d5ef20e8f4b42"} Jun 09 17:42:23.594080 ip-10-0-143-124 kubenswrapper[2552]: I0609 17:42:23.594043 2552 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/dashboard-redirect-54fb48c7f6-mffj8"] Jun 09 17:42:23.597567 ip-10-0-143-124 kubenswrapper[2552]: I0609 17:42:23.597543 2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/dashboard-redirect-54fb48c7f6-mffj8" Jun 09 17:42:23.601410 ip-10-0-143-124 kubenswrapper[2552]: I0609 17:42:23.601223 2552 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"default-dockercfg-d9hld\"" Jun 09 17:42:23.601410 ip-10-0-143-124 kubenswrapper[2552]: I0609 17:42:23.601323 2552 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"dashboard-redirect-config\"" Jun 09 17:42:23.612225 ip-10-0-143-124 kubenswrapper[2552]: I0609 17:42:23.611791 2552 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/dashboard-redirect-54fb48c7f6-mffj8"] Jun 09 17:42:23.666217 ip-10-0-143-124 kubenswrapper[2552]: I0609 17:42:23.666173 2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gctfs_8563ebab-ebdd-4d68-bce1-78d2a7f62992/konnectivity-agent/0.log" limit=1024 Jun 09 17:42:23.759861 ip-10-0-143-124 kubenswrapper[2552]: I0609 17:42:23.759825 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-znh7j\" (UniqueName: \"kubernetes.io/projected/0e04dbaf-ff38-4ccd-9d38-22cebb02badb-kube-api-access-znh7j\") pod \"dashboard-redirect-54fb48c7f6-mffj8\" (UID: \"0e04dbaf-ff38-4ccd-9d38-22cebb02badb\") " pod="opendatahub/dashboard-redirect-54fb48c7f6-mffj8" Jun 09 17:42:23.760041 ip-10-0-143-124 kubenswrapper[2552]: I0609 17:42:23.759956 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"redirect-config\" (UniqueName: \"kubernetes.io/configmap/0e04dbaf-ff38-4ccd-9d38-22cebb02badb-redirect-config\") pod \"dashboard-redirect-54fb48c7f6-mffj8\" (UID: \"0e04dbaf-ff38-4ccd-9d38-22cebb02badb\") " pod="opendatahub/dashboard-redirect-54fb48c7f6-mffj8" Jun 09 17:42:23.861125 ip-10-0-143-124 kubenswrapper[2552]: I0609 17:42:23.861037 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"redirect-config\" (UniqueName: \"kubernetes.io/configmap/0e04dbaf-ff38-4ccd-9d38-22cebb02badb-redirect-config\") pod \"dashboard-redirect-54fb48c7f6-mffj8\" (UID: \"0e04dbaf-ff38-4ccd-9d38-22cebb02badb\") " pod="opendatahub/dashboard-redirect-54fb48c7f6-mffj8" Jun 09 17:42:23.861289 ip-10-0-143-124 kubenswrapper[2552]: I0609 17:42:23.861146 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-znh7j\" (UniqueName: \"kubernetes.io/projected/0e04dbaf-ff38-4ccd-9d38-22cebb02badb-kube-api-access-znh7j\") pod \"dashboard-redirect-54fb48c7f6-mffj8\" (UID: \"0e04dbaf-ff38-4ccd-9d38-22cebb02badb\") " pod="opendatahub/dashboard-redirect-54fb48c7f6-mffj8" Jun 09 17:42:23.861974 ip-10-0-143-124 kubenswrapper[2552]: I0609 17:42:23.861937 2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"redirect-config\" (UniqueName: \"kubernetes.io/configmap/0e04dbaf-ff38-4ccd-9d38-22cebb02badb-redirect-config\") pod \"dashboard-redirect-54fb48c7f6-mffj8\" (UID: \"0e04dbaf-ff38-4ccd-9d38-22cebb02badb\") " pod="opendatahub/dashboard-redirect-54fb48c7f6-mffj8" Jun 09 17:42:23.874384 ip-10-0-143-124 kubenswrapper[2552]: I0609 17:42:23.874357 2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-znh7j\" (UniqueName: \"kubernetes.io/projected/0e04dbaf-ff38-4ccd-9d38-22cebb02badb-kube-api-access-znh7j\") pod \"dashboard-redirect-54fb48c7f6-mffj8\" (UID: \"0e04dbaf-ff38-4ccd-9d38-22cebb02badb\") " pod="opendatahub/dashboard-redirect-54fb48c7f6-mffj8" Jun 09 17:42:23.913367 ip-10-0-143-124 kubenswrapper[2552]: I0609 17:42:23.913336 2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/dashboard-redirect-54fb48c7f6-mffj8" Jun 09 17:42:24.081336 ip-10-0-143-124 kubenswrapper[2552]: I0609 17:42:24.081309 2552 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/dashboard-redirect-54fb48c7f6-mffj8"] Jun 09 17:42:24.082937 ip-10-0-143-124 kubenswrapper[2552]: W0609 17:42:24.082914 2552 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0e04dbaf_ff38_4ccd_9d38_22cebb02badb.slice/crio-df06baf29201163a1230081b590016b456b23a14f8308eeca25730705e3ae372 WatchSource:0}: Error finding container df06baf29201163a1230081b590016b456b23a14f8308eeca25730705e3ae372: Status 404 returned error can't find the container with id df06baf29201163a1230081b590016b456b23a14f8308eeca25730705e3ae372 Jun 09 17:42:24.528231 ip-10-0-143-124 kubenswrapper[2552]: I0609 17:42:24.528188 2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/dashboard-redirect-54fb48c7f6-mffj8" event={"ID":"0e04dbaf-ff38-4ccd-9d38-22cebb02badb","Type":"ContainerStarted","Data":"df06baf29201163a1230081b590016b456b23a14f8308eeca25730705e3ae372"} Jun 09 17:42:25.538347 ip-10-0-143-124 kubenswrapper[2552]: I0609 17:42:25.538304 2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-operators/servicemesh-operator3-57f65f65fb-qmxdg" event={"ID":"4e96ecf7-6f96-4a40-884c-31b5046520fb","Type":"ContainerStarted","Data":"bd109d4d23a5ba9d8e4dc82e51d781162e151c9dad8a6f142b23c0beb3abc416"} Jun 09 17:42:25.538842 ip-10-0-143-124 kubenswrapper[2552]: I0609 17:42:25.538478 2552 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-operators/servicemesh-operator3-57f65f65fb-qmxdg" Jun 09 17:42:25.564190 ip-10-0-143-124 kubenswrapper[2552]: I0609 17:42:25.564078 2552 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-operators/servicemesh-operator3-57f65f65fb-qmxdg" podStartSLOduration=1.347548027 podStartE2EDuration="3.564059755s" totalImagesPullingTime="2.216511728s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-09 17:42:22 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-09 17:42:25.562149221 +0000 UTC m=+549.662051874" watchObservedRunningTime="2026-06-09 17:42:25.564059755 +0000 UTC m=+549.663962404" Jun 09 17:42:27.549374 ip-10-0-143-124 kubenswrapper[2552]: I0609 17:42:27.549335 2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/dashboard-redirect-54fb48c7f6-mffj8" event={"ID":"0e04dbaf-ff38-4ccd-9d38-22cebb02badb","Type":"ContainerStarted","Data":"2627f5a78dbe118994fe35517c71020286a309e3c1e9d04bf732ab7e69e16591"} Jun 09 17:42:27.566053 ip-10-0-143-124 kubenswrapper[2552]: I0609 17:42:27.566000 2552 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/dashboard-redirect-54fb48c7f6-mffj8" podStartSLOduration=2.071574926 podStartE2EDuration="4.565985183s" totalImagesPullingTime="2.494410257s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-09 17:42:23 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-09 17:42:27.565001673 +0000 UTC m=+551.664904327" watchObservedRunningTime="2026-06-09 17:42:27.565985183 +0000 UTC m=+551.665887871" Jun 09 17:42:31.570229 ip-10-0-143-124 kubenswrapper[2552]: I0609 17:42:31.570187 2552 generic.go:356] "Generic (PLEG): container finished" podID="41709049-f258-405f-a492-86963a0219ed" containerID="b53628bcdc67b8ff4e45cff739aa3de57ee3f6de7369320c984e64f0580ee65a" exitCode=0 Jun 09 17:42:31.570643 ip-10-0-143-124 kubenswrapper[2552]: I0609 17:42:31.570266 2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762amhczh" event={"ID":"41709049-f258-405f-a492-86963a0219ed","Type":"ContainerDied","Data":"b53628bcdc67b8ff4e45cff739aa3de57ee3f6de7369320c984e64f0580ee65a"} Jun 09 17:42:32.171465 ip-10-0-143-124 kubenswrapper[2552]: I0609 17:42:32.171432 2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gctfs_8563ebab-ebdd-4d68-bce1-78d2a7f62992/konnectivity-agent/0.log" limit=1024 Jun 09 17:42:32.285073 ip-10-0-143-124 kubenswrapper[2552]: I0609 17:42:32.285039 2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gctfs_8563ebab-ebdd-4d68-bce1-78d2a7f62992/konnectivity-agent/0.log" limit=1024 Jun 09 17:42:32.576651 ip-10-0-143-124 kubenswrapper[2552]: I0609 17:42:32.576615 2552 generic.go:356] "Generic (PLEG): container finished" podID="41709049-f258-405f-a492-86963a0219ed" containerID="91ca7b35119e3255d2ec0b840c9cb1ffef58cbac8a274b43a4653961269bc078" exitCode=0 Jun 09 17:42:32.576651 ip-10-0-143-124 kubenswrapper[2552]: I0609 17:42:32.576633 2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762amhczh" event={"ID":"41709049-f258-405f-a492-86963a0219ed","Type":"ContainerDied","Data":"91ca7b35119e3255d2ec0b840c9cb1ffef58cbac8a274b43a4653961269bc078"} Jun 09 17:42:33.057823 ip-10-0-143-124 kubenswrapper[2552]: I0609 17:42:33.057789 2552 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/istiod-openshift-gateway-75c67f8887-xc6nt"] Jun 09 17:42:33.061698 ip-10-0-143-124 kubenswrapper[2552]: I0609 17:42:33.061675 2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/istiod-openshift-gateway-75c67f8887-xc6nt" Jun 09 17:42:33.064174 ip-10-0-143-124 kubenswrapper[2552]: I0609 17:42:33.064154 2552 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"cacerts\"" Jun 09 17:42:33.064434 ip-10-0-143-124 kubenswrapper[2552]: I0609 17:42:33.064399 2552 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"istio-kubeconfig\"" Jun 09 17:42:33.064434 ip-10-0-143-124 kubenswrapper[2552]: I0609 17:42:33.064419 2552 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"istiod-tls\"" Jun 09 17:42:33.064577 ip-10-0-143-124 kubenswrapper[2552]: I0609 17:42:33.064440 2552 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"istiod-openshift-gateway-dockercfg-hz84f\"" Jun 09 17:42:33.064718 ip-10-0-143-124 kubenswrapper[2552]: I0609 17:42:33.064687 2552 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-gw-ca-root-cert\"" Jun 09 17:42:33.064824 ip-10-0-143-124 kubenswrapper[2552]: I0609 17:42:33.064731 2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gctfs_8563ebab-ebdd-4d68-bce1-78d2a7f62992/konnectivity-agent/0.log" limit=1024 Jun 09 17:42:33.074350 ip-10-0-143-124 kubenswrapper[2552]: I0609 17:42:33.074330 2552 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-75c67f8887-xc6nt"] Jun 09 17:42:33.164704 ip-10-0-143-124 kubenswrapper[2552]: I0609 17:42:33.164652 2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gctfs_8563ebab-ebdd-4d68-bce1-78d2a7f62992/konnectivity-agent/0.log" limit=1024 Jun 09 17:42:33.242932 ip-10-0-143-124 kubenswrapper[2552]: I0609 17:42:33.242895 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/a8d42ce6-62c5-49df-bd94-bfe2c12dfceb-cacerts\") pod \"istiod-openshift-gateway-75c67f8887-xc6nt\" (UID: \"a8d42ce6-62c5-49df-bd94-bfe2c12dfceb\") " pod="openshift-ingress/istiod-openshift-gateway-75c67f8887-xc6nt" Jun 09 17:42:33.243105 ip-10-0-143-124 kubenswrapper[2552]: I0609 17:42:33.242955 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/a8d42ce6-62c5-49df-bd94-bfe2c12dfceb-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-75c67f8887-xc6nt\" (UID: \"a8d42ce6-62c5-49df-bd94-bfe2c12dfceb\") " pod="openshift-ingress/istiod-openshift-gateway-75c67f8887-xc6nt" Jun 09 17:42:33.243105 ip-10-0-143-124 kubenswrapper[2552]: I0609 17:42:33.243024 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/a8d42ce6-62c5-49df-bd94-bfe2c12dfceb-istio-token\") pod \"istiod-openshift-gateway-75c67f8887-xc6nt\" (UID: \"a8d42ce6-62c5-49df-bd94-bfe2c12dfceb\") " pod="openshift-ingress/istiod-openshift-gateway-75c67f8887-xc6nt" Jun 09 17:42:33.243105 ip-10-0-143-124 kubenswrapper[2552]: I0609 17:42:33.243064 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/a8d42ce6-62c5-49df-bd94-bfe2c12dfceb-istio-kubeconfig\") pod \"istiod-openshift-gateway-75c67f8887-xc6nt\" (UID: \"a8d42ce6-62c5-49df-bd94-bfe2c12dfceb\") " pod="openshift-ingress/istiod-openshift-gateway-75c67f8887-xc6nt" Jun 09 17:42:33.243105 ip-10-0-143-124 kubenswrapper[2552]: I0609 17:42:33.243097 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4r2jx\" (UniqueName: \"kubernetes.io/projected/a8d42ce6-62c5-49df-bd94-bfe2c12dfceb-kube-api-access-4r2jx\") pod \"istiod-openshift-gateway-75c67f8887-xc6nt\" (UID: \"a8d42ce6-62c5-49df-bd94-bfe2c12dfceb\") " pod="openshift-ingress/istiod-openshift-gateway-75c67f8887-xc6nt" Jun 09 17:42:33.243470 ip-10-0-143-124 kubenswrapper[2552]: I0609 17:42:33.243120 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/a8d42ce6-62c5-49df-bd94-bfe2c12dfceb-local-certs\") pod \"istiod-openshift-gateway-75c67f8887-xc6nt\" (UID: \"a8d42ce6-62c5-49df-bd94-bfe2c12dfceb\") " pod="openshift-ingress/istiod-openshift-gateway-75c67f8887-xc6nt" Jun 09 17:42:33.243470 ip-10-0-143-124 kubenswrapper[2552]: I0609 17:42:33.243138 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/a8d42ce6-62c5-49df-bd94-bfe2c12dfceb-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-75c67f8887-xc6nt\" (UID: \"a8d42ce6-62c5-49df-bd94-bfe2c12dfceb\") " pod="openshift-ingress/istiod-openshift-gateway-75c67f8887-xc6nt" Jun 09 17:42:33.344016 ip-10-0-143-124 kubenswrapper[2552]: I0609 17:42:33.343922 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/a8d42ce6-62c5-49df-bd94-bfe2c12dfceb-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-75c67f8887-xc6nt\" (UID: \"a8d42ce6-62c5-49df-bd94-bfe2c12dfceb\") " pod="openshift-ingress/istiod-openshift-gateway-75c67f8887-xc6nt" Jun 09 17:42:33.344016 ip-10-0-143-124 kubenswrapper[2552]: I0609 17:42:33.344004 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/a8d42ce6-62c5-49df-bd94-bfe2c12dfceb-istio-token\") pod \"istiod-openshift-gateway-75c67f8887-xc6nt\" (UID: \"a8d42ce6-62c5-49df-bd94-bfe2c12dfceb\") " pod="openshift-ingress/istiod-openshift-gateway-75c67f8887-xc6nt" Jun 09 17:42:33.344198 ip-10-0-143-124 kubenswrapper[2552]: I0609 17:42:33.344039 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/a8d42ce6-62c5-49df-bd94-bfe2c12dfceb-istio-kubeconfig\") pod \"istiod-openshift-gateway-75c67f8887-xc6nt\" (UID: \"a8d42ce6-62c5-49df-bd94-bfe2c12dfceb\") " pod="openshift-ingress/istiod-openshift-gateway-75c67f8887-xc6nt" Jun 09 17:42:33.344198 ip-10-0-143-124 kubenswrapper[2552]: I0609 17:42:33.344173 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4r2jx\" (UniqueName: \"kubernetes.io/projected/a8d42ce6-62c5-49df-bd94-bfe2c12dfceb-kube-api-access-4r2jx\") pod \"istiod-openshift-gateway-75c67f8887-xc6nt\" (UID: \"a8d42ce6-62c5-49df-bd94-bfe2c12dfceb\") " pod="openshift-ingress/istiod-openshift-gateway-75c67f8887-xc6nt" Jun 09 17:42:33.344285 ip-10-0-143-124 kubenswrapper[2552]: I0609 17:42:33.344214 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/a8d42ce6-62c5-49df-bd94-bfe2c12dfceb-local-certs\") pod \"istiod-openshift-gateway-75c67f8887-xc6nt\" (UID: \"a8d42ce6-62c5-49df-bd94-bfe2c12dfceb\") " pod="openshift-ingress/istiod-openshift-gateway-75c67f8887-xc6nt" Jun 09 17:42:33.344285 ip-10-0-143-124 kubenswrapper[2552]: I0609 17:42:33.344242 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/a8d42ce6-62c5-49df-bd94-bfe2c12dfceb-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-75c67f8887-xc6nt\" (UID: \"a8d42ce6-62c5-49df-bd94-bfe2c12dfceb\") " pod="openshift-ingress/istiod-openshift-gateway-75c67f8887-xc6nt" Jun 09 17:42:33.344386 ip-10-0-143-124 kubenswrapper[2552]: I0609 17:42:33.344356 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/a8d42ce6-62c5-49df-bd94-bfe2c12dfceb-cacerts\") pod \"istiod-openshift-gateway-75c67f8887-xc6nt\" (UID: \"a8d42ce6-62c5-49df-bd94-bfe2c12dfceb\") " pod="openshift-ingress/istiod-openshift-gateway-75c67f8887-xc6nt" Jun 09 17:42:33.344932 ip-10-0-143-124 kubenswrapper[2552]: I0609 17:42:33.344880 2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/a8d42ce6-62c5-49df-bd94-bfe2c12dfceb-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-75c67f8887-xc6nt\" (UID: \"a8d42ce6-62c5-49df-bd94-bfe2c12dfceb\") " pod="openshift-ingress/istiod-openshift-gateway-75c67f8887-xc6nt" Jun 09 17:42:33.346675 ip-10-0-143-124 kubenswrapper[2552]: I0609 17:42:33.346648 2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/a8d42ce6-62c5-49df-bd94-bfe2c12dfceb-cacerts\") pod \"istiod-openshift-gateway-75c67f8887-xc6nt\" (UID: \"a8d42ce6-62c5-49df-bd94-bfe2c12dfceb\") " pod="openshift-ingress/istiod-openshift-gateway-75c67f8887-xc6nt" Jun 09 17:42:33.346789 ip-10-0-143-124 kubenswrapper[2552]: I0609 17:42:33.346729 2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/a8d42ce6-62c5-49df-bd94-bfe2c12dfceb-istio-kubeconfig\") pod \"istiod-openshift-gateway-75c67f8887-xc6nt\" (UID: \"a8d42ce6-62c5-49df-bd94-bfe2c12dfceb\") " pod="openshift-ingress/istiod-openshift-gateway-75c67f8887-xc6nt" Jun 09 17:42:33.346789 ip-10-0-143-124 kubenswrapper[2552]: I0609 17:42:33.346757 2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/a8d42ce6-62c5-49df-bd94-bfe2c12dfceb-local-certs\") pod \"istiod-openshift-gateway-75c67f8887-xc6nt\" (UID: \"a8d42ce6-62c5-49df-bd94-bfe2c12dfceb\") " pod="openshift-ingress/istiod-openshift-gateway-75c67f8887-xc6nt" Jun 09 17:42:33.346919 ip-10-0-143-124 kubenswrapper[2552]: I0609 17:42:33.346899 2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/a8d42ce6-62c5-49df-bd94-bfe2c12dfceb-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-75c67f8887-xc6nt\" (UID: \"a8d42ce6-62c5-49df-bd94-bfe2c12dfceb\") " pod="openshift-ingress/istiod-openshift-gateway-75c67f8887-xc6nt" Jun 09 17:42:33.352631 ip-10-0-143-124 kubenswrapper[2552]: I0609 17:42:33.352580 2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-4r2jx\" (UniqueName: \"kubernetes.io/projected/a8d42ce6-62c5-49df-bd94-bfe2c12dfceb-kube-api-access-4r2jx\") pod \"istiod-openshift-gateway-75c67f8887-xc6nt\" (UID: \"a8d42ce6-62c5-49df-bd94-bfe2c12dfceb\") " pod="openshift-ingress/istiod-openshift-gateway-75c67f8887-xc6nt" Jun 09 17:42:33.352823 ip-10-0-143-124 kubenswrapper[2552]: I0609 17:42:33.352807 2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/a8d42ce6-62c5-49df-bd94-bfe2c12dfceb-istio-token\") pod \"istiod-openshift-gateway-75c67f8887-xc6nt\" (UID: \"a8d42ce6-62c5-49df-bd94-bfe2c12dfceb\") " pod="openshift-ingress/istiod-openshift-gateway-75c67f8887-xc6nt" Jun 09 17:42:33.371766 ip-10-0-143-124 kubenswrapper[2552]: I0609 17:42:33.371741 2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/istiod-openshift-gateway-75c67f8887-xc6nt" Jun 09 17:42:33.511811 ip-10-0-143-124 kubenswrapper[2552]: I0609 17:42:33.511787 2552 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-75c67f8887-xc6nt"] Jun 09 17:42:33.513922 ip-10-0-143-124 kubenswrapper[2552]: W0609 17:42:33.513895 2552 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda8d42ce6_62c5_49df_bd94_bfe2c12dfceb.slice/crio-1731a4dcf34242158a7280ee5a6b69e7daa2aeff696cbfdb98f22326357ef7fb WatchSource:0}: Error finding container 1731a4dcf34242158a7280ee5a6b69e7daa2aeff696cbfdb98f22326357ef7fb: Status 404 returned error can't find the container with id 1731a4dcf34242158a7280ee5a6b69e7daa2aeff696cbfdb98f22326357ef7fb Jun 09 17:42:33.583121 ip-10-0-143-124 kubenswrapper[2552]: I0609 17:42:33.583089 2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/istiod-openshift-gateway-75c67f8887-xc6nt" event={"ID":"a8d42ce6-62c5-49df-bd94-bfe2c12dfceb","Type":"ContainerStarted","Data":"1731a4dcf34242158a7280ee5a6b69e7daa2aeff696cbfdb98f22326357ef7fb"} Jun 09 17:42:33.622945 ip-10-0-143-124 kubenswrapper[2552]: I0609 17:42:33.622847 2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gctfs_8563ebab-ebdd-4d68-bce1-78d2a7f62992/konnectivity-agent/0.log" limit=1024 Jun 09 17:42:33.708927 ip-10-0-143-124 kubenswrapper[2552]: I0609 17:42:33.708903 2552 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762amhczh" Jun 09 17:42:33.748257 ip-10-0-143-124 kubenswrapper[2552]: I0609 17:42:33.748227 2552 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/41709049-f258-405f-a492-86963a0219ed-util\") pod \"41709049-f258-405f-a492-86963a0219ed\" (UID: \"41709049-f258-405f-a492-86963a0219ed\") " Jun 09 17:42:33.748408 ip-10-0-143-124 kubenswrapper[2552]: I0609 17:42:33.748323 2552 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/41709049-f258-405f-a492-86963a0219ed-bundle\") pod \"41709049-f258-405f-a492-86963a0219ed\" (UID: \"41709049-f258-405f-a492-86963a0219ed\") " Jun 09 17:42:33.748408 ip-10-0-143-124 kubenswrapper[2552]: I0609 17:42:33.748365 2552 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-xz4js\" (UniqueName: \"kubernetes.io/projected/41709049-f258-405f-a492-86963a0219ed-kube-api-access-xz4js\") pod \"41709049-f258-405f-a492-86963a0219ed\" (UID: \"41709049-f258-405f-a492-86963a0219ed\") " Jun 09 17:42:33.749285 ip-10-0-143-124 kubenswrapper[2552]: I0609 17:42:33.749246 2552 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/41709049-f258-405f-a492-86963a0219ed-bundle" (OuterVolumeSpecName: "bundle") pod "41709049-f258-405f-a492-86963a0219ed" (UID: "41709049-f258-405f-a492-86963a0219ed"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 09 17:42:33.750532 ip-10-0-143-124 kubenswrapper[2552]: I0609 17:42:33.750500 2552 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/41709049-f258-405f-a492-86963a0219ed-kube-api-access-xz4js" (OuterVolumeSpecName: "kube-api-access-xz4js") pod "41709049-f258-405f-a492-86963a0219ed" (UID: "41709049-f258-405f-a492-86963a0219ed"). InnerVolumeSpecName "kube-api-access-xz4js". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 09 17:42:33.753493 ip-10-0-143-124 kubenswrapper[2552]: I0609 17:42:33.753473 2552 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/41709049-f258-405f-a492-86963a0219ed-util" (OuterVolumeSpecName: "util") pod "41709049-f258-405f-a492-86963a0219ed" (UID: "41709049-f258-405f-a492-86963a0219ed"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 09 17:42:33.849040 ip-10-0-143-124 kubenswrapper[2552]: I0609 17:42:33.849001 2552 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/41709049-f258-405f-a492-86963a0219ed-util\") on node \"ip-10-0-143-124.ec2.internal\" DevicePath \"\"" Jun 09 17:42:33.849040 ip-10-0-143-124 kubenswrapper[2552]: I0609 17:42:33.849031 2552 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/41709049-f258-405f-a492-86963a0219ed-bundle\") on node \"ip-10-0-143-124.ec2.internal\" DevicePath \"\"" Jun 09 17:42:33.849040 ip-10-0-143-124 kubenswrapper[2552]: I0609 17:42:33.849043 2552 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-xz4js\" (UniqueName: \"kubernetes.io/projected/41709049-f258-405f-a492-86963a0219ed-kube-api-access-xz4js\") on node \"ip-10-0-143-124.ec2.internal\" DevicePath \"\"" Jun 09 17:42:34.589833 ip-10-0-143-124 kubenswrapper[2552]: I0609 17:42:34.589798 2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762amhczh" event={"ID":"41709049-f258-405f-a492-86963a0219ed","Type":"ContainerDied","Data":"3331db86ba8f5f42a8b6ebb6f1b9c7382ba1288d207aff868e71328f52519dcc"} Jun 09 17:42:34.590169 ip-10-0-143-124 kubenswrapper[2552]: I0609 17:42:34.589880 2552 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="3331db86ba8f5f42a8b6ebb6f1b9c7382ba1288d207aff868e71328f52519dcc" Jun 09 17:42:34.590169 ip-10-0-143-124 kubenswrapper[2552]: I0609 17:42:34.589813 2552 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762amhczh" Jun 09 17:42:36.546396 ip-10-0-143-124 kubenswrapper[2552]: I0609 17:42:36.546369 2552 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-operators/servicemesh-operator3-57f65f65fb-qmxdg" Jun 09 17:42:36.741518 ip-10-0-143-124 kubenswrapper[2552]: I0609 17:42:36.741476 2552 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"} Jun 09 17:42:36.741644 ip-10-0-143-124 kubenswrapper[2552]: I0609 17:42:36.741546 2552 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"} Jun 09 17:42:37.605659 ip-10-0-143-124 kubenswrapper[2552]: I0609 17:42:37.605607 2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/istiod-openshift-gateway-75c67f8887-xc6nt" event={"ID":"a8d42ce6-62c5-49df-bd94-bfe2c12dfceb","Type":"ContainerStarted","Data":"8aed3b5ad4e5767f08ec2fdbea8e33a86b4bb9df788011f04d65ee9b89dd8182"} Jun 09 17:42:37.606133 ip-10-0-143-124 kubenswrapper[2552]: I0609 17:42:37.605685 2552 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/istiod-openshift-gateway-75c67f8887-xc6nt" Jun 09 17:42:37.607190 ip-10-0-143-124 kubenswrapper[2552]: I0609 17:42:37.607168 2552 patch_prober.go:28] interesting pod/istiod-openshift-gateway-75c67f8887-xc6nt container/discovery namespace/openshift-ingress: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body= Jun 09 17:42:37.607258 ip-10-0-143-124 kubenswrapper[2552]: I0609 17:42:37.607219 2552 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/istiod-openshift-gateway-75c67f8887-xc6nt" podUID="a8d42ce6-62c5-49df-bd94-bfe2c12dfceb" containerName="discovery" probeResult="failure" output="HTTP probe failed with statuscode: 503" Jun 09 17:42:37.638110 ip-10-0-143-124 kubenswrapper[2552]: I0609 17:42:37.638057 2552 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/istiod-openshift-gateway-75c67f8887-xc6nt" podStartSLOduration=1.412923602 podStartE2EDuration="4.638041482s" totalImagesPullingTime="3.22511788s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-09 17:42:33 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-09 17:42:37.63668389 +0000 UTC m=+561.736586540" watchObservedRunningTime="2026-06-09 17:42:37.638041482 +0000 UTC m=+561.737944130" Jun 09 17:42:37.839354 ip-10-0-143-124 kubenswrapper[2552]: I0609 17:42:37.839318 2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gctfs_8563ebab-ebdd-4d68-bce1-78d2a7f62992/konnectivity-agent/0.log" limit=1024 Jun 09 17:42:37.945146 ip-10-0-143-124 kubenswrapper[2552]: I0609 17:42:37.945054 2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gctfs_8563ebab-ebdd-4d68-bce1-78d2a7f62992/konnectivity-agent/0.log" limit=1024 Jun 09 17:42:38.109339 ip-10-0-143-124 kubenswrapper[2552]: I0609 17:42:38.109303 2552 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/data-science-gateway-data-science-gateway-class-74759f9795hj6g8"] Jun 09 17:42:38.109789 ip-10-0-143-124 kubenswrapper[2552]: I0609 17:42:38.109762 2552 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="41709049-f258-405f-a492-86963a0219ed" containerName="extract" Jun 09 17:42:38.109789 ip-10-0-143-124 kubenswrapper[2552]: I0609 17:42:38.109787 2552 state_mem.go:107] "Deleted CPUSet assignment" podUID="41709049-f258-405f-a492-86963a0219ed" containerName="extract" Jun 09 17:42:38.109789 ip-10-0-143-124 kubenswrapper[2552]: I0609 17:42:38.109802 2552 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="41709049-f258-405f-a492-86963a0219ed" containerName="pull" Jun 09 17:42:38.110063 ip-10-0-143-124 kubenswrapper[2552]: I0609 17:42:38.109812 2552 state_mem.go:107] "Deleted CPUSet assignment" podUID="41709049-f258-405f-a492-86963a0219ed" containerName="pull" Jun 09 17:42:38.110063 ip-10-0-143-124 kubenswrapper[2552]: I0609 17:42:38.109830 2552 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="41709049-f258-405f-a492-86963a0219ed" containerName="util" Jun 09 17:42:38.110063 ip-10-0-143-124 kubenswrapper[2552]: I0609 17:42:38.109839 2552 state_mem.go:107] "Deleted CPUSet assignment" podUID="41709049-f258-405f-a492-86963a0219ed" containerName="util" Jun 09 17:42:38.110063 ip-10-0-143-124 kubenswrapper[2552]: I0609 17:42:38.109950 2552 memory_manager.go:368] "RemoveStaleState removing state" podUID="41709049-f258-405f-a492-86963a0219ed" containerName="extract" Jun 09 17:42:38.130646 ip-10-0-143-124 kubenswrapper[2552]: I0609 17:42:38.130591 2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-74759f9795hj6g8" Jun 09 17:42:38.132352 ip-10-0-143-124 kubenswrapper[2552]: I0609 17:42:38.132326 2552 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/data-science-gateway-data-science-gateway-class-74759f9795hj6g8"] Jun 09 17:42:38.134057 ip-10-0-143-124 kubenswrapper[2552]: I0609 17:42:38.134034 2552 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"data-science-gateway-data-science-gateway-class-dockercfg-jcvt5\"" Jun 09 17:42:38.164404 ip-10-0-143-124 kubenswrapper[2552]: I0609 17:42:38.164347 2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gctfs_8563ebab-ebdd-4d68-bce1-78d2a7f62992/konnectivity-agent/0.log" limit=1024 Jun 09 17:42:38.189273 ip-10-0-143-124 kubenswrapper[2552]: I0609 17:42:38.189240 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/c95272d7-db45-4381-bf31-d54704151566-credential-socket\") pod \"data-science-gateway-data-science-gateway-class-74759f9795hj6g8\" (UID: \"c95272d7-db45-4381-bf31-d54704151566\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-74759f9795hj6g8" Jun 09 17:42:38.189428 ip-10-0-143-124 kubenswrapper[2552]: I0609 17:42:38.189284 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-gdh5v\" (UniqueName: \"kubernetes.io/projected/c95272d7-db45-4381-bf31-d54704151566-kube-api-access-gdh5v\") pod \"data-science-gateway-data-science-gateway-class-74759f9795hj6g8\" (UID: \"c95272d7-db45-4381-bf31-d54704151566\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-74759f9795hj6g8" Jun 09 17:42:38.189428 ip-10-0-143-124 kubenswrapper[2552]: I0609 17:42:38.189311 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/c95272d7-db45-4381-bf31-d54704151566-istiod-ca-cert\") pod \"data-science-gateway-data-science-gateway-class-74759f9795hj6g8\" (UID: \"c95272d7-db45-4381-bf31-d54704151566\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-74759f9795hj6g8" Jun 09 17:42:38.189428 ip-10-0-143-124 kubenswrapper[2552]: I0609 17:42:38.189379 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/c95272d7-db45-4381-bf31-d54704151566-istio-token\") pod \"data-science-gateway-data-science-gateway-class-74759f9795hj6g8\" (UID: \"c95272d7-db45-4381-bf31-d54704151566\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-74759f9795hj6g8" Jun 09 17:42:38.189614 ip-10-0-143-124 kubenswrapper[2552]: I0609 17:42:38.189431 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/c95272d7-db45-4381-bf31-d54704151566-istio-data\") pod \"data-science-gateway-data-science-gateway-class-74759f9795hj6g8\" (UID: \"c95272d7-db45-4381-bf31-d54704151566\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-74759f9795hj6g8" Jun 09 17:42:38.189614 ip-10-0-143-124 kubenswrapper[2552]: I0609 17:42:38.189464 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/c95272d7-db45-4381-bf31-d54704151566-istio-podinfo\") pod \"data-science-gateway-data-science-gateway-class-74759f9795hj6g8\" (UID: \"c95272d7-db45-4381-bf31-d54704151566\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-74759f9795hj6g8" Jun 09 17:42:38.189614 ip-10-0-143-124 kubenswrapper[2552]: I0609 17:42:38.189537 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/c95272d7-db45-4381-bf31-d54704151566-workload-socket\") pod \"data-science-gateway-data-science-gateway-class-74759f9795hj6g8\" (UID: \"c95272d7-db45-4381-bf31-d54704151566\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-74759f9795hj6g8" Jun 09 17:42:38.189614 ip-10-0-143-124 kubenswrapper[2552]: I0609 17:42:38.189584 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/c95272d7-db45-4381-bf31-d54704151566-workload-certs\") pod \"data-science-gateway-data-science-gateway-class-74759f9795hj6g8\" (UID: \"c95272d7-db45-4381-bf31-d54704151566\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-74759f9795hj6g8" Jun 09 17:42:38.189800 ip-10-0-143-124 kubenswrapper[2552]: I0609 17:42:38.189643 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/c95272d7-db45-4381-bf31-d54704151566-istio-envoy\") pod \"data-science-gateway-data-science-gateway-class-74759f9795hj6g8\" (UID: \"c95272d7-db45-4381-bf31-d54704151566\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-74759f9795hj6g8" Jun 09 17:42:38.290223 ip-10-0-143-124 kubenswrapper[2552]: I0609 17:42:38.290189 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/c95272d7-db45-4381-bf31-d54704151566-workload-socket\") pod \"data-science-gateway-data-science-gateway-class-74759f9795hj6g8\" (UID: \"c95272d7-db45-4381-bf31-d54704151566\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-74759f9795hj6g8" Jun 09 17:42:38.290385 ip-10-0-143-124 kubenswrapper[2552]: I0609 17:42:38.290229 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/c95272d7-db45-4381-bf31-d54704151566-workload-certs\") pod \"data-science-gateway-data-science-gateway-class-74759f9795hj6g8\" (UID: \"c95272d7-db45-4381-bf31-d54704151566\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-74759f9795hj6g8" Jun 09 17:42:38.290385 ip-10-0-143-124 kubenswrapper[2552]: I0609 17:42:38.290252 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/c95272d7-db45-4381-bf31-d54704151566-istio-envoy\") pod \"data-science-gateway-data-science-gateway-class-74759f9795hj6g8\" (UID: \"c95272d7-db45-4381-bf31-d54704151566\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-74759f9795hj6g8" Jun 09 17:42:38.290385 ip-10-0-143-124 kubenswrapper[2552]: I0609 17:42:38.290296 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/c95272d7-db45-4381-bf31-d54704151566-credential-socket\") pod \"data-science-gateway-data-science-gateway-class-74759f9795hj6g8\" (UID: \"c95272d7-db45-4381-bf31-d54704151566\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-74759f9795hj6g8" Jun 09 17:42:38.290385 ip-10-0-143-124 kubenswrapper[2552]: I0609 17:42:38.290316 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-gdh5v\" (UniqueName: \"kubernetes.io/projected/c95272d7-db45-4381-bf31-d54704151566-kube-api-access-gdh5v\") pod \"data-science-gateway-data-science-gateway-class-74759f9795hj6g8\" (UID: \"c95272d7-db45-4381-bf31-d54704151566\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-74759f9795hj6g8" Jun 09 17:42:38.290385 ip-10-0-143-124 kubenswrapper[2552]: I0609 17:42:38.290335 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/c95272d7-db45-4381-bf31-d54704151566-istiod-ca-cert\") pod \"data-science-gateway-data-science-gateway-class-74759f9795hj6g8\" (UID: \"c95272d7-db45-4381-bf31-d54704151566\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-74759f9795hj6g8" Jun 09 17:42:38.290385 ip-10-0-143-124 kubenswrapper[2552]: I0609 17:42:38.290357 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/c95272d7-db45-4381-bf31-d54704151566-istio-token\") pod \"data-science-gateway-data-science-gateway-class-74759f9795hj6g8\" (UID: \"c95272d7-db45-4381-bf31-d54704151566\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-74759f9795hj6g8" Jun 09 17:42:38.290385 ip-10-0-143-124 kubenswrapper[2552]: I0609 17:42:38.290377 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/c95272d7-db45-4381-bf31-d54704151566-istio-data\") pod \"data-science-gateway-data-science-gateway-class-74759f9795hj6g8\" (UID: \"c95272d7-db45-4381-bf31-d54704151566\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-74759f9795hj6g8" Jun 09 17:42:38.290812 ip-10-0-143-124 kubenswrapper[2552]: I0609 17:42:38.290403 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/c95272d7-db45-4381-bf31-d54704151566-istio-podinfo\") pod \"data-science-gateway-data-science-gateway-class-74759f9795hj6g8\" (UID: \"c95272d7-db45-4381-bf31-d54704151566\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-74759f9795hj6g8" Jun 09 17:42:38.290812 ip-10-0-143-124 kubenswrapper[2552]: I0609 17:42:38.290660 2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/c95272d7-db45-4381-bf31-d54704151566-workload-certs\") pod \"data-science-gateway-data-science-gateway-class-74759f9795hj6g8\" (UID: \"c95272d7-db45-4381-bf31-d54704151566\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-74759f9795hj6g8" Jun 09 17:42:38.290920 ip-10-0-143-124 kubenswrapper[2552]: I0609 17:42:38.290893 2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/c95272d7-db45-4381-bf31-d54704151566-istio-data\") pod \"data-science-gateway-data-science-gateway-class-74759f9795hj6g8\" (UID: \"c95272d7-db45-4381-bf31-d54704151566\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-74759f9795hj6g8" Jun 09 17:42:38.291009 ip-10-0-143-124 kubenswrapper[2552]: I0609 17:42:38.290987 2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/c95272d7-db45-4381-bf31-d54704151566-credential-socket\") pod \"data-science-gateway-data-science-gateway-class-74759f9795hj6g8\" (UID: \"c95272d7-db45-4381-bf31-d54704151566\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-74759f9795hj6g8" Jun 09 17:42:38.291078 ip-10-0-143-124 kubenswrapper[2552]: I0609 17:42:38.291052 2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/c95272d7-db45-4381-bf31-d54704151566-workload-socket\") pod \"data-science-gateway-data-science-gateway-class-74759f9795hj6g8\" (UID: \"c95272d7-db45-4381-bf31-d54704151566\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-74759f9795hj6g8" Jun 09 17:42:38.291117 ip-10-0-143-124 kubenswrapper[2552]: I0609 17:42:38.291076 2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/c95272d7-db45-4381-bf31-d54704151566-istiod-ca-cert\") pod \"data-science-gateway-data-science-gateway-class-74759f9795hj6g8\" (UID: \"c95272d7-db45-4381-bf31-d54704151566\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-74759f9795hj6g8" Jun 09 17:42:38.292703 ip-10-0-143-124 kubenswrapper[2552]: I0609 17:42:38.292685 2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/c95272d7-db45-4381-bf31-d54704151566-istio-envoy\") pod \"data-science-gateway-data-science-gateway-class-74759f9795hj6g8\" (UID: \"c95272d7-db45-4381-bf31-d54704151566\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-74759f9795hj6g8" Jun 09 17:42:38.292978 ip-10-0-143-124 kubenswrapper[2552]: I0609 17:42:38.292962 2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/c95272d7-db45-4381-bf31-d54704151566-istio-podinfo\") pod \"data-science-gateway-data-science-gateway-class-74759f9795hj6g8\" (UID: \"c95272d7-db45-4381-bf31-d54704151566\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-74759f9795hj6g8" Jun 09 17:42:38.301974 ip-10-0-143-124 kubenswrapper[2552]: I0609 17:42:38.301950 2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-gdh5v\" (UniqueName: \"kubernetes.io/projected/c95272d7-db45-4381-bf31-d54704151566-kube-api-access-gdh5v\") pod \"data-science-gateway-data-science-gateway-class-74759f9795hj6g8\" (UID: \"c95272d7-db45-4381-bf31-d54704151566\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-74759f9795hj6g8" Jun 09 17:42:38.314215 ip-10-0-143-124 kubenswrapper[2552]: I0609 17:42:38.314181 2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/c95272d7-db45-4381-bf31-d54704151566-istio-token\") pod \"data-science-gateway-data-science-gateway-class-74759f9795hj6g8\" (UID: \"c95272d7-db45-4381-bf31-d54704151566\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-74759f9795hj6g8" Jun 09 17:42:38.410219 ip-10-0-143-124 kubenswrapper[2552]: I0609 17:42:38.410173 2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gctfs_8563ebab-ebdd-4d68-bce1-78d2a7f62992/konnectivity-agent/0.log" limit=1024 Jun 09 17:42:38.442234 ip-10-0-143-124 kubenswrapper[2552]: I0609 17:42:38.442208 2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-74759f9795hj6g8" Jun 09 17:42:38.612232 ip-10-0-143-124 kubenswrapper[2552]: I0609 17:42:38.612206 2552 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/istiod-openshift-gateway-75c67f8887-xc6nt" Jun 09 17:42:38.651239 ip-10-0-143-124 kubenswrapper[2552]: I0609 17:42:38.651212 2552 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/data-science-gateway-data-science-gateway-class-74759f9795hj6g8"] Jun 09 17:42:38.652037 ip-10-0-143-124 kubenswrapper[2552]: W0609 17:42:38.652012 2552 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc95272d7_db45_4381_bf31_d54704151566.slice/crio-1ea7b959c2d12238b3b440951edb8b0361cf66eb02def4bbbf4ad11064f6d9c1 WatchSource:0}: Error finding container 1ea7b959c2d12238b3b440951edb8b0361cf66eb02def4bbbf4ad11064f6d9c1: Status 404 returned error can't find the container with id 1ea7b959c2d12238b3b440951edb8b0361cf66eb02def4bbbf4ad11064f6d9c1 Jun 09 17:42:38.736721 ip-10-0-143-124 kubenswrapper[2552]: I0609 17:42:38.736685 2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gctfs_8563ebab-ebdd-4d68-bce1-78d2a7f62992/konnectivity-agent/0.log" limit=1024 Jun 09 17:42:38.938347 ip-10-0-143-124 kubenswrapper[2552]: I0609 17:42:38.938266 2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gctfs_8563ebab-ebdd-4d68-bce1-78d2a7f62992/konnectivity-agent/0.log" limit=1024 Jun 09 17:42:39.618988 ip-10-0-143-124 kubenswrapper[2552]: I0609 17:42:39.618951 2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-74759f9795hj6g8" event={"ID":"c95272d7-db45-4381-bf31-d54704151566","Type":"ContainerStarted","Data":"1ea7b959c2d12238b3b440951edb8b0361cf66eb02def4bbbf4ad11064f6d9c1"} Jun 09 17:42:41.324675 ip-10-0-143-124 kubenswrapper[2552]: I0609 17:42:41.324638 2552 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"} Jun 09 17:42:41.324935 ip-10-0-143-124 kubenswrapper[2552]: I0609 17:42:41.324715 2552 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"} Jun 09 17:42:41.324935 ip-10-0-143-124 kubenswrapper[2552]: I0609 17:42:41.324744 2552 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"} Jun 09 17:42:41.632994 ip-10-0-143-124 kubenswrapper[2552]: I0609 17:42:41.632905 2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-74759f9795hj6g8" event={"ID":"c95272d7-db45-4381-bf31-d54704151566","Type":"ContainerStarted","Data":"447bfc5c16a225af917f29b58c35137d0075ad185de1d18038a5908ebf29e07d"} Jun 09 17:42:41.657540 ip-10-0-143-124 kubenswrapper[2552]: I0609 17:42:41.657486 2552 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-74759f9795hj6g8" podStartSLOduration=0.987291017 podStartE2EDuration="3.657470097s" totalImagesPullingTime="2.67017908s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-09 17:42:38 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-09 17:42:41.654038959 +0000 UTC m=+565.753941608" watchObservedRunningTime="2026-06-09 17:42:41.657470097 +0000 UTC m=+565.757372746" Jun 09 17:42:42.443010 ip-10-0-143-124 kubenswrapper[2552]: I0609 17:42:42.442980 2552 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-74759f9795hj6g8" Jun 09 17:42:42.447718 ip-10-0-143-124 kubenswrapper[2552]: I0609 17:42:42.447696 2552 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-74759f9795hj6g8" Jun 09 17:42:42.471754 ip-10-0-143-124 kubenswrapper[2552]: I0609 17:42:42.471727 2552 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/llmisvc-controller-manager-864bfd7bc9-jr926" Jun 09 17:42:42.638931 ip-10-0-143-124 kubenswrapper[2552]: I0609 17:42:42.638902 2552 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-74759f9795hj6g8" Jun 09 17:42:42.639960 ip-10-0-143-124 kubenswrapper[2552]: I0609 17:42:42.639942 2552 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-74759f9795hj6g8" Jun 09 17:42:57.733620 ip-10-0-143-124 kubenswrapper[2552]: I0609 17:42:57.733556 2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gctfs_8563ebab-ebdd-4d68-bce1-78d2a7f62992/konnectivity-agent/0.log" limit=1024 Jun 09 17:42:57.827409 ip-10-0-143-124 kubenswrapper[2552]: I0609 17:42:57.827367 2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gctfs_8563ebab-ebdd-4d68-bce1-78d2a7f62992/konnectivity-agent/0.log" limit=1024 Jun 09 17:42:57.927361 ip-10-0-143-124 kubenswrapper[2552]: I0609 17:42:57.927318 2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gctfs_8563ebab-ebdd-4d68-bce1-78d2a7f62992/konnectivity-agent/0.log" limit=1024 Jun 09 17:43:11.526724 ip-10-0-143-124 kubenswrapper[2552]: I0609 17:43:11.526676 2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gctfs_8563ebab-ebdd-4d68-bce1-78d2a7f62992/konnectivity-agent/0.log" limit=1024 Jun 09 17:43:12.637195 ip-10-0-143-124 kubenswrapper[2552]: I0609 17:43:12.637150 2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gctfs_8563ebab-ebdd-4d68-bce1-78d2a7f62992/konnectivity-agent/0.log" limit=1024 Jun 09 17:43:13.225698 ip-10-0-143-124 kubenswrapper[2552]: I0609 17:43:13.225663 2552 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73pmj5j"] Jun 09 17:43:13.238174 ip-10-0-143-124 kubenswrapper[2552]: I0609 17:43:13.238151 2552 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73pmj5j"] Jun 09 17:43:13.238312 ip-10-0-143-124 kubenswrapper[2552]: I0609 17:43:13.238258 2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73pmj5j" Jun 09 17:43:13.241200 ip-10-0-143-124 kubenswrapper[2552]: I0609 17:43:13.241178 2552 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"default-dockercfg-skvrh\"" Jun 09 17:43:13.241200 ip-10-0-143-124 kubenswrapper[2552]: I0609 17:43:13.241202 2552 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"openshift-service-ca.crt\"" Jun 09 17:43:13.242231 ip-10-0-143-124 kubenswrapper[2552]: I0609 17:43:13.242210 2552 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"kube-root-ca.crt\"" Jun 09 17:43:13.405663 ip-10-0-143-124 kubenswrapper[2552]: I0609 17:43:13.405632 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/5b6171c4-52fa-4e4c-9769-eca68fe2f0ac-util\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73pmj5j\" (UID: \"5b6171c4-52fa-4e4c-9769-eca68fe2f0ac\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73pmj5j" Jun 09 17:43:13.405831 ip-10-0-143-124 kubenswrapper[2552]: I0609 17:43:13.405672 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xmt5g\" (UniqueName: \"kubernetes.io/projected/5b6171c4-52fa-4e4c-9769-eca68fe2f0ac-kube-api-access-xmt5g\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73pmj5j\" (UID: \"5b6171c4-52fa-4e4c-9769-eca68fe2f0ac\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73pmj5j" Jun 09 17:43:13.405831 ip-10-0-143-124 kubenswrapper[2552]: I0609 17:43:13.405762 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/5b6171c4-52fa-4e4c-9769-eca68fe2f0ac-bundle\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73pmj5j\" (UID: \"5b6171c4-52fa-4e4c-9769-eca68fe2f0ac\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73pmj5j" Jun 09 17:43:13.506722 ip-10-0-143-124 kubenswrapper[2552]: I0609 17:43:13.506691 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/5b6171c4-52fa-4e4c-9769-eca68fe2f0ac-bundle\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73pmj5j\" (UID: \"5b6171c4-52fa-4e4c-9769-eca68fe2f0ac\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73pmj5j" Jun 09 17:43:13.506886 ip-10-0-143-124 kubenswrapper[2552]: I0609 17:43:13.506760 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/5b6171c4-52fa-4e4c-9769-eca68fe2f0ac-util\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73pmj5j\" (UID: \"5b6171c4-52fa-4e4c-9769-eca68fe2f0ac\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73pmj5j" Jun 09 17:43:13.506886 ip-10-0-143-124 kubenswrapper[2552]: I0609 17:43:13.506785 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xmt5g\" (UniqueName: \"kubernetes.io/projected/5b6171c4-52fa-4e4c-9769-eca68fe2f0ac-kube-api-access-xmt5g\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73pmj5j\" (UID: \"5b6171c4-52fa-4e4c-9769-eca68fe2f0ac\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73pmj5j" Jun 09 17:43:13.507131 ip-10-0-143-124 kubenswrapper[2552]: I0609 17:43:13.507112 2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/5b6171c4-52fa-4e4c-9769-eca68fe2f0ac-bundle\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73pmj5j\" (UID: \"5b6171c4-52fa-4e4c-9769-eca68fe2f0ac\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73pmj5j" Jun 09 17:43:13.507170 ip-10-0-143-124 kubenswrapper[2552]: I0609 17:43:13.507129 2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/5b6171c4-52fa-4e4c-9769-eca68fe2f0ac-util\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73pmj5j\" (UID: \"5b6171c4-52fa-4e4c-9769-eca68fe2f0ac\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73pmj5j" Jun 09 17:43:13.518243 ip-10-0-143-124 kubenswrapper[2552]: I0609 17:43:13.518215 2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-xmt5g\" (UniqueName: \"kubernetes.io/projected/5b6171c4-52fa-4e4c-9769-eca68fe2f0ac-kube-api-access-xmt5g\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73pmj5j\" (UID: \"5b6171c4-52fa-4e4c-9769-eca68fe2f0ac\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73pmj5j" Jun 09 17:43:13.548788 ip-10-0-143-124 kubenswrapper[2552]: I0609 17:43:13.548761 2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73pmj5j" Jun 09 17:43:13.683394 ip-10-0-143-124 kubenswrapper[2552]: I0609 17:43:13.683369 2552 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73pmj5j"] Jun 09 17:43:13.685197 ip-10-0-143-124 kubenswrapper[2552]: W0609 17:43:13.685169 2552 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5b6171c4_52fa_4e4c_9769_eca68fe2f0ac.slice/crio-c7b6ab97e7d1296ef2837fb0818ac85bd70f57a31be35eefa65cb1962dd7528d WatchSource:0}: Error finding container c7b6ab97e7d1296ef2837fb0818ac85bd70f57a31be35eefa65cb1962dd7528d: Status 404 returned error can't find the container with id c7b6ab97e7d1296ef2837fb0818ac85bd70f57a31be35eefa65cb1962dd7528d Jun 09 17:43:13.791272 ip-10-0-143-124 kubenswrapper[2552]: I0609 17:43:13.791233 2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73pmj5j" event={"ID":"5b6171c4-52fa-4e4c-9769-eca68fe2f0ac","Type":"ContainerStarted","Data":"37d97d60e2df62764a605bb538dc3c19f67f27ba9691847798febd1b15146862"} Jun 09 17:43:13.791433 ip-10-0-143-124 kubenswrapper[2552]: I0609 17:43:13.791317 2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73pmj5j" event={"ID":"5b6171c4-52fa-4e4c-9769-eca68fe2f0ac","Type":"ContainerStarted","Data":"c7b6ab97e7d1296ef2837fb0818ac85bd70f57a31be35eefa65cb1962dd7528d"} Jun 09 17:43:13.815427 ip-10-0-143-124 kubenswrapper[2552]: I0609 17:43:13.815400 2552 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1d9bw2"] Jun 09 17:43:13.818892 ip-10-0-143-124 kubenswrapper[2552]: I0609 17:43:13.818875 2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1d9bw2" Jun 09 17:43:13.830277 ip-10-0-143-124 kubenswrapper[2552]: I0609 17:43:13.830252 2552 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1d9bw2"] Jun 09 17:43:14.011569 ip-10-0-143-124 kubenswrapper[2552]: I0609 17:43:14.011492 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/3eb06456-961a-44b1-9e2d-963b63644584-bundle\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1d9bw2\" (UID: \"3eb06456-961a-44b1-9e2d-963b63644584\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1d9bw2" Jun 09 17:43:14.011569 ip-10-0-143-124 kubenswrapper[2552]: I0609 17:43:14.011543 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/3eb06456-961a-44b1-9e2d-963b63644584-util\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1d9bw2\" (UID: \"3eb06456-961a-44b1-9e2d-963b63644584\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1d9bw2" Jun 09 17:43:14.011762 ip-10-0-143-124 kubenswrapper[2552]: I0609 17:43:14.011661 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-bvb5z\" (UniqueName: \"kubernetes.io/projected/3eb06456-961a-44b1-9e2d-963b63644584-kube-api-access-bvb5z\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1d9bw2\" (UID: \"3eb06456-961a-44b1-9e2d-963b63644584\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1d9bw2" Jun 09 17:43:14.112215 ip-10-0-143-124 kubenswrapper[2552]: I0609 17:43:14.112183 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/3eb06456-961a-44b1-9e2d-963b63644584-bundle\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1d9bw2\" (UID: \"3eb06456-961a-44b1-9e2d-963b63644584\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1d9bw2" Jun 09 17:43:14.112376 ip-10-0-143-124 kubenswrapper[2552]: I0609 17:43:14.112223 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/3eb06456-961a-44b1-9e2d-963b63644584-util\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1d9bw2\" (UID: \"3eb06456-961a-44b1-9e2d-963b63644584\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1d9bw2" Jun 09 17:43:14.112376 ip-10-0-143-124 kubenswrapper[2552]: I0609 17:43:14.112260 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-bvb5z\" (UniqueName: \"kubernetes.io/projected/3eb06456-961a-44b1-9e2d-963b63644584-kube-api-access-bvb5z\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1d9bw2\" (UID: \"3eb06456-961a-44b1-9e2d-963b63644584\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1d9bw2" Jun 09 17:43:14.112692 ip-10-0-143-124 kubenswrapper[2552]: I0609 17:43:14.112668 2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/3eb06456-961a-44b1-9e2d-963b63644584-bundle\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1d9bw2\" (UID: \"3eb06456-961a-44b1-9e2d-963b63644584\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1d9bw2" Jun 09 17:43:14.112735 ip-10-0-143-124 kubenswrapper[2552]: I0609 17:43:14.112724 2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/3eb06456-961a-44b1-9e2d-963b63644584-util\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1d9bw2\" (UID: \"3eb06456-961a-44b1-9e2d-963b63644584\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1d9bw2" Jun 09 17:43:14.121314 ip-10-0-143-124 kubenswrapper[2552]: I0609 17:43:14.121295 2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-bvb5z\" (UniqueName: \"kubernetes.io/projected/3eb06456-961a-44b1-9e2d-963b63644584-kube-api-access-bvb5z\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1d9bw2\" (UID: \"3eb06456-961a-44b1-9e2d-963b63644584\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1d9bw2" Jun 09 17:43:14.163081 ip-10-0-143-124 kubenswrapper[2552]: I0609 17:43:14.163056 2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1d9bw2" Jun 09 17:43:14.218345 ip-10-0-143-124 kubenswrapper[2552]: I0609 17:43:14.218313 2552 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7596r2jv"] Jun 09 17:43:14.223915 ip-10-0-143-124 kubenswrapper[2552]: I0609 17:43:14.223892 2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7596r2jv" Jun 09 17:43:14.232094 ip-10-0-143-124 kubenswrapper[2552]: I0609 17:43:14.232007 2552 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7596r2jv"] Jun 09 17:43:14.300079 ip-10-0-143-124 kubenswrapper[2552]: I0609 17:43:14.300057 2552 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1d9bw2"] Jun 09 17:43:14.301869 ip-10-0-143-124 kubenswrapper[2552]: W0609 17:43:14.301839 2552 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3eb06456_961a_44b1_9e2d_963b63644584.slice/crio-e14c4b9516074a77d219c1075ef77a6c887503650a6d5ef54014dcc49dabc50f WatchSource:0}: Error finding container e14c4b9516074a77d219c1075ef77a6c887503650a6d5ef54014dcc49dabc50f: Status 404 returned error can't find the container with id e14c4b9516074a77d219c1075ef77a6c887503650a6d5ef54014dcc49dabc50f Jun 09 17:43:14.313575 ip-10-0-143-124 kubenswrapper[2552]: I0609 17:43:14.313551 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/3fd7a23d-1fbd-4c8f-b102-684ecf696e27-bundle\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7596r2jv\" (UID: \"3fd7a23d-1fbd-4c8f-b102-684ecf696e27\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7596r2jv" Jun 09 17:43:14.313701 ip-10-0-143-124 kubenswrapper[2552]: I0609 17:43:14.313584 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-kpbvq\" (UniqueName: \"kubernetes.io/projected/3fd7a23d-1fbd-4c8f-b102-684ecf696e27-kube-api-access-kpbvq\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7596r2jv\" (UID: \"3fd7a23d-1fbd-4c8f-b102-684ecf696e27\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7596r2jv" Jun 09 17:43:14.313701 ip-10-0-143-124 kubenswrapper[2552]: I0609 17:43:14.313666 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/3fd7a23d-1fbd-4c8f-b102-684ecf696e27-util\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7596r2jv\" (UID: \"3fd7a23d-1fbd-4c8f-b102-684ecf696e27\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7596r2jv" Jun 09 17:43:14.414176 ip-10-0-143-124 kubenswrapper[2552]: I0609 17:43:14.414145 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/3fd7a23d-1fbd-4c8f-b102-684ecf696e27-bundle\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7596r2jv\" (UID: \"3fd7a23d-1fbd-4c8f-b102-684ecf696e27\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7596r2jv" Jun 09 17:43:14.414310 ip-10-0-143-124 kubenswrapper[2552]: I0609 17:43:14.414197 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-kpbvq\" (UniqueName: \"kubernetes.io/projected/3fd7a23d-1fbd-4c8f-b102-684ecf696e27-kube-api-access-kpbvq\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7596r2jv\" (UID: \"3fd7a23d-1fbd-4c8f-b102-684ecf696e27\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7596r2jv" Jun 09 17:43:14.414310 ip-10-0-143-124 kubenswrapper[2552]: I0609 17:43:14.414250 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/3fd7a23d-1fbd-4c8f-b102-684ecf696e27-util\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7596r2jv\" (UID: \"3fd7a23d-1fbd-4c8f-b102-684ecf696e27\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7596r2jv" Jun 09 17:43:14.414491 ip-10-0-143-124 kubenswrapper[2552]: I0609 17:43:14.414469 2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/3fd7a23d-1fbd-4c8f-b102-684ecf696e27-bundle\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7596r2jv\" (UID: \"3fd7a23d-1fbd-4c8f-b102-684ecf696e27\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7596r2jv" Jun 09 17:43:14.414580 ip-10-0-143-124 kubenswrapper[2552]: I0609 17:43:14.414560 2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/3fd7a23d-1fbd-4c8f-b102-684ecf696e27-util\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7596r2jv\" (UID: \"3fd7a23d-1fbd-4c8f-b102-684ecf696e27\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7596r2jv" Jun 09 17:43:14.422934 ip-10-0-143-124 kubenswrapper[2552]: I0609 17:43:14.422909 2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-kpbvq\" (UniqueName: \"kubernetes.io/projected/3fd7a23d-1fbd-4c8f-b102-684ecf696e27-kube-api-access-kpbvq\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7596r2jv\" (UID: \"3fd7a23d-1fbd-4c8f-b102-684ecf696e27\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7596r2jv" Jun 09 17:43:14.535078 ip-10-0-143-124 kubenswrapper[2552]: I0609 17:43:14.535049 2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7596r2jv" Jun 09 17:43:14.619971 ip-10-0-143-124 kubenswrapper[2552]: I0609 17:43:14.619907 2552 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0hl5dr"] Jun 09 17:43:14.624267 ip-10-0-143-124 kubenswrapper[2552]: I0609 17:43:14.624241 2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0hl5dr" Jun 09 17:43:14.633289 ip-10-0-143-124 kubenswrapper[2552]: I0609 17:43:14.633249 2552 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0hl5dr"] Jun 09 17:43:14.672394 ip-10-0-143-124 kubenswrapper[2552]: I0609 17:43:14.672368 2552 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7596r2jv"] Jun 09 17:43:14.674255 ip-10-0-143-124 kubenswrapper[2552]: W0609 17:43:14.674226 2552 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3fd7a23d_1fbd_4c8f_b102_684ecf696e27.slice/crio-b458a06b4bf1393484ee22a5e539b26c4d8dc3f30afeb349df90c97d20a67034 WatchSource:0}: Error finding container b458a06b4bf1393484ee22a5e539b26c4d8dc3f30afeb349df90c97d20a67034: Status 404 returned error can't find the container with id b458a06b4bf1393484ee22a5e539b26c4d8dc3f30afeb349df90c97d20a67034 Jun 09 17:43:14.715915 ip-10-0-143-124 kubenswrapper[2552]: I0609 17:43:14.715883 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/ddd1104d-713f-4dc3-9220-34812e0b2802-bundle\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0hl5dr\" (UID: \"ddd1104d-713f-4dc3-9220-34812e0b2802\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0hl5dr" Jun 09 17:43:14.716311 ip-10-0-143-124 kubenswrapper[2552]: I0609 17:43:14.715979 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/ddd1104d-713f-4dc3-9220-34812e0b2802-util\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0hl5dr\" (UID: \"ddd1104d-713f-4dc3-9220-34812e0b2802\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0hl5dr" Jun 09 17:43:14.716311 ip-10-0-143-124 kubenswrapper[2552]: I0609 17:43:14.716016 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9xshm\" (UniqueName: \"kubernetes.io/projected/ddd1104d-713f-4dc3-9220-34812e0b2802-kube-api-access-9xshm\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0hl5dr\" (UID: \"ddd1104d-713f-4dc3-9220-34812e0b2802\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0hl5dr" Jun 09 17:43:14.797756 ip-10-0-143-124 kubenswrapper[2552]: I0609 17:43:14.797722 2552 generic.go:356] "Generic (PLEG): container finished" podID="3fd7a23d-1fbd-4c8f-b102-684ecf696e27" containerID="58f6987199cf348d2fbaf0bc24814513a6c652cc1543b75ae1643dfa7cbfd4d8" exitCode=0 Jun 09 17:43:14.797872 ip-10-0-143-124 kubenswrapper[2552]: I0609 17:43:14.797810 2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7596r2jv" event={"ID":"3fd7a23d-1fbd-4c8f-b102-684ecf696e27","Type":"ContainerDied","Data":"58f6987199cf348d2fbaf0bc24814513a6c652cc1543b75ae1643dfa7cbfd4d8"} Jun 09 17:43:14.797872 ip-10-0-143-124 kubenswrapper[2552]: I0609 17:43:14.797868 2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7596r2jv" event={"ID":"3fd7a23d-1fbd-4c8f-b102-684ecf696e27","Type":"ContainerStarted","Data":"b458a06b4bf1393484ee22a5e539b26c4d8dc3f30afeb349df90c97d20a67034"} Jun 09 17:43:14.799349 ip-10-0-143-124 kubenswrapper[2552]: I0609 17:43:14.799325 2552 generic.go:356] "Generic (PLEG): container finished" podID="3eb06456-961a-44b1-9e2d-963b63644584" containerID="3dfaa4c7e89968037c7d7ff456c1cb65ad367a26bb5b28ea9f21aa769dbc6e80" exitCode=0 Jun 09 17:43:14.799431 ip-10-0-143-124 kubenswrapper[2552]: I0609 17:43:14.799350 2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1d9bw2" event={"ID":"3eb06456-961a-44b1-9e2d-963b63644584","Type":"ContainerDied","Data":"3dfaa4c7e89968037c7d7ff456c1cb65ad367a26bb5b28ea9f21aa769dbc6e80"} Jun 09 17:43:14.799431 ip-10-0-143-124 kubenswrapper[2552]: I0609 17:43:14.799385 2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1d9bw2" event={"ID":"3eb06456-961a-44b1-9e2d-963b63644584","Type":"ContainerStarted","Data":"e14c4b9516074a77d219c1075ef77a6c887503650a6d5ef54014dcc49dabc50f"} Jun 09 17:43:14.800951 ip-10-0-143-124 kubenswrapper[2552]: I0609 17:43:14.800881 2552 generic.go:356] "Generic (PLEG): container finished" podID="5b6171c4-52fa-4e4c-9769-eca68fe2f0ac" containerID="37d97d60e2df62764a605bb538dc3c19f67f27ba9691847798febd1b15146862" exitCode=0 Jun 09 17:43:14.800951 ip-10-0-143-124 kubenswrapper[2552]: I0609 17:43:14.800904 2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73pmj5j" event={"ID":"5b6171c4-52fa-4e4c-9769-eca68fe2f0ac","Type":"ContainerDied","Data":"37d97d60e2df62764a605bb538dc3c19f67f27ba9691847798febd1b15146862"} Jun 09 17:43:14.816665 ip-10-0-143-124 kubenswrapper[2552]: I0609 17:43:14.816643 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/ddd1104d-713f-4dc3-9220-34812e0b2802-util\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0hl5dr\" (UID: \"ddd1104d-713f-4dc3-9220-34812e0b2802\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0hl5dr" Jun 09 17:43:14.816785 ip-10-0-143-124 kubenswrapper[2552]: I0609 17:43:14.816680 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9xshm\" (UniqueName: \"kubernetes.io/projected/ddd1104d-713f-4dc3-9220-34812e0b2802-kube-api-access-9xshm\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0hl5dr\" (UID: \"ddd1104d-713f-4dc3-9220-34812e0b2802\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0hl5dr" Jun 09 17:43:14.816785 ip-10-0-143-124 kubenswrapper[2552]: I0609 17:43:14.816780 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/ddd1104d-713f-4dc3-9220-34812e0b2802-bundle\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0hl5dr\" (UID: \"ddd1104d-713f-4dc3-9220-34812e0b2802\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0hl5dr" Jun 09 17:43:14.817089 ip-10-0-143-124 kubenswrapper[2552]: I0609 17:43:14.817067 2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/ddd1104d-713f-4dc3-9220-34812e0b2802-util\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0hl5dr\" (UID: \"ddd1104d-713f-4dc3-9220-34812e0b2802\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0hl5dr" Jun 09 17:43:14.817174 ip-10-0-143-124 kubenswrapper[2552]: I0609 17:43:14.817088 2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/ddd1104d-713f-4dc3-9220-34812e0b2802-bundle\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0hl5dr\" (UID: \"ddd1104d-713f-4dc3-9220-34812e0b2802\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0hl5dr" Jun 09 17:43:14.825564 ip-10-0-143-124 kubenswrapper[2552]: I0609 17:43:14.825543 2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-9xshm\" (UniqueName: \"kubernetes.io/projected/ddd1104d-713f-4dc3-9220-34812e0b2802-kube-api-access-9xshm\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0hl5dr\" (UID: \"ddd1104d-713f-4dc3-9220-34812e0b2802\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0hl5dr" Jun 09 17:43:14.936184 ip-10-0-143-124 kubenswrapper[2552]: I0609 17:43:14.936106 2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0hl5dr" Jun 09 17:43:15.066188 ip-10-0-143-124 kubenswrapper[2552]: I0609 17:43:15.066159 2552 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0hl5dr"] Jun 09 17:43:15.067243 ip-10-0-143-124 kubenswrapper[2552]: W0609 17:43:15.067218 2552 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podddd1104d_713f_4dc3_9220_34812e0b2802.slice/crio-23dd144b9896e5037de5ae80e713247999857368b239cd31947f48fb6a2645aa WatchSource:0}: Error finding container 23dd144b9896e5037de5ae80e713247999857368b239cd31947f48fb6a2645aa: Status 404 returned error can't find the container with id 23dd144b9896e5037de5ae80e713247999857368b239cd31947f48fb6a2645aa Jun 09 17:43:15.808880 ip-10-0-143-124 kubenswrapper[2552]: I0609 17:43:15.808807 2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7596r2jv" event={"ID":"3fd7a23d-1fbd-4c8f-b102-684ecf696e27","Type":"ContainerStarted","Data":"6aad9690250b5bb221d2ddadf21749a8e9522972eea626c42b45fd3ebbb2f7c9"} Jun 09 17:43:15.811023 ip-10-0-143-124 kubenswrapper[2552]: I0609 17:43:15.810932 2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73pmj5j" event={"ID":"5b6171c4-52fa-4e4c-9769-eca68fe2f0ac","Type":"ContainerStarted","Data":"9509882ac97e969aa1c7b886ba74b14c59e29263c490ce9152bdd4118994c2ce"} Jun 09 17:43:15.813609 ip-10-0-143-124 kubenswrapper[2552]: I0609 17:43:15.813502 2552 generic.go:356] "Generic (PLEG): container finished" podID="ddd1104d-713f-4dc3-9220-34812e0b2802" containerID="73d867a211c80e934ae72fc96ee735f791394ee6edf59ebd9ea5634c3772ff80" exitCode=0 Jun 09 17:43:15.813609 ip-10-0-143-124 kubenswrapper[2552]: I0609 17:43:15.813562 2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0hl5dr" event={"ID":"ddd1104d-713f-4dc3-9220-34812e0b2802","Type":"ContainerDied","Data":"73d867a211c80e934ae72fc96ee735f791394ee6edf59ebd9ea5634c3772ff80"} Jun 09 17:43:15.813788 ip-10-0-143-124 kubenswrapper[2552]: I0609 17:43:15.813618 2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0hl5dr" event={"ID":"ddd1104d-713f-4dc3-9220-34812e0b2802","Type":"ContainerStarted","Data":"23dd144b9896e5037de5ae80e713247999857368b239cd31947f48fb6a2645aa"} Jun 09 17:43:16.318242 ip-10-0-143-124 kubenswrapper[2552]: I0609 17:43:16.318214 2552 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-kwh69_9aa08551-03ce-4c12-96d9-d6ca9bb43bf7/ovn-acl-logging/0.log" Jun 09 17:43:16.318402 ip-10-0-143-124 kubenswrapper[2552]: I0609 17:43:16.318218 2552 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-kwh69_9aa08551-03ce-4c12-96d9-d6ca9bb43bf7/ovn-acl-logging/0.log" Jun 09 17:43:16.820429 ip-10-0-143-124 kubenswrapper[2552]: I0609 17:43:16.820392 2552 generic.go:356] "Generic (PLEG): container finished" podID="3fd7a23d-1fbd-4c8f-b102-684ecf696e27" containerID="6aad9690250b5bb221d2ddadf21749a8e9522972eea626c42b45fd3ebbb2f7c9" exitCode=0 Jun 09 17:43:16.820914 ip-10-0-143-124 kubenswrapper[2552]: I0609 17:43:16.820483 2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7596r2jv" event={"ID":"3fd7a23d-1fbd-4c8f-b102-684ecf696e27","Type":"ContainerDied","Data":"6aad9690250b5bb221d2ddadf21749a8e9522972eea626c42b45fd3ebbb2f7c9"} Jun 09 17:43:16.822571 ip-10-0-143-124 kubenswrapper[2552]: I0609 17:43:16.822541 2552 generic.go:356] "Generic (PLEG): container finished" podID="3eb06456-961a-44b1-9e2d-963b63644584" containerID="104cbcc218edbf1483a7f24bd596c7ce782687407a7d27774099502f9711680e" exitCode=0 Jun 09 17:43:16.822703 ip-10-0-143-124 kubenswrapper[2552]: I0609 17:43:16.822574 2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1d9bw2" event={"ID":"3eb06456-961a-44b1-9e2d-963b63644584","Type":"ContainerDied","Data":"104cbcc218edbf1483a7f24bd596c7ce782687407a7d27774099502f9711680e"} Jun 09 17:43:16.824441 ip-10-0-143-124 kubenswrapper[2552]: I0609 17:43:16.824419 2552 generic.go:356] "Generic (PLEG): container finished" podID="5b6171c4-52fa-4e4c-9769-eca68fe2f0ac" containerID="9509882ac97e969aa1c7b886ba74b14c59e29263c490ce9152bdd4118994c2ce" exitCode=0 Jun 09 17:43:16.824523 ip-10-0-143-124 kubenswrapper[2552]: I0609 17:43:16.824488 2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73pmj5j" event={"ID":"5b6171c4-52fa-4e4c-9769-eca68fe2f0ac","Type":"ContainerDied","Data":"9509882ac97e969aa1c7b886ba74b14c59e29263c490ce9152bdd4118994c2ce"} Jun 09 17:43:16.826364 ip-10-0-143-124 kubenswrapper[2552]: I0609 17:43:16.826345 2552 generic.go:356] "Generic (PLEG): container finished" podID="ddd1104d-713f-4dc3-9220-34812e0b2802" containerID="b015f646f3e494c16e18f12927ccebe7425e179f52199aaf93df52dcab67f071" exitCode=0 Jun 09 17:43:16.826451 ip-10-0-143-124 kubenswrapper[2552]: I0609 17:43:16.826413 2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0hl5dr" event={"ID":"ddd1104d-713f-4dc3-9220-34812e0b2802","Type":"ContainerDied","Data":"b015f646f3e494c16e18f12927ccebe7425e179f52199aaf93df52dcab67f071"} Jun 09 17:43:17.834148 ip-10-0-143-124 kubenswrapper[2552]: I0609 17:43:17.834053 2552 generic.go:356] "Generic (PLEG): container finished" podID="5b6171c4-52fa-4e4c-9769-eca68fe2f0ac" containerID="f47b810d9e2ecde5facf90ea999599786d1d66ba28e1dc8ac2bd7cc592efd09d" exitCode=0 Jun 09 17:43:17.834148 ip-10-0-143-124 kubenswrapper[2552]: I0609 17:43:17.834125 2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73pmj5j" event={"ID":"5b6171c4-52fa-4e4c-9769-eca68fe2f0ac","Type":"ContainerDied","Data":"f47b810d9e2ecde5facf90ea999599786d1d66ba28e1dc8ac2bd7cc592efd09d"} Jun 09 17:43:17.836063 ip-10-0-143-124 kubenswrapper[2552]: I0609 17:43:17.836042 2552 generic.go:356] "Generic (PLEG): container finished" podID="ddd1104d-713f-4dc3-9220-34812e0b2802" containerID="53f866724339c958f06ea0ea8631bc982d59e4eba00bf3164a3bb4e1b5e65783" exitCode=0 Jun 09 17:43:17.836165 ip-10-0-143-124 kubenswrapper[2552]: I0609 17:43:17.836125 2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0hl5dr" event={"ID":"ddd1104d-713f-4dc3-9220-34812e0b2802","Type":"ContainerDied","Data":"53f866724339c958f06ea0ea8631bc982d59e4eba00bf3164a3bb4e1b5e65783"} Jun 09 17:43:17.838173 ip-10-0-143-124 kubenswrapper[2552]: I0609 17:43:17.838152 2552 generic.go:356] "Generic (PLEG): container finished" podID="3fd7a23d-1fbd-4c8f-b102-684ecf696e27" containerID="71c4a729fb68f5f97badc2c29d96e34966ef4c4730ca7635affce0f7afc343e4" exitCode=0 Jun 09 17:43:17.838268 ip-10-0-143-124 kubenswrapper[2552]: I0609 17:43:17.838233 2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7596r2jv" event={"ID":"3fd7a23d-1fbd-4c8f-b102-684ecf696e27","Type":"ContainerDied","Data":"71c4a729fb68f5f97badc2c29d96e34966ef4c4730ca7635affce0f7afc343e4"} Jun 09 17:43:17.840195 ip-10-0-143-124 kubenswrapper[2552]: I0609 17:43:17.840176 2552 generic.go:356] "Generic (PLEG): container finished" podID="3eb06456-961a-44b1-9e2d-963b63644584" containerID="7deeba235ab3372f1f0f96fe8f353cf46b1efdee75ca3bc0289d75cdd5aa6a67" exitCode=0 Jun 09 17:43:17.840279 ip-10-0-143-124 kubenswrapper[2552]: I0609 17:43:17.840210 2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1d9bw2" event={"ID":"3eb06456-961a-44b1-9e2d-963b63644584","Type":"ContainerDied","Data":"7deeba235ab3372f1f0f96fe8f353cf46b1efdee75ca3bc0289d75cdd5aa6a67"} Jun 09 17:43:18.992803 ip-10-0-143-124 kubenswrapper[2552]: I0609 17:43:18.992772 2552 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73pmj5j" Jun 09 17:43:19.050898 ip-10-0-143-124 kubenswrapper[2552]: I0609 17:43:19.050871 2552 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/5b6171c4-52fa-4e4c-9769-eca68fe2f0ac-bundle\") pod \"5b6171c4-52fa-4e4c-9769-eca68fe2f0ac\" (UID: \"5b6171c4-52fa-4e4c-9769-eca68fe2f0ac\") " Jun 09 17:43:19.050996 ip-10-0-143-124 kubenswrapper[2552]: I0609 17:43:19.050922 2552 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/5b6171c4-52fa-4e4c-9769-eca68fe2f0ac-util\") pod \"5b6171c4-52fa-4e4c-9769-eca68fe2f0ac\" (UID: \"5b6171c4-52fa-4e4c-9769-eca68fe2f0ac\") " Jun 09 17:43:19.050996 ip-10-0-143-124 kubenswrapper[2552]: I0609 17:43:19.050989 2552 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-xmt5g\" (UniqueName: \"kubernetes.io/projected/5b6171c4-52fa-4e4c-9769-eca68fe2f0ac-kube-api-access-xmt5g\") pod \"5b6171c4-52fa-4e4c-9769-eca68fe2f0ac\" (UID: \"5b6171c4-52fa-4e4c-9769-eca68fe2f0ac\") " Jun 09 17:43:19.051581 ip-10-0-143-124 kubenswrapper[2552]: I0609 17:43:19.051554 2552 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/5b6171c4-52fa-4e4c-9769-eca68fe2f0ac-bundle" (OuterVolumeSpecName: "bundle") pod "5b6171c4-52fa-4e4c-9769-eca68fe2f0ac" (UID: "5b6171c4-52fa-4e4c-9769-eca68fe2f0ac"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 09 17:43:19.053246 ip-10-0-143-124 kubenswrapper[2552]: I0609 17:43:19.053217 2552 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/5b6171c4-52fa-4e4c-9769-eca68fe2f0ac-kube-api-access-xmt5g" (OuterVolumeSpecName: "kube-api-access-xmt5g") pod "5b6171c4-52fa-4e4c-9769-eca68fe2f0ac" (UID: "5b6171c4-52fa-4e4c-9769-eca68fe2f0ac"). InnerVolumeSpecName "kube-api-access-xmt5g". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 09 17:43:19.056216 ip-10-0-143-124 kubenswrapper[2552]: I0609 17:43:19.056195 2552 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/5b6171c4-52fa-4e4c-9769-eca68fe2f0ac-util" (OuterVolumeSpecName: "util") pod "5b6171c4-52fa-4e4c-9769-eca68fe2f0ac" (UID: "5b6171c4-52fa-4e4c-9769-eca68fe2f0ac"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 09 17:43:19.060311 ip-10-0-143-124 kubenswrapper[2552]: I0609 17:43:19.060291 2552 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1d9bw2" Jun 09 17:43:19.062480 ip-10-0-143-124 kubenswrapper[2552]: I0609 17:43:19.062464 2552 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7596r2jv" Jun 09 17:43:19.065702 ip-10-0-143-124 kubenswrapper[2552]: I0609 17:43:19.065686 2552 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0hl5dr" Jun 09 17:43:19.151756 ip-10-0-143-124 kubenswrapper[2552]: I0609 17:43:19.151675 2552 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/3fd7a23d-1fbd-4c8f-b102-684ecf696e27-util\") pod \"3fd7a23d-1fbd-4c8f-b102-684ecf696e27\" (UID: \"3fd7a23d-1fbd-4c8f-b102-684ecf696e27\") " Jun 09 17:43:19.151756 ip-10-0-143-124 kubenswrapper[2552]: I0609 17:43:19.151734 2552 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-kpbvq\" (UniqueName: \"kubernetes.io/projected/3fd7a23d-1fbd-4c8f-b102-684ecf696e27-kube-api-access-kpbvq\") pod \"3fd7a23d-1fbd-4c8f-b102-684ecf696e27\" (UID: \"3fd7a23d-1fbd-4c8f-b102-684ecf696e27\") " Jun 09 17:43:19.151981 ip-10-0-143-124 kubenswrapper[2552]: I0609 17:43:19.151789 2552 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/ddd1104d-713f-4dc3-9220-34812e0b2802-bundle\") pod \"ddd1104d-713f-4dc3-9220-34812e0b2802\" (UID: \"ddd1104d-713f-4dc3-9220-34812e0b2802\") " Jun 09 17:43:19.151981 ip-10-0-143-124 kubenswrapper[2552]: I0609 17:43:19.151820 2552 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/3eb06456-961a-44b1-9e2d-963b63644584-util\") pod \"3eb06456-961a-44b1-9e2d-963b63644584\" (UID: \"3eb06456-961a-44b1-9e2d-963b63644584\") " Jun 09 17:43:19.151981 ip-10-0-143-124 kubenswrapper[2552]: I0609 17:43:19.151846 2552 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/3fd7a23d-1fbd-4c8f-b102-684ecf696e27-bundle\") pod \"3fd7a23d-1fbd-4c8f-b102-684ecf696e27\" (UID: \"3fd7a23d-1fbd-4c8f-b102-684ecf696e27\") " Jun 09 17:43:19.151981 ip-10-0-143-124 kubenswrapper[2552]: I0609 17:43:19.151882 2552 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/ddd1104d-713f-4dc3-9220-34812e0b2802-util\") pod \"ddd1104d-713f-4dc3-9220-34812e0b2802\" (UID: \"ddd1104d-713f-4dc3-9220-34812e0b2802\") " Jun 09 17:43:19.151981 ip-10-0-143-124 kubenswrapper[2552]: I0609 17:43:19.151931 2552 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-9xshm\" (UniqueName: \"kubernetes.io/projected/ddd1104d-713f-4dc3-9220-34812e0b2802-kube-api-access-9xshm\") pod \"ddd1104d-713f-4dc3-9220-34812e0b2802\" (UID: \"ddd1104d-713f-4dc3-9220-34812e0b2802\") " Jun 09 17:43:19.151981 ip-10-0-143-124 kubenswrapper[2552]: I0609 17:43:19.151966 2552 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/3eb06456-961a-44b1-9e2d-963b63644584-bundle\") pod \"3eb06456-961a-44b1-9e2d-963b63644584\" (UID: \"3eb06456-961a-44b1-9e2d-963b63644584\") " Jun 09 17:43:19.152265 ip-10-0-143-124 kubenswrapper[2552]: I0609 17:43:19.151989 2552 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-bvb5z\" (UniqueName: \"kubernetes.io/projected/3eb06456-961a-44b1-9e2d-963b63644584-kube-api-access-bvb5z\") pod \"3eb06456-961a-44b1-9e2d-963b63644584\" (UID: \"3eb06456-961a-44b1-9e2d-963b63644584\") " Jun 09 17:43:19.152381 ip-10-0-143-124 kubenswrapper[2552]: I0609 17:43:19.152275 2552 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/3fd7a23d-1fbd-4c8f-b102-684ecf696e27-bundle" (OuterVolumeSpecName: "bundle") pod "3fd7a23d-1fbd-4c8f-b102-684ecf696e27" (UID: "3fd7a23d-1fbd-4c8f-b102-684ecf696e27"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 09 17:43:19.152381 ip-10-0-143-124 kubenswrapper[2552]: I0609 17:43:19.152286 2552 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/5b6171c4-52fa-4e4c-9769-eca68fe2f0ac-util\") on node \"ip-10-0-143-124.ec2.internal\" DevicePath \"\"" Jun 09 17:43:19.152381 ip-10-0-143-124 kubenswrapper[2552]: I0609 17:43:19.152328 2552 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-xmt5g\" (UniqueName: \"kubernetes.io/projected/5b6171c4-52fa-4e4c-9769-eca68fe2f0ac-kube-api-access-xmt5g\") on node \"ip-10-0-143-124.ec2.internal\" DevicePath \"\"" Jun 09 17:43:19.152381 ip-10-0-143-124 kubenswrapper[2552]: I0609 17:43:19.152346 2552 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/5b6171c4-52fa-4e4c-9769-eca68fe2f0ac-bundle\") on node \"ip-10-0-143-124.ec2.internal\" DevicePath \"\"" Jun 09 17:43:19.152710 ip-10-0-143-124 kubenswrapper[2552]: I0609 17:43:19.152685 2552 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/ddd1104d-713f-4dc3-9220-34812e0b2802-bundle" (OuterVolumeSpecName: "bundle") pod "ddd1104d-713f-4dc3-9220-34812e0b2802" (UID: "ddd1104d-713f-4dc3-9220-34812e0b2802"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 09 17:43:19.153119 ip-10-0-143-124 kubenswrapper[2552]: I0609 17:43:19.153067 2552 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/3eb06456-961a-44b1-9e2d-963b63644584-bundle" (OuterVolumeSpecName: "bundle") pod "3eb06456-961a-44b1-9e2d-963b63644584" (UID: "3eb06456-961a-44b1-9e2d-963b63644584"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 09 17:43:19.154410 ip-10-0-143-124 kubenswrapper[2552]: I0609 17:43:19.154388 2552 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/3fd7a23d-1fbd-4c8f-b102-684ecf696e27-kube-api-access-kpbvq" (OuterVolumeSpecName: "kube-api-access-kpbvq") pod "3fd7a23d-1fbd-4c8f-b102-684ecf696e27" (UID: "3fd7a23d-1fbd-4c8f-b102-684ecf696e27"). InnerVolumeSpecName "kube-api-access-kpbvq". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 09 17:43:19.154504 ip-10-0-143-124 kubenswrapper[2552]: I0609 17:43:19.154450 2552 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/3eb06456-961a-44b1-9e2d-963b63644584-kube-api-access-bvb5z" (OuterVolumeSpecName: "kube-api-access-bvb5z") pod "3eb06456-961a-44b1-9e2d-963b63644584" (UID: "3eb06456-961a-44b1-9e2d-963b63644584"). InnerVolumeSpecName "kube-api-access-bvb5z". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 09 17:43:19.154560 ip-10-0-143-124 kubenswrapper[2552]: I0609 17:43:19.154511 2552 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/ddd1104d-713f-4dc3-9220-34812e0b2802-kube-api-access-9xshm" (OuterVolumeSpecName: "kube-api-access-9xshm") pod "ddd1104d-713f-4dc3-9220-34812e0b2802" (UID: "ddd1104d-713f-4dc3-9220-34812e0b2802"). InnerVolumeSpecName "kube-api-access-9xshm". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 09 17:43:19.157964 ip-10-0-143-124 kubenswrapper[2552]: I0609 17:43:19.157920 2552 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/3fd7a23d-1fbd-4c8f-b102-684ecf696e27-util" (OuterVolumeSpecName: "util") pod "3fd7a23d-1fbd-4c8f-b102-684ecf696e27" (UID: "3fd7a23d-1fbd-4c8f-b102-684ecf696e27"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 09 17:43:19.161082 ip-10-0-143-124 kubenswrapper[2552]: I0609 17:43:19.161056 2552 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/ddd1104d-713f-4dc3-9220-34812e0b2802-util" (OuterVolumeSpecName: "util") pod "ddd1104d-713f-4dc3-9220-34812e0b2802" (UID: "ddd1104d-713f-4dc3-9220-34812e0b2802"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 09 17:43:19.161201 ip-10-0-143-124 kubenswrapper[2552]: I0609 17:43:19.161185 2552 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/3eb06456-961a-44b1-9e2d-963b63644584-util" (OuterVolumeSpecName: "util") pod "3eb06456-961a-44b1-9e2d-963b63644584" (UID: "3eb06456-961a-44b1-9e2d-963b63644584"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 09 17:43:19.252823 ip-10-0-143-124 kubenswrapper[2552]: I0609 17:43:19.252790 2552 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/ddd1104d-713f-4dc3-9220-34812e0b2802-bundle\") on node \"ip-10-0-143-124.ec2.internal\" DevicePath \"\"" Jun 09 17:43:19.252823 ip-10-0-143-124 kubenswrapper[2552]: I0609 17:43:19.252818 2552 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/3eb06456-961a-44b1-9e2d-963b63644584-util\") on node \"ip-10-0-143-124.ec2.internal\" DevicePath \"\"" Jun 09 17:43:19.252823 ip-10-0-143-124 kubenswrapper[2552]: I0609 17:43:19.252827 2552 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/3fd7a23d-1fbd-4c8f-b102-684ecf696e27-bundle\") on node \"ip-10-0-143-124.ec2.internal\" DevicePath \"\"" Jun 09 17:43:19.253034 ip-10-0-143-124 kubenswrapper[2552]: I0609 17:43:19.252834 2552 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/ddd1104d-713f-4dc3-9220-34812e0b2802-util\") on node \"ip-10-0-143-124.ec2.internal\" DevicePath \"\"" Jun 09 17:43:19.253034 ip-10-0-143-124 kubenswrapper[2552]: I0609 17:43:19.252842 2552 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-9xshm\" (UniqueName: \"kubernetes.io/projected/ddd1104d-713f-4dc3-9220-34812e0b2802-kube-api-access-9xshm\") on node \"ip-10-0-143-124.ec2.internal\" DevicePath \"\"" Jun 09 17:43:19.253034 ip-10-0-143-124 kubenswrapper[2552]: I0609 17:43:19.252851 2552 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/3eb06456-961a-44b1-9e2d-963b63644584-bundle\") on node \"ip-10-0-143-124.ec2.internal\" DevicePath \"\"" Jun 09 17:43:19.253034 ip-10-0-143-124 kubenswrapper[2552]: I0609 17:43:19.252859 2552 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-bvb5z\" (UniqueName: \"kubernetes.io/projected/3eb06456-961a-44b1-9e2d-963b63644584-kube-api-access-bvb5z\") on node \"ip-10-0-143-124.ec2.internal\" DevicePath \"\"" Jun 09 17:43:19.253034 ip-10-0-143-124 kubenswrapper[2552]: I0609 17:43:19.252867 2552 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/3fd7a23d-1fbd-4c8f-b102-684ecf696e27-util\") on node \"ip-10-0-143-124.ec2.internal\" DevicePath \"\"" Jun 09 17:43:19.253034 ip-10-0-143-124 kubenswrapper[2552]: I0609 17:43:19.252876 2552 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-kpbvq\" (UniqueName: \"kubernetes.io/projected/3fd7a23d-1fbd-4c8f-b102-684ecf696e27-kube-api-access-kpbvq\") on node \"ip-10-0-143-124.ec2.internal\" DevicePath \"\"" Jun 09 17:43:19.854380 ip-10-0-143-124 kubenswrapper[2552]: I0609 17:43:19.854343 2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7596r2jv" event={"ID":"3fd7a23d-1fbd-4c8f-b102-684ecf696e27","Type":"ContainerDied","Data":"b458a06b4bf1393484ee22a5e539b26c4d8dc3f30afeb349df90c97d20a67034"} Jun 09 17:43:19.854574 ip-10-0-143-124 kubenswrapper[2552]: I0609 17:43:19.854396 2552 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="b458a06b4bf1393484ee22a5e539b26c4d8dc3f30afeb349df90c97d20a67034" Jun 09 17:43:19.854574 ip-10-0-143-124 kubenswrapper[2552]: I0609 17:43:19.854353 2552 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7596r2jv" Jun 09 17:43:19.856260 ip-10-0-143-124 kubenswrapper[2552]: I0609 17:43:19.856240 2552 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1d9bw2" Jun 09 17:43:19.856371 ip-10-0-143-124 kubenswrapper[2552]: I0609 17:43:19.856271 2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1d9bw2" event={"ID":"3eb06456-961a-44b1-9e2d-963b63644584","Type":"ContainerDied","Data":"e14c4b9516074a77d219c1075ef77a6c887503650a6d5ef54014dcc49dabc50f"} Jun 09 17:43:19.856371 ip-10-0-143-124 kubenswrapper[2552]: I0609 17:43:19.856317 2552 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="e14c4b9516074a77d219c1075ef77a6c887503650a6d5ef54014dcc49dabc50f" Jun 09 17:43:19.858118 ip-10-0-143-124 kubenswrapper[2552]: I0609 17:43:19.858101 2552 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73pmj5j" Jun 09 17:43:19.858118 ip-10-0-143-124 kubenswrapper[2552]: I0609 17:43:19.858105 2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73pmj5j" event={"ID":"5b6171c4-52fa-4e4c-9769-eca68fe2f0ac","Type":"ContainerDied","Data":"c7b6ab97e7d1296ef2837fb0818ac85bd70f57a31be35eefa65cb1962dd7528d"} Jun 09 17:43:19.858268 ip-10-0-143-124 kubenswrapper[2552]: I0609 17:43:19.858140 2552 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="c7b6ab97e7d1296ef2837fb0818ac85bd70f57a31be35eefa65cb1962dd7528d" Jun 09 17:43:19.860129 ip-10-0-143-124 kubenswrapper[2552]: I0609 17:43:19.860112 2552 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0hl5dr" Jun 09 17:43:19.860239 ip-10-0-143-124 kubenswrapper[2552]: I0609 17:43:19.860137 2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0hl5dr" event={"ID":"ddd1104d-713f-4dc3-9220-34812e0b2802","Type":"ContainerDied","Data":"23dd144b9896e5037de5ae80e713247999857368b239cd31947f48fb6a2645aa"} Jun 09 17:43:19.860239 ip-10-0-143-124 kubenswrapper[2552]: I0609 17:43:19.860169 2552 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="23dd144b9896e5037de5ae80e713247999857368b239cd31947f48fb6a2645aa" Jun 09 17:43:25.966781 ip-10-0-143-124 kubenswrapper[2552]: I0609 17:43:25.966745 2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gctfs_8563ebab-ebdd-4d68-bce1-78d2a7f62992/konnectivity-agent/0.log" limit=1024 Jun 09 17:43:26.571431 ip-10-0-143-124 kubenswrapper[2552]: I0609 17:43:26.571396 2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gctfs_8563ebab-ebdd-4d68-bce1-78d2a7f62992/konnectivity-agent/0.log" limit=1024 Jun 09 17:43:27.605620 ip-10-0-143-124 kubenswrapper[2552]: I0609 17:43:27.605560 2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gctfs_8563ebab-ebdd-4d68-bce1-78d2a7f62992/konnectivity-agent/0.log" limit=1024 Jun 09 17:43:27.705892 ip-10-0-143-124 kubenswrapper[2552]: I0609 17:43:27.705862 2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gctfs_8563ebab-ebdd-4d68-bce1-78d2a7f62992/konnectivity-agent/0.log" limit=1024 Jun 09 17:43:29.671275 ip-10-0-143-124 kubenswrapper[2552]: I0609 17:43:29.671229 2552 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-7b7f9c877b-d52fh"] Jun 09 17:43:29.671758 ip-10-0-143-124 kubenswrapper[2552]: I0609 17:43:29.671712 2552 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="ddd1104d-713f-4dc3-9220-34812e0b2802" containerName="util" Jun 09 17:43:29.671758 ip-10-0-143-124 kubenswrapper[2552]: I0609 17:43:29.671731 2552 state_mem.go:107] "Deleted CPUSet assignment" podUID="ddd1104d-713f-4dc3-9220-34812e0b2802" containerName="util" Jun 09 17:43:29.671758 ip-10-0-143-124 kubenswrapper[2552]: I0609 17:43:29.671744 2552 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="3eb06456-961a-44b1-9e2d-963b63644584" containerName="extract" Jun 09 17:43:29.671758 ip-10-0-143-124 kubenswrapper[2552]: I0609 17:43:29.671752 2552 state_mem.go:107] "Deleted CPUSet assignment" podUID="3eb06456-961a-44b1-9e2d-963b63644584" containerName="extract" Jun 09 17:43:29.671982 ip-10-0-143-124 kubenswrapper[2552]: I0609 17:43:29.671764 2552 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="5b6171c4-52fa-4e4c-9769-eca68fe2f0ac" containerName="extract" Jun 09 17:43:29.671982 ip-10-0-143-124 kubenswrapper[2552]: I0609 17:43:29.671773 2552 state_mem.go:107] "Deleted CPUSet assignment" podUID="5b6171c4-52fa-4e4c-9769-eca68fe2f0ac" containerName="extract" Jun 09 17:43:29.671982 ip-10-0-143-124 kubenswrapper[2552]: I0609 17:43:29.671798 2552 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="5b6171c4-52fa-4e4c-9769-eca68fe2f0ac" containerName="util" Jun 09 17:43:29.671982 ip-10-0-143-124 kubenswrapper[2552]: I0609 17:43:29.671807 2552 state_mem.go:107] "Deleted CPUSet assignment" podUID="5b6171c4-52fa-4e4c-9769-eca68fe2f0ac" containerName="util" Jun 09 17:43:29.671982 ip-10-0-143-124 kubenswrapper[2552]: I0609 17:43:29.671817 2552 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="3eb06456-961a-44b1-9e2d-963b63644584" containerName="util" Jun 09 17:43:29.671982 ip-10-0-143-124 kubenswrapper[2552]: I0609 17:43:29.671825 2552 state_mem.go:107] "Deleted CPUSet assignment" podUID="3eb06456-961a-44b1-9e2d-963b63644584" containerName="util" Jun 09 17:43:29.671982 ip-10-0-143-124 kubenswrapper[2552]: I0609 17:43:29.671834 2552 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="3fd7a23d-1fbd-4c8f-b102-684ecf696e27" containerName="util" Jun 09 17:43:29.671982 ip-10-0-143-124 kubenswrapper[2552]: I0609 17:43:29.671843 2552 state_mem.go:107] "Deleted CPUSet assignment" podUID="3fd7a23d-1fbd-4c8f-b102-684ecf696e27" containerName="util" Jun 09 17:43:29.671982 ip-10-0-143-124 kubenswrapper[2552]: I0609 17:43:29.671851 2552 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="5b6171c4-52fa-4e4c-9769-eca68fe2f0ac" containerName="pull" Jun 09 17:43:29.671982 ip-10-0-143-124 kubenswrapper[2552]: I0609 17:43:29.671859 2552 state_mem.go:107] "Deleted CPUSet assignment" podUID="5b6171c4-52fa-4e4c-9769-eca68fe2f0ac" containerName="pull" Jun 09 17:43:29.671982 ip-10-0-143-124 kubenswrapper[2552]: I0609 17:43:29.671871 2552 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="ddd1104d-713f-4dc3-9220-34812e0b2802" containerName="pull" Jun 09 17:43:29.671982 ip-10-0-143-124 kubenswrapper[2552]: I0609 17:43:29.671881 2552 state_mem.go:107] "Deleted CPUSet assignment" podUID="ddd1104d-713f-4dc3-9220-34812e0b2802" containerName="pull" Jun 09 17:43:29.671982 ip-10-0-143-124 kubenswrapper[2552]: I0609 17:43:29.671892 2552 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="3fd7a23d-1fbd-4c8f-b102-684ecf696e27" containerName="pull" Jun 09 17:43:29.671982 ip-10-0-143-124 kubenswrapper[2552]: I0609 17:43:29.671901 2552 state_mem.go:107] "Deleted CPUSet assignment" podUID="3fd7a23d-1fbd-4c8f-b102-684ecf696e27" containerName="pull" Jun 09 17:43:29.671982 ip-10-0-143-124 kubenswrapper[2552]: I0609 17:43:29.671910 2552 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="ddd1104d-713f-4dc3-9220-34812e0b2802" containerName="extract" Jun 09 17:43:29.671982 ip-10-0-143-124 kubenswrapper[2552]: I0609 17:43:29.671920 2552 state_mem.go:107] "Deleted CPUSet assignment" podUID="ddd1104d-713f-4dc3-9220-34812e0b2802" containerName="extract" Jun 09 17:43:29.671982 ip-10-0-143-124 kubenswrapper[2552]: I0609 17:43:29.671933 2552 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="3eb06456-961a-44b1-9e2d-963b63644584" containerName="pull" Jun 09 17:43:29.671982 ip-10-0-143-124 kubenswrapper[2552]: I0609 17:43:29.671940 2552 state_mem.go:107] "Deleted CPUSet assignment" podUID="3eb06456-961a-44b1-9e2d-963b63644584" containerName="pull" Jun 09 17:43:29.671982 ip-10-0-143-124 kubenswrapper[2552]: I0609 17:43:29.671960 2552 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="3fd7a23d-1fbd-4c8f-b102-684ecf696e27" containerName="extract" Jun 09 17:43:29.671982 ip-10-0-143-124 kubenswrapper[2552]: I0609 17:43:29.671968 2552 state_mem.go:107] "Deleted CPUSet assignment" podUID="3fd7a23d-1fbd-4c8f-b102-684ecf696e27" containerName="extract" Jun 09 17:43:29.672912 ip-10-0-143-124 kubenswrapper[2552]: I0609 17:43:29.672048 2552 memory_manager.go:368] "RemoveStaleState removing state" podUID="3fd7a23d-1fbd-4c8f-b102-684ecf696e27" containerName="extract" Jun 09 17:43:29.672912 ip-10-0-143-124 kubenswrapper[2552]: I0609 17:43:29.672059 2552 memory_manager.go:368] "RemoveStaleState removing state" podUID="3eb06456-961a-44b1-9e2d-963b63644584" containerName="extract" Jun 09 17:43:29.672912 ip-10-0-143-124 kubenswrapper[2552]: I0609 17:43:29.672074 2552 memory_manager.go:368] "RemoveStaleState removing state" podUID="5b6171c4-52fa-4e4c-9769-eca68fe2f0ac" containerName="extract" Jun 09 17:43:29.672912 ip-10-0-143-124 kubenswrapper[2552]: I0609 17:43:29.672084 2552 memory_manager.go:368] "RemoveStaleState removing state" podUID="ddd1104d-713f-4dc3-9220-34812e0b2802" containerName="extract" Jun 09 17:43:29.676657 ip-10-0-143-124 kubenswrapper[2552]: I0609 17:43:29.676636 2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-7b7f9c877b-d52fh" Jun 09 17:43:29.687954 ip-10-0-143-124 kubenswrapper[2552]: I0609 17:43:29.687927 2552 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-7b7f9c877b-d52fh"] Jun 09 17:43:29.737262 ip-10-0-143-124 kubenswrapper[2552]: I0609 17:43:29.737233 2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gctfs_8563ebab-ebdd-4d68-bce1-78d2a7f62992/konnectivity-agent/0.log" limit=1024 Jun 09 17:43:29.747520 ip-10-0-143-124 kubenswrapper[2552]: I0609 17:43:29.747501 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/c6ec9e7f-f33a-4df6-92e0-c6dc86058013-console-oauth-config\") pod \"console-7b7f9c877b-d52fh\" (UID: \"c6ec9e7f-f33a-4df6-92e0-c6dc86058013\") " pod="openshift-console/console-7b7f9c877b-d52fh" Jun 09 17:43:29.747637 ip-10-0-143-124 kubenswrapper[2552]: I0609 17:43:29.747530 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/c6ec9e7f-f33a-4df6-92e0-c6dc86058013-trusted-ca-bundle\") pod \"console-7b7f9c877b-d52fh\" (UID: \"c6ec9e7f-f33a-4df6-92e0-c6dc86058013\") " pod="openshift-console/console-7b7f9c877b-d52fh" Jun 09 17:43:29.747637 ip-10-0-143-124 kubenswrapper[2552]: I0609 17:43:29.747554 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/c6ec9e7f-f33a-4df6-92e0-c6dc86058013-service-ca\") pod \"console-7b7f9c877b-d52fh\" (UID: \"c6ec9e7f-f33a-4df6-92e0-c6dc86058013\") " pod="openshift-console/console-7b7f9c877b-d52fh" Jun 09 17:43:29.747728 ip-10-0-143-124 kubenswrapper[2552]: I0609 17:43:29.747656 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/c6ec9e7f-f33a-4df6-92e0-c6dc86058013-oauth-serving-cert\") pod \"console-7b7f9c877b-d52fh\" (UID: \"c6ec9e7f-f33a-4df6-92e0-c6dc86058013\") " pod="openshift-console/console-7b7f9c877b-d52fh" Jun 09 17:43:29.747728 ip-10-0-143-124 kubenswrapper[2552]: I0609 17:43:29.747720 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/c6ec9e7f-f33a-4df6-92e0-c6dc86058013-console-serving-cert\") pod \"console-7b7f9c877b-d52fh\" (UID: \"c6ec9e7f-f33a-4df6-92e0-c6dc86058013\") " pod="openshift-console/console-7b7f9c877b-d52fh" Jun 09 17:43:29.747810 ip-10-0-143-124 kubenswrapper[2552]: I0609 17:43:29.747749 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7swjs\" (UniqueName: \"kubernetes.io/projected/c6ec9e7f-f33a-4df6-92e0-c6dc86058013-kube-api-access-7swjs\") pod \"console-7b7f9c877b-d52fh\" (UID: \"c6ec9e7f-f33a-4df6-92e0-c6dc86058013\") " pod="openshift-console/console-7b7f9c877b-d52fh" Jun 09 17:43:29.747810 ip-10-0-143-124 kubenswrapper[2552]: I0609 17:43:29.747776 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/c6ec9e7f-f33a-4df6-92e0-c6dc86058013-console-config\") pod \"console-7b7f9c877b-d52fh\" (UID: \"c6ec9e7f-f33a-4df6-92e0-c6dc86058013\") " pod="openshift-console/console-7b7f9c877b-d52fh" Jun 09 17:43:29.848865 ip-10-0-143-124 kubenswrapper[2552]: I0609 17:43:29.848833 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/c6ec9e7f-f33a-4df6-92e0-c6dc86058013-oauth-serving-cert\") pod \"console-7b7f9c877b-d52fh\" (UID: \"c6ec9e7f-f33a-4df6-92e0-c6dc86058013\") " pod="openshift-console/console-7b7f9c877b-d52fh" Jun 09 17:43:29.849007 ip-10-0-143-124 kubenswrapper[2552]: I0609 17:43:29.848892 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/c6ec9e7f-f33a-4df6-92e0-c6dc86058013-console-serving-cert\") pod \"console-7b7f9c877b-d52fh\" (UID: \"c6ec9e7f-f33a-4df6-92e0-c6dc86058013\") " pod="openshift-console/console-7b7f9c877b-d52fh" Jun 09 17:43:29.849007 ip-10-0-143-124 kubenswrapper[2552]: I0609 17:43:29.848910 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7swjs\" (UniqueName: \"kubernetes.io/projected/c6ec9e7f-f33a-4df6-92e0-c6dc86058013-kube-api-access-7swjs\") pod \"console-7b7f9c877b-d52fh\" (UID: \"c6ec9e7f-f33a-4df6-92e0-c6dc86058013\") " pod="openshift-console/console-7b7f9c877b-d52fh" Jun 09 17:43:29.849007 ip-10-0-143-124 kubenswrapper[2552]: I0609 17:43:29.848927 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/c6ec9e7f-f33a-4df6-92e0-c6dc86058013-console-config\") pod \"console-7b7f9c877b-d52fh\" (UID: \"c6ec9e7f-f33a-4df6-92e0-c6dc86058013\") " pod="openshift-console/console-7b7f9c877b-d52fh" Jun 09 17:43:29.849169 ip-10-0-143-124 kubenswrapper[2552]: I0609 17:43:29.849048 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/c6ec9e7f-f33a-4df6-92e0-c6dc86058013-console-oauth-config\") pod \"console-7b7f9c877b-d52fh\" (UID: \"c6ec9e7f-f33a-4df6-92e0-c6dc86058013\") " pod="openshift-console/console-7b7f9c877b-d52fh" Jun 09 17:43:29.849169 ip-10-0-143-124 kubenswrapper[2552]: I0609 17:43:29.849096 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/c6ec9e7f-f33a-4df6-92e0-c6dc86058013-trusted-ca-bundle\") pod \"console-7b7f9c877b-d52fh\" (UID: \"c6ec9e7f-f33a-4df6-92e0-c6dc86058013\") " pod="openshift-console/console-7b7f9c877b-d52fh" Jun 09 17:43:29.849169 ip-10-0-143-124 kubenswrapper[2552]: I0609 17:43:29.849121 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/c6ec9e7f-f33a-4df6-92e0-c6dc86058013-service-ca\") pod \"console-7b7f9c877b-d52fh\" (UID: \"c6ec9e7f-f33a-4df6-92e0-c6dc86058013\") " pod="openshift-console/console-7b7f9c877b-d52fh" Jun 09 17:43:29.849674 ip-10-0-143-124 kubenswrapper[2552]: I0609 17:43:29.849651 2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/c6ec9e7f-f33a-4df6-92e0-c6dc86058013-oauth-serving-cert\") pod \"console-7b7f9c877b-d52fh\" (UID: \"c6ec9e7f-f33a-4df6-92e0-c6dc86058013\") " pod="openshift-console/console-7b7f9c877b-d52fh" Jun 09 17:43:29.849674 ip-10-0-143-124 kubenswrapper[2552]: I0609 17:43:29.849668 2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/c6ec9e7f-f33a-4df6-92e0-c6dc86058013-console-config\") pod \"console-7b7f9c877b-d52fh\" (UID: \"c6ec9e7f-f33a-4df6-92e0-c6dc86058013\") " pod="openshift-console/console-7b7f9c877b-d52fh" Jun 09 17:43:29.849867 ip-10-0-143-124 kubenswrapper[2552]: I0609 17:43:29.849844 2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/c6ec9e7f-f33a-4df6-92e0-c6dc86058013-service-ca\") pod \"console-7b7f9c877b-d52fh\" (UID: \"c6ec9e7f-f33a-4df6-92e0-c6dc86058013\") " pod="openshift-console/console-7b7f9c877b-d52fh" Jun 09 17:43:29.849948 ip-10-0-143-124 kubenswrapper[2552]: I0609 17:43:29.849930 2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/c6ec9e7f-f33a-4df6-92e0-c6dc86058013-trusted-ca-bundle\") pod \"console-7b7f9c877b-d52fh\" (UID: \"c6ec9e7f-f33a-4df6-92e0-c6dc86058013\") " pod="openshift-console/console-7b7f9c877b-d52fh" Jun 09 17:43:29.851336 ip-10-0-143-124 kubenswrapper[2552]: I0609 17:43:29.851310 2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/c6ec9e7f-f33a-4df6-92e0-c6dc86058013-console-serving-cert\") pod \"console-7b7f9c877b-d52fh\" (UID: \"c6ec9e7f-f33a-4df6-92e0-c6dc86058013\") " pod="openshift-console/console-7b7f9c877b-d52fh" Jun 09 17:43:29.851415 ip-10-0-143-124 kubenswrapper[2552]: I0609 17:43:29.851370 2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/c6ec9e7f-f33a-4df6-92e0-c6dc86058013-console-oauth-config\") pod \"console-7b7f9c877b-d52fh\" (UID: \"c6ec9e7f-f33a-4df6-92e0-c6dc86058013\") " pod="openshift-console/console-7b7f9c877b-d52fh" Jun 09 17:43:29.856767 ip-10-0-143-124 kubenswrapper[2552]: I0609 17:43:29.856742 2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-7swjs\" (UniqueName: \"kubernetes.io/projected/c6ec9e7f-f33a-4df6-92e0-c6dc86058013-kube-api-access-7swjs\") pod \"console-7b7f9c877b-d52fh\" (UID: \"c6ec9e7f-f33a-4df6-92e0-c6dc86058013\") " pod="openshift-console/console-7b7f9c877b-d52fh" Jun 09 17:43:29.871698 ip-10-0-143-124 kubenswrapper[2552]: I0609 17:43:29.871672 2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gctfs_8563ebab-ebdd-4d68-bce1-78d2a7f62992/konnectivity-agent/0.log" limit=1024 Jun 09 17:43:29.986020 ip-10-0-143-124 kubenswrapper[2552]: I0609 17:43:29.985947 2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-7b7f9c877b-d52fh" Jun 09 17:43:29.988009 ip-10-0-143-124 kubenswrapper[2552]: I0609 17:43:29.987983 2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gctfs_8563ebab-ebdd-4d68-bce1-78d2a7f62992/konnectivity-agent/0.log" limit=1024 Jun 09 17:43:30.131109 ip-10-0-143-124 kubenswrapper[2552]: I0609 17:43:30.131079 2552 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-7b7f9c877b-d52fh"] Jun 09 17:43:30.132566 ip-10-0-143-124 kubenswrapper[2552]: W0609 17:43:30.132537 2552 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc6ec9e7f_f33a_4df6_92e0_c6dc86058013.slice/crio-ae928688fe2f3156036ab3a9e94348decbe446a874a8bf06d80de484c8c7bab5 WatchSource:0}: Error finding container ae928688fe2f3156036ab3a9e94348decbe446a874a8bf06d80de484c8c7bab5: Status 404 returned error can't find the container with id ae928688fe2f3156036ab3a9e94348decbe446a874a8bf06d80de484c8c7bab5 Jun 09 17:43:30.477864 ip-10-0-143-124 kubenswrapper[2552]: I0609 17:43:30.477827 2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gctfs_8563ebab-ebdd-4d68-bce1-78d2a7f62992/konnectivity-agent/0.log" limit=1024 Jun 09 17:43:30.578242 ip-10-0-143-124 kubenswrapper[2552]: I0609 17:43:30.578204 2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gctfs_8563ebab-ebdd-4d68-bce1-78d2a7f62992/konnectivity-agent/0.log" limit=1024 Jun 09 17:43:30.795021 ip-10-0-143-124 kubenswrapper[2552]: I0609 17:43:30.794991 2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gctfs_8563ebab-ebdd-4d68-bce1-78d2a7f62992/konnectivity-agent/0.log" limit=1024 Jun 09 17:43:30.916734 ip-10-0-143-124 kubenswrapper[2552]: I0609 17:43:30.916697 2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-7b7f9c877b-d52fh" event={"ID":"c6ec9e7f-f33a-4df6-92e0-c6dc86058013","Type":"ContainerStarted","Data":"04b213964f0cde7d821b6eda8792ac263e1f7ee5f252c95e711f4ec4f724bf85"} Jun 09 17:43:30.916877 ip-10-0-143-124 kubenswrapper[2552]: I0609 17:43:30.916750 2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-7b7f9c877b-d52fh" event={"ID":"c6ec9e7f-f33a-4df6-92e0-c6dc86058013","Type":"ContainerStarted","Data":"ae928688fe2f3156036ab3a9e94348decbe446a874a8bf06d80de484c8c7bab5"} Jun 09 17:43:30.936613 ip-10-0-143-124 kubenswrapper[2552]: I0609 17:43:30.936540 2552 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-7b7f9c877b-d52fh" podStartSLOduration=1.936524556 podStartE2EDuration="1.936524556s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-09 17:43:29 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-09 17:43:30.93578687 +0000 UTC m=+615.035689521" watchObservedRunningTime="2026-06-09 17:43:30.936524556 +0000 UTC m=+615.036427206" Jun 09 17:43:32.653928 ip-10-0-143-124 kubenswrapper[2552]: I0609 17:43:32.653894 2552 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-7nlz9"] Jun 09 17:43:32.656566 ip-10-0-143-124 kubenswrapper[2552]: I0609 17:43:32.656548 2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-7nlz9" Jun 09 17:43:32.659195 ip-10-0-143-124 kubenswrapper[2552]: I0609 17:43:32.659173 2552 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"kube-root-ca.crt\"" Jun 09 17:43:32.660145 ip-10-0-143-124 kubenswrapper[2552]: I0609 17:43:32.660126 2552 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"openshift-service-ca.crt\"" Jun 09 17:43:32.660239 ip-10-0-143-124 kubenswrapper[2552]: I0609 17:43:32.660126 2552 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"limitador-operator-controller-manager-dockercfg-ps8cv\"" Jun 09 17:43:32.670924 ip-10-0-143-124 kubenswrapper[2552]: I0609 17:43:32.670903 2552 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-7nlz9"] Jun 09 17:43:32.777799 ip-10-0-143-124 kubenswrapper[2552]: I0609 17:43:32.777764 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-fxjld\" (UniqueName: \"kubernetes.io/projected/c62442cb-f7f9-4ca1-b1a1-fc244f490bfa-kube-api-access-fxjld\") pod \"limitador-operator-controller-manager-859d7b78bd-7nlz9\" (UID: \"c62442cb-f7f9-4ca1-b1a1-fc244f490bfa\") " pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-7nlz9" Jun 09 17:43:32.878197 ip-10-0-143-124 kubenswrapper[2552]: I0609 17:43:32.878162 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-fxjld\" (UniqueName: \"kubernetes.io/projected/c62442cb-f7f9-4ca1-b1a1-fc244f490bfa-kube-api-access-fxjld\") pod \"limitador-operator-controller-manager-859d7b78bd-7nlz9\" (UID: \"c62442cb-f7f9-4ca1-b1a1-fc244f490bfa\") " pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-7nlz9" Jun 09 17:43:32.890494 ip-10-0-143-124 kubenswrapper[2552]: I0609 17:43:32.890459 2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-fxjld\" (UniqueName: \"kubernetes.io/projected/c62442cb-f7f9-4ca1-b1a1-fc244f490bfa-kube-api-access-fxjld\") pod \"limitador-operator-controller-manager-859d7b78bd-7nlz9\" (UID: \"c62442cb-f7f9-4ca1-b1a1-fc244f490bfa\") " pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-7nlz9" Jun 09 17:43:32.967885 ip-10-0-143-124 kubenswrapper[2552]: I0609 17:43:32.967808 2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-7nlz9" Jun 09 17:43:33.101522 ip-10-0-143-124 kubenswrapper[2552]: I0609 17:43:33.101488 2552 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-7nlz9"] Jun 09 17:43:33.102921 ip-10-0-143-124 kubenswrapper[2552]: W0609 17:43:33.102896 2552 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc62442cb_f7f9_4ca1_b1a1_fc244f490bfa.slice/crio-e56c65af7078fb56bb5adfca8d91b5810b4d8f90e5daba0e514918b414f40df4 WatchSource:0}: Error finding container e56c65af7078fb56bb5adfca8d91b5810b4d8f90e5daba0e514918b414f40df4: Status 404 returned error can't find the container with id e56c65af7078fb56bb5adfca8d91b5810b4d8f90e5daba0e514918b414f40df4 Jun 09 17:43:33.380021 ip-10-0-143-124 kubenswrapper[2552]: I0609 17:43:33.379981 2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gctfs_8563ebab-ebdd-4d68-bce1-78d2a7f62992/konnectivity-agent/0.log" limit=1024 Jun 09 17:43:33.936464 ip-10-0-143-124 kubenswrapper[2552]: I0609 17:43:33.936415 2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-7nlz9" event={"ID":"c62442cb-f7f9-4ca1-b1a1-fc244f490bfa","Type":"ContainerStarted","Data":"e56c65af7078fb56bb5adfca8d91b5810b4d8f90e5daba0e514918b414f40df4"} Jun 09 17:43:34.860360 ip-10-0-143-124 kubenswrapper[2552]: I0609 17:43:34.860311 2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gctfs_8563ebab-ebdd-4d68-bce1-78d2a7f62992/konnectivity-agent/0.log" limit=1024 Jun 09 17:43:35.948292 ip-10-0-143-124 kubenswrapper[2552]: I0609 17:43:35.948254 2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-7nlz9" event={"ID":"c62442cb-f7f9-4ca1-b1a1-fc244f490bfa","Type":"ContainerStarted","Data":"d7fc018bc766f5bf7b39775d4dfa5f486dab16aec6ca104368ffb4cbc03de11f"} Jun 09 17:43:35.948717 ip-10-0-143-124 kubenswrapper[2552]: I0609 17:43:35.948342 2552 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-7nlz9" Jun 09 17:43:35.970508 ip-10-0-143-124 kubenswrapper[2552]: I0609 17:43:35.970447 2552 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-7nlz9" podStartSLOduration=2.137259845 podStartE2EDuration="3.970429108s" totalImagesPullingTime="1.833169263s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-09 17:43:32 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-09 17:43:35.970079974 +0000 UTC m=+620.069982635" watchObservedRunningTime="2026-06-09 17:43:35.970429108 +0000 UTC m=+620.070331850" Jun 09 17:43:36.225298 ip-10-0-143-124 kubenswrapper[2552]: I0609 17:43:36.225205 2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gctfs_8563ebab-ebdd-4d68-bce1-78d2a7f62992/konnectivity-agent/0.log" limit=1024 Jun 09 17:43:37.596533 ip-10-0-143-124 kubenswrapper[2552]: I0609 17:43:37.596493 2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gctfs_8563ebab-ebdd-4d68-bce1-78d2a7f62992/konnectivity-agent/0.log" limit=1024 Jun 09 17:43:38.867487 ip-10-0-143-124 kubenswrapper[2552]: I0609 17:43:38.867447 2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gctfs_8563ebab-ebdd-4d68-bce1-78d2a7f62992/konnectivity-agent/0.log" limit=1024 Jun 09 17:43:39.986289 ip-10-0-143-124 kubenswrapper[2552]: I0609 17:43:39.986254 2552 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-7b7f9c877b-d52fh" Jun 09 17:43:39.986709 ip-10-0-143-124 kubenswrapper[2552]: I0609 17:43:39.986306 2552 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-7b7f9c877b-d52fh" Jun 09 17:43:39.991034 ip-10-0-143-124 kubenswrapper[2552]: I0609 17:43:39.991013 2552 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-7b7f9c877b-d52fh" Jun 09 17:43:40.798260 ip-10-0-143-124 kubenswrapper[2552]: I0609 17:43:40.798222 2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gctfs_8563ebab-ebdd-4d68-bce1-78d2a7f62992/konnectivity-agent/0.log" limit=1024 Jun 09 17:43:40.917227 ip-10-0-143-124 kubenswrapper[2552]: I0609 17:43:40.917190 2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gctfs_8563ebab-ebdd-4d68-bce1-78d2a7f62992/konnectivity-agent/0.log" limit=1024 Jun 09 17:43:40.977484 ip-10-0-143-124 kubenswrapper[2552]: I0609 17:43:40.977459 2552 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-7b7f9c877b-d52fh" Jun 09 17:43:41.057342 ip-10-0-143-124 kubenswrapper[2552]: I0609 17:43:41.057261 2552 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-8697ccbf4b-qqwdj"] Jun 09 17:43:41.192877 ip-10-0-143-124 kubenswrapper[2552]: I0609 17:43:41.192816 2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gctfs_8563ebab-ebdd-4d68-bce1-78d2a7f62992/konnectivity-agent/0.log" limit=1024 Jun 09 17:43:41.296376 ip-10-0-143-124 kubenswrapper[2552]: I0609 17:43:41.296341 2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gctfs_8563ebab-ebdd-4d68-bce1-78d2a7f62992/konnectivity-agent/0.log" limit=1024 Jun 09 17:43:41.393040 ip-10-0-143-124 kubenswrapper[2552]: I0609 17:43:41.392946 2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gctfs_8563ebab-ebdd-4d68-bce1-78d2a7f62992/konnectivity-agent/0.log" limit=1024 Jun 09 17:43:44.829953 ip-10-0-143-124 kubenswrapper[2552]: I0609 17:43:44.829915 2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gctfs_8563ebab-ebdd-4d68-bce1-78d2a7f62992/konnectivity-agent/0.log" limit=1024 Jun 09 17:43:44.981366 ip-10-0-143-124 kubenswrapper[2552]: I0609 17:43:44.981326 2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gctfs_8563ebab-ebdd-4d68-bce1-78d2a7f62992/konnectivity-agent/0.log" limit=1024 Jun 09 17:43:46.956237 ip-10-0-143-124 kubenswrapper[2552]: I0609 17:43:46.956204 2552 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-7nlz9" Jun 09 17:43:47.166975 ip-10-0-143-124 kubenswrapper[2552]: I0609 17:43:47.166935 2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gctfs_8563ebab-ebdd-4d68-bce1-78d2a7f62992/konnectivity-agent/0.log" limit=1024 Jun 09 17:43:47.395419 ip-10-0-143-124 kubenswrapper[2552]: I0609 17:43:47.395380 2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gctfs_8563ebab-ebdd-4d68-bce1-78d2a7f62992/konnectivity-agent/0.log" limit=1024 Jun 09 17:43:47.982829 ip-10-0-143-124 kubenswrapper[2552]: I0609 17:43:47.982790 2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gctfs_8563ebab-ebdd-4d68-bce1-78d2a7f62992/konnectivity-agent/0.log" limit=1024 Jun 09 17:43:48.083679 ip-10-0-143-124 kubenswrapper[2552]: I0609 17:43:48.083648 2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gctfs_8563ebab-ebdd-4d68-bce1-78d2a7f62992/konnectivity-agent/0.log" limit=1024 Jun 09 17:43:54.453275 ip-10-0-143-124 kubenswrapper[2552]: I0609 17:43:54.453244 2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gctfs_8563ebab-ebdd-4d68-bce1-78d2a7f62992/konnectivity-agent/0.log" limit=1024 Jun 09 17:43:54.548991 ip-10-0-143-124 kubenswrapper[2552]: I0609 17:43:54.548959 2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gctfs_8563ebab-ebdd-4d68-bce1-78d2a7f62992/konnectivity-agent/0.log" limit=1024 Jun 09 17:43:58.001049 ip-10-0-143-124 kubenswrapper[2552]: I0609 17:43:58.001007 2552 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-7nlz9"] Jun 09 17:43:58.001542 ip-10-0-143-124 kubenswrapper[2552]: I0609 17:43:58.001201 2552 kuberuntime_container.go:872] "Killing container with a grace period" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-7nlz9" podUID="c62442cb-f7f9-4ca1-b1a1-fc244f490bfa" containerName="manager" containerID="cri-o://d7fc018bc766f5bf7b39775d4dfa5f486dab16aec6ca104368ffb4cbc03de11f" gracePeriod=2 Jun 09 17:43:58.010496 ip-10-0-143-124 kubenswrapper[2552]: I0609 17:43:58.010469 2552 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-7nlz9"] Jun 09 17:43:58.051712 ip-10-0-143-124 kubenswrapper[2552]: I0609 17:43:58.051678 2552 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-jkksq"] Jun 09 17:43:58.052096 ip-10-0-143-124 kubenswrapper[2552]: I0609 17:43:58.052079 2552 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="c62442cb-f7f9-4ca1-b1a1-fc244f490bfa" containerName="manager" Jun 09 17:43:58.052184 ip-10-0-143-124 kubenswrapper[2552]: I0609 17:43:58.052099 2552 state_mem.go:107] "Deleted CPUSet assignment" podUID="c62442cb-f7f9-4ca1-b1a1-fc244f490bfa" containerName="manager" Jun 09 17:43:58.052240 ip-10-0-143-124 kubenswrapper[2552]: I0609 17:43:58.052197 2552 memory_manager.go:368] "RemoveStaleState removing state" podUID="c62442cb-f7f9-4ca1-b1a1-fc244f490bfa" containerName="manager" Jun 09 17:43:58.055415 ip-10-0-143-124 kubenswrapper[2552]: I0609 17:43:58.055392 2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-jkksq" Jun 09 17:43:58.059895 ip-10-0-143-124 kubenswrapper[2552]: E0609 17:43:58.059863 2552 status_manager.go:1018] "Failed to get status for pod" err="pods \"limitador-operator-controller-manager-859d7b78bd-7nlz9\" is forbidden: User \"system:node:ip-10-0-143-124.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-143-124.ec2.internal' and this object" podUID="c62442cb-f7f9-4ca1-b1a1-fc244f490bfa" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-7nlz9" Jun 09 17:43:58.084285 ip-10-0-143-124 kubenswrapper[2552]: I0609 17:43:58.084256 2552 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-jkksq"] Jun 09 17:43:58.205467 ip-10-0-143-124 kubenswrapper[2552]: I0609 17:43:58.205423 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-t6qdl\" (UniqueName: \"kubernetes.io/projected/26c875bc-c46e-4910-b2b1-1d142df4992c-kube-api-access-t6qdl\") pod \"limitador-operator-controller-manager-859d7b78bd-jkksq\" (UID: \"26c875bc-c46e-4910-b2b1-1d142df4992c\") " pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-jkksq" Jun 09 17:43:58.251359 ip-10-0-143-124 kubenswrapper[2552]: I0609 17:43:58.251303 2552 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-7nlz9" Jun 09 17:43:58.253588 ip-10-0-143-124 kubenswrapper[2552]: E0609 17:43:58.253564 2552 status_manager.go:1018] "Failed to get status for pod" err="pods \"limitador-operator-controller-manager-859d7b78bd-7nlz9\" is forbidden: User \"system:node:ip-10-0-143-124.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-143-124.ec2.internal' and this object" podUID="c62442cb-f7f9-4ca1-b1a1-fc244f490bfa" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-7nlz9" Jun 09 17:43:58.306184 ip-10-0-143-124 kubenswrapper[2552]: I0609 17:43:58.306151 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-t6qdl\" (UniqueName: \"kubernetes.io/projected/26c875bc-c46e-4910-b2b1-1d142df4992c-kube-api-access-t6qdl\") pod \"limitador-operator-controller-manager-859d7b78bd-jkksq\" (UID: \"26c875bc-c46e-4910-b2b1-1d142df4992c\") " pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-jkksq" Jun 09 17:43:58.320784 ip-10-0-143-124 kubenswrapper[2552]: I0609 17:43:58.320754 2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-t6qdl\" (UniqueName: \"kubernetes.io/projected/26c875bc-c46e-4910-b2b1-1d142df4992c-kube-api-access-t6qdl\") pod \"limitador-operator-controller-manager-859d7b78bd-jkksq\" (UID: \"26c875bc-c46e-4910-b2b1-1d142df4992c\") " pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-jkksq" Jun 09 17:43:58.373192 ip-10-0-143-124 kubenswrapper[2552]: I0609 17:43:58.373164 2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-jkksq" Jun 09 17:43:58.407314 ip-10-0-143-124 kubenswrapper[2552]: I0609 17:43:58.407277 2552 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-fxjld\" (UniqueName: \"kubernetes.io/projected/c62442cb-f7f9-4ca1-b1a1-fc244f490bfa-kube-api-access-fxjld\") pod \"c62442cb-f7f9-4ca1-b1a1-fc244f490bfa\" (UID: \"c62442cb-f7f9-4ca1-b1a1-fc244f490bfa\") " Jun 09 17:43:58.409342 ip-10-0-143-124 kubenswrapper[2552]: I0609 17:43:58.409312 2552 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/c62442cb-f7f9-4ca1-b1a1-fc244f490bfa-kube-api-access-fxjld" (OuterVolumeSpecName: "kube-api-access-fxjld") pod "c62442cb-f7f9-4ca1-b1a1-fc244f490bfa" (UID: "c62442cb-f7f9-4ca1-b1a1-fc244f490bfa"). InnerVolumeSpecName "kube-api-access-fxjld". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 09 17:43:58.507888 ip-10-0-143-124 kubenswrapper[2552]: I0609 17:43:58.507807 2552 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-fxjld\" (UniqueName: \"kubernetes.io/projected/c62442cb-f7f9-4ca1-b1a1-fc244f490bfa-kube-api-access-fxjld\") on node \"ip-10-0-143-124.ec2.internal\" DevicePath \"\"" Jun 09 17:43:58.553300 ip-10-0-143-124 kubenswrapper[2552]: I0609 17:43:58.553267 2552 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-jkksq"] Jun 09 17:43:58.553801 ip-10-0-143-124 kubenswrapper[2552]: W0609 17:43:58.553779 2552 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod26c875bc_c46e_4910_b2b1_1d142df4992c.slice/crio-e7c642df0f0f2579b28e6dcdbdf2a303bee384cc1511b289ed2f52058875739d WatchSource:0}: Error finding container e7c642df0f0f2579b28e6dcdbdf2a303bee384cc1511b289ed2f52058875739d: Status 404 returned error can't find the container with id e7c642df0f0f2579b28e6dcdbdf2a303bee384cc1511b289ed2f52058875739d Jun 09 17:43:59.078726 ip-10-0-143-124 kubenswrapper[2552]: I0609 17:43:59.078689 2552 generic.go:356] "Generic (PLEG): container finished" podID="c62442cb-f7f9-4ca1-b1a1-fc244f490bfa" containerID="d7fc018bc766f5bf7b39775d4dfa5f486dab16aec6ca104368ffb4cbc03de11f" exitCode=0 Jun 09 17:43:59.079114 ip-10-0-143-124 kubenswrapper[2552]: I0609 17:43:59.078731 2552 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-7nlz9" Jun 09 17:43:59.079114 ip-10-0-143-124 kubenswrapper[2552]: I0609 17:43:59.078790 2552 scope.go:117] "RemoveContainer" containerID="d7fc018bc766f5bf7b39775d4dfa5f486dab16aec6ca104368ffb4cbc03de11f" Jun 09 17:43:59.080700 ip-10-0-143-124 kubenswrapper[2552]: I0609 17:43:59.080670 2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-jkksq" event={"ID":"26c875bc-c46e-4910-b2b1-1d142df4992c","Type":"ContainerStarted","Data":"e4c3c69ea7c050b8063f15c05be06c6dcdb03173475659fe2f3531f69ee0a4a1"} Jun 09 17:43:59.080814 ip-10-0-143-124 kubenswrapper[2552]: I0609 17:43:59.080732 2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-jkksq" event={"ID":"26c875bc-c46e-4910-b2b1-1d142df4992c","Type":"ContainerStarted","Data":"e7c642df0f0f2579b28e6dcdbdf2a303bee384cc1511b289ed2f52058875739d"} Jun 09 17:43:59.080814 ip-10-0-143-124 kubenswrapper[2552]: I0609 17:43:59.080765 2552 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-jkksq" Jun 09 17:43:59.090062 ip-10-0-143-124 kubenswrapper[2552]: I0609 17:43:59.089819 2552 scope.go:117] "RemoveContainer" containerID="d7fc018bc766f5bf7b39775d4dfa5f486dab16aec6ca104368ffb4cbc03de11f" Jun 09 17:43:59.090537 ip-10-0-143-124 kubenswrapper[2552]: E0609 17:43:59.090502 2552 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"d7fc018bc766f5bf7b39775d4dfa5f486dab16aec6ca104368ffb4cbc03de11f\": container with ID starting with d7fc018bc766f5bf7b39775d4dfa5f486dab16aec6ca104368ffb4cbc03de11f not found: ID does not exist" containerID="d7fc018bc766f5bf7b39775d4dfa5f486dab16aec6ca104368ffb4cbc03de11f" Jun 09 17:43:59.090625 ip-10-0-143-124 kubenswrapper[2552]: I0609 17:43:59.090547 2552 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"d7fc018bc766f5bf7b39775d4dfa5f486dab16aec6ca104368ffb4cbc03de11f"} err="failed to get container status \"d7fc018bc766f5bf7b39775d4dfa5f486dab16aec6ca104368ffb4cbc03de11f\": rpc error: code = NotFound desc = could not find container \"d7fc018bc766f5bf7b39775d4dfa5f486dab16aec6ca104368ffb4cbc03de11f\": container with ID starting with d7fc018bc766f5bf7b39775d4dfa5f486dab16aec6ca104368ffb4cbc03de11f not found: ID does not exist" Jun 09 17:43:59.129846 ip-10-0-143-124 kubenswrapper[2552]: I0609 17:43:59.129792 2552 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-jkksq" podStartSLOduration=1.12977645 podStartE2EDuration="1.12977645s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-09 17:43:58 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-09 17:43:59.127573972 +0000 UTC m=+643.227476632" watchObservedRunningTime="2026-06-09 17:43:59.12977645 +0000 UTC m=+643.229679099" Jun 09 17:44:00.262511 ip-10-0-143-124 kubenswrapper[2552]: I0609 17:44:00.262476 2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gctfs_8563ebab-ebdd-4d68-bce1-78d2a7f62992/konnectivity-agent/0.log" limit=1024 Jun 09 17:44:00.337470 ip-10-0-143-124 kubenswrapper[2552]: I0609 17:44:00.337439 2552 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="c62442cb-f7f9-4ca1-b1a1-fc244f490bfa" path="/var/lib/kubelet/pods/c62442cb-f7f9-4ca1-b1a1-fc244f490bfa/volumes" Jun 09 17:44:00.364329 ip-10-0-143-124 kubenswrapper[2552]: I0609 17:44:00.364290 2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gctfs_8563ebab-ebdd-4d68-bce1-78d2a7f62992/konnectivity-agent/0.log" limit=1024 Jun 09 17:44:00.869684 ip-10-0-143-124 kubenswrapper[2552]: I0609 17:44:00.869643 2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gctfs_8563ebab-ebdd-4d68-bce1-78d2a7f62992/konnectivity-agent/0.log" limit=1024 Jun 09 17:44:00.976479 ip-10-0-143-124 kubenswrapper[2552]: I0609 17:44:00.976438 2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gctfs_8563ebab-ebdd-4d68-bce1-78d2a7f62992/konnectivity-agent/0.log" limit=1024 Jun 09 17:44:04.292011 ip-10-0-143-124 kubenswrapper[2552]: I0609 17:44:04.291973 2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gctfs_8563ebab-ebdd-4d68-bce1-78d2a7f62992/konnectivity-agent/0.log" limit=1024 Jun 09 17:44:04.426019 ip-10-0-143-124 kubenswrapper[2552]: I0609 17:44:04.425984 2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gctfs_8563ebab-ebdd-4d68-bce1-78d2a7f62992/konnectivity-agent/0.log" limit=1024 Jun 09 17:44:06.077005 ip-10-0-143-124 kubenswrapper[2552]: I0609 17:44:06.076936 2552 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-console/console-8697ccbf4b-qqwdj" podUID="fc1e95b3-4d3a-4153-9ffb-29bfeb4b6690" containerName="console" containerID="cri-o://f87a46a9e86c6dae1c75cc6143d8ded19786df5cab087d7440c62d1f04baa187" gracePeriod=15 Jun 09 17:44:06.322805 ip-10-0-143-124 kubenswrapper[2552]: I0609 17:44:06.322781 2552 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-8697ccbf4b-qqwdj" Jun 09 17:44:06.369517 ip-10-0-143-124 kubenswrapper[2552]: I0609 17:44:06.369434 2552 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/fc1e95b3-4d3a-4153-9ffb-29bfeb4b6690-console-config\") pod \"fc1e95b3-4d3a-4153-9ffb-29bfeb4b6690\" (UID: \"fc1e95b3-4d3a-4153-9ffb-29bfeb4b6690\") " Jun 09 17:44:06.369517 ip-10-0-143-124 kubenswrapper[2552]: I0609 17:44:06.369474 2552 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/fc1e95b3-4d3a-4153-9ffb-29bfeb4b6690-oauth-serving-cert\") pod \"fc1e95b3-4d3a-4153-9ffb-29bfeb4b6690\" (UID: \"fc1e95b3-4d3a-4153-9ffb-29bfeb4b6690\") " Jun 09 17:44:06.369517 ip-10-0-143-124 kubenswrapper[2552]: I0609 17:44:06.369504 2552 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-s7z5p\" (UniqueName: \"kubernetes.io/projected/fc1e95b3-4d3a-4153-9ffb-29bfeb4b6690-kube-api-access-s7z5p\") pod \"fc1e95b3-4d3a-4153-9ffb-29bfeb4b6690\" (UID: \"fc1e95b3-4d3a-4153-9ffb-29bfeb4b6690\") " Jun 09 17:44:06.369884 ip-10-0-143-124 kubenswrapper[2552]: I0609 17:44:06.369530 2552 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/fc1e95b3-4d3a-4153-9ffb-29bfeb4b6690-console-serving-cert\") pod \"fc1e95b3-4d3a-4153-9ffb-29bfeb4b6690\" (UID: \"fc1e95b3-4d3a-4153-9ffb-29bfeb4b6690\") " Jun 09 17:44:06.369884 ip-10-0-143-124 kubenswrapper[2552]: I0609 17:44:06.369580 2552 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/fc1e95b3-4d3a-4153-9ffb-29bfeb4b6690-trusted-ca-bundle\") pod \"fc1e95b3-4d3a-4153-9ffb-29bfeb4b6690\" (UID: \"fc1e95b3-4d3a-4153-9ffb-29bfeb4b6690\") " Jun 09 17:44:06.369884 ip-10-0-143-124 kubenswrapper[2552]: I0609 17:44:06.369648 2552 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/fc1e95b3-4d3a-4153-9ffb-29bfeb4b6690-service-ca\") pod \"fc1e95b3-4d3a-4153-9ffb-29bfeb4b6690\" (UID: \"fc1e95b3-4d3a-4153-9ffb-29bfeb4b6690\") " Jun 09 17:44:06.369884 ip-10-0-143-124 kubenswrapper[2552]: I0609 17:44:06.369714 2552 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/fc1e95b3-4d3a-4153-9ffb-29bfeb4b6690-console-oauth-config\") pod \"fc1e95b3-4d3a-4153-9ffb-29bfeb4b6690\" (UID: \"fc1e95b3-4d3a-4153-9ffb-29bfeb4b6690\") " Jun 09 17:44:06.370125 ip-10-0-143-124 kubenswrapper[2552]: I0609 17:44:06.369878 2552 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/fc1e95b3-4d3a-4153-9ffb-29bfeb4b6690-console-config" (OuterVolumeSpecName: "console-config") pod "fc1e95b3-4d3a-4153-9ffb-29bfeb4b6690" (UID: "fc1e95b3-4d3a-4153-9ffb-29bfeb4b6690"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 09 17:44:06.370125 ip-10-0-143-124 kubenswrapper[2552]: I0609 17:44:06.369923 2552 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/fc1e95b3-4d3a-4153-9ffb-29bfeb4b6690-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "fc1e95b3-4d3a-4153-9ffb-29bfeb4b6690" (UID: "fc1e95b3-4d3a-4153-9ffb-29bfeb4b6690"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 09 17:44:06.370125 ip-10-0-143-124 kubenswrapper[2552]: I0609 17:44:06.370026 2552 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/fc1e95b3-4d3a-4153-9ffb-29bfeb4b6690-console-config\") on node \"ip-10-0-143-124.ec2.internal\" DevicePath \"\"" Jun 09 17:44:06.370125 ip-10-0-143-124 kubenswrapper[2552]: I0609 17:44:06.370039 2552 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/fc1e95b3-4d3a-4153-9ffb-29bfeb4b6690-oauth-serving-cert\") on node \"ip-10-0-143-124.ec2.internal\" DevicePath \"\"" Jun 09 17:44:06.370125 ip-10-0-143-124 kubenswrapper[2552]: I0609 17:44:06.370034 2552 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/fc1e95b3-4d3a-4153-9ffb-29bfeb4b6690-trusted-ca-bundle" (OuterVolumeSpecName: "trusted-ca-bundle") pod "fc1e95b3-4d3a-4153-9ffb-29bfeb4b6690" (UID: "fc1e95b3-4d3a-4153-9ffb-29bfeb4b6690"). InnerVolumeSpecName "trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 09 17:44:06.370396 ip-10-0-143-124 kubenswrapper[2552]: I0609 17:44:06.370323 2552 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/fc1e95b3-4d3a-4153-9ffb-29bfeb4b6690-service-ca" (OuterVolumeSpecName: "service-ca") pod "fc1e95b3-4d3a-4153-9ffb-29bfeb4b6690" (UID: "fc1e95b3-4d3a-4153-9ffb-29bfeb4b6690"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 09 17:44:06.371993 ip-10-0-143-124 kubenswrapper[2552]: I0609 17:44:06.371961 2552 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/fc1e95b3-4d3a-4153-9ffb-29bfeb4b6690-kube-api-access-s7z5p" (OuterVolumeSpecName: "kube-api-access-s7z5p") pod "fc1e95b3-4d3a-4153-9ffb-29bfeb4b6690" (UID: "fc1e95b3-4d3a-4153-9ffb-29bfeb4b6690"). InnerVolumeSpecName "kube-api-access-s7z5p". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 09 17:44:06.372107 ip-10-0-143-124 kubenswrapper[2552]: I0609 17:44:06.372007 2552 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/fc1e95b3-4d3a-4153-9ffb-29bfeb4b6690-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "fc1e95b3-4d3a-4153-9ffb-29bfeb4b6690" (UID: "fc1e95b3-4d3a-4153-9ffb-29bfeb4b6690"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 09 17:44:06.372107 ip-10-0-143-124 kubenswrapper[2552]: I0609 17:44:06.372085 2552 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/fc1e95b3-4d3a-4153-9ffb-29bfeb4b6690-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "fc1e95b3-4d3a-4153-9ffb-29bfeb4b6690" (UID: "fc1e95b3-4d3a-4153-9ffb-29bfeb4b6690"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 09 17:44:06.470514 ip-10-0-143-124 kubenswrapper[2552]: I0609 17:44:06.470484 2552 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/fc1e95b3-4d3a-4153-9ffb-29bfeb4b6690-console-oauth-config\") on node \"ip-10-0-143-124.ec2.internal\" DevicePath \"\"" Jun 09 17:44:06.470514 ip-10-0-143-124 kubenswrapper[2552]: I0609 17:44:06.470513 2552 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-s7z5p\" (UniqueName: \"kubernetes.io/projected/fc1e95b3-4d3a-4153-9ffb-29bfeb4b6690-kube-api-access-s7z5p\") on node \"ip-10-0-143-124.ec2.internal\" DevicePath \"\"" Jun 09 17:44:06.470514 ip-10-0-143-124 kubenswrapper[2552]: I0609 17:44:06.470527 2552 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/fc1e95b3-4d3a-4153-9ffb-29bfeb4b6690-console-serving-cert\") on node \"ip-10-0-143-124.ec2.internal\" DevicePath \"\"" Jun 09 17:44:06.470806 ip-10-0-143-124 kubenswrapper[2552]: I0609 17:44:06.470538 2552 reconciler_common.go:299] "Volume detached for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/fc1e95b3-4d3a-4153-9ffb-29bfeb4b6690-trusted-ca-bundle\") on node \"ip-10-0-143-124.ec2.internal\" DevicePath \"\"" Jun 09 17:44:06.470806 ip-10-0-143-124 kubenswrapper[2552]: I0609 17:44:06.470571 2552 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/fc1e95b3-4d3a-4153-9ffb-29bfeb4b6690-service-ca\") on node \"ip-10-0-143-124.ec2.internal\" DevicePath \"\"" Jun 09 17:44:07.124980 ip-10-0-143-124 kubenswrapper[2552]: I0609 17:44:07.124941 2552 generic.go:356] "Generic (PLEG): container finished" podID="fc1e95b3-4d3a-4153-9ffb-29bfeb4b6690" containerID="f87a46a9e86c6dae1c75cc6143d8ded19786df5cab087d7440c62d1f04baa187" exitCode=0 Jun 09 17:44:07.125371 ip-10-0-143-124 kubenswrapper[2552]: I0609 17:44:07.124992 2552 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-8697ccbf4b-qqwdj" Jun 09 17:44:07.125371 ip-10-0-143-124 kubenswrapper[2552]: I0609 17:44:07.125025 2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-8697ccbf4b-qqwdj" event={"ID":"fc1e95b3-4d3a-4153-9ffb-29bfeb4b6690","Type":"ContainerDied","Data":"f87a46a9e86c6dae1c75cc6143d8ded19786df5cab087d7440c62d1f04baa187"} Jun 09 17:44:07.125371 ip-10-0-143-124 kubenswrapper[2552]: I0609 17:44:07.125084 2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-8697ccbf4b-qqwdj" event={"ID":"fc1e95b3-4d3a-4153-9ffb-29bfeb4b6690","Type":"ContainerDied","Data":"c58a867bc2dad339ee55bdeb3e5fe35a9f1587d296447c937ed39df3716e5e18"} Jun 09 17:44:07.125371 ip-10-0-143-124 kubenswrapper[2552]: I0609 17:44:07.125107 2552 scope.go:117] "RemoveContainer" containerID="f87a46a9e86c6dae1c75cc6143d8ded19786df5cab087d7440c62d1f04baa187" Jun 09 17:44:07.134863 ip-10-0-143-124 kubenswrapper[2552]: I0609 17:44:07.134847 2552 scope.go:117] "RemoveContainer" containerID="f87a46a9e86c6dae1c75cc6143d8ded19786df5cab087d7440c62d1f04baa187" Jun 09 17:44:07.135159 ip-10-0-143-124 kubenswrapper[2552]: E0609 17:44:07.135137 2552 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"f87a46a9e86c6dae1c75cc6143d8ded19786df5cab087d7440c62d1f04baa187\": container with ID starting with f87a46a9e86c6dae1c75cc6143d8ded19786df5cab087d7440c62d1f04baa187 not found: ID does not exist" containerID="f87a46a9e86c6dae1c75cc6143d8ded19786df5cab087d7440c62d1f04baa187" Jun 09 17:44:07.135202 ip-10-0-143-124 kubenswrapper[2552]: I0609 17:44:07.135168 2552 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"f87a46a9e86c6dae1c75cc6143d8ded19786df5cab087d7440c62d1f04baa187"} err="failed to get container status \"f87a46a9e86c6dae1c75cc6143d8ded19786df5cab087d7440c62d1f04baa187\": rpc error: code = NotFound desc = could not find container \"f87a46a9e86c6dae1c75cc6143d8ded19786df5cab087d7440c62d1f04baa187\": container with ID starting with f87a46a9e86c6dae1c75cc6143d8ded19786df5cab087d7440c62d1f04baa187 not found: ID does not exist" Jun 09 17:44:07.150400 ip-10-0-143-124 kubenswrapper[2552]: I0609 17:44:07.150378 2552 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-8697ccbf4b-qqwdj"] Jun 09 17:44:07.155919 ip-10-0-143-124 kubenswrapper[2552]: I0609 17:44:07.155898 2552 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-8697ccbf4b-qqwdj"] Jun 09 17:44:08.065570 ip-10-0-143-124 kubenswrapper[2552]: I0609 17:44:08.065537 2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gctfs_8563ebab-ebdd-4d68-bce1-78d2a7f62992/konnectivity-agent/0.log" limit=1024 Jun 09 17:44:08.179150 ip-10-0-143-124 kubenswrapper[2552]: I0609 17:44:08.179115 2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gctfs_8563ebab-ebdd-4d68-bce1-78d2a7f62992/konnectivity-agent/0.log" limit=1024 Jun 09 17:44:08.338096 ip-10-0-143-124 kubenswrapper[2552]: I0609 17:44:08.338018 2552 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="fc1e95b3-4d3a-4153-9ffb-29bfeb4b6690" path="/var/lib/kubelet/pods/fc1e95b3-4d3a-4153-9ffb-29bfeb4b6690/volumes" Jun 09 17:44:10.089520 ip-10-0-143-124 kubenswrapper[2552]: I0609 17:44:10.089492 2552 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-jkksq" Jun 09 17:44:11.363342 ip-10-0-143-124 kubenswrapper[2552]: I0609 17:44:11.363304 2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gctfs_8563ebab-ebdd-4d68-bce1-78d2a7f62992/konnectivity-agent/0.log" limit=1024 Jun 09 17:44:11.538278 ip-10-0-143-124 kubenswrapper[2552]: I0609 17:44:11.538241 2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gctfs_8563ebab-ebdd-4d68-bce1-78d2a7f62992/konnectivity-agent/0.log" limit=1024 Jun 09 17:44:14.568758 ip-10-0-143-124 kubenswrapper[2552]: I0609 17:44:14.568720 2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gctfs_8563ebab-ebdd-4d68-bce1-78d2a7f62992/konnectivity-agent/0.log" limit=1024 Jun 09 17:44:14.806896 ip-10-0-143-124 kubenswrapper[2552]: I0609 17:44:14.806865 2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gctfs_8563ebab-ebdd-4d68-bce1-78d2a7f62992/konnectivity-agent/0.log" limit=1024 Jun 09 17:44:15.035477 ip-10-0-143-124 kubenswrapper[2552]: I0609 17:44:15.035443 2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gctfs_8563ebab-ebdd-4d68-bce1-78d2a7f62992/konnectivity-agent/0.log" limit=1024 Jun 09 17:44:28.665754 ip-10-0-143-124 kubenswrapper[2552]: I0609 17:44:28.665721 2552 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/maas-default-gateway-openshift-default-687ff6996-dsvbr"] Jun 09 17:44:28.666521 ip-10-0-143-124 kubenswrapper[2552]: I0609 17:44:28.666250 2552 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="fc1e95b3-4d3a-4153-9ffb-29bfeb4b6690" containerName="console" Jun 09 17:44:28.666521 ip-10-0-143-124 kubenswrapper[2552]: I0609 17:44:28.666269 2552 state_mem.go:107] "Deleted CPUSet assignment" podUID="fc1e95b3-4d3a-4153-9ffb-29bfeb4b6690" containerName="console" Jun 09 17:44:28.666521 ip-10-0-143-124 kubenswrapper[2552]: I0609 17:44:28.666359 2552 memory_manager.go:368] "RemoveStaleState removing state" podUID="fc1e95b3-4d3a-4153-9ffb-29bfeb4b6690" containerName="console" Jun 09 17:44:28.671647 ip-10-0-143-124 kubenswrapper[2552]: I0609 17:44:28.671623 2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-dsvbr" Jun 09 17:44:28.674326 ip-10-0-143-124 kubenswrapper[2552]: I0609 17:44:28.674304 2552 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"maas-default-gateway-openshift-default-dockercfg-m7ht9\"" Jun 09 17:44:28.696969 ip-10-0-143-124 kubenswrapper[2552]: I0609 17:44:28.696945 2552 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/maas-default-gateway-openshift-default-687ff6996-dsvbr"] Jun 09 17:44:28.712420 ip-10-0-143-124 kubenswrapper[2552]: I0609 17:44:28.712364 2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gctfs_8563ebab-ebdd-4d68-bce1-78d2a7f62992/konnectivity-agent/0.log" limit=1024 Jun 09 17:44:28.759693 ip-10-0-143-124 kubenswrapper[2552]: I0609 17:44:28.759662 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/632ed562-280d-499c-ad1d-976509489a95-istio-envoy\") pod \"maas-default-gateway-openshift-default-687ff6996-dsvbr\" (UID: \"632ed562-280d-499c-ad1d-976509489a95\") " pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-dsvbr" Jun 09 17:44:28.759809 ip-10-0-143-124 kubenswrapper[2552]: I0609 17:44:28.759694 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/632ed562-280d-499c-ad1d-976509489a95-istio-token\") pod \"maas-default-gateway-openshift-default-687ff6996-dsvbr\" (UID: \"632ed562-280d-499c-ad1d-976509489a95\") " pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-dsvbr" Jun 09 17:44:28.759809 ip-10-0-143-124 kubenswrapper[2552]: I0609 17:44:28.759790 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/632ed562-280d-499c-ad1d-976509489a95-credential-socket\") pod \"maas-default-gateway-openshift-default-687ff6996-dsvbr\" (UID: \"632ed562-280d-499c-ad1d-976509489a95\") " pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-dsvbr" Jun 09 17:44:28.759886 ip-10-0-143-124 kubenswrapper[2552]: I0609 17:44:28.759830 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/632ed562-280d-499c-ad1d-976509489a95-istio-data\") pod \"maas-default-gateway-openshift-default-687ff6996-dsvbr\" (UID: \"632ed562-280d-499c-ad1d-976509489a95\") " pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-dsvbr" Jun 09 17:44:28.759886 ip-10-0-143-124 kubenswrapper[2552]: I0609 17:44:28.759850 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hksx9\" (UniqueName: \"kubernetes.io/projected/632ed562-280d-499c-ad1d-976509489a95-kube-api-access-hksx9\") pod \"maas-default-gateway-openshift-default-687ff6996-dsvbr\" (UID: \"632ed562-280d-499c-ad1d-976509489a95\") " pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-dsvbr" Jun 09 17:44:28.759961 ip-10-0-143-124 kubenswrapper[2552]: I0609 17:44:28.759897 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/632ed562-280d-499c-ad1d-976509489a95-workload-socket\") pod \"maas-default-gateway-openshift-default-687ff6996-dsvbr\" (UID: \"632ed562-280d-499c-ad1d-976509489a95\") " pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-dsvbr" Jun 09 17:44:28.759961 ip-10-0-143-124 kubenswrapper[2552]: I0609 17:44:28.759920 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/632ed562-280d-499c-ad1d-976509489a95-workload-certs\") pod \"maas-default-gateway-openshift-default-687ff6996-dsvbr\" (UID: \"632ed562-280d-499c-ad1d-976509489a95\") " pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-dsvbr" Jun 09 17:44:28.759961 ip-10-0-143-124 kubenswrapper[2552]: I0609 17:44:28.759935 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/632ed562-280d-499c-ad1d-976509489a95-istiod-ca-cert\") pod \"maas-default-gateway-openshift-default-687ff6996-dsvbr\" (UID: \"632ed562-280d-499c-ad1d-976509489a95\") " pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-dsvbr" Jun 09 17:44:28.760054 ip-10-0-143-124 kubenswrapper[2552]: I0609 17:44:28.759980 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/632ed562-280d-499c-ad1d-976509489a95-istio-podinfo\") pod \"maas-default-gateway-openshift-default-687ff6996-dsvbr\" (UID: \"632ed562-280d-499c-ad1d-976509489a95\") " pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-dsvbr" Jun 09 17:44:28.811451 ip-10-0-143-124 kubenswrapper[2552]: I0609 17:44:28.811408 2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gctfs_8563ebab-ebdd-4d68-bce1-78d2a7f62992/konnectivity-agent/0.log" limit=1024 Jun 09 17:44:28.860538 ip-10-0-143-124 kubenswrapper[2552]: I0609 17:44:28.860501 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/632ed562-280d-499c-ad1d-976509489a95-workload-socket\") pod \"maas-default-gateway-openshift-default-687ff6996-dsvbr\" (UID: \"632ed562-280d-499c-ad1d-976509489a95\") " pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-dsvbr" Jun 09 17:44:28.860538 ip-10-0-143-124 kubenswrapper[2552]: I0609 17:44:28.860537 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/632ed562-280d-499c-ad1d-976509489a95-workload-certs\") pod \"maas-default-gateway-openshift-default-687ff6996-dsvbr\" (UID: \"632ed562-280d-499c-ad1d-976509489a95\") " pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-dsvbr" Jun 09 17:44:28.860806 ip-10-0-143-124 kubenswrapper[2552]: I0609 17:44:28.860553 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/632ed562-280d-499c-ad1d-976509489a95-istiod-ca-cert\") pod \"maas-default-gateway-openshift-default-687ff6996-dsvbr\" (UID: \"632ed562-280d-499c-ad1d-976509489a95\") " pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-dsvbr" Jun 09 17:44:28.860806 ip-10-0-143-124 kubenswrapper[2552]: I0609 17:44:28.860589 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/632ed562-280d-499c-ad1d-976509489a95-istio-podinfo\") pod \"maas-default-gateway-openshift-default-687ff6996-dsvbr\" (UID: \"632ed562-280d-499c-ad1d-976509489a95\") " pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-dsvbr" Jun 09 17:44:28.860806 ip-10-0-143-124 kubenswrapper[2552]: I0609 17:44:28.860653 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/632ed562-280d-499c-ad1d-976509489a95-istio-envoy\") pod \"maas-default-gateway-openshift-default-687ff6996-dsvbr\" (UID: \"632ed562-280d-499c-ad1d-976509489a95\") " pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-dsvbr" Jun 09 17:44:28.860806 ip-10-0-143-124 kubenswrapper[2552]: I0609 17:44:28.860668 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/632ed562-280d-499c-ad1d-976509489a95-istio-token\") pod \"maas-default-gateway-openshift-default-687ff6996-dsvbr\" (UID: \"632ed562-280d-499c-ad1d-976509489a95\") " pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-dsvbr" Jun 09 17:44:28.860806 ip-10-0-143-124 kubenswrapper[2552]: I0609 17:44:28.860726 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/632ed562-280d-499c-ad1d-976509489a95-credential-socket\") pod \"maas-default-gateway-openshift-default-687ff6996-dsvbr\" (UID: \"632ed562-280d-499c-ad1d-976509489a95\") " pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-dsvbr" Jun 09 17:44:28.860806 ip-10-0-143-124 kubenswrapper[2552]: I0609 17:44:28.860762 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/632ed562-280d-499c-ad1d-976509489a95-istio-data\") pod \"maas-default-gateway-openshift-default-687ff6996-dsvbr\" (UID: \"632ed562-280d-499c-ad1d-976509489a95\") " pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-dsvbr" Jun 09 17:44:28.860806 ip-10-0-143-124 kubenswrapper[2552]: I0609 17:44:28.860786 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hksx9\" (UniqueName: \"kubernetes.io/projected/632ed562-280d-499c-ad1d-976509489a95-kube-api-access-hksx9\") pod \"maas-default-gateway-openshift-default-687ff6996-dsvbr\" (UID: \"632ed562-280d-499c-ad1d-976509489a95\") " pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-dsvbr" Jun 09 17:44:28.861158 ip-10-0-143-124 kubenswrapper[2552]: I0609 17:44:28.861044 2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/632ed562-280d-499c-ad1d-976509489a95-workload-socket\") pod \"maas-default-gateway-openshift-default-687ff6996-dsvbr\" (UID: \"632ed562-280d-499c-ad1d-976509489a95\") " pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-dsvbr" Jun 09 17:44:28.861158 ip-10-0-143-124 kubenswrapper[2552]: I0609 17:44:28.861088 2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/632ed562-280d-499c-ad1d-976509489a95-workload-certs\") pod \"maas-default-gateway-openshift-default-687ff6996-dsvbr\" (UID: \"632ed562-280d-499c-ad1d-976509489a95\") " pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-dsvbr" Jun 09 17:44:28.861312 ip-10-0-143-124 kubenswrapper[2552]: I0609 17:44:28.861291 2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/632ed562-280d-499c-ad1d-976509489a95-credential-socket\") pod \"maas-default-gateway-openshift-default-687ff6996-dsvbr\" (UID: \"632ed562-280d-499c-ad1d-976509489a95\") " pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-dsvbr" Jun 09 17:44:28.861379 ip-10-0-143-124 kubenswrapper[2552]: I0609 17:44:28.861347 2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/632ed562-280d-499c-ad1d-976509489a95-istiod-ca-cert\") pod \"maas-default-gateway-openshift-default-687ff6996-dsvbr\" (UID: \"632ed562-280d-499c-ad1d-976509489a95\") " pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-dsvbr" Jun 09 17:44:28.861441 ip-10-0-143-124 kubenswrapper[2552]: I0609 17:44:28.861386 2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/632ed562-280d-499c-ad1d-976509489a95-istio-data\") pod \"maas-default-gateway-openshift-default-687ff6996-dsvbr\" (UID: \"632ed562-280d-499c-ad1d-976509489a95\") " pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-dsvbr" Jun 09 17:44:28.863104 ip-10-0-143-124 kubenswrapper[2552]: I0609 17:44:28.863081 2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/632ed562-280d-499c-ad1d-976509489a95-istio-envoy\") pod \"maas-default-gateway-openshift-default-687ff6996-dsvbr\" (UID: \"632ed562-280d-499c-ad1d-976509489a95\") " pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-dsvbr" Jun 09 17:44:28.863419 ip-10-0-143-124 kubenswrapper[2552]: I0609 17:44:28.863396 2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/632ed562-280d-499c-ad1d-976509489a95-istio-podinfo\") pod \"maas-default-gateway-openshift-default-687ff6996-dsvbr\" (UID: \"632ed562-280d-499c-ad1d-976509489a95\") " pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-dsvbr" Jun 09 17:44:28.869621 ip-10-0-143-124 kubenswrapper[2552]: I0609 17:44:28.869566 2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-hksx9\" (UniqueName: \"kubernetes.io/projected/632ed562-280d-499c-ad1d-976509489a95-kube-api-access-hksx9\") pod \"maas-default-gateway-openshift-default-687ff6996-dsvbr\" (UID: \"632ed562-280d-499c-ad1d-976509489a95\") " pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-dsvbr" Jun 09 17:44:28.869621 ip-10-0-143-124 kubenswrapper[2552]: I0609 17:44:28.869580 2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/632ed562-280d-499c-ad1d-976509489a95-istio-token\") pod \"maas-default-gateway-openshift-default-687ff6996-dsvbr\" (UID: \"632ed562-280d-499c-ad1d-976509489a95\") " pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-dsvbr" Jun 09 17:44:28.985222 ip-10-0-143-124 kubenswrapper[2552]: I0609 17:44:28.985127 2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-dsvbr" Jun 09 17:44:29.133974 ip-10-0-143-124 kubenswrapper[2552]: I0609 17:44:29.133948 2552 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/maas-default-gateway-openshift-default-687ff6996-dsvbr"] Jun 09 17:44:29.135269 ip-10-0-143-124 kubenswrapper[2552]: W0609 17:44:29.135234 2552 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod632ed562_280d_499c_ad1d_976509489a95.slice/crio-d333424046dd8866196ef4b3b3633aae74f61402bbc7132c334922e9407efb0c WatchSource:0}: Error finding container d333424046dd8866196ef4b3b3633aae74f61402bbc7132c334922e9407efb0c: Status 404 returned error can't find the container with id d333424046dd8866196ef4b3b3633aae74f61402bbc7132c334922e9407efb0c Jun 09 17:44:29.137390 ip-10-0-143-124 kubenswrapper[2552]: I0609 17:44:29.137348 2552 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"} Jun 09 17:44:29.137459 ip-10-0-143-124 kubenswrapper[2552]: I0609 17:44:29.137446 2552 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"} Jun 09 17:44:29.137497 ip-10-0-143-124 kubenswrapper[2552]: I0609 17:44:29.137487 2552 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"} Jun 09 17:44:29.250339 ip-10-0-143-124 kubenswrapper[2552]: I0609 17:44:29.250296 2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-dsvbr" event={"ID":"632ed562-280d-499c-ad1d-976509489a95","Type":"ContainerStarted","Data":"441001a26504db2c6a90e4569734cc330bd5ab7fc4955cbb6df40dab465f3946"} Jun 09 17:44:29.250529 ip-10-0-143-124 kubenswrapper[2552]: I0609 17:44:29.250363 2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-dsvbr" event={"ID":"632ed562-280d-499c-ad1d-976509489a95","Type":"ContainerStarted","Data":"d333424046dd8866196ef4b3b3633aae74f61402bbc7132c334922e9407efb0c"} Jun 09 17:44:29.291197 ip-10-0-143-124 kubenswrapper[2552]: I0609 17:44:29.291143 2552 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-dsvbr" podStartSLOduration=1.291126526 podStartE2EDuration="1.291126526s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-09 17:44:28 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-09 17:44:29.2899767 +0000 UTC m=+673.389879350" watchObservedRunningTime="2026-06-09 17:44:29.291126526 +0000 UTC m=+673.391029176" Jun 09 17:44:29.985837 ip-10-0-143-124 kubenswrapper[2552]: I0609 17:44:29.985803 2552 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-dsvbr" Jun 09 17:44:30.990312 ip-10-0-143-124 kubenswrapper[2552]: I0609 17:44:30.990286 2552 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-dsvbr" Jun 09 17:44:31.260994 ip-10-0-143-124 kubenswrapper[2552]: I0609 17:44:31.260913 2552 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-dsvbr" Jun 09 17:44:31.262027 ip-10-0-143-124 kubenswrapper[2552]: I0609 17:44:31.262007 2552 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-dsvbr" Jun 09 17:44:31.451416 ip-10-0-143-124 kubenswrapper[2552]: I0609 17:44:31.451381 2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gctfs_8563ebab-ebdd-4d68-bce1-78d2a7f62992/konnectivity-agent/0.log" limit=1024 Jun 09 17:44:32.302470 ip-10-0-143-124 kubenswrapper[2552]: I0609 17:44:32.302435 2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gctfs_8563ebab-ebdd-4d68-bce1-78d2a7f62992/konnectivity-agent/0.log" limit=1024 Jun 09 17:44:32.688796 ip-10-0-143-124 kubenswrapper[2552]: I0609 17:44:32.688709 2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gctfs_8563ebab-ebdd-4d68-bce1-78d2a7f62992/konnectivity-agent/0.log" limit=1024 Jun 09 17:44:32.793901 ip-10-0-143-124 kubenswrapper[2552]: I0609 17:44:32.793858 2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gctfs_8563ebab-ebdd-4d68-bce1-78d2a7f62992/konnectivity-agent/0.log" limit=1024 Jun 09 17:44:32.876272 ip-10-0-143-124 kubenswrapper[2552]: I0609 17:44:32.876236 2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gctfs_8563ebab-ebdd-4d68-bce1-78d2a7f62992/konnectivity-agent/0.log" limit=1024 Jun 09 17:44:33.622262 ip-10-0-143-124 kubenswrapper[2552]: I0609 17:44:33.622231 2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gctfs_8563ebab-ebdd-4d68-bce1-78d2a7f62992/konnectivity-agent/0.log" limit=1024 Jun 09 17:44:33.704555 ip-10-0-143-124 kubenswrapper[2552]: I0609 17:44:33.704514 2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gctfs_8563ebab-ebdd-4d68-bce1-78d2a7f62992/konnectivity-agent/0.log" limit=1024 Jun 09 17:44:54.037647 ip-10-0-143-124 kubenswrapper[2552]: I0609 17:44:54.037586 2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gctfs_8563ebab-ebdd-4d68-bce1-78d2a7f62992/konnectivity-agent/0.log" limit=1024 Jun 09 17:45:06.231667 ip-10-0-143-124 kubenswrapper[2552]: I0609 17:45:06.231559 2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gctfs_8563ebab-ebdd-4d68-bce1-78d2a7f62992/konnectivity-agent/0.log" limit=1024 Jun 09 17:45:06.326367 ip-10-0-143-124 kubenswrapper[2552]: I0609 17:45:06.326336 2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gctfs_8563ebab-ebdd-4d68-bce1-78d2a7f62992/konnectivity-agent/0.log" limit=1024 Jun 09 17:45:06.495989 ip-10-0-143-124 kubenswrapper[2552]: I0609 17:45:06.495932 2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gctfs_8563ebab-ebdd-4d68-bce1-78d2a7f62992/konnectivity-agent/0.log" limit=1024 Jun 09 17:45:07.653207 ip-10-0-143-124 kubenswrapper[2552]: I0609 17:45:07.653170 2552 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-marketplace/0228a3cc79630676fae641e6a38dab1752e85a08a4a9edc59ccf0da748fbsmc"] Jun 09 17:45:07.655734 ip-10-0-143-124 kubenswrapper[2552]: I0609 17:45:07.655718 2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/0228a3cc79630676fae641e6a38dab1752e85a08a4a9edc59ccf0da748fbsmc" Jun 09 17:45:07.658710 ip-10-0-143-124 kubenswrapper[2552]: I0609 17:45:07.658689 2552 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"openshift-service-ca.crt\"" Jun 09 17:45:07.658919 ip-10-0-143-124 kubenswrapper[2552]: I0609 17:45:07.658905 2552 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-marketplace\"/\"default-dockercfg-xcgzg\"" Jun 09 17:45:07.659753 ip-10-0-143-124 kubenswrapper[2552]: I0609 17:45:07.659739 2552 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"kube-root-ca.crt\"" Jun 09 17:45:07.668167 ip-10-0-143-124 kubenswrapper[2552]: I0609 17:45:07.668146 2552 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/0228a3cc79630676fae641e6a38dab1752e85a08a4a9edc59ccf0da748fbsmc"] Jun 09 17:45:07.700352 ip-10-0-143-124 kubenswrapper[2552]: I0609 17:45:07.700323 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/5c637e6c-13d7-47e3-885d-db097bf3788f-bundle\") pod \"0228a3cc79630676fae641e6a38dab1752e85a08a4a9edc59ccf0da748fbsmc\" (UID: \"5c637e6c-13d7-47e3-885d-db097bf3788f\") " pod="openshift-marketplace/0228a3cc79630676fae641e6a38dab1752e85a08a4a9edc59ccf0da748fbsmc" Jun 09 17:45:07.700486 ip-10-0-143-124 kubenswrapper[2552]: I0609 17:45:07.700355 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5mtp9\" (UniqueName: \"kubernetes.io/projected/5c637e6c-13d7-47e3-885d-db097bf3788f-kube-api-access-5mtp9\") pod \"0228a3cc79630676fae641e6a38dab1752e85a08a4a9edc59ccf0da748fbsmc\" (UID: \"5c637e6c-13d7-47e3-885d-db097bf3788f\") " pod="openshift-marketplace/0228a3cc79630676fae641e6a38dab1752e85a08a4a9edc59ccf0da748fbsmc" Jun 09 17:45:07.700486 ip-10-0-143-124 kubenswrapper[2552]: I0609 17:45:07.700430 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/5c637e6c-13d7-47e3-885d-db097bf3788f-util\") pod \"0228a3cc79630676fae641e6a38dab1752e85a08a4a9edc59ccf0da748fbsmc\" (UID: \"5c637e6c-13d7-47e3-885d-db097bf3788f\") " pod="openshift-marketplace/0228a3cc79630676fae641e6a38dab1752e85a08a4a9edc59ccf0da748fbsmc" Jun 09 17:45:07.801219 ip-10-0-143-124 kubenswrapper[2552]: I0609 17:45:07.801170 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/5c637e6c-13d7-47e3-885d-db097bf3788f-bundle\") pod \"0228a3cc79630676fae641e6a38dab1752e85a08a4a9edc59ccf0da748fbsmc\" (UID: \"5c637e6c-13d7-47e3-885d-db097bf3788f\") " pod="openshift-marketplace/0228a3cc79630676fae641e6a38dab1752e85a08a4a9edc59ccf0da748fbsmc" Jun 09 17:45:07.801421 ip-10-0-143-124 kubenswrapper[2552]: I0609 17:45:07.801230 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5mtp9\" (UniqueName: \"kubernetes.io/projected/5c637e6c-13d7-47e3-885d-db097bf3788f-kube-api-access-5mtp9\") pod \"0228a3cc79630676fae641e6a38dab1752e85a08a4a9edc59ccf0da748fbsmc\" (UID: \"5c637e6c-13d7-47e3-885d-db097bf3788f\") " pod="openshift-marketplace/0228a3cc79630676fae641e6a38dab1752e85a08a4a9edc59ccf0da748fbsmc" Jun 09 17:45:07.801421 ip-10-0-143-124 kubenswrapper[2552]: I0609 17:45:07.801312 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/5c637e6c-13d7-47e3-885d-db097bf3788f-util\") pod \"0228a3cc79630676fae641e6a38dab1752e85a08a4a9edc59ccf0da748fbsmc\" (UID: \"5c637e6c-13d7-47e3-885d-db097bf3788f\") " pod="openshift-marketplace/0228a3cc79630676fae641e6a38dab1752e85a08a4a9edc59ccf0da748fbsmc" Jun 09 17:45:07.801680 ip-10-0-143-124 kubenswrapper[2552]: I0609 17:45:07.801658 2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/5c637e6c-13d7-47e3-885d-db097bf3788f-bundle\") pod \"0228a3cc79630676fae641e6a38dab1752e85a08a4a9edc59ccf0da748fbsmc\" (UID: \"5c637e6c-13d7-47e3-885d-db097bf3788f\") " pod="openshift-marketplace/0228a3cc79630676fae641e6a38dab1752e85a08a4a9edc59ccf0da748fbsmc" Jun 09 17:45:07.801732 ip-10-0-143-124 kubenswrapper[2552]: I0609 17:45:07.801677 2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/5c637e6c-13d7-47e3-885d-db097bf3788f-util\") pod \"0228a3cc79630676fae641e6a38dab1752e85a08a4a9edc59ccf0da748fbsmc\" (UID: \"5c637e6c-13d7-47e3-885d-db097bf3788f\") " pod="openshift-marketplace/0228a3cc79630676fae641e6a38dab1752e85a08a4a9edc59ccf0da748fbsmc" Jun 09 17:45:07.810914 ip-10-0-143-124 kubenswrapper[2552]: I0609 17:45:07.810891 2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-5mtp9\" (UniqueName: \"kubernetes.io/projected/5c637e6c-13d7-47e3-885d-db097bf3788f-kube-api-access-5mtp9\") pod \"0228a3cc79630676fae641e6a38dab1752e85a08a4a9edc59ccf0da748fbsmc\" (UID: \"5c637e6c-13d7-47e3-885d-db097bf3788f\") " pod="openshift-marketplace/0228a3cc79630676fae641e6a38dab1752e85a08a4a9edc59ccf0da748fbsmc" Jun 09 17:45:07.965737 ip-10-0-143-124 kubenswrapper[2552]: I0609 17:45:07.965646 2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/0228a3cc79630676fae641e6a38dab1752e85a08a4a9edc59ccf0da748fbsmc" Jun 09 17:45:08.114111 ip-10-0-143-124 kubenswrapper[2552]: I0609 17:45:08.114084 2552 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/0228a3cc79630676fae641e6a38dab1752e85a08a4a9edc59ccf0da748fbsmc"] Jun 09 17:45:08.114543 ip-10-0-143-124 kubenswrapper[2552]: W0609 17:45:08.114516 2552 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5c637e6c_13d7_47e3_885d_db097bf3788f.slice/crio-6429c851f9408f54d86fe22ec6f7cfab84775ffec55627936e386b3693022ff3 WatchSource:0}: Error finding container 6429c851f9408f54d86fe22ec6f7cfab84775ffec55627936e386b3693022ff3: Status 404 returned error can't find the container with id 6429c851f9408f54d86fe22ec6f7cfab84775ffec55627936e386b3693022ff3 Jun 09 17:45:08.453239 ip-10-0-143-124 kubenswrapper[2552]: I0609 17:45:08.453208 2552 generic.go:356] "Generic (PLEG): container finished" podID="5c637e6c-13d7-47e3-885d-db097bf3788f" containerID="7390c57ccf5b42df573d77f79319f85d0f0043abacee123d4115ab8bec125844" exitCode=0 Jun 09 17:45:08.453405 ip-10-0-143-124 kubenswrapper[2552]: I0609 17:45:08.453246 2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/0228a3cc79630676fae641e6a38dab1752e85a08a4a9edc59ccf0da748fbsmc" event={"ID":"5c637e6c-13d7-47e3-885d-db097bf3788f","Type":"ContainerDied","Data":"7390c57ccf5b42df573d77f79319f85d0f0043abacee123d4115ab8bec125844"} Jun 09 17:45:08.453405 ip-10-0-143-124 kubenswrapper[2552]: I0609 17:45:08.453280 2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/0228a3cc79630676fae641e6a38dab1752e85a08a4a9edc59ccf0da748fbsmc" event={"ID":"5c637e6c-13d7-47e3-885d-db097bf3788f","Type":"ContainerStarted","Data":"6429c851f9408f54d86fe22ec6f7cfab84775ffec55627936e386b3693022ff3"} Jun 09 17:45:09.460392 ip-10-0-143-124 kubenswrapper[2552]: I0609 17:45:09.460310 2552 generic.go:356] "Generic (PLEG): container finished" podID="5c637e6c-13d7-47e3-885d-db097bf3788f" containerID="0630f95ad831a5fac6b621733c0b06b9e6f4f9a711e19e7eb36d7ca591c4ae1f" exitCode=0 Jun 09 17:45:09.460771 ip-10-0-143-124 kubenswrapper[2552]: I0609 17:45:09.460402 2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/0228a3cc79630676fae641e6a38dab1752e85a08a4a9edc59ccf0da748fbsmc" event={"ID":"5c637e6c-13d7-47e3-885d-db097bf3788f","Type":"ContainerDied","Data":"0630f95ad831a5fac6b621733c0b06b9e6f4f9a711e19e7eb36d7ca591c4ae1f"} Jun 09 17:45:10.468147 ip-10-0-143-124 kubenswrapper[2552]: I0609 17:45:10.468115 2552 generic.go:356] "Generic (PLEG): container finished" podID="5c637e6c-13d7-47e3-885d-db097bf3788f" containerID="0d7184988a6f0f52e3449e174134c01635c50e677f299213a31197188297365d" exitCode=0 Jun 09 17:45:10.468513 ip-10-0-143-124 kubenswrapper[2552]: I0609 17:45:10.468202 2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/0228a3cc79630676fae641e6a38dab1752e85a08a4a9edc59ccf0da748fbsmc" event={"ID":"5c637e6c-13d7-47e3-885d-db097bf3788f","Type":"ContainerDied","Data":"0d7184988a6f0f52e3449e174134c01635c50e677f299213a31197188297365d"} Jun 09 17:45:11.605757 ip-10-0-143-124 kubenswrapper[2552]: I0609 17:45:11.605732 2552 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/0228a3cc79630676fae641e6a38dab1752e85a08a4a9edc59ccf0da748fbsmc" Jun 09 17:45:11.738475 ip-10-0-143-124 kubenswrapper[2552]: I0609 17:45:11.738377 2552 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/5c637e6c-13d7-47e3-885d-db097bf3788f-bundle\") pod \"5c637e6c-13d7-47e3-885d-db097bf3788f\" (UID: \"5c637e6c-13d7-47e3-885d-db097bf3788f\") " Jun 09 17:45:11.738475 ip-10-0-143-124 kubenswrapper[2552]: I0609 17:45:11.738450 2552 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-5mtp9\" (UniqueName: \"kubernetes.io/projected/5c637e6c-13d7-47e3-885d-db097bf3788f-kube-api-access-5mtp9\") pod \"5c637e6c-13d7-47e3-885d-db097bf3788f\" (UID: \"5c637e6c-13d7-47e3-885d-db097bf3788f\") " Jun 09 17:45:11.738475 ip-10-0-143-124 kubenswrapper[2552]: I0609 17:45:11.738471 2552 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/5c637e6c-13d7-47e3-885d-db097bf3788f-util\") pod \"5c637e6c-13d7-47e3-885d-db097bf3788f\" (UID: \"5c637e6c-13d7-47e3-885d-db097bf3788f\") " Jun 09 17:45:11.738947 ip-10-0-143-124 kubenswrapper[2552]: I0609 17:45:11.738920 2552 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/5c637e6c-13d7-47e3-885d-db097bf3788f-bundle" (OuterVolumeSpecName: "bundle") pod "5c637e6c-13d7-47e3-885d-db097bf3788f" (UID: "5c637e6c-13d7-47e3-885d-db097bf3788f"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 09 17:45:11.740648 ip-10-0-143-124 kubenswrapper[2552]: I0609 17:45:11.740569 2552 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/5c637e6c-13d7-47e3-885d-db097bf3788f-kube-api-access-5mtp9" (OuterVolumeSpecName: "kube-api-access-5mtp9") pod "5c637e6c-13d7-47e3-885d-db097bf3788f" (UID: "5c637e6c-13d7-47e3-885d-db097bf3788f"). InnerVolumeSpecName "kube-api-access-5mtp9". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 09 17:45:11.743991 ip-10-0-143-124 kubenswrapper[2552]: I0609 17:45:11.743971 2552 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/5c637e6c-13d7-47e3-885d-db097bf3788f-util" (OuterVolumeSpecName: "util") pod "5c637e6c-13d7-47e3-885d-db097bf3788f" (UID: "5c637e6c-13d7-47e3-885d-db097bf3788f"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 09 17:45:11.839405 ip-10-0-143-124 kubenswrapper[2552]: I0609 17:45:11.839362 2552 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/5c637e6c-13d7-47e3-885d-db097bf3788f-bundle\") on node \"ip-10-0-143-124.ec2.internal\" DevicePath \"\"" Jun 09 17:45:11.839405 ip-10-0-143-124 kubenswrapper[2552]: I0609 17:45:11.839403 2552 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-5mtp9\" (UniqueName: \"kubernetes.io/projected/5c637e6c-13d7-47e3-885d-db097bf3788f-kube-api-access-5mtp9\") on node \"ip-10-0-143-124.ec2.internal\" DevicePath \"\"" Jun 09 17:45:11.839405 ip-10-0-143-124 kubenswrapper[2552]: I0609 17:45:11.839413 2552 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/5c637e6c-13d7-47e3-885d-db097bf3788f-util\") on node \"ip-10-0-143-124.ec2.internal\" DevicePath \"\"" Jun 09 17:45:12.480459 ip-10-0-143-124 kubenswrapper[2552]: I0609 17:45:12.480434 2552 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/0228a3cc79630676fae641e6a38dab1752e85a08a4a9edc59ccf0da748fbsmc" Jun 09 17:45:12.480459 ip-10-0-143-124 kubenswrapper[2552]: I0609 17:45:12.480444 2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/0228a3cc79630676fae641e6a38dab1752e85a08a4a9edc59ccf0da748fbsmc" event={"ID":"5c637e6c-13d7-47e3-885d-db097bf3788f","Type":"ContainerDied","Data":"6429c851f9408f54d86fe22ec6f7cfab84775ffec55627936e386b3693022ff3"} Jun 09 17:45:12.480690 ip-10-0-143-124 kubenswrapper[2552]: I0609 17:45:12.480483 2552 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="6429c851f9408f54d86fe22ec6f7cfab84775ffec55627936e386b3693022ff3" Jun 09 17:45:32.113116 ip-10-0-143-124 kubenswrapper[2552]: I0609 17:45:32.113079 2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gctfs_8563ebab-ebdd-4d68-bce1-78d2a7f62992/konnectivity-agent/0.log" limit=1024 Jun 09 17:45:32.181161 ip-10-0-143-124 kubenswrapper[2552]: I0609 17:45:32.181128 2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gctfs_8563ebab-ebdd-4d68-bce1-78d2a7f62992/konnectivity-agent/0.log" limit=1024 Jun 09 17:45:32.411557 ip-10-0-143-124 kubenswrapper[2552]: I0609 17:45:32.411473 2552 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["keycloak-system/maas-keycloak-0"] Jun 09 17:45:32.411833 ip-10-0-143-124 kubenswrapper[2552]: I0609 17:45:32.411820 2552 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="5c637e6c-13d7-47e3-885d-db097bf3788f" containerName="extract" Jun 09 17:45:32.411882 ip-10-0-143-124 kubenswrapper[2552]: I0609 17:45:32.411835 2552 state_mem.go:107] "Deleted CPUSet assignment" podUID="5c637e6c-13d7-47e3-885d-db097bf3788f" containerName="extract" Jun 09 17:45:32.411882 ip-10-0-143-124 kubenswrapper[2552]: I0609 17:45:32.411853 2552 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="5c637e6c-13d7-47e3-885d-db097bf3788f" containerName="util" Jun 09 17:45:32.411882 ip-10-0-143-124 kubenswrapper[2552]: I0609 17:45:32.411858 2552 state_mem.go:107] "Deleted CPUSet assignment" podUID="5c637e6c-13d7-47e3-885d-db097bf3788f" containerName="util" Jun 09 17:45:32.411882 ip-10-0-143-124 kubenswrapper[2552]: I0609 17:45:32.411869 2552 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="5c637e6c-13d7-47e3-885d-db097bf3788f" containerName="pull" Jun 09 17:45:32.411882 ip-10-0-143-124 kubenswrapper[2552]: I0609 17:45:32.411875 2552 state_mem.go:107] "Deleted CPUSet assignment" podUID="5c637e6c-13d7-47e3-885d-db097bf3788f" containerName="pull" Jun 09 17:45:32.412029 ip-10-0-143-124 kubenswrapper[2552]: I0609 17:45:32.411932 2552 memory_manager.go:368] "RemoveStaleState removing state" podUID="5c637e6c-13d7-47e3-885d-db097bf3788f" containerName="extract" Jun 09 17:45:32.414171 ip-10-0-143-124 kubenswrapper[2552]: I0609 17:45:32.414151 2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="keycloak-system/maas-keycloak-0" Jun 09 17:45:32.416805 ip-10-0-143-124 kubenswrapper[2552]: I0609 17:45:32.416782 2552 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"keycloak-system\"/\"kube-root-ca.crt\"" Jun 09 17:45:32.417388 ip-10-0-143-124 kubenswrapper[2552]: I0609 17:45:32.417371 2552 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"keycloak-system\"/\"maas-keycloak-initial-admin\"" Jun 09 17:45:32.417871 ip-10-0-143-124 kubenswrapper[2552]: I0609 17:45:32.417855 2552 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"keycloak-system\"/\"default-dockercfg-9zkbd\"" Jun 09 17:45:32.417952 ip-10-0-143-124 kubenswrapper[2552]: I0609 17:45:32.417874 2552 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"keycloak-system\"/\"openshift-service-ca.crt\"" Jun 09 17:45:32.429942 ip-10-0-143-124 kubenswrapper[2552]: I0609 17:45:32.429904 2552 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["keycloak-system/maas-keycloak-0"] Jun 09 17:45:32.522486 ip-10-0-143-124 kubenswrapper[2552]: I0609 17:45:32.522455 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-pv62p\" (UniqueName: \"kubernetes.io/projected/454523dd-4306-4490-b948-ed010373bdd0-kube-api-access-pv62p\") pod \"maas-keycloak-0\" (UID: \"454523dd-4306-4490-b948-ed010373bdd0\") " pod="keycloak-system/maas-keycloak-0" Jun 09 17:45:32.623773 ip-10-0-143-124 kubenswrapper[2552]: I0609 17:45:32.623733 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-pv62p\" (UniqueName: \"kubernetes.io/projected/454523dd-4306-4490-b948-ed010373bdd0-kube-api-access-pv62p\") pod \"maas-keycloak-0\" (UID: \"454523dd-4306-4490-b948-ed010373bdd0\") " pod="keycloak-system/maas-keycloak-0" Jun 09 17:45:32.632885 ip-10-0-143-124 kubenswrapper[2552]: I0609 17:45:32.632850 2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-pv62p\" (UniqueName: \"kubernetes.io/projected/454523dd-4306-4490-b948-ed010373bdd0-kube-api-access-pv62p\") pod \"maas-keycloak-0\" (UID: \"454523dd-4306-4490-b948-ed010373bdd0\") " pod="keycloak-system/maas-keycloak-0" Jun 09 17:45:32.723641 ip-10-0-143-124 kubenswrapper[2552]: I0609 17:45:32.723549 2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="keycloak-system/maas-keycloak-0" Jun 09 17:45:32.860075 ip-10-0-143-124 kubenswrapper[2552]: I0609 17:45:32.860050 2552 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["keycloak-system/maas-keycloak-0"] Jun 09 17:45:32.862803 ip-10-0-143-124 kubenswrapper[2552]: W0609 17:45:32.862780 2552 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod454523dd_4306_4490_b948_ed010373bdd0.slice/crio-9d6842d073a1c0860e0dd5d25049fd3bfeb184f4bc50a64fafbf1761ea6d6acb WatchSource:0}: Error finding container 9d6842d073a1c0860e0dd5d25049fd3bfeb184f4bc50a64fafbf1761ea6d6acb: Status 404 returned error can't find the container with id 9d6842d073a1c0860e0dd5d25049fd3bfeb184f4bc50a64fafbf1761ea6d6acb Jun 09 17:45:32.864059 ip-10-0-143-124 kubenswrapper[2552]: I0609 17:45:32.864040 2552 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jun 09 17:45:33.599158 ip-10-0-143-124 kubenswrapper[2552]: I0609 17:45:33.599129 2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="keycloak-system/maas-keycloak-0" event={"ID":"454523dd-4306-4490-b948-ed010373bdd0","Type":"ContainerStarted","Data":"9d6842d073a1c0860e0dd5d25049fd3bfeb184f4bc50a64fafbf1761ea6d6acb"} Jun 09 17:45:38.639361 ip-10-0-143-124 kubenswrapper[2552]: I0609 17:45:38.639317 2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="keycloak-system/maas-keycloak-0" event={"ID":"454523dd-4306-4490-b948-ed010373bdd0","Type":"ContainerStarted","Data":"cbc0cb31d91d9c0e4f59769bb27110c3bae408f3f4d48d6fedbef87c6d49fff7"} Jun 09 17:45:38.662036 ip-10-0-143-124 kubenswrapper[2552]: I0609 17:45:38.661979 2552 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="keycloak-system/maas-keycloak-0" podStartSLOduration=1.882791576 podStartE2EDuration="6.661962404s" totalImagesPullingTime="4.779170828s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-09 17:45:32 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-09 17:45:38.658387907 +0000 UTC m=+742.758290560" watchObservedRunningTime="2026-06-09 17:45:38.661962404 +0000 UTC m=+742.761865054" Jun 09 17:45:38.723980 ip-10-0-143-124 kubenswrapper[2552]: I0609 17:45:38.723933 2552 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="keycloak-system/maas-keycloak-0" Jun 09 17:45:38.725870 ip-10-0-143-124 kubenswrapper[2552]: I0609 17:45:38.725838 2552 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="454523dd-4306-4490-b948-ed010373bdd0" containerName="keycloak" probeResult="failure" output="Get \"http://10.134.0.48:9000/health/started\": dial tcp 10.134.0.48:9000: connect: connection refused" Jun 09 17:45:39.724274 ip-10-0-143-124 kubenswrapper[2552]: I0609 17:45:39.724223 2552 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="454523dd-4306-4490-b948-ed010373bdd0" containerName="keycloak" probeResult="failure" output="Get \"http://10.134.0.48:9000/health/started\": dial tcp 10.134.0.48:9000: connect: connection refused" Jun 09 17:45:40.724907 ip-10-0-143-124 kubenswrapper[2552]: I0609 17:45:40.724851 2552 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="454523dd-4306-4490-b948-ed010373bdd0" containerName="keycloak" probeResult="failure" output="Get \"http://10.134.0.48:9000/health/started\": dial tcp 10.134.0.48:9000: connect: connection refused" Jun 09 17:45:41.079105 ip-10-0-143-124 kubenswrapper[2552]: I0609 17:45:41.079069 2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gctfs_8563ebab-ebdd-4d68-bce1-78d2a7f62992/konnectivity-agent/0.log" limit=1024 Jun 09 17:45:41.724460 ip-10-0-143-124 kubenswrapper[2552]: I0609 17:45:41.724412 2552 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="454523dd-4306-4490-b948-ed010373bdd0" containerName="keycloak" probeResult="failure" output="Get \"http://10.134.0.48:9000/health/started\": dial tcp 10.134.0.48:9000: connect: connection refused" Jun 09 17:45:42.724085 ip-10-0-143-124 kubenswrapper[2552]: I0609 17:45:42.724030 2552 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="454523dd-4306-4490-b948-ed010373bdd0" containerName="keycloak" probeResult="failure" output="Get \"http://10.134.0.48:9000/health/started\": dial tcp 10.134.0.48:9000: connect: connection refused" Jun 09 17:45:42.725991 ip-10-0-143-124 kubenswrapper[2552]: I0609 17:45:42.725965 2552 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="keycloak-system/maas-keycloak-0" Jun 09 17:45:43.724841 ip-10-0-143-124 kubenswrapper[2552]: I0609 17:45:43.724783 2552 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="454523dd-4306-4490-b948-ed010373bdd0" containerName="keycloak" probeResult="failure" output="Get \"http://10.134.0.48:9000/health/started\": dial tcp 10.134.0.48:9000: connect: connection refused" Jun 09 17:45:44.724964 ip-10-0-143-124 kubenswrapper[2552]: I0609 17:45:44.724914 2552 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="454523dd-4306-4490-b948-ed010373bdd0" containerName="keycloak" probeResult="failure" output="Get \"http://10.134.0.48:9000/health/started\": dial tcp 10.134.0.48:9000: connect: connection refused" Jun 09 17:45:45.724612 ip-10-0-143-124 kubenswrapper[2552]: I0609 17:45:45.724556 2552 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="454523dd-4306-4490-b948-ed010373bdd0" containerName="keycloak" probeResult="failure" output="Get \"http://10.134.0.48:9000/health/started\": dial tcp 10.134.0.48:9000: connect: connection refused" Jun 09 17:45:46.724857 ip-10-0-143-124 kubenswrapper[2552]: I0609 17:45:46.724814 2552 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="454523dd-4306-4490-b948-ed010373bdd0" containerName="keycloak" probeResult="failure" output="Get \"http://10.134.0.48:9000/health/started\": dial tcp 10.134.0.48:9000: connect: connection refused" Jun 09 17:45:47.724495 ip-10-0-143-124 kubenswrapper[2552]: I0609 17:45:47.724437 2552 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="454523dd-4306-4490-b948-ed010373bdd0" containerName="keycloak" probeResult="failure" output="Get \"http://10.134.0.48:9000/health/started\": dial tcp 10.134.0.48:9000: connect: connection refused" Jun 09 17:45:48.724437 ip-10-0-143-124 kubenswrapper[2552]: I0609 17:45:48.724388 2552 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="454523dd-4306-4490-b948-ed010373bdd0" containerName="keycloak" probeResult="failure" output="Get \"http://10.134.0.48:9000/health/started\": dial tcp 10.134.0.48:9000: connect: connection refused" Jun 09 17:45:49.724399 ip-10-0-143-124 kubenswrapper[2552]: I0609 17:45:49.724341 2552 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="454523dd-4306-4490-b948-ed010373bdd0" containerName="keycloak" probeResult="failure" output="Get \"http://10.134.0.48:9000/health/started\": dial tcp 10.134.0.48:9000: connect: connection refused" Jun 09 17:45:50.821589 ip-10-0-143-124 kubenswrapper[2552]: I0609 17:45:50.821549 2552 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="keycloak-system/maas-keycloak-0" Jun 09 17:45:50.836094 ip-10-0-143-124 kubenswrapper[2552]: I0609 17:45:50.836042 2552 prober.go:120] "Probe failed" probeType="Readiness" pod="keycloak-system/maas-keycloak-0" podUID="454523dd-4306-4490-b948-ed010373bdd0" containerName="keycloak" probeResult="failure" output="HTTP probe failed with statuscode: 503" Jun 09 17:45:56.995782 ip-10-0-143-124 kubenswrapper[2552]: I0609 17:45:56.995737 2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gctfs_8563ebab-ebdd-4d68-bce1-78d2a7f62992/konnectivity-agent/0.log" limit=1024 Jun 09 17:45:57.094243 ip-10-0-143-124 kubenswrapper[2552]: I0609 17:45:57.094196 2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gctfs_8563ebab-ebdd-4d68-bce1-78d2a7f62992/konnectivity-agent/0.log" limit=1024 Jun 09 17:46:00.828183 ip-10-0-143-124 kubenswrapper[2552]: I0609 17:46:00.828149 2552 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="keycloak-system/maas-keycloak-0" Jun 09 17:46:01.618723 ip-10-0-143-124 kubenswrapper[2552]: I0609 17:46:01.618682 2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gctfs_8563ebab-ebdd-4d68-bce1-78d2a7f62992/konnectivity-agent/0.log" limit=1024 Jun 09 17:46:01.941541 ip-10-0-143-124 kubenswrapper[2552]: I0609 17:46:01.941450 2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gctfs_8563ebab-ebdd-4d68-bce1-78d2a7f62992/konnectivity-agent/0.log" limit=1024 Jun 09 17:46:07.481726 ip-10-0-143-124 kubenswrapper[2552]: I0609 17:46:07.481686 2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gctfs_8563ebab-ebdd-4d68-bce1-78d2a7f62992/konnectivity-agent/0.log" limit=1024 Jun 09 17:46:07.483423 ip-10-0-143-124 kubenswrapper[2552]: I0609 17:46:07.483396 2552 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/maas-controller-74c64d7d48-48lgd"] Jun 09 17:46:07.487263 ip-10-0-143-124 kubenswrapper[2552]: I0609 17:46:07.487243 2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-74c64d7d48-48lgd" Jun 09 17:46:07.489923 ip-10-0-143-124 kubenswrapper[2552]: I0609 17:46:07.489899 2552 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"maas-parameters\"" Jun 09 17:46:07.490027 ip-10-0-143-124 kubenswrapper[2552]: I0609 17:46:07.490000 2552 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-controller-webhook-cert\"" Jun 09 17:46:07.490131 ip-10-0-143-124 kubenswrapper[2552]: I0609 17:46:07.490116 2552 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-controller-dockercfg-8qql6\"" Jun 09 17:46:07.496632 ip-10-0-143-124 kubenswrapper[2552]: I0609 17:46:07.496612 2552 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-74c64d7d48-48lgd"] Jun 09 17:46:07.579162 ip-10-0-143-124 kubenswrapper[2552]: I0609 17:46:07.579111 2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gctfs_8563ebab-ebdd-4d68-bce1-78d2a7f62992/konnectivity-agent/0.log" limit=1024 Jun 09 17:46:07.580099 ip-10-0-143-124 kubenswrapper[2552]: I0609 17:46:07.580081 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-b7vzb\" (UniqueName: \"kubernetes.io/projected/64881c67-ae3c-4001-a38f-ba0e49e84fb5-kube-api-access-b7vzb\") pod \"maas-controller-74c64d7d48-48lgd\" (UID: \"64881c67-ae3c-4001-a38f-ba0e49e84fb5\") " pod="opendatahub/maas-controller-74c64d7d48-48lgd" Jun 09 17:46:07.580171 ip-10-0-143-124 kubenswrapper[2552]: I0609 17:46:07.580124 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/64881c67-ae3c-4001-a38f-ba0e49e84fb5-webhook-cert\") pod \"maas-controller-74c64d7d48-48lgd\" (UID: \"64881c67-ae3c-4001-a38f-ba0e49e84fb5\") " pod="opendatahub/maas-controller-74c64d7d48-48lgd" Jun 09 17:46:07.680808 ip-10-0-143-124 kubenswrapper[2552]: I0609 17:46:07.680772 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-b7vzb\" (UniqueName: \"kubernetes.io/projected/64881c67-ae3c-4001-a38f-ba0e49e84fb5-kube-api-access-b7vzb\") pod \"maas-controller-74c64d7d48-48lgd\" (UID: \"64881c67-ae3c-4001-a38f-ba0e49e84fb5\") " pod="opendatahub/maas-controller-74c64d7d48-48lgd" Jun 09 17:46:07.681014 ip-10-0-143-124 kubenswrapper[2552]: I0609 17:46:07.680826 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/64881c67-ae3c-4001-a38f-ba0e49e84fb5-webhook-cert\") pod \"maas-controller-74c64d7d48-48lgd\" (UID: \"64881c67-ae3c-4001-a38f-ba0e49e84fb5\") " pod="opendatahub/maas-controller-74c64d7d48-48lgd" Jun 09 17:46:07.681014 ip-10-0-143-124 kubenswrapper[2552]: I0609 17:46:07.680771 2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gctfs_8563ebab-ebdd-4d68-bce1-78d2a7f62992/konnectivity-agent/0.log" limit=1024 Jun 09 17:46:07.681014 ip-10-0-143-124 kubenswrapper[2552]: E0609 17:46:07.680967 2552 secret.go:189] Couldn't get secret opendatahub/maas-controller-webhook-cert: secret "maas-controller-webhook-cert" not found Jun 09 17:46:07.681129 ip-10-0-143-124 kubenswrapper[2552]: E0609 17:46:07.681029 2552 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/64881c67-ae3c-4001-a38f-ba0e49e84fb5-webhook-cert podName:64881c67-ae3c-4001-a38f-ba0e49e84fb5 nodeName:}" failed. No retries permitted until 2026-06-09 17:46:08.181012858 +0000 UTC m=+772.280915488 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "webhook-cert" (UniqueName: "kubernetes.io/secret/64881c67-ae3c-4001-a38f-ba0e49e84fb5-webhook-cert") pod "maas-controller-74c64d7d48-48lgd" (UID: "64881c67-ae3c-4001-a38f-ba0e49e84fb5") : secret "maas-controller-webhook-cert" not found Jun 09 17:46:07.704703 ip-10-0-143-124 kubenswrapper[2552]: I0609 17:46:07.704669 2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-b7vzb\" (UniqueName: \"kubernetes.io/projected/64881c67-ae3c-4001-a38f-ba0e49e84fb5-kube-api-access-b7vzb\") pod \"maas-controller-74c64d7d48-48lgd\" (UID: \"64881c67-ae3c-4001-a38f-ba0e49e84fb5\") " pod="opendatahub/maas-controller-74c64d7d48-48lgd" Jun 09 17:46:07.769502 ip-10-0-143-124 kubenswrapper[2552]: I0609 17:46:07.769470 2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gctfs_8563ebab-ebdd-4d68-bce1-78d2a7f62992/konnectivity-agent/0.log" limit=1024 Jun 09 17:46:08.185995 ip-10-0-143-124 kubenswrapper[2552]: I0609 17:46:08.185891 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/64881c67-ae3c-4001-a38f-ba0e49e84fb5-webhook-cert\") pod \"maas-controller-74c64d7d48-48lgd\" (UID: \"64881c67-ae3c-4001-a38f-ba0e49e84fb5\") " pod="opendatahub/maas-controller-74c64d7d48-48lgd" Jun 09 17:46:08.188291 ip-10-0-143-124 kubenswrapper[2552]: I0609 17:46:08.188266 2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/64881c67-ae3c-4001-a38f-ba0e49e84fb5-webhook-cert\") pod \"maas-controller-74c64d7d48-48lgd\" (UID: \"64881c67-ae3c-4001-a38f-ba0e49e84fb5\") " pod="opendatahub/maas-controller-74c64d7d48-48lgd" Jun 09 17:46:08.399075 ip-10-0-143-124 kubenswrapper[2552]: I0609 17:46:08.399043 2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-74c64d7d48-48lgd" Jun 09 17:46:08.531453 ip-10-0-143-124 kubenswrapper[2552]: I0609 17:46:08.531422 2552 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-74c64d7d48-48lgd"] Jun 09 17:46:08.533367 ip-10-0-143-124 kubenswrapper[2552]: W0609 17:46:08.533338 2552 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod64881c67_ae3c_4001_a38f_ba0e49e84fb5.slice/crio-2cac5da062163fee016b9276cd0880daf1b87cd5a3324e9241cdabb6bb815160 WatchSource:0}: Error finding container 2cac5da062163fee016b9276cd0880daf1b87cd5a3324e9241cdabb6bb815160: Status 404 returned error can't find the container with id 2cac5da062163fee016b9276cd0880daf1b87cd5a3324e9241cdabb6bb815160 Jun 09 17:46:08.841570 ip-10-0-143-124 kubenswrapper[2552]: I0609 17:46:08.841537 2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-74c64d7d48-48lgd" event={"ID":"64881c67-ae3c-4001-a38f-ba0e49e84fb5","Type":"ContainerStarted","Data":"2cac5da062163fee016b9276cd0880daf1b87cd5a3324e9241cdabb6bb815160"} Jun 09 17:46:11.862258 ip-10-0-143-124 kubenswrapper[2552]: I0609 17:46:11.862222 2552 generic.go:356] "Generic (PLEG): container finished" podID="64881c67-ae3c-4001-a38f-ba0e49e84fb5" containerID="fc168a512943779c6b2474801a61a209faa1ae74f0c3b9ec976cc8094379133d" exitCode=2 Jun 09 17:46:11.862765 ip-10-0-143-124 kubenswrapper[2552]: I0609 17:46:11.862306 2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-74c64d7d48-48lgd" event={"ID":"64881c67-ae3c-4001-a38f-ba0e49e84fb5","Type":"ContainerDied","Data":"fc168a512943779c6b2474801a61a209faa1ae74f0c3b9ec976cc8094379133d"} Jun 09 17:46:11.862765 ip-10-0-143-124 kubenswrapper[2552]: I0609 17:46:11.862560 2552 scope.go:117] "RemoveContainer" containerID="fc168a512943779c6b2474801a61a209faa1ae74f0c3b9ec976cc8094379133d" Jun 09 17:46:12.869002 ip-10-0-143-124 kubenswrapper[2552]: I0609 17:46:12.868972 2552 generic.go:356] "Generic (PLEG): container finished" podID="64881c67-ae3c-4001-a38f-ba0e49e84fb5" containerID="46547089a2053b5f4bbcfae07dfdc0ed974a7aa58af3f57bfd0e7c51a264870f" exitCode=2 Jun 09 17:46:12.869479 ip-10-0-143-124 kubenswrapper[2552]: I0609 17:46:12.869074 2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-74c64d7d48-48lgd" event={"ID":"64881c67-ae3c-4001-a38f-ba0e49e84fb5","Type":"ContainerDied","Data":"46547089a2053b5f4bbcfae07dfdc0ed974a7aa58af3f57bfd0e7c51a264870f"} Jun 09 17:46:12.869479 ip-10-0-143-124 kubenswrapper[2552]: I0609 17:46:12.869134 2552 scope.go:117] "RemoveContainer" containerID="fc168a512943779c6b2474801a61a209faa1ae74f0c3b9ec976cc8094379133d" Jun 09 17:46:12.869479 ip-10-0-143-124 kubenswrapper[2552]: I0609 17:46:12.869269 2552 scope.go:117] "RemoveContainer" containerID="46547089a2053b5f4bbcfae07dfdc0ed974a7aa58af3f57bfd0e7c51a264870f" Jun 09 17:46:12.869620 ip-10-0-143-124 kubenswrapper[2552]: E0609 17:46:12.869487 2552 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"manager\" with CrashLoopBackOff: \"back-off 10s restarting failed container=manager pod=maas-controller-74c64d7d48-48lgd_opendatahub(64881c67-ae3c-4001-a38f-ba0e49e84fb5)\"" pod="opendatahub/maas-controller-74c64d7d48-48lgd" podUID="64881c67-ae3c-4001-a38f-ba0e49e84fb5" Jun 09 17:46:13.876539 ip-10-0-143-124 kubenswrapper[2552]: I0609 17:46:13.876504 2552 scope.go:117] "RemoveContainer" containerID="46547089a2053b5f4bbcfae07dfdc0ed974a7aa58af3f57bfd0e7c51a264870f" Jun 09 17:46:13.876936 ip-10-0-143-124 kubenswrapper[2552]: E0609 17:46:13.876723 2552 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"manager\" with CrashLoopBackOff: \"back-off 10s restarting failed container=manager pod=maas-controller-74c64d7d48-48lgd_opendatahub(64881c67-ae3c-4001-a38f-ba0e49e84fb5)\"" pod="opendatahub/maas-controller-74c64d7d48-48lgd" podUID="64881c67-ae3c-4001-a38f-ba0e49e84fb5" Jun 09 17:46:18.399669 ip-10-0-143-124 kubenswrapper[2552]: I0609 17:46:18.399625 2552 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/maas-controller-74c64d7d48-48lgd" Jun 09 17:46:18.400058 ip-10-0-143-124 kubenswrapper[2552]: I0609 17:46:18.399984 2552 scope.go:117] "RemoveContainer" containerID="46547089a2053b5f4bbcfae07dfdc0ed974a7aa58af3f57bfd0e7c51a264870f" Jun 09 17:46:18.400232 ip-10-0-143-124 kubenswrapper[2552]: E0609 17:46:18.400208 2552 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"manager\" with CrashLoopBackOff: \"back-off 10s restarting failed container=manager pod=maas-controller-74c64d7d48-48lgd_opendatahub(64881c67-ae3c-4001-a38f-ba0e49e84fb5)\"" pod="opendatahub/maas-controller-74c64d7d48-48lgd" podUID="64881c67-ae3c-4001-a38f-ba0e49e84fb5" Jun 09 17:46:28.399800 ip-10-0-143-124 kubenswrapper[2552]: I0609 17:46:28.399762 2552 kubelet.go:2654] "SyncLoop (probe)" probe="liveness" status="unhealthy" pod="opendatahub/maas-controller-74c64d7d48-48lgd" Jun 09 17:46:28.400268 ip-10-0-143-124 kubenswrapper[2552]: I0609 17:46:28.400142 2552 scope.go:117] "RemoveContainer" containerID="46547089a2053b5f4bbcfae07dfdc0ed974a7aa58af3f57bfd0e7c51a264870f" Jun 09 17:46:28.956500 ip-10-0-143-124 kubenswrapper[2552]: I0609 17:46:28.956468 2552 generic.go:356] "Generic (PLEG): container finished" podID="64881c67-ae3c-4001-a38f-ba0e49e84fb5" containerID="f2e29d5de13cb484b9b0e00faa5e5381f61f4ffcc045f623c58487482607c3b1" exitCode=2 Jun 09 17:46:28.956647 ip-10-0-143-124 kubenswrapper[2552]: I0609 17:46:28.956558 2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-74c64d7d48-48lgd" event={"ID":"64881c67-ae3c-4001-a38f-ba0e49e84fb5","Type":"ContainerDied","Data":"f2e29d5de13cb484b9b0e00faa5e5381f61f4ffcc045f623c58487482607c3b1"} Jun 09 17:46:28.956647 ip-10-0-143-124 kubenswrapper[2552]: I0609 17:46:28.956639 2552 scope.go:117] "RemoveContainer" containerID="46547089a2053b5f4bbcfae07dfdc0ed974a7aa58af3f57bfd0e7c51a264870f" Jun 09 17:46:28.957010 ip-10-0-143-124 kubenswrapper[2552]: I0609 17:46:28.956991 2552 scope.go:117] "RemoveContainer" containerID="f2e29d5de13cb484b9b0e00faa5e5381f61f4ffcc045f623c58487482607c3b1" Jun 09 17:46:28.957208 ip-10-0-143-124 kubenswrapper[2552]: E0609 17:46:28.957186 2552 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"manager\" with CrashLoopBackOff: \"back-off 20s restarting failed container=manager pod=maas-controller-74c64d7d48-48lgd_opendatahub(64881c67-ae3c-4001-a38f-ba0e49e84fb5)\"" pod="opendatahub/maas-controller-74c64d7d48-48lgd" podUID="64881c67-ae3c-4001-a38f-ba0e49e84fb5" Jun 09 17:46:30.579984 ip-10-0-143-124 kubenswrapper[2552]: I0609 17:46:30.579950 2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gctfs_8563ebab-ebdd-4d68-bce1-78d2a7f62992/konnectivity-agent/0.log" limit=1024 Jun 09 17:46:38.399284 ip-10-0-143-124 kubenswrapper[2552]: I0609 17:46:38.399252 2552 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/maas-controller-74c64d7d48-48lgd" Jun 09 17:46:38.399709 ip-10-0-143-124 kubenswrapper[2552]: I0609 17:46:38.399558 2552 scope.go:117] "RemoveContainer" containerID="f2e29d5de13cb484b9b0e00faa5e5381f61f4ffcc045f623c58487482607c3b1" Jun 09 17:46:38.399764 ip-10-0-143-124 kubenswrapper[2552]: E0609 17:46:38.399747 2552 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"manager\" with CrashLoopBackOff: \"back-off 20s restarting failed container=manager pod=maas-controller-74c64d7d48-48lgd_opendatahub(64881c67-ae3c-4001-a38f-ba0e49e84fb5)\"" pod="opendatahub/maas-controller-74c64d7d48-48lgd" podUID="64881c67-ae3c-4001-a38f-ba0e49e84fb5" Jun 09 17:46:44.906641 ip-10-0-143-124 kubenswrapper[2552]: I0609 17:46:44.906575 2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gctfs_8563ebab-ebdd-4d68-bce1-78d2a7f62992/konnectivity-agent/0.log" limit=1024 Jun 09 17:46:44.993835 ip-10-0-143-124 kubenswrapper[2552]: I0609 17:46:44.993802 2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gctfs_8563ebab-ebdd-4d68-bce1-78d2a7f62992/konnectivity-agent/0.log" limit=1024 Jun 09 17:46:48.399901 ip-10-0-143-124 kubenswrapper[2552]: I0609 17:46:48.399865 2552 kubelet.go:2654] "SyncLoop (probe)" probe="liveness" status="unhealthy" pod="opendatahub/maas-controller-74c64d7d48-48lgd" Jun 09 17:46:48.400288 ip-10-0-143-124 kubenswrapper[2552]: I0609 17:46:48.400245 2552 scope.go:117] "RemoveContainer" containerID="f2e29d5de13cb484b9b0e00faa5e5381f61f4ffcc045f623c58487482607c3b1" Jun 09 17:46:48.400431 ip-10-0-143-124 kubenswrapper[2552]: E0609 17:46:48.400411 2552 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"manager\" with CrashLoopBackOff: \"back-off 20s restarting failed container=manager pod=maas-controller-74c64d7d48-48lgd_opendatahub(64881c67-ae3c-4001-a38f-ba0e49e84fb5)\"" pod="opendatahub/maas-controller-74c64d7d48-48lgd" podUID="64881c67-ae3c-4001-a38f-ba0e49e84fb5" Jun 09 17:47:03.331794 ip-10-0-143-124 kubenswrapper[2552]: I0609 17:47:03.331763 2552 scope.go:117] "RemoveContainer" containerID="f2e29d5de13cb484b9b0e00faa5e5381f61f4ffcc045f623c58487482607c3b1" Jun 09 17:47:04.154996 ip-10-0-143-124 kubenswrapper[2552]: I0609 17:47:04.154965 2552 generic.go:356] "Generic (PLEG): container finished" podID="64881c67-ae3c-4001-a38f-ba0e49e84fb5" containerID="a8a3ce8ef9a6cc808a6f92af7e4dd8081cfaa8783a318aa8025f57d7ca54839b" exitCode=2 Jun 09 17:47:04.155176 ip-10-0-143-124 kubenswrapper[2552]: I0609 17:47:04.155042 2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-74c64d7d48-48lgd" event={"ID":"64881c67-ae3c-4001-a38f-ba0e49e84fb5","Type":"ContainerDied","Data":"a8a3ce8ef9a6cc808a6f92af7e4dd8081cfaa8783a318aa8025f57d7ca54839b"} Jun 09 17:47:04.155176 ip-10-0-143-124 kubenswrapper[2552]: I0609 17:47:04.155108 2552 scope.go:117] "RemoveContainer" containerID="f2e29d5de13cb484b9b0e00faa5e5381f61f4ffcc045f623c58487482607c3b1" Jun 09 17:47:04.155439 ip-10-0-143-124 kubenswrapper[2552]: I0609 17:47:04.155416 2552 scope.go:117] "RemoveContainer" containerID="a8a3ce8ef9a6cc808a6f92af7e4dd8081cfaa8783a318aa8025f57d7ca54839b" Jun 09 17:47:04.155643 ip-10-0-143-124 kubenswrapper[2552]: E0609 17:47:04.155624 2552 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"manager\" with CrashLoopBackOff: \"back-off 40s restarting failed container=manager pod=maas-controller-74c64d7d48-48lgd_opendatahub(64881c67-ae3c-4001-a38f-ba0e49e84fb5)\"" pod="opendatahub/maas-controller-74c64d7d48-48lgd" podUID="64881c67-ae3c-4001-a38f-ba0e49e84fb5" Jun 09 17:47:08.399764 ip-10-0-143-124 kubenswrapper[2552]: I0609 17:47:08.399735 2552 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/maas-controller-74c64d7d48-48lgd" Jun 09 17:47:08.400178 ip-10-0-143-124 kubenswrapper[2552]: I0609 17:47:08.399790 2552 kubelet.go:2654] "SyncLoop (probe)" probe="liveness" status="unhealthy" pod="opendatahub/maas-controller-74c64d7d48-48lgd" Jun 09 17:47:08.400178 ip-10-0-143-124 kubenswrapper[2552]: I0609 17:47:08.400084 2552 scope.go:117] "RemoveContainer" containerID="a8a3ce8ef9a6cc808a6f92af7e4dd8081cfaa8783a318aa8025f57d7ca54839b" Jun 09 17:47:08.400297 ip-10-0-143-124 kubenswrapper[2552]: E0609 17:47:08.400277 2552 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"manager\" with CrashLoopBackOff: \"back-off 40s restarting failed container=manager pod=maas-controller-74c64d7d48-48lgd_opendatahub(64881c67-ae3c-4001-a38f-ba0e49e84fb5)\"" pod="opendatahub/maas-controller-74c64d7d48-48lgd" podUID="64881c67-ae3c-4001-a38f-ba0e49e84fb5" Jun 09 17:47:21.331674 ip-10-0-143-124 kubenswrapper[2552]: I0609 17:47:21.331641 2552 scope.go:117] "RemoveContainer" containerID="a8a3ce8ef9a6cc808a6f92af7e4dd8081cfaa8783a318aa8025f57d7ca54839b" Jun 09 17:47:21.332066 ip-10-0-143-124 kubenswrapper[2552]: E0609 17:47:21.331827 2552 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"manager\" with CrashLoopBackOff: \"back-off 40s restarting failed container=manager pod=maas-controller-74c64d7d48-48lgd_opendatahub(64881c67-ae3c-4001-a38f-ba0e49e84fb5)\"" pod="opendatahub/maas-controller-74c64d7d48-48lgd" podUID="64881c67-ae3c-4001-a38f-ba0e49e84fb5" Jun 09 17:47:32.332087 ip-10-0-143-124 kubenswrapper[2552]: I0609 17:47:32.332059 2552 scope.go:117] "RemoveContainer" containerID="a8a3ce8ef9a6cc808a6f92af7e4dd8081cfaa8783a318aa8025f57d7ca54839b" Jun 09 17:47:32.332457 ip-10-0-143-124 kubenswrapper[2552]: E0609 17:47:32.332225 2552 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"manager\" with CrashLoopBackOff: \"back-off 40s restarting failed container=manager pod=maas-controller-74c64d7d48-48lgd_opendatahub(64881c67-ae3c-4001-a38f-ba0e49e84fb5)\"" pod="opendatahub/maas-controller-74c64d7d48-48lgd" podUID="64881c67-ae3c-4001-a38f-ba0e49e84fb5" Jun 09 17:47:43.331684 ip-10-0-143-124 kubenswrapper[2552]: I0609 17:47:43.331649 2552 scope.go:117] "RemoveContainer" containerID="a8a3ce8ef9a6cc808a6f92af7e4dd8081cfaa8783a318aa8025f57d7ca54839b" Jun 09 17:47:43.332153 ip-10-0-143-124 kubenswrapper[2552]: E0609 17:47:43.331849 2552 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"manager\" with CrashLoopBackOff: \"back-off 40s restarting failed container=manager pod=maas-controller-74c64d7d48-48lgd_opendatahub(64881c67-ae3c-4001-a38f-ba0e49e84fb5)\"" pod="opendatahub/maas-controller-74c64d7d48-48lgd" podUID="64881c67-ae3c-4001-a38f-ba0e49e84fb5" Jun 09 17:47:54.332129 ip-10-0-143-124 kubenswrapper[2552]: I0609 17:47:54.332097 2552 scope.go:117] "RemoveContainer" containerID="a8a3ce8ef9a6cc808a6f92af7e4dd8081cfaa8783a318aa8025f57d7ca54839b" Jun 09 17:47:55.445421 ip-10-0-143-124 kubenswrapper[2552]: I0609 17:47:55.445389 2552 generic.go:356] "Generic (PLEG): container finished" podID="64881c67-ae3c-4001-a38f-ba0e49e84fb5" containerID="b282ba914d58e4198fe3ee106b22ad42f3725a1ce7ee52652f949f5867c7ddad" exitCode=2 Jun 09 17:47:55.445857 ip-10-0-143-124 kubenswrapper[2552]: I0609 17:47:55.445468 2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-74c64d7d48-48lgd" event={"ID":"64881c67-ae3c-4001-a38f-ba0e49e84fb5","Type":"ContainerDied","Data":"b282ba914d58e4198fe3ee106b22ad42f3725a1ce7ee52652f949f5867c7ddad"} Jun 09 17:47:55.445857 ip-10-0-143-124 kubenswrapper[2552]: I0609 17:47:55.445531 2552 scope.go:117] "RemoveContainer" containerID="a8a3ce8ef9a6cc808a6f92af7e4dd8081cfaa8783a318aa8025f57d7ca54839b" Jun 09 17:47:55.445952 ip-10-0-143-124 kubenswrapper[2552]: I0609 17:47:55.445883 2552 scope.go:117] "RemoveContainer" containerID="b282ba914d58e4198fe3ee106b22ad42f3725a1ce7ee52652f949f5867c7ddad" Jun 09 17:47:55.446109 ip-10-0-143-124 kubenswrapper[2552]: E0609 17:47:55.446087 2552 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"manager\" with CrashLoopBackOff: \"back-off 1m20s restarting failed container=manager pod=maas-controller-74c64d7d48-48lgd_opendatahub(64881c67-ae3c-4001-a38f-ba0e49e84fb5)\"" pod="opendatahub/maas-controller-74c64d7d48-48lgd" podUID="64881c67-ae3c-4001-a38f-ba0e49e84fb5" Jun 09 17:47:58.399885 ip-10-0-143-124 kubenswrapper[2552]: I0609 17:47:58.399852 2552 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/maas-controller-74c64d7d48-48lgd" Jun 09 17:47:58.400264 ip-10-0-143-124 kubenswrapper[2552]: I0609 17:47:58.400176 2552 scope.go:117] "RemoveContainer" containerID="b282ba914d58e4198fe3ee106b22ad42f3725a1ce7ee52652f949f5867c7ddad" Jun 09 17:47:58.400407 ip-10-0-143-124 kubenswrapper[2552]: E0609 17:47:58.400384 2552 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"manager\" with CrashLoopBackOff: \"back-off 1m20s restarting failed container=manager pod=maas-controller-74c64d7d48-48lgd_opendatahub(64881c67-ae3c-4001-a38f-ba0e49e84fb5)\"" pod="opendatahub/maas-controller-74c64d7d48-48lgd" podUID="64881c67-ae3c-4001-a38f-ba0e49e84fb5" Jun 09 17:48:08.399907 ip-10-0-143-124 kubenswrapper[2552]: I0609 17:48:08.399832 2552 kubelet.go:2654] "SyncLoop (probe)" probe="liveness" status="unhealthy" pod="opendatahub/maas-controller-74c64d7d48-48lgd" Jun 09 17:48:08.400272 ip-10-0-143-124 kubenswrapper[2552]: I0609 17:48:08.400206 2552 scope.go:117] "RemoveContainer" containerID="b282ba914d58e4198fe3ee106b22ad42f3725a1ce7ee52652f949f5867c7ddad" Jun 09 17:48:08.400401 ip-10-0-143-124 kubenswrapper[2552]: E0609 17:48:08.400380 2552 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"manager\" with CrashLoopBackOff: \"back-off 1m20s restarting failed container=manager pod=maas-controller-74c64d7d48-48lgd_opendatahub(64881c67-ae3c-4001-a38f-ba0e49e84fb5)\"" pod="opendatahub/maas-controller-74c64d7d48-48lgd" podUID="64881c67-ae3c-4001-a38f-ba0e49e84fb5" Jun 09 17:48:11.356165 ip-10-0-143-124 kubenswrapper[2552]: I0609 17:48:11.356128 2552 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_dashboard-redirect-54fb48c7f6-mffj8_0e04dbaf-ff38-4ccd-9d38-22cebb02badb/nginx/0.log" Jun 09 17:48:11.580293 ip-10-0-143-124 kubenswrapper[2552]: I0609 17:48:11.580267 2552 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_llmisvc-controller-manager-864bfd7bc9-jr926_29a513a4-725e-400b-aa6b-459355eeb531/manager/0.log" Jun 09 17:48:11.808346 ip-10-0-143-124 kubenswrapper[2552]: I0609 17:48:11.808310 2552 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_maas-controller-74c64d7d48-48lgd_64881c67-ae3c-4001-a38f-ba0e49e84fb5/manager/4.log" Jun 09 17:48:11.918326 ip-10-0-143-124 kubenswrapper[2552]: I0609 17:48:11.918291 2552 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_model-serving-api-5dd488fc48-hnszm_fe0acebb-1dc4-44f6-99ed-62a699d9fe1c/server/0.log" Jun 09 17:48:12.039464 ip-10-0-143-124 kubenswrapper[2552]: I0609 17:48:12.039428 2552 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_odh-model-controller-6dc94f689f-mpvn5_5c147dc2-9013-4b7b-8663-88517c65aed6/manager/0.log" Jun 09 17:48:12.399990 ip-10-0-143-124 kubenswrapper[2552]: I0609 17:48:12.399960 2552 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-6f958f486-vmz6p_f91285d9-a18a-44eb-8272-c0ef9586564d/copy-manifests/0.log" Jun 09 17:48:12.407487 ip-10-0-143-124 kubenswrapper[2552]: I0609 17:48:12.407459 2552 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-6f958f486-vmz6p_f91285d9-a18a-44eb-8272-c0ef9586564d/manager/0.log" Jun 09 17:48:13.177274 ip-10-0-143-124 kubenswrapper[2552]: I0609 17:48:13.177241 2552 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7596r2jv_3fd7a23d-1fbd-4c8f-b102-684ecf696e27/util/0.log" Jun 09 17:48:13.183967 ip-10-0-143-124 kubenswrapper[2552]: I0609 17:48:13.183941 2552 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7596r2jv_3fd7a23d-1fbd-4c8f-b102-684ecf696e27/pull/0.log" Jun 09 17:48:13.190270 ip-10-0-143-124 kubenswrapper[2552]: I0609 17:48:13.190238 2552 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7596r2jv_3fd7a23d-1fbd-4c8f-b102-684ecf696e27/extract/0.log" Jun 09 17:48:13.297958 ip-10-0-143-124 kubenswrapper[2552]: I0609 17:48:13.297928 2552 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0hl5dr_ddd1104d-713f-4dc3-9220-34812e0b2802/util/0.log" Jun 09 17:48:13.304318 ip-10-0-143-124 kubenswrapper[2552]: I0609 17:48:13.304295 2552 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0hl5dr_ddd1104d-713f-4dc3-9220-34812e0b2802/pull/0.log" Jun 09 17:48:13.310198 ip-10-0-143-124 kubenswrapper[2552]: I0609 17:48:13.310177 2552 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0hl5dr_ddd1104d-713f-4dc3-9220-34812e0b2802/extract/0.log" Jun 09 17:48:13.420053 ip-10-0-143-124 kubenswrapper[2552]: I0609 17:48:13.420024 2552 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73pmj5j_5b6171c4-52fa-4e4c-9769-eca68fe2f0ac/pull/0.log" Jun 09 17:48:13.426848 ip-10-0-143-124 kubenswrapper[2552]: I0609 17:48:13.426826 2552 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73pmj5j_5b6171c4-52fa-4e4c-9769-eca68fe2f0ac/extract/0.log" Jun 09 17:48:13.432928 ip-10-0-143-124 kubenswrapper[2552]: I0609 17:48:13.432863 2552 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73pmj5j_5b6171c4-52fa-4e4c-9769-eca68fe2f0ac/util/0.log" Jun 09 17:48:13.541747 ip-10-0-143-124 kubenswrapper[2552]: I0609 17:48:13.541714 2552 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1d9bw2_3eb06456-961a-44b1-9e2d-963b63644584/extract/0.log" Jun 09 17:48:13.547457 ip-10-0-143-124 kubenswrapper[2552]: I0609 17:48:13.547436 2552 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1d9bw2_3eb06456-961a-44b1-9e2d-963b63644584/util/0.log" Jun 09 17:48:13.554073 ip-10-0-143-124 kubenswrapper[2552]: I0609 17:48:13.554049 2552 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1d9bw2_3eb06456-961a-44b1-9e2d-963b63644584/pull/0.log" Jun 09 17:48:14.437198 ip-10-0-143-124 kubenswrapper[2552]: I0609 17:48:14.437169 2552 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_limitador-operator-controller-manager-859d7b78bd-jkksq_26c875bc-c46e-4910-b2b1-1d142df4992c/manager/0.log" Jun 09 17:48:14.777931 ip-10-0-143-124 kubenswrapper[2552]: I0609 17:48:14.777899 2552 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_data-science-gateway-data-science-gateway-class-74759f9795hj6g8_c95272d7-db45-4381-bf31-d54704151566/istio-proxy/0.log" Jun 09 17:48:14.902096 ip-10-0-143-124 kubenswrapper[2552]: I0609 17:48:14.902063 2552 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_istiod-openshift-gateway-75c67f8887-xc6nt_a8d42ce6-62c5-49df-bd94-bfe2c12dfceb/discovery/0.log" Jun 09 17:48:15.012343 ip-10-0-143-124 kubenswrapper[2552]: I0609 17:48:15.012316 2552 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-5b7fdf8456-ffzh6_f7c52d7b-25dc-4686-9794-7dfaae7eed22/kube-auth-proxy/0.log" Jun 09 17:48:15.236977 ip-10-0-143-124 kubenswrapper[2552]: I0609 17:48:15.236881 2552 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-687ff6996-dsvbr_632ed562-280d-499c-ad1d-976509489a95/istio-proxy/0.log" Jun 09 17:48:16.355712 ip-10-0-143-124 kubenswrapper[2552]: I0609 17:48:16.355682 2552 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-kwh69_9aa08551-03ce-4c12-96d9-d6ca9bb43bf7/ovn-acl-logging/0.log" Jun 09 17:48:16.357803 ip-10-0-143-124 kubenswrapper[2552]: I0609 17:48:16.357775 2552 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-kwh69_9aa08551-03ce-4c12-96d9-d6ca9bb43bf7/ovn-acl-logging/0.log" Jun 09 17:48:17.868128 ip-10-0-143-124 kubenswrapper[2552]: I0609 17:48:17.868089 2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gctfs_8563ebab-ebdd-4d68-bce1-78d2a7f62992/konnectivity-agent/0.log" limit=1024 Jun 09 17:48:19.408179 ip-10-0-143-124 kubenswrapper[2552]: I0609 17:48:19.408139 2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gctfs_8563ebab-ebdd-4d68-bce1-78d2a7f62992/konnectivity-agent/0.log" limit=1024 Jun 09 17:48:19.548952 ip-10-0-143-124 kubenswrapper[2552]: I0609 17:48:19.548913 2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gctfs_8563ebab-ebdd-4d68-bce1-78d2a7f62992/konnectivity-agent/0.log" limit=1024 Jun 09 17:48:22.332031 ip-10-0-143-124 kubenswrapper[2552]: I0609 17:48:22.332003 2552 scope.go:117] "RemoveContainer" containerID="b282ba914d58e4198fe3ee106b22ad42f3725a1ce7ee52652f949f5867c7ddad" Jun 09 17:48:22.332395 ip-10-0-143-124 kubenswrapper[2552]: E0609 17:48:22.332189 2552 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"manager\" with CrashLoopBackOff: \"back-off 1m20s restarting failed container=manager pod=maas-controller-74c64d7d48-48lgd_opendatahub(64881c67-ae3c-4001-a38f-ba0e49e84fb5)\"" pod="opendatahub/maas-controller-74c64d7d48-48lgd" podUID="64881c67-ae3c-4001-a38f-ba0e49e84fb5" Jun 09 17:48:22.652749 ip-10-0-143-124 kubenswrapper[2552]: I0609 17:48:22.652667 2552 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_global-pull-secret-syncer-lt4n9_a71cd181-3d23-4c4b-ac2f-e212dd9b5193/global-pull-secret-syncer/0.log" Jun 09 17:48:22.699411 ip-10-0-143-124 kubenswrapper[2552]: I0609 17:48:22.699378 2552 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_konnectivity-agent-gctfs_8563ebab-ebdd-4d68-bce1-78d2a7f62992/konnectivity-agent/0.log" Jun 09 17:48:22.817666 ip-10-0-143-124 kubenswrapper[2552]: I0609 17:48:22.817635 2552 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_kube-apiserver-proxy-ip-10-0-143-124.ec2.internal_c6eab2ff3a3679dccbb6f4cc985d9ef6/haproxy/0.log" Jun 09 17:48:26.908180 ip-10-0-143-124 kubenswrapper[2552]: I0609 17:48:26.908149 2552 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7596r2jv_3fd7a23d-1fbd-4c8f-b102-684ecf696e27/extract/0.log" Jun 09 17:48:26.930949 ip-10-0-143-124 kubenswrapper[2552]: I0609 17:48:26.930921 2552 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7596r2jv_3fd7a23d-1fbd-4c8f-b102-684ecf696e27/util/0.log" Jun 09 17:48:26.961862 ip-10-0-143-124 kubenswrapper[2552]: I0609 17:48:26.961840 2552 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7596r2jv_3fd7a23d-1fbd-4c8f-b102-684ecf696e27/pull/0.log" Jun 09 17:48:26.989305 ip-10-0-143-124 kubenswrapper[2552]: I0609 17:48:26.989280 2552 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0hl5dr_ddd1104d-713f-4dc3-9220-34812e0b2802/extract/0.log" Jun 09 17:48:27.017273 ip-10-0-143-124 kubenswrapper[2552]: I0609 17:48:27.017246 2552 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0hl5dr_ddd1104d-713f-4dc3-9220-34812e0b2802/util/0.log" Jun 09 17:48:27.042757 ip-10-0-143-124 kubenswrapper[2552]: I0609 17:48:27.042729 2552 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0hl5dr_ddd1104d-713f-4dc3-9220-34812e0b2802/pull/0.log" Jun 09 17:48:27.077344 ip-10-0-143-124 kubenswrapper[2552]: I0609 17:48:27.077305 2552 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73pmj5j_5b6171c4-52fa-4e4c-9769-eca68fe2f0ac/extract/0.log" Jun 09 17:48:27.093287 ip-10-0-143-124 kubenswrapper[2552]: I0609 17:48:27.093262 2552 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-operators_servicemesh-operator3-57f65f65fb-qmxdg_4e96ecf7-6f96-4a40-884c-31b5046520fb/sail-operator/0.log" Jun 09 17:48:27.101892 ip-10-0-143-124 kubenswrapper[2552]: I0609 17:48:27.101873 2552 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73pmj5j_5b6171c4-52fa-4e4c-9769-eca68fe2f0ac/util/0.log" Jun 09 17:48:27.123504 ip-10-0-143-124 kubenswrapper[2552]: I0609 17:48:27.123485 2552 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73pmj5j_5b6171c4-52fa-4e4c-9769-eca68fe2f0ac/pull/0.log" Jun 09 17:48:27.152041 ip-10-0-143-124 kubenswrapper[2552]: I0609 17:48:27.152023 2552 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1d9bw2_3eb06456-961a-44b1-9e2d-963b63644584/extract/0.log" Jun 09 17:48:27.177522 ip-10-0-143-124 kubenswrapper[2552]: I0609 17:48:27.177463 2552 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1d9bw2_3eb06456-961a-44b1-9e2d-963b63644584/util/0.log" Jun 09 17:48:27.202104 ip-10-0-143-124 kubenswrapper[2552]: I0609 17:48:27.202081 2552 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1d9bw2_3eb06456-961a-44b1-9e2d-963b63644584/pull/0.log" Jun 09 17:48:27.511181 ip-10-0-143-124 kubenswrapper[2552]: I0609 17:48:27.511148 2552 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_limitador-operator-controller-manager-859d7b78bd-jkksq_26c875bc-c46e-4910-b2b1-1d142df4992c/manager/0.log" Jun 09 17:48:29.403724 ip-10-0-143-124 kubenswrapper[2552]: I0609 17:48:29.403681 2552 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_cluster-monitoring-operator-74bbf69bbb-mxm64_6a24035e-75a9-4ed0-a190-07948fdc748a/cluster-monitoring-operator/0.log" Jun 09 17:48:29.662190 ip-10-0-143-124 kubenswrapper[2552]: I0609 17:48:29.662105 2552 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-brwq7_2839fcc7-c296-4ed6-bcc4-d5a3cdf99c72/node-exporter/0.log" Jun 09 17:48:29.694176 ip-10-0-143-124 kubenswrapper[2552]: I0609 17:48:29.694148 2552 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-brwq7_2839fcc7-c296-4ed6-bcc4-d5a3cdf99c72/kube-rbac-proxy/0.log" Jun 09 17:48:29.721010 ip-10-0-143-124 kubenswrapper[2552]: I0609 17:48:29.720983 2552 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-brwq7_2839fcc7-c296-4ed6-bcc4-d5a3cdf99c72/init-textfile/0.log" Jun 09 17:48:33.022024 ip-10-0-143-124 kubenswrapper[2552]: I0609 17:48:33.021996 2552 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-must-gather-9c6lr/perf-node-gather-daemonset-v7ft8"] Jun 09 17:48:33.025521 ip-10-0-143-124 kubenswrapper[2552]: I0609 17:48:33.025504 2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-9c6lr/perf-node-gather-daemonset-v7ft8" Jun 09 17:48:33.028200 ip-10-0-143-124 kubenswrapper[2552]: I0609 17:48:33.028179 2552 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-9c6lr\"/\"kube-root-ca.crt\"" Jun 09 17:48:33.028298 ip-10-0-143-124 kubenswrapper[2552]: I0609 17:48:33.028199 2552 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-9c6lr\"/\"openshift-service-ca.crt\"" Jun 09 17:48:33.029061 ip-10-0-143-124 kubenswrapper[2552]: I0609 17:48:33.029033 2552 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-must-gather-9c6lr\"/\"default-dockercfg-7g6tm\"" Jun 09 17:48:33.037129 ip-10-0-143-124 kubenswrapper[2552]: I0609 17:48:33.037099 2552 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-9c6lr/perf-node-gather-daemonset-v7ft8"] Jun 09 17:48:33.091033 ip-10-0-143-124 kubenswrapper[2552]: I0609 17:48:33.091000 2552 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console_console-7b7f9c877b-d52fh_c6ec9e7f-f33a-4df6-92e0-c6dc86058013/console/0.log" Jun 09 17:48:33.132275 ip-10-0-143-124 kubenswrapper[2552]: I0609 17:48:33.132244 2552 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console_downloads-6657875f97-cljc7_3c2d3304-77d3-4fef-b40d-8933971fedda/download-server/0.log" Jun 09 17:48:33.168824 ip-10-0-143-124 kubenswrapper[2552]: I0609 17:48:33.168794 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/1532314c-c983-47e3-937b-5411de363148-lib-modules\") pod \"perf-node-gather-daemonset-v7ft8\" (UID: \"1532314c-c983-47e3-937b-5411de363148\") " pod="openshift-must-gather-9c6lr/perf-node-gather-daemonset-v7ft8" Jun 09 17:48:33.169018 ip-10-0-143-124 kubenswrapper[2552]: I0609 17:48:33.168847 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/1532314c-c983-47e3-937b-5411de363148-proc\") pod \"perf-node-gather-daemonset-v7ft8\" (UID: \"1532314c-c983-47e3-937b-5411de363148\") " pod="openshift-must-gather-9c6lr/perf-node-gather-daemonset-v7ft8" Jun 09 17:48:33.169018 ip-10-0-143-124 kubenswrapper[2552]: I0609 17:48:33.168868 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-twk8z\" (UniqueName: \"kubernetes.io/projected/1532314c-c983-47e3-937b-5411de363148-kube-api-access-twk8z\") pod \"perf-node-gather-daemonset-v7ft8\" (UID: \"1532314c-c983-47e3-937b-5411de363148\") " pod="openshift-must-gather-9c6lr/perf-node-gather-daemonset-v7ft8" Jun 09 17:48:33.169018 ip-10-0-143-124 kubenswrapper[2552]: I0609 17:48:33.168968 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/1532314c-c983-47e3-937b-5411de363148-sys\") pod \"perf-node-gather-daemonset-v7ft8\" (UID: \"1532314c-c983-47e3-937b-5411de363148\") " pod="openshift-must-gather-9c6lr/perf-node-gather-daemonset-v7ft8" Jun 09 17:48:33.169160 ip-10-0-143-124 kubenswrapper[2552]: I0609 17:48:33.169034 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/1532314c-c983-47e3-937b-5411de363148-podres\") pod \"perf-node-gather-daemonset-v7ft8\" (UID: \"1532314c-c983-47e3-937b-5411de363148\") " pod="openshift-must-gather-9c6lr/perf-node-gather-daemonset-v7ft8" Jun 09 17:48:33.269756 ip-10-0-143-124 kubenswrapper[2552]: I0609 17:48:33.269720 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/1532314c-c983-47e3-937b-5411de363148-proc\") pod \"perf-node-gather-daemonset-v7ft8\" (UID: \"1532314c-c983-47e3-937b-5411de363148\") " pod="openshift-must-gather-9c6lr/perf-node-gather-daemonset-v7ft8" Jun 09 17:48:33.269934 ip-10-0-143-124 kubenswrapper[2552]: I0609 17:48:33.269761 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-twk8z\" (UniqueName: \"kubernetes.io/projected/1532314c-c983-47e3-937b-5411de363148-kube-api-access-twk8z\") pod \"perf-node-gather-daemonset-v7ft8\" (UID: \"1532314c-c983-47e3-937b-5411de363148\") " pod="openshift-must-gather-9c6lr/perf-node-gather-daemonset-v7ft8" Jun 09 17:48:33.269934 ip-10-0-143-124 kubenswrapper[2552]: I0609 17:48:33.269803 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/1532314c-c983-47e3-937b-5411de363148-sys\") pod \"perf-node-gather-daemonset-v7ft8\" (UID: \"1532314c-c983-47e3-937b-5411de363148\") " pod="openshift-must-gather-9c6lr/perf-node-gather-daemonset-v7ft8" Jun 09 17:48:33.269934 ip-10-0-143-124 kubenswrapper[2552]: I0609 17:48:33.269848 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/1532314c-c983-47e3-937b-5411de363148-podres\") pod \"perf-node-gather-daemonset-v7ft8\" (UID: \"1532314c-c983-47e3-937b-5411de363148\") " pod="openshift-must-gather-9c6lr/perf-node-gather-daemonset-v7ft8" Jun 09 17:48:33.269934 ip-10-0-143-124 kubenswrapper[2552]: I0609 17:48:33.269867 2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/1532314c-c983-47e3-937b-5411de363148-proc\") pod \"perf-node-gather-daemonset-v7ft8\" (UID: \"1532314c-c983-47e3-937b-5411de363148\") " pod="openshift-must-gather-9c6lr/perf-node-gather-daemonset-v7ft8" Jun 09 17:48:33.269934 ip-10-0-143-124 kubenswrapper[2552]: I0609 17:48:33.269889 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/1532314c-c983-47e3-937b-5411de363148-lib-modules\") pod \"perf-node-gather-daemonset-v7ft8\" (UID: \"1532314c-c983-47e3-937b-5411de363148\") " pod="openshift-must-gather-9c6lr/perf-node-gather-daemonset-v7ft8" Jun 09 17:48:33.270136 ip-10-0-143-124 kubenswrapper[2552]: I0609 17:48:33.269942 2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/1532314c-c983-47e3-937b-5411de363148-sys\") pod \"perf-node-gather-daemonset-v7ft8\" (UID: \"1532314c-c983-47e3-937b-5411de363148\") " pod="openshift-must-gather-9c6lr/perf-node-gather-daemonset-v7ft8" Jun 09 17:48:33.270136 ip-10-0-143-124 kubenswrapper[2552]: I0609 17:48:33.270016 2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/1532314c-c983-47e3-937b-5411de363148-lib-modules\") pod \"perf-node-gather-daemonset-v7ft8\" (UID: \"1532314c-c983-47e3-937b-5411de363148\") " pod="openshift-must-gather-9c6lr/perf-node-gather-daemonset-v7ft8" Jun 09 17:48:33.270136 ip-10-0-143-124 kubenswrapper[2552]: I0609 17:48:33.270020 2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/1532314c-c983-47e3-937b-5411de363148-podres\") pod \"perf-node-gather-daemonset-v7ft8\" (UID: \"1532314c-c983-47e3-937b-5411de363148\") " pod="openshift-must-gather-9c6lr/perf-node-gather-daemonset-v7ft8" Jun 09 17:48:33.278189 ip-10-0-143-124 kubenswrapper[2552]: I0609 17:48:33.278124 2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-twk8z\" (UniqueName: \"kubernetes.io/projected/1532314c-c983-47e3-937b-5411de363148-kube-api-access-twk8z\") pod \"perf-node-gather-daemonset-v7ft8\" (UID: \"1532314c-c983-47e3-937b-5411de363148\") " pod="openshift-must-gather-9c6lr/perf-node-gather-daemonset-v7ft8" Jun 09 17:48:33.332120 ip-10-0-143-124 kubenswrapper[2552]: I0609 17:48:33.332097 2552 scope.go:117] "RemoveContainer" containerID="b282ba914d58e4198fe3ee106b22ad42f3725a1ce7ee52652f949f5867c7ddad" Jun 09 17:48:33.332298 ip-10-0-143-124 kubenswrapper[2552]: E0609 17:48:33.332280 2552 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"manager\" with CrashLoopBackOff: \"back-off 1m20s restarting failed container=manager pod=maas-controller-74c64d7d48-48lgd_opendatahub(64881c67-ae3c-4001-a38f-ba0e49e84fb5)\"" pod="opendatahub/maas-controller-74c64d7d48-48lgd" podUID="64881c67-ae3c-4001-a38f-ba0e49e84fb5" Jun 09 17:48:33.343923 ip-10-0-143-124 kubenswrapper[2552]: I0609 17:48:33.343901 2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-9c6lr/perf-node-gather-daemonset-v7ft8" Jun 09 17:48:33.497788 ip-10-0-143-124 kubenswrapper[2552]: I0609 17:48:33.497761 2552 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-9c6lr/perf-node-gather-daemonset-v7ft8"] Jun 09 17:48:33.499241 ip-10-0-143-124 kubenswrapper[2552]: W0609 17:48:33.499213 2552 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-pod1532314c_c983_47e3_937b_5411de363148.slice/crio-a236ee647b6b2bcfd454274c1258054d131f5fac8eba98fa1efb95b377d804f5 WatchSource:0}: Error finding container a236ee647b6b2bcfd454274c1258054d131f5fac8eba98fa1efb95b377d804f5: Status 404 returned error can't find the container with id a236ee647b6b2bcfd454274c1258054d131f5fac8eba98fa1efb95b377d804f5 Jun 09 17:48:33.666556 ip-10-0-143-124 kubenswrapper[2552]: I0609 17:48:33.666525 2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-9c6lr/perf-node-gather-daemonset-v7ft8" event={"ID":"1532314c-c983-47e3-937b-5411de363148","Type":"ContainerStarted","Data":"6d49056b0e6beec02e1aaff00d808fc2295a2ae573f297c990bcc8a8d7c2e15d"} Jun 09 17:48:33.666687 ip-10-0-143-124 kubenswrapper[2552]: I0609 17:48:33.666577 2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-9c6lr/perf-node-gather-daemonset-v7ft8" event={"ID":"1532314c-c983-47e3-937b-5411de363148","Type":"ContainerStarted","Data":"a236ee647b6b2bcfd454274c1258054d131f5fac8eba98fa1efb95b377d804f5"} Jun 09 17:48:33.666687 ip-10-0-143-124 kubenswrapper[2552]: I0609 17:48:33.666676 2552 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-must-gather-9c6lr/perf-node-gather-daemonset-v7ft8" Jun 09 17:48:33.683292 ip-10-0-143-124 kubenswrapper[2552]: I0609 17:48:33.683244 2552 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-must-gather-9c6lr/perf-node-gather-daemonset-v7ft8" podStartSLOduration=1.683231079 podStartE2EDuration="1.683231079s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-09 17:48:32 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-09 17:48:33.680989192 +0000 UTC m=+917.780891844" watchObservedRunningTime="2026-06-09 17:48:33.683231079 +0000 UTC m=+917.783133736" Jun 09 17:48:34.900189 ip-10-0-143-124 kubenswrapper[2552]: I0609 17:48:34.900155 2552 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-bmg8n_3ed6274b-3981-436a-99bb-77b505c76d3d/dns/0.log" Jun 09 17:48:34.921974 ip-10-0-143-124 kubenswrapper[2552]: I0609 17:48:34.921951 2552 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-bmg8n_3ed6274b-3981-436a-99bb-77b505c76d3d/kube-rbac-proxy/0.log" Jun 09 17:48:35.058726 ip-10-0-143-124 kubenswrapper[2552]: I0609 17:48:35.058695 2552 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-qbd4p_f077d86b-598b-4398-9376-2956816fa47d/dns-node-resolver/0.log" Jun 09 17:48:35.610284 ip-10-0-143-124 kubenswrapper[2552]: I0609 17:48:35.610212 2552 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_image-registry-cb9f4f84d-864t8_52bfbcd9-9374-4f7b-9bdc-6525c1e21821/registry/0.log" Jun 09 17:48:35.615524 ip-10-0-143-124 kubenswrapper[2552]: I0609 17:48:35.615499 2552 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_image-registry-cb9f4f84d-864t8_52bfbcd9-9374-4f7b-9bdc-6525c1e21821/registry/1.log" Jun 09 17:48:35.655293 ip-10-0-143-124 kubenswrapper[2552]: I0609 17:48:35.655262 2552 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-tb8b5_2ef810f8-073d-4b45-ad02-2e098f31ed47/node-ca/0.log" Jun 09 17:48:36.614264 ip-10-0-143-124 kubenswrapper[2552]: I0609 17:48:36.614231 2552 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_data-science-gateway-data-science-gateway-class-74759f9795hj6g8_c95272d7-db45-4381-bf31-d54704151566/istio-proxy/0.log" Jun 09 17:48:36.666615 ip-10-0-143-124 kubenswrapper[2552]: I0609 17:48:36.666561 2552 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_istiod-openshift-gateway-75c67f8887-xc6nt_a8d42ce6-62c5-49df-bd94-bfe2c12dfceb/discovery/0.log" Jun 09 17:48:36.685087 ip-10-0-143-124 kubenswrapper[2552]: I0609 17:48:36.685056 2552 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-5b7fdf8456-ffzh6_f7c52d7b-25dc-4686-9794-7dfaae7eed22/kube-auth-proxy/0.log" Jun 09 17:48:36.736843 ip-10-0-143-124 kubenswrapper[2552]: I0609 17:48:36.736818 2552 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-687ff6996-dsvbr_632ed562-280d-499c-ad1d-976509489a95/istio-proxy/0.log" Jun 09 17:48:37.415546 ip-10-0-143-124 kubenswrapper[2552]: I0609 17:48:37.415515 2552 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-w8w2r_389f25e7-e5ca-48dc-884b-a5046ab1dc6b/serve-healthcheck-canary/0.log" Jun 09 17:48:37.951046 ip-10-0-143-124 kubenswrapper[2552]: I0609 17:48:37.951018 2552 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-operator-896549976-7z8hc_c12461c8-8309-43fb-8384-f20159a4324b/insights-operator/1.log" Jun 09 17:48:37.960968 ip-10-0-143-124 kubenswrapper[2552]: I0609 17:48:37.960939 2552 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-operator-896549976-7z8hc_c12461c8-8309-43fb-8384-f20159a4324b/insights-operator/0.log" Jun 09 17:48:38.001585 ip-10-0-143-124 kubenswrapper[2552]: I0609 17:48:38.001561 2552 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-5m558_3d6cff79-6280-46e2-93cf-304ec7fa1e33/kube-rbac-proxy/0.log" Jun 09 17:48:38.041438 ip-10-0-143-124 kubenswrapper[2552]: I0609 17:48:38.041412 2552 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-5m558_3d6cff79-6280-46e2-93cf-304ec7fa1e33/exporter/0.log" Jun 09 17:48:38.082560 ip-10-0-143-124 kubenswrapper[2552]: I0609 17:48:38.082524 2552 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-5m558_3d6cff79-6280-46e2-93cf-304ec7fa1e33/extractor/0.log" Jun 09 17:48:39.681981 ip-10-0-143-124 kubenswrapper[2552]: I0609 17:48:39.681949 2552 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-must-gather-9c6lr/perf-node-gather-daemonset-v7ft8" Jun 09 17:48:40.629677 ip-10-0-143-124 kubenswrapper[2552]: I0609 17:48:40.629630 2552 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_dashboard-redirect-54fb48c7f6-mffj8_0e04dbaf-ff38-4ccd-9d38-22cebb02badb/nginx/0.log" Jun 09 17:48:40.679176 ip-10-0-143-124 kubenswrapper[2552]: I0609 17:48:40.679150 2552 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_llmisvc-controller-manager-864bfd7bc9-jr926_29a513a4-725e-400b-aa6b-459355eeb531/manager/0.log" Jun 09 17:48:40.724036 ip-10-0-143-124 kubenswrapper[2552]: I0609 17:48:40.724006 2552 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_maas-controller-74c64d7d48-48lgd_64881c67-ae3c-4001-a38f-ba0e49e84fb5/manager/4.log" Jun 09 17:48:40.724423 ip-10-0-143-124 kubenswrapper[2552]: I0609 17:48:40.724126 2552 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_maas-controller-74c64d7d48-48lgd_64881c67-ae3c-4001-a38f-ba0e49e84fb5/manager/4.log" Jun 09 17:48:40.742807 ip-10-0-143-124 kubenswrapper[2552]: I0609 17:48:40.742778 2552 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_model-serving-api-5dd488fc48-hnszm_fe0acebb-1dc4-44f6-99ed-62a699d9fe1c/server/0.log" Jun 09 17:48:40.802931 ip-10-0-143-124 kubenswrapper[2552]: I0609 17:48:40.802902 2552 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_odh-model-controller-6dc94f689f-mpvn5_5c147dc2-9013-4b7b-8663-88517c65aed6/manager/0.log" Jun 09 17:48:40.967145 ip-10-0-143-124 kubenswrapper[2552]: I0609 17:48:40.967051 2552 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-6f958f486-vmz6p_f91285d9-a18a-44eb-8272-c0ef9586564d/manager/0.log" Jun 09 17:48:40.986081 ip-10-0-143-124 kubenswrapper[2552]: I0609 17:48:40.986059 2552 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-6f958f486-vmz6p_f91285d9-a18a-44eb-8272-c0ef9586564d/copy-manifests/0.log" Jun 09 17:48:44.454333 ip-10-0-143-124 kubenswrapper[2552]: I0609 17:48:44.454247 2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gctfs_8563ebab-ebdd-4d68-bce1-78d2a7f62992/konnectivity-agent/0.log" limit=1024 Jun 09 17:48:44.555610 ip-10-0-143-124 kubenswrapper[2552]: I0609 17:48:44.555560 2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gctfs_8563ebab-ebdd-4d68-bce1-78d2a7f62992/konnectivity-agent/0.log" limit=1024 Jun 09 17:48:47.479283 ip-10-0-143-124 kubenswrapper[2552]: I0609 17:48:47.479252 2552 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_data-science-gateway-data-science-gateway-class-74759f9795hj6g8_c95272d7-db45-4381-bf31-d54704151566/istio-proxy/0.log" Jun 09 17:48:47.524251 ip-10-0-143-124 kubenswrapper[2552]: I0609 17:48:47.524225 2552 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_istiod-openshift-gateway-75c67f8887-xc6nt_a8d42ce6-62c5-49df-bd94-bfe2c12dfceb/discovery/0.log" Jun 09 17:48:47.538201 ip-10-0-143-124 kubenswrapper[2552]: I0609 17:48:47.538174 2552 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-5b7fdf8456-ffzh6_f7c52d7b-25dc-4686-9794-7dfaae7eed22/kube-auth-proxy/0.log" Jun 09 17:48:47.572455 ip-10-0-143-124 kubenswrapper[2552]: I0609 17:48:47.572422 2552 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-687ff6996-dsvbr_632ed562-280d-499c-ad1d-976509489a95/istio-proxy/0.log" Jun 09 17:48:47.842565 ip-10-0-143-124 kubenswrapper[2552]: I0609 17:48:47.842533 2552 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator_migrator-955ffdf5f-lm9ds_b3e3cf1c-7ca7-4b77-ac16-dd2195e08e1e/migrator/0.log" Jun 09 17:48:47.864240 ip-10-0-143-124 kubenswrapper[2552]: I0609 17:48:47.864213 2552 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator_migrator-955ffdf5f-lm9ds_b3e3cf1c-7ca7-4b77-ac16-dd2195e08e1e/graceful-termination/0.log" Jun 09 17:48:48.327796 ip-10-0-143-124 kubenswrapper[2552]: I0609 17:48:48.327760 2552 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator-operator_kube-storage-version-migrator-operator-55bb7c4d49-7nmpt_1b04f167-2855-4595-b910-313bea3fd061/kube-storage-version-migrator-operator/1.log" Jun 09 17:48:48.329619 ip-10-0-143-124 kubenswrapper[2552]: I0609 17:48:48.329579 2552 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator-operator_kube-storage-version-migrator-operator-55bb7c4d49-7nmpt_1b04f167-2855-4595-b910-313bea3fd061/kube-storage-version-migrator-operator/0.log" Jun 09 17:48:48.332578 ip-10-0-143-124 kubenswrapper[2552]: I0609 17:48:48.332542 2552 scope.go:117] "RemoveContainer" containerID="b282ba914d58e4198fe3ee106b22ad42f3725a1ce7ee52652f949f5867c7ddad" Jun 09 17:48:48.332821 ip-10-0-143-124 kubenswrapper[2552]: E0609 17:48:48.332793 2552 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"manager\" with CrashLoopBackOff: \"back-off 1m20s restarting failed container=manager pod=maas-controller-74c64d7d48-48lgd_opendatahub(64881c67-ae3c-4001-a38f-ba0e49e84fb5)\"" pod="opendatahub/maas-controller-74c64d7d48-48lgd" podUID="64881c67-ae3c-4001-a38f-ba0e49e84fb5" Jun 09 17:48:48.605710 ip-10-0-143-124 kubenswrapper[2552]: I0609 17:48:48.605625 2552 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_data-science-gateway-data-science-gateway-class-74759f9795hj6g8_c95272d7-db45-4381-bf31-d54704151566/istio-proxy/0.log" Jun 09 17:48:48.656337 ip-10-0-143-124 kubenswrapper[2552]: I0609 17:48:48.656309 2552 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_istiod-openshift-gateway-75c67f8887-xc6nt_a8d42ce6-62c5-49df-bd94-bfe2c12dfceb/discovery/0.log" Jun 09 17:48:48.668318 ip-10-0-143-124 kubenswrapper[2552]: I0609 17:48:48.668292 2552 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-5b7fdf8456-ffzh6_f7c52d7b-25dc-4686-9794-7dfaae7eed22/kube-auth-proxy/0.log" Jun 09 17:48:48.701614 ip-10-0-143-124 kubenswrapper[2552]: I0609 17:48:48.701564 2552 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-687ff6996-dsvbr_632ed562-280d-499c-ad1d-976509489a95/istio-proxy/0.log" Jun 09 17:48:49.756328 ip-10-0-143-124 kubenswrapper[2552]: I0609 17:48:49.756302 2552 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-s8d9p_57526948-94e0-40fd-b0bf-ada9cf355743/kube-multus-additional-cni-plugins/0.log" Jun 09 17:48:49.775757 ip-10-0-143-124 kubenswrapper[2552]: I0609 17:48:49.775733 2552 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-s8d9p_57526948-94e0-40fd-b0bf-ada9cf355743/egress-router-binary-copy/0.log" Jun 09 17:48:49.795178 ip-10-0-143-124 kubenswrapper[2552]: I0609 17:48:49.795153 2552 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-s8d9p_57526948-94e0-40fd-b0bf-ada9cf355743/cni-plugins/0.log" Jun 09 17:48:49.819719 ip-10-0-143-124 kubenswrapper[2552]: I0609 17:48:49.819694 2552 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-s8d9p_57526948-94e0-40fd-b0bf-ada9cf355743/bond-cni-plugin/0.log" Jun 09 17:48:49.841279 ip-10-0-143-124 kubenswrapper[2552]: I0609 17:48:49.841256 2552 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-s8d9p_57526948-94e0-40fd-b0bf-ada9cf355743/routeoverride-cni/0.log" Jun 09 17:48:49.862806 ip-10-0-143-124 kubenswrapper[2552]: I0609 17:48:49.862786 2552 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-s8d9p_57526948-94e0-40fd-b0bf-ada9cf355743/whereabouts-cni-bincopy/0.log" Jun 09 17:48:49.882768 ip-10-0-143-124 kubenswrapper[2552]: I0609 17:48:49.882749 2552 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-s8d9p_57526948-94e0-40fd-b0bf-ada9cf355743/whereabouts-cni/0.log" Jun 09 17:48:49.950860 ip-10-0-143-124 kubenswrapper[2552]: I0609 17:48:49.950835 2552 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-n6545_99815f55-a516-4e96-bdb4-67bf609055f2/kube-multus/0.log" Jun 09 17:48:50.068624 ip-10-0-143-124 kubenswrapper[2552]: I0609 17:48:50.068523 2552 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_network-metrics-daemon-pvmnc_b817ed32-ca44-43a6-99cf-8cf86ffd8c05/network-metrics-daemon/0.log" Jun 09 17:48:50.088646 ip-10-0-143-124 kubenswrapper[2552]: I0609 17:48:50.088617 2552 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_network-metrics-daemon-pvmnc_b817ed32-ca44-43a6-99cf-8cf86ffd8c05/kube-rbac-proxy/0.log" Jun 09 17:48:50.283433 ip-10-0-143-124 kubenswrapper[2552]: I0609 17:48:50.283405 2552 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_data-science-gateway-data-science-gateway-class-74759f9795hj6g8_c95272d7-db45-4381-bf31-d54704151566/istio-proxy/0.log" Jun 09 17:48:50.326107 ip-10-0-143-124 kubenswrapper[2552]: I0609 17:48:50.326032 2552 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_istiod-openshift-gateway-75c67f8887-xc6nt_a8d42ce6-62c5-49df-bd94-bfe2c12dfceb/discovery/0.log" Jun 09 17:48:50.335442 ip-10-0-143-124 kubenswrapper[2552]: I0609 17:48:50.335421 2552 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-5b7fdf8456-ffzh6_f7c52d7b-25dc-4686-9794-7dfaae7eed22/kube-auth-proxy/0.log" Jun 09 17:48:50.368764 ip-10-0-143-124 kubenswrapper[2552]: I0609 17:48:50.368734 2552 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-687ff6996-dsvbr_632ed562-280d-499c-ad1d-976509489a95/istio-proxy/0.log"