Jun 11 18:28:01.120614 ip-10-0-130-170 systemd[1]: Starting Kubernetes Kubelet... Jun 11 18:28:01.568880 ip-10-0-130-170 kubenswrapper[2565]: Flag --container-runtime-endpoint has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Jun 11 18:28:01.568880 ip-10-0-130-170 kubenswrapper[2565]: Flag --minimum-container-ttl-duration has been deprecated, Use --eviction-hard or --eviction-soft instead. Will be removed in a future version. Jun 11 18:28:01.568880 ip-10-0-130-170 kubenswrapper[2565]: Flag --volume-plugin-dir has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Jun 11 18:28:01.568880 ip-10-0-130-170 kubenswrapper[2565]: Flag --pod-infra-container-image has been deprecated, will be removed in 1.35. Image garbage collector will get sandbox image information from CRI. Jun 11 18:28:01.568880 ip-10-0-130-170 kubenswrapper[2565]: Flag --system-reserved has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Jun 11 18:28:01.569907 ip-10-0-130-170 kubenswrapper[2565]: I0611 18:28:01.569814 2565 server.go:213] "--pod-infra-container-image will not be pruned by the image garbage collector in kubelet and should also be set in the remote runtime" Jun 11 18:28:01.573733 ip-10-0-130-170 kubenswrapper[2565]: W0611 18:28:01.573708 2565 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jun 11 18:28:01.573733 ip-10-0-130-170 kubenswrapper[2565]: W0611 18:28:01.573731 2565 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jun 11 18:28:01.573733 ip-10-0-130-170 kubenswrapper[2565]: W0611 18:28:01.573735 2565 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jun 11 18:28:01.573830 ip-10-0-130-170 kubenswrapper[2565]: W0611 18:28:01.573739 2565 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jun 11 18:28:01.573830 ip-10-0-130-170 kubenswrapper[2565]: W0611 18:28:01.573742 2565 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jun 11 18:28:01.573830 ip-10-0-130-170 kubenswrapper[2565]: W0611 18:28:01.573745 2565 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jun 11 18:28:01.573830 ip-10-0-130-170 kubenswrapper[2565]: W0611 18:28:01.573748 2565 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jun 11 18:28:01.573830 ip-10-0-130-170 kubenswrapper[2565]: W0611 18:28:01.573751 2565 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jun 11 18:28:01.573830 ip-10-0-130-170 kubenswrapper[2565]: W0611 18:28:01.573754 2565 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jun 11 18:28:01.573830 ip-10-0-130-170 kubenswrapper[2565]: W0611 18:28:01.573757 2565 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jun 11 18:28:01.573830 ip-10-0-130-170 kubenswrapper[2565]: W0611 18:28:01.573760 2565 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jun 11 18:28:01.573830 ip-10-0-130-170 kubenswrapper[2565]: W0611 18:28:01.573764 2565 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jun 11 18:28:01.573830 ip-10-0-130-170 kubenswrapper[2565]: W0611 18:28:01.573766 2565 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jun 11 18:28:01.573830 ip-10-0-130-170 kubenswrapper[2565]: W0611 18:28:01.573769 2565 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jun 11 18:28:01.573830 ip-10-0-130-170 kubenswrapper[2565]: W0611 18:28:01.573772 2565 feature_gate.go:328] unrecognized feature gate: NewOLM Jun 11 18:28:01.573830 ip-10-0-130-170 kubenswrapper[2565]: W0611 18:28:01.573779 2565 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jun 11 18:28:01.573830 ip-10-0-130-170 kubenswrapper[2565]: W0611 18:28:01.573782 2565 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jun 11 18:28:01.573830 ip-10-0-130-170 kubenswrapper[2565]: W0611 18:28:01.573785 2565 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jun 11 18:28:01.573830 ip-10-0-130-170 kubenswrapper[2565]: W0611 18:28:01.573788 2565 feature_gate.go:328] unrecognized feature gate: OSStreams Jun 11 18:28:01.573830 ip-10-0-130-170 kubenswrapper[2565]: W0611 18:28:01.573790 2565 feature_gate.go:328] unrecognized feature gate: Example2 Jun 11 18:28:01.573830 ip-10-0-130-170 kubenswrapper[2565]: W0611 18:28:01.573793 2565 feature_gate.go:328] unrecognized feature gate: SignatureStores Jun 11 18:28:01.573830 ip-10-0-130-170 kubenswrapper[2565]: W0611 18:28:01.573795 2565 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jun 11 18:28:01.573830 ip-10-0-130-170 kubenswrapper[2565]: W0611 18:28:01.573798 2565 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jun 11 18:28:01.574328 ip-10-0-130-170 kubenswrapper[2565]: W0611 18:28:01.573800 2565 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jun 11 18:28:01.574328 ip-10-0-130-170 kubenswrapper[2565]: W0611 18:28:01.573803 2565 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jun 11 18:28:01.574328 ip-10-0-130-170 kubenswrapper[2565]: W0611 18:28:01.573806 2565 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jun 11 18:28:01.574328 ip-10-0-130-170 kubenswrapper[2565]: W0611 18:28:01.573809 2565 feature_gate.go:328] unrecognized feature gate: PinnedImages Jun 11 18:28:01.574328 ip-10-0-130-170 kubenswrapper[2565]: W0611 18:28:01.573811 2565 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jun 11 18:28:01.574328 ip-10-0-130-170 kubenswrapper[2565]: W0611 18:28:01.573814 2565 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jun 11 18:28:01.574328 ip-10-0-130-170 kubenswrapper[2565]: W0611 18:28:01.573816 2565 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jun 11 18:28:01.574328 ip-10-0-130-170 kubenswrapper[2565]: W0611 18:28:01.573819 2565 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jun 11 18:28:01.574328 ip-10-0-130-170 kubenswrapper[2565]: W0611 18:28:01.573822 2565 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jun 11 18:28:01.574328 ip-10-0-130-170 kubenswrapper[2565]: W0611 18:28:01.573824 2565 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jun 11 18:28:01.574328 ip-10-0-130-170 kubenswrapper[2565]: W0611 18:28:01.573827 2565 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jun 11 18:28:01.574328 ip-10-0-130-170 kubenswrapper[2565]: W0611 18:28:01.573829 2565 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jun 11 18:28:01.574328 ip-10-0-130-170 kubenswrapper[2565]: W0611 18:28:01.573832 2565 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jun 11 18:28:01.574328 ip-10-0-130-170 kubenswrapper[2565]: W0611 18:28:01.573835 2565 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jun 11 18:28:01.574328 ip-10-0-130-170 kubenswrapper[2565]: W0611 18:28:01.573839 2565 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jun 11 18:28:01.574328 ip-10-0-130-170 kubenswrapper[2565]: W0611 18:28:01.573844 2565 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jun 11 18:28:01.574328 ip-10-0-130-170 kubenswrapper[2565]: W0611 18:28:01.573847 2565 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jun 11 18:28:01.574328 ip-10-0-130-170 kubenswrapper[2565]: W0611 18:28:01.573850 2565 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jun 11 18:28:01.574328 ip-10-0-130-170 kubenswrapper[2565]: W0611 18:28:01.573852 2565 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jun 11 18:28:01.574799 ip-10-0-130-170 kubenswrapper[2565]: W0611 18:28:01.573855 2565 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jun 11 18:28:01.574799 ip-10-0-130-170 kubenswrapper[2565]: W0611 18:28:01.573857 2565 feature_gate.go:328] unrecognized feature gate: Example Jun 11 18:28:01.574799 ip-10-0-130-170 kubenswrapper[2565]: W0611 18:28:01.573860 2565 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jun 11 18:28:01.574799 ip-10-0-130-170 kubenswrapper[2565]: W0611 18:28:01.573862 2565 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jun 11 18:28:01.574799 ip-10-0-130-170 kubenswrapper[2565]: W0611 18:28:01.573866 2565 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jun 11 18:28:01.574799 ip-10-0-130-170 kubenswrapper[2565]: W0611 18:28:01.573868 2565 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jun 11 18:28:01.574799 ip-10-0-130-170 kubenswrapper[2565]: W0611 18:28:01.573870 2565 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jun 11 18:28:01.574799 ip-10-0-130-170 kubenswrapper[2565]: W0611 18:28:01.573873 2565 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jun 11 18:28:01.574799 ip-10-0-130-170 kubenswrapper[2565]: W0611 18:28:01.573876 2565 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jun 11 18:28:01.574799 ip-10-0-130-170 kubenswrapper[2565]: W0611 18:28:01.573878 2565 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jun 11 18:28:01.574799 ip-10-0-130-170 kubenswrapper[2565]: W0611 18:28:01.573881 2565 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jun 11 18:28:01.574799 ip-10-0-130-170 kubenswrapper[2565]: W0611 18:28:01.573885 2565 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jun 11 18:28:01.574799 ip-10-0-130-170 kubenswrapper[2565]: W0611 18:28:01.573888 2565 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jun 11 18:28:01.574799 ip-10-0-130-170 kubenswrapper[2565]: W0611 18:28:01.573891 2565 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jun 11 18:28:01.574799 ip-10-0-130-170 kubenswrapper[2565]: W0611 18:28:01.573897 2565 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jun 11 18:28:01.574799 ip-10-0-130-170 kubenswrapper[2565]: W0611 18:28:01.573900 2565 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jun 11 18:28:01.574799 ip-10-0-130-170 kubenswrapper[2565]: W0611 18:28:01.573904 2565 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jun 11 18:28:01.574799 ip-10-0-130-170 kubenswrapper[2565]: W0611 18:28:01.573907 2565 feature_gate.go:328] unrecognized feature gate: OVNObservability Jun 11 18:28:01.574799 ip-10-0-130-170 kubenswrapper[2565]: W0611 18:28:01.573909 2565 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jun 11 18:28:01.575306 ip-10-0-130-170 kubenswrapper[2565]: W0611 18:28:01.573912 2565 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jun 11 18:28:01.575306 ip-10-0-130-170 kubenswrapper[2565]: W0611 18:28:01.573914 2565 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jun 11 18:28:01.575306 ip-10-0-130-170 kubenswrapper[2565]: W0611 18:28:01.573917 2565 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jun 11 18:28:01.575306 ip-10-0-130-170 kubenswrapper[2565]: W0611 18:28:01.573919 2565 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jun 11 18:28:01.575306 ip-10-0-130-170 kubenswrapper[2565]: W0611 18:28:01.573922 2565 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jun 11 18:28:01.575306 ip-10-0-130-170 kubenswrapper[2565]: W0611 18:28:01.573924 2565 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jun 11 18:28:01.575306 ip-10-0-130-170 kubenswrapper[2565]: W0611 18:28:01.573927 2565 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jun 11 18:28:01.575306 ip-10-0-130-170 kubenswrapper[2565]: W0611 18:28:01.573930 2565 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jun 11 18:28:01.575306 ip-10-0-130-170 kubenswrapper[2565]: W0611 18:28:01.573932 2565 feature_gate.go:328] unrecognized feature gate: EventTTL Jun 11 18:28:01.575306 ip-10-0-130-170 kubenswrapper[2565]: W0611 18:28:01.573935 2565 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jun 11 18:28:01.575306 ip-10-0-130-170 kubenswrapper[2565]: W0611 18:28:01.573937 2565 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jun 11 18:28:01.575306 ip-10-0-130-170 kubenswrapper[2565]: W0611 18:28:01.573940 2565 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jun 11 18:28:01.575306 ip-10-0-130-170 kubenswrapper[2565]: W0611 18:28:01.573942 2565 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jun 11 18:28:01.575306 ip-10-0-130-170 kubenswrapper[2565]: W0611 18:28:01.573944 2565 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jun 11 18:28:01.575306 ip-10-0-130-170 kubenswrapper[2565]: W0611 18:28:01.573947 2565 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jun 11 18:28:01.575306 ip-10-0-130-170 kubenswrapper[2565]: W0611 18:28:01.573950 2565 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jun 11 18:28:01.575306 ip-10-0-130-170 kubenswrapper[2565]: W0611 18:28:01.573952 2565 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jun 11 18:28:01.575306 ip-10-0-130-170 kubenswrapper[2565]: W0611 18:28:01.573955 2565 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jun 11 18:28:01.575306 ip-10-0-130-170 kubenswrapper[2565]: W0611 18:28:01.573958 2565 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jun 11 18:28:01.575306 ip-10-0-130-170 kubenswrapper[2565]: W0611 18:28:01.573960 2565 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jun 11 18:28:01.575798 ip-10-0-130-170 kubenswrapper[2565]: W0611 18:28:01.573963 2565 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jun 11 18:28:01.575798 ip-10-0-130-170 kubenswrapper[2565]: W0611 18:28:01.573965 2565 feature_gate.go:328] unrecognized feature gate: DualReplica Jun 11 18:28:01.575798 ip-10-0-130-170 kubenswrapper[2565]: W0611 18:28:01.573968 2565 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jun 11 18:28:01.575798 ip-10-0-130-170 kubenswrapper[2565]: W0611 18:28:01.573971 2565 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jun 11 18:28:01.575798 ip-10-0-130-170 kubenswrapper[2565]: W0611 18:28:01.573973 2565 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jun 11 18:28:01.575798 ip-10-0-130-170 kubenswrapper[2565]: W0611 18:28:01.573976 2565 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jun 11 18:28:01.575798 ip-10-0-130-170 kubenswrapper[2565]: W0611 18:28:01.573979 2565 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jun 11 18:28:01.575798 ip-10-0-130-170 kubenswrapper[2565]: W0611 18:28:01.573984 2565 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jun 11 18:28:01.575798 ip-10-0-130-170 kubenswrapper[2565]: W0611 18:28:01.573988 2565 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jun 11 18:28:01.575798 ip-10-0-130-170 kubenswrapper[2565]: W0611 18:28:01.573991 2565 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jun 11 18:28:01.575798 ip-10-0-130-170 kubenswrapper[2565]: W0611 18:28:01.573994 2565 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jun 11 18:28:01.575798 ip-10-0-130-170 kubenswrapper[2565]: W0611 18:28:01.573996 2565 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jun 11 18:28:01.575798 ip-10-0-130-170 kubenswrapper[2565]: W0611 18:28:01.573999 2565 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jun 11 18:28:01.575798 ip-10-0-130-170 kubenswrapper[2565]: W0611 18:28:01.574001 2565 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jun 11 18:28:01.575798 ip-10-0-130-170 kubenswrapper[2565]: W0611 18:28:01.574004 2565 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jun 11 18:28:01.575798 ip-10-0-130-170 kubenswrapper[2565]: W0611 18:28:01.574007 2565 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jun 11 18:28:01.575798 ip-10-0-130-170 kubenswrapper[2565]: W0611 18:28:01.574010 2565 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jun 11 18:28:01.575798 ip-10-0-130-170 kubenswrapper[2565]: W0611 18:28:01.574012 2565 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jun 11 18:28:01.575798 ip-10-0-130-170 kubenswrapper[2565]: W0611 18:28:01.574775 2565 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jun 11 18:28:01.575798 ip-10-0-130-170 kubenswrapper[2565]: W0611 18:28:01.574783 2565 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jun 11 18:28:01.576295 ip-10-0-130-170 kubenswrapper[2565]: W0611 18:28:01.574786 2565 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jun 11 18:28:01.576295 ip-10-0-130-170 kubenswrapper[2565]: W0611 18:28:01.574790 2565 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jun 11 18:28:01.576295 ip-10-0-130-170 kubenswrapper[2565]: W0611 18:28:01.574794 2565 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jun 11 18:28:01.576295 ip-10-0-130-170 kubenswrapper[2565]: W0611 18:28:01.574797 2565 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jun 11 18:28:01.576295 ip-10-0-130-170 kubenswrapper[2565]: W0611 18:28:01.574800 2565 feature_gate.go:328] unrecognized feature gate: DualReplica Jun 11 18:28:01.576295 ip-10-0-130-170 kubenswrapper[2565]: W0611 18:28:01.574803 2565 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jun 11 18:28:01.576295 ip-10-0-130-170 kubenswrapper[2565]: W0611 18:28:01.574806 2565 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jun 11 18:28:01.576295 ip-10-0-130-170 kubenswrapper[2565]: W0611 18:28:01.574810 2565 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jun 11 18:28:01.576295 ip-10-0-130-170 kubenswrapper[2565]: W0611 18:28:01.574813 2565 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jun 11 18:28:01.576295 ip-10-0-130-170 kubenswrapper[2565]: W0611 18:28:01.574815 2565 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jun 11 18:28:01.576295 ip-10-0-130-170 kubenswrapper[2565]: W0611 18:28:01.574818 2565 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jun 11 18:28:01.576295 ip-10-0-130-170 kubenswrapper[2565]: W0611 18:28:01.574821 2565 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jun 11 18:28:01.576295 ip-10-0-130-170 kubenswrapper[2565]: W0611 18:28:01.574824 2565 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jun 11 18:28:01.576295 ip-10-0-130-170 kubenswrapper[2565]: W0611 18:28:01.574827 2565 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jun 11 18:28:01.576295 ip-10-0-130-170 kubenswrapper[2565]: W0611 18:28:01.574829 2565 feature_gate.go:328] unrecognized feature gate: OVNObservability Jun 11 18:28:01.576295 ip-10-0-130-170 kubenswrapper[2565]: W0611 18:28:01.574832 2565 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jun 11 18:28:01.576295 ip-10-0-130-170 kubenswrapper[2565]: W0611 18:28:01.574834 2565 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jun 11 18:28:01.576295 ip-10-0-130-170 kubenswrapper[2565]: W0611 18:28:01.574837 2565 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jun 11 18:28:01.576295 ip-10-0-130-170 kubenswrapper[2565]: W0611 18:28:01.574839 2565 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jun 11 18:28:01.576765 ip-10-0-130-170 kubenswrapper[2565]: W0611 18:28:01.574843 2565 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jun 11 18:28:01.576765 ip-10-0-130-170 kubenswrapper[2565]: W0611 18:28:01.574846 2565 feature_gate.go:328] unrecognized feature gate: PinnedImages Jun 11 18:28:01.576765 ip-10-0-130-170 kubenswrapper[2565]: W0611 18:28:01.574849 2565 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jun 11 18:28:01.576765 ip-10-0-130-170 kubenswrapper[2565]: W0611 18:28:01.574851 2565 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jun 11 18:28:01.576765 ip-10-0-130-170 kubenswrapper[2565]: W0611 18:28:01.574855 2565 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jun 11 18:28:01.576765 ip-10-0-130-170 kubenswrapper[2565]: W0611 18:28:01.574859 2565 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jun 11 18:28:01.576765 ip-10-0-130-170 kubenswrapper[2565]: W0611 18:28:01.574863 2565 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jun 11 18:28:01.576765 ip-10-0-130-170 kubenswrapper[2565]: W0611 18:28:01.574866 2565 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jun 11 18:28:01.576765 ip-10-0-130-170 kubenswrapper[2565]: W0611 18:28:01.574868 2565 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jun 11 18:28:01.576765 ip-10-0-130-170 kubenswrapper[2565]: W0611 18:28:01.574871 2565 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jun 11 18:28:01.576765 ip-10-0-130-170 kubenswrapper[2565]: W0611 18:28:01.574874 2565 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jun 11 18:28:01.576765 ip-10-0-130-170 kubenswrapper[2565]: W0611 18:28:01.574876 2565 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jun 11 18:28:01.576765 ip-10-0-130-170 kubenswrapper[2565]: W0611 18:28:01.574879 2565 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jun 11 18:28:01.576765 ip-10-0-130-170 kubenswrapper[2565]: W0611 18:28:01.574881 2565 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jun 11 18:28:01.576765 ip-10-0-130-170 kubenswrapper[2565]: W0611 18:28:01.574884 2565 feature_gate.go:328] unrecognized feature gate: OSStreams Jun 11 18:28:01.576765 ip-10-0-130-170 kubenswrapper[2565]: W0611 18:28:01.574886 2565 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jun 11 18:28:01.576765 ip-10-0-130-170 kubenswrapper[2565]: W0611 18:28:01.574889 2565 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jun 11 18:28:01.576765 ip-10-0-130-170 kubenswrapper[2565]: W0611 18:28:01.574891 2565 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jun 11 18:28:01.576765 ip-10-0-130-170 kubenswrapper[2565]: W0611 18:28:01.574894 2565 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jun 11 18:28:01.577228 ip-10-0-130-170 kubenswrapper[2565]: W0611 18:28:01.574897 2565 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jun 11 18:28:01.577228 ip-10-0-130-170 kubenswrapper[2565]: W0611 18:28:01.574900 2565 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jun 11 18:28:01.577228 ip-10-0-130-170 kubenswrapper[2565]: W0611 18:28:01.574902 2565 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jun 11 18:28:01.577228 ip-10-0-130-170 kubenswrapper[2565]: W0611 18:28:01.574904 2565 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jun 11 18:28:01.577228 ip-10-0-130-170 kubenswrapper[2565]: W0611 18:28:01.574907 2565 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jun 11 18:28:01.577228 ip-10-0-130-170 kubenswrapper[2565]: W0611 18:28:01.574909 2565 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jun 11 18:28:01.577228 ip-10-0-130-170 kubenswrapper[2565]: W0611 18:28:01.574913 2565 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jun 11 18:28:01.577228 ip-10-0-130-170 kubenswrapper[2565]: W0611 18:28:01.574917 2565 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jun 11 18:28:01.577228 ip-10-0-130-170 kubenswrapper[2565]: W0611 18:28:01.574920 2565 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jun 11 18:28:01.577228 ip-10-0-130-170 kubenswrapper[2565]: W0611 18:28:01.574923 2565 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jun 11 18:28:01.577228 ip-10-0-130-170 kubenswrapper[2565]: W0611 18:28:01.574926 2565 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jun 11 18:28:01.577228 ip-10-0-130-170 kubenswrapper[2565]: W0611 18:28:01.574929 2565 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jun 11 18:28:01.577228 ip-10-0-130-170 kubenswrapper[2565]: W0611 18:28:01.574932 2565 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jun 11 18:28:01.577228 ip-10-0-130-170 kubenswrapper[2565]: W0611 18:28:01.574936 2565 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jun 11 18:28:01.577228 ip-10-0-130-170 kubenswrapper[2565]: W0611 18:28:01.574939 2565 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jun 11 18:28:01.577228 ip-10-0-130-170 kubenswrapper[2565]: W0611 18:28:01.574941 2565 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jun 11 18:28:01.577228 ip-10-0-130-170 kubenswrapper[2565]: W0611 18:28:01.574944 2565 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jun 11 18:28:01.577228 ip-10-0-130-170 kubenswrapper[2565]: W0611 18:28:01.574947 2565 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jun 11 18:28:01.577228 ip-10-0-130-170 kubenswrapper[2565]: W0611 18:28:01.574950 2565 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jun 11 18:28:01.577706 ip-10-0-130-170 kubenswrapper[2565]: W0611 18:28:01.574952 2565 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jun 11 18:28:01.577706 ip-10-0-130-170 kubenswrapper[2565]: W0611 18:28:01.574955 2565 feature_gate.go:328] unrecognized feature gate: EventTTL Jun 11 18:28:01.577706 ip-10-0-130-170 kubenswrapper[2565]: W0611 18:28:01.574959 2565 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jun 11 18:28:01.577706 ip-10-0-130-170 kubenswrapper[2565]: W0611 18:28:01.574961 2565 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jun 11 18:28:01.577706 ip-10-0-130-170 kubenswrapper[2565]: W0611 18:28:01.574964 2565 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jun 11 18:28:01.577706 ip-10-0-130-170 kubenswrapper[2565]: W0611 18:28:01.574966 2565 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jun 11 18:28:01.577706 ip-10-0-130-170 kubenswrapper[2565]: W0611 18:28:01.574968 2565 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jun 11 18:28:01.577706 ip-10-0-130-170 kubenswrapper[2565]: W0611 18:28:01.574971 2565 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jun 11 18:28:01.577706 ip-10-0-130-170 kubenswrapper[2565]: W0611 18:28:01.574973 2565 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jun 11 18:28:01.577706 ip-10-0-130-170 kubenswrapper[2565]: W0611 18:28:01.574976 2565 feature_gate.go:328] unrecognized feature gate: SignatureStores Jun 11 18:28:01.577706 ip-10-0-130-170 kubenswrapper[2565]: W0611 18:28:01.574978 2565 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jun 11 18:28:01.577706 ip-10-0-130-170 kubenswrapper[2565]: W0611 18:28:01.574981 2565 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jun 11 18:28:01.577706 ip-10-0-130-170 kubenswrapper[2565]: W0611 18:28:01.574983 2565 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jun 11 18:28:01.577706 ip-10-0-130-170 kubenswrapper[2565]: W0611 18:28:01.574985 2565 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jun 11 18:28:01.577706 ip-10-0-130-170 kubenswrapper[2565]: W0611 18:28:01.574988 2565 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jun 11 18:28:01.577706 ip-10-0-130-170 kubenswrapper[2565]: W0611 18:28:01.574990 2565 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jun 11 18:28:01.577706 ip-10-0-130-170 kubenswrapper[2565]: W0611 18:28:01.574993 2565 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jun 11 18:28:01.577706 ip-10-0-130-170 kubenswrapper[2565]: W0611 18:28:01.574995 2565 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jun 11 18:28:01.577706 ip-10-0-130-170 kubenswrapper[2565]: W0611 18:28:01.574998 2565 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jun 11 18:28:01.577706 ip-10-0-130-170 kubenswrapper[2565]: W0611 18:28:01.575000 2565 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jun 11 18:28:01.578197 ip-10-0-130-170 kubenswrapper[2565]: W0611 18:28:01.575004 2565 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jun 11 18:28:01.578197 ip-10-0-130-170 kubenswrapper[2565]: W0611 18:28:01.575006 2565 feature_gate.go:328] unrecognized feature gate: Example Jun 11 18:28:01.578197 ip-10-0-130-170 kubenswrapper[2565]: W0611 18:28:01.575008 2565 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jun 11 18:28:01.578197 ip-10-0-130-170 kubenswrapper[2565]: W0611 18:28:01.575011 2565 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jun 11 18:28:01.578197 ip-10-0-130-170 kubenswrapper[2565]: W0611 18:28:01.575013 2565 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jun 11 18:28:01.578197 ip-10-0-130-170 kubenswrapper[2565]: W0611 18:28:01.575015 2565 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jun 11 18:28:01.578197 ip-10-0-130-170 kubenswrapper[2565]: W0611 18:28:01.575018 2565 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jun 11 18:28:01.578197 ip-10-0-130-170 kubenswrapper[2565]: W0611 18:28:01.575021 2565 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jun 11 18:28:01.578197 ip-10-0-130-170 kubenswrapper[2565]: W0611 18:28:01.575024 2565 feature_gate.go:328] unrecognized feature gate: Example2 Jun 11 18:28:01.578197 ip-10-0-130-170 kubenswrapper[2565]: W0611 18:28:01.575026 2565 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jun 11 18:28:01.578197 ip-10-0-130-170 kubenswrapper[2565]: W0611 18:28:01.575029 2565 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jun 11 18:28:01.578197 ip-10-0-130-170 kubenswrapper[2565]: W0611 18:28:01.575031 2565 feature_gate.go:328] unrecognized feature gate: NewOLM Jun 11 18:28:01.578197 ip-10-0-130-170 kubenswrapper[2565]: W0611 18:28:01.575035 2565 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jun 11 18:28:01.578197 ip-10-0-130-170 kubenswrapper[2565]: W0611 18:28:01.575037 2565 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jun 11 18:28:01.578197 ip-10-0-130-170 kubenswrapper[2565]: W0611 18:28:01.575040 2565 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jun 11 18:28:01.578197 ip-10-0-130-170 kubenswrapper[2565]: W0611 18:28:01.575043 2565 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jun 11 18:28:01.578197 ip-10-0-130-170 kubenswrapper[2565]: W0611 18:28:01.575045 2565 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jun 11 18:28:01.578197 ip-10-0-130-170 kubenswrapper[2565]: W0611 18:28:01.575048 2565 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jun 11 18:28:01.578197 ip-10-0-130-170 kubenswrapper[2565]: W0611 18:28:01.575050 2565 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jun 11 18:28:01.578197 ip-10-0-130-170 kubenswrapper[2565]: W0611 18:28:01.575053 2565 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jun 11 18:28:01.578710 ip-10-0-130-170 kubenswrapper[2565]: W0611 18:28:01.575479 2565 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jun 11 18:28:01.578710 ip-10-0-130-170 kubenswrapper[2565]: W0611 18:28:01.575485 2565 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jun 11 18:28:01.578710 ip-10-0-130-170 kubenswrapper[2565]: W0611 18:28:01.575488 2565 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jun 11 18:28:01.578710 ip-10-0-130-170 kubenswrapper[2565]: W0611 18:28:01.575491 2565 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jun 11 18:28:01.578710 ip-10-0-130-170 kubenswrapper[2565]: W0611 18:28:01.575493 2565 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jun 11 18:28:01.578710 ip-10-0-130-170 kubenswrapper[2565]: W0611 18:28:01.575496 2565 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jun 11 18:28:01.578710 ip-10-0-130-170 kubenswrapper[2565]: W0611 18:28:01.575498 2565 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jun 11 18:28:01.578710 ip-10-0-130-170 kubenswrapper[2565]: W0611 18:28:01.575503 2565 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jun 11 18:28:01.578710 ip-10-0-130-170 kubenswrapper[2565]: W0611 18:28:01.575507 2565 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jun 11 18:28:01.578710 ip-10-0-130-170 kubenswrapper[2565]: W0611 18:28:01.575510 2565 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jun 11 18:28:01.578710 ip-10-0-130-170 kubenswrapper[2565]: W0611 18:28:01.575513 2565 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jun 11 18:28:01.578710 ip-10-0-130-170 kubenswrapper[2565]: W0611 18:28:01.575516 2565 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jun 11 18:28:01.578710 ip-10-0-130-170 kubenswrapper[2565]: W0611 18:28:01.575519 2565 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jun 11 18:28:01.578710 ip-10-0-130-170 kubenswrapper[2565]: W0611 18:28:01.575522 2565 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jun 11 18:28:01.578710 ip-10-0-130-170 kubenswrapper[2565]: W0611 18:28:01.575525 2565 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jun 11 18:28:01.578710 ip-10-0-130-170 kubenswrapper[2565]: W0611 18:28:01.575528 2565 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jun 11 18:28:01.578710 ip-10-0-130-170 kubenswrapper[2565]: W0611 18:28:01.575531 2565 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jun 11 18:28:01.578710 ip-10-0-130-170 kubenswrapper[2565]: W0611 18:28:01.575533 2565 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jun 11 18:28:01.578710 ip-10-0-130-170 kubenswrapper[2565]: W0611 18:28:01.575537 2565 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jun 11 18:28:01.578710 ip-10-0-130-170 kubenswrapper[2565]: W0611 18:28:01.575540 2565 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jun 11 18:28:01.579198 ip-10-0-130-170 kubenswrapper[2565]: W0611 18:28:01.575542 2565 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jun 11 18:28:01.579198 ip-10-0-130-170 kubenswrapper[2565]: W0611 18:28:01.575545 2565 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jun 11 18:28:01.579198 ip-10-0-130-170 kubenswrapper[2565]: W0611 18:28:01.575547 2565 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jun 11 18:28:01.579198 ip-10-0-130-170 kubenswrapper[2565]: W0611 18:28:01.575550 2565 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jun 11 18:28:01.579198 ip-10-0-130-170 kubenswrapper[2565]: W0611 18:28:01.575553 2565 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jun 11 18:28:01.579198 ip-10-0-130-170 kubenswrapper[2565]: W0611 18:28:01.575555 2565 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jun 11 18:28:01.579198 ip-10-0-130-170 kubenswrapper[2565]: W0611 18:28:01.575557 2565 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jun 11 18:28:01.579198 ip-10-0-130-170 kubenswrapper[2565]: W0611 18:28:01.575560 2565 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jun 11 18:28:01.579198 ip-10-0-130-170 kubenswrapper[2565]: W0611 18:28:01.575562 2565 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jun 11 18:28:01.579198 ip-10-0-130-170 kubenswrapper[2565]: W0611 18:28:01.575565 2565 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jun 11 18:28:01.579198 ip-10-0-130-170 kubenswrapper[2565]: W0611 18:28:01.575567 2565 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jun 11 18:28:01.579198 ip-10-0-130-170 kubenswrapper[2565]: W0611 18:28:01.575569 2565 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jun 11 18:28:01.579198 ip-10-0-130-170 kubenswrapper[2565]: W0611 18:28:01.575572 2565 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jun 11 18:28:01.579198 ip-10-0-130-170 kubenswrapper[2565]: W0611 18:28:01.575575 2565 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jun 11 18:28:01.579198 ip-10-0-130-170 kubenswrapper[2565]: W0611 18:28:01.575577 2565 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jun 11 18:28:01.579198 ip-10-0-130-170 kubenswrapper[2565]: W0611 18:28:01.575580 2565 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jun 11 18:28:01.579198 ip-10-0-130-170 kubenswrapper[2565]: W0611 18:28:01.575582 2565 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jun 11 18:28:01.579198 ip-10-0-130-170 kubenswrapper[2565]: W0611 18:28:01.575586 2565 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jun 11 18:28:01.579198 ip-10-0-130-170 kubenswrapper[2565]: W0611 18:28:01.575589 2565 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jun 11 18:28:01.579725 ip-10-0-130-170 kubenswrapper[2565]: W0611 18:28:01.575592 2565 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jun 11 18:28:01.579725 ip-10-0-130-170 kubenswrapper[2565]: W0611 18:28:01.575594 2565 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jun 11 18:28:01.579725 ip-10-0-130-170 kubenswrapper[2565]: W0611 18:28:01.575597 2565 feature_gate.go:328] unrecognized feature gate: DualReplica Jun 11 18:28:01.579725 ip-10-0-130-170 kubenswrapper[2565]: W0611 18:28:01.575599 2565 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jun 11 18:28:01.579725 ip-10-0-130-170 kubenswrapper[2565]: W0611 18:28:01.575602 2565 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jun 11 18:28:01.579725 ip-10-0-130-170 kubenswrapper[2565]: W0611 18:28:01.575604 2565 feature_gate.go:328] unrecognized feature gate: PinnedImages Jun 11 18:28:01.579725 ip-10-0-130-170 kubenswrapper[2565]: W0611 18:28:01.575608 2565 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jun 11 18:28:01.579725 ip-10-0-130-170 kubenswrapper[2565]: W0611 18:28:01.575611 2565 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jun 11 18:28:01.579725 ip-10-0-130-170 kubenswrapper[2565]: W0611 18:28:01.575613 2565 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jun 11 18:28:01.579725 ip-10-0-130-170 kubenswrapper[2565]: W0611 18:28:01.575616 2565 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jun 11 18:28:01.579725 ip-10-0-130-170 kubenswrapper[2565]: W0611 18:28:01.575619 2565 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jun 11 18:28:01.579725 ip-10-0-130-170 kubenswrapper[2565]: W0611 18:28:01.575625 2565 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jun 11 18:28:01.579725 ip-10-0-130-170 kubenswrapper[2565]: W0611 18:28:01.575627 2565 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jun 11 18:28:01.579725 ip-10-0-130-170 kubenswrapper[2565]: W0611 18:28:01.575630 2565 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jun 11 18:28:01.579725 ip-10-0-130-170 kubenswrapper[2565]: W0611 18:28:01.575632 2565 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jun 11 18:28:01.579725 ip-10-0-130-170 kubenswrapper[2565]: W0611 18:28:01.575635 2565 feature_gate.go:328] unrecognized feature gate: OVNObservability Jun 11 18:28:01.579725 ip-10-0-130-170 kubenswrapper[2565]: W0611 18:28:01.575638 2565 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jun 11 18:28:01.579725 ip-10-0-130-170 kubenswrapper[2565]: W0611 18:28:01.575641 2565 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jun 11 18:28:01.579725 ip-10-0-130-170 kubenswrapper[2565]: W0611 18:28:01.575644 2565 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jun 11 18:28:01.580211 ip-10-0-130-170 kubenswrapper[2565]: W0611 18:28:01.575647 2565 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jun 11 18:28:01.580211 ip-10-0-130-170 kubenswrapper[2565]: W0611 18:28:01.575659 2565 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jun 11 18:28:01.580211 ip-10-0-130-170 kubenswrapper[2565]: W0611 18:28:01.575662 2565 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jun 11 18:28:01.580211 ip-10-0-130-170 kubenswrapper[2565]: W0611 18:28:01.575665 2565 feature_gate.go:328] unrecognized feature gate: NewOLM Jun 11 18:28:01.580211 ip-10-0-130-170 kubenswrapper[2565]: W0611 18:28:01.575667 2565 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jun 11 18:28:01.580211 ip-10-0-130-170 kubenswrapper[2565]: W0611 18:28:01.575670 2565 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jun 11 18:28:01.580211 ip-10-0-130-170 kubenswrapper[2565]: W0611 18:28:01.575673 2565 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jun 11 18:28:01.580211 ip-10-0-130-170 kubenswrapper[2565]: W0611 18:28:01.575676 2565 feature_gate.go:328] unrecognized feature gate: EventTTL Jun 11 18:28:01.580211 ip-10-0-130-170 kubenswrapper[2565]: W0611 18:28:01.575679 2565 feature_gate.go:328] unrecognized feature gate: Example Jun 11 18:28:01.580211 ip-10-0-130-170 kubenswrapper[2565]: W0611 18:28:01.575681 2565 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jun 11 18:28:01.580211 ip-10-0-130-170 kubenswrapper[2565]: W0611 18:28:01.575684 2565 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jun 11 18:28:01.580211 ip-10-0-130-170 kubenswrapper[2565]: W0611 18:28:01.575686 2565 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jun 11 18:28:01.580211 ip-10-0-130-170 kubenswrapper[2565]: W0611 18:28:01.575688 2565 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jun 11 18:28:01.580211 ip-10-0-130-170 kubenswrapper[2565]: W0611 18:28:01.575691 2565 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jun 11 18:28:01.580211 ip-10-0-130-170 kubenswrapper[2565]: W0611 18:28:01.575693 2565 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jun 11 18:28:01.580211 ip-10-0-130-170 kubenswrapper[2565]: W0611 18:28:01.575696 2565 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jun 11 18:28:01.580211 ip-10-0-130-170 kubenswrapper[2565]: W0611 18:28:01.575698 2565 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jun 11 18:28:01.580211 ip-10-0-130-170 kubenswrapper[2565]: W0611 18:28:01.575701 2565 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jun 11 18:28:01.580211 ip-10-0-130-170 kubenswrapper[2565]: W0611 18:28:01.575703 2565 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jun 11 18:28:01.580211 ip-10-0-130-170 kubenswrapper[2565]: W0611 18:28:01.575706 2565 feature_gate.go:328] unrecognized feature gate: OSStreams Jun 11 18:28:01.580727 ip-10-0-130-170 kubenswrapper[2565]: W0611 18:28:01.575709 2565 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jun 11 18:28:01.580727 ip-10-0-130-170 kubenswrapper[2565]: W0611 18:28:01.575711 2565 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jun 11 18:28:01.580727 ip-10-0-130-170 kubenswrapper[2565]: W0611 18:28:01.575714 2565 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jun 11 18:28:01.580727 ip-10-0-130-170 kubenswrapper[2565]: W0611 18:28:01.575718 2565 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jun 11 18:28:01.580727 ip-10-0-130-170 kubenswrapper[2565]: W0611 18:28:01.575722 2565 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jun 11 18:28:01.580727 ip-10-0-130-170 kubenswrapper[2565]: W0611 18:28:01.575724 2565 feature_gate.go:328] unrecognized feature gate: SignatureStores Jun 11 18:28:01.580727 ip-10-0-130-170 kubenswrapper[2565]: W0611 18:28:01.575727 2565 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jun 11 18:28:01.580727 ip-10-0-130-170 kubenswrapper[2565]: W0611 18:28:01.575729 2565 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jun 11 18:28:01.580727 ip-10-0-130-170 kubenswrapper[2565]: W0611 18:28:01.575732 2565 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jun 11 18:28:01.580727 ip-10-0-130-170 kubenswrapper[2565]: W0611 18:28:01.575734 2565 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jun 11 18:28:01.580727 ip-10-0-130-170 kubenswrapper[2565]: W0611 18:28:01.575737 2565 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jun 11 18:28:01.580727 ip-10-0-130-170 kubenswrapper[2565]: W0611 18:28:01.575739 2565 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jun 11 18:28:01.580727 ip-10-0-130-170 kubenswrapper[2565]: W0611 18:28:01.575741 2565 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jun 11 18:28:01.580727 ip-10-0-130-170 kubenswrapper[2565]: W0611 18:28:01.575744 2565 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jun 11 18:28:01.580727 ip-10-0-130-170 kubenswrapper[2565]: W0611 18:28:01.575746 2565 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jun 11 18:28:01.580727 ip-10-0-130-170 kubenswrapper[2565]: W0611 18:28:01.575749 2565 feature_gate.go:328] unrecognized feature gate: Example2 Jun 11 18:28:01.580727 ip-10-0-130-170 kubenswrapper[2565]: W0611 18:28:01.575751 2565 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jun 11 18:28:01.580727 ip-10-0-130-170 kubenswrapper[2565]: W0611 18:28:01.575754 2565 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jun 11 18:28:01.580727 ip-10-0-130-170 kubenswrapper[2565]: W0611 18:28:01.575756 2565 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jun 11 18:28:01.580727 ip-10-0-130-170 kubenswrapper[2565]: W0611 18:28:01.575759 2565 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jun 11 18:28:01.581213 ip-10-0-130-170 kubenswrapper[2565]: W0611 18:28:01.575762 2565 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jun 11 18:28:01.581213 ip-10-0-130-170 kubenswrapper[2565]: I0611 18:28:01.575862 2565 flags.go:64] FLAG: --address="0.0.0.0" Jun 11 18:28:01.581213 ip-10-0-130-170 kubenswrapper[2565]: I0611 18:28:01.575874 2565 flags.go:64] FLAG: --allowed-unsafe-sysctls="[]" Jun 11 18:28:01.581213 ip-10-0-130-170 kubenswrapper[2565]: I0611 18:28:01.575884 2565 flags.go:64] FLAG: --anonymous-auth="true" Jun 11 18:28:01.581213 ip-10-0-130-170 kubenswrapper[2565]: I0611 18:28:01.575891 2565 flags.go:64] FLAG: --application-metrics-count-limit="100" Jun 11 18:28:01.581213 ip-10-0-130-170 kubenswrapper[2565]: I0611 18:28:01.575899 2565 flags.go:64] FLAG: --authentication-token-webhook="false" Jun 11 18:28:01.581213 ip-10-0-130-170 kubenswrapper[2565]: I0611 18:28:01.575903 2565 flags.go:64] FLAG: --authentication-token-webhook-cache-ttl="2m0s" Jun 11 18:28:01.581213 ip-10-0-130-170 kubenswrapper[2565]: I0611 18:28:01.575907 2565 flags.go:64] FLAG: --authorization-mode="AlwaysAllow" Jun 11 18:28:01.581213 ip-10-0-130-170 kubenswrapper[2565]: I0611 18:28:01.575912 2565 flags.go:64] FLAG: --authorization-webhook-cache-authorized-ttl="5m0s" Jun 11 18:28:01.581213 ip-10-0-130-170 kubenswrapper[2565]: I0611 18:28:01.575915 2565 flags.go:64] FLAG: --authorization-webhook-cache-unauthorized-ttl="30s" Jun 11 18:28:01.581213 ip-10-0-130-170 kubenswrapper[2565]: I0611 18:28:01.575918 2565 flags.go:64] FLAG: --boot-id-file="/proc/sys/kernel/random/boot_id" Jun 11 18:28:01.581213 ip-10-0-130-170 kubenswrapper[2565]: I0611 18:28:01.575922 2565 flags.go:64] FLAG: --bootstrap-kubeconfig="/etc/kubernetes/kubeconfig" Jun 11 18:28:01.581213 ip-10-0-130-170 kubenswrapper[2565]: I0611 18:28:01.575925 2565 flags.go:64] FLAG: --cert-dir="/var/lib/kubelet/pki" Jun 11 18:28:01.581213 ip-10-0-130-170 kubenswrapper[2565]: I0611 18:28:01.575929 2565 flags.go:64] FLAG: --cgroup-driver="cgroupfs" Jun 11 18:28:01.581213 ip-10-0-130-170 kubenswrapper[2565]: I0611 18:28:01.575932 2565 flags.go:64] FLAG: --cgroup-root="" Jun 11 18:28:01.581213 ip-10-0-130-170 kubenswrapper[2565]: I0611 18:28:01.575935 2565 flags.go:64] FLAG: --cgroups-per-qos="true" Jun 11 18:28:01.581213 ip-10-0-130-170 kubenswrapper[2565]: I0611 18:28:01.575943 2565 flags.go:64] FLAG: --client-ca-file="" Jun 11 18:28:01.581213 ip-10-0-130-170 kubenswrapper[2565]: I0611 18:28:01.575946 2565 flags.go:64] FLAG: --cloud-provider="external" Jun 11 18:28:01.581213 ip-10-0-130-170 kubenswrapper[2565]: I0611 18:28:01.575949 2565 flags.go:64] FLAG: --cluster-dns="[]" Jun 11 18:28:01.581213 ip-10-0-130-170 kubenswrapper[2565]: I0611 18:28:01.575955 2565 flags.go:64] FLAG: --cluster-domain="" Jun 11 18:28:01.581213 ip-10-0-130-170 kubenswrapper[2565]: I0611 18:28:01.575957 2565 flags.go:64] FLAG: --config="/etc/kubernetes/kubelet.conf" Jun 11 18:28:01.581213 ip-10-0-130-170 kubenswrapper[2565]: I0611 18:28:01.575960 2565 flags.go:64] FLAG: --config-dir="/etc/openshift/kubelet.conf.d" Jun 11 18:28:01.581213 ip-10-0-130-170 kubenswrapper[2565]: I0611 18:28:01.575963 2565 flags.go:64] FLAG: --container-hints="/etc/cadvisor/container_hints.json" Jun 11 18:28:01.581213 ip-10-0-130-170 kubenswrapper[2565]: I0611 18:28:01.575966 2565 flags.go:64] FLAG: --container-log-max-files="5" Jun 11 18:28:01.581795 ip-10-0-130-170 kubenswrapper[2565]: I0611 18:28:01.575970 2565 flags.go:64] FLAG: --container-log-max-size="10Mi" Jun 11 18:28:01.581795 ip-10-0-130-170 kubenswrapper[2565]: I0611 18:28:01.575972 2565 flags.go:64] FLAG: --container-runtime-endpoint="/var/run/crio/crio.sock" Jun 11 18:28:01.581795 ip-10-0-130-170 kubenswrapper[2565]: I0611 18:28:01.575975 2565 flags.go:64] FLAG: --containerd="/run/containerd/containerd.sock" Jun 11 18:28:01.581795 ip-10-0-130-170 kubenswrapper[2565]: I0611 18:28:01.575978 2565 flags.go:64] FLAG: --containerd-namespace="k8s.io" Jun 11 18:28:01.581795 ip-10-0-130-170 kubenswrapper[2565]: I0611 18:28:01.575982 2565 flags.go:64] FLAG: --contention-profiling="false" Jun 11 18:28:01.581795 ip-10-0-130-170 kubenswrapper[2565]: I0611 18:28:01.575985 2565 flags.go:64] FLAG: --cpu-cfs-quota="true" Jun 11 18:28:01.581795 ip-10-0-130-170 kubenswrapper[2565]: I0611 18:28:01.575988 2565 flags.go:64] FLAG: --cpu-cfs-quota-period="100ms" Jun 11 18:28:01.581795 ip-10-0-130-170 kubenswrapper[2565]: I0611 18:28:01.575991 2565 flags.go:64] FLAG: --cpu-manager-policy="none" Jun 11 18:28:01.581795 ip-10-0-130-170 kubenswrapper[2565]: I0611 18:28:01.575993 2565 flags.go:64] FLAG: --cpu-manager-policy-options="" Jun 11 18:28:01.581795 ip-10-0-130-170 kubenswrapper[2565]: I0611 18:28:01.575998 2565 flags.go:64] FLAG: --cpu-manager-reconcile-period="10s" Jun 11 18:28:01.581795 ip-10-0-130-170 kubenswrapper[2565]: I0611 18:28:01.576001 2565 flags.go:64] FLAG: --enable-controller-attach-detach="true" Jun 11 18:28:01.581795 ip-10-0-130-170 kubenswrapper[2565]: I0611 18:28:01.576003 2565 flags.go:64] FLAG: --enable-debugging-handlers="true" Jun 11 18:28:01.581795 ip-10-0-130-170 kubenswrapper[2565]: I0611 18:28:01.576006 2565 flags.go:64] FLAG: --enable-load-reader="false" Jun 11 18:28:01.581795 ip-10-0-130-170 kubenswrapper[2565]: I0611 18:28:01.576009 2565 flags.go:64] FLAG: --enable-server="true" Jun 11 18:28:01.581795 ip-10-0-130-170 kubenswrapper[2565]: I0611 18:28:01.576011 2565 flags.go:64] FLAG: --enforce-node-allocatable="[pods]" Jun 11 18:28:01.581795 ip-10-0-130-170 kubenswrapper[2565]: I0611 18:28:01.576015 2565 flags.go:64] FLAG: --event-burst="100" Jun 11 18:28:01.581795 ip-10-0-130-170 kubenswrapper[2565]: I0611 18:28:01.576018 2565 flags.go:64] FLAG: --event-qps="50" Jun 11 18:28:01.581795 ip-10-0-130-170 kubenswrapper[2565]: I0611 18:28:01.576021 2565 flags.go:64] FLAG: --event-storage-age-limit="default=0" Jun 11 18:28:01.581795 ip-10-0-130-170 kubenswrapper[2565]: I0611 18:28:01.576024 2565 flags.go:64] FLAG: --event-storage-event-limit="default=0" Jun 11 18:28:01.581795 ip-10-0-130-170 kubenswrapper[2565]: I0611 18:28:01.576026 2565 flags.go:64] FLAG: --eviction-hard="" Jun 11 18:28:01.581795 ip-10-0-130-170 kubenswrapper[2565]: I0611 18:28:01.576030 2565 flags.go:64] FLAG: --eviction-max-pod-grace-period="0" Jun 11 18:28:01.581795 ip-10-0-130-170 kubenswrapper[2565]: I0611 18:28:01.576033 2565 flags.go:64] FLAG: --eviction-minimum-reclaim="" Jun 11 18:28:01.581795 ip-10-0-130-170 kubenswrapper[2565]: I0611 18:28:01.576036 2565 flags.go:64] FLAG: --eviction-pressure-transition-period="5m0s" Jun 11 18:28:01.581795 ip-10-0-130-170 kubenswrapper[2565]: I0611 18:28:01.576039 2565 flags.go:64] FLAG: --eviction-soft="" Jun 11 18:28:01.581795 ip-10-0-130-170 kubenswrapper[2565]: I0611 18:28:01.576045 2565 flags.go:64] FLAG: --eviction-soft-grace-period="" Jun 11 18:28:01.582447 ip-10-0-130-170 kubenswrapper[2565]: I0611 18:28:01.576048 2565 flags.go:64] FLAG: --exit-on-lock-contention="false" Jun 11 18:28:01.582447 ip-10-0-130-170 kubenswrapper[2565]: I0611 18:28:01.576051 2565 flags.go:64] FLAG: --experimental-allocatable-ignore-eviction="false" Jun 11 18:28:01.582447 ip-10-0-130-170 kubenswrapper[2565]: I0611 18:28:01.576054 2565 flags.go:64] FLAG: --experimental-mounter-path="" Jun 11 18:28:01.582447 ip-10-0-130-170 kubenswrapper[2565]: I0611 18:28:01.576057 2565 flags.go:64] FLAG: --fail-cgroupv1="false" Jun 11 18:28:01.582447 ip-10-0-130-170 kubenswrapper[2565]: I0611 18:28:01.576060 2565 flags.go:64] FLAG: --fail-swap-on="true" Jun 11 18:28:01.582447 ip-10-0-130-170 kubenswrapper[2565]: I0611 18:28:01.576063 2565 flags.go:64] FLAG: --feature-gates="" Jun 11 18:28:01.582447 ip-10-0-130-170 kubenswrapper[2565]: I0611 18:28:01.576067 2565 flags.go:64] FLAG: --file-check-frequency="20s" Jun 11 18:28:01.582447 ip-10-0-130-170 kubenswrapper[2565]: I0611 18:28:01.576069 2565 flags.go:64] FLAG: --global-housekeeping-interval="1m0s" Jun 11 18:28:01.582447 ip-10-0-130-170 kubenswrapper[2565]: I0611 18:28:01.576073 2565 flags.go:64] FLAG: --hairpin-mode="promiscuous-bridge" Jun 11 18:28:01.582447 ip-10-0-130-170 kubenswrapper[2565]: I0611 18:28:01.576076 2565 flags.go:64] FLAG: --healthz-bind-address="127.0.0.1" Jun 11 18:28:01.582447 ip-10-0-130-170 kubenswrapper[2565]: I0611 18:28:01.576079 2565 flags.go:64] FLAG: --healthz-port="10248" Jun 11 18:28:01.582447 ip-10-0-130-170 kubenswrapper[2565]: I0611 18:28:01.576082 2565 flags.go:64] FLAG: --help="false" Jun 11 18:28:01.582447 ip-10-0-130-170 kubenswrapper[2565]: I0611 18:28:01.576085 2565 flags.go:64] FLAG: --hostname-override="ip-10-0-130-170.ec2.internal" Jun 11 18:28:01.582447 ip-10-0-130-170 kubenswrapper[2565]: I0611 18:28:01.576088 2565 flags.go:64] FLAG: --housekeeping-interval="10s" Jun 11 18:28:01.582447 ip-10-0-130-170 kubenswrapper[2565]: I0611 18:28:01.576091 2565 flags.go:64] FLAG: --http-check-frequency="20s" Jun 11 18:28:01.582447 ip-10-0-130-170 kubenswrapper[2565]: I0611 18:28:01.576094 2565 flags.go:64] FLAG: --image-credential-provider-bin-dir="/usr/libexec/kubelet-image-credential-provider-plugins" Jun 11 18:28:01.582447 ip-10-0-130-170 kubenswrapper[2565]: I0611 18:28:01.576097 2565 flags.go:64] FLAG: --image-credential-provider-config="/etc/kubernetes/credential-providers/ecr-credential-provider.yaml" Jun 11 18:28:01.582447 ip-10-0-130-170 kubenswrapper[2565]: I0611 18:28:01.576100 2565 flags.go:64] FLAG: --image-gc-high-threshold="85" Jun 11 18:28:01.582447 ip-10-0-130-170 kubenswrapper[2565]: I0611 18:28:01.576103 2565 flags.go:64] FLAG: --image-gc-low-threshold="80" Jun 11 18:28:01.582447 ip-10-0-130-170 kubenswrapper[2565]: I0611 18:28:01.576105 2565 flags.go:64] FLAG: --image-service-endpoint="" Jun 11 18:28:01.582447 ip-10-0-130-170 kubenswrapper[2565]: I0611 18:28:01.576108 2565 flags.go:64] FLAG: --kernel-memcg-notification="false" Jun 11 18:28:01.582447 ip-10-0-130-170 kubenswrapper[2565]: I0611 18:28:01.576111 2565 flags.go:64] FLAG: --kube-api-burst="100" Jun 11 18:28:01.582447 ip-10-0-130-170 kubenswrapper[2565]: I0611 18:28:01.576114 2565 flags.go:64] FLAG: --kube-api-content-type="application/vnd.kubernetes.protobuf" Jun 11 18:28:01.583024 ip-10-0-130-170 kubenswrapper[2565]: I0611 18:28:01.576116 2565 flags.go:64] FLAG: --kube-api-qps="50" Jun 11 18:28:01.583024 ip-10-0-130-170 kubenswrapper[2565]: I0611 18:28:01.576120 2565 flags.go:64] FLAG: --kube-reserved="" Jun 11 18:28:01.583024 ip-10-0-130-170 kubenswrapper[2565]: I0611 18:28:01.576122 2565 flags.go:64] FLAG: --kube-reserved-cgroup="" Jun 11 18:28:01.583024 ip-10-0-130-170 kubenswrapper[2565]: I0611 18:28:01.576125 2565 flags.go:64] FLAG: --kubeconfig="/var/lib/kubelet/kubeconfig" Jun 11 18:28:01.583024 ip-10-0-130-170 kubenswrapper[2565]: I0611 18:28:01.576128 2565 flags.go:64] FLAG: --kubelet-cgroups="" Jun 11 18:28:01.583024 ip-10-0-130-170 kubenswrapper[2565]: I0611 18:28:01.576131 2565 flags.go:64] FLAG: --local-storage-capacity-isolation="true" Jun 11 18:28:01.583024 ip-10-0-130-170 kubenswrapper[2565]: I0611 18:28:01.576133 2565 flags.go:64] FLAG: --lock-file="" Jun 11 18:28:01.583024 ip-10-0-130-170 kubenswrapper[2565]: I0611 18:28:01.576138 2565 flags.go:64] FLAG: --log-cadvisor-usage="false" Jun 11 18:28:01.583024 ip-10-0-130-170 kubenswrapper[2565]: I0611 18:28:01.576142 2565 flags.go:64] FLAG: --log-flush-frequency="5s" Jun 11 18:28:01.583024 ip-10-0-130-170 kubenswrapper[2565]: I0611 18:28:01.576144 2565 flags.go:64] FLAG: --log-json-info-buffer-size="0" Jun 11 18:28:01.583024 ip-10-0-130-170 kubenswrapper[2565]: I0611 18:28:01.576149 2565 flags.go:64] FLAG: --log-json-split-stream="false" Jun 11 18:28:01.583024 ip-10-0-130-170 kubenswrapper[2565]: I0611 18:28:01.576152 2565 flags.go:64] FLAG: --log-text-info-buffer-size="0" Jun 11 18:28:01.583024 ip-10-0-130-170 kubenswrapper[2565]: I0611 18:28:01.576155 2565 flags.go:64] FLAG: --log-text-split-stream="false" Jun 11 18:28:01.583024 ip-10-0-130-170 kubenswrapper[2565]: I0611 18:28:01.576158 2565 flags.go:64] FLAG: --logging-format="text" Jun 11 18:28:01.583024 ip-10-0-130-170 kubenswrapper[2565]: I0611 18:28:01.576160 2565 flags.go:64] FLAG: --machine-id-file="/etc/machine-id,/var/lib/dbus/machine-id" Jun 11 18:28:01.583024 ip-10-0-130-170 kubenswrapper[2565]: I0611 18:28:01.576164 2565 flags.go:64] FLAG: --make-iptables-util-chains="true" Jun 11 18:28:01.583024 ip-10-0-130-170 kubenswrapper[2565]: I0611 18:28:01.576167 2565 flags.go:64] FLAG: --manifest-url="" Jun 11 18:28:01.583024 ip-10-0-130-170 kubenswrapper[2565]: I0611 18:28:01.576169 2565 flags.go:64] FLAG: --manifest-url-header="" Jun 11 18:28:01.583024 ip-10-0-130-170 kubenswrapper[2565]: I0611 18:28:01.576174 2565 flags.go:64] FLAG: --max-housekeeping-interval="15s" Jun 11 18:28:01.583024 ip-10-0-130-170 kubenswrapper[2565]: I0611 18:28:01.576176 2565 flags.go:64] FLAG: --max-open-files="1000000" Jun 11 18:28:01.583024 ip-10-0-130-170 kubenswrapper[2565]: I0611 18:28:01.576180 2565 flags.go:64] FLAG: --max-pods="110" Jun 11 18:28:01.583024 ip-10-0-130-170 kubenswrapper[2565]: I0611 18:28:01.576183 2565 flags.go:64] FLAG: --maximum-dead-containers="-1" Jun 11 18:28:01.583024 ip-10-0-130-170 kubenswrapper[2565]: I0611 18:28:01.576186 2565 flags.go:64] FLAG: --maximum-dead-containers-per-container="1" Jun 11 18:28:01.583024 ip-10-0-130-170 kubenswrapper[2565]: I0611 18:28:01.576189 2565 flags.go:64] FLAG: --memory-manager-policy="None" Jun 11 18:28:01.583024 ip-10-0-130-170 kubenswrapper[2565]: I0611 18:28:01.576191 2565 flags.go:64] FLAG: --minimum-container-ttl-duration="6m0s" Jun 11 18:28:01.583697 ip-10-0-130-170 kubenswrapper[2565]: I0611 18:28:01.576194 2565 flags.go:64] FLAG: --minimum-image-ttl-duration="2m0s" Jun 11 18:28:01.583697 ip-10-0-130-170 kubenswrapper[2565]: I0611 18:28:01.576197 2565 flags.go:64] FLAG: --node-ip="0.0.0.0" Jun 11 18:28:01.583697 ip-10-0-130-170 kubenswrapper[2565]: I0611 18:28:01.576200 2565 flags.go:64] FLAG: --node-labels="node-role.kubernetes.io/worker=,node.openshift.io/os_id=rhel" Jun 11 18:28:01.583697 ip-10-0-130-170 kubenswrapper[2565]: I0611 18:28:01.576207 2565 flags.go:64] FLAG: --node-status-max-images="50" Jun 11 18:28:01.583697 ip-10-0-130-170 kubenswrapper[2565]: I0611 18:28:01.576210 2565 flags.go:64] FLAG: --node-status-update-frequency="10s" Jun 11 18:28:01.583697 ip-10-0-130-170 kubenswrapper[2565]: I0611 18:28:01.576213 2565 flags.go:64] FLAG: --oom-score-adj="-999" Jun 11 18:28:01.583697 ip-10-0-130-170 kubenswrapper[2565]: I0611 18:28:01.576216 2565 flags.go:64] FLAG: --pod-cidr="" Jun 11 18:28:01.583697 ip-10-0-130-170 kubenswrapper[2565]: I0611 18:28:01.576218 2565 flags.go:64] FLAG: --pod-infra-container-image="quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:4a2e90c8ef7d783e4d635e24fb09435f5e1f6e954583512c0944f9e57bc77b52" Jun 11 18:28:01.583697 ip-10-0-130-170 kubenswrapper[2565]: I0611 18:28:01.576225 2565 flags.go:64] FLAG: --pod-manifest-path="" Jun 11 18:28:01.583697 ip-10-0-130-170 kubenswrapper[2565]: I0611 18:28:01.576228 2565 flags.go:64] FLAG: --pod-max-pids="-1" Jun 11 18:28:01.583697 ip-10-0-130-170 kubenswrapper[2565]: I0611 18:28:01.576231 2565 flags.go:64] FLAG: --pods-per-core="0" Jun 11 18:28:01.583697 ip-10-0-130-170 kubenswrapper[2565]: I0611 18:28:01.576234 2565 flags.go:64] FLAG: --port="10250" Jun 11 18:28:01.583697 ip-10-0-130-170 kubenswrapper[2565]: I0611 18:28:01.576237 2565 flags.go:64] FLAG: --protect-kernel-defaults="false" Jun 11 18:28:01.583697 ip-10-0-130-170 kubenswrapper[2565]: I0611 18:28:01.576240 2565 flags.go:64] FLAG: --provider-id="aws:///us-east-1a/i-01f1d0b2fc9c1705d" Jun 11 18:28:01.583697 ip-10-0-130-170 kubenswrapper[2565]: I0611 18:28:01.576243 2565 flags.go:64] FLAG: --qos-reserved="" Jun 11 18:28:01.583697 ip-10-0-130-170 kubenswrapper[2565]: I0611 18:28:01.576249 2565 flags.go:64] FLAG: --read-only-port="10255" Jun 11 18:28:01.583697 ip-10-0-130-170 kubenswrapper[2565]: I0611 18:28:01.576267 2565 flags.go:64] FLAG: --register-node="true" Jun 11 18:28:01.583697 ip-10-0-130-170 kubenswrapper[2565]: I0611 18:28:01.576270 2565 flags.go:64] FLAG: --register-with-taints="" Jun 11 18:28:01.583697 ip-10-0-130-170 kubenswrapper[2565]: I0611 18:28:01.576274 2565 flags.go:64] FLAG: --registry-burst="10" Jun 11 18:28:01.583697 ip-10-0-130-170 kubenswrapper[2565]: I0611 18:28:01.576277 2565 flags.go:64] FLAG: --registry-qps="5" Jun 11 18:28:01.583697 ip-10-0-130-170 kubenswrapper[2565]: I0611 18:28:01.576280 2565 flags.go:64] FLAG: --reserved-cpus="" Jun 11 18:28:01.583697 ip-10-0-130-170 kubenswrapper[2565]: I0611 18:28:01.576282 2565 flags.go:64] FLAG: --reserved-memory="" Jun 11 18:28:01.583697 ip-10-0-130-170 kubenswrapper[2565]: I0611 18:28:01.576286 2565 flags.go:64] FLAG: --resolv-conf="/etc/resolv.conf" Jun 11 18:28:01.583697 ip-10-0-130-170 kubenswrapper[2565]: I0611 18:28:01.576289 2565 flags.go:64] FLAG: --root-dir="/var/lib/kubelet" Jun 11 18:28:01.583697 ip-10-0-130-170 kubenswrapper[2565]: I0611 18:28:01.576292 2565 flags.go:64] FLAG: --rotate-certificates="false" Jun 11 18:28:01.584306 ip-10-0-130-170 kubenswrapper[2565]: I0611 18:28:01.576295 2565 flags.go:64] FLAG: --rotate-server-certificates="false" Jun 11 18:28:01.584306 ip-10-0-130-170 kubenswrapper[2565]: I0611 18:28:01.576298 2565 flags.go:64] FLAG: --runonce="false" Jun 11 18:28:01.584306 ip-10-0-130-170 kubenswrapper[2565]: I0611 18:28:01.576301 2565 flags.go:64] FLAG: --runtime-cgroups="/system.slice/crio.service" Jun 11 18:28:01.584306 ip-10-0-130-170 kubenswrapper[2565]: I0611 18:28:01.576304 2565 flags.go:64] FLAG: --runtime-request-timeout="2m0s" Jun 11 18:28:01.584306 ip-10-0-130-170 kubenswrapper[2565]: I0611 18:28:01.576307 2565 flags.go:64] FLAG: --seccomp-default="false" Jun 11 18:28:01.584306 ip-10-0-130-170 kubenswrapper[2565]: I0611 18:28:01.576310 2565 flags.go:64] FLAG: --serialize-image-pulls="true" Jun 11 18:28:01.584306 ip-10-0-130-170 kubenswrapper[2565]: I0611 18:28:01.576313 2565 flags.go:64] FLAG: --storage-driver-buffer-duration="1m0s" Jun 11 18:28:01.584306 ip-10-0-130-170 kubenswrapper[2565]: I0611 18:28:01.576316 2565 flags.go:64] FLAG: --storage-driver-db="cadvisor" Jun 11 18:28:01.584306 ip-10-0-130-170 kubenswrapper[2565]: I0611 18:28:01.576319 2565 flags.go:64] FLAG: --storage-driver-host="localhost:8086" Jun 11 18:28:01.584306 ip-10-0-130-170 kubenswrapper[2565]: I0611 18:28:01.576322 2565 flags.go:64] FLAG: --storage-driver-password="root" Jun 11 18:28:01.584306 ip-10-0-130-170 kubenswrapper[2565]: I0611 18:28:01.576324 2565 flags.go:64] FLAG: --storage-driver-secure="false" Jun 11 18:28:01.584306 ip-10-0-130-170 kubenswrapper[2565]: I0611 18:28:01.576327 2565 flags.go:64] FLAG: --storage-driver-table="stats" Jun 11 18:28:01.584306 ip-10-0-130-170 kubenswrapper[2565]: I0611 18:28:01.576330 2565 flags.go:64] FLAG: --storage-driver-user="root" Jun 11 18:28:01.584306 ip-10-0-130-170 kubenswrapper[2565]: I0611 18:28:01.576333 2565 flags.go:64] FLAG: --streaming-connection-idle-timeout="4h0m0s" Jun 11 18:28:01.584306 ip-10-0-130-170 kubenswrapper[2565]: I0611 18:28:01.576336 2565 flags.go:64] FLAG: --sync-frequency="1m0s" Jun 11 18:28:01.584306 ip-10-0-130-170 kubenswrapper[2565]: I0611 18:28:01.576339 2565 flags.go:64] FLAG: --system-cgroups="" Jun 11 18:28:01.584306 ip-10-0-130-170 kubenswrapper[2565]: I0611 18:28:01.576341 2565 flags.go:64] FLAG: --system-reserved="cpu=500m,ephemeral-storage=1Gi,memory=1Gi" Jun 11 18:28:01.584306 ip-10-0-130-170 kubenswrapper[2565]: I0611 18:28:01.576347 2565 flags.go:64] FLAG: --system-reserved-cgroup="" Jun 11 18:28:01.584306 ip-10-0-130-170 kubenswrapper[2565]: I0611 18:28:01.576349 2565 flags.go:64] FLAG: --tls-cert-file="" Jun 11 18:28:01.584306 ip-10-0-130-170 kubenswrapper[2565]: I0611 18:28:01.576352 2565 flags.go:64] FLAG: --tls-cipher-suites="[]" Jun 11 18:28:01.584306 ip-10-0-130-170 kubenswrapper[2565]: I0611 18:28:01.576357 2565 flags.go:64] FLAG: --tls-min-version="" Jun 11 18:28:01.584306 ip-10-0-130-170 kubenswrapper[2565]: I0611 18:28:01.576359 2565 flags.go:64] FLAG: --tls-private-key-file="" Jun 11 18:28:01.584306 ip-10-0-130-170 kubenswrapper[2565]: I0611 18:28:01.576365 2565 flags.go:64] FLAG: --topology-manager-policy="none" Jun 11 18:28:01.584306 ip-10-0-130-170 kubenswrapper[2565]: I0611 18:28:01.576370 2565 flags.go:64] FLAG: --topology-manager-policy-options="" Jun 11 18:28:01.584306 ip-10-0-130-170 kubenswrapper[2565]: I0611 18:28:01.576373 2565 flags.go:64] FLAG: --topology-manager-scope="container" Jun 11 18:28:01.584988 ip-10-0-130-170 kubenswrapper[2565]: I0611 18:28:01.576376 2565 flags.go:64] FLAG: --v="2" Jun 11 18:28:01.584988 ip-10-0-130-170 kubenswrapper[2565]: I0611 18:28:01.576380 2565 flags.go:64] FLAG: --version="false" Jun 11 18:28:01.584988 ip-10-0-130-170 kubenswrapper[2565]: I0611 18:28:01.576384 2565 flags.go:64] FLAG: --vmodule="" Jun 11 18:28:01.584988 ip-10-0-130-170 kubenswrapper[2565]: I0611 18:28:01.576388 2565 flags.go:64] FLAG: --volume-plugin-dir="/etc/kubernetes/kubelet-plugins/volume/exec" Jun 11 18:28:01.584988 ip-10-0-130-170 kubenswrapper[2565]: I0611 18:28:01.576391 2565 flags.go:64] FLAG: --volume-stats-agg-period="1m0s" Jun 11 18:28:01.584988 ip-10-0-130-170 kubenswrapper[2565]: W0611 18:28:01.576519 2565 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jun 11 18:28:01.584988 ip-10-0-130-170 kubenswrapper[2565]: W0611 18:28:01.576523 2565 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jun 11 18:28:01.584988 ip-10-0-130-170 kubenswrapper[2565]: W0611 18:28:01.576527 2565 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jun 11 18:28:01.584988 ip-10-0-130-170 kubenswrapper[2565]: W0611 18:28:01.576530 2565 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jun 11 18:28:01.584988 ip-10-0-130-170 kubenswrapper[2565]: W0611 18:28:01.576533 2565 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jun 11 18:28:01.584988 ip-10-0-130-170 kubenswrapper[2565]: W0611 18:28:01.576535 2565 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jun 11 18:28:01.584988 ip-10-0-130-170 kubenswrapper[2565]: W0611 18:28:01.576538 2565 feature_gate.go:328] unrecognized feature gate: Example2 Jun 11 18:28:01.584988 ip-10-0-130-170 kubenswrapper[2565]: W0611 18:28:01.576540 2565 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jun 11 18:28:01.584988 ip-10-0-130-170 kubenswrapper[2565]: W0611 18:28:01.576542 2565 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jun 11 18:28:01.584988 ip-10-0-130-170 kubenswrapper[2565]: W0611 18:28:01.576545 2565 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jun 11 18:28:01.584988 ip-10-0-130-170 kubenswrapper[2565]: W0611 18:28:01.576548 2565 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jun 11 18:28:01.584988 ip-10-0-130-170 kubenswrapper[2565]: W0611 18:28:01.576552 2565 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jun 11 18:28:01.584988 ip-10-0-130-170 kubenswrapper[2565]: W0611 18:28:01.576554 2565 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jun 11 18:28:01.584988 ip-10-0-130-170 kubenswrapper[2565]: W0611 18:28:01.576557 2565 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jun 11 18:28:01.584988 ip-10-0-130-170 kubenswrapper[2565]: W0611 18:28:01.576559 2565 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jun 11 18:28:01.584988 ip-10-0-130-170 kubenswrapper[2565]: W0611 18:28:01.576562 2565 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jun 11 18:28:01.585546 ip-10-0-130-170 kubenswrapper[2565]: W0611 18:28:01.576564 2565 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jun 11 18:28:01.585546 ip-10-0-130-170 kubenswrapper[2565]: W0611 18:28:01.576567 2565 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jun 11 18:28:01.585546 ip-10-0-130-170 kubenswrapper[2565]: W0611 18:28:01.576569 2565 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jun 11 18:28:01.585546 ip-10-0-130-170 kubenswrapper[2565]: W0611 18:28:01.576571 2565 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jun 11 18:28:01.585546 ip-10-0-130-170 kubenswrapper[2565]: W0611 18:28:01.576574 2565 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jun 11 18:28:01.585546 ip-10-0-130-170 kubenswrapper[2565]: W0611 18:28:01.576577 2565 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jun 11 18:28:01.585546 ip-10-0-130-170 kubenswrapper[2565]: W0611 18:28:01.576579 2565 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jun 11 18:28:01.585546 ip-10-0-130-170 kubenswrapper[2565]: W0611 18:28:01.576582 2565 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jun 11 18:28:01.585546 ip-10-0-130-170 kubenswrapper[2565]: W0611 18:28:01.576587 2565 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jun 11 18:28:01.585546 ip-10-0-130-170 kubenswrapper[2565]: W0611 18:28:01.576590 2565 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jun 11 18:28:01.585546 ip-10-0-130-170 kubenswrapper[2565]: W0611 18:28:01.576594 2565 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jun 11 18:28:01.585546 ip-10-0-130-170 kubenswrapper[2565]: W0611 18:28:01.576596 2565 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jun 11 18:28:01.585546 ip-10-0-130-170 kubenswrapper[2565]: W0611 18:28:01.576599 2565 feature_gate.go:328] unrecognized feature gate: EventTTL Jun 11 18:28:01.585546 ip-10-0-130-170 kubenswrapper[2565]: W0611 18:28:01.576601 2565 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jun 11 18:28:01.585546 ip-10-0-130-170 kubenswrapper[2565]: W0611 18:28:01.576604 2565 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jun 11 18:28:01.585546 ip-10-0-130-170 kubenswrapper[2565]: W0611 18:28:01.576606 2565 feature_gate.go:328] unrecognized feature gate: OVNObservability Jun 11 18:28:01.585546 ip-10-0-130-170 kubenswrapper[2565]: W0611 18:28:01.576609 2565 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jun 11 18:28:01.585546 ip-10-0-130-170 kubenswrapper[2565]: W0611 18:28:01.576611 2565 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jun 11 18:28:01.585546 ip-10-0-130-170 kubenswrapper[2565]: W0611 18:28:01.576614 2565 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jun 11 18:28:01.585546 ip-10-0-130-170 kubenswrapper[2565]: W0611 18:28:01.576616 2565 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jun 11 18:28:01.586034 ip-10-0-130-170 kubenswrapper[2565]: W0611 18:28:01.576618 2565 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jun 11 18:28:01.586034 ip-10-0-130-170 kubenswrapper[2565]: W0611 18:28:01.576621 2565 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jun 11 18:28:01.586034 ip-10-0-130-170 kubenswrapper[2565]: W0611 18:28:01.576623 2565 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jun 11 18:28:01.586034 ip-10-0-130-170 kubenswrapper[2565]: W0611 18:28:01.576626 2565 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jun 11 18:28:01.586034 ip-10-0-130-170 kubenswrapper[2565]: W0611 18:28:01.576629 2565 feature_gate.go:328] unrecognized feature gate: NewOLM Jun 11 18:28:01.586034 ip-10-0-130-170 kubenswrapper[2565]: W0611 18:28:01.576631 2565 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jun 11 18:28:01.586034 ip-10-0-130-170 kubenswrapper[2565]: W0611 18:28:01.576634 2565 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jun 11 18:28:01.586034 ip-10-0-130-170 kubenswrapper[2565]: W0611 18:28:01.576636 2565 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jun 11 18:28:01.586034 ip-10-0-130-170 kubenswrapper[2565]: W0611 18:28:01.576639 2565 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jun 11 18:28:01.586034 ip-10-0-130-170 kubenswrapper[2565]: W0611 18:28:01.576641 2565 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jun 11 18:28:01.586034 ip-10-0-130-170 kubenswrapper[2565]: W0611 18:28:01.576644 2565 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jun 11 18:28:01.586034 ip-10-0-130-170 kubenswrapper[2565]: W0611 18:28:01.576647 2565 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jun 11 18:28:01.586034 ip-10-0-130-170 kubenswrapper[2565]: W0611 18:28:01.576649 2565 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jun 11 18:28:01.586034 ip-10-0-130-170 kubenswrapper[2565]: W0611 18:28:01.576652 2565 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jun 11 18:28:01.586034 ip-10-0-130-170 kubenswrapper[2565]: W0611 18:28:01.576654 2565 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jun 11 18:28:01.586034 ip-10-0-130-170 kubenswrapper[2565]: W0611 18:28:01.576657 2565 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jun 11 18:28:01.586034 ip-10-0-130-170 kubenswrapper[2565]: W0611 18:28:01.576660 2565 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jun 11 18:28:01.586034 ip-10-0-130-170 kubenswrapper[2565]: W0611 18:28:01.576664 2565 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jun 11 18:28:01.586034 ip-10-0-130-170 kubenswrapper[2565]: W0611 18:28:01.576667 2565 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jun 11 18:28:01.586515 ip-10-0-130-170 kubenswrapper[2565]: W0611 18:28:01.576670 2565 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jun 11 18:28:01.586515 ip-10-0-130-170 kubenswrapper[2565]: W0611 18:28:01.576676 2565 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jun 11 18:28:01.586515 ip-10-0-130-170 kubenswrapper[2565]: W0611 18:28:01.576678 2565 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jun 11 18:28:01.586515 ip-10-0-130-170 kubenswrapper[2565]: W0611 18:28:01.576681 2565 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jun 11 18:28:01.586515 ip-10-0-130-170 kubenswrapper[2565]: W0611 18:28:01.576685 2565 feature_gate.go:328] unrecognized feature gate: OSStreams Jun 11 18:28:01.586515 ip-10-0-130-170 kubenswrapper[2565]: W0611 18:28:01.576688 2565 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jun 11 18:28:01.586515 ip-10-0-130-170 kubenswrapper[2565]: W0611 18:28:01.576690 2565 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jun 11 18:28:01.586515 ip-10-0-130-170 kubenswrapper[2565]: W0611 18:28:01.576693 2565 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jun 11 18:28:01.586515 ip-10-0-130-170 kubenswrapper[2565]: W0611 18:28:01.576695 2565 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jun 11 18:28:01.586515 ip-10-0-130-170 kubenswrapper[2565]: W0611 18:28:01.576697 2565 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jun 11 18:28:01.586515 ip-10-0-130-170 kubenswrapper[2565]: W0611 18:28:01.576700 2565 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jun 11 18:28:01.586515 ip-10-0-130-170 kubenswrapper[2565]: W0611 18:28:01.576702 2565 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jun 11 18:28:01.586515 ip-10-0-130-170 kubenswrapper[2565]: W0611 18:28:01.576705 2565 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jun 11 18:28:01.586515 ip-10-0-130-170 kubenswrapper[2565]: W0611 18:28:01.576707 2565 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jun 11 18:28:01.586515 ip-10-0-130-170 kubenswrapper[2565]: W0611 18:28:01.576710 2565 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jun 11 18:28:01.586515 ip-10-0-130-170 kubenswrapper[2565]: W0611 18:28:01.576712 2565 feature_gate.go:328] unrecognized feature gate: DualReplica Jun 11 18:28:01.586515 ip-10-0-130-170 kubenswrapper[2565]: W0611 18:28:01.576715 2565 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jun 11 18:28:01.586515 ip-10-0-130-170 kubenswrapper[2565]: W0611 18:28:01.576717 2565 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jun 11 18:28:01.586515 ip-10-0-130-170 kubenswrapper[2565]: W0611 18:28:01.576720 2565 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jun 11 18:28:01.586515 ip-10-0-130-170 kubenswrapper[2565]: W0611 18:28:01.576723 2565 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jun 11 18:28:01.587003 ip-10-0-130-170 kubenswrapper[2565]: W0611 18:28:01.576727 2565 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jun 11 18:28:01.587003 ip-10-0-130-170 kubenswrapper[2565]: W0611 18:28:01.576730 2565 feature_gate.go:328] unrecognized feature gate: Example Jun 11 18:28:01.587003 ip-10-0-130-170 kubenswrapper[2565]: W0611 18:28:01.576734 2565 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jun 11 18:28:01.587003 ip-10-0-130-170 kubenswrapper[2565]: W0611 18:28:01.576736 2565 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jun 11 18:28:01.587003 ip-10-0-130-170 kubenswrapper[2565]: W0611 18:28:01.576739 2565 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jun 11 18:28:01.587003 ip-10-0-130-170 kubenswrapper[2565]: W0611 18:28:01.576742 2565 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jun 11 18:28:01.587003 ip-10-0-130-170 kubenswrapper[2565]: W0611 18:28:01.576744 2565 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jun 11 18:28:01.587003 ip-10-0-130-170 kubenswrapper[2565]: W0611 18:28:01.576747 2565 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jun 11 18:28:01.587003 ip-10-0-130-170 kubenswrapper[2565]: W0611 18:28:01.576750 2565 feature_gate.go:328] unrecognized feature gate: PinnedImages Jun 11 18:28:01.587003 ip-10-0-130-170 kubenswrapper[2565]: W0611 18:28:01.576752 2565 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jun 11 18:28:01.587003 ip-10-0-130-170 kubenswrapper[2565]: W0611 18:28:01.576754 2565 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jun 11 18:28:01.587003 ip-10-0-130-170 kubenswrapper[2565]: W0611 18:28:01.576757 2565 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jun 11 18:28:01.587003 ip-10-0-130-170 kubenswrapper[2565]: W0611 18:28:01.576760 2565 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jun 11 18:28:01.587003 ip-10-0-130-170 kubenswrapper[2565]: W0611 18:28:01.576765 2565 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jun 11 18:28:01.587003 ip-10-0-130-170 kubenswrapper[2565]: W0611 18:28:01.576768 2565 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jun 11 18:28:01.587003 ip-10-0-130-170 kubenswrapper[2565]: W0611 18:28:01.576771 2565 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jun 11 18:28:01.587003 ip-10-0-130-170 kubenswrapper[2565]: W0611 18:28:01.576773 2565 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jun 11 18:28:01.587003 ip-10-0-130-170 kubenswrapper[2565]: W0611 18:28:01.576781 2565 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jun 11 18:28:01.587003 ip-10-0-130-170 kubenswrapper[2565]: W0611 18:28:01.576784 2565 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jun 11 18:28:01.587003 ip-10-0-130-170 kubenswrapper[2565]: W0611 18:28:01.576787 2565 feature_gate.go:328] unrecognized feature gate: SignatureStores Jun 11 18:28:01.587514 ip-10-0-130-170 kubenswrapper[2565]: W0611 18:28:01.576789 2565 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jun 11 18:28:01.587514 ip-10-0-130-170 kubenswrapper[2565]: W0611 18:28:01.576792 2565 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jun 11 18:28:01.587514 ip-10-0-130-170 kubenswrapper[2565]: W0611 18:28:01.576794 2565 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jun 11 18:28:01.587514 ip-10-0-130-170 kubenswrapper[2565]: W0611 18:28:01.576797 2565 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jun 11 18:28:01.587514 ip-10-0-130-170 kubenswrapper[2565]: I0611 18:28:01.576802 2565 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]} Jun 11 18:28:01.587514 ip-10-0-130-170 kubenswrapper[2565]: I0611 18:28:01.583954 2565 server.go:529] "Kubelet version" kubeletVersion="v1.34.8" Jun 11 18:28:01.587514 ip-10-0-130-170 kubenswrapper[2565]: I0611 18:28:01.584083 2565 server.go:531] "Golang settings" GOGC="" GOMAXPROCS="" GOTRACEBACK="" Jun 11 18:28:01.587514 ip-10-0-130-170 kubenswrapper[2565]: I0611 18:28:01.584104 2565 watchdog_linux.go:95] "Systemd watchdog is not enabled" Jun 11 18:28:01.587514 ip-10-0-130-170 kubenswrapper[2565]: I0611 18:28:01.584114 2565 watchdog_linux.go:137] "Systemd watchdog is not enabled or the interval is invalid, so health checking will not be started." Jun 11 18:28:01.587514 ip-10-0-130-170 kubenswrapper[2565]: W0611 18:28:01.584173 2565 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jun 11 18:28:01.587514 ip-10-0-130-170 kubenswrapper[2565]: W0611 18:28:01.584178 2565 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jun 11 18:28:01.587514 ip-10-0-130-170 kubenswrapper[2565]: W0611 18:28:01.584181 2565 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jun 11 18:28:01.587514 ip-10-0-130-170 kubenswrapper[2565]: W0611 18:28:01.584184 2565 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jun 11 18:28:01.587514 ip-10-0-130-170 kubenswrapper[2565]: W0611 18:28:01.584187 2565 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jun 11 18:28:01.587514 ip-10-0-130-170 kubenswrapper[2565]: W0611 18:28:01.584190 2565 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jun 11 18:28:01.587903 ip-10-0-130-170 kubenswrapper[2565]: W0611 18:28:01.584193 2565 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jun 11 18:28:01.587903 ip-10-0-130-170 kubenswrapper[2565]: W0611 18:28:01.584196 2565 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jun 11 18:28:01.587903 ip-10-0-130-170 kubenswrapper[2565]: W0611 18:28:01.584200 2565 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jun 11 18:28:01.587903 ip-10-0-130-170 kubenswrapper[2565]: W0611 18:28:01.584202 2565 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jun 11 18:28:01.587903 ip-10-0-130-170 kubenswrapper[2565]: W0611 18:28:01.584205 2565 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jun 11 18:28:01.587903 ip-10-0-130-170 kubenswrapper[2565]: W0611 18:28:01.584208 2565 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jun 11 18:28:01.587903 ip-10-0-130-170 kubenswrapper[2565]: W0611 18:28:01.584210 2565 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jun 11 18:28:01.587903 ip-10-0-130-170 kubenswrapper[2565]: W0611 18:28:01.584212 2565 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jun 11 18:28:01.587903 ip-10-0-130-170 kubenswrapper[2565]: W0611 18:28:01.584215 2565 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jun 11 18:28:01.587903 ip-10-0-130-170 kubenswrapper[2565]: W0611 18:28:01.584218 2565 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jun 11 18:28:01.587903 ip-10-0-130-170 kubenswrapper[2565]: W0611 18:28:01.584221 2565 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jun 11 18:28:01.587903 ip-10-0-130-170 kubenswrapper[2565]: W0611 18:28:01.584223 2565 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jun 11 18:28:01.587903 ip-10-0-130-170 kubenswrapper[2565]: W0611 18:28:01.584226 2565 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jun 11 18:28:01.587903 ip-10-0-130-170 kubenswrapper[2565]: W0611 18:28:01.584228 2565 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jun 11 18:28:01.587903 ip-10-0-130-170 kubenswrapper[2565]: W0611 18:28:01.584231 2565 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jun 11 18:28:01.587903 ip-10-0-130-170 kubenswrapper[2565]: W0611 18:28:01.584233 2565 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jun 11 18:28:01.587903 ip-10-0-130-170 kubenswrapper[2565]: W0611 18:28:01.584236 2565 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jun 11 18:28:01.587903 ip-10-0-130-170 kubenswrapper[2565]: W0611 18:28:01.584238 2565 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jun 11 18:28:01.587903 ip-10-0-130-170 kubenswrapper[2565]: W0611 18:28:01.584241 2565 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jun 11 18:28:01.587903 ip-10-0-130-170 kubenswrapper[2565]: W0611 18:28:01.584243 2565 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jun 11 18:28:01.588438 ip-10-0-130-170 kubenswrapper[2565]: W0611 18:28:01.584246 2565 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jun 11 18:28:01.588438 ip-10-0-130-170 kubenswrapper[2565]: W0611 18:28:01.584248 2565 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jun 11 18:28:01.588438 ip-10-0-130-170 kubenswrapper[2565]: W0611 18:28:01.584269 2565 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jun 11 18:28:01.588438 ip-10-0-130-170 kubenswrapper[2565]: W0611 18:28:01.584274 2565 feature_gate.go:328] unrecognized feature gate: Example Jun 11 18:28:01.588438 ip-10-0-130-170 kubenswrapper[2565]: W0611 18:28:01.584277 2565 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jun 11 18:28:01.588438 ip-10-0-130-170 kubenswrapper[2565]: W0611 18:28:01.584280 2565 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jun 11 18:28:01.588438 ip-10-0-130-170 kubenswrapper[2565]: W0611 18:28:01.584282 2565 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jun 11 18:28:01.588438 ip-10-0-130-170 kubenswrapper[2565]: W0611 18:28:01.584285 2565 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jun 11 18:28:01.588438 ip-10-0-130-170 kubenswrapper[2565]: W0611 18:28:01.584288 2565 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jun 11 18:28:01.588438 ip-10-0-130-170 kubenswrapper[2565]: W0611 18:28:01.584291 2565 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jun 11 18:28:01.588438 ip-10-0-130-170 kubenswrapper[2565]: W0611 18:28:01.584293 2565 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jun 11 18:28:01.588438 ip-10-0-130-170 kubenswrapper[2565]: W0611 18:28:01.584295 2565 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jun 11 18:28:01.588438 ip-10-0-130-170 kubenswrapper[2565]: W0611 18:28:01.584298 2565 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jun 11 18:28:01.588438 ip-10-0-130-170 kubenswrapper[2565]: W0611 18:28:01.584301 2565 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jun 11 18:28:01.588438 ip-10-0-130-170 kubenswrapper[2565]: W0611 18:28:01.584303 2565 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jun 11 18:28:01.588438 ip-10-0-130-170 kubenswrapper[2565]: W0611 18:28:01.584306 2565 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jun 11 18:28:01.588438 ip-10-0-130-170 kubenswrapper[2565]: W0611 18:28:01.584308 2565 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jun 11 18:28:01.588438 ip-10-0-130-170 kubenswrapper[2565]: W0611 18:28:01.584312 2565 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jun 11 18:28:01.588438 ip-10-0-130-170 kubenswrapper[2565]: W0611 18:28:01.584317 2565 feature_gate.go:328] unrecognized feature gate: OSStreams Jun 11 18:28:01.588438 ip-10-0-130-170 kubenswrapper[2565]: W0611 18:28:01.584319 2565 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jun 11 18:28:01.588960 ip-10-0-130-170 kubenswrapper[2565]: W0611 18:28:01.584322 2565 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jun 11 18:28:01.588960 ip-10-0-130-170 kubenswrapper[2565]: W0611 18:28:01.584325 2565 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jun 11 18:28:01.588960 ip-10-0-130-170 kubenswrapper[2565]: W0611 18:28:01.584328 2565 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jun 11 18:28:01.588960 ip-10-0-130-170 kubenswrapper[2565]: W0611 18:28:01.584330 2565 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jun 11 18:28:01.588960 ip-10-0-130-170 kubenswrapper[2565]: W0611 18:28:01.584333 2565 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jun 11 18:28:01.588960 ip-10-0-130-170 kubenswrapper[2565]: W0611 18:28:01.584336 2565 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jun 11 18:28:01.588960 ip-10-0-130-170 kubenswrapper[2565]: W0611 18:28:01.584338 2565 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jun 11 18:28:01.588960 ip-10-0-130-170 kubenswrapper[2565]: W0611 18:28:01.584341 2565 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jun 11 18:28:01.588960 ip-10-0-130-170 kubenswrapper[2565]: W0611 18:28:01.584343 2565 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jun 11 18:28:01.588960 ip-10-0-130-170 kubenswrapper[2565]: W0611 18:28:01.584346 2565 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jun 11 18:28:01.588960 ip-10-0-130-170 kubenswrapper[2565]: W0611 18:28:01.584348 2565 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jun 11 18:28:01.588960 ip-10-0-130-170 kubenswrapper[2565]: W0611 18:28:01.584351 2565 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jun 11 18:28:01.588960 ip-10-0-130-170 kubenswrapper[2565]: W0611 18:28:01.584353 2565 feature_gate.go:328] unrecognized feature gate: DualReplica Jun 11 18:28:01.588960 ip-10-0-130-170 kubenswrapper[2565]: W0611 18:28:01.584356 2565 feature_gate.go:328] unrecognized feature gate: PinnedImages Jun 11 18:28:01.588960 ip-10-0-130-170 kubenswrapper[2565]: W0611 18:28:01.584358 2565 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jun 11 18:28:01.588960 ip-10-0-130-170 kubenswrapper[2565]: W0611 18:28:01.584362 2565 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jun 11 18:28:01.588960 ip-10-0-130-170 kubenswrapper[2565]: W0611 18:28:01.584366 2565 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jun 11 18:28:01.588960 ip-10-0-130-170 kubenswrapper[2565]: W0611 18:28:01.584370 2565 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jun 11 18:28:01.588960 ip-10-0-130-170 kubenswrapper[2565]: W0611 18:28:01.584374 2565 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jun 11 18:28:01.589495 ip-10-0-130-170 kubenswrapper[2565]: W0611 18:28:01.584378 2565 feature_gate.go:328] unrecognized feature gate: OVNObservability Jun 11 18:28:01.589495 ip-10-0-130-170 kubenswrapper[2565]: W0611 18:28:01.584380 2565 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jun 11 18:28:01.589495 ip-10-0-130-170 kubenswrapper[2565]: W0611 18:28:01.584383 2565 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jun 11 18:28:01.589495 ip-10-0-130-170 kubenswrapper[2565]: W0611 18:28:01.584386 2565 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jun 11 18:28:01.589495 ip-10-0-130-170 kubenswrapper[2565]: W0611 18:28:01.584389 2565 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jun 11 18:28:01.589495 ip-10-0-130-170 kubenswrapper[2565]: W0611 18:28:01.584391 2565 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jun 11 18:28:01.589495 ip-10-0-130-170 kubenswrapper[2565]: W0611 18:28:01.584394 2565 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jun 11 18:28:01.589495 ip-10-0-130-170 kubenswrapper[2565]: W0611 18:28:01.584397 2565 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jun 11 18:28:01.589495 ip-10-0-130-170 kubenswrapper[2565]: W0611 18:28:01.584399 2565 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jun 11 18:28:01.589495 ip-10-0-130-170 kubenswrapper[2565]: W0611 18:28:01.584402 2565 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jun 11 18:28:01.589495 ip-10-0-130-170 kubenswrapper[2565]: W0611 18:28:01.584404 2565 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jun 11 18:28:01.589495 ip-10-0-130-170 kubenswrapper[2565]: W0611 18:28:01.584406 2565 feature_gate.go:328] unrecognized feature gate: SignatureStores Jun 11 18:28:01.589495 ip-10-0-130-170 kubenswrapper[2565]: W0611 18:28:01.584409 2565 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jun 11 18:28:01.589495 ip-10-0-130-170 kubenswrapper[2565]: W0611 18:28:01.584411 2565 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jun 11 18:28:01.589495 ip-10-0-130-170 kubenswrapper[2565]: W0611 18:28:01.584414 2565 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jun 11 18:28:01.589495 ip-10-0-130-170 kubenswrapper[2565]: W0611 18:28:01.584416 2565 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jun 11 18:28:01.589495 ip-10-0-130-170 kubenswrapper[2565]: W0611 18:28:01.584419 2565 feature_gate.go:328] unrecognized feature gate: Example2 Jun 11 18:28:01.589495 ip-10-0-130-170 kubenswrapper[2565]: W0611 18:28:01.584421 2565 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jun 11 18:28:01.589495 ip-10-0-130-170 kubenswrapper[2565]: W0611 18:28:01.584424 2565 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jun 11 18:28:01.589495 ip-10-0-130-170 kubenswrapper[2565]: W0611 18:28:01.584426 2565 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jun 11 18:28:01.589986 ip-10-0-130-170 kubenswrapper[2565]: W0611 18:28:01.584428 2565 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jun 11 18:28:01.589986 ip-10-0-130-170 kubenswrapper[2565]: W0611 18:28:01.584431 2565 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jun 11 18:28:01.589986 ip-10-0-130-170 kubenswrapper[2565]: W0611 18:28:01.584433 2565 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jun 11 18:28:01.589986 ip-10-0-130-170 kubenswrapper[2565]: W0611 18:28:01.584436 2565 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jun 11 18:28:01.589986 ip-10-0-130-170 kubenswrapper[2565]: W0611 18:28:01.584438 2565 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jun 11 18:28:01.589986 ip-10-0-130-170 kubenswrapper[2565]: W0611 18:28:01.584441 2565 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jun 11 18:28:01.589986 ip-10-0-130-170 kubenswrapper[2565]: W0611 18:28:01.584443 2565 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jun 11 18:28:01.589986 ip-10-0-130-170 kubenswrapper[2565]: W0611 18:28:01.584446 2565 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jun 11 18:28:01.589986 ip-10-0-130-170 kubenswrapper[2565]: W0611 18:28:01.584449 2565 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jun 11 18:28:01.589986 ip-10-0-130-170 kubenswrapper[2565]: W0611 18:28:01.584452 2565 feature_gate.go:328] unrecognized feature gate: NewOLM Jun 11 18:28:01.589986 ip-10-0-130-170 kubenswrapper[2565]: W0611 18:28:01.584455 2565 feature_gate.go:328] unrecognized feature gate: EventTTL Jun 11 18:28:01.589986 ip-10-0-130-170 kubenswrapper[2565]: W0611 18:28:01.584457 2565 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jun 11 18:28:01.589986 ip-10-0-130-170 kubenswrapper[2565]: W0611 18:28:01.584460 2565 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jun 11 18:28:01.589986 ip-10-0-130-170 kubenswrapper[2565]: W0611 18:28:01.584462 2565 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jun 11 18:28:01.589986 ip-10-0-130-170 kubenswrapper[2565]: I0611 18:28:01.584467 2565 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]} Jun 11 18:28:01.590376 ip-10-0-130-170 kubenswrapper[2565]: W0611 18:28:01.584590 2565 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jun 11 18:28:01.590376 ip-10-0-130-170 kubenswrapper[2565]: W0611 18:28:01.584596 2565 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jun 11 18:28:01.590376 ip-10-0-130-170 kubenswrapper[2565]: W0611 18:28:01.584599 2565 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jun 11 18:28:01.590376 ip-10-0-130-170 kubenswrapper[2565]: W0611 18:28:01.584602 2565 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jun 11 18:28:01.590376 ip-10-0-130-170 kubenswrapper[2565]: W0611 18:28:01.584605 2565 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jun 11 18:28:01.590376 ip-10-0-130-170 kubenswrapper[2565]: W0611 18:28:01.584608 2565 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jun 11 18:28:01.590376 ip-10-0-130-170 kubenswrapper[2565]: W0611 18:28:01.584611 2565 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jun 11 18:28:01.590376 ip-10-0-130-170 kubenswrapper[2565]: W0611 18:28:01.584614 2565 feature_gate.go:328] unrecognized feature gate: Example Jun 11 18:28:01.590376 ip-10-0-130-170 kubenswrapper[2565]: W0611 18:28:01.584617 2565 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jun 11 18:28:01.590376 ip-10-0-130-170 kubenswrapper[2565]: W0611 18:28:01.584620 2565 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jun 11 18:28:01.590376 ip-10-0-130-170 kubenswrapper[2565]: W0611 18:28:01.584622 2565 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jun 11 18:28:01.590376 ip-10-0-130-170 kubenswrapper[2565]: W0611 18:28:01.584625 2565 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jun 11 18:28:01.590376 ip-10-0-130-170 kubenswrapper[2565]: W0611 18:28:01.584628 2565 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jun 11 18:28:01.590376 ip-10-0-130-170 kubenswrapper[2565]: W0611 18:28:01.584631 2565 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jun 11 18:28:01.590376 ip-10-0-130-170 kubenswrapper[2565]: W0611 18:28:01.584633 2565 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jun 11 18:28:01.590376 ip-10-0-130-170 kubenswrapper[2565]: W0611 18:28:01.584636 2565 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jun 11 18:28:01.590376 ip-10-0-130-170 kubenswrapper[2565]: W0611 18:28:01.584638 2565 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jun 11 18:28:01.590376 ip-10-0-130-170 kubenswrapper[2565]: W0611 18:28:01.584640 2565 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jun 11 18:28:01.590376 ip-10-0-130-170 kubenswrapper[2565]: W0611 18:28:01.584643 2565 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jun 11 18:28:01.590376 ip-10-0-130-170 kubenswrapper[2565]: W0611 18:28:01.584645 2565 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jun 11 18:28:01.590877 ip-10-0-130-170 kubenswrapper[2565]: W0611 18:28:01.584648 2565 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jun 11 18:28:01.590877 ip-10-0-130-170 kubenswrapper[2565]: W0611 18:28:01.584651 2565 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jun 11 18:28:01.590877 ip-10-0-130-170 kubenswrapper[2565]: W0611 18:28:01.584653 2565 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jun 11 18:28:01.590877 ip-10-0-130-170 kubenswrapper[2565]: W0611 18:28:01.584655 2565 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jun 11 18:28:01.590877 ip-10-0-130-170 kubenswrapper[2565]: W0611 18:28:01.584658 2565 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jun 11 18:28:01.590877 ip-10-0-130-170 kubenswrapper[2565]: W0611 18:28:01.584661 2565 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jun 11 18:28:01.590877 ip-10-0-130-170 kubenswrapper[2565]: W0611 18:28:01.584664 2565 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jun 11 18:28:01.590877 ip-10-0-130-170 kubenswrapper[2565]: W0611 18:28:01.584667 2565 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jun 11 18:28:01.590877 ip-10-0-130-170 kubenswrapper[2565]: W0611 18:28:01.584672 2565 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jun 11 18:28:01.590877 ip-10-0-130-170 kubenswrapper[2565]: W0611 18:28:01.584675 2565 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jun 11 18:28:01.590877 ip-10-0-130-170 kubenswrapper[2565]: W0611 18:28:01.584678 2565 feature_gate.go:328] unrecognized feature gate: OVNObservability Jun 11 18:28:01.590877 ip-10-0-130-170 kubenswrapper[2565]: W0611 18:28:01.584681 2565 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jun 11 18:28:01.590877 ip-10-0-130-170 kubenswrapper[2565]: W0611 18:28:01.584684 2565 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jun 11 18:28:01.590877 ip-10-0-130-170 kubenswrapper[2565]: W0611 18:28:01.584686 2565 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jun 11 18:28:01.590877 ip-10-0-130-170 kubenswrapper[2565]: W0611 18:28:01.584689 2565 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jun 11 18:28:01.590877 ip-10-0-130-170 kubenswrapper[2565]: W0611 18:28:01.584691 2565 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jun 11 18:28:01.590877 ip-10-0-130-170 kubenswrapper[2565]: W0611 18:28:01.584693 2565 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jun 11 18:28:01.590877 ip-10-0-130-170 kubenswrapper[2565]: W0611 18:28:01.584696 2565 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jun 11 18:28:01.590877 ip-10-0-130-170 kubenswrapper[2565]: W0611 18:28:01.584698 2565 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jun 11 18:28:01.591354 ip-10-0-130-170 kubenswrapper[2565]: W0611 18:28:01.584701 2565 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jun 11 18:28:01.591354 ip-10-0-130-170 kubenswrapper[2565]: W0611 18:28:01.584703 2565 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jun 11 18:28:01.591354 ip-10-0-130-170 kubenswrapper[2565]: W0611 18:28:01.584705 2565 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jun 11 18:28:01.591354 ip-10-0-130-170 kubenswrapper[2565]: W0611 18:28:01.584708 2565 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jun 11 18:28:01.591354 ip-10-0-130-170 kubenswrapper[2565]: W0611 18:28:01.584710 2565 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jun 11 18:28:01.591354 ip-10-0-130-170 kubenswrapper[2565]: W0611 18:28:01.584713 2565 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jun 11 18:28:01.591354 ip-10-0-130-170 kubenswrapper[2565]: W0611 18:28:01.584715 2565 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jun 11 18:28:01.591354 ip-10-0-130-170 kubenswrapper[2565]: W0611 18:28:01.584718 2565 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jun 11 18:28:01.591354 ip-10-0-130-170 kubenswrapper[2565]: W0611 18:28:01.584720 2565 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jun 11 18:28:01.591354 ip-10-0-130-170 kubenswrapper[2565]: W0611 18:28:01.584722 2565 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jun 11 18:28:01.591354 ip-10-0-130-170 kubenswrapper[2565]: W0611 18:28:01.584725 2565 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jun 11 18:28:01.591354 ip-10-0-130-170 kubenswrapper[2565]: W0611 18:28:01.584727 2565 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jun 11 18:28:01.591354 ip-10-0-130-170 kubenswrapper[2565]: W0611 18:28:01.584730 2565 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jun 11 18:28:01.591354 ip-10-0-130-170 kubenswrapper[2565]: W0611 18:28:01.584732 2565 feature_gate.go:328] unrecognized feature gate: NewOLM Jun 11 18:28:01.591354 ip-10-0-130-170 kubenswrapper[2565]: W0611 18:28:01.584735 2565 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jun 11 18:28:01.591354 ip-10-0-130-170 kubenswrapper[2565]: W0611 18:28:01.584737 2565 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jun 11 18:28:01.591354 ip-10-0-130-170 kubenswrapper[2565]: W0611 18:28:01.584740 2565 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jun 11 18:28:01.591354 ip-10-0-130-170 kubenswrapper[2565]: W0611 18:28:01.584742 2565 feature_gate.go:328] unrecognized feature gate: OSStreams Jun 11 18:28:01.591354 ip-10-0-130-170 kubenswrapper[2565]: W0611 18:28:01.584745 2565 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jun 11 18:28:01.591354 ip-10-0-130-170 kubenswrapper[2565]: W0611 18:28:01.584749 2565 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jun 11 18:28:01.591354 ip-10-0-130-170 kubenswrapper[2565]: W0611 18:28:01.584751 2565 feature_gate.go:328] unrecognized feature gate: DualReplica Jun 11 18:28:01.591890 ip-10-0-130-170 kubenswrapper[2565]: W0611 18:28:01.584754 2565 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jun 11 18:28:01.591890 ip-10-0-130-170 kubenswrapper[2565]: W0611 18:28:01.584757 2565 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jun 11 18:28:01.591890 ip-10-0-130-170 kubenswrapper[2565]: W0611 18:28:01.584759 2565 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jun 11 18:28:01.591890 ip-10-0-130-170 kubenswrapper[2565]: W0611 18:28:01.584762 2565 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jun 11 18:28:01.591890 ip-10-0-130-170 kubenswrapper[2565]: W0611 18:28:01.584764 2565 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jun 11 18:28:01.591890 ip-10-0-130-170 kubenswrapper[2565]: W0611 18:28:01.584766 2565 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jun 11 18:28:01.591890 ip-10-0-130-170 kubenswrapper[2565]: W0611 18:28:01.584769 2565 feature_gate.go:328] unrecognized feature gate: Example2 Jun 11 18:28:01.591890 ip-10-0-130-170 kubenswrapper[2565]: W0611 18:28:01.584771 2565 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jun 11 18:28:01.591890 ip-10-0-130-170 kubenswrapper[2565]: W0611 18:28:01.584774 2565 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jun 11 18:28:01.591890 ip-10-0-130-170 kubenswrapper[2565]: W0611 18:28:01.584776 2565 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jun 11 18:28:01.591890 ip-10-0-130-170 kubenswrapper[2565]: W0611 18:28:01.584779 2565 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jun 11 18:28:01.591890 ip-10-0-130-170 kubenswrapper[2565]: W0611 18:28:01.584781 2565 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jun 11 18:28:01.591890 ip-10-0-130-170 kubenswrapper[2565]: W0611 18:28:01.584783 2565 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jun 11 18:28:01.591890 ip-10-0-130-170 kubenswrapper[2565]: W0611 18:28:01.584786 2565 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jun 11 18:28:01.591890 ip-10-0-130-170 kubenswrapper[2565]: W0611 18:28:01.584790 2565 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jun 11 18:28:01.591890 ip-10-0-130-170 kubenswrapper[2565]: W0611 18:28:01.584793 2565 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jun 11 18:28:01.591890 ip-10-0-130-170 kubenswrapper[2565]: W0611 18:28:01.584796 2565 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jun 11 18:28:01.591890 ip-10-0-130-170 kubenswrapper[2565]: W0611 18:28:01.584800 2565 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jun 11 18:28:01.591890 ip-10-0-130-170 kubenswrapper[2565]: W0611 18:28:01.584803 2565 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jun 11 18:28:01.592507 ip-10-0-130-170 kubenswrapper[2565]: W0611 18:28:01.584806 2565 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jun 11 18:28:01.592507 ip-10-0-130-170 kubenswrapper[2565]: W0611 18:28:01.584809 2565 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jun 11 18:28:01.592507 ip-10-0-130-170 kubenswrapper[2565]: W0611 18:28:01.584812 2565 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jun 11 18:28:01.592507 ip-10-0-130-170 kubenswrapper[2565]: W0611 18:28:01.584814 2565 feature_gate.go:328] unrecognized feature gate: PinnedImages Jun 11 18:28:01.592507 ip-10-0-130-170 kubenswrapper[2565]: W0611 18:28:01.584817 2565 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jun 11 18:28:01.592507 ip-10-0-130-170 kubenswrapper[2565]: W0611 18:28:01.584819 2565 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jun 11 18:28:01.592507 ip-10-0-130-170 kubenswrapper[2565]: W0611 18:28:01.584822 2565 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jun 11 18:28:01.592507 ip-10-0-130-170 kubenswrapper[2565]: W0611 18:28:01.584824 2565 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jun 11 18:28:01.592507 ip-10-0-130-170 kubenswrapper[2565]: W0611 18:28:01.584827 2565 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jun 11 18:28:01.592507 ip-10-0-130-170 kubenswrapper[2565]: W0611 18:28:01.584829 2565 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jun 11 18:28:01.592507 ip-10-0-130-170 kubenswrapper[2565]: W0611 18:28:01.584832 2565 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jun 11 18:28:01.592507 ip-10-0-130-170 kubenswrapper[2565]: W0611 18:28:01.584835 2565 feature_gate.go:328] unrecognized feature gate: EventTTL Jun 11 18:28:01.592507 ip-10-0-130-170 kubenswrapper[2565]: W0611 18:28:01.584837 2565 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jun 11 18:28:01.592507 ip-10-0-130-170 kubenswrapper[2565]: W0611 18:28:01.584840 2565 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jun 11 18:28:01.592507 ip-10-0-130-170 kubenswrapper[2565]: W0611 18:28:01.584842 2565 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jun 11 18:28:01.592507 ip-10-0-130-170 kubenswrapper[2565]: W0611 18:28:01.584845 2565 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jun 11 18:28:01.592507 ip-10-0-130-170 kubenswrapper[2565]: W0611 18:28:01.584847 2565 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jun 11 18:28:01.592507 ip-10-0-130-170 kubenswrapper[2565]: W0611 18:28:01.584850 2565 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jun 11 18:28:01.592507 ip-10-0-130-170 kubenswrapper[2565]: W0611 18:28:01.584852 2565 feature_gate.go:328] unrecognized feature gate: SignatureStores Jun 11 18:28:01.592507 ip-10-0-130-170 kubenswrapper[2565]: W0611 18:28:01.584855 2565 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jun 11 18:28:01.593038 ip-10-0-130-170 kubenswrapper[2565]: I0611 18:28:01.584860 2565 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]} Jun 11 18:28:01.593038 ip-10-0-130-170 kubenswrapper[2565]: I0611 18:28:01.584990 2565 server.go:962] "Client rotation is on, will bootstrap in background" Jun 11 18:28:01.593038 ip-10-0-130-170 kubenswrapper[2565]: I0611 18:28:01.588040 2565 bootstrap.go:101] "Use the bootstrap credentials to request a cert, and set kubeconfig to point to the certificate dir" Jun 11 18:28:01.593038 ip-10-0-130-170 kubenswrapper[2565]: I0611 18:28:01.589617 2565 server.go:1019] "Starting client certificate rotation" Jun 11 18:28:01.593038 ip-10-0-130-170 kubenswrapper[2565]: I0611 18:28:01.589718 2565 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kube-apiserver-client-kubelet" Jun 11 18:28:01.593038 ip-10-0-130-170 kubenswrapper[2565]: I0611 18:28:01.589752 2565 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kube-apiserver-client-kubelet" Jun 11 18:28:01.593038 ip-10-0-130-170 kubenswrapper[2565]: I0611 18:28:01.592386 2565 dynamic_cafile_content.go:123] "Loaded a new CA Bundle and Verifier" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt" Jun 11 18:28:01.593858 ip-10-0-130-170 kubenswrapper[2565]: I0611 18:28:01.593842 2565 dynamic_cafile_content.go:161] "Starting controller" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt" Jun 11 18:28:01.608006 ip-10-0-130-170 kubenswrapper[2565]: I0611 18:28:01.607981 2565 log.go:25] "Validated CRI v1 runtime API" Jun 11 18:28:01.611493 ip-10-0-130-170 kubenswrapper[2565]: I0611 18:28:01.611474 2565 log.go:25] "Validated CRI v1 image API" Jun 11 18:28:01.612413 ip-10-0-130-170 kubenswrapper[2565]: I0611 18:28:01.612394 2565 server.go:1429] "Using cgroup driver setting received from the CRI runtime" cgroupDriver="systemd" Jun 11 18:28:01.615754 ip-10-0-130-170 kubenswrapper[2565]: I0611 18:28:01.615727 2565 fs.go:135] Filesystem UUIDs: map[7B77-95E7:/dev/nvme0n1p2 7dde07d5-bccb-40ee-87bf-6a8efe46ef15:/dev/nvme0n1p3 c5fe92e7-c08c-4f9a-9fe7-f47c29de36b3:/dev/nvme0n1p4] Jun 11 18:28:01.615817 ip-10-0-130-170 kubenswrapper[2565]: I0611 18:28:01.615754 2565 fs.go:136] Filesystem partitions: map[/dev/nvme0n1p3:{mountpoint:/boot major:259 minor:3 fsType:ext4 blockSize:0} /dev/nvme0n1p4:{mountpoint:/var major:259 minor:4 fsType:xfs blockSize:0} /dev/shm:{mountpoint:/dev/shm major:0 minor:22 fsType:tmpfs blockSize:0} /run:{mountpoint:/run major:0 minor:24 fsType:tmpfs blockSize:0} /tmp:{mountpoint:/tmp major:0 minor:31 fsType:tmpfs blockSize:0} composefs_0-33:{mountpoint:/ major:0 minor:33 fsType:overlay blockSize:0}] Jun 11 18:28:01.621008 ip-10-0-130-170 kubenswrapper[2565]: I0611 18:28:01.620889 2565 manager.go:216] Machine: {Timestamp:2026-06-11 18:28:01.61950934 +0000 UTC m=+0.368195353 CPUVendorID:GenuineIntel NumCores:8 NumPhysicalCores:4 NumSockets:1 CpuFrequency:3102314 MemoryCapacity:32812175360 SwapCapacity:0 MemoryByType:map[] NVMInfo:{MemoryModeCapacity:0 AppDirectModeCapacity:0 AvgPowerBudget:0} HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] MachineID:ec26faa5b84add090893b54662a22b71 SystemUUID:ec26faa5-b84a-dd09-0893-b54662a22b71 BootID:d9d0b66b-191a-460c-af01-9114c9d3a217 Filesystems:[{Device:/tmp DeviceMajor:0 DeviceMinor:31 Capacity:16406089728 Type:vfs Inodes:1048576 HasInodes:true} {Device:/dev/nvme0n1p3 DeviceMajor:259 DeviceMinor:3 Capacity:366869504 Type:vfs Inodes:98304 HasInodes:true} {Device:/dev/shm DeviceMajor:0 DeviceMinor:22 Capacity:16406085632 Type:vfs Inodes:4005392 HasInodes:true} {Device:/run DeviceMajor:0 DeviceMinor:24 Capacity:6562435072 Type:vfs Inodes:819200 HasInodes:true} {Device:/dev/nvme0n1p4 DeviceMajor:259 DeviceMinor:4 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:composefs_0-33 DeviceMajor:0 DeviceMinor:33 Capacity:6107136 Type:vfs Inodes:18446744073709551615 HasInodes:true}] DiskMap:map[259:0:{Name:nvme0n1 Major:259 Minor:0 Size:128849018880 Scheduler:none}] NetworkDevices:[{Name:br-ex MacAddress:02:c4:bb:78:4e:1d Speed:0 Mtu:9001} {Name:ens5 MacAddress:02:c4:bb:78:4e:1d Speed:0 Mtu:9001} {Name:ovs-system MacAddress:36:31:66:bd:4e:a2 Speed:0 Mtu:1500}] Topology:[{Id:0 Memory:32812175360 HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] Cores:[{Id:0 Threads:[0 4] Caches:[{Id:0 Size:32768 Type:Data Level:1} {Id:0 Size:32768 Type:Instruction Level:1} {Id:0 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:1 Threads:[1 5] Caches:[{Id:1 Size:32768 Type:Data Level:1} {Id:1 Size:32768 Type:Instruction Level:1} {Id:1 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:2 Threads:[2 6] Caches:[{Id:2 Size:32768 Type:Data Level:1} {Id:2 Size:32768 Type:Instruction Level:1} {Id:2 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:3 Threads:[3 7] Caches:[{Id:3 Size:32768 Type:Data Level:1} {Id:3 Size:32768 Type:Instruction Level:1} {Id:3 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:}] Caches:[{Id:0 Size:34603008 Type:Unified Level:3}] Distances:[10]}] CloudProvider:Unknown InstanceType:Unknown InstanceID:None} Jun 11 18:28:01.621008 ip-10-0-130-170 kubenswrapper[2565]: I0611 18:28:01.621003 2565 manager_no_libpfm.go:29] cAdvisor is build without cgo and/or libpfm support. Perf event counters are not available. Jun 11 18:28:01.621157 ip-10-0-130-170 kubenswrapper[2565]: I0611 18:28:01.621145 2565 manager.go:232] Version: {KernelVersion:5.14.0-570.120.1.el9_6.x86_64 ContainerOsVersion:Red Hat Enterprise Linux CoreOS 9.6.20260608-0 (Plow) DockerVersion: DockerAPIVersion: CadvisorVersion: CadvisorRevision:} Jun 11 18:28:01.621603 ip-10-0-130-170 kubenswrapper[2565]: I0611 18:28:01.621582 2565 reflector.go:439] "Caches populated" logger="kubernetes.io/kube-apiserver-client-kubelet" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162" Jun 11 18:28:01.624613 ip-10-0-130-170 kubenswrapper[2565]: I0611 18:28:01.624584 2565 container_manager_linux.go:273] "Container manager verified user specified cgroup-root exists" cgroupRoot=[] Jun 11 18:28:01.624760 ip-10-0-130-170 kubenswrapper[2565]: I0611 18:28:01.624617 2565 container_manager_linux.go:278] "Creating Container Manager object based on Node Config" nodeConfig={"NodeName":"ip-10-0-130-170.ec2.internal","RuntimeCgroupsName":"/system.slice/crio.service","SystemCgroupsName":"/system.slice","KubeletCgroupsName":"","KubeletOOMScoreAdj":-999,"ContainerRuntime":"","CgroupsPerQOS":true,"CgroupRoot":"/","CgroupDriver":"systemd","KubeletRootDir":"/var/lib/kubelet","ProtectKernelDefaults":true,"KubeReservedCgroupName":"","SystemReservedCgroupName":"","ReservedSystemCPUs":{},"EnforceNodeAllocatable":{"pods":{}},"KubeReserved":null,"SystemReserved":{"cpu":"500m","ephemeral-storage":"1Gi","memory":"1Gi"},"HardEvictionThresholds":[{"Signal":"imagefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.15},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"memory.available","Operator":"LessThan","Value":{"Quantity":"100Mi","Percentage":0},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.1},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null}],"QOSReserved":{},"CPUManagerPolicy":"none","CPUManagerPolicyOptions":null,"TopologyManagerScope":"container","CPUManagerReconcilePeriod":10000000000,"MemoryManagerPolicy":"None","MemoryManagerReservedMemory":null,"PodPidsLimit":4096,"EnforceCPULimits":true,"CPUCFSQuotaPeriod":100000000,"TopologyManagerPolicy":"none","TopologyManagerPolicyOptions":null,"CgroupVersion":2} Jun 11 18:28:01.625468 ip-10-0-130-170 kubenswrapper[2565]: I0611 18:28:01.625458 2565 topology_manager.go:138] "Creating topology manager with none policy" Jun 11 18:28:01.625500 ip-10-0-130-170 kubenswrapper[2565]: I0611 18:28:01.625472 2565 container_manager_linux.go:309] "Creating device plugin manager" Jun 11 18:28:01.625500 ip-10-0-130-170 kubenswrapper[2565]: I0611 18:28:01.625479 2565 manager.go:141] "Creating Device Plugin manager" path="/var/lib/kubelet/device-plugins/kubelet.sock" Jun 11 18:28:01.626868 ip-10-0-130-170 kubenswrapper[2565]: I0611 18:28:01.626856 2565 server.go:74] "Creating device plugin registration server" version="v1beta1" socket="/var/lib/kubelet/device-plugins/kubelet.sock" Jun 11 18:28:01.628359 ip-10-0-130-170 kubenswrapper[2565]: I0611 18:28:01.628346 2565 container_manager_linux.go:318] "Creating Dynamic Resource Allocation (DRA) manager" Jun 11 18:28:01.631492 ip-10-0-130-170 kubenswrapper[2565]: I0611 18:28:01.631481 2565 state_mem.go:36] "Initialized new in-memory state store" Jun 11 18:28:01.631619 ip-10-0-130-170 kubenswrapper[2565]: I0611 18:28:01.631609 2565 server.go:1240] "Using root directory" path="/var/lib/kubelet" Jun 11 18:28:01.631658 ip-10-0-130-170 kubenswrapper[2565]: I0611 18:28:01.631639 2565 kubelet.go:486] "Attempting to sync node with API server" Jun 11 18:28:01.631658 ip-10-0-130-170 kubenswrapper[2565]: I0611 18:28:01.631656 2565 kubelet.go:387] "Adding static pod path" path="/etc/kubernetes/manifests" Jun 11 18:28:01.631712 ip-10-0-130-170 kubenswrapper[2565]: I0611 18:28:01.631670 2565 file.go:69] "Watching path" path="/etc/kubernetes/manifests" Jun 11 18:28:01.631712 ip-10-0-130-170 kubenswrapper[2565]: I0611 18:28:01.631680 2565 kubelet.go:398] "Adding apiserver pod source" Jun 11 18:28:01.631712 ip-10-0-130-170 kubenswrapper[2565]: I0611 18:28:01.631689 2565 apiserver.go:42] "Waiting for node sync before watching apiserver pods" Jun 11 18:28:01.632285 ip-10-0-130-170 kubenswrapper[2565]: I0611 18:28:01.632073 2565 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking" Jun 11 18:28:01.632336 ip-10-0-130-170 kubenswrapper[2565]: I0611 18:28:01.632314 2565 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking" Jun 11 18:28:01.641546 ip-10-0-130-170 kubenswrapper[2565]: I0611 18:28:01.641525 2565 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-m56nb" Jun 11 18:28:01.646490 ip-10-0-130-170 kubenswrapper[2565]: I0611 18:28:01.646472 2565 kuberuntime_manager.go:301] "Container runtime initialized" containerRuntime="cri-o" version="1.34.8-3.rhaos4.21.git91b4b0b.el9" apiVersion="v1" Jun 11 18:28:01.648131 ip-10-0-130-170 kubenswrapper[2565]: I0611 18:28:01.648116 2565 kubelet.go:960] "Not starting ClusterTrustBundle informer because we are in static kubelet mode or the ClusterTrustBundleProjection featuregate is disabled" Jun 11 18:28:01.648193 ip-10-0-130-170 kubenswrapper[2565]: I0611 18:28:01.648148 2565 kubelet.go:984] "Not starting PodCertificateRequest manager because we are in static kubelet mode or the PodCertificateProjection feature gate is disabled" Jun 11 18:28:01.648351 ip-10-0-130-170 kubenswrapper[2565]: I0611 18:28:01.648340 2565 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/portworx-volume" Jun 11 18:28:01.648389 ip-10-0-130-170 kubenswrapper[2565]: I0611 18:28:01.648356 2565 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/empty-dir" Jun 11 18:28:01.648389 ip-10-0-130-170 kubenswrapper[2565]: I0611 18:28:01.648363 2565 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/git-repo" Jun 11 18:28:01.648389 ip-10-0-130-170 kubenswrapper[2565]: I0611 18:28:01.648368 2565 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/host-path" Jun 11 18:28:01.648389 ip-10-0-130-170 kubenswrapper[2565]: I0611 18:28:01.648376 2565 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/nfs" Jun 11 18:28:01.648389 ip-10-0-130-170 kubenswrapper[2565]: I0611 18:28:01.648382 2565 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/secret" Jun 11 18:28:01.648986 ip-10-0-130-170 kubenswrapper[2565]: I0611 18:28:01.648977 2565 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/iscsi" Jun 11 18:28:01.649031 ip-10-0-130-170 kubenswrapper[2565]: I0611 18:28:01.648986 2565 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/downward-api" Jun 11 18:28:01.649031 ip-10-0-130-170 kubenswrapper[2565]: I0611 18:28:01.648996 2565 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/fc" Jun 11 18:28:01.649031 ip-10-0-130-170 kubenswrapper[2565]: I0611 18:28:01.649003 2565 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/configmap" Jun 11 18:28:01.649031 ip-10-0-130-170 kubenswrapper[2565]: I0611 18:28:01.649024 2565 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/projected" Jun 11 18:28:01.649162 ip-10-0-130-170 kubenswrapper[2565]: I0611 18:28:01.649034 2565 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/local-volume" Jun 11 18:28:01.649162 ip-10-0-130-170 kubenswrapper[2565]: I0611 18:28:01.649153 2565 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-m56nb" Jun 11 18:28:01.649571 ip-10-0-130-170 kubenswrapper[2565]: E0611 18:28:01.649551 2565 reflector.go:205] "Failed to watch" err="failed to list *v1.Node: nodes \"ip-10-0-130-170.ec2.internal\" is forbidden: User \"system:anonymous\" cannot list resource \"nodes\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Node" Jun 11 18:28:01.649657 ip-10-0-130-170 kubenswrapper[2565]: E0611 18:28:01.649607 2565 reflector.go:205] "Failed to watch" err="failed to list *v1.Service: services is forbidden: User \"system:anonymous\" cannot list resource \"services\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Service" Jun 11 18:28:01.649844 ip-10-0-130-170 kubenswrapper[2565]: I0611 18:28:01.649832 2565 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/csi" Jun 11 18:28:01.649881 ip-10-0-130-170 kubenswrapper[2565]: I0611 18:28:01.649846 2565 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/image" Jun 11 18:28:01.653196 ip-10-0-130-170 kubenswrapper[2565]: I0611 18:28:01.653179 2565 server.go:1268] "Started kubelet" Jun 11 18:28:01.653322 ip-10-0-130-170 kubenswrapper[2565]: I0611 18:28:01.653275 2565 server.go:180] "Starting to listen" address="0.0.0.0" port=10250 Jun 11 18:28:01.653322 ip-10-0-130-170 kubenswrapper[2565]: I0611 18:28:01.653279 2565 ratelimit.go:56] "Setting rate limiting for endpoint" service="podresources" qps=100 burstTokens=10 Jun 11 18:28:01.653437 ip-10-0-130-170 kubenswrapper[2565]: I0611 18:28:01.653348 2565 server_v1.go:49] "podresources" method="list" useActivePods=true Jun 11 18:28:01.654210 ip-10-0-130-170 systemd[1]: Started Kubernetes Kubelet. Jun 11 18:28:01.656773 ip-10-0-130-170 kubenswrapper[2565]: I0611 18:28:01.656740 2565 server.go:249] "Starting to serve the podresources API" endpoint="unix:/var/lib/kubelet/pod-resources/kubelet.sock" Jun 11 18:28:01.658339 ip-10-0-130-170 kubenswrapper[2565]: I0611 18:28:01.658318 2565 server.go:310] "Adding debug handlers to kubelet server" Jun 11 18:28:01.663592 ip-10-0-130-170 kubenswrapper[2565]: E0611 18:28:01.663569 2565 kubelet.go:1638] "Image garbage collection failed once. Stats initialization may not have completed yet" err="failed to get imageFs info: unable to find data in memory cache" Jun 11 18:28:01.664404 ip-10-0-130-170 kubenswrapper[2565]: I0611 18:28:01.664387 2565 fs_resource_analyzer.go:67] "Starting FS ResourceAnalyzer" Jun 11 18:28:01.664499 ip-10-0-130-170 kubenswrapper[2565]: I0611 18:28:01.664404 2565 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kubelet-serving" Jun 11 18:28:01.664499 ip-10-0-130-170 kubenswrapper[2565]: E0611 18:28:01.664477 2565 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-130-170.ec2.internal\" not found" Jun 11 18:28:01.665038 ip-10-0-130-170 kubenswrapper[2565]: I0611 18:28:01.665016 2565 desired_state_of_world_populator.go:146] "Desired state populator starts to run" Jun 11 18:28:01.665038 ip-10-0-130-170 kubenswrapper[2565]: I0611 18:28:01.665017 2565 volume_manager.go:311] "The desired_state_of_world populator starts" Jun 11 18:28:01.665164 ip-10-0-130-170 kubenswrapper[2565]: I0611 18:28:01.665048 2565 volume_manager.go:313] "Starting Kubelet Volume Manager" Jun 11 18:28:01.665164 ip-10-0-130-170 kubenswrapper[2565]: I0611 18:28:01.665151 2565 reconstruct.go:97] "Volume reconstruction finished" Jun 11 18:28:01.665164 ip-10-0-130-170 kubenswrapper[2565]: I0611 18:28:01.665162 2565 reconciler.go:29] "Reconciler: start to sync state" Jun 11 18:28:01.665341 ip-10-0-130-170 kubenswrapper[2565]: I0611 18:28:01.665323 2565 factory.go:55] Registering systemd factory Jun 11 18:28:01.665468 ip-10-0-130-170 kubenswrapper[2565]: I0611 18:28:01.665442 2565 factory.go:223] Registration of the systemd container factory successfully Jun 11 18:28:01.665800 ip-10-0-130-170 kubenswrapper[2565]: I0611 18:28:01.665788 2565 factory.go:153] Registering CRI-O factory Jun 11 18:28:01.665800 ip-10-0-130-170 kubenswrapper[2565]: I0611 18:28:01.665802 2565 factory.go:223] Registration of the crio container factory successfully Jun 11 18:28:01.665885 ip-10-0-130-170 kubenswrapper[2565]: I0611 18:28:01.665853 2565 factory.go:221] Registration of the containerd container factory failed: unable to create containerd client: containerd: cannot unix dial containerd api service: dial unix /run/containerd/containerd.sock: connect: no such file or directory Jun 11 18:28:01.665885 ip-10-0-130-170 kubenswrapper[2565]: I0611 18:28:01.665873 2565 factory.go:103] Registering Raw factory Jun 11 18:28:01.665885 ip-10-0-130-170 kubenswrapper[2565]: I0611 18:28:01.665887 2565 manager.go:1196] Started watching for new ooms in manager Jun 11 18:28:01.666239 ip-10-0-130-170 kubenswrapper[2565]: I0611 18:28:01.666226 2565 manager.go:349] Starting recovery of all containers Jun 11 18:28:01.667369 ip-10-0-130-170 kubenswrapper[2565]: I0611 18:28:01.667344 2565 reflector.go:439] "Caches populated" type="*v1.CSIDriver" reflector="k8s.io/client-go/informers/factory.go:160" Jun 11 18:28:01.669645 ip-10-0-130-170 kubenswrapper[2565]: I0611 18:28:01.669622 2565 nodeinfomanager.go:417] Failed to publish CSINode: nodes "ip-10-0-130-170.ec2.internal" not found Jun 11 18:28:01.670128 ip-10-0-130-170 kubenswrapper[2565]: E0611 18:28:01.670104 2565 nodelease.go:49] "Failed to get node when trying to set owner ref to the node lease" err="nodes \"ip-10-0-130-170.ec2.internal\" not found" node="ip-10-0-130-170.ec2.internal" Jun 11 18:28:01.675845 ip-10-0-130-170 kubenswrapper[2565]: I0611 18:28:01.675827 2565 manager.go:354] Recovery completed Jun 11 18:28:01.677417 ip-10-0-130-170 kubenswrapper[2565]: E0611 18:28:01.677396 2565 watcher.go:152] Failed to watch directory "/sys/fs/cgroup/system.slice/systemd-update-utmp-runlevel.service": inotify_add_watch /sys/fs/cgroup/system.slice/systemd-update-utmp-runlevel.service: no such file or directory Jun 11 18:28:01.680200 ip-10-0-130-170 kubenswrapper[2565]: I0611 18:28:01.680182 2565 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jun 11 18:28:01.682223 ip-10-0-130-170 kubenswrapper[2565]: I0611 18:28:01.682202 2565 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-130-170.ec2.internal" event="NodeHasSufficientMemory" Jun 11 18:28:01.682315 ip-10-0-130-170 kubenswrapper[2565]: I0611 18:28:01.682241 2565 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-130-170.ec2.internal" event="NodeHasNoDiskPressure" Jun 11 18:28:01.682315 ip-10-0-130-170 kubenswrapper[2565]: I0611 18:28:01.682297 2565 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-130-170.ec2.internal" event="NodeHasSufficientPID" Jun 11 18:28:01.682905 ip-10-0-130-170 kubenswrapper[2565]: I0611 18:28:01.682886 2565 cpu_manager.go:222] "Starting CPU manager" policy="none" Jun 11 18:28:01.682905 ip-10-0-130-170 kubenswrapper[2565]: I0611 18:28:01.682905 2565 cpu_manager.go:223] "Reconciling" reconcilePeriod="10s" Jun 11 18:28:01.683034 ip-10-0-130-170 kubenswrapper[2565]: I0611 18:28:01.682918 2565 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jun 11 18:28:01.683034 ip-10-0-130-170 kubenswrapper[2565]: I0611 18:28:01.682926 2565 state_mem.go:36] "Initialized new in-memory state store" Jun 11 18:28:01.684390 ip-10-0-130-170 kubenswrapper[2565]: I0611 18:28:01.684374 2565 policy_none.go:49] "None policy: Start" Jun 11 18:28:01.684482 ip-10-0-130-170 kubenswrapper[2565]: I0611 18:28:01.684394 2565 memory_manager.go:187] "Starting memorymanager" policy="None" Jun 11 18:28:01.684482 ip-10-0-130-170 kubenswrapper[2565]: I0611 18:28:01.684409 2565 state_mem.go:36] "Initializing new in-memory state store" logger="Memory Manager state checkpoint" Jun 11 18:28:01.684662 ip-10-0-130-170 kubenswrapper[2565]: I0611 18:28:01.684544 2565 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-130-170.ec2.internal" event="NodeHasSufficientMemory" Jun 11 18:28:01.684662 ip-10-0-130-170 kubenswrapper[2565]: I0611 18:28:01.684576 2565 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-130-170.ec2.internal" event="NodeHasNoDiskPressure" Jun 11 18:28:01.684662 ip-10-0-130-170 kubenswrapper[2565]: I0611 18:28:01.684591 2565 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-130-170.ec2.internal" event="NodeHasSufficientPID" Jun 11 18:28:01.685586 ip-10-0-130-170 kubenswrapper[2565]: I0611 18:28:01.685573 2565 policy_none.go:47] "Start" Jun 11 18:28:01.685774 ip-10-0-130-170 kubenswrapper[2565]: I0611 18:28:01.685760 2565 nodeinfomanager.go:417] Failed to publish CSINode: nodes "ip-10-0-130-170.ec2.internal" not found Jun 11 18:28:01.738974 ip-10-0-130-170 kubenswrapper[2565]: I0611 18:28:01.738935 2565 manager.go:337] "Starting Device Plugin manager" Jun 11 18:28:01.744490 ip-10-0-130-170 kubenswrapper[2565]: E0611 18:28:01.739026 2565 manager.go:513] "Failed to read data from checkpoint" err="checkpoint is not found" checkpoint="kubelet_internal_checkpoint" Jun 11 18:28:01.744490 ip-10-0-130-170 kubenswrapper[2565]: I0611 18:28:01.739045 2565 server.go:87] "Starting device plugin registration server" Jun 11 18:28:01.744490 ip-10-0-130-170 kubenswrapper[2565]: I0611 18:28:01.739338 2565 eviction_manager.go:189] "Eviction manager: starting control loop" Jun 11 18:28:01.744490 ip-10-0-130-170 kubenswrapper[2565]: I0611 18:28:01.739349 2565 container_log_manager.go:146] "Initializing container log rotate workers" workers=1 monitorPeriod="10s" Jun 11 18:28:01.744490 ip-10-0-130-170 kubenswrapper[2565]: I0611 18:28:01.739505 2565 plugin_watcher.go:51] "Plugin Watcher Start" path="/var/lib/kubelet/plugins_registry" Jun 11 18:28:01.744490 ip-10-0-130-170 kubenswrapper[2565]: I0611 18:28:01.739583 2565 plugin_manager.go:116] "The desired_state_of_world populator (plugin watcher) starts" Jun 11 18:28:01.744490 ip-10-0-130-170 kubenswrapper[2565]: I0611 18:28:01.739591 2565 plugin_manager.go:118] "Starting Kubelet Plugin Manager" Jun 11 18:28:01.744490 ip-10-0-130-170 kubenswrapper[2565]: I0611 18:28:01.740284 2565 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv4" Jun 11 18:28:01.744490 ip-10-0-130-170 kubenswrapper[2565]: E0611 18:28:01.740990 2565 eviction_manager.go:267] "eviction manager: failed to check if we have separate container filesystem. Ignoring." err="non-existent label \"crio-containers\"" Jun 11 18:28:01.744490 ip-10-0-130-170 kubenswrapper[2565]: E0611 18:28:01.741058 2565 eviction_manager.go:292] "Eviction manager: failed to get summary stats" err="failed to get node info: node \"ip-10-0-130-170.ec2.internal\" not found" Jun 11 18:28:01.744490 ip-10-0-130-170 kubenswrapper[2565]: I0611 18:28:01.742095 2565 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv6" Jun 11 18:28:01.744490 ip-10-0-130-170 kubenswrapper[2565]: I0611 18:28:01.742146 2565 status_manager.go:244] "Starting to sync pod status with apiserver" Jun 11 18:28:01.744490 ip-10-0-130-170 kubenswrapper[2565]: I0611 18:28:01.742171 2565 kubelet.go:2448] "Starting kubelet main sync loop" Jun 11 18:28:01.744490 ip-10-0-130-170 kubenswrapper[2565]: E0611 18:28:01.742353 2565 kubelet.go:2472] "Skipping pod synchronization" err="PLEG is not healthy: pleg has yet to be successful" Jun 11 18:28:01.745194 ip-10-0-130-170 kubenswrapper[2565]: I0611 18:28:01.744627 2565 nodeinfomanager.go:417] Failed to publish CSINode: nodes "ip-10-0-130-170.ec2.internal" not found Jun 11 18:28:01.745194 ip-10-0-130-170 kubenswrapper[2565]: I0611 18:28:01.744776 2565 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160" Jun 11 18:28:01.839866 ip-10-0-130-170 kubenswrapper[2565]: I0611 18:28:01.839782 2565 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jun 11 18:28:01.842069 ip-10-0-130-170 kubenswrapper[2565]: I0611 18:28:01.842050 2565 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-130-170.ec2.internal" event="NodeHasSufficientMemory" Jun 11 18:28:01.842132 ip-10-0-130-170 kubenswrapper[2565]: I0611 18:28:01.842087 2565 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-130-170.ec2.internal" event="NodeHasNoDiskPressure" Jun 11 18:28:01.842132 ip-10-0-130-170 kubenswrapper[2565]: I0611 18:28:01.842102 2565 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-130-170.ec2.internal" event="NodeHasSufficientPID" Jun 11 18:28:01.842132 ip-10-0-130-170 kubenswrapper[2565]: I0611 18:28:01.842127 2565 kubelet_node_status.go:78] "Attempting to register node" node="ip-10-0-130-170.ec2.internal" Jun 11 18:28:01.842413 ip-10-0-130-170 kubenswrapper[2565]: I0611 18:28:01.842392 2565 kubelet.go:2535] "SyncLoop ADD" source="file" pods=["openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-130-170.ec2.internal","kube-system/kube-apiserver-proxy-ip-10-0-130-170.ec2.internal"] Jun 11 18:28:01.842479 ip-10-0-130-170 kubenswrapper[2565]: I0611 18:28:01.842471 2565 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jun 11 18:28:01.844565 ip-10-0-130-170 kubenswrapper[2565]: I0611 18:28:01.844550 2565 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-130-170.ec2.internal" event="NodeHasSufficientMemory" Jun 11 18:28:01.844643 ip-10-0-130-170 kubenswrapper[2565]: I0611 18:28:01.844580 2565 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-130-170.ec2.internal" event="NodeHasNoDiskPressure" Jun 11 18:28:01.844643 ip-10-0-130-170 kubenswrapper[2565]: I0611 18:28:01.844594 2565 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-130-170.ec2.internal" event="NodeHasSufficientPID" Jun 11 18:28:01.846238 ip-10-0-130-170 kubenswrapper[2565]: I0611 18:28:01.846223 2565 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jun 11 18:28:01.846391 ip-10-0-130-170 kubenswrapper[2565]: I0611 18:28:01.846370 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-130-170.ec2.internal" Jun 11 18:28:01.846444 ip-10-0-130-170 kubenswrapper[2565]: I0611 18:28:01.846435 2565 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jun 11 18:28:01.847016 ip-10-0-130-170 kubenswrapper[2565]: I0611 18:28:01.846992 2565 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-130-170.ec2.internal" event="NodeHasSufficientMemory" Jun 11 18:28:01.847122 ip-10-0-130-170 kubenswrapper[2565]: I0611 18:28:01.847032 2565 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-130-170.ec2.internal" event="NodeHasNoDiskPressure" Jun 11 18:28:01.847122 ip-10-0-130-170 kubenswrapper[2565]: I0611 18:28:01.847040 2565 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-130-170.ec2.internal" event="NodeHasSufficientMemory" Jun 11 18:28:01.847122 ip-10-0-130-170 kubenswrapper[2565]: I0611 18:28:01.847064 2565 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-130-170.ec2.internal" event="NodeHasNoDiskPressure" Jun 11 18:28:01.847122 ip-10-0-130-170 kubenswrapper[2565]: I0611 18:28:01.847075 2565 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-130-170.ec2.internal" event="NodeHasSufficientPID" Jun 11 18:28:01.847122 ip-10-0-130-170 kubenswrapper[2565]: I0611 18:28:01.847046 2565 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-130-170.ec2.internal" event="NodeHasSufficientPID" Jun 11 18:28:01.848326 ip-10-0-130-170 kubenswrapper[2565]: I0611 18:28:01.848311 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-130-170.ec2.internal" Jun 11 18:28:01.848395 ip-10-0-130-170 kubenswrapper[2565]: I0611 18:28:01.848336 2565 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jun 11 18:28:01.849129 ip-10-0-130-170 kubenswrapper[2565]: I0611 18:28:01.849112 2565 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-130-170.ec2.internal" event="NodeHasSufficientMemory" Jun 11 18:28:01.849186 ip-10-0-130-170 kubenswrapper[2565]: I0611 18:28:01.849138 2565 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-130-170.ec2.internal" event="NodeHasNoDiskPressure" Jun 11 18:28:01.849186 ip-10-0-130-170 kubenswrapper[2565]: I0611 18:28:01.849148 2565 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-130-170.ec2.internal" event="NodeHasSufficientPID" Jun 11 18:28:01.852221 ip-10-0-130-170 kubenswrapper[2565]: I0611 18:28:01.852206 2565 kubelet_node_status.go:81] "Successfully registered node" node="ip-10-0-130-170.ec2.internal" Jun 11 18:28:01.852316 ip-10-0-130-170 kubenswrapper[2565]: E0611 18:28:01.852228 2565 kubelet_node_status.go:536] "Error updating node status, will retry" err="error getting node \"ip-10-0-130-170.ec2.internal\": node \"ip-10-0-130-170.ec2.internal\" not found" Jun 11 18:28:01.866525 ip-10-0-130-170 kubenswrapper[2565]: I0611 18:28:01.866500 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/d27cacba6b716e5c50a39b60d514201c-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-130-170.ec2.internal\" (UID: \"d27cacba6b716e5c50a39b60d514201c\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-130-170.ec2.internal" Jun 11 18:28:01.866658 ip-10-0-130-170 kubenswrapper[2565]: I0611 18:28:01.866530 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/d27cacba6b716e5c50a39b60d514201c-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-130-170.ec2.internal\" (UID: \"d27cacba6b716e5c50a39b60d514201c\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-130-170.ec2.internal" Jun 11 18:28:01.866658 ip-10-0-130-170 kubenswrapper[2565]: I0611 18:28:01.866549 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/cbc21c3b8650a365de338167fa32510b-config\") pod \"kube-apiserver-proxy-ip-10-0-130-170.ec2.internal\" (UID: \"cbc21c3b8650a365de338167fa32510b\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-130-170.ec2.internal" Jun 11 18:28:01.867024 ip-10-0-130-170 kubenswrapper[2565]: E0611 18:28:01.867009 2565 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-130-170.ec2.internal\" not found" Jun 11 18:28:01.872035 ip-10-0-130-170 kubenswrapper[2565]: E0611 18:28:01.872016 2565 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-130-170.ec2.internal\" not found" node="ip-10-0-130-170.ec2.internal" Jun 11 18:28:01.876518 ip-10-0-130-170 kubenswrapper[2565]: E0611 18:28:01.876498 2565 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-130-170.ec2.internal\" not found" node="ip-10-0-130-170.ec2.internal" Jun 11 18:28:01.967054 ip-10-0-130-170 kubenswrapper[2565]: I0611 18:28:01.967027 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/d27cacba6b716e5c50a39b60d514201c-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-130-170.ec2.internal\" (UID: \"d27cacba6b716e5c50a39b60d514201c\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-130-170.ec2.internal" Jun 11 18:28:01.967175 ip-10-0-130-170 kubenswrapper[2565]: I0611 18:28:01.966992 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/d27cacba6b716e5c50a39b60d514201c-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-130-170.ec2.internal\" (UID: \"d27cacba6b716e5c50a39b60d514201c\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-130-170.ec2.internal" Jun 11 18:28:01.967175 ip-10-0-130-170 kubenswrapper[2565]: E0611 18:28:01.967092 2565 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-130-170.ec2.internal\" not found" Jun 11 18:28:01.967175 ip-10-0-130-170 kubenswrapper[2565]: I0611 18:28:01.967111 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/d27cacba6b716e5c50a39b60d514201c-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-130-170.ec2.internal\" (UID: \"d27cacba6b716e5c50a39b60d514201c\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-130-170.ec2.internal" Jun 11 18:28:01.967175 ip-10-0-130-170 kubenswrapper[2565]: I0611 18:28:01.967136 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/cbc21c3b8650a365de338167fa32510b-config\") pod \"kube-apiserver-proxy-ip-10-0-130-170.ec2.internal\" (UID: \"cbc21c3b8650a365de338167fa32510b\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-130-170.ec2.internal" Jun 11 18:28:01.967175 ip-10-0-130-170 kubenswrapper[2565]: I0611 18:28:01.967166 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/host-path/cbc21c3b8650a365de338167fa32510b-config\") pod \"kube-apiserver-proxy-ip-10-0-130-170.ec2.internal\" (UID: \"cbc21c3b8650a365de338167fa32510b\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-130-170.ec2.internal" Jun 11 18:28:01.967365 ip-10-0-130-170 kubenswrapper[2565]: I0611 18:28:01.967195 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/d27cacba6b716e5c50a39b60d514201c-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-130-170.ec2.internal\" (UID: \"d27cacba6b716e5c50a39b60d514201c\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-130-170.ec2.internal" Jun 11 18:28:02.067485 ip-10-0-130-170 kubenswrapper[2565]: E0611 18:28:02.067442 2565 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-130-170.ec2.internal\" not found" Jun 11 18:28:02.168140 ip-10-0-130-170 kubenswrapper[2565]: E0611 18:28:02.168112 2565 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-130-170.ec2.internal\" not found" Jun 11 18:28:02.174230 ip-10-0-130-170 kubenswrapper[2565]: I0611 18:28:02.174212 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-130-170.ec2.internal" Jun 11 18:28:02.180570 ip-10-0-130-170 kubenswrapper[2565]: I0611 18:28:02.180552 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-130-170.ec2.internal" Jun 11 18:28:02.268226 ip-10-0-130-170 kubenswrapper[2565]: E0611 18:28:02.268178 2565 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-130-170.ec2.internal\" not found" Jun 11 18:28:02.368624 ip-10-0-130-170 kubenswrapper[2565]: E0611 18:28:02.368585 2565 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-130-170.ec2.internal\" not found" Jun 11 18:28:02.469053 ip-10-0-130-170 kubenswrapper[2565]: E0611 18:28:02.468969 2565 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-130-170.ec2.internal\" not found" Jun 11 18:28:02.569590 ip-10-0-130-170 kubenswrapper[2565]: E0611 18:28:02.569554 2565 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-130-170.ec2.internal\" not found" Jun 11 18:28:02.588759 ip-10-0-130-170 kubenswrapper[2565]: I0611 18:28:02.588730 2565 transport.go:147] "Certificate rotation detected, shutting down client connections to start using new credentials" Jun 11 18:28:02.588952 ip-10-0-130-170 kubenswrapper[2565]: I0611 18:28:02.588922 2565 reflector.go:571] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.RuntimeClass" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received" Jun 11 18:28:02.589037 ip-10-0-130-170 kubenswrapper[2565]: I0611 18:28:02.588952 2565 reflector.go:571] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.CSIDriver" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received" Jun 11 18:28:02.647351 ip-10-0-130-170 kubenswrapper[2565]: W0611 18:28:02.647317 2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podcbc21c3b8650a365de338167fa32510b.slice/crio-e8d2fd9b48bccdfd9d24cb2166471e699d78f563111a714b2914c2c7e7138fc7 WatchSource:0}: Error finding container e8d2fd9b48bccdfd9d24cb2166471e699d78f563111a714b2914c2c7e7138fc7: Status 404 returned error can't find the container with id e8d2fd9b48bccdfd9d24cb2166471e699d78f563111a714b2914c2c7e7138fc7 Jun 11 18:28:02.647708 ip-10-0-130-170 kubenswrapper[2565]: W0611 18:28:02.647679 2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd27cacba6b716e5c50a39b60d514201c.slice/crio-314c98396b5946361beb021a2e2f26556786e17d3e0d0478efbbb2de1617aa29 WatchSource:0}: Error finding container 314c98396b5946361beb021a2e2f26556786e17d3e0d0478efbbb2de1617aa29: Status 404 returned error can't find the container with id 314c98396b5946361beb021a2e2f26556786e17d3e0d0478efbbb2de1617aa29 Jun 11 18:28:02.653294 ip-10-0-130-170 kubenswrapper[2565]: I0611 18:28:02.653194 2565 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kube-apiserver-client-kubelet" expiration="2028-06-10 18:23:01 +0000 UTC" deadline="2028-01-25 03:10:24.693672832 +0000 UTC" Jun 11 18:28:02.653294 ip-10-0-130-170 kubenswrapper[2565]: I0611 18:28:02.653283 2565 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kube-apiserver-client-kubelet" sleep="14216h42m22.040395056s" Jun 11 18:28:02.653442 ip-10-0-130-170 kubenswrapper[2565]: I0611 18:28:02.653328 2565 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jun 11 18:28:02.669660 ip-10-0-130-170 kubenswrapper[2565]: E0611 18:28:02.669637 2565 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-130-170.ec2.internal\" not found" Jun 11 18:28:02.747414 ip-10-0-130-170 kubenswrapper[2565]: I0611 18:28:02.747299 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-130-170.ec2.internal" event={"ID":"cbc21c3b8650a365de338167fa32510b","Type":"ContainerStarted","Data":"e8d2fd9b48bccdfd9d24cb2166471e699d78f563111a714b2914c2c7e7138fc7"} Jun 11 18:28:02.748346 ip-10-0-130-170 kubenswrapper[2565]: I0611 18:28:02.748315 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-130-170.ec2.internal" event={"ID":"d27cacba6b716e5c50a39b60d514201c","Type":"ContainerStarted","Data":"314c98396b5946361beb021a2e2f26556786e17d3e0d0478efbbb2de1617aa29"} Jun 11 18:28:02.758037 ip-10-0-130-170 kubenswrapper[2565]: I0611 18:28:02.758015 2565 reflector.go:439] "Caches populated" type="*v1.Node" reflector="k8s.io/client-go/informers/factory.go:160" Jun 11 18:28:02.764981 ip-10-0-130-170 kubenswrapper[2565]: I0611 18:28:02.764964 2565 kubelet.go:3248] "Creating a mirror pod for static pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-130-170.ec2.internal" Jun 11 18:28:02.776330 ip-10-0-130-170 kubenswrapper[2565]: I0611 18:28:02.776311 2565 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]" Jun 11 18:28:02.778129 ip-10-0-130-170 kubenswrapper[2565]: I0611 18:28:02.778116 2565 kubelet.go:3248] "Creating a mirror pod for static pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-130-170.ec2.internal" Jun 11 18:28:02.786592 ip-10-0-130-170 kubenswrapper[2565]: I0611 18:28:02.786574 2565 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]" Jun 11 18:28:03.152664 ip-10-0-130-170 kubenswrapper[2565]: I0611 18:28:03.152632 2565 reflector.go:439] "Caches populated" type="*v1.Service" reflector="k8s.io/client-go/informers/factory.go:160" Jun 11 18:28:03.453748 ip-10-0-130-170 kubenswrapper[2565]: I0611 18:28:03.453490 2565 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160" Jun 11 18:28:03.632697 ip-10-0-130-170 kubenswrapper[2565]: I0611 18:28:03.632669 2565 apiserver.go:52] "Watching apiserver" Jun 11 18:28:03.639359 ip-10-0-130-170 kubenswrapper[2565]: I0611 18:28:03.639334 2565 reflector.go:439] "Caches populated" type="*v1.Pod" reflector="pkg/kubelet/config/apiserver.go:66" Jun 11 18:28:03.639769 ip-10-0-130-170 kubenswrapper[2565]: I0611 18:28:03.639738 2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-dns/node-resolver-ckltw","openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-130-170.ec2.internal","openshift-multus/multus-additional-cni-plugins-7qn5t","openshift-network-diagnostics/network-check-target-nh426","openshift-network-operator/iptables-alerter-v4p88","kube-system/global-pull-secret-syncer-wqbfv","openshift-cluster-node-tuning-operator/tuned-krq26","openshift-image-registry/node-ca-wwlkz","openshift-multus/multus-pfc8t","openshift-multus/network-metrics-daemon-bvwxp","openshift-ovn-kubernetes/ovnkube-node-9xbcp","kube-system/konnectivity-agent-rv8x7","kube-system/kube-apiserver-proxy-ip-10-0-130-170.ec2.internal","openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-fbfnw"] Jun 11 18:28:03.641528 ip-10-0-130-170 kubenswrapper[2565]: I0611 18:28:03.641508 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-krq26" Jun 11 18:28:03.644364 ip-10-0-130-170 kubenswrapper[2565]: I0611 18:28:03.644339 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-9xbcp" Jun 11 18:28:03.645295 ip-10-0-130-170 kubenswrapper[2565]: I0611 18:28:03.645249 2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"openshift-service-ca.crt\"" Jun 11 18:28:03.645442 ip-10-0-130-170 kubenswrapper[2565]: I0611 18:28:03.645425 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"tuned-dockercfg-nlxbl\"" Jun 11 18:28:03.645553 ip-10-0-130-170 kubenswrapper[2565]: I0611 18:28:03.645534 2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"kube-root-ca.crt\"" Jun 11 18:28:03.646904 ip-10-0-130-170 kubenswrapper[2565]: I0611 18:28:03.646884 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-kubernetes-node-dockercfg-f294x\"" Jun 11 18:28:03.647316 ip-10-0-130-170 kubenswrapper[2565]: I0611 18:28:03.647299 2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"openshift-service-ca.crt\"" Jun 11 18:28:03.647403 ip-10-0-130-170 kubenswrapper[2565]: I0611 18:28:03.647388 2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"kube-root-ca.crt\"" Jun 11 18:28:03.647817 ip-10-0-130-170 kubenswrapper[2565]: I0611 18:28:03.647604 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-node-metrics-cert\"" Jun 11 18:28:03.647817 ip-10-0-130-170 kubenswrapper[2565]: I0611 18:28:03.647627 2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-config\"" Jun 11 18:28:03.647817 ip-10-0-130-170 kubenswrapper[2565]: I0611 18:28:03.647673 2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-script-lib\"" Jun 11 18:28:03.647817 ip-10-0-130-170 kubenswrapper[2565]: I0611 18:28:03.647771 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-7qn5t" Jun 11 18:28:03.648247 ip-10-0-130-170 kubenswrapper[2565]: I0611 18:28:03.648226 2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"env-overrides\"" Jun 11 18:28:03.648876 ip-10-0-130-170 kubenswrapper[2565]: I0611 18:28:03.648858 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-nh426" Jun 11 18:28:03.649029 ip-10-0-130-170 kubenswrapper[2565]: E0611 18:28:03.648977 2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-nh426" podUID="48f7111f-5fb9-477e-8a9e-3e9b22030f6a" Jun 11 18:28:03.649848 ip-10-0-130-170 kubenswrapper[2565]: I0611 18:28:03.649827 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"multus-ancillary-tools-dockercfg-cz6x6\"" Jun 11 18:28:03.649919 ip-10-0-130-170 kubenswrapper[2565]: I0611 18:28:03.649883 2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"openshift-service-ca.crt\"" Jun 11 18:28:03.650033 ip-10-0-130-170 kubenswrapper[2565]: I0611 18:28:03.650017 2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"default-cni-sysctl-allowlist\"" Jun 11 18:28:03.650125 ip-10-0-130-170 kubenswrapper[2565]: I0611 18:28:03.650103 2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"whereabouts-flatfile-config\"" Jun 11 18:28:03.650125 ip-10-0-130-170 kubenswrapper[2565]: I0611 18:28:03.650119 2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"kube-root-ca.crt\"" Jun 11 18:28:03.650416 ip-10-0-130-170 kubenswrapper[2565]: I0611 18:28:03.650399 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-v4p88" Jun 11 18:28:03.650496 ip-10-0-130-170 kubenswrapper[2565]: I0611 18:28:03.650465 2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"cni-copy-resources\"" Jun 11 18:28:03.651677 ip-10-0-130-170 kubenswrapper[2565]: I0611 18:28:03.651657 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-fbfnw" Jun 11 18:28:03.652960 ip-10-0-130-170 kubenswrapper[2565]: I0611 18:28:03.652942 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-pfc8t" Jun 11 18:28:03.654518 ip-10-0-130-170 kubenswrapper[2565]: I0611 18:28:03.654501 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-wwlkz" Jun 11 18:28:03.654829 ip-10-0-130-170 kubenswrapper[2565]: I0611 18:28:03.654801 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-metrics-serving-cert\"" Jun 11 18:28:03.654933 ip-10-0-130-170 kubenswrapper[2565]: I0611 18:28:03.654900 2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"kube-root-ca.crt\"" Jun 11 18:28:03.655017 ip-10-0-130-170 kubenswrapper[2565]: I0611 18:28:03.654989 2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"openshift-service-ca.crt\"" Jun 11 18:28:03.655084 ip-10-0-130-170 kubenswrapper[2565]: I0611 18:28:03.655066 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-dockercfg-4vgsk\"" Jun 11 18:28:03.655179 ip-10-0-130-170 kubenswrapper[2565]: I0611 18:28:03.655162 2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"openshift-service-ca.crt\"" Jun 11 18:28:03.655244 ip-10-0-130-170 kubenswrapper[2565]: I0611 18:28:03.655205 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-sa-dockercfg-8855z\"" Jun 11 18:28:03.655337 ip-10-0-130-170 kubenswrapper[2565]: I0611 18:28:03.655293 2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-script\"" Jun 11 18:28:03.655402 ip-10-0-130-170 kubenswrapper[2565]: I0611 18:28:03.655384 2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"multus-daemon-config\"" Jun 11 18:28:03.655518 ip-10-0-130-170 kubenswrapper[2565]: I0611 18:28:03.655495 2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"kube-root-ca.crt\"" Jun 11 18:28:03.656339 ip-10-0-130-170 kubenswrapper[2565]: I0611 18:28:03.656042 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"default-dockercfg-xnbw2\"" Jun 11 18:28:03.656339 ip-10-0-130-170 kubenswrapper[2565]: I0611 18:28:03.656053 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-rv8x7" Jun 11 18:28:03.656761 ip-10-0-130-170 kubenswrapper[2565]: I0611 18:28:03.656741 2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"image-registry-certificates\"" Jun 11 18:28:03.657136 ip-10-0-130-170 kubenswrapper[2565]: I0611 18:28:03.657116 2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"kube-root-ca.crt\"" Jun 11 18:28:03.657221 ip-10-0-130-170 kubenswrapper[2565]: I0611 18:28:03.657120 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"node-ca-dockercfg-9p2lk\"" Jun 11 18:28:03.657850 ip-10-0-130-170 kubenswrapper[2565]: I0611 18:28:03.657377 2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"openshift-service-ca.crt\"" Jun 11 18:28:03.657850 ip-10-0-130-170 kubenswrapper[2565]: I0611 18:28:03.657654 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-bvwxp" Jun 11 18:28:03.657850 ip-10-0-130-170 kubenswrapper[2565]: E0611 18:28:03.657727 2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-bvwxp" podUID="2f4a1ff8-558e-4d9b-9208-ca0211b2b4e1" Jun 11 18:28:03.658147 ip-10-0-130-170 kubenswrapper[2565]: I0611 18:28:03.658129 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"default-dockercfg-hrbfz\"" Jun 11 18:28:03.658442 ip-10-0-130-170 kubenswrapper[2565]: I0611 18:28:03.658425 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"konnectivity-agent\"" Jun 11 18:28:03.658627 ip-10-0-130-170 kubenswrapper[2565]: I0611 18:28:03.658613 2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kube-system\"/\"konnectivity-ca-bundle\"" Jun 11 18:28:03.660623 ip-10-0-130-170 kubenswrapper[2565]: I0611 18:28:03.660601 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-ckltw" Jun 11 18:28:03.662449 ip-10-0-130-170 kubenswrapper[2565]: I0611 18:28:03.662426 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-wqbfv" Jun 11 18:28:03.662547 ip-10-0-130-170 kubenswrapper[2565]: E0611 18:28:03.662513 2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-wqbfv" podUID="1f1530cc-c788-4dc5-9e3d-7209386e9b94" Jun 11 18:28:03.663467 ip-10-0-130-170 kubenswrapper[2565]: I0611 18:28:03.663136 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"node-resolver-dockercfg-649f5\"" Jun 11 18:28:03.663467 ip-10-0-130-170 kubenswrapper[2565]: I0611 18:28:03.663189 2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"openshift-service-ca.crt\"" Jun 11 18:28:03.663767 ip-10-0-130-170 kubenswrapper[2565]: I0611 18:28:03.663749 2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"kube-root-ca.crt\"" Jun 11 18:28:03.665084 ip-10-0-130-170 kubenswrapper[2565]: I0611 18:28:03.665067 2565 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kubelet-serving" Jun 11 18:28:03.666949 ip-10-0-130-170 kubenswrapper[2565]: I0611 18:28:03.666913 2565 desired_state_of_world_populator.go:154] "Finished populating initial desired state of world" Jun 11 18:28:03.673656 ip-10-0-130-170 kubenswrapper[2565]: I0611 18:28:03.673635 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/c3f907b5-05ec-4fc1-ae51-df0b4b2432fd-sys\") pod \"tuned-krq26\" (UID: \"c3f907b5-05ec-4fc1-ae51-df0b4b2432fd\") " pod="openshift-cluster-node-tuning-operator/tuned-krq26" Jun 11 18:28:03.673755 ip-10-0-130-170 kubenswrapper[2565]: I0611 18:28:03.673666 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/c3f907b5-05ec-4fc1-ae51-df0b4b2432fd-tmp\") pod \"tuned-krq26\" (UID: \"c3f907b5-05ec-4fc1-ae51-df0b4b2432fd\") " pod="openshift-cluster-node-tuning-operator/tuned-krq26" Jun 11 18:28:03.673755 ip-10-0-130-170 kubenswrapper[2565]: I0611 18:28:03.673690 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/5f6a1d9d-054f-4a94-99a3-21b77d4995dd-run-openvswitch\") pod \"ovnkube-node-9xbcp\" (UID: \"5f6a1d9d-054f-4a94-99a3-21b77d4995dd\") " pod="openshift-ovn-kubernetes/ovnkube-node-9xbcp" Jun 11 18:28:03.673755 ip-10-0-130-170 kubenswrapper[2565]: I0611 18:28:03.673714 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/5f6a1d9d-054f-4a94-99a3-21b77d4995dd-host-run-ovn-kubernetes\") pod \"ovnkube-node-9xbcp\" (UID: \"5f6a1d9d-054f-4a94-99a3-21b77d4995dd\") " pod="openshift-ovn-kubernetes/ovnkube-node-9xbcp" Jun 11 18:28:03.673755 ip-10-0-130-170 kubenswrapper[2565]: I0611 18:28:03.673739 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-78kwd\" (UniqueName: \"kubernetes.io/projected/48f7111f-5fb9-477e-8a9e-3e9b22030f6a-kube-api-access-78kwd\") pod \"network-check-target-nh426\" (UID: \"48f7111f-5fb9-477e-8a9e-3e9b22030f6a\") " pod="openshift-network-diagnostics/network-check-target-nh426" Jun 11 18:28:03.673979 ip-10-0-130-170 kubenswrapper[2565]: I0611 18:28:03.673782 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/7a08c57b-6d27-43b1-8518-7d2564aa682e-iptables-alerter-script\") pod \"iptables-alerter-v4p88\" (UID: \"7a08c57b-6d27-43b1-8518-7d2564aa682e\") " pod="openshift-network-operator/iptables-alerter-v4p88" Jun 11 18:28:03.673979 ip-10-0-130-170 kubenswrapper[2565]: I0611 18:28:03.673815 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/fbbe1b81-aba0-4a02-9e7e-b272155f08ff-host-var-lib-cni-bin\") pod \"multus-pfc8t\" (UID: \"fbbe1b81-aba0-4a02-9e7e-b272155f08ff\") " pod="openshift-multus/multus-pfc8t" Jun 11 18:28:03.673979 ip-10-0-130-170 kubenswrapper[2565]: I0611 18:28:03.673838 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/fbbe1b81-aba0-4a02-9e7e-b272155f08ff-host-run-multus-certs\") pod \"multus-pfc8t\" (UID: \"fbbe1b81-aba0-4a02-9e7e-b272155f08ff\") " pod="openshift-multus/multus-pfc8t" Jun 11 18:28:03.673979 ip-10-0-130-170 kubenswrapper[2565]: I0611 18:28:03.673907 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/0a391608-1cd7-4bb8-8907-2f8e7078bf68-system-cni-dir\") pod \"multus-additional-cni-plugins-7qn5t\" (UID: \"0a391608-1cd7-4bb8-8907-2f8e7078bf68\") " pod="openshift-multus/multus-additional-cni-plugins-7qn5t" Jun 11 18:28:03.673979 ip-10-0-130-170 kubenswrapper[2565]: I0611 18:28:03.673929 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/3335d6c8-7cdf-4a68-a152-49545421f36d-device-dir\") pod \"aws-ebs-csi-driver-node-fbfnw\" (UID: \"3335d6c8-7cdf-4a68-a152-49545421f36d\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-fbfnw" Jun 11 18:28:03.673979 ip-10-0-130-170 kubenswrapper[2565]: I0611 18:28:03.673948 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/5f6a1d9d-054f-4a94-99a3-21b77d4995dd-var-lib-openvswitch\") pod \"ovnkube-node-9xbcp\" (UID: \"5f6a1d9d-054f-4a94-99a3-21b77d4995dd\") " pod="openshift-ovn-kubernetes/ovnkube-node-9xbcp" Jun 11 18:28:03.674191 ip-10-0-130-170 kubenswrapper[2565]: I0611 18:28:03.673982 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/fbbe1b81-aba0-4a02-9e7e-b272155f08ff-host-run-netns\") pod \"multus-pfc8t\" (UID: \"fbbe1b81-aba0-4a02-9e7e-b272155f08ff\") " pod="openshift-multus/multus-pfc8t" Jun 11 18:28:03.674191 ip-10-0-130-170 kubenswrapper[2565]: I0611 18:28:03.674004 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/7f5f862b-4ec0-44cd-96f3-1554a1656229-host\") pod \"node-ca-wwlkz\" (UID: \"7f5f862b-4ec0-44cd-96f3-1554a1656229\") " pod="openshift-image-registry/node-ca-wwlkz" Jun 11 18:28:03.674191 ip-10-0-130-170 kubenswrapper[2565]: I0611 18:28:03.674030 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hg79k\" (UniqueName: \"kubernetes.io/projected/7f5f862b-4ec0-44cd-96f3-1554a1656229-kube-api-access-hg79k\") pod \"node-ca-wwlkz\" (UID: \"7f5f862b-4ec0-44cd-96f3-1554a1656229\") " pod="openshift-image-registry/node-ca-wwlkz" Jun 11 18:28:03.674191 ip-10-0-130-170 kubenswrapper[2565]: I0611 18:28:03.674053 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/c3f907b5-05ec-4fc1-ae51-df0b4b2432fd-etc-systemd\") pod \"tuned-krq26\" (UID: \"c3f907b5-05ec-4fc1-ae51-df0b4b2432fd\") " pod="openshift-cluster-node-tuning-operator/tuned-krq26" Jun 11 18:28:03.674191 ip-10-0-130-170 kubenswrapper[2565]: I0611 18:28:03.674081 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/0a391608-1cd7-4bb8-8907-2f8e7078bf68-cni-binary-copy\") pod \"multus-additional-cni-plugins-7qn5t\" (UID: \"0a391608-1cd7-4bb8-8907-2f8e7078bf68\") " pod="openshift-multus/multus-additional-cni-plugins-7qn5t" Jun 11 18:28:03.674191 ip-10-0-130-170 kubenswrapper[2565]: I0611 18:28:03.674113 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/8e426e7d-dc89-476c-b72a-7cfc3b64a1f2-hosts-file\") pod \"node-resolver-ckltw\" (UID: \"8e426e7d-dc89-476c-b72a-7cfc3b64a1f2\") " pod="openshift-dns/node-resolver-ckltw" Jun 11 18:28:03.674191 ip-10-0-130-170 kubenswrapper[2565]: I0611 18:28:03.674142 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qjm4q\" (UniqueName: \"kubernetes.io/projected/c3f907b5-05ec-4fc1-ae51-df0b4b2432fd-kube-api-access-qjm4q\") pod \"tuned-krq26\" (UID: \"c3f907b5-05ec-4fc1-ae51-df0b4b2432fd\") " pod="openshift-cluster-node-tuning-operator/tuned-krq26" Jun 11 18:28:03.674191 ip-10-0-130-170 kubenswrapper[2565]: I0611 18:28:03.674163 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/fbbe1b81-aba0-4a02-9e7e-b272155f08ff-system-cni-dir\") pod \"multus-pfc8t\" (UID: \"fbbe1b81-aba0-4a02-9e7e-b272155f08ff\") " pod="openshift-multus/multus-pfc8t" Jun 11 18:28:03.674191 ip-10-0-130-170 kubenswrapper[2565]: I0611 18:28:03.674185 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/b36592f7-5d47-450e-bb47-12b43070bbf1-konnectivity-ca\") pod \"konnectivity-agent-rv8x7\" (UID: \"b36592f7-5d47-450e-bb47-12b43070bbf1\") " pod="kube-system/konnectivity-agent-rv8x7" Jun 11 18:28:03.674524 ip-10-0-130-170 kubenswrapper[2565]: I0611 18:28:03.674221 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/3335d6c8-7cdf-4a68-a152-49545421f36d-sys-fs\") pod \"aws-ebs-csi-driver-node-fbfnw\" (UID: \"3335d6c8-7cdf-4a68-a152-49545421f36d\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-fbfnw" Jun 11 18:28:03.674524 ip-10-0-130-170 kubenswrapper[2565]: I0611 18:28:03.674245 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-kzmpp\" (UniqueName: \"kubernetes.io/projected/3335d6c8-7cdf-4a68-a152-49545421f36d-kube-api-access-kzmpp\") pod \"aws-ebs-csi-driver-node-fbfnw\" (UID: \"3335d6c8-7cdf-4a68-a152-49545421f36d\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-fbfnw" Jun 11 18:28:03.674524 ip-10-0-130-170 kubenswrapper[2565]: I0611 18:28:03.674304 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xcffv\" (UniqueName: \"kubernetes.io/projected/2f4a1ff8-558e-4d9b-9208-ca0211b2b4e1-kube-api-access-xcffv\") pod \"network-metrics-daemon-bvwxp\" (UID: \"2f4a1ff8-558e-4d9b-9208-ca0211b2b4e1\") " pod="openshift-multus/network-metrics-daemon-bvwxp" Jun 11 18:28:03.674524 ip-10-0-130-170 kubenswrapper[2565]: I0611 18:28:03.674328 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/c3f907b5-05ec-4fc1-ae51-df0b4b2432fd-etc-kubernetes\") pod \"tuned-krq26\" (UID: \"c3f907b5-05ec-4fc1-ae51-df0b4b2432fd\") " pod="openshift-cluster-node-tuning-operator/tuned-krq26" Jun 11 18:28:03.674524 ip-10-0-130-170 kubenswrapper[2565]: I0611 18:28:03.674353 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-tlldj\" (UniqueName: \"kubernetes.io/projected/5f6a1d9d-054f-4a94-99a3-21b77d4995dd-kube-api-access-tlldj\") pod \"ovnkube-node-9xbcp\" (UID: \"5f6a1d9d-054f-4a94-99a3-21b77d4995dd\") " pod="openshift-ovn-kubernetes/ovnkube-node-9xbcp" Jun 11 18:28:03.674524 ip-10-0-130-170 kubenswrapper[2565]: I0611 18:28:03.674376 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/fbbe1b81-aba0-4a02-9e7e-b272155f08ff-multus-conf-dir\") pod \"multus-pfc8t\" (UID: \"fbbe1b81-aba0-4a02-9e7e-b272155f08ff\") " pod="openshift-multus/multus-pfc8t" Jun 11 18:28:03.674524 ip-10-0-130-170 kubenswrapper[2565]: I0611 18:28:03.674400 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/fbbe1b81-aba0-4a02-9e7e-b272155f08ff-etc-kubernetes\") pod \"multus-pfc8t\" (UID: \"fbbe1b81-aba0-4a02-9e7e-b272155f08ff\") " pod="openshift-multus/multus-pfc8t" Jun 11 18:28:03.674524 ip-10-0-130-170 kubenswrapper[2565]: I0611 18:28:03.674424 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/0a391608-1cd7-4bb8-8907-2f8e7078bf68-os-release\") pod \"multus-additional-cni-plugins-7qn5t\" (UID: \"0a391608-1cd7-4bb8-8907-2f8e7078bf68\") " pod="openshift-multus/multus-additional-cni-plugins-7qn5t" Jun 11 18:28:03.674524 ip-10-0-130-170 kubenswrapper[2565]: I0611 18:28:03.674446 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/5f6a1d9d-054f-4a94-99a3-21b77d4995dd-run-systemd\") pod \"ovnkube-node-9xbcp\" (UID: \"5f6a1d9d-054f-4a94-99a3-21b77d4995dd\") " pod="openshift-ovn-kubernetes/ovnkube-node-9xbcp" Jun 11 18:28:03.674524 ip-10-0-130-170 kubenswrapper[2565]: I0611 18:28:03.674475 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/5f6a1d9d-054f-4a94-99a3-21b77d4995dd-ovnkube-script-lib\") pod \"ovnkube-node-9xbcp\" (UID: \"5f6a1d9d-054f-4a94-99a3-21b77d4995dd\") " pod="openshift-ovn-kubernetes/ovnkube-node-9xbcp" Jun 11 18:28:03.674524 ip-10-0-130-170 kubenswrapper[2565]: I0611 18:28:03.674496 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/0a391608-1cd7-4bb8-8907-2f8e7078bf68-cnibin\") pod \"multus-additional-cni-plugins-7qn5t\" (UID: \"0a391608-1cd7-4bb8-8907-2f8e7078bf68\") " pod="openshift-multus/multus-additional-cni-plugins-7qn5t" Jun 11 18:28:03.674971 ip-10-0-130-170 kubenswrapper[2565]: I0611 18:28:03.674532 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/fbbe1b81-aba0-4a02-9e7e-b272155f08ff-cnibin\") pod \"multus-pfc8t\" (UID: \"fbbe1b81-aba0-4a02-9e7e-b272155f08ff\") " pod="openshift-multus/multus-pfc8t" Jun 11 18:28:03.674971 ip-10-0-130-170 kubenswrapper[2565]: I0611 18:28:03.674563 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/fbbe1b81-aba0-4a02-9e7e-b272155f08ff-os-release\") pod \"multus-pfc8t\" (UID: \"fbbe1b81-aba0-4a02-9e7e-b272155f08ff\") " pod="openshift-multus/multus-pfc8t" Jun 11 18:28:03.674971 ip-10-0-130-170 kubenswrapper[2565]: I0611 18:28:03.674589 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/fbbe1b81-aba0-4a02-9e7e-b272155f08ff-host-var-lib-cni-multus\") pod \"multus-pfc8t\" (UID: \"fbbe1b81-aba0-4a02-9e7e-b272155f08ff\") " pod="openshift-multus/multus-pfc8t" Jun 11 18:28:03.674971 ip-10-0-130-170 kubenswrapper[2565]: I0611 18:28:03.674613 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/7f5f862b-4ec0-44cd-96f3-1554a1656229-serviceca\") pod \"node-ca-wwlkz\" (UID: \"7f5f862b-4ec0-44cd-96f3-1554a1656229\") " pod="openshift-image-registry/node-ca-wwlkz" Jun 11 18:28:03.674971 ip-10-0-130-170 kubenswrapper[2565]: I0611 18:28:03.674637 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/0a391608-1cd7-4bb8-8907-2f8e7078bf68-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-7qn5t\" (UID: \"0a391608-1cd7-4bb8-8907-2f8e7078bf68\") " pod="openshift-multus/multus-additional-cni-plugins-7qn5t" Jun 11 18:28:03.674971 ip-10-0-130-170 kubenswrapper[2565]: I0611 18:28:03.674660 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/c3f907b5-05ec-4fc1-ae51-df0b4b2432fd-etc-modprobe-d\") pod \"tuned-krq26\" (UID: \"c3f907b5-05ec-4fc1-ae51-df0b4b2432fd\") " pod="openshift-cluster-node-tuning-operator/tuned-krq26" Jun 11 18:28:03.674971 ip-10-0-130-170 kubenswrapper[2565]: I0611 18:28:03.674681 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/5f6a1d9d-054f-4a94-99a3-21b77d4995dd-host-kubelet\") pod \"ovnkube-node-9xbcp\" (UID: \"5f6a1d9d-054f-4a94-99a3-21b77d4995dd\") " pod="openshift-ovn-kubernetes/ovnkube-node-9xbcp" Jun 11 18:28:03.674971 ip-10-0-130-170 kubenswrapper[2565]: I0611 18:28:03.674705 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-r7m48\" (UniqueName: \"kubernetes.io/projected/7a08c57b-6d27-43b1-8518-7d2564aa682e-kube-api-access-r7m48\") pod \"iptables-alerter-v4p88\" (UID: \"7a08c57b-6d27-43b1-8518-7d2564aa682e\") " pod="openshift-network-operator/iptables-alerter-v4p88" Jun 11 18:28:03.675323 ip-10-0-130-170 kubenswrapper[2565]: I0611 18:28:03.675220 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/3335d6c8-7cdf-4a68-a152-49545421f36d-etc-selinux\") pod \"aws-ebs-csi-driver-node-fbfnw\" (UID: \"3335d6c8-7cdf-4a68-a152-49545421f36d\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-fbfnw" Jun 11 18:28:03.675955 ip-10-0-130-170 kubenswrapper[2565]: I0611 18:28:03.675301 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/2f4a1ff8-558e-4d9b-9208-ca0211b2b4e1-metrics-certs\") pod \"network-metrics-daemon-bvwxp\" (UID: \"2f4a1ff8-558e-4d9b-9208-ca0211b2b4e1\") " pod="openshift-multus/network-metrics-daemon-bvwxp" Jun 11 18:28:03.675955 ip-10-0-130-170 kubenswrapper[2565]: I0611 18:28:03.675872 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/c3f907b5-05ec-4fc1-ae51-df0b4b2432fd-lib-modules\") pod \"tuned-krq26\" (UID: \"c3f907b5-05ec-4fc1-ae51-df0b4b2432fd\") " pod="openshift-cluster-node-tuning-operator/tuned-krq26" Jun 11 18:28:03.675955 ip-10-0-130-170 kubenswrapper[2565]: I0611 18:28:03.675909 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/c3f907b5-05ec-4fc1-ae51-df0b4b2432fd-host\") pod \"tuned-krq26\" (UID: \"c3f907b5-05ec-4fc1-ae51-df0b4b2432fd\") " pod="openshift-cluster-node-tuning-operator/tuned-krq26" Jun 11 18:28:03.676117 ip-10-0-130-170 kubenswrapper[2565]: I0611 18:28:03.675944 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/5f6a1d9d-054f-4a94-99a3-21b77d4995dd-log-socket\") pod \"ovnkube-node-9xbcp\" (UID: \"5f6a1d9d-054f-4a94-99a3-21b77d4995dd\") " pod="openshift-ovn-kubernetes/ovnkube-node-9xbcp" Jun 11 18:28:03.676117 ip-10-0-130-170 kubenswrapper[2565]: I0611 18:28:03.676064 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/1f1530cc-c788-4dc5-9e3d-7209386e9b94-original-pull-secret\") pod \"global-pull-secret-syncer-wqbfv\" (UID: \"1f1530cc-c788-4dc5-9e3d-7209386e9b94\") " pod="kube-system/global-pull-secret-syncer-wqbfv" Jun 11 18:28:03.676117 ip-10-0-130-170 kubenswrapper[2565]: I0611 18:28:03.676097 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/0a391608-1cd7-4bb8-8907-2f8e7078bf68-tuning-conf-dir\") pod \"multus-additional-cni-plugins-7qn5t\" (UID: \"0a391608-1cd7-4bb8-8907-2f8e7078bf68\") " pod="openshift-multus/multus-additional-cni-plugins-7qn5t" Jun 11 18:28:03.676285 ip-10-0-130-170 kubenswrapper[2565]: I0611 18:28:03.676127 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/3335d6c8-7cdf-4a68-a152-49545421f36d-registration-dir\") pod \"aws-ebs-csi-driver-node-fbfnw\" (UID: \"3335d6c8-7cdf-4a68-a152-49545421f36d\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-fbfnw" Jun 11 18:28:03.676285 ip-10-0-130-170 kubenswrapper[2565]: I0611 18:28:03.676149 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/c3f907b5-05ec-4fc1-ae51-df0b4b2432fd-var-lib-kubelet\") pod \"tuned-krq26\" (UID: \"c3f907b5-05ec-4fc1-ae51-df0b4b2432fd\") " pod="openshift-cluster-node-tuning-operator/tuned-krq26" Jun 11 18:28:03.676285 ip-10-0-130-170 kubenswrapper[2565]: I0611 18:28:03.676246 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/5f6a1d9d-054f-4a94-99a3-21b77d4995dd-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-9xbcp\" (UID: \"5f6a1d9d-054f-4a94-99a3-21b77d4995dd\") " pod="openshift-ovn-kubernetes/ovnkube-node-9xbcp" Jun 11 18:28:03.676433 ip-10-0-130-170 kubenswrapper[2565]: I0611 18:28:03.676303 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/5f6a1d9d-054f-4a94-99a3-21b77d4995dd-ovn-node-metrics-cert\") pod \"ovnkube-node-9xbcp\" (UID: \"5f6a1d9d-054f-4a94-99a3-21b77d4995dd\") " pod="openshift-ovn-kubernetes/ovnkube-node-9xbcp" Jun 11 18:28:03.676433 ip-10-0-130-170 kubenswrapper[2565]: I0611 18:28:03.676332 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-m4khc\" (UniqueName: \"kubernetes.io/projected/8e426e7d-dc89-476c-b72a-7cfc3b64a1f2-kube-api-access-m4khc\") pod \"node-resolver-ckltw\" (UID: \"8e426e7d-dc89-476c-b72a-7cfc3b64a1f2\") " pod="openshift-dns/node-resolver-ckltw" Jun 11 18:28:03.676526 ip-10-0-130-170 kubenswrapper[2565]: I0611 18:28:03.676460 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/5f6a1d9d-054f-4a94-99a3-21b77d4995dd-host-run-netns\") pod \"ovnkube-node-9xbcp\" (UID: \"5f6a1d9d-054f-4a94-99a3-21b77d4995dd\") " pod="openshift-ovn-kubernetes/ovnkube-node-9xbcp" Jun 11 18:28:03.676526 ip-10-0-130-170 kubenswrapper[2565]: I0611 18:28:03.676493 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/fbbe1b81-aba0-4a02-9e7e-b272155f08ff-multus-socket-dir-parent\") pod \"multus-pfc8t\" (UID: \"fbbe1b81-aba0-4a02-9e7e-b272155f08ff\") " pod="openshift-multus/multus-pfc8t" Jun 11 18:28:03.676624 ip-10-0-130-170 kubenswrapper[2565]: I0611 18:28:03.676525 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/fbbe1b81-aba0-4a02-9e7e-b272155f08ff-host-run-k8s-cni-cncf-io\") pod \"multus-pfc8t\" (UID: \"fbbe1b81-aba0-4a02-9e7e-b272155f08ff\") " pod="openshift-multus/multus-pfc8t" Jun 11 18:28:03.676624 ip-10-0-130-170 kubenswrapper[2565]: I0611 18:28:03.676585 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/fbbe1b81-aba0-4a02-9e7e-b272155f08ff-host-var-lib-kubelet\") pod \"multus-pfc8t\" (UID: \"fbbe1b81-aba0-4a02-9e7e-b272155f08ff\") " pod="openshift-multus/multus-pfc8t" Jun 11 18:28:03.676713 ip-10-0-130-170 kubenswrapper[2565]: I0611 18:28:03.676636 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/fbbe1b81-aba0-4a02-9e7e-b272155f08ff-hostroot\") pod \"multus-pfc8t\" (UID: \"fbbe1b81-aba0-4a02-9e7e-b272155f08ff\") " pod="openshift-multus/multus-pfc8t" Jun 11 18:28:03.676842 ip-10-0-130-170 kubenswrapper[2565]: I0611 18:28:03.676817 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/fbbe1b81-aba0-4a02-9e7e-b272155f08ff-multus-daemon-config\") pod \"multus-pfc8t\" (UID: \"fbbe1b81-aba0-4a02-9e7e-b272155f08ff\") " pod="openshift-multus/multus-pfc8t" Jun 11 18:28:03.677210 ip-10-0-130-170 kubenswrapper[2565]: I0611 18:28:03.677192 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/3335d6c8-7cdf-4a68-a152-49545421f36d-kubelet-dir\") pod \"aws-ebs-csi-driver-node-fbfnw\" (UID: \"3335d6c8-7cdf-4a68-a152-49545421f36d\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-fbfnw" Jun 11 18:28:03.677291 ip-10-0-130-170 kubenswrapper[2565]: I0611 18:28:03.677223 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/b36592f7-5d47-450e-bb47-12b43070bbf1-agent-certs\") pod \"konnectivity-agent-rv8x7\" (UID: \"b36592f7-5d47-450e-bb47-12b43070bbf1\") " pod="kube-system/konnectivity-agent-rv8x7" Jun 11 18:28:03.677291 ip-10-0-130-170 kubenswrapper[2565]: I0611 18:28:03.677280 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/5f6a1d9d-054f-4a94-99a3-21b77d4995dd-systemd-units\") pod \"ovnkube-node-9xbcp\" (UID: \"5f6a1d9d-054f-4a94-99a3-21b77d4995dd\") " pod="openshift-ovn-kubernetes/ovnkube-node-9xbcp" Jun 11 18:28:03.677380 ip-10-0-130-170 kubenswrapper[2565]: I0611 18:28:03.677303 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/5f6a1d9d-054f-4a94-99a3-21b77d4995dd-host-cni-bin\") pod \"ovnkube-node-9xbcp\" (UID: \"5f6a1d9d-054f-4a94-99a3-21b77d4995dd\") " pod="openshift-ovn-kubernetes/ovnkube-node-9xbcp" Jun 11 18:28:03.677380 ip-10-0-130-170 kubenswrapper[2565]: I0611 18:28:03.677321 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/7a08c57b-6d27-43b1-8518-7d2564aa682e-host-slash\") pod \"iptables-alerter-v4p88\" (UID: \"7a08c57b-6d27-43b1-8518-7d2564aa682e\") " pod="openshift-network-operator/iptables-alerter-v4p88" Jun 11 18:28:03.677380 ip-10-0-130-170 kubenswrapper[2565]: I0611 18:28:03.677346 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/c3f907b5-05ec-4fc1-ae51-df0b4b2432fd-etc-tuned\") pod \"tuned-krq26\" (UID: \"c3f907b5-05ec-4fc1-ae51-df0b4b2432fd\") " pod="openshift-cluster-node-tuning-operator/tuned-krq26" Jun 11 18:28:03.677380 ip-10-0-130-170 kubenswrapper[2565]: I0611 18:28:03.677375 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/5f6a1d9d-054f-4a94-99a3-21b77d4995dd-etc-openvswitch\") pod \"ovnkube-node-9xbcp\" (UID: \"5f6a1d9d-054f-4a94-99a3-21b77d4995dd\") " pod="openshift-ovn-kubernetes/ovnkube-node-9xbcp" Jun 11 18:28:03.677592 ip-10-0-130-170 kubenswrapper[2565]: I0611 18:28:03.677412 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/5f6a1d9d-054f-4a94-99a3-21b77d4995dd-node-log\") pod \"ovnkube-node-9xbcp\" (UID: \"5f6a1d9d-054f-4a94-99a3-21b77d4995dd\") " pod="openshift-ovn-kubernetes/ovnkube-node-9xbcp" Jun 11 18:28:03.677592 ip-10-0-130-170 kubenswrapper[2565]: I0611 18:28:03.677463 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/5f6a1d9d-054f-4a94-99a3-21b77d4995dd-host-cni-netd\") pod \"ovnkube-node-9xbcp\" (UID: \"5f6a1d9d-054f-4a94-99a3-21b77d4995dd\") " pod="openshift-ovn-kubernetes/ovnkube-node-9xbcp" Jun 11 18:28:03.677592 ip-10-0-130-170 kubenswrapper[2565]: I0611 18:28:03.677504 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/1f1530cc-c788-4dc5-9e3d-7209386e9b94-kubelet-config\") pod \"global-pull-secret-syncer-wqbfv\" (UID: \"1f1530cc-c788-4dc5-9e3d-7209386e9b94\") " pod="kube-system/global-pull-secret-syncer-wqbfv" Jun 11 18:28:03.677722 ip-10-0-130-170 kubenswrapper[2565]: I0611 18:28:03.677612 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vx5cz\" (UniqueName: \"kubernetes.io/projected/0a391608-1cd7-4bb8-8907-2f8e7078bf68-kube-api-access-vx5cz\") pod \"multus-additional-cni-plugins-7qn5t\" (UID: \"0a391608-1cd7-4bb8-8907-2f8e7078bf68\") " pod="openshift-multus/multus-additional-cni-plugins-7qn5t" Jun 11 18:28:03.677722 ip-10-0-130-170 kubenswrapper[2565]: I0611 18:28:03.677656 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/3335d6c8-7cdf-4a68-a152-49545421f36d-socket-dir\") pod \"aws-ebs-csi-driver-node-fbfnw\" (UID: \"3335d6c8-7cdf-4a68-a152-49545421f36d\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-fbfnw" Jun 11 18:28:03.677722 ip-10-0-130-170 kubenswrapper[2565]: I0611 18:28:03.677685 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/c3f907b5-05ec-4fc1-ae51-df0b4b2432fd-etc-sysctl-d\") pod \"tuned-krq26\" (UID: \"c3f907b5-05ec-4fc1-ae51-df0b4b2432fd\") " pod="openshift-cluster-node-tuning-operator/tuned-krq26" Jun 11 18:28:03.677722 ip-10-0-130-170 kubenswrapper[2565]: I0611 18:28:03.677714 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/c3f907b5-05ec-4fc1-ae51-df0b4b2432fd-etc-sysctl-conf\") pod \"tuned-krq26\" (UID: \"c3f907b5-05ec-4fc1-ae51-df0b4b2432fd\") " pod="openshift-cluster-node-tuning-operator/tuned-krq26" Jun 11 18:28:03.677907 ip-10-0-130-170 kubenswrapper[2565]: I0611 18:28:03.677743 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/5f6a1d9d-054f-4a94-99a3-21b77d4995dd-host-slash\") pod \"ovnkube-node-9xbcp\" (UID: \"5f6a1d9d-054f-4a94-99a3-21b77d4995dd\") " pod="openshift-ovn-kubernetes/ovnkube-node-9xbcp" Jun 11 18:28:03.677907 ip-10-0-130-170 kubenswrapper[2565]: I0611 18:28:03.677782 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/0a391608-1cd7-4bb8-8907-2f8e7078bf68-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-7qn5t\" (UID: \"0a391608-1cd7-4bb8-8907-2f8e7078bf68\") " pod="openshift-multus/multus-additional-cni-plugins-7qn5t" Jun 11 18:28:03.677907 ip-10-0-130-170 kubenswrapper[2565]: I0611 18:28:03.677814 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/8e426e7d-dc89-476c-b72a-7cfc3b64a1f2-tmp-dir\") pod \"node-resolver-ckltw\" (UID: \"8e426e7d-dc89-476c-b72a-7cfc3b64a1f2\") " pod="openshift-dns/node-resolver-ckltw" Jun 11 18:28:03.677907 ip-10-0-130-170 kubenswrapper[2565]: I0611 18:28:03.677842 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/1f1530cc-c788-4dc5-9e3d-7209386e9b94-dbus\") pod \"global-pull-secret-syncer-wqbfv\" (UID: \"1f1530cc-c788-4dc5-9e3d-7209386e9b94\") " pod="kube-system/global-pull-secret-syncer-wqbfv" Jun 11 18:28:03.677907 ip-10-0-130-170 kubenswrapper[2565]: I0611 18:28:03.677871 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/c3f907b5-05ec-4fc1-ae51-df0b4b2432fd-etc-sysconfig\") pod \"tuned-krq26\" (UID: \"c3f907b5-05ec-4fc1-ae51-df0b4b2432fd\") " pod="openshift-cluster-node-tuning-operator/tuned-krq26" Jun 11 18:28:03.677907 ip-10-0-130-170 kubenswrapper[2565]: I0611 18:28:03.677902 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/5f6a1d9d-054f-4a94-99a3-21b77d4995dd-run-ovn\") pod \"ovnkube-node-9xbcp\" (UID: \"5f6a1d9d-054f-4a94-99a3-21b77d4995dd\") " pod="openshift-ovn-kubernetes/ovnkube-node-9xbcp" Jun 11 18:28:03.678214 ip-10-0-130-170 kubenswrapper[2565]: I0611 18:28:03.677934 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/5f6a1d9d-054f-4a94-99a3-21b77d4995dd-env-overrides\") pod \"ovnkube-node-9xbcp\" (UID: \"5f6a1d9d-054f-4a94-99a3-21b77d4995dd\") " pod="openshift-ovn-kubernetes/ovnkube-node-9xbcp" Jun 11 18:28:03.678214 ip-10-0-130-170 kubenswrapper[2565]: I0611 18:28:03.677963 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/fbbe1b81-aba0-4a02-9e7e-b272155f08ff-multus-cni-dir\") pod \"multus-pfc8t\" (UID: \"fbbe1b81-aba0-4a02-9e7e-b272155f08ff\") " pod="openshift-multus/multus-pfc8t" Jun 11 18:28:03.678214 ip-10-0-130-170 kubenswrapper[2565]: I0611 18:28:03.678015 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/c3f907b5-05ec-4fc1-ae51-df0b4b2432fd-run\") pod \"tuned-krq26\" (UID: \"c3f907b5-05ec-4fc1-ae51-df0b4b2432fd\") " pod="openshift-cluster-node-tuning-operator/tuned-krq26" Jun 11 18:28:03.678214 ip-10-0-130-170 kubenswrapper[2565]: I0611 18:28:03.678050 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/5f6a1d9d-054f-4a94-99a3-21b77d4995dd-ovnkube-config\") pod \"ovnkube-node-9xbcp\" (UID: \"5f6a1d9d-054f-4a94-99a3-21b77d4995dd\") " pod="openshift-ovn-kubernetes/ovnkube-node-9xbcp" Jun 11 18:28:03.678214 ip-10-0-130-170 kubenswrapper[2565]: I0611 18:28:03.678073 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/fbbe1b81-aba0-4a02-9e7e-b272155f08ff-cni-binary-copy\") pod \"multus-pfc8t\" (UID: \"fbbe1b81-aba0-4a02-9e7e-b272155f08ff\") " pod="openshift-multus/multus-pfc8t" Jun 11 18:28:03.678214 ip-10-0-130-170 kubenswrapper[2565]: I0611 18:28:03.678101 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-z5fkw\" (UniqueName: \"kubernetes.io/projected/fbbe1b81-aba0-4a02-9e7e-b272155f08ff-kube-api-access-z5fkw\") pod \"multus-pfc8t\" (UID: \"fbbe1b81-aba0-4a02-9e7e-b272155f08ff\") " pod="openshift-multus/multus-pfc8t" Jun 11 18:28:03.679457 ip-10-0-130-170 kubenswrapper[2565]: I0611 18:28:03.679438 2565 reflector.go:439] "Caches populated" logger="kubernetes.io/kubelet-serving" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162" Jun 11 18:28:03.698031 ip-10-0-130-170 kubenswrapper[2565]: I0611 18:28:03.698010 2565 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kubelet-serving" csr="csr-jfkcs" Jun 11 18:28:03.709286 ip-10-0-130-170 kubenswrapper[2565]: I0611 18:28:03.709245 2565 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kubelet-serving" csr="csr-jfkcs" Jun 11 18:28:03.779184 ip-10-0-130-170 kubenswrapper[2565]: I0611 18:28:03.779152 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/fbbe1b81-aba0-4a02-9e7e-b272155f08ff-host-var-lib-kubelet\") pod \"multus-pfc8t\" (UID: \"fbbe1b81-aba0-4a02-9e7e-b272155f08ff\") " pod="openshift-multus/multus-pfc8t" Jun 11 18:28:03.779184 ip-10-0-130-170 kubenswrapper[2565]: I0611 18:28:03.779194 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/fbbe1b81-aba0-4a02-9e7e-b272155f08ff-hostroot\") pod \"multus-pfc8t\" (UID: \"fbbe1b81-aba0-4a02-9e7e-b272155f08ff\") " pod="openshift-multus/multus-pfc8t" Jun 11 18:28:03.779412 ip-10-0-130-170 kubenswrapper[2565]: I0611 18:28:03.779226 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/fbbe1b81-aba0-4a02-9e7e-b272155f08ff-multus-daemon-config\") pod \"multus-pfc8t\" (UID: \"fbbe1b81-aba0-4a02-9e7e-b272155f08ff\") " pod="openshift-multus/multus-pfc8t" Jun 11 18:28:03.779412 ip-10-0-130-170 kubenswrapper[2565]: I0611 18:28:03.779269 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/3335d6c8-7cdf-4a68-a152-49545421f36d-kubelet-dir\") pod \"aws-ebs-csi-driver-node-fbfnw\" (UID: \"3335d6c8-7cdf-4a68-a152-49545421f36d\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-fbfnw" Jun 11 18:28:03.779412 ip-10-0-130-170 kubenswrapper[2565]: I0611 18:28:03.779290 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/fbbe1b81-aba0-4a02-9e7e-b272155f08ff-host-var-lib-kubelet\") pod \"multus-pfc8t\" (UID: \"fbbe1b81-aba0-4a02-9e7e-b272155f08ff\") " pod="openshift-multus/multus-pfc8t" Jun 11 18:28:03.779412 ip-10-0-130-170 kubenswrapper[2565]: I0611 18:28:03.779341 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/fbbe1b81-aba0-4a02-9e7e-b272155f08ff-hostroot\") pod \"multus-pfc8t\" (UID: \"fbbe1b81-aba0-4a02-9e7e-b272155f08ff\") " pod="openshift-multus/multus-pfc8t" Jun 11 18:28:03.779412 ip-10-0-130-170 kubenswrapper[2565]: I0611 18:28:03.779360 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/3335d6c8-7cdf-4a68-a152-49545421f36d-kubelet-dir\") pod \"aws-ebs-csi-driver-node-fbfnw\" (UID: \"3335d6c8-7cdf-4a68-a152-49545421f36d\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-fbfnw" Jun 11 18:28:03.779412 ip-10-0-130-170 kubenswrapper[2565]: I0611 18:28:03.779297 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/b36592f7-5d47-450e-bb47-12b43070bbf1-agent-certs\") pod \"konnectivity-agent-rv8x7\" (UID: \"b36592f7-5d47-450e-bb47-12b43070bbf1\") " pod="kube-system/konnectivity-agent-rv8x7" Jun 11 18:28:03.779412 ip-10-0-130-170 kubenswrapper[2565]: I0611 18:28:03.779403 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/5f6a1d9d-054f-4a94-99a3-21b77d4995dd-systemd-units\") pod \"ovnkube-node-9xbcp\" (UID: \"5f6a1d9d-054f-4a94-99a3-21b77d4995dd\") " pod="openshift-ovn-kubernetes/ovnkube-node-9xbcp" Jun 11 18:28:03.779622 ip-10-0-130-170 kubenswrapper[2565]: I0611 18:28:03.779420 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/5f6a1d9d-054f-4a94-99a3-21b77d4995dd-host-cni-bin\") pod \"ovnkube-node-9xbcp\" (UID: \"5f6a1d9d-054f-4a94-99a3-21b77d4995dd\") " pod="openshift-ovn-kubernetes/ovnkube-node-9xbcp" Jun 11 18:28:03.779622 ip-10-0-130-170 kubenswrapper[2565]: I0611 18:28:03.779445 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/7a08c57b-6d27-43b1-8518-7d2564aa682e-host-slash\") pod \"iptables-alerter-v4p88\" (UID: \"7a08c57b-6d27-43b1-8518-7d2564aa682e\") " pod="openshift-network-operator/iptables-alerter-v4p88" Jun 11 18:28:03.779622 ip-10-0-130-170 kubenswrapper[2565]: I0611 18:28:03.779461 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/c3f907b5-05ec-4fc1-ae51-df0b4b2432fd-etc-tuned\") pod \"tuned-krq26\" (UID: \"c3f907b5-05ec-4fc1-ae51-df0b4b2432fd\") " pod="openshift-cluster-node-tuning-operator/tuned-krq26" Jun 11 18:28:03.779622 ip-10-0-130-170 kubenswrapper[2565]: I0611 18:28:03.779475 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/5f6a1d9d-054f-4a94-99a3-21b77d4995dd-etc-openvswitch\") pod \"ovnkube-node-9xbcp\" (UID: \"5f6a1d9d-054f-4a94-99a3-21b77d4995dd\") " pod="openshift-ovn-kubernetes/ovnkube-node-9xbcp" Jun 11 18:28:03.779622 ip-10-0-130-170 kubenswrapper[2565]: I0611 18:28:03.779491 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/5f6a1d9d-054f-4a94-99a3-21b77d4995dd-node-log\") pod \"ovnkube-node-9xbcp\" (UID: \"5f6a1d9d-054f-4a94-99a3-21b77d4995dd\") " pod="openshift-ovn-kubernetes/ovnkube-node-9xbcp" Jun 11 18:28:03.779622 ip-10-0-130-170 kubenswrapper[2565]: I0611 18:28:03.779515 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/5f6a1d9d-054f-4a94-99a3-21b77d4995dd-host-cni-netd\") pod \"ovnkube-node-9xbcp\" (UID: \"5f6a1d9d-054f-4a94-99a3-21b77d4995dd\") " pod="openshift-ovn-kubernetes/ovnkube-node-9xbcp" Jun 11 18:28:03.779622 ip-10-0-130-170 kubenswrapper[2565]: I0611 18:28:03.779532 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/1f1530cc-c788-4dc5-9e3d-7209386e9b94-kubelet-config\") pod \"global-pull-secret-syncer-wqbfv\" (UID: \"1f1530cc-c788-4dc5-9e3d-7209386e9b94\") " pod="kube-system/global-pull-secret-syncer-wqbfv" Jun 11 18:28:03.779622 ip-10-0-130-170 kubenswrapper[2565]: I0611 18:28:03.779548 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vx5cz\" (UniqueName: \"kubernetes.io/projected/0a391608-1cd7-4bb8-8907-2f8e7078bf68-kube-api-access-vx5cz\") pod \"multus-additional-cni-plugins-7qn5t\" (UID: \"0a391608-1cd7-4bb8-8907-2f8e7078bf68\") " pod="openshift-multus/multus-additional-cni-plugins-7qn5t" Jun 11 18:28:03.779622 ip-10-0-130-170 kubenswrapper[2565]: I0611 18:28:03.779566 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/3335d6c8-7cdf-4a68-a152-49545421f36d-socket-dir\") pod \"aws-ebs-csi-driver-node-fbfnw\" (UID: \"3335d6c8-7cdf-4a68-a152-49545421f36d\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-fbfnw" Jun 11 18:28:03.779622 ip-10-0-130-170 kubenswrapper[2565]: I0611 18:28:03.779595 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/c3f907b5-05ec-4fc1-ae51-df0b4b2432fd-etc-sysctl-d\") pod \"tuned-krq26\" (UID: \"c3f907b5-05ec-4fc1-ae51-df0b4b2432fd\") " pod="openshift-cluster-node-tuning-operator/tuned-krq26" Jun 11 18:28:03.779622 ip-10-0-130-170 kubenswrapper[2565]: I0611 18:28:03.779617 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/c3f907b5-05ec-4fc1-ae51-df0b4b2432fd-etc-sysctl-conf\") pod \"tuned-krq26\" (UID: \"c3f907b5-05ec-4fc1-ae51-df0b4b2432fd\") " pod="openshift-cluster-node-tuning-operator/tuned-krq26" Jun 11 18:28:03.779913 ip-10-0-130-170 kubenswrapper[2565]: I0611 18:28:03.779634 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/5f6a1d9d-054f-4a94-99a3-21b77d4995dd-host-slash\") pod \"ovnkube-node-9xbcp\" (UID: \"5f6a1d9d-054f-4a94-99a3-21b77d4995dd\") " pod="openshift-ovn-kubernetes/ovnkube-node-9xbcp" Jun 11 18:28:03.779913 ip-10-0-130-170 kubenswrapper[2565]: I0611 18:28:03.779651 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/0a391608-1cd7-4bb8-8907-2f8e7078bf68-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-7qn5t\" (UID: \"0a391608-1cd7-4bb8-8907-2f8e7078bf68\") " pod="openshift-multus/multus-additional-cni-plugins-7qn5t" Jun 11 18:28:03.779913 ip-10-0-130-170 kubenswrapper[2565]: I0611 18:28:03.779668 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/8e426e7d-dc89-476c-b72a-7cfc3b64a1f2-tmp-dir\") pod \"node-resolver-ckltw\" (UID: \"8e426e7d-dc89-476c-b72a-7cfc3b64a1f2\") " pod="openshift-dns/node-resolver-ckltw" Jun 11 18:28:03.779913 ip-10-0-130-170 kubenswrapper[2565]: I0611 18:28:03.779683 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/1f1530cc-c788-4dc5-9e3d-7209386e9b94-dbus\") pod \"global-pull-secret-syncer-wqbfv\" (UID: \"1f1530cc-c788-4dc5-9e3d-7209386e9b94\") " pod="kube-system/global-pull-secret-syncer-wqbfv" Jun 11 18:28:03.779913 ip-10-0-130-170 kubenswrapper[2565]: I0611 18:28:03.779708 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/c3f907b5-05ec-4fc1-ae51-df0b4b2432fd-etc-sysconfig\") pod \"tuned-krq26\" (UID: \"c3f907b5-05ec-4fc1-ae51-df0b4b2432fd\") " pod="openshift-cluster-node-tuning-operator/tuned-krq26" Jun 11 18:28:03.779913 ip-10-0-130-170 kubenswrapper[2565]: I0611 18:28:03.779727 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/5f6a1d9d-054f-4a94-99a3-21b77d4995dd-run-ovn\") pod \"ovnkube-node-9xbcp\" (UID: \"5f6a1d9d-054f-4a94-99a3-21b77d4995dd\") " pod="openshift-ovn-kubernetes/ovnkube-node-9xbcp" Jun 11 18:28:03.779913 ip-10-0-130-170 kubenswrapper[2565]: I0611 18:28:03.779741 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/5f6a1d9d-054f-4a94-99a3-21b77d4995dd-env-overrides\") pod \"ovnkube-node-9xbcp\" (UID: \"5f6a1d9d-054f-4a94-99a3-21b77d4995dd\") " pod="openshift-ovn-kubernetes/ovnkube-node-9xbcp" Jun 11 18:28:03.779913 ip-10-0-130-170 kubenswrapper[2565]: I0611 18:28:03.779757 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/fbbe1b81-aba0-4a02-9e7e-b272155f08ff-multus-cni-dir\") pod \"multus-pfc8t\" (UID: \"fbbe1b81-aba0-4a02-9e7e-b272155f08ff\") " pod="openshift-multus/multus-pfc8t" Jun 11 18:28:03.779913 ip-10-0-130-170 kubenswrapper[2565]: I0611 18:28:03.779771 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/c3f907b5-05ec-4fc1-ae51-df0b4b2432fd-run\") pod \"tuned-krq26\" (UID: \"c3f907b5-05ec-4fc1-ae51-df0b4b2432fd\") " pod="openshift-cluster-node-tuning-operator/tuned-krq26" Jun 11 18:28:03.779913 ip-10-0-130-170 kubenswrapper[2565]: I0611 18:28:03.779786 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/5f6a1d9d-054f-4a94-99a3-21b77d4995dd-ovnkube-config\") pod \"ovnkube-node-9xbcp\" (UID: \"5f6a1d9d-054f-4a94-99a3-21b77d4995dd\") " pod="openshift-ovn-kubernetes/ovnkube-node-9xbcp" Jun 11 18:28:03.779913 ip-10-0-130-170 kubenswrapper[2565]: I0611 18:28:03.779801 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/fbbe1b81-aba0-4a02-9e7e-b272155f08ff-cni-binary-copy\") pod \"multus-pfc8t\" (UID: \"fbbe1b81-aba0-4a02-9e7e-b272155f08ff\") " pod="openshift-multus/multus-pfc8t" Jun 11 18:28:03.779913 ip-10-0-130-170 kubenswrapper[2565]: I0611 18:28:03.779812 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/fbbe1b81-aba0-4a02-9e7e-b272155f08ff-multus-daemon-config\") pod \"multus-pfc8t\" (UID: \"fbbe1b81-aba0-4a02-9e7e-b272155f08ff\") " pod="openshift-multus/multus-pfc8t" Jun 11 18:28:03.779913 ip-10-0-130-170 kubenswrapper[2565]: I0611 18:28:03.779846 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/5f6a1d9d-054f-4a94-99a3-21b77d4995dd-systemd-units\") pod \"ovnkube-node-9xbcp\" (UID: \"5f6a1d9d-054f-4a94-99a3-21b77d4995dd\") " pod="openshift-ovn-kubernetes/ovnkube-node-9xbcp" Jun 11 18:28:03.779913 ip-10-0-130-170 kubenswrapper[2565]: I0611 18:28:03.779886 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/5f6a1d9d-054f-4a94-99a3-21b77d4995dd-host-cni-bin\") pod \"ovnkube-node-9xbcp\" (UID: \"5f6a1d9d-054f-4a94-99a3-21b77d4995dd\") " pod="openshift-ovn-kubernetes/ovnkube-node-9xbcp" Jun 11 18:28:03.779913 ip-10-0-130-170 kubenswrapper[2565]: I0611 18:28:03.779912 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/7a08c57b-6d27-43b1-8518-7d2564aa682e-host-slash\") pod \"iptables-alerter-v4p88\" (UID: \"7a08c57b-6d27-43b1-8518-7d2564aa682e\") " pod="openshift-network-operator/iptables-alerter-v4p88" Jun 11 18:28:03.780335 ip-10-0-130-170 kubenswrapper[2565]: I0611 18:28:03.779816 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-z5fkw\" (UniqueName: \"kubernetes.io/projected/fbbe1b81-aba0-4a02-9e7e-b272155f08ff-kube-api-access-z5fkw\") pod \"multus-pfc8t\" (UID: \"fbbe1b81-aba0-4a02-9e7e-b272155f08ff\") " pod="openshift-multus/multus-pfc8t" Jun 11 18:28:03.780335 ip-10-0-130-170 kubenswrapper[2565]: I0611 18:28:03.780153 2565 swap_util.go:74] "error creating dir to test if tmpfs noswap is enabled. Assuming not supported" mount path="" error="stat /var/lib/kubelet/plugins/kubernetes.io/empty-dir: no such file or directory" Jun 11 18:28:03.780335 ip-10-0-130-170 kubenswrapper[2565]: I0611 18:28:03.780192 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/c3f907b5-05ec-4fc1-ae51-df0b4b2432fd-sys\") pod \"tuned-krq26\" (UID: \"c3f907b5-05ec-4fc1-ae51-df0b4b2432fd\") " pod="openshift-cluster-node-tuning-operator/tuned-krq26" Jun 11 18:28:03.780335 ip-10-0-130-170 kubenswrapper[2565]: I0611 18:28:03.780211 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/c3f907b5-05ec-4fc1-ae51-df0b4b2432fd-tmp\") pod \"tuned-krq26\" (UID: \"c3f907b5-05ec-4fc1-ae51-df0b4b2432fd\") " pod="openshift-cluster-node-tuning-operator/tuned-krq26" Jun 11 18:28:03.780335 ip-10-0-130-170 kubenswrapper[2565]: I0611 18:28:03.780228 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/5f6a1d9d-054f-4a94-99a3-21b77d4995dd-run-openvswitch\") pod \"ovnkube-node-9xbcp\" (UID: \"5f6a1d9d-054f-4a94-99a3-21b77d4995dd\") " pod="openshift-ovn-kubernetes/ovnkube-node-9xbcp" Jun 11 18:28:03.780335 ip-10-0-130-170 kubenswrapper[2565]: I0611 18:28:03.780300 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/5f6a1d9d-054f-4a94-99a3-21b77d4995dd-host-run-ovn-kubernetes\") pod \"ovnkube-node-9xbcp\" (UID: \"5f6a1d9d-054f-4a94-99a3-21b77d4995dd\") " pod="openshift-ovn-kubernetes/ovnkube-node-9xbcp" Jun 11 18:28:03.780335 ip-10-0-130-170 kubenswrapper[2565]: I0611 18:28:03.780323 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-78kwd\" (UniqueName: \"kubernetes.io/projected/48f7111f-5fb9-477e-8a9e-3e9b22030f6a-kube-api-access-78kwd\") pod \"network-check-target-nh426\" (UID: \"48f7111f-5fb9-477e-8a9e-3e9b22030f6a\") " pod="openshift-network-diagnostics/network-check-target-nh426" Jun 11 18:28:03.780542 ip-10-0-130-170 kubenswrapper[2565]: I0611 18:28:03.780343 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/7a08c57b-6d27-43b1-8518-7d2564aa682e-iptables-alerter-script\") pod \"iptables-alerter-v4p88\" (UID: \"7a08c57b-6d27-43b1-8518-7d2564aa682e\") " pod="openshift-network-operator/iptables-alerter-v4p88" Jun 11 18:28:03.780542 ip-10-0-130-170 kubenswrapper[2565]: I0611 18:28:03.780360 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/fbbe1b81-aba0-4a02-9e7e-b272155f08ff-host-var-lib-cni-bin\") pod \"multus-pfc8t\" (UID: \"fbbe1b81-aba0-4a02-9e7e-b272155f08ff\") " pod="openshift-multus/multus-pfc8t" Jun 11 18:28:03.780542 ip-10-0-130-170 kubenswrapper[2565]: I0611 18:28:03.780375 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/fbbe1b81-aba0-4a02-9e7e-b272155f08ff-host-run-multus-certs\") pod \"multus-pfc8t\" (UID: \"fbbe1b81-aba0-4a02-9e7e-b272155f08ff\") " pod="openshift-multus/multus-pfc8t" Jun 11 18:28:03.780542 ip-10-0-130-170 kubenswrapper[2565]: I0611 18:28:03.780390 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/0a391608-1cd7-4bb8-8907-2f8e7078bf68-system-cni-dir\") pod \"multus-additional-cni-plugins-7qn5t\" (UID: \"0a391608-1cd7-4bb8-8907-2f8e7078bf68\") " pod="openshift-multus/multus-additional-cni-plugins-7qn5t" Jun 11 18:28:03.780542 ip-10-0-130-170 kubenswrapper[2565]: I0611 18:28:03.780413 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/3335d6c8-7cdf-4a68-a152-49545421f36d-device-dir\") pod \"aws-ebs-csi-driver-node-fbfnw\" (UID: \"3335d6c8-7cdf-4a68-a152-49545421f36d\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-fbfnw" Jun 11 18:28:03.780542 ip-10-0-130-170 kubenswrapper[2565]: I0611 18:28:03.780429 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/5f6a1d9d-054f-4a94-99a3-21b77d4995dd-var-lib-openvswitch\") pod \"ovnkube-node-9xbcp\" (UID: \"5f6a1d9d-054f-4a94-99a3-21b77d4995dd\") " pod="openshift-ovn-kubernetes/ovnkube-node-9xbcp" Jun 11 18:28:03.780542 ip-10-0-130-170 kubenswrapper[2565]: I0611 18:28:03.780463 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/fbbe1b81-aba0-4a02-9e7e-b272155f08ff-host-run-netns\") pod \"multus-pfc8t\" (UID: \"fbbe1b81-aba0-4a02-9e7e-b272155f08ff\") " pod="openshift-multus/multus-pfc8t" Jun 11 18:28:03.780542 ip-10-0-130-170 kubenswrapper[2565]: I0611 18:28:03.780499 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/7f5f862b-4ec0-44cd-96f3-1554a1656229-host\") pod \"node-ca-wwlkz\" (UID: \"7f5f862b-4ec0-44cd-96f3-1554a1656229\") " pod="openshift-image-registry/node-ca-wwlkz" Jun 11 18:28:03.780542 ip-10-0-130-170 kubenswrapper[2565]: I0611 18:28:03.780518 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hg79k\" (UniqueName: \"kubernetes.io/projected/7f5f862b-4ec0-44cd-96f3-1554a1656229-kube-api-access-hg79k\") pod \"node-ca-wwlkz\" (UID: \"7f5f862b-4ec0-44cd-96f3-1554a1656229\") " pod="openshift-image-registry/node-ca-wwlkz" Jun 11 18:28:03.780542 ip-10-0-130-170 kubenswrapper[2565]: I0611 18:28:03.780521 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/0a391608-1cd7-4bb8-8907-2f8e7078bf68-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-7qn5t\" (UID: \"0a391608-1cd7-4bb8-8907-2f8e7078bf68\") " pod="openshift-multus/multus-additional-cni-plugins-7qn5t" Jun 11 18:28:03.780542 ip-10-0-130-170 kubenswrapper[2565]: I0611 18:28:03.780532 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/c3f907b5-05ec-4fc1-ae51-df0b4b2432fd-etc-systemd\") pod \"tuned-krq26\" (UID: \"c3f907b5-05ec-4fc1-ae51-df0b4b2432fd\") " pod="openshift-cluster-node-tuning-operator/tuned-krq26" Jun 11 18:28:03.780841 ip-10-0-130-170 kubenswrapper[2565]: I0611 18:28:03.780560 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/0a391608-1cd7-4bb8-8907-2f8e7078bf68-cni-binary-copy\") pod \"multus-additional-cni-plugins-7qn5t\" (UID: \"0a391608-1cd7-4bb8-8907-2f8e7078bf68\") " pod="openshift-multus/multus-additional-cni-plugins-7qn5t" Jun 11 18:28:03.780841 ip-10-0-130-170 kubenswrapper[2565]: I0611 18:28:03.780565 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/5f6a1d9d-054f-4a94-99a3-21b77d4995dd-etc-openvswitch\") pod \"ovnkube-node-9xbcp\" (UID: \"5f6a1d9d-054f-4a94-99a3-21b77d4995dd\") " pod="openshift-ovn-kubernetes/ovnkube-node-9xbcp" Jun 11 18:28:03.780841 ip-10-0-130-170 kubenswrapper[2565]: I0611 18:28:03.780583 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/8e426e7d-dc89-476c-b72a-7cfc3b64a1f2-hosts-file\") pod \"node-resolver-ckltw\" (UID: \"8e426e7d-dc89-476c-b72a-7cfc3b64a1f2\") " pod="openshift-dns/node-resolver-ckltw" Jun 11 18:28:03.780841 ip-10-0-130-170 kubenswrapper[2565]: I0611 18:28:03.780596 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/5f6a1d9d-054f-4a94-99a3-21b77d4995dd-node-log\") pod \"ovnkube-node-9xbcp\" (UID: \"5f6a1d9d-054f-4a94-99a3-21b77d4995dd\") " pod="openshift-ovn-kubernetes/ovnkube-node-9xbcp" Jun 11 18:28:03.780841 ip-10-0-130-170 kubenswrapper[2565]: I0611 18:28:03.780603 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qjm4q\" (UniqueName: \"kubernetes.io/projected/c3f907b5-05ec-4fc1-ae51-df0b4b2432fd-kube-api-access-qjm4q\") pod \"tuned-krq26\" (UID: \"c3f907b5-05ec-4fc1-ae51-df0b4b2432fd\") " pod="openshift-cluster-node-tuning-operator/tuned-krq26" Jun 11 18:28:03.780841 ip-10-0-130-170 kubenswrapper[2565]: I0611 18:28:03.780618 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/fbbe1b81-aba0-4a02-9e7e-b272155f08ff-system-cni-dir\") pod \"multus-pfc8t\" (UID: \"fbbe1b81-aba0-4a02-9e7e-b272155f08ff\") " pod="openshift-multus/multus-pfc8t" Jun 11 18:28:03.780841 ip-10-0-130-170 kubenswrapper[2565]: I0611 18:28:03.780626 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/5f6a1d9d-054f-4a94-99a3-21b77d4995dd-host-cni-netd\") pod \"ovnkube-node-9xbcp\" (UID: \"5f6a1d9d-054f-4a94-99a3-21b77d4995dd\") " pod="openshift-ovn-kubernetes/ovnkube-node-9xbcp" Jun 11 18:28:03.780841 ip-10-0-130-170 kubenswrapper[2565]: I0611 18:28:03.780634 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/b36592f7-5d47-450e-bb47-12b43070bbf1-konnectivity-ca\") pod \"konnectivity-agent-rv8x7\" (UID: \"b36592f7-5d47-450e-bb47-12b43070bbf1\") " pod="kube-system/konnectivity-agent-rv8x7" Jun 11 18:28:03.780841 ip-10-0-130-170 kubenswrapper[2565]: I0611 18:28:03.780657 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/1f1530cc-c788-4dc5-9e3d-7209386e9b94-kubelet-config\") pod \"global-pull-secret-syncer-wqbfv\" (UID: \"1f1530cc-c788-4dc5-9e3d-7209386e9b94\") " pod="kube-system/global-pull-secret-syncer-wqbfv" Jun 11 18:28:03.780841 ip-10-0-130-170 kubenswrapper[2565]: I0611 18:28:03.780658 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/3335d6c8-7cdf-4a68-a152-49545421f36d-sys-fs\") pod \"aws-ebs-csi-driver-node-fbfnw\" (UID: \"3335d6c8-7cdf-4a68-a152-49545421f36d\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-fbfnw" Jun 11 18:28:03.780841 ip-10-0-130-170 kubenswrapper[2565]: I0611 18:28:03.780685 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-kzmpp\" (UniqueName: \"kubernetes.io/projected/3335d6c8-7cdf-4a68-a152-49545421f36d-kube-api-access-kzmpp\") pod \"aws-ebs-csi-driver-node-fbfnw\" (UID: \"3335d6c8-7cdf-4a68-a152-49545421f36d\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-fbfnw" Jun 11 18:28:03.780841 ip-10-0-130-170 kubenswrapper[2565]: I0611 18:28:03.780697 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/3335d6c8-7cdf-4a68-a152-49545421f36d-sys-fs\") pod \"aws-ebs-csi-driver-node-fbfnw\" (UID: \"3335d6c8-7cdf-4a68-a152-49545421f36d\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-fbfnw" Jun 11 18:28:03.780841 ip-10-0-130-170 kubenswrapper[2565]: I0611 18:28:03.780702 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xcffv\" (UniqueName: \"kubernetes.io/projected/2f4a1ff8-558e-4d9b-9208-ca0211b2b4e1-kube-api-access-xcffv\") pod \"network-metrics-daemon-bvwxp\" (UID: \"2f4a1ff8-558e-4d9b-9208-ca0211b2b4e1\") " pod="openshift-multus/network-metrics-daemon-bvwxp" Jun 11 18:28:03.780841 ip-10-0-130-170 kubenswrapper[2565]: I0611 18:28:03.780718 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/c3f907b5-05ec-4fc1-ae51-df0b4b2432fd-etc-kubernetes\") pod \"tuned-krq26\" (UID: \"c3f907b5-05ec-4fc1-ae51-df0b4b2432fd\") " pod="openshift-cluster-node-tuning-operator/tuned-krq26" Jun 11 18:28:03.780841 ip-10-0-130-170 kubenswrapper[2565]: I0611 18:28:03.780733 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/c3f907b5-05ec-4fc1-ae51-df0b4b2432fd-sys\") pod \"tuned-krq26\" (UID: \"c3f907b5-05ec-4fc1-ae51-df0b4b2432fd\") " pod="openshift-cluster-node-tuning-operator/tuned-krq26" Jun 11 18:28:03.780841 ip-10-0-130-170 kubenswrapper[2565]: I0611 18:28:03.780738 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-tlldj\" (UniqueName: \"kubernetes.io/projected/5f6a1d9d-054f-4a94-99a3-21b77d4995dd-kube-api-access-tlldj\") pod \"ovnkube-node-9xbcp\" (UID: \"5f6a1d9d-054f-4a94-99a3-21b77d4995dd\") " pod="openshift-ovn-kubernetes/ovnkube-node-9xbcp" Jun 11 18:28:03.780841 ip-10-0-130-170 kubenswrapper[2565]: I0611 18:28:03.780764 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/fbbe1b81-aba0-4a02-9e7e-b272155f08ff-multus-conf-dir\") pod \"multus-pfc8t\" (UID: \"fbbe1b81-aba0-4a02-9e7e-b272155f08ff\") " pod="openshift-multus/multus-pfc8t" Jun 11 18:28:03.781765 ip-10-0-130-170 kubenswrapper[2565]: I0611 18:28:03.780807 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/fbbe1b81-aba0-4a02-9e7e-b272155f08ff-multus-conf-dir\") pod \"multus-pfc8t\" (UID: \"fbbe1b81-aba0-4a02-9e7e-b272155f08ff\") " pod="openshift-multus/multus-pfc8t" Jun 11 18:28:03.781765 ip-10-0-130-170 kubenswrapper[2565]: I0611 18:28:03.780805 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/5f6a1d9d-054f-4a94-99a3-21b77d4995dd-host-slash\") pod \"ovnkube-node-9xbcp\" (UID: \"5f6a1d9d-054f-4a94-99a3-21b77d4995dd\") " pod="openshift-ovn-kubernetes/ovnkube-node-9xbcp" Jun 11 18:28:03.781765 ip-10-0-130-170 kubenswrapper[2565]: I0611 18:28:03.780854 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/fbbe1b81-aba0-4a02-9e7e-b272155f08ff-etc-kubernetes\") pod \"multus-pfc8t\" (UID: \"fbbe1b81-aba0-4a02-9e7e-b272155f08ff\") " pod="openshift-multus/multus-pfc8t" Jun 11 18:28:03.781765 ip-10-0-130-170 kubenswrapper[2565]: I0611 18:28:03.780882 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/0a391608-1cd7-4bb8-8907-2f8e7078bf68-os-release\") pod \"multus-additional-cni-plugins-7qn5t\" (UID: \"0a391608-1cd7-4bb8-8907-2f8e7078bf68\") " pod="openshift-multus/multus-additional-cni-plugins-7qn5t" Jun 11 18:28:03.781765 ip-10-0-130-170 kubenswrapper[2565]: I0611 18:28:03.781009 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/3335d6c8-7cdf-4a68-a152-49545421f36d-socket-dir\") pod \"aws-ebs-csi-driver-node-fbfnw\" (UID: \"3335d6c8-7cdf-4a68-a152-49545421f36d\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-fbfnw" Jun 11 18:28:03.781765 ip-10-0-130-170 kubenswrapper[2565]: I0611 18:28:03.781015 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/c3f907b5-05ec-4fc1-ae51-df0b4b2432fd-etc-sysctl-d\") pod \"tuned-krq26\" (UID: \"c3f907b5-05ec-4fc1-ae51-df0b4b2432fd\") " pod="openshift-cluster-node-tuning-operator/tuned-krq26" Jun 11 18:28:03.781765 ip-10-0-130-170 kubenswrapper[2565]: I0611 18:28:03.781061 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/c3f907b5-05ec-4fc1-ae51-df0b4b2432fd-etc-kubernetes\") pod \"tuned-krq26\" (UID: \"c3f907b5-05ec-4fc1-ae51-df0b4b2432fd\") " pod="openshift-cluster-node-tuning-operator/tuned-krq26" Jun 11 18:28:03.781765 ip-10-0-130-170 kubenswrapper[2565]: I0611 18:28:03.781125 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/c3f907b5-05ec-4fc1-ae51-df0b4b2432fd-etc-sysctl-conf\") pod \"tuned-krq26\" (UID: \"c3f907b5-05ec-4fc1-ae51-df0b4b2432fd\") " pod="openshift-cluster-node-tuning-operator/tuned-krq26" Jun 11 18:28:03.781765 ip-10-0-130-170 kubenswrapper[2565]: I0611 18:28:03.781138 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/0a391608-1cd7-4bb8-8907-2f8e7078bf68-os-release\") pod \"multus-additional-cni-plugins-7qn5t\" (UID: \"0a391608-1cd7-4bb8-8907-2f8e7078bf68\") " pod="openshift-multus/multus-additional-cni-plugins-7qn5t" Jun 11 18:28:03.781765 ip-10-0-130-170 kubenswrapper[2565]: I0611 18:28:03.781184 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/c3f907b5-05ec-4fc1-ae51-df0b4b2432fd-etc-sysconfig\") pod \"tuned-krq26\" (UID: \"c3f907b5-05ec-4fc1-ae51-df0b4b2432fd\") " pod="openshift-cluster-node-tuning-operator/tuned-krq26" Jun 11 18:28:03.781765 ip-10-0-130-170 kubenswrapper[2565]: I0611 18:28:03.781287 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/fbbe1b81-aba0-4a02-9e7e-b272155f08ff-etc-kubernetes\") pod \"multus-pfc8t\" (UID: \"fbbe1b81-aba0-4a02-9e7e-b272155f08ff\") " pod="openshift-multus/multus-pfc8t" Jun 11 18:28:03.781765 ip-10-0-130-170 kubenswrapper[2565]: I0611 18:28:03.781328 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/5f6a1d9d-054f-4a94-99a3-21b77d4995dd-run-ovn\") pod \"ovnkube-node-9xbcp\" (UID: \"5f6a1d9d-054f-4a94-99a3-21b77d4995dd\") " pod="openshift-ovn-kubernetes/ovnkube-node-9xbcp" Jun 11 18:28:03.781765 ip-10-0-130-170 kubenswrapper[2565]: I0611 18:28:03.781293 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/1f1530cc-c788-4dc5-9e3d-7209386e9b94-dbus\") pod \"global-pull-secret-syncer-wqbfv\" (UID: \"1f1530cc-c788-4dc5-9e3d-7209386e9b94\") " pod="kube-system/global-pull-secret-syncer-wqbfv" Jun 11 18:28:03.781765 ip-10-0-130-170 kubenswrapper[2565]: I0611 18:28:03.781369 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/5f6a1d9d-054f-4a94-99a3-21b77d4995dd-var-lib-openvswitch\") pod \"ovnkube-node-9xbcp\" (UID: \"5f6a1d9d-054f-4a94-99a3-21b77d4995dd\") " pod="openshift-ovn-kubernetes/ovnkube-node-9xbcp" Jun 11 18:28:03.781765 ip-10-0-130-170 kubenswrapper[2565]: I0611 18:28:03.781411 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/5f6a1d9d-054f-4a94-99a3-21b77d4995dd-host-run-ovn-kubernetes\") pod \"ovnkube-node-9xbcp\" (UID: \"5f6a1d9d-054f-4a94-99a3-21b77d4995dd\") " pod="openshift-ovn-kubernetes/ovnkube-node-9xbcp" Jun 11 18:28:03.781765 ip-10-0-130-170 kubenswrapper[2565]: I0611 18:28:03.781428 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/fbbe1b81-aba0-4a02-9e7e-b272155f08ff-multus-cni-dir\") pod \"multus-pfc8t\" (UID: \"fbbe1b81-aba0-4a02-9e7e-b272155f08ff\") " pod="openshift-multus/multus-pfc8t" Jun 11 18:28:03.781765 ip-10-0-130-170 kubenswrapper[2565]: I0611 18:28:03.781460 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/5f6a1d9d-054f-4a94-99a3-21b77d4995dd-run-systemd\") pod \"ovnkube-node-9xbcp\" (UID: \"5f6a1d9d-054f-4a94-99a3-21b77d4995dd\") " pod="openshift-ovn-kubernetes/ovnkube-node-9xbcp" Jun 11 18:28:03.781765 ip-10-0-130-170 kubenswrapper[2565]: I0611 18:28:03.781473 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run\" (UniqueName: \"kubernetes.io/host-path/c3f907b5-05ec-4fc1-ae51-df0b4b2432fd-run\") pod \"tuned-krq26\" (UID: \"c3f907b5-05ec-4fc1-ae51-df0b4b2432fd\") " pod="openshift-cluster-node-tuning-operator/tuned-krq26" Jun 11 18:28:03.782673 ip-10-0-130-170 kubenswrapper[2565]: I0611 18:28:03.781473 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/fbbe1b81-aba0-4a02-9e7e-b272155f08ff-host-var-lib-cni-bin\") pod \"multus-pfc8t\" (UID: \"fbbe1b81-aba0-4a02-9e7e-b272155f08ff\") " pod="openshift-multus/multus-pfc8t" Jun 11 18:28:03.782673 ip-10-0-130-170 kubenswrapper[2565]: I0611 18:28:03.781492 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/fbbe1b81-aba0-4a02-9e7e-b272155f08ff-host-run-netns\") pod \"multus-pfc8t\" (UID: \"fbbe1b81-aba0-4a02-9e7e-b272155f08ff\") " pod="openshift-multus/multus-pfc8t" Jun 11 18:28:03.782673 ip-10-0-130-170 kubenswrapper[2565]: I0611 18:28:03.781530 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/5f6a1d9d-054f-4a94-99a3-21b77d4995dd-ovnkube-script-lib\") pod \"ovnkube-node-9xbcp\" (UID: \"5f6a1d9d-054f-4a94-99a3-21b77d4995dd\") " pod="openshift-ovn-kubernetes/ovnkube-node-9xbcp" Jun 11 18:28:03.782673 ip-10-0-130-170 kubenswrapper[2565]: I0611 18:28:03.781544 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/7f5f862b-4ec0-44cd-96f3-1554a1656229-host\") pod \"node-ca-wwlkz\" (UID: \"7f5f862b-4ec0-44cd-96f3-1554a1656229\") " pod="openshift-image-registry/node-ca-wwlkz" Jun 11 18:28:03.782673 ip-10-0-130-170 kubenswrapper[2565]: I0611 18:28:03.781557 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/0a391608-1cd7-4bb8-8907-2f8e7078bf68-cnibin\") pod \"multus-additional-cni-plugins-7qn5t\" (UID: \"0a391608-1cd7-4bb8-8907-2f8e7078bf68\") " pod="openshift-multus/multus-additional-cni-plugins-7qn5t" Jun 11 18:28:03.782673 ip-10-0-130-170 kubenswrapper[2565]: I0611 18:28:03.781582 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/fbbe1b81-aba0-4a02-9e7e-b272155f08ff-cnibin\") pod \"multus-pfc8t\" (UID: \"fbbe1b81-aba0-4a02-9e7e-b272155f08ff\") " pod="openshift-multus/multus-pfc8t" Jun 11 18:28:03.782673 ip-10-0-130-170 kubenswrapper[2565]: I0611 18:28:03.781603 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/fbbe1b81-aba0-4a02-9e7e-b272155f08ff-os-release\") pod \"multus-pfc8t\" (UID: \"fbbe1b81-aba0-4a02-9e7e-b272155f08ff\") " pod="openshift-multus/multus-pfc8t" Jun 11 18:28:03.782673 ip-10-0-130-170 kubenswrapper[2565]: I0611 18:28:03.781628 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/fbbe1b81-aba0-4a02-9e7e-b272155f08ff-host-var-lib-cni-multus\") pod \"multus-pfc8t\" (UID: \"fbbe1b81-aba0-4a02-9e7e-b272155f08ff\") " pod="openshift-multus/multus-pfc8t" Jun 11 18:28:03.782673 ip-10-0-130-170 kubenswrapper[2565]: I0611 18:28:03.781652 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/7f5f862b-4ec0-44cd-96f3-1554a1656229-serviceca\") pod \"node-ca-wwlkz\" (UID: \"7f5f862b-4ec0-44cd-96f3-1554a1656229\") " pod="openshift-image-registry/node-ca-wwlkz" Jun 11 18:28:03.782673 ip-10-0-130-170 kubenswrapper[2565]: I0611 18:28:03.781679 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/0a391608-1cd7-4bb8-8907-2f8e7078bf68-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-7qn5t\" (UID: \"0a391608-1cd7-4bb8-8907-2f8e7078bf68\") " pod="openshift-multus/multus-additional-cni-plugins-7qn5t" Jun 11 18:28:03.782673 ip-10-0-130-170 kubenswrapper[2565]: I0611 18:28:03.781700 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/5f6a1d9d-054f-4a94-99a3-21b77d4995dd-env-overrides\") pod \"ovnkube-node-9xbcp\" (UID: \"5f6a1d9d-054f-4a94-99a3-21b77d4995dd\") " pod="openshift-ovn-kubernetes/ovnkube-node-9xbcp" Jun 11 18:28:03.782673 ip-10-0-130-170 kubenswrapper[2565]: I0611 18:28:03.781705 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/c3f907b5-05ec-4fc1-ae51-df0b4b2432fd-etc-modprobe-d\") pod \"tuned-krq26\" (UID: \"c3f907b5-05ec-4fc1-ae51-df0b4b2432fd\") " pod="openshift-cluster-node-tuning-operator/tuned-krq26" Jun 11 18:28:03.782673 ip-10-0-130-170 kubenswrapper[2565]: I0611 18:28:03.781141 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/8e426e7d-dc89-476c-b72a-7cfc3b64a1f2-tmp-dir\") pod \"node-resolver-ckltw\" (UID: \"8e426e7d-dc89-476c-b72a-7cfc3b64a1f2\") " pod="openshift-dns/node-resolver-ckltw" Jun 11 18:28:03.782673 ip-10-0-130-170 kubenswrapper[2565]: I0611 18:28:03.781791 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/c3f907b5-05ec-4fc1-ae51-df0b4b2432fd-etc-modprobe-d\") pod \"tuned-krq26\" (UID: \"c3f907b5-05ec-4fc1-ae51-df0b4b2432fd\") " pod="openshift-cluster-node-tuning-operator/tuned-krq26" Jun 11 18:28:03.782673 ip-10-0-130-170 kubenswrapper[2565]: I0611 18:28:03.781838 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/5f6a1d9d-054f-4a94-99a3-21b77d4995dd-run-openvswitch\") pod \"ovnkube-node-9xbcp\" (UID: \"5f6a1d9d-054f-4a94-99a3-21b77d4995dd\") " pod="openshift-ovn-kubernetes/ovnkube-node-9xbcp" Jun 11 18:28:03.782673 ip-10-0-130-170 kubenswrapper[2565]: I0611 18:28:03.781874 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/3335d6c8-7cdf-4a68-a152-49545421f36d-device-dir\") pod \"aws-ebs-csi-driver-node-fbfnw\" (UID: \"3335d6c8-7cdf-4a68-a152-49545421f36d\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-fbfnw" Jun 11 18:28:03.782673 ip-10-0-130-170 kubenswrapper[2565]: I0611 18:28:03.781914 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/0a391608-1cd7-4bb8-8907-2f8e7078bf68-system-cni-dir\") pod \"multus-additional-cni-plugins-7qn5t\" (UID: \"0a391608-1cd7-4bb8-8907-2f8e7078bf68\") " pod="openshift-multus/multus-additional-cni-plugins-7qn5t" Jun 11 18:28:03.782673 ip-10-0-130-170 kubenswrapper[2565]: I0611 18:28:03.781931 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/5f6a1d9d-054f-4a94-99a3-21b77d4995dd-ovnkube-config\") pod \"ovnkube-node-9xbcp\" (UID: \"5f6a1d9d-054f-4a94-99a3-21b77d4995dd\") " pod="openshift-ovn-kubernetes/ovnkube-node-9xbcp" Jun 11 18:28:03.783591 ip-10-0-130-170 kubenswrapper[2565]: I0611 18:28:03.781960 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/5f6a1d9d-054f-4a94-99a3-21b77d4995dd-host-kubelet\") pod \"ovnkube-node-9xbcp\" (UID: \"5f6a1d9d-054f-4a94-99a3-21b77d4995dd\") " pod="openshift-ovn-kubernetes/ovnkube-node-9xbcp" Jun 11 18:28:03.783591 ip-10-0-130-170 kubenswrapper[2565]: I0611 18:28:03.781985 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/fbbe1b81-aba0-4a02-9e7e-b272155f08ff-host-run-multus-certs\") pod \"multus-pfc8t\" (UID: \"fbbe1b81-aba0-4a02-9e7e-b272155f08ff\") " pod="openshift-multus/multus-pfc8t" Jun 11 18:28:03.783591 ip-10-0-130-170 kubenswrapper[2565]: I0611 18:28:03.781987 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-r7m48\" (UniqueName: \"kubernetes.io/projected/7a08c57b-6d27-43b1-8518-7d2564aa682e-kube-api-access-r7m48\") pod \"iptables-alerter-v4p88\" (UID: \"7a08c57b-6d27-43b1-8518-7d2564aa682e\") " pod="openshift-network-operator/iptables-alerter-v4p88" Jun 11 18:28:03.783591 ip-10-0-130-170 kubenswrapper[2565]: I0611 18:28:03.782036 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/3335d6c8-7cdf-4a68-a152-49545421f36d-etc-selinux\") pod \"aws-ebs-csi-driver-node-fbfnw\" (UID: \"3335d6c8-7cdf-4a68-a152-49545421f36d\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-fbfnw" Jun 11 18:28:03.783591 ip-10-0-130-170 kubenswrapper[2565]: I0611 18:28:03.782040 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/5f6a1d9d-054f-4a94-99a3-21b77d4995dd-run-systemd\") pod \"ovnkube-node-9xbcp\" (UID: \"5f6a1d9d-054f-4a94-99a3-21b77d4995dd\") " pod="openshift-ovn-kubernetes/ovnkube-node-9xbcp" Jun 11 18:28:03.783591 ip-10-0-130-170 kubenswrapper[2565]: I0611 18:28:03.782070 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/2f4a1ff8-558e-4d9b-9208-ca0211b2b4e1-metrics-certs\") pod \"network-metrics-daemon-bvwxp\" (UID: \"2f4a1ff8-558e-4d9b-9208-ca0211b2b4e1\") " pod="openshift-multus/network-metrics-daemon-bvwxp" Jun 11 18:28:03.783591 ip-10-0-130-170 kubenswrapper[2565]: I0611 18:28:03.782096 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/8e426e7d-dc89-476c-b72a-7cfc3b64a1f2-hosts-file\") pod \"node-resolver-ckltw\" (UID: \"8e426e7d-dc89-476c-b72a-7cfc3b64a1f2\") " pod="openshift-dns/node-resolver-ckltw" Jun 11 18:28:03.783591 ip-10-0-130-170 kubenswrapper[2565]: I0611 18:28:03.782140 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/0a391608-1cd7-4bb8-8907-2f8e7078bf68-cnibin\") pod \"multus-additional-cni-plugins-7qn5t\" (UID: \"0a391608-1cd7-4bb8-8907-2f8e7078bf68\") " pod="openshift-multus/multus-additional-cni-plugins-7qn5t" Jun 11 18:28:03.783591 ip-10-0-130-170 kubenswrapper[2565]: I0611 18:28:03.782194 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/fbbe1b81-aba0-4a02-9e7e-b272155f08ff-cnibin\") pod \"multus-pfc8t\" (UID: \"fbbe1b81-aba0-4a02-9e7e-b272155f08ff\") " pod="openshift-multus/multus-pfc8t" Jun 11 18:28:03.783591 ip-10-0-130-170 kubenswrapper[2565]: I0611 18:28:03.782200 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/fbbe1b81-aba0-4a02-9e7e-b272155f08ff-host-var-lib-cni-multus\") pod \"multus-pfc8t\" (UID: \"fbbe1b81-aba0-4a02-9e7e-b272155f08ff\") " pod="openshift-multus/multus-pfc8t" Jun 11 18:28:03.783591 ip-10-0-130-170 kubenswrapper[2565]: I0611 18:28:03.782244 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/5f6a1d9d-054f-4a94-99a3-21b77d4995dd-host-kubelet\") pod \"ovnkube-node-9xbcp\" (UID: \"5f6a1d9d-054f-4a94-99a3-21b77d4995dd\") " pod="openshift-ovn-kubernetes/ovnkube-node-9xbcp" Jun 11 18:28:03.783591 ip-10-0-130-170 kubenswrapper[2565]: I0611 18:28:03.782322 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/fbbe1b81-aba0-4a02-9e7e-b272155f08ff-system-cni-dir\") pod \"multus-pfc8t\" (UID: \"fbbe1b81-aba0-4a02-9e7e-b272155f08ff\") " pod="openshift-multus/multus-pfc8t" Jun 11 18:28:03.783591 ip-10-0-130-170 kubenswrapper[2565]: I0611 18:28:03.782328 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/7a08c57b-6d27-43b1-8518-7d2564aa682e-iptables-alerter-script\") pod \"iptables-alerter-v4p88\" (UID: \"7a08c57b-6d27-43b1-8518-7d2564aa682e\") " pod="openshift-network-operator/iptables-alerter-v4p88" Jun 11 18:28:03.783591 ip-10-0-130-170 kubenswrapper[2565]: I0611 18:28:03.782749 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/0a391608-1cd7-4bb8-8907-2f8e7078bf68-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-7qn5t\" (UID: \"0a391608-1cd7-4bb8-8907-2f8e7078bf68\") " pod="openshift-multus/multus-additional-cni-plugins-7qn5t" Jun 11 18:28:03.783591 ip-10-0-130-170 kubenswrapper[2565]: I0611 18:28:03.782791 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/0a391608-1cd7-4bb8-8907-2f8e7078bf68-cni-binary-copy\") pod \"multus-additional-cni-plugins-7qn5t\" (UID: \"0a391608-1cd7-4bb8-8907-2f8e7078bf68\") " pod="openshift-multus/multus-additional-cni-plugins-7qn5t" Jun 11 18:28:03.783591 ip-10-0-130-170 kubenswrapper[2565]: I0611 18:28:03.782816 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/c3f907b5-05ec-4fc1-ae51-df0b4b2432fd-etc-systemd\") pod \"tuned-krq26\" (UID: \"c3f907b5-05ec-4fc1-ae51-df0b4b2432fd\") " pod="openshift-cluster-node-tuning-operator/tuned-krq26" Jun 11 18:28:03.783591 ip-10-0-130-170 kubenswrapper[2565]: I0611 18:28:03.782845 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/b36592f7-5d47-450e-bb47-12b43070bbf1-konnectivity-ca\") pod \"konnectivity-agent-rv8x7\" (UID: \"b36592f7-5d47-450e-bb47-12b43070bbf1\") " pod="kube-system/konnectivity-agent-rv8x7" Jun 11 18:28:03.783591 ip-10-0-130-170 kubenswrapper[2565]: I0611 18:28:03.782887 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/7f5f862b-4ec0-44cd-96f3-1554a1656229-serviceca\") pod \"node-ca-wwlkz\" (UID: \"7f5f862b-4ec0-44cd-96f3-1554a1656229\") " pod="openshift-image-registry/node-ca-wwlkz" Jun 11 18:28:03.784573 ip-10-0-130-170 kubenswrapper[2565]: I0611 18:28:03.782924 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/c3f907b5-05ec-4fc1-ae51-df0b4b2432fd-lib-modules\") pod \"tuned-krq26\" (UID: \"c3f907b5-05ec-4fc1-ae51-df0b4b2432fd\") " pod="openshift-cluster-node-tuning-operator/tuned-krq26" Jun 11 18:28:03.784573 ip-10-0-130-170 kubenswrapper[2565]: E0611 18:28:03.782935 2565 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jun 11 18:28:03.784573 ip-10-0-130-170 kubenswrapper[2565]: I0611 18:28:03.782940 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/3335d6c8-7cdf-4a68-a152-49545421f36d-etc-selinux\") pod \"aws-ebs-csi-driver-node-fbfnw\" (UID: \"3335d6c8-7cdf-4a68-a152-49545421f36d\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-fbfnw" Jun 11 18:28:03.784573 ip-10-0-130-170 kubenswrapper[2565]: I0611 18:28:03.782964 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/c3f907b5-05ec-4fc1-ae51-df0b4b2432fd-host\") pod \"tuned-krq26\" (UID: \"c3f907b5-05ec-4fc1-ae51-df0b4b2432fd\") " pod="openshift-cluster-node-tuning-operator/tuned-krq26" Jun 11 18:28:03.784573 ip-10-0-130-170 kubenswrapper[2565]: E0611 18:28:03.783026 2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/2f4a1ff8-558e-4d9b-9208-ca0211b2b4e1-metrics-certs podName:2f4a1ff8-558e-4d9b-9208-ca0211b2b4e1 nodeName:}" failed. No retries permitted until 2026-06-11 18:28:04.282994277 +0000 UTC m=+3.031680279 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/2f4a1ff8-558e-4d9b-9208-ca0211b2b4e1-metrics-certs") pod "network-metrics-daemon-bvwxp" (UID: "2f4a1ff8-558e-4d9b-9208-ca0211b2b4e1") : object "openshift-multus"/"metrics-daemon-secret" not registered Jun 11 18:28:03.784573 ip-10-0-130-170 kubenswrapper[2565]: I0611 18:28:03.783074 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/5f6a1d9d-054f-4a94-99a3-21b77d4995dd-log-socket\") pod \"ovnkube-node-9xbcp\" (UID: \"5f6a1d9d-054f-4a94-99a3-21b77d4995dd\") " pod="openshift-ovn-kubernetes/ovnkube-node-9xbcp" Jun 11 18:28:03.784573 ip-10-0-130-170 kubenswrapper[2565]: I0611 18:28:03.783089 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/fbbe1b81-aba0-4a02-9e7e-b272155f08ff-os-release\") pod \"multus-pfc8t\" (UID: \"fbbe1b81-aba0-4a02-9e7e-b272155f08ff\") " pod="openshift-multus/multus-pfc8t" Jun 11 18:28:03.784573 ip-10-0-130-170 kubenswrapper[2565]: I0611 18:28:03.783101 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/1f1530cc-c788-4dc5-9e3d-7209386e9b94-original-pull-secret\") pod \"global-pull-secret-syncer-wqbfv\" (UID: \"1f1530cc-c788-4dc5-9e3d-7209386e9b94\") " pod="kube-system/global-pull-secret-syncer-wqbfv" Jun 11 18:28:03.784573 ip-10-0-130-170 kubenswrapper[2565]: I0611 18:28:03.783138 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/c3f907b5-05ec-4fc1-ae51-df0b4b2432fd-host\") pod \"tuned-krq26\" (UID: \"c3f907b5-05ec-4fc1-ae51-df0b4b2432fd\") " pod="openshift-cluster-node-tuning-operator/tuned-krq26" Jun 11 18:28:03.784573 ip-10-0-130-170 kubenswrapper[2565]: I0611 18:28:03.783210 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/fbbe1b81-aba0-4a02-9e7e-b272155f08ff-cni-binary-copy\") pod \"multus-pfc8t\" (UID: \"fbbe1b81-aba0-4a02-9e7e-b272155f08ff\") " pod="openshift-multus/multus-pfc8t" Jun 11 18:28:03.784573 ip-10-0-130-170 kubenswrapper[2565]: E0611 18:28:03.783229 2565 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jun 11 18:28:03.784573 ip-10-0-130-170 kubenswrapper[2565]: I0611 18:28:03.783216 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/0a391608-1cd7-4bb8-8907-2f8e7078bf68-tuning-conf-dir\") pod \"multus-additional-cni-plugins-7qn5t\" (UID: \"0a391608-1cd7-4bb8-8907-2f8e7078bf68\") " pod="openshift-multus/multus-additional-cni-plugins-7qn5t" Jun 11 18:28:03.784573 ip-10-0-130-170 kubenswrapper[2565]: I0611 18:28:03.783324 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/c3f907b5-05ec-4fc1-ae51-df0b4b2432fd-lib-modules\") pod \"tuned-krq26\" (UID: \"c3f907b5-05ec-4fc1-ae51-df0b4b2432fd\") " pod="openshift-cluster-node-tuning-operator/tuned-krq26" Jun 11 18:28:03.784573 ip-10-0-130-170 kubenswrapper[2565]: E0611 18:28:03.783339 2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/1f1530cc-c788-4dc5-9e3d-7209386e9b94-original-pull-secret podName:1f1530cc-c788-4dc5-9e3d-7209386e9b94 nodeName:}" failed. No retries permitted until 2026-06-11 18:28:04.283321888 +0000 UTC m=+3.032007888 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/1f1530cc-c788-4dc5-9e3d-7209386e9b94-original-pull-secret") pod "global-pull-secret-syncer-wqbfv" (UID: "1f1530cc-c788-4dc5-9e3d-7209386e9b94") : object "kube-system"/"original-pull-secret" not registered Jun 11 18:28:03.784573 ip-10-0-130-170 kubenswrapper[2565]: I0611 18:28:03.783370 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/3335d6c8-7cdf-4a68-a152-49545421f36d-registration-dir\") pod \"aws-ebs-csi-driver-node-fbfnw\" (UID: \"3335d6c8-7cdf-4a68-a152-49545421f36d\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-fbfnw" Jun 11 18:28:03.784573 ip-10-0-130-170 kubenswrapper[2565]: I0611 18:28:03.783368 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/0a391608-1cd7-4bb8-8907-2f8e7078bf68-tuning-conf-dir\") pod \"multus-additional-cni-plugins-7qn5t\" (UID: \"0a391608-1cd7-4bb8-8907-2f8e7078bf68\") " pod="openshift-multus/multus-additional-cni-plugins-7qn5t" Jun 11 18:28:03.784573 ip-10-0-130-170 kubenswrapper[2565]: I0611 18:28:03.783383 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/5f6a1d9d-054f-4a94-99a3-21b77d4995dd-log-socket\") pod \"ovnkube-node-9xbcp\" (UID: \"5f6a1d9d-054f-4a94-99a3-21b77d4995dd\") " pod="openshift-ovn-kubernetes/ovnkube-node-9xbcp" Jun 11 18:28:03.785410 ip-10-0-130-170 kubenswrapper[2565]: I0611 18:28:03.783412 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/3335d6c8-7cdf-4a68-a152-49545421f36d-registration-dir\") pod \"aws-ebs-csi-driver-node-fbfnw\" (UID: \"3335d6c8-7cdf-4a68-a152-49545421f36d\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-fbfnw" Jun 11 18:28:03.785410 ip-10-0-130-170 kubenswrapper[2565]: I0611 18:28:03.783420 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/c3f907b5-05ec-4fc1-ae51-df0b4b2432fd-var-lib-kubelet\") pod \"tuned-krq26\" (UID: \"c3f907b5-05ec-4fc1-ae51-df0b4b2432fd\") " pod="openshift-cluster-node-tuning-operator/tuned-krq26" Jun 11 18:28:03.785410 ip-10-0-130-170 kubenswrapper[2565]: I0611 18:28:03.783463 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/c3f907b5-05ec-4fc1-ae51-df0b4b2432fd-var-lib-kubelet\") pod \"tuned-krq26\" (UID: \"c3f907b5-05ec-4fc1-ae51-df0b4b2432fd\") " pod="openshift-cluster-node-tuning-operator/tuned-krq26" Jun 11 18:28:03.785410 ip-10-0-130-170 kubenswrapper[2565]: I0611 18:28:03.783499 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/5f6a1d9d-054f-4a94-99a3-21b77d4995dd-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-9xbcp\" (UID: \"5f6a1d9d-054f-4a94-99a3-21b77d4995dd\") " pod="openshift-ovn-kubernetes/ovnkube-node-9xbcp" Jun 11 18:28:03.785410 ip-10-0-130-170 kubenswrapper[2565]: I0611 18:28:03.783534 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/5f6a1d9d-054f-4a94-99a3-21b77d4995dd-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-9xbcp\" (UID: \"5f6a1d9d-054f-4a94-99a3-21b77d4995dd\") " pod="openshift-ovn-kubernetes/ovnkube-node-9xbcp" Jun 11 18:28:03.785410 ip-10-0-130-170 kubenswrapper[2565]: I0611 18:28:03.783568 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/5f6a1d9d-054f-4a94-99a3-21b77d4995dd-ovn-node-metrics-cert\") pod \"ovnkube-node-9xbcp\" (UID: \"5f6a1d9d-054f-4a94-99a3-21b77d4995dd\") " pod="openshift-ovn-kubernetes/ovnkube-node-9xbcp" Jun 11 18:28:03.785410 ip-10-0-130-170 kubenswrapper[2565]: I0611 18:28:03.783614 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/5f6a1d9d-054f-4a94-99a3-21b77d4995dd-ovnkube-script-lib\") pod \"ovnkube-node-9xbcp\" (UID: \"5f6a1d9d-054f-4a94-99a3-21b77d4995dd\") " pod="openshift-ovn-kubernetes/ovnkube-node-9xbcp" Jun 11 18:28:03.785410 ip-10-0-130-170 kubenswrapper[2565]: I0611 18:28:03.783620 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-m4khc\" (UniqueName: \"kubernetes.io/projected/8e426e7d-dc89-476c-b72a-7cfc3b64a1f2-kube-api-access-m4khc\") pod \"node-resolver-ckltw\" (UID: \"8e426e7d-dc89-476c-b72a-7cfc3b64a1f2\") " pod="openshift-dns/node-resolver-ckltw" Jun 11 18:28:03.785410 ip-10-0-130-170 kubenswrapper[2565]: I0611 18:28:03.783774 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/5f6a1d9d-054f-4a94-99a3-21b77d4995dd-host-run-netns\") pod \"ovnkube-node-9xbcp\" (UID: \"5f6a1d9d-054f-4a94-99a3-21b77d4995dd\") " pod="openshift-ovn-kubernetes/ovnkube-node-9xbcp" Jun 11 18:28:03.785410 ip-10-0-130-170 kubenswrapper[2565]: I0611 18:28:03.783808 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/fbbe1b81-aba0-4a02-9e7e-b272155f08ff-multus-socket-dir-parent\") pod \"multus-pfc8t\" (UID: \"fbbe1b81-aba0-4a02-9e7e-b272155f08ff\") " pod="openshift-multus/multus-pfc8t" Jun 11 18:28:03.785410 ip-10-0-130-170 kubenswrapper[2565]: I0611 18:28:03.783836 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/5f6a1d9d-054f-4a94-99a3-21b77d4995dd-host-run-netns\") pod \"ovnkube-node-9xbcp\" (UID: \"5f6a1d9d-054f-4a94-99a3-21b77d4995dd\") " pod="openshift-ovn-kubernetes/ovnkube-node-9xbcp" Jun 11 18:28:03.785410 ip-10-0-130-170 kubenswrapper[2565]: I0611 18:28:03.783845 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/fbbe1b81-aba0-4a02-9e7e-b272155f08ff-host-run-k8s-cni-cncf-io\") pod \"multus-pfc8t\" (UID: \"fbbe1b81-aba0-4a02-9e7e-b272155f08ff\") " pod="openshift-multus/multus-pfc8t" Jun 11 18:28:03.785410 ip-10-0-130-170 kubenswrapper[2565]: I0611 18:28:03.783895 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/fbbe1b81-aba0-4a02-9e7e-b272155f08ff-multus-socket-dir-parent\") pod \"multus-pfc8t\" (UID: \"fbbe1b81-aba0-4a02-9e7e-b272155f08ff\") " pod="openshift-multus/multus-pfc8t" Jun 11 18:28:03.785410 ip-10-0-130-170 kubenswrapper[2565]: I0611 18:28:03.783914 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/fbbe1b81-aba0-4a02-9e7e-b272155f08ff-host-run-k8s-cni-cncf-io\") pod \"multus-pfc8t\" (UID: \"fbbe1b81-aba0-4a02-9e7e-b272155f08ff\") " pod="openshift-multus/multus-pfc8t" Jun 11 18:28:03.785410 ip-10-0-130-170 kubenswrapper[2565]: I0611 18:28:03.783980 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/c3f907b5-05ec-4fc1-ae51-df0b4b2432fd-tmp\") pod \"tuned-krq26\" (UID: \"c3f907b5-05ec-4fc1-ae51-df0b4b2432fd\") " pod="openshift-cluster-node-tuning-operator/tuned-krq26" Jun 11 18:28:03.785410 ip-10-0-130-170 kubenswrapper[2565]: I0611 18:28:03.784023 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/c3f907b5-05ec-4fc1-ae51-df0b4b2432fd-etc-tuned\") pod \"tuned-krq26\" (UID: \"c3f907b5-05ec-4fc1-ae51-df0b4b2432fd\") " pod="openshift-cluster-node-tuning-operator/tuned-krq26" Jun 11 18:28:03.786361 ip-10-0-130-170 kubenswrapper[2565]: I0611 18:28:03.786338 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/5f6a1d9d-054f-4a94-99a3-21b77d4995dd-ovn-node-metrics-cert\") pod \"ovnkube-node-9xbcp\" (UID: \"5f6a1d9d-054f-4a94-99a3-21b77d4995dd\") " pod="openshift-ovn-kubernetes/ovnkube-node-9xbcp" Jun 11 18:28:03.787426 ip-10-0-130-170 kubenswrapper[2565]: I0611 18:28:03.787402 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/b36592f7-5d47-450e-bb47-12b43070bbf1-agent-certs\") pod \"konnectivity-agent-rv8x7\" (UID: \"b36592f7-5d47-450e-bb47-12b43070bbf1\") " pod="kube-system/konnectivity-agent-rv8x7" Jun 11 18:28:03.789345 ip-10-0-130-170 kubenswrapper[2565]: E0611 18:28:03.789325 2565 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jun 11 18:28:03.789451 ip-10-0-130-170 kubenswrapper[2565]: E0611 18:28:03.789349 2565 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jun 11 18:28:03.789451 ip-10-0-130-170 kubenswrapper[2565]: E0611 18:28:03.789365 2565 projected.go:196] Error preparing data for projected volume kube-api-access-78kwd for pod openshift-network-diagnostics/network-check-target-nh426: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 11 18:28:03.789451 ip-10-0-130-170 kubenswrapper[2565]: E0611 18:28:03.789426 2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/48f7111f-5fb9-477e-8a9e-3e9b22030f6a-kube-api-access-78kwd podName:48f7111f-5fb9-477e-8a9e-3e9b22030f6a nodeName:}" failed. No retries permitted until 2026-06-11 18:28:04.28940949 +0000 UTC m=+3.038095510 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-api-access-78kwd" (UniqueName: "kubernetes.io/projected/48f7111f-5fb9-477e-8a9e-3e9b22030f6a-kube-api-access-78kwd") pod "network-check-target-nh426" (UID: "48f7111f-5fb9-477e-8a9e-3e9b22030f6a") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 11 18:28:03.791057 ip-10-0-130-170 kubenswrapper[2565]: I0611 18:28:03.791027 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-z5fkw\" (UniqueName: \"kubernetes.io/projected/fbbe1b81-aba0-4a02-9e7e-b272155f08ff-kube-api-access-z5fkw\") pod \"multus-pfc8t\" (UID: \"fbbe1b81-aba0-4a02-9e7e-b272155f08ff\") " pod="openshift-multus/multus-pfc8t" Jun 11 18:28:03.791228 ip-10-0-130-170 kubenswrapper[2565]: I0611 18:28:03.791202 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-xcffv\" (UniqueName: \"kubernetes.io/projected/2f4a1ff8-558e-4d9b-9208-ca0211b2b4e1-kube-api-access-xcffv\") pod \"network-metrics-daemon-bvwxp\" (UID: \"2f4a1ff8-558e-4d9b-9208-ca0211b2b4e1\") " pod="openshift-multus/network-metrics-daemon-bvwxp" Jun 11 18:28:03.793142 ip-10-0-130-170 kubenswrapper[2565]: I0611 18:28:03.793119 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-tlldj\" (UniqueName: \"kubernetes.io/projected/5f6a1d9d-054f-4a94-99a3-21b77d4995dd-kube-api-access-tlldj\") pod \"ovnkube-node-9xbcp\" (UID: \"5f6a1d9d-054f-4a94-99a3-21b77d4995dd\") " pod="openshift-ovn-kubernetes/ovnkube-node-9xbcp" Jun 11 18:28:03.794048 ip-10-0-130-170 kubenswrapper[2565]: I0611 18:28:03.794027 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-hg79k\" (UniqueName: \"kubernetes.io/projected/7f5f862b-4ec0-44cd-96f3-1554a1656229-kube-api-access-hg79k\") pod \"node-ca-wwlkz\" (UID: \"7f5f862b-4ec0-44cd-96f3-1554a1656229\") " pod="openshift-image-registry/node-ca-wwlkz" Jun 11 18:28:03.794706 ip-10-0-130-170 kubenswrapper[2565]: I0611 18:28:03.794682 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-qjm4q\" (UniqueName: \"kubernetes.io/projected/c3f907b5-05ec-4fc1-ae51-df0b4b2432fd-kube-api-access-qjm4q\") pod \"tuned-krq26\" (UID: \"c3f907b5-05ec-4fc1-ae51-df0b4b2432fd\") " pod="openshift-cluster-node-tuning-operator/tuned-krq26" Jun 11 18:28:03.794706 ip-10-0-130-170 kubenswrapper[2565]: I0611 18:28:03.794698 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-r7m48\" (UniqueName: \"kubernetes.io/projected/7a08c57b-6d27-43b1-8518-7d2564aa682e-kube-api-access-r7m48\") pod \"iptables-alerter-v4p88\" (UID: \"7a08c57b-6d27-43b1-8518-7d2564aa682e\") " pod="openshift-network-operator/iptables-alerter-v4p88" Jun 11 18:28:03.794802 ip-10-0-130-170 kubenswrapper[2565]: I0611 18:28:03.794704 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-kzmpp\" (UniqueName: \"kubernetes.io/projected/3335d6c8-7cdf-4a68-a152-49545421f36d-kube-api-access-kzmpp\") pod \"aws-ebs-csi-driver-node-fbfnw\" (UID: \"3335d6c8-7cdf-4a68-a152-49545421f36d\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-fbfnw" Jun 11 18:28:03.798160 ip-10-0-130-170 kubenswrapper[2565]: I0611 18:28:03.795359 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-m4khc\" (UniqueName: \"kubernetes.io/projected/8e426e7d-dc89-476c-b72a-7cfc3b64a1f2-kube-api-access-m4khc\") pod \"node-resolver-ckltw\" (UID: \"8e426e7d-dc89-476c-b72a-7cfc3b64a1f2\") " pod="openshift-dns/node-resolver-ckltw" Jun 11 18:28:03.798160 ip-10-0-130-170 kubenswrapper[2565]: I0611 18:28:03.795441 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-vx5cz\" (UniqueName: \"kubernetes.io/projected/0a391608-1cd7-4bb8-8907-2f8e7078bf68-kube-api-access-vx5cz\") pod \"multus-additional-cni-plugins-7qn5t\" (UID: \"0a391608-1cd7-4bb8-8907-2f8e7078bf68\") " pod="openshift-multus/multus-additional-cni-plugins-7qn5t" Jun 11 18:28:03.956224 ip-10-0-130-170 kubenswrapper[2565]: I0611 18:28:03.956126 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-krq26" Jun 11 18:28:03.965171 ip-10-0-130-170 kubenswrapper[2565]: I0611 18:28:03.965149 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-9xbcp" Jun 11 18:28:03.973354 ip-10-0-130-170 kubenswrapper[2565]: I0611 18:28:03.973327 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-7qn5t" Jun 11 18:28:03.981926 ip-10-0-130-170 kubenswrapper[2565]: I0611 18:28:03.981907 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-v4p88" Jun 11 18:28:03.988465 ip-10-0-130-170 kubenswrapper[2565]: I0611 18:28:03.988443 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-fbfnw" Jun 11 18:28:03.994762 ip-10-0-130-170 kubenswrapper[2565]: I0611 18:28:03.994741 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-pfc8t" Jun 11 18:28:04.001673 ip-10-0-130-170 kubenswrapper[2565]: I0611 18:28:04.001653 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-wwlkz" Jun 11 18:28:04.008741 ip-10-0-130-170 kubenswrapper[2565]: I0611 18:28:04.008722 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-rv8x7" Jun 11 18:28:04.013743 ip-10-0-130-170 kubenswrapper[2565]: I0611 18:28:04.013722 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-ckltw" Jun 11 18:28:04.156511 ip-10-0-130-170 kubenswrapper[2565]: I0611 18:28:04.156483 2565 reflector.go:439] "Caches populated" type="*v1.CSIDriver" reflector="k8s.io/client-go/informers/factory.go:160" Jun 11 18:28:04.288603 ip-10-0-130-170 kubenswrapper[2565]: I0611 18:28:04.288523 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/2f4a1ff8-558e-4d9b-9208-ca0211b2b4e1-metrics-certs\") pod \"network-metrics-daemon-bvwxp\" (UID: \"2f4a1ff8-558e-4d9b-9208-ca0211b2b4e1\") " pod="openshift-multus/network-metrics-daemon-bvwxp" Jun 11 18:28:04.288603 ip-10-0-130-170 kubenswrapper[2565]: I0611 18:28:04.288559 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/1f1530cc-c788-4dc5-9e3d-7209386e9b94-original-pull-secret\") pod \"global-pull-secret-syncer-wqbfv\" (UID: \"1f1530cc-c788-4dc5-9e3d-7209386e9b94\") " pod="kube-system/global-pull-secret-syncer-wqbfv" Jun 11 18:28:04.288763 ip-10-0-130-170 kubenswrapper[2565]: E0611 18:28:04.288669 2565 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jun 11 18:28:04.288763 ip-10-0-130-170 kubenswrapper[2565]: E0611 18:28:04.288688 2565 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jun 11 18:28:04.288763 ip-10-0-130-170 kubenswrapper[2565]: E0611 18:28:04.288740 2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/2f4a1ff8-558e-4d9b-9208-ca0211b2b4e1-metrics-certs podName:2f4a1ff8-558e-4d9b-9208-ca0211b2b4e1 nodeName:}" failed. No retries permitted until 2026-06-11 18:28:05.288720929 +0000 UTC m=+4.037406944 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/2f4a1ff8-558e-4d9b-9208-ca0211b2b4e1-metrics-certs") pod "network-metrics-daemon-bvwxp" (UID: "2f4a1ff8-558e-4d9b-9208-ca0211b2b4e1") : object "openshift-multus"/"metrics-daemon-secret" not registered Jun 11 18:28:04.288763 ip-10-0-130-170 kubenswrapper[2565]: E0611 18:28:04.288754 2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/1f1530cc-c788-4dc5-9e3d-7209386e9b94-original-pull-secret podName:1f1530cc-c788-4dc5-9e3d-7209386e9b94 nodeName:}" failed. No retries permitted until 2026-06-11 18:28:05.288748156 +0000 UTC m=+4.037434156 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/1f1530cc-c788-4dc5-9e3d-7209386e9b94-original-pull-secret") pod "global-pull-secret-syncer-wqbfv" (UID: "1f1530cc-c788-4dc5-9e3d-7209386e9b94") : object "kube-system"/"original-pull-secret" not registered Jun 11 18:28:04.389386 ip-10-0-130-170 kubenswrapper[2565]: I0611 18:28:04.389340 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-78kwd\" (UniqueName: \"kubernetes.io/projected/48f7111f-5fb9-477e-8a9e-3e9b22030f6a-kube-api-access-78kwd\") pod \"network-check-target-nh426\" (UID: \"48f7111f-5fb9-477e-8a9e-3e9b22030f6a\") " pod="openshift-network-diagnostics/network-check-target-nh426" Jun 11 18:28:04.389557 ip-10-0-130-170 kubenswrapper[2565]: E0611 18:28:04.389487 2565 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jun 11 18:28:04.389557 ip-10-0-130-170 kubenswrapper[2565]: E0611 18:28:04.389512 2565 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jun 11 18:28:04.389557 ip-10-0-130-170 kubenswrapper[2565]: E0611 18:28:04.389521 2565 projected.go:196] Error preparing data for projected volume kube-api-access-78kwd for pod openshift-network-diagnostics/network-check-target-nh426: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 11 18:28:04.389698 ip-10-0-130-170 kubenswrapper[2565]: E0611 18:28:04.389606 2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/48f7111f-5fb9-477e-8a9e-3e9b22030f6a-kube-api-access-78kwd podName:48f7111f-5fb9-477e-8a9e-3e9b22030f6a nodeName:}" failed. No retries permitted until 2026-06-11 18:28:05.389562968 +0000 UTC m=+4.138248986 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-api-access-78kwd" (UniqueName: "kubernetes.io/projected/48f7111f-5fb9-477e-8a9e-3e9b22030f6a-kube-api-access-78kwd") pod "network-check-target-nh426" (UID: "48f7111f-5fb9-477e-8a9e-3e9b22030f6a") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 11 18:28:04.585312 ip-10-0-130-170 kubenswrapper[2565]: W0611 18:28:04.585287 2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3335d6c8_7cdf_4a68_a152_49545421f36d.slice/crio-6550ef54656a4c259834bb893f464cad42e4f734718d565dc5d31db9c408706b WatchSource:0}: Error finding container 6550ef54656a4c259834bb893f464cad42e4f734718d565dc5d31db9c408706b: Status 404 returned error can't find the container with id 6550ef54656a4c259834bb893f464cad42e4f734718d565dc5d31db9c408706b Jun 11 18:28:04.586874 ip-10-0-130-170 kubenswrapper[2565]: W0611 18:28:04.586845 2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7f5f862b_4ec0_44cd_96f3_1554a1656229.slice/crio-e17e129a90160d784fd3689ca3a7c7f930a6c1b81b09dbaf74291cd6df1d841d WatchSource:0}: Error finding container e17e129a90160d784fd3689ca3a7c7f930a6c1b81b09dbaf74291cd6df1d841d: Status 404 returned error can't find the container with id e17e129a90160d784fd3689ca3a7c7f930a6c1b81b09dbaf74291cd6df1d841d Jun 11 18:28:04.588564 ip-10-0-130-170 kubenswrapper[2565]: W0611 18:28:04.588455 2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5f6a1d9d_054f_4a94_99a3_21b77d4995dd.slice/crio-ad453f81071408f86e57283ce2f4935bd258ea59624e727d5fdeaaecfd1c2362 WatchSource:0}: Error finding container ad453f81071408f86e57283ce2f4935bd258ea59624e727d5fdeaaecfd1c2362: Status 404 returned error can't find the container with id ad453f81071408f86e57283ce2f4935bd258ea59624e727d5fdeaaecfd1c2362 Jun 11 18:28:04.591188 ip-10-0-130-170 kubenswrapper[2565]: W0611 18:28:04.590616 2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8e426e7d_dc89_476c_b72a_7cfc3b64a1f2.slice/crio-1726d60069ef00bce688b1ab9cdb61ac8df8f6782075b24ee265dba3c551708f WatchSource:0}: Error finding container 1726d60069ef00bce688b1ab9cdb61ac8df8f6782075b24ee265dba3c551708f: Status 404 returned error can't find the container with id 1726d60069ef00bce688b1ab9cdb61ac8df8f6782075b24ee265dba3c551708f Jun 11 18:28:04.592047 ip-10-0-130-170 kubenswrapper[2565]: W0611 18:28:04.592021 2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0a391608_1cd7_4bb8_8907_2f8e7078bf68.slice/crio-876a13e4cdec6b3280b671a7235850c9607603e0ab34eaf38eaa7f456fda1ac5 WatchSource:0}: Error finding container 876a13e4cdec6b3280b671a7235850c9607603e0ab34eaf38eaa7f456fda1ac5: Status 404 returned error can't find the container with id 876a13e4cdec6b3280b671a7235850c9607603e0ab34eaf38eaa7f456fda1ac5 Jun 11 18:28:04.712041 ip-10-0-130-170 kubenswrapper[2565]: I0611 18:28:04.712009 2565 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-06-10 18:23:03 +0000 UTC" deadline="2028-03-07 18:15:40.513297404 +0000 UTC" Jun 11 18:28:04.712041 ip-10-0-130-170 kubenswrapper[2565]: I0611 18:28:04.712039 2565 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="15239h47m35.801263624s" Jun 11 18:28:04.753401 ip-10-0-130-170 kubenswrapper[2565]: I0611 18:28:04.753360 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-130-170.ec2.internal" event={"ID":"cbc21c3b8650a365de338167fa32510b","Type":"ContainerStarted","Data":"7704ab99631a76efd3ac27b1ab2cb2b1548564dd42ac7ea7b869ea9199545105"} Jun 11 18:28:04.754606 ip-10-0-130-170 kubenswrapper[2565]: I0611 18:28:04.754576 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-pfc8t" event={"ID":"fbbe1b81-aba0-4a02-9e7e-b272155f08ff","Type":"ContainerStarted","Data":"3e1a517bfb0af2febf93fe69755246c8c068ab2275d1e6a6a816692881a78ba9"} Jun 11 18:28:04.755863 ip-10-0-130-170 kubenswrapper[2565]: I0611 18:28:04.755838 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-krq26" event={"ID":"c3f907b5-05ec-4fc1-ae51-df0b4b2432fd","Type":"ContainerStarted","Data":"9c5b0ca67531e072e11f5f11130c5228a484a3f6be94c15a8c9d77f39f8ce488"} Jun 11 18:28:04.757386 ip-10-0-130-170 kubenswrapper[2565]: I0611 18:28:04.757367 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-v4p88" event={"ID":"7a08c57b-6d27-43b1-8518-7d2564aa682e","Type":"ContainerStarted","Data":"61250f9fe526cb382be9a8c06cca10073815365ade8222d231747db5bd6896f7"} Jun 11 18:28:04.758591 ip-10-0-130-170 kubenswrapper[2565]: I0611 18:28:04.758556 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-9xbcp" event={"ID":"5f6a1d9d-054f-4a94-99a3-21b77d4995dd","Type":"ContainerStarted","Data":"ad453f81071408f86e57283ce2f4935bd258ea59624e727d5fdeaaecfd1c2362"} Jun 11 18:28:04.759706 ip-10-0-130-170 kubenswrapper[2565]: I0611 18:28:04.759682 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-rv8x7" event={"ID":"b36592f7-5d47-450e-bb47-12b43070bbf1","Type":"ContainerStarted","Data":"2bcd7cbf2caa833aa283a7a5bce3054bdf64e7f1cda472ba120c923ac332d69c"} Jun 11 18:28:04.760867 ip-10-0-130-170 kubenswrapper[2565]: I0611 18:28:04.760840 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-7qn5t" event={"ID":"0a391608-1cd7-4bb8-8907-2f8e7078bf68","Type":"ContainerStarted","Data":"876a13e4cdec6b3280b671a7235850c9607603e0ab34eaf38eaa7f456fda1ac5"} Jun 11 18:28:04.761870 ip-10-0-130-170 kubenswrapper[2565]: I0611 18:28:04.761851 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-ckltw" event={"ID":"8e426e7d-dc89-476c-b72a-7cfc3b64a1f2","Type":"ContainerStarted","Data":"1726d60069ef00bce688b1ab9cdb61ac8df8f6782075b24ee265dba3c551708f"} Jun 11 18:28:04.763008 ip-10-0-130-170 kubenswrapper[2565]: I0611 18:28:04.762989 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-wwlkz" event={"ID":"7f5f862b-4ec0-44cd-96f3-1554a1656229","Type":"ContainerStarted","Data":"e17e129a90160d784fd3689ca3a7c7f930a6c1b81b09dbaf74291cd6df1d841d"} Jun 11 18:28:04.763924 ip-10-0-130-170 kubenswrapper[2565]: I0611 18:28:04.763905 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-fbfnw" event={"ID":"3335d6c8-7cdf-4a68-a152-49545421f36d","Type":"ContainerStarted","Data":"6550ef54656a4c259834bb893f464cad42e4f734718d565dc5d31db9c408706b"} Jun 11 18:28:04.767096 ip-10-0-130-170 kubenswrapper[2565]: I0611 18:28:04.767058 2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/kube-apiserver-proxy-ip-10-0-130-170.ec2.internal" podStartSLOduration=2.7670464150000003 podStartE2EDuration="2.767046415s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-11 18:28:02 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-11 18:28:04.766941905 +0000 UTC m=+3.515627928" watchObservedRunningTime="2026-06-11 18:28:04.767046415 +0000 UTC m=+3.515732436" Jun 11 18:28:05.295641 ip-10-0-130-170 kubenswrapper[2565]: I0611 18:28:05.295318 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/1f1530cc-c788-4dc5-9e3d-7209386e9b94-original-pull-secret\") pod \"global-pull-secret-syncer-wqbfv\" (UID: \"1f1530cc-c788-4dc5-9e3d-7209386e9b94\") " pod="kube-system/global-pull-secret-syncer-wqbfv" Jun 11 18:28:05.295641 ip-10-0-130-170 kubenswrapper[2565]: I0611 18:28:05.295436 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/2f4a1ff8-558e-4d9b-9208-ca0211b2b4e1-metrics-certs\") pod \"network-metrics-daemon-bvwxp\" (UID: \"2f4a1ff8-558e-4d9b-9208-ca0211b2b4e1\") " pod="openshift-multus/network-metrics-daemon-bvwxp" Jun 11 18:28:05.295641 ip-10-0-130-170 kubenswrapper[2565]: E0611 18:28:05.295471 2565 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jun 11 18:28:05.295641 ip-10-0-130-170 kubenswrapper[2565]: E0611 18:28:05.295546 2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/1f1530cc-c788-4dc5-9e3d-7209386e9b94-original-pull-secret podName:1f1530cc-c788-4dc5-9e3d-7209386e9b94 nodeName:}" failed. No retries permitted until 2026-06-11 18:28:07.295526109 +0000 UTC m=+6.044212124 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/1f1530cc-c788-4dc5-9e3d-7209386e9b94-original-pull-secret") pod "global-pull-secret-syncer-wqbfv" (UID: "1f1530cc-c788-4dc5-9e3d-7209386e9b94") : object "kube-system"/"original-pull-secret" not registered Jun 11 18:28:05.295641 ip-10-0-130-170 kubenswrapper[2565]: E0611 18:28:05.295553 2565 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jun 11 18:28:05.295641 ip-10-0-130-170 kubenswrapper[2565]: E0611 18:28:05.295611 2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/2f4a1ff8-558e-4d9b-9208-ca0211b2b4e1-metrics-certs podName:2f4a1ff8-558e-4d9b-9208-ca0211b2b4e1 nodeName:}" failed. No retries permitted until 2026-06-11 18:28:07.295595321 +0000 UTC m=+6.044281326 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/2f4a1ff8-558e-4d9b-9208-ca0211b2b4e1-metrics-certs") pod "network-metrics-daemon-bvwxp" (UID: "2f4a1ff8-558e-4d9b-9208-ca0211b2b4e1") : object "openshift-multus"/"metrics-daemon-secret" not registered Jun 11 18:28:05.398609 ip-10-0-130-170 kubenswrapper[2565]: I0611 18:28:05.398568 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-78kwd\" (UniqueName: \"kubernetes.io/projected/48f7111f-5fb9-477e-8a9e-3e9b22030f6a-kube-api-access-78kwd\") pod \"network-check-target-nh426\" (UID: \"48f7111f-5fb9-477e-8a9e-3e9b22030f6a\") " pod="openshift-network-diagnostics/network-check-target-nh426" Jun 11 18:28:05.398794 ip-10-0-130-170 kubenswrapper[2565]: E0611 18:28:05.398737 2565 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jun 11 18:28:05.398794 ip-10-0-130-170 kubenswrapper[2565]: E0611 18:28:05.398760 2565 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jun 11 18:28:05.398794 ip-10-0-130-170 kubenswrapper[2565]: E0611 18:28:05.398775 2565 projected.go:196] Error preparing data for projected volume kube-api-access-78kwd for pod openshift-network-diagnostics/network-check-target-nh426: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 11 18:28:05.398956 ip-10-0-130-170 kubenswrapper[2565]: E0611 18:28:05.398837 2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/48f7111f-5fb9-477e-8a9e-3e9b22030f6a-kube-api-access-78kwd podName:48f7111f-5fb9-477e-8a9e-3e9b22030f6a nodeName:}" failed. No retries permitted until 2026-06-11 18:28:07.398819585 +0000 UTC m=+6.147505591 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-api-access-78kwd" (UniqueName: "kubernetes.io/projected/48f7111f-5fb9-477e-8a9e-3e9b22030f6a-kube-api-access-78kwd") pod "network-check-target-nh426" (UID: "48f7111f-5fb9-477e-8a9e-3e9b22030f6a") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 11 18:28:05.713104 ip-10-0-130-170 kubenswrapper[2565]: I0611 18:28:05.713039 2565 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-06-10 18:23:03 +0000 UTC" deadline="2028-01-05 10:36:32.995132984 +0000 UTC" Jun 11 18:28:05.713104 ip-10-0-130-170 kubenswrapper[2565]: I0611 18:28:05.713101 2565 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="13744h8m27.282035548s" Jun 11 18:28:05.742856 ip-10-0-130-170 kubenswrapper[2565]: I0611 18:28:05.742793 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-nh426" Jun 11 18:28:05.742856 ip-10-0-130-170 kubenswrapper[2565]: I0611 18:28:05.742823 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-bvwxp" Jun 11 18:28:05.743085 ip-10-0-130-170 kubenswrapper[2565]: E0611 18:28:05.742911 2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-nh426" podUID="48f7111f-5fb9-477e-8a9e-3e9b22030f6a" Jun 11 18:28:05.743085 ip-10-0-130-170 kubenswrapper[2565]: E0611 18:28:05.743049 2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-bvwxp" podUID="2f4a1ff8-558e-4d9b-9208-ca0211b2b4e1" Jun 11 18:28:05.743181 ip-10-0-130-170 kubenswrapper[2565]: I0611 18:28:05.743134 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-wqbfv" Jun 11 18:28:05.743228 ip-10-0-130-170 kubenswrapper[2565]: E0611 18:28:05.743208 2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-wqbfv" podUID="1f1530cc-c788-4dc5-9e3d-7209386e9b94" Jun 11 18:28:05.787456 ip-10-0-130-170 kubenswrapper[2565]: I0611 18:28:05.787418 2565 generic.go:356] "Generic (PLEG): container finished" podID="d27cacba6b716e5c50a39b60d514201c" containerID="c03d7bf498e66abd2ee25d618931831c0955ec978032b0ad6c4e9c5ecee39944" exitCode=0 Jun 11 18:28:05.788107 ip-10-0-130-170 kubenswrapper[2565]: I0611 18:28:05.787943 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-130-170.ec2.internal" event={"ID":"d27cacba6b716e5c50a39b60d514201c","Type":"ContainerDied","Data":"c03d7bf498e66abd2ee25d618931831c0955ec978032b0ad6c4e9c5ecee39944"} Jun 11 18:28:06.820301 ip-10-0-130-170 kubenswrapper[2565]: I0611 18:28:06.819399 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-130-170.ec2.internal" event={"ID":"d27cacba6b716e5c50a39b60d514201c","Type":"ContainerStarted","Data":"5eb686bac270e31a72b793c25ad25b2313e2ef38f8da3fd42c0057c928b58094"} Jun 11 18:28:07.314166 ip-10-0-130-170 kubenswrapper[2565]: I0611 18:28:07.314115 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/2f4a1ff8-558e-4d9b-9208-ca0211b2b4e1-metrics-certs\") pod \"network-metrics-daemon-bvwxp\" (UID: \"2f4a1ff8-558e-4d9b-9208-ca0211b2b4e1\") " pod="openshift-multus/network-metrics-daemon-bvwxp" Jun 11 18:28:07.314166 ip-10-0-130-170 kubenswrapper[2565]: I0611 18:28:07.314171 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/1f1530cc-c788-4dc5-9e3d-7209386e9b94-original-pull-secret\") pod \"global-pull-secret-syncer-wqbfv\" (UID: \"1f1530cc-c788-4dc5-9e3d-7209386e9b94\") " pod="kube-system/global-pull-secret-syncer-wqbfv" Jun 11 18:28:07.314459 ip-10-0-130-170 kubenswrapper[2565]: E0611 18:28:07.314328 2565 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jun 11 18:28:07.314459 ip-10-0-130-170 kubenswrapper[2565]: E0611 18:28:07.314394 2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/1f1530cc-c788-4dc5-9e3d-7209386e9b94-original-pull-secret podName:1f1530cc-c788-4dc5-9e3d-7209386e9b94 nodeName:}" failed. No retries permitted until 2026-06-11 18:28:11.314375684 +0000 UTC m=+10.063061687 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/1f1530cc-c788-4dc5-9e3d-7209386e9b94-original-pull-secret") pod "global-pull-secret-syncer-wqbfv" (UID: "1f1530cc-c788-4dc5-9e3d-7209386e9b94") : object "kube-system"/"original-pull-secret" not registered Jun 11 18:28:07.314580 ip-10-0-130-170 kubenswrapper[2565]: E0611 18:28:07.314470 2565 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jun 11 18:28:07.314580 ip-10-0-130-170 kubenswrapper[2565]: E0611 18:28:07.314509 2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/2f4a1ff8-558e-4d9b-9208-ca0211b2b4e1-metrics-certs podName:2f4a1ff8-558e-4d9b-9208-ca0211b2b4e1 nodeName:}" failed. No retries permitted until 2026-06-11 18:28:11.314497015 +0000 UTC m=+10.063183019 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/2f4a1ff8-558e-4d9b-9208-ca0211b2b4e1-metrics-certs") pod "network-metrics-daemon-bvwxp" (UID: "2f4a1ff8-558e-4d9b-9208-ca0211b2b4e1") : object "openshift-multus"/"metrics-daemon-secret" not registered Jun 11 18:28:07.415099 ip-10-0-130-170 kubenswrapper[2565]: I0611 18:28:07.415060 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-78kwd\" (UniqueName: \"kubernetes.io/projected/48f7111f-5fb9-477e-8a9e-3e9b22030f6a-kube-api-access-78kwd\") pod \"network-check-target-nh426\" (UID: \"48f7111f-5fb9-477e-8a9e-3e9b22030f6a\") " pod="openshift-network-diagnostics/network-check-target-nh426" Jun 11 18:28:07.415308 ip-10-0-130-170 kubenswrapper[2565]: E0611 18:28:07.415290 2565 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jun 11 18:28:07.415377 ip-10-0-130-170 kubenswrapper[2565]: E0611 18:28:07.415316 2565 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jun 11 18:28:07.415377 ip-10-0-130-170 kubenswrapper[2565]: E0611 18:28:07.415331 2565 projected.go:196] Error preparing data for projected volume kube-api-access-78kwd for pod openshift-network-diagnostics/network-check-target-nh426: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 11 18:28:07.415475 ip-10-0-130-170 kubenswrapper[2565]: E0611 18:28:07.415414 2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/48f7111f-5fb9-477e-8a9e-3e9b22030f6a-kube-api-access-78kwd podName:48f7111f-5fb9-477e-8a9e-3e9b22030f6a nodeName:}" failed. No retries permitted until 2026-06-11 18:28:11.41537126 +0000 UTC m=+10.164057272 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-api-access-78kwd" (UniqueName: "kubernetes.io/projected/48f7111f-5fb9-477e-8a9e-3e9b22030f6a-kube-api-access-78kwd") pod "network-check-target-nh426" (UID: "48f7111f-5fb9-477e-8a9e-3e9b22030f6a") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 11 18:28:07.744289 ip-10-0-130-170 kubenswrapper[2565]: I0611 18:28:07.744240 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-bvwxp" Jun 11 18:28:07.744465 ip-10-0-130-170 kubenswrapper[2565]: E0611 18:28:07.744376 2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-bvwxp" podUID="2f4a1ff8-558e-4d9b-9208-ca0211b2b4e1" Jun 11 18:28:07.744691 ip-10-0-130-170 kubenswrapper[2565]: I0611 18:28:07.744672 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-wqbfv" Jun 11 18:28:07.744772 ip-10-0-130-170 kubenswrapper[2565]: E0611 18:28:07.744756 2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-wqbfv" podUID="1f1530cc-c788-4dc5-9e3d-7209386e9b94" Jun 11 18:28:07.744823 ip-10-0-130-170 kubenswrapper[2565]: I0611 18:28:07.744791 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-nh426" Jun 11 18:28:07.744871 ip-10-0-130-170 kubenswrapper[2565]: E0611 18:28:07.744839 2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-nh426" podUID="48f7111f-5fb9-477e-8a9e-3e9b22030f6a" Jun 11 18:28:09.743125 ip-10-0-130-170 kubenswrapper[2565]: I0611 18:28:09.743086 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-bvwxp" Jun 11 18:28:09.743632 ip-10-0-130-170 kubenswrapper[2565]: I0611 18:28:09.743100 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-nh426" Jun 11 18:28:09.743632 ip-10-0-130-170 kubenswrapper[2565]: I0611 18:28:09.743238 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-wqbfv" Jun 11 18:28:09.743632 ip-10-0-130-170 kubenswrapper[2565]: E0611 18:28:09.743239 2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-bvwxp" podUID="2f4a1ff8-558e-4d9b-9208-ca0211b2b4e1" Jun 11 18:28:09.743632 ip-10-0-130-170 kubenswrapper[2565]: E0611 18:28:09.743339 2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-nh426" podUID="48f7111f-5fb9-477e-8a9e-3e9b22030f6a" Jun 11 18:28:09.743632 ip-10-0-130-170 kubenswrapper[2565]: E0611 18:28:09.743418 2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-wqbfv" podUID="1f1530cc-c788-4dc5-9e3d-7209386e9b94" Jun 11 18:28:11.349375 ip-10-0-130-170 kubenswrapper[2565]: I0611 18:28:11.349336 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/2f4a1ff8-558e-4d9b-9208-ca0211b2b4e1-metrics-certs\") pod \"network-metrics-daemon-bvwxp\" (UID: \"2f4a1ff8-558e-4d9b-9208-ca0211b2b4e1\") " pod="openshift-multus/network-metrics-daemon-bvwxp" Jun 11 18:28:11.349857 ip-10-0-130-170 kubenswrapper[2565]: I0611 18:28:11.349391 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/1f1530cc-c788-4dc5-9e3d-7209386e9b94-original-pull-secret\") pod \"global-pull-secret-syncer-wqbfv\" (UID: \"1f1530cc-c788-4dc5-9e3d-7209386e9b94\") " pod="kube-system/global-pull-secret-syncer-wqbfv" Jun 11 18:28:11.349857 ip-10-0-130-170 kubenswrapper[2565]: E0611 18:28:11.349509 2565 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jun 11 18:28:11.349857 ip-10-0-130-170 kubenswrapper[2565]: E0611 18:28:11.349518 2565 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jun 11 18:28:11.349857 ip-10-0-130-170 kubenswrapper[2565]: E0611 18:28:11.349559 2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/1f1530cc-c788-4dc5-9e3d-7209386e9b94-original-pull-secret podName:1f1530cc-c788-4dc5-9e3d-7209386e9b94 nodeName:}" failed. No retries permitted until 2026-06-11 18:28:19.349546237 +0000 UTC m=+18.098232242 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/1f1530cc-c788-4dc5-9e3d-7209386e9b94-original-pull-secret") pod "global-pull-secret-syncer-wqbfv" (UID: "1f1530cc-c788-4dc5-9e3d-7209386e9b94") : object "kube-system"/"original-pull-secret" not registered Jun 11 18:28:11.349857 ip-10-0-130-170 kubenswrapper[2565]: E0611 18:28:11.349584 2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/2f4a1ff8-558e-4d9b-9208-ca0211b2b4e1-metrics-certs podName:2f4a1ff8-558e-4d9b-9208-ca0211b2b4e1 nodeName:}" failed. No retries permitted until 2026-06-11 18:28:19.349566354 +0000 UTC m=+18.098252361 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/2f4a1ff8-558e-4d9b-9208-ca0211b2b4e1-metrics-certs") pod "network-metrics-daemon-bvwxp" (UID: "2f4a1ff8-558e-4d9b-9208-ca0211b2b4e1") : object "openshift-multus"/"metrics-daemon-secret" not registered Jun 11 18:28:11.450010 ip-10-0-130-170 kubenswrapper[2565]: I0611 18:28:11.449969 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-78kwd\" (UniqueName: \"kubernetes.io/projected/48f7111f-5fb9-477e-8a9e-3e9b22030f6a-kube-api-access-78kwd\") pod \"network-check-target-nh426\" (UID: \"48f7111f-5fb9-477e-8a9e-3e9b22030f6a\") " pod="openshift-network-diagnostics/network-check-target-nh426" Jun 11 18:28:11.450571 ip-10-0-130-170 kubenswrapper[2565]: E0611 18:28:11.450172 2565 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jun 11 18:28:11.450571 ip-10-0-130-170 kubenswrapper[2565]: E0611 18:28:11.450197 2565 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jun 11 18:28:11.450571 ip-10-0-130-170 kubenswrapper[2565]: E0611 18:28:11.450209 2565 projected.go:196] Error preparing data for projected volume kube-api-access-78kwd for pod openshift-network-diagnostics/network-check-target-nh426: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 11 18:28:11.450571 ip-10-0-130-170 kubenswrapper[2565]: E0611 18:28:11.450285 2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/48f7111f-5fb9-477e-8a9e-3e9b22030f6a-kube-api-access-78kwd podName:48f7111f-5fb9-477e-8a9e-3e9b22030f6a nodeName:}" failed. No retries permitted until 2026-06-11 18:28:19.450251059 +0000 UTC m=+18.198937062 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-api-access-78kwd" (UniqueName: "kubernetes.io/projected/48f7111f-5fb9-477e-8a9e-3e9b22030f6a-kube-api-access-78kwd") pod "network-check-target-nh426" (UID: "48f7111f-5fb9-477e-8a9e-3e9b22030f6a") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 11 18:28:11.743137 ip-10-0-130-170 kubenswrapper[2565]: I0611 18:28:11.743106 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-bvwxp" Jun 11 18:28:11.743314 ip-10-0-130-170 kubenswrapper[2565]: E0611 18:28:11.743203 2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-bvwxp" podUID="2f4a1ff8-558e-4d9b-9208-ca0211b2b4e1" Jun 11 18:28:11.743314 ip-10-0-130-170 kubenswrapper[2565]: I0611 18:28:11.743302 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-wqbfv" Jun 11 18:28:11.743398 ip-10-0-130-170 kubenswrapper[2565]: E0611 18:28:11.743378 2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-wqbfv" podUID="1f1530cc-c788-4dc5-9e3d-7209386e9b94" Jun 11 18:28:11.743433 ip-10-0-130-170 kubenswrapper[2565]: I0611 18:28:11.743407 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-nh426" Jun 11 18:28:11.743462 ip-10-0-130-170 kubenswrapper[2565]: E0611 18:28:11.743447 2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-nh426" podUID="48f7111f-5fb9-477e-8a9e-3e9b22030f6a" Jun 11 18:28:13.743357 ip-10-0-130-170 kubenswrapper[2565]: I0611 18:28:13.742856 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-bvwxp" Jun 11 18:28:13.743357 ip-10-0-130-170 kubenswrapper[2565]: I0611 18:28:13.742880 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-wqbfv" Jun 11 18:28:13.743357 ip-10-0-130-170 kubenswrapper[2565]: I0611 18:28:13.742858 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-nh426" Jun 11 18:28:13.743357 ip-10-0-130-170 kubenswrapper[2565]: E0611 18:28:13.743022 2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-wqbfv" podUID="1f1530cc-c788-4dc5-9e3d-7209386e9b94" Jun 11 18:28:13.743357 ip-10-0-130-170 kubenswrapper[2565]: E0611 18:28:13.743056 2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-nh426" podUID="48f7111f-5fb9-477e-8a9e-3e9b22030f6a" Jun 11 18:28:13.743357 ip-10-0-130-170 kubenswrapper[2565]: E0611 18:28:13.743155 2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-bvwxp" podUID="2f4a1ff8-558e-4d9b-9208-ca0211b2b4e1" Jun 11 18:28:15.742555 ip-10-0-130-170 kubenswrapper[2565]: I0611 18:28:15.742513 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-bvwxp" Jun 11 18:28:15.743024 ip-10-0-130-170 kubenswrapper[2565]: I0611 18:28:15.742518 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-wqbfv" Jun 11 18:28:15.743024 ip-10-0-130-170 kubenswrapper[2565]: E0611 18:28:15.742658 2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-bvwxp" podUID="2f4a1ff8-558e-4d9b-9208-ca0211b2b4e1" Jun 11 18:28:15.743024 ip-10-0-130-170 kubenswrapper[2565]: I0611 18:28:15.742713 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-nh426" Jun 11 18:28:15.743024 ip-10-0-130-170 kubenswrapper[2565]: E0611 18:28:15.742843 2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-wqbfv" podUID="1f1530cc-c788-4dc5-9e3d-7209386e9b94" Jun 11 18:28:15.743024 ip-10-0-130-170 kubenswrapper[2565]: E0611 18:28:15.742934 2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-nh426" podUID="48f7111f-5fb9-477e-8a9e-3e9b22030f6a" Jun 11 18:28:17.742479 ip-10-0-130-170 kubenswrapper[2565]: I0611 18:28:17.742445 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-nh426" Jun 11 18:28:17.742479 ip-10-0-130-170 kubenswrapper[2565]: I0611 18:28:17.742475 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-wqbfv" Jun 11 18:28:17.743010 ip-10-0-130-170 kubenswrapper[2565]: I0611 18:28:17.742445 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-bvwxp" Jun 11 18:28:17.743010 ip-10-0-130-170 kubenswrapper[2565]: E0611 18:28:17.742565 2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-nh426" podUID="48f7111f-5fb9-477e-8a9e-3e9b22030f6a" Jun 11 18:28:17.743117 ip-10-0-130-170 kubenswrapper[2565]: E0611 18:28:17.743090 2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-bvwxp" podUID="2f4a1ff8-558e-4d9b-9208-ca0211b2b4e1" Jun 11 18:28:17.743411 ip-10-0-130-170 kubenswrapper[2565]: E0611 18:28:17.743384 2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-wqbfv" podUID="1f1530cc-c788-4dc5-9e3d-7209386e9b94" Jun 11 18:28:19.413582 ip-10-0-130-170 kubenswrapper[2565]: I0611 18:28:19.413539 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/2f4a1ff8-558e-4d9b-9208-ca0211b2b4e1-metrics-certs\") pod \"network-metrics-daemon-bvwxp\" (UID: \"2f4a1ff8-558e-4d9b-9208-ca0211b2b4e1\") " pod="openshift-multus/network-metrics-daemon-bvwxp" Jun 11 18:28:19.414027 ip-10-0-130-170 kubenswrapper[2565]: I0611 18:28:19.413600 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/1f1530cc-c788-4dc5-9e3d-7209386e9b94-original-pull-secret\") pod \"global-pull-secret-syncer-wqbfv\" (UID: \"1f1530cc-c788-4dc5-9e3d-7209386e9b94\") " pod="kube-system/global-pull-secret-syncer-wqbfv" Jun 11 18:28:19.414027 ip-10-0-130-170 kubenswrapper[2565]: E0611 18:28:19.413717 2565 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jun 11 18:28:19.414027 ip-10-0-130-170 kubenswrapper[2565]: E0611 18:28:19.413746 2565 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jun 11 18:28:19.414027 ip-10-0-130-170 kubenswrapper[2565]: E0611 18:28:19.413821 2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/1f1530cc-c788-4dc5-9e3d-7209386e9b94-original-pull-secret podName:1f1530cc-c788-4dc5-9e3d-7209386e9b94 nodeName:}" failed. No retries permitted until 2026-06-11 18:28:35.413799373 +0000 UTC m=+34.162485378 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/1f1530cc-c788-4dc5-9e3d-7209386e9b94-original-pull-secret") pod "global-pull-secret-syncer-wqbfv" (UID: "1f1530cc-c788-4dc5-9e3d-7209386e9b94") : object "kube-system"/"original-pull-secret" not registered Jun 11 18:28:19.414027 ip-10-0-130-170 kubenswrapper[2565]: E0611 18:28:19.413845 2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/2f4a1ff8-558e-4d9b-9208-ca0211b2b4e1-metrics-certs podName:2f4a1ff8-558e-4d9b-9208-ca0211b2b4e1 nodeName:}" failed. No retries permitted until 2026-06-11 18:28:35.413832786 +0000 UTC m=+34.162518789 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/2f4a1ff8-558e-4d9b-9208-ca0211b2b4e1-metrics-certs") pod "network-metrics-daemon-bvwxp" (UID: "2f4a1ff8-558e-4d9b-9208-ca0211b2b4e1") : object "openshift-multus"/"metrics-daemon-secret" not registered Jun 11 18:28:19.514026 ip-10-0-130-170 kubenswrapper[2565]: I0611 18:28:19.513983 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-78kwd\" (UniqueName: \"kubernetes.io/projected/48f7111f-5fb9-477e-8a9e-3e9b22030f6a-kube-api-access-78kwd\") pod \"network-check-target-nh426\" (UID: \"48f7111f-5fb9-477e-8a9e-3e9b22030f6a\") " pod="openshift-network-diagnostics/network-check-target-nh426" Jun 11 18:28:19.514216 ip-10-0-130-170 kubenswrapper[2565]: E0611 18:28:19.514138 2565 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jun 11 18:28:19.514216 ip-10-0-130-170 kubenswrapper[2565]: E0611 18:28:19.514158 2565 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jun 11 18:28:19.514216 ip-10-0-130-170 kubenswrapper[2565]: E0611 18:28:19.514167 2565 projected.go:196] Error preparing data for projected volume kube-api-access-78kwd for pod openshift-network-diagnostics/network-check-target-nh426: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 11 18:28:19.514380 ip-10-0-130-170 kubenswrapper[2565]: E0611 18:28:19.514225 2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/48f7111f-5fb9-477e-8a9e-3e9b22030f6a-kube-api-access-78kwd podName:48f7111f-5fb9-477e-8a9e-3e9b22030f6a nodeName:}" failed. No retries permitted until 2026-06-11 18:28:35.514210461 +0000 UTC m=+34.262896478 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "kube-api-access-78kwd" (UniqueName: "kubernetes.io/projected/48f7111f-5fb9-477e-8a9e-3e9b22030f6a-kube-api-access-78kwd") pod "network-check-target-nh426" (UID: "48f7111f-5fb9-477e-8a9e-3e9b22030f6a") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 11 18:28:19.742665 ip-10-0-130-170 kubenswrapper[2565]: I0611 18:28:19.742577 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-wqbfv" Jun 11 18:28:19.742804 ip-10-0-130-170 kubenswrapper[2565]: I0611 18:28:19.742576 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-nh426" Jun 11 18:28:19.742804 ip-10-0-130-170 kubenswrapper[2565]: E0611 18:28:19.742727 2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-wqbfv" podUID="1f1530cc-c788-4dc5-9e3d-7209386e9b94" Jun 11 18:28:19.742804 ip-10-0-130-170 kubenswrapper[2565]: E0611 18:28:19.742738 2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-nh426" podUID="48f7111f-5fb9-477e-8a9e-3e9b22030f6a" Jun 11 18:28:19.742804 ip-10-0-130-170 kubenswrapper[2565]: I0611 18:28:19.742577 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-bvwxp" Jun 11 18:28:19.742934 ip-10-0-130-170 kubenswrapper[2565]: E0611 18:28:19.742876 2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-bvwxp" podUID="2f4a1ff8-558e-4d9b-9208-ca0211b2b4e1" Jun 11 18:28:21.744027 ip-10-0-130-170 kubenswrapper[2565]: I0611 18:28:21.743990 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-nh426" Jun 11 18:28:21.744561 ip-10-0-130-170 kubenswrapper[2565]: E0611 18:28:21.744108 2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-nh426" podUID="48f7111f-5fb9-477e-8a9e-3e9b22030f6a" Jun 11 18:28:21.744561 ip-10-0-130-170 kubenswrapper[2565]: I0611 18:28:21.744149 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-wqbfv" Jun 11 18:28:21.744561 ip-10-0-130-170 kubenswrapper[2565]: I0611 18:28:21.744239 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-bvwxp" Jun 11 18:28:21.744561 ip-10-0-130-170 kubenswrapper[2565]: E0611 18:28:21.744249 2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-wqbfv" podUID="1f1530cc-c788-4dc5-9e3d-7209386e9b94" Jun 11 18:28:21.744561 ip-10-0-130-170 kubenswrapper[2565]: E0611 18:28:21.744374 2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-bvwxp" podUID="2f4a1ff8-558e-4d9b-9208-ca0211b2b4e1" Jun 11 18:28:23.743486 ip-10-0-130-170 kubenswrapper[2565]: I0611 18:28:23.742455 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-nh426" Jun 11 18:28:23.743486 ip-10-0-130-170 kubenswrapper[2565]: I0611 18:28:23.742668 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-bvwxp" Jun 11 18:28:23.743486 ip-10-0-130-170 kubenswrapper[2565]: E0611 18:28:23.742759 2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-nh426" podUID="48f7111f-5fb9-477e-8a9e-3e9b22030f6a" Jun 11 18:28:23.743486 ip-10-0-130-170 kubenswrapper[2565]: E0611 18:28:23.743443 2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-bvwxp" podUID="2f4a1ff8-558e-4d9b-9208-ca0211b2b4e1" Jun 11 18:28:23.744674 ip-10-0-130-170 kubenswrapper[2565]: I0611 18:28:23.744565 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-wqbfv" Jun 11 18:28:23.744674 ip-10-0-130-170 kubenswrapper[2565]: E0611 18:28:23.744643 2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-wqbfv" podUID="1f1530cc-c788-4dc5-9e3d-7209386e9b94" Jun 11 18:28:23.858037 ip-10-0-130-170 kubenswrapper[2565]: I0611 18:28:23.858006 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-rv8x7" event={"ID":"b36592f7-5d47-450e-bb47-12b43070bbf1","Type":"ContainerStarted","Data":"6d196af0345640756c59fe784fc7bcf74f192114ab4f90b17c051dfaa28dab03"} Jun 11 18:28:23.859674 ip-10-0-130-170 kubenswrapper[2565]: I0611 18:28:23.859645 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-7qn5t" event={"ID":"0a391608-1cd7-4bb8-8907-2f8e7078bf68","Type":"ContainerStarted","Data":"3d0345f5a5879654983fbe8dbb9296577c8283cad65f8fb26c726b279eb813f9"} Jun 11 18:28:23.861132 ip-10-0-130-170 kubenswrapper[2565]: I0611 18:28:23.861108 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-ckltw" event={"ID":"8e426e7d-dc89-476c-b72a-7cfc3b64a1f2","Type":"ContainerStarted","Data":"e0c6c9aaabf4c223d5d156a711ff6c98d03012c2da0b25beb21b75d59dca67a0"} Jun 11 18:28:23.862902 ip-10-0-130-170 kubenswrapper[2565]: I0611 18:28:23.862877 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-wwlkz" event={"ID":"7f5f862b-4ec0-44cd-96f3-1554a1656229","Type":"ContainerStarted","Data":"9f942738750984bd799688744df0f11a9173021d11086cca181b64eeca4cd8c0"} Jun 11 18:28:23.864088 ip-10-0-130-170 kubenswrapper[2565]: I0611 18:28:23.864067 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-fbfnw" event={"ID":"3335d6c8-7cdf-4a68-a152-49545421f36d","Type":"ContainerStarted","Data":"dda4724d288a1151fc5002e70ef50d95ff407c649d13147742a8fda2149ca55f"} Jun 11 18:28:23.865295 ip-10-0-130-170 kubenswrapper[2565]: I0611 18:28:23.865276 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-pfc8t" event={"ID":"fbbe1b81-aba0-4a02-9e7e-b272155f08ff","Type":"ContainerStarted","Data":"65881d33684bc8492a2464da0499209ea7de659738ddcf86d178b1952c7680a0"} Jun 11 18:28:23.866400 ip-10-0-130-170 kubenswrapper[2565]: I0611 18:28:23.866380 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-krq26" event={"ID":"c3f907b5-05ec-4fc1-ae51-df0b4b2432fd","Type":"ContainerStarted","Data":"65d64ea90c7b8fe4b7998a834ccad93e660b065ca4e79dc15a818d6989dc5244"} Jun 11 18:28:23.867672 ip-10-0-130-170 kubenswrapper[2565]: I0611 18:28:23.867655 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-9xbcp" event={"ID":"5f6a1d9d-054f-4a94-99a3-21b77d4995dd","Type":"ContainerStarted","Data":"a6598e92dbd33a62df6ceb90027f9bcd935d108ff63906db93cffcbd058b532b"} Jun 11 18:28:23.871715 ip-10-0-130-170 kubenswrapper[2565]: I0611 18:28:23.871677 2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-130-170.ec2.internal" podStartSLOduration=21.871666579 podStartE2EDuration="21.871666579s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-11 18:28:02 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-11 18:28:06.836377025 +0000 UTC m=+5.585063049" watchObservedRunningTime="2026-06-11 18:28:23.871666579 +0000 UTC m=+22.620352601" Jun 11 18:28:23.872160 ip-10-0-130-170 kubenswrapper[2565]: I0611 18:28:23.872140 2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/konnectivity-agent-rv8x7" podStartSLOduration=4.048743697 podStartE2EDuration="22.872134391s" totalImagesPullingTime="18.823390694s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-11 18:28:01 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-11 18:28:23.871441711 +0000 UTC m=+22.620127733" watchObservedRunningTime="2026-06-11 18:28:23.872134391 +0000 UTC m=+22.620820414" Jun 11 18:28:23.886546 ip-10-0-130-170 kubenswrapper[2565]: I0611 18:28:23.886510 2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-node-tuning-operator/tuned-krq26" podStartSLOduration=4.008796164 podStartE2EDuration="22.886493766s" totalImagesPullingTime="18.877697602s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-11 18:28:01 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-11 18:28:23.886454171 +0000 UTC m=+22.635140193" watchObservedRunningTime="2026-06-11 18:28:23.886493766 +0000 UTC m=+22.635179789" Jun 11 18:28:23.918221 ip-10-0-130-170 kubenswrapper[2565]: I0611 18:28:23.918040 2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/node-ca-wwlkz" podStartSLOduration=4.054095787 podStartE2EDuration="22.918026505s" totalImagesPullingTime="18.863930718s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-11 18:28:01 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-11 18:28:23.917721117 +0000 UTC m=+22.666407139" watchObservedRunningTime="2026-06-11 18:28:23.918026505 +0000 UTC m=+22.666712527" Jun 11 18:28:23.934665 ip-10-0-130-170 kubenswrapper[2565]: I0611 18:28:23.934591 2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-pfc8t" podStartSLOduration=4.045562698 podStartE2EDuration="22.934574914s" totalImagesPullingTime="18.889012216s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-11 18:28:01 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-11 18:28:23.934525662 +0000 UTC m=+22.683211683" watchObservedRunningTime="2026-06-11 18:28:23.934574914 +0000 UTC m=+22.683260935" Jun 11 18:28:23.954153 ip-10-0-130-170 kubenswrapper[2565]: I0611 18:28:23.954116 2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/node-resolver-ckltw" podStartSLOduration=4.063586852 podStartE2EDuration="22.954103164s" totalImagesPullingTime="18.890516312s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-11 18:28:01 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-11 18:28:23.953924908 +0000 UTC m=+22.702610944" watchObservedRunningTime="2026-06-11 18:28:23.954103164 +0000 UTC m=+22.702789186" Jun 11 18:28:24.857995 ip-10-0-130-170 kubenswrapper[2565]: I0611 18:28:24.857968 2565 plugin_watcher.go:194] "Adding socket path or updating timestamp to desired state cache" path="/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock" Jun 11 18:28:24.871034 ip-10-0-130-170 kubenswrapper[2565]: I0611 18:28:24.870924 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-v4p88" event={"ID":"7a08c57b-6d27-43b1-8518-7d2564aa682e","Type":"ContainerStarted","Data":"f0b4a13e7f18982bd509e6d339d6eef58508d343d49ce8071b401884ca4e9fcc"} Jun 11 18:28:24.873602 ip-10-0-130-170 kubenswrapper[2565]: I0611 18:28:24.873585 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-9xbcp_5f6a1d9d-054f-4a94-99a3-21b77d4995dd/ovn-acl-logging/0.log" Jun 11 18:28:24.873920 ip-10-0-130-170 kubenswrapper[2565]: I0611 18:28:24.873899 2565 generic.go:356] "Generic (PLEG): container finished" podID="5f6a1d9d-054f-4a94-99a3-21b77d4995dd" containerID="ae27fe337bbdf1bad9303adf2a4a9f1fbdc26a9c97b0e4431b5a4af40b290f40" exitCode=1 Jun 11 18:28:24.874005 ip-10-0-130-170 kubenswrapper[2565]: I0611 18:28:24.873973 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-9xbcp" event={"ID":"5f6a1d9d-054f-4a94-99a3-21b77d4995dd","Type":"ContainerStarted","Data":"2f78df47fe1cc337f8b5f202dbf46cf1c390353a88aff4e29da469800e03893c"} Jun 11 18:28:24.874072 ip-10-0-130-170 kubenswrapper[2565]: I0611 18:28:24.874056 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-9xbcp" event={"ID":"5f6a1d9d-054f-4a94-99a3-21b77d4995dd","Type":"ContainerStarted","Data":"9bf3456dcd77ad4e08fcf8c521f41685df61f5815561d6b36ab99c12621a49a8"} Jun 11 18:28:24.874116 ip-10-0-130-170 kubenswrapper[2565]: I0611 18:28:24.874099 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-9xbcp" event={"ID":"5f6a1d9d-054f-4a94-99a3-21b77d4995dd","Type":"ContainerStarted","Data":"08154c1e871b94b2e200d5ee080ab9375b2aa18e75658f550c11f7db31ba1a82"} Jun 11 18:28:24.874164 ip-10-0-130-170 kubenswrapper[2565]: I0611 18:28:24.874154 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-9xbcp" event={"ID":"5f6a1d9d-054f-4a94-99a3-21b77d4995dd","Type":"ContainerStarted","Data":"d81971663c8d5910f10594c254a04413a1637cafdad5142de7999943e7cd5385"} Jun 11 18:28:24.874209 ip-10-0-130-170 kubenswrapper[2565]: I0611 18:28:24.874188 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-9xbcp" event={"ID":"5f6a1d9d-054f-4a94-99a3-21b77d4995dd","Type":"ContainerDied","Data":"ae27fe337bbdf1bad9303adf2a4a9f1fbdc26a9c97b0e4431b5a4af40b290f40"} Jun 11 18:28:24.875464 ip-10-0-130-170 kubenswrapper[2565]: I0611 18:28:24.875440 2565 generic.go:356] "Generic (PLEG): container finished" podID="0a391608-1cd7-4bb8-8907-2f8e7078bf68" containerID="3d0345f5a5879654983fbe8dbb9296577c8283cad65f8fb26c726b279eb813f9" exitCode=0 Jun 11 18:28:24.875539 ip-10-0-130-170 kubenswrapper[2565]: I0611 18:28:24.875516 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-7qn5t" event={"ID":"0a391608-1cd7-4bb8-8907-2f8e7078bf68","Type":"ContainerDied","Data":"3d0345f5a5879654983fbe8dbb9296577c8283cad65f8fb26c726b279eb813f9"} Jun 11 18:28:24.877314 ip-10-0-130-170 kubenswrapper[2565]: I0611 18:28:24.877288 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-fbfnw" event={"ID":"3335d6c8-7cdf-4a68-a152-49545421f36d","Type":"ContainerStarted","Data":"7a96c96917bae7279f373cca731a6b34219711d66010e0a65d05c6814c6a56bc"} Jun 11 18:28:24.885966 ip-10-0-130-170 kubenswrapper[2565]: I0611 18:28:24.885906 2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-operator/iptables-alerter-v4p88" podStartSLOduration=5.029248966 podStartE2EDuration="23.885894355s" totalImagesPullingTime="18.856645389s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-11 18:28:01 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-11 18:28:24.885305376 +0000 UTC m=+23.633991398" watchObservedRunningTime="2026-06-11 18:28:24.885894355 +0000 UTC m=+23.634580377" Jun 11 18:28:25.132118 ip-10-0-130-170 kubenswrapper[2565]: I0611 18:28:25.131958 2565 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="kube-system/konnectivity-agent-rv8x7" Jun 11 18:28:25.132553 ip-10-0-130-170 kubenswrapper[2565]: I0611 18:28:25.132538 2565 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="kube-system/konnectivity-agent-rv8x7" Jun 11 18:28:25.743485 ip-10-0-130-170 kubenswrapper[2565]: I0611 18:28:25.743453 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-wqbfv" Jun 11 18:28:25.743671 ip-10-0-130-170 kubenswrapper[2565]: I0611 18:28:25.743453 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-nh426" Jun 11 18:28:25.743671 ip-10-0-130-170 kubenswrapper[2565]: E0611 18:28:25.743580 2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-wqbfv" podUID="1f1530cc-c788-4dc5-9e3d-7209386e9b94" Jun 11 18:28:25.743796 ip-10-0-130-170 kubenswrapper[2565]: E0611 18:28:25.743665 2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-nh426" podUID="48f7111f-5fb9-477e-8a9e-3e9b22030f6a" Jun 11 18:28:25.743796 ip-10-0-130-170 kubenswrapper[2565]: I0611 18:28:25.743461 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-bvwxp" Jun 11 18:28:25.743796 ip-10-0-130-170 kubenswrapper[2565]: E0611 18:28:25.743785 2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-bvwxp" podUID="2f4a1ff8-558e-4d9b-9208-ca0211b2b4e1" Jun 11 18:28:25.754151 ip-10-0-130-170 kubenswrapper[2565]: I0611 18:28:25.754060 2565 reconciler.go:161] "OperationExecutor.RegisterPlugin started" plugin={"SocketPath":"/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock","Timestamp":"2026-06-11T18:28:24.857990827Z","UUID":"5b2cf071-9245-4ba0-8843-eecbb62e9a15","Handler":null,"Name":"","Endpoint":""} Jun 11 18:28:25.755872 ip-10-0-130-170 kubenswrapper[2565]: I0611 18:28:25.755849 2565 csi_plugin.go:106] kubernetes.io/csi: Trying to validate a new CSI Driver with name: ebs.csi.aws.com endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock versions: 1.0.0 Jun 11 18:28:25.755981 ip-10-0-130-170 kubenswrapper[2565]: I0611 18:28:25.755882 2565 csi_plugin.go:119] kubernetes.io/csi: Register new plugin with name: ebs.csi.aws.com at endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock Jun 11 18:28:26.885303 ip-10-0-130-170 kubenswrapper[2565]: I0611 18:28:26.885276 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-9xbcp_5f6a1d9d-054f-4a94-99a3-21b77d4995dd/ovn-acl-logging/0.log" Jun 11 18:28:26.885966 ip-10-0-130-170 kubenswrapper[2565]: I0611 18:28:26.885794 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-9xbcp" event={"ID":"5f6a1d9d-054f-4a94-99a3-21b77d4995dd","Type":"ContainerStarted","Data":"4c6804ecf9226df1f785ba799f92c3ae28af6610c353c35b3fdc45ce1d76b63a"} Jun 11 18:28:26.888547 ip-10-0-130-170 kubenswrapper[2565]: I0611 18:28:26.888019 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-fbfnw" event={"ID":"3335d6c8-7cdf-4a68-a152-49545421f36d","Type":"ContainerStarted","Data":"3386418c4a779a1a4d41a7e2d68484bab897469ee7e5591fa72ead0da0439ea2"} Jun 11 18:28:26.888547 ip-10-0-130-170 kubenswrapper[2565]: I0611 18:28:26.888057 2565 prober_manager.go:312] "Failed to trigger a manual run" probe="Readiness" Jun 11 18:28:26.905191 ip-10-0-130-170 kubenswrapper[2565]: I0611 18:28:26.905135 2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-fbfnw" podStartSLOduration=5.062128865 podStartE2EDuration="25.905123298s" totalImagesPullingTime="20.842994433s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-11 18:28:01 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-11 18:28:26.904629774 +0000 UTC m=+25.653315796" watchObservedRunningTime="2026-06-11 18:28:26.905123298 +0000 UTC m=+25.653809320" Jun 11 18:28:27.743331 ip-10-0-130-170 kubenswrapper[2565]: I0611 18:28:27.743303 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-wqbfv" Jun 11 18:28:27.743331 ip-10-0-130-170 kubenswrapper[2565]: I0611 18:28:27.743338 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-nh426" Jun 11 18:28:27.743552 ip-10-0-130-170 kubenswrapper[2565]: I0611 18:28:27.743308 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-bvwxp" Jun 11 18:28:27.743552 ip-10-0-130-170 kubenswrapper[2565]: E0611 18:28:27.743407 2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-wqbfv" podUID="1f1530cc-c788-4dc5-9e3d-7209386e9b94" Jun 11 18:28:27.743552 ip-10-0-130-170 kubenswrapper[2565]: E0611 18:28:27.743484 2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-bvwxp" podUID="2f4a1ff8-558e-4d9b-9208-ca0211b2b4e1" Jun 11 18:28:27.743678 ip-10-0-130-170 kubenswrapper[2565]: E0611 18:28:27.743584 2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-nh426" podUID="48f7111f-5fb9-477e-8a9e-3e9b22030f6a" Jun 11 18:28:29.742953 ip-10-0-130-170 kubenswrapper[2565]: I0611 18:28:29.742917 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-nh426" Jun 11 18:28:29.743547 ip-10-0-130-170 kubenswrapper[2565]: I0611 18:28:29.742963 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-bvwxp" Jun 11 18:28:29.743547 ip-10-0-130-170 kubenswrapper[2565]: I0611 18:28:29.742918 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-wqbfv" Jun 11 18:28:29.743547 ip-10-0-130-170 kubenswrapper[2565]: E0611 18:28:29.743061 2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-nh426" podUID="48f7111f-5fb9-477e-8a9e-3e9b22030f6a" Jun 11 18:28:29.743547 ip-10-0-130-170 kubenswrapper[2565]: E0611 18:28:29.743118 2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-bvwxp" podUID="2f4a1ff8-558e-4d9b-9208-ca0211b2b4e1" Jun 11 18:28:29.743547 ip-10-0-130-170 kubenswrapper[2565]: E0611 18:28:29.743196 2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-wqbfv" podUID="1f1530cc-c788-4dc5-9e3d-7209386e9b94" Jun 11 18:28:29.868678 ip-10-0-130-170 kubenswrapper[2565]: I0611 18:28:29.868645 2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kube-system/konnectivity-agent-rv8x7" Jun 11 18:28:29.868868 ip-10-0-130-170 kubenswrapper[2565]: I0611 18:28:29.868768 2565 prober_manager.go:312] "Failed to trigger a manual run" probe="Readiness" Jun 11 18:28:29.869499 ip-10-0-130-170 kubenswrapper[2565]: I0611 18:28:29.869452 2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kube-system/konnectivity-agent-rv8x7" Jun 11 18:28:30.900533 ip-10-0-130-170 kubenswrapper[2565]: I0611 18:28:30.900366 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-9xbcp_5f6a1d9d-054f-4a94-99a3-21b77d4995dd/ovn-acl-logging/0.log" Jun 11 18:28:30.900938 ip-10-0-130-170 kubenswrapper[2565]: I0611 18:28:30.900881 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-9xbcp" event={"ID":"5f6a1d9d-054f-4a94-99a3-21b77d4995dd","Type":"ContainerStarted","Data":"afa507649ff9064c1e4bc6e3db76363f4695d33108039f46d9acbe5c1e984076"} Jun 11 18:28:30.901162 ip-10-0-130-170 kubenswrapper[2565]: I0611 18:28:30.901141 2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-9xbcp" Jun 11 18:28:30.901284 ip-10-0-130-170 kubenswrapper[2565]: I0611 18:28:30.901214 2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-9xbcp" Jun 11 18:28:30.901284 ip-10-0-130-170 kubenswrapper[2565]: I0611 18:28:30.901281 2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-9xbcp" Jun 11 18:28:30.901392 ip-10-0-130-170 kubenswrapper[2565]: I0611 18:28:30.901369 2565 scope.go:117] "RemoveContainer" containerID="ae27fe337bbdf1bad9303adf2a4a9f1fbdc26a9c97b0e4431b5a4af40b290f40" Jun 11 18:28:30.902975 ip-10-0-130-170 kubenswrapper[2565]: I0611 18:28:30.902954 2565 generic.go:356] "Generic (PLEG): container finished" podID="0a391608-1cd7-4bb8-8907-2f8e7078bf68" containerID="7eef8c8258934748c81c090a9f425f59c26b2630a1efd5252ee838879505de9d" exitCode=0 Jun 11 18:28:30.903060 ip-10-0-130-170 kubenswrapper[2565]: I0611 18:28:30.902999 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-7qn5t" event={"ID":"0a391608-1cd7-4bb8-8907-2f8e7078bf68","Type":"ContainerDied","Data":"7eef8c8258934748c81c090a9f425f59c26b2630a1efd5252ee838879505de9d"} Jun 11 18:28:30.920026 ip-10-0-130-170 kubenswrapper[2565]: I0611 18:28:30.919998 2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-9xbcp" Jun 11 18:28:30.920412 ip-10-0-130-170 kubenswrapper[2565]: I0611 18:28:30.920396 2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-9xbcp" Jun 11 18:28:31.744374 ip-10-0-130-170 kubenswrapper[2565]: I0611 18:28:31.744278 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-wqbfv" Jun 11 18:28:31.744537 ip-10-0-130-170 kubenswrapper[2565]: E0611 18:28:31.744393 2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-wqbfv" podUID="1f1530cc-c788-4dc5-9e3d-7209386e9b94" Jun 11 18:28:31.744537 ip-10-0-130-170 kubenswrapper[2565]: I0611 18:28:31.744454 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-nh426" Jun 11 18:28:31.744537 ip-10-0-130-170 kubenswrapper[2565]: E0611 18:28:31.744515 2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-nh426" podUID="48f7111f-5fb9-477e-8a9e-3e9b22030f6a" Jun 11 18:28:31.744673 ip-10-0-130-170 kubenswrapper[2565]: I0611 18:28:31.744565 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-bvwxp" Jun 11 18:28:31.744673 ip-10-0-130-170 kubenswrapper[2565]: E0611 18:28:31.744640 2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-bvwxp" podUID="2f4a1ff8-558e-4d9b-9208-ca0211b2b4e1" Jun 11 18:28:31.909269 ip-10-0-130-170 kubenswrapper[2565]: I0611 18:28:31.909226 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-9xbcp_5f6a1d9d-054f-4a94-99a3-21b77d4995dd/ovn-acl-logging/0.log" Jun 11 18:28:31.909729 ip-10-0-130-170 kubenswrapper[2565]: I0611 18:28:31.909655 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-9xbcp" event={"ID":"5f6a1d9d-054f-4a94-99a3-21b77d4995dd","Type":"ContainerStarted","Data":"e0e193ce7d36f5b9f46c25345a3b20815266cdbacf587df43d8a54a8487ee447"} Jun 11 18:28:31.946235 ip-10-0-130-170 kubenswrapper[2565]: I0611 18:28:31.946176 2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ovn-kubernetes/ovnkube-node-9xbcp" podStartSLOduration=11.780664898 podStartE2EDuration="30.946153991s" totalImagesPullingTime="19.165489093s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-11 18:28:01 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-11 18:28:31.945191328 +0000 UTC m=+30.693877350" watchObservedRunningTime="2026-06-11 18:28:31.946153991 +0000 UTC m=+30.694840014" Jun 11 18:28:32.349112 ip-10-0-130-170 kubenswrapper[2565]: I0611 18:28:32.348897 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-wqbfv"] Jun 11 18:28:32.349250 ip-10-0-130-170 kubenswrapper[2565]: I0611 18:28:32.349164 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-wqbfv" Jun 11 18:28:32.349307 ip-10-0-130-170 kubenswrapper[2565]: E0611 18:28:32.349273 2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-wqbfv" podUID="1f1530cc-c788-4dc5-9e3d-7209386e9b94" Jun 11 18:28:32.354276 ip-10-0-130-170 kubenswrapper[2565]: I0611 18:28:32.354202 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-nh426"] Jun 11 18:28:32.354422 ip-10-0-130-170 kubenswrapper[2565]: I0611 18:28:32.354327 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-nh426" Jun 11 18:28:32.354480 ip-10-0-130-170 kubenswrapper[2565]: E0611 18:28:32.354427 2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-nh426" podUID="48f7111f-5fb9-477e-8a9e-3e9b22030f6a" Jun 11 18:28:32.354922 ip-10-0-130-170 kubenswrapper[2565]: I0611 18:28:32.354901 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-bvwxp"] Jun 11 18:28:32.355006 ip-10-0-130-170 kubenswrapper[2565]: I0611 18:28:32.354995 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-bvwxp" Jun 11 18:28:32.355096 ip-10-0-130-170 kubenswrapper[2565]: E0611 18:28:32.355080 2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-bvwxp" podUID="2f4a1ff8-558e-4d9b-9208-ca0211b2b4e1" Jun 11 18:28:32.914955 ip-10-0-130-170 kubenswrapper[2565]: I0611 18:28:32.914922 2565 generic.go:356] "Generic (PLEG): container finished" podID="0a391608-1cd7-4bb8-8907-2f8e7078bf68" containerID="234afa7223b568d704790bee76eb9606f11c5a61c4828b4a4149c9b73f851948" exitCode=0 Jun 11 18:28:32.915442 ip-10-0-130-170 kubenswrapper[2565]: I0611 18:28:32.915023 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-7qn5t" event={"ID":"0a391608-1cd7-4bb8-8907-2f8e7078bf68","Type":"ContainerDied","Data":"234afa7223b568d704790bee76eb9606f11c5a61c4828b4a4149c9b73f851948"} Jun 11 18:28:33.742823 ip-10-0-130-170 kubenswrapper[2565]: I0611 18:28:33.742726 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-wqbfv" Jun 11 18:28:33.742970 ip-10-0-130-170 kubenswrapper[2565]: I0611 18:28:33.742725 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-nh426" Jun 11 18:28:33.742970 ip-10-0-130-170 kubenswrapper[2565]: E0611 18:28:33.742871 2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-wqbfv" podUID="1f1530cc-c788-4dc5-9e3d-7209386e9b94" Jun 11 18:28:33.742970 ip-10-0-130-170 kubenswrapper[2565]: E0611 18:28:33.742927 2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-nh426" podUID="48f7111f-5fb9-477e-8a9e-3e9b22030f6a" Jun 11 18:28:33.919809 ip-10-0-130-170 kubenswrapper[2565]: I0611 18:28:33.919778 2565 generic.go:356] "Generic (PLEG): container finished" podID="0a391608-1cd7-4bb8-8907-2f8e7078bf68" containerID="8f15f9794b83ea19c280d121b8740cb5660d216c97e870cb388a7333cd655e6b" exitCode=0 Jun 11 18:28:33.920190 ip-10-0-130-170 kubenswrapper[2565]: I0611 18:28:33.919830 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-7qn5t" event={"ID":"0a391608-1cd7-4bb8-8907-2f8e7078bf68","Type":"ContainerDied","Data":"8f15f9794b83ea19c280d121b8740cb5660d216c97e870cb388a7333cd655e6b"} Jun 11 18:28:34.743103 ip-10-0-130-170 kubenswrapper[2565]: I0611 18:28:34.743071 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-bvwxp" Jun 11 18:28:34.743377 ip-10-0-130-170 kubenswrapper[2565]: E0611 18:28:34.743186 2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-bvwxp" podUID="2f4a1ff8-558e-4d9b-9208-ca0211b2b4e1" Jun 11 18:28:35.429038 ip-10-0-130-170 kubenswrapper[2565]: I0611 18:28:35.429007 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/2f4a1ff8-558e-4d9b-9208-ca0211b2b4e1-metrics-certs\") pod \"network-metrics-daemon-bvwxp\" (UID: \"2f4a1ff8-558e-4d9b-9208-ca0211b2b4e1\") " pod="openshift-multus/network-metrics-daemon-bvwxp" Jun 11 18:28:35.429510 ip-10-0-130-170 kubenswrapper[2565]: I0611 18:28:35.429054 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/1f1530cc-c788-4dc5-9e3d-7209386e9b94-original-pull-secret\") pod \"global-pull-secret-syncer-wqbfv\" (UID: \"1f1530cc-c788-4dc5-9e3d-7209386e9b94\") " pod="kube-system/global-pull-secret-syncer-wqbfv" Jun 11 18:28:35.429510 ip-10-0-130-170 kubenswrapper[2565]: E0611 18:28:35.429178 2565 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jun 11 18:28:35.429510 ip-10-0-130-170 kubenswrapper[2565]: E0611 18:28:35.429178 2565 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jun 11 18:28:35.429510 ip-10-0-130-170 kubenswrapper[2565]: E0611 18:28:35.429244 2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/1f1530cc-c788-4dc5-9e3d-7209386e9b94-original-pull-secret podName:1f1530cc-c788-4dc5-9e3d-7209386e9b94 nodeName:}" failed. No retries permitted until 2026-06-11 18:29:07.429225299 +0000 UTC m=+66.177911302 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/1f1530cc-c788-4dc5-9e3d-7209386e9b94-original-pull-secret") pod "global-pull-secret-syncer-wqbfv" (UID: "1f1530cc-c788-4dc5-9e3d-7209386e9b94") : object "kube-system"/"original-pull-secret" not registered Jun 11 18:28:35.429510 ip-10-0-130-170 kubenswrapper[2565]: E0611 18:28:35.429284 2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/2f4a1ff8-558e-4d9b-9208-ca0211b2b4e1-metrics-certs podName:2f4a1ff8-558e-4d9b-9208-ca0211b2b4e1 nodeName:}" failed. No retries permitted until 2026-06-11 18:29:07.429273496 +0000 UTC m=+66.177959498 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/2f4a1ff8-558e-4d9b-9208-ca0211b2b4e1-metrics-certs") pod "network-metrics-daemon-bvwxp" (UID: "2f4a1ff8-558e-4d9b-9208-ca0211b2b4e1") : object "openshift-multus"/"metrics-daemon-secret" not registered Jun 11 18:28:35.529711 ip-10-0-130-170 kubenswrapper[2565]: I0611 18:28:35.529675 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-78kwd\" (UniqueName: \"kubernetes.io/projected/48f7111f-5fb9-477e-8a9e-3e9b22030f6a-kube-api-access-78kwd\") pod \"network-check-target-nh426\" (UID: \"48f7111f-5fb9-477e-8a9e-3e9b22030f6a\") " pod="openshift-network-diagnostics/network-check-target-nh426" Jun 11 18:28:35.529911 ip-10-0-130-170 kubenswrapper[2565]: E0611 18:28:35.529869 2565 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jun 11 18:28:35.529911 ip-10-0-130-170 kubenswrapper[2565]: E0611 18:28:35.529903 2565 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jun 11 18:28:35.530002 ip-10-0-130-170 kubenswrapper[2565]: E0611 18:28:35.529917 2565 projected.go:196] Error preparing data for projected volume kube-api-access-78kwd for pod openshift-network-diagnostics/network-check-target-nh426: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 11 18:28:35.530002 ip-10-0-130-170 kubenswrapper[2565]: E0611 18:28:35.529986 2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/48f7111f-5fb9-477e-8a9e-3e9b22030f6a-kube-api-access-78kwd podName:48f7111f-5fb9-477e-8a9e-3e9b22030f6a nodeName:}" failed. No retries permitted until 2026-06-11 18:29:07.529966445 +0000 UTC m=+66.278652447 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "kube-api-access-78kwd" (UniqueName: "kubernetes.io/projected/48f7111f-5fb9-477e-8a9e-3e9b22030f6a-kube-api-access-78kwd") pod "network-check-target-nh426" (UID: "48f7111f-5fb9-477e-8a9e-3e9b22030f6a") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 11 18:28:35.743333 ip-10-0-130-170 kubenswrapper[2565]: I0611 18:28:35.743239 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-nh426" Jun 11 18:28:35.743333 ip-10-0-130-170 kubenswrapper[2565]: I0611 18:28:35.743275 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-wqbfv" Jun 11 18:28:35.743544 ip-10-0-130-170 kubenswrapper[2565]: E0611 18:28:35.743370 2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-nh426" podUID="48f7111f-5fb9-477e-8a9e-3e9b22030f6a" Jun 11 18:28:35.743544 ip-10-0-130-170 kubenswrapper[2565]: E0611 18:28:35.743509 2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-wqbfv" podUID="1f1530cc-c788-4dc5-9e3d-7209386e9b94" Jun 11 18:28:36.551622 ip-10-0-130-170 kubenswrapper[2565]: I0611 18:28:36.551546 2565 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-130-170.ec2.internal" event="NodeReady" Jun 11 18:28:36.552063 ip-10-0-130-170 kubenswrapper[2565]: I0611 18:28:36.551683 2565 kubelet_node_status.go:489] "Fast updating node status as it just became ready" Jun 11 18:28:36.594246 ip-10-0-130-170 kubenswrapper[2565]: I0611 18:28:36.594209 2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-image-registry/image-registry-666fb979b7-zhmbp"] Jun 11 18:28:36.612792 ip-10-0-130-170 kubenswrapper[2565]: I0611 18:28:36.612760 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-666fb979b7-zhmbp" Jun 11 18:28:36.616029 ip-10-0-130-170 kubenswrapper[2565]: I0611 18:28:36.615727 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"registry-dockercfg-9h7xm\"" Jun 11 18:28:36.616029 ip-10-0-130-170 kubenswrapper[2565]: I0611 18:28:36.615825 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-private-configuration\"" Jun 11 18:28:36.620907 ip-10-0-130-170 kubenswrapper[2565]: I0611 18:28:36.615831 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"installation-pull-secrets\"" Jun 11 18:28:36.621668 ip-10-0-130-170 kubenswrapper[2565]: I0611 18:28:36.621645 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-tls\"" Jun 11 18:28:36.624718 ip-10-0-130-170 kubenswrapper[2565]: I0611 18:28:36.624404 2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-dns/dns-default-4z9qr"] Jun 11 18:28:36.629502 ip-10-0-130-170 kubenswrapper[2565]: I0611 18:28:36.629477 2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"trusted-ca\"" Jun 11 18:28:36.638059 ip-10-0-130-170 kubenswrapper[2565]: I0611 18:28:36.638034 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-666fb979b7-zhmbp"] Jun 11 18:28:36.638173 ip-10-0-130-170 kubenswrapper[2565]: I0611 18:28:36.638082 2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress-canary/ingress-canary-czdq5"] Jun 11 18:28:36.638173 ip-10-0-130-170 kubenswrapper[2565]: I0611 18:28:36.638167 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-4z9qr" Jun 11 18:28:36.640787 ip-10-0-130-170 kubenswrapper[2565]: I0611 18:28:36.640770 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-cszq9\"" Jun 11 18:28:36.640787 ip-10-0-130-170 kubenswrapper[2565]: I0611 18:28:36.640782 2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"dns-default\"" Jun 11 18:28:36.640942 ip-10-0-130-170 kubenswrapper[2565]: I0611 18:28:36.640769 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-default-metrics-tls\"" Jun 11 18:28:36.651080 ip-10-0-130-170 kubenswrapper[2565]: I0611 18:28:36.651059 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-czdq5"] Jun 11 18:28:36.651193 ip-10-0-130-170 kubenswrapper[2565]: I0611 18:28:36.651090 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-4z9qr"] Jun 11 18:28:36.651193 ip-10-0-130-170 kubenswrapper[2565]: I0611 18:28:36.651175 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-czdq5" Jun 11 18:28:36.653499 ip-10-0-130-170 kubenswrapper[2565]: I0611 18:28:36.653476 2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"kube-root-ca.crt\"" Jun 11 18:28:36.653612 ip-10-0-130-170 kubenswrapper[2565]: I0611 18:28:36.653504 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"default-dockercfg-rkrwn\"" Jun 11 18:28:36.653612 ip-10-0-130-170 kubenswrapper[2565]: I0611 18:28:36.653594 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"canary-serving-cert\"" Jun 11 18:28:36.653770 ip-10-0-130-170 kubenswrapper[2565]: I0611 18:28:36.653740 2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"openshift-service-ca.crt\"" Jun 11 18:28:36.739510 ip-10-0-130-170 kubenswrapper[2565]: I0611 18:28:36.739473 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/0a494089-a655-4522-b2a2-955594964ac7-installation-pull-secrets\") pod \"image-registry-666fb979b7-zhmbp\" (UID: \"0a494089-a655-4522-b2a2-955594964ac7\") " pod="openshift-image-registry/image-registry-666fb979b7-zhmbp" Jun 11 18:28:36.739684 ip-10-0-130-170 kubenswrapper[2565]: I0611 18:28:36.739519 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/0a494089-a655-4522-b2a2-955594964ac7-ca-trust-extracted\") pod \"image-registry-666fb979b7-zhmbp\" (UID: \"0a494089-a655-4522-b2a2-955594964ac7\") " pod="openshift-image-registry/image-registry-666fb979b7-zhmbp" Jun 11 18:28:36.739684 ip-10-0-130-170 kubenswrapper[2565]: I0611 18:28:36.739548 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/0a494089-a655-4522-b2a2-955594964ac7-registry-certificates\") pod \"image-registry-666fb979b7-zhmbp\" (UID: \"0a494089-a655-4522-b2a2-955594964ac7\") " pod="openshift-image-registry/image-registry-666fb979b7-zhmbp" Jun 11 18:28:36.739684 ip-10-0-130-170 kubenswrapper[2565]: I0611 18:28:36.739583 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ttlhp\" (UniqueName: \"kubernetes.io/projected/35a5e103-2756-40a3-ad29-bae095288d5b-kube-api-access-ttlhp\") pod \"ingress-canary-czdq5\" (UID: \"35a5e103-2756-40a3-ad29-bae095288d5b\") " pod="openshift-ingress-canary/ingress-canary-czdq5" Jun 11 18:28:36.739684 ip-10-0-130-170 kubenswrapper[2565]: I0611 18:28:36.739613 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/41d85d95-09c6-46e3-990f-59c9ab3ad81f-metrics-tls\") pod \"dns-default-4z9qr\" (UID: \"41d85d95-09c6-46e3-990f-59c9ab3ad81f\") " pod="openshift-dns/dns-default-4z9qr" Jun 11 18:28:36.739684 ip-10-0-130-170 kubenswrapper[2565]: I0611 18:28:36.739633 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-f2vfj\" (UniqueName: \"kubernetes.io/projected/41d85d95-09c6-46e3-990f-59c9ab3ad81f-kube-api-access-f2vfj\") pod \"dns-default-4z9qr\" (UID: \"41d85d95-09c6-46e3-990f-59c9ab3ad81f\") " pod="openshift-dns/dns-default-4z9qr" Jun 11 18:28:36.739684 ip-10-0-130-170 kubenswrapper[2565]: I0611 18:28:36.739673 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/41d85d95-09c6-46e3-990f-59c9ab3ad81f-tmp-dir\") pod \"dns-default-4z9qr\" (UID: \"41d85d95-09c6-46e3-990f-59c9ab3ad81f\") " pod="openshift-dns/dns-default-4z9qr" Jun 11 18:28:36.740005 ip-10-0-130-170 kubenswrapper[2565]: I0611 18:28:36.739702 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/35a5e103-2756-40a3-ad29-bae095288d5b-cert\") pod \"ingress-canary-czdq5\" (UID: \"35a5e103-2756-40a3-ad29-bae095288d5b\") " pod="openshift-ingress-canary/ingress-canary-czdq5" Jun 11 18:28:36.740005 ip-10-0-130-170 kubenswrapper[2565]: I0611 18:28:36.739733 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/41d85d95-09c6-46e3-990f-59c9ab3ad81f-config-volume\") pod \"dns-default-4z9qr\" (UID: \"41d85d95-09c6-46e3-990f-59c9ab3ad81f\") " pod="openshift-dns/dns-default-4z9qr" Jun 11 18:28:36.740005 ip-10-0-130-170 kubenswrapper[2565]: I0611 18:28:36.739765 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/0a494089-a655-4522-b2a2-955594964ac7-trusted-ca\") pod \"image-registry-666fb979b7-zhmbp\" (UID: \"0a494089-a655-4522-b2a2-955594964ac7\") " pod="openshift-image-registry/image-registry-666fb979b7-zhmbp" Jun 11 18:28:36.740005 ip-10-0-130-170 kubenswrapper[2565]: I0611 18:28:36.739839 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/0a494089-a655-4522-b2a2-955594964ac7-registry-tls\") pod \"image-registry-666fb979b7-zhmbp\" (UID: \"0a494089-a655-4522-b2a2-955594964ac7\") " pod="openshift-image-registry/image-registry-666fb979b7-zhmbp" Jun 11 18:28:36.740005 ip-10-0-130-170 kubenswrapper[2565]: I0611 18:28:36.739876 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/0a494089-a655-4522-b2a2-955594964ac7-bound-sa-token\") pod \"image-registry-666fb979b7-zhmbp\" (UID: \"0a494089-a655-4522-b2a2-955594964ac7\") " pod="openshift-image-registry/image-registry-666fb979b7-zhmbp" Jun 11 18:28:36.740005 ip-10-0-130-170 kubenswrapper[2565]: I0611 18:28:36.739906 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-s7hwm\" (UniqueName: \"kubernetes.io/projected/0a494089-a655-4522-b2a2-955594964ac7-kube-api-access-s7hwm\") pod \"image-registry-666fb979b7-zhmbp\" (UID: \"0a494089-a655-4522-b2a2-955594964ac7\") " pod="openshift-image-registry/image-registry-666fb979b7-zhmbp" Jun 11 18:28:36.740005 ip-10-0-130-170 kubenswrapper[2565]: I0611 18:28:36.739973 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/0a494089-a655-4522-b2a2-955594964ac7-image-registry-private-configuration\") pod \"image-registry-666fb979b7-zhmbp\" (UID: \"0a494089-a655-4522-b2a2-955594964ac7\") " pod="openshift-image-registry/image-registry-666fb979b7-zhmbp" Jun 11 18:28:36.742571 ip-10-0-130-170 kubenswrapper[2565]: I0611 18:28:36.742544 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-bvwxp" Jun 11 18:28:36.745301 ip-10-0-130-170 kubenswrapper[2565]: I0611 18:28:36.745278 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-j7h7l\"" Jun 11 18:28:36.745395 ip-10-0-130-170 kubenswrapper[2565]: I0611 18:28:36.745380 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\"" Jun 11 18:28:36.840482 ip-10-0-130-170 kubenswrapper[2565]: I0611 18:28:36.840404 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/41d85d95-09c6-46e3-990f-59c9ab3ad81f-tmp-dir\") pod \"dns-default-4z9qr\" (UID: \"41d85d95-09c6-46e3-990f-59c9ab3ad81f\") " pod="openshift-dns/dns-default-4z9qr" Jun 11 18:28:36.840482 ip-10-0-130-170 kubenswrapper[2565]: I0611 18:28:36.840442 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/35a5e103-2756-40a3-ad29-bae095288d5b-cert\") pod \"ingress-canary-czdq5\" (UID: \"35a5e103-2756-40a3-ad29-bae095288d5b\") " pod="openshift-ingress-canary/ingress-canary-czdq5" Jun 11 18:28:36.840482 ip-10-0-130-170 kubenswrapper[2565]: I0611 18:28:36.840475 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/41d85d95-09c6-46e3-990f-59c9ab3ad81f-config-volume\") pod \"dns-default-4z9qr\" (UID: \"41d85d95-09c6-46e3-990f-59c9ab3ad81f\") " pod="openshift-dns/dns-default-4z9qr" Jun 11 18:28:36.840757 ip-10-0-130-170 kubenswrapper[2565]: I0611 18:28:36.840526 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/0a494089-a655-4522-b2a2-955594964ac7-trusted-ca\") pod \"image-registry-666fb979b7-zhmbp\" (UID: \"0a494089-a655-4522-b2a2-955594964ac7\") " pod="openshift-image-registry/image-registry-666fb979b7-zhmbp" Jun 11 18:28:36.840757 ip-10-0-130-170 kubenswrapper[2565]: I0611 18:28:36.840558 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/0a494089-a655-4522-b2a2-955594964ac7-registry-tls\") pod \"image-registry-666fb979b7-zhmbp\" (UID: \"0a494089-a655-4522-b2a2-955594964ac7\") " pod="openshift-image-registry/image-registry-666fb979b7-zhmbp" Jun 11 18:28:36.840757 ip-10-0-130-170 kubenswrapper[2565]: I0611 18:28:36.840583 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/0a494089-a655-4522-b2a2-955594964ac7-bound-sa-token\") pod \"image-registry-666fb979b7-zhmbp\" (UID: \"0a494089-a655-4522-b2a2-955594964ac7\") " pod="openshift-image-registry/image-registry-666fb979b7-zhmbp" Jun 11 18:28:36.840757 ip-10-0-130-170 kubenswrapper[2565]: I0611 18:28:36.840607 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-s7hwm\" (UniqueName: \"kubernetes.io/projected/0a494089-a655-4522-b2a2-955594964ac7-kube-api-access-s7hwm\") pod \"image-registry-666fb979b7-zhmbp\" (UID: \"0a494089-a655-4522-b2a2-955594964ac7\") " pod="openshift-image-registry/image-registry-666fb979b7-zhmbp" Jun 11 18:28:36.840757 ip-10-0-130-170 kubenswrapper[2565]: I0611 18:28:36.840658 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/0a494089-a655-4522-b2a2-955594964ac7-image-registry-private-configuration\") pod \"image-registry-666fb979b7-zhmbp\" (UID: \"0a494089-a655-4522-b2a2-955594964ac7\") " pod="openshift-image-registry/image-registry-666fb979b7-zhmbp" Jun 11 18:28:36.840757 ip-10-0-130-170 kubenswrapper[2565]: I0611 18:28:36.840678 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/0a494089-a655-4522-b2a2-955594964ac7-installation-pull-secrets\") pod \"image-registry-666fb979b7-zhmbp\" (UID: \"0a494089-a655-4522-b2a2-955594964ac7\") " pod="openshift-image-registry/image-registry-666fb979b7-zhmbp" Jun 11 18:28:36.840757 ip-10-0-130-170 kubenswrapper[2565]: I0611 18:28:36.840695 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/0a494089-a655-4522-b2a2-955594964ac7-ca-trust-extracted\") pod \"image-registry-666fb979b7-zhmbp\" (UID: \"0a494089-a655-4522-b2a2-955594964ac7\") " pod="openshift-image-registry/image-registry-666fb979b7-zhmbp" Jun 11 18:28:36.840757 ip-10-0-130-170 kubenswrapper[2565]: I0611 18:28:36.840721 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/0a494089-a655-4522-b2a2-955594964ac7-registry-certificates\") pod \"image-registry-666fb979b7-zhmbp\" (UID: \"0a494089-a655-4522-b2a2-955594964ac7\") " pod="openshift-image-registry/image-registry-666fb979b7-zhmbp" Jun 11 18:28:36.840757 ip-10-0-130-170 kubenswrapper[2565]: I0611 18:28:36.840755 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ttlhp\" (UniqueName: \"kubernetes.io/projected/35a5e103-2756-40a3-ad29-bae095288d5b-kube-api-access-ttlhp\") pod \"ingress-canary-czdq5\" (UID: \"35a5e103-2756-40a3-ad29-bae095288d5b\") " pod="openshift-ingress-canary/ingress-canary-czdq5" Jun 11 18:28:36.841198 ip-10-0-130-170 kubenswrapper[2565]: I0611 18:28:36.840789 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/41d85d95-09c6-46e3-990f-59c9ab3ad81f-metrics-tls\") pod \"dns-default-4z9qr\" (UID: \"41d85d95-09c6-46e3-990f-59c9ab3ad81f\") " pod="openshift-dns/dns-default-4z9qr" Jun 11 18:28:36.841198 ip-10-0-130-170 kubenswrapper[2565]: I0611 18:28:36.840815 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-f2vfj\" (UniqueName: \"kubernetes.io/projected/41d85d95-09c6-46e3-990f-59c9ab3ad81f-kube-api-access-f2vfj\") pod \"dns-default-4z9qr\" (UID: \"41d85d95-09c6-46e3-990f-59c9ab3ad81f\") " pod="openshift-dns/dns-default-4z9qr" Jun 11 18:28:36.841198 ip-10-0-130-170 kubenswrapper[2565]: I0611 18:28:36.840860 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/41d85d95-09c6-46e3-990f-59c9ab3ad81f-tmp-dir\") pod \"dns-default-4z9qr\" (UID: \"41d85d95-09c6-46e3-990f-59c9ab3ad81f\") " pod="openshift-dns/dns-default-4z9qr" Jun 11 18:28:36.841198 ip-10-0-130-170 kubenswrapper[2565]: E0611 18:28:36.841056 2565 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jun 11 18:28:36.841198 ip-10-0-130-170 kubenswrapper[2565]: E0611 18:28:36.841069 2565 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-666fb979b7-zhmbp: secret "image-registry-tls" not found Jun 11 18:28:36.841198 ip-10-0-130-170 kubenswrapper[2565]: I0611 18:28:36.841123 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/0a494089-a655-4522-b2a2-955594964ac7-ca-trust-extracted\") pod \"image-registry-666fb979b7-zhmbp\" (UID: \"0a494089-a655-4522-b2a2-955594964ac7\") " pod="openshift-image-registry/image-registry-666fb979b7-zhmbp" Jun 11 18:28:36.841198 ip-10-0-130-170 kubenswrapper[2565]: E0611 18:28:36.841130 2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/0a494089-a655-4522-b2a2-955594964ac7-registry-tls podName:0a494089-a655-4522-b2a2-955594964ac7 nodeName:}" failed. No retries permitted until 2026-06-11 18:28:37.341109653 +0000 UTC m=+36.089795655 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/0a494089-a655-4522-b2a2-955594964ac7-registry-tls") pod "image-registry-666fb979b7-zhmbp" (UID: "0a494089-a655-4522-b2a2-955594964ac7") : secret "image-registry-tls" not found Jun 11 18:28:36.841531 ip-10-0-130-170 kubenswrapper[2565]: E0611 18:28:36.841346 2565 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jun 11 18:28:36.841531 ip-10-0-130-170 kubenswrapper[2565]: E0611 18:28:36.841399 2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/41d85d95-09c6-46e3-990f-59c9ab3ad81f-metrics-tls podName:41d85d95-09c6-46e3-990f-59c9ab3ad81f nodeName:}" failed. No retries permitted until 2026-06-11 18:28:37.341382706 +0000 UTC m=+36.090068713 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/41d85d95-09c6-46e3-990f-59c9ab3ad81f-metrics-tls") pod "dns-default-4z9qr" (UID: "41d85d95-09c6-46e3-990f-59c9ab3ad81f") : secret "dns-default-metrics-tls" not found Jun 11 18:28:36.841591 ip-10-0-130-170 kubenswrapper[2565]: I0611 18:28:36.841562 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/0a494089-a655-4522-b2a2-955594964ac7-registry-certificates\") pod \"image-registry-666fb979b7-zhmbp\" (UID: \"0a494089-a655-4522-b2a2-955594964ac7\") " pod="openshift-image-registry/image-registry-666fb979b7-zhmbp" Jun 11 18:28:36.841918 ip-10-0-130-170 kubenswrapper[2565]: I0611 18:28:36.841899 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/41d85d95-09c6-46e3-990f-59c9ab3ad81f-config-volume\") pod \"dns-default-4z9qr\" (UID: \"41d85d95-09c6-46e3-990f-59c9ab3ad81f\") " pod="openshift-dns/dns-default-4z9qr" Jun 11 18:28:36.842742 ip-10-0-130-170 kubenswrapper[2565]: I0611 18:28:36.842715 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/0a494089-a655-4522-b2a2-955594964ac7-trusted-ca\") pod \"image-registry-666fb979b7-zhmbp\" (UID: \"0a494089-a655-4522-b2a2-955594964ac7\") " pod="openshift-image-registry/image-registry-666fb979b7-zhmbp" Jun 11 18:28:36.846030 ip-10-0-130-170 kubenswrapper[2565]: I0611 18:28:36.846004 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/0a494089-a655-4522-b2a2-955594964ac7-installation-pull-secrets\") pod \"image-registry-666fb979b7-zhmbp\" (UID: \"0a494089-a655-4522-b2a2-955594964ac7\") " pod="openshift-image-registry/image-registry-666fb979b7-zhmbp" Jun 11 18:28:36.846173 ip-10-0-130-170 kubenswrapper[2565]: I0611 18:28:36.846157 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/35a5e103-2756-40a3-ad29-bae095288d5b-cert\") pod \"ingress-canary-czdq5\" (UID: \"35a5e103-2756-40a3-ad29-bae095288d5b\") " pod="openshift-ingress-canary/ingress-canary-czdq5" Jun 11 18:28:36.846775 ip-10-0-130-170 kubenswrapper[2565]: I0611 18:28:36.846755 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/0a494089-a655-4522-b2a2-955594964ac7-image-registry-private-configuration\") pod \"image-registry-666fb979b7-zhmbp\" (UID: \"0a494089-a655-4522-b2a2-955594964ac7\") " pod="openshift-image-registry/image-registry-666fb979b7-zhmbp" Jun 11 18:28:36.850296 ip-10-0-130-170 kubenswrapper[2565]: I0611 18:28:36.850270 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-ttlhp\" (UniqueName: \"kubernetes.io/projected/35a5e103-2756-40a3-ad29-bae095288d5b-kube-api-access-ttlhp\") pod \"ingress-canary-czdq5\" (UID: \"35a5e103-2756-40a3-ad29-bae095288d5b\") " pod="openshift-ingress-canary/ingress-canary-czdq5" Jun 11 18:28:36.850488 ip-10-0-130-170 kubenswrapper[2565]: I0611 18:28:36.850450 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-s7hwm\" (UniqueName: \"kubernetes.io/projected/0a494089-a655-4522-b2a2-955594964ac7-kube-api-access-s7hwm\") pod \"image-registry-666fb979b7-zhmbp\" (UID: \"0a494089-a655-4522-b2a2-955594964ac7\") " pod="openshift-image-registry/image-registry-666fb979b7-zhmbp" Jun 11 18:28:36.850824 ip-10-0-130-170 kubenswrapper[2565]: I0611 18:28:36.850789 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/0a494089-a655-4522-b2a2-955594964ac7-bound-sa-token\") pod \"image-registry-666fb979b7-zhmbp\" (UID: \"0a494089-a655-4522-b2a2-955594964ac7\") " pod="openshift-image-registry/image-registry-666fb979b7-zhmbp" Jun 11 18:28:36.851024 ip-10-0-130-170 kubenswrapper[2565]: I0611 18:28:36.851002 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-f2vfj\" (UniqueName: \"kubernetes.io/projected/41d85d95-09c6-46e3-990f-59c9ab3ad81f-kube-api-access-f2vfj\") pod \"dns-default-4z9qr\" (UID: \"41d85d95-09c6-46e3-990f-59c9ab3ad81f\") " pod="openshift-dns/dns-default-4z9qr" Jun 11 18:28:36.961455 ip-10-0-130-170 kubenswrapper[2565]: I0611 18:28:36.961422 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-czdq5" Jun 11 18:28:37.344372 ip-10-0-130-170 kubenswrapper[2565]: I0611 18:28:37.344333 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/0a494089-a655-4522-b2a2-955594964ac7-registry-tls\") pod \"image-registry-666fb979b7-zhmbp\" (UID: \"0a494089-a655-4522-b2a2-955594964ac7\") " pod="openshift-image-registry/image-registry-666fb979b7-zhmbp" Jun 11 18:28:37.344554 ip-10-0-130-170 kubenswrapper[2565]: I0611 18:28:37.344444 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/41d85d95-09c6-46e3-990f-59c9ab3ad81f-metrics-tls\") pod \"dns-default-4z9qr\" (UID: \"41d85d95-09c6-46e3-990f-59c9ab3ad81f\") " pod="openshift-dns/dns-default-4z9qr" Jun 11 18:28:37.344554 ip-10-0-130-170 kubenswrapper[2565]: E0611 18:28:37.344509 2565 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jun 11 18:28:37.344554 ip-10-0-130-170 kubenswrapper[2565]: E0611 18:28:37.344533 2565 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-666fb979b7-zhmbp: secret "image-registry-tls" not found Jun 11 18:28:37.344674 ip-10-0-130-170 kubenswrapper[2565]: E0611 18:28:37.344572 2565 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jun 11 18:28:37.344674 ip-10-0-130-170 kubenswrapper[2565]: E0611 18:28:37.344594 2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/0a494089-a655-4522-b2a2-955594964ac7-registry-tls podName:0a494089-a655-4522-b2a2-955594964ac7 nodeName:}" failed. No retries permitted until 2026-06-11 18:28:38.344577312 +0000 UTC m=+37.093263317 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/0a494089-a655-4522-b2a2-955594964ac7-registry-tls") pod "image-registry-666fb979b7-zhmbp" (UID: "0a494089-a655-4522-b2a2-955594964ac7") : secret "image-registry-tls" not found Jun 11 18:28:37.344674 ip-10-0-130-170 kubenswrapper[2565]: E0611 18:28:37.344616 2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/41d85d95-09c6-46e3-990f-59c9ab3ad81f-metrics-tls podName:41d85d95-09c6-46e3-990f-59c9ab3ad81f nodeName:}" failed. No retries permitted until 2026-06-11 18:28:38.344603333 +0000 UTC m=+37.093289338 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/41d85d95-09c6-46e3-990f-59c9ab3ad81f-metrics-tls") pod "dns-default-4z9qr" (UID: "41d85d95-09c6-46e3-990f-59c9ab3ad81f") : secret "dns-default-metrics-tls" not found Jun 11 18:28:37.743180 ip-10-0-130-170 kubenswrapper[2565]: I0611 18:28:37.743138 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-wqbfv" Jun 11 18:28:37.743631 ip-10-0-130-170 kubenswrapper[2565]: I0611 18:28:37.743153 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-nh426" Jun 11 18:28:37.746516 ip-10-0-130-170 kubenswrapper[2565]: I0611 18:28:37.746317 2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\"" Jun 11 18:28:37.746516 ip-10-0-130-170 kubenswrapper[2565]: I0611 18:28:37.746421 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\"" Jun 11 18:28:37.747058 ip-10-0-130-170 kubenswrapper[2565]: I0611 18:28:37.747036 2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\"" Jun 11 18:28:37.747179 ip-10-0-130-170 kubenswrapper[2565]: I0611 18:28:37.747036 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-85nqp\"" Jun 11 18:28:38.221650 ip-10-0-130-170 kubenswrapper[2565]: I0611 18:28:38.221484 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-czdq5"] Jun 11 18:28:38.226552 ip-10-0-130-170 kubenswrapper[2565]: W0611 18:28:38.226518 2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod35a5e103_2756_40a3_ad29_bae095288d5b.slice/crio-bae4d513853ac282cf7c0f27b53911d362963411fabcae57897f56649e3ddc7b WatchSource:0}: Error finding container bae4d513853ac282cf7c0f27b53911d362963411fabcae57897f56649e3ddc7b: Status 404 returned error can't find the container with id bae4d513853ac282cf7c0f27b53911d362963411fabcae57897f56649e3ddc7b Jun 11 18:28:38.351668 ip-10-0-130-170 kubenswrapper[2565]: I0611 18:28:38.351631 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/41d85d95-09c6-46e3-990f-59c9ab3ad81f-metrics-tls\") pod \"dns-default-4z9qr\" (UID: \"41d85d95-09c6-46e3-990f-59c9ab3ad81f\") " pod="openshift-dns/dns-default-4z9qr" Jun 11 18:28:38.351770 ip-10-0-130-170 kubenswrapper[2565]: I0611 18:28:38.351743 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/0a494089-a655-4522-b2a2-955594964ac7-registry-tls\") pod \"image-registry-666fb979b7-zhmbp\" (UID: \"0a494089-a655-4522-b2a2-955594964ac7\") " pod="openshift-image-registry/image-registry-666fb979b7-zhmbp" Jun 11 18:28:38.351810 ip-10-0-130-170 kubenswrapper[2565]: E0611 18:28:38.351779 2565 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jun 11 18:28:38.351858 ip-10-0-130-170 kubenswrapper[2565]: E0611 18:28:38.351847 2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/41d85d95-09c6-46e3-990f-59c9ab3ad81f-metrics-tls podName:41d85d95-09c6-46e3-990f-59c9ab3ad81f nodeName:}" failed. No retries permitted until 2026-06-11 18:28:40.351830949 +0000 UTC m=+39.100516949 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/41d85d95-09c6-46e3-990f-59c9ab3ad81f-metrics-tls") pod "dns-default-4z9qr" (UID: "41d85d95-09c6-46e3-990f-59c9ab3ad81f") : secret "dns-default-metrics-tls" not found Jun 11 18:28:38.351908 ip-10-0-130-170 kubenswrapper[2565]: E0611 18:28:38.351875 2565 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jun 11 18:28:38.351908 ip-10-0-130-170 kubenswrapper[2565]: E0611 18:28:38.351895 2565 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-666fb979b7-zhmbp: secret "image-registry-tls" not found Jun 11 18:28:38.351971 ip-10-0-130-170 kubenswrapper[2565]: E0611 18:28:38.351946 2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/0a494089-a655-4522-b2a2-955594964ac7-registry-tls podName:0a494089-a655-4522-b2a2-955594964ac7 nodeName:}" failed. No retries permitted until 2026-06-11 18:28:40.35193135 +0000 UTC m=+39.100617370 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/0a494089-a655-4522-b2a2-955594964ac7-registry-tls") pod "image-registry-666fb979b7-zhmbp" (UID: "0a494089-a655-4522-b2a2-955594964ac7") : secret "image-registry-tls" not found Jun 11 18:28:38.935023 ip-10-0-130-170 kubenswrapper[2565]: I0611 18:28:38.934988 2565 generic.go:356] "Generic (PLEG): container finished" podID="0a391608-1cd7-4bb8-8907-2f8e7078bf68" containerID="6a0d9a97d07a2442037e90175778a9a5bef218c0303df9d15791b348dbaa27a3" exitCode=0 Jun 11 18:28:38.935568 ip-10-0-130-170 kubenswrapper[2565]: I0611 18:28:38.935069 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-7qn5t" event={"ID":"0a391608-1cd7-4bb8-8907-2f8e7078bf68","Type":"ContainerDied","Data":"6a0d9a97d07a2442037e90175778a9a5bef218c0303df9d15791b348dbaa27a3"} Jun 11 18:28:38.936352 ip-10-0-130-170 kubenswrapper[2565]: I0611 18:28:38.936328 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-czdq5" event={"ID":"35a5e103-2756-40a3-ad29-bae095288d5b","Type":"ContainerStarted","Data":"bae4d513853ac282cf7c0f27b53911d362963411fabcae57897f56649e3ddc7b"} Jun 11 18:28:39.942103 ip-10-0-130-170 kubenswrapper[2565]: I0611 18:28:39.941930 2565 generic.go:356] "Generic (PLEG): container finished" podID="0a391608-1cd7-4bb8-8907-2f8e7078bf68" containerID="89a123c193f07f15d94685f57f91bbfb39d7c1c280af538a58db20a64ff2b105" exitCode=0 Jun 11 18:28:39.942103 ip-10-0-130-170 kubenswrapper[2565]: I0611 18:28:39.942015 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-7qn5t" event={"ID":"0a391608-1cd7-4bb8-8907-2f8e7078bf68","Type":"ContainerDied","Data":"89a123c193f07f15d94685f57f91bbfb39d7c1c280af538a58db20a64ff2b105"} Jun 11 18:28:40.366733 ip-10-0-130-170 kubenswrapper[2565]: I0611 18:28:40.366694 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/0a494089-a655-4522-b2a2-955594964ac7-registry-tls\") pod \"image-registry-666fb979b7-zhmbp\" (UID: \"0a494089-a655-4522-b2a2-955594964ac7\") " pod="openshift-image-registry/image-registry-666fb979b7-zhmbp" Jun 11 18:28:40.366911 ip-10-0-130-170 kubenswrapper[2565]: I0611 18:28:40.366766 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/41d85d95-09c6-46e3-990f-59c9ab3ad81f-metrics-tls\") pod \"dns-default-4z9qr\" (UID: \"41d85d95-09c6-46e3-990f-59c9ab3ad81f\") " pod="openshift-dns/dns-default-4z9qr" Jun 11 18:28:40.366911 ip-10-0-130-170 kubenswrapper[2565]: E0611 18:28:40.366820 2565 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jun 11 18:28:40.366911 ip-10-0-130-170 kubenswrapper[2565]: E0611 18:28:40.366840 2565 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-666fb979b7-zhmbp: secret "image-registry-tls" not found Jun 11 18:28:40.366911 ip-10-0-130-170 kubenswrapper[2565]: E0611 18:28:40.366847 2565 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jun 11 18:28:40.366911 ip-10-0-130-170 kubenswrapper[2565]: E0611 18:28:40.366891 2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/41d85d95-09c6-46e3-990f-59c9ab3ad81f-metrics-tls podName:41d85d95-09c6-46e3-990f-59c9ab3ad81f nodeName:}" failed. No retries permitted until 2026-06-11 18:28:44.366879449 +0000 UTC m=+43.115565449 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/41d85d95-09c6-46e3-990f-59c9ab3ad81f-metrics-tls") pod "dns-default-4z9qr" (UID: "41d85d95-09c6-46e3-990f-59c9ab3ad81f") : secret "dns-default-metrics-tls" not found Jun 11 18:28:40.366911 ip-10-0-130-170 kubenswrapper[2565]: E0611 18:28:40.366904 2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/0a494089-a655-4522-b2a2-955594964ac7-registry-tls podName:0a494089-a655-4522-b2a2-955594964ac7 nodeName:}" failed. No retries permitted until 2026-06-11 18:28:44.36689833 +0000 UTC m=+43.115584329 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/0a494089-a655-4522-b2a2-955594964ac7-registry-tls") pod "image-registry-666fb979b7-zhmbp" (UID: "0a494089-a655-4522-b2a2-955594964ac7") : secret "image-registry-tls" not found Jun 11 18:28:40.945735 ip-10-0-130-170 kubenswrapper[2565]: I0611 18:28:40.945698 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-czdq5" event={"ID":"35a5e103-2756-40a3-ad29-bae095288d5b","Type":"ContainerStarted","Data":"a44a947a113e2f23b910a58500c7832a08816b5dd4dde3e48537ba206c9fffa4"} Jun 11 18:28:40.949028 ip-10-0-130-170 kubenswrapper[2565]: I0611 18:28:40.949001 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-7qn5t" event={"ID":"0a391608-1cd7-4bb8-8907-2f8e7078bf68","Type":"ContainerStarted","Data":"0d264553a75d4d88829006b0624d71038971dd9d5a70c2c29449221c927fe7ec"} Jun 11 18:28:40.965836 ip-10-0-130-170 kubenswrapper[2565]: I0611 18:28:40.965782 2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress-canary/ingress-canary-czdq5" podStartSLOduration=2.974887452 podStartE2EDuration="4.965763618s" totalImagesPullingTime="1.990876166s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-11 18:28:36 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-11 18:28:40.965051805 +0000 UTC m=+39.713737826" watchObservedRunningTime="2026-06-11 18:28:40.965763618 +0000 UTC m=+39.714449640" Jun 11 18:28:40.986223 ip-10-0-130-170 kubenswrapper[2565]: I0611 18:28:40.986162 2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-additional-cni-plugins-7qn5t" podStartSLOduration=9.832146016 podStartE2EDuration="39.986148164s" totalImagesPullingTime="30.154002148s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-11 18:28:01 +0000 UTC" imagePullSessionsCount=5 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-11 18:28:40.98536845 +0000 UTC m=+39.734054473" watchObservedRunningTime="2026-06-11 18:28:40.986148164 +0000 UTC m=+39.734834193" Jun 11 18:28:44.396598 ip-10-0-130-170 kubenswrapper[2565]: I0611 18:28:44.396548 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/0a494089-a655-4522-b2a2-955594964ac7-registry-tls\") pod \"image-registry-666fb979b7-zhmbp\" (UID: \"0a494089-a655-4522-b2a2-955594964ac7\") " pod="openshift-image-registry/image-registry-666fb979b7-zhmbp" Jun 11 18:28:44.397196 ip-10-0-130-170 kubenswrapper[2565]: I0611 18:28:44.396647 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/41d85d95-09c6-46e3-990f-59c9ab3ad81f-metrics-tls\") pod \"dns-default-4z9qr\" (UID: \"41d85d95-09c6-46e3-990f-59c9ab3ad81f\") " pod="openshift-dns/dns-default-4z9qr" Jun 11 18:28:44.397196 ip-10-0-130-170 kubenswrapper[2565]: E0611 18:28:44.396718 2565 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jun 11 18:28:44.397196 ip-10-0-130-170 kubenswrapper[2565]: E0611 18:28:44.396739 2565 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-666fb979b7-zhmbp: secret "image-registry-tls" not found Jun 11 18:28:44.397196 ip-10-0-130-170 kubenswrapper[2565]: E0611 18:28:44.396744 2565 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jun 11 18:28:44.397196 ip-10-0-130-170 kubenswrapper[2565]: E0611 18:28:44.396800 2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/41d85d95-09c6-46e3-990f-59c9ab3ad81f-metrics-tls podName:41d85d95-09c6-46e3-990f-59c9ab3ad81f nodeName:}" failed. No retries permitted until 2026-06-11 18:28:52.396782383 +0000 UTC m=+51.145468397 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/41d85d95-09c6-46e3-990f-59c9ab3ad81f-metrics-tls") pod "dns-default-4z9qr" (UID: "41d85d95-09c6-46e3-990f-59c9ab3ad81f") : secret "dns-default-metrics-tls" not found Jun 11 18:28:44.397196 ip-10-0-130-170 kubenswrapper[2565]: E0611 18:28:44.396819 2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/0a494089-a655-4522-b2a2-955594964ac7-registry-tls podName:0a494089-a655-4522-b2a2-955594964ac7 nodeName:}" failed. No retries permitted until 2026-06-11 18:28:52.396810425 +0000 UTC m=+51.145496425 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/0a494089-a655-4522-b2a2-955594964ac7-registry-tls") pod "image-registry-666fb979b7-zhmbp" (UID: "0a494089-a655-4522-b2a2-955594964ac7") : secret "image-registry-tls" not found Jun 11 18:28:52.457087 ip-10-0-130-170 kubenswrapper[2565]: I0611 18:28:52.457046 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/41d85d95-09c6-46e3-990f-59c9ab3ad81f-metrics-tls\") pod \"dns-default-4z9qr\" (UID: \"41d85d95-09c6-46e3-990f-59c9ab3ad81f\") " pod="openshift-dns/dns-default-4z9qr" Jun 11 18:28:52.457656 ip-10-0-130-170 kubenswrapper[2565]: I0611 18:28:52.457107 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/0a494089-a655-4522-b2a2-955594964ac7-registry-tls\") pod \"image-registry-666fb979b7-zhmbp\" (UID: \"0a494089-a655-4522-b2a2-955594964ac7\") " pod="openshift-image-registry/image-registry-666fb979b7-zhmbp" Jun 11 18:28:52.457656 ip-10-0-130-170 kubenswrapper[2565]: E0611 18:28:52.457201 2565 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jun 11 18:28:52.457656 ip-10-0-130-170 kubenswrapper[2565]: E0611 18:28:52.457213 2565 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-666fb979b7-zhmbp: secret "image-registry-tls" not found Jun 11 18:28:52.457656 ip-10-0-130-170 kubenswrapper[2565]: E0611 18:28:52.457222 2565 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jun 11 18:28:52.457656 ip-10-0-130-170 kubenswrapper[2565]: E0611 18:28:52.457284 2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/0a494089-a655-4522-b2a2-955594964ac7-registry-tls podName:0a494089-a655-4522-b2a2-955594964ac7 nodeName:}" failed. No retries permitted until 2026-06-11 18:29:08.457250846 +0000 UTC m=+67.205936846 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/0a494089-a655-4522-b2a2-955594964ac7-registry-tls") pod "image-registry-666fb979b7-zhmbp" (UID: "0a494089-a655-4522-b2a2-955594964ac7") : secret "image-registry-tls" not found Jun 11 18:28:52.457656 ip-10-0-130-170 kubenswrapper[2565]: E0611 18:28:52.457323 2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/41d85d95-09c6-46e3-990f-59c9ab3ad81f-metrics-tls podName:41d85d95-09c6-46e3-990f-59c9ab3ad81f nodeName:}" failed. No retries permitted until 2026-06-11 18:29:08.457302142 +0000 UTC m=+67.205988142 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/41d85d95-09c6-46e3-990f-59c9ab3ad81f-metrics-tls") pod "dns-default-4z9qr" (UID: "41d85d95-09c6-46e3-990f-59c9ab3ad81f") : secret "dns-default-metrics-tls" not found Jun 11 18:29:02.925660 ip-10-0-130-170 kubenswrapper[2565]: I0611 18:29:02.925633 2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-9xbcp" Jun 11 18:29:07.464029 ip-10-0-130-170 kubenswrapper[2565]: I0611 18:29:07.463989 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/2f4a1ff8-558e-4d9b-9208-ca0211b2b4e1-metrics-certs\") pod \"network-metrics-daemon-bvwxp\" (UID: \"2f4a1ff8-558e-4d9b-9208-ca0211b2b4e1\") " pod="openshift-multus/network-metrics-daemon-bvwxp" Jun 11 18:29:07.464029 ip-10-0-130-170 kubenswrapper[2565]: I0611 18:29:07.464027 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/1f1530cc-c788-4dc5-9e3d-7209386e9b94-original-pull-secret\") pod \"global-pull-secret-syncer-wqbfv\" (UID: \"1f1530cc-c788-4dc5-9e3d-7209386e9b94\") " pod="kube-system/global-pull-secret-syncer-wqbfv" Jun 11 18:29:07.466783 ip-10-0-130-170 kubenswrapper[2565]: I0611 18:29:07.466764 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\"" Jun 11 18:29:07.466913 ip-10-0-130-170 kubenswrapper[2565]: I0611 18:29:07.466892 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\"" Jun 11 18:29:07.474664 ip-10-0-130-170 kubenswrapper[2565]: E0611 18:29:07.474638 2565 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: secret "metrics-daemon-secret" not found Jun 11 18:29:07.474789 ip-10-0-130-170 kubenswrapper[2565]: E0611 18:29:07.474719 2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/2f4a1ff8-558e-4d9b-9208-ca0211b2b4e1-metrics-certs podName:2f4a1ff8-558e-4d9b-9208-ca0211b2b4e1 nodeName:}" failed. No retries permitted until 2026-06-11 18:30:11.474699325 +0000 UTC m=+130.223385328 (durationBeforeRetry 1m4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/2f4a1ff8-558e-4d9b-9208-ca0211b2b4e1-metrics-certs") pod "network-metrics-daemon-bvwxp" (UID: "2f4a1ff8-558e-4d9b-9208-ca0211b2b4e1") : secret "metrics-daemon-secret" not found Jun 11 18:29:07.478320 ip-10-0-130-170 kubenswrapper[2565]: I0611 18:29:07.478299 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/1f1530cc-c788-4dc5-9e3d-7209386e9b94-original-pull-secret\") pod \"global-pull-secret-syncer-wqbfv\" (UID: \"1f1530cc-c788-4dc5-9e3d-7209386e9b94\") " pod="kube-system/global-pull-secret-syncer-wqbfv" Jun 11 18:29:07.565316 ip-10-0-130-170 kubenswrapper[2565]: I0611 18:29:07.565271 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-78kwd\" (UniqueName: \"kubernetes.io/projected/48f7111f-5fb9-477e-8a9e-3e9b22030f6a-kube-api-access-78kwd\") pod \"network-check-target-nh426\" (UID: \"48f7111f-5fb9-477e-8a9e-3e9b22030f6a\") " pod="openshift-network-diagnostics/network-check-target-nh426" Jun 11 18:29:07.567919 ip-10-0-130-170 kubenswrapper[2565]: I0611 18:29:07.567897 2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\"" Jun 11 18:29:07.577765 ip-10-0-130-170 kubenswrapper[2565]: I0611 18:29:07.577739 2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\"" Jun 11 18:29:07.589049 ip-10-0-130-170 kubenswrapper[2565]: I0611 18:29:07.589028 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-78kwd\" (UniqueName: \"kubernetes.io/projected/48f7111f-5fb9-477e-8a9e-3e9b22030f6a-kube-api-access-78kwd\") pod \"network-check-target-nh426\" (UID: \"48f7111f-5fb9-477e-8a9e-3e9b22030f6a\") " pod="openshift-network-diagnostics/network-check-target-nh426" Jun 11 18:29:07.755395 ip-10-0-130-170 kubenswrapper[2565]: I0611 18:29:07.755314 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-wqbfv" Jun 11 18:29:07.764032 ip-10-0-130-170 kubenswrapper[2565]: I0611 18:29:07.764007 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-85nqp\"" Jun 11 18:29:07.772237 ip-10-0-130-170 kubenswrapper[2565]: I0611 18:29:07.772210 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-nh426" Jun 11 18:29:07.890122 ip-10-0-130-170 kubenswrapper[2565]: I0611 18:29:07.890087 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-wqbfv"] Jun 11 18:29:07.894444 ip-10-0-130-170 kubenswrapper[2565]: W0611 18:29:07.894411 2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1f1530cc_c788_4dc5_9e3d_7209386e9b94.slice/crio-edbf7c545f5a2d9eab68bfa3c5120a93a4b3f878f75a995474cff6f7551415ff WatchSource:0}: Error finding container edbf7c545f5a2d9eab68bfa3c5120a93a4b3f878f75a995474cff6f7551415ff: Status 404 returned error can't find the container with id edbf7c545f5a2d9eab68bfa3c5120a93a4b3f878f75a995474cff6f7551415ff Jun 11 18:29:07.904656 ip-10-0-130-170 kubenswrapper[2565]: I0611 18:29:07.904635 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-nh426"] Jun 11 18:29:07.907312 ip-10-0-130-170 kubenswrapper[2565]: W0611 18:29:07.907291 2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod48f7111f_5fb9_477e_8a9e_3e9b22030f6a.slice/crio-9791039116d1abfeede2cbe41eb9eaf045c4ed332b2593c11cb29bd190767e01 WatchSource:0}: Error finding container 9791039116d1abfeede2cbe41eb9eaf045c4ed332b2593c11cb29bd190767e01: Status 404 returned error can't find the container with id 9791039116d1abfeede2cbe41eb9eaf045c4ed332b2593c11cb29bd190767e01 Jun 11 18:29:08.011639 ip-10-0-130-170 kubenswrapper[2565]: I0611 18:29:08.011531 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-nh426" event={"ID":"48f7111f-5fb9-477e-8a9e-3e9b22030f6a","Type":"ContainerStarted","Data":"9791039116d1abfeede2cbe41eb9eaf045c4ed332b2593c11cb29bd190767e01"} Jun 11 18:29:08.012626 ip-10-0-130-170 kubenswrapper[2565]: I0611 18:29:08.012604 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-wqbfv" event={"ID":"1f1530cc-c788-4dc5-9e3d-7209386e9b94","Type":"ContainerStarted","Data":"edbf7c545f5a2d9eab68bfa3c5120a93a4b3f878f75a995474cff6f7551415ff"} Jun 11 18:29:08.472523 ip-10-0-130-170 kubenswrapper[2565]: I0611 18:29:08.472483 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/41d85d95-09c6-46e3-990f-59c9ab3ad81f-metrics-tls\") pod \"dns-default-4z9qr\" (UID: \"41d85d95-09c6-46e3-990f-59c9ab3ad81f\") " pod="openshift-dns/dns-default-4z9qr" Jun 11 18:29:08.472998 ip-10-0-130-170 kubenswrapper[2565]: I0611 18:29:08.472553 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/0a494089-a655-4522-b2a2-955594964ac7-registry-tls\") pod \"image-registry-666fb979b7-zhmbp\" (UID: \"0a494089-a655-4522-b2a2-955594964ac7\") " pod="openshift-image-registry/image-registry-666fb979b7-zhmbp" Jun 11 18:29:08.472998 ip-10-0-130-170 kubenswrapper[2565]: E0611 18:29:08.472663 2565 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jun 11 18:29:08.472998 ip-10-0-130-170 kubenswrapper[2565]: E0611 18:29:08.472700 2565 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jun 11 18:29:08.472998 ip-10-0-130-170 kubenswrapper[2565]: E0611 18:29:08.472714 2565 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-666fb979b7-zhmbp: secret "image-registry-tls" not found Jun 11 18:29:08.472998 ip-10-0-130-170 kubenswrapper[2565]: E0611 18:29:08.472738 2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/41d85d95-09c6-46e3-990f-59c9ab3ad81f-metrics-tls podName:41d85d95-09c6-46e3-990f-59c9ab3ad81f nodeName:}" failed. No retries permitted until 2026-06-11 18:29:40.472718226 +0000 UTC m=+99.221404239 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/41d85d95-09c6-46e3-990f-59c9ab3ad81f-metrics-tls") pod "dns-default-4z9qr" (UID: "41d85d95-09c6-46e3-990f-59c9ab3ad81f") : secret "dns-default-metrics-tls" not found Jun 11 18:29:08.472998 ip-10-0-130-170 kubenswrapper[2565]: E0611 18:29:08.472762 2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/0a494089-a655-4522-b2a2-955594964ac7-registry-tls podName:0a494089-a655-4522-b2a2-955594964ac7 nodeName:}" failed. No retries permitted until 2026-06-11 18:29:40.472745951 +0000 UTC m=+99.221431971 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/0a494089-a655-4522-b2a2-955594964ac7-registry-tls") pod "image-registry-666fb979b7-zhmbp" (UID: "0a494089-a655-4522-b2a2-955594964ac7") : secret "image-registry-tls" not found Jun 11 18:29:13.027983 ip-10-0-130-170 kubenswrapper[2565]: I0611 18:29:13.027942 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-wqbfv" event={"ID":"1f1530cc-c788-4dc5-9e3d-7209386e9b94","Type":"ContainerStarted","Data":"9e87cbf5e405e43a71601963abd64149cceca3da44465aad8848761249d421f3"} Jun 11 18:29:13.029360 ip-10-0-130-170 kubenswrapper[2565]: I0611 18:29:13.029340 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-nh426" event={"ID":"48f7111f-5fb9-477e-8a9e-3e9b22030f6a","Type":"ContainerStarted","Data":"ca50e782d282bfc45081a1227da725b9932db4d6e0ee449a4ae06e49fa1e55a0"} Jun 11 18:29:13.029493 ip-10-0-130-170 kubenswrapper[2565]: I0611 18:29:13.029474 2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-network-diagnostics/network-check-target-nh426" Jun 11 18:29:13.045073 ip-10-0-130-170 kubenswrapper[2565]: I0611 18:29:13.045034 2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/global-pull-secret-syncer-wqbfv" podStartSLOduration=66.80810475 podStartE2EDuration="1m11.045021346s" totalImagesPullingTime="4.236916596s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-11 18:28:02 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-11 18:29:13.044572661 +0000 UTC m=+71.793258706" watchObservedRunningTime="2026-06-11 18:29:13.045021346 +0000 UTC m=+71.793707368" Jun 11 18:29:13.058976 ip-10-0-130-170 kubenswrapper[2565]: I0611 18:29:13.058938 2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-diagnostics/network-check-target-nh426" podStartSLOduration=67.838006228 podStartE2EDuration="1m12.058925046s" totalImagesPullingTime="4.220918818s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-11 18:28:01 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-11 18:29:13.058317433 +0000 UTC m=+71.807003453" watchObservedRunningTime="2026-06-11 18:29:13.058925046 +0000 UTC m=+71.807611094" Jun 11 18:29:40.502476 ip-10-0-130-170 kubenswrapper[2565]: I0611 18:29:40.502430 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/0a494089-a655-4522-b2a2-955594964ac7-registry-tls\") pod \"image-registry-666fb979b7-zhmbp\" (UID: \"0a494089-a655-4522-b2a2-955594964ac7\") " pod="openshift-image-registry/image-registry-666fb979b7-zhmbp" Jun 11 18:29:40.502989 ip-10-0-130-170 kubenswrapper[2565]: I0611 18:29:40.502494 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/41d85d95-09c6-46e3-990f-59c9ab3ad81f-metrics-tls\") pod \"dns-default-4z9qr\" (UID: \"41d85d95-09c6-46e3-990f-59c9ab3ad81f\") " pod="openshift-dns/dns-default-4z9qr" Jun 11 18:29:40.502989 ip-10-0-130-170 kubenswrapper[2565]: E0611 18:29:40.502602 2565 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jun 11 18:29:40.502989 ip-10-0-130-170 kubenswrapper[2565]: E0611 18:29:40.502625 2565 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-666fb979b7-zhmbp: secret "image-registry-tls" not found Jun 11 18:29:40.502989 ip-10-0-130-170 kubenswrapper[2565]: E0611 18:29:40.502685 2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/0a494089-a655-4522-b2a2-955594964ac7-registry-tls podName:0a494089-a655-4522-b2a2-955594964ac7 nodeName:}" failed. No retries permitted until 2026-06-11 18:30:44.502665925 +0000 UTC m=+163.251351926 (durationBeforeRetry 1m4s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/0a494089-a655-4522-b2a2-955594964ac7-registry-tls") pod "image-registry-666fb979b7-zhmbp" (UID: "0a494089-a655-4522-b2a2-955594964ac7") : secret "image-registry-tls" not found Jun 11 18:29:40.502989 ip-10-0-130-170 kubenswrapper[2565]: E0611 18:29:40.502599 2565 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jun 11 18:29:40.502989 ip-10-0-130-170 kubenswrapper[2565]: E0611 18:29:40.502759 2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/41d85d95-09c6-46e3-990f-59c9ab3ad81f-metrics-tls podName:41d85d95-09c6-46e3-990f-59c9ab3ad81f nodeName:}" failed. No retries permitted until 2026-06-11 18:30:44.50274582 +0000 UTC m=+163.251431835 (durationBeforeRetry 1m4s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/41d85d95-09c6-46e3-990f-59c9ab3ad81f-metrics-tls") pod "dns-default-4z9qr" (UID: "41d85d95-09c6-46e3-990f-59c9ab3ad81f") : secret "dns-default-metrics-tls" not found Jun 11 18:29:44.034550 ip-10-0-130-170 kubenswrapper[2565]: I0611 18:29:44.034515 2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-network-diagnostics/network-check-target-nh426" Jun 11 18:30:11.526758 ip-10-0-130-170 kubenswrapper[2565]: I0611 18:30:11.526717 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/2f4a1ff8-558e-4d9b-9208-ca0211b2b4e1-metrics-certs\") pod \"network-metrics-daemon-bvwxp\" (UID: \"2f4a1ff8-558e-4d9b-9208-ca0211b2b4e1\") " pod="openshift-multus/network-metrics-daemon-bvwxp" Jun 11 18:30:11.527305 ip-10-0-130-170 kubenswrapper[2565]: E0611 18:30:11.526855 2565 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: secret "metrics-daemon-secret" not found Jun 11 18:30:11.527305 ip-10-0-130-170 kubenswrapper[2565]: E0611 18:30:11.526912 2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/2f4a1ff8-558e-4d9b-9208-ca0211b2b4e1-metrics-certs podName:2f4a1ff8-558e-4d9b-9208-ca0211b2b4e1 nodeName:}" failed. No retries permitted until 2026-06-11 18:32:13.526897651 +0000 UTC m=+252.275583651 (durationBeforeRetry 2m2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/2f4a1ff8-558e-4d9b-9208-ca0211b2b4e1-metrics-certs") pod "network-metrics-daemon-bvwxp" (UID: "2f4a1ff8-558e-4d9b-9208-ca0211b2b4e1") : secret "metrics-daemon-secret" not found Jun 11 18:30:39.631699 ip-10-0-130-170 kubenswrapper[2565]: E0611 18:30:39.631627 2565 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[registry-tls], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-image-registry/image-registry-666fb979b7-zhmbp" podUID="0a494089-a655-4522-b2a2-955594964ac7" Jun 11 18:30:39.647897 ip-10-0-130-170 kubenswrapper[2565]: E0611 18:30:39.647858 2565 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[metrics-tls], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-dns/dns-default-4z9qr" podUID="41d85d95-09c6-46e3-990f-59c9ab3ad81f" Jun 11 18:30:39.753825 ip-10-0-130-170 kubenswrapper[2565]: E0611 18:30:39.753788 2565 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[metrics-certs], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-multus/network-metrics-daemon-bvwxp" podUID="2f4a1ff8-558e-4d9b-9208-ca0211b2b4e1" Jun 11 18:30:40.237939 ip-10-0-130-170 kubenswrapper[2565]: I0611 18:30:40.237909 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-666fb979b7-zhmbp" Jun 11 18:30:40.238090 ip-10-0-130-170 kubenswrapper[2565]: I0611 18:30:40.237909 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-4z9qr" Jun 11 18:30:44.553181 ip-10-0-130-170 kubenswrapper[2565]: I0611 18:30:44.553128 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/41d85d95-09c6-46e3-990f-59c9ab3ad81f-metrics-tls\") pod \"dns-default-4z9qr\" (UID: \"41d85d95-09c6-46e3-990f-59c9ab3ad81f\") " pod="openshift-dns/dns-default-4z9qr" Jun 11 18:30:44.553181 ip-10-0-130-170 kubenswrapper[2565]: I0611 18:30:44.553191 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/0a494089-a655-4522-b2a2-955594964ac7-registry-tls\") pod \"image-registry-666fb979b7-zhmbp\" (UID: \"0a494089-a655-4522-b2a2-955594964ac7\") " pod="openshift-image-registry/image-registry-666fb979b7-zhmbp" Jun 11 18:30:44.553656 ip-10-0-130-170 kubenswrapper[2565]: E0611 18:30:44.553300 2565 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jun 11 18:30:44.553656 ip-10-0-130-170 kubenswrapper[2565]: E0611 18:30:44.553364 2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/41d85d95-09c6-46e3-990f-59c9ab3ad81f-metrics-tls podName:41d85d95-09c6-46e3-990f-59c9ab3ad81f nodeName:}" failed. No retries permitted until 2026-06-11 18:32:46.553348715 +0000 UTC m=+285.302034719 (durationBeforeRetry 2m2s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/41d85d95-09c6-46e3-990f-59c9ab3ad81f-metrics-tls") pod "dns-default-4z9qr" (UID: "41d85d95-09c6-46e3-990f-59c9ab3ad81f") : secret "dns-default-metrics-tls" not found Jun 11 18:30:44.553656 ip-10-0-130-170 kubenswrapper[2565]: E0611 18:30:44.553307 2565 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jun 11 18:30:44.553656 ip-10-0-130-170 kubenswrapper[2565]: E0611 18:30:44.553398 2565 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-666fb979b7-zhmbp: secret "image-registry-tls" not found Jun 11 18:30:44.553656 ip-10-0-130-170 kubenswrapper[2565]: E0611 18:30:44.553463 2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/0a494089-a655-4522-b2a2-955594964ac7-registry-tls podName:0a494089-a655-4522-b2a2-955594964ac7 nodeName:}" failed. No retries permitted until 2026-06-11 18:32:46.553451479 +0000 UTC m=+285.302137478 (durationBeforeRetry 2m2s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/0a494089-a655-4522-b2a2-955594964ac7-registry-tls") pod "image-registry-666fb979b7-zhmbp" (UID: "0a494089-a655-4522-b2a2-955594964ac7") : secret "image-registry-tls" not found Jun 11 18:30:51.745627 ip-10-0-130-170 kubenswrapper[2565]: I0611 18:30:51.745598 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-bvwxp" Jun 11 18:31:41.061208 ip-10-0-130-170 kubenswrapper[2565]: I0611 18:31:41.061173 2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-service-ca-operator/service-ca-operator-7ccbfd59dc-vtjsg"] Jun 11 18:31:41.062906 ip-10-0-130-170 kubenswrapper[2565]: I0611 18:31:41.062890 2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-network-console/networking-console-plugin-867b76cb74-mbzpt"] Jun 11 18:31:41.063023 ip-10-0-130-170 kubenswrapper[2565]: I0611 18:31:41.063002 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-service-ca-operator/service-ca-operator-7ccbfd59dc-vtjsg" Jun 11 18:31:41.064627 ip-10-0-130-170 kubenswrapper[2565]: I0611 18:31:41.064608 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-console/networking-console-plugin-867b76cb74-mbzpt" Jun 11 18:31:41.068801 ip-10-0-130-170 kubenswrapper[2565]: I0611 18:31:41.068775 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-service-ca-operator\"/\"serving-cert\"" Jun 11 18:31:41.068902 ip-10-0-130-170 kubenswrapper[2565]: I0611 18:31:41.068819 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-console\"/\"networking-console-plugin-cert\"" Jun 11 18:31:41.068902 ip-10-0-130-170 kubenswrapper[2565]: I0611 18:31:41.068831 2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca-operator\"/\"kube-root-ca.crt\"" Jun 11 18:31:41.068902 ip-10-0-130-170 kubenswrapper[2565]: I0611 18:31:41.068790 2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca-operator\"/\"service-ca-operator-config\"" Jun 11 18:31:41.069922 ip-10-0-130-170 kubenswrapper[2565]: I0611 18:31:41.069791 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-console\"/\"default-dockercfg-29z4z\"" Jun 11 18:31:41.069922 ip-10-0-130-170 kubenswrapper[2565]: I0611 18:31:41.069828 2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca-operator\"/\"openshift-service-ca.crt\"" Jun 11 18:31:41.069922 ip-10-0-130-170 kubenswrapper[2565]: I0611 18:31:41.069828 2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-console\"/\"networking-console-plugin\"" Jun 11 18:31:41.069922 ip-10-0-130-170 kubenswrapper[2565]: I0611 18:31:41.069878 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-service-ca-operator\"/\"service-ca-operator-dockercfg-5kbvb\"" Jun 11 18:31:41.122436 ip-10-0-130-170 kubenswrapper[2565]: I0611 18:31:41.122401 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-console/networking-console-plugin-867b76cb74-mbzpt"] Jun 11 18:31:41.123126 ip-10-0-130-170 kubenswrapper[2565]: I0611 18:31:41.123107 2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-cluster-samples-operator/cluster-samples-operator-9547488fd-z2lx7"] Jun 11 18:31:41.125505 ip-10-0-130-170 kubenswrapper[2565]: I0611 18:31:41.125489 2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-insights/insights-operator-5bbd86d6bd-xr2lr"] Jun 11 18:31:41.125637 ip-10-0-130-170 kubenswrapper[2565]: I0611 18:31:41.125620 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-samples-operator/cluster-samples-operator-9547488fd-z2lx7" Jun 11 18:31:41.127167 ip-10-0-130-170 kubenswrapper[2565]: I0611 18:31:41.127149 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-service-ca-operator/service-ca-operator-7ccbfd59dc-vtjsg"] Jun 11 18:31:41.127287 ip-10-0-130-170 kubenswrapper[2565]: I0611 18:31:41.127220 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-operator-5bbd86d6bd-xr2lr" Jun 11 18:31:41.130456 ip-10-0-130-170 kubenswrapper[2565]: I0611 18:31:41.130435 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"openshift-insights-serving-cert\"" Jun 11 18:31:41.130824 ip-10-0-130-170 kubenswrapper[2565]: I0611 18:31:41.130800 2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"openshift-service-ca.crt\"" Jun 11 18:31:41.138332 ip-10-0-130-170 kubenswrapper[2565]: I0611 18:31:41.138297 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-samples-operator\"/\"samples-operator-tls\"" Jun 11 18:31:41.138439 ip-10-0-130-170 kubenswrapper[2565]: I0611 18:31:41.138379 2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-root-ca.crt\"" Jun 11 18:31:41.138511 ip-10-0-130-170 kubenswrapper[2565]: I0611 18:31:41.138441 2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"service-ca-bundle\"" Jun 11 18:31:41.138681 ip-10-0-130-170 kubenswrapper[2565]: I0611 18:31:41.138664 2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-samples-operator\"/\"openshift-service-ca.crt\"" Jun 11 18:31:41.138767 ip-10-0-130-170 kubenswrapper[2565]: I0611 18:31:41.138749 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"operator-dockercfg-8clhb\"" Jun 11 18:31:41.138827 ip-10-0-130-170 kubenswrapper[2565]: I0611 18:31:41.138813 2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-samples-operator\"/\"kube-root-ca.crt\"" Jun 11 18:31:41.139019 ip-10-0-130-170 kubenswrapper[2565]: I0611 18:31:41.139005 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-samples-operator\"/\"cluster-samples-operator-dockercfg-4xcmm\"" Jun 11 18:31:41.143579 ip-10-0-130-170 kubenswrapper[2565]: I0611 18:31:41.143559 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-operator-5bbd86d6bd-xr2lr"] Jun 11 18:31:41.146998 ip-10-0-130-170 kubenswrapper[2565]: I0611 18:31:41.146971 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/d9d950d8-2c16-43ec-a77c-8c0b870f52e6-networking-console-plugin-cert\") pod \"networking-console-plugin-867b76cb74-mbzpt\" (UID: \"d9d950d8-2c16-43ec-a77c-8c0b870f52e6\") " pod="openshift-network-console/networking-console-plugin-867b76cb74-mbzpt" Jun 11 18:31:41.147171 ip-10-0-130-170 kubenswrapper[2565]: I0611 18:31:41.147056 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/6557afae-a8c6-4147-9f64-5c22cacf0d89-config\") pod \"service-ca-operator-7ccbfd59dc-vtjsg\" (UID: \"6557afae-a8c6-4147-9f64-5c22cacf0d89\") " pod="openshift-service-ca-operator/service-ca-operator-7ccbfd59dc-vtjsg" Jun 11 18:31:41.147171 ip-10-0-130-170 kubenswrapper[2565]: I0611 18:31:41.147126 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/6557afae-a8c6-4147-9f64-5c22cacf0d89-serving-cert\") pod \"service-ca-operator-7ccbfd59dc-vtjsg\" (UID: \"6557afae-a8c6-4147-9f64-5c22cacf0d89\") " pod="openshift-service-ca-operator/service-ca-operator-7ccbfd59dc-vtjsg" Jun 11 18:31:41.147310 ip-10-0-130-170 kubenswrapper[2565]: I0611 18:31:41.147206 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/d9d950d8-2c16-43ec-a77c-8c0b870f52e6-nginx-conf\") pod \"networking-console-plugin-867b76cb74-mbzpt\" (UID: \"d9d950d8-2c16-43ec-a77c-8c0b870f52e6\") " pod="openshift-network-console/networking-console-plugin-867b76cb74-mbzpt" Jun 11 18:31:41.147310 ip-10-0-130-170 kubenswrapper[2565]: I0611 18:31:41.147227 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5ps6b\" (UniqueName: \"kubernetes.io/projected/6557afae-a8c6-4147-9f64-5c22cacf0d89-kube-api-access-5ps6b\") pod \"service-ca-operator-7ccbfd59dc-vtjsg\" (UID: \"6557afae-a8c6-4147-9f64-5c22cacf0d89\") " pod="openshift-service-ca-operator/service-ca-operator-7ccbfd59dc-vtjsg" Jun 11 18:31:41.148042 ip-10-0-130-170 kubenswrapper[2565]: I0611 18:31:41.148025 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-cluster-samples-operator/cluster-samples-operator-9547488fd-z2lx7"] Jun 11 18:31:41.157170 ip-10-0-130-170 kubenswrapper[2565]: I0611 18:31:41.157148 2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"trusted-ca-bundle\"" Jun 11 18:31:41.171612 ip-10-0-130-170 kubenswrapper[2565]: I0611 18:31:41.171590 2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-network-diagnostics/network-check-source-6947749cfc-8zxb4"] Jun 11 18:31:41.173518 ip-10-0-130-170 kubenswrapper[2565]: I0611 18:31:41.173505 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-source-6947749cfc-8zxb4" Jun 11 18:31:41.176895 ip-10-0-130-170 kubenswrapper[2565]: I0611 18:31:41.176871 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"network-diagnostics-dockercfg-lrh5w\"" Jun 11 18:31:41.205178 ip-10-0-130-170 kubenswrapper[2565]: I0611 18:31:41.205149 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-source-6947749cfc-8zxb4"] Jun 11 18:31:41.248232 ip-10-0-130-170 kubenswrapper[2565]: I0611 18:31:41.248203 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-586xj\" (UniqueName: \"kubernetes.io/projected/7e07093b-14a2-45a2-ab61-8a88da306b9d-kube-api-access-586xj\") pod \"network-check-source-6947749cfc-8zxb4\" (UID: \"7e07093b-14a2-45a2-ab61-8a88da306b9d\") " pod="openshift-network-diagnostics/network-check-source-6947749cfc-8zxb4" Jun 11 18:31:41.248376 ip-10-0-130-170 kubenswrapper[2565]: I0611 18:31:41.248238 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"snapshots\" (UniqueName: \"kubernetes.io/empty-dir/41864c84-6359-4718-9e48-64baa8e95dbc-snapshots\") pod \"insights-operator-5bbd86d6bd-xr2lr\" (UID: \"41864c84-6359-4718-9e48-64baa8e95dbc\") " pod="openshift-insights/insights-operator-5bbd86d6bd-xr2lr" Jun 11 18:31:41.248376 ip-10-0-130-170 kubenswrapper[2565]: I0611 18:31:41.248300 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/41864c84-6359-4718-9e48-64baa8e95dbc-service-ca-bundle\") pod \"insights-operator-5bbd86d6bd-xr2lr\" (UID: \"41864c84-6359-4718-9e48-64baa8e95dbc\") " pod="openshift-insights/insights-operator-5bbd86d6bd-xr2lr" Jun 11 18:31:41.248376 ip-10-0-130-170 kubenswrapper[2565]: I0611 18:31:41.248351 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5ps6b\" (UniqueName: \"kubernetes.io/projected/6557afae-a8c6-4147-9f64-5c22cacf0d89-kube-api-access-5ps6b\") pod \"service-ca-operator-7ccbfd59dc-vtjsg\" (UID: \"6557afae-a8c6-4147-9f64-5c22cacf0d89\") " pod="openshift-service-ca-operator/service-ca-operator-7ccbfd59dc-vtjsg" Jun 11 18:31:41.248376 ip-10-0-130-170 kubenswrapper[2565]: I0611 18:31:41.248373 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/41864c84-6359-4718-9e48-64baa8e95dbc-trusted-ca-bundle\") pod \"insights-operator-5bbd86d6bd-xr2lr\" (UID: \"41864c84-6359-4718-9e48-64baa8e95dbc\") " pod="openshift-insights/insights-operator-5bbd86d6bd-xr2lr" Jun 11 18:31:41.248543 ip-10-0-130-170 kubenswrapper[2565]: I0611 18:31:41.248408 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-m5sld\" (UniqueName: \"kubernetes.io/projected/1e5bc198-f331-4cbf-a556-b57063b26c89-kube-api-access-m5sld\") pod \"cluster-samples-operator-9547488fd-z2lx7\" (UID: \"1e5bc198-f331-4cbf-a556-b57063b26c89\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-9547488fd-z2lx7" Jun 11 18:31:41.248543 ip-10-0-130-170 kubenswrapper[2565]: I0611 18:31:41.248434 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-lvpq7\" (UniqueName: \"kubernetes.io/projected/41864c84-6359-4718-9e48-64baa8e95dbc-kube-api-access-lvpq7\") pod \"insights-operator-5bbd86d6bd-xr2lr\" (UID: \"41864c84-6359-4718-9e48-64baa8e95dbc\") " pod="openshift-insights/insights-operator-5bbd86d6bd-xr2lr" Jun 11 18:31:41.248543 ip-10-0-130-170 kubenswrapper[2565]: I0611 18:31:41.248474 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/6557afae-a8c6-4147-9f64-5c22cacf0d89-serving-cert\") pod \"service-ca-operator-7ccbfd59dc-vtjsg\" (UID: \"6557afae-a8c6-4147-9f64-5c22cacf0d89\") " pod="openshift-service-ca-operator/service-ca-operator-7ccbfd59dc-vtjsg" Jun 11 18:31:41.248543 ip-10-0-130-170 kubenswrapper[2565]: I0611 18:31:41.248500 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/41864c84-6359-4718-9e48-64baa8e95dbc-tmp\") pod \"insights-operator-5bbd86d6bd-xr2lr\" (UID: \"41864c84-6359-4718-9e48-64baa8e95dbc\") " pod="openshift-insights/insights-operator-5bbd86d6bd-xr2lr" Jun 11 18:31:41.248543 ip-10-0-130-170 kubenswrapper[2565]: I0611 18:31:41.248523 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/41864c84-6359-4718-9e48-64baa8e95dbc-serving-cert\") pod \"insights-operator-5bbd86d6bd-xr2lr\" (UID: \"41864c84-6359-4718-9e48-64baa8e95dbc\") " pod="openshift-insights/insights-operator-5bbd86d6bd-xr2lr" Jun 11 18:31:41.248767 ip-10-0-130-170 kubenswrapper[2565]: I0611 18:31:41.248546 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/1e5bc198-f331-4cbf-a556-b57063b26c89-samples-operator-tls\") pod \"cluster-samples-operator-9547488fd-z2lx7\" (UID: \"1e5bc198-f331-4cbf-a556-b57063b26c89\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-9547488fd-z2lx7" Jun 11 18:31:41.248767 ip-10-0-130-170 kubenswrapper[2565]: I0611 18:31:41.248572 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/d9d950d8-2c16-43ec-a77c-8c0b870f52e6-networking-console-plugin-cert\") pod \"networking-console-plugin-867b76cb74-mbzpt\" (UID: \"d9d950d8-2c16-43ec-a77c-8c0b870f52e6\") " pod="openshift-network-console/networking-console-plugin-867b76cb74-mbzpt" Jun 11 18:31:41.248767 ip-10-0-130-170 kubenswrapper[2565]: I0611 18:31:41.248613 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/6557afae-a8c6-4147-9f64-5c22cacf0d89-config\") pod \"service-ca-operator-7ccbfd59dc-vtjsg\" (UID: \"6557afae-a8c6-4147-9f64-5c22cacf0d89\") " pod="openshift-service-ca-operator/service-ca-operator-7ccbfd59dc-vtjsg" Jun 11 18:31:41.248767 ip-10-0-130-170 kubenswrapper[2565]: E0611 18:31:41.248678 2565 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found Jun 11 18:31:41.248928 ip-10-0-130-170 kubenswrapper[2565]: E0611 18:31:41.248773 2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d9d950d8-2c16-43ec-a77c-8c0b870f52e6-networking-console-plugin-cert podName:d9d950d8-2c16-43ec-a77c-8c0b870f52e6 nodeName:}" failed. No retries permitted until 2026-06-11 18:31:41.748752046 +0000 UTC m=+220.497438049 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/d9d950d8-2c16-43ec-a77c-8c0b870f52e6-networking-console-plugin-cert") pod "networking-console-plugin-867b76cb74-mbzpt" (UID: "d9d950d8-2c16-43ec-a77c-8c0b870f52e6") : secret "networking-console-plugin-cert" not found Jun 11 18:31:41.248928 ip-10-0-130-170 kubenswrapper[2565]: I0611 18:31:41.248681 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/d9d950d8-2c16-43ec-a77c-8c0b870f52e6-nginx-conf\") pod \"networking-console-plugin-867b76cb74-mbzpt\" (UID: \"d9d950d8-2c16-43ec-a77c-8c0b870f52e6\") " pod="openshift-network-console/networking-console-plugin-867b76cb74-mbzpt" Jun 11 18:31:41.249158 ip-10-0-130-170 kubenswrapper[2565]: I0611 18:31:41.249141 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/configmap/6557afae-a8c6-4147-9f64-5c22cacf0d89-config\") pod \"service-ca-operator-7ccbfd59dc-vtjsg\" (UID: \"6557afae-a8c6-4147-9f64-5c22cacf0d89\") " pod="openshift-service-ca-operator/service-ca-operator-7ccbfd59dc-vtjsg" Jun 11 18:31:41.249279 ip-10-0-130-170 kubenswrapper[2565]: I0611 18:31:41.249206 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/d9d950d8-2c16-43ec-a77c-8c0b870f52e6-nginx-conf\") pod \"networking-console-plugin-867b76cb74-mbzpt\" (UID: \"d9d950d8-2c16-43ec-a77c-8c0b870f52e6\") " pod="openshift-network-console/networking-console-plugin-867b76cb74-mbzpt" Jun 11 18:31:41.250810 ip-10-0-130-170 kubenswrapper[2565]: I0611 18:31:41.250791 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/6557afae-a8c6-4147-9f64-5c22cacf0d89-serving-cert\") pod \"service-ca-operator-7ccbfd59dc-vtjsg\" (UID: \"6557afae-a8c6-4147-9f64-5c22cacf0d89\") " pod="openshift-service-ca-operator/service-ca-operator-7ccbfd59dc-vtjsg" Jun 11 18:31:41.271669 ip-10-0-130-170 kubenswrapper[2565]: I0611 18:31:41.271645 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-5ps6b\" (UniqueName: \"kubernetes.io/projected/6557afae-a8c6-4147-9f64-5c22cacf0d89-kube-api-access-5ps6b\") pod \"service-ca-operator-7ccbfd59dc-vtjsg\" (UID: \"6557afae-a8c6-4147-9f64-5c22cacf0d89\") " pod="openshift-service-ca-operator/service-ca-operator-7ccbfd59dc-vtjsg" Jun 11 18:31:41.273329 ip-10-0-130-170 kubenswrapper[2565]: I0611 18:31:41.273306 2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console-operator/console-operator-5dbbb5d744-vpdts"] Jun 11 18:31:41.275442 ip-10-0-130-170 kubenswrapper[2565]: I0611 18:31:41.275421 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console-operator/console-operator-5dbbb5d744-vpdts" Jun 11 18:31:41.277932 ip-10-0-130-170 kubenswrapper[2565]: I0611 18:31:41.277909 2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console-operator\"/\"console-operator-config\"" Jun 11 18:31:41.278041 ip-10-0-130-170 kubenswrapper[2565]: I0611 18:31:41.277956 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console-operator\"/\"serving-cert\"" Jun 11 18:31:41.278233 ip-10-0-130-170 kubenswrapper[2565]: I0611 18:31:41.278208 2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console-operator\"/\"openshift-service-ca.crt\"" Jun 11 18:31:41.278368 ip-10-0-130-170 kubenswrapper[2565]: I0611 18:31:41.278249 2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console-operator\"/\"kube-root-ca.crt\"" Jun 11 18:31:41.278368 ip-10-0-130-170 kubenswrapper[2565]: I0611 18:31:41.278351 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console-operator\"/\"console-operator-dockercfg-w6nh4\"" Jun 11 18:31:41.284764 ip-10-0-130-170 kubenswrapper[2565]: I0611 18:31:41.284746 2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console-operator\"/\"trusted-ca\"" Jun 11 18:31:41.289759 ip-10-0-130-170 kubenswrapper[2565]: I0611 18:31:41.289740 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console-operator/console-operator-5dbbb5d744-vpdts"] Jun 11 18:31:41.349529 ip-10-0-130-170 kubenswrapper[2565]: I0611 18:31:41.349444 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-m5sld\" (UniqueName: \"kubernetes.io/projected/1e5bc198-f331-4cbf-a556-b57063b26c89-kube-api-access-m5sld\") pod \"cluster-samples-operator-9547488fd-z2lx7\" (UID: \"1e5bc198-f331-4cbf-a556-b57063b26c89\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-9547488fd-z2lx7" Jun 11 18:31:41.349529 ip-10-0-130-170 kubenswrapper[2565]: I0611 18:31:41.349479 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-lvpq7\" (UniqueName: \"kubernetes.io/projected/41864c84-6359-4718-9e48-64baa8e95dbc-kube-api-access-lvpq7\") pod \"insights-operator-5bbd86d6bd-xr2lr\" (UID: \"41864c84-6359-4718-9e48-64baa8e95dbc\") " pod="openshift-insights/insights-operator-5bbd86d6bd-xr2lr" Jun 11 18:31:41.349529 ip-10-0-130-170 kubenswrapper[2565]: I0611 18:31:41.349506 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/3329f4b1-ac8c-4472-b6a0-13bb76075957-trusted-ca\") pod \"console-operator-5dbbb5d744-vpdts\" (UID: \"3329f4b1-ac8c-4472-b6a0-13bb76075957\") " pod="openshift-console-operator/console-operator-5dbbb5d744-vpdts" Jun 11 18:31:41.349809 ip-10-0-130-170 kubenswrapper[2565]: I0611 18:31:41.349534 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/41864c84-6359-4718-9e48-64baa8e95dbc-tmp\") pod \"insights-operator-5bbd86d6bd-xr2lr\" (UID: \"41864c84-6359-4718-9e48-64baa8e95dbc\") " pod="openshift-insights/insights-operator-5bbd86d6bd-xr2lr" Jun 11 18:31:41.349809 ip-10-0-130-170 kubenswrapper[2565]: I0611 18:31:41.349561 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/41864c84-6359-4718-9e48-64baa8e95dbc-serving-cert\") pod \"insights-operator-5bbd86d6bd-xr2lr\" (UID: \"41864c84-6359-4718-9e48-64baa8e95dbc\") " pod="openshift-insights/insights-operator-5bbd86d6bd-xr2lr" Jun 11 18:31:41.349809 ip-10-0-130-170 kubenswrapper[2565]: I0611 18:31:41.349584 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/1e5bc198-f331-4cbf-a556-b57063b26c89-samples-operator-tls\") pod \"cluster-samples-operator-9547488fd-z2lx7\" (UID: \"1e5bc198-f331-4cbf-a556-b57063b26c89\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-9547488fd-z2lx7" Jun 11 18:31:41.349809 ip-10-0-130-170 kubenswrapper[2565]: I0611 18:31:41.349639 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-kl8km\" (UniqueName: \"kubernetes.io/projected/3329f4b1-ac8c-4472-b6a0-13bb76075957-kube-api-access-kl8km\") pod \"console-operator-5dbbb5d744-vpdts\" (UID: \"3329f4b1-ac8c-4472-b6a0-13bb76075957\") " pod="openshift-console-operator/console-operator-5dbbb5d744-vpdts" Jun 11 18:31:41.349809 ip-10-0-130-170 kubenswrapper[2565]: I0611 18:31:41.349670 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-586xj\" (UniqueName: \"kubernetes.io/projected/7e07093b-14a2-45a2-ab61-8a88da306b9d-kube-api-access-586xj\") pod \"network-check-source-6947749cfc-8zxb4\" (UID: \"7e07093b-14a2-45a2-ab61-8a88da306b9d\") " pod="openshift-network-diagnostics/network-check-source-6947749cfc-8zxb4" Jun 11 18:31:41.349809 ip-10-0-130-170 kubenswrapper[2565]: I0611 18:31:41.349695 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/3329f4b1-ac8c-4472-b6a0-13bb76075957-serving-cert\") pod \"console-operator-5dbbb5d744-vpdts\" (UID: \"3329f4b1-ac8c-4472-b6a0-13bb76075957\") " pod="openshift-console-operator/console-operator-5dbbb5d744-vpdts" Jun 11 18:31:41.349809 ip-10-0-130-170 kubenswrapper[2565]: E0611 18:31:41.349729 2565 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found Jun 11 18:31:41.349809 ip-10-0-130-170 kubenswrapper[2565]: E0611 18:31:41.349800 2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/1e5bc198-f331-4cbf-a556-b57063b26c89-samples-operator-tls podName:1e5bc198-f331-4cbf-a556-b57063b26c89 nodeName:}" failed. No retries permitted until 2026-06-11 18:31:41.849779856 +0000 UTC m=+220.598465875 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/1e5bc198-f331-4cbf-a556-b57063b26c89-samples-operator-tls") pod "cluster-samples-operator-9547488fd-z2lx7" (UID: "1e5bc198-f331-4cbf-a556-b57063b26c89") : secret "samples-operator-tls" not found Jun 11 18:31:41.350186 ip-10-0-130-170 kubenswrapper[2565]: I0611 18:31:41.349837 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"snapshots\" (UniqueName: \"kubernetes.io/empty-dir/41864c84-6359-4718-9e48-64baa8e95dbc-snapshots\") pod \"insights-operator-5bbd86d6bd-xr2lr\" (UID: \"41864c84-6359-4718-9e48-64baa8e95dbc\") " pod="openshift-insights/insights-operator-5bbd86d6bd-xr2lr" Jun 11 18:31:41.350186 ip-10-0-130-170 kubenswrapper[2565]: I0611 18:31:41.349881 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/41864c84-6359-4718-9e48-64baa8e95dbc-tmp\") pod \"insights-operator-5bbd86d6bd-xr2lr\" (UID: \"41864c84-6359-4718-9e48-64baa8e95dbc\") " pod="openshift-insights/insights-operator-5bbd86d6bd-xr2lr" Jun 11 18:31:41.350186 ip-10-0-130-170 kubenswrapper[2565]: I0611 18:31:41.349906 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/41864c84-6359-4718-9e48-64baa8e95dbc-service-ca-bundle\") pod \"insights-operator-5bbd86d6bd-xr2lr\" (UID: \"41864c84-6359-4718-9e48-64baa8e95dbc\") " pod="openshift-insights/insights-operator-5bbd86d6bd-xr2lr" Jun 11 18:31:41.350186 ip-10-0-130-170 kubenswrapper[2565]: I0611 18:31:41.350004 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/3329f4b1-ac8c-4472-b6a0-13bb76075957-config\") pod \"console-operator-5dbbb5d744-vpdts\" (UID: \"3329f4b1-ac8c-4472-b6a0-13bb76075957\") " pod="openshift-console-operator/console-operator-5dbbb5d744-vpdts" Jun 11 18:31:41.350186 ip-10-0-130-170 kubenswrapper[2565]: I0611 18:31:41.350044 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/41864c84-6359-4718-9e48-64baa8e95dbc-trusted-ca-bundle\") pod \"insights-operator-5bbd86d6bd-xr2lr\" (UID: \"41864c84-6359-4718-9e48-64baa8e95dbc\") " pod="openshift-insights/insights-operator-5bbd86d6bd-xr2lr" Jun 11 18:31:41.350432 ip-10-0-130-170 kubenswrapper[2565]: I0611 18:31:41.350411 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"snapshots\" (UniqueName: \"kubernetes.io/empty-dir/41864c84-6359-4718-9e48-64baa8e95dbc-snapshots\") pod \"insights-operator-5bbd86d6bd-xr2lr\" (UID: \"41864c84-6359-4718-9e48-64baa8e95dbc\") " pod="openshift-insights/insights-operator-5bbd86d6bd-xr2lr" Jun 11 18:31:41.350464 ip-10-0-130-170 kubenswrapper[2565]: I0611 18:31:41.350433 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/41864c84-6359-4718-9e48-64baa8e95dbc-service-ca-bundle\") pod \"insights-operator-5bbd86d6bd-xr2lr\" (UID: \"41864c84-6359-4718-9e48-64baa8e95dbc\") " pod="openshift-insights/insights-operator-5bbd86d6bd-xr2lr" Jun 11 18:31:41.350706 ip-10-0-130-170 kubenswrapper[2565]: I0611 18:31:41.350689 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/41864c84-6359-4718-9e48-64baa8e95dbc-trusted-ca-bundle\") pod \"insights-operator-5bbd86d6bd-xr2lr\" (UID: \"41864c84-6359-4718-9e48-64baa8e95dbc\") " pod="openshift-insights/insights-operator-5bbd86d6bd-xr2lr" Jun 11 18:31:41.351968 ip-10-0-130-170 kubenswrapper[2565]: I0611 18:31:41.351947 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/41864c84-6359-4718-9e48-64baa8e95dbc-serving-cert\") pod \"insights-operator-5bbd86d6bd-xr2lr\" (UID: \"41864c84-6359-4718-9e48-64baa8e95dbc\") " pod="openshift-insights/insights-operator-5bbd86d6bd-xr2lr" Jun 11 18:31:41.372384 ip-10-0-130-170 kubenswrapper[2565]: I0611 18:31:41.372360 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-service-ca-operator/service-ca-operator-7ccbfd59dc-vtjsg" Jun 11 18:31:41.378959 ip-10-0-130-170 kubenswrapper[2565]: I0611 18:31:41.378931 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-m5sld\" (UniqueName: \"kubernetes.io/projected/1e5bc198-f331-4cbf-a556-b57063b26c89-kube-api-access-m5sld\") pod \"cluster-samples-operator-9547488fd-z2lx7\" (UID: \"1e5bc198-f331-4cbf-a556-b57063b26c89\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-9547488fd-z2lx7" Jun 11 18:31:41.379084 ip-10-0-130-170 kubenswrapper[2565]: I0611 18:31:41.379042 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-586xj\" (UniqueName: \"kubernetes.io/projected/7e07093b-14a2-45a2-ab61-8a88da306b9d-kube-api-access-586xj\") pod \"network-check-source-6947749cfc-8zxb4\" (UID: \"7e07093b-14a2-45a2-ab61-8a88da306b9d\") " pod="openshift-network-diagnostics/network-check-source-6947749cfc-8zxb4" Jun 11 18:31:41.379964 ip-10-0-130-170 kubenswrapper[2565]: I0611 18:31:41.379937 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-lvpq7\" (UniqueName: \"kubernetes.io/projected/41864c84-6359-4718-9e48-64baa8e95dbc-kube-api-access-lvpq7\") pod \"insights-operator-5bbd86d6bd-xr2lr\" (UID: \"41864c84-6359-4718-9e48-64baa8e95dbc\") " pod="openshift-insights/insights-operator-5bbd86d6bd-xr2lr" Jun 11 18:31:41.440778 ip-10-0-130-170 kubenswrapper[2565]: I0611 18:31:41.440748 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-operator-5bbd86d6bd-xr2lr" Jun 11 18:31:41.450766 ip-10-0-130-170 kubenswrapper[2565]: I0611 18:31:41.450737 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/3329f4b1-ac8c-4472-b6a0-13bb76075957-trusted-ca\") pod \"console-operator-5dbbb5d744-vpdts\" (UID: \"3329f4b1-ac8c-4472-b6a0-13bb76075957\") " pod="openshift-console-operator/console-operator-5dbbb5d744-vpdts" Jun 11 18:31:41.450884 ip-10-0-130-170 kubenswrapper[2565]: I0611 18:31:41.450802 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-kl8km\" (UniqueName: \"kubernetes.io/projected/3329f4b1-ac8c-4472-b6a0-13bb76075957-kube-api-access-kl8km\") pod \"console-operator-5dbbb5d744-vpdts\" (UID: \"3329f4b1-ac8c-4472-b6a0-13bb76075957\") " pod="openshift-console-operator/console-operator-5dbbb5d744-vpdts" Jun 11 18:31:41.450884 ip-10-0-130-170 kubenswrapper[2565]: I0611 18:31:41.450834 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/3329f4b1-ac8c-4472-b6a0-13bb76075957-serving-cert\") pod \"console-operator-5dbbb5d744-vpdts\" (UID: \"3329f4b1-ac8c-4472-b6a0-13bb76075957\") " pod="openshift-console-operator/console-operator-5dbbb5d744-vpdts" Jun 11 18:31:41.450986 ip-10-0-130-170 kubenswrapper[2565]: I0611 18:31:41.450897 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/3329f4b1-ac8c-4472-b6a0-13bb76075957-config\") pod \"console-operator-5dbbb5d744-vpdts\" (UID: \"3329f4b1-ac8c-4472-b6a0-13bb76075957\") " pod="openshift-console-operator/console-operator-5dbbb5d744-vpdts" Jun 11 18:31:41.451652 ip-10-0-130-170 kubenswrapper[2565]: I0611 18:31:41.451609 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/configmap/3329f4b1-ac8c-4472-b6a0-13bb76075957-config\") pod \"console-operator-5dbbb5d744-vpdts\" (UID: \"3329f4b1-ac8c-4472-b6a0-13bb76075957\") " pod="openshift-console-operator/console-operator-5dbbb5d744-vpdts" Jun 11 18:31:41.451757 ip-10-0-130-170 kubenswrapper[2565]: I0611 18:31:41.451692 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/3329f4b1-ac8c-4472-b6a0-13bb76075957-trusted-ca\") pod \"console-operator-5dbbb5d744-vpdts\" (UID: \"3329f4b1-ac8c-4472-b6a0-13bb76075957\") " pod="openshift-console-operator/console-operator-5dbbb5d744-vpdts" Jun 11 18:31:41.454954 ip-10-0-130-170 kubenswrapper[2565]: I0611 18:31:41.454931 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/3329f4b1-ac8c-4472-b6a0-13bb76075957-serving-cert\") pod \"console-operator-5dbbb5d744-vpdts\" (UID: \"3329f4b1-ac8c-4472-b6a0-13bb76075957\") " pod="openshift-console-operator/console-operator-5dbbb5d744-vpdts" Jun 11 18:31:41.481058 ip-10-0-130-170 kubenswrapper[2565]: I0611 18:31:41.481028 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-kl8km\" (UniqueName: \"kubernetes.io/projected/3329f4b1-ac8c-4472-b6a0-13bb76075957-kube-api-access-kl8km\") pod \"console-operator-5dbbb5d744-vpdts\" (UID: \"3329f4b1-ac8c-4472-b6a0-13bb76075957\") " pod="openshift-console-operator/console-operator-5dbbb5d744-vpdts" Jun 11 18:31:41.482836 ip-10-0-130-170 kubenswrapper[2565]: I0611 18:31:41.482811 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-source-6947749cfc-8zxb4" Jun 11 18:31:41.526449 ip-10-0-130-170 kubenswrapper[2565]: I0611 18:31:41.526353 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-service-ca-operator/service-ca-operator-7ccbfd59dc-vtjsg"] Jun 11 18:31:41.530140 ip-10-0-130-170 kubenswrapper[2565]: W0611 18:31:41.530098 2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6557afae_a8c6_4147_9f64_5c22cacf0d89.slice/crio-02a0a89d9513ec33ade5e6c467392ba14251eed7f64bfc1600e830334b2ef7b3 WatchSource:0}: Error finding container 02a0a89d9513ec33ade5e6c467392ba14251eed7f64bfc1600e830334b2ef7b3: Status 404 returned error can't find the container with id 02a0a89d9513ec33ade5e6c467392ba14251eed7f64bfc1600e830334b2ef7b3 Jun 11 18:31:41.580418 ip-10-0-130-170 kubenswrapper[2565]: I0611 18:31:41.580383 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-operator-5bbd86d6bd-xr2lr"] Jun 11 18:31:41.583226 ip-10-0-130-170 kubenswrapper[2565]: W0611 18:31:41.583191 2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod41864c84_6359_4718_9e48_64baa8e95dbc.slice/crio-0b6b220abba146a433e22df631ddac4f4a52cae29550d26728ab257f098b8062 WatchSource:0}: Error finding container 0b6b220abba146a433e22df631ddac4f4a52cae29550d26728ab257f098b8062: Status 404 returned error can't find the container with id 0b6b220abba146a433e22df631ddac4f4a52cae29550d26728ab257f098b8062 Jun 11 18:31:41.584661 ip-10-0-130-170 kubenswrapper[2565]: I0611 18:31:41.584634 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console-operator/console-operator-5dbbb5d744-vpdts" Jun 11 18:31:41.626137 ip-10-0-130-170 kubenswrapper[2565]: I0611 18:31:41.625981 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-source-6947749cfc-8zxb4"] Jun 11 18:31:41.628555 ip-10-0-130-170 kubenswrapper[2565]: W0611 18:31:41.628532 2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7e07093b_14a2_45a2_ab61_8a88da306b9d.slice/crio-060be35e3a05e2869c8dfc0d1eca481c6106bb9434da536ba7c0e45a0247963c WatchSource:0}: Error finding container 060be35e3a05e2869c8dfc0d1eca481c6106bb9434da536ba7c0e45a0247963c: Status 404 returned error can't find the container with id 060be35e3a05e2869c8dfc0d1eca481c6106bb9434da536ba7c0e45a0247963c Jun 11 18:31:41.714091 ip-10-0-130-170 kubenswrapper[2565]: I0611 18:31:41.714063 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console-operator/console-operator-5dbbb5d744-vpdts"] Jun 11 18:31:41.717361 ip-10-0-130-170 kubenswrapper[2565]: W0611 18:31:41.717328 2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3329f4b1_ac8c_4472_b6a0_13bb76075957.slice/crio-3925a9ee58834e13992ede8e77d1b63a178dfecd5af284c5fdc992141b60218e WatchSource:0}: Error finding container 3925a9ee58834e13992ede8e77d1b63a178dfecd5af284c5fdc992141b60218e: Status 404 returned error can't find the container with id 3925a9ee58834e13992ede8e77d1b63a178dfecd5af284c5fdc992141b60218e Jun 11 18:31:41.752839 ip-10-0-130-170 kubenswrapper[2565]: I0611 18:31:41.752810 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/d9d950d8-2c16-43ec-a77c-8c0b870f52e6-networking-console-plugin-cert\") pod \"networking-console-plugin-867b76cb74-mbzpt\" (UID: \"d9d950d8-2c16-43ec-a77c-8c0b870f52e6\") " pod="openshift-network-console/networking-console-plugin-867b76cb74-mbzpt" Jun 11 18:31:41.752989 ip-10-0-130-170 kubenswrapper[2565]: E0611 18:31:41.752950 2565 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found Jun 11 18:31:41.753036 ip-10-0-130-170 kubenswrapper[2565]: E0611 18:31:41.753007 2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d9d950d8-2c16-43ec-a77c-8c0b870f52e6-networking-console-plugin-cert podName:d9d950d8-2c16-43ec-a77c-8c0b870f52e6 nodeName:}" failed. No retries permitted until 2026-06-11 18:31:42.752994313 +0000 UTC m=+221.501680312 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/d9d950d8-2c16-43ec-a77c-8c0b870f52e6-networking-console-plugin-cert") pod "networking-console-plugin-867b76cb74-mbzpt" (UID: "d9d950d8-2c16-43ec-a77c-8c0b870f52e6") : secret "networking-console-plugin-cert" not found Jun 11 18:31:41.853907 ip-10-0-130-170 kubenswrapper[2565]: I0611 18:31:41.853871 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/1e5bc198-f331-4cbf-a556-b57063b26c89-samples-operator-tls\") pod \"cluster-samples-operator-9547488fd-z2lx7\" (UID: \"1e5bc198-f331-4cbf-a556-b57063b26c89\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-9547488fd-z2lx7" Jun 11 18:31:41.854096 ip-10-0-130-170 kubenswrapper[2565]: E0611 18:31:41.854020 2565 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found Jun 11 18:31:41.854096 ip-10-0-130-170 kubenswrapper[2565]: E0611 18:31:41.854083 2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/1e5bc198-f331-4cbf-a556-b57063b26c89-samples-operator-tls podName:1e5bc198-f331-4cbf-a556-b57063b26c89 nodeName:}" failed. No retries permitted until 2026-06-11 18:31:42.854067931 +0000 UTC m=+221.602753933 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/1e5bc198-f331-4cbf-a556-b57063b26c89-samples-operator-tls") pod "cluster-samples-operator-9547488fd-z2lx7" (UID: "1e5bc198-f331-4cbf-a556-b57063b26c89") : secret "samples-operator-tls" not found Jun 11 18:31:42.388032 ip-10-0-130-170 kubenswrapper[2565]: I0611 18:31:42.387998 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-5dbbb5d744-vpdts" event={"ID":"3329f4b1-ac8c-4472-b6a0-13bb76075957","Type":"ContainerStarted","Data":"3925a9ee58834e13992ede8e77d1b63a178dfecd5af284c5fdc992141b60218e"} Jun 11 18:31:42.389458 ip-10-0-130-170 kubenswrapper[2565]: I0611 18:31:42.389435 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-source-6947749cfc-8zxb4" event={"ID":"7e07093b-14a2-45a2-ab61-8a88da306b9d","Type":"ContainerStarted","Data":"f9b1c715e38099bc0ccaec6e59ac7573c135ea17bd941bed22741876f6c87685"} Jun 11 18:31:42.389588 ip-10-0-130-170 kubenswrapper[2565]: I0611 18:31:42.389472 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-source-6947749cfc-8zxb4" event={"ID":"7e07093b-14a2-45a2-ab61-8a88da306b9d","Type":"ContainerStarted","Data":"060be35e3a05e2869c8dfc0d1eca481c6106bb9434da536ba7c0e45a0247963c"} Jun 11 18:31:42.390564 ip-10-0-130-170 kubenswrapper[2565]: I0611 18:31:42.390542 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-operator-5bbd86d6bd-xr2lr" event={"ID":"41864c84-6359-4718-9e48-64baa8e95dbc","Type":"ContainerStarted","Data":"0b6b220abba146a433e22df631ddac4f4a52cae29550d26728ab257f098b8062"} Jun 11 18:31:42.391527 ip-10-0-130-170 kubenswrapper[2565]: I0611 18:31:42.391508 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca-operator/service-ca-operator-7ccbfd59dc-vtjsg" event={"ID":"6557afae-a8c6-4147-9f64-5c22cacf0d89","Type":"ContainerStarted","Data":"02a0a89d9513ec33ade5e6c467392ba14251eed7f64bfc1600e830334b2ef7b3"} Jun 11 18:31:42.406528 ip-10-0-130-170 kubenswrapper[2565]: I0611 18:31:42.406481 2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-diagnostics/network-check-source-6947749cfc-8zxb4" podStartSLOduration=1.406465645 podStartE2EDuration="1.406465645s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-11 18:31:41 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-11 18:31:42.405272816 +0000 UTC m=+221.153958854" watchObservedRunningTime="2026-06-11 18:31:42.406465645 +0000 UTC m=+221.155151692" Jun 11 18:31:42.763162 ip-10-0-130-170 kubenswrapper[2565]: I0611 18:31:42.763076 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/d9d950d8-2c16-43ec-a77c-8c0b870f52e6-networking-console-plugin-cert\") pod \"networking-console-plugin-867b76cb74-mbzpt\" (UID: \"d9d950d8-2c16-43ec-a77c-8c0b870f52e6\") " pod="openshift-network-console/networking-console-plugin-867b76cb74-mbzpt" Jun 11 18:31:42.763357 ip-10-0-130-170 kubenswrapper[2565]: E0611 18:31:42.763295 2565 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found Jun 11 18:31:42.763357 ip-10-0-130-170 kubenswrapper[2565]: E0611 18:31:42.763357 2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d9d950d8-2c16-43ec-a77c-8c0b870f52e6-networking-console-plugin-cert podName:d9d950d8-2c16-43ec-a77c-8c0b870f52e6 nodeName:}" failed. No retries permitted until 2026-06-11 18:31:44.763338768 +0000 UTC m=+223.512024783 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/d9d950d8-2c16-43ec-a77c-8c0b870f52e6-networking-console-plugin-cert") pod "networking-console-plugin-867b76cb74-mbzpt" (UID: "d9d950d8-2c16-43ec-a77c-8c0b870f52e6") : secret "networking-console-plugin-cert" not found Jun 11 18:31:42.864275 ip-10-0-130-170 kubenswrapper[2565]: I0611 18:31:42.864210 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/1e5bc198-f331-4cbf-a556-b57063b26c89-samples-operator-tls\") pod \"cluster-samples-operator-9547488fd-z2lx7\" (UID: \"1e5bc198-f331-4cbf-a556-b57063b26c89\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-9547488fd-z2lx7" Jun 11 18:31:42.864463 ip-10-0-130-170 kubenswrapper[2565]: E0611 18:31:42.864404 2565 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found Jun 11 18:31:42.864545 ip-10-0-130-170 kubenswrapper[2565]: E0611 18:31:42.864477 2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/1e5bc198-f331-4cbf-a556-b57063b26c89-samples-operator-tls podName:1e5bc198-f331-4cbf-a556-b57063b26c89 nodeName:}" failed. No retries permitted until 2026-06-11 18:31:44.864456621 +0000 UTC m=+223.613142626 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/1e5bc198-f331-4cbf-a556-b57063b26c89-samples-operator-tls") pod "cluster-samples-operator-9547488fd-z2lx7" (UID: "1e5bc198-f331-4cbf-a556-b57063b26c89") : secret "samples-operator-tls" not found Jun 11 18:31:44.780609 ip-10-0-130-170 kubenswrapper[2565]: I0611 18:31:44.780569 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/d9d950d8-2c16-43ec-a77c-8c0b870f52e6-networking-console-plugin-cert\") pod \"networking-console-plugin-867b76cb74-mbzpt\" (UID: \"d9d950d8-2c16-43ec-a77c-8c0b870f52e6\") " pod="openshift-network-console/networking-console-plugin-867b76cb74-mbzpt" Jun 11 18:31:44.781070 ip-10-0-130-170 kubenswrapper[2565]: E0611 18:31:44.780718 2565 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found Jun 11 18:31:44.781070 ip-10-0-130-170 kubenswrapper[2565]: E0611 18:31:44.780794 2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d9d950d8-2c16-43ec-a77c-8c0b870f52e6-networking-console-plugin-cert podName:d9d950d8-2c16-43ec-a77c-8c0b870f52e6 nodeName:}" failed. No retries permitted until 2026-06-11 18:31:48.780771959 +0000 UTC m=+227.529457959 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/d9d950d8-2c16-43ec-a77c-8c0b870f52e6-networking-console-plugin-cert") pod "networking-console-plugin-867b76cb74-mbzpt" (UID: "d9d950d8-2c16-43ec-a77c-8c0b870f52e6") : secret "networking-console-plugin-cert" not found Jun 11 18:31:44.881217 ip-10-0-130-170 kubenswrapper[2565]: I0611 18:31:44.881186 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/1e5bc198-f331-4cbf-a556-b57063b26c89-samples-operator-tls\") pod \"cluster-samples-operator-9547488fd-z2lx7\" (UID: \"1e5bc198-f331-4cbf-a556-b57063b26c89\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-9547488fd-z2lx7" Jun 11 18:31:44.881414 ip-10-0-130-170 kubenswrapper[2565]: E0611 18:31:44.881374 2565 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found Jun 11 18:31:44.881482 ip-10-0-130-170 kubenswrapper[2565]: E0611 18:31:44.881454 2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/1e5bc198-f331-4cbf-a556-b57063b26c89-samples-operator-tls podName:1e5bc198-f331-4cbf-a556-b57063b26c89 nodeName:}" failed. No retries permitted until 2026-06-11 18:31:48.881433714 +0000 UTC m=+227.630119727 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/1e5bc198-f331-4cbf-a556-b57063b26c89-samples-operator-tls") pod "cluster-samples-operator-9547488fd-z2lx7" (UID: "1e5bc198-f331-4cbf-a556-b57063b26c89") : secret "samples-operator-tls" not found Jun 11 18:31:45.407022 ip-10-0-130-170 kubenswrapper[2565]: I0611 18:31:45.406990 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-5dbbb5d744-vpdts_3329f4b1-ac8c-4472-b6a0-13bb76075957/console-operator/0.log" Jun 11 18:31:45.407163 ip-10-0-130-170 kubenswrapper[2565]: I0611 18:31:45.407039 2565 generic.go:356] "Generic (PLEG): container finished" podID="3329f4b1-ac8c-4472-b6a0-13bb76075957" containerID="8ba0d5e483d030ea08cff87e3370894075ef52c52d267d77c36265d8ff137348" exitCode=255 Jun 11 18:31:45.407163 ip-10-0-130-170 kubenswrapper[2565]: I0611 18:31:45.407128 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-5dbbb5d744-vpdts" event={"ID":"3329f4b1-ac8c-4472-b6a0-13bb76075957","Type":"ContainerDied","Data":"8ba0d5e483d030ea08cff87e3370894075ef52c52d267d77c36265d8ff137348"} Jun 11 18:31:45.407402 ip-10-0-130-170 kubenswrapper[2565]: I0611 18:31:45.407375 2565 scope.go:117] "RemoveContainer" containerID="8ba0d5e483d030ea08cff87e3370894075ef52c52d267d77c36265d8ff137348" Jun 11 18:31:45.408895 ip-10-0-130-170 kubenswrapper[2565]: I0611 18:31:45.408873 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-operator-5bbd86d6bd-xr2lr" event={"ID":"41864c84-6359-4718-9e48-64baa8e95dbc","Type":"ContainerStarted","Data":"6a4da90b388ae1deb163c14e758e26ef08e4bcbe90fa787a5bd089744308824c"} Jun 11 18:31:45.410436 ip-10-0-130-170 kubenswrapper[2565]: I0611 18:31:45.410414 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca-operator/service-ca-operator-7ccbfd59dc-vtjsg" event={"ID":"6557afae-a8c6-4147-9f64-5c22cacf0d89","Type":"ContainerStarted","Data":"33f6cd061140f9bb4805995a151054618e06d659fed0b5fce73cebb2c9ab75ff"} Jun 11 18:31:45.441423 ip-10-0-130-170 kubenswrapper[2565]: I0611 18:31:45.441372 2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-insights/insights-operator-5bbd86d6bd-xr2lr" podStartSLOduration=1.110827111 podStartE2EDuration="4.441356253s" totalImagesPullingTime="3.330529142s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-11 18:31:41 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-11 18:31:45.440281457 +0000 UTC m=+224.188967479" watchObservedRunningTime="2026-06-11 18:31:45.441356253 +0000 UTC m=+224.190042275" Jun 11 18:31:45.455397 ip-10-0-130-170 kubenswrapper[2565]: I0611 18:31:45.455349 2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-service-ca-operator/service-ca-operator-7ccbfd59dc-vtjsg" podStartSLOduration=1.080253536 podStartE2EDuration="4.455332375s" totalImagesPullingTime="3.375078839s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-11 18:31:41 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-11 18:31:45.454362549 +0000 UTC m=+224.203048570" watchObservedRunningTime="2026-06-11 18:31:45.455332375 +0000 UTC m=+224.204018396" Jun 11 18:31:45.878890 ip-10-0-130-170 kubenswrapper[2565]: I0611 18:31:45.878861 2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-kube-storage-version-migrator/migrator-d4bcd4867-mrrwt"] Jun 11 18:31:45.881175 ip-10-0-130-170 kubenswrapper[2565]: I0611 18:31:45.881159 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-storage-version-migrator/migrator-d4bcd4867-mrrwt" Jun 11 18:31:45.883962 ip-10-0-130-170 kubenswrapper[2565]: I0611 18:31:45.883932 2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator\"/\"openshift-service-ca.crt\"" Jun 11 18:31:45.884082 ip-10-0-130-170 kubenswrapper[2565]: I0611 18:31:45.883996 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-kube-storage-version-migrator\"/\"kube-storage-version-migrator-sa-dockercfg-fq4wz\"" Jun 11 18:31:45.884145 ip-10-0-130-170 kubenswrapper[2565]: I0611 18:31:45.884097 2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator\"/\"kube-root-ca.crt\"" Jun 11 18:31:45.891685 ip-10-0-130-170 kubenswrapper[2565]: I0611 18:31:45.891656 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-kube-storage-version-migrator/migrator-d4bcd4867-mrrwt"] Jun 11 18:31:45.989987 ip-10-0-130-170 kubenswrapper[2565]: I0611 18:31:45.989952 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-cdtcr\" (UniqueName: \"kubernetes.io/projected/419b22af-d1e6-4c34-a8ee-caefea3daa6f-kube-api-access-cdtcr\") pod \"migrator-d4bcd4867-mrrwt\" (UID: \"419b22af-d1e6-4c34-a8ee-caefea3daa6f\") " pod="openshift-kube-storage-version-migrator/migrator-d4bcd4867-mrrwt" Jun 11 18:31:46.066582 ip-10-0-130-170 kubenswrapper[2565]: I0611 18:31:46.066539 2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-insights/insights-runtime-extractor-ncmzq"] Jun 11 18:31:46.069098 ip-10-0-130-170 kubenswrapper[2565]: I0611 18:31:46.069074 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-ncmzq" Jun 11 18:31:46.071678 ip-10-0-130-170 kubenswrapper[2565]: I0611 18:31:46.071615 2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-rbac-proxy\"" Jun 11 18:31:46.071678 ip-10-0-130-170 kubenswrapper[2565]: I0611 18:31:46.071656 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-tls\"" Jun 11 18:31:46.071888 ip-10-0-130-170 kubenswrapper[2565]: I0611 18:31:46.071656 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-sa-dockercfg-rrdf4\"" Jun 11 18:31:46.080601 ip-10-0-130-170 kubenswrapper[2565]: I0611 18:31:46.080568 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-ncmzq"] Jun 11 18:31:46.090757 ip-10-0-130-170 kubenswrapper[2565]: I0611 18:31:46.090728 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-cdtcr\" (UniqueName: \"kubernetes.io/projected/419b22af-d1e6-4c34-a8ee-caefea3daa6f-kube-api-access-cdtcr\") pod \"migrator-d4bcd4867-mrrwt\" (UID: \"419b22af-d1e6-4c34-a8ee-caefea3daa6f\") " pod="openshift-kube-storage-version-migrator/migrator-d4bcd4867-mrrwt" Jun 11 18:31:46.102992 ip-10-0-130-170 kubenswrapper[2565]: I0611 18:31:46.102970 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-cdtcr\" (UniqueName: \"kubernetes.io/projected/419b22af-d1e6-4c34-a8ee-caefea3daa6f-kube-api-access-cdtcr\") pod \"migrator-d4bcd4867-mrrwt\" (UID: \"419b22af-d1e6-4c34-a8ee-caefea3daa6f\") " pod="openshift-kube-storage-version-migrator/migrator-d4bcd4867-mrrwt" Jun 11 18:31:46.190375 ip-10-0-130-170 kubenswrapper[2565]: I0611 18:31:46.190292 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-storage-version-migrator/migrator-d4bcd4867-mrrwt" Jun 11 18:31:46.191519 ip-10-0-130-170 kubenswrapper[2565]: I0611 18:31:46.191490 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/8bcf15d4-27a3-4749-9e68-ba74ffb6004a-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-ncmzq\" (UID: \"8bcf15d4-27a3-4749-9e68-ba74ffb6004a\") " pod="openshift-insights/insights-runtime-extractor-ncmzq" Jun 11 18:31:46.191614 ip-10-0-130-170 kubenswrapper[2565]: I0611 18:31:46.191563 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/8bcf15d4-27a3-4749-9e68-ba74ffb6004a-crio-socket\") pod \"insights-runtime-extractor-ncmzq\" (UID: \"8bcf15d4-27a3-4749-9e68-ba74ffb6004a\") " pod="openshift-insights/insights-runtime-extractor-ncmzq" Jun 11 18:31:46.191614 ip-10-0-130-170 kubenswrapper[2565]: I0611 18:31:46.191589 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/8bcf15d4-27a3-4749-9e68-ba74ffb6004a-data-volume\") pod \"insights-runtime-extractor-ncmzq\" (UID: \"8bcf15d4-27a3-4749-9e68-ba74ffb6004a\") " pod="openshift-insights/insights-runtime-extractor-ncmzq" Jun 11 18:31:46.191689 ip-10-0-130-170 kubenswrapper[2565]: I0611 18:31:46.191621 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ql52w\" (UniqueName: \"kubernetes.io/projected/8bcf15d4-27a3-4749-9e68-ba74ffb6004a-kube-api-access-ql52w\") pod \"insights-runtime-extractor-ncmzq\" (UID: \"8bcf15d4-27a3-4749-9e68-ba74ffb6004a\") " pod="openshift-insights/insights-runtime-extractor-ncmzq" Jun 11 18:31:46.191722 ip-10-0-130-170 kubenswrapper[2565]: I0611 18:31:46.191692 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/8bcf15d4-27a3-4749-9e68-ba74ffb6004a-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-ncmzq\" (UID: \"8bcf15d4-27a3-4749-9e68-ba74ffb6004a\") " pod="openshift-insights/insights-runtime-extractor-ncmzq" Jun 11 18:31:46.292812 ip-10-0-130-170 kubenswrapper[2565]: I0611 18:31:46.292778 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/8bcf15d4-27a3-4749-9e68-ba74ffb6004a-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-ncmzq\" (UID: \"8bcf15d4-27a3-4749-9e68-ba74ffb6004a\") " pod="openshift-insights/insights-runtime-extractor-ncmzq" Jun 11 18:31:46.292971 ip-10-0-130-170 kubenswrapper[2565]: I0611 18:31:46.292826 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/8bcf15d4-27a3-4749-9e68-ba74ffb6004a-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-ncmzq\" (UID: \"8bcf15d4-27a3-4749-9e68-ba74ffb6004a\") " pod="openshift-insights/insights-runtime-extractor-ncmzq" Jun 11 18:31:46.292971 ip-10-0-130-170 kubenswrapper[2565]: E0611 18:31:46.292907 2565 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found Jun 11 18:31:46.292971 ip-10-0-130-170 kubenswrapper[2565]: E0611 18:31:46.292934 2565 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Jun 11 18:31:46.292971 ip-10-0-130-170 kubenswrapper[2565]: E0611 18:31:46.292965 2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/8bcf15d4-27a3-4749-9e68-ba74ffb6004a-kube-rbac-proxy-cm podName:8bcf15d4-27a3-4749-9e68-ba74ffb6004a nodeName:}" failed. No retries permitted until 2026-06-11 18:31:46.792947766 +0000 UTC m=+225.541633766 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/8bcf15d4-27a3-4749-9e68-ba74ffb6004a-kube-rbac-proxy-cm") pod "insights-runtime-extractor-ncmzq" (UID: "8bcf15d4-27a3-4749-9e68-ba74ffb6004a") : configmap "kube-rbac-proxy" not found Jun 11 18:31:46.293180 ip-10-0-130-170 kubenswrapper[2565]: E0611 18:31:46.292996 2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/8bcf15d4-27a3-4749-9e68-ba74ffb6004a-insights-runtime-extractor-tls podName:8bcf15d4-27a3-4749-9e68-ba74ffb6004a nodeName:}" failed. No retries permitted until 2026-06-11 18:31:46.792978194 +0000 UTC m=+225.541664194 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/8bcf15d4-27a3-4749-9e68-ba74ffb6004a-insights-runtime-extractor-tls") pod "insights-runtime-extractor-ncmzq" (UID: "8bcf15d4-27a3-4749-9e68-ba74ffb6004a") : secret "insights-runtime-extractor-tls" not found Jun 11 18:31:46.293180 ip-10-0-130-170 kubenswrapper[2565]: I0611 18:31:46.293060 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/8bcf15d4-27a3-4749-9e68-ba74ffb6004a-crio-socket\") pod \"insights-runtime-extractor-ncmzq\" (UID: \"8bcf15d4-27a3-4749-9e68-ba74ffb6004a\") " pod="openshift-insights/insights-runtime-extractor-ncmzq" Jun 11 18:31:46.293180 ip-10-0-130-170 kubenswrapper[2565]: I0611 18:31:46.293087 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/8bcf15d4-27a3-4749-9e68-ba74ffb6004a-data-volume\") pod \"insights-runtime-extractor-ncmzq\" (UID: \"8bcf15d4-27a3-4749-9e68-ba74ffb6004a\") " pod="openshift-insights/insights-runtime-extractor-ncmzq" Jun 11 18:31:46.293180 ip-10-0-130-170 kubenswrapper[2565]: I0611 18:31:46.293124 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ql52w\" (UniqueName: \"kubernetes.io/projected/8bcf15d4-27a3-4749-9e68-ba74ffb6004a-kube-api-access-ql52w\") pod \"insights-runtime-extractor-ncmzq\" (UID: \"8bcf15d4-27a3-4749-9e68-ba74ffb6004a\") " pod="openshift-insights/insights-runtime-extractor-ncmzq" Jun 11 18:31:46.293180 ip-10-0-130-170 kubenswrapper[2565]: I0611 18:31:46.293169 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/8bcf15d4-27a3-4749-9e68-ba74ffb6004a-crio-socket\") pod \"insights-runtime-extractor-ncmzq\" (UID: \"8bcf15d4-27a3-4749-9e68-ba74ffb6004a\") " pod="openshift-insights/insights-runtime-extractor-ncmzq" Jun 11 18:31:46.293509 ip-10-0-130-170 kubenswrapper[2565]: I0611 18:31:46.293489 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/8bcf15d4-27a3-4749-9e68-ba74ffb6004a-data-volume\") pod \"insights-runtime-extractor-ncmzq\" (UID: \"8bcf15d4-27a3-4749-9e68-ba74ffb6004a\") " pod="openshift-insights/insights-runtime-extractor-ncmzq" Jun 11 18:31:46.301694 ip-10-0-130-170 kubenswrapper[2565]: I0611 18:31:46.301673 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-ql52w\" (UniqueName: \"kubernetes.io/projected/8bcf15d4-27a3-4749-9e68-ba74ffb6004a-kube-api-access-ql52w\") pod \"insights-runtime-extractor-ncmzq\" (UID: \"8bcf15d4-27a3-4749-9e68-ba74ffb6004a\") " pod="openshift-insights/insights-runtime-extractor-ncmzq" Jun 11 18:31:46.318692 ip-10-0-130-170 kubenswrapper[2565]: I0611 18:31:46.318663 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-kube-storage-version-migrator/migrator-d4bcd4867-mrrwt"] Jun 11 18:31:46.321130 ip-10-0-130-170 kubenswrapper[2565]: W0611 18:31:46.321106 2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod419b22af_d1e6_4c34_a8ee_caefea3daa6f.slice/crio-b6e92fc695cd5764e2876dc4dfa3965118b69b731fb0d18f857660457b97fc0d WatchSource:0}: Error finding container b6e92fc695cd5764e2876dc4dfa3965118b69b731fb0d18f857660457b97fc0d: Status 404 returned error can't find the container with id b6e92fc695cd5764e2876dc4dfa3965118b69b731fb0d18f857660457b97fc0d Jun 11 18:31:46.414958 ip-10-0-130-170 kubenswrapper[2565]: I0611 18:31:46.414930 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-5dbbb5d744-vpdts_3329f4b1-ac8c-4472-b6a0-13bb76075957/console-operator/1.log" Jun 11 18:31:46.415370 ip-10-0-130-170 kubenswrapper[2565]: I0611 18:31:46.415353 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-5dbbb5d744-vpdts_3329f4b1-ac8c-4472-b6a0-13bb76075957/console-operator/0.log" Jun 11 18:31:46.415437 ip-10-0-130-170 kubenswrapper[2565]: I0611 18:31:46.415389 2565 generic.go:356] "Generic (PLEG): container finished" podID="3329f4b1-ac8c-4472-b6a0-13bb76075957" containerID="4e3c0c0aadd7680a9c0cc09900b1289f42bfbf293465197dd0a61bdc33969a82" exitCode=255 Jun 11 18:31:46.415515 ip-10-0-130-170 kubenswrapper[2565]: I0611 18:31:46.415490 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-5dbbb5d744-vpdts" event={"ID":"3329f4b1-ac8c-4472-b6a0-13bb76075957","Type":"ContainerDied","Data":"4e3c0c0aadd7680a9c0cc09900b1289f42bfbf293465197dd0a61bdc33969a82"} Jun 11 18:31:46.415593 ip-10-0-130-170 kubenswrapper[2565]: I0611 18:31:46.415559 2565 scope.go:117] "RemoveContainer" containerID="8ba0d5e483d030ea08cff87e3370894075ef52c52d267d77c36265d8ff137348" Jun 11 18:31:46.415756 ip-10-0-130-170 kubenswrapper[2565]: I0611 18:31:46.415734 2565 scope.go:117] "RemoveContainer" containerID="4e3c0c0aadd7680a9c0cc09900b1289f42bfbf293465197dd0a61bdc33969a82" Jun 11 18:31:46.415957 ip-10-0-130-170 kubenswrapper[2565]: E0611 18:31:46.415934 2565 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"console-operator\" with CrashLoopBackOff: \"back-off 10s restarting failed container=console-operator pod=console-operator-5dbbb5d744-vpdts_openshift-console-operator(3329f4b1-ac8c-4472-b6a0-13bb76075957)\"" pod="openshift-console-operator/console-operator-5dbbb5d744-vpdts" podUID="3329f4b1-ac8c-4472-b6a0-13bb76075957" Jun 11 18:31:46.416832 ip-10-0-130-170 kubenswrapper[2565]: I0611 18:31:46.416700 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator/migrator-d4bcd4867-mrrwt" event={"ID":"419b22af-d1e6-4c34-a8ee-caefea3daa6f","Type":"ContainerStarted","Data":"b6e92fc695cd5764e2876dc4dfa3965118b69b731fb0d18f857660457b97fc0d"} Jun 11 18:31:46.797414 ip-10-0-130-170 kubenswrapper[2565]: I0611 18:31:46.797378 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/8bcf15d4-27a3-4749-9e68-ba74ffb6004a-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-ncmzq\" (UID: \"8bcf15d4-27a3-4749-9e68-ba74ffb6004a\") " pod="openshift-insights/insights-runtime-extractor-ncmzq" Jun 11 18:31:46.797414 ip-10-0-130-170 kubenswrapper[2565]: I0611 18:31:46.797416 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/8bcf15d4-27a3-4749-9e68-ba74ffb6004a-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-ncmzq\" (UID: \"8bcf15d4-27a3-4749-9e68-ba74ffb6004a\") " pod="openshift-insights/insights-runtime-extractor-ncmzq" Jun 11 18:31:46.797620 ip-10-0-130-170 kubenswrapper[2565]: E0611 18:31:46.797499 2565 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found Jun 11 18:31:46.797620 ip-10-0-130-170 kubenswrapper[2565]: E0611 18:31:46.797524 2565 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Jun 11 18:31:46.797620 ip-10-0-130-170 kubenswrapper[2565]: E0611 18:31:46.797549 2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/8bcf15d4-27a3-4749-9e68-ba74ffb6004a-kube-rbac-proxy-cm podName:8bcf15d4-27a3-4749-9e68-ba74ffb6004a nodeName:}" failed. No retries permitted until 2026-06-11 18:31:47.797536189 +0000 UTC m=+226.546222189 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/8bcf15d4-27a3-4749-9e68-ba74ffb6004a-kube-rbac-proxy-cm") pod "insights-runtime-extractor-ncmzq" (UID: "8bcf15d4-27a3-4749-9e68-ba74ffb6004a") : configmap "kube-rbac-proxy" not found Jun 11 18:31:46.797620 ip-10-0-130-170 kubenswrapper[2565]: E0611 18:31:46.797584 2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/8bcf15d4-27a3-4749-9e68-ba74ffb6004a-insights-runtime-extractor-tls podName:8bcf15d4-27a3-4749-9e68-ba74ffb6004a nodeName:}" failed. No retries permitted until 2026-06-11 18:31:47.797569727 +0000 UTC m=+226.546255730 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/8bcf15d4-27a3-4749-9e68-ba74ffb6004a-insights-runtime-extractor-tls") pod "insights-runtime-extractor-ncmzq" (UID: "8bcf15d4-27a3-4749-9e68-ba74ffb6004a") : secret "insights-runtime-extractor-tls" not found Jun 11 18:31:47.422239 ip-10-0-130-170 kubenswrapper[2565]: I0611 18:31:47.422211 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-5dbbb5d744-vpdts_3329f4b1-ac8c-4472-b6a0-13bb76075957/console-operator/1.log" Jun 11 18:31:47.422675 ip-10-0-130-170 kubenswrapper[2565]: I0611 18:31:47.422636 2565 scope.go:117] "RemoveContainer" containerID="4e3c0c0aadd7680a9c0cc09900b1289f42bfbf293465197dd0a61bdc33969a82" Jun 11 18:31:47.422836 ip-10-0-130-170 kubenswrapper[2565]: E0611 18:31:47.422817 2565 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"console-operator\" with CrashLoopBackOff: \"back-off 10s restarting failed container=console-operator pod=console-operator-5dbbb5d744-vpdts_openshift-console-operator(3329f4b1-ac8c-4472-b6a0-13bb76075957)\"" pod="openshift-console-operator/console-operator-5dbbb5d744-vpdts" podUID="3329f4b1-ac8c-4472-b6a0-13bb76075957" Jun 11 18:31:47.804751 ip-10-0-130-170 kubenswrapper[2565]: I0611 18:31:47.804651 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/8bcf15d4-27a3-4749-9e68-ba74ffb6004a-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-ncmzq\" (UID: \"8bcf15d4-27a3-4749-9e68-ba74ffb6004a\") " pod="openshift-insights/insights-runtime-extractor-ncmzq" Jun 11 18:31:47.805032 ip-10-0-130-170 kubenswrapper[2565]: I0611 18:31:47.804777 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/8bcf15d4-27a3-4749-9e68-ba74ffb6004a-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-ncmzq\" (UID: \"8bcf15d4-27a3-4749-9e68-ba74ffb6004a\") " pod="openshift-insights/insights-runtime-extractor-ncmzq" Jun 11 18:31:47.805032 ip-10-0-130-170 kubenswrapper[2565]: E0611 18:31:47.804775 2565 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found Jun 11 18:31:47.805032 ip-10-0-130-170 kubenswrapper[2565]: E0611 18:31:47.804857 2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/8bcf15d4-27a3-4749-9e68-ba74ffb6004a-kube-rbac-proxy-cm podName:8bcf15d4-27a3-4749-9e68-ba74ffb6004a nodeName:}" failed. No retries permitted until 2026-06-11 18:31:49.804835549 +0000 UTC m=+228.553521549 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/8bcf15d4-27a3-4749-9e68-ba74ffb6004a-kube-rbac-proxy-cm") pod "insights-runtime-extractor-ncmzq" (UID: "8bcf15d4-27a3-4749-9e68-ba74ffb6004a") : configmap "kube-rbac-proxy" not found Jun 11 18:31:47.805032 ip-10-0-130-170 kubenswrapper[2565]: E0611 18:31:47.804869 2565 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Jun 11 18:31:47.805032 ip-10-0-130-170 kubenswrapper[2565]: E0611 18:31:47.804907 2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/8bcf15d4-27a3-4749-9e68-ba74ffb6004a-insights-runtime-extractor-tls podName:8bcf15d4-27a3-4749-9e68-ba74ffb6004a nodeName:}" failed. No retries permitted until 2026-06-11 18:31:49.804896518 +0000 UTC m=+228.553582517 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/8bcf15d4-27a3-4749-9e68-ba74ffb6004a-insights-runtime-extractor-tls") pod "insights-runtime-extractor-ncmzq" (UID: "8bcf15d4-27a3-4749-9e68-ba74ffb6004a") : secret "insights-runtime-extractor-tls" not found Jun 11 18:31:48.427839 ip-10-0-130-170 kubenswrapper[2565]: I0611 18:31:48.427801 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator/migrator-d4bcd4867-mrrwt" event={"ID":"419b22af-d1e6-4c34-a8ee-caefea3daa6f","Type":"ContainerStarted","Data":"52d9288eb084c3f30dc32eb2361af0f43098e6c805e2d716a5e93d532b263122"} Jun 11 18:31:48.428361 ip-10-0-130-170 kubenswrapper[2565]: I0611 18:31:48.427861 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator/migrator-d4bcd4867-mrrwt" event={"ID":"419b22af-d1e6-4c34-a8ee-caefea3daa6f","Type":"ContainerStarted","Data":"81c63b8422f8b5c358121122bcbb36bc195634ac66f86b5d4fe1b73ab78cf611"} Jun 11 18:31:48.444709 ip-10-0-130-170 kubenswrapper[2565]: I0611 18:31:48.444650 2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-kube-storage-version-migrator/migrator-d4bcd4867-mrrwt" podStartSLOduration=2.251879231 podStartE2EDuration="3.444630786s" totalImagesPullingTime="1.192751555s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-11 18:31:45 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-11 18:31:48.443474114 +0000 UTC m=+227.192160137" watchObservedRunningTime="2026-06-11 18:31:48.444630786 +0000 UTC m=+227.193316809" Jun 11 18:31:48.670385 ip-10-0-130-170 kubenswrapper[2565]: I0611 18:31:48.670344 2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-service-ca/service-ca-7b994bc59-dx6fv"] Jun 11 18:31:48.673470 ip-10-0-130-170 kubenswrapper[2565]: I0611 18:31:48.673445 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-service-ca/service-ca-7b994bc59-dx6fv" Jun 11 18:31:48.676269 ip-10-0-130-170 kubenswrapper[2565]: I0611 18:31:48.676234 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-service-ca\"/\"signing-key\"" Jun 11 18:31:48.676405 ip-10-0-130-170 kubenswrapper[2565]: I0611 18:31:48.676251 2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca\"/\"signing-cabundle\"" Jun 11 18:31:48.676405 ip-10-0-130-170 kubenswrapper[2565]: I0611 18:31:48.676291 2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca\"/\"openshift-service-ca.crt\"" Jun 11 18:31:48.676405 ip-10-0-130-170 kubenswrapper[2565]: I0611 18:31:48.676323 2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca\"/\"kube-root-ca.crt\"" Jun 11 18:31:48.677088 ip-10-0-130-170 kubenswrapper[2565]: I0611 18:31:48.677075 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-service-ca\"/\"service-ca-dockercfg-hx6nm\"" Jun 11 18:31:48.683572 ip-10-0-130-170 kubenswrapper[2565]: I0611 18:31:48.683549 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-service-ca/service-ca-7b994bc59-dx6fv"] Jun 11 18:31:48.812582 ip-10-0-130-170 kubenswrapper[2565]: I0611 18:31:48.812541 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"signing-cabundle\" (UniqueName: \"kubernetes.io/configmap/39cf99ce-c7c7-4f17-ae02-e42f152599ab-signing-cabundle\") pod \"service-ca-7b994bc59-dx6fv\" (UID: \"39cf99ce-c7c7-4f17-ae02-e42f152599ab\") " pod="openshift-service-ca/service-ca-7b994bc59-dx6fv" Jun 11 18:31:48.812780 ip-10-0-130-170 kubenswrapper[2565]: I0611 18:31:48.812598 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"signing-key\" (UniqueName: \"kubernetes.io/secret/39cf99ce-c7c7-4f17-ae02-e42f152599ab-signing-key\") pod \"service-ca-7b994bc59-dx6fv\" (UID: \"39cf99ce-c7c7-4f17-ae02-e42f152599ab\") " pod="openshift-service-ca/service-ca-7b994bc59-dx6fv" Jun 11 18:31:48.812780 ip-10-0-130-170 kubenswrapper[2565]: I0611 18:31:48.812644 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-67n4k\" (UniqueName: \"kubernetes.io/projected/39cf99ce-c7c7-4f17-ae02-e42f152599ab-kube-api-access-67n4k\") pod \"service-ca-7b994bc59-dx6fv\" (UID: \"39cf99ce-c7c7-4f17-ae02-e42f152599ab\") " pod="openshift-service-ca/service-ca-7b994bc59-dx6fv" Jun 11 18:31:48.812780 ip-10-0-130-170 kubenswrapper[2565]: I0611 18:31:48.812674 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/d9d950d8-2c16-43ec-a77c-8c0b870f52e6-networking-console-plugin-cert\") pod \"networking-console-plugin-867b76cb74-mbzpt\" (UID: \"d9d950d8-2c16-43ec-a77c-8c0b870f52e6\") " pod="openshift-network-console/networking-console-plugin-867b76cb74-mbzpt" Jun 11 18:31:48.812910 ip-10-0-130-170 kubenswrapper[2565]: E0611 18:31:48.812783 2565 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found Jun 11 18:31:48.812910 ip-10-0-130-170 kubenswrapper[2565]: E0611 18:31:48.812832 2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d9d950d8-2c16-43ec-a77c-8c0b870f52e6-networking-console-plugin-cert podName:d9d950d8-2c16-43ec-a77c-8c0b870f52e6 nodeName:}" failed. No retries permitted until 2026-06-11 18:31:56.812818586 +0000 UTC m=+235.561504586 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/d9d950d8-2c16-43ec-a77c-8c0b870f52e6-networking-console-plugin-cert") pod "networking-console-plugin-867b76cb74-mbzpt" (UID: "d9d950d8-2c16-43ec-a77c-8c0b870f52e6") : secret "networking-console-plugin-cert" not found Jun 11 18:31:48.850351 ip-10-0-130-170 kubenswrapper[2565]: I0611 18:31:48.850327 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-ckltw_8e426e7d-dc89-476c-b72a-7cfc3b64a1f2/dns-node-resolver/0.log" Jun 11 18:31:48.913312 ip-10-0-130-170 kubenswrapper[2565]: I0611 18:31:48.913273 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"signing-key\" (UniqueName: \"kubernetes.io/secret/39cf99ce-c7c7-4f17-ae02-e42f152599ab-signing-key\") pod \"service-ca-7b994bc59-dx6fv\" (UID: \"39cf99ce-c7c7-4f17-ae02-e42f152599ab\") " pod="openshift-service-ca/service-ca-7b994bc59-dx6fv" Jun 11 18:31:48.913516 ip-10-0-130-170 kubenswrapper[2565]: I0611 18:31:48.913345 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-67n4k\" (UniqueName: \"kubernetes.io/projected/39cf99ce-c7c7-4f17-ae02-e42f152599ab-kube-api-access-67n4k\") pod \"service-ca-7b994bc59-dx6fv\" (UID: \"39cf99ce-c7c7-4f17-ae02-e42f152599ab\") " pod="openshift-service-ca/service-ca-7b994bc59-dx6fv" Jun 11 18:31:48.913516 ip-10-0-130-170 kubenswrapper[2565]: I0611 18:31:48.913368 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/1e5bc198-f331-4cbf-a556-b57063b26c89-samples-operator-tls\") pod \"cluster-samples-operator-9547488fd-z2lx7\" (UID: \"1e5bc198-f331-4cbf-a556-b57063b26c89\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-9547488fd-z2lx7" Jun 11 18:31:48.913516 ip-10-0-130-170 kubenswrapper[2565]: E0611 18:31:48.913476 2565 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found Jun 11 18:31:48.913684 ip-10-0-130-170 kubenswrapper[2565]: E0611 18:31:48.913525 2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/1e5bc198-f331-4cbf-a556-b57063b26c89-samples-operator-tls podName:1e5bc198-f331-4cbf-a556-b57063b26c89 nodeName:}" failed. No retries permitted until 2026-06-11 18:31:56.913509278 +0000 UTC m=+235.662195278 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/1e5bc198-f331-4cbf-a556-b57063b26c89-samples-operator-tls") pod "cluster-samples-operator-9547488fd-z2lx7" (UID: "1e5bc198-f331-4cbf-a556-b57063b26c89") : secret "samples-operator-tls" not found Jun 11 18:31:48.913684 ip-10-0-130-170 kubenswrapper[2565]: I0611 18:31:48.913518 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"signing-cabundle\" (UniqueName: \"kubernetes.io/configmap/39cf99ce-c7c7-4f17-ae02-e42f152599ab-signing-cabundle\") pod \"service-ca-7b994bc59-dx6fv\" (UID: \"39cf99ce-c7c7-4f17-ae02-e42f152599ab\") " pod="openshift-service-ca/service-ca-7b994bc59-dx6fv" Jun 11 18:31:48.914123 ip-10-0-130-170 kubenswrapper[2565]: I0611 18:31:48.914098 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"signing-cabundle\" (UniqueName: \"kubernetes.io/configmap/39cf99ce-c7c7-4f17-ae02-e42f152599ab-signing-cabundle\") pod \"service-ca-7b994bc59-dx6fv\" (UID: \"39cf99ce-c7c7-4f17-ae02-e42f152599ab\") " pod="openshift-service-ca/service-ca-7b994bc59-dx6fv" Jun 11 18:31:48.915995 ip-10-0-130-170 kubenswrapper[2565]: I0611 18:31:48.915973 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"signing-key\" (UniqueName: \"kubernetes.io/secret/39cf99ce-c7c7-4f17-ae02-e42f152599ab-signing-key\") pod \"service-ca-7b994bc59-dx6fv\" (UID: \"39cf99ce-c7c7-4f17-ae02-e42f152599ab\") " pod="openshift-service-ca/service-ca-7b994bc59-dx6fv" Jun 11 18:31:48.924949 ip-10-0-130-170 kubenswrapper[2565]: I0611 18:31:48.924926 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-67n4k\" (UniqueName: \"kubernetes.io/projected/39cf99ce-c7c7-4f17-ae02-e42f152599ab-kube-api-access-67n4k\") pod \"service-ca-7b994bc59-dx6fv\" (UID: \"39cf99ce-c7c7-4f17-ae02-e42f152599ab\") " pod="openshift-service-ca/service-ca-7b994bc59-dx6fv" Jun 11 18:31:48.982803 ip-10-0-130-170 kubenswrapper[2565]: I0611 18:31:48.982705 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-service-ca/service-ca-7b994bc59-dx6fv" Jun 11 18:31:49.111038 ip-10-0-130-170 kubenswrapper[2565]: I0611 18:31:49.111010 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-service-ca/service-ca-7b994bc59-dx6fv"] Jun 11 18:31:49.113200 ip-10-0-130-170 kubenswrapper[2565]: W0611 18:31:49.113178 2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod39cf99ce_c7c7_4f17_ae02_e42f152599ab.slice/crio-479a99e5bb267da3778aed2521bb5cafc0f4c32d8084ebf23dd27c2c7ee77b44 WatchSource:0}: Error finding container 479a99e5bb267da3778aed2521bb5cafc0f4c32d8084ebf23dd27c2c7ee77b44: Status 404 returned error can't find the container with id 479a99e5bb267da3778aed2521bb5cafc0f4c32d8084ebf23dd27c2c7ee77b44 Jun 11 18:31:49.432539 ip-10-0-130-170 kubenswrapper[2565]: I0611 18:31:49.432500 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca/service-ca-7b994bc59-dx6fv" event={"ID":"39cf99ce-c7c7-4f17-ae02-e42f152599ab","Type":"ContainerStarted","Data":"1dbf912a744751ab1fd28b2d8fe566f4f4e0a5f2e9d0cd0fa7d0bba81666f708"} Jun 11 18:31:49.432972 ip-10-0-130-170 kubenswrapper[2565]: I0611 18:31:49.432560 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca/service-ca-7b994bc59-dx6fv" event={"ID":"39cf99ce-c7c7-4f17-ae02-e42f152599ab","Type":"ContainerStarted","Data":"479a99e5bb267da3778aed2521bb5cafc0f4c32d8084ebf23dd27c2c7ee77b44"} Jun 11 18:31:49.457615 ip-10-0-130-170 kubenswrapper[2565]: I0611 18:31:49.457558 2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-service-ca/service-ca-7b994bc59-dx6fv" podStartSLOduration=1.457542708 podStartE2EDuration="1.457542708s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-11 18:31:48 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-11 18:31:49.456934132 +0000 UTC m=+228.205620156" watchObservedRunningTime="2026-06-11 18:31:49.457542708 +0000 UTC m=+228.206228729" Jun 11 18:31:49.821714 ip-10-0-130-170 kubenswrapper[2565]: I0611 18:31:49.821619 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/8bcf15d4-27a3-4749-9e68-ba74ffb6004a-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-ncmzq\" (UID: \"8bcf15d4-27a3-4749-9e68-ba74ffb6004a\") " pod="openshift-insights/insights-runtime-extractor-ncmzq" Jun 11 18:31:49.821714 ip-10-0-130-170 kubenswrapper[2565]: I0611 18:31:49.821669 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/8bcf15d4-27a3-4749-9e68-ba74ffb6004a-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-ncmzq\" (UID: \"8bcf15d4-27a3-4749-9e68-ba74ffb6004a\") " pod="openshift-insights/insights-runtime-extractor-ncmzq" Jun 11 18:31:49.821905 ip-10-0-130-170 kubenswrapper[2565]: E0611 18:31:49.821768 2565 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Jun 11 18:31:49.821905 ip-10-0-130-170 kubenswrapper[2565]: E0611 18:31:49.821796 2565 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found Jun 11 18:31:49.821905 ip-10-0-130-170 kubenswrapper[2565]: E0611 18:31:49.821849 2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/8bcf15d4-27a3-4749-9e68-ba74ffb6004a-insights-runtime-extractor-tls podName:8bcf15d4-27a3-4749-9e68-ba74ffb6004a nodeName:}" failed. No retries permitted until 2026-06-11 18:31:53.82182854 +0000 UTC m=+232.570514555 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/8bcf15d4-27a3-4749-9e68-ba74ffb6004a-insights-runtime-extractor-tls") pod "insights-runtime-extractor-ncmzq" (UID: "8bcf15d4-27a3-4749-9e68-ba74ffb6004a") : secret "insights-runtime-extractor-tls" not found Jun 11 18:31:49.821905 ip-10-0-130-170 kubenswrapper[2565]: E0611 18:31:49.821867 2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/8bcf15d4-27a3-4749-9e68-ba74ffb6004a-kube-rbac-proxy-cm podName:8bcf15d4-27a3-4749-9e68-ba74ffb6004a nodeName:}" failed. No retries permitted until 2026-06-11 18:31:53.821857909 +0000 UTC m=+232.570543912 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/8bcf15d4-27a3-4749-9e68-ba74ffb6004a-kube-rbac-proxy-cm") pod "insights-runtime-extractor-ncmzq" (UID: "8bcf15d4-27a3-4749-9e68-ba74ffb6004a") : configmap "kube-rbac-proxy" not found Jun 11 18:31:49.850896 ip-10-0-130-170 kubenswrapper[2565]: I0611 18:31:49.850868 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-wwlkz_7f5f862b-4ec0-44cd-96f3-1554a1656229/node-ca/0.log" Jun 11 18:31:50.650554 ip-10-0-130-170 kubenswrapper[2565]: I0611 18:31:50.650525 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-czdq5_35a5e103-2756-40a3-ad29-bae095288d5b/serve-healthcheck-canary/0.log" Jun 11 18:31:51.052949 ip-10-0-130-170 kubenswrapper[2565]: I0611 18:31:51.052868 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator_migrator-d4bcd4867-mrrwt_419b22af-d1e6-4c34-a8ee-caefea3daa6f/migrator/0.log" Jun 11 18:31:51.253104 ip-10-0-130-170 kubenswrapper[2565]: I0611 18:31:51.253073 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator_migrator-d4bcd4867-mrrwt_419b22af-d1e6-4c34-a8ee-caefea3daa6f/graceful-termination/0.log" Jun 11 18:31:51.584877 ip-10-0-130-170 kubenswrapper[2565]: I0611 18:31:51.584841 2565 kubelet.go:2654] "SyncLoop (probe)" probe="liveness" status="unhealthy" pod="openshift-console-operator/console-operator-5dbbb5d744-vpdts" Jun 11 18:31:51.585051 ip-10-0-130-170 kubenswrapper[2565]: I0611 18:31:51.584899 2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console-operator/console-operator-5dbbb5d744-vpdts" Jun 11 18:31:51.585237 ip-10-0-130-170 kubenswrapper[2565]: I0611 18:31:51.585224 2565 scope.go:117] "RemoveContainer" containerID="4e3c0c0aadd7680a9c0cc09900b1289f42bfbf293465197dd0a61bdc33969a82" Jun 11 18:31:51.585441 ip-10-0-130-170 kubenswrapper[2565]: E0611 18:31:51.585423 2565 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"console-operator\" with CrashLoopBackOff: \"back-off 10s restarting failed container=console-operator pod=console-operator-5dbbb5d744-vpdts_openshift-console-operator(3329f4b1-ac8c-4472-b6a0-13bb76075957)\"" pod="openshift-console-operator/console-operator-5dbbb5d744-vpdts" podUID="3329f4b1-ac8c-4472-b6a0-13bb76075957" Jun 11 18:31:53.858485 ip-10-0-130-170 kubenswrapper[2565]: I0611 18:31:53.858438 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/8bcf15d4-27a3-4749-9e68-ba74ffb6004a-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-ncmzq\" (UID: \"8bcf15d4-27a3-4749-9e68-ba74ffb6004a\") " pod="openshift-insights/insights-runtime-extractor-ncmzq" Jun 11 18:31:53.858934 ip-10-0-130-170 kubenswrapper[2565]: I0611 18:31:53.858494 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/8bcf15d4-27a3-4749-9e68-ba74ffb6004a-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-ncmzq\" (UID: \"8bcf15d4-27a3-4749-9e68-ba74ffb6004a\") " pod="openshift-insights/insights-runtime-extractor-ncmzq" Jun 11 18:31:53.858934 ip-10-0-130-170 kubenswrapper[2565]: E0611 18:31:53.858609 2565 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Jun 11 18:31:53.858934 ip-10-0-130-170 kubenswrapper[2565]: E0611 18:31:53.858624 2565 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found Jun 11 18:31:53.858934 ip-10-0-130-170 kubenswrapper[2565]: E0611 18:31:53.858695 2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/8bcf15d4-27a3-4749-9e68-ba74ffb6004a-insights-runtime-extractor-tls podName:8bcf15d4-27a3-4749-9e68-ba74ffb6004a nodeName:}" failed. No retries permitted until 2026-06-11 18:32:01.858673439 +0000 UTC m=+240.607359439 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/8bcf15d4-27a3-4749-9e68-ba74ffb6004a-insights-runtime-extractor-tls") pod "insights-runtime-extractor-ncmzq" (UID: "8bcf15d4-27a3-4749-9e68-ba74ffb6004a") : secret "insights-runtime-extractor-tls" not found Jun 11 18:31:53.858934 ip-10-0-130-170 kubenswrapper[2565]: E0611 18:31:53.858712 2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/8bcf15d4-27a3-4749-9e68-ba74ffb6004a-kube-rbac-proxy-cm podName:8bcf15d4-27a3-4749-9e68-ba74ffb6004a nodeName:}" failed. No retries permitted until 2026-06-11 18:32:01.858704952 +0000 UTC m=+240.607390952 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/8bcf15d4-27a3-4749-9e68-ba74ffb6004a-kube-rbac-proxy-cm") pod "insights-runtime-extractor-ncmzq" (UID: "8bcf15d4-27a3-4749-9e68-ba74ffb6004a") : configmap "kube-rbac-proxy" not found Jun 11 18:31:56.885871 ip-10-0-130-170 kubenswrapper[2565]: I0611 18:31:56.885836 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/d9d950d8-2c16-43ec-a77c-8c0b870f52e6-networking-console-plugin-cert\") pod \"networking-console-plugin-867b76cb74-mbzpt\" (UID: \"d9d950d8-2c16-43ec-a77c-8c0b870f52e6\") " pod="openshift-network-console/networking-console-plugin-867b76cb74-mbzpt" Jun 11 18:31:56.886284 ip-10-0-130-170 kubenswrapper[2565]: E0611 18:31:56.885988 2565 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found Jun 11 18:31:56.886284 ip-10-0-130-170 kubenswrapper[2565]: E0611 18:31:56.886054 2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d9d950d8-2c16-43ec-a77c-8c0b870f52e6-networking-console-plugin-cert podName:d9d950d8-2c16-43ec-a77c-8c0b870f52e6 nodeName:}" failed. No retries permitted until 2026-06-11 18:32:12.886039322 +0000 UTC m=+251.634725327 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/d9d950d8-2c16-43ec-a77c-8c0b870f52e6-networking-console-plugin-cert") pod "networking-console-plugin-867b76cb74-mbzpt" (UID: "d9d950d8-2c16-43ec-a77c-8c0b870f52e6") : secret "networking-console-plugin-cert" not found Jun 11 18:31:56.986938 ip-10-0-130-170 kubenswrapper[2565]: I0611 18:31:56.986902 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/1e5bc198-f331-4cbf-a556-b57063b26c89-samples-operator-tls\") pod \"cluster-samples-operator-9547488fd-z2lx7\" (UID: \"1e5bc198-f331-4cbf-a556-b57063b26c89\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-9547488fd-z2lx7" Jun 11 18:31:56.989516 ip-10-0-130-170 kubenswrapper[2565]: I0611 18:31:56.989494 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/1e5bc198-f331-4cbf-a556-b57063b26c89-samples-operator-tls\") pod \"cluster-samples-operator-9547488fd-z2lx7\" (UID: \"1e5bc198-f331-4cbf-a556-b57063b26c89\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-9547488fd-z2lx7" Jun 11 18:31:57.035537 ip-10-0-130-170 kubenswrapper[2565]: I0611 18:31:57.035488 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-samples-operator/cluster-samples-operator-9547488fd-z2lx7" Jun 11 18:31:57.162847 ip-10-0-130-170 kubenswrapper[2565]: I0611 18:31:57.162750 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-cluster-samples-operator/cluster-samples-operator-9547488fd-z2lx7"] Jun 11 18:31:57.458648 ip-10-0-130-170 kubenswrapper[2565]: I0611 18:31:57.458556 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-samples-operator/cluster-samples-operator-9547488fd-z2lx7" event={"ID":"1e5bc198-f331-4cbf-a556-b57063b26c89","Type":"ContainerStarted","Data":"0d139076a2e19508283622e17f1270d49b9c3dee0cdfc793732efaf0537928df"} Jun 11 18:31:59.469609 ip-10-0-130-170 kubenswrapper[2565]: I0611 18:31:59.469568 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-samples-operator/cluster-samples-operator-9547488fd-z2lx7" event={"ID":"1e5bc198-f331-4cbf-a556-b57063b26c89","Type":"ContainerStarted","Data":"0f4d1220bfe051c81649c8f7c009d9c8da5a5f708e551e0ca0af3e491c350525"} Jun 11 18:31:59.469987 ip-10-0-130-170 kubenswrapper[2565]: I0611 18:31:59.469674 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-samples-operator/cluster-samples-operator-9547488fd-z2lx7" event={"ID":"1e5bc198-f331-4cbf-a556-b57063b26c89","Type":"ContainerStarted","Data":"0bd696ce0d3e5b34f6fa45c88be1b200f71f0a3ac4b0ead9d50d8b81c2a73616"} Jun 11 18:31:59.488720 ip-10-0-130-170 kubenswrapper[2565]: I0611 18:31:59.488666 2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-samples-operator/cluster-samples-operator-9547488fd-z2lx7" podStartSLOduration=16.768011216 podStartE2EDuration="18.488648891s" totalImagesPullingTime="1.720637675s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-11 18:31:41 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-11 18:31:59.488592668 +0000 UTC m=+238.237278691" watchObservedRunningTime="2026-06-11 18:31:59.488648891 +0000 UTC m=+238.237334892" Jun 11 18:32:01.927675 ip-10-0-130-170 kubenswrapper[2565]: I0611 18:32:01.927631 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/8bcf15d4-27a3-4749-9e68-ba74ffb6004a-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-ncmzq\" (UID: \"8bcf15d4-27a3-4749-9e68-ba74ffb6004a\") " pod="openshift-insights/insights-runtime-extractor-ncmzq" Jun 11 18:32:01.927675 ip-10-0-130-170 kubenswrapper[2565]: I0611 18:32:01.927682 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/8bcf15d4-27a3-4749-9e68-ba74ffb6004a-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-ncmzq\" (UID: \"8bcf15d4-27a3-4749-9e68-ba74ffb6004a\") " pod="openshift-insights/insights-runtime-extractor-ncmzq" Jun 11 18:32:01.928180 ip-10-0-130-170 kubenswrapper[2565]: I0611 18:32:01.928155 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/8bcf15d4-27a3-4749-9e68-ba74ffb6004a-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-ncmzq\" (UID: \"8bcf15d4-27a3-4749-9e68-ba74ffb6004a\") " pod="openshift-insights/insights-runtime-extractor-ncmzq" Jun 11 18:32:01.930095 ip-10-0-130-170 kubenswrapper[2565]: I0611 18:32:01.930074 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/8bcf15d4-27a3-4749-9e68-ba74ffb6004a-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-ncmzq\" (UID: \"8bcf15d4-27a3-4749-9e68-ba74ffb6004a\") " pod="openshift-insights/insights-runtime-extractor-ncmzq" Jun 11 18:32:01.980861 ip-10-0-130-170 kubenswrapper[2565]: I0611 18:32:01.980826 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-sa-dockercfg-rrdf4\"" Jun 11 18:32:01.988625 ip-10-0-130-170 kubenswrapper[2565]: I0611 18:32:01.988585 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-ncmzq" Jun 11 18:32:02.117558 ip-10-0-130-170 kubenswrapper[2565]: I0611 18:32:02.117530 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-ncmzq"] Jun 11 18:32:02.119852 ip-10-0-130-170 kubenswrapper[2565]: W0611 18:32:02.119826 2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8bcf15d4_27a3_4749_9e68_ba74ffb6004a.slice/crio-a22eadb001cf8dc87c169b2b7e4f10523f09d00115ccccc45334e373b6904b31 WatchSource:0}: Error finding container a22eadb001cf8dc87c169b2b7e4f10523f09d00115ccccc45334e373b6904b31: Status 404 returned error can't find the container with id a22eadb001cf8dc87c169b2b7e4f10523f09d00115ccccc45334e373b6904b31 Jun 11 18:32:02.480405 ip-10-0-130-170 kubenswrapper[2565]: I0611 18:32:02.480365 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-ncmzq" event={"ID":"8bcf15d4-27a3-4749-9e68-ba74ffb6004a","Type":"ContainerStarted","Data":"a22eadb001cf8dc87c169b2b7e4f10523f09d00115ccccc45334e373b6904b31"} Jun 11 18:32:02.743713 ip-10-0-130-170 kubenswrapper[2565]: I0611 18:32:02.743616 2565 scope.go:117] "RemoveContainer" containerID="4e3c0c0aadd7680a9c0cc09900b1289f42bfbf293465197dd0a61bdc33969a82" Jun 11 18:32:03.487564 ip-10-0-130-170 kubenswrapper[2565]: I0611 18:32:03.487534 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-5dbbb5d744-vpdts_3329f4b1-ac8c-4472-b6a0-13bb76075957/console-operator/1.log" Jun 11 18:32:03.488029 ip-10-0-130-170 kubenswrapper[2565]: I0611 18:32:03.487607 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-5dbbb5d744-vpdts" event={"ID":"3329f4b1-ac8c-4472-b6a0-13bb76075957","Type":"ContainerStarted","Data":"f1a50566ff75baf98c928e4f722ca09be50eb28c3ce58c15acbb74fa7b145678"} Jun 11 18:32:03.488029 ip-10-0-130-170 kubenswrapper[2565]: I0611 18:32:03.487899 2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console-operator/console-operator-5dbbb5d744-vpdts" Jun 11 18:32:03.507173 ip-10-0-130-170 kubenswrapper[2565]: I0611 18:32:03.507125 2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console-operator/console-operator-5dbbb5d744-vpdts" podStartSLOduration=19.314839367 podStartE2EDuration="22.5071102s" totalImagesPullingTime="3.192270833s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-11 18:31:41 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-11 18:32:03.505491577 +0000 UTC m=+242.254177600" watchObservedRunningTime="2026-06-11 18:32:03.5071102 +0000 UTC m=+242.255796219" Jun 11 18:32:04.088145 ip-10-0-130-170 kubenswrapper[2565]: I0611 18:32:04.087740 2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console-operator/console-operator-5dbbb5d744-vpdts" Jun 11 18:32:06.501042 ip-10-0-130-170 kubenswrapper[2565]: I0611 18:32:06.500994 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-ncmzq" event={"ID":"8bcf15d4-27a3-4749-9e68-ba74ffb6004a","Type":"ContainerStarted","Data":"5da17d77820d9687d7ab4196217b59873bfa65e2313df0693efa815ca1ad722b"} Jun 11 18:32:06.501432 ip-10-0-130-170 kubenswrapper[2565]: I0611 18:32:06.501063 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-ncmzq" event={"ID":"8bcf15d4-27a3-4749-9e68-ba74ffb6004a","Type":"ContainerStarted","Data":"d8d2b8f73a54503b94a74c19f4f3ad2611b55233dc2c0acc1626cee0b3c0ce1b"} Jun 11 18:32:08.518731 ip-10-0-130-170 kubenswrapper[2565]: I0611 18:32:08.518698 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-ncmzq" event={"ID":"8bcf15d4-27a3-4749-9e68-ba74ffb6004a","Type":"ContainerStarted","Data":"8d3e42dea0d1e06b9375baf2a3cb4a478cc3be33674aa78296c1de8b924ee205"} Jun 11 18:32:08.537213 ip-10-0-130-170 kubenswrapper[2565]: I0611 18:32:08.537160 2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-insights/insights-runtime-extractor-ncmzq" podStartSLOduration=16.816882377 podStartE2EDuration="22.537143683s" totalImagesPullingTime="5.720261306s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-11 18:31:46 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-11 18:32:08.53615854 +0000 UTC m=+247.284844561" watchObservedRunningTime="2026-06-11 18:32:08.537143683 +0000 UTC m=+247.285829706" Jun 11 18:32:12.921464 ip-10-0-130-170 kubenswrapper[2565]: I0611 18:32:12.921375 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/d9d950d8-2c16-43ec-a77c-8c0b870f52e6-networking-console-plugin-cert\") pod \"networking-console-plugin-867b76cb74-mbzpt\" (UID: \"d9d950d8-2c16-43ec-a77c-8c0b870f52e6\") " pod="openshift-network-console/networking-console-plugin-867b76cb74-mbzpt" Jun 11 18:32:12.923943 ip-10-0-130-170 kubenswrapper[2565]: I0611 18:32:12.923921 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/d9d950d8-2c16-43ec-a77c-8c0b870f52e6-networking-console-plugin-cert\") pod \"networking-console-plugin-867b76cb74-mbzpt\" (UID: \"d9d950d8-2c16-43ec-a77c-8c0b870f52e6\") " pod="openshift-network-console/networking-console-plugin-867b76cb74-mbzpt" Jun 11 18:32:13.181056 ip-10-0-130-170 kubenswrapper[2565]: I0611 18:32:13.180976 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-console\"/\"default-dockercfg-29z4z\"" Jun 11 18:32:13.188324 ip-10-0-130-170 kubenswrapper[2565]: I0611 18:32:13.188310 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-console/networking-console-plugin-867b76cb74-mbzpt" Jun 11 18:32:13.313943 ip-10-0-130-170 kubenswrapper[2565]: I0611 18:32:13.313910 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-console/networking-console-plugin-867b76cb74-mbzpt"] Jun 11 18:32:13.316830 ip-10-0-130-170 kubenswrapper[2565]: W0611 18:32:13.316802 2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd9d950d8_2c16_43ec_a77c_8c0b870f52e6.slice/crio-7f7ce4179a5f961d1535685abc61946e4ac572b5e5a771f372f9541b716fb423 WatchSource:0}: Error finding container 7f7ce4179a5f961d1535685abc61946e4ac572b5e5a771f372f9541b716fb423: Status 404 returned error can't find the container with id 7f7ce4179a5f961d1535685abc61946e4ac572b5e5a771f372f9541b716fb423 Jun 11 18:32:13.540421 ip-10-0-130-170 kubenswrapper[2565]: I0611 18:32:13.540338 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-console/networking-console-plugin-867b76cb74-mbzpt" event={"ID":"d9d950d8-2c16-43ec-a77c-8c0b870f52e6","Type":"ContainerStarted","Data":"7f7ce4179a5f961d1535685abc61946e4ac572b5e5a771f372f9541b716fb423"} Jun 11 18:32:13.627052 ip-10-0-130-170 kubenswrapper[2565]: I0611 18:32:13.627018 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/2f4a1ff8-558e-4d9b-9208-ca0211b2b4e1-metrics-certs\") pod \"network-metrics-daemon-bvwxp\" (UID: \"2f4a1ff8-558e-4d9b-9208-ca0211b2b4e1\") " pod="openshift-multus/network-metrics-daemon-bvwxp" Jun 11 18:32:13.629383 ip-10-0-130-170 kubenswrapper[2565]: I0611 18:32:13.629361 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/2f4a1ff8-558e-4d9b-9208-ca0211b2b4e1-metrics-certs\") pod \"network-metrics-daemon-bvwxp\" (UID: \"2f4a1ff8-558e-4d9b-9208-ca0211b2b4e1\") " pod="openshift-multus/network-metrics-daemon-bvwxp" Jun 11 18:32:13.649477 ip-10-0-130-170 kubenswrapper[2565]: I0611 18:32:13.649451 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-j7h7l\"" Jun 11 18:32:13.657480 ip-10-0-130-170 kubenswrapper[2565]: I0611 18:32:13.657464 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-bvwxp" Jun 11 18:32:13.785350 ip-10-0-130-170 kubenswrapper[2565]: I0611 18:32:13.785320 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-bvwxp"] Jun 11 18:32:13.788539 ip-10-0-130-170 kubenswrapper[2565]: W0611 18:32:13.788513 2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2f4a1ff8_558e_4d9b_9208_ca0211b2b4e1.slice/crio-92c984b36557e3e6fc0e480ae8aedad4586d783fcf46bbc0b650e5a422c5f81b WatchSource:0}: Error finding container 92c984b36557e3e6fc0e480ae8aedad4586d783fcf46bbc0b650e5a422c5f81b: Status 404 returned error can't find the container with id 92c984b36557e3e6fc0e480ae8aedad4586d783fcf46bbc0b650e5a422c5f81b Jun 11 18:32:14.544718 ip-10-0-130-170 kubenswrapper[2565]: I0611 18:32:14.544677 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-bvwxp" event={"ID":"2f4a1ff8-558e-4d9b-9208-ca0211b2b4e1","Type":"ContainerStarted","Data":"92c984b36557e3e6fc0e480ae8aedad4586d783fcf46bbc0b650e5a422c5f81b"} Jun 11 18:32:15.549598 ip-10-0-130-170 kubenswrapper[2565]: I0611 18:32:15.549562 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-console/networking-console-plugin-867b76cb74-mbzpt" event={"ID":"d9d950d8-2c16-43ec-a77c-8c0b870f52e6","Type":"ContainerStarted","Data":"acc77e823e00da8bf22891cd864fc3a8b03f0c96f5abb3022f06e18de4b9983c"} Jun 11 18:32:15.551324 ip-10-0-130-170 kubenswrapper[2565]: I0611 18:32:15.551299 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-bvwxp" event={"ID":"2f4a1ff8-558e-4d9b-9208-ca0211b2b4e1","Type":"ContainerStarted","Data":"1ea4f12f42a34762b2b93aab74e919d9daf829a7015105190d786fdd0d7101fb"} Jun 11 18:32:15.551444 ip-10-0-130-170 kubenswrapper[2565]: I0611 18:32:15.551346 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-bvwxp" event={"ID":"2f4a1ff8-558e-4d9b-9208-ca0211b2b4e1","Type":"ContainerStarted","Data":"f9a2ce8bdc09e9e2df008d5620547af0ed05078f62651d3ec724050ab284d6aa"} Jun 11 18:32:15.565452 ip-10-0-130-170 kubenswrapper[2565]: I0611 18:32:15.565412 2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-console/networking-console-plugin-867b76cb74-mbzpt" podStartSLOduration=32.999883192 podStartE2EDuration="34.565397304s" totalImagesPullingTime="1.565514112s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-11 18:31:41 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-11 18:32:15.564347728 +0000 UTC m=+254.313033761" watchObservedRunningTime="2026-06-11 18:32:15.565397304 +0000 UTC m=+254.314083358" Jun 11 18:32:15.580227 ip-10-0-130-170 kubenswrapper[2565]: I0611 18:32:15.580181 2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/network-metrics-daemon-bvwxp" podStartSLOduration=253.484318652 podStartE2EDuration="4m14.580165684s" totalImagesPullingTime="1.095847032s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-11 18:28:01 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-11 18:32:15.578871058 +0000 UTC m=+254.327557082" watchObservedRunningTime="2026-06-11 18:32:15.580165684 +0000 UTC m=+254.328851705" Jun 11 18:32:16.645687 ip-10-0-130-170 kubenswrapper[2565]: I0611 18:32:16.645647 2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/prometheus-operator-admission-webhook-5cf667749c-xvt57"] Jun 11 18:32:16.647844 ip-10-0-130-170 kubenswrapper[2565]: I0611 18:32:16.647826 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-admission-webhook-5cf667749c-xvt57" Jun 11 18:32:16.650225 ip-10-0-130-170 kubenswrapper[2565]: I0611 18:32:16.650200 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-admission-webhook-tls\"" Jun 11 18:32:16.650458 ip-10-0-130-170 kubenswrapper[2565]: I0611 18:32:16.650409 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-admission-webhook-dockercfg-6c855\"" Jun 11 18:32:16.656287 ip-10-0-130-170 kubenswrapper[2565]: I0611 18:32:16.656238 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-admission-webhook-5cf667749c-xvt57"] Jun 11 18:32:16.751269 ip-10-0-130-170 kubenswrapper[2565]: I0611 18:32:16.751222 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certificates\" (UniqueName: \"kubernetes.io/secret/4b33b201-681a-4673-be4d-cdcf0eed397a-tls-certificates\") pod \"prometheus-operator-admission-webhook-5cf667749c-xvt57\" (UID: \"4b33b201-681a-4673-be4d-cdcf0eed397a\") " pod="openshift-monitoring/prometheus-operator-admission-webhook-5cf667749c-xvt57" Jun 11 18:32:16.851712 ip-10-0-130-170 kubenswrapper[2565]: I0611 18:32:16.851679 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certificates\" (UniqueName: \"kubernetes.io/secret/4b33b201-681a-4673-be4d-cdcf0eed397a-tls-certificates\") pod \"prometheus-operator-admission-webhook-5cf667749c-xvt57\" (UID: \"4b33b201-681a-4673-be4d-cdcf0eed397a\") " pod="openshift-monitoring/prometheus-operator-admission-webhook-5cf667749c-xvt57" Jun 11 18:32:16.854227 ip-10-0-130-170 kubenswrapper[2565]: I0611 18:32:16.854200 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certificates\" (UniqueName: \"kubernetes.io/secret/4b33b201-681a-4673-be4d-cdcf0eed397a-tls-certificates\") pod \"prometheus-operator-admission-webhook-5cf667749c-xvt57\" (UID: \"4b33b201-681a-4673-be4d-cdcf0eed397a\") " pod="openshift-monitoring/prometheus-operator-admission-webhook-5cf667749c-xvt57" Jun 11 18:32:16.957751 ip-10-0-130-170 kubenswrapper[2565]: I0611 18:32:16.957657 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-admission-webhook-5cf667749c-xvt57" Jun 11 18:32:17.085762 ip-10-0-130-170 kubenswrapper[2565]: I0611 18:32:17.085733 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-admission-webhook-5cf667749c-xvt57"] Jun 11 18:32:17.088866 ip-10-0-130-170 kubenswrapper[2565]: W0611 18:32:17.088841 2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4b33b201_681a_4673_be4d_cdcf0eed397a.slice/crio-61b3fc484733a8f2f34c86481d11945ff8da6fbfc0257ae7e869cf40fe7b7d1b WatchSource:0}: Error finding container 61b3fc484733a8f2f34c86481d11945ff8da6fbfc0257ae7e869cf40fe7b7d1b: Status 404 returned error can't find the container with id 61b3fc484733a8f2f34c86481d11945ff8da6fbfc0257ae7e869cf40fe7b7d1b Jun 11 18:32:17.558709 ip-10-0-130-170 kubenswrapper[2565]: I0611 18:32:17.558673 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-admission-webhook-5cf667749c-xvt57" event={"ID":"4b33b201-681a-4673-be4d-cdcf0eed397a","Type":"ContainerStarted","Data":"61b3fc484733a8f2f34c86481d11945ff8da6fbfc0257ae7e869cf40fe7b7d1b"} Jun 11 18:32:18.563163 ip-10-0-130-170 kubenswrapper[2565]: I0611 18:32:18.563070 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-admission-webhook-5cf667749c-xvt57" event={"ID":"4b33b201-681a-4673-be4d-cdcf0eed397a","Type":"ContainerStarted","Data":"cf72b23eefd9c9ec99392ba5d81af8052e037b9265fe81b06b2d0435d5e2a517"} Jun 11 18:32:18.563614 ip-10-0-130-170 kubenswrapper[2565]: I0611 18:32:18.563162 2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/prometheus-operator-admission-webhook-5cf667749c-xvt57" Jun 11 18:32:18.567748 ip-10-0-130-170 kubenswrapper[2565]: I0611 18:32:18.567723 2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/prometheus-operator-admission-webhook-5cf667749c-xvt57" Jun 11 18:32:18.578787 ip-10-0-130-170 kubenswrapper[2565]: I0611 18:32:18.578737 2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/prometheus-operator-admission-webhook-5cf667749c-xvt57" podStartSLOduration=1.3774988910000001 podStartE2EDuration="2.578723047s" totalImagesPullingTime="1.201224156s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-11 18:32:16 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-11 18:32:18.578044822 +0000 UTC m=+257.326730844" watchObservedRunningTime="2026-06-11 18:32:18.578723047 +0000 UTC m=+257.327409069" Jun 11 18:32:20.772938 ip-10-0-130-170 kubenswrapper[2565]: I0611 18:32:20.772897 2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-7f88bbcffb-b7z9j"] Jun 11 18:32:20.775451 ip-10-0-130-170 kubenswrapper[2565]: I0611 18:32:20.775429 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-7f88bbcffb-b7z9j" Jun 11 18:32:20.777899 ip-10-0-130-170 kubenswrapper[2565]: I0611 18:32:20.777880 2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"console-config\"" Jun 11 18:32:20.777899 ip-10-0-130-170 kubenswrapper[2565]: I0611 18:32:20.777891 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-dockercfg-rx75w\"" Jun 11 18:32:20.778772 ip-10-0-130-170 kubenswrapper[2565]: I0611 18:32:20.778753 2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"openshift-service-ca.crt\"" Jun 11 18:32:20.778854 ip-10-0-130-170 kubenswrapper[2565]: I0611 18:32:20.778821 2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"kube-root-ca.crt\"" Jun 11 18:32:20.778951 ip-10-0-130-170 kubenswrapper[2565]: I0611 18:32:20.778931 2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"service-ca\"" Jun 11 18:32:20.779188 ip-10-0-130-170 kubenswrapper[2565]: I0611 18:32:20.779165 2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"oauth-serving-cert\"" Jun 11 18:32:20.779293 ip-10-0-130-170 kubenswrapper[2565]: I0611 18:32:20.779219 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-oauth-config\"" Jun 11 18:32:20.779293 ip-10-0-130-170 kubenswrapper[2565]: I0611 18:32:20.779237 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-serving-cert\"" Jun 11 18:32:20.782838 ip-10-0-130-170 kubenswrapper[2565]: I0611 18:32:20.782817 2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"trusted-ca-bundle\"" Jun 11 18:32:20.787618 ip-10-0-130-170 kubenswrapper[2565]: I0611 18:32:20.787597 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-7f88bbcffb-b7z9j"] Jun 11 18:32:20.879590 ip-10-0-130-170 kubenswrapper[2565]: I0611 18:32:20.879552 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/4473e901-c297-4298-b314-1c31a91d3510-oauth-serving-cert\") pod \"console-7f88bbcffb-b7z9j\" (UID: \"4473e901-c297-4298-b314-1c31a91d3510\") " pod="openshift-console/console-7f88bbcffb-b7z9j" Jun 11 18:32:20.879590 ip-10-0-130-170 kubenswrapper[2565]: I0611 18:32:20.879591 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/4473e901-c297-4298-b314-1c31a91d3510-console-config\") pod \"console-7f88bbcffb-b7z9j\" (UID: \"4473e901-c297-4298-b314-1c31a91d3510\") " pod="openshift-console/console-7f88bbcffb-b7z9j" Jun 11 18:32:20.879858 ip-10-0-130-170 kubenswrapper[2565]: I0611 18:32:20.879615 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/4473e901-c297-4298-b314-1c31a91d3510-trusted-ca-bundle\") pod \"console-7f88bbcffb-b7z9j\" (UID: \"4473e901-c297-4298-b314-1c31a91d3510\") " pod="openshift-console/console-7f88bbcffb-b7z9j" Jun 11 18:32:20.879858 ip-10-0-130-170 kubenswrapper[2565]: I0611 18:32:20.879728 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wgqcp\" (UniqueName: \"kubernetes.io/projected/4473e901-c297-4298-b314-1c31a91d3510-kube-api-access-wgqcp\") pod \"console-7f88bbcffb-b7z9j\" (UID: \"4473e901-c297-4298-b314-1c31a91d3510\") " pod="openshift-console/console-7f88bbcffb-b7z9j" Jun 11 18:32:20.879858 ip-10-0-130-170 kubenswrapper[2565]: I0611 18:32:20.879774 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/4473e901-c297-4298-b314-1c31a91d3510-console-serving-cert\") pod \"console-7f88bbcffb-b7z9j\" (UID: \"4473e901-c297-4298-b314-1c31a91d3510\") " pod="openshift-console/console-7f88bbcffb-b7z9j" Jun 11 18:32:20.879858 ip-10-0-130-170 kubenswrapper[2565]: I0611 18:32:20.879806 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/4473e901-c297-4298-b314-1c31a91d3510-service-ca\") pod \"console-7f88bbcffb-b7z9j\" (UID: \"4473e901-c297-4298-b314-1c31a91d3510\") " pod="openshift-console/console-7f88bbcffb-b7z9j" Jun 11 18:32:20.879858 ip-10-0-130-170 kubenswrapper[2565]: I0611 18:32:20.879838 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/4473e901-c297-4298-b314-1c31a91d3510-console-oauth-config\") pod \"console-7f88bbcffb-b7z9j\" (UID: \"4473e901-c297-4298-b314-1c31a91d3510\") " pod="openshift-console/console-7f88bbcffb-b7z9j" Jun 11 18:32:20.981309 ip-10-0-130-170 kubenswrapper[2565]: I0611 18:32:20.981271 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wgqcp\" (UniqueName: \"kubernetes.io/projected/4473e901-c297-4298-b314-1c31a91d3510-kube-api-access-wgqcp\") pod \"console-7f88bbcffb-b7z9j\" (UID: \"4473e901-c297-4298-b314-1c31a91d3510\") " pod="openshift-console/console-7f88bbcffb-b7z9j" Jun 11 18:32:20.981489 ip-10-0-130-170 kubenswrapper[2565]: I0611 18:32:20.981352 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/4473e901-c297-4298-b314-1c31a91d3510-console-serving-cert\") pod \"console-7f88bbcffb-b7z9j\" (UID: \"4473e901-c297-4298-b314-1c31a91d3510\") " pod="openshift-console/console-7f88bbcffb-b7z9j" Jun 11 18:32:20.981489 ip-10-0-130-170 kubenswrapper[2565]: I0611 18:32:20.981396 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/4473e901-c297-4298-b314-1c31a91d3510-service-ca\") pod \"console-7f88bbcffb-b7z9j\" (UID: \"4473e901-c297-4298-b314-1c31a91d3510\") " pod="openshift-console/console-7f88bbcffb-b7z9j" Jun 11 18:32:20.981489 ip-10-0-130-170 kubenswrapper[2565]: I0611 18:32:20.981429 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/4473e901-c297-4298-b314-1c31a91d3510-console-oauth-config\") pod \"console-7f88bbcffb-b7z9j\" (UID: \"4473e901-c297-4298-b314-1c31a91d3510\") " pod="openshift-console/console-7f88bbcffb-b7z9j" Jun 11 18:32:20.981489 ip-10-0-130-170 kubenswrapper[2565]: I0611 18:32:20.981471 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/4473e901-c297-4298-b314-1c31a91d3510-oauth-serving-cert\") pod \"console-7f88bbcffb-b7z9j\" (UID: \"4473e901-c297-4298-b314-1c31a91d3510\") " pod="openshift-console/console-7f88bbcffb-b7z9j" Jun 11 18:32:20.981727 ip-10-0-130-170 kubenswrapper[2565]: I0611 18:32:20.981495 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/4473e901-c297-4298-b314-1c31a91d3510-console-config\") pod \"console-7f88bbcffb-b7z9j\" (UID: \"4473e901-c297-4298-b314-1c31a91d3510\") " pod="openshift-console/console-7f88bbcffb-b7z9j" Jun 11 18:32:20.981727 ip-10-0-130-170 kubenswrapper[2565]: I0611 18:32:20.981521 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/4473e901-c297-4298-b314-1c31a91d3510-trusted-ca-bundle\") pod \"console-7f88bbcffb-b7z9j\" (UID: \"4473e901-c297-4298-b314-1c31a91d3510\") " pod="openshift-console/console-7f88bbcffb-b7z9j" Jun 11 18:32:20.982232 ip-10-0-130-170 kubenswrapper[2565]: I0611 18:32:20.982204 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/4473e901-c297-4298-b314-1c31a91d3510-service-ca\") pod \"console-7f88bbcffb-b7z9j\" (UID: \"4473e901-c297-4298-b314-1c31a91d3510\") " pod="openshift-console/console-7f88bbcffb-b7z9j" Jun 11 18:32:20.982377 ip-10-0-130-170 kubenswrapper[2565]: I0611 18:32:20.982277 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/4473e901-c297-4298-b314-1c31a91d3510-oauth-serving-cert\") pod \"console-7f88bbcffb-b7z9j\" (UID: \"4473e901-c297-4298-b314-1c31a91d3510\") " pod="openshift-console/console-7f88bbcffb-b7z9j" Jun 11 18:32:20.982595 ip-10-0-130-170 kubenswrapper[2565]: I0611 18:32:20.982574 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/4473e901-c297-4298-b314-1c31a91d3510-console-config\") pod \"console-7f88bbcffb-b7z9j\" (UID: \"4473e901-c297-4298-b314-1c31a91d3510\") " pod="openshift-console/console-7f88bbcffb-b7z9j" Jun 11 18:32:20.982667 ip-10-0-130-170 kubenswrapper[2565]: I0611 18:32:20.982644 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/4473e901-c297-4298-b314-1c31a91d3510-trusted-ca-bundle\") pod \"console-7f88bbcffb-b7z9j\" (UID: \"4473e901-c297-4298-b314-1c31a91d3510\") " pod="openshift-console/console-7f88bbcffb-b7z9j" Jun 11 18:32:20.984018 ip-10-0-130-170 kubenswrapper[2565]: I0611 18:32:20.983999 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/4473e901-c297-4298-b314-1c31a91d3510-console-oauth-config\") pod \"console-7f88bbcffb-b7z9j\" (UID: \"4473e901-c297-4298-b314-1c31a91d3510\") " pod="openshift-console/console-7f88bbcffb-b7z9j" Jun 11 18:32:20.984119 ip-10-0-130-170 kubenswrapper[2565]: I0611 18:32:20.984096 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/4473e901-c297-4298-b314-1c31a91d3510-console-serving-cert\") pod \"console-7f88bbcffb-b7z9j\" (UID: \"4473e901-c297-4298-b314-1c31a91d3510\") " pod="openshift-console/console-7f88bbcffb-b7z9j" Jun 11 18:32:20.989516 ip-10-0-130-170 kubenswrapper[2565]: I0611 18:32:20.989487 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-wgqcp\" (UniqueName: \"kubernetes.io/projected/4473e901-c297-4298-b314-1c31a91d3510-kube-api-access-wgqcp\") pod \"console-7f88bbcffb-b7z9j\" (UID: \"4473e901-c297-4298-b314-1c31a91d3510\") " pod="openshift-console/console-7f88bbcffb-b7z9j" Jun 11 18:32:21.085426 ip-10-0-130-170 kubenswrapper[2565]: I0611 18:32:21.085336 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-7f88bbcffb-b7z9j" Jun 11 18:32:21.216142 ip-10-0-130-170 kubenswrapper[2565]: I0611 18:32:21.216114 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-7f88bbcffb-b7z9j"] Jun 11 18:32:21.218579 ip-10-0-130-170 kubenswrapper[2565]: W0611 18:32:21.218546 2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4473e901_c297_4298_b314_1c31a91d3510.slice/crio-7b3ad074652a92b38f8c56a927c310bd64f1006f9f510d2e3ac5941f06cc20db WatchSource:0}: Error finding container 7b3ad074652a92b38f8c56a927c310bd64f1006f9f510d2e3ac5941f06cc20db: Status 404 returned error can't find the container with id 7b3ad074652a92b38f8c56a927c310bd64f1006f9f510d2e3ac5941f06cc20db Jun 11 18:32:21.575044 ip-10-0-130-170 kubenswrapper[2565]: I0611 18:32:21.575005 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-7f88bbcffb-b7z9j" event={"ID":"4473e901-c297-4298-b314-1c31a91d3510","Type":"ContainerStarted","Data":"7b3ad074652a92b38f8c56a927c310bd64f1006f9f510d2e3ac5941f06cc20db"} Jun 11 18:32:24.137510 ip-10-0-130-170 kubenswrapper[2565]: I0611 18:32:24.137465 2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/openshift-state-metrics-6b8d965dd5-wdstt"] Jun 11 18:32:24.140659 ip-10-0-130-170 kubenswrapper[2565]: I0611 18:32:24.140634 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/openshift-state-metrics-6b8d965dd5-wdstt" Jun 11 18:32:24.143326 ip-10-0-130-170 kubenswrapper[2565]: I0611 18:32:24.143301 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"openshift-state-metrics-tls\"" Jun 11 18:32:24.143475 ip-10-0-130-170 kubenswrapper[2565]: I0611 18:32:24.143335 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"openshift-state-metrics-kube-rbac-proxy-config\"" Jun 11 18:32:24.143787 ip-10-0-130-170 kubenswrapper[2565]: I0611 18:32:24.143772 2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"openshift-service-ca.crt\"" Jun 11 18:32:24.144591 ip-10-0-130-170 kubenswrapper[2565]: I0611 18:32:24.144572 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"openshift-state-metrics-dockercfg-p8mzv\"" Jun 11 18:32:24.144736 ip-10-0-130-170 kubenswrapper[2565]: I0611 18:32:24.144579 2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kube-root-ca.crt\"" Jun 11 18:32:24.144856 ip-10-0-130-170 kubenswrapper[2565]: I0611 18:32:24.144583 2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"metrics-client-ca\"" Jun 11 18:32:24.152199 ip-10-0-130-170 kubenswrapper[2565]: I0611 18:32:24.152178 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/openshift-state-metrics-6b8d965dd5-wdstt"] Jun 11 18:32:24.175546 ip-10-0-130-170 kubenswrapper[2565]: I0611 18:32:24.175519 2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/kube-state-metrics-678bc549d7-89x49"] Jun 11 18:32:24.178171 ip-10-0-130-170 kubenswrapper[2565]: I0611 18:32:24.178116 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/kube-state-metrics-678bc549d7-89x49" Jun 11 18:32:24.181062 ip-10-0-130-170 kubenswrapper[2565]: I0611 18:32:24.180859 2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-custom-resource-state-configmap\"" Jun 11 18:32:24.181062 ip-10-0-130-170 kubenswrapper[2565]: I0611 18:32:24.180952 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-kube-rbac-proxy-config\"" Jun 11 18:32:24.181221 ip-10-0-130-170 kubenswrapper[2565]: I0611 18:32:24.181133 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-dockercfg-5hpv9\"" Jun 11 18:32:24.184052 ip-10-0-130-170 kubenswrapper[2565]: I0611 18:32:24.184031 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-tls\"" Jun 11 18:32:24.194298 ip-10-0-130-170 kubenswrapper[2565]: I0611 18:32:24.194276 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/kube-state-metrics-678bc549d7-89x49"] Jun 11 18:32:24.196983 ip-10-0-130-170 kubenswrapper[2565]: I0611 18:32:24.196963 2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/node-exporter-jthcp"] Jun 11 18:32:24.199332 ip-10-0-130-170 kubenswrapper[2565]: I0611 18:32:24.199314 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-jthcp" Jun 11 18:32:24.201884 ip-10-0-130-170 kubenswrapper[2565]: I0611 18:32:24.201866 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-kube-rbac-proxy-config\"" Jun 11 18:32:24.202084 ip-10-0-130-170 kubenswrapper[2565]: I0611 18:32:24.202062 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-dockercfg-w5qd2\"" Jun 11 18:32:24.202542 ip-10-0-130-170 kubenswrapper[2565]: I0611 18:32:24.202217 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-tls\"" Jun 11 18:32:24.202542 ip-10-0-130-170 kubenswrapper[2565]: I0611 18:32:24.202416 2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"node-exporter-accelerators-collector-config\"" Jun 11 18:32:24.208079 ip-10-0-130-170 kubenswrapper[2565]: I0611 18:32:24.208056 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/11ac62e4-72e1-48d7-8b55-a615e80ea6ca-kube-state-metrics-tls\") pod \"kube-state-metrics-678bc549d7-89x49\" (UID: \"11ac62e4-72e1-48d7-8b55-a615e80ea6ca\") " pod="openshift-monitoring/kube-state-metrics-678bc549d7-89x49" Jun 11 18:32:24.208174 ip-10-0-130-170 kubenswrapper[2565]: I0611 18:32:24.208120 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/11ac62e4-72e1-48d7-8b55-a615e80ea6ca-kube-state-metrics-kube-rbac-proxy-config\") pod \"kube-state-metrics-678bc549d7-89x49\" (UID: \"11ac62e4-72e1-48d7-8b55-a615e80ea6ca\") " pod="openshift-monitoring/kube-state-metrics-678bc549d7-89x49" Jun 11 18:32:24.208230 ip-10-0-130-170 kubenswrapper[2565]: I0611 18:32:24.208169 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/c9e106ea-f5bb-4fe9-9c47-b57141e42b07-openshift-state-metrics-tls\") pod \"openshift-state-metrics-6b8d965dd5-wdstt\" (UID: \"c9e106ea-f5bb-4fe9-9c47-b57141e42b07\") " pod="openshift-monitoring/openshift-state-metrics-6b8d965dd5-wdstt" Jun 11 18:32:24.208298 ip-10-0-130-170 kubenswrapper[2565]: I0611 18:32:24.208240 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/11ac62e4-72e1-48d7-8b55-a615e80ea6ca-metrics-client-ca\") pod \"kube-state-metrics-678bc549d7-89x49\" (UID: \"11ac62e4-72e1-48d7-8b55-a615e80ea6ca\") " pod="openshift-monitoring/kube-state-metrics-678bc549d7-89x49" Jun 11 18:32:24.208298 ip-10-0-130-170 kubenswrapper[2565]: I0611 18:32:24.208284 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-fkwqn\" (UniqueName: \"kubernetes.io/projected/11ac62e4-72e1-48d7-8b55-a615e80ea6ca-kube-api-access-fkwqn\") pod \"kube-state-metrics-678bc549d7-89x49\" (UID: \"11ac62e4-72e1-48d7-8b55-a615e80ea6ca\") " pod="openshift-monitoring/kube-state-metrics-678bc549d7-89x49" Jun 11 18:32:24.208378 ip-10-0-130-170 kubenswrapper[2565]: I0611 18:32:24.208332 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/c9e106ea-f5bb-4fe9-9c47-b57141e42b07-metrics-client-ca\") pod \"openshift-state-metrics-6b8d965dd5-wdstt\" (UID: \"c9e106ea-f5bb-4fe9-9c47-b57141e42b07\") " pod="openshift-monitoring/openshift-state-metrics-6b8d965dd5-wdstt" Jun 11 18:32:24.208378 ip-10-0-130-170 kubenswrapper[2565]: I0611 18:32:24.208362 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-state-metrics-custom-resource-state-configmap\" (UniqueName: \"kubernetes.io/configmap/11ac62e4-72e1-48d7-8b55-a615e80ea6ca-kube-state-metrics-custom-resource-state-configmap\") pod \"kube-state-metrics-678bc549d7-89x49\" (UID: \"11ac62e4-72e1-48d7-8b55-a615e80ea6ca\") " pod="openshift-monitoring/kube-state-metrics-678bc549d7-89x49" Jun 11 18:32:24.208464 ip-10-0-130-170 kubenswrapper[2565]: I0611 18:32:24.208444 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"volume-directive-shadow\" (UniqueName: \"kubernetes.io/empty-dir/11ac62e4-72e1-48d7-8b55-a615e80ea6ca-volume-directive-shadow\") pod \"kube-state-metrics-678bc549d7-89x49\" (UID: \"11ac62e4-72e1-48d7-8b55-a615e80ea6ca\") " pod="openshift-monitoring/kube-state-metrics-678bc549d7-89x49" Jun 11 18:32:24.208541 ip-10-0-130-170 kubenswrapper[2565]: I0611 18:32:24.208525 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-j2gb5\" (UniqueName: \"kubernetes.io/projected/c9e106ea-f5bb-4fe9-9c47-b57141e42b07-kube-api-access-j2gb5\") pod \"openshift-state-metrics-6b8d965dd5-wdstt\" (UID: \"c9e106ea-f5bb-4fe9-9c47-b57141e42b07\") " pod="openshift-monitoring/openshift-state-metrics-6b8d965dd5-wdstt" Jun 11 18:32:24.208582 ip-10-0-130-170 kubenswrapper[2565]: I0611 18:32:24.208562 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/c9e106ea-f5bb-4fe9-9c47-b57141e42b07-openshift-state-metrics-kube-rbac-proxy-config\") pod \"openshift-state-metrics-6b8d965dd5-wdstt\" (UID: \"c9e106ea-f5bb-4fe9-9c47-b57141e42b07\") " pod="openshift-monitoring/openshift-state-metrics-6b8d965dd5-wdstt" Jun 11 18:32:24.309863 ip-10-0-130-170 kubenswrapper[2565]: I0611 18:32:24.309824 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/11ac62e4-72e1-48d7-8b55-a615e80ea6ca-kube-state-metrics-kube-rbac-proxy-config\") pod \"kube-state-metrics-678bc549d7-89x49\" (UID: \"11ac62e4-72e1-48d7-8b55-a615e80ea6ca\") " pod="openshift-monitoring/kube-state-metrics-678bc549d7-89x49" Jun 11 18:32:24.309863 ip-10-0-130-170 kubenswrapper[2565]: I0611 18:32:24.309860 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/c9e106ea-f5bb-4fe9-9c47-b57141e42b07-openshift-state-metrics-tls\") pod \"openshift-state-metrics-6b8d965dd5-wdstt\" (UID: \"c9e106ea-f5bb-4fe9-9c47-b57141e42b07\") " pod="openshift-monitoring/openshift-state-metrics-6b8d965dd5-wdstt" Jun 11 18:32:24.310086 ip-10-0-130-170 kubenswrapper[2565]: I0611 18:32:24.309894 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/11ac62e4-72e1-48d7-8b55-a615e80ea6ca-metrics-client-ca\") pod \"kube-state-metrics-678bc549d7-89x49\" (UID: \"11ac62e4-72e1-48d7-8b55-a615e80ea6ca\") " pod="openshift-monitoring/kube-state-metrics-678bc549d7-89x49" Jun 11 18:32:24.310086 ip-10-0-130-170 kubenswrapper[2565]: I0611 18:32:24.309966 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-fkwqn\" (UniqueName: \"kubernetes.io/projected/11ac62e4-72e1-48d7-8b55-a615e80ea6ca-kube-api-access-fkwqn\") pod \"kube-state-metrics-678bc549d7-89x49\" (UID: \"11ac62e4-72e1-48d7-8b55-a615e80ea6ca\") " pod="openshift-monitoring/kube-state-metrics-678bc549d7-89x49" Jun 11 18:32:24.310086 ip-10-0-130-170 kubenswrapper[2565]: I0611 18:32:24.310020 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/c9e106ea-f5bb-4fe9-9c47-b57141e42b07-metrics-client-ca\") pod \"openshift-state-metrics-6b8d965dd5-wdstt\" (UID: \"c9e106ea-f5bb-4fe9-9c47-b57141e42b07\") " pod="openshift-monitoring/openshift-state-metrics-6b8d965dd5-wdstt" Jun 11 18:32:24.310086 ip-10-0-130-170 kubenswrapper[2565]: I0611 18:32:24.310052 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-state-metrics-custom-resource-state-configmap\" (UniqueName: \"kubernetes.io/configmap/11ac62e4-72e1-48d7-8b55-a615e80ea6ca-kube-state-metrics-custom-resource-state-configmap\") pod \"kube-state-metrics-678bc549d7-89x49\" (UID: \"11ac62e4-72e1-48d7-8b55-a615e80ea6ca\") " pod="openshift-monitoring/kube-state-metrics-678bc549d7-89x49" Jun 11 18:32:24.310086 ip-10-0-130-170 kubenswrapper[2565]: I0611 18:32:24.310085 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/89eea2f5-d058-4ebf-b5f8-d6dbb8c40369-node-exporter-accelerators-collector-config\") pod \"node-exporter-jthcp\" (UID: \"89eea2f5-d058-4ebf-b5f8-d6dbb8c40369\") " pod="openshift-monitoring/node-exporter-jthcp" Jun 11 18:32:24.310361 ip-10-0-130-170 kubenswrapper[2565]: I0611 18:32:24.310247 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/89eea2f5-d058-4ebf-b5f8-d6dbb8c40369-sys\") pod \"node-exporter-jthcp\" (UID: \"89eea2f5-d058-4ebf-b5f8-d6dbb8c40369\") " pod="openshift-monitoring/node-exporter-jthcp" Jun 11 18:32:24.310361 ip-10-0-130-170 kubenswrapper[2565]: I0611 18:32:24.310294 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/89eea2f5-d058-4ebf-b5f8-d6dbb8c40369-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-jthcp\" (UID: \"89eea2f5-d058-4ebf-b5f8-d6dbb8c40369\") " pod="openshift-monitoring/node-exporter-jthcp" Jun 11 18:32:24.310473 ip-10-0-130-170 kubenswrapper[2565]: I0611 18:32:24.310360 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"volume-directive-shadow\" (UniqueName: \"kubernetes.io/empty-dir/11ac62e4-72e1-48d7-8b55-a615e80ea6ca-volume-directive-shadow\") pod \"kube-state-metrics-678bc549d7-89x49\" (UID: \"11ac62e4-72e1-48d7-8b55-a615e80ea6ca\") " pod="openshift-monitoring/kube-state-metrics-678bc549d7-89x49" Jun 11 18:32:24.310473 ip-10-0-130-170 kubenswrapper[2565]: I0611 18:32:24.310443 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/89eea2f5-d058-4ebf-b5f8-d6dbb8c40369-node-exporter-textfile\") pod \"node-exporter-jthcp\" (UID: \"89eea2f5-d058-4ebf-b5f8-d6dbb8c40369\") " pod="openshift-monitoring/node-exporter-jthcp" Jun 11 18:32:24.310574 ip-10-0-130-170 kubenswrapper[2565]: I0611 18:32:24.310506 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-j2gb5\" (UniqueName: \"kubernetes.io/projected/c9e106ea-f5bb-4fe9-9c47-b57141e42b07-kube-api-access-j2gb5\") pod \"openshift-state-metrics-6b8d965dd5-wdstt\" (UID: \"c9e106ea-f5bb-4fe9-9c47-b57141e42b07\") " pod="openshift-monitoring/openshift-state-metrics-6b8d965dd5-wdstt" Jun 11 18:32:24.310574 ip-10-0-130-170 kubenswrapper[2565]: I0611 18:32:24.310536 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/89eea2f5-d058-4ebf-b5f8-d6dbb8c40369-root\") pod \"node-exporter-jthcp\" (UID: \"89eea2f5-d058-4ebf-b5f8-d6dbb8c40369\") " pod="openshift-monitoring/node-exporter-jthcp" Jun 11 18:32:24.310574 ip-10-0-130-170 kubenswrapper[2565]: I0611 18:32:24.310559 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/89eea2f5-d058-4ebf-b5f8-d6dbb8c40369-node-exporter-tls\") pod \"node-exporter-jthcp\" (UID: \"89eea2f5-d058-4ebf-b5f8-d6dbb8c40369\") " pod="openshift-monitoring/node-exporter-jthcp" Jun 11 18:32:24.310721 ip-10-0-130-170 kubenswrapper[2565]: I0611 18:32:24.310593 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/c9e106ea-f5bb-4fe9-9c47-b57141e42b07-openshift-state-metrics-kube-rbac-proxy-config\") pod \"openshift-state-metrics-6b8d965dd5-wdstt\" (UID: \"c9e106ea-f5bb-4fe9-9c47-b57141e42b07\") " pod="openshift-monitoring/openshift-state-metrics-6b8d965dd5-wdstt" Jun 11 18:32:24.310721 ip-10-0-130-170 kubenswrapper[2565]: I0611 18:32:24.310632 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/89eea2f5-d058-4ebf-b5f8-d6dbb8c40369-node-exporter-wtmp\") pod \"node-exporter-jthcp\" (UID: \"89eea2f5-d058-4ebf-b5f8-d6dbb8c40369\") " pod="openshift-monitoring/node-exporter-jthcp" Jun 11 18:32:24.310721 ip-10-0-130-170 kubenswrapper[2565]: I0611 18:32:24.310664 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/11ac62e4-72e1-48d7-8b55-a615e80ea6ca-kube-state-metrics-tls\") pod \"kube-state-metrics-678bc549d7-89x49\" (UID: \"11ac62e4-72e1-48d7-8b55-a615e80ea6ca\") " pod="openshift-monitoring/kube-state-metrics-678bc549d7-89x49" Jun 11 18:32:24.310721 ip-10-0-130-170 kubenswrapper[2565]: I0611 18:32:24.310700 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/89eea2f5-d058-4ebf-b5f8-d6dbb8c40369-metrics-client-ca\") pod \"node-exporter-jthcp\" (UID: \"89eea2f5-d058-4ebf-b5f8-d6dbb8c40369\") " pod="openshift-monitoring/node-exporter-jthcp" Jun 11 18:32:24.310911 ip-10-0-130-170 kubenswrapper[2565]: I0611 18:32:24.310722 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-v7fcr\" (UniqueName: \"kubernetes.io/projected/89eea2f5-d058-4ebf-b5f8-d6dbb8c40369-kube-api-access-v7fcr\") pod \"node-exporter-jthcp\" (UID: \"89eea2f5-d058-4ebf-b5f8-d6dbb8c40369\") " pod="openshift-monitoring/node-exporter-jthcp" Jun 11 18:32:24.310911 ip-10-0-130-170 kubenswrapper[2565]: I0611 18:32:24.310769 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"volume-directive-shadow\" (UniqueName: \"kubernetes.io/empty-dir/11ac62e4-72e1-48d7-8b55-a615e80ea6ca-volume-directive-shadow\") pod \"kube-state-metrics-678bc549d7-89x49\" (UID: \"11ac62e4-72e1-48d7-8b55-a615e80ea6ca\") " pod="openshift-monitoring/kube-state-metrics-678bc549d7-89x49" Jun 11 18:32:24.310911 ip-10-0-130-170 kubenswrapper[2565]: I0611 18:32:24.310818 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/11ac62e4-72e1-48d7-8b55-a615e80ea6ca-metrics-client-ca\") pod \"kube-state-metrics-678bc549d7-89x49\" (UID: \"11ac62e4-72e1-48d7-8b55-a615e80ea6ca\") " pod="openshift-monitoring/kube-state-metrics-678bc549d7-89x49" Jun 11 18:32:24.310911 ip-10-0-130-170 kubenswrapper[2565]: I0611 18:32:24.310818 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-state-metrics-custom-resource-state-configmap\" (UniqueName: \"kubernetes.io/configmap/11ac62e4-72e1-48d7-8b55-a615e80ea6ca-kube-state-metrics-custom-resource-state-configmap\") pod \"kube-state-metrics-678bc549d7-89x49\" (UID: \"11ac62e4-72e1-48d7-8b55-a615e80ea6ca\") " pod="openshift-monitoring/kube-state-metrics-678bc549d7-89x49" Jun 11 18:32:24.311188 ip-10-0-130-170 kubenswrapper[2565]: I0611 18:32:24.311157 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/c9e106ea-f5bb-4fe9-9c47-b57141e42b07-metrics-client-ca\") pod \"openshift-state-metrics-6b8d965dd5-wdstt\" (UID: \"c9e106ea-f5bb-4fe9-9c47-b57141e42b07\") " pod="openshift-monitoring/openshift-state-metrics-6b8d965dd5-wdstt" Jun 11 18:32:24.313170 ip-10-0-130-170 kubenswrapper[2565]: I0611 18:32:24.312834 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/11ac62e4-72e1-48d7-8b55-a615e80ea6ca-kube-state-metrics-kube-rbac-proxy-config\") pod \"kube-state-metrics-678bc549d7-89x49\" (UID: \"11ac62e4-72e1-48d7-8b55-a615e80ea6ca\") " pod="openshift-monitoring/kube-state-metrics-678bc549d7-89x49" Jun 11 18:32:24.313170 ip-10-0-130-170 kubenswrapper[2565]: I0611 18:32:24.313135 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"openshift-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/c9e106ea-f5bb-4fe9-9c47-b57141e42b07-openshift-state-metrics-kube-rbac-proxy-config\") pod \"openshift-state-metrics-6b8d965dd5-wdstt\" (UID: \"c9e106ea-f5bb-4fe9-9c47-b57141e42b07\") " pod="openshift-monitoring/openshift-state-metrics-6b8d965dd5-wdstt" Jun 11 18:32:24.313368 ip-10-0-130-170 kubenswrapper[2565]: I0611 18:32:24.313352 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/11ac62e4-72e1-48d7-8b55-a615e80ea6ca-kube-state-metrics-tls\") pod \"kube-state-metrics-678bc549d7-89x49\" (UID: \"11ac62e4-72e1-48d7-8b55-a615e80ea6ca\") " pod="openshift-monitoring/kube-state-metrics-678bc549d7-89x49" Jun 11 18:32:24.313656 ip-10-0-130-170 kubenswrapper[2565]: I0611 18:32:24.313637 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"openshift-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/c9e106ea-f5bb-4fe9-9c47-b57141e42b07-openshift-state-metrics-tls\") pod \"openshift-state-metrics-6b8d965dd5-wdstt\" (UID: \"c9e106ea-f5bb-4fe9-9c47-b57141e42b07\") " pod="openshift-monitoring/openshift-state-metrics-6b8d965dd5-wdstt" Jun 11 18:32:24.318622 ip-10-0-130-170 kubenswrapper[2565]: I0611 18:32:24.318599 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-j2gb5\" (UniqueName: \"kubernetes.io/projected/c9e106ea-f5bb-4fe9-9c47-b57141e42b07-kube-api-access-j2gb5\") pod \"openshift-state-metrics-6b8d965dd5-wdstt\" (UID: \"c9e106ea-f5bb-4fe9-9c47-b57141e42b07\") " pod="openshift-monitoring/openshift-state-metrics-6b8d965dd5-wdstt" Jun 11 18:32:24.319075 ip-10-0-130-170 kubenswrapper[2565]: I0611 18:32:24.319054 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-fkwqn\" (UniqueName: \"kubernetes.io/projected/11ac62e4-72e1-48d7-8b55-a615e80ea6ca-kube-api-access-fkwqn\") pod \"kube-state-metrics-678bc549d7-89x49\" (UID: \"11ac62e4-72e1-48d7-8b55-a615e80ea6ca\") " pod="openshift-monitoring/kube-state-metrics-678bc549d7-89x49" Jun 11 18:32:24.412044 ip-10-0-130-170 kubenswrapper[2565]: I0611 18:32:24.412008 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/89eea2f5-d058-4ebf-b5f8-d6dbb8c40369-node-exporter-textfile\") pod \"node-exporter-jthcp\" (UID: \"89eea2f5-d058-4ebf-b5f8-d6dbb8c40369\") " pod="openshift-monitoring/node-exporter-jthcp" Jun 11 18:32:24.412249 ip-10-0-130-170 kubenswrapper[2565]: I0611 18:32:24.412062 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/89eea2f5-d058-4ebf-b5f8-d6dbb8c40369-root\") pod \"node-exporter-jthcp\" (UID: \"89eea2f5-d058-4ebf-b5f8-d6dbb8c40369\") " pod="openshift-monitoring/node-exporter-jthcp" Jun 11 18:32:24.412249 ip-10-0-130-170 kubenswrapper[2565]: I0611 18:32:24.412087 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/89eea2f5-d058-4ebf-b5f8-d6dbb8c40369-node-exporter-tls\") pod \"node-exporter-jthcp\" (UID: \"89eea2f5-d058-4ebf-b5f8-d6dbb8c40369\") " pod="openshift-monitoring/node-exporter-jthcp" Jun 11 18:32:24.412249 ip-10-0-130-170 kubenswrapper[2565]: I0611 18:32:24.412119 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/89eea2f5-d058-4ebf-b5f8-d6dbb8c40369-node-exporter-wtmp\") pod \"node-exporter-jthcp\" (UID: \"89eea2f5-d058-4ebf-b5f8-d6dbb8c40369\") " pod="openshift-monitoring/node-exporter-jthcp" Jun 11 18:32:24.412249 ip-10-0-130-170 kubenswrapper[2565]: I0611 18:32:24.412142 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"root\" (UniqueName: \"kubernetes.io/host-path/89eea2f5-d058-4ebf-b5f8-d6dbb8c40369-root\") pod \"node-exporter-jthcp\" (UID: \"89eea2f5-d058-4ebf-b5f8-d6dbb8c40369\") " pod="openshift-monitoring/node-exporter-jthcp" Jun 11 18:32:24.412249 ip-10-0-130-170 kubenswrapper[2565]: I0611 18:32:24.412157 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/89eea2f5-d058-4ebf-b5f8-d6dbb8c40369-metrics-client-ca\") pod \"node-exporter-jthcp\" (UID: \"89eea2f5-d058-4ebf-b5f8-d6dbb8c40369\") " pod="openshift-monitoring/node-exporter-jthcp" Jun 11 18:32:24.412249 ip-10-0-130-170 kubenswrapper[2565]: I0611 18:32:24.412181 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-v7fcr\" (UniqueName: \"kubernetes.io/projected/89eea2f5-d058-4ebf-b5f8-d6dbb8c40369-kube-api-access-v7fcr\") pod \"node-exporter-jthcp\" (UID: \"89eea2f5-d058-4ebf-b5f8-d6dbb8c40369\") " pod="openshift-monitoring/node-exporter-jthcp" Jun 11 18:32:24.412591 ip-10-0-130-170 kubenswrapper[2565]: I0611 18:32:24.412284 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/89eea2f5-d058-4ebf-b5f8-d6dbb8c40369-node-exporter-accelerators-collector-config\") pod \"node-exporter-jthcp\" (UID: \"89eea2f5-d058-4ebf-b5f8-d6dbb8c40369\") " pod="openshift-monitoring/node-exporter-jthcp" Jun 11 18:32:24.412591 ip-10-0-130-170 kubenswrapper[2565]: I0611 18:32:24.412324 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/89eea2f5-d058-4ebf-b5f8-d6dbb8c40369-node-exporter-wtmp\") pod \"node-exporter-jthcp\" (UID: \"89eea2f5-d058-4ebf-b5f8-d6dbb8c40369\") " pod="openshift-monitoring/node-exporter-jthcp" Jun 11 18:32:24.412591 ip-10-0-130-170 kubenswrapper[2565]: I0611 18:32:24.412330 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/89eea2f5-d058-4ebf-b5f8-d6dbb8c40369-sys\") pod \"node-exporter-jthcp\" (UID: \"89eea2f5-d058-4ebf-b5f8-d6dbb8c40369\") " pod="openshift-monitoring/node-exporter-jthcp" Jun 11 18:32:24.412591 ip-10-0-130-170 kubenswrapper[2565]: I0611 18:32:24.412373 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/89eea2f5-d058-4ebf-b5f8-d6dbb8c40369-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-jthcp\" (UID: \"89eea2f5-d058-4ebf-b5f8-d6dbb8c40369\") " pod="openshift-monitoring/node-exporter-jthcp" Jun 11 18:32:24.412591 ip-10-0-130-170 kubenswrapper[2565]: I0611 18:32:24.412378 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/89eea2f5-d058-4ebf-b5f8-d6dbb8c40369-sys\") pod \"node-exporter-jthcp\" (UID: \"89eea2f5-d058-4ebf-b5f8-d6dbb8c40369\") " pod="openshift-monitoring/node-exporter-jthcp" Jun 11 18:32:24.412591 ip-10-0-130-170 kubenswrapper[2565]: I0611 18:32:24.412446 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/89eea2f5-d058-4ebf-b5f8-d6dbb8c40369-node-exporter-textfile\") pod \"node-exporter-jthcp\" (UID: \"89eea2f5-d058-4ebf-b5f8-d6dbb8c40369\") " pod="openshift-monitoring/node-exporter-jthcp" Jun 11 18:32:24.412884 ip-10-0-130-170 kubenswrapper[2565]: I0611 18:32:24.412767 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/89eea2f5-d058-4ebf-b5f8-d6dbb8c40369-metrics-client-ca\") pod \"node-exporter-jthcp\" (UID: \"89eea2f5-d058-4ebf-b5f8-d6dbb8c40369\") " pod="openshift-monitoring/node-exporter-jthcp" Jun 11 18:32:24.412884 ip-10-0-130-170 kubenswrapper[2565]: I0611 18:32:24.412829 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/89eea2f5-d058-4ebf-b5f8-d6dbb8c40369-node-exporter-accelerators-collector-config\") pod \"node-exporter-jthcp\" (UID: \"89eea2f5-d058-4ebf-b5f8-d6dbb8c40369\") " pod="openshift-monitoring/node-exporter-jthcp" Jun 11 18:32:24.414773 ip-10-0-130-170 kubenswrapper[2565]: I0611 18:32:24.414751 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/89eea2f5-d058-4ebf-b5f8-d6dbb8c40369-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-jthcp\" (UID: \"89eea2f5-d058-4ebf-b5f8-d6dbb8c40369\") " pod="openshift-monitoring/node-exporter-jthcp" Jun 11 18:32:24.414773 ip-10-0-130-170 kubenswrapper[2565]: I0611 18:32:24.414761 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/89eea2f5-d058-4ebf-b5f8-d6dbb8c40369-node-exporter-tls\") pod \"node-exporter-jthcp\" (UID: \"89eea2f5-d058-4ebf-b5f8-d6dbb8c40369\") " pod="openshift-monitoring/node-exporter-jthcp" Jun 11 18:32:24.421735 ip-10-0-130-170 kubenswrapper[2565]: I0611 18:32:24.421712 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-v7fcr\" (UniqueName: \"kubernetes.io/projected/89eea2f5-d058-4ebf-b5f8-d6dbb8c40369-kube-api-access-v7fcr\") pod \"node-exporter-jthcp\" (UID: \"89eea2f5-d058-4ebf-b5f8-d6dbb8c40369\") " pod="openshift-monitoring/node-exporter-jthcp" Jun 11 18:32:24.451651 ip-10-0-130-170 kubenswrapper[2565]: I0611 18:32:24.451575 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/openshift-state-metrics-6b8d965dd5-wdstt" Jun 11 18:32:24.489711 ip-10-0-130-170 kubenswrapper[2565]: I0611 18:32:24.489672 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/kube-state-metrics-678bc549d7-89x49" Jun 11 18:32:24.511020 ip-10-0-130-170 kubenswrapper[2565]: I0611 18:32:24.509532 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-jthcp" Jun 11 18:32:24.524641 ip-10-0-130-170 kubenswrapper[2565]: W0611 18:32:24.524578 2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod89eea2f5_d058_4ebf_b5f8_d6dbb8c40369.slice/crio-fe5e83e013ab50bc81eec69ffa868bce95cb29b9e0e086f23a2ec275c0f59344 WatchSource:0}: Error finding container fe5e83e013ab50bc81eec69ffa868bce95cb29b9e0e086f23a2ec275c0f59344: Status 404 returned error can't find the container with id fe5e83e013ab50bc81eec69ffa868bce95cb29b9e0e086f23a2ec275c0f59344 Jun 11 18:32:24.588673 ip-10-0-130-170 kubenswrapper[2565]: I0611 18:32:24.588641 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-jthcp" event={"ID":"89eea2f5-d058-4ebf-b5f8-d6dbb8c40369","Type":"ContainerStarted","Data":"fe5e83e013ab50bc81eec69ffa868bce95cb29b9e0e086f23a2ec275c0f59344"} Jun 11 18:32:24.590419 ip-10-0-130-170 kubenswrapper[2565]: I0611 18:32:24.590393 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-7f88bbcffb-b7z9j" event={"ID":"4473e901-c297-4298-b314-1c31a91d3510","Type":"ContainerStarted","Data":"f6efb8bc72995ef2509b2d16f9e39dad29583482446fb40f9d7c4b1cbd5e297f"} Jun 11 18:32:24.601735 ip-10-0-130-170 kubenswrapper[2565]: I0611 18:32:24.601711 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/openshift-state-metrics-6b8d965dd5-wdstt"] Jun 11 18:32:24.603927 ip-10-0-130-170 kubenswrapper[2565]: W0611 18:32:24.603900 2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc9e106ea_f5bb_4fe9_9c47_b57141e42b07.slice/crio-488bfd4c2623381e11f461294318f6cc85aac9a1b9161941e921c86d255d1e8b WatchSource:0}: Error finding container 488bfd4c2623381e11f461294318f6cc85aac9a1b9161941e921c86d255d1e8b: Status 404 returned error can't find the container with id 488bfd4c2623381e11f461294318f6cc85aac9a1b9161941e921c86d255d1e8b Jun 11 18:32:24.615918 ip-10-0-130-170 kubenswrapper[2565]: I0611 18:32:24.615848 2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-7f88bbcffb-b7z9j" podStartSLOduration=1.9066665120000001 podStartE2EDuration="4.615831531s" totalImagesPullingTime="2.709165019s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-11 18:32:20 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-11 18:32:24.615025293 +0000 UTC m=+263.363711355" watchObservedRunningTime="2026-06-11 18:32:24.615831531 +0000 UTC m=+263.364517594" Jun 11 18:32:24.647687 ip-10-0-130-170 kubenswrapper[2565]: I0611 18:32:24.647556 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/kube-state-metrics-678bc549d7-89x49"] Jun 11 18:32:24.657424 ip-10-0-130-170 kubenswrapper[2565]: W0611 18:32:24.657392 2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod11ac62e4_72e1_48d7_8b55_a615e80ea6ca.slice/crio-72906e24155dd828eeca2a42f92a7397381a98038da25dab5bf616e78ae837d3 WatchSource:0}: Error finding container 72906e24155dd828eeca2a42f92a7397381a98038da25dab5bf616e78ae837d3: Status 404 returned error can't find the container with id 72906e24155dd828eeca2a42f92a7397381a98038da25dab5bf616e78ae837d3 Jun 11 18:32:25.225042 ip-10-0-130-170 kubenswrapper[2565]: I0611 18:32:25.225004 2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Jun 11 18:32:25.227877 ip-10-0-130-170 kubenswrapper[2565]: I0611 18:32:25.227849 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0" Jun 11 18:32:25.230699 ip-10-0-130-170 kubenswrapper[2565]: I0611 18:32:25.230509 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-tls-assets-0\"" Jun 11 18:32:25.230699 ip-10-0-130-170 kubenswrapper[2565]: I0611 18:32:25.230529 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy-web\"" Jun 11 18:32:25.230699 ip-10-0-130-170 kubenswrapper[2565]: I0611 18:32:25.230552 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy\"" Jun 11 18:32:25.230699 ip-10-0-130-170 kubenswrapper[2565]: I0611 18:32:25.230531 2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"alertmanager-trusted-ca-bundle\"" Jun 11 18:32:25.230699 ip-10-0-130-170 kubenswrapper[2565]: I0611 18:32:25.230573 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-dockercfg-rjchx\"" Jun 11 18:32:25.230699 ip-10-0-130-170 kubenswrapper[2565]: I0611 18:32:25.230689 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-cluster-tls-config\"" Jun 11 18:32:25.230970 ip-10-0-130-170 kubenswrapper[2565]: I0611 18:32:25.230867 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-web-config\"" Jun 11 18:32:25.230970 ip-10-0-130-170 kubenswrapper[2565]: I0611 18:32:25.230952 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-tls\"" Jun 11 18:32:25.231046 ip-10-0-130-170 kubenswrapper[2565]: I0611 18:32:25.230992 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy-metric\"" Jun 11 18:32:25.231207 ip-10-0-130-170 kubenswrapper[2565]: I0611 18:32:25.231194 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-generated\"" Jun 11 18:32:25.245820 ip-10-0-130-170 kubenswrapper[2565]: I0611 18:32:25.245791 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Jun 11 18:32:25.322334 ip-10-0-130-170 kubenswrapper[2565]: I0611 18:32:25.322293 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/a198f4a2-26ba-432c-adae-ce340c910fe0-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"a198f4a2-26ba-432c-adae-ce340c910fe0\") " pod="openshift-monitoring/alertmanager-main-0" Jun 11 18:32:25.322506 ip-10-0-130-170 kubenswrapper[2565]: I0611 18:32:25.322394 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/a198f4a2-26ba-432c-adae-ce340c910fe0-config-volume\") pod \"alertmanager-main-0\" (UID: \"a198f4a2-26ba-432c-adae-ce340c910fe0\") " pod="openshift-monitoring/alertmanager-main-0" Jun 11 18:32:25.322506 ip-10-0-130-170 kubenswrapper[2565]: I0611 18:32:25.322432 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rbbr9\" (UniqueName: \"kubernetes.io/projected/a198f4a2-26ba-432c-adae-ce340c910fe0-kube-api-access-rbbr9\") pod \"alertmanager-main-0\" (UID: \"a198f4a2-26ba-432c-adae-ce340c910fe0\") " pod="openshift-monitoring/alertmanager-main-0" Jun 11 18:32:25.322506 ip-10-0-130-170 kubenswrapper[2565]: I0611 18:32:25.322463 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/a198f4a2-26ba-432c-adae-ce340c910fe0-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"a198f4a2-26ba-432c-adae-ce340c910fe0\") " pod="openshift-monitoring/alertmanager-main-0" Jun 11 18:32:25.322506 ip-10-0-130-170 kubenswrapper[2565]: I0611 18:32:25.322497 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/a198f4a2-26ba-432c-adae-ce340c910fe0-config-out\") pod \"alertmanager-main-0\" (UID: \"a198f4a2-26ba-432c-adae-ce340c910fe0\") " pod="openshift-monitoring/alertmanager-main-0" Jun 11 18:32:25.322751 ip-10-0-130-170 kubenswrapper[2565]: I0611 18:32:25.322550 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/a198f4a2-26ba-432c-adae-ce340c910fe0-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"a198f4a2-26ba-432c-adae-ce340c910fe0\") " pod="openshift-monitoring/alertmanager-main-0" Jun 11 18:32:25.322751 ip-10-0-130-170 kubenswrapper[2565]: I0611 18:32:25.322611 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/a198f4a2-26ba-432c-adae-ce340c910fe0-tls-assets\") pod \"alertmanager-main-0\" (UID: \"a198f4a2-26ba-432c-adae-ce340c910fe0\") " pod="openshift-monitoring/alertmanager-main-0" Jun 11 18:32:25.322751 ip-10-0-130-170 kubenswrapper[2565]: I0611 18:32:25.322643 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/a198f4a2-26ba-432c-adae-ce340c910fe0-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"a198f4a2-26ba-432c-adae-ce340c910fe0\") " pod="openshift-monitoring/alertmanager-main-0" Jun 11 18:32:25.322751 ip-10-0-130-170 kubenswrapper[2565]: I0611 18:32:25.322694 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/a198f4a2-26ba-432c-adae-ce340c910fe0-web-config\") pod \"alertmanager-main-0\" (UID: \"a198f4a2-26ba-432c-adae-ce340c910fe0\") " pod="openshift-monitoring/alertmanager-main-0" Jun 11 18:32:25.322751 ip-10-0-130-170 kubenswrapper[2565]: I0611 18:32:25.322731 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/a198f4a2-26ba-432c-adae-ce340c910fe0-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"a198f4a2-26ba-432c-adae-ce340c910fe0\") " pod="openshift-monitoring/alertmanager-main-0" Jun 11 18:32:25.323118 ip-10-0-130-170 kubenswrapper[2565]: I0611 18:32:25.322769 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/a198f4a2-26ba-432c-adae-ce340c910fe0-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"a198f4a2-26ba-432c-adae-ce340c910fe0\") " pod="openshift-monitoring/alertmanager-main-0" Jun 11 18:32:25.323118 ip-10-0-130-170 kubenswrapper[2565]: I0611 18:32:25.322794 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/a198f4a2-26ba-432c-adae-ce340c910fe0-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"a198f4a2-26ba-432c-adae-ce340c910fe0\") " pod="openshift-monitoring/alertmanager-main-0" Jun 11 18:32:25.323118 ip-10-0-130-170 kubenswrapper[2565]: I0611 18:32:25.322841 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/a198f4a2-26ba-432c-adae-ce340c910fe0-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"a198f4a2-26ba-432c-adae-ce340c910fe0\") " pod="openshift-monitoring/alertmanager-main-0" Jun 11 18:32:25.423614 ip-10-0-130-170 kubenswrapper[2565]: I0611 18:32:25.423579 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rbbr9\" (UniqueName: \"kubernetes.io/projected/a198f4a2-26ba-432c-adae-ce340c910fe0-kube-api-access-rbbr9\") pod \"alertmanager-main-0\" (UID: \"a198f4a2-26ba-432c-adae-ce340c910fe0\") " pod="openshift-monitoring/alertmanager-main-0" Jun 11 18:32:25.423812 ip-10-0-130-170 kubenswrapper[2565]: I0611 18:32:25.423632 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/a198f4a2-26ba-432c-adae-ce340c910fe0-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"a198f4a2-26ba-432c-adae-ce340c910fe0\") " pod="openshift-monitoring/alertmanager-main-0" Jun 11 18:32:25.423812 ip-10-0-130-170 kubenswrapper[2565]: I0611 18:32:25.423658 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/a198f4a2-26ba-432c-adae-ce340c910fe0-config-out\") pod \"alertmanager-main-0\" (UID: \"a198f4a2-26ba-432c-adae-ce340c910fe0\") " pod="openshift-monitoring/alertmanager-main-0" Jun 11 18:32:25.423812 ip-10-0-130-170 kubenswrapper[2565]: I0611 18:32:25.423692 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/a198f4a2-26ba-432c-adae-ce340c910fe0-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"a198f4a2-26ba-432c-adae-ce340c910fe0\") " pod="openshift-monitoring/alertmanager-main-0" Jun 11 18:32:25.423812 ip-10-0-130-170 kubenswrapper[2565]: I0611 18:32:25.423721 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/a198f4a2-26ba-432c-adae-ce340c910fe0-tls-assets\") pod \"alertmanager-main-0\" (UID: \"a198f4a2-26ba-432c-adae-ce340c910fe0\") " pod="openshift-monitoring/alertmanager-main-0" Jun 11 18:32:25.423812 ip-10-0-130-170 kubenswrapper[2565]: I0611 18:32:25.423747 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/a198f4a2-26ba-432c-adae-ce340c910fe0-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"a198f4a2-26ba-432c-adae-ce340c910fe0\") " pod="openshift-monitoring/alertmanager-main-0" Jun 11 18:32:25.423812 ip-10-0-130-170 kubenswrapper[2565]: I0611 18:32:25.423787 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/a198f4a2-26ba-432c-adae-ce340c910fe0-web-config\") pod \"alertmanager-main-0\" (UID: \"a198f4a2-26ba-432c-adae-ce340c910fe0\") " pod="openshift-monitoring/alertmanager-main-0" Jun 11 18:32:25.424095 ip-10-0-130-170 kubenswrapper[2565]: I0611 18:32:25.423822 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/a198f4a2-26ba-432c-adae-ce340c910fe0-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"a198f4a2-26ba-432c-adae-ce340c910fe0\") " pod="openshift-monitoring/alertmanager-main-0" Jun 11 18:32:25.424095 ip-10-0-130-170 kubenswrapper[2565]: I0611 18:32:25.423863 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/a198f4a2-26ba-432c-adae-ce340c910fe0-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"a198f4a2-26ba-432c-adae-ce340c910fe0\") " pod="openshift-monitoring/alertmanager-main-0" Jun 11 18:32:25.424095 ip-10-0-130-170 kubenswrapper[2565]: I0611 18:32:25.423889 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/a198f4a2-26ba-432c-adae-ce340c910fe0-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"a198f4a2-26ba-432c-adae-ce340c910fe0\") " pod="openshift-monitoring/alertmanager-main-0" Jun 11 18:32:25.424095 ip-10-0-130-170 kubenswrapper[2565]: I0611 18:32:25.423936 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/a198f4a2-26ba-432c-adae-ce340c910fe0-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"a198f4a2-26ba-432c-adae-ce340c910fe0\") " pod="openshift-monitoring/alertmanager-main-0" Jun 11 18:32:25.424095 ip-10-0-130-170 kubenswrapper[2565]: I0611 18:32:25.423976 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/a198f4a2-26ba-432c-adae-ce340c910fe0-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"a198f4a2-26ba-432c-adae-ce340c910fe0\") " pod="openshift-monitoring/alertmanager-main-0" Jun 11 18:32:25.424095 ip-10-0-130-170 kubenswrapper[2565]: I0611 18:32:25.424037 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/a198f4a2-26ba-432c-adae-ce340c910fe0-config-volume\") pod \"alertmanager-main-0\" (UID: \"a198f4a2-26ba-432c-adae-ce340c910fe0\") " pod="openshift-monitoring/alertmanager-main-0" Jun 11 18:32:25.428577 ip-10-0-130-170 kubenswrapper[2565]: E0611 18:32:25.424620 2565 secret.go:189] Couldn't get secret openshift-monitoring/alertmanager-main-tls: secret "alertmanager-main-tls" not found Jun 11 18:32:25.428577 ip-10-0-130-170 kubenswrapper[2565]: E0611 18:32:25.424688 2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a198f4a2-26ba-432c-adae-ce340c910fe0-secret-alertmanager-main-tls podName:a198f4a2-26ba-432c-adae-ce340c910fe0 nodeName:}" failed. No retries permitted until 2026-06-11 18:32:25.92466836 +0000 UTC m=+264.673354366 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "secret-alertmanager-main-tls" (UniqueName: "kubernetes.io/secret/a198f4a2-26ba-432c-adae-ce340c910fe0-secret-alertmanager-main-tls") pod "alertmanager-main-0" (UID: "a198f4a2-26ba-432c-adae-ce340c910fe0") : secret "alertmanager-main-tls" not found Jun 11 18:32:25.428577 ip-10-0-130-170 kubenswrapper[2565]: I0611 18:32:25.427021 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/a198f4a2-26ba-432c-adae-ce340c910fe0-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"a198f4a2-26ba-432c-adae-ce340c910fe0\") " pod="openshift-monitoring/alertmanager-main-0" Jun 11 18:32:25.428577 ip-10-0-130-170 kubenswrapper[2565]: I0611 18:32:25.427771 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/a198f4a2-26ba-432c-adae-ce340c910fe0-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"a198f4a2-26ba-432c-adae-ce340c910fe0\") " pod="openshift-monitoring/alertmanager-main-0" Jun 11 18:32:25.428577 ip-10-0-130-170 kubenswrapper[2565]: I0611 18:32:25.428525 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/a198f4a2-26ba-432c-adae-ce340c910fe0-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"a198f4a2-26ba-432c-adae-ce340c910fe0\") " pod="openshift-monitoring/alertmanager-main-0" Jun 11 18:32:25.435212 ip-10-0-130-170 kubenswrapper[2565]: I0611 18:32:25.433632 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-rbbr9\" (UniqueName: \"kubernetes.io/projected/a198f4a2-26ba-432c-adae-ce340c910fe0-kube-api-access-rbbr9\") pod \"alertmanager-main-0\" (UID: \"a198f4a2-26ba-432c-adae-ce340c910fe0\") " pod="openshift-monitoring/alertmanager-main-0" Jun 11 18:32:25.435212 ip-10-0-130-170 kubenswrapper[2565]: I0611 18:32:25.433711 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/a198f4a2-26ba-432c-adae-ce340c910fe0-config-out\") pod \"alertmanager-main-0\" (UID: \"a198f4a2-26ba-432c-adae-ce340c910fe0\") " pod="openshift-monitoring/alertmanager-main-0" Jun 11 18:32:25.435212 ip-10-0-130-170 kubenswrapper[2565]: I0611 18:32:25.434070 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/a198f4a2-26ba-432c-adae-ce340c910fe0-web-config\") pod \"alertmanager-main-0\" (UID: \"a198f4a2-26ba-432c-adae-ce340c910fe0\") " pod="openshift-monitoring/alertmanager-main-0" Jun 11 18:32:25.435212 ip-10-0-130-170 kubenswrapper[2565]: I0611 18:32:25.434473 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/a198f4a2-26ba-432c-adae-ce340c910fe0-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"a198f4a2-26ba-432c-adae-ce340c910fe0\") " pod="openshift-monitoring/alertmanager-main-0" Jun 11 18:32:25.435212 ip-10-0-130-170 kubenswrapper[2565]: I0611 18:32:25.434832 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/a198f4a2-26ba-432c-adae-ce340c910fe0-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"a198f4a2-26ba-432c-adae-ce340c910fe0\") " pod="openshift-monitoring/alertmanager-main-0" Jun 11 18:32:25.435212 ip-10-0-130-170 kubenswrapper[2565]: I0611 18:32:25.435181 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/a198f4a2-26ba-432c-adae-ce340c910fe0-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"a198f4a2-26ba-432c-adae-ce340c910fe0\") " pod="openshift-monitoring/alertmanager-main-0" Jun 11 18:32:25.436392 ip-10-0-130-170 kubenswrapper[2565]: I0611 18:32:25.435718 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/a198f4a2-26ba-432c-adae-ce340c910fe0-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"a198f4a2-26ba-432c-adae-ce340c910fe0\") " pod="openshift-monitoring/alertmanager-main-0" Jun 11 18:32:25.436392 ip-10-0-130-170 kubenswrapper[2565]: I0611 18:32:25.436017 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/a198f4a2-26ba-432c-adae-ce340c910fe0-tls-assets\") pod \"alertmanager-main-0\" (UID: \"a198f4a2-26ba-432c-adae-ce340c910fe0\") " pod="openshift-monitoring/alertmanager-main-0" Jun 11 18:32:25.437100 ip-10-0-130-170 kubenswrapper[2565]: I0611 18:32:25.436991 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/a198f4a2-26ba-432c-adae-ce340c910fe0-config-volume\") pod \"alertmanager-main-0\" (UID: \"a198f4a2-26ba-432c-adae-ce340c910fe0\") " pod="openshift-monitoring/alertmanager-main-0" Jun 11 18:32:25.597365 ip-10-0-130-170 kubenswrapper[2565]: I0611 18:32:25.597232 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/kube-state-metrics-678bc549d7-89x49" event={"ID":"11ac62e4-72e1-48d7-8b55-a615e80ea6ca","Type":"ContainerStarted","Data":"72906e24155dd828eeca2a42f92a7397381a98038da25dab5bf616e78ae837d3"} Jun 11 18:32:25.600318 ip-10-0-130-170 kubenswrapper[2565]: I0611 18:32:25.600283 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-6b8d965dd5-wdstt" event={"ID":"c9e106ea-f5bb-4fe9-9c47-b57141e42b07","Type":"ContainerStarted","Data":"b1600ee6e2bc052941a2ae41d7918efcac90a6717087de3a50beec6399470997"} Jun 11 18:32:25.600484 ip-10-0-130-170 kubenswrapper[2565]: I0611 18:32:25.600343 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-6b8d965dd5-wdstt" event={"ID":"c9e106ea-f5bb-4fe9-9c47-b57141e42b07","Type":"ContainerStarted","Data":"bbab2300406356faac79068f7e3571f18bfeb9c0b503e8a722ec90a7a3751da3"} Jun 11 18:32:25.600484 ip-10-0-130-170 kubenswrapper[2565]: I0611 18:32:25.600375 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-6b8d965dd5-wdstt" event={"ID":"c9e106ea-f5bb-4fe9-9c47-b57141e42b07","Type":"ContainerStarted","Data":"488bfd4c2623381e11f461294318f6cc85aac9a1b9161941e921c86d255d1e8b"} Jun 11 18:32:25.928944 ip-10-0-130-170 kubenswrapper[2565]: I0611 18:32:25.928904 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/a198f4a2-26ba-432c-adae-ce340c910fe0-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"a198f4a2-26ba-432c-adae-ce340c910fe0\") " pod="openshift-monitoring/alertmanager-main-0" Jun 11 18:32:25.931567 ip-10-0-130-170 kubenswrapper[2565]: I0611 18:32:25.931534 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/a198f4a2-26ba-432c-adae-ce340c910fe0-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"a198f4a2-26ba-432c-adae-ce340c910fe0\") " pod="openshift-monitoring/alertmanager-main-0" Jun 11 18:32:26.138642 ip-10-0-130-170 kubenswrapper[2565]: I0611 18:32:26.138597 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0" Jun 11 18:32:26.433416 ip-10-0-130-170 kubenswrapper[2565]: I0611 18:32:26.433147 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Jun 11 18:32:26.438778 ip-10-0-130-170 kubenswrapper[2565]: W0611 18:32:26.438733 2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda198f4a2_26ba_432c_adae_ce340c910fe0.slice/crio-735eb8b53ddafc44c1ac2101ca2d319a6db6dc601d040656508d7c51e3a55a95 WatchSource:0}: Error finding container 735eb8b53ddafc44c1ac2101ca2d319a6db6dc601d040656508d7c51e3a55a95: Status 404 returned error can't find the container with id 735eb8b53ddafc44c1ac2101ca2d319a6db6dc601d040656508d7c51e3a55a95 Jun 11 18:32:26.606051 ip-10-0-130-170 kubenswrapper[2565]: I0611 18:32:26.606013 2565 generic.go:356] "Generic (PLEG): container finished" podID="89eea2f5-d058-4ebf-b5f8-d6dbb8c40369" containerID="b28f8f94e7791c6891e49a680a064757f7a003b28ef7fa004189bef3e6b7694f" exitCode=0 Jun 11 18:32:26.606454 ip-10-0-130-170 kubenswrapper[2565]: I0611 18:32:26.606091 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-jthcp" event={"ID":"89eea2f5-d058-4ebf-b5f8-d6dbb8c40369","Type":"ContainerDied","Data":"b28f8f94e7791c6891e49a680a064757f7a003b28ef7fa004189bef3e6b7694f"} Jun 11 18:32:26.608508 ip-10-0-130-170 kubenswrapper[2565]: I0611 18:32:26.608484 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-6b8d965dd5-wdstt" event={"ID":"c9e106ea-f5bb-4fe9-9c47-b57141e42b07","Type":"ContainerStarted","Data":"482de431ca5b527bf0aff8b0b524f7dec75994ab0b70f831a9f00fa8a67331aa"} Jun 11 18:32:26.609891 ip-10-0-130-170 kubenswrapper[2565]: I0611 18:32:26.609865 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"a198f4a2-26ba-432c-adae-ce340c910fe0","Type":"ContainerStarted","Data":"735eb8b53ddafc44c1ac2101ca2d319a6db6dc601d040656508d7c51e3a55a95"} Jun 11 18:32:26.612100 ip-10-0-130-170 kubenswrapper[2565]: I0611 18:32:26.612080 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/kube-state-metrics-678bc549d7-89x49" event={"ID":"11ac62e4-72e1-48d7-8b55-a615e80ea6ca","Type":"ContainerStarted","Data":"be7f73e9e96c8de82afdf6b3ba50a33e0639b2ac409a4e02589adb2b2707053e"} Jun 11 18:32:26.612200 ip-10-0-130-170 kubenswrapper[2565]: I0611 18:32:26.612119 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/kube-state-metrics-678bc549d7-89x49" event={"ID":"11ac62e4-72e1-48d7-8b55-a615e80ea6ca","Type":"ContainerStarted","Data":"d7f0f58e9dacb8c05bce888e4598e5d43363de2298853974baa568a43be54dbc"} Jun 11 18:32:26.612200 ip-10-0-130-170 kubenswrapper[2565]: I0611 18:32:26.612137 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/kube-state-metrics-678bc549d7-89x49" event={"ID":"11ac62e4-72e1-48d7-8b55-a615e80ea6ca","Type":"ContainerStarted","Data":"b3f2ba114da4523535a712fa8f313918b82b9afbc648cd4a60c0e2562ac4f6cb"} Jun 11 18:32:26.641145 ip-10-0-130-170 kubenswrapper[2565]: I0611 18:32:26.641089 2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/kube-state-metrics-678bc549d7-89x49" podStartSLOduration=1.025945107 podStartE2EDuration="2.641070084s" totalImagesPullingTime="1.615124977s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-11 18:32:24 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-11 18:32:26.640222474 +0000 UTC m=+265.388908497" watchObservedRunningTime="2026-06-11 18:32:26.641070084 +0000 UTC m=+265.389756107" Jun 11 18:32:26.658879 ip-10-0-130-170 kubenswrapper[2565]: I0611 18:32:26.658834 2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/openshift-state-metrics-6b8d965dd5-wdstt" podStartSLOduration=1.111048275 podStartE2EDuration="2.658820064s" totalImagesPullingTime="1.547771789s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-11 18:32:24 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-11 18:32:26.657669001 +0000 UTC m=+265.406355024" watchObservedRunningTime="2026-06-11 18:32:26.658820064 +0000 UTC m=+265.407506085" Jun 11 18:32:27.619717 ip-10-0-130-170 kubenswrapper[2565]: I0611 18:32:27.619682 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-jthcp" event={"ID":"89eea2f5-d058-4ebf-b5f8-d6dbb8c40369","Type":"ContainerStarted","Data":"9b0cb16cb712c71f713989dbc9621cdd0e7ababf214fce9c3eec7341bc7d1778"} Jun 11 18:32:27.620085 ip-10-0-130-170 kubenswrapper[2565]: I0611 18:32:27.619791 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-jthcp" event={"ID":"89eea2f5-d058-4ebf-b5f8-d6dbb8c40369","Type":"ContainerStarted","Data":"a18c25534aef38a493880ab55f218acaba22d3bcbd4f79c01123f868d57ee519"} Jun 11 18:32:27.641455 ip-10-0-130-170 kubenswrapper[2565]: I0611 18:32:27.641411 2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/node-exporter-jthcp" podStartSLOduration=1.78957691 podStartE2EDuration="3.641394768s" totalImagesPullingTime="1.746383641s" totalInitContainerRuntime="105.434217ms" isStatefulPod=true podCreationTimestamp="2026-06-11 18:32:24 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-11 18:32:27.640205858 +0000 UTC m=+266.388891879" watchObservedRunningTime="2026-06-11 18:32:27.641394768 +0000 UTC m=+266.390080792" Jun 11 18:32:28.625917 ip-10-0-130-170 kubenswrapper[2565]: I0611 18:32:28.625879 2565 generic.go:356] "Generic (PLEG): container finished" podID="a198f4a2-26ba-432c-adae-ce340c910fe0" containerID="b0663328f3392d3faba3b19023562d4e3d56b831b541a3b63bdc1ef9d0a99aaa" exitCode=0 Jun 11 18:32:28.626395 ip-10-0-130-170 kubenswrapper[2565]: I0611 18:32:28.625974 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"a198f4a2-26ba-432c-adae-ce340c910fe0","Type":"ContainerDied","Data":"b0663328f3392d3faba3b19023562d4e3d56b831b541a3b63bdc1ef9d0a99aaa"} Jun 11 18:32:28.906672 ip-10-0-130-170 kubenswrapper[2565]: I0611 18:32:28.906630 2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/monitoring-plugin-589576dfc7-rxk8n"] Jun 11 18:32:28.910267 ip-10-0-130-170 kubenswrapper[2565]: I0611 18:32:28.910234 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/monitoring-plugin-589576dfc7-rxk8n" Jun 11 18:32:28.913134 ip-10-0-130-170 kubenswrapper[2565]: I0611 18:32:28.913110 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"monitoring-plugin-dockercfg-zwc5c\"" Jun 11 18:32:28.913335 ip-10-0-130-170 kubenswrapper[2565]: I0611 18:32:28.913147 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"monitoring-plugin-cert\"" Jun 11 18:32:28.919162 ip-10-0-130-170 kubenswrapper[2565]: I0611 18:32:28.919137 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/monitoring-plugin-589576dfc7-rxk8n"] Jun 11 18:32:28.957178 ip-10-0-130-170 kubenswrapper[2565]: I0611 18:32:28.957151 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-kjdgm\" (UniqueName: \"kubernetes.io/projected/ed0fc27f-c5f2-4635-b24c-39acc6db3cab-kube-api-access-kjdgm\") pod \"monitoring-plugin-589576dfc7-rxk8n\" (UID: \"ed0fc27f-c5f2-4635-b24c-39acc6db3cab\") " pod="openshift-monitoring/monitoring-plugin-589576dfc7-rxk8n" Jun 11 18:32:28.957340 ip-10-0-130-170 kubenswrapper[2565]: I0611 18:32:28.957199 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"monitoring-plugin-cert\" (UniqueName: \"kubernetes.io/secret/ed0fc27f-c5f2-4635-b24c-39acc6db3cab-monitoring-plugin-cert\") pod \"monitoring-plugin-589576dfc7-rxk8n\" (UID: \"ed0fc27f-c5f2-4635-b24c-39acc6db3cab\") " pod="openshift-monitoring/monitoring-plugin-589576dfc7-rxk8n" Jun 11 18:32:29.057963 ip-10-0-130-170 kubenswrapper[2565]: I0611 18:32:29.057927 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-kjdgm\" (UniqueName: \"kubernetes.io/projected/ed0fc27f-c5f2-4635-b24c-39acc6db3cab-kube-api-access-kjdgm\") pod \"monitoring-plugin-589576dfc7-rxk8n\" (UID: \"ed0fc27f-c5f2-4635-b24c-39acc6db3cab\") " pod="openshift-monitoring/monitoring-plugin-589576dfc7-rxk8n" Jun 11 18:32:29.058111 ip-10-0-130-170 kubenswrapper[2565]: I0611 18:32:29.057978 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"monitoring-plugin-cert\" (UniqueName: \"kubernetes.io/secret/ed0fc27f-c5f2-4635-b24c-39acc6db3cab-monitoring-plugin-cert\") pod \"monitoring-plugin-589576dfc7-rxk8n\" (UID: \"ed0fc27f-c5f2-4635-b24c-39acc6db3cab\") " pod="openshift-monitoring/monitoring-plugin-589576dfc7-rxk8n" Jun 11 18:32:29.058111 ip-10-0-130-170 kubenswrapper[2565]: E0611 18:32:29.058106 2565 secret.go:189] Couldn't get secret openshift-monitoring/monitoring-plugin-cert: secret "monitoring-plugin-cert" not found Jun 11 18:32:29.058198 ip-10-0-130-170 kubenswrapper[2565]: E0611 18:32:29.058156 2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ed0fc27f-c5f2-4635-b24c-39acc6db3cab-monitoring-plugin-cert podName:ed0fc27f-c5f2-4635-b24c-39acc6db3cab nodeName:}" failed. No retries permitted until 2026-06-11 18:32:29.558141262 +0000 UTC m=+268.306827263 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "monitoring-plugin-cert" (UniqueName: "kubernetes.io/secret/ed0fc27f-c5f2-4635-b24c-39acc6db3cab-monitoring-plugin-cert") pod "monitoring-plugin-589576dfc7-rxk8n" (UID: "ed0fc27f-c5f2-4635-b24c-39acc6db3cab") : secret "monitoring-plugin-cert" not found Jun 11 18:32:29.066995 ip-10-0-130-170 kubenswrapper[2565]: I0611 18:32:29.066966 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-kjdgm\" (UniqueName: \"kubernetes.io/projected/ed0fc27f-c5f2-4635-b24c-39acc6db3cab-kube-api-access-kjdgm\") pod \"monitoring-plugin-589576dfc7-rxk8n\" (UID: \"ed0fc27f-c5f2-4635-b24c-39acc6db3cab\") " pod="openshift-monitoring/monitoring-plugin-589576dfc7-rxk8n" Jun 11 18:32:29.562635 ip-10-0-130-170 kubenswrapper[2565]: I0611 18:32:29.562596 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"monitoring-plugin-cert\" (UniqueName: \"kubernetes.io/secret/ed0fc27f-c5f2-4635-b24c-39acc6db3cab-monitoring-plugin-cert\") pod \"monitoring-plugin-589576dfc7-rxk8n\" (UID: \"ed0fc27f-c5f2-4635-b24c-39acc6db3cab\") " pod="openshift-monitoring/monitoring-plugin-589576dfc7-rxk8n" Jun 11 18:32:29.565112 ip-10-0-130-170 kubenswrapper[2565]: I0611 18:32:29.565089 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"monitoring-plugin-cert\" (UniqueName: \"kubernetes.io/secret/ed0fc27f-c5f2-4635-b24c-39acc6db3cab-monitoring-plugin-cert\") pod \"monitoring-plugin-589576dfc7-rxk8n\" (UID: \"ed0fc27f-c5f2-4635-b24c-39acc6db3cab\") " pod="openshift-monitoring/monitoring-plugin-589576dfc7-rxk8n" Jun 11 18:32:29.821784 ip-10-0-130-170 kubenswrapper[2565]: I0611 18:32:29.821699 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/monitoring-plugin-589576dfc7-rxk8n" Jun 11 18:32:29.958294 ip-10-0-130-170 kubenswrapper[2565]: I0611 18:32:29.958230 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/monitoring-plugin-589576dfc7-rxk8n"] Jun 11 18:32:29.960562 ip-10-0-130-170 kubenswrapper[2565]: W0611 18:32:29.960529 2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poded0fc27f_c5f2_4635_b24c_39acc6db3cab.slice/crio-adeeaf9ff7d8f6fdcb55bc36c3aaa32df7615a546f63a08e842accfa84d0d607 WatchSource:0}: Error finding container adeeaf9ff7d8f6fdcb55bc36c3aaa32df7615a546f63a08e842accfa84d0d607: Status 404 returned error can't find the container with id adeeaf9ff7d8f6fdcb55bc36c3aaa32df7615a546f63a08e842accfa84d0d607 Jun 11 18:32:30.637177 ip-10-0-130-170 kubenswrapper[2565]: I0611 18:32:30.637145 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/monitoring-plugin-589576dfc7-rxk8n" event={"ID":"ed0fc27f-c5f2-4635-b24c-39acc6db3cab","Type":"ContainerStarted","Data":"adeeaf9ff7d8f6fdcb55bc36c3aaa32df7615a546f63a08e842accfa84d0d607"} Jun 11 18:32:31.085814 ip-10-0-130-170 kubenswrapper[2565]: I0611 18:32:31.085723 2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-7f88bbcffb-b7z9j" Jun 11 18:32:31.085814 ip-10-0-130-170 kubenswrapper[2565]: I0611 18:32:31.085803 2565 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-7f88bbcffb-b7z9j" Jun 11 18:32:31.087294 ip-10-0-130-170 kubenswrapper[2565]: I0611 18:32:31.087247 2565 patch_prober.go:28] interesting pod/console-7f88bbcffb-b7z9j container/console namespace/openshift-console: Startup probe status=failure output="Get \"https://10.133.0.19:8443/health\": dial tcp 10.133.0.19:8443: connect: connection refused" start-of-body= Jun 11 18:32:31.087441 ip-10-0-130-170 kubenswrapper[2565]: I0611 18:32:31.087322 2565 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-console/console-7f88bbcffb-b7z9j" podUID="4473e901-c297-4298-b314-1c31a91d3510" containerName="console" probeResult="failure" output="Get \"https://10.133.0.19:8443/health\": dial tcp 10.133.0.19:8443: connect: connection refused" Jun 11 18:32:32.649845 ip-10-0-130-170 kubenswrapper[2565]: I0611 18:32:32.649806 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/monitoring-plugin-589576dfc7-rxk8n" event={"ID":"ed0fc27f-c5f2-4635-b24c-39acc6db3cab","Type":"ContainerStarted","Data":"b5611fad4da4212159c51311a8f2499562016f84c81f772a9b13b45e95a037aa"} Jun 11 18:32:32.650315 ip-10-0-130-170 kubenswrapper[2565]: I0611 18:32:32.649878 2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/monitoring-plugin-589576dfc7-rxk8n" Jun 11 18:32:32.653350 ip-10-0-130-170 kubenswrapper[2565]: I0611 18:32:32.653319 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"a198f4a2-26ba-432c-adae-ce340c910fe0","Type":"ContainerStarted","Data":"736c624d11924e94091b9424bbb5087f107e1515d66759ebcdea7946b5698c75"} Jun 11 18:32:32.653480 ip-10-0-130-170 kubenswrapper[2565]: I0611 18:32:32.653442 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"a198f4a2-26ba-432c-adae-ce340c910fe0","Type":"ContainerStarted","Data":"93acb0800c91752e5e0e46d2c86e0937b1c66ea0f7bade554afe2342dcc5d351"} Jun 11 18:32:32.653541 ip-10-0-130-170 kubenswrapper[2565]: I0611 18:32:32.653492 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"a198f4a2-26ba-432c-adae-ce340c910fe0","Type":"ContainerStarted","Data":"ada101b3efdb80de5aca57b0efed9a384996f1394a2c6b165c0ea6928539b73b"} Jun 11 18:32:32.653541 ip-10-0-130-170 kubenswrapper[2565]: I0611 18:32:32.653522 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"a198f4a2-26ba-432c-adae-ce340c910fe0","Type":"ContainerStarted","Data":"79a0bffa427dbcb417dd42bb10b9f7d749fdb82f628ac9495e68e75907caf789"} Jun 11 18:32:32.653646 ip-10-0-130-170 kubenswrapper[2565]: I0611 18:32:32.653547 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"a198f4a2-26ba-432c-adae-ce340c910fe0","Type":"ContainerStarted","Data":"84e442e656ac88da7e6e71f4efbc05546d5ad388cd67dc1dd225fff5ea4a90d0"} Jun 11 18:32:32.655126 ip-10-0-130-170 kubenswrapper[2565]: I0611 18:32:32.655107 2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/monitoring-plugin-589576dfc7-rxk8n" Jun 11 18:32:32.666160 ip-10-0-130-170 kubenswrapper[2565]: I0611 18:32:32.666115 2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/monitoring-plugin-589576dfc7-rxk8n" podStartSLOduration=2.976559235 podStartE2EDuration="4.66609827s" totalImagesPullingTime="1.689539035s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-11 18:32:28 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-11 18:32:32.664587608 +0000 UTC m=+271.413273632" watchObservedRunningTime="2026-06-11 18:32:32.66609827 +0000 UTC m=+271.414784314" Jun 11 18:32:33.659631 ip-10-0-130-170 kubenswrapper[2565]: I0611 18:32:33.659596 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"a198f4a2-26ba-432c-adae-ce340c910fe0","Type":"ContainerStarted","Data":"2f60ec24578315640a4f300b33588e2f84ec4c6a27fbb723ca49ff3e3c5aedc8"} Jun 11 18:32:33.686751 ip-10-0-130-170 kubenswrapper[2565]: I0611 18:32:33.686700 2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/alertmanager-main-0" podStartSLOduration=3.829541876 podStartE2EDuration="8.686682499s" totalImagesPullingTime="4.841859226s" totalInitContainerRuntime="15.281397ms" isStatefulPod=false podCreationTimestamp="2026-06-11 18:32:25 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-11 18:32:33.684276993 +0000 UTC m=+272.432963005" watchObservedRunningTime="2026-06-11 18:32:33.686682499 +0000 UTC m=+272.435368521" Jun 11 18:32:36.720164 ip-10-0-130-170 kubenswrapper[2565]: I0611 18:32:36.720125 2565 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-7f88bbcffb-b7z9j"] Jun 11 18:32:43.238433 ip-10-0-130-170 kubenswrapper[2565]: E0611 18:32:43.238393 2565 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[registry-tls], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-image-registry/image-registry-666fb979b7-zhmbp" podUID="0a494089-a655-4522-b2a2-955594964ac7" Jun 11 18:32:43.238828 ip-10-0-130-170 kubenswrapper[2565]: E0611 18:32:43.238574 2565 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[metrics-tls], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-dns/dns-default-4z9qr" podUID="41d85d95-09c6-46e3-990f-59c9ab3ad81f" Jun 11 18:32:43.697827 ip-10-0-130-170 kubenswrapper[2565]: I0611 18:32:43.697796 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-666fb979b7-zhmbp" Jun 11 18:32:43.697827 ip-10-0-130-170 kubenswrapper[2565]: I0611 18:32:43.697831 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-4z9qr" Jun 11 18:32:46.632907 ip-10-0-130-170 kubenswrapper[2565]: I0611 18:32:46.632844 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/0a494089-a655-4522-b2a2-955594964ac7-registry-tls\") pod \"image-registry-666fb979b7-zhmbp\" (UID: \"0a494089-a655-4522-b2a2-955594964ac7\") " pod="openshift-image-registry/image-registry-666fb979b7-zhmbp" Jun 11 18:32:46.633340 ip-10-0-130-170 kubenswrapper[2565]: I0611 18:32:46.632933 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/41d85d95-09c6-46e3-990f-59c9ab3ad81f-metrics-tls\") pod \"dns-default-4z9qr\" (UID: \"41d85d95-09c6-46e3-990f-59c9ab3ad81f\") " pod="openshift-dns/dns-default-4z9qr" Jun 11 18:32:46.635539 ip-10-0-130-170 kubenswrapper[2565]: I0611 18:32:46.635507 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/41d85d95-09c6-46e3-990f-59c9ab3ad81f-metrics-tls\") pod \"dns-default-4z9qr\" (UID: \"41d85d95-09c6-46e3-990f-59c9ab3ad81f\") " pod="openshift-dns/dns-default-4z9qr" Jun 11 18:32:46.635660 ip-10-0-130-170 kubenswrapper[2565]: I0611 18:32:46.635587 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/0a494089-a655-4522-b2a2-955594964ac7-registry-tls\") pod \"image-registry-666fb979b7-zhmbp\" (UID: \"0a494089-a655-4522-b2a2-955594964ac7\") " pod="openshift-image-registry/image-registry-666fb979b7-zhmbp" Jun 11 18:32:46.701539 ip-10-0-130-170 kubenswrapper[2565]: I0611 18:32:46.701505 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"registry-dockercfg-9h7xm\"" Jun 11 18:32:46.701539 ip-10-0-130-170 kubenswrapper[2565]: I0611 18:32:46.701505 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-cszq9\"" Jun 11 18:32:46.708654 ip-10-0-130-170 kubenswrapper[2565]: I0611 18:32:46.708627 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-4z9qr" Jun 11 18:32:46.708808 ip-10-0-130-170 kubenswrapper[2565]: I0611 18:32:46.708663 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-666fb979b7-zhmbp" Jun 11 18:32:46.853396 ip-10-0-130-170 kubenswrapper[2565]: I0611 18:32:46.853369 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-4z9qr"] Jun 11 18:32:46.855979 ip-10-0-130-170 kubenswrapper[2565]: W0611 18:32:46.855956 2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod41d85d95_09c6_46e3_990f_59c9ab3ad81f.slice/crio-45d44ae5f85ec5a14ab35155ec348be93bba93aafdf5fcd0c013a64b0e7ccf4f WatchSource:0}: Error finding container 45d44ae5f85ec5a14ab35155ec348be93bba93aafdf5fcd0c013a64b0e7ccf4f: Status 404 returned error can't find the container with id 45d44ae5f85ec5a14ab35155ec348be93bba93aafdf5fcd0c013a64b0e7ccf4f Jun 11 18:32:46.874179 ip-10-0-130-170 kubenswrapper[2565]: I0611 18:32:46.874156 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-666fb979b7-zhmbp"] Jun 11 18:32:46.876116 ip-10-0-130-170 kubenswrapper[2565]: W0611 18:32:46.876087 2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0a494089_a655_4522_b2a2_955594964ac7.slice/crio-42db8403cb56ce681427b015e3578ad41e0b98e674b09960136b56b3c178f611 WatchSource:0}: Error finding container 42db8403cb56ce681427b015e3578ad41e0b98e674b09960136b56b3c178f611: Status 404 returned error can't find the container with id 42db8403cb56ce681427b015e3578ad41e0b98e674b09960136b56b3c178f611 Jun 11 18:32:47.715982 ip-10-0-130-170 kubenswrapper[2565]: I0611 18:32:47.715917 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-666fb979b7-zhmbp" event={"ID":"0a494089-a655-4522-b2a2-955594964ac7","Type":"ContainerStarted","Data":"685b863dba322f3d8d93d69120469fb5691c6d41ed96f7108e051925ebc4a88c"} Jun 11 18:32:47.716523 ip-10-0-130-170 kubenswrapper[2565]: I0611 18:32:47.715992 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-666fb979b7-zhmbp" event={"ID":"0a494089-a655-4522-b2a2-955594964ac7","Type":"ContainerStarted","Data":"42db8403cb56ce681427b015e3578ad41e0b98e674b09960136b56b3c178f611"} Jun 11 18:32:47.716523 ip-10-0-130-170 kubenswrapper[2565]: I0611 18:32:47.716142 2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-image-registry/image-registry-666fb979b7-zhmbp" Jun 11 18:32:47.717401 ip-10-0-130-170 kubenswrapper[2565]: I0611 18:32:47.717369 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-4z9qr" event={"ID":"41d85d95-09c6-46e3-990f-59c9ab3ad81f","Type":"ContainerStarted","Data":"45d44ae5f85ec5a14ab35155ec348be93bba93aafdf5fcd0c013a64b0e7ccf4f"} Jun 11 18:32:47.747638 ip-10-0-130-170 kubenswrapper[2565]: I0611 18:32:47.747572 2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/image-registry-666fb979b7-zhmbp" podStartSLOduration=288.747550593 podStartE2EDuration="4m48.747550593s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-11 18:27:59 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-11 18:32:47.746359304 +0000 UTC m=+286.495045327" watchObservedRunningTime="2026-06-11 18:32:47.747550593 +0000 UTC m=+286.496236616" Jun 11 18:32:49.726281 ip-10-0-130-170 kubenswrapper[2565]: I0611 18:32:49.726221 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-4z9qr" event={"ID":"41d85d95-09c6-46e3-990f-59c9ab3ad81f","Type":"ContainerStarted","Data":"3510d2952b030183c08a4da9d896ab6644caf0a219d1ae2b2346631efb4ecee4"} Jun 11 18:32:49.726681 ip-10-0-130-170 kubenswrapper[2565]: I0611 18:32:49.726312 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-4z9qr" event={"ID":"41d85d95-09c6-46e3-990f-59c9ab3ad81f","Type":"ContainerStarted","Data":"25f0766368c643326e1f7abade243567f8b7a17af75a9870b0c5e9bc2a3924ee"} Jun 11 18:32:49.726681 ip-10-0-130-170 kubenswrapper[2565]: I0611 18:32:49.726385 2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-dns/dns-default-4z9qr" Jun 11 18:32:49.746894 ip-10-0-130-170 kubenswrapper[2565]: I0611 18:32:49.746827 2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/dns-default-4z9qr" podStartSLOduration=251.936108443 podStartE2EDuration="4m13.746804136s" totalImagesPullingTime="1.810695693s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-11 18:28:36 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-11 18:32:49.74610591 +0000 UTC m=+288.494791946" watchObservedRunningTime="2026-06-11 18:32:49.746804136 +0000 UTC m=+288.495490183" Jun 11 18:32:59.732610 ip-10-0-130-170 kubenswrapper[2565]: I0611 18:32:59.732575 2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-dns/dns-default-4z9qr" Jun 11 18:33:00.771882 ip-10-0-130-170 kubenswrapper[2565]: I0611 18:33:00.771848 2565 generic.go:356] "Generic (PLEG): container finished" podID="6557afae-a8c6-4147-9f64-5c22cacf0d89" containerID="33f6cd061140f9bb4805995a151054618e06d659fed0b5fce73cebb2c9ab75ff" exitCode=0 Jun 11 18:33:00.772242 ip-10-0-130-170 kubenswrapper[2565]: I0611 18:33:00.771896 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca-operator/service-ca-operator-7ccbfd59dc-vtjsg" event={"ID":"6557afae-a8c6-4147-9f64-5c22cacf0d89","Type":"ContainerDied","Data":"33f6cd061140f9bb4805995a151054618e06d659fed0b5fce73cebb2c9ab75ff"} Jun 11 18:33:00.772242 ip-10-0-130-170 kubenswrapper[2565]: I0611 18:33:00.772178 2565 scope.go:117] "RemoveContainer" containerID="33f6cd061140f9bb4805995a151054618e06d659fed0b5fce73cebb2c9ab75ff" Jun 11 18:33:01.682909 ip-10-0-130-170 kubenswrapper[2565]: I0611 18:33:01.682878 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-5dbbb5d744-vpdts_3329f4b1-ac8c-4472-b6a0-13bb76075957/console-operator/1.log" Jun 11 18:33:01.683752 ip-10-0-130-170 kubenswrapper[2565]: I0611 18:33:01.683729 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-5dbbb5d744-vpdts_3329f4b1-ac8c-4472-b6a0-13bb76075957/console-operator/1.log" Jun 11 18:33:01.691715 ip-10-0-130-170 kubenswrapper[2565]: I0611 18:33:01.691678 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-9xbcp_5f6a1d9d-054f-4a94-99a3-21b77d4995dd/ovn-acl-logging/0.log" Jun 11 18:33:01.692275 ip-10-0-130-170 kubenswrapper[2565]: I0611 18:33:01.692238 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-9xbcp_5f6a1d9d-054f-4a94-99a3-21b77d4995dd/ovn-acl-logging/0.log" Jun 11 18:33:01.695835 ip-10-0-130-170 kubenswrapper[2565]: I0611 18:33:01.695812 2565 kubelet.go:1648] "Image garbage collection succeeded" Jun 11 18:33:01.741495 ip-10-0-130-170 kubenswrapper[2565]: I0611 18:33:01.741329 2565 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-console/console-7f88bbcffb-b7z9j" podUID="4473e901-c297-4298-b314-1c31a91d3510" containerName="console" containerID="cri-o://f6efb8bc72995ef2509b2d16f9e39dad29583482446fb40f9d7c4b1cbd5e297f" gracePeriod=15 Jun 11 18:33:01.920231 ip-10-0-130-170 kubenswrapper[2565]: I0611 18:33:01.777447 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca-operator/service-ca-operator-7ccbfd59dc-vtjsg" event={"ID":"6557afae-a8c6-4147-9f64-5c22cacf0d89","Type":"ContainerStarted","Data":"e721521ec95e91a6475295bd63c8fc96895633fafb28749c97735fff7a5e602b"} Jun 11 18:33:04.287340 ip-10-0-130-170 kubenswrapper[2565]: I0611 18:33:04.287312 2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-7f88bbcffb-b7z9j" Jun 11 18:33:04.377445 ip-10-0-130-170 kubenswrapper[2565]: I0611 18:33:04.377352 2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/4473e901-c297-4298-b314-1c31a91d3510-oauth-serving-cert\") pod \"4473e901-c297-4298-b314-1c31a91d3510\" (UID: \"4473e901-c297-4298-b314-1c31a91d3510\") " Jun 11 18:33:04.377445 ip-10-0-130-170 kubenswrapper[2565]: I0611 18:33:04.377395 2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/4473e901-c297-4298-b314-1c31a91d3510-console-serving-cert\") pod \"4473e901-c297-4298-b314-1c31a91d3510\" (UID: \"4473e901-c297-4298-b314-1c31a91d3510\") " Jun 11 18:33:04.377445 ip-10-0-130-170 kubenswrapper[2565]: I0611 18:33:04.377439 2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/4473e901-c297-4298-b314-1c31a91d3510-trusted-ca-bundle\") pod \"4473e901-c297-4298-b314-1c31a91d3510\" (UID: \"4473e901-c297-4298-b314-1c31a91d3510\") " Jun 11 18:33:04.377704 ip-10-0-130-170 kubenswrapper[2565]: I0611 18:33:04.377482 2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-wgqcp\" (UniqueName: \"kubernetes.io/projected/4473e901-c297-4298-b314-1c31a91d3510-kube-api-access-wgqcp\") pod \"4473e901-c297-4298-b314-1c31a91d3510\" (UID: \"4473e901-c297-4298-b314-1c31a91d3510\") " Jun 11 18:33:04.377704 ip-10-0-130-170 kubenswrapper[2565]: I0611 18:33:04.377532 2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/4473e901-c297-4298-b314-1c31a91d3510-console-config\") pod \"4473e901-c297-4298-b314-1c31a91d3510\" (UID: \"4473e901-c297-4298-b314-1c31a91d3510\") " Jun 11 18:33:04.377704 ip-10-0-130-170 kubenswrapper[2565]: I0611 18:33:04.377555 2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/4473e901-c297-4298-b314-1c31a91d3510-console-oauth-config\") pod \"4473e901-c297-4298-b314-1c31a91d3510\" (UID: \"4473e901-c297-4298-b314-1c31a91d3510\") " Jun 11 18:33:04.377704 ip-10-0-130-170 kubenswrapper[2565]: I0611 18:33:04.377577 2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/4473e901-c297-4298-b314-1c31a91d3510-service-ca\") pod \"4473e901-c297-4298-b314-1c31a91d3510\" (UID: \"4473e901-c297-4298-b314-1c31a91d3510\") " Jun 11 18:33:04.377907 ip-10-0-130-170 kubenswrapper[2565]: I0611 18:33:04.377816 2565 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/4473e901-c297-4298-b314-1c31a91d3510-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "4473e901-c297-4298-b314-1c31a91d3510" (UID: "4473e901-c297-4298-b314-1c31a91d3510"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 11 18:33:04.378012 ip-10-0-130-170 kubenswrapper[2565]: I0611 18:33:04.377975 2565 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/4473e901-c297-4298-b314-1c31a91d3510-console-config" (OuterVolumeSpecName: "console-config") pod "4473e901-c297-4298-b314-1c31a91d3510" (UID: "4473e901-c297-4298-b314-1c31a91d3510"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 11 18:33:04.378154 ip-10-0-130-170 kubenswrapper[2565]: I0611 18:33:04.378038 2565 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/4473e901-c297-4298-b314-1c31a91d3510-service-ca" (OuterVolumeSpecName: "service-ca") pod "4473e901-c297-4298-b314-1c31a91d3510" (UID: "4473e901-c297-4298-b314-1c31a91d3510"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 11 18:33:04.378154 ip-10-0-130-170 kubenswrapper[2565]: I0611 18:33:04.378076 2565 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/4473e901-c297-4298-b314-1c31a91d3510-trusted-ca-bundle" (OuterVolumeSpecName: "trusted-ca-bundle") pod "4473e901-c297-4298-b314-1c31a91d3510" (UID: "4473e901-c297-4298-b314-1c31a91d3510"). InnerVolumeSpecName "trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 11 18:33:04.379993 ip-10-0-130-170 kubenswrapper[2565]: I0611 18:33:04.379964 2565 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/4473e901-c297-4298-b314-1c31a91d3510-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "4473e901-c297-4298-b314-1c31a91d3510" (UID: "4473e901-c297-4298-b314-1c31a91d3510"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 11 18:33:04.380079 ip-10-0-130-170 kubenswrapper[2565]: I0611 18:33:04.380012 2565 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/4473e901-c297-4298-b314-1c31a91d3510-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "4473e901-c297-4298-b314-1c31a91d3510" (UID: "4473e901-c297-4298-b314-1c31a91d3510"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 11 18:33:04.380079 ip-10-0-130-170 kubenswrapper[2565]: I0611 18:33:04.380026 2565 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/4473e901-c297-4298-b314-1c31a91d3510-kube-api-access-wgqcp" (OuterVolumeSpecName: "kube-api-access-wgqcp") pod "4473e901-c297-4298-b314-1c31a91d3510" (UID: "4473e901-c297-4298-b314-1c31a91d3510"). InnerVolumeSpecName "kube-api-access-wgqcp". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 11 18:33:04.478183 ip-10-0-130-170 kubenswrapper[2565]: I0611 18:33:04.478143 2565 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-wgqcp\" (UniqueName: \"kubernetes.io/projected/4473e901-c297-4298-b314-1c31a91d3510-kube-api-access-wgqcp\") on node \"ip-10-0-130-170.ec2.internal\" DevicePath \"\"" Jun 11 18:33:04.478183 ip-10-0-130-170 kubenswrapper[2565]: I0611 18:33:04.478172 2565 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/4473e901-c297-4298-b314-1c31a91d3510-console-config\") on node \"ip-10-0-130-170.ec2.internal\" DevicePath \"\"" Jun 11 18:33:04.478183 ip-10-0-130-170 kubenswrapper[2565]: I0611 18:33:04.478183 2565 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/4473e901-c297-4298-b314-1c31a91d3510-console-oauth-config\") on node \"ip-10-0-130-170.ec2.internal\" DevicePath \"\"" Jun 11 18:33:04.478183 ip-10-0-130-170 kubenswrapper[2565]: I0611 18:33:04.478193 2565 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/4473e901-c297-4298-b314-1c31a91d3510-service-ca\") on node \"ip-10-0-130-170.ec2.internal\" DevicePath \"\"" Jun 11 18:33:04.478488 ip-10-0-130-170 kubenswrapper[2565]: I0611 18:33:04.478201 2565 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/4473e901-c297-4298-b314-1c31a91d3510-oauth-serving-cert\") on node \"ip-10-0-130-170.ec2.internal\" DevicePath \"\"" Jun 11 18:33:04.478488 ip-10-0-130-170 kubenswrapper[2565]: I0611 18:33:04.478210 2565 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/4473e901-c297-4298-b314-1c31a91d3510-console-serving-cert\") on node \"ip-10-0-130-170.ec2.internal\" DevicePath \"\"" Jun 11 18:33:04.478488 ip-10-0-130-170 kubenswrapper[2565]: I0611 18:33:04.478218 2565 reconciler_common.go:299] "Volume detached for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/4473e901-c297-4298-b314-1c31a91d3510-trusted-ca-bundle\") on node \"ip-10-0-130-170.ec2.internal\" DevicePath \"\"" Jun 11 18:33:04.791166 ip-10-0-130-170 kubenswrapper[2565]: I0611 18:33:04.791129 2565 generic.go:356] "Generic (PLEG): container finished" podID="4473e901-c297-4298-b314-1c31a91d3510" containerID="f6efb8bc72995ef2509b2d16f9e39dad29583482446fb40f9d7c4b1cbd5e297f" exitCode=0 Jun 11 18:33:04.791467 ip-10-0-130-170 kubenswrapper[2565]: I0611 18:33:04.791172 2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-7f88bbcffb-b7z9j" Jun 11 18:33:04.791467 ip-10-0-130-170 kubenswrapper[2565]: I0611 18:33:04.791212 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-7f88bbcffb-b7z9j" event={"ID":"4473e901-c297-4298-b314-1c31a91d3510","Type":"ContainerDied","Data":"f6efb8bc72995ef2509b2d16f9e39dad29583482446fb40f9d7c4b1cbd5e297f"} Jun 11 18:33:04.791467 ip-10-0-130-170 kubenswrapper[2565]: I0611 18:33:04.791284 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-7f88bbcffb-b7z9j" event={"ID":"4473e901-c297-4298-b314-1c31a91d3510","Type":"ContainerDied","Data":"7b3ad074652a92b38f8c56a927c310bd64f1006f9f510d2e3ac5941f06cc20db"} Jun 11 18:33:04.791467 ip-10-0-130-170 kubenswrapper[2565]: I0611 18:33:04.791308 2565 scope.go:117] "RemoveContainer" containerID="f6efb8bc72995ef2509b2d16f9e39dad29583482446fb40f9d7c4b1cbd5e297f" Jun 11 18:33:04.800486 ip-10-0-130-170 kubenswrapper[2565]: I0611 18:33:04.800468 2565 scope.go:117] "RemoveContainer" containerID="f6efb8bc72995ef2509b2d16f9e39dad29583482446fb40f9d7c4b1cbd5e297f" Jun 11 18:33:04.800761 ip-10-0-130-170 kubenswrapper[2565]: E0611 18:33:04.800740 2565 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"f6efb8bc72995ef2509b2d16f9e39dad29583482446fb40f9d7c4b1cbd5e297f\": container with ID starting with f6efb8bc72995ef2509b2d16f9e39dad29583482446fb40f9d7c4b1cbd5e297f not found: ID does not exist" containerID="f6efb8bc72995ef2509b2d16f9e39dad29583482446fb40f9d7c4b1cbd5e297f" Jun 11 18:33:04.800810 ip-10-0-130-170 kubenswrapper[2565]: I0611 18:33:04.800771 2565 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"f6efb8bc72995ef2509b2d16f9e39dad29583482446fb40f9d7c4b1cbd5e297f"} err="failed to get container status \"f6efb8bc72995ef2509b2d16f9e39dad29583482446fb40f9d7c4b1cbd5e297f\": rpc error: code = NotFound desc = could not find container \"f6efb8bc72995ef2509b2d16f9e39dad29583482446fb40f9d7c4b1cbd5e297f\": container with ID starting with f6efb8bc72995ef2509b2d16f9e39dad29583482446fb40f9d7c4b1cbd5e297f not found: ID does not exist" Jun 11 18:33:04.812673 ip-10-0-130-170 kubenswrapper[2565]: I0611 18:33:04.812645 2565 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-7f88bbcffb-b7z9j"] Jun 11 18:33:04.816311 ip-10-0-130-170 kubenswrapper[2565]: I0611 18:33:04.816285 2565 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-7f88bbcffb-b7z9j"] Jun 11 18:33:05.747464 ip-10-0-130-170 kubenswrapper[2565]: I0611 18:33:05.747390 2565 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="4473e901-c297-4298-b314-1c31a91d3510" path="/var/lib/kubelet/pods/4473e901-c297-4298-b314-1c31a91d3510/volumes" Jun 11 18:33:05.797050 ip-10-0-130-170 kubenswrapper[2565]: I0611 18:33:05.797014 2565 generic.go:356] "Generic (PLEG): container finished" podID="41864c84-6359-4718-9e48-64baa8e95dbc" containerID="6a4da90b388ae1deb163c14e758e26ef08e4bcbe90fa787a5bd089744308824c" exitCode=0 Jun 11 18:33:05.797236 ip-10-0-130-170 kubenswrapper[2565]: I0611 18:33:05.797086 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-operator-5bbd86d6bd-xr2lr" event={"ID":"41864c84-6359-4718-9e48-64baa8e95dbc","Type":"ContainerDied","Data":"6a4da90b388ae1deb163c14e758e26ef08e4bcbe90fa787a5bd089744308824c"} Jun 11 18:33:05.797455 ip-10-0-130-170 kubenswrapper[2565]: I0611 18:33:05.797440 2565 scope.go:117] "RemoveContainer" containerID="6a4da90b388ae1deb163c14e758e26ef08e4bcbe90fa787a5bd089744308824c" Jun 11 18:33:06.713437 ip-10-0-130-170 kubenswrapper[2565]: I0611 18:33:06.713399 2565 patch_prober.go:28] interesting pod/image-registry-666fb979b7-zhmbp container/registry namespace/openshift-image-registry: Liveness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body={"errors":[{"code":"UNAVAILABLE","message":"service unavailable","detail":"health check failed: please see /debug/health"}]} Jun 11 18:33:06.713592 ip-10-0-130-170 kubenswrapper[2565]: I0611 18:33:06.713475 2565 prober.go:120] "Probe failed" probeType="Liveness" pod="openshift-image-registry/image-registry-666fb979b7-zhmbp" podUID="0a494089-a655-4522-b2a2-955594964ac7" containerName="registry" probeResult="failure" output="HTTP probe failed with statuscode: 503" Jun 11 18:33:06.804035 ip-10-0-130-170 kubenswrapper[2565]: I0611 18:33:06.804004 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-operator-5bbd86d6bd-xr2lr" event={"ID":"41864c84-6359-4718-9e48-64baa8e95dbc","Type":"ContainerStarted","Data":"206723d2d430ea6367705e1a22b529380cb0ddf9ffb2b64021995d67503b118a"} Jun 11 18:33:08.555148 ip-10-0-130-170 kubenswrapper[2565]: I0611 18:33:08.555122 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_a198f4a2-26ba-432c-adae-ce340c910fe0/init-config-reloader/0.log" Jun 11 18:33:08.725234 ip-10-0-130-170 kubenswrapper[2565]: I0611 18:33:08.725206 2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-image-registry/image-registry-666fb979b7-zhmbp" Jun 11 18:33:08.757427 ip-10-0-130-170 kubenswrapper[2565]: I0611 18:33:08.757398 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_a198f4a2-26ba-432c-adae-ce340c910fe0/alertmanager/0.log" Jun 11 18:33:08.955572 ip-10-0-130-170 kubenswrapper[2565]: I0611 18:33:08.955536 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_a198f4a2-26ba-432c-adae-ce340c910fe0/config-reloader/0.log" Jun 11 18:33:09.155118 ip-10-0-130-170 kubenswrapper[2565]: I0611 18:33:09.155090 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_a198f4a2-26ba-432c-adae-ce340c910fe0/kube-rbac-proxy-web/0.log" Jun 11 18:33:09.354905 ip-10-0-130-170 kubenswrapper[2565]: I0611 18:33:09.354832 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_a198f4a2-26ba-432c-adae-ce340c910fe0/kube-rbac-proxy/0.log" Jun 11 18:33:09.556880 ip-10-0-130-170 kubenswrapper[2565]: I0611 18:33:09.556856 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_a198f4a2-26ba-432c-adae-ce340c910fe0/kube-rbac-proxy-metric/0.log" Jun 11 18:33:09.755202 ip-10-0-130-170 kubenswrapper[2565]: I0611 18:33:09.755177 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_a198f4a2-26ba-432c-adae-ce340c910fe0/prom-label-proxy/0.log" Jun 11 18:33:10.114359 ip-10-0-130-170 kubenswrapper[2565]: I0611 18:33:10.114274 2565 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-image-registry/image-registry-666fb979b7-zhmbp"] Jun 11 18:33:10.154908 ip-10-0-130-170 kubenswrapper[2565]: I0611 18:33:10.154880 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_kube-state-metrics-678bc549d7-89x49_11ac62e4-72e1-48d7-8b55-a615e80ea6ca/kube-state-metrics/0.log" Jun 11 18:33:10.355007 ip-10-0-130-170 kubenswrapper[2565]: I0611 18:33:10.354978 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_kube-state-metrics-678bc549d7-89x49_11ac62e4-72e1-48d7-8b55-a615e80ea6ca/kube-rbac-proxy-main/0.log" Jun 11 18:33:10.554922 ip-10-0-130-170 kubenswrapper[2565]: I0611 18:33:10.554893 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_kube-state-metrics-678bc549d7-89x49_11ac62e4-72e1-48d7-8b55-a615e80ea6ca/kube-rbac-proxy-self/0.log" Jun 11 18:33:10.955237 ip-10-0-130-170 kubenswrapper[2565]: I0611 18:33:10.955215 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_monitoring-plugin-589576dfc7-rxk8n_ed0fc27f-c5f2-4635-b24c-39acc6db3cab/monitoring-plugin/0.log" Jun 11 18:33:11.754528 ip-10-0-130-170 kubenswrapper[2565]: I0611 18:33:11.754500 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-jthcp_89eea2f5-d058-4ebf-b5f8-d6dbb8c40369/init-textfile/0.log" Jun 11 18:33:11.955352 ip-10-0-130-170 kubenswrapper[2565]: I0611 18:33:11.955322 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-jthcp_89eea2f5-d058-4ebf-b5f8-d6dbb8c40369/node-exporter/0.log" Jun 11 18:33:12.155220 ip-10-0-130-170 kubenswrapper[2565]: I0611 18:33:12.155193 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-jthcp_89eea2f5-d058-4ebf-b5f8-d6dbb8c40369/kube-rbac-proxy/0.log" Jun 11 18:33:12.954691 ip-10-0-130-170 kubenswrapper[2565]: I0611 18:33:12.954648 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_openshift-state-metrics-6b8d965dd5-wdstt_c9e106ea-f5bb-4fe9-9c47-b57141e42b07/kube-rbac-proxy-main/0.log" Jun 11 18:33:13.154695 ip-10-0-130-170 kubenswrapper[2565]: I0611 18:33:13.154669 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_openshift-state-metrics-6b8d965dd5-wdstt_c9e106ea-f5bb-4fe9-9c47-b57141e42b07/kube-rbac-proxy-self/0.log" Jun 11 18:33:13.355403 ip-10-0-130-170 kubenswrapper[2565]: I0611 18:33:13.355329 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_openshift-state-metrics-6b8d965dd5-wdstt_c9e106ea-f5bb-4fe9-9c47-b57141e42b07/openshift-state-metrics/0.log" Jun 11 18:33:15.355334 ip-10-0-130-170 kubenswrapper[2565]: I0611 18:33:15.355306 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-operator-admission-webhook-5cf667749c-xvt57_4b33b201-681a-4673-be4d-cdcf0eed397a/prometheus-operator-admission-webhook/0.log" Jun 11 18:33:17.355944 ip-10-0-130-170 kubenswrapper[2565]: I0611 18:33:17.355916 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-network-console_networking-console-plugin-867b76cb74-mbzpt_d9d950d8-2c16-43ec-a77c-8c0b870f52e6/networking-console-plugin/0.log" Jun 11 18:33:17.555429 ip-10-0-130-170 kubenswrapper[2565]: I0611 18:33:17.555402 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-5dbbb5d744-vpdts_3329f4b1-ac8c-4472-b6a0-13bb76075957/console-operator/1.log" Jun 11 18:33:17.757209 ip-10-0-130-170 kubenswrapper[2565]: I0611 18:33:17.757179 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-5dbbb5d744-vpdts_3329f4b1-ac8c-4472-b6a0-13bb76075957/console-operator/2.log" Jun 11 18:33:18.555739 ip-10-0-130-170 kubenswrapper[2565]: I0611 18:33:18.555672 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-4z9qr_41d85d95-09c6-46e3-990f-59c9ab3ad81f/dns/0.log" Jun 11 18:33:18.757294 ip-10-0-130-170 kubenswrapper[2565]: I0611 18:33:18.757215 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-4z9qr_41d85d95-09c6-46e3-990f-59c9ab3ad81f/kube-rbac-proxy/0.log" Jun 11 18:33:19.955373 ip-10-0-130-170 kubenswrapper[2565]: I0611 18:33:19.955349 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-ckltw_8e426e7d-dc89-476c-b72a-7cfc3b64a1f2/dns-node-resolver/0.log" Jun 11 18:33:20.355853 ip-10-0-130-170 kubenswrapper[2565]: I0611 18:33:20.355757 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_image-registry-666fb979b7-zhmbp_0a494089-a655-4522-b2a2-955594964ac7/registry/0.log" Jun 11 18:33:20.955678 ip-10-0-130-170 kubenswrapper[2565]: I0611 18:33:20.955653 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-wwlkz_7f5f862b-4ec0-44cd-96f3-1554a1656229/node-ca/0.log" Jun 11 18:33:21.754997 ip-10-0-130-170 kubenswrapper[2565]: I0611 18:33:21.754972 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-czdq5_35a5e103-2756-40a3-ad29-bae095288d5b/serve-healthcheck-canary/0.log" Jun 11 18:33:35.134760 ip-10-0-130-170 kubenswrapper[2565]: I0611 18:33:35.134721 2565 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-image-registry/image-registry-666fb979b7-zhmbp" podUID="0a494089-a655-4522-b2a2-955594964ac7" containerName="registry" containerID="cri-o://685b863dba322f3d8d93d69120469fb5691c6d41ed96f7108e051925ebc4a88c" gracePeriod=30 Jun 11 18:33:36.396708 ip-10-0-130-170 kubenswrapper[2565]: I0611 18:33:36.396684 2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-666fb979b7-zhmbp" Jun 11 18:33:36.549619 ip-10-0-130-170 kubenswrapper[2565]: I0611 18:33:36.549531 2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-s7hwm\" (UniqueName: \"kubernetes.io/projected/0a494089-a655-4522-b2a2-955594964ac7-kube-api-access-s7hwm\") pod \"0a494089-a655-4522-b2a2-955594964ac7\" (UID: \"0a494089-a655-4522-b2a2-955594964ac7\") " Jun 11 18:33:36.549619 ip-10-0-130-170 kubenswrapper[2565]: I0611 18:33:36.549573 2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/0a494089-a655-4522-b2a2-955594964ac7-ca-trust-extracted\") pod \"0a494089-a655-4522-b2a2-955594964ac7\" (UID: \"0a494089-a655-4522-b2a2-955594964ac7\") " Jun 11 18:33:36.549619 ip-10-0-130-170 kubenswrapper[2565]: I0611 18:33:36.549597 2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/0a494089-a655-4522-b2a2-955594964ac7-registry-tls\") pod \"0a494089-a655-4522-b2a2-955594964ac7\" (UID: \"0a494089-a655-4522-b2a2-955594964ac7\") " Jun 11 18:33:36.549619 ip-10-0-130-170 kubenswrapper[2565]: I0611 18:33:36.549615 2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/0a494089-a655-4522-b2a2-955594964ac7-image-registry-private-configuration\") pod \"0a494089-a655-4522-b2a2-955594964ac7\" (UID: \"0a494089-a655-4522-b2a2-955594964ac7\") " Jun 11 18:33:36.549934 ip-10-0-130-170 kubenswrapper[2565]: I0611 18:33:36.549665 2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/0a494089-a655-4522-b2a2-955594964ac7-installation-pull-secrets\") pod \"0a494089-a655-4522-b2a2-955594964ac7\" (UID: \"0a494089-a655-4522-b2a2-955594964ac7\") " Jun 11 18:33:36.549934 ip-10-0-130-170 kubenswrapper[2565]: I0611 18:33:36.549684 2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/0a494089-a655-4522-b2a2-955594964ac7-bound-sa-token\") pod \"0a494089-a655-4522-b2a2-955594964ac7\" (UID: \"0a494089-a655-4522-b2a2-955594964ac7\") " Jun 11 18:33:36.549934 ip-10-0-130-170 kubenswrapper[2565]: I0611 18:33:36.549737 2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/0a494089-a655-4522-b2a2-955594964ac7-registry-certificates\") pod \"0a494089-a655-4522-b2a2-955594964ac7\" (UID: \"0a494089-a655-4522-b2a2-955594964ac7\") " Jun 11 18:33:36.549934 ip-10-0-130-170 kubenswrapper[2565]: I0611 18:33:36.549761 2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/0a494089-a655-4522-b2a2-955594964ac7-trusted-ca\") pod \"0a494089-a655-4522-b2a2-955594964ac7\" (UID: \"0a494089-a655-4522-b2a2-955594964ac7\") " Jun 11 18:33:36.550860 ip-10-0-130-170 kubenswrapper[2565]: I0611 18:33:36.550412 2565 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/0a494089-a655-4522-b2a2-955594964ac7-trusted-ca" (OuterVolumeSpecName: "trusted-ca") pod "0a494089-a655-4522-b2a2-955594964ac7" (UID: "0a494089-a655-4522-b2a2-955594964ac7"). InnerVolumeSpecName "trusted-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 11 18:33:36.550860 ip-10-0-130-170 kubenswrapper[2565]: I0611 18:33:36.550819 2565 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/0a494089-a655-4522-b2a2-955594964ac7-registry-certificates" (OuterVolumeSpecName: "registry-certificates") pod "0a494089-a655-4522-b2a2-955594964ac7" (UID: "0a494089-a655-4522-b2a2-955594964ac7"). InnerVolumeSpecName "registry-certificates". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 11 18:33:36.552475 ip-10-0-130-170 kubenswrapper[2565]: I0611 18:33:36.552239 2565 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/0a494089-a655-4522-b2a2-955594964ac7-image-registry-private-configuration" (OuterVolumeSpecName: "image-registry-private-configuration") pod "0a494089-a655-4522-b2a2-955594964ac7" (UID: "0a494089-a655-4522-b2a2-955594964ac7"). InnerVolumeSpecName "image-registry-private-configuration". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 11 18:33:36.552604 ip-10-0-130-170 kubenswrapper[2565]: I0611 18:33:36.552565 2565 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/0a494089-a655-4522-b2a2-955594964ac7-installation-pull-secrets" (OuterVolumeSpecName: "installation-pull-secrets") pod "0a494089-a655-4522-b2a2-955594964ac7" (UID: "0a494089-a655-4522-b2a2-955594964ac7"). InnerVolumeSpecName "installation-pull-secrets". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 11 18:33:36.552659 ip-10-0-130-170 kubenswrapper[2565]: I0611 18:33:36.552605 2565 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/0a494089-a655-4522-b2a2-955594964ac7-registry-tls" (OuterVolumeSpecName: "registry-tls") pod "0a494089-a655-4522-b2a2-955594964ac7" (UID: "0a494089-a655-4522-b2a2-955594964ac7"). InnerVolumeSpecName "registry-tls". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 11 18:33:36.552659 ip-10-0-130-170 kubenswrapper[2565]: I0611 18:33:36.552615 2565 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/0a494089-a655-4522-b2a2-955594964ac7-kube-api-access-s7hwm" (OuterVolumeSpecName: "kube-api-access-s7hwm") pod "0a494089-a655-4522-b2a2-955594964ac7" (UID: "0a494089-a655-4522-b2a2-955594964ac7"). InnerVolumeSpecName "kube-api-access-s7hwm". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 11 18:33:36.552729 ip-10-0-130-170 kubenswrapper[2565]: I0611 18:33:36.552709 2565 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/0a494089-a655-4522-b2a2-955594964ac7-bound-sa-token" (OuterVolumeSpecName: "bound-sa-token") pod "0a494089-a655-4522-b2a2-955594964ac7" (UID: "0a494089-a655-4522-b2a2-955594964ac7"). InnerVolumeSpecName "bound-sa-token". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 11 18:33:36.558867 ip-10-0-130-170 kubenswrapper[2565]: I0611 18:33:36.558843 2565 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/0a494089-a655-4522-b2a2-955594964ac7-ca-trust-extracted" (OuterVolumeSpecName: "ca-trust-extracted") pod "0a494089-a655-4522-b2a2-955594964ac7" (UID: "0a494089-a655-4522-b2a2-955594964ac7"). InnerVolumeSpecName "ca-trust-extracted". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 11 18:33:36.651310 ip-10-0-130-170 kubenswrapper[2565]: I0611 18:33:36.651248 2565 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-s7hwm\" (UniqueName: \"kubernetes.io/projected/0a494089-a655-4522-b2a2-955594964ac7-kube-api-access-s7hwm\") on node \"ip-10-0-130-170.ec2.internal\" DevicePath \"\"" Jun 11 18:33:36.651310 ip-10-0-130-170 kubenswrapper[2565]: I0611 18:33:36.651306 2565 reconciler_common.go:299] "Volume detached for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/0a494089-a655-4522-b2a2-955594964ac7-ca-trust-extracted\") on node \"ip-10-0-130-170.ec2.internal\" DevicePath \"\"" Jun 11 18:33:36.651310 ip-10-0-130-170 kubenswrapper[2565]: I0611 18:33:36.651316 2565 reconciler_common.go:299] "Volume detached for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/0a494089-a655-4522-b2a2-955594964ac7-registry-tls\") on node \"ip-10-0-130-170.ec2.internal\" DevicePath \"\"" Jun 11 18:33:36.651548 ip-10-0-130-170 kubenswrapper[2565]: I0611 18:33:36.651326 2565 reconciler_common.go:299] "Volume detached for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/0a494089-a655-4522-b2a2-955594964ac7-image-registry-private-configuration\") on node \"ip-10-0-130-170.ec2.internal\" DevicePath \"\"" Jun 11 18:33:36.651548 ip-10-0-130-170 kubenswrapper[2565]: I0611 18:33:36.651336 2565 reconciler_common.go:299] "Volume detached for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/0a494089-a655-4522-b2a2-955594964ac7-installation-pull-secrets\") on node \"ip-10-0-130-170.ec2.internal\" DevicePath \"\"" Jun 11 18:33:36.651548 ip-10-0-130-170 kubenswrapper[2565]: I0611 18:33:36.651344 2565 reconciler_common.go:299] "Volume detached for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/0a494089-a655-4522-b2a2-955594964ac7-bound-sa-token\") on node \"ip-10-0-130-170.ec2.internal\" DevicePath \"\"" Jun 11 18:33:36.651548 ip-10-0-130-170 kubenswrapper[2565]: I0611 18:33:36.651352 2565 reconciler_common.go:299] "Volume detached for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/0a494089-a655-4522-b2a2-955594964ac7-registry-certificates\") on node \"ip-10-0-130-170.ec2.internal\" DevicePath \"\"" Jun 11 18:33:36.651548 ip-10-0-130-170 kubenswrapper[2565]: I0611 18:33:36.651360 2565 reconciler_common.go:299] "Volume detached for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/0a494089-a655-4522-b2a2-955594964ac7-trusted-ca\") on node \"ip-10-0-130-170.ec2.internal\" DevicePath \"\"" Jun 11 18:33:36.938060 ip-10-0-130-170 kubenswrapper[2565]: I0611 18:33:36.938027 2565 generic.go:356] "Generic (PLEG): container finished" podID="0a494089-a655-4522-b2a2-955594964ac7" containerID="685b863dba322f3d8d93d69120469fb5691c6d41ed96f7108e051925ebc4a88c" exitCode=0 Jun 11 18:33:36.938224 ip-10-0-130-170 kubenswrapper[2565]: I0611 18:33:36.938071 2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-666fb979b7-zhmbp" Jun 11 18:33:36.938224 ip-10-0-130-170 kubenswrapper[2565]: I0611 18:33:36.938105 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-666fb979b7-zhmbp" event={"ID":"0a494089-a655-4522-b2a2-955594964ac7","Type":"ContainerDied","Data":"685b863dba322f3d8d93d69120469fb5691c6d41ed96f7108e051925ebc4a88c"} Jun 11 18:33:36.938224 ip-10-0-130-170 kubenswrapper[2565]: I0611 18:33:36.938158 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-666fb979b7-zhmbp" event={"ID":"0a494089-a655-4522-b2a2-955594964ac7","Type":"ContainerDied","Data":"42db8403cb56ce681427b015e3578ad41e0b98e674b09960136b56b3c178f611"} Jun 11 18:33:36.938224 ip-10-0-130-170 kubenswrapper[2565]: I0611 18:33:36.938184 2565 scope.go:117] "RemoveContainer" containerID="685b863dba322f3d8d93d69120469fb5691c6d41ed96f7108e051925ebc4a88c" Jun 11 18:33:36.947239 ip-10-0-130-170 kubenswrapper[2565]: I0611 18:33:36.947220 2565 scope.go:117] "RemoveContainer" containerID="685b863dba322f3d8d93d69120469fb5691c6d41ed96f7108e051925ebc4a88c" Jun 11 18:33:36.947514 ip-10-0-130-170 kubenswrapper[2565]: E0611 18:33:36.947497 2565 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"685b863dba322f3d8d93d69120469fb5691c6d41ed96f7108e051925ebc4a88c\": container with ID starting with 685b863dba322f3d8d93d69120469fb5691c6d41ed96f7108e051925ebc4a88c not found: ID does not exist" containerID="685b863dba322f3d8d93d69120469fb5691c6d41ed96f7108e051925ebc4a88c" Jun 11 18:33:36.947568 ip-10-0-130-170 kubenswrapper[2565]: I0611 18:33:36.947522 2565 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"685b863dba322f3d8d93d69120469fb5691c6d41ed96f7108e051925ebc4a88c"} err="failed to get container status \"685b863dba322f3d8d93d69120469fb5691c6d41ed96f7108e051925ebc4a88c\": rpc error: code = NotFound desc = could not find container \"685b863dba322f3d8d93d69120469fb5691c6d41ed96f7108e051925ebc4a88c\": container with ID starting with 685b863dba322f3d8d93d69120469fb5691c6d41ed96f7108e051925ebc4a88c not found: ID does not exist" Jun 11 18:33:36.960129 ip-10-0-130-170 kubenswrapper[2565]: I0611 18:33:36.960104 2565 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-image-registry/image-registry-666fb979b7-zhmbp"] Jun 11 18:33:36.963881 ip-10-0-130-170 kubenswrapper[2565]: I0611 18:33:36.963857 2565 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-image-registry/image-registry-666fb979b7-zhmbp"] Jun 11 18:33:37.751726 ip-10-0-130-170 kubenswrapper[2565]: I0611 18:33:37.749380 2565 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="0a494089-a655-4522-b2a2-955594964ac7" path="/var/lib/kubelet/pods/0a494089-a655-4522-b2a2-955594964ac7/volumes" Jun 11 18:34:04.473615 ip-10-0-130-170 kubenswrapper[2565]: I0611 18:34:04.473493 2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-5b4bb9566c-52tn6"] Jun 11 18:34:04.474150 ip-10-0-130-170 kubenswrapper[2565]: I0611 18:34:04.473933 2565 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="0a494089-a655-4522-b2a2-955594964ac7" containerName="registry" Jun 11 18:34:04.474150 ip-10-0-130-170 kubenswrapper[2565]: I0611 18:34:04.473953 2565 state_mem.go:107] "Deleted CPUSet assignment" podUID="0a494089-a655-4522-b2a2-955594964ac7" containerName="registry" Jun 11 18:34:04.474150 ip-10-0-130-170 kubenswrapper[2565]: I0611 18:34:04.473986 2565 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="4473e901-c297-4298-b314-1c31a91d3510" containerName="console" Jun 11 18:34:04.474150 ip-10-0-130-170 kubenswrapper[2565]: I0611 18:34:04.473995 2565 state_mem.go:107] "Deleted CPUSet assignment" podUID="4473e901-c297-4298-b314-1c31a91d3510" containerName="console" Jun 11 18:34:04.474150 ip-10-0-130-170 kubenswrapper[2565]: I0611 18:34:04.474068 2565 memory_manager.go:368] "RemoveStaleState removing state" podUID="0a494089-a655-4522-b2a2-955594964ac7" containerName="registry" Jun 11 18:34:04.474150 ip-10-0-130-170 kubenswrapper[2565]: I0611 18:34:04.474083 2565 memory_manager.go:368] "RemoveStaleState removing state" podUID="4473e901-c297-4298-b314-1c31a91d3510" containerName="console" Jun 11 18:34:04.478697 ip-10-0-130-170 kubenswrapper[2565]: I0611 18:34:04.478666 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-5b4bb9566c-52tn6" Jun 11 18:34:04.481384 ip-10-0-130-170 kubenswrapper[2565]: I0611 18:34:04.481347 2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"console-config\"" Jun 11 18:34:04.481384 ip-10-0-130-170 kubenswrapper[2565]: I0611 18:34:04.481377 2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"oauth-serving-cert\"" Jun 11 18:34:04.482246 ip-10-0-130-170 kubenswrapper[2565]: I0611 18:34:04.482231 2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"openshift-service-ca.crt\"" Jun 11 18:34:04.482343 ip-10-0-130-170 kubenswrapper[2565]: I0611 18:34:04.482315 2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"kube-root-ca.crt\"" Jun 11 18:34:04.482411 ip-10-0-130-170 kubenswrapper[2565]: I0611 18:34:04.482390 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-oauth-config\"" Jun 11 18:34:04.482464 ip-10-0-130-170 kubenswrapper[2565]: I0611 18:34:04.482454 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-dockercfg-rx75w\"" Jun 11 18:34:04.482518 ip-10-0-130-170 kubenswrapper[2565]: I0611 18:34:04.482460 2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"service-ca\"" Jun 11 18:34:04.482518 ip-10-0-130-170 kubenswrapper[2565]: I0611 18:34:04.482452 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-serving-cert\"" Jun 11 18:34:04.491619 ip-10-0-130-170 kubenswrapper[2565]: I0611 18:34:04.491593 2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"trusted-ca-bundle\"" Jun 11 18:34:04.493018 ip-10-0-130-170 kubenswrapper[2565]: I0611 18:34:04.492993 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-5b4bb9566c-52tn6"] Jun 11 18:34:04.574971 ip-10-0-130-170 kubenswrapper[2565]: I0611 18:34:04.574942 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/70f4db72-609a-42aa-bb5d-bc973440eede-console-oauth-config\") pod \"console-5b4bb9566c-52tn6\" (UID: \"70f4db72-609a-42aa-bb5d-bc973440eede\") " pod="openshift-console/console-5b4bb9566c-52tn6" Jun 11 18:34:04.575168 ip-10-0-130-170 kubenswrapper[2565]: I0611 18:34:04.574985 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/70f4db72-609a-42aa-bb5d-bc973440eede-console-config\") pod \"console-5b4bb9566c-52tn6\" (UID: \"70f4db72-609a-42aa-bb5d-bc973440eede\") " pod="openshift-console/console-5b4bb9566c-52tn6" Jun 11 18:34:04.575168 ip-10-0-130-170 kubenswrapper[2565]: I0611 18:34:04.575008 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/70f4db72-609a-42aa-bb5d-bc973440eede-service-ca\") pod \"console-5b4bb9566c-52tn6\" (UID: \"70f4db72-609a-42aa-bb5d-bc973440eede\") " pod="openshift-console/console-5b4bb9566c-52tn6" Jun 11 18:34:04.575168 ip-10-0-130-170 kubenswrapper[2565]: I0611 18:34:04.575032 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/70f4db72-609a-42aa-bb5d-bc973440eede-console-serving-cert\") pod \"console-5b4bb9566c-52tn6\" (UID: \"70f4db72-609a-42aa-bb5d-bc973440eede\") " pod="openshift-console/console-5b4bb9566c-52tn6" Jun 11 18:34:04.575168 ip-10-0-130-170 kubenswrapper[2565]: I0611 18:34:04.575080 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/70f4db72-609a-42aa-bb5d-bc973440eede-trusted-ca-bundle\") pod \"console-5b4bb9566c-52tn6\" (UID: \"70f4db72-609a-42aa-bb5d-bc973440eede\") " pod="openshift-console/console-5b4bb9566c-52tn6" Jun 11 18:34:04.575168 ip-10-0-130-170 kubenswrapper[2565]: I0611 18:34:04.575127 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-td2ls\" (UniqueName: \"kubernetes.io/projected/70f4db72-609a-42aa-bb5d-bc973440eede-kube-api-access-td2ls\") pod \"console-5b4bb9566c-52tn6\" (UID: \"70f4db72-609a-42aa-bb5d-bc973440eede\") " pod="openshift-console/console-5b4bb9566c-52tn6" Jun 11 18:34:04.575168 ip-10-0-130-170 kubenswrapper[2565]: I0611 18:34:04.575158 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/70f4db72-609a-42aa-bb5d-bc973440eede-oauth-serving-cert\") pod \"console-5b4bb9566c-52tn6\" (UID: \"70f4db72-609a-42aa-bb5d-bc973440eede\") " pod="openshift-console/console-5b4bb9566c-52tn6" Jun 11 18:34:04.676594 ip-10-0-130-170 kubenswrapper[2565]: I0611 18:34:04.676556 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/70f4db72-609a-42aa-bb5d-bc973440eede-console-oauth-config\") pod \"console-5b4bb9566c-52tn6\" (UID: \"70f4db72-609a-42aa-bb5d-bc973440eede\") " pod="openshift-console/console-5b4bb9566c-52tn6" Jun 11 18:34:04.676784 ip-10-0-130-170 kubenswrapper[2565]: I0611 18:34:04.676608 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/70f4db72-609a-42aa-bb5d-bc973440eede-console-config\") pod \"console-5b4bb9566c-52tn6\" (UID: \"70f4db72-609a-42aa-bb5d-bc973440eede\") " pod="openshift-console/console-5b4bb9566c-52tn6" Jun 11 18:34:04.676784 ip-10-0-130-170 kubenswrapper[2565]: I0611 18:34:04.676738 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/70f4db72-609a-42aa-bb5d-bc973440eede-service-ca\") pod \"console-5b4bb9566c-52tn6\" (UID: \"70f4db72-609a-42aa-bb5d-bc973440eede\") " pod="openshift-console/console-5b4bb9566c-52tn6" Jun 11 18:34:04.676899 ip-10-0-130-170 kubenswrapper[2565]: I0611 18:34:04.676783 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/70f4db72-609a-42aa-bb5d-bc973440eede-console-serving-cert\") pod \"console-5b4bb9566c-52tn6\" (UID: \"70f4db72-609a-42aa-bb5d-bc973440eede\") " pod="openshift-console/console-5b4bb9566c-52tn6" Jun 11 18:34:04.676899 ip-10-0-130-170 kubenswrapper[2565]: I0611 18:34:04.676810 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/70f4db72-609a-42aa-bb5d-bc973440eede-trusted-ca-bundle\") pod \"console-5b4bb9566c-52tn6\" (UID: \"70f4db72-609a-42aa-bb5d-bc973440eede\") " pod="openshift-console/console-5b4bb9566c-52tn6" Jun 11 18:34:04.676899 ip-10-0-130-170 kubenswrapper[2565]: I0611 18:34:04.676835 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-td2ls\" (UniqueName: \"kubernetes.io/projected/70f4db72-609a-42aa-bb5d-bc973440eede-kube-api-access-td2ls\") pod \"console-5b4bb9566c-52tn6\" (UID: \"70f4db72-609a-42aa-bb5d-bc973440eede\") " pod="openshift-console/console-5b4bb9566c-52tn6" Jun 11 18:34:04.676899 ip-10-0-130-170 kubenswrapper[2565]: I0611 18:34:04.676866 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/70f4db72-609a-42aa-bb5d-bc973440eede-oauth-serving-cert\") pod \"console-5b4bb9566c-52tn6\" (UID: \"70f4db72-609a-42aa-bb5d-bc973440eede\") " pod="openshift-console/console-5b4bb9566c-52tn6" Jun 11 18:34:04.677433 ip-10-0-130-170 kubenswrapper[2565]: I0611 18:34:04.677400 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/70f4db72-609a-42aa-bb5d-bc973440eede-console-config\") pod \"console-5b4bb9566c-52tn6\" (UID: \"70f4db72-609a-42aa-bb5d-bc973440eede\") " pod="openshift-console/console-5b4bb9566c-52tn6" Jun 11 18:34:04.677547 ip-10-0-130-170 kubenswrapper[2565]: I0611 18:34:04.677488 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/70f4db72-609a-42aa-bb5d-bc973440eede-service-ca\") pod \"console-5b4bb9566c-52tn6\" (UID: \"70f4db72-609a-42aa-bb5d-bc973440eede\") " pod="openshift-console/console-5b4bb9566c-52tn6" Jun 11 18:34:04.677818 ip-10-0-130-170 kubenswrapper[2565]: I0611 18:34:04.677795 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/70f4db72-609a-42aa-bb5d-bc973440eede-oauth-serving-cert\") pod \"console-5b4bb9566c-52tn6\" (UID: \"70f4db72-609a-42aa-bb5d-bc973440eede\") " pod="openshift-console/console-5b4bb9566c-52tn6" Jun 11 18:34:04.677992 ip-10-0-130-170 kubenswrapper[2565]: I0611 18:34:04.677968 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/70f4db72-609a-42aa-bb5d-bc973440eede-trusted-ca-bundle\") pod \"console-5b4bb9566c-52tn6\" (UID: \"70f4db72-609a-42aa-bb5d-bc973440eede\") " pod="openshift-console/console-5b4bb9566c-52tn6" Jun 11 18:34:04.679342 ip-10-0-130-170 kubenswrapper[2565]: I0611 18:34:04.679318 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/70f4db72-609a-42aa-bb5d-bc973440eede-console-oauth-config\") pod \"console-5b4bb9566c-52tn6\" (UID: \"70f4db72-609a-42aa-bb5d-bc973440eede\") " pod="openshift-console/console-5b4bb9566c-52tn6" Jun 11 18:34:04.679442 ip-10-0-130-170 kubenswrapper[2565]: I0611 18:34:04.679424 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/70f4db72-609a-42aa-bb5d-bc973440eede-console-serving-cert\") pod \"console-5b4bb9566c-52tn6\" (UID: \"70f4db72-609a-42aa-bb5d-bc973440eede\") " pod="openshift-console/console-5b4bb9566c-52tn6" Jun 11 18:34:04.685175 ip-10-0-130-170 kubenswrapper[2565]: I0611 18:34:04.685152 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-td2ls\" (UniqueName: \"kubernetes.io/projected/70f4db72-609a-42aa-bb5d-bc973440eede-kube-api-access-td2ls\") pod \"console-5b4bb9566c-52tn6\" (UID: \"70f4db72-609a-42aa-bb5d-bc973440eede\") " pod="openshift-console/console-5b4bb9566c-52tn6" Jun 11 18:34:04.790343 ip-10-0-130-170 kubenswrapper[2565]: I0611 18:34:04.790248 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-5b4bb9566c-52tn6" Jun 11 18:34:04.926534 ip-10-0-130-170 kubenswrapper[2565]: I0611 18:34:04.926508 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-5b4bb9566c-52tn6"] Jun 11 18:34:04.929187 ip-10-0-130-170 kubenswrapper[2565]: W0611 18:34:04.929159 2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod70f4db72_609a_42aa_bb5d_bc973440eede.slice/crio-93cbbb912e235871d8f6879ae97ceff4cf742246805677d29405ec0306b72a95 WatchSource:0}: Error finding container 93cbbb912e235871d8f6879ae97ceff4cf742246805677d29405ec0306b72a95: Status 404 returned error can't find the container with id 93cbbb912e235871d8f6879ae97ceff4cf742246805677d29405ec0306b72a95 Jun 11 18:34:05.050900 ip-10-0-130-170 kubenswrapper[2565]: I0611 18:34:05.050797 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-5b4bb9566c-52tn6" event={"ID":"70f4db72-609a-42aa-bb5d-bc973440eede","Type":"ContainerStarted","Data":"cad454969ddc06561d23b179125d986d3e2554268126a4269bc02d6ff828cb75"} Jun 11 18:34:05.050900 ip-10-0-130-170 kubenswrapper[2565]: I0611 18:34:05.050866 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-5b4bb9566c-52tn6" event={"ID":"70f4db72-609a-42aa-bb5d-bc973440eede","Type":"ContainerStarted","Data":"93cbbb912e235871d8f6879ae97ceff4cf742246805677d29405ec0306b72a95"} Jun 11 18:34:05.069706 ip-10-0-130-170 kubenswrapper[2565]: I0611 18:34:05.069647 2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-5b4bb9566c-52tn6" podStartSLOduration=1.069628637 podStartE2EDuration="1.069628637s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-11 18:34:04 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-11 18:34:05.069365158 +0000 UTC m=+363.818051180" watchObservedRunningTime="2026-06-11 18:34:05.069628637 +0000 UTC m=+363.818314660" Jun 11 18:34:14.790635 ip-10-0-130-170 kubenswrapper[2565]: I0611 18:34:14.790595 2565 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-5b4bb9566c-52tn6" Jun 11 18:34:14.791085 ip-10-0-130-170 kubenswrapper[2565]: I0611 18:34:14.790658 2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-5b4bb9566c-52tn6" Jun 11 18:34:14.795404 ip-10-0-130-170 kubenswrapper[2565]: I0611 18:34:14.795379 2565 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-5b4bb9566c-52tn6" Jun 11 18:34:15.094492 ip-10-0-130-170 kubenswrapper[2565]: I0611 18:34:15.094402 2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-5b4bb9566c-52tn6" Jun 11 18:34:38.679008 ip-10-0-130-170 kubenswrapper[2565]: I0611 18:34:38.678967 2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dxvfhh"] Jun 11 18:34:38.682476 ip-10-0-130-170 kubenswrapper[2565]: I0611 18:34:38.682456 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dxvfhh" Jun 11 18:34:38.685329 ip-10-0-130-170 kubenswrapper[2565]: I0611 18:34:38.685295 2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"kube-root-ca.crt\"" Jun 11 18:34:38.686191 ip-10-0-130-170 kubenswrapper[2565]: I0611 18:34:38.686175 2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"openshift-service-ca.crt\"" Jun 11 18:34:38.686310 ip-10-0-130-170 kubenswrapper[2565]: I0611 18:34:38.686214 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-marketplace\"/\"default-dockercfg-8jd6m\"" Jun 11 18:34:38.693323 ip-10-0-130-170 kubenswrapper[2565]: I0611 18:34:38.693300 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dxvfhh"] Jun 11 18:34:38.768822 ip-10-0-130-170 kubenswrapper[2565]: I0611 18:34:38.768784 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/945a68c7-7400-4d11-9a4a-b09119225f58-util\") pod \"2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dxvfhh\" (UID: \"945a68c7-7400-4d11-9a4a-b09119225f58\") " pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dxvfhh" Jun 11 18:34:38.768822 ip-10-0-130-170 kubenswrapper[2565]: I0611 18:34:38.768822 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-tjqkp\" (UniqueName: \"kubernetes.io/projected/945a68c7-7400-4d11-9a4a-b09119225f58-kube-api-access-tjqkp\") pod \"2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dxvfhh\" (UID: \"945a68c7-7400-4d11-9a4a-b09119225f58\") " pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dxvfhh" Jun 11 18:34:38.769025 ip-10-0-130-170 kubenswrapper[2565]: I0611 18:34:38.768902 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/945a68c7-7400-4d11-9a4a-b09119225f58-bundle\") pod \"2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dxvfhh\" (UID: \"945a68c7-7400-4d11-9a4a-b09119225f58\") " pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dxvfhh" Jun 11 18:34:38.870279 ip-10-0-130-170 kubenswrapper[2565]: I0611 18:34:38.870216 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/945a68c7-7400-4d11-9a4a-b09119225f58-bundle\") pod \"2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dxvfhh\" (UID: \"945a68c7-7400-4d11-9a4a-b09119225f58\") " pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dxvfhh" Jun 11 18:34:38.870468 ip-10-0-130-170 kubenswrapper[2565]: I0611 18:34:38.870442 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/945a68c7-7400-4d11-9a4a-b09119225f58-util\") pod \"2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dxvfhh\" (UID: \"945a68c7-7400-4d11-9a4a-b09119225f58\") " pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dxvfhh" Jun 11 18:34:38.870536 ip-10-0-130-170 kubenswrapper[2565]: I0611 18:34:38.870480 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-tjqkp\" (UniqueName: \"kubernetes.io/projected/945a68c7-7400-4d11-9a4a-b09119225f58-kube-api-access-tjqkp\") pod \"2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dxvfhh\" (UID: \"945a68c7-7400-4d11-9a4a-b09119225f58\") " pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dxvfhh" Jun 11 18:34:38.870605 ip-10-0-130-170 kubenswrapper[2565]: I0611 18:34:38.870583 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/945a68c7-7400-4d11-9a4a-b09119225f58-bundle\") pod \"2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dxvfhh\" (UID: \"945a68c7-7400-4d11-9a4a-b09119225f58\") " pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dxvfhh" Jun 11 18:34:38.870745 ip-10-0-130-170 kubenswrapper[2565]: I0611 18:34:38.870721 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/945a68c7-7400-4d11-9a4a-b09119225f58-util\") pod \"2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dxvfhh\" (UID: \"945a68c7-7400-4d11-9a4a-b09119225f58\") " pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dxvfhh" Jun 11 18:34:38.879122 ip-10-0-130-170 kubenswrapper[2565]: I0611 18:34:38.879097 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-tjqkp\" (UniqueName: \"kubernetes.io/projected/945a68c7-7400-4d11-9a4a-b09119225f58-kube-api-access-tjqkp\") pod \"2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dxvfhh\" (UID: \"945a68c7-7400-4d11-9a4a-b09119225f58\") " pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dxvfhh" Jun 11 18:34:38.993288 ip-10-0-130-170 kubenswrapper[2565]: I0611 18:34:38.993180 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dxvfhh" Jun 11 18:34:39.124569 ip-10-0-130-170 kubenswrapper[2565]: I0611 18:34:39.124542 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dxvfhh"] Jun 11 18:34:39.127160 ip-10-0-130-170 kubenswrapper[2565]: W0611 18:34:39.127134 2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod945a68c7_7400_4d11_9a4a_b09119225f58.slice/crio-bd51ab607feee633e672da1828826920a70870e8adccde26297445ce7f37eee1 WatchSource:0}: Error finding container bd51ab607feee633e672da1828826920a70870e8adccde26297445ce7f37eee1: Status 404 returned error can't find the container with id bd51ab607feee633e672da1828826920a70870e8adccde26297445ce7f37eee1 Jun 11 18:34:39.129150 ip-10-0-130-170 kubenswrapper[2565]: I0611 18:34:39.129134 2565 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jun 11 18:34:39.189005 ip-10-0-130-170 kubenswrapper[2565]: I0611 18:34:39.188972 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dxvfhh" event={"ID":"945a68c7-7400-4d11-9a4a-b09119225f58","Type":"ContainerStarted","Data":"bd51ab607feee633e672da1828826920a70870e8adccde26297445ce7f37eee1"} Jun 11 18:34:46.222590 ip-10-0-130-170 kubenswrapper[2565]: I0611 18:34:46.222553 2565 generic.go:356] "Generic (PLEG): container finished" podID="945a68c7-7400-4d11-9a4a-b09119225f58" containerID="986d5a299b5d48c5b06a36d37d2034a6399b2b1ce4bb15a2799cb16d296e550c" exitCode=0 Jun 11 18:34:46.223005 ip-10-0-130-170 kubenswrapper[2565]: I0611 18:34:46.222602 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dxvfhh" event={"ID":"945a68c7-7400-4d11-9a4a-b09119225f58","Type":"ContainerDied","Data":"986d5a299b5d48c5b06a36d37d2034a6399b2b1ce4bb15a2799cb16d296e550c"} Jun 11 18:34:49.237090 ip-10-0-130-170 kubenswrapper[2565]: I0611 18:34:49.237054 2565 generic.go:356] "Generic (PLEG): container finished" podID="945a68c7-7400-4d11-9a4a-b09119225f58" containerID="48f858e8a2f7a1e25b7d640a261b2d45ccdcf6fb72b5a36111e0dcefe757d6cd" exitCode=0 Jun 11 18:34:49.237498 ip-10-0-130-170 kubenswrapper[2565]: I0611 18:34:49.237101 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dxvfhh" event={"ID":"945a68c7-7400-4d11-9a4a-b09119225f58","Type":"ContainerDied","Data":"48f858e8a2f7a1e25b7d640a261b2d45ccdcf6fb72b5a36111e0dcefe757d6cd"} Jun 11 18:34:57.278087 ip-10-0-130-170 kubenswrapper[2565]: I0611 18:34:57.278052 2565 generic.go:356] "Generic (PLEG): container finished" podID="945a68c7-7400-4d11-9a4a-b09119225f58" containerID="e3af93265a7af7449a308c6373f542e691d3b47c0863f820d8f6118ccf4b4686" exitCode=0 Jun 11 18:34:57.278575 ip-10-0-130-170 kubenswrapper[2565]: I0611 18:34:57.278143 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dxvfhh" event={"ID":"945a68c7-7400-4d11-9a4a-b09119225f58","Type":"ContainerDied","Data":"e3af93265a7af7449a308c6373f542e691d3b47c0863f820d8f6118ccf4b4686"} Jun 11 18:34:58.416693 ip-10-0-130-170 kubenswrapper[2565]: I0611 18:34:58.416669 2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dxvfhh" Jun 11 18:34:58.431665 ip-10-0-130-170 kubenswrapper[2565]: I0611 18:34:58.431642 2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/945a68c7-7400-4d11-9a4a-b09119225f58-bundle\") pod \"945a68c7-7400-4d11-9a4a-b09119225f58\" (UID: \"945a68c7-7400-4d11-9a4a-b09119225f58\") " Jun 11 18:34:58.431810 ip-10-0-130-170 kubenswrapper[2565]: I0611 18:34:58.431740 2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/945a68c7-7400-4d11-9a4a-b09119225f58-util\") pod \"945a68c7-7400-4d11-9a4a-b09119225f58\" (UID: \"945a68c7-7400-4d11-9a4a-b09119225f58\") " Jun 11 18:34:58.431810 ip-10-0-130-170 kubenswrapper[2565]: I0611 18:34:58.431761 2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-tjqkp\" (UniqueName: \"kubernetes.io/projected/945a68c7-7400-4d11-9a4a-b09119225f58-kube-api-access-tjqkp\") pod \"945a68c7-7400-4d11-9a4a-b09119225f58\" (UID: \"945a68c7-7400-4d11-9a4a-b09119225f58\") " Jun 11 18:34:58.432410 ip-10-0-130-170 kubenswrapper[2565]: I0611 18:34:58.432372 2565 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/945a68c7-7400-4d11-9a4a-b09119225f58-bundle" (OuterVolumeSpecName: "bundle") pod "945a68c7-7400-4d11-9a4a-b09119225f58" (UID: "945a68c7-7400-4d11-9a4a-b09119225f58"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 11 18:34:58.434631 ip-10-0-130-170 kubenswrapper[2565]: I0611 18:34:58.434602 2565 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/945a68c7-7400-4d11-9a4a-b09119225f58-kube-api-access-tjqkp" (OuterVolumeSpecName: "kube-api-access-tjqkp") pod "945a68c7-7400-4d11-9a4a-b09119225f58" (UID: "945a68c7-7400-4d11-9a4a-b09119225f58"). InnerVolumeSpecName "kube-api-access-tjqkp". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 11 18:34:58.437082 ip-10-0-130-170 kubenswrapper[2565]: I0611 18:34:58.437055 2565 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/945a68c7-7400-4d11-9a4a-b09119225f58-util" (OuterVolumeSpecName: "util") pod "945a68c7-7400-4d11-9a4a-b09119225f58" (UID: "945a68c7-7400-4d11-9a4a-b09119225f58"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 11 18:34:58.532221 ip-10-0-130-170 kubenswrapper[2565]: I0611 18:34:58.532186 2565 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/945a68c7-7400-4d11-9a4a-b09119225f58-util\") on node \"ip-10-0-130-170.ec2.internal\" DevicePath \"\"" Jun 11 18:34:58.532221 ip-10-0-130-170 kubenswrapper[2565]: I0611 18:34:58.532215 2565 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-tjqkp\" (UniqueName: \"kubernetes.io/projected/945a68c7-7400-4d11-9a4a-b09119225f58-kube-api-access-tjqkp\") on node \"ip-10-0-130-170.ec2.internal\" DevicePath \"\"" Jun 11 18:34:58.532221 ip-10-0-130-170 kubenswrapper[2565]: I0611 18:34:58.532225 2565 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/945a68c7-7400-4d11-9a4a-b09119225f58-bundle\") on node \"ip-10-0-130-170.ec2.internal\" DevicePath \"\"" Jun 11 18:34:59.288628 ip-10-0-130-170 kubenswrapper[2565]: I0611 18:34:59.288603 2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dxvfhh" Jun 11 18:34:59.288801 ip-10-0-130-170 kubenswrapper[2565]: I0611 18:34:59.288639 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dxvfhh" event={"ID":"945a68c7-7400-4d11-9a4a-b09119225f58","Type":"ContainerDied","Data":"bd51ab607feee633e672da1828826920a70870e8adccde26297445ce7f37eee1"} Jun 11 18:34:59.288801 ip-10-0-130-170 kubenswrapper[2565]: I0611 18:34:59.288683 2565 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="bd51ab607feee633e672da1828826920a70870e8adccde26297445ce7f37eee1" Jun 11 18:35:11.889595 ip-10-0-130-170 kubenswrapper[2565]: I0611 18:35:11.889503 2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fsbxvw"] Jun 11 18:35:11.890086 ip-10-0-130-170 kubenswrapper[2565]: I0611 18:35:11.889814 2565 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="945a68c7-7400-4d11-9a4a-b09119225f58" containerName="extract" Jun 11 18:35:11.890086 ip-10-0-130-170 kubenswrapper[2565]: I0611 18:35:11.889824 2565 state_mem.go:107] "Deleted CPUSet assignment" podUID="945a68c7-7400-4d11-9a4a-b09119225f58" containerName="extract" Jun 11 18:35:11.890086 ip-10-0-130-170 kubenswrapper[2565]: I0611 18:35:11.889833 2565 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="945a68c7-7400-4d11-9a4a-b09119225f58" containerName="pull" Jun 11 18:35:11.890086 ip-10-0-130-170 kubenswrapper[2565]: I0611 18:35:11.889839 2565 state_mem.go:107] "Deleted CPUSet assignment" podUID="945a68c7-7400-4d11-9a4a-b09119225f58" containerName="pull" Jun 11 18:35:11.890086 ip-10-0-130-170 kubenswrapper[2565]: I0611 18:35:11.889847 2565 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="945a68c7-7400-4d11-9a4a-b09119225f58" containerName="util" Jun 11 18:35:11.890086 ip-10-0-130-170 kubenswrapper[2565]: I0611 18:35:11.889852 2565 state_mem.go:107] "Deleted CPUSet assignment" podUID="945a68c7-7400-4d11-9a4a-b09119225f58" containerName="util" Jun 11 18:35:11.890086 ip-10-0-130-170 kubenswrapper[2565]: I0611 18:35:11.889911 2565 memory_manager.go:368] "RemoveStaleState removing state" podUID="945a68c7-7400-4d11-9a4a-b09119225f58" containerName="extract" Jun 11 18:35:11.892039 ip-10-0-130-170 kubenswrapper[2565]: I0611 18:35:11.892023 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fsbxvw" Jun 11 18:35:11.894915 ip-10-0-130-170 kubenswrapper[2565]: I0611 18:35:11.894892 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-marketplace\"/\"default-dockercfg-8jd6m\"" Jun 11 18:35:11.895052 ip-10-0-130-170 kubenswrapper[2565]: I0611 18:35:11.894971 2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"kube-root-ca.crt\"" Jun 11 18:35:11.895052 ip-10-0-130-170 kubenswrapper[2565]: I0611 18:35:11.895011 2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"openshift-service-ca.crt\"" Jun 11 18:35:11.904553 ip-10-0-130-170 kubenswrapper[2565]: I0611 18:35:11.904532 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fsbxvw"] Jun 11 18:35:11.939607 ip-10-0-130-170 kubenswrapper[2565]: I0611 18:35:11.939575 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/ece9b1f2-dec4-4123-8cd9-6f15288bae72-util\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fsbxvw\" (UID: \"ece9b1f2-dec4-4123-8cd9-6f15288bae72\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fsbxvw" Jun 11 18:35:11.939755 ip-10-0-130-170 kubenswrapper[2565]: I0611 18:35:11.939687 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/ece9b1f2-dec4-4123-8cd9-6f15288bae72-bundle\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fsbxvw\" (UID: \"ece9b1f2-dec4-4123-8cd9-6f15288bae72\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fsbxvw" Jun 11 18:35:11.939755 ip-10-0-130-170 kubenswrapper[2565]: I0611 18:35:11.939725 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5rnws\" (UniqueName: \"kubernetes.io/projected/ece9b1f2-dec4-4123-8cd9-6f15288bae72-kube-api-access-5rnws\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fsbxvw\" (UID: \"ece9b1f2-dec4-4123-8cd9-6f15288bae72\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fsbxvw" Jun 11 18:35:12.040756 ip-10-0-130-170 kubenswrapper[2565]: I0611 18:35:12.040714 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/ece9b1f2-dec4-4123-8cd9-6f15288bae72-bundle\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fsbxvw\" (UID: \"ece9b1f2-dec4-4123-8cd9-6f15288bae72\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fsbxvw" Jun 11 18:35:12.040940 ip-10-0-130-170 kubenswrapper[2565]: I0611 18:35:12.040761 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5rnws\" (UniqueName: \"kubernetes.io/projected/ece9b1f2-dec4-4123-8cd9-6f15288bae72-kube-api-access-5rnws\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fsbxvw\" (UID: \"ece9b1f2-dec4-4123-8cd9-6f15288bae72\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fsbxvw" Jun 11 18:35:12.040940 ip-10-0-130-170 kubenswrapper[2565]: I0611 18:35:12.040811 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/ece9b1f2-dec4-4123-8cd9-6f15288bae72-util\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fsbxvw\" (UID: \"ece9b1f2-dec4-4123-8cd9-6f15288bae72\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fsbxvw" Jun 11 18:35:12.041179 ip-10-0-130-170 kubenswrapper[2565]: I0611 18:35:12.041157 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/ece9b1f2-dec4-4123-8cd9-6f15288bae72-bundle\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fsbxvw\" (UID: \"ece9b1f2-dec4-4123-8cd9-6f15288bae72\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fsbxvw" Jun 11 18:35:12.041219 ip-10-0-130-170 kubenswrapper[2565]: I0611 18:35:12.041172 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/ece9b1f2-dec4-4123-8cd9-6f15288bae72-util\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fsbxvw\" (UID: \"ece9b1f2-dec4-4123-8cd9-6f15288bae72\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fsbxvw" Jun 11 18:35:12.050025 ip-10-0-130-170 kubenswrapper[2565]: I0611 18:35:12.049998 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-5rnws\" (UniqueName: \"kubernetes.io/projected/ece9b1f2-dec4-4123-8cd9-6f15288bae72-kube-api-access-5rnws\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fsbxvw\" (UID: \"ece9b1f2-dec4-4123-8cd9-6f15288bae72\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fsbxvw" Jun 11 18:35:12.200999 ip-10-0-130-170 kubenswrapper[2565]: I0611 18:35:12.200909 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fsbxvw" Jun 11 18:35:12.333239 ip-10-0-130-170 kubenswrapper[2565]: I0611 18:35:12.333211 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fsbxvw"] Jun 11 18:35:12.335571 ip-10-0-130-170 kubenswrapper[2565]: W0611 18:35:12.335545 2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podece9b1f2_dec4_4123_8cd9_6f15288bae72.slice/crio-a60cadf25d2379577d139b874f7f9dfdcc76f71ce94fc3e84ac9377922f23874 WatchSource:0}: Error finding container a60cadf25d2379577d139b874f7f9dfdcc76f71ce94fc3e84ac9377922f23874: Status 404 returned error can't find the container with id a60cadf25d2379577d139b874f7f9dfdcc76f71ce94fc3e84ac9377922f23874 Jun 11 18:35:12.344457 ip-10-0-130-170 kubenswrapper[2565]: I0611 18:35:12.344431 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fsbxvw" event={"ID":"ece9b1f2-dec4-4123-8cd9-6f15288bae72","Type":"ContainerStarted","Data":"a60cadf25d2379577d139b874f7f9dfdcc76f71ce94fc3e84ac9377922f23874"} Jun 11 18:35:13.350085 ip-10-0-130-170 kubenswrapper[2565]: I0611 18:35:13.350005 2565 generic.go:356] "Generic (PLEG): container finished" podID="ece9b1f2-dec4-4123-8cd9-6f15288bae72" containerID="ed09c50c68eeee53bdeed92803c38b717053b5ae24c223039a8a009acd96a038" exitCode=0 Jun 11 18:35:13.350500 ip-10-0-130-170 kubenswrapper[2565]: I0611 18:35:13.350095 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fsbxvw" event={"ID":"ece9b1f2-dec4-4123-8cd9-6f15288bae72","Type":"ContainerDied","Data":"ed09c50c68eeee53bdeed92803c38b717053b5ae24c223039a8a009acd96a038"} Jun 11 18:35:16.366968 ip-10-0-130-170 kubenswrapper[2565]: I0611 18:35:16.366933 2565 generic.go:356] "Generic (PLEG): container finished" podID="ece9b1f2-dec4-4123-8cd9-6f15288bae72" containerID="9e3998973febef478fa4bb2fd758d556d2f03cd42a8dfb90ff23bd13b3c376c1" exitCode=0 Jun 11 18:35:16.367347 ip-10-0-130-170 kubenswrapper[2565]: I0611 18:35:16.367021 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fsbxvw" event={"ID":"ece9b1f2-dec4-4123-8cd9-6f15288bae72","Type":"ContainerDied","Data":"9e3998973febef478fa4bb2fd758d556d2f03cd42a8dfb90ff23bd13b3c376c1"} Jun 11 18:35:16.568381 ip-10-0-130-170 kubenswrapper[2565]: I0611 18:35:16.568347 2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["cert-manager/cert-manager-cainjector-5d99449ffd-r9jkj"] Jun 11 18:35:16.570645 ip-10-0-130-170 kubenswrapper[2565]: I0611 18:35:16.570626 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-cainjector-5d99449ffd-r9jkj" Jun 11 18:35:16.572939 ip-10-0-130-170 kubenswrapper[2565]: I0611 18:35:16.572911 2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager\"/\"openshift-service-ca.crt\"" Jun 11 18:35:16.573081 ip-10-0-130-170 kubenswrapper[2565]: I0611 18:35:16.573038 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"cert-manager\"/\"cert-manager-cainjector-dockercfg-hgcwp\"" Jun 11 18:35:16.573081 ip-10-0-130-170 kubenswrapper[2565]: I0611 18:35:16.573043 2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager\"/\"kube-root-ca.crt\"" Jun 11 18:35:16.580727 ip-10-0-130-170 kubenswrapper[2565]: I0611 18:35:16.580701 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-cainjector-5d99449ffd-r9jkj"] Jun 11 18:35:16.681113 ip-10-0-130-170 kubenswrapper[2565]: I0611 18:35:16.681087 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-g7vbx\" (UniqueName: \"kubernetes.io/projected/bb5e8057-341a-43be-b7c2-1770a56fae36-kube-api-access-g7vbx\") pod \"cert-manager-cainjector-5d99449ffd-r9jkj\" (UID: \"bb5e8057-341a-43be-b7c2-1770a56fae36\") " pod="cert-manager/cert-manager-cainjector-5d99449ffd-r9jkj" Jun 11 18:35:16.681321 ip-10-0-130-170 kubenswrapper[2565]: I0611 18:35:16.681149 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/bb5e8057-341a-43be-b7c2-1770a56fae36-bound-sa-token\") pod \"cert-manager-cainjector-5d99449ffd-r9jkj\" (UID: \"bb5e8057-341a-43be-b7c2-1770a56fae36\") " pod="cert-manager/cert-manager-cainjector-5d99449ffd-r9jkj" Jun 11 18:35:16.781714 ip-10-0-130-170 kubenswrapper[2565]: I0611 18:35:16.781680 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/bb5e8057-341a-43be-b7c2-1770a56fae36-bound-sa-token\") pod \"cert-manager-cainjector-5d99449ffd-r9jkj\" (UID: \"bb5e8057-341a-43be-b7c2-1770a56fae36\") " pod="cert-manager/cert-manager-cainjector-5d99449ffd-r9jkj" Jun 11 18:35:16.781882 ip-10-0-130-170 kubenswrapper[2565]: I0611 18:35:16.781731 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-g7vbx\" (UniqueName: \"kubernetes.io/projected/bb5e8057-341a-43be-b7c2-1770a56fae36-kube-api-access-g7vbx\") pod \"cert-manager-cainjector-5d99449ffd-r9jkj\" (UID: \"bb5e8057-341a-43be-b7c2-1770a56fae36\") " pod="cert-manager/cert-manager-cainjector-5d99449ffd-r9jkj" Jun 11 18:35:16.790069 ip-10-0-130-170 kubenswrapper[2565]: I0611 18:35:16.790031 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/bb5e8057-341a-43be-b7c2-1770a56fae36-bound-sa-token\") pod \"cert-manager-cainjector-5d99449ffd-r9jkj\" (UID: \"bb5e8057-341a-43be-b7c2-1770a56fae36\") " pod="cert-manager/cert-manager-cainjector-5d99449ffd-r9jkj" Jun 11 18:35:16.790366 ip-10-0-130-170 kubenswrapper[2565]: I0611 18:35:16.790344 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-g7vbx\" (UniqueName: \"kubernetes.io/projected/bb5e8057-341a-43be-b7c2-1770a56fae36-kube-api-access-g7vbx\") pod \"cert-manager-cainjector-5d99449ffd-r9jkj\" (UID: \"bb5e8057-341a-43be-b7c2-1770a56fae36\") " pod="cert-manager/cert-manager-cainjector-5d99449ffd-r9jkj" Jun 11 18:35:16.890672 ip-10-0-130-170 kubenswrapper[2565]: I0611 18:35:16.890625 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-cainjector-5d99449ffd-r9jkj" Jun 11 18:35:17.024673 ip-10-0-130-170 kubenswrapper[2565]: I0611 18:35:17.024647 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-cainjector-5d99449ffd-r9jkj"] Jun 11 18:35:17.026560 ip-10-0-130-170 kubenswrapper[2565]: W0611 18:35:17.026528 2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podbb5e8057_341a_43be_b7c2_1770a56fae36.slice/crio-f4421391d7e5f7dfcbf550bb926ff709497154ba7bb09baa553efb6d2250c75f WatchSource:0}: Error finding container f4421391d7e5f7dfcbf550bb926ff709497154ba7bb09baa553efb6d2250c75f: Status 404 returned error can't find the container with id f4421391d7e5f7dfcbf550bb926ff709497154ba7bb09baa553efb6d2250c75f Jun 11 18:35:17.373035 ip-10-0-130-170 kubenswrapper[2565]: I0611 18:35:17.372939 2565 generic.go:356] "Generic (PLEG): container finished" podID="ece9b1f2-dec4-4123-8cd9-6f15288bae72" containerID="2385198ecab6db3abb09b1dc0d08c700358ada3655cc37686645d0cf6a98465e" exitCode=0 Jun 11 18:35:17.373035 ip-10-0-130-170 kubenswrapper[2565]: I0611 18:35:17.373013 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fsbxvw" event={"ID":"ece9b1f2-dec4-4123-8cd9-6f15288bae72","Type":"ContainerDied","Data":"2385198ecab6db3abb09b1dc0d08c700358ada3655cc37686645d0cf6a98465e"} Jun 11 18:35:17.374184 ip-10-0-130-170 kubenswrapper[2565]: I0611 18:35:17.374162 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-cainjector-5d99449ffd-r9jkj" event={"ID":"bb5e8057-341a-43be-b7c2-1770a56fae36","Type":"ContainerStarted","Data":"f4421391d7e5f7dfcbf550bb926ff709497154ba7bb09baa553efb6d2250c75f"} Jun 11 18:35:18.532717 ip-10-0-130-170 kubenswrapper[2565]: I0611 18:35:18.532690 2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fsbxvw" Jun 11 18:35:18.599089 ip-10-0-130-170 kubenswrapper[2565]: I0611 18:35:18.599055 2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/ece9b1f2-dec4-4123-8cd9-6f15288bae72-util\") pod \"ece9b1f2-dec4-4123-8cd9-6f15288bae72\" (UID: \"ece9b1f2-dec4-4123-8cd9-6f15288bae72\") " Jun 11 18:35:18.599304 ip-10-0-130-170 kubenswrapper[2565]: I0611 18:35:18.599101 2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-5rnws\" (UniqueName: \"kubernetes.io/projected/ece9b1f2-dec4-4123-8cd9-6f15288bae72-kube-api-access-5rnws\") pod \"ece9b1f2-dec4-4123-8cd9-6f15288bae72\" (UID: \"ece9b1f2-dec4-4123-8cd9-6f15288bae72\") " Jun 11 18:35:18.599304 ip-10-0-130-170 kubenswrapper[2565]: I0611 18:35:18.599222 2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/ece9b1f2-dec4-4123-8cd9-6f15288bae72-bundle\") pod \"ece9b1f2-dec4-4123-8cd9-6f15288bae72\" (UID: \"ece9b1f2-dec4-4123-8cd9-6f15288bae72\") " Jun 11 18:35:18.599628 ip-10-0-130-170 kubenswrapper[2565]: I0611 18:35:18.599596 2565 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/ece9b1f2-dec4-4123-8cd9-6f15288bae72-bundle" (OuterVolumeSpecName: "bundle") pod "ece9b1f2-dec4-4123-8cd9-6f15288bae72" (UID: "ece9b1f2-dec4-4123-8cd9-6f15288bae72"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 11 18:35:18.601864 ip-10-0-130-170 kubenswrapper[2565]: I0611 18:35:18.601837 2565 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/ece9b1f2-dec4-4123-8cd9-6f15288bae72-kube-api-access-5rnws" (OuterVolumeSpecName: "kube-api-access-5rnws") pod "ece9b1f2-dec4-4123-8cd9-6f15288bae72" (UID: "ece9b1f2-dec4-4123-8cd9-6f15288bae72"). InnerVolumeSpecName "kube-api-access-5rnws". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 11 18:35:18.604545 ip-10-0-130-170 kubenswrapper[2565]: I0611 18:35:18.604518 2565 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/ece9b1f2-dec4-4123-8cd9-6f15288bae72-util" (OuterVolumeSpecName: "util") pod "ece9b1f2-dec4-4123-8cd9-6f15288bae72" (UID: "ece9b1f2-dec4-4123-8cd9-6f15288bae72"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 11 18:35:18.700398 ip-10-0-130-170 kubenswrapper[2565]: I0611 18:35:18.700315 2565 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/ece9b1f2-dec4-4123-8cd9-6f15288bae72-bundle\") on node \"ip-10-0-130-170.ec2.internal\" DevicePath \"\"" Jun 11 18:35:18.700398 ip-10-0-130-170 kubenswrapper[2565]: I0611 18:35:18.700343 2565 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/ece9b1f2-dec4-4123-8cd9-6f15288bae72-util\") on node \"ip-10-0-130-170.ec2.internal\" DevicePath \"\"" Jun 11 18:35:18.700398 ip-10-0-130-170 kubenswrapper[2565]: I0611 18:35:18.700352 2565 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-5rnws\" (UniqueName: \"kubernetes.io/projected/ece9b1f2-dec4-4123-8cd9-6f15288bae72-kube-api-access-5rnws\") on node \"ip-10-0-130-170.ec2.internal\" DevicePath \"\"" Jun 11 18:35:19.332008 ip-10-0-130-170 kubenswrapper[2565]: I0611 18:35:19.331973 2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["cert-manager/cert-manager-webhook-7dc76cbb94-85k52"] Jun 11 18:35:19.332379 ip-10-0-130-170 kubenswrapper[2565]: I0611 18:35:19.332361 2565 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="ece9b1f2-dec4-4123-8cd9-6f15288bae72" containerName="extract" Jun 11 18:35:19.332481 ip-10-0-130-170 kubenswrapper[2565]: I0611 18:35:19.332381 2565 state_mem.go:107] "Deleted CPUSet assignment" podUID="ece9b1f2-dec4-4123-8cd9-6f15288bae72" containerName="extract" Jun 11 18:35:19.332481 ip-10-0-130-170 kubenswrapper[2565]: I0611 18:35:19.332399 2565 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="ece9b1f2-dec4-4123-8cd9-6f15288bae72" containerName="pull" Jun 11 18:35:19.332481 ip-10-0-130-170 kubenswrapper[2565]: I0611 18:35:19.332408 2565 state_mem.go:107] "Deleted CPUSet assignment" podUID="ece9b1f2-dec4-4123-8cd9-6f15288bae72" containerName="pull" Jun 11 18:35:19.332481 ip-10-0-130-170 kubenswrapper[2565]: I0611 18:35:19.332444 2565 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="ece9b1f2-dec4-4123-8cd9-6f15288bae72" containerName="util" Jun 11 18:35:19.332481 ip-10-0-130-170 kubenswrapper[2565]: I0611 18:35:19.332452 2565 state_mem.go:107] "Deleted CPUSet assignment" podUID="ece9b1f2-dec4-4123-8cd9-6f15288bae72" containerName="util" Jun 11 18:35:19.332709 ip-10-0-130-170 kubenswrapper[2565]: I0611 18:35:19.332556 2565 memory_manager.go:368] "RemoveStaleState removing state" podUID="ece9b1f2-dec4-4123-8cd9-6f15288bae72" containerName="extract" Jun 11 18:35:19.334778 ip-10-0-130-170 kubenswrapper[2565]: I0611 18:35:19.334757 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-webhook-7dc76cbb94-85k52" Jun 11 18:35:19.337285 ip-10-0-130-170 kubenswrapper[2565]: I0611 18:35:19.337230 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"cert-manager\"/\"cert-manager-webhook-dockercfg-znz7h\"" Jun 11 18:35:19.346086 ip-10-0-130-170 kubenswrapper[2565]: I0611 18:35:19.346065 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-webhook-7dc76cbb94-85k52"] Jun 11 18:35:19.386324 ip-10-0-130-170 kubenswrapper[2565]: I0611 18:35:19.386284 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fsbxvw" event={"ID":"ece9b1f2-dec4-4123-8cd9-6f15288bae72","Type":"ContainerDied","Data":"a60cadf25d2379577d139b874f7f9dfdcc76f71ce94fc3e84ac9377922f23874"} Jun 11 18:35:19.386490 ip-10-0-130-170 kubenswrapper[2565]: I0611 18:35:19.386330 2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fsbxvw" Jun 11 18:35:19.386490 ip-10-0-130-170 kubenswrapper[2565]: I0611 18:35:19.386344 2565 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="a60cadf25d2379577d139b874f7f9dfdcc76f71ce94fc3e84ac9377922f23874" Jun 11 18:35:19.407974 ip-10-0-130-170 kubenswrapper[2565]: I0611 18:35:19.407939 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-tjfns\" (UniqueName: \"kubernetes.io/projected/d041051d-42d4-40d2-9c6c-de872dfee37d-kube-api-access-tjfns\") pod \"cert-manager-webhook-7dc76cbb94-85k52\" (UID: \"d041051d-42d4-40d2-9c6c-de872dfee37d\") " pod="cert-manager/cert-manager-webhook-7dc76cbb94-85k52" Jun 11 18:35:19.408129 ip-10-0-130-170 kubenswrapper[2565]: I0611 18:35:19.407992 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/d041051d-42d4-40d2-9c6c-de872dfee37d-bound-sa-token\") pod \"cert-manager-webhook-7dc76cbb94-85k52\" (UID: \"d041051d-42d4-40d2-9c6c-de872dfee37d\") " pod="cert-manager/cert-manager-webhook-7dc76cbb94-85k52" Jun 11 18:35:19.509090 ip-10-0-130-170 kubenswrapper[2565]: I0611 18:35:19.509049 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/d041051d-42d4-40d2-9c6c-de872dfee37d-bound-sa-token\") pod \"cert-manager-webhook-7dc76cbb94-85k52\" (UID: \"d041051d-42d4-40d2-9c6c-de872dfee37d\") " pod="cert-manager/cert-manager-webhook-7dc76cbb94-85k52" Jun 11 18:35:19.509312 ip-10-0-130-170 kubenswrapper[2565]: I0611 18:35:19.509187 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-tjfns\" (UniqueName: \"kubernetes.io/projected/d041051d-42d4-40d2-9c6c-de872dfee37d-kube-api-access-tjfns\") pod \"cert-manager-webhook-7dc76cbb94-85k52\" (UID: \"d041051d-42d4-40d2-9c6c-de872dfee37d\") " pod="cert-manager/cert-manager-webhook-7dc76cbb94-85k52" Jun 11 18:35:19.518627 ip-10-0-130-170 kubenswrapper[2565]: I0611 18:35:19.518591 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/d041051d-42d4-40d2-9c6c-de872dfee37d-bound-sa-token\") pod \"cert-manager-webhook-7dc76cbb94-85k52\" (UID: \"d041051d-42d4-40d2-9c6c-de872dfee37d\") " pod="cert-manager/cert-manager-webhook-7dc76cbb94-85k52" Jun 11 18:35:19.518765 ip-10-0-130-170 kubenswrapper[2565]: I0611 18:35:19.518734 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-tjfns\" (UniqueName: \"kubernetes.io/projected/d041051d-42d4-40d2-9c6c-de872dfee37d-kube-api-access-tjfns\") pod \"cert-manager-webhook-7dc76cbb94-85k52\" (UID: \"d041051d-42d4-40d2-9c6c-de872dfee37d\") " pod="cert-manager/cert-manager-webhook-7dc76cbb94-85k52" Jun 11 18:35:19.645522 ip-10-0-130-170 kubenswrapper[2565]: I0611 18:35:19.645493 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-webhook-7dc76cbb94-85k52" Jun 11 18:35:19.803070 ip-10-0-130-170 kubenswrapper[2565]: I0611 18:35:19.803040 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-webhook-7dc76cbb94-85k52"] Jun 11 18:35:19.805634 ip-10-0-130-170 kubenswrapper[2565]: W0611 18:35:19.805603 2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podd041051d_42d4_40d2_9c6c_de872dfee37d.slice/crio-389c184e006e13c3fb20802a3307aa74a47bbc785cdfb52b5e3fc0b9f472725c WatchSource:0}: Error finding container 389c184e006e13c3fb20802a3307aa74a47bbc785cdfb52b5e3fc0b9f472725c: Status 404 returned error can't find the container with id 389c184e006e13c3fb20802a3307aa74a47bbc785cdfb52b5e3fc0b9f472725c Jun 11 18:35:20.392120 ip-10-0-130-170 kubenswrapper[2565]: I0611 18:35:20.392081 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-cainjector-5d99449ffd-r9jkj" event={"ID":"bb5e8057-341a-43be-b7c2-1770a56fae36","Type":"ContainerStarted","Data":"a90e579c9ac5058daa7d2c662e48c58b1f2847f8029b4fb2b85affcded6a62d7"} Jun 11 18:35:20.393628 ip-10-0-130-170 kubenswrapper[2565]: I0611 18:35:20.393601 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-webhook-7dc76cbb94-85k52" event={"ID":"d041051d-42d4-40d2-9c6c-de872dfee37d","Type":"ContainerStarted","Data":"67f8ffb0d3ee3154fe82a1b05d72c2283efc405545a6d0220a8835113258be64"} Jun 11 18:35:20.393756 ip-10-0-130-170 kubenswrapper[2565]: I0611 18:35:20.393639 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-webhook-7dc76cbb94-85k52" event={"ID":"d041051d-42d4-40d2-9c6c-de872dfee37d","Type":"ContainerStarted","Data":"389c184e006e13c3fb20802a3307aa74a47bbc785cdfb52b5e3fc0b9f472725c"} Jun 11 18:35:20.393756 ip-10-0-130-170 kubenswrapper[2565]: I0611 18:35:20.393684 2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="cert-manager/cert-manager-webhook-7dc76cbb94-85k52" Jun 11 18:35:20.409381 ip-10-0-130-170 kubenswrapper[2565]: I0611 18:35:20.409334 2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="cert-manager/cert-manager-cainjector-5d99449ffd-r9jkj" podStartSLOduration=1.765823511 podStartE2EDuration="4.409315436s" totalImagesPullingTime="2.643491925s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-11 18:35:16 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-11 18:35:20.409192066 +0000 UTC m=+439.157878105" watchObservedRunningTime="2026-06-11 18:35:20.409315436 +0000 UTC m=+439.158001457" Jun 11 18:35:20.425330 ip-10-0-130-170 kubenswrapper[2565]: I0611 18:35:20.425277 2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="cert-manager/cert-manager-webhook-7dc76cbb94-85k52" podStartSLOduration=1.42523871 podStartE2EDuration="1.42523871s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-11 18:35:19 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-11 18:35:20.424123925 +0000 UTC m=+439.172809965" watchObservedRunningTime="2026-06-11 18:35:20.42523871 +0000 UTC m=+439.173924734" Jun 11 18:35:26.400931 ip-10-0-130-170 kubenswrapper[2565]: I0611 18:35:26.400902 2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="cert-manager/cert-manager-webhook-7dc76cbb94-85k52" Jun 11 18:35:32.416521 ip-10-0-130-170 kubenswrapper[2565]: I0611 18:35:32.416485 2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-marketplace/410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cdhb9pl"] Jun 11 18:35:32.419454 ip-10-0-130-170 kubenswrapper[2565]: I0611 18:35:32.419434 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cdhb9pl" Jun 11 18:35:32.422113 ip-10-0-130-170 kubenswrapper[2565]: I0611 18:35:32.422080 2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"openshift-service-ca.crt\"" Jun 11 18:35:32.422113 ip-10-0-130-170 kubenswrapper[2565]: I0611 18:35:32.422104 2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"kube-root-ca.crt\"" Jun 11 18:35:32.423002 ip-10-0-130-170 kubenswrapper[2565]: I0611 18:35:32.422987 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-marketplace\"/\"default-dockercfg-8jd6m\"" Jun 11 18:35:32.427843 ip-10-0-130-170 kubenswrapper[2565]: I0611 18:35:32.427822 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cdhb9pl"] Jun 11 18:35:32.525996 ip-10-0-130-170 kubenswrapper[2565]: I0611 18:35:32.525962 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/17f271b9-78e0-4fc2-bd35-66e5a3b2b0a0-util\") pod \"410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cdhb9pl\" (UID: \"17f271b9-78e0-4fc2-bd35-66e5a3b2b0a0\") " pod="openshift-marketplace/410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cdhb9pl" Jun 11 18:35:32.525996 ip-10-0-130-170 kubenswrapper[2565]: I0611 18:35:32.526000 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6lf2k\" (UniqueName: \"kubernetes.io/projected/17f271b9-78e0-4fc2-bd35-66e5a3b2b0a0-kube-api-access-6lf2k\") pod \"410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cdhb9pl\" (UID: \"17f271b9-78e0-4fc2-bd35-66e5a3b2b0a0\") " pod="openshift-marketplace/410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cdhb9pl" Jun 11 18:35:32.526199 ip-10-0-130-170 kubenswrapper[2565]: I0611 18:35:32.526018 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/17f271b9-78e0-4fc2-bd35-66e5a3b2b0a0-bundle\") pod \"410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cdhb9pl\" (UID: \"17f271b9-78e0-4fc2-bd35-66e5a3b2b0a0\") " pod="openshift-marketplace/410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cdhb9pl" Jun 11 18:35:32.627441 ip-10-0-130-170 kubenswrapper[2565]: I0611 18:35:32.627392 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/17f271b9-78e0-4fc2-bd35-66e5a3b2b0a0-bundle\") pod \"410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cdhb9pl\" (UID: \"17f271b9-78e0-4fc2-bd35-66e5a3b2b0a0\") " pod="openshift-marketplace/410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cdhb9pl" Jun 11 18:35:32.627611 ip-10-0-130-170 kubenswrapper[2565]: I0611 18:35:32.627503 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/17f271b9-78e0-4fc2-bd35-66e5a3b2b0a0-util\") pod \"410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cdhb9pl\" (UID: \"17f271b9-78e0-4fc2-bd35-66e5a3b2b0a0\") " pod="openshift-marketplace/410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cdhb9pl" Jun 11 18:35:32.627611 ip-10-0-130-170 kubenswrapper[2565]: I0611 18:35:32.627525 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6lf2k\" (UniqueName: \"kubernetes.io/projected/17f271b9-78e0-4fc2-bd35-66e5a3b2b0a0-kube-api-access-6lf2k\") pod \"410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cdhb9pl\" (UID: \"17f271b9-78e0-4fc2-bd35-66e5a3b2b0a0\") " pod="openshift-marketplace/410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cdhb9pl" Jun 11 18:35:32.627924 ip-10-0-130-170 kubenswrapper[2565]: I0611 18:35:32.627900 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/17f271b9-78e0-4fc2-bd35-66e5a3b2b0a0-bundle\") pod \"410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cdhb9pl\" (UID: \"17f271b9-78e0-4fc2-bd35-66e5a3b2b0a0\") " pod="openshift-marketplace/410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cdhb9pl" Jun 11 18:35:32.627924 ip-10-0-130-170 kubenswrapper[2565]: I0611 18:35:32.627916 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/17f271b9-78e0-4fc2-bd35-66e5a3b2b0a0-util\") pod \"410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cdhb9pl\" (UID: \"17f271b9-78e0-4fc2-bd35-66e5a3b2b0a0\") " pod="openshift-marketplace/410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cdhb9pl" Jun 11 18:35:32.636358 ip-10-0-130-170 kubenswrapper[2565]: I0611 18:35:32.636326 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-6lf2k\" (UniqueName: \"kubernetes.io/projected/17f271b9-78e0-4fc2-bd35-66e5a3b2b0a0-kube-api-access-6lf2k\") pod \"410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cdhb9pl\" (UID: \"17f271b9-78e0-4fc2-bd35-66e5a3b2b0a0\") " pod="openshift-marketplace/410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cdhb9pl" Jun 11 18:35:32.730298 ip-10-0-130-170 kubenswrapper[2565]: I0611 18:35:32.730195 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cdhb9pl" Jun 11 18:35:32.860355 ip-10-0-130-170 kubenswrapper[2565]: I0611 18:35:32.860323 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cdhb9pl"] Jun 11 18:35:32.867511 ip-10-0-130-170 kubenswrapper[2565]: W0611 18:35:32.867483 2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod17f271b9_78e0_4fc2_bd35_66e5a3b2b0a0.slice/crio-92c8945351a368e78f27e4a1253a630cc6af6fb630343475d21f5859cafd42da WatchSource:0}: Error finding container 92c8945351a368e78f27e4a1253a630cc6af6fb630343475d21f5859cafd42da: Status 404 returned error can't find the container with id 92c8945351a368e78f27e4a1253a630cc6af6fb630343475d21f5859cafd42da Jun 11 18:35:33.455190 ip-10-0-130-170 kubenswrapper[2565]: I0611 18:35:33.455157 2565 generic.go:356] "Generic (PLEG): container finished" podID="17f271b9-78e0-4fc2-bd35-66e5a3b2b0a0" containerID="b72bb30d974a9352e786777295e1ca22cdaf5f1e50ea29df5d31d897038a294b" exitCode=0 Jun 11 18:35:33.455591 ip-10-0-130-170 kubenswrapper[2565]: I0611 18:35:33.455224 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cdhb9pl" event={"ID":"17f271b9-78e0-4fc2-bd35-66e5a3b2b0a0","Type":"ContainerDied","Data":"b72bb30d974a9352e786777295e1ca22cdaf5f1e50ea29df5d31d897038a294b"} Jun 11 18:35:33.455591 ip-10-0-130-170 kubenswrapper[2565]: I0611 18:35:33.455281 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cdhb9pl" event={"ID":"17f271b9-78e0-4fc2-bd35-66e5a3b2b0a0","Type":"ContainerStarted","Data":"92c8945351a368e78f27e4a1253a630cc6af6fb630343475d21f5859cafd42da"} Jun 11 18:35:34.461312 ip-10-0-130-170 kubenswrapper[2565]: I0611 18:35:34.461247 2565 generic.go:356] "Generic (PLEG): container finished" podID="17f271b9-78e0-4fc2-bd35-66e5a3b2b0a0" containerID="f9387435191aeaaafa2993978996b3e023d27014d4a479ceaf99833c440ae712" exitCode=0 Jun 11 18:35:34.461691 ip-10-0-130-170 kubenswrapper[2565]: I0611 18:35:34.461336 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cdhb9pl" event={"ID":"17f271b9-78e0-4fc2-bd35-66e5a3b2b0a0","Type":"ContainerDied","Data":"f9387435191aeaaafa2993978996b3e023d27014d4a479ceaf99833c440ae712"} Jun 11 18:35:35.467813 ip-10-0-130-170 kubenswrapper[2565]: I0611 18:35:35.467776 2565 generic.go:356] "Generic (PLEG): container finished" podID="17f271b9-78e0-4fc2-bd35-66e5a3b2b0a0" containerID="bf02e84f8bafac96f004b356318e1bc23afe373233c749b02b3b506b18dea5a7" exitCode=0 Jun 11 18:35:35.468204 ip-10-0-130-170 kubenswrapper[2565]: I0611 18:35:35.467870 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cdhb9pl" event={"ID":"17f271b9-78e0-4fc2-bd35-66e5a3b2b0a0","Type":"ContainerDied","Data":"bf02e84f8bafac96f004b356318e1bc23afe373233c749b02b3b506b18dea5a7"} Jun 11 18:35:36.606182 ip-10-0-130-170 kubenswrapper[2565]: I0611 18:35:36.606159 2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cdhb9pl" Jun 11 18:35:36.762764 ip-10-0-130-170 kubenswrapper[2565]: I0611 18:35:36.762679 2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/17f271b9-78e0-4fc2-bd35-66e5a3b2b0a0-util\") pod \"17f271b9-78e0-4fc2-bd35-66e5a3b2b0a0\" (UID: \"17f271b9-78e0-4fc2-bd35-66e5a3b2b0a0\") " Jun 11 18:35:36.762764 ip-10-0-130-170 kubenswrapper[2565]: I0611 18:35:36.762718 2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/17f271b9-78e0-4fc2-bd35-66e5a3b2b0a0-bundle\") pod \"17f271b9-78e0-4fc2-bd35-66e5a3b2b0a0\" (UID: \"17f271b9-78e0-4fc2-bd35-66e5a3b2b0a0\") " Jun 11 18:35:36.762764 ip-10-0-130-170 kubenswrapper[2565]: I0611 18:35:36.762766 2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-6lf2k\" (UniqueName: \"kubernetes.io/projected/17f271b9-78e0-4fc2-bd35-66e5a3b2b0a0-kube-api-access-6lf2k\") pod \"17f271b9-78e0-4fc2-bd35-66e5a3b2b0a0\" (UID: \"17f271b9-78e0-4fc2-bd35-66e5a3b2b0a0\") " Jun 11 18:35:36.763457 ip-10-0-130-170 kubenswrapper[2565]: I0611 18:35:36.763427 2565 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/17f271b9-78e0-4fc2-bd35-66e5a3b2b0a0-bundle" (OuterVolumeSpecName: "bundle") pod "17f271b9-78e0-4fc2-bd35-66e5a3b2b0a0" (UID: "17f271b9-78e0-4fc2-bd35-66e5a3b2b0a0"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 11 18:35:36.765060 ip-10-0-130-170 kubenswrapper[2565]: I0611 18:35:36.765029 2565 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/17f271b9-78e0-4fc2-bd35-66e5a3b2b0a0-kube-api-access-6lf2k" (OuterVolumeSpecName: "kube-api-access-6lf2k") pod "17f271b9-78e0-4fc2-bd35-66e5a3b2b0a0" (UID: "17f271b9-78e0-4fc2-bd35-66e5a3b2b0a0"). InnerVolumeSpecName "kube-api-access-6lf2k". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 11 18:35:36.768059 ip-10-0-130-170 kubenswrapper[2565]: I0611 18:35:36.768024 2565 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/17f271b9-78e0-4fc2-bd35-66e5a3b2b0a0-util" (OuterVolumeSpecName: "util") pod "17f271b9-78e0-4fc2-bd35-66e5a3b2b0a0" (UID: "17f271b9-78e0-4fc2-bd35-66e5a3b2b0a0"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 11 18:35:36.864162 ip-10-0-130-170 kubenswrapper[2565]: I0611 18:35:36.864116 2565 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/17f271b9-78e0-4fc2-bd35-66e5a3b2b0a0-util\") on node \"ip-10-0-130-170.ec2.internal\" DevicePath \"\"" Jun 11 18:35:36.864162 ip-10-0-130-170 kubenswrapper[2565]: I0611 18:35:36.864157 2565 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/17f271b9-78e0-4fc2-bd35-66e5a3b2b0a0-bundle\") on node \"ip-10-0-130-170.ec2.internal\" DevicePath \"\"" Jun 11 18:35:36.864162 ip-10-0-130-170 kubenswrapper[2565]: I0611 18:35:36.864168 2565 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-6lf2k\" (UniqueName: \"kubernetes.io/projected/17f271b9-78e0-4fc2-bd35-66e5a3b2b0a0-kube-api-access-6lf2k\") on node \"ip-10-0-130-170.ec2.internal\" DevicePath \"\"" Jun 11 18:35:37.478937 ip-10-0-130-170 kubenswrapper[2565]: I0611 18:35:37.478906 2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cdhb9pl" Jun 11 18:35:37.478937 ip-10-0-130-170 kubenswrapper[2565]: I0611 18:35:37.478915 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cdhb9pl" event={"ID":"17f271b9-78e0-4fc2-bd35-66e5a3b2b0a0","Type":"ContainerDied","Data":"92c8945351a368e78f27e4a1253a630cc6af6fb630343475d21f5859cafd42da"} Jun 11 18:35:37.479137 ip-10-0-130-170 kubenswrapper[2565]: I0611 18:35:37.478963 2565 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="92c8945351a368e78f27e4a1253a630cc6af6fb630343475d21f5859cafd42da" Jun 11 18:35:47.202942 ip-10-0-130-170 kubenswrapper[2565]: I0611 18:35:47.202898 2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-lws-operator/lws-controller-manager-6d68fdb559-jj7dc"] Jun 11 18:35:47.203463 ip-10-0-130-170 kubenswrapper[2565]: I0611 18:35:47.203233 2565 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="17f271b9-78e0-4fc2-bd35-66e5a3b2b0a0" containerName="extract" Jun 11 18:35:47.203463 ip-10-0-130-170 kubenswrapper[2565]: I0611 18:35:47.203244 2565 state_mem.go:107] "Deleted CPUSet assignment" podUID="17f271b9-78e0-4fc2-bd35-66e5a3b2b0a0" containerName="extract" Jun 11 18:35:47.203463 ip-10-0-130-170 kubenswrapper[2565]: I0611 18:35:47.203286 2565 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="17f271b9-78e0-4fc2-bd35-66e5a3b2b0a0" containerName="util" Jun 11 18:35:47.203463 ip-10-0-130-170 kubenswrapper[2565]: I0611 18:35:47.203295 2565 state_mem.go:107] "Deleted CPUSet assignment" podUID="17f271b9-78e0-4fc2-bd35-66e5a3b2b0a0" containerName="util" Jun 11 18:35:47.203463 ip-10-0-130-170 kubenswrapper[2565]: I0611 18:35:47.203307 2565 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="17f271b9-78e0-4fc2-bd35-66e5a3b2b0a0" containerName="pull" Jun 11 18:35:47.203463 ip-10-0-130-170 kubenswrapper[2565]: I0611 18:35:47.203315 2565 state_mem.go:107] "Deleted CPUSet assignment" podUID="17f271b9-78e0-4fc2-bd35-66e5a3b2b0a0" containerName="pull" Jun 11 18:35:47.203463 ip-10-0-130-170 kubenswrapper[2565]: I0611 18:35:47.203397 2565 memory_manager.go:368] "RemoveStaleState removing state" podUID="17f271b9-78e0-4fc2-bd35-66e5a3b2b0a0" containerName="extract" Jun 11 18:35:47.206601 ip-10-0-130-170 kubenswrapper[2565]: I0611 18:35:47.206540 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/lws-controller-manager-6d68fdb559-jj7dc" Jun 11 18:35:47.209575 ip-10-0-130-170 kubenswrapper[2565]: I0611 18:35:47.209538 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"webhook-server-cert\"" Jun 11 18:35:47.210666 ip-10-0-130-170 kubenswrapper[2565]: I0611 18:35:47.210648 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"metrics-server-cert\"" Jun 11 18:35:47.210774 ip-10-0-130-170 kubenswrapper[2565]: I0611 18:35:47.210654 2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"kube-root-ca.crt\"" Jun 11 18:35:47.210774 ip-10-0-130-170 kubenswrapper[2565]: I0611 18:35:47.210739 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"lws-controller-manager-dockercfg-xhg9p\"" Jun 11 18:35:47.210774 ip-10-0-130-170 kubenswrapper[2565]: I0611 18:35:47.210656 2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"lws-manager-config\"" Jun 11 18:35:47.210961 ip-10-0-130-170 kubenswrapper[2565]: I0611 18:35:47.210656 2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"openshift-service-ca.crt\"" Jun 11 18:35:47.232752 ip-10-0-130-170 kubenswrapper[2565]: I0611 18:35:47.232723 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/lws-controller-manager-6d68fdb559-jj7dc"] Jun 11 18:35:47.250998 ip-10-0-130-170 kubenswrapper[2565]: I0611 18:35:47.250969 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-pw879\" (UniqueName: \"kubernetes.io/projected/a0525b53-c65a-41bb-86fc-fb007aa4590e-kube-api-access-pw879\") pod \"lws-controller-manager-6d68fdb559-jj7dc\" (UID: \"a0525b53-c65a-41bb-86fc-fb007aa4590e\") " pod="openshift-lws-operator/lws-controller-manager-6d68fdb559-jj7dc" Jun 11 18:35:47.251108 ip-10-0-130-170 kubenswrapper[2565]: I0611 18:35:47.251011 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/a0525b53-c65a-41bb-86fc-fb007aa4590e-cert\") pod \"lws-controller-manager-6d68fdb559-jj7dc\" (UID: \"a0525b53-c65a-41bb-86fc-fb007aa4590e\") " pod="openshift-lws-operator/lws-controller-manager-6d68fdb559-jj7dc" Jun 11 18:35:47.251108 ip-10-0-130-170 kubenswrapper[2565]: I0611 18:35:47.251031 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/a0525b53-c65a-41bb-86fc-fb007aa4590e-manager-config\") pod \"lws-controller-manager-6d68fdb559-jj7dc\" (UID: \"a0525b53-c65a-41bb-86fc-fb007aa4590e\") " pod="openshift-lws-operator/lws-controller-manager-6d68fdb559-jj7dc" Jun 11 18:35:47.251197 ip-10-0-130-170 kubenswrapper[2565]: I0611 18:35:47.251103 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/a0525b53-c65a-41bb-86fc-fb007aa4590e-metrics-cert\") pod \"lws-controller-manager-6d68fdb559-jj7dc\" (UID: \"a0525b53-c65a-41bb-86fc-fb007aa4590e\") " pod="openshift-lws-operator/lws-controller-manager-6d68fdb559-jj7dc" Jun 11 18:35:47.351834 ip-10-0-130-170 kubenswrapper[2565]: I0611 18:35:47.351789 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/a0525b53-c65a-41bb-86fc-fb007aa4590e-metrics-cert\") pod \"lws-controller-manager-6d68fdb559-jj7dc\" (UID: \"a0525b53-c65a-41bb-86fc-fb007aa4590e\") " pod="openshift-lws-operator/lws-controller-manager-6d68fdb559-jj7dc" Jun 11 18:35:47.352034 ip-10-0-130-170 kubenswrapper[2565]: I0611 18:35:47.351858 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-pw879\" (UniqueName: \"kubernetes.io/projected/a0525b53-c65a-41bb-86fc-fb007aa4590e-kube-api-access-pw879\") pod \"lws-controller-manager-6d68fdb559-jj7dc\" (UID: \"a0525b53-c65a-41bb-86fc-fb007aa4590e\") " pod="openshift-lws-operator/lws-controller-manager-6d68fdb559-jj7dc" Jun 11 18:35:47.352034 ip-10-0-130-170 kubenswrapper[2565]: I0611 18:35:47.351909 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/a0525b53-c65a-41bb-86fc-fb007aa4590e-cert\") pod \"lws-controller-manager-6d68fdb559-jj7dc\" (UID: \"a0525b53-c65a-41bb-86fc-fb007aa4590e\") " pod="openshift-lws-operator/lws-controller-manager-6d68fdb559-jj7dc" Jun 11 18:35:47.352034 ip-10-0-130-170 kubenswrapper[2565]: I0611 18:35:47.351929 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/a0525b53-c65a-41bb-86fc-fb007aa4590e-manager-config\") pod \"lws-controller-manager-6d68fdb559-jj7dc\" (UID: \"a0525b53-c65a-41bb-86fc-fb007aa4590e\") " pod="openshift-lws-operator/lws-controller-manager-6d68fdb559-jj7dc" Jun 11 18:35:47.353212 ip-10-0-130-170 kubenswrapper[2565]: I0611 18:35:47.353184 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/a0525b53-c65a-41bb-86fc-fb007aa4590e-manager-config\") pod \"lws-controller-manager-6d68fdb559-jj7dc\" (UID: \"a0525b53-c65a-41bb-86fc-fb007aa4590e\") " pod="openshift-lws-operator/lws-controller-manager-6d68fdb559-jj7dc" Jun 11 18:35:47.354858 ip-10-0-130-170 kubenswrapper[2565]: I0611 18:35:47.354832 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/a0525b53-c65a-41bb-86fc-fb007aa4590e-metrics-cert\") pod \"lws-controller-manager-6d68fdb559-jj7dc\" (UID: \"a0525b53-c65a-41bb-86fc-fb007aa4590e\") " pod="openshift-lws-operator/lws-controller-manager-6d68fdb559-jj7dc" Jun 11 18:35:47.355073 ip-10-0-130-170 kubenswrapper[2565]: I0611 18:35:47.355049 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/a0525b53-c65a-41bb-86fc-fb007aa4590e-cert\") pod \"lws-controller-manager-6d68fdb559-jj7dc\" (UID: \"a0525b53-c65a-41bb-86fc-fb007aa4590e\") " pod="openshift-lws-operator/lws-controller-manager-6d68fdb559-jj7dc" Jun 11 18:35:47.367124 ip-10-0-130-170 kubenswrapper[2565]: I0611 18:35:47.367098 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-pw879\" (UniqueName: \"kubernetes.io/projected/a0525b53-c65a-41bb-86fc-fb007aa4590e-kube-api-access-pw879\") pod \"lws-controller-manager-6d68fdb559-jj7dc\" (UID: \"a0525b53-c65a-41bb-86fc-fb007aa4590e\") " pod="openshift-lws-operator/lws-controller-manager-6d68fdb559-jj7dc" Jun 11 18:35:47.516999 ip-10-0-130-170 kubenswrapper[2565]: I0611 18:35:47.516918 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/lws-controller-manager-6d68fdb559-jj7dc" Jun 11 18:35:47.703301 ip-10-0-130-170 kubenswrapper[2565]: I0611 18:35:47.703272 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/lws-controller-manager-6d68fdb559-jj7dc"] Jun 11 18:35:47.706180 ip-10-0-130-170 kubenswrapper[2565]: W0611 18:35:47.706145 2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda0525b53_c65a_41bb_86fc_fb007aa4590e.slice/crio-48fa6801a6b15f1c0245243de1efa078d334e09084bc431ca40dcb12df274575 WatchSource:0}: Error finding container 48fa6801a6b15f1c0245243de1efa078d334e09084bc431ca40dcb12df274575: Status 404 returned error can't find the container with id 48fa6801a6b15f1c0245243de1efa078d334e09084bc431ca40dcb12df274575 Jun 11 18:35:48.530395 ip-10-0-130-170 kubenswrapper[2565]: I0611 18:35:48.530364 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/lws-controller-manager-6d68fdb559-jj7dc" event={"ID":"a0525b53-c65a-41bb-86fc-fb007aa4590e","Type":"ContainerStarted","Data":"48fa6801a6b15f1c0245243de1efa078d334e09084bc431ca40dcb12df274575"} Jun 11 18:35:49.737756 ip-10-0-130-170 kubenswrapper[2565]: I0611 18:35:49.737724 2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-699bfcf455-j96zk"] Jun 11 18:35:49.769464 ip-10-0-130-170 kubenswrapper[2565]: I0611 18:35:49.769433 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-699bfcf455-j96zk"] Jun 11 18:35:49.769663 ip-10-0-130-170 kubenswrapper[2565]: I0611 18:35:49.769567 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-699bfcf455-j96zk" Jun 11 18:35:49.772858 ip-10-0-130-170 kubenswrapper[2565]: I0611 18:35:49.772836 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-dockercfg-sgm5f\"" Jun 11 18:35:49.773017 ip-10-0-130-170 kubenswrapper[2565]: I0611 18:35:49.772900 2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"kube-root-ca.crt\"" Jun 11 18:35:49.773017 ip-10-0-130-170 kubenswrapper[2565]: I0611 18:35:49.772901 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-service-cert\"" Jun 11 18:35:49.773299 ip-10-0-130-170 kubenswrapper[2565]: I0611 18:35:49.773282 2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"openshift-service-ca.crt\"" Jun 11 18:35:49.773378 ip-10-0-130-170 kubenswrapper[2565]: I0611 18:35:49.773312 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-webhook-cert\"" Jun 11 18:35:49.873205 ip-10-0-130-170 kubenswrapper[2565]: I0611 18:35:49.873158 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-t5kkx\" (UniqueName: \"kubernetes.io/projected/666c734e-668e-4b2e-a00c-8b10d199f510-kube-api-access-t5kkx\") pod \"opendatahub-operator-controller-manager-699bfcf455-j96zk\" (UID: \"666c734e-668e-4b2e-a00c-8b10d199f510\") " pod="opendatahub/opendatahub-operator-controller-manager-699bfcf455-j96zk" Jun 11 18:35:49.873406 ip-10-0-130-170 kubenswrapper[2565]: I0611 18:35:49.873332 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/666c734e-668e-4b2e-a00c-8b10d199f510-tmp\") pod \"opendatahub-operator-controller-manager-699bfcf455-j96zk\" (UID: \"666c734e-668e-4b2e-a00c-8b10d199f510\") " pod="opendatahub/opendatahub-operator-controller-manager-699bfcf455-j96zk" Jun 11 18:35:49.873406 ip-10-0-130-170 kubenswrapper[2565]: I0611 18:35:49.873379 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/666c734e-668e-4b2e-a00c-8b10d199f510-apiservice-cert\") pod \"opendatahub-operator-controller-manager-699bfcf455-j96zk\" (UID: \"666c734e-668e-4b2e-a00c-8b10d199f510\") " pod="opendatahub/opendatahub-operator-controller-manager-699bfcf455-j96zk" Jun 11 18:35:49.873531 ip-10-0-130-170 kubenswrapper[2565]: I0611 18:35:49.873452 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/666c734e-668e-4b2e-a00c-8b10d199f510-manifests\") pod \"opendatahub-operator-controller-manager-699bfcf455-j96zk\" (UID: \"666c734e-668e-4b2e-a00c-8b10d199f510\") " pod="opendatahub/opendatahub-operator-controller-manager-699bfcf455-j96zk" Jun 11 18:35:49.873531 ip-10-0-130-170 kubenswrapper[2565]: I0611 18:35:49.873469 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/666c734e-668e-4b2e-a00c-8b10d199f510-webhook-cert\") pod \"opendatahub-operator-controller-manager-699bfcf455-j96zk\" (UID: \"666c734e-668e-4b2e-a00c-8b10d199f510\") " pod="opendatahub/opendatahub-operator-controller-manager-699bfcf455-j96zk" Jun 11 18:35:49.974335 ip-10-0-130-170 kubenswrapper[2565]: I0611 18:35:49.974293 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/666c734e-668e-4b2e-a00c-8b10d199f510-tmp\") pod \"opendatahub-operator-controller-manager-699bfcf455-j96zk\" (UID: \"666c734e-668e-4b2e-a00c-8b10d199f510\") " pod="opendatahub/opendatahub-operator-controller-manager-699bfcf455-j96zk" Jun 11 18:35:49.974335 ip-10-0-130-170 kubenswrapper[2565]: I0611 18:35:49.974343 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/666c734e-668e-4b2e-a00c-8b10d199f510-apiservice-cert\") pod \"opendatahub-operator-controller-manager-699bfcf455-j96zk\" (UID: \"666c734e-668e-4b2e-a00c-8b10d199f510\") " pod="opendatahub/opendatahub-operator-controller-manager-699bfcf455-j96zk" Jun 11 18:35:49.974610 ip-10-0-130-170 kubenswrapper[2565]: I0611 18:35:49.974397 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/666c734e-668e-4b2e-a00c-8b10d199f510-manifests\") pod \"opendatahub-operator-controller-manager-699bfcf455-j96zk\" (UID: \"666c734e-668e-4b2e-a00c-8b10d199f510\") " pod="opendatahub/opendatahub-operator-controller-manager-699bfcf455-j96zk" Jun 11 18:35:49.974610 ip-10-0-130-170 kubenswrapper[2565]: I0611 18:35:49.974422 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/666c734e-668e-4b2e-a00c-8b10d199f510-webhook-cert\") pod \"opendatahub-operator-controller-manager-699bfcf455-j96zk\" (UID: \"666c734e-668e-4b2e-a00c-8b10d199f510\") " pod="opendatahub/opendatahub-operator-controller-manager-699bfcf455-j96zk" Jun 11 18:35:49.974610 ip-10-0-130-170 kubenswrapper[2565]: I0611 18:35:49.974465 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-t5kkx\" (UniqueName: \"kubernetes.io/projected/666c734e-668e-4b2e-a00c-8b10d199f510-kube-api-access-t5kkx\") pod \"opendatahub-operator-controller-manager-699bfcf455-j96zk\" (UID: \"666c734e-668e-4b2e-a00c-8b10d199f510\") " pod="opendatahub/opendatahub-operator-controller-manager-699bfcf455-j96zk" Jun 11 18:35:49.974924 ip-10-0-130-170 kubenswrapper[2565]: I0611 18:35:49.974873 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/666c734e-668e-4b2e-a00c-8b10d199f510-manifests\") pod \"opendatahub-operator-controller-manager-699bfcf455-j96zk\" (UID: \"666c734e-668e-4b2e-a00c-8b10d199f510\") " pod="opendatahub/opendatahub-operator-controller-manager-699bfcf455-j96zk" Jun 11 18:35:49.977095 ip-10-0-130-170 kubenswrapper[2565]: I0611 18:35:49.977069 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/666c734e-668e-4b2e-a00c-8b10d199f510-tmp\") pod \"opendatahub-operator-controller-manager-699bfcf455-j96zk\" (UID: \"666c734e-668e-4b2e-a00c-8b10d199f510\") " pod="opendatahub/opendatahub-operator-controller-manager-699bfcf455-j96zk" Jun 11 18:35:49.977438 ip-10-0-130-170 kubenswrapper[2565]: I0611 18:35:49.977418 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/666c734e-668e-4b2e-a00c-8b10d199f510-apiservice-cert\") pod \"opendatahub-operator-controller-manager-699bfcf455-j96zk\" (UID: \"666c734e-668e-4b2e-a00c-8b10d199f510\") " pod="opendatahub/opendatahub-operator-controller-manager-699bfcf455-j96zk" Jun 11 18:35:49.977524 ip-10-0-130-170 kubenswrapper[2565]: I0611 18:35:49.977423 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/666c734e-668e-4b2e-a00c-8b10d199f510-webhook-cert\") pod \"opendatahub-operator-controller-manager-699bfcf455-j96zk\" (UID: \"666c734e-668e-4b2e-a00c-8b10d199f510\") " pod="opendatahub/opendatahub-operator-controller-manager-699bfcf455-j96zk" Jun 11 18:35:49.987673 ip-10-0-130-170 kubenswrapper[2565]: I0611 18:35:49.987640 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-t5kkx\" (UniqueName: \"kubernetes.io/projected/666c734e-668e-4b2e-a00c-8b10d199f510-kube-api-access-t5kkx\") pod \"opendatahub-operator-controller-manager-699bfcf455-j96zk\" (UID: \"666c734e-668e-4b2e-a00c-8b10d199f510\") " pod="opendatahub/opendatahub-operator-controller-manager-699bfcf455-j96zk" Jun 11 18:35:50.083478 ip-10-0-130-170 kubenswrapper[2565]: I0611 18:35:50.083392 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-699bfcf455-j96zk" Jun 11 18:35:50.377903 ip-10-0-130-170 kubenswrapper[2565]: I0611 18:35:50.377881 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-699bfcf455-j96zk"] Jun 11 18:35:50.380193 ip-10-0-130-170 kubenswrapper[2565]: W0611 18:35:50.380167 2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod666c734e_668e_4b2e_a00c_8b10d199f510.slice/crio-afe1db83aebf611258fe0e93fe0193f8b771681852c1af7b0e1c4b6754404f0a WatchSource:0}: Error finding container afe1db83aebf611258fe0e93fe0193f8b771681852c1af7b0e1c4b6754404f0a: Status 404 returned error can't find the container with id afe1db83aebf611258fe0e93fe0193f8b771681852c1af7b0e1c4b6754404f0a Jun 11 18:35:50.543392 ip-10-0-130-170 kubenswrapper[2565]: I0611 18:35:50.543355 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/lws-controller-manager-6d68fdb559-jj7dc" event={"ID":"a0525b53-c65a-41bb-86fc-fb007aa4590e","Type":"ContainerStarted","Data":"a8a0d03466b61834ebe67b4b7d1ea21f72ddcf0aea9e6d9485327967544690d5"} Jun 11 18:35:50.543574 ip-10-0-130-170 kubenswrapper[2565]: I0611 18:35:50.543428 2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-lws-operator/lws-controller-manager-6d68fdb559-jj7dc" Jun 11 18:35:50.544748 ip-10-0-130-170 kubenswrapper[2565]: I0611 18:35:50.544722 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-699bfcf455-j96zk" event={"ID":"666c734e-668e-4b2e-a00c-8b10d199f510","Type":"ContainerStarted","Data":"afe1db83aebf611258fe0e93fe0193f8b771681852c1af7b0e1c4b6754404f0a"} Jun 11 18:35:50.562542 ip-10-0-130-170 kubenswrapper[2565]: I0611 18:35:50.562473 2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-lws-operator/lws-controller-manager-6d68fdb559-jj7dc" podStartSLOduration=1.005264544 podStartE2EDuration="3.562452264s" totalImagesPullingTime="2.55718772s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-11 18:35:47 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-11 18:35:50.559825418 +0000 UTC m=+469.308511670" watchObservedRunningTime="2026-06-11 18:35:50.562452264 +0000 UTC m=+469.311138289" Jun 11 18:35:53.561551 ip-10-0-130-170 kubenswrapper[2565]: I0611 18:35:53.561504 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-699bfcf455-j96zk" event={"ID":"666c734e-668e-4b2e-a00c-8b10d199f510","Type":"ContainerStarted","Data":"5100cabdcc41f758f00c8361ab3f52444cb623f8b660550f302c158c81dd1540"} Jun 11 18:35:54.567954 ip-10-0-130-170 kubenswrapper[2565]: I0611 18:35:54.567917 2565 generic.go:356] "Generic (PLEG): container finished" podID="666c734e-668e-4b2e-a00c-8b10d199f510" containerID="5100cabdcc41f758f00c8361ab3f52444cb623f8b660550f302c158c81dd1540" exitCode=0 Jun 11 18:35:54.568444 ip-10-0-130-170 kubenswrapper[2565]: I0611 18:35:54.568004 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-699bfcf455-j96zk" event={"ID":"666c734e-668e-4b2e-a00c-8b10d199f510","Type":"ContainerDied","Data":"5100cabdcc41f758f00c8361ab3f52444cb623f8b660550f302c158c81dd1540"} Jun 11 18:35:55.575273 ip-10-0-130-170 kubenswrapper[2565]: I0611 18:35:55.575221 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-699bfcf455-j96zk" event={"ID":"666c734e-668e-4b2e-a00c-8b10d199f510","Type":"ContainerStarted","Data":"2ce98f53247afb443615eb56925d0db2419db89a504f5dcce2a9d9272ad3a0ee"} Jun 11 18:35:55.575740 ip-10-0-130-170 kubenswrapper[2565]: I0611 18:35:55.575311 2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/opendatahub-operator-controller-manager-699bfcf455-j96zk" Jun 11 18:35:55.601091 ip-10-0-130-170 kubenswrapper[2565]: I0611 18:35:55.601036 2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/opendatahub-operator-controller-manager-699bfcf455-j96zk" podStartSLOduration=2.348232843 podStartE2EDuration="6.601019992s" totalImagesPullingTime="3.340085096s" totalInitContainerRuntime="912.702053ms" isStatefulPod=false podCreationTimestamp="2026-06-11 18:35:49 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-11 18:35:55.597814552 +0000 UTC m=+474.346500592" watchObservedRunningTime="2026-06-11 18:35:55.601019992 +0000 UTC m=+474.349706070" Jun 11 18:36:01.552781 ip-10-0-130-170 kubenswrapper[2565]: I0611 18:36:01.552748 2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-lws-operator/lws-controller-manager-6d68fdb559-jj7dc" Jun 11 18:36:06.582582 ip-10-0-130-170 kubenswrapper[2565]: I0611 18:36:06.582547 2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/opendatahub-operator-controller-manager-699bfcf455-j96zk" Jun 11 18:36:14.707353 ip-10-0-130-170 kubenswrapper[2565]: I0611 18:36:14.707319 2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/kube-auth-proxy-576bcbdbd6-w42kf"] Jun 11 18:36:14.710051 ip-10-0-130-170 kubenswrapper[2565]: I0611 18:36:14.710034 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/kube-auth-proxy-576bcbdbd6-w42kf" Jun 11 18:36:14.717279 ip-10-0-130-170 kubenswrapper[2565]: I0611 18:36:14.713891 2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"kube-root-ca.crt\"" Jun 11 18:36:14.717279 ip-10-0-130-170 kubenswrapper[2565]: I0611 18:36:14.713891 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-dockercfg-7txr4\"" Jun 11 18:36:14.717279 ip-10-0-130-170 kubenswrapper[2565]: I0611 18:36:14.714860 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-tls\"" Jun 11 18:36:14.717279 ip-10-0-130-170 kubenswrapper[2565]: I0611 18:36:14.715234 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-creds\"" Jun 11 18:36:14.717279 ip-10-0-130-170 kubenswrapper[2565]: I0611 18:36:14.715603 2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-service-ca.crt\"" Jun 11 18:36:14.724838 ip-10-0-130-170 kubenswrapper[2565]: I0611 18:36:14.724641 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/kube-auth-proxy-576bcbdbd6-w42kf"] Jun 11 18:36:14.803211 ip-10-0-130-170 kubenswrapper[2565]: I0611 18:36:14.803177 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-54k85\" (UniqueName: \"kubernetes.io/projected/25f90e47-48bd-46f3-ad3c-9870b92d355e-kube-api-access-54k85\") pod \"kube-auth-proxy-576bcbdbd6-w42kf\" (UID: \"25f90e47-48bd-46f3-ad3c-9870b92d355e\") " pod="openshift-ingress/kube-auth-proxy-576bcbdbd6-w42kf" Jun 11 18:36:14.803403 ip-10-0-130-170 kubenswrapper[2565]: I0611 18:36:14.803219 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/25f90e47-48bd-46f3-ad3c-9870b92d355e-tls-certs\") pod \"kube-auth-proxy-576bcbdbd6-w42kf\" (UID: \"25f90e47-48bd-46f3-ad3c-9870b92d355e\") " pod="openshift-ingress/kube-auth-proxy-576bcbdbd6-w42kf" Jun 11 18:36:14.803403 ip-10-0-130-170 kubenswrapper[2565]: I0611 18:36:14.803396 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/25f90e47-48bd-46f3-ad3c-9870b92d355e-tmp\") pod \"kube-auth-proxy-576bcbdbd6-w42kf\" (UID: \"25f90e47-48bd-46f3-ad3c-9870b92d355e\") " pod="openshift-ingress/kube-auth-proxy-576bcbdbd6-w42kf" Jun 11 18:36:14.904274 ip-10-0-130-170 kubenswrapper[2565]: I0611 18:36:14.904216 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/25f90e47-48bd-46f3-ad3c-9870b92d355e-tmp\") pod \"kube-auth-proxy-576bcbdbd6-w42kf\" (UID: \"25f90e47-48bd-46f3-ad3c-9870b92d355e\") " pod="openshift-ingress/kube-auth-proxy-576bcbdbd6-w42kf" Jun 11 18:36:14.904447 ip-10-0-130-170 kubenswrapper[2565]: I0611 18:36:14.904309 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-54k85\" (UniqueName: \"kubernetes.io/projected/25f90e47-48bd-46f3-ad3c-9870b92d355e-kube-api-access-54k85\") pod \"kube-auth-proxy-576bcbdbd6-w42kf\" (UID: \"25f90e47-48bd-46f3-ad3c-9870b92d355e\") " pod="openshift-ingress/kube-auth-proxy-576bcbdbd6-w42kf" Jun 11 18:36:14.904447 ip-10-0-130-170 kubenswrapper[2565]: I0611 18:36:14.904338 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/25f90e47-48bd-46f3-ad3c-9870b92d355e-tls-certs\") pod \"kube-auth-proxy-576bcbdbd6-w42kf\" (UID: \"25f90e47-48bd-46f3-ad3c-9870b92d355e\") " pod="openshift-ingress/kube-auth-proxy-576bcbdbd6-w42kf" Jun 11 18:36:14.907538 ip-10-0-130-170 kubenswrapper[2565]: I0611 18:36:14.907508 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/25f90e47-48bd-46f3-ad3c-9870b92d355e-tmp\") pod \"kube-auth-proxy-576bcbdbd6-w42kf\" (UID: \"25f90e47-48bd-46f3-ad3c-9870b92d355e\") " pod="openshift-ingress/kube-auth-proxy-576bcbdbd6-w42kf" Jun 11 18:36:14.907852 ip-10-0-130-170 kubenswrapper[2565]: I0611 18:36:14.907835 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/25f90e47-48bd-46f3-ad3c-9870b92d355e-tls-certs\") pod \"kube-auth-proxy-576bcbdbd6-w42kf\" (UID: \"25f90e47-48bd-46f3-ad3c-9870b92d355e\") " pod="openshift-ingress/kube-auth-proxy-576bcbdbd6-w42kf" Jun 11 18:36:14.913645 ip-10-0-130-170 kubenswrapper[2565]: I0611 18:36:14.913616 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-54k85\" (UniqueName: \"kubernetes.io/projected/25f90e47-48bd-46f3-ad3c-9870b92d355e-kube-api-access-54k85\") pod \"kube-auth-proxy-576bcbdbd6-w42kf\" (UID: \"25f90e47-48bd-46f3-ad3c-9870b92d355e\") " pod="openshift-ingress/kube-auth-proxy-576bcbdbd6-w42kf" Jun 11 18:36:14.944442 ip-10-0-130-170 kubenswrapper[2565]: I0611 18:36:14.944412 2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-marketplace/4258531154569488b4b06856545cf53ed48b82e88ddd64b4ce22efab0685tsd"] Jun 11 18:36:14.947483 ip-10-0-130-170 kubenswrapper[2565]: I0611 18:36:14.947461 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/4258531154569488b4b06856545cf53ed48b82e88ddd64b4ce22efab0685tsd" Jun 11 18:36:14.950561 ip-10-0-130-170 kubenswrapper[2565]: I0611 18:36:14.950530 2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"kube-root-ca.crt\"" Jun 11 18:36:14.950685 ip-10-0-130-170 kubenswrapper[2565]: I0611 18:36:14.950595 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-marketplace\"/\"default-dockercfg-8jd6m\"" Jun 11 18:36:14.950685 ip-10-0-130-170 kubenswrapper[2565]: I0611 18:36:14.950595 2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"openshift-service-ca.crt\"" Jun 11 18:36:14.958505 ip-10-0-130-170 kubenswrapper[2565]: I0611 18:36:14.958432 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/4258531154569488b4b06856545cf53ed48b82e88ddd64b4ce22efab0685tsd"] Jun 11 18:36:15.027857 ip-10-0-130-170 kubenswrapper[2565]: I0611 18:36:15.027805 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/kube-auth-proxy-576bcbdbd6-w42kf" Jun 11 18:36:15.107063 ip-10-0-130-170 kubenswrapper[2565]: I0611 18:36:15.107027 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/126566e4-1a39-4427-a5cb-1e5c48871352-bundle\") pod \"4258531154569488b4b06856545cf53ed48b82e88ddd64b4ce22efab0685tsd\" (UID: \"126566e4-1a39-4427-a5cb-1e5c48871352\") " pod="openshift-marketplace/4258531154569488b4b06856545cf53ed48b82e88ddd64b4ce22efab0685tsd" Jun 11 18:36:15.107205 ip-10-0-130-170 kubenswrapper[2565]: I0611 18:36:15.107117 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/126566e4-1a39-4427-a5cb-1e5c48871352-util\") pod \"4258531154569488b4b06856545cf53ed48b82e88ddd64b4ce22efab0685tsd\" (UID: \"126566e4-1a39-4427-a5cb-1e5c48871352\") " pod="openshift-marketplace/4258531154569488b4b06856545cf53ed48b82e88ddd64b4ce22efab0685tsd" Jun 11 18:36:15.107205 ip-10-0-130-170 kubenswrapper[2565]: I0611 18:36:15.107174 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xv24v\" (UniqueName: \"kubernetes.io/projected/126566e4-1a39-4427-a5cb-1e5c48871352-kube-api-access-xv24v\") pod \"4258531154569488b4b06856545cf53ed48b82e88ddd64b4ce22efab0685tsd\" (UID: \"126566e4-1a39-4427-a5cb-1e5c48871352\") " pod="openshift-marketplace/4258531154569488b4b06856545cf53ed48b82e88ddd64b4ce22efab0685tsd" Jun 11 18:36:15.174305 ip-10-0-130-170 kubenswrapper[2565]: I0611 18:36:15.174269 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/kube-auth-proxy-576bcbdbd6-w42kf"] Jun 11 18:36:15.175947 ip-10-0-130-170 kubenswrapper[2565]: W0611 18:36:15.175916 2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod25f90e47_48bd_46f3_ad3c_9870b92d355e.slice/crio-f0b63dd057b0f0c31585d36509349c2671571d365a6bb1bc06e82d1d22fb6084 WatchSource:0}: Error finding container f0b63dd057b0f0c31585d36509349c2671571d365a6bb1bc06e82d1d22fb6084: Status 404 returned error can't find the container with id f0b63dd057b0f0c31585d36509349c2671571d365a6bb1bc06e82d1d22fb6084 Jun 11 18:36:15.208656 ip-10-0-130-170 kubenswrapper[2565]: I0611 18:36:15.208558 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/126566e4-1a39-4427-a5cb-1e5c48871352-util\") pod \"4258531154569488b4b06856545cf53ed48b82e88ddd64b4ce22efab0685tsd\" (UID: \"126566e4-1a39-4427-a5cb-1e5c48871352\") " pod="openshift-marketplace/4258531154569488b4b06856545cf53ed48b82e88ddd64b4ce22efab0685tsd" Jun 11 18:36:15.208656 ip-10-0-130-170 kubenswrapper[2565]: I0611 18:36:15.208617 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xv24v\" (UniqueName: \"kubernetes.io/projected/126566e4-1a39-4427-a5cb-1e5c48871352-kube-api-access-xv24v\") pod \"4258531154569488b4b06856545cf53ed48b82e88ddd64b4ce22efab0685tsd\" (UID: \"126566e4-1a39-4427-a5cb-1e5c48871352\") " pod="openshift-marketplace/4258531154569488b4b06856545cf53ed48b82e88ddd64b4ce22efab0685tsd" Jun 11 18:36:15.208879 ip-10-0-130-170 kubenswrapper[2565]: I0611 18:36:15.208713 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/126566e4-1a39-4427-a5cb-1e5c48871352-bundle\") pod \"4258531154569488b4b06856545cf53ed48b82e88ddd64b4ce22efab0685tsd\" (UID: \"126566e4-1a39-4427-a5cb-1e5c48871352\") " pod="openshift-marketplace/4258531154569488b4b06856545cf53ed48b82e88ddd64b4ce22efab0685tsd" Jun 11 18:36:15.208977 ip-10-0-130-170 kubenswrapper[2565]: I0611 18:36:15.208957 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/126566e4-1a39-4427-a5cb-1e5c48871352-util\") pod \"4258531154569488b4b06856545cf53ed48b82e88ddd64b4ce22efab0685tsd\" (UID: \"126566e4-1a39-4427-a5cb-1e5c48871352\") " pod="openshift-marketplace/4258531154569488b4b06856545cf53ed48b82e88ddd64b4ce22efab0685tsd" Jun 11 18:36:15.209070 ip-10-0-130-170 kubenswrapper[2565]: I0611 18:36:15.209027 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/126566e4-1a39-4427-a5cb-1e5c48871352-bundle\") pod \"4258531154569488b4b06856545cf53ed48b82e88ddd64b4ce22efab0685tsd\" (UID: \"126566e4-1a39-4427-a5cb-1e5c48871352\") " pod="openshift-marketplace/4258531154569488b4b06856545cf53ed48b82e88ddd64b4ce22efab0685tsd" Jun 11 18:36:15.217342 ip-10-0-130-170 kubenswrapper[2565]: I0611 18:36:15.217319 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-xv24v\" (UniqueName: \"kubernetes.io/projected/126566e4-1a39-4427-a5cb-1e5c48871352-kube-api-access-xv24v\") pod \"4258531154569488b4b06856545cf53ed48b82e88ddd64b4ce22efab0685tsd\" (UID: \"126566e4-1a39-4427-a5cb-1e5c48871352\") " pod="openshift-marketplace/4258531154569488b4b06856545cf53ed48b82e88ddd64b4ce22efab0685tsd" Jun 11 18:36:15.261232 ip-10-0-130-170 kubenswrapper[2565]: I0611 18:36:15.261196 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/4258531154569488b4b06856545cf53ed48b82e88ddd64b4ce22efab0685tsd" Jun 11 18:36:15.411726 ip-10-0-130-170 kubenswrapper[2565]: I0611 18:36:15.411697 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/4258531154569488b4b06856545cf53ed48b82e88ddd64b4ce22efab0685tsd"] Jun 11 18:36:15.413665 ip-10-0-130-170 kubenswrapper[2565]: W0611 18:36:15.413634 2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod126566e4_1a39_4427_a5cb_1e5c48871352.slice/crio-f2f87a5c56a895d7fa5bb48e7ca770da45ddeaaa8ee2ca9ee917b80be89cf28a WatchSource:0}: Error finding container f2f87a5c56a895d7fa5bb48e7ca770da45ddeaaa8ee2ca9ee917b80be89cf28a: Status 404 returned error can't find the container with id f2f87a5c56a895d7fa5bb48e7ca770da45ddeaaa8ee2ca9ee917b80be89cf28a Jun 11 18:36:15.681043 ip-10-0-130-170 kubenswrapper[2565]: I0611 18:36:15.681014 2565 generic.go:356] "Generic (PLEG): container finished" podID="126566e4-1a39-4427-a5cb-1e5c48871352" containerID="d592eec47fe6e9ba4f2c61f507be5304e5fdcf2c8686c5692d6ab75408f22e3c" exitCode=0 Jun 11 18:36:15.681242 ip-10-0-130-170 kubenswrapper[2565]: I0611 18:36:15.681111 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/4258531154569488b4b06856545cf53ed48b82e88ddd64b4ce22efab0685tsd" event={"ID":"126566e4-1a39-4427-a5cb-1e5c48871352","Type":"ContainerDied","Data":"d592eec47fe6e9ba4f2c61f507be5304e5fdcf2c8686c5692d6ab75408f22e3c"} Jun 11 18:36:15.681242 ip-10-0-130-170 kubenswrapper[2565]: I0611 18:36:15.681175 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/4258531154569488b4b06856545cf53ed48b82e88ddd64b4ce22efab0685tsd" event={"ID":"126566e4-1a39-4427-a5cb-1e5c48871352","Type":"ContainerStarted","Data":"f2f87a5c56a895d7fa5bb48e7ca770da45ddeaaa8ee2ca9ee917b80be89cf28a"} Jun 11 18:36:15.682404 ip-10-0-130-170 kubenswrapper[2565]: I0611 18:36:15.682381 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/kube-auth-proxy-576bcbdbd6-w42kf" event={"ID":"25f90e47-48bd-46f3-ad3c-9870b92d355e","Type":"ContainerStarted","Data":"f0b63dd057b0f0c31585d36509349c2671571d365a6bb1bc06e82d1d22fb6084"} Jun 11 18:36:18.702284 ip-10-0-130-170 kubenswrapper[2565]: I0611 18:36:18.702237 2565 generic.go:356] "Generic (PLEG): container finished" podID="126566e4-1a39-4427-a5cb-1e5c48871352" containerID="f330455515158fee6ae0909a7ad54dff06bb03e92015641866747e2a2f1154a2" exitCode=0 Jun 11 18:36:18.702702 ip-10-0-130-170 kubenswrapper[2565]: I0611 18:36:18.702302 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/4258531154569488b4b06856545cf53ed48b82e88ddd64b4ce22efab0685tsd" event={"ID":"126566e4-1a39-4427-a5cb-1e5c48871352","Type":"ContainerDied","Data":"f330455515158fee6ae0909a7ad54dff06bb03e92015641866747e2a2f1154a2"} Jun 11 18:36:18.704006 ip-10-0-130-170 kubenswrapper[2565]: I0611 18:36:18.703984 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/kube-auth-proxy-576bcbdbd6-w42kf" event={"ID":"25f90e47-48bd-46f3-ad3c-9870b92d355e","Type":"ContainerStarted","Data":"1651ab4ea2841693bca08ebeb5da6390cb968c746ce3c19c1d54cb7c3b0b1f20"} Jun 11 18:36:18.737134 ip-10-0-130-170 kubenswrapper[2565]: I0611 18:36:18.737080 2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/kube-auth-proxy-576bcbdbd6-w42kf" podStartSLOduration=1.7268157560000001 podStartE2EDuration="4.737065104s" totalImagesPullingTime="3.010249348s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-11 18:36:14 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-11 18:36:18.735661136 +0000 UTC m=+497.484347159" watchObservedRunningTime="2026-06-11 18:36:18.737065104 +0000 UTC m=+497.485751147" Jun 11 18:36:19.711466 ip-10-0-130-170 kubenswrapper[2565]: I0611 18:36:19.711426 2565 generic.go:356] "Generic (PLEG): container finished" podID="126566e4-1a39-4427-a5cb-1e5c48871352" containerID="b7eb1fe084fd7926ba04130e551e5bd58e19b67baf4dbc85d4489d44625c59fc" exitCode=0 Jun 11 18:36:19.711864 ip-10-0-130-170 kubenswrapper[2565]: I0611 18:36:19.711513 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/4258531154569488b4b06856545cf53ed48b82e88ddd64b4ce22efab0685tsd" event={"ID":"126566e4-1a39-4427-a5cb-1e5c48871352","Type":"ContainerDied","Data":"b7eb1fe084fd7926ba04130e551e5bd58e19b67baf4dbc85d4489d44625c59fc"} Jun 11 18:36:20.851890 ip-10-0-130-170 kubenswrapper[2565]: I0611 18:36:20.851863 2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/4258531154569488b4b06856545cf53ed48b82e88ddd64b4ce22efab0685tsd" Jun 11 18:36:20.966364 ip-10-0-130-170 kubenswrapper[2565]: I0611 18:36:20.966326 2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/126566e4-1a39-4427-a5cb-1e5c48871352-bundle\") pod \"126566e4-1a39-4427-a5cb-1e5c48871352\" (UID: \"126566e4-1a39-4427-a5cb-1e5c48871352\") " Jun 11 18:36:20.966574 ip-10-0-130-170 kubenswrapper[2565]: I0611 18:36:20.966377 2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-xv24v\" (UniqueName: \"kubernetes.io/projected/126566e4-1a39-4427-a5cb-1e5c48871352-kube-api-access-xv24v\") pod \"126566e4-1a39-4427-a5cb-1e5c48871352\" (UID: \"126566e4-1a39-4427-a5cb-1e5c48871352\") " Jun 11 18:36:20.966574 ip-10-0-130-170 kubenswrapper[2565]: I0611 18:36:20.966406 2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/126566e4-1a39-4427-a5cb-1e5c48871352-util\") pod \"126566e4-1a39-4427-a5cb-1e5c48871352\" (UID: \"126566e4-1a39-4427-a5cb-1e5c48871352\") " Jun 11 18:36:20.967323 ip-10-0-130-170 kubenswrapper[2565]: I0611 18:36:20.967294 2565 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/126566e4-1a39-4427-a5cb-1e5c48871352-bundle" (OuterVolumeSpecName: "bundle") pod "126566e4-1a39-4427-a5cb-1e5c48871352" (UID: "126566e4-1a39-4427-a5cb-1e5c48871352"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 11 18:36:20.968729 ip-10-0-130-170 kubenswrapper[2565]: I0611 18:36:20.968691 2565 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/126566e4-1a39-4427-a5cb-1e5c48871352-kube-api-access-xv24v" (OuterVolumeSpecName: "kube-api-access-xv24v") pod "126566e4-1a39-4427-a5cb-1e5c48871352" (UID: "126566e4-1a39-4427-a5cb-1e5c48871352"). InnerVolumeSpecName "kube-api-access-xv24v". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 11 18:36:20.970752 ip-10-0-130-170 kubenswrapper[2565]: I0611 18:36:20.970727 2565 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/126566e4-1a39-4427-a5cb-1e5c48871352-util" (OuterVolumeSpecName: "util") pod "126566e4-1a39-4427-a5cb-1e5c48871352" (UID: "126566e4-1a39-4427-a5cb-1e5c48871352"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 11 18:36:21.067963 ip-10-0-130-170 kubenswrapper[2565]: I0611 18:36:21.067924 2565 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/126566e4-1a39-4427-a5cb-1e5c48871352-util\") on node \"ip-10-0-130-170.ec2.internal\" DevicePath \"\"" Jun 11 18:36:21.067963 ip-10-0-130-170 kubenswrapper[2565]: I0611 18:36:21.067956 2565 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/126566e4-1a39-4427-a5cb-1e5c48871352-bundle\") on node \"ip-10-0-130-170.ec2.internal\" DevicePath \"\"" Jun 11 18:36:21.067963 ip-10-0-130-170 kubenswrapper[2565]: I0611 18:36:21.067967 2565 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-xv24v\" (UniqueName: \"kubernetes.io/projected/126566e4-1a39-4427-a5cb-1e5c48871352-kube-api-access-xv24v\") on node \"ip-10-0-130-170.ec2.internal\" DevicePath \"\"" Jun 11 18:36:21.722719 ip-10-0-130-170 kubenswrapper[2565]: I0611 18:36:21.722685 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/4258531154569488b4b06856545cf53ed48b82e88ddd64b4ce22efab0685tsd" event={"ID":"126566e4-1a39-4427-a5cb-1e5c48871352","Type":"ContainerDied","Data":"f2f87a5c56a895d7fa5bb48e7ca770da45ddeaaa8ee2ca9ee917b80be89cf28a"} Jun 11 18:36:21.722719 ip-10-0-130-170 kubenswrapper[2565]: I0611 18:36:21.722708 2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/4258531154569488b4b06856545cf53ed48b82e88ddd64b4ce22efab0685tsd" Jun 11 18:36:21.722926 ip-10-0-130-170 kubenswrapper[2565]: I0611 18:36:21.722732 2565 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="f2f87a5c56a895d7fa5bb48e7ca770da45ddeaaa8ee2ca9ee917b80be89cf28a" Jun 11 18:36:30.008282 ip-10-0-130-170 kubenswrapper[2565]: I0611 18:36:30.008233 2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762ah7wst"] Jun 11 18:36:30.008681 ip-10-0-130-170 kubenswrapper[2565]: I0611 18:36:30.008597 2565 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="126566e4-1a39-4427-a5cb-1e5c48871352" containerName="extract" Jun 11 18:36:30.008681 ip-10-0-130-170 kubenswrapper[2565]: I0611 18:36:30.008609 2565 state_mem.go:107] "Deleted CPUSet assignment" podUID="126566e4-1a39-4427-a5cb-1e5c48871352" containerName="extract" Jun 11 18:36:30.008681 ip-10-0-130-170 kubenswrapper[2565]: I0611 18:36:30.008628 2565 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="126566e4-1a39-4427-a5cb-1e5c48871352" containerName="util" Jun 11 18:36:30.008681 ip-10-0-130-170 kubenswrapper[2565]: I0611 18:36:30.008634 2565 state_mem.go:107] "Deleted CPUSet assignment" podUID="126566e4-1a39-4427-a5cb-1e5c48871352" containerName="util" Jun 11 18:36:30.008681 ip-10-0-130-170 kubenswrapper[2565]: I0611 18:36:30.008640 2565 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="126566e4-1a39-4427-a5cb-1e5c48871352" containerName="pull" Jun 11 18:36:30.008681 ip-10-0-130-170 kubenswrapper[2565]: I0611 18:36:30.008645 2565 state_mem.go:107] "Deleted CPUSet assignment" podUID="126566e4-1a39-4427-a5cb-1e5c48871352" containerName="pull" Jun 11 18:36:30.008863 ip-10-0-130-170 kubenswrapper[2565]: I0611 18:36:30.008694 2565 memory_manager.go:368] "RemoveStaleState removing state" podUID="126566e4-1a39-4427-a5cb-1e5c48871352" containerName="extract" Jun 11 18:36:30.015115 ip-10-0-130-170 kubenswrapper[2565]: I0611 18:36:30.015088 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762ah7wst" Jun 11 18:36:30.019114 ip-10-0-130-170 kubenswrapper[2565]: I0611 18:36:30.019090 2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"openshift-service-ca.crt\"" Jun 11 18:36:30.019286 ip-10-0-130-170 kubenswrapper[2565]: I0611 18:36:30.019209 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-marketplace\"/\"default-dockercfg-8jd6m\"" Jun 11 18:36:30.021332 ip-10-0-130-170 kubenswrapper[2565]: I0611 18:36:30.021315 2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"kube-root-ca.crt\"" Jun 11 18:36:30.034359 ip-10-0-130-170 kubenswrapper[2565]: I0611 18:36:30.034321 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762ah7wst"] Jun 11 18:36:30.050131 ip-10-0-130-170 kubenswrapper[2565]: I0611 18:36:30.050092 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/ebd2b3db-a6a2-4ad6-bbdc-0aaf6dfe7a6e-util\") pod \"c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762ah7wst\" (UID: \"ebd2b3db-a6a2-4ad6-bbdc-0aaf6dfe7a6e\") " pod="openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762ah7wst" Jun 11 18:36:30.050131 ip-10-0-130-170 kubenswrapper[2565]: I0611 18:36:30.050134 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/ebd2b3db-a6a2-4ad6-bbdc-0aaf6dfe7a6e-bundle\") pod \"c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762ah7wst\" (UID: \"ebd2b3db-a6a2-4ad6-bbdc-0aaf6dfe7a6e\") " pod="openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762ah7wst" Jun 11 18:36:30.050389 ip-10-0-130-170 kubenswrapper[2565]: I0611 18:36:30.050164 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wp77m\" (UniqueName: \"kubernetes.io/projected/ebd2b3db-a6a2-4ad6-bbdc-0aaf6dfe7a6e-kube-api-access-wp77m\") pod \"c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762ah7wst\" (UID: \"ebd2b3db-a6a2-4ad6-bbdc-0aaf6dfe7a6e\") " pod="openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762ah7wst" Jun 11 18:36:30.151286 ip-10-0-130-170 kubenswrapper[2565]: I0611 18:36:30.151212 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/ebd2b3db-a6a2-4ad6-bbdc-0aaf6dfe7a6e-util\") pod \"c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762ah7wst\" (UID: \"ebd2b3db-a6a2-4ad6-bbdc-0aaf6dfe7a6e\") " pod="openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762ah7wst" Jun 11 18:36:30.151286 ip-10-0-130-170 kubenswrapper[2565]: I0611 18:36:30.151287 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/ebd2b3db-a6a2-4ad6-bbdc-0aaf6dfe7a6e-bundle\") pod \"c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762ah7wst\" (UID: \"ebd2b3db-a6a2-4ad6-bbdc-0aaf6dfe7a6e\") " pod="openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762ah7wst" Jun 11 18:36:30.151541 ip-10-0-130-170 kubenswrapper[2565]: I0611 18:36:30.151328 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wp77m\" (UniqueName: \"kubernetes.io/projected/ebd2b3db-a6a2-4ad6-bbdc-0aaf6dfe7a6e-kube-api-access-wp77m\") pod \"c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762ah7wst\" (UID: \"ebd2b3db-a6a2-4ad6-bbdc-0aaf6dfe7a6e\") " pod="openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762ah7wst" Jun 11 18:36:30.151715 ip-10-0-130-170 kubenswrapper[2565]: I0611 18:36:30.151692 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/ebd2b3db-a6a2-4ad6-bbdc-0aaf6dfe7a6e-util\") pod \"c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762ah7wst\" (UID: \"ebd2b3db-a6a2-4ad6-bbdc-0aaf6dfe7a6e\") " pod="openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762ah7wst" Jun 11 18:36:30.151781 ip-10-0-130-170 kubenswrapper[2565]: I0611 18:36:30.151735 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/ebd2b3db-a6a2-4ad6-bbdc-0aaf6dfe7a6e-bundle\") pod \"c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762ah7wst\" (UID: \"ebd2b3db-a6a2-4ad6-bbdc-0aaf6dfe7a6e\") " pod="openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762ah7wst" Jun 11 18:36:30.161642 ip-10-0-130-170 kubenswrapper[2565]: I0611 18:36:30.161618 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-wp77m\" (UniqueName: \"kubernetes.io/projected/ebd2b3db-a6a2-4ad6-bbdc-0aaf6dfe7a6e-kube-api-access-wp77m\") pod \"c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762ah7wst\" (UID: \"ebd2b3db-a6a2-4ad6-bbdc-0aaf6dfe7a6e\") " pod="openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762ah7wst" Jun 11 18:36:30.324550 ip-10-0-130-170 kubenswrapper[2565]: I0611 18:36:30.324464 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762ah7wst" Jun 11 18:36:30.475935 ip-10-0-130-170 kubenswrapper[2565]: I0611 18:36:30.475902 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762ah7wst"] Jun 11 18:36:30.479357 ip-10-0-130-170 kubenswrapper[2565]: W0611 18:36:30.479318 2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podebd2b3db_a6a2_4ad6_bbdc_0aaf6dfe7a6e.slice/crio-5f0f2e6b0f00b65129c4d917b03d439d6d39b29e36259fb4544081b08c12a35b WatchSource:0}: Error finding container 5f0f2e6b0f00b65129c4d917b03d439d6d39b29e36259fb4544081b08c12a35b: Status 404 returned error can't find the container with id 5f0f2e6b0f00b65129c4d917b03d439d6d39b29e36259fb4544081b08c12a35b Jun 11 18:36:30.770021 ip-10-0-130-170 kubenswrapper[2565]: I0611 18:36:30.769983 2565 generic.go:356] "Generic (PLEG): container finished" podID="ebd2b3db-a6a2-4ad6-bbdc-0aaf6dfe7a6e" containerID="26810d337de2874e291bc8e9529d73ea33a878270e39e8896a8dcd391ae5e267" exitCode=0 Jun 11 18:36:30.770210 ip-10-0-130-170 kubenswrapper[2565]: I0611 18:36:30.770079 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762ah7wst" event={"ID":"ebd2b3db-a6a2-4ad6-bbdc-0aaf6dfe7a6e","Type":"ContainerDied","Data":"26810d337de2874e291bc8e9529d73ea33a878270e39e8896a8dcd391ae5e267"} Jun 11 18:36:30.770210 ip-10-0-130-170 kubenswrapper[2565]: I0611 18:36:30.770134 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762ah7wst" event={"ID":"ebd2b3db-a6a2-4ad6-bbdc-0aaf6dfe7a6e","Type":"ContainerStarted","Data":"5f0f2e6b0f00b65129c4d917b03d439d6d39b29e36259fb4544081b08c12a35b"} Jun 11 18:36:31.728410 ip-10-0-130-170 kubenswrapper[2565]: E0611 18:36:31.728383 2565 cadvisor_stats_provider.go:567] "Partial failure issuing cadvisor.ContainerInfoV2" err="partial failures: [\"/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podebd2b3db_a6a2_4ad6_bbdc_0aaf6dfe7a6e.slice/crio-conmon-d949392f2d8ce978c88538d7f8be14cd8db217df442195fed78f6ce9f511521b.scope\": RecentStats: unable to find data in memory cache]" Jun 11 18:36:31.778126 ip-10-0-130-170 kubenswrapper[2565]: I0611 18:36:31.778095 2565 generic.go:356] "Generic (PLEG): container finished" podID="ebd2b3db-a6a2-4ad6-bbdc-0aaf6dfe7a6e" containerID="d949392f2d8ce978c88538d7f8be14cd8db217df442195fed78f6ce9f511521b" exitCode=0 Jun 11 18:36:31.778334 ip-10-0-130-170 kubenswrapper[2565]: I0611 18:36:31.778173 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762ah7wst" event={"ID":"ebd2b3db-a6a2-4ad6-bbdc-0aaf6dfe7a6e","Type":"ContainerDied","Data":"d949392f2d8ce978c88538d7f8be14cd8db217df442195fed78f6ce9f511521b"} Jun 11 18:36:32.787629 ip-10-0-130-170 kubenswrapper[2565]: I0611 18:36:32.787596 2565 generic.go:356] "Generic (PLEG): container finished" podID="ebd2b3db-a6a2-4ad6-bbdc-0aaf6dfe7a6e" containerID="81d25c91c299e4ae511c0c94dd49a564368a955a05e3823d7f89bae73bf29b7d" exitCode=0 Jun 11 18:36:32.788022 ip-10-0-130-170 kubenswrapper[2565]: I0611 18:36:32.787680 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762ah7wst" event={"ID":"ebd2b3db-a6a2-4ad6-bbdc-0aaf6dfe7a6e","Type":"ContainerDied","Data":"81d25c91c299e4ae511c0c94dd49a564368a955a05e3823d7f89bae73bf29b7d"} Jun 11 18:36:33.923520 ip-10-0-130-170 kubenswrapper[2565]: I0611 18:36:33.923496 2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762ah7wst" Jun 11 18:36:33.976460 ip-10-0-130-170 kubenswrapper[2565]: I0611 18:36:33.976429 2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/ebd2b3db-a6a2-4ad6-bbdc-0aaf6dfe7a6e-bundle\") pod \"ebd2b3db-a6a2-4ad6-bbdc-0aaf6dfe7a6e\" (UID: \"ebd2b3db-a6a2-4ad6-bbdc-0aaf6dfe7a6e\") " Jun 11 18:36:33.976618 ip-10-0-130-170 kubenswrapper[2565]: I0611 18:36:33.976478 2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-wp77m\" (UniqueName: \"kubernetes.io/projected/ebd2b3db-a6a2-4ad6-bbdc-0aaf6dfe7a6e-kube-api-access-wp77m\") pod \"ebd2b3db-a6a2-4ad6-bbdc-0aaf6dfe7a6e\" (UID: \"ebd2b3db-a6a2-4ad6-bbdc-0aaf6dfe7a6e\") " Jun 11 18:36:33.976618 ip-10-0-130-170 kubenswrapper[2565]: I0611 18:36:33.976548 2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/ebd2b3db-a6a2-4ad6-bbdc-0aaf6dfe7a6e-util\") pod \"ebd2b3db-a6a2-4ad6-bbdc-0aaf6dfe7a6e\" (UID: \"ebd2b3db-a6a2-4ad6-bbdc-0aaf6dfe7a6e\") " Jun 11 18:36:33.977396 ip-10-0-130-170 kubenswrapper[2565]: I0611 18:36:33.977363 2565 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/ebd2b3db-a6a2-4ad6-bbdc-0aaf6dfe7a6e-bundle" (OuterVolumeSpecName: "bundle") pod "ebd2b3db-a6a2-4ad6-bbdc-0aaf6dfe7a6e" (UID: "ebd2b3db-a6a2-4ad6-bbdc-0aaf6dfe7a6e"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 11 18:36:33.978807 ip-10-0-130-170 kubenswrapper[2565]: I0611 18:36:33.978782 2565 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/ebd2b3db-a6a2-4ad6-bbdc-0aaf6dfe7a6e-kube-api-access-wp77m" (OuterVolumeSpecName: "kube-api-access-wp77m") pod "ebd2b3db-a6a2-4ad6-bbdc-0aaf6dfe7a6e" (UID: "ebd2b3db-a6a2-4ad6-bbdc-0aaf6dfe7a6e"). InnerVolumeSpecName "kube-api-access-wp77m". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 11 18:36:33.982342 ip-10-0-130-170 kubenswrapper[2565]: I0611 18:36:33.982308 2565 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/ebd2b3db-a6a2-4ad6-bbdc-0aaf6dfe7a6e-util" (OuterVolumeSpecName: "util") pod "ebd2b3db-a6a2-4ad6-bbdc-0aaf6dfe7a6e" (UID: "ebd2b3db-a6a2-4ad6-bbdc-0aaf6dfe7a6e"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 11 18:36:34.077428 ip-10-0-130-170 kubenswrapper[2565]: I0611 18:36:34.077343 2565 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/ebd2b3db-a6a2-4ad6-bbdc-0aaf6dfe7a6e-bundle\") on node \"ip-10-0-130-170.ec2.internal\" DevicePath \"\"" Jun 11 18:36:34.077428 ip-10-0-130-170 kubenswrapper[2565]: I0611 18:36:34.077372 2565 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-wp77m\" (UniqueName: \"kubernetes.io/projected/ebd2b3db-a6a2-4ad6-bbdc-0aaf6dfe7a6e-kube-api-access-wp77m\") on node \"ip-10-0-130-170.ec2.internal\" DevicePath \"\"" Jun 11 18:36:34.077428 ip-10-0-130-170 kubenswrapper[2565]: I0611 18:36:34.077382 2565 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/ebd2b3db-a6a2-4ad6-bbdc-0aaf6dfe7a6e-util\") on node \"ip-10-0-130-170.ec2.internal\" DevicePath \"\"" Jun 11 18:36:34.800860 ip-10-0-130-170 kubenswrapper[2565]: I0611 18:36:34.800820 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762ah7wst" event={"ID":"ebd2b3db-a6a2-4ad6-bbdc-0aaf6dfe7a6e","Type":"ContainerDied","Data":"5f0f2e6b0f00b65129c4d917b03d439d6d39b29e36259fb4544081b08c12a35b"} Jun 11 18:36:34.800860 ip-10-0-130-170 kubenswrapper[2565]: I0611 18:36:34.800843 2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762ah7wst" Jun 11 18:36:34.800860 ip-10-0-130-170 kubenswrapper[2565]: I0611 18:36:34.800865 2565 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="5f0f2e6b0f00b65129c4d917b03d439d6d39b29e36259fb4544081b08c12a35b" Jun 11 18:37:26.180057 ip-10-0-130-170 kubenswrapper[2565]: I0611 18:37:26.180018 2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0z9z8z"] Jun 11 18:37:26.180618 ip-10-0-130-170 kubenswrapper[2565]: I0611 18:37:26.180402 2565 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="ebd2b3db-a6a2-4ad6-bbdc-0aaf6dfe7a6e" containerName="util" Jun 11 18:37:26.180618 ip-10-0-130-170 kubenswrapper[2565]: I0611 18:37:26.180420 2565 state_mem.go:107] "Deleted CPUSet assignment" podUID="ebd2b3db-a6a2-4ad6-bbdc-0aaf6dfe7a6e" containerName="util" Jun 11 18:37:26.180618 ip-10-0-130-170 kubenswrapper[2565]: I0611 18:37:26.180435 2565 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="ebd2b3db-a6a2-4ad6-bbdc-0aaf6dfe7a6e" containerName="pull" Jun 11 18:37:26.180618 ip-10-0-130-170 kubenswrapper[2565]: I0611 18:37:26.180442 2565 state_mem.go:107] "Deleted CPUSet assignment" podUID="ebd2b3db-a6a2-4ad6-bbdc-0aaf6dfe7a6e" containerName="pull" Jun 11 18:37:26.180618 ip-10-0-130-170 kubenswrapper[2565]: I0611 18:37:26.180452 2565 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="ebd2b3db-a6a2-4ad6-bbdc-0aaf6dfe7a6e" containerName="extract" Jun 11 18:37:26.180618 ip-10-0-130-170 kubenswrapper[2565]: I0611 18:37:26.180458 2565 state_mem.go:107] "Deleted CPUSet assignment" podUID="ebd2b3db-a6a2-4ad6-bbdc-0aaf6dfe7a6e" containerName="extract" Jun 11 18:37:26.180618 ip-10-0-130-170 kubenswrapper[2565]: I0611 18:37:26.180526 2565 memory_manager.go:368] "RemoveStaleState removing state" podUID="ebd2b3db-a6a2-4ad6-bbdc-0aaf6dfe7a6e" containerName="extract" Jun 11 18:37:26.183192 ip-10-0-130-170 kubenswrapper[2565]: I0611 18:37:26.183164 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0z9z8z" Jun 11 18:37:26.185777 ip-10-0-130-170 kubenswrapper[2565]: I0611 18:37:26.185758 2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"kube-root-ca.crt\"" Jun 11 18:37:26.185869 ip-10-0-130-170 kubenswrapper[2565]: I0611 18:37:26.185760 2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"openshift-service-ca.crt\"" Jun 11 18:37:26.186911 ip-10-0-130-170 kubenswrapper[2565]: I0611 18:37:26.186894 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"default-dockercfg-wmbv9\"" Jun 11 18:37:26.192587 ip-10-0-130-170 kubenswrapper[2565]: I0611 18:37:26.192565 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0z9z8z"] Jun 11 18:37:26.232851 ip-10-0-130-170 kubenswrapper[2565]: I0611 18:37:26.232818 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/334df8f5-d1e1-43fb-9919-e28c647d6327-bundle\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0z9z8z\" (UID: \"334df8f5-d1e1-43fb-9919-e28c647d6327\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0z9z8z" Jun 11 18:37:26.232851 ip-10-0-130-170 kubenswrapper[2565]: I0611 18:37:26.232853 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/334df8f5-d1e1-43fb-9919-e28c647d6327-util\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0z9z8z\" (UID: \"334df8f5-d1e1-43fb-9919-e28c647d6327\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0z9z8z" Jun 11 18:37:26.233098 ip-10-0-130-170 kubenswrapper[2565]: I0611 18:37:26.232982 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-c722n\" (UniqueName: \"kubernetes.io/projected/334df8f5-d1e1-43fb-9919-e28c647d6327-kube-api-access-c722n\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0z9z8z\" (UID: \"334df8f5-d1e1-43fb-9919-e28c647d6327\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0z9z8z" Jun 11 18:37:26.334227 ip-10-0-130-170 kubenswrapper[2565]: I0611 18:37:26.334189 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-c722n\" (UniqueName: \"kubernetes.io/projected/334df8f5-d1e1-43fb-9919-e28c647d6327-kube-api-access-c722n\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0z9z8z\" (UID: \"334df8f5-d1e1-43fb-9919-e28c647d6327\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0z9z8z" Jun 11 18:37:26.334422 ip-10-0-130-170 kubenswrapper[2565]: I0611 18:37:26.334241 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/334df8f5-d1e1-43fb-9919-e28c647d6327-bundle\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0z9z8z\" (UID: \"334df8f5-d1e1-43fb-9919-e28c647d6327\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0z9z8z" Jun 11 18:37:26.334422 ip-10-0-130-170 kubenswrapper[2565]: I0611 18:37:26.334290 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/334df8f5-d1e1-43fb-9919-e28c647d6327-util\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0z9z8z\" (UID: \"334df8f5-d1e1-43fb-9919-e28c647d6327\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0z9z8z" Jun 11 18:37:26.334730 ip-10-0-130-170 kubenswrapper[2565]: I0611 18:37:26.334707 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/334df8f5-d1e1-43fb-9919-e28c647d6327-bundle\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0z9z8z\" (UID: \"334df8f5-d1e1-43fb-9919-e28c647d6327\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0z9z8z" Jun 11 18:37:26.334771 ip-10-0-130-170 kubenswrapper[2565]: I0611 18:37:26.334722 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/334df8f5-d1e1-43fb-9919-e28c647d6327-util\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0z9z8z\" (UID: \"334df8f5-d1e1-43fb-9919-e28c647d6327\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0z9z8z" Jun 11 18:37:26.343094 ip-10-0-130-170 kubenswrapper[2565]: I0611 18:37:26.343071 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-c722n\" (UniqueName: \"kubernetes.io/projected/334df8f5-d1e1-43fb-9919-e28c647d6327-kube-api-access-c722n\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0z9z8z\" (UID: \"334df8f5-d1e1-43fb-9919-e28c647d6327\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0z9z8z" Jun 11 18:37:26.493147 ip-10-0-130-170 kubenswrapper[2565]: I0611 18:37:26.493047 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0z9z8z" Jun 11 18:37:26.631088 ip-10-0-130-170 kubenswrapper[2565]: I0611 18:37:26.631063 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0z9z8z"] Jun 11 18:37:26.634100 ip-10-0-130-170 kubenswrapper[2565]: W0611 18:37:26.634069 2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod334df8f5_d1e1_43fb_9919_e28c647d6327.slice/crio-07178f380aa10d0ca72d77e1dfa76794e50bf048e81255ac87cc87796d1ccbfe WatchSource:0}: Error finding container 07178f380aa10d0ca72d77e1dfa76794e50bf048e81255ac87cc87796d1ccbfe: Status 404 returned error can't find the container with id 07178f380aa10d0ca72d77e1dfa76794e50bf048e81255ac87cc87796d1ccbfe Jun 11 18:37:26.975635 ip-10-0-130-170 kubenswrapper[2565]: I0611 18:37:26.975598 2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7592jfrw"] Jun 11 18:37:26.978802 ip-10-0-130-170 kubenswrapper[2565]: I0611 18:37:26.978785 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7592jfrw" Jun 11 18:37:26.987447 ip-10-0-130-170 kubenswrapper[2565]: I0611 18:37:26.987421 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7592jfrw"] Jun 11 18:37:27.039315 ip-10-0-130-170 kubenswrapper[2565]: I0611 18:37:27.039228 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/c1fb0eff-7b15-4d34-a1bc-79dd5d06e02d-util\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7592jfrw\" (UID: \"c1fb0eff-7b15-4d34-a1bc-79dd5d06e02d\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7592jfrw" Jun 11 18:37:27.039456 ip-10-0-130-170 kubenswrapper[2565]: I0611 18:37:27.039349 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/c1fb0eff-7b15-4d34-a1bc-79dd5d06e02d-bundle\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7592jfrw\" (UID: \"c1fb0eff-7b15-4d34-a1bc-79dd5d06e02d\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7592jfrw" Jun 11 18:37:27.039456 ip-10-0-130-170 kubenswrapper[2565]: I0611 18:37:27.039410 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vrm2w\" (UniqueName: \"kubernetes.io/projected/c1fb0eff-7b15-4d34-a1bc-79dd5d06e02d-kube-api-access-vrm2w\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7592jfrw\" (UID: \"c1fb0eff-7b15-4d34-a1bc-79dd5d06e02d\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7592jfrw" Jun 11 18:37:27.064523 ip-10-0-130-170 kubenswrapper[2565]: I0611 18:37:27.064491 2565 generic.go:356] "Generic (PLEG): container finished" podID="334df8f5-d1e1-43fb-9919-e28c647d6327" containerID="65c54b17695925bb0042a13f2724ba202b7ca329e68909958ea6fd8356921c8a" exitCode=0 Jun 11 18:37:27.064688 ip-10-0-130-170 kubenswrapper[2565]: I0611 18:37:27.064540 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0z9z8z" event={"ID":"334df8f5-d1e1-43fb-9919-e28c647d6327","Type":"ContainerDied","Data":"65c54b17695925bb0042a13f2724ba202b7ca329e68909958ea6fd8356921c8a"} Jun 11 18:37:27.064688 ip-10-0-130-170 kubenswrapper[2565]: I0611 18:37:27.064607 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0z9z8z" event={"ID":"334df8f5-d1e1-43fb-9919-e28c647d6327","Type":"ContainerStarted","Data":"07178f380aa10d0ca72d77e1dfa76794e50bf048e81255ac87cc87796d1ccbfe"} Jun 11 18:37:27.140425 ip-10-0-130-170 kubenswrapper[2565]: I0611 18:37:27.140387 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/c1fb0eff-7b15-4d34-a1bc-79dd5d06e02d-bundle\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7592jfrw\" (UID: \"c1fb0eff-7b15-4d34-a1bc-79dd5d06e02d\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7592jfrw" Jun 11 18:37:27.140605 ip-10-0-130-170 kubenswrapper[2565]: I0611 18:37:27.140439 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vrm2w\" (UniqueName: \"kubernetes.io/projected/c1fb0eff-7b15-4d34-a1bc-79dd5d06e02d-kube-api-access-vrm2w\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7592jfrw\" (UID: \"c1fb0eff-7b15-4d34-a1bc-79dd5d06e02d\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7592jfrw" Jun 11 18:37:27.140605 ip-10-0-130-170 kubenswrapper[2565]: I0611 18:37:27.140476 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/c1fb0eff-7b15-4d34-a1bc-79dd5d06e02d-util\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7592jfrw\" (UID: \"c1fb0eff-7b15-4d34-a1bc-79dd5d06e02d\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7592jfrw" Jun 11 18:37:27.140760 ip-10-0-130-170 kubenswrapper[2565]: I0611 18:37:27.140737 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/c1fb0eff-7b15-4d34-a1bc-79dd5d06e02d-bundle\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7592jfrw\" (UID: \"c1fb0eff-7b15-4d34-a1bc-79dd5d06e02d\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7592jfrw" Jun 11 18:37:27.140864 ip-10-0-130-170 kubenswrapper[2565]: I0611 18:37:27.140843 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/c1fb0eff-7b15-4d34-a1bc-79dd5d06e02d-util\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7592jfrw\" (UID: \"c1fb0eff-7b15-4d34-a1bc-79dd5d06e02d\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7592jfrw" Jun 11 18:37:27.148512 ip-10-0-130-170 kubenswrapper[2565]: I0611 18:37:27.148488 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-vrm2w\" (UniqueName: \"kubernetes.io/projected/c1fb0eff-7b15-4d34-a1bc-79dd5d06e02d-kube-api-access-vrm2w\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7592jfrw\" (UID: \"c1fb0eff-7b15-4d34-a1bc-79dd5d06e02d\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7592jfrw" Jun 11 18:37:27.289161 ip-10-0-130-170 kubenswrapper[2565]: I0611 18:37:27.289126 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7592jfrw" Jun 11 18:37:27.422770 ip-10-0-130-170 kubenswrapper[2565]: I0611 18:37:27.422743 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7592jfrw"] Jun 11 18:37:27.424803 ip-10-0-130-170 kubenswrapper[2565]: W0611 18:37:27.424782 2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc1fb0eff_7b15_4d34_a1bc_79dd5d06e02d.slice/crio-ed10c194739bffccc0f9bab5893ff43ff32bca3f5a23da92519e4089e5d4888b WatchSource:0}: Error finding container ed10c194739bffccc0f9bab5893ff43ff32bca3f5a23da92519e4089e5d4888b: Status 404 returned error can't find the container with id ed10c194739bffccc0f9bab5893ff43ff32bca3f5a23da92519e4089e5d4888b Jun 11 18:37:27.771204 ip-10-0-130-170 kubenswrapper[2565]: I0611 18:37:27.771179 2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73kvjgf"] Jun 11 18:37:27.776162 ip-10-0-130-170 kubenswrapper[2565]: I0611 18:37:27.776144 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73kvjgf" Jun 11 18:37:27.781165 ip-10-0-130-170 kubenswrapper[2565]: I0611 18:37:27.781143 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73kvjgf"] Jun 11 18:37:27.847379 ip-10-0-130-170 kubenswrapper[2565]: I0611 18:37:27.847342 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/cf3a06b1-22a2-43c8-a104-75ae129d04e1-util\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73kvjgf\" (UID: \"cf3a06b1-22a2-43c8-a104-75ae129d04e1\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73kvjgf" Jun 11 18:37:27.847530 ip-10-0-130-170 kubenswrapper[2565]: I0611 18:37:27.847412 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-lkszv\" (UniqueName: \"kubernetes.io/projected/cf3a06b1-22a2-43c8-a104-75ae129d04e1-kube-api-access-lkszv\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73kvjgf\" (UID: \"cf3a06b1-22a2-43c8-a104-75ae129d04e1\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73kvjgf" Jun 11 18:37:27.847530 ip-10-0-130-170 kubenswrapper[2565]: I0611 18:37:27.847467 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/cf3a06b1-22a2-43c8-a104-75ae129d04e1-bundle\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73kvjgf\" (UID: \"cf3a06b1-22a2-43c8-a104-75ae129d04e1\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73kvjgf" Jun 11 18:37:27.948729 ip-10-0-130-170 kubenswrapper[2565]: I0611 18:37:27.948695 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/cf3a06b1-22a2-43c8-a104-75ae129d04e1-bundle\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73kvjgf\" (UID: \"cf3a06b1-22a2-43c8-a104-75ae129d04e1\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73kvjgf" Jun 11 18:37:27.948913 ip-10-0-130-170 kubenswrapper[2565]: I0611 18:37:27.948773 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/cf3a06b1-22a2-43c8-a104-75ae129d04e1-util\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73kvjgf\" (UID: \"cf3a06b1-22a2-43c8-a104-75ae129d04e1\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73kvjgf" Jun 11 18:37:27.948913 ip-10-0-130-170 kubenswrapper[2565]: I0611 18:37:27.948794 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-lkszv\" (UniqueName: \"kubernetes.io/projected/cf3a06b1-22a2-43c8-a104-75ae129d04e1-kube-api-access-lkszv\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73kvjgf\" (UID: \"cf3a06b1-22a2-43c8-a104-75ae129d04e1\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73kvjgf" Jun 11 18:37:27.949175 ip-10-0-130-170 kubenswrapper[2565]: I0611 18:37:27.949151 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/cf3a06b1-22a2-43c8-a104-75ae129d04e1-bundle\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73kvjgf\" (UID: \"cf3a06b1-22a2-43c8-a104-75ae129d04e1\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73kvjgf" Jun 11 18:37:27.949214 ip-10-0-130-170 kubenswrapper[2565]: I0611 18:37:27.949160 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/cf3a06b1-22a2-43c8-a104-75ae129d04e1-util\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73kvjgf\" (UID: \"cf3a06b1-22a2-43c8-a104-75ae129d04e1\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73kvjgf" Jun 11 18:37:27.957111 ip-10-0-130-170 kubenswrapper[2565]: I0611 18:37:27.957078 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-lkszv\" (UniqueName: \"kubernetes.io/projected/cf3a06b1-22a2-43c8-a104-75ae129d04e1-kube-api-access-lkszv\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73kvjgf\" (UID: \"cf3a06b1-22a2-43c8-a104-75ae129d04e1\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73kvjgf" Jun 11 18:37:28.072617 ip-10-0-130-170 kubenswrapper[2565]: I0611 18:37:28.072520 2565 generic.go:356] "Generic (PLEG): container finished" podID="334df8f5-d1e1-43fb-9919-e28c647d6327" containerID="4d1eeefe3cade86edd922e152fe3485d0b1bf1d72b7e3fc4d5d9df0317bac560" exitCode=0 Jun 11 18:37:28.072776 ip-10-0-130-170 kubenswrapper[2565]: I0611 18:37:28.072610 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0z9z8z" event={"ID":"334df8f5-d1e1-43fb-9919-e28c647d6327","Type":"ContainerDied","Data":"4d1eeefe3cade86edd922e152fe3485d0b1bf1d72b7e3fc4d5d9df0317bac560"} Jun 11 18:37:28.074213 ip-10-0-130-170 kubenswrapper[2565]: I0611 18:37:28.074194 2565 generic.go:356] "Generic (PLEG): container finished" podID="c1fb0eff-7b15-4d34-a1bc-79dd5d06e02d" containerID="d035afb51146d0feeaa6093628ff0439c4a06da9d5a8c4781584b65a142c35b6" exitCode=0 Jun 11 18:37:28.074386 ip-10-0-130-170 kubenswrapper[2565]: I0611 18:37:28.074249 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7592jfrw" event={"ID":"c1fb0eff-7b15-4d34-a1bc-79dd5d06e02d","Type":"ContainerDied","Data":"d035afb51146d0feeaa6093628ff0439c4a06da9d5a8c4781584b65a142c35b6"} Jun 11 18:37:28.074386 ip-10-0-130-170 kubenswrapper[2565]: I0611 18:37:28.074312 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7592jfrw" event={"ID":"c1fb0eff-7b15-4d34-a1bc-79dd5d06e02d","Type":"ContainerStarted","Data":"ed10c194739bffccc0f9bab5893ff43ff32bca3f5a23da92519e4089e5d4888b"} Jun 11 18:37:28.096018 ip-10-0-130-170 kubenswrapper[2565]: I0611 18:37:28.095992 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73kvjgf" Jun 11 18:37:28.236129 ip-10-0-130-170 kubenswrapper[2565]: I0611 18:37:28.236106 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73kvjgf"] Jun 11 18:37:28.264109 ip-10-0-130-170 kubenswrapper[2565]: W0611 18:37:28.264078 2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podcf3a06b1_22a2_43c8_a104_75ae129d04e1.slice/crio-20109276110e9109d5ee4ca851e46703d7a025801d5e01977b238b964cb36df8 WatchSource:0}: Error finding container 20109276110e9109d5ee4ca851e46703d7a025801d5e01977b238b964cb36df8: Status 404 returned error can't find the container with id 20109276110e9109d5ee4ca851e46703d7a025801d5e01977b238b964cb36df8 Jun 11 18:37:28.375224 ip-10-0-130-170 kubenswrapper[2565]: I0611 18:37:28.375196 2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef187nj6"] Jun 11 18:37:28.378688 ip-10-0-130-170 kubenswrapper[2565]: I0611 18:37:28.378668 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef187nj6" Jun 11 18:37:28.388847 ip-10-0-130-170 kubenswrapper[2565]: I0611 18:37:28.388822 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef187nj6"] Jun 11 18:37:28.453548 ip-10-0-130-170 kubenswrapper[2565]: I0611 18:37:28.453518 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/10ee4034-8bda-47ea-ba8d-d79f6d8b66e9-util\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef187nj6\" (UID: \"10ee4034-8bda-47ea-ba8d-d79f6d8b66e9\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef187nj6" Jun 11 18:37:28.453705 ip-10-0-130-170 kubenswrapper[2565]: I0611 18:37:28.453590 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/10ee4034-8bda-47ea-ba8d-d79f6d8b66e9-bundle\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef187nj6\" (UID: \"10ee4034-8bda-47ea-ba8d-d79f6d8b66e9\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef187nj6" Jun 11 18:37:28.453705 ip-10-0-130-170 kubenswrapper[2565]: I0611 18:37:28.453630 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-75ghb\" (UniqueName: \"kubernetes.io/projected/10ee4034-8bda-47ea-ba8d-d79f6d8b66e9-kube-api-access-75ghb\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef187nj6\" (UID: \"10ee4034-8bda-47ea-ba8d-d79f6d8b66e9\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef187nj6" Jun 11 18:37:28.554359 ip-10-0-130-170 kubenswrapper[2565]: I0611 18:37:28.554311 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-75ghb\" (UniqueName: \"kubernetes.io/projected/10ee4034-8bda-47ea-ba8d-d79f6d8b66e9-kube-api-access-75ghb\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef187nj6\" (UID: \"10ee4034-8bda-47ea-ba8d-d79f6d8b66e9\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef187nj6" Jun 11 18:37:28.554546 ip-10-0-130-170 kubenswrapper[2565]: I0611 18:37:28.554386 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/10ee4034-8bda-47ea-ba8d-d79f6d8b66e9-util\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef187nj6\" (UID: \"10ee4034-8bda-47ea-ba8d-d79f6d8b66e9\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef187nj6" Jun 11 18:37:28.554546 ip-10-0-130-170 kubenswrapper[2565]: I0611 18:37:28.554488 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/10ee4034-8bda-47ea-ba8d-d79f6d8b66e9-bundle\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef187nj6\" (UID: \"10ee4034-8bda-47ea-ba8d-d79f6d8b66e9\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef187nj6" Jun 11 18:37:28.554754 ip-10-0-130-170 kubenswrapper[2565]: I0611 18:37:28.554736 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/10ee4034-8bda-47ea-ba8d-d79f6d8b66e9-util\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef187nj6\" (UID: \"10ee4034-8bda-47ea-ba8d-d79f6d8b66e9\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef187nj6" Jun 11 18:37:28.554802 ip-10-0-130-170 kubenswrapper[2565]: I0611 18:37:28.554786 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/10ee4034-8bda-47ea-ba8d-d79f6d8b66e9-bundle\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef187nj6\" (UID: \"10ee4034-8bda-47ea-ba8d-d79f6d8b66e9\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef187nj6" Jun 11 18:37:28.564621 ip-10-0-130-170 kubenswrapper[2565]: I0611 18:37:28.564591 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-75ghb\" (UniqueName: \"kubernetes.io/projected/10ee4034-8bda-47ea-ba8d-d79f6d8b66e9-kube-api-access-75ghb\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef187nj6\" (UID: \"10ee4034-8bda-47ea-ba8d-d79f6d8b66e9\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef187nj6" Jun 11 18:37:28.724436 ip-10-0-130-170 kubenswrapper[2565]: I0611 18:37:28.724390 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef187nj6" Jun 11 18:37:28.863963 ip-10-0-130-170 kubenswrapper[2565]: I0611 18:37:28.863939 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef187nj6"] Jun 11 18:37:28.900243 ip-10-0-130-170 kubenswrapper[2565]: W0611 18:37:28.900199 2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod10ee4034_8bda_47ea_ba8d_d79f6d8b66e9.slice/crio-70a83acb01a5a25ff1b52c3f988f961342fbf1f1653e67f8f681ce8ad0fed3b4 WatchSource:0}: Error finding container 70a83acb01a5a25ff1b52c3f988f961342fbf1f1653e67f8f681ce8ad0fed3b4: Status 404 returned error can't find the container with id 70a83acb01a5a25ff1b52c3f988f961342fbf1f1653e67f8f681ce8ad0fed3b4 Jun 11 18:37:29.083490 ip-10-0-130-170 kubenswrapper[2565]: I0611 18:37:29.083455 2565 generic.go:356] "Generic (PLEG): container finished" podID="334df8f5-d1e1-43fb-9919-e28c647d6327" containerID="94c4fdf2b401970c187d35c376d2d2b1f385916359ec1faf44c1873fbdc3bdcd" exitCode=0 Jun 11 18:37:29.083607 ip-10-0-130-170 kubenswrapper[2565]: I0611 18:37:29.083527 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0z9z8z" event={"ID":"334df8f5-d1e1-43fb-9919-e28c647d6327","Type":"ContainerDied","Data":"94c4fdf2b401970c187d35c376d2d2b1f385916359ec1faf44c1873fbdc3bdcd"} Jun 11 18:37:29.085168 ip-10-0-130-170 kubenswrapper[2565]: I0611 18:37:29.085146 2565 generic.go:356] "Generic (PLEG): container finished" podID="cf3a06b1-22a2-43c8-a104-75ae129d04e1" containerID="20775fea3159aefc5dc8c291e4d42130f54d5b2b03374f5f0f2f05123152a4df" exitCode=0 Jun 11 18:37:29.085295 ip-10-0-130-170 kubenswrapper[2565]: I0611 18:37:29.085223 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73kvjgf" event={"ID":"cf3a06b1-22a2-43c8-a104-75ae129d04e1","Type":"ContainerDied","Data":"20775fea3159aefc5dc8c291e4d42130f54d5b2b03374f5f0f2f05123152a4df"} Jun 11 18:37:29.085352 ip-10-0-130-170 kubenswrapper[2565]: I0611 18:37:29.085309 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73kvjgf" event={"ID":"cf3a06b1-22a2-43c8-a104-75ae129d04e1","Type":"ContainerStarted","Data":"20109276110e9109d5ee4ca851e46703d7a025801d5e01977b238b964cb36df8"} Jun 11 18:37:29.086809 ip-10-0-130-170 kubenswrapper[2565]: I0611 18:37:29.086788 2565 generic.go:356] "Generic (PLEG): container finished" podID="10ee4034-8bda-47ea-ba8d-d79f6d8b66e9" containerID="f81d6b29b903b4014bba86f26e4b8c2cd21929658e264359af5829acbdcbab29" exitCode=0 Jun 11 18:37:29.086907 ip-10-0-130-170 kubenswrapper[2565]: I0611 18:37:29.086818 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef187nj6" event={"ID":"10ee4034-8bda-47ea-ba8d-d79f6d8b66e9","Type":"ContainerDied","Data":"f81d6b29b903b4014bba86f26e4b8c2cd21929658e264359af5829acbdcbab29"} Jun 11 18:37:29.086907 ip-10-0-130-170 kubenswrapper[2565]: I0611 18:37:29.086858 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef187nj6" event={"ID":"10ee4034-8bda-47ea-ba8d-d79f6d8b66e9","Type":"ContainerStarted","Data":"70a83acb01a5a25ff1b52c3f988f961342fbf1f1653e67f8f681ce8ad0fed3b4"} Jun 11 18:37:29.089433 ip-10-0-130-170 kubenswrapper[2565]: I0611 18:37:29.089414 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7592jfrw" event={"ID":"c1fb0eff-7b15-4d34-a1bc-79dd5d06e02d","Type":"ContainerStarted","Data":"d9314b60d61a60d2729400b7bda876ebde06c05fb86272b6a36b065a1c72a595"} Jun 11 18:37:30.096856 ip-10-0-130-170 kubenswrapper[2565]: I0611 18:37:30.096824 2565 generic.go:356] "Generic (PLEG): container finished" podID="cf3a06b1-22a2-43c8-a104-75ae129d04e1" containerID="80de916fbe72365318dc43d2a0093a04b5de7a99b7ddfc5e0e4e4865f2e9d6b6" exitCode=0 Jun 11 18:37:30.097315 ip-10-0-130-170 kubenswrapper[2565]: I0611 18:37:30.096921 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73kvjgf" event={"ID":"cf3a06b1-22a2-43c8-a104-75ae129d04e1","Type":"ContainerDied","Data":"80de916fbe72365318dc43d2a0093a04b5de7a99b7ddfc5e0e4e4865f2e9d6b6"} Jun 11 18:37:30.098946 ip-10-0-130-170 kubenswrapper[2565]: I0611 18:37:30.098920 2565 generic.go:356] "Generic (PLEG): container finished" podID="10ee4034-8bda-47ea-ba8d-d79f6d8b66e9" containerID="0a21c9c70b66c686af39d37e23d2c419cbe9cd98cb45f56940b5c5a526c7e858" exitCode=0 Jun 11 18:37:30.099020 ip-10-0-130-170 kubenswrapper[2565]: I0611 18:37:30.098996 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef187nj6" event={"ID":"10ee4034-8bda-47ea-ba8d-d79f6d8b66e9","Type":"ContainerDied","Data":"0a21c9c70b66c686af39d37e23d2c419cbe9cd98cb45f56940b5c5a526c7e858"} Jun 11 18:37:30.101540 ip-10-0-130-170 kubenswrapper[2565]: I0611 18:37:30.101521 2565 generic.go:356] "Generic (PLEG): container finished" podID="c1fb0eff-7b15-4d34-a1bc-79dd5d06e02d" containerID="d9314b60d61a60d2729400b7bda876ebde06c05fb86272b6a36b065a1c72a595" exitCode=0 Jun 11 18:37:30.101540 ip-10-0-130-170 kubenswrapper[2565]: I0611 18:37:30.101540 2565 generic.go:356] "Generic (PLEG): container finished" podID="c1fb0eff-7b15-4d34-a1bc-79dd5d06e02d" containerID="b784a32c79624dc16ae5721055a103fffac9042f4563727f91f5b6d711b1f426" exitCode=0 Jun 11 18:37:30.101662 ip-10-0-130-170 kubenswrapper[2565]: I0611 18:37:30.101597 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7592jfrw" event={"ID":"c1fb0eff-7b15-4d34-a1bc-79dd5d06e02d","Type":"ContainerDied","Data":"d9314b60d61a60d2729400b7bda876ebde06c05fb86272b6a36b065a1c72a595"} Jun 11 18:37:30.101662 ip-10-0-130-170 kubenswrapper[2565]: I0611 18:37:30.101635 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7592jfrw" event={"ID":"c1fb0eff-7b15-4d34-a1bc-79dd5d06e02d","Type":"ContainerDied","Data":"b784a32c79624dc16ae5721055a103fffac9042f4563727f91f5b6d711b1f426"} Jun 11 18:37:30.240652 ip-10-0-130-170 kubenswrapper[2565]: I0611 18:37:30.240624 2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0z9z8z" Jun 11 18:37:30.269222 ip-10-0-130-170 kubenswrapper[2565]: I0611 18:37:30.269194 2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/334df8f5-d1e1-43fb-9919-e28c647d6327-bundle\") pod \"334df8f5-d1e1-43fb-9919-e28c647d6327\" (UID: \"334df8f5-d1e1-43fb-9919-e28c647d6327\") " Jun 11 18:37:30.269402 ip-10-0-130-170 kubenswrapper[2565]: I0611 18:37:30.269240 2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-c722n\" (UniqueName: \"kubernetes.io/projected/334df8f5-d1e1-43fb-9919-e28c647d6327-kube-api-access-c722n\") pod \"334df8f5-d1e1-43fb-9919-e28c647d6327\" (UID: \"334df8f5-d1e1-43fb-9919-e28c647d6327\") " Jun 11 18:37:30.269402 ip-10-0-130-170 kubenswrapper[2565]: I0611 18:37:30.269327 2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/334df8f5-d1e1-43fb-9919-e28c647d6327-util\") pod \"334df8f5-d1e1-43fb-9919-e28c647d6327\" (UID: \"334df8f5-d1e1-43fb-9919-e28c647d6327\") " Jun 11 18:37:30.269781 ip-10-0-130-170 kubenswrapper[2565]: I0611 18:37:30.269753 2565 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/334df8f5-d1e1-43fb-9919-e28c647d6327-bundle" (OuterVolumeSpecName: "bundle") pod "334df8f5-d1e1-43fb-9919-e28c647d6327" (UID: "334df8f5-d1e1-43fb-9919-e28c647d6327"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 11 18:37:30.271526 ip-10-0-130-170 kubenswrapper[2565]: I0611 18:37:30.271505 2565 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/334df8f5-d1e1-43fb-9919-e28c647d6327-kube-api-access-c722n" (OuterVolumeSpecName: "kube-api-access-c722n") pod "334df8f5-d1e1-43fb-9919-e28c647d6327" (UID: "334df8f5-d1e1-43fb-9919-e28c647d6327"). InnerVolumeSpecName "kube-api-access-c722n". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 11 18:37:30.277763 ip-10-0-130-170 kubenswrapper[2565]: I0611 18:37:30.277723 2565 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/334df8f5-d1e1-43fb-9919-e28c647d6327-util" (OuterVolumeSpecName: "util") pod "334df8f5-d1e1-43fb-9919-e28c647d6327" (UID: "334df8f5-d1e1-43fb-9919-e28c647d6327"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 11 18:37:30.370819 ip-10-0-130-170 kubenswrapper[2565]: I0611 18:37:30.370783 2565 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/334df8f5-d1e1-43fb-9919-e28c647d6327-bundle\") on node \"ip-10-0-130-170.ec2.internal\" DevicePath \"\"" Jun 11 18:37:30.370819 ip-10-0-130-170 kubenswrapper[2565]: I0611 18:37:30.370813 2565 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-c722n\" (UniqueName: \"kubernetes.io/projected/334df8f5-d1e1-43fb-9919-e28c647d6327-kube-api-access-c722n\") on node \"ip-10-0-130-170.ec2.internal\" DevicePath \"\"" Jun 11 18:37:30.370819 ip-10-0-130-170 kubenswrapper[2565]: I0611 18:37:30.370822 2565 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/334df8f5-d1e1-43fb-9919-e28c647d6327-util\") on node \"ip-10-0-130-170.ec2.internal\" DevicePath \"\"" Jun 11 18:37:31.109787 ip-10-0-130-170 kubenswrapper[2565]: I0611 18:37:31.109755 2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0z9z8z" Jun 11 18:37:31.110206 ip-10-0-130-170 kubenswrapper[2565]: I0611 18:37:31.109753 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0z9z8z" event={"ID":"334df8f5-d1e1-43fb-9919-e28c647d6327","Type":"ContainerDied","Data":"07178f380aa10d0ca72d77e1dfa76794e50bf048e81255ac87cc87796d1ccbfe"} Jun 11 18:37:31.110206 ip-10-0-130-170 kubenswrapper[2565]: I0611 18:37:31.109895 2565 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="07178f380aa10d0ca72d77e1dfa76794e50bf048e81255ac87cc87796d1ccbfe" Jun 11 18:37:31.112047 ip-10-0-130-170 kubenswrapper[2565]: I0611 18:37:31.112022 2565 generic.go:356] "Generic (PLEG): container finished" podID="cf3a06b1-22a2-43c8-a104-75ae129d04e1" containerID="dfbd43ffcbf119b498155c6b3e61bbb6ad50e3109fc13e34d7de564df5f773df" exitCode=0 Jun 11 18:37:31.112180 ip-10-0-130-170 kubenswrapper[2565]: I0611 18:37:31.112107 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73kvjgf" event={"ID":"cf3a06b1-22a2-43c8-a104-75ae129d04e1","Type":"ContainerDied","Data":"dfbd43ffcbf119b498155c6b3e61bbb6ad50e3109fc13e34d7de564df5f773df"} Jun 11 18:37:31.114203 ip-10-0-130-170 kubenswrapper[2565]: I0611 18:37:31.114181 2565 generic.go:356] "Generic (PLEG): container finished" podID="10ee4034-8bda-47ea-ba8d-d79f6d8b66e9" containerID="2d231ec1dc7e30fb69feee8326ddf6de702d0b6beab78df7f26c0aa02917bc92" exitCode=0 Jun 11 18:37:31.114314 ip-10-0-130-170 kubenswrapper[2565]: I0611 18:37:31.114272 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef187nj6" event={"ID":"10ee4034-8bda-47ea-ba8d-d79f6d8b66e9","Type":"ContainerDied","Data":"2d231ec1dc7e30fb69feee8326ddf6de702d0b6beab78df7f26c0aa02917bc92"} Jun 11 18:37:31.248326 ip-10-0-130-170 kubenswrapper[2565]: I0611 18:37:31.248300 2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7592jfrw" Jun 11 18:37:31.279129 ip-10-0-130-170 kubenswrapper[2565]: I0611 18:37:31.279103 2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/c1fb0eff-7b15-4d34-a1bc-79dd5d06e02d-util\") pod \"c1fb0eff-7b15-4d34-a1bc-79dd5d06e02d\" (UID: \"c1fb0eff-7b15-4d34-a1bc-79dd5d06e02d\") " Jun 11 18:37:31.279300 ip-10-0-130-170 kubenswrapper[2565]: I0611 18:37:31.279149 2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-vrm2w\" (UniqueName: \"kubernetes.io/projected/c1fb0eff-7b15-4d34-a1bc-79dd5d06e02d-kube-api-access-vrm2w\") pod \"c1fb0eff-7b15-4d34-a1bc-79dd5d06e02d\" (UID: \"c1fb0eff-7b15-4d34-a1bc-79dd5d06e02d\") " Jun 11 18:37:31.279300 ip-10-0-130-170 kubenswrapper[2565]: I0611 18:37:31.279230 2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/c1fb0eff-7b15-4d34-a1bc-79dd5d06e02d-bundle\") pod \"c1fb0eff-7b15-4d34-a1bc-79dd5d06e02d\" (UID: \"c1fb0eff-7b15-4d34-a1bc-79dd5d06e02d\") " Jun 11 18:37:31.279805 ip-10-0-130-170 kubenswrapper[2565]: I0611 18:37:31.279774 2565 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/c1fb0eff-7b15-4d34-a1bc-79dd5d06e02d-bundle" (OuterVolumeSpecName: "bundle") pod "c1fb0eff-7b15-4d34-a1bc-79dd5d06e02d" (UID: "c1fb0eff-7b15-4d34-a1bc-79dd5d06e02d"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 11 18:37:31.281407 ip-10-0-130-170 kubenswrapper[2565]: I0611 18:37:31.281374 2565 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/c1fb0eff-7b15-4d34-a1bc-79dd5d06e02d-kube-api-access-vrm2w" (OuterVolumeSpecName: "kube-api-access-vrm2w") pod "c1fb0eff-7b15-4d34-a1bc-79dd5d06e02d" (UID: "c1fb0eff-7b15-4d34-a1bc-79dd5d06e02d"). InnerVolumeSpecName "kube-api-access-vrm2w". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 11 18:37:31.284382 ip-10-0-130-170 kubenswrapper[2565]: I0611 18:37:31.284356 2565 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/c1fb0eff-7b15-4d34-a1bc-79dd5d06e02d-util" (OuterVolumeSpecName: "util") pod "c1fb0eff-7b15-4d34-a1bc-79dd5d06e02d" (UID: "c1fb0eff-7b15-4d34-a1bc-79dd5d06e02d"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 11 18:37:31.380045 ip-10-0-130-170 kubenswrapper[2565]: I0611 18:37:31.380016 2565 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/c1fb0eff-7b15-4d34-a1bc-79dd5d06e02d-bundle\") on node \"ip-10-0-130-170.ec2.internal\" DevicePath \"\"" Jun 11 18:37:31.380045 ip-10-0-130-170 kubenswrapper[2565]: I0611 18:37:31.380045 2565 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/c1fb0eff-7b15-4d34-a1bc-79dd5d06e02d-util\") on node \"ip-10-0-130-170.ec2.internal\" DevicePath \"\"" Jun 11 18:37:31.380212 ip-10-0-130-170 kubenswrapper[2565]: I0611 18:37:31.380058 2565 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-vrm2w\" (UniqueName: \"kubernetes.io/projected/c1fb0eff-7b15-4d34-a1bc-79dd5d06e02d-kube-api-access-vrm2w\") on node \"ip-10-0-130-170.ec2.internal\" DevicePath \"\"" Jun 11 18:37:32.121128 ip-10-0-130-170 kubenswrapper[2565]: I0611 18:37:32.121041 2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7592jfrw" Jun 11 18:37:32.121128 ip-10-0-130-170 kubenswrapper[2565]: I0611 18:37:32.121067 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7592jfrw" event={"ID":"c1fb0eff-7b15-4d34-a1bc-79dd5d06e02d","Type":"ContainerDied","Data":"ed10c194739bffccc0f9bab5893ff43ff32bca3f5a23da92519e4089e5d4888b"} Jun 11 18:37:32.121128 ip-10-0-130-170 kubenswrapper[2565]: I0611 18:37:32.121120 2565 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="ed10c194739bffccc0f9bab5893ff43ff32bca3f5a23da92519e4089e5d4888b" Jun 11 18:37:32.286016 ip-10-0-130-170 kubenswrapper[2565]: I0611 18:37:32.285990 2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef187nj6" Jun 11 18:37:32.288688 ip-10-0-130-170 kubenswrapper[2565]: I0611 18:37:32.288664 2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73kvjgf" Jun 11 18:37:32.393428 ip-10-0-130-170 kubenswrapper[2565]: I0611 18:37:32.393401 2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/cf3a06b1-22a2-43c8-a104-75ae129d04e1-util\") pod \"cf3a06b1-22a2-43c8-a104-75ae129d04e1\" (UID: \"cf3a06b1-22a2-43c8-a104-75ae129d04e1\") " Jun 11 18:37:32.393598 ip-10-0-130-170 kubenswrapper[2565]: I0611 18:37:32.393507 2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-lkszv\" (UniqueName: \"kubernetes.io/projected/cf3a06b1-22a2-43c8-a104-75ae129d04e1-kube-api-access-lkszv\") pod \"cf3a06b1-22a2-43c8-a104-75ae129d04e1\" (UID: \"cf3a06b1-22a2-43c8-a104-75ae129d04e1\") " Jun 11 18:37:32.393598 ip-10-0-130-170 kubenswrapper[2565]: I0611 18:37:32.393535 2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/10ee4034-8bda-47ea-ba8d-d79f6d8b66e9-util\") pod \"10ee4034-8bda-47ea-ba8d-d79f6d8b66e9\" (UID: \"10ee4034-8bda-47ea-ba8d-d79f6d8b66e9\") " Jun 11 18:37:32.393598 ip-10-0-130-170 kubenswrapper[2565]: I0611 18:37:32.393557 2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/10ee4034-8bda-47ea-ba8d-d79f6d8b66e9-bundle\") pod \"10ee4034-8bda-47ea-ba8d-d79f6d8b66e9\" (UID: \"10ee4034-8bda-47ea-ba8d-d79f6d8b66e9\") " Jun 11 18:37:32.393722 ip-10-0-130-170 kubenswrapper[2565]: I0611 18:37:32.393609 2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/cf3a06b1-22a2-43c8-a104-75ae129d04e1-bundle\") pod \"cf3a06b1-22a2-43c8-a104-75ae129d04e1\" (UID: \"cf3a06b1-22a2-43c8-a104-75ae129d04e1\") " Jun 11 18:37:32.393722 ip-10-0-130-170 kubenswrapper[2565]: I0611 18:37:32.393645 2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-75ghb\" (UniqueName: \"kubernetes.io/projected/10ee4034-8bda-47ea-ba8d-d79f6d8b66e9-kube-api-access-75ghb\") pod \"10ee4034-8bda-47ea-ba8d-d79f6d8b66e9\" (UID: \"10ee4034-8bda-47ea-ba8d-d79f6d8b66e9\") " Jun 11 18:37:32.394200 ip-10-0-130-170 kubenswrapper[2565]: I0611 18:37:32.394168 2565 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/10ee4034-8bda-47ea-ba8d-d79f6d8b66e9-bundle" (OuterVolumeSpecName: "bundle") pod "10ee4034-8bda-47ea-ba8d-d79f6d8b66e9" (UID: "10ee4034-8bda-47ea-ba8d-d79f6d8b66e9"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 11 18:37:32.394615 ip-10-0-130-170 kubenswrapper[2565]: I0611 18:37:32.394577 2565 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/cf3a06b1-22a2-43c8-a104-75ae129d04e1-bundle" (OuterVolumeSpecName: "bundle") pod "cf3a06b1-22a2-43c8-a104-75ae129d04e1" (UID: "cf3a06b1-22a2-43c8-a104-75ae129d04e1"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 11 18:37:32.395949 ip-10-0-130-170 kubenswrapper[2565]: I0611 18:37:32.395928 2565 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/cf3a06b1-22a2-43c8-a104-75ae129d04e1-kube-api-access-lkszv" (OuterVolumeSpecName: "kube-api-access-lkszv") pod "cf3a06b1-22a2-43c8-a104-75ae129d04e1" (UID: "cf3a06b1-22a2-43c8-a104-75ae129d04e1"). InnerVolumeSpecName "kube-api-access-lkszv". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 11 18:37:32.396031 ip-10-0-130-170 kubenswrapper[2565]: I0611 18:37:32.395938 2565 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/10ee4034-8bda-47ea-ba8d-d79f6d8b66e9-kube-api-access-75ghb" (OuterVolumeSpecName: "kube-api-access-75ghb") pod "10ee4034-8bda-47ea-ba8d-d79f6d8b66e9" (UID: "10ee4034-8bda-47ea-ba8d-d79f6d8b66e9"). InnerVolumeSpecName "kube-api-access-75ghb". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 11 18:37:32.399383 ip-10-0-130-170 kubenswrapper[2565]: I0611 18:37:32.399357 2565 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/cf3a06b1-22a2-43c8-a104-75ae129d04e1-util" (OuterVolumeSpecName: "util") pod "cf3a06b1-22a2-43c8-a104-75ae129d04e1" (UID: "cf3a06b1-22a2-43c8-a104-75ae129d04e1"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 11 18:37:32.401884 ip-10-0-130-170 kubenswrapper[2565]: I0611 18:37:32.401860 2565 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/10ee4034-8bda-47ea-ba8d-d79f6d8b66e9-util" (OuterVolumeSpecName: "util") pod "10ee4034-8bda-47ea-ba8d-d79f6d8b66e9" (UID: "10ee4034-8bda-47ea-ba8d-d79f6d8b66e9"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 11 18:37:32.495280 ip-10-0-130-170 kubenswrapper[2565]: I0611 18:37:32.495212 2565 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-lkszv\" (UniqueName: \"kubernetes.io/projected/cf3a06b1-22a2-43c8-a104-75ae129d04e1-kube-api-access-lkszv\") on node \"ip-10-0-130-170.ec2.internal\" DevicePath \"\"" Jun 11 18:37:32.495280 ip-10-0-130-170 kubenswrapper[2565]: I0611 18:37:32.495243 2565 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/10ee4034-8bda-47ea-ba8d-d79f6d8b66e9-util\") on node \"ip-10-0-130-170.ec2.internal\" DevicePath \"\"" Jun 11 18:37:32.495280 ip-10-0-130-170 kubenswrapper[2565]: I0611 18:37:32.495283 2565 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/10ee4034-8bda-47ea-ba8d-d79f6d8b66e9-bundle\") on node \"ip-10-0-130-170.ec2.internal\" DevicePath \"\"" Jun 11 18:37:32.495280 ip-10-0-130-170 kubenswrapper[2565]: I0611 18:37:32.495293 2565 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/cf3a06b1-22a2-43c8-a104-75ae129d04e1-bundle\") on node \"ip-10-0-130-170.ec2.internal\" DevicePath \"\"" Jun 11 18:37:32.495541 ip-10-0-130-170 kubenswrapper[2565]: I0611 18:37:32.495301 2565 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-75ghb\" (UniqueName: \"kubernetes.io/projected/10ee4034-8bda-47ea-ba8d-d79f6d8b66e9-kube-api-access-75ghb\") on node \"ip-10-0-130-170.ec2.internal\" DevicePath \"\"" Jun 11 18:37:32.495541 ip-10-0-130-170 kubenswrapper[2565]: I0611 18:37:32.495310 2565 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/cf3a06b1-22a2-43c8-a104-75ae129d04e1-util\") on node \"ip-10-0-130-170.ec2.internal\" DevicePath \"\"" Jun 11 18:37:33.128320 ip-10-0-130-170 kubenswrapper[2565]: I0611 18:37:33.128294 2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef187nj6" Jun 11 18:37:33.128710 ip-10-0-130-170 kubenswrapper[2565]: I0611 18:37:33.128293 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef187nj6" event={"ID":"10ee4034-8bda-47ea-ba8d-d79f6d8b66e9","Type":"ContainerDied","Data":"70a83acb01a5a25ff1b52c3f988f961342fbf1f1653e67f8f681ce8ad0fed3b4"} Jun 11 18:37:33.128710 ip-10-0-130-170 kubenswrapper[2565]: I0611 18:37:33.128410 2565 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="70a83acb01a5a25ff1b52c3f988f961342fbf1f1653e67f8f681ce8ad0fed3b4" Jun 11 18:37:33.130278 ip-10-0-130-170 kubenswrapper[2565]: I0611 18:37:33.130231 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73kvjgf" event={"ID":"cf3a06b1-22a2-43c8-a104-75ae129d04e1","Type":"ContainerDied","Data":"20109276110e9109d5ee4ca851e46703d7a025801d5e01977b238b964cb36df8"} Jun 11 18:37:33.130417 ip-10-0-130-170 kubenswrapper[2565]: I0611 18:37:33.130283 2565 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="20109276110e9109d5ee4ca851e46703d7a025801d5e01977b238b964cb36df8" Jun 11 18:37:33.130417 ip-10-0-130-170 kubenswrapper[2565]: I0611 18:37:33.130300 2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73kvjgf" Jun 11 18:37:52.947183 ip-10-0-130-170 kubenswrapper[2565]: I0611 18:37:52.947144 2565 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-5b4bb9566c-52tn6"] Jun 11 18:38:01.728680 ip-10-0-130-170 kubenswrapper[2565]: I0611 18:38:01.728649 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-5dbbb5d744-vpdts_3329f4b1-ac8c-4472-b6a0-13bb76075957/console-operator/1.log" Jun 11 18:38:01.729204 ip-10-0-130-170 kubenswrapper[2565]: I0611 18:38:01.728654 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-5dbbb5d744-vpdts_3329f4b1-ac8c-4472-b6a0-13bb76075957/console-operator/1.log" Jun 11 18:38:01.736727 ip-10-0-130-170 kubenswrapper[2565]: I0611 18:38:01.736708 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-9xbcp_5f6a1d9d-054f-4a94-99a3-21b77d4995dd/ovn-acl-logging/0.log" Jun 11 18:38:01.737158 ip-10-0-130-170 kubenswrapper[2565]: I0611 18:38:01.737141 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-9xbcp_5f6a1d9d-054f-4a94-99a3-21b77d4995dd/ovn-acl-logging/0.log" Jun 11 18:38:01.930481 ip-10-0-130-170 kubenswrapper[2565]: I0611 18:38:01.930445 2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-console-plugin-66b5774985-nbbh7"] Jun 11 18:38:01.932616 ip-10-0-130-170 kubenswrapper[2565]: I0611 18:38:01.930780 2565 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="10ee4034-8bda-47ea-ba8d-d79f6d8b66e9" containerName="extract" Jun 11 18:38:01.932616 ip-10-0-130-170 kubenswrapper[2565]: I0611 18:38:01.930793 2565 state_mem.go:107] "Deleted CPUSet assignment" podUID="10ee4034-8bda-47ea-ba8d-d79f6d8b66e9" containerName="extract" Jun 11 18:38:01.932616 ip-10-0-130-170 kubenswrapper[2565]: I0611 18:38:01.930802 2565 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="334df8f5-d1e1-43fb-9919-e28c647d6327" containerName="util" Jun 11 18:38:01.932616 ip-10-0-130-170 kubenswrapper[2565]: I0611 18:38:01.930809 2565 state_mem.go:107] "Deleted CPUSet assignment" podUID="334df8f5-d1e1-43fb-9919-e28c647d6327" containerName="util" Jun 11 18:38:01.932616 ip-10-0-130-170 kubenswrapper[2565]: I0611 18:38:01.930821 2565 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="c1fb0eff-7b15-4d34-a1bc-79dd5d06e02d" containerName="util" Jun 11 18:38:01.932616 ip-10-0-130-170 kubenswrapper[2565]: I0611 18:38:01.930826 2565 state_mem.go:107] "Deleted CPUSet assignment" podUID="c1fb0eff-7b15-4d34-a1bc-79dd5d06e02d" containerName="util" Jun 11 18:38:01.932616 ip-10-0-130-170 kubenswrapper[2565]: I0611 18:38:01.930832 2565 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="cf3a06b1-22a2-43c8-a104-75ae129d04e1" containerName="extract" Jun 11 18:38:01.932616 ip-10-0-130-170 kubenswrapper[2565]: I0611 18:38:01.930837 2565 state_mem.go:107] "Deleted CPUSet assignment" podUID="cf3a06b1-22a2-43c8-a104-75ae129d04e1" containerName="extract" Jun 11 18:38:01.932616 ip-10-0-130-170 kubenswrapper[2565]: I0611 18:38:01.930847 2565 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="cf3a06b1-22a2-43c8-a104-75ae129d04e1" containerName="pull" Jun 11 18:38:01.932616 ip-10-0-130-170 kubenswrapper[2565]: I0611 18:38:01.930852 2565 state_mem.go:107] "Deleted CPUSet assignment" podUID="cf3a06b1-22a2-43c8-a104-75ae129d04e1" containerName="pull" Jun 11 18:38:01.932616 ip-10-0-130-170 kubenswrapper[2565]: I0611 18:38:01.930860 2565 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="334df8f5-d1e1-43fb-9919-e28c647d6327" containerName="extract" Jun 11 18:38:01.932616 ip-10-0-130-170 kubenswrapper[2565]: I0611 18:38:01.930865 2565 state_mem.go:107] "Deleted CPUSet assignment" podUID="334df8f5-d1e1-43fb-9919-e28c647d6327" containerName="extract" Jun 11 18:38:01.932616 ip-10-0-130-170 kubenswrapper[2565]: I0611 18:38:01.930873 2565 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="334df8f5-d1e1-43fb-9919-e28c647d6327" containerName="pull" Jun 11 18:38:01.932616 ip-10-0-130-170 kubenswrapper[2565]: I0611 18:38:01.930878 2565 state_mem.go:107] "Deleted CPUSet assignment" podUID="334df8f5-d1e1-43fb-9919-e28c647d6327" containerName="pull" Jun 11 18:38:01.932616 ip-10-0-130-170 kubenswrapper[2565]: I0611 18:38:01.930884 2565 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="cf3a06b1-22a2-43c8-a104-75ae129d04e1" containerName="util" Jun 11 18:38:01.932616 ip-10-0-130-170 kubenswrapper[2565]: I0611 18:38:01.930888 2565 state_mem.go:107] "Deleted CPUSet assignment" podUID="cf3a06b1-22a2-43c8-a104-75ae129d04e1" containerName="util" Jun 11 18:38:01.932616 ip-10-0-130-170 kubenswrapper[2565]: I0611 18:38:01.930895 2565 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="10ee4034-8bda-47ea-ba8d-d79f6d8b66e9" containerName="util" Jun 11 18:38:01.932616 ip-10-0-130-170 kubenswrapper[2565]: I0611 18:38:01.930899 2565 state_mem.go:107] "Deleted CPUSet assignment" podUID="10ee4034-8bda-47ea-ba8d-d79f6d8b66e9" containerName="util" Jun 11 18:38:01.932616 ip-10-0-130-170 kubenswrapper[2565]: I0611 18:38:01.930904 2565 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="c1fb0eff-7b15-4d34-a1bc-79dd5d06e02d" containerName="extract" Jun 11 18:38:01.932616 ip-10-0-130-170 kubenswrapper[2565]: I0611 18:38:01.930908 2565 state_mem.go:107] "Deleted CPUSet assignment" podUID="c1fb0eff-7b15-4d34-a1bc-79dd5d06e02d" containerName="extract" Jun 11 18:38:01.932616 ip-10-0-130-170 kubenswrapper[2565]: I0611 18:38:01.930915 2565 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="10ee4034-8bda-47ea-ba8d-d79f6d8b66e9" containerName="pull" Jun 11 18:38:01.932616 ip-10-0-130-170 kubenswrapper[2565]: I0611 18:38:01.930920 2565 state_mem.go:107] "Deleted CPUSet assignment" podUID="10ee4034-8bda-47ea-ba8d-d79f6d8b66e9" containerName="pull" Jun 11 18:38:01.932616 ip-10-0-130-170 kubenswrapper[2565]: I0611 18:38:01.930926 2565 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="c1fb0eff-7b15-4d34-a1bc-79dd5d06e02d" containerName="pull" Jun 11 18:38:01.932616 ip-10-0-130-170 kubenswrapper[2565]: I0611 18:38:01.930931 2565 state_mem.go:107] "Deleted CPUSet assignment" podUID="c1fb0eff-7b15-4d34-a1bc-79dd5d06e02d" containerName="pull" Jun 11 18:38:01.932616 ip-10-0-130-170 kubenswrapper[2565]: I0611 18:38:01.930996 2565 memory_manager.go:368] "RemoveStaleState removing state" podUID="10ee4034-8bda-47ea-ba8d-d79f6d8b66e9" containerName="extract" Jun 11 18:38:01.932616 ip-10-0-130-170 kubenswrapper[2565]: I0611 18:38:01.931007 2565 memory_manager.go:368] "RemoveStaleState removing state" podUID="334df8f5-d1e1-43fb-9919-e28c647d6327" containerName="extract" Jun 11 18:38:01.932616 ip-10-0-130-170 kubenswrapper[2565]: I0611 18:38:01.931012 2565 memory_manager.go:368] "RemoveStaleState removing state" podUID="c1fb0eff-7b15-4d34-a1bc-79dd5d06e02d" containerName="extract" Jun 11 18:38:01.932616 ip-10-0-130-170 kubenswrapper[2565]: I0611 18:38:01.931019 2565 memory_manager.go:368] "RemoveStaleState removing state" podUID="cf3a06b1-22a2-43c8-a104-75ae129d04e1" containerName="extract" Jun 11 18:38:01.933931 ip-10-0-130-170 kubenswrapper[2565]: I0611 18:38:01.933747 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-console-plugin-66b5774985-nbbh7" Jun 11 18:38:01.936451 ip-10-0-130-170 kubenswrapper[2565]: I0611 18:38:01.936431 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"plugin-serving-cert\"" Jun 11 18:38:01.936567 ip-10-0-130-170 kubenswrapper[2565]: I0611 18:38:01.936453 2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"kuadrant-console-nginx-conf\"" Jun 11 18:38:01.936567 ip-10-0-130-170 kubenswrapper[2565]: I0611 18:38:01.936442 2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"kube-root-ca.crt\"" Jun 11 18:38:01.936567 ip-10-0-130-170 kubenswrapper[2565]: I0611 18:38:01.936513 2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"openshift-service-ca.crt\"" Jun 11 18:38:01.937453 ip-10-0-130-170 kubenswrapper[2565]: I0611 18:38:01.937436 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"default-dockercfg-wmbv9\"" Jun 11 18:38:01.943433 ip-10-0-130-170 kubenswrapper[2565]: I0611 18:38:01.943148 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-console-plugin-66b5774985-nbbh7"] Jun 11 18:38:02.053004 ip-10-0-130-170 kubenswrapper[2565]: I0611 18:38:02.052902 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/e7de33dc-d04d-4d11-9449-614482d8bf2e-nginx-conf\") pod \"kuadrant-console-plugin-66b5774985-nbbh7\" (UID: \"e7de33dc-d04d-4d11-9449-614482d8bf2e\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-nbbh7" Jun 11 18:38:02.053004 ip-10-0-130-170 kubenswrapper[2565]: I0611 18:38:02.052965 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qwqk5\" (UniqueName: \"kubernetes.io/projected/e7de33dc-d04d-4d11-9449-614482d8bf2e-kube-api-access-qwqk5\") pod \"kuadrant-console-plugin-66b5774985-nbbh7\" (UID: \"e7de33dc-d04d-4d11-9449-614482d8bf2e\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-nbbh7" Jun 11 18:38:02.053227 ip-10-0-130-170 kubenswrapper[2565]: I0611 18:38:02.053087 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugin-serving-cert\" (UniqueName: \"kubernetes.io/secret/e7de33dc-d04d-4d11-9449-614482d8bf2e-plugin-serving-cert\") pod \"kuadrant-console-plugin-66b5774985-nbbh7\" (UID: \"e7de33dc-d04d-4d11-9449-614482d8bf2e\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-nbbh7" Jun 11 18:38:02.154569 ip-10-0-130-170 kubenswrapper[2565]: I0611 18:38:02.154531 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qwqk5\" (UniqueName: \"kubernetes.io/projected/e7de33dc-d04d-4d11-9449-614482d8bf2e-kube-api-access-qwqk5\") pod \"kuadrant-console-plugin-66b5774985-nbbh7\" (UID: \"e7de33dc-d04d-4d11-9449-614482d8bf2e\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-nbbh7" Jun 11 18:38:02.154778 ip-10-0-130-170 kubenswrapper[2565]: I0611 18:38:02.154585 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugin-serving-cert\" (UniqueName: \"kubernetes.io/secret/e7de33dc-d04d-4d11-9449-614482d8bf2e-plugin-serving-cert\") pod \"kuadrant-console-plugin-66b5774985-nbbh7\" (UID: \"e7de33dc-d04d-4d11-9449-614482d8bf2e\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-nbbh7" Jun 11 18:38:02.154778 ip-10-0-130-170 kubenswrapper[2565]: I0611 18:38:02.154637 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/e7de33dc-d04d-4d11-9449-614482d8bf2e-nginx-conf\") pod \"kuadrant-console-plugin-66b5774985-nbbh7\" (UID: \"e7de33dc-d04d-4d11-9449-614482d8bf2e\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-nbbh7" Jun 11 18:38:02.155370 ip-10-0-130-170 kubenswrapper[2565]: I0611 18:38:02.155349 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/e7de33dc-d04d-4d11-9449-614482d8bf2e-nginx-conf\") pod \"kuadrant-console-plugin-66b5774985-nbbh7\" (UID: \"e7de33dc-d04d-4d11-9449-614482d8bf2e\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-nbbh7" Jun 11 18:38:02.157208 ip-10-0-130-170 kubenswrapper[2565]: I0611 18:38:02.157186 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"plugin-serving-cert\" (UniqueName: \"kubernetes.io/secret/e7de33dc-d04d-4d11-9449-614482d8bf2e-plugin-serving-cert\") pod \"kuadrant-console-plugin-66b5774985-nbbh7\" (UID: \"e7de33dc-d04d-4d11-9449-614482d8bf2e\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-nbbh7" Jun 11 18:38:02.162913 ip-10-0-130-170 kubenswrapper[2565]: I0611 18:38:02.162890 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-qwqk5\" (UniqueName: \"kubernetes.io/projected/e7de33dc-d04d-4d11-9449-614482d8bf2e-kube-api-access-qwqk5\") pod \"kuadrant-console-plugin-66b5774985-nbbh7\" (UID: \"e7de33dc-d04d-4d11-9449-614482d8bf2e\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-nbbh7" Jun 11 18:38:02.246588 ip-10-0-130-170 kubenswrapper[2565]: I0611 18:38:02.246524 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-console-plugin-66b5774985-nbbh7" Jun 11 18:38:02.382337 ip-10-0-130-170 kubenswrapper[2565]: I0611 18:38:02.382309 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-console-plugin-66b5774985-nbbh7"] Jun 11 18:38:02.386811 ip-10-0-130-170 kubenswrapper[2565]: W0611 18:38:02.386784 2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pode7de33dc_d04d_4d11_9449_614482d8bf2e.slice/crio-818e93a77bc2320bb132883d88bb5ea394e3610bf8dbaf0bb5c4764469804f91 WatchSource:0}: Error finding container 818e93a77bc2320bb132883d88bb5ea394e3610bf8dbaf0bb5c4764469804f91: Status 404 returned error can't find the container with id 818e93a77bc2320bb132883d88bb5ea394e3610bf8dbaf0bb5c4764469804f91 Jun 11 18:38:03.292388 ip-10-0-130-170 kubenswrapper[2565]: I0611 18:38:03.292350 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-console-plugin-66b5774985-nbbh7" event={"ID":"e7de33dc-d04d-4d11-9449-614482d8bf2e","Type":"ContainerStarted","Data":"818e93a77bc2320bb132883d88bb5ea394e3610bf8dbaf0bb5c4764469804f91"} Jun 11 18:38:17.975478 ip-10-0-130-170 kubenswrapper[2565]: I0611 18:38:17.975384 2565 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-console/console-5b4bb9566c-52tn6" podUID="70f4db72-609a-42aa-bb5d-bc973440eede" containerName="console" containerID="cri-o://cad454969ddc06561d23b179125d986d3e2554268126a4269bc02d6ff828cb75" gracePeriod=15 Jun 11 18:38:25.092093 ip-10-0-130-170 kubenswrapper[2565]: I0611 18:38:25.092052 2565 patch_prober.go:28] interesting pod/console-5b4bb9566c-52tn6 container/console namespace/openshift-console: Readiness probe status=failure output="Get \"https://10.133.0.24:8443/health\": dial tcp 10.133.0.24:8443: connect: connection refused" start-of-body= Jun 11 18:38:25.092612 ip-10-0-130-170 kubenswrapper[2565]: I0611 18:38:25.092121 2565 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-console/console-5b4bb9566c-52tn6" podUID="70f4db72-609a-42aa-bb5d-bc973440eede" containerName="console" probeResult="failure" output="Get \"https://10.133.0.24:8443/health\": dial tcp 10.133.0.24:8443: connect: connection refused" Jun 11 18:38:27.258226 ip-10-0-130-170 kubenswrapper[2565]: I0611 18:38:27.258202 2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-5b4bb9566c-52tn6" Jun 11 18:38:27.307791 ip-10-0-130-170 kubenswrapper[2565]: I0611 18:38:27.307752 2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/70f4db72-609a-42aa-bb5d-bc973440eede-console-serving-cert\") pod \"70f4db72-609a-42aa-bb5d-bc973440eede\" (UID: \"70f4db72-609a-42aa-bb5d-bc973440eede\") " Jun 11 18:38:27.307982 ip-10-0-130-170 kubenswrapper[2565]: I0611 18:38:27.307802 2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/70f4db72-609a-42aa-bb5d-bc973440eede-service-ca\") pod \"70f4db72-609a-42aa-bb5d-bc973440eede\" (UID: \"70f4db72-609a-42aa-bb5d-bc973440eede\") " Jun 11 18:38:27.307982 ip-10-0-130-170 kubenswrapper[2565]: I0611 18:38:27.307819 2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-td2ls\" (UniqueName: \"kubernetes.io/projected/70f4db72-609a-42aa-bb5d-bc973440eede-kube-api-access-td2ls\") pod \"70f4db72-609a-42aa-bb5d-bc973440eede\" (UID: \"70f4db72-609a-42aa-bb5d-bc973440eede\") " Jun 11 18:38:27.307982 ip-10-0-130-170 kubenswrapper[2565]: I0611 18:38:27.307835 2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/70f4db72-609a-42aa-bb5d-bc973440eede-oauth-serving-cert\") pod \"70f4db72-609a-42aa-bb5d-bc973440eede\" (UID: \"70f4db72-609a-42aa-bb5d-bc973440eede\") " Jun 11 18:38:27.307982 ip-10-0-130-170 kubenswrapper[2565]: I0611 18:38:27.307863 2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/70f4db72-609a-42aa-bb5d-bc973440eede-console-config\") pod \"70f4db72-609a-42aa-bb5d-bc973440eede\" (UID: \"70f4db72-609a-42aa-bb5d-bc973440eede\") " Jun 11 18:38:27.307982 ip-10-0-130-170 kubenswrapper[2565]: I0611 18:38:27.307904 2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/70f4db72-609a-42aa-bb5d-bc973440eede-console-oauth-config\") pod \"70f4db72-609a-42aa-bb5d-bc973440eede\" (UID: \"70f4db72-609a-42aa-bb5d-bc973440eede\") " Jun 11 18:38:27.308302 ip-10-0-130-170 kubenswrapper[2565]: I0611 18:38:27.308063 2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/70f4db72-609a-42aa-bb5d-bc973440eede-trusted-ca-bundle\") pod \"70f4db72-609a-42aa-bb5d-bc973440eede\" (UID: \"70f4db72-609a-42aa-bb5d-bc973440eede\") " Jun 11 18:38:27.308302 ip-10-0-130-170 kubenswrapper[2565]: I0611 18:38:27.308216 2565 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/70f4db72-609a-42aa-bb5d-bc973440eede-service-ca" (OuterVolumeSpecName: "service-ca") pod "70f4db72-609a-42aa-bb5d-bc973440eede" (UID: "70f4db72-609a-42aa-bb5d-bc973440eede"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 11 18:38:27.308302 ip-10-0-130-170 kubenswrapper[2565]: I0611 18:38:27.308275 2565 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/70f4db72-609a-42aa-bb5d-bc973440eede-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "70f4db72-609a-42aa-bb5d-bc973440eede" (UID: "70f4db72-609a-42aa-bb5d-bc973440eede"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 11 18:38:27.308465 ip-10-0-130-170 kubenswrapper[2565]: I0611 18:38:27.308329 2565 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/70f4db72-609a-42aa-bb5d-bc973440eede-console-config" (OuterVolumeSpecName: "console-config") pod "70f4db72-609a-42aa-bb5d-bc973440eede" (UID: "70f4db72-609a-42aa-bb5d-bc973440eede"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 11 18:38:27.308465 ip-10-0-130-170 kubenswrapper[2565]: I0611 18:38:27.308423 2565 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/70f4db72-609a-42aa-bb5d-bc973440eede-service-ca\") on node \"ip-10-0-130-170.ec2.internal\" DevicePath \"\"" Jun 11 18:38:27.308465 ip-10-0-130-170 kubenswrapper[2565]: I0611 18:38:27.308442 2565 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/70f4db72-609a-42aa-bb5d-bc973440eede-oauth-serving-cert\") on node \"ip-10-0-130-170.ec2.internal\" DevicePath \"\"" Jun 11 18:38:27.308465 ip-10-0-130-170 kubenswrapper[2565]: I0611 18:38:27.308458 2565 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/70f4db72-609a-42aa-bb5d-bc973440eede-console-config\") on node \"ip-10-0-130-170.ec2.internal\" DevicePath \"\"" Jun 11 18:38:27.308840 ip-10-0-130-170 kubenswrapper[2565]: I0611 18:38:27.308541 2565 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/70f4db72-609a-42aa-bb5d-bc973440eede-trusted-ca-bundle" (OuterVolumeSpecName: "trusted-ca-bundle") pod "70f4db72-609a-42aa-bb5d-bc973440eede" (UID: "70f4db72-609a-42aa-bb5d-bc973440eede"). InnerVolumeSpecName "trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 11 18:38:27.310159 ip-10-0-130-170 kubenswrapper[2565]: I0611 18:38:27.310134 2565 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/70f4db72-609a-42aa-bb5d-bc973440eede-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "70f4db72-609a-42aa-bb5d-bc973440eede" (UID: "70f4db72-609a-42aa-bb5d-bc973440eede"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 11 18:38:27.310159 ip-10-0-130-170 kubenswrapper[2565]: I0611 18:38:27.310147 2565 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/70f4db72-609a-42aa-bb5d-bc973440eede-kube-api-access-td2ls" (OuterVolumeSpecName: "kube-api-access-td2ls") pod "70f4db72-609a-42aa-bb5d-bc973440eede" (UID: "70f4db72-609a-42aa-bb5d-bc973440eede"). InnerVolumeSpecName "kube-api-access-td2ls". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 11 18:38:27.310318 ip-10-0-130-170 kubenswrapper[2565]: I0611 18:38:27.310162 2565 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/70f4db72-609a-42aa-bb5d-bc973440eede-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "70f4db72-609a-42aa-bb5d-bc973440eede" (UID: "70f4db72-609a-42aa-bb5d-bc973440eede"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 11 18:38:27.409881 ip-10-0-130-170 kubenswrapper[2565]: I0611 18:38:27.409853 2565 reconciler_common.go:299] "Volume detached for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/70f4db72-609a-42aa-bb5d-bc973440eede-trusted-ca-bundle\") on node \"ip-10-0-130-170.ec2.internal\" DevicePath \"\"" Jun 11 18:38:27.409881 ip-10-0-130-170 kubenswrapper[2565]: I0611 18:38:27.409878 2565 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/70f4db72-609a-42aa-bb5d-bc973440eede-console-serving-cert\") on node \"ip-10-0-130-170.ec2.internal\" DevicePath \"\"" Jun 11 18:38:27.409881 ip-10-0-130-170 kubenswrapper[2565]: I0611 18:38:27.409888 2565 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-td2ls\" (UniqueName: \"kubernetes.io/projected/70f4db72-609a-42aa-bb5d-bc973440eede-kube-api-access-td2ls\") on node \"ip-10-0-130-170.ec2.internal\" DevicePath \"\"" Jun 11 18:38:27.410123 ip-10-0-130-170 kubenswrapper[2565]: I0611 18:38:27.409900 2565 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/70f4db72-609a-42aa-bb5d-bc973440eede-console-oauth-config\") on node \"ip-10-0-130-170.ec2.internal\" DevicePath \"\"" Jun 11 18:38:27.442988 ip-10-0-130-170 kubenswrapper[2565]: I0611 18:38:27.442956 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-console-plugin-66b5774985-nbbh7" event={"ID":"e7de33dc-d04d-4d11-9449-614482d8bf2e","Type":"ContainerStarted","Data":"870016e6b42df6f47b38bb32dfd7c62a5dad9603340a647d324a108a408d11f2"} Jun 11 18:38:27.444348 ip-10-0-130-170 kubenswrapper[2565]: I0611 18:38:27.444326 2565 generic.go:356] "Generic (PLEG): container finished" podID="70f4db72-609a-42aa-bb5d-bc973440eede" containerID="cad454969ddc06561d23b179125d986d3e2554268126a4269bc02d6ff828cb75" exitCode=0 Jun 11 18:38:27.444466 ip-10-0-130-170 kubenswrapper[2565]: I0611 18:38:27.444366 2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-5b4bb9566c-52tn6" Jun 11 18:38:27.444466 ip-10-0-130-170 kubenswrapper[2565]: I0611 18:38:27.444386 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-5b4bb9566c-52tn6" event={"ID":"70f4db72-609a-42aa-bb5d-bc973440eede","Type":"ContainerDied","Data":"cad454969ddc06561d23b179125d986d3e2554268126a4269bc02d6ff828cb75"} Jun 11 18:38:27.444466 ip-10-0-130-170 kubenswrapper[2565]: I0611 18:38:27.444419 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-5b4bb9566c-52tn6" event={"ID":"70f4db72-609a-42aa-bb5d-bc973440eede","Type":"ContainerDied","Data":"93cbbb912e235871d8f6879ae97ceff4cf742246805677d29405ec0306b72a95"} Jun 11 18:38:27.444466 ip-10-0-130-170 kubenswrapper[2565]: I0611 18:38:27.444440 2565 scope.go:117] "RemoveContainer" containerID="cad454969ddc06561d23b179125d986d3e2554268126a4269bc02d6ff828cb75" Jun 11 18:38:27.454370 ip-10-0-130-170 kubenswrapper[2565]: I0611 18:38:27.454352 2565 scope.go:117] "RemoveContainer" containerID="cad454969ddc06561d23b179125d986d3e2554268126a4269bc02d6ff828cb75" Jun 11 18:38:27.454640 ip-10-0-130-170 kubenswrapper[2565]: E0611 18:38:27.454620 2565 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"cad454969ddc06561d23b179125d986d3e2554268126a4269bc02d6ff828cb75\": container with ID starting with cad454969ddc06561d23b179125d986d3e2554268126a4269bc02d6ff828cb75 not found: ID does not exist" containerID="cad454969ddc06561d23b179125d986d3e2554268126a4269bc02d6ff828cb75" Jun 11 18:38:27.454712 ip-10-0-130-170 kubenswrapper[2565]: I0611 18:38:27.454663 2565 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"cad454969ddc06561d23b179125d986d3e2554268126a4269bc02d6ff828cb75"} err="failed to get container status \"cad454969ddc06561d23b179125d986d3e2554268126a4269bc02d6ff828cb75\": rpc error: code = NotFound desc = could not find container \"cad454969ddc06561d23b179125d986d3e2554268126a4269bc02d6ff828cb75\": container with ID starting with cad454969ddc06561d23b179125d986d3e2554268126a4269bc02d6ff828cb75 not found: ID does not exist" Jun 11 18:38:27.462320 ip-10-0-130-170 kubenswrapper[2565]: I0611 18:38:27.462249 2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-console-plugin-66b5774985-nbbh7" podStartSLOduration=1.6566338900000002 podStartE2EDuration="26.462234174s" totalImagesPullingTime="24.805600284s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-11 18:38:01 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-11 18:38:27.461334433 +0000 UTC m=+626.210020458" watchObservedRunningTime="2026-06-11 18:38:27.462234174 +0000 UTC m=+626.210920195" Jun 11 18:38:27.491095 ip-10-0-130-170 kubenswrapper[2565]: I0611 18:38:27.491056 2565 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-5b4bb9566c-52tn6"] Jun 11 18:38:27.495769 ip-10-0-130-170 kubenswrapper[2565]: I0611 18:38:27.495738 2565 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-5b4bb9566c-52tn6"] Jun 11 18:38:27.749636 ip-10-0-130-170 kubenswrapper[2565]: I0611 18:38:27.749533 2565 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="70f4db72-609a-42aa-bb5d-bc973440eede" path="/var/lib/kubelet/pods/70f4db72-609a-42aa-bb5d-bc973440eede/volumes" Jun 11 18:38:56.969043 ip-10-0-130-170 kubenswrapper[2565]: I0611 18:38:56.969012 2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/limitador-limitador-64c94fd64f-h72kn"] Jun 11 18:38:56.969468 ip-10-0-130-170 kubenswrapper[2565]: I0611 18:38:56.969400 2565 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="70f4db72-609a-42aa-bb5d-bc973440eede" containerName="console" Jun 11 18:38:56.969468 ip-10-0-130-170 kubenswrapper[2565]: I0611 18:38:56.969412 2565 state_mem.go:107] "Deleted CPUSet assignment" podUID="70f4db72-609a-42aa-bb5d-bc973440eede" containerName="console" Jun 11 18:38:56.969542 ip-10-0-130-170 kubenswrapper[2565]: I0611 18:38:56.969472 2565 memory_manager.go:368] "RemoveStaleState removing state" podUID="70f4db72-609a-42aa-bb5d-bc973440eede" containerName="console" Jun 11 18:38:57.015840 ip-10-0-130-170 kubenswrapper[2565]: I0611 18:38:57.015809 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-64c94fd64f-h72kn"] Jun 11 18:38:57.015996 ip-10-0-130-170 kubenswrapper[2565]: I0611 18:38:57.015918 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-64c94fd64f-h72kn" Jun 11 18:38:57.018414 ip-10-0-130-170 kubenswrapper[2565]: I0611 18:38:57.018397 2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"limitador-limits-config-limitador\"" Jun 11 18:38:57.061774 ip-10-0-130-170 kubenswrapper[2565]: I0611 18:38:57.061739 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-64c94fd64f-h72kn"] Jun 11 18:38:57.073775 ip-10-0-130-170 kubenswrapper[2565]: I0611 18:38:57.073742 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-npdhr\" (UniqueName: \"kubernetes.io/projected/aa98c487-e68a-4d3b-965c-9e6bd97a25fe-kube-api-access-npdhr\") pod \"limitador-limitador-64c94fd64f-h72kn\" (UID: \"aa98c487-e68a-4d3b-965c-9e6bd97a25fe\") " pod="kuadrant-system/limitador-limitador-64c94fd64f-h72kn" Jun 11 18:38:57.073948 ip-10-0-130-170 kubenswrapper[2565]: I0611 18:38:57.073803 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/aa98c487-e68a-4d3b-965c-9e6bd97a25fe-config-file\") pod \"limitador-limitador-64c94fd64f-h72kn\" (UID: \"aa98c487-e68a-4d3b-965c-9e6bd97a25fe\") " pod="kuadrant-system/limitador-limitador-64c94fd64f-h72kn" Jun 11 18:38:57.174675 ip-10-0-130-170 kubenswrapper[2565]: I0611 18:38:57.174639 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-npdhr\" (UniqueName: \"kubernetes.io/projected/aa98c487-e68a-4d3b-965c-9e6bd97a25fe-kube-api-access-npdhr\") pod \"limitador-limitador-64c94fd64f-h72kn\" (UID: \"aa98c487-e68a-4d3b-965c-9e6bd97a25fe\") " pod="kuadrant-system/limitador-limitador-64c94fd64f-h72kn" Jun 11 18:38:57.174849 ip-10-0-130-170 kubenswrapper[2565]: I0611 18:38:57.174698 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/aa98c487-e68a-4d3b-965c-9e6bd97a25fe-config-file\") pod \"limitador-limitador-64c94fd64f-h72kn\" (UID: \"aa98c487-e68a-4d3b-965c-9e6bd97a25fe\") " pod="kuadrant-system/limitador-limitador-64c94fd64f-h72kn" Jun 11 18:38:57.175355 ip-10-0-130-170 kubenswrapper[2565]: I0611 18:38:57.175336 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/aa98c487-e68a-4d3b-965c-9e6bd97a25fe-config-file\") pod \"limitador-limitador-64c94fd64f-h72kn\" (UID: \"aa98c487-e68a-4d3b-965c-9e6bd97a25fe\") " pod="kuadrant-system/limitador-limitador-64c94fd64f-h72kn" Jun 11 18:38:57.183624 ip-10-0-130-170 kubenswrapper[2565]: I0611 18:38:57.183594 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-npdhr\" (UniqueName: \"kubernetes.io/projected/aa98c487-e68a-4d3b-965c-9e6bd97a25fe-kube-api-access-npdhr\") pod \"limitador-limitador-64c94fd64f-h72kn\" (UID: \"aa98c487-e68a-4d3b-965c-9e6bd97a25fe\") " pod="kuadrant-system/limitador-limitador-64c94fd64f-h72kn" Jun 11 18:38:57.326935 ip-10-0-130-170 kubenswrapper[2565]: I0611 18:38:57.326852 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-64c94fd64f-h72kn" Jun 11 18:38:57.464873 ip-10-0-130-170 kubenswrapper[2565]: I0611 18:38:57.464849 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-64c94fd64f-h72kn"] Jun 11 18:38:57.466907 ip-10-0-130-170 kubenswrapper[2565]: W0611 18:38:57.466876 2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podaa98c487_e68a_4d3b_965c_9e6bd97a25fe.slice/crio-946eebe0b9218a2825cd32a4d617d1a98697022f91c11da31aaf3d539eeeb504 WatchSource:0}: Error finding container 946eebe0b9218a2825cd32a4d617d1a98697022f91c11da31aaf3d539eeeb504: Status 404 returned error can't find the container with id 946eebe0b9218a2825cd32a4d617d1a98697022f91c11da31aaf3d539eeeb504 Jun 11 18:38:57.605491 ip-10-0-130-170 kubenswrapper[2565]: I0611 18:38:57.605398 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-64c94fd64f-h72kn" event={"ID":"aa98c487-e68a-4d3b-965c-9e6bd97a25fe","Type":"ContainerStarted","Data":"946eebe0b9218a2825cd32a4d617d1a98697022f91c11da31aaf3d539eeeb504"} Jun 11 18:38:57.884875 ip-10-0-130-170 kubenswrapper[2565]: I0611 18:38:57.884840 2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-58cd955675-fgpnr"] Jun 11 18:38:57.889572 ip-10-0-130-170 kubenswrapper[2565]: I0611 18:38:57.889553 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-58cd955675-fgpnr" Jun 11 18:38:57.892173 ip-10-0-130-170 kubenswrapper[2565]: I0611 18:38:57.892151 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"authorino-authorino-dockercfg-fpr8h\"" Jun 11 18:38:57.895821 ip-10-0-130-170 kubenswrapper[2565]: I0611 18:38:57.895796 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-58cd955675-fgpnr"] Jun 11 18:38:57.981596 ip-10-0-130-170 kubenswrapper[2565]: I0611 18:38:57.981559 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-n2hgf\" (UniqueName: \"kubernetes.io/projected/27b71a8b-1337-4bd2-be19-3c6e448ad56b-kube-api-access-n2hgf\") pod \"authorino-58cd955675-fgpnr\" (UID: \"27b71a8b-1337-4bd2-be19-3c6e448ad56b\") " pod="kuadrant-system/authorino-58cd955675-fgpnr" Jun 11 18:38:58.073209 ip-10-0-130-170 kubenswrapper[2565]: I0611 18:38:58.073172 2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-75d556bd77-mg8j2"] Jun 11 18:38:58.076628 ip-10-0-130-170 kubenswrapper[2565]: I0611 18:38:58.076605 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-75d556bd77-mg8j2" Jun 11 18:38:58.082390 ip-10-0-130-170 kubenswrapper[2565]: I0611 18:38:58.082363 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-n2hgf\" (UniqueName: \"kubernetes.io/projected/27b71a8b-1337-4bd2-be19-3c6e448ad56b-kube-api-access-n2hgf\") pod \"authorino-58cd955675-fgpnr\" (UID: \"27b71a8b-1337-4bd2-be19-3c6e448ad56b\") " pod="kuadrant-system/authorino-58cd955675-fgpnr" Jun 11 18:38:58.084798 ip-10-0-130-170 kubenswrapper[2565]: I0611 18:38:58.084779 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-75d556bd77-mg8j2"] Jun 11 18:38:58.095912 ip-10-0-130-170 kubenswrapper[2565]: I0611 18:38:58.095882 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-n2hgf\" (UniqueName: \"kubernetes.io/projected/27b71a8b-1337-4bd2-be19-3c6e448ad56b-kube-api-access-n2hgf\") pod \"authorino-58cd955675-fgpnr\" (UID: \"27b71a8b-1337-4bd2-be19-3c6e448ad56b\") " pod="kuadrant-system/authorino-58cd955675-fgpnr" Jun 11 18:38:58.183843 ip-10-0-130-170 kubenswrapper[2565]: I0611 18:38:58.183655 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-t4dxv\" (UniqueName: \"kubernetes.io/projected/f5c11e16-ed9d-485a-87fa-b6092992558b-kube-api-access-t4dxv\") pod \"authorino-75d556bd77-mg8j2\" (UID: \"f5c11e16-ed9d-485a-87fa-b6092992558b\") " pod="kuadrant-system/authorino-75d556bd77-mg8j2" Jun 11 18:38:58.200697 ip-10-0-130-170 kubenswrapper[2565]: I0611 18:38:58.200664 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-58cd955675-fgpnr" Jun 11 18:38:58.286109 ip-10-0-130-170 kubenswrapper[2565]: I0611 18:38:58.285222 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-t4dxv\" (UniqueName: \"kubernetes.io/projected/f5c11e16-ed9d-485a-87fa-b6092992558b-kube-api-access-t4dxv\") pod \"authorino-75d556bd77-mg8j2\" (UID: \"f5c11e16-ed9d-485a-87fa-b6092992558b\") " pod="kuadrant-system/authorino-75d556bd77-mg8j2" Jun 11 18:38:58.304954 ip-10-0-130-170 kubenswrapper[2565]: I0611 18:38:58.304922 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-t4dxv\" (UniqueName: \"kubernetes.io/projected/f5c11e16-ed9d-485a-87fa-b6092992558b-kube-api-access-t4dxv\") pod \"authorino-75d556bd77-mg8j2\" (UID: \"f5c11e16-ed9d-485a-87fa-b6092992558b\") " pod="kuadrant-system/authorino-75d556bd77-mg8j2" Jun 11 18:38:58.386823 ip-10-0-130-170 kubenswrapper[2565]: I0611 18:38:58.386588 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-75d556bd77-mg8j2" Jun 11 18:38:58.392270 ip-10-0-130-170 kubenswrapper[2565]: I0611 18:38:58.392224 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-58cd955675-fgpnr"] Jun 11 18:38:58.394384 ip-10-0-130-170 kubenswrapper[2565]: W0611 18:38:58.394355 2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod27b71a8b_1337_4bd2_be19_3c6e448ad56b.slice/crio-33f9004f0cb10e5e029b7dd87a0364c580ac9323ac392de41b17e6907c9fd880 WatchSource:0}: Error finding container 33f9004f0cb10e5e029b7dd87a0364c580ac9323ac392de41b17e6907c9fd880: Status 404 returned error can't find the container with id 33f9004f0cb10e5e029b7dd87a0364c580ac9323ac392de41b17e6907c9fd880 Jun 11 18:38:58.560864 ip-10-0-130-170 kubenswrapper[2565]: I0611 18:38:58.560832 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-75d556bd77-mg8j2"] Jun 11 18:38:58.562778 ip-10-0-130-170 kubenswrapper[2565]: W0611 18:38:58.562747 2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podf5c11e16_ed9d_485a_87fa_b6092992558b.slice/crio-4833bac47ef6112fa0fdc8eeba7b15eb16fae52ff0f4a89fc980ab90d09b3412 WatchSource:0}: Error finding container 4833bac47ef6112fa0fdc8eeba7b15eb16fae52ff0f4a89fc980ab90d09b3412: Status 404 returned error can't find the container with id 4833bac47ef6112fa0fdc8eeba7b15eb16fae52ff0f4a89fc980ab90d09b3412 Jun 11 18:38:58.614102 ip-10-0-130-170 kubenswrapper[2565]: I0611 18:38:58.614031 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-58cd955675-fgpnr" event={"ID":"27b71a8b-1337-4bd2-be19-3c6e448ad56b","Type":"ContainerStarted","Data":"33f9004f0cb10e5e029b7dd87a0364c580ac9323ac392de41b17e6907c9fd880"} Jun 11 18:38:58.615840 ip-10-0-130-170 kubenswrapper[2565]: I0611 18:38:58.615768 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-75d556bd77-mg8j2" event={"ID":"f5c11e16-ed9d-485a-87fa-b6092992558b","Type":"ContainerStarted","Data":"4833bac47ef6112fa0fdc8eeba7b15eb16fae52ff0f4a89fc980ab90d09b3412"} Jun 11 18:39:01.694147 ip-10-0-130-170 kubenswrapper[2565]: E0611 18:39:01.694056 2565 cadvisor_stats_provider.go:567] "Partial failure issuing cadvisor.ContainerInfoV2" err="partial failures: [\"/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podf5c11e16_ed9d_485a_87fa_b6092992558b.slice/crio-4833bac47ef6112fa0fdc8eeba7b15eb16fae52ff0f4a89fc980ab90d09b3412\": RecentStats: unable to find data in memory cache]" Jun 11 18:39:02.646890 ip-10-0-130-170 kubenswrapper[2565]: I0611 18:39:02.646840 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-64c94fd64f-h72kn" event={"ID":"aa98c487-e68a-4d3b-965c-9e6bd97a25fe","Type":"ContainerStarted","Data":"a1708d1e9d86efaf65489b21a3857b234da23edef8ddc547972fdbc3793bf0bc"} Jun 11 18:39:02.647083 ip-10-0-130-170 kubenswrapper[2565]: I0611 18:39:02.647026 2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/limitador-limitador-64c94fd64f-h72kn" Jun 11 18:39:02.648390 ip-10-0-130-170 kubenswrapper[2565]: I0611 18:39:02.648365 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-58cd955675-fgpnr" event={"ID":"27b71a8b-1337-4bd2-be19-3c6e448ad56b","Type":"ContainerStarted","Data":"48edc28923c410583d5e4d1d6c1449fae8e177c8403769617b2765002d44c39d"} Jun 11 18:39:02.649755 ip-10-0-130-170 kubenswrapper[2565]: I0611 18:39:02.649730 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-75d556bd77-mg8j2" event={"ID":"f5c11e16-ed9d-485a-87fa-b6092992558b","Type":"ContainerStarted","Data":"f205c387a5ce6a5d29c2cc1e1a2c5e10a343048b1c19989d89bbba471be671b7"} Jun 11 18:39:02.663563 ip-10-0-130-170 kubenswrapper[2565]: I0611 18:39:02.663519 2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/limitador-limitador-64c94fd64f-h72kn" podStartSLOduration=1.766064037 podStartE2EDuration="6.66350541s" totalImagesPullingTime="4.897441373s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-11 18:38:56 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-11 18:39:02.662445937 +0000 UTC m=+661.411131962" watchObservedRunningTime="2026-06-11 18:39:02.66350541 +0000 UTC m=+661.412191432" Jun 11 18:39:02.676869 ip-10-0-130-170 kubenswrapper[2565]: I0611 18:39:02.676814 2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/authorino-75d556bd77-mg8j2" podStartSLOduration=0.797135336 podStartE2EDuration="4.676800104s" totalImagesPullingTime="3.879664768s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-11 18:38:58 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-11 18:39:02.676176951 +0000 UTC m=+661.424862974" watchObservedRunningTime="2026-06-11 18:39:02.676800104 +0000 UTC m=+661.425486125" Jun 11 18:39:02.691485 ip-10-0-130-170 kubenswrapper[2565]: I0611 18:39:02.691438 2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/authorino-58cd955675-fgpnr" podStartSLOduration=1.6495348779999999 podStartE2EDuration="5.691423246s" totalImagesPullingTime="4.041888368s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-11 18:38:57 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-11 18:39:02.68914007 +0000 UTC m=+661.437826092" watchObservedRunningTime="2026-06-11 18:39:02.691423246 +0000 UTC m=+661.440109268" Jun 11 18:39:02.721851 ip-10-0-130-170 kubenswrapper[2565]: I0611 18:39:02.721819 2565 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-58cd955675-fgpnr"] Jun 11 18:39:04.660867 ip-10-0-130-170 kubenswrapper[2565]: I0611 18:39:04.660820 2565 kuberuntime_container.go:872] "Killing container with a grace period" pod="kuadrant-system/authorino-58cd955675-fgpnr" podUID="27b71a8b-1337-4bd2-be19-3c6e448ad56b" containerName="authorino" containerID="cri-o://48edc28923c410583d5e4d1d6c1449fae8e177c8403769617b2765002d44c39d" gracePeriod=30 Jun 11 18:39:04.913542 ip-10-0-130-170 kubenswrapper[2565]: I0611 18:39:04.913485 2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-58cd955675-fgpnr" Jun 11 18:39:05.047937 ip-10-0-130-170 kubenswrapper[2565]: I0611 18:39:05.047901 2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-n2hgf\" (UniqueName: \"kubernetes.io/projected/27b71a8b-1337-4bd2-be19-3c6e448ad56b-kube-api-access-n2hgf\") pod \"27b71a8b-1337-4bd2-be19-3c6e448ad56b\" (UID: \"27b71a8b-1337-4bd2-be19-3c6e448ad56b\") " Jun 11 18:39:05.050113 ip-10-0-130-170 kubenswrapper[2565]: I0611 18:39:05.050088 2565 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/27b71a8b-1337-4bd2-be19-3c6e448ad56b-kube-api-access-n2hgf" (OuterVolumeSpecName: "kube-api-access-n2hgf") pod "27b71a8b-1337-4bd2-be19-3c6e448ad56b" (UID: "27b71a8b-1337-4bd2-be19-3c6e448ad56b"). InnerVolumeSpecName "kube-api-access-n2hgf". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 11 18:39:05.149142 ip-10-0-130-170 kubenswrapper[2565]: I0611 18:39:05.149102 2565 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-n2hgf\" (UniqueName: \"kubernetes.io/projected/27b71a8b-1337-4bd2-be19-3c6e448ad56b-kube-api-access-n2hgf\") on node \"ip-10-0-130-170.ec2.internal\" DevicePath \"\"" Jun 11 18:39:05.666934 ip-10-0-130-170 kubenswrapper[2565]: I0611 18:39:05.666894 2565 generic.go:356] "Generic (PLEG): container finished" podID="27b71a8b-1337-4bd2-be19-3c6e448ad56b" containerID="48edc28923c410583d5e4d1d6c1449fae8e177c8403769617b2765002d44c39d" exitCode=0 Jun 11 18:39:05.666934 ip-10-0-130-170 kubenswrapper[2565]: I0611 18:39:05.666928 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-58cd955675-fgpnr" event={"ID":"27b71a8b-1337-4bd2-be19-3c6e448ad56b","Type":"ContainerDied","Data":"48edc28923c410583d5e4d1d6c1449fae8e177c8403769617b2765002d44c39d"} Jun 11 18:39:05.667427 ip-10-0-130-170 kubenswrapper[2565]: I0611 18:39:05.666944 2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-58cd955675-fgpnr" Jun 11 18:39:05.667427 ip-10-0-130-170 kubenswrapper[2565]: I0611 18:39:05.666973 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-58cd955675-fgpnr" event={"ID":"27b71a8b-1337-4bd2-be19-3c6e448ad56b","Type":"ContainerDied","Data":"33f9004f0cb10e5e029b7dd87a0364c580ac9323ac392de41b17e6907c9fd880"} Jun 11 18:39:05.667427 ip-10-0-130-170 kubenswrapper[2565]: I0611 18:39:05.666993 2565 scope.go:117] "RemoveContainer" containerID="48edc28923c410583d5e4d1d6c1449fae8e177c8403769617b2765002d44c39d" Jun 11 18:39:05.676607 ip-10-0-130-170 kubenswrapper[2565]: I0611 18:39:05.676590 2565 scope.go:117] "RemoveContainer" containerID="48edc28923c410583d5e4d1d6c1449fae8e177c8403769617b2765002d44c39d" Jun 11 18:39:05.676883 ip-10-0-130-170 kubenswrapper[2565]: E0611 18:39:05.676865 2565 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"48edc28923c410583d5e4d1d6c1449fae8e177c8403769617b2765002d44c39d\": container with ID starting with 48edc28923c410583d5e4d1d6c1449fae8e177c8403769617b2765002d44c39d not found: ID does not exist" containerID="48edc28923c410583d5e4d1d6c1449fae8e177c8403769617b2765002d44c39d" Jun 11 18:39:05.676927 ip-10-0-130-170 kubenswrapper[2565]: I0611 18:39:05.676893 2565 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"48edc28923c410583d5e4d1d6c1449fae8e177c8403769617b2765002d44c39d"} err="failed to get container status \"48edc28923c410583d5e4d1d6c1449fae8e177c8403769617b2765002d44c39d\": rpc error: code = NotFound desc = could not find container \"48edc28923c410583d5e4d1d6c1449fae8e177c8403769617b2765002d44c39d\": container with ID starting with 48edc28923c410583d5e4d1d6c1449fae8e177c8403769617b2765002d44c39d not found: ID does not exist" Jun 11 18:39:05.688128 ip-10-0-130-170 kubenswrapper[2565]: I0611 18:39:05.688101 2565 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-58cd955675-fgpnr"] Jun 11 18:39:05.691468 ip-10-0-130-170 kubenswrapper[2565]: I0611 18:39:05.691447 2565 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/authorino-58cd955675-fgpnr"] Jun 11 18:39:05.749127 ip-10-0-130-170 kubenswrapper[2565]: I0611 18:39:05.749097 2565 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="27b71a8b-1337-4bd2-be19-3c6e448ad56b" path="/var/lib/kubelet/pods/27b71a8b-1337-4bd2-be19-3c6e448ad56b/volumes" Jun 11 18:39:12.304196 ip-10-0-130-170 kubenswrapper[2565]: I0611 18:39:12.304158 2565 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/limitador-limitador-64c94fd64f-h72kn"] Jun 11 18:39:12.304669 ip-10-0-130-170 kubenswrapper[2565]: I0611 18:39:12.304388 2565 kuberuntime_container.go:872] "Killing container with a grace period" pod="kuadrant-system/limitador-limitador-64c94fd64f-h72kn" podUID="aa98c487-e68a-4d3b-965c-9e6bd97a25fe" containerName="limitador" containerID="cri-o://a1708d1e9d86efaf65489b21a3857b234da23edef8ddc547972fdbc3793bf0bc" gracePeriod=30 Jun 11 18:39:12.305165 ip-10-0-130-170 kubenswrapper[2565]: I0611 18:39:12.305148 2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/limitador-limitador-64c94fd64f-h72kn" Jun 11 18:39:12.866511 ip-10-0-130-170 kubenswrapper[2565]: I0611 18:39:12.866451 2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-64c94fd64f-h72kn" Jun 11 18:39:13.015275 ip-10-0-130-170 kubenswrapper[2565]: I0611 18:39:13.015226 2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/aa98c487-e68a-4d3b-965c-9e6bd97a25fe-config-file\") pod \"aa98c487-e68a-4d3b-965c-9e6bd97a25fe\" (UID: \"aa98c487-e68a-4d3b-965c-9e6bd97a25fe\") " Jun 11 18:39:13.015462 ip-10-0-130-170 kubenswrapper[2565]: I0611 18:39:13.015341 2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-npdhr\" (UniqueName: \"kubernetes.io/projected/aa98c487-e68a-4d3b-965c-9e6bd97a25fe-kube-api-access-npdhr\") pod \"aa98c487-e68a-4d3b-965c-9e6bd97a25fe\" (UID: \"aa98c487-e68a-4d3b-965c-9e6bd97a25fe\") " Jun 11 18:39:13.015611 ip-10-0-130-170 kubenswrapper[2565]: I0611 18:39:13.015585 2565 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/aa98c487-e68a-4d3b-965c-9e6bd97a25fe-config-file" (OuterVolumeSpecName: "config-file") pod "aa98c487-e68a-4d3b-965c-9e6bd97a25fe" (UID: "aa98c487-e68a-4d3b-965c-9e6bd97a25fe"). InnerVolumeSpecName "config-file". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 11 18:39:13.017645 ip-10-0-130-170 kubenswrapper[2565]: I0611 18:39:13.017607 2565 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/aa98c487-e68a-4d3b-965c-9e6bd97a25fe-kube-api-access-npdhr" (OuterVolumeSpecName: "kube-api-access-npdhr") pod "aa98c487-e68a-4d3b-965c-9e6bd97a25fe" (UID: "aa98c487-e68a-4d3b-965c-9e6bd97a25fe"). InnerVolumeSpecName "kube-api-access-npdhr". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 11 18:39:13.116251 ip-10-0-130-170 kubenswrapper[2565]: I0611 18:39:13.116213 2565 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-npdhr\" (UniqueName: \"kubernetes.io/projected/aa98c487-e68a-4d3b-965c-9e6bd97a25fe-kube-api-access-npdhr\") on node \"ip-10-0-130-170.ec2.internal\" DevicePath \"\"" Jun 11 18:39:13.116251 ip-10-0-130-170 kubenswrapper[2565]: I0611 18:39:13.116243 2565 reconciler_common.go:299] "Volume detached for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/aa98c487-e68a-4d3b-965c-9e6bd97a25fe-config-file\") on node \"ip-10-0-130-170.ec2.internal\" DevicePath \"\"" Jun 11 18:39:13.711230 ip-10-0-130-170 kubenswrapper[2565]: I0611 18:39:13.711193 2565 generic.go:356] "Generic (PLEG): container finished" podID="aa98c487-e68a-4d3b-965c-9e6bd97a25fe" containerID="a1708d1e9d86efaf65489b21a3857b234da23edef8ddc547972fdbc3793bf0bc" exitCode=0 Jun 11 18:39:13.711725 ip-10-0-130-170 kubenswrapper[2565]: I0611 18:39:13.711240 2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-64c94fd64f-h72kn" Jun 11 18:39:13.711725 ip-10-0-130-170 kubenswrapper[2565]: I0611 18:39:13.711282 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-64c94fd64f-h72kn" event={"ID":"aa98c487-e68a-4d3b-965c-9e6bd97a25fe","Type":"ContainerDied","Data":"a1708d1e9d86efaf65489b21a3857b234da23edef8ddc547972fdbc3793bf0bc"} Jun 11 18:39:13.711725 ip-10-0-130-170 kubenswrapper[2565]: I0611 18:39:13.711333 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-64c94fd64f-h72kn" event={"ID":"aa98c487-e68a-4d3b-965c-9e6bd97a25fe","Type":"ContainerDied","Data":"946eebe0b9218a2825cd32a4d617d1a98697022f91c11da31aaf3d539eeeb504"} Jun 11 18:39:13.711725 ip-10-0-130-170 kubenswrapper[2565]: I0611 18:39:13.711356 2565 scope.go:117] "RemoveContainer" containerID="a1708d1e9d86efaf65489b21a3857b234da23edef8ddc547972fdbc3793bf0bc" Jun 11 18:39:13.720789 ip-10-0-130-170 kubenswrapper[2565]: I0611 18:39:13.720774 2565 scope.go:117] "RemoveContainer" containerID="a1708d1e9d86efaf65489b21a3857b234da23edef8ddc547972fdbc3793bf0bc" Jun 11 18:39:13.721058 ip-10-0-130-170 kubenswrapper[2565]: E0611 18:39:13.721042 2565 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"a1708d1e9d86efaf65489b21a3857b234da23edef8ddc547972fdbc3793bf0bc\": container with ID starting with a1708d1e9d86efaf65489b21a3857b234da23edef8ddc547972fdbc3793bf0bc not found: ID does not exist" containerID="a1708d1e9d86efaf65489b21a3857b234da23edef8ddc547972fdbc3793bf0bc" Jun 11 18:39:13.721104 ip-10-0-130-170 kubenswrapper[2565]: I0611 18:39:13.721068 2565 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"a1708d1e9d86efaf65489b21a3857b234da23edef8ddc547972fdbc3793bf0bc"} err="failed to get container status \"a1708d1e9d86efaf65489b21a3857b234da23edef8ddc547972fdbc3793bf0bc\": rpc error: code = NotFound desc = could not find container \"a1708d1e9d86efaf65489b21a3857b234da23edef8ddc547972fdbc3793bf0bc\": container with ID starting with a1708d1e9d86efaf65489b21a3857b234da23edef8ddc547972fdbc3793bf0bc not found: ID does not exist" Jun 11 18:39:13.733366 ip-10-0-130-170 kubenswrapper[2565]: I0611 18:39:13.733337 2565 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/limitador-limitador-64c94fd64f-h72kn"] Jun 11 18:39:13.735661 ip-10-0-130-170 kubenswrapper[2565]: I0611 18:39:13.735641 2565 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/limitador-limitador-64c94fd64f-h72kn"] Jun 11 18:39:13.748672 ip-10-0-130-170 kubenswrapper[2565]: I0611 18:39:13.748645 2565 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="aa98c487-e68a-4d3b-965c-9e6bd97a25fe" path="/var/lib/kubelet/pods/aa98c487-e68a-4d3b-965c-9e6bd97a25fe/volumes" Jun 11 18:39:15.139465 ip-10-0-130-170 kubenswrapper[2565]: I0611 18:39:15.139431 2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/postgres-69fb4594cf-sgst5"] Jun 11 18:39:15.139841 ip-10-0-130-170 kubenswrapper[2565]: I0611 18:39:15.139825 2565 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="27b71a8b-1337-4bd2-be19-3c6e448ad56b" containerName="authorino" Jun 11 18:39:15.139890 ip-10-0-130-170 kubenswrapper[2565]: I0611 18:39:15.139843 2565 state_mem.go:107] "Deleted CPUSet assignment" podUID="27b71a8b-1337-4bd2-be19-3c6e448ad56b" containerName="authorino" Jun 11 18:39:15.139890 ip-10-0-130-170 kubenswrapper[2565]: I0611 18:39:15.139861 2565 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="aa98c487-e68a-4d3b-965c-9e6bd97a25fe" containerName="limitador" Jun 11 18:39:15.139890 ip-10-0-130-170 kubenswrapper[2565]: I0611 18:39:15.139869 2565 state_mem.go:107] "Deleted CPUSet assignment" podUID="aa98c487-e68a-4d3b-965c-9e6bd97a25fe" containerName="limitador" Jun 11 18:39:15.140035 ip-10-0-130-170 kubenswrapper[2565]: I0611 18:39:15.139967 2565 memory_manager.go:368] "RemoveStaleState removing state" podUID="27b71a8b-1337-4bd2-be19-3c6e448ad56b" containerName="authorino" Jun 11 18:39:15.140035 ip-10-0-130-170 kubenswrapper[2565]: I0611 18:39:15.139980 2565 memory_manager.go:368] "RemoveStaleState removing state" podUID="aa98c487-e68a-4d3b-965c-9e6bd97a25fe" containerName="limitador" Jun 11 18:39:15.144248 ip-10-0-130-170 kubenswrapper[2565]: I0611 18:39:15.144226 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/postgres-69fb4594cf-sgst5" Jun 11 18:39:15.147379 ip-10-0-130-170 kubenswrapper[2565]: I0611 18:39:15.147358 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"postgres-creds\"" Jun 11 18:39:15.147500 ip-10-0-130-170 kubenswrapper[2565]: I0611 18:39:15.147396 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"default-dockercfg-mtn5v\"" Jun 11 18:39:15.151994 ip-10-0-130-170 kubenswrapper[2565]: I0611 18:39:15.151975 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/postgres-69fb4594cf-sgst5"] Jun 11 18:39:15.234508 ip-10-0-130-170 kubenswrapper[2565]: I0611 18:39:15.234470 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data\" (UniqueName: \"kubernetes.io/empty-dir/470bf921-3acd-4689-9217-c858efd6b61e-data\") pod \"postgres-69fb4594cf-sgst5\" (UID: \"470bf921-3acd-4689-9217-c858efd6b61e\") " pod="opendatahub/postgres-69fb4594cf-sgst5" Jun 11 18:39:15.234700 ip-10-0-130-170 kubenswrapper[2565]: I0611 18:39:15.234548 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zwzbq\" (UniqueName: \"kubernetes.io/projected/470bf921-3acd-4689-9217-c858efd6b61e-kube-api-access-zwzbq\") pod \"postgres-69fb4594cf-sgst5\" (UID: \"470bf921-3acd-4689-9217-c858efd6b61e\") " pod="opendatahub/postgres-69fb4594cf-sgst5" Jun 11 18:39:15.335638 ip-10-0-130-170 kubenswrapper[2565]: I0611 18:39:15.335604 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zwzbq\" (UniqueName: \"kubernetes.io/projected/470bf921-3acd-4689-9217-c858efd6b61e-kube-api-access-zwzbq\") pod \"postgres-69fb4594cf-sgst5\" (UID: \"470bf921-3acd-4689-9217-c858efd6b61e\") " pod="opendatahub/postgres-69fb4594cf-sgst5" Jun 11 18:39:15.335812 ip-10-0-130-170 kubenswrapper[2565]: I0611 18:39:15.335667 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"data\" (UniqueName: \"kubernetes.io/empty-dir/470bf921-3acd-4689-9217-c858efd6b61e-data\") pod \"postgres-69fb4594cf-sgst5\" (UID: \"470bf921-3acd-4689-9217-c858efd6b61e\") " pod="opendatahub/postgres-69fb4594cf-sgst5" Jun 11 18:39:15.336069 ip-10-0-130-170 kubenswrapper[2565]: I0611 18:39:15.336050 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"data\" (UniqueName: \"kubernetes.io/empty-dir/470bf921-3acd-4689-9217-c858efd6b61e-data\") pod \"postgres-69fb4594cf-sgst5\" (UID: \"470bf921-3acd-4689-9217-c858efd6b61e\") " pod="opendatahub/postgres-69fb4594cf-sgst5" Jun 11 18:39:15.344441 ip-10-0-130-170 kubenswrapper[2565]: I0611 18:39:15.344407 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-zwzbq\" (UniqueName: \"kubernetes.io/projected/470bf921-3acd-4689-9217-c858efd6b61e-kube-api-access-zwzbq\") pod \"postgres-69fb4594cf-sgst5\" (UID: \"470bf921-3acd-4689-9217-c858efd6b61e\") " pod="opendatahub/postgres-69fb4594cf-sgst5" Jun 11 18:39:15.457635 ip-10-0-130-170 kubenswrapper[2565]: I0611 18:39:15.457538 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/postgres-69fb4594cf-sgst5" Jun 11 18:39:15.595687 ip-10-0-130-170 kubenswrapper[2565]: I0611 18:39:15.595658 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/postgres-69fb4594cf-sgst5"] Jun 11 18:39:15.596917 ip-10-0-130-170 kubenswrapper[2565]: W0611 18:39:15.596889 2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod470bf921_3acd_4689_9217_c858efd6b61e.slice/crio-49e1dc89fbc0c0664ed3a021a1e468d3420afac72c3fd0df2466e9ace5c46dfc WatchSource:0}: Error finding container 49e1dc89fbc0c0664ed3a021a1e468d3420afac72c3fd0df2466e9ace5c46dfc: Status 404 returned error can't find the container with id 49e1dc89fbc0c0664ed3a021a1e468d3420afac72c3fd0df2466e9ace5c46dfc Jun 11 18:39:15.730993 ip-10-0-130-170 kubenswrapper[2565]: I0611 18:39:15.730903 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/postgres-69fb4594cf-sgst5" event={"ID":"470bf921-3acd-4689-9217-c858efd6b61e","Type":"ContainerStarted","Data":"49e1dc89fbc0c0664ed3a021a1e468d3420afac72c3fd0df2466e9ace5c46dfc"} Jun 11 18:39:18.756146 ip-10-0-130-170 kubenswrapper[2565]: I0611 18:39:18.756107 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/postgres-69fb4594cf-sgst5" event={"ID":"470bf921-3acd-4689-9217-c858efd6b61e","Type":"ContainerStarted","Data":"4b1ec7f89d40784e4e805e15a8e5eed64c884515cc74f5ddf9b6d48704e7bb98"} Jun 11 18:39:18.756632 ip-10-0-130-170 kubenswrapper[2565]: I0611 18:39:18.756276 2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/postgres-69fb4594cf-sgst5" Jun 11 18:39:18.773453 ip-10-0-130-170 kubenswrapper[2565]: I0611 18:39:18.773404 2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/postgres-69fb4594cf-sgst5" podStartSLOduration=1.390639202 podStartE2EDuration="3.773388436s" totalImagesPullingTime="2.382749234s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-11 18:39:15 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-11 18:39:18.772043799 +0000 UTC m=+677.520729822" watchObservedRunningTime="2026-06-11 18:39:18.773388436 +0000 UTC m=+677.522074458" Jun 11 18:39:24.797534 ip-10-0-130-170 kubenswrapper[2565]: I0611 18:39:24.797505 2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/postgres-69fb4594cf-sgst5" Jun 11 18:39:26.192883 ip-10-0-130-170 kubenswrapper[2565]: I0611 18:39:26.192840 2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-marketplace/0228a3cc79630676fae641e6a38dab1752e85a08a4a9edc59ccf0da748qrh7r"] Jun 11 18:39:26.198502 ip-10-0-130-170 kubenswrapper[2565]: I0611 18:39:26.198481 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/0228a3cc79630676fae641e6a38dab1752e85a08a4a9edc59ccf0da748qrh7r" Jun 11 18:39:26.201026 ip-10-0-130-170 kubenswrapper[2565]: I0611 18:39:26.201004 2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"openshift-service-ca.crt\"" Jun 11 18:39:26.202140 ip-10-0-130-170 kubenswrapper[2565]: I0611 18:39:26.202118 2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"kube-root-ca.crt\"" Jun 11 18:39:26.202554 ip-10-0-130-170 kubenswrapper[2565]: I0611 18:39:26.202532 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-marketplace\"/\"default-dockercfg-8jd6m\"" Jun 11 18:39:26.205026 ip-10-0-130-170 kubenswrapper[2565]: I0611 18:39:26.205004 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/0228a3cc79630676fae641e6a38dab1752e85a08a4a9edc59ccf0da748qrh7r"] Jun 11 18:39:26.335399 ip-10-0-130-170 kubenswrapper[2565]: I0611 18:39:26.335361 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/4d8ce8ec-6c82-480b-8a9b-42ed429387d4-util\") pod \"0228a3cc79630676fae641e6a38dab1752e85a08a4a9edc59ccf0da748qrh7r\" (UID: \"4d8ce8ec-6c82-480b-8a9b-42ed429387d4\") " pod="openshift-marketplace/0228a3cc79630676fae641e6a38dab1752e85a08a4a9edc59ccf0da748qrh7r" Jun 11 18:39:26.335574 ip-10-0-130-170 kubenswrapper[2565]: I0611 18:39:26.335484 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/4d8ce8ec-6c82-480b-8a9b-42ed429387d4-bundle\") pod \"0228a3cc79630676fae641e6a38dab1752e85a08a4a9edc59ccf0da748qrh7r\" (UID: \"4d8ce8ec-6c82-480b-8a9b-42ed429387d4\") " pod="openshift-marketplace/0228a3cc79630676fae641e6a38dab1752e85a08a4a9edc59ccf0da748qrh7r" Jun 11 18:39:26.335574 ip-10-0-130-170 kubenswrapper[2565]: I0611 18:39:26.335526 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mm2v2\" (UniqueName: \"kubernetes.io/projected/4d8ce8ec-6c82-480b-8a9b-42ed429387d4-kube-api-access-mm2v2\") pod \"0228a3cc79630676fae641e6a38dab1752e85a08a4a9edc59ccf0da748qrh7r\" (UID: \"4d8ce8ec-6c82-480b-8a9b-42ed429387d4\") " pod="openshift-marketplace/0228a3cc79630676fae641e6a38dab1752e85a08a4a9edc59ccf0da748qrh7r" Jun 11 18:39:26.435933 ip-10-0-130-170 kubenswrapper[2565]: I0611 18:39:26.435898 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/4d8ce8ec-6c82-480b-8a9b-42ed429387d4-bundle\") pod \"0228a3cc79630676fae641e6a38dab1752e85a08a4a9edc59ccf0da748qrh7r\" (UID: \"4d8ce8ec-6c82-480b-8a9b-42ed429387d4\") " pod="openshift-marketplace/0228a3cc79630676fae641e6a38dab1752e85a08a4a9edc59ccf0da748qrh7r" Jun 11 18:39:26.435933 ip-10-0-130-170 kubenswrapper[2565]: I0611 18:39:26.435938 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mm2v2\" (UniqueName: \"kubernetes.io/projected/4d8ce8ec-6c82-480b-8a9b-42ed429387d4-kube-api-access-mm2v2\") pod \"0228a3cc79630676fae641e6a38dab1752e85a08a4a9edc59ccf0da748qrh7r\" (UID: \"4d8ce8ec-6c82-480b-8a9b-42ed429387d4\") " pod="openshift-marketplace/0228a3cc79630676fae641e6a38dab1752e85a08a4a9edc59ccf0da748qrh7r" Jun 11 18:39:26.436182 ip-10-0-130-170 kubenswrapper[2565]: I0611 18:39:26.435980 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/4d8ce8ec-6c82-480b-8a9b-42ed429387d4-util\") pod \"0228a3cc79630676fae641e6a38dab1752e85a08a4a9edc59ccf0da748qrh7r\" (UID: \"4d8ce8ec-6c82-480b-8a9b-42ed429387d4\") " pod="openshift-marketplace/0228a3cc79630676fae641e6a38dab1752e85a08a4a9edc59ccf0da748qrh7r" Jun 11 18:39:26.436311 ip-10-0-130-170 kubenswrapper[2565]: I0611 18:39:26.436291 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/4d8ce8ec-6c82-480b-8a9b-42ed429387d4-bundle\") pod \"0228a3cc79630676fae641e6a38dab1752e85a08a4a9edc59ccf0da748qrh7r\" (UID: \"4d8ce8ec-6c82-480b-8a9b-42ed429387d4\") " pod="openshift-marketplace/0228a3cc79630676fae641e6a38dab1752e85a08a4a9edc59ccf0da748qrh7r" Jun 11 18:39:26.436385 ip-10-0-130-170 kubenswrapper[2565]: I0611 18:39:26.436330 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/4d8ce8ec-6c82-480b-8a9b-42ed429387d4-util\") pod \"0228a3cc79630676fae641e6a38dab1752e85a08a4a9edc59ccf0da748qrh7r\" (UID: \"4d8ce8ec-6c82-480b-8a9b-42ed429387d4\") " pod="openshift-marketplace/0228a3cc79630676fae641e6a38dab1752e85a08a4a9edc59ccf0da748qrh7r" Jun 11 18:39:26.445570 ip-10-0-130-170 kubenswrapper[2565]: I0611 18:39:26.445506 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-mm2v2\" (UniqueName: \"kubernetes.io/projected/4d8ce8ec-6c82-480b-8a9b-42ed429387d4-kube-api-access-mm2v2\") pod \"0228a3cc79630676fae641e6a38dab1752e85a08a4a9edc59ccf0da748qrh7r\" (UID: \"4d8ce8ec-6c82-480b-8a9b-42ed429387d4\") " pod="openshift-marketplace/0228a3cc79630676fae641e6a38dab1752e85a08a4a9edc59ccf0da748qrh7r" Jun 11 18:39:26.509346 ip-10-0-130-170 kubenswrapper[2565]: I0611 18:39:26.509301 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/0228a3cc79630676fae641e6a38dab1752e85a08a4a9edc59ccf0da748qrh7r" Jun 11 18:39:26.674103 ip-10-0-130-170 kubenswrapper[2565]: I0611 18:39:26.674071 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/0228a3cc79630676fae641e6a38dab1752e85a08a4a9edc59ccf0da748qrh7r"] Jun 11 18:39:26.675733 ip-10-0-130-170 kubenswrapper[2565]: W0611 18:39:26.675697 2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4d8ce8ec_6c82_480b_8a9b_42ed429387d4.slice/crio-12a4c4855e90257e0b06656bb447667cbf46c8e12021949f32f07c97adcc60b5 WatchSource:0}: Error finding container 12a4c4855e90257e0b06656bb447667cbf46c8e12021949f32f07c97adcc60b5: Status 404 returned error can't find the container with id 12a4c4855e90257e0b06656bb447667cbf46c8e12021949f32f07c97adcc60b5 Jun 11 18:39:26.798951 ip-10-0-130-170 kubenswrapper[2565]: I0611 18:39:26.798923 2565 generic.go:356] "Generic (PLEG): container finished" podID="4d8ce8ec-6c82-480b-8a9b-42ed429387d4" containerID="c20b1ae2fabe167bd670d3a21d060c68fdeebdd16add0bc854d1d696916cb890" exitCode=0 Jun 11 18:39:26.799097 ip-10-0-130-170 kubenswrapper[2565]: I0611 18:39:26.799009 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/0228a3cc79630676fae641e6a38dab1752e85a08a4a9edc59ccf0da748qrh7r" event={"ID":"4d8ce8ec-6c82-480b-8a9b-42ed429387d4","Type":"ContainerDied","Data":"c20b1ae2fabe167bd670d3a21d060c68fdeebdd16add0bc854d1d696916cb890"} Jun 11 18:39:26.799097 ip-10-0-130-170 kubenswrapper[2565]: I0611 18:39:26.799055 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/0228a3cc79630676fae641e6a38dab1752e85a08a4a9edc59ccf0da748qrh7r" event={"ID":"4d8ce8ec-6c82-480b-8a9b-42ed429387d4","Type":"ContainerStarted","Data":"12a4c4855e90257e0b06656bb447667cbf46c8e12021949f32f07c97adcc60b5"} Jun 11 18:39:28.812723 ip-10-0-130-170 kubenswrapper[2565]: I0611 18:39:28.812690 2565 generic.go:356] "Generic (PLEG): container finished" podID="4d8ce8ec-6c82-480b-8a9b-42ed429387d4" containerID="b16a43cb2cd55b7d59ac0e3a87ab0b9f03c236c66688bf312e758ecd8d4c68d1" exitCode=0 Jun 11 18:39:28.813180 ip-10-0-130-170 kubenswrapper[2565]: I0611 18:39:28.812782 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/0228a3cc79630676fae641e6a38dab1752e85a08a4a9edc59ccf0da748qrh7r" event={"ID":"4d8ce8ec-6c82-480b-8a9b-42ed429387d4","Type":"ContainerDied","Data":"b16a43cb2cd55b7d59ac0e3a87ab0b9f03c236c66688bf312e758ecd8d4c68d1"} Jun 11 18:39:29.821381 ip-10-0-130-170 kubenswrapper[2565]: I0611 18:39:29.821347 2565 generic.go:356] "Generic (PLEG): container finished" podID="4d8ce8ec-6c82-480b-8a9b-42ed429387d4" containerID="7046cceb80bf8d8545c4f5f1fab0fad2bde62cf76938f62a00e77d8ac9f97b98" exitCode=0 Jun 11 18:39:29.821749 ip-10-0-130-170 kubenswrapper[2565]: I0611 18:39:29.821428 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/0228a3cc79630676fae641e6a38dab1752e85a08a4a9edc59ccf0da748qrh7r" event={"ID":"4d8ce8ec-6c82-480b-8a9b-42ed429387d4","Type":"ContainerDied","Data":"7046cceb80bf8d8545c4f5f1fab0fad2bde62cf76938f62a00e77d8ac9f97b98"} Jun 11 18:39:30.969477 ip-10-0-130-170 kubenswrapper[2565]: I0611 18:39:30.969448 2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/0228a3cc79630676fae641e6a38dab1752e85a08a4a9edc59ccf0da748qrh7r" Jun 11 18:39:31.074169 ip-10-0-130-170 kubenswrapper[2565]: I0611 18:39:31.074141 2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/4d8ce8ec-6c82-480b-8a9b-42ed429387d4-util\") pod \"4d8ce8ec-6c82-480b-8a9b-42ed429387d4\" (UID: \"4d8ce8ec-6c82-480b-8a9b-42ed429387d4\") " Jun 11 18:39:31.074360 ip-10-0-130-170 kubenswrapper[2565]: I0611 18:39:31.074198 2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-mm2v2\" (UniqueName: \"kubernetes.io/projected/4d8ce8ec-6c82-480b-8a9b-42ed429387d4-kube-api-access-mm2v2\") pod \"4d8ce8ec-6c82-480b-8a9b-42ed429387d4\" (UID: \"4d8ce8ec-6c82-480b-8a9b-42ed429387d4\") " Jun 11 18:39:31.074360 ip-10-0-130-170 kubenswrapper[2565]: I0611 18:39:31.074272 2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/4d8ce8ec-6c82-480b-8a9b-42ed429387d4-bundle\") pod \"4d8ce8ec-6c82-480b-8a9b-42ed429387d4\" (UID: \"4d8ce8ec-6c82-480b-8a9b-42ed429387d4\") " Jun 11 18:39:31.074848 ip-10-0-130-170 kubenswrapper[2565]: I0611 18:39:31.074812 2565 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/4d8ce8ec-6c82-480b-8a9b-42ed429387d4-bundle" (OuterVolumeSpecName: "bundle") pod "4d8ce8ec-6c82-480b-8a9b-42ed429387d4" (UID: "4d8ce8ec-6c82-480b-8a9b-42ed429387d4"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 11 18:39:31.076454 ip-10-0-130-170 kubenswrapper[2565]: I0611 18:39:31.076431 2565 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/4d8ce8ec-6c82-480b-8a9b-42ed429387d4-kube-api-access-mm2v2" (OuterVolumeSpecName: "kube-api-access-mm2v2") pod "4d8ce8ec-6c82-480b-8a9b-42ed429387d4" (UID: "4d8ce8ec-6c82-480b-8a9b-42ed429387d4"). InnerVolumeSpecName "kube-api-access-mm2v2". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 11 18:39:31.079549 ip-10-0-130-170 kubenswrapper[2565]: I0611 18:39:31.079498 2565 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/4d8ce8ec-6c82-480b-8a9b-42ed429387d4-util" (OuterVolumeSpecName: "util") pod "4d8ce8ec-6c82-480b-8a9b-42ed429387d4" (UID: "4d8ce8ec-6c82-480b-8a9b-42ed429387d4"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 11 18:39:31.175422 ip-10-0-130-170 kubenswrapper[2565]: I0611 18:39:31.175390 2565 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-mm2v2\" (UniqueName: \"kubernetes.io/projected/4d8ce8ec-6c82-480b-8a9b-42ed429387d4-kube-api-access-mm2v2\") on node \"ip-10-0-130-170.ec2.internal\" DevicePath \"\"" Jun 11 18:39:31.175422 ip-10-0-130-170 kubenswrapper[2565]: I0611 18:39:31.175420 2565 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/4d8ce8ec-6c82-480b-8a9b-42ed429387d4-bundle\") on node \"ip-10-0-130-170.ec2.internal\" DevicePath \"\"" Jun 11 18:39:31.175422 ip-10-0-130-170 kubenswrapper[2565]: I0611 18:39:31.175432 2565 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/4d8ce8ec-6c82-480b-8a9b-42ed429387d4-util\") on node \"ip-10-0-130-170.ec2.internal\" DevicePath \"\"" Jun 11 18:39:31.833617 ip-10-0-130-170 kubenswrapper[2565]: I0611 18:39:31.833581 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/0228a3cc79630676fae641e6a38dab1752e85a08a4a9edc59ccf0da748qrh7r" event={"ID":"4d8ce8ec-6c82-480b-8a9b-42ed429387d4","Type":"ContainerDied","Data":"12a4c4855e90257e0b06656bb447667cbf46c8e12021949f32f07c97adcc60b5"} Jun 11 18:39:31.833617 ip-10-0-130-170 kubenswrapper[2565]: I0611 18:39:31.833619 2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/0228a3cc79630676fae641e6a38dab1752e85a08a4a9edc59ccf0da748qrh7r" Jun 11 18:39:31.833826 ip-10-0-130-170 kubenswrapper[2565]: I0611 18:39:31.833659 2565 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="12a4c4855e90257e0b06656bb447667cbf46c8e12021949f32f07c97adcc60b5" Jun 11 18:39:49.968054 ip-10-0-130-170 kubenswrapper[2565]: I0611 18:39:49.967969 2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["keycloak-system/maas-keycloak-0"] Jun 11 18:39:49.968625 ip-10-0-130-170 kubenswrapper[2565]: I0611 18:39:49.968518 2565 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="4d8ce8ec-6c82-480b-8a9b-42ed429387d4" containerName="pull" Jun 11 18:39:49.968625 ip-10-0-130-170 kubenswrapper[2565]: I0611 18:39:49.968540 2565 state_mem.go:107] "Deleted CPUSet assignment" podUID="4d8ce8ec-6c82-480b-8a9b-42ed429387d4" containerName="pull" Jun 11 18:39:49.968625 ip-10-0-130-170 kubenswrapper[2565]: I0611 18:39:49.968557 2565 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="4d8ce8ec-6c82-480b-8a9b-42ed429387d4" containerName="extract" Jun 11 18:39:49.968625 ip-10-0-130-170 kubenswrapper[2565]: I0611 18:39:49.968567 2565 state_mem.go:107] "Deleted CPUSet assignment" podUID="4d8ce8ec-6c82-480b-8a9b-42ed429387d4" containerName="extract" Jun 11 18:39:49.968625 ip-10-0-130-170 kubenswrapper[2565]: I0611 18:39:49.968603 2565 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="4d8ce8ec-6c82-480b-8a9b-42ed429387d4" containerName="util" Jun 11 18:39:49.968625 ip-10-0-130-170 kubenswrapper[2565]: I0611 18:39:49.968611 2565 state_mem.go:107] "Deleted CPUSet assignment" podUID="4d8ce8ec-6c82-480b-8a9b-42ed429387d4" containerName="util" Jun 11 18:39:49.968963 ip-10-0-130-170 kubenswrapper[2565]: I0611 18:39:49.968701 2565 memory_manager.go:368] "RemoveStaleState removing state" podUID="4d8ce8ec-6c82-480b-8a9b-42ed429387d4" containerName="extract" Jun 11 18:39:49.971770 ip-10-0-130-170 kubenswrapper[2565]: I0611 18:39:49.971750 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="keycloak-system/maas-keycloak-0" Jun 11 18:39:49.974552 ip-10-0-130-170 kubenswrapper[2565]: I0611 18:39:49.974525 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"keycloak-system\"/\"default-dockercfg-sc9nz\"" Jun 11 18:39:49.974552 ip-10-0-130-170 kubenswrapper[2565]: I0611 18:39:49.974525 2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"keycloak-system\"/\"kube-root-ca.crt\"" Jun 11 18:39:49.974720 ip-10-0-130-170 kubenswrapper[2565]: I0611 18:39:49.974525 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"keycloak-system\"/\"maas-keycloak-initial-admin\"" Jun 11 18:39:49.975336 ip-10-0-130-170 kubenswrapper[2565]: I0611 18:39:49.975323 2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"keycloak-system\"/\"openshift-service-ca.crt\"" Jun 11 18:39:49.983383 ip-10-0-130-170 kubenswrapper[2565]: I0611 18:39:49.983361 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["keycloak-system/maas-keycloak-0"] Jun 11 18:39:50.037964 ip-10-0-130-170 kubenswrapper[2565]: I0611 18:39:50.037924 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-lhncb\" (UniqueName: \"kubernetes.io/projected/37f7fd84-32dc-41f2-a38d-526538e33709-kube-api-access-lhncb\") pod \"maas-keycloak-0\" (UID: \"37f7fd84-32dc-41f2-a38d-526538e33709\") " pod="keycloak-system/maas-keycloak-0" Jun 11 18:39:50.139058 ip-10-0-130-170 kubenswrapper[2565]: I0611 18:39:50.139020 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-lhncb\" (UniqueName: \"kubernetes.io/projected/37f7fd84-32dc-41f2-a38d-526538e33709-kube-api-access-lhncb\") pod \"maas-keycloak-0\" (UID: \"37f7fd84-32dc-41f2-a38d-526538e33709\") " pod="keycloak-system/maas-keycloak-0" Jun 11 18:39:50.148129 ip-10-0-130-170 kubenswrapper[2565]: I0611 18:39:50.148099 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-lhncb\" (UniqueName: \"kubernetes.io/projected/37f7fd84-32dc-41f2-a38d-526538e33709-kube-api-access-lhncb\") pod \"maas-keycloak-0\" (UID: \"37f7fd84-32dc-41f2-a38d-526538e33709\") " pod="keycloak-system/maas-keycloak-0" Jun 11 18:39:50.281893 ip-10-0-130-170 kubenswrapper[2565]: I0611 18:39:50.281804 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="keycloak-system/maas-keycloak-0" Jun 11 18:39:50.417293 ip-10-0-130-170 kubenswrapper[2565]: I0611 18:39:50.417245 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["keycloak-system/maas-keycloak-0"] Jun 11 18:39:50.418512 ip-10-0-130-170 kubenswrapper[2565]: W0611 18:39:50.418487 2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod37f7fd84_32dc_41f2_a38d_526538e33709.slice/crio-623972494a5dda67a32a56f77129c315013e0c3443b6e4d13d7f1c3298c1ed75 WatchSource:0}: Error finding container 623972494a5dda67a32a56f77129c315013e0c3443b6e4d13d7f1c3298c1ed75: Status 404 returned error can't find the container with id 623972494a5dda67a32a56f77129c315013e0c3443b6e4d13d7f1c3298c1ed75 Jun 11 18:39:50.419853 ip-10-0-130-170 kubenswrapper[2565]: I0611 18:39:50.419833 2565 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jun 11 18:39:50.942295 ip-10-0-130-170 kubenswrapper[2565]: I0611 18:39:50.942238 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="keycloak-system/maas-keycloak-0" event={"ID":"37f7fd84-32dc-41f2-a38d-526538e33709","Type":"ContainerStarted","Data":"623972494a5dda67a32a56f77129c315013e0c3443b6e4d13d7f1c3298c1ed75"} Jun 11 18:39:56.985853 ip-10-0-130-170 kubenswrapper[2565]: I0611 18:39:56.985800 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="keycloak-system/maas-keycloak-0" event={"ID":"37f7fd84-32dc-41f2-a38d-526538e33709","Type":"ContainerStarted","Data":"e50ba2460c7ba69246c185ca007ec2c9dc01b839e471cf80fea4f5d0916cadc8"} Jun 11 18:39:57.006401 ip-10-0-130-170 kubenswrapper[2565]: I0611 18:39:57.006336 2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="keycloak-system/maas-keycloak-0" podStartSLOduration=2.438640169 podStartE2EDuration="8.006320853s" totalImagesPullingTime="5.567680684s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-11 18:39:49 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-11 18:39:57.003142255 +0000 UTC m=+715.751828281" watchObservedRunningTime="2026-06-11 18:39:57.006320853 +0000 UTC m=+715.755006876" Jun 11 18:39:57.282402 ip-10-0-130-170 kubenswrapper[2565]: I0611 18:39:57.282288 2565 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="keycloak-system/maas-keycloak-0" Jun 11 18:39:57.284291 ip-10-0-130-170 kubenswrapper[2565]: I0611 18:39:57.284227 2565 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="37f7fd84-32dc-41f2-a38d-526538e33709" containerName="keycloak" probeResult="failure" output="Get \"http://10.133.0.45:9000/health/started\": dial tcp 10.133.0.45:9000: connect: connection refused" Jun 11 18:39:58.283358 ip-10-0-130-170 kubenswrapper[2565]: I0611 18:39:58.283302 2565 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="37f7fd84-32dc-41f2-a38d-526538e33709" containerName="keycloak" probeResult="failure" output="Get \"http://10.133.0.45:9000/health/started\": dial tcp 10.133.0.45:9000: connect: connection refused" Jun 11 18:39:59.282572 ip-10-0-130-170 kubenswrapper[2565]: I0611 18:39:59.282519 2565 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="37f7fd84-32dc-41f2-a38d-526538e33709" containerName="keycloak" probeResult="failure" output="Get \"http://10.133.0.45:9000/health/started\": dial tcp 10.133.0.45:9000: connect: connection refused" Jun 11 18:40:00.282863 ip-10-0-130-170 kubenswrapper[2565]: I0611 18:40:00.282810 2565 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="37f7fd84-32dc-41f2-a38d-526538e33709" containerName="keycloak" probeResult="failure" output="Get \"http://10.133.0.45:9000/health/started\": dial tcp 10.133.0.45:9000: connect: connection refused" Jun 11 18:40:00.283940 ip-10-0-130-170 kubenswrapper[2565]: I0611 18:40:00.283906 2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="keycloak-system/maas-keycloak-0" Jun 11 18:40:01.282584 ip-10-0-130-170 kubenswrapper[2565]: I0611 18:40:01.282535 2565 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="37f7fd84-32dc-41f2-a38d-526538e33709" containerName="keycloak" probeResult="failure" output="Get \"http://10.133.0.45:9000/health/started\": dial tcp 10.133.0.45:9000: connect: connection refused" Jun 11 18:40:02.282393 ip-10-0-130-170 kubenswrapper[2565]: I0611 18:40:02.282342 2565 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="37f7fd84-32dc-41f2-a38d-526538e33709" containerName="keycloak" probeResult="failure" output="Get \"http://10.133.0.45:9000/health/started\": dial tcp 10.133.0.45:9000: connect: connection refused" Jun 11 18:40:03.283141 ip-10-0-130-170 kubenswrapper[2565]: I0611 18:40:03.283089 2565 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="37f7fd84-32dc-41f2-a38d-526538e33709" containerName="keycloak" probeResult="failure" output="Get \"http://10.133.0.45:9000/health/started\": dial tcp 10.133.0.45:9000: connect: connection refused" Jun 11 18:40:04.282697 ip-10-0-130-170 kubenswrapper[2565]: I0611 18:40:04.282644 2565 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="37f7fd84-32dc-41f2-a38d-526538e33709" containerName="keycloak" probeResult="failure" output="Get \"http://10.133.0.45:9000/health/started\": dial tcp 10.133.0.45:9000: connect: connection refused" Jun 11 18:40:05.282226 ip-10-0-130-170 kubenswrapper[2565]: I0611 18:40:05.282177 2565 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="37f7fd84-32dc-41f2-a38d-526538e33709" containerName="keycloak" probeResult="failure" output="Get \"http://10.133.0.45:9000/health/started\": dial tcp 10.133.0.45:9000: connect: connection refused" Jun 11 18:40:06.283083 ip-10-0-130-170 kubenswrapper[2565]: I0611 18:40:06.283013 2565 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="37f7fd84-32dc-41f2-a38d-526538e33709" containerName="keycloak" probeResult="failure" output="Get \"http://10.133.0.45:9000/health/started\": dial tcp 10.133.0.45:9000: connect: connection refused" Jun 11 18:40:07.283072 ip-10-0-130-170 kubenswrapper[2565]: I0611 18:40:07.283019 2565 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="37f7fd84-32dc-41f2-a38d-526538e33709" containerName="keycloak" probeResult="failure" output="Get \"http://10.133.0.45:9000/health/started\": dial tcp 10.133.0.45:9000: connect: connection refused" Jun 11 18:40:08.282690 ip-10-0-130-170 kubenswrapper[2565]: I0611 18:40:08.282643 2565 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="37f7fd84-32dc-41f2-a38d-526538e33709" containerName="keycloak" probeResult="failure" output="Get \"http://10.133.0.45:9000/health/started\": dial tcp 10.133.0.45:9000: connect: connection refused" Jun 11 18:40:09.401071 ip-10-0-130-170 kubenswrapper[2565]: I0611 18:40:09.401036 2565 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="keycloak-system/maas-keycloak-0" Jun 11 18:40:09.417692 ip-10-0-130-170 kubenswrapper[2565]: I0611 18:40:09.417638 2565 prober.go:120] "Probe failed" probeType="Readiness" pod="keycloak-system/maas-keycloak-0" podUID="37f7fd84-32dc-41f2-a38d-526538e33709" containerName="keycloak" probeResult="failure" output="HTTP probe failed with statuscode: 503" Jun 11 18:40:19.408193 ip-10-0-130-170 kubenswrapper[2565]: I0611 18:40:19.408144 2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="keycloak-system/maas-keycloak-0" Jun 11 18:40:20.358855 ip-10-0-130-170 kubenswrapper[2565]: I0611 18:40:20.358813 2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-5d4b67c446-46xwm"] Jun 11 18:40:20.365168 ip-10-0-130-170 kubenswrapper[2565]: I0611 18:40:20.365143 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-5d4b67c446-46xwm" Jun 11 18:40:20.369743 ip-10-0-130-170 kubenswrapper[2565]: I0611 18:40:20.369710 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-5d4b67c446-46xwm"] Jun 11 18:40:20.523163 ip-10-0-130-170 kubenswrapper[2565]: I0611 18:40:20.523119 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-slgns\" (UniqueName: \"kubernetes.io/projected/8b2f2f73-1294-4ed8-9e2a-c67a761e0399-kube-api-access-slgns\") pod \"authorino-5d4b67c446-46xwm\" (UID: \"8b2f2f73-1294-4ed8-9e2a-c67a761e0399\") " pod="kuadrant-system/authorino-5d4b67c446-46xwm" Jun 11 18:40:20.579034 ip-10-0-130-170 kubenswrapper[2565]: I0611 18:40:20.579000 2565 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-5d4b67c446-46xwm"] Jun 11 18:40:20.579303 ip-10-0-130-170 kubenswrapper[2565]: E0611 18:40:20.579280 2565 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[kube-api-access-slgns], unattached volumes=[], failed to process volumes=[]: context canceled" pod="kuadrant-system/authorino-5d4b67c446-46xwm" podUID="8b2f2f73-1294-4ed8-9e2a-c67a761e0399" Jun 11 18:40:20.608777 ip-10-0-130-170 kubenswrapper[2565]: I0611 18:40:20.608740 2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-56f854f9d-l8pf8"] Jun 11 18:40:20.611398 ip-10-0-130-170 kubenswrapper[2565]: I0611 18:40:20.611344 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-56f854f9d-l8pf8" Jun 11 18:40:20.614244 ip-10-0-130-170 kubenswrapper[2565]: I0611 18:40:20.614227 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"authorino-server-cert\"" Jun 11 18:40:20.620081 ip-10-0-130-170 kubenswrapper[2565]: I0611 18:40:20.620058 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-56f854f9d-l8pf8"] Jun 11 18:40:20.623963 ip-10-0-130-170 kubenswrapper[2565]: I0611 18:40:20.623940 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-slgns\" (UniqueName: \"kubernetes.io/projected/8b2f2f73-1294-4ed8-9e2a-c67a761e0399-kube-api-access-slgns\") pod \"authorino-5d4b67c446-46xwm\" (UID: \"8b2f2f73-1294-4ed8-9e2a-c67a761e0399\") " pod="kuadrant-system/authorino-5d4b67c446-46xwm" Jun 11 18:40:20.638591 ip-10-0-130-170 kubenswrapper[2565]: I0611 18:40:20.638558 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-slgns\" (UniqueName: \"kubernetes.io/projected/8b2f2f73-1294-4ed8-9e2a-c67a761e0399-kube-api-access-slgns\") pod \"authorino-5d4b67c446-46xwm\" (UID: \"8b2f2f73-1294-4ed8-9e2a-c67a761e0399\") " pod="kuadrant-system/authorino-5d4b67c446-46xwm" Jun 11 18:40:20.725284 ip-10-0-130-170 kubenswrapper[2565]: I0611 18:40:20.725229 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-bvpb9\" (UniqueName: \"kubernetes.io/projected/20286eda-0acf-44cf-8323-87b4594e0c23-kube-api-access-bvpb9\") pod \"authorino-56f854f9d-l8pf8\" (UID: \"20286eda-0acf-44cf-8323-87b4594e0c23\") " pod="kuadrant-system/authorino-56f854f9d-l8pf8" Jun 11 18:40:20.725456 ip-10-0-130-170 kubenswrapper[2565]: I0611 18:40:20.725350 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/20286eda-0acf-44cf-8323-87b4594e0c23-tls-cert\") pod \"authorino-56f854f9d-l8pf8\" (UID: \"20286eda-0acf-44cf-8323-87b4594e0c23\") " pod="kuadrant-system/authorino-56f854f9d-l8pf8" Jun 11 18:40:20.826500 ip-10-0-130-170 kubenswrapper[2565]: I0611 18:40:20.826464 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-bvpb9\" (UniqueName: \"kubernetes.io/projected/20286eda-0acf-44cf-8323-87b4594e0c23-kube-api-access-bvpb9\") pod \"authorino-56f854f9d-l8pf8\" (UID: \"20286eda-0acf-44cf-8323-87b4594e0c23\") " pod="kuadrant-system/authorino-56f854f9d-l8pf8" Jun 11 18:40:20.826676 ip-10-0-130-170 kubenswrapper[2565]: I0611 18:40:20.826542 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/20286eda-0acf-44cf-8323-87b4594e0c23-tls-cert\") pod \"authorino-56f854f9d-l8pf8\" (UID: \"20286eda-0acf-44cf-8323-87b4594e0c23\") " pod="kuadrant-system/authorino-56f854f9d-l8pf8" Jun 11 18:40:20.829105 ip-10-0-130-170 kubenswrapper[2565]: I0611 18:40:20.829086 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/20286eda-0acf-44cf-8323-87b4594e0c23-tls-cert\") pod \"authorino-56f854f9d-l8pf8\" (UID: \"20286eda-0acf-44cf-8323-87b4594e0c23\") " pod="kuadrant-system/authorino-56f854f9d-l8pf8" Jun 11 18:40:20.834963 ip-10-0-130-170 kubenswrapper[2565]: I0611 18:40:20.834943 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-bvpb9\" (UniqueName: \"kubernetes.io/projected/20286eda-0acf-44cf-8323-87b4594e0c23-kube-api-access-bvpb9\") pod \"authorino-56f854f9d-l8pf8\" (UID: \"20286eda-0acf-44cf-8323-87b4594e0c23\") " pod="kuadrant-system/authorino-56f854f9d-l8pf8" Jun 11 18:40:20.922018 ip-10-0-130-170 kubenswrapper[2565]: I0611 18:40:20.921991 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-56f854f9d-l8pf8" Jun 11 18:40:21.057938 ip-10-0-130-170 kubenswrapper[2565]: I0611 18:40:21.057911 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-56f854f9d-l8pf8"] Jun 11 18:40:21.059744 ip-10-0-130-170 kubenswrapper[2565]: W0611 18:40:21.059715 2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod20286eda_0acf_44cf_8323_87b4594e0c23.slice/crio-08103347bed0b21d62dd81a414de40ac0154ab65284faf6156cad73442f53dd4 WatchSource:0}: Error finding container 08103347bed0b21d62dd81a414de40ac0154ab65284faf6156cad73442f53dd4: Status 404 returned error can't find the container with id 08103347bed0b21d62dd81a414de40ac0154ab65284faf6156cad73442f53dd4 Jun 11 18:40:21.174864 ip-10-0-130-170 kubenswrapper[2565]: I0611 18:40:21.174769 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-56f854f9d-l8pf8" event={"ID":"20286eda-0acf-44cf-8323-87b4594e0c23","Type":"ContainerStarted","Data":"08103347bed0b21d62dd81a414de40ac0154ab65284faf6156cad73442f53dd4"} Jun 11 18:40:21.174864 ip-10-0-130-170 kubenswrapper[2565]: I0611 18:40:21.174788 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-5d4b67c446-46xwm" Jun 11 18:40:21.181865 ip-10-0-130-170 kubenswrapper[2565]: I0611 18:40:21.181837 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-5d4b67c446-46xwm" Jun 11 18:40:21.330200 ip-10-0-130-170 kubenswrapper[2565]: I0611 18:40:21.330166 2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-slgns\" (UniqueName: \"kubernetes.io/projected/8b2f2f73-1294-4ed8-9e2a-c67a761e0399-kube-api-access-slgns\") pod \"8b2f2f73-1294-4ed8-9e2a-c67a761e0399\" (UID: \"8b2f2f73-1294-4ed8-9e2a-c67a761e0399\") " Jun 11 18:40:21.332467 ip-10-0-130-170 kubenswrapper[2565]: I0611 18:40:21.332432 2565 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/8b2f2f73-1294-4ed8-9e2a-c67a761e0399-kube-api-access-slgns" (OuterVolumeSpecName: "kube-api-access-slgns") pod "8b2f2f73-1294-4ed8-9e2a-c67a761e0399" (UID: "8b2f2f73-1294-4ed8-9e2a-c67a761e0399"). InnerVolumeSpecName "kube-api-access-slgns". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 11 18:40:21.430880 ip-10-0-130-170 kubenswrapper[2565]: I0611 18:40:21.430824 2565 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-slgns\" (UniqueName: \"kubernetes.io/projected/8b2f2f73-1294-4ed8-9e2a-c67a761e0399-kube-api-access-slgns\") on node \"ip-10-0-130-170.ec2.internal\" DevicePath \"\"" Jun 11 18:40:22.182358 ip-10-0-130-170 kubenswrapper[2565]: I0611 18:40:22.182324 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-56f854f9d-l8pf8" event={"ID":"20286eda-0acf-44cf-8323-87b4594e0c23","Type":"ContainerStarted","Data":"98758a3c0dd9930f5ed437c3f64abbe32e4492626bfaf9c425aef715aa3de87d"} Jun 11 18:40:22.182750 ip-10-0-130-170 kubenswrapper[2565]: I0611 18:40:22.182362 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-5d4b67c446-46xwm" Jun 11 18:40:22.207904 ip-10-0-130-170 kubenswrapper[2565]: I0611 18:40:22.207841 2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/authorino-56f854f9d-l8pf8" podStartSLOduration=1.864150097 podStartE2EDuration="2.2078256s" totalImagesPullingTime="343.675503ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-11 18:40:20 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-11 18:40:22.206424095 +0000 UTC m=+740.955110136" watchObservedRunningTime="2026-06-11 18:40:22.2078256 +0000 UTC m=+740.956511621" Jun 11 18:40:22.241770 ip-10-0-130-170 kubenswrapper[2565]: I0611 18:40:22.241734 2565 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-75d556bd77-mg8j2"] Jun 11 18:40:22.241941 ip-10-0-130-170 kubenswrapper[2565]: I0611 18:40:22.241920 2565 kuberuntime_container.go:872] "Killing container with a grace period" pod="kuadrant-system/authorino-75d556bd77-mg8j2" podUID="f5c11e16-ed9d-485a-87fa-b6092992558b" containerName="authorino" containerID="cri-o://f205c387a5ce6a5d29c2cc1e1a2c5e10a343048b1c19989d89bbba471be671b7" gracePeriod=30 Jun 11 18:40:22.258094 ip-10-0-130-170 kubenswrapper[2565]: I0611 18:40:22.258066 2565 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-5d4b67c446-46xwm"] Jun 11 18:40:22.260868 ip-10-0-130-170 kubenswrapper[2565]: I0611 18:40:22.260834 2565 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/authorino-5d4b67c446-46xwm"] Jun 11 18:40:22.501070 ip-10-0-130-170 kubenswrapper[2565]: I0611 18:40:22.501046 2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-75d556bd77-mg8j2" Jun 11 18:40:22.641083 ip-10-0-130-170 kubenswrapper[2565]: I0611 18:40:22.641045 2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-t4dxv\" (UniqueName: \"kubernetes.io/projected/f5c11e16-ed9d-485a-87fa-b6092992558b-kube-api-access-t4dxv\") pod \"f5c11e16-ed9d-485a-87fa-b6092992558b\" (UID: \"f5c11e16-ed9d-485a-87fa-b6092992558b\") " Jun 11 18:40:22.643326 ip-10-0-130-170 kubenswrapper[2565]: I0611 18:40:22.643298 2565 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/f5c11e16-ed9d-485a-87fa-b6092992558b-kube-api-access-t4dxv" (OuterVolumeSpecName: "kube-api-access-t4dxv") pod "f5c11e16-ed9d-485a-87fa-b6092992558b" (UID: "f5c11e16-ed9d-485a-87fa-b6092992558b"). InnerVolumeSpecName "kube-api-access-t4dxv". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 11 18:40:22.742600 ip-10-0-130-170 kubenswrapper[2565]: I0611 18:40:22.742512 2565 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-t4dxv\" (UniqueName: \"kubernetes.io/projected/f5c11e16-ed9d-485a-87fa-b6092992558b-kube-api-access-t4dxv\") on node \"ip-10-0-130-170.ec2.internal\" DevicePath \"\"" Jun 11 18:40:23.189057 ip-10-0-130-170 kubenswrapper[2565]: I0611 18:40:23.189023 2565 generic.go:356] "Generic (PLEG): container finished" podID="f5c11e16-ed9d-485a-87fa-b6092992558b" containerID="f205c387a5ce6a5d29c2cc1e1a2c5e10a343048b1c19989d89bbba471be671b7" exitCode=0 Jun 11 18:40:23.189519 ip-10-0-130-170 kubenswrapper[2565]: I0611 18:40:23.189065 2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-75d556bd77-mg8j2" Jun 11 18:40:23.189519 ip-10-0-130-170 kubenswrapper[2565]: I0611 18:40:23.189111 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-75d556bd77-mg8j2" event={"ID":"f5c11e16-ed9d-485a-87fa-b6092992558b","Type":"ContainerDied","Data":"f205c387a5ce6a5d29c2cc1e1a2c5e10a343048b1c19989d89bbba471be671b7"} Jun 11 18:40:23.189519 ip-10-0-130-170 kubenswrapper[2565]: I0611 18:40:23.189153 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-75d556bd77-mg8j2" event={"ID":"f5c11e16-ed9d-485a-87fa-b6092992558b","Type":"ContainerDied","Data":"4833bac47ef6112fa0fdc8eeba7b15eb16fae52ff0f4a89fc980ab90d09b3412"} Jun 11 18:40:23.189519 ip-10-0-130-170 kubenswrapper[2565]: I0611 18:40:23.189178 2565 scope.go:117] "RemoveContainer" containerID="f205c387a5ce6a5d29c2cc1e1a2c5e10a343048b1c19989d89bbba471be671b7" Jun 11 18:40:23.198552 ip-10-0-130-170 kubenswrapper[2565]: I0611 18:40:23.198536 2565 scope.go:117] "RemoveContainer" containerID="f205c387a5ce6a5d29c2cc1e1a2c5e10a343048b1c19989d89bbba471be671b7" Jun 11 18:40:23.198832 ip-10-0-130-170 kubenswrapper[2565]: E0611 18:40:23.198812 2565 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"f205c387a5ce6a5d29c2cc1e1a2c5e10a343048b1c19989d89bbba471be671b7\": container with ID starting with f205c387a5ce6a5d29c2cc1e1a2c5e10a343048b1c19989d89bbba471be671b7 not found: ID does not exist" containerID="f205c387a5ce6a5d29c2cc1e1a2c5e10a343048b1c19989d89bbba471be671b7" Jun 11 18:40:23.198882 ip-10-0-130-170 kubenswrapper[2565]: I0611 18:40:23.198842 2565 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"f205c387a5ce6a5d29c2cc1e1a2c5e10a343048b1c19989d89bbba471be671b7"} err="failed to get container status \"f205c387a5ce6a5d29c2cc1e1a2c5e10a343048b1c19989d89bbba471be671b7\": rpc error: code = NotFound desc = could not find container \"f205c387a5ce6a5d29c2cc1e1a2c5e10a343048b1c19989d89bbba471be671b7\": container with ID starting with f205c387a5ce6a5d29c2cc1e1a2c5e10a343048b1c19989d89bbba471be671b7 not found: ID does not exist" Jun 11 18:40:23.212204 ip-10-0-130-170 kubenswrapper[2565]: I0611 18:40:23.212173 2565 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-75d556bd77-mg8j2"] Jun 11 18:40:23.219306 ip-10-0-130-170 kubenswrapper[2565]: I0611 18:40:23.217168 2565 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/authorino-75d556bd77-mg8j2"] Jun 11 18:40:23.748924 ip-10-0-130-170 kubenswrapper[2565]: I0611 18:40:23.748887 2565 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="8b2f2f73-1294-4ed8-9e2a-c67a761e0399" path="/var/lib/kubelet/pods/8b2f2f73-1294-4ed8-9e2a-c67a761e0399/volumes" Jun 11 18:40:23.749132 ip-10-0-130-170 kubenswrapper[2565]: I0611 18:40:23.749120 2565 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="f5c11e16-ed9d-485a-87fa-b6092992558b" path="/var/lib/kubelet/pods/f5c11e16-ed9d-485a-87fa-b6092992558b/volumes" Jun 11 18:40:25.890192 ip-10-0-130-170 kubenswrapper[2565]: I0611 18:40:25.890155 2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/maas-controller-5df4ff5574-mjxqh"] Jun 11 18:40:25.890607 ip-10-0-130-170 kubenswrapper[2565]: I0611 18:40:25.890545 2565 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="f5c11e16-ed9d-485a-87fa-b6092992558b" containerName="authorino" Jun 11 18:40:25.890607 ip-10-0-130-170 kubenswrapper[2565]: I0611 18:40:25.890558 2565 state_mem.go:107] "Deleted CPUSet assignment" podUID="f5c11e16-ed9d-485a-87fa-b6092992558b" containerName="authorino" Jun 11 18:40:25.890679 ip-10-0-130-170 kubenswrapper[2565]: I0611 18:40:25.890620 2565 memory_manager.go:368] "RemoveStaleState removing state" podUID="f5c11e16-ed9d-485a-87fa-b6092992558b" containerName="authorino" Jun 11 18:40:25.893653 ip-10-0-130-170 kubenswrapper[2565]: I0611 18:40:25.893636 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-5df4ff5574-mjxqh" Jun 11 18:40:25.896613 ip-10-0-130-170 kubenswrapper[2565]: I0611 18:40:25.896586 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-controller-webhook-cert\"" Jun 11 18:40:25.896749 ip-10-0-130-170 kubenswrapper[2565]: I0611 18:40:25.896708 2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"maas-parameters\"" Jun 11 18:40:25.897008 ip-10-0-130-170 kubenswrapper[2565]: I0611 18:40:25.896993 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-controller-dockercfg-4rckp\"" Jun 11 18:40:25.928555 ip-10-0-130-170 kubenswrapper[2565]: I0611 18:40:25.928531 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-5df4ff5574-mjxqh"] Jun 11 18:40:26.073013 ip-10-0-130-170 kubenswrapper[2565]: I0611 18:40:26.072973 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-lwsdv\" (UniqueName: \"kubernetes.io/projected/47e0b2c9-715f-4312-b201-2b82527907e9-kube-api-access-lwsdv\") pod \"maas-controller-5df4ff5574-mjxqh\" (UID: \"47e0b2c9-715f-4312-b201-2b82527907e9\") " pod="opendatahub/maas-controller-5df4ff5574-mjxqh" Jun 11 18:40:26.073013 ip-10-0-130-170 kubenswrapper[2565]: I0611 18:40:26.073017 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/47e0b2c9-715f-4312-b201-2b82527907e9-webhook-cert\") pod \"maas-controller-5df4ff5574-mjxqh\" (UID: \"47e0b2c9-715f-4312-b201-2b82527907e9\") " pod="opendatahub/maas-controller-5df4ff5574-mjxqh" Jun 11 18:40:26.142649 ip-10-0-130-170 kubenswrapper[2565]: I0611 18:40:26.142571 2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/maas-controller-7478944844-gbqtz"] Jun 11 18:40:26.145134 ip-10-0-130-170 kubenswrapper[2565]: I0611 18:40:26.145116 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-7478944844-gbqtz" Jun 11 18:40:26.158677 ip-10-0-130-170 kubenswrapper[2565]: I0611 18:40:26.158650 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-7478944844-gbqtz"] Jun 11 18:40:26.173998 ip-10-0-130-170 kubenswrapper[2565]: I0611 18:40:26.173972 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-lwsdv\" (UniqueName: \"kubernetes.io/projected/47e0b2c9-715f-4312-b201-2b82527907e9-kube-api-access-lwsdv\") pod \"maas-controller-5df4ff5574-mjxqh\" (UID: \"47e0b2c9-715f-4312-b201-2b82527907e9\") " pod="opendatahub/maas-controller-5df4ff5574-mjxqh" Jun 11 18:40:26.174148 ip-10-0-130-170 kubenswrapper[2565]: I0611 18:40:26.174015 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/47e0b2c9-715f-4312-b201-2b82527907e9-webhook-cert\") pod \"maas-controller-5df4ff5574-mjxqh\" (UID: \"47e0b2c9-715f-4312-b201-2b82527907e9\") " pod="opendatahub/maas-controller-5df4ff5574-mjxqh" Jun 11 18:40:26.177028 ip-10-0-130-170 kubenswrapper[2565]: I0611 18:40:26.177003 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/47e0b2c9-715f-4312-b201-2b82527907e9-webhook-cert\") pod \"maas-controller-5df4ff5574-mjxqh\" (UID: \"47e0b2c9-715f-4312-b201-2b82527907e9\") " pod="opendatahub/maas-controller-5df4ff5574-mjxqh" Jun 11 18:40:26.183022 ip-10-0-130-170 kubenswrapper[2565]: I0611 18:40:26.182999 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-lwsdv\" (UniqueName: \"kubernetes.io/projected/47e0b2c9-715f-4312-b201-2b82527907e9-kube-api-access-lwsdv\") pod \"maas-controller-5df4ff5574-mjxqh\" (UID: \"47e0b2c9-715f-4312-b201-2b82527907e9\") " pod="opendatahub/maas-controller-5df4ff5574-mjxqh" Jun 11 18:40:26.203905 ip-10-0-130-170 kubenswrapper[2565]: I0611 18:40:26.203870 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-5df4ff5574-mjxqh" Jun 11 18:40:26.275011 ip-10-0-130-170 kubenswrapper[2565]: I0611 18:40:26.274971 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/ebeb6c60-5943-4e1a-ad2e-3978698b144f-webhook-cert\") pod \"maas-controller-7478944844-gbqtz\" (UID: \"ebeb6c60-5943-4e1a-ad2e-3978698b144f\") " pod="opendatahub/maas-controller-7478944844-gbqtz" Jun 11 18:40:26.275169 ip-10-0-130-170 kubenswrapper[2565]: I0611 18:40:26.275028 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-p9swv\" (UniqueName: \"kubernetes.io/projected/ebeb6c60-5943-4e1a-ad2e-3978698b144f-kube-api-access-p9swv\") pod \"maas-controller-7478944844-gbqtz\" (UID: \"ebeb6c60-5943-4e1a-ad2e-3978698b144f\") " pod="opendatahub/maas-controller-7478944844-gbqtz" Jun 11 18:40:26.351100 ip-10-0-130-170 kubenswrapper[2565]: I0611 18:40:26.351070 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-5df4ff5574-mjxqh"] Jun 11 18:40:26.352515 ip-10-0-130-170 kubenswrapper[2565]: W0611 18:40:26.352486 2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod47e0b2c9_715f_4312_b201_2b82527907e9.slice/crio-779d10cd08829b5b76939379f65e1de8c2e69f99b0ae5ff2b19e8354f937f7bd WatchSource:0}: Error finding container 779d10cd08829b5b76939379f65e1de8c2e69f99b0ae5ff2b19e8354f937f7bd: Status 404 returned error can't find the container with id 779d10cd08829b5b76939379f65e1de8c2e69f99b0ae5ff2b19e8354f937f7bd Jun 11 18:40:26.376405 ip-10-0-130-170 kubenswrapper[2565]: I0611 18:40:26.376373 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/ebeb6c60-5943-4e1a-ad2e-3978698b144f-webhook-cert\") pod \"maas-controller-7478944844-gbqtz\" (UID: \"ebeb6c60-5943-4e1a-ad2e-3978698b144f\") " pod="opendatahub/maas-controller-7478944844-gbqtz" Jun 11 18:40:26.376568 ip-10-0-130-170 kubenswrapper[2565]: I0611 18:40:26.376420 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-p9swv\" (UniqueName: \"kubernetes.io/projected/ebeb6c60-5943-4e1a-ad2e-3978698b144f-kube-api-access-p9swv\") pod \"maas-controller-7478944844-gbqtz\" (UID: \"ebeb6c60-5943-4e1a-ad2e-3978698b144f\") " pod="opendatahub/maas-controller-7478944844-gbqtz" Jun 11 18:40:26.379222 ip-10-0-130-170 kubenswrapper[2565]: I0611 18:40:26.379196 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/ebeb6c60-5943-4e1a-ad2e-3978698b144f-webhook-cert\") pod \"maas-controller-7478944844-gbqtz\" (UID: \"ebeb6c60-5943-4e1a-ad2e-3978698b144f\") " pod="opendatahub/maas-controller-7478944844-gbqtz" Jun 11 18:40:26.386046 ip-10-0-130-170 kubenswrapper[2565]: I0611 18:40:26.386025 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-p9swv\" (UniqueName: \"kubernetes.io/projected/ebeb6c60-5943-4e1a-ad2e-3978698b144f-kube-api-access-p9swv\") pod \"maas-controller-7478944844-gbqtz\" (UID: \"ebeb6c60-5943-4e1a-ad2e-3978698b144f\") " pod="opendatahub/maas-controller-7478944844-gbqtz" Jun 11 18:40:26.454861 ip-10-0-130-170 kubenswrapper[2565]: I0611 18:40:26.454772 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-7478944844-gbqtz" Jun 11 18:40:26.598727 ip-10-0-130-170 kubenswrapper[2565]: I0611 18:40:26.598701 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-7478944844-gbqtz"] Jun 11 18:40:26.600245 ip-10-0-130-170 kubenswrapper[2565]: W0611 18:40:26.600217 2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podebeb6c60_5943_4e1a_ad2e_3978698b144f.slice/crio-d444940ad256af048ecf464e0cbea175f3d1e6fccdb26b12904acf08e784b1c3 WatchSource:0}: Error finding container d444940ad256af048ecf464e0cbea175f3d1e6fccdb26b12904acf08e784b1c3: Status 404 returned error can't find the container with id d444940ad256af048ecf464e0cbea175f3d1e6fccdb26b12904acf08e784b1c3 Jun 11 18:40:27.217402 ip-10-0-130-170 kubenswrapper[2565]: I0611 18:40:27.217362 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-7478944844-gbqtz" event={"ID":"ebeb6c60-5943-4e1a-ad2e-3978698b144f","Type":"ContainerStarted","Data":"d444940ad256af048ecf464e0cbea175f3d1e6fccdb26b12904acf08e784b1c3"} Jun 11 18:40:27.219192 ip-10-0-130-170 kubenswrapper[2565]: I0611 18:40:27.219134 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-5df4ff5574-mjxqh" event={"ID":"47e0b2c9-715f-4312-b201-2b82527907e9","Type":"ContainerStarted","Data":"779d10cd08829b5b76939379f65e1de8c2e69f99b0ae5ff2b19e8354f937f7bd"} Jun 11 18:40:29.238472 ip-10-0-130-170 kubenswrapper[2565]: I0611 18:40:29.238429 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-5df4ff5574-mjxqh" event={"ID":"47e0b2c9-715f-4312-b201-2b82527907e9","Type":"ContainerStarted","Data":"4c2831c79b00a9b1f7880c1fa65ad6b2152caec247df21cd5d3b44ced10188c9"} Jun 11 18:40:29.238935 ip-10-0-130-170 kubenswrapper[2565]: I0611 18:40:29.238605 2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/maas-controller-5df4ff5574-mjxqh" Jun 11 18:40:29.240400 ip-10-0-130-170 kubenswrapper[2565]: I0611 18:40:29.240361 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-7478944844-gbqtz" event={"ID":"ebeb6c60-5943-4e1a-ad2e-3978698b144f","Type":"ContainerStarted","Data":"00d3dd64893fc620743a4582408da23f0937b1fa3591caf56d2e56112a5a8564"} Jun 11 18:40:29.240574 ip-10-0-130-170 kubenswrapper[2565]: I0611 18:40:29.240532 2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/maas-controller-7478944844-gbqtz" Jun 11 18:40:29.272948 ip-10-0-130-170 kubenswrapper[2565]: I0611 18:40:29.272835 2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/maas-controller-5df4ff5574-mjxqh" podStartSLOduration=1.605577508 podStartE2EDuration="4.272819445s" totalImagesPullingTime="2.667241937s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-11 18:40:25 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-11 18:40:29.271849267 +0000 UTC m=+748.020535287" watchObservedRunningTime="2026-06-11 18:40:29.272819445 +0000 UTC m=+748.021505507" Jun 11 18:40:29.289995 ip-10-0-130-170 kubenswrapper[2565]: I0611 18:40:29.289933 2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/maas-controller-7478944844-gbqtz" podStartSLOduration=0.877514286 podStartE2EDuration="3.289913824s" totalImagesPullingTime="2.412399538s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-11 18:40:26 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-11 18:40:29.289220315 +0000 UTC m=+748.037906339" watchObservedRunningTime="2026-06-11 18:40:29.289913824 +0000 UTC m=+748.038599845" Jun 11 18:40:40.252478 ip-10-0-130-170 kubenswrapper[2565]: I0611 18:40:40.252443 2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/maas-controller-7478944844-gbqtz" Jun 11 18:40:40.252920 ip-10-0-130-170 kubenswrapper[2565]: I0611 18:40:40.252521 2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/maas-controller-5df4ff5574-mjxqh" Jun 11 18:40:40.315244 ip-10-0-130-170 kubenswrapper[2565]: I0611 18:40:40.315203 2565 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-controller-5df4ff5574-mjxqh"] Jun 11 18:40:40.315469 ip-10-0-130-170 kubenswrapper[2565]: I0611 18:40:40.315445 2565 kuberuntime_container.go:872] "Killing container with a grace period" pod="opendatahub/maas-controller-5df4ff5574-mjxqh" podUID="47e0b2c9-715f-4312-b201-2b82527907e9" containerName="manager" containerID="cri-o://4c2831c79b00a9b1f7880c1fa65ad6b2152caec247df21cd5d3b44ced10188c9" gracePeriod=30 Jun 11 18:40:40.568044 ip-10-0-130-170 kubenswrapper[2565]: I0611 18:40:40.568016 2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-5df4ff5574-mjxqh" Jun 11 18:40:40.594521 ip-10-0-130-170 kubenswrapper[2565]: I0611 18:40:40.594487 2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-lwsdv\" (UniqueName: \"kubernetes.io/projected/47e0b2c9-715f-4312-b201-2b82527907e9-kube-api-access-lwsdv\") pod \"47e0b2c9-715f-4312-b201-2b82527907e9\" (UID: \"47e0b2c9-715f-4312-b201-2b82527907e9\") " Jun 11 18:40:40.594521 ip-10-0-130-170 kubenswrapper[2565]: I0611 18:40:40.594527 2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/47e0b2c9-715f-4312-b201-2b82527907e9-webhook-cert\") pod \"47e0b2c9-715f-4312-b201-2b82527907e9\" (UID: \"47e0b2c9-715f-4312-b201-2b82527907e9\") " Jun 11 18:40:40.596758 ip-10-0-130-170 kubenswrapper[2565]: I0611 18:40:40.596729 2565 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/47e0b2c9-715f-4312-b201-2b82527907e9-webhook-cert" (OuterVolumeSpecName: "webhook-cert") pod "47e0b2c9-715f-4312-b201-2b82527907e9" (UID: "47e0b2c9-715f-4312-b201-2b82527907e9"). InnerVolumeSpecName "webhook-cert". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 11 18:40:40.596881 ip-10-0-130-170 kubenswrapper[2565]: I0611 18:40:40.596760 2565 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/47e0b2c9-715f-4312-b201-2b82527907e9-kube-api-access-lwsdv" (OuterVolumeSpecName: "kube-api-access-lwsdv") pod "47e0b2c9-715f-4312-b201-2b82527907e9" (UID: "47e0b2c9-715f-4312-b201-2b82527907e9"). InnerVolumeSpecName "kube-api-access-lwsdv". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 11 18:40:40.695553 ip-10-0-130-170 kubenswrapper[2565]: I0611 18:40:40.695518 2565 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-lwsdv\" (UniqueName: \"kubernetes.io/projected/47e0b2c9-715f-4312-b201-2b82527907e9-kube-api-access-lwsdv\") on node \"ip-10-0-130-170.ec2.internal\" DevicePath \"\"" Jun 11 18:40:40.695553 ip-10-0-130-170 kubenswrapper[2565]: I0611 18:40:40.695547 2565 reconciler_common.go:299] "Volume detached for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/47e0b2c9-715f-4312-b201-2b82527907e9-webhook-cert\") on node \"ip-10-0-130-170.ec2.internal\" DevicePath \"\"" Jun 11 18:40:41.312866 ip-10-0-130-170 kubenswrapper[2565]: I0611 18:40:41.312829 2565 generic.go:356] "Generic (PLEG): container finished" podID="47e0b2c9-715f-4312-b201-2b82527907e9" containerID="4c2831c79b00a9b1f7880c1fa65ad6b2152caec247df21cd5d3b44ced10188c9" exitCode=0 Jun 11 18:40:41.313244 ip-10-0-130-170 kubenswrapper[2565]: I0611 18:40:41.312875 2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-5df4ff5574-mjxqh" Jun 11 18:40:41.313244 ip-10-0-130-170 kubenswrapper[2565]: I0611 18:40:41.312913 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-5df4ff5574-mjxqh" event={"ID":"47e0b2c9-715f-4312-b201-2b82527907e9","Type":"ContainerDied","Data":"4c2831c79b00a9b1f7880c1fa65ad6b2152caec247df21cd5d3b44ced10188c9"} Jun 11 18:40:41.313244 ip-10-0-130-170 kubenswrapper[2565]: I0611 18:40:41.312968 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-5df4ff5574-mjxqh" event={"ID":"47e0b2c9-715f-4312-b201-2b82527907e9","Type":"ContainerDied","Data":"779d10cd08829b5b76939379f65e1de8c2e69f99b0ae5ff2b19e8354f937f7bd"} Jun 11 18:40:41.313244 ip-10-0-130-170 kubenswrapper[2565]: I0611 18:40:41.312991 2565 scope.go:117] "RemoveContainer" containerID="4c2831c79b00a9b1f7880c1fa65ad6b2152caec247df21cd5d3b44ced10188c9" Jun 11 18:40:41.322747 ip-10-0-130-170 kubenswrapper[2565]: I0611 18:40:41.322613 2565 scope.go:117] "RemoveContainer" containerID="4c2831c79b00a9b1f7880c1fa65ad6b2152caec247df21cd5d3b44ced10188c9" Jun 11 18:40:41.322912 ip-10-0-130-170 kubenswrapper[2565]: E0611 18:40:41.322891 2565 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"4c2831c79b00a9b1f7880c1fa65ad6b2152caec247df21cd5d3b44ced10188c9\": container with ID starting with 4c2831c79b00a9b1f7880c1fa65ad6b2152caec247df21cd5d3b44ced10188c9 not found: ID does not exist" containerID="4c2831c79b00a9b1f7880c1fa65ad6b2152caec247df21cd5d3b44ced10188c9" Jun 11 18:40:41.322952 ip-10-0-130-170 kubenswrapper[2565]: I0611 18:40:41.322920 2565 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"4c2831c79b00a9b1f7880c1fa65ad6b2152caec247df21cd5d3b44ced10188c9"} err="failed to get container status \"4c2831c79b00a9b1f7880c1fa65ad6b2152caec247df21cd5d3b44ced10188c9\": rpc error: code = NotFound desc = could not find container \"4c2831c79b00a9b1f7880c1fa65ad6b2152caec247df21cd5d3b44ced10188c9\": container with ID starting with 4c2831c79b00a9b1f7880c1fa65ad6b2152caec247df21cd5d3b44ced10188c9 not found: ID does not exist" Jun 11 18:40:41.336085 ip-10-0-130-170 kubenswrapper[2565]: I0611 18:40:41.336057 2565 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-controller-5df4ff5574-mjxqh"] Jun 11 18:40:41.340286 ip-10-0-130-170 kubenswrapper[2565]: I0611 18:40:41.340248 2565 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/maas-controller-5df4ff5574-mjxqh"] Jun 11 18:40:41.748785 ip-10-0-130-170 kubenswrapper[2565]: I0611 18:40:41.748752 2565 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="47e0b2c9-715f-4312-b201-2b82527907e9" path="/var/lib/kubelet/pods/47e0b2c9-715f-4312-b201-2b82527907e9/volumes" Jun 11 18:41:00.041488 ip-10-0-130-170 kubenswrapper[2565]: I0611 18:41:00.041444 2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/maas-api-bb976594-hlkpk"] Jun 11 18:41:00.042075 ip-10-0-130-170 kubenswrapper[2565]: I0611 18:41:00.042019 2565 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="47e0b2c9-715f-4312-b201-2b82527907e9" containerName="manager" Jun 11 18:41:00.042075 ip-10-0-130-170 kubenswrapper[2565]: I0611 18:41:00.042039 2565 state_mem.go:107] "Deleted CPUSet assignment" podUID="47e0b2c9-715f-4312-b201-2b82527907e9" containerName="manager" Jun 11 18:41:00.042194 ip-10-0-130-170 kubenswrapper[2565]: I0611 18:41:00.042167 2565 memory_manager.go:368] "RemoveStaleState removing state" podUID="47e0b2c9-715f-4312-b201-2b82527907e9" containerName="manager" Jun 11 18:41:00.048395 ip-10-0-130-170 kubenswrapper[2565]: I0611 18:41:00.048366 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-bb976594-hlkpk" Jun 11 18:41:00.052937 ip-10-0-130-170 kubenswrapper[2565]: I0611 18:41:00.052910 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-api-dockercfg-j9x9s\"" Jun 11 18:41:00.053102 ip-10-0-130-170 kubenswrapper[2565]: I0611 18:41:00.052968 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-api-serving-cert\"" Jun 11 18:41:00.071095 ip-10-0-130-170 kubenswrapper[2565]: I0611 18:41:00.071065 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-api-bb976594-hlkpk"] Jun 11 18:41:00.172399 ip-10-0-130-170 kubenswrapper[2565]: I0611 18:41:00.172357 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/c6111163-ec5f-414d-bacc-4fb015cc78d1-maas-api-tls\") pod \"maas-api-bb976594-hlkpk\" (UID: \"c6111163-ec5f-414d-bacc-4fb015cc78d1\") " pod="opendatahub/maas-api-bb976594-hlkpk" Jun 11 18:41:00.172573 ip-10-0-130-170 kubenswrapper[2565]: I0611 18:41:00.172413 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/c6111163-ec5f-414d-bacc-4fb015cc78d1-openshift-service-ca\") pod \"maas-api-bb976594-hlkpk\" (UID: \"c6111163-ec5f-414d-bacc-4fb015cc78d1\") " pod="opendatahub/maas-api-bb976594-hlkpk" Jun 11 18:41:00.172573 ip-10-0-130-170 kubenswrapper[2565]: I0611 18:41:00.172442 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-v75q2\" (UniqueName: \"kubernetes.io/projected/c6111163-ec5f-414d-bacc-4fb015cc78d1-kube-api-access-v75q2\") pod \"maas-api-bb976594-hlkpk\" (UID: \"c6111163-ec5f-414d-bacc-4fb015cc78d1\") " pod="opendatahub/maas-api-bb976594-hlkpk" Jun 11 18:41:00.273314 ip-10-0-130-170 kubenswrapper[2565]: I0611 18:41:00.273245 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-v75q2\" (UniqueName: \"kubernetes.io/projected/c6111163-ec5f-414d-bacc-4fb015cc78d1-kube-api-access-v75q2\") pod \"maas-api-bb976594-hlkpk\" (UID: \"c6111163-ec5f-414d-bacc-4fb015cc78d1\") " pod="opendatahub/maas-api-bb976594-hlkpk" Jun 11 18:41:00.273515 ip-10-0-130-170 kubenswrapper[2565]: I0611 18:41:00.273358 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/c6111163-ec5f-414d-bacc-4fb015cc78d1-maas-api-tls\") pod \"maas-api-bb976594-hlkpk\" (UID: \"c6111163-ec5f-414d-bacc-4fb015cc78d1\") " pod="opendatahub/maas-api-bb976594-hlkpk" Jun 11 18:41:00.273515 ip-10-0-130-170 kubenswrapper[2565]: I0611 18:41:00.273396 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/c6111163-ec5f-414d-bacc-4fb015cc78d1-openshift-service-ca\") pod \"maas-api-bb976594-hlkpk\" (UID: \"c6111163-ec5f-414d-bacc-4fb015cc78d1\") " pod="opendatahub/maas-api-bb976594-hlkpk" Jun 11 18:41:00.273987 ip-10-0-130-170 kubenswrapper[2565]: I0611 18:41:00.273960 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/c6111163-ec5f-414d-bacc-4fb015cc78d1-openshift-service-ca\") pod \"maas-api-bb976594-hlkpk\" (UID: \"c6111163-ec5f-414d-bacc-4fb015cc78d1\") " pod="opendatahub/maas-api-bb976594-hlkpk" Jun 11 18:41:00.276070 ip-10-0-130-170 kubenswrapper[2565]: I0611 18:41:00.276050 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/c6111163-ec5f-414d-bacc-4fb015cc78d1-maas-api-tls\") pod \"maas-api-bb976594-hlkpk\" (UID: \"c6111163-ec5f-414d-bacc-4fb015cc78d1\") " pod="opendatahub/maas-api-bb976594-hlkpk" Jun 11 18:41:00.287746 ip-10-0-130-170 kubenswrapper[2565]: I0611 18:41:00.287720 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-v75q2\" (UniqueName: \"kubernetes.io/projected/c6111163-ec5f-414d-bacc-4fb015cc78d1-kube-api-access-v75q2\") pod \"maas-api-bb976594-hlkpk\" (UID: \"c6111163-ec5f-414d-bacc-4fb015cc78d1\") " pod="opendatahub/maas-api-bb976594-hlkpk" Jun 11 18:41:00.359715 ip-10-0-130-170 kubenswrapper[2565]: I0611 18:41:00.359610 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-bb976594-hlkpk" Jun 11 18:41:00.519767 ip-10-0-130-170 kubenswrapper[2565]: I0611 18:41:00.519725 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-api-bb976594-hlkpk"] Jun 11 18:41:00.520080 ip-10-0-130-170 kubenswrapper[2565]: W0611 18:41:00.520044 2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc6111163_ec5f_414d_bacc_4fb015cc78d1.slice/crio-d2e035a8eb46e3a4682d415597a8871a841ba77a2d110040d0f3d99fd13cb6f4 WatchSource:0}: Error finding container d2e035a8eb46e3a4682d415597a8871a841ba77a2d110040d0f3d99fd13cb6f4: Status 404 returned error can't find the container with id d2e035a8eb46e3a4682d415597a8871a841ba77a2d110040d0f3d99fd13cb6f4 Jun 11 18:41:00.670462 ip-10-0-130-170 kubenswrapper[2565]: I0611 18:41:00.670417 2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-processing-699b6cd6c-d2hv7"] Jun 11 18:41:00.676030 ip-10-0-130-170 kubenswrapper[2565]: I0611 18:41:00.676003 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-699b6cd6c-d2hv7" Jun 11 18:41:00.678643 ip-10-0-130-170 kubenswrapper[2565]: I0611 18:41:00.678619 2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins\"" Jun 11 18:41:00.686173 ip-10-0-130-170 kubenswrapper[2565]: I0611 18:41:00.686146 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-699b6cd6c-d2hv7"] Jun 11 18:41:00.746706 ip-10-0-130-170 kubenswrapper[2565]: I0611 18:41:00.746674 2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-pre-processing-579785bc64-d9ctc"] Jun 11 18:41:00.750533 ip-10-0-130-170 kubenswrapper[2565]: I0611 18:41:00.750513 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-579785bc64-d9ctc" Jun 11 18:41:00.753566 ip-10-0-130-170 kubenswrapper[2565]: I0611 18:41:00.753545 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-dockercfg-98ddb\"" Jun 11 18:41:00.763597 ip-10-0-130-170 kubenswrapper[2565]: I0611 18:41:00.763572 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-579785bc64-d9ctc"] Jun 11 18:41:00.778635 ip-10-0-130-170 kubenswrapper[2565]: I0611 18:41:00.778612 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-h4cqw\" (UniqueName: \"kubernetes.io/projected/149996de-bcb1-4224-a05c-85b25a696aa3-kube-api-access-h4cqw\") pod \"payload-processing-699b6cd6c-d2hv7\" (UID: \"149996de-bcb1-4224-a05c-85b25a696aa3\") " pod="openshift-ingress/payload-processing-699b6cd6c-d2hv7" Jun 11 18:41:00.879124 ip-10-0-130-170 kubenswrapper[2565]: I0611 18:41:00.879090 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-h4cqw\" (UniqueName: \"kubernetes.io/projected/149996de-bcb1-4224-a05c-85b25a696aa3-kube-api-access-h4cqw\") pod \"payload-processing-699b6cd6c-d2hv7\" (UID: \"149996de-bcb1-4224-a05c-85b25a696aa3\") " pod="openshift-ingress/payload-processing-699b6cd6c-d2hv7" Jun 11 18:41:00.879326 ip-10-0-130-170 kubenswrapper[2565]: I0611 18:41:00.879176 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-c4vdj\" (UniqueName: \"kubernetes.io/projected/622f4f16-2d87-4bb3-8e2f-1231c35b2d39-kube-api-access-c4vdj\") pod \"payload-pre-processing-579785bc64-d9ctc\" (UID: \"622f4f16-2d87-4bb3-8e2f-1231c35b2d39\") " pod="openshift-ingress/payload-pre-processing-579785bc64-d9ctc" Jun 11 18:41:00.888187 ip-10-0-130-170 kubenswrapper[2565]: I0611 18:41:00.888162 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-h4cqw\" (UniqueName: \"kubernetes.io/projected/149996de-bcb1-4224-a05c-85b25a696aa3-kube-api-access-h4cqw\") pod \"payload-processing-699b6cd6c-d2hv7\" (UID: \"149996de-bcb1-4224-a05c-85b25a696aa3\") " pod="openshift-ingress/payload-processing-699b6cd6c-d2hv7" Jun 11 18:41:00.980609 ip-10-0-130-170 kubenswrapper[2565]: I0611 18:41:00.980514 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-c4vdj\" (UniqueName: \"kubernetes.io/projected/622f4f16-2d87-4bb3-8e2f-1231c35b2d39-kube-api-access-c4vdj\") pod \"payload-pre-processing-579785bc64-d9ctc\" (UID: \"622f4f16-2d87-4bb3-8e2f-1231c35b2d39\") " pod="openshift-ingress/payload-pre-processing-579785bc64-d9ctc" Jun 11 18:41:00.988390 ip-10-0-130-170 kubenswrapper[2565]: I0611 18:41:00.988361 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-699b6cd6c-d2hv7" Jun 11 18:41:00.994096 ip-10-0-130-170 kubenswrapper[2565]: I0611 18:41:00.994072 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-c4vdj\" (UniqueName: \"kubernetes.io/projected/622f4f16-2d87-4bb3-8e2f-1231c35b2d39-kube-api-access-c4vdj\") pod \"payload-pre-processing-579785bc64-d9ctc\" (UID: \"622f4f16-2d87-4bb3-8e2f-1231c35b2d39\") " pod="openshift-ingress/payload-pre-processing-579785bc64-d9ctc" Jun 11 18:41:01.061027 ip-10-0-130-170 kubenswrapper[2565]: I0611 18:41:01.060992 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-579785bc64-d9ctc" Jun 11 18:41:01.152184 ip-10-0-130-170 kubenswrapper[2565]: I0611 18:41:01.152148 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-699b6cd6c-d2hv7"] Jun 11 18:41:01.153633 ip-10-0-130-170 kubenswrapper[2565]: W0611 18:41:01.153605 2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod149996de_bcb1_4224_a05c_85b25a696aa3.slice/crio-febfe144511f3432ab8fbcc4d4bf1887a436c2248cea1f794ea0fb7d24cbae01 WatchSource:0}: Error finding container febfe144511f3432ab8fbcc4d4bf1887a436c2248cea1f794ea0fb7d24cbae01: Status 404 returned error can't find the container with id febfe144511f3432ab8fbcc4d4bf1887a436c2248cea1f794ea0fb7d24cbae01 Jun 11 18:41:01.240515 ip-10-0-130-170 kubenswrapper[2565]: I0611 18:41:01.240379 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-579785bc64-d9ctc"] Jun 11 18:41:01.427017 ip-10-0-130-170 kubenswrapper[2565]: I0611 18:41:01.426979 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-579785bc64-d9ctc" event={"ID":"622f4f16-2d87-4bb3-8e2f-1231c35b2d39","Type":"ContainerStarted","Data":"9c9c68bef16cc77102bc434e386c1f006e31a55e1284a1683e0c9200c39bf979"} Jun 11 18:41:01.428153 ip-10-0-130-170 kubenswrapper[2565]: I0611 18:41:01.428130 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-699b6cd6c-d2hv7" event={"ID":"149996de-bcb1-4224-a05c-85b25a696aa3","Type":"ContainerStarted","Data":"febfe144511f3432ab8fbcc4d4bf1887a436c2248cea1f794ea0fb7d24cbae01"} Jun 11 18:41:01.429222 ip-10-0-130-170 kubenswrapper[2565]: I0611 18:41:01.429202 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-bb976594-hlkpk" event={"ID":"c6111163-ec5f-414d-bacc-4fb015cc78d1","Type":"ContainerStarted","Data":"d2e035a8eb46e3a4682d415597a8871a841ba77a2d110040d0f3d99fd13cb6f4"} Jun 11 18:41:03.733362 ip-10-0-130-170 kubenswrapper[2565]: I0611 18:41:03.733319 2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins\"" Jun 11 18:41:04.458828 ip-10-0-130-170 kubenswrapper[2565]: I0611 18:41:04.458787 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-579785bc64-d9ctc" event={"ID":"622f4f16-2d87-4bb3-8e2f-1231c35b2d39","Type":"ContainerStarted","Data":"56b8838ee83e2674089dd98e84c5336607d8375a8064468de1add36a3b230353"} Jun 11 18:41:04.459030 ip-10-0-130-170 kubenswrapper[2565]: I0611 18:41:04.458893 2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-pre-processing-579785bc64-d9ctc" Jun 11 18:41:04.460725 ip-10-0-130-170 kubenswrapper[2565]: I0611 18:41:04.460699 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-699b6cd6c-d2hv7" event={"ID":"149996de-bcb1-4224-a05c-85b25a696aa3","Type":"ContainerStarted","Data":"16b80de4d8239aa77b2159bfa338416731ddd3cc993ff224ba40991887efc8ac"} Jun 11 18:41:04.461096 ip-10-0-130-170 kubenswrapper[2565]: I0611 18:41:04.461074 2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-processing-699b6cd6c-d2hv7" Jun 11 18:41:04.462312 ip-10-0-130-170 kubenswrapper[2565]: I0611 18:41:04.462289 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-bb976594-hlkpk" event={"ID":"c6111163-ec5f-414d-bacc-4fb015cc78d1","Type":"ContainerStarted","Data":"88b41808833dd77a092cbcb0417afa3c0c9c08c49bb08efa59183ce6992412a8"} Jun 11 18:41:04.462433 ip-10-0-130-170 kubenswrapper[2565]: I0611 18:41:04.462385 2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/maas-api-bb976594-hlkpk" Jun 11 18:41:04.479554 ip-10-0-130-170 kubenswrapper[2565]: I0611 18:41:04.479512 2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-pre-processing-579785bc64-d9ctc" podStartSLOduration=1.996900964 podStartE2EDuration="4.479497778s" totalImagesPullingTime="2.482596814s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-11 18:41:00 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-11 18:41:04.478808714 +0000 UTC m=+783.227494738" watchObservedRunningTime="2026-06-11 18:41:04.479497778 +0000 UTC m=+783.228183777" Jun 11 18:41:04.496808 ip-10-0-130-170 kubenswrapper[2565]: I0611 18:41:04.496761 2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-processing-699b6cd6c-d2hv7" podStartSLOduration=1.915968297 podStartE2EDuration="4.496746991s" totalImagesPullingTime="2.580778694s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-11 18:41:00 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-11 18:41:04.495446347 +0000 UTC m=+783.244132368" watchObservedRunningTime="2026-06-11 18:41:04.496746991 +0000 UTC m=+783.245433013" Jun 11 18:41:04.515279 ip-10-0-130-170 kubenswrapper[2565]: I0611 18:41:04.515206 2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/maas-api-bb976594-hlkpk" podStartSLOduration=1.370875227 podStartE2EDuration="4.515188501s" totalImagesPullingTime="3.144313274s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-11 18:41:00 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-11 18:41:04.512610538 +0000 UTC m=+783.261296561" watchObservedRunningTime="2026-06-11 18:41:04.515188501 +0000 UTC m=+783.263874522" Jun 11 18:41:10.474506 ip-10-0-130-170 kubenswrapper[2565]: I0611 18:41:10.474475 2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/maas-api-bb976594-hlkpk" Jun 11 18:41:11.404179 ip-10-0-130-170 kubenswrapper[2565]: I0611 18:41:11.403913 2565 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-api-bb976594-hlkpk"] Jun 11 18:41:11.404426 ip-10-0-130-170 kubenswrapper[2565]: I0611 18:41:11.404210 2565 kuberuntime_container.go:872] "Killing container with a grace period" pod="opendatahub/maas-api-bb976594-hlkpk" podUID="c6111163-ec5f-414d-bacc-4fb015cc78d1" containerName="maas-api" containerID="cri-o://88b41808833dd77a092cbcb0417afa3c0c9c08c49bb08efa59183ce6992412a8" gracePeriod=30 Jun 11 18:41:11.504167 ip-10-0-130-170 kubenswrapper[2565]: I0611 18:41:11.504132 2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/maas-api-bb976594-c6jrm"] Jun 11 18:41:11.508216 ip-10-0-130-170 kubenswrapper[2565]: I0611 18:41:11.508187 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-bb976594-c6jrm" Jun 11 18:41:11.520498 ip-10-0-130-170 kubenswrapper[2565]: I0611 18:41:11.520014 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-api-bb976594-c6jrm"] Jun 11 18:41:11.677186 ip-10-0-130-170 kubenswrapper[2565]: I0611 18:41:11.677160 2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-bb976594-hlkpk" Jun 11 18:41:11.682095 ip-10-0-130-170 kubenswrapper[2565]: I0611 18:41:11.682063 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xsb8q\" (UniqueName: \"kubernetes.io/projected/f2534569-596b-4980-a79d-7694811a1967-kube-api-access-xsb8q\") pod \"maas-api-bb976594-c6jrm\" (UID: \"f2534569-596b-4980-a79d-7694811a1967\") " pod="opendatahub/maas-api-bb976594-c6jrm" Jun 11 18:41:11.682229 ip-10-0-130-170 kubenswrapper[2565]: I0611 18:41:11.682157 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/f2534569-596b-4980-a79d-7694811a1967-maas-api-tls\") pod \"maas-api-bb976594-c6jrm\" (UID: \"f2534569-596b-4980-a79d-7694811a1967\") " pod="opendatahub/maas-api-bb976594-c6jrm" Jun 11 18:41:11.682229 ip-10-0-130-170 kubenswrapper[2565]: I0611 18:41:11.682186 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/f2534569-596b-4980-a79d-7694811a1967-openshift-service-ca\") pod \"maas-api-bb976594-c6jrm\" (UID: \"f2534569-596b-4980-a79d-7694811a1967\") " pod="opendatahub/maas-api-bb976594-c6jrm" Jun 11 18:41:11.782674 ip-10-0-130-170 kubenswrapper[2565]: I0611 18:41:11.782640 2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-v75q2\" (UniqueName: \"kubernetes.io/projected/c6111163-ec5f-414d-bacc-4fb015cc78d1-kube-api-access-v75q2\") pod \"c6111163-ec5f-414d-bacc-4fb015cc78d1\" (UID: \"c6111163-ec5f-414d-bacc-4fb015cc78d1\") " Jun 11 18:41:11.782842 ip-10-0-130-170 kubenswrapper[2565]: I0611 18:41:11.782713 2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/c6111163-ec5f-414d-bacc-4fb015cc78d1-openshift-service-ca\") pod \"c6111163-ec5f-414d-bacc-4fb015cc78d1\" (UID: \"c6111163-ec5f-414d-bacc-4fb015cc78d1\") " Jun 11 18:41:11.782842 ip-10-0-130-170 kubenswrapper[2565]: I0611 18:41:11.782746 2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/c6111163-ec5f-414d-bacc-4fb015cc78d1-maas-api-tls\") pod \"c6111163-ec5f-414d-bacc-4fb015cc78d1\" (UID: \"c6111163-ec5f-414d-bacc-4fb015cc78d1\") " Jun 11 18:41:11.782930 ip-10-0-130-170 kubenswrapper[2565]: I0611 18:41:11.782889 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xsb8q\" (UniqueName: \"kubernetes.io/projected/f2534569-596b-4980-a79d-7694811a1967-kube-api-access-xsb8q\") pod \"maas-api-bb976594-c6jrm\" (UID: \"f2534569-596b-4980-a79d-7694811a1967\") " pod="opendatahub/maas-api-bb976594-c6jrm" Jun 11 18:41:11.782930 ip-10-0-130-170 kubenswrapper[2565]: I0611 18:41:11.782927 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/f2534569-596b-4980-a79d-7694811a1967-maas-api-tls\") pod \"maas-api-bb976594-c6jrm\" (UID: \"f2534569-596b-4980-a79d-7694811a1967\") " pod="opendatahub/maas-api-bb976594-c6jrm" Jun 11 18:41:11.783016 ip-10-0-130-170 kubenswrapper[2565]: I0611 18:41:11.782944 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/f2534569-596b-4980-a79d-7694811a1967-openshift-service-ca\") pod \"maas-api-bb976594-c6jrm\" (UID: \"f2534569-596b-4980-a79d-7694811a1967\") " pod="opendatahub/maas-api-bb976594-c6jrm" Jun 11 18:41:11.783133 ip-10-0-130-170 kubenswrapper[2565]: I0611 18:41:11.783096 2565 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/c6111163-ec5f-414d-bacc-4fb015cc78d1-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "c6111163-ec5f-414d-bacc-4fb015cc78d1" (UID: "c6111163-ec5f-414d-bacc-4fb015cc78d1"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 11 18:41:11.783652 ip-10-0-130-170 kubenswrapper[2565]: I0611 18:41:11.783632 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/f2534569-596b-4980-a79d-7694811a1967-openshift-service-ca\") pod \"maas-api-bb976594-c6jrm\" (UID: \"f2534569-596b-4980-a79d-7694811a1967\") " pod="opendatahub/maas-api-bb976594-c6jrm" Jun 11 18:41:11.785064 ip-10-0-130-170 kubenswrapper[2565]: I0611 18:41:11.785034 2565 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/c6111163-ec5f-414d-bacc-4fb015cc78d1-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "c6111163-ec5f-414d-bacc-4fb015cc78d1" (UID: "c6111163-ec5f-414d-bacc-4fb015cc78d1"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 11 18:41:11.785160 ip-10-0-130-170 kubenswrapper[2565]: I0611 18:41:11.785108 2565 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/c6111163-ec5f-414d-bacc-4fb015cc78d1-kube-api-access-v75q2" (OuterVolumeSpecName: "kube-api-access-v75q2") pod "c6111163-ec5f-414d-bacc-4fb015cc78d1" (UID: "c6111163-ec5f-414d-bacc-4fb015cc78d1"). InnerVolumeSpecName "kube-api-access-v75q2". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 11 18:41:11.785526 ip-10-0-130-170 kubenswrapper[2565]: I0611 18:41:11.785509 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/f2534569-596b-4980-a79d-7694811a1967-maas-api-tls\") pod \"maas-api-bb976594-c6jrm\" (UID: \"f2534569-596b-4980-a79d-7694811a1967\") " pod="opendatahub/maas-api-bb976594-c6jrm" Jun 11 18:41:11.795681 ip-10-0-130-170 kubenswrapper[2565]: I0611 18:41:11.795651 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-xsb8q\" (UniqueName: \"kubernetes.io/projected/f2534569-596b-4980-a79d-7694811a1967-kube-api-access-xsb8q\") pod \"maas-api-bb976594-c6jrm\" (UID: \"f2534569-596b-4980-a79d-7694811a1967\") " pod="opendatahub/maas-api-bb976594-c6jrm" Jun 11 18:41:11.826104 ip-10-0-130-170 kubenswrapper[2565]: I0611 18:41:11.826075 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-bb976594-c6jrm" Jun 11 18:41:11.891571 ip-10-0-130-170 kubenswrapper[2565]: I0611 18:41:11.890836 2565 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/c6111163-ec5f-414d-bacc-4fb015cc78d1-maas-api-tls\") on node \"ip-10-0-130-170.ec2.internal\" DevicePath \"\"" Jun 11 18:41:11.891571 ip-10-0-130-170 kubenswrapper[2565]: I0611 18:41:11.890871 2565 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-v75q2\" (UniqueName: \"kubernetes.io/projected/c6111163-ec5f-414d-bacc-4fb015cc78d1-kube-api-access-v75q2\") on node \"ip-10-0-130-170.ec2.internal\" DevicePath \"\"" Jun 11 18:41:11.891571 ip-10-0-130-170 kubenswrapper[2565]: I0611 18:41:11.890884 2565 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/c6111163-ec5f-414d-bacc-4fb015cc78d1-openshift-service-ca\") on node \"ip-10-0-130-170.ec2.internal\" DevicePath \"\"" Jun 11 18:41:11.990494 ip-10-0-130-170 kubenswrapper[2565]: I0611 18:41:11.990459 2565 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["keycloak-system/maas-keycloak-0"] Jun 11 18:41:11.990747 ip-10-0-130-170 kubenswrapper[2565]: I0611 18:41:11.990716 2565 kuberuntime_container.go:872] "Killing container with a grace period" pod="keycloak-system/maas-keycloak-0" podUID="37f7fd84-32dc-41f2-a38d-526538e33709" containerName="keycloak" containerID="cri-o://e50ba2460c7ba69246c185ca007ec2c9dc01b839e471cf80fea4f5d0916cadc8" gracePeriod=30 Jun 11 18:41:12.016014 ip-10-0-130-170 kubenswrapper[2565]: I0611 18:41:12.015986 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-api-bb976594-c6jrm"] Jun 11 18:41:12.016681 ip-10-0-130-170 kubenswrapper[2565]: W0611 18:41:12.016656 2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf2534569_596b_4980_a79d_7694811a1967.slice/crio-50213c4c5e9753e0f13ec2cd40e02eac2271154db5f40ac05aa3b3929cf3e0ef WatchSource:0}: Error finding container 50213c4c5e9753e0f13ec2cd40e02eac2271154db5f40ac05aa3b3929cf3e0ef: Status 404 returned error can't find the container with id 50213c4c5e9753e0f13ec2cd40e02eac2271154db5f40ac05aa3b3929cf3e0ef Jun 11 18:41:12.514271 ip-10-0-130-170 kubenswrapper[2565]: I0611 18:41:12.514226 2565 generic.go:356] "Generic (PLEG): container finished" podID="c6111163-ec5f-414d-bacc-4fb015cc78d1" containerID="88b41808833dd77a092cbcb0417afa3c0c9c08c49bb08efa59183ce6992412a8" exitCode=0 Jun 11 18:41:12.514708 ip-10-0-130-170 kubenswrapper[2565]: I0611 18:41:12.514291 2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-bb976594-hlkpk" Jun 11 18:41:12.514708 ip-10-0-130-170 kubenswrapper[2565]: I0611 18:41:12.514321 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-bb976594-hlkpk" event={"ID":"c6111163-ec5f-414d-bacc-4fb015cc78d1","Type":"ContainerDied","Data":"88b41808833dd77a092cbcb0417afa3c0c9c08c49bb08efa59183ce6992412a8"} Jun 11 18:41:12.514708 ip-10-0-130-170 kubenswrapper[2565]: I0611 18:41:12.514394 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-bb976594-hlkpk" event={"ID":"c6111163-ec5f-414d-bacc-4fb015cc78d1","Type":"ContainerDied","Data":"d2e035a8eb46e3a4682d415597a8871a841ba77a2d110040d0f3d99fd13cb6f4"} Jun 11 18:41:12.514708 ip-10-0-130-170 kubenswrapper[2565]: I0611 18:41:12.514431 2565 scope.go:117] "RemoveContainer" containerID="88b41808833dd77a092cbcb0417afa3c0c9c08c49bb08efa59183ce6992412a8" Jun 11 18:41:12.516471 ip-10-0-130-170 kubenswrapper[2565]: I0611 18:41:12.516447 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-bb976594-c6jrm" event={"ID":"f2534569-596b-4980-a79d-7694811a1967","Type":"ContainerStarted","Data":"75ab6582f0a963ea0a9299eecee5024ad0e979f57c2fffdd9bed17a063313576"} Jun 11 18:41:12.516593 ip-10-0-130-170 kubenswrapper[2565]: I0611 18:41:12.516505 2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/maas-api-bb976594-c6jrm" Jun 11 18:41:12.516593 ip-10-0-130-170 kubenswrapper[2565]: I0611 18:41:12.516532 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-bb976594-c6jrm" event={"ID":"f2534569-596b-4980-a79d-7694811a1967","Type":"ContainerStarted","Data":"50213c4c5e9753e0f13ec2cd40e02eac2271154db5f40ac05aa3b3929cf3e0ef"} Jun 11 18:41:12.524878 ip-10-0-130-170 kubenswrapper[2565]: I0611 18:41:12.524861 2565 scope.go:117] "RemoveContainer" containerID="88b41808833dd77a092cbcb0417afa3c0c9c08c49bb08efa59183ce6992412a8" Jun 11 18:41:12.525158 ip-10-0-130-170 kubenswrapper[2565]: E0611 18:41:12.525138 2565 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"88b41808833dd77a092cbcb0417afa3c0c9c08c49bb08efa59183ce6992412a8\": container with ID starting with 88b41808833dd77a092cbcb0417afa3c0c9c08c49bb08efa59183ce6992412a8 not found: ID does not exist" containerID="88b41808833dd77a092cbcb0417afa3c0c9c08c49bb08efa59183ce6992412a8" Jun 11 18:41:12.525222 ip-10-0-130-170 kubenswrapper[2565]: I0611 18:41:12.525168 2565 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"88b41808833dd77a092cbcb0417afa3c0c9c08c49bb08efa59183ce6992412a8"} err="failed to get container status \"88b41808833dd77a092cbcb0417afa3c0c9c08c49bb08efa59183ce6992412a8\": rpc error: code = NotFound desc = could not find container \"88b41808833dd77a092cbcb0417afa3c0c9c08c49bb08efa59183ce6992412a8\": container with ID starting with 88b41808833dd77a092cbcb0417afa3c0c9c08c49bb08efa59183ce6992412a8 not found: ID does not exist" Jun 11 18:41:12.539994 ip-10-0-130-170 kubenswrapper[2565]: I0611 18:41:12.539946 2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/maas-api-bb976594-c6jrm" podStartSLOduration=1.1339194400000001 podStartE2EDuration="1.539932684s" totalImagesPullingTime="406.013244ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-11 18:41:11 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-11 18:41:12.537275191 +0000 UTC m=+791.285961214" watchObservedRunningTime="2026-06-11 18:41:12.539932684 +0000 UTC m=+791.288618706" Jun 11 18:41:12.553925 ip-10-0-130-170 kubenswrapper[2565]: I0611 18:41:12.553903 2565 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-api-bb976594-hlkpk"] Jun 11 18:41:12.559480 ip-10-0-130-170 kubenswrapper[2565]: I0611 18:41:12.559458 2565 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/maas-api-bb976594-hlkpk"] Jun 11 18:41:13.524010 ip-10-0-130-170 kubenswrapper[2565]: I0611 18:41:13.523972 2565 generic.go:356] "Generic (PLEG): container finished" podID="37f7fd84-32dc-41f2-a38d-526538e33709" containerID="e50ba2460c7ba69246c185ca007ec2c9dc01b839e471cf80fea4f5d0916cadc8" exitCode=143 Jun 11 18:41:13.524461 ip-10-0-130-170 kubenswrapper[2565]: I0611 18:41:13.524045 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="keycloak-system/maas-keycloak-0" event={"ID":"37f7fd84-32dc-41f2-a38d-526538e33709","Type":"ContainerDied","Data":"e50ba2460c7ba69246c185ca007ec2c9dc01b839e471cf80fea4f5d0916cadc8"} Jun 11 18:41:13.749388 ip-10-0-130-170 kubenswrapper[2565]: I0611 18:41:13.749303 2565 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="c6111163-ec5f-414d-bacc-4fb015cc78d1" path="/var/lib/kubelet/pods/c6111163-ec5f-414d-bacc-4fb015cc78d1/volumes" Jun 11 18:41:14.044372 ip-10-0-130-170 kubenswrapper[2565]: I0611 18:41:14.044347 2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="keycloak-system/maas-keycloak-0" Jun 11 18:41:14.211826 ip-10-0-130-170 kubenswrapper[2565]: I0611 18:41:14.211790 2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-lhncb\" (UniqueName: \"kubernetes.io/projected/37f7fd84-32dc-41f2-a38d-526538e33709-kube-api-access-lhncb\") pod \"37f7fd84-32dc-41f2-a38d-526538e33709\" (UID: \"37f7fd84-32dc-41f2-a38d-526538e33709\") " Jun 11 18:41:14.214117 ip-10-0-130-170 kubenswrapper[2565]: I0611 18:41:14.214082 2565 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/37f7fd84-32dc-41f2-a38d-526538e33709-kube-api-access-lhncb" (OuterVolumeSpecName: "kube-api-access-lhncb") pod "37f7fd84-32dc-41f2-a38d-526538e33709" (UID: "37f7fd84-32dc-41f2-a38d-526538e33709"). InnerVolumeSpecName "kube-api-access-lhncb". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 11 18:41:14.312989 ip-10-0-130-170 kubenswrapper[2565]: I0611 18:41:14.312899 2565 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-lhncb\" (UniqueName: \"kubernetes.io/projected/37f7fd84-32dc-41f2-a38d-526538e33709-kube-api-access-lhncb\") on node \"ip-10-0-130-170.ec2.internal\" DevicePath \"\"" Jun 11 18:41:14.532612 ip-10-0-130-170 kubenswrapper[2565]: I0611 18:41:14.532579 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="keycloak-system/maas-keycloak-0" event={"ID":"37f7fd84-32dc-41f2-a38d-526538e33709","Type":"ContainerDied","Data":"623972494a5dda67a32a56f77129c315013e0c3443b6e4d13d7f1c3298c1ed75"} Jun 11 18:41:14.533036 ip-10-0-130-170 kubenswrapper[2565]: I0611 18:41:14.532621 2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="keycloak-system/maas-keycloak-0" Jun 11 18:41:14.533036 ip-10-0-130-170 kubenswrapper[2565]: I0611 18:41:14.532670 2565 scope.go:117] "RemoveContainer" containerID="e50ba2460c7ba69246c185ca007ec2c9dc01b839e471cf80fea4f5d0916cadc8" Jun 11 18:41:14.556110 ip-10-0-130-170 kubenswrapper[2565]: I0611 18:41:14.556085 2565 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["keycloak-system/maas-keycloak-0"] Jun 11 18:41:14.560226 ip-10-0-130-170 kubenswrapper[2565]: I0611 18:41:14.560199 2565 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["keycloak-system/maas-keycloak-0"] Jun 11 18:41:14.596387 ip-10-0-130-170 kubenswrapper[2565]: I0611 18:41:14.596310 2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["keycloak-system/maas-keycloak-0"] Jun 11 18:41:14.596783 ip-10-0-130-170 kubenswrapper[2565]: I0611 18:41:14.596762 2565 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="c6111163-ec5f-414d-bacc-4fb015cc78d1" containerName="maas-api" Jun 11 18:41:14.596783 ip-10-0-130-170 kubenswrapper[2565]: I0611 18:41:14.596782 2565 state_mem.go:107] "Deleted CPUSet assignment" podUID="c6111163-ec5f-414d-bacc-4fb015cc78d1" containerName="maas-api" Jun 11 18:41:14.596936 ip-10-0-130-170 kubenswrapper[2565]: I0611 18:41:14.596801 2565 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="37f7fd84-32dc-41f2-a38d-526538e33709" containerName="keycloak" Jun 11 18:41:14.596936 ip-10-0-130-170 kubenswrapper[2565]: I0611 18:41:14.596807 2565 state_mem.go:107] "Deleted CPUSet assignment" podUID="37f7fd84-32dc-41f2-a38d-526538e33709" containerName="keycloak" Jun 11 18:41:14.596936 ip-10-0-130-170 kubenswrapper[2565]: I0611 18:41:14.596863 2565 memory_manager.go:368] "RemoveStaleState removing state" podUID="37f7fd84-32dc-41f2-a38d-526538e33709" containerName="keycloak" Jun 11 18:41:14.596936 ip-10-0-130-170 kubenswrapper[2565]: I0611 18:41:14.596875 2565 memory_manager.go:368] "RemoveStaleState removing state" podUID="c6111163-ec5f-414d-bacc-4fb015cc78d1" containerName="maas-api" Jun 11 18:41:14.601338 ip-10-0-130-170 kubenswrapper[2565]: I0611 18:41:14.601322 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="keycloak-system/maas-keycloak-0" Jun 11 18:41:14.604052 ip-10-0-130-170 kubenswrapper[2565]: I0611 18:41:14.604019 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"keycloak-system\"/\"maas-keycloak-initial-admin\"" Jun 11 18:41:14.604366 ip-10-0-130-170 kubenswrapper[2565]: I0611 18:41:14.604349 2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"keycloak-system\"/\"openshift-service-ca.crt\"" Jun 11 18:41:14.604366 ip-10-0-130-170 kubenswrapper[2565]: I0611 18:41:14.604355 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"keycloak-system\"/\"default-dockercfg-sc9nz\"" Jun 11 18:41:14.604536 ip-10-0-130-170 kubenswrapper[2565]: I0611 18:41:14.604368 2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"keycloak-system\"/\"kube-root-ca.crt\"" Jun 11 18:41:14.604536 ip-10-0-130-170 kubenswrapper[2565]: I0611 18:41:14.604350 2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"keycloak-system\"/\"keycloak-test-realms\"" Jun 11 18:41:14.610451 ip-10-0-130-170 kubenswrapper[2565]: I0611 18:41:14.610429 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["keycloak-system/maas-keycloak-0"] Jun 11 18:41:14.715537 ip-10-0-130-170 kubenswrapper[2565]: I0611 18:41:14.715503 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"test-realms\" (UniqueName: \"kubernetes.io/configmap/78610def-7bd0-46ca-a55b-282e44c3c286-test-realms\") pod \"maas-keycloak-0\" (UID: \"78610def-7bd0-46ca-a55b-282e44c3c286\") " pod="keycloak-system/maas-keycloak-0" Jun 11 18:41:14.715740 ip-10-0-130-170 kubenswrapper[2565]: I0611 18:41:14.715601 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-82wr6\" (UniqueName: \"kubernetes.io/projected/78610def-7bd0-46ca-a55b-282e44c3c286-kube-api-access-82wr6\") pod \"maas-keycloak-0\" (UID: \"78610def-7bd0-46ca-a55b-282e44c3c286\") " pod="keycloak-system/maas-keycloak-0" Jun 11 18:41:14.816210 ip-10-0-130-170 kubenswrapper[2565]: I0611 18:41:14.816179 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-82wr6\" (UniqueName: \"kubernetes.io/projected/78610def-7bd0-46ca-a55b-282e44c3c286-kube-api-access-82wr6\") pod \"maas-keycloak-0\" (UID: \"78610def-7bd0-46ca-a55b-282e44c3c286\") " pod="keycloak-system/maas-keycloak-0" Jun 11 18:41:14.816385 ip-10-0-130-170 kubenswrapper[2565]: I0611 18:41:14.816228 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"test-realms\" (UniqueName: \"kubernetes.io/configmap/78610def-7bd0-46ca-a55b-282e44c3c286-test-realms\") pod \"maas-keycloak-0\" (UID: \"78610def-7bd0-46ca-a55b-282e44c3c286\") " pod="keycloak-system/maas-keycloak-0" Jun 11 18:41:14.816988 ip-10-0-130-170 kubenswrapper[2565]: I0611 18:41:14.816967 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"test-realms\" (UniqueName: \"kubernetes.io/configmap/78610def-7bd0-46ca-a55b-282e44c3c286-test-realms\") pod \"maas-keycloak-0\" (UID: \"78610def-7bd0-46ca-a55b-282e44c3c286\") " pod="keycloak-system/maas-keycloak-0" Jun 11 18:41:14.825521 ip-10-0-130-170 kubenswrapper[2565]: I0611 18:41:14.825500 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-82wr6\" (UniqueName: \"kubernetes.io/projected/78610def-7bd0-46ca-a55b-282e44c3c286-kube-api-access-82wr6\") pod \"maas-keycloak-0\" (UID: \"78610def-7bd0-46ca-a55b-282e44c3c286\") " pod="keycloak-system/maas-keycloak-0" Jun 11 18:41:14.912799 ip-10-0-130-170 kubenswrapper[2565]: I0611 18:41:14.912761 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="keycloak-system/maas-keycloak-0" Jun 11 18:41:15.059338 ip-10-0-130-170 kubenswrapper[2565]: I0611 18:41:15.059309 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["keycloak-system/maas-keycloak-0"] Jun 11 18:41:15.059475 ip-10-0-130-170 kubenswrapper[2565]: W0611 18:41:15.059448 2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod78610def_7bd0_46ca_a55b_282e44c3c286.slice/crio-7be5d3ce3ebbe999ef0874c1dbf47f6611c987a3f5076b398562a8cc571da23d WatchSource:0}: Error finding container 7be5d3ce3ebbe999ef0874c1dbf47f6611c987a3f5076b398562a8cc571da23d: Status 404 returned error can't find the container with id 7be5d3ce3ebbe999ef0874c1dbf47f6611c987a3f5076b398562a8cc571da23d Jun 11 18:41:15.470758 ip-10-0-130-170 kubenswrapper[2565]: I0611 18:41:15.470722 2565 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/payload-pre-processing-579785bc64-d9ctc" podUID="622f4f16-2d87-4bb3-8e2f-1231c35b2d39" containerName="payload-pre-processing" probeResult="failure" output="dial tcp 10.133.0.52:9004: connect: connection refused" Jun 11 18:41:15.470957 ip-10-0-130-170 kubenswrapper[2565]: I0611 18:41:15.470937 2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-processing-699b6cd6c-d2hv7" Jun 11 18:41:15.543797 ip-10-0-130-170 kubenswrapper[2565]: I0611 18:41:15.543764 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="keycloak-system/maas-keycloak-0" event={"ID":"78610def-7bd0-46ca-a55b-282e44c3c286","Type":"ContainerStarted","Data":"5389e3b7718ef5f0ef243b0aa1d7490e4e9aa97f5e0145e280bc7228eb8079a5"} Jun 11 18:41:15.544241 ip-10-0-130-170 kubenswrapper[2565]: I0611 18:41:15.543810 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="keycloak-system/maas-keycloak-0" event={"ID":"78610def-7bd0-46ca-a55b-282e44c3c286","Type":"ContainerStarted","Data":"7be5d3ce3ebbe999ef0874c1dbf47f6611c987a3f5076b398562a8cc571da23d"} Jun 11 18:41:15.565020 ip-10-0-130-170 kubenswrapper[2565]: I0611 18:41:15.564965 2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="keycloak-system/maas-keycloak-0" podStartSLOduration=1.240206913 podStartE2EDuration="1.564949606s" totalImagesPullingTime="324.742693ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-11 18:41:14 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-11 18:41:15.562380138 +0000 UTC m=+794.311066161" watchObservedRunningTime="2026-06-11 18:41:15.564949606 +0000 UTC m=+794.313635639" Jun 11 18:41:15.751401 ip-10-0-130-170 kubenswrapper[2565]: I0611 18:41:15.751311 2565 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="37f7fd84-32dc-41f2-a38d-526538e33709" path="/var/lib/kubelet/pods/37f7fd84-32dc-41f2-a38d-526538e33709/volumes" Jun 11 18:41:15.913079 ip-10-0-130-170 kubenswrapper[2565]: I0611 18:41:15.913039 2565 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="keycloak-system/maas-keycloak-0" Jun 11 18:41:15.914988 ip-10-0-130-170 kubenswrapper[2565]: I0611 18:41:15.914953 2565 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="78610def-7bd0-46ca-a55b-282e44c3c286" containerName="keycloak" probeResult="failure" output="Get \"http://10.133.0.54:9000/health/started\": dial tcp 10.133.0.54:9000: connect: connection refused" Jun 11 18:41:16.914364 ip-10-0-130-170 kubenswrapper[2565]: I0611 18:41:16.914307 2565 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="78610def-7bd0-46ca-a55b-282e44c3c286" containerName="keycloak" probeResult="failure" output="Get \"http://10.133.0.54:9000/health/started\": dial tcp 10.133.0.54:9000: connect: connection refused" Jun 11 18:41:17.913320 ip-10-0-130-170 kubenswrapper[2565]: I0611 18:41:17.913241 2565 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="78610def-7bd0-46ca-a55b-282e44c3c286" containerName="keycloak" probeResult="failure" output="Get \"http://10.133.0.54:9000/health/started\": dial tcp 10.133.0.54:9000: connect: connection refused" Jun 11 18:41:18.531913 ip-10-0-130-170 kubenswrapper[2565]: I0611 18:41:18.531882 2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/maas-api-bb976594-c6jrm" Jun 11 18:41:18.913528 ip-10-0-130-170 kubenswrapper[2565]: I0611 18:41:18.913474 2565 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="78610def-7bd0-46ca-a55b-282e44c3c286" containerName="keycloak" probeResult="failure" output="Get \"http://10.133.0.54:9000/health/started\": dial tcp 10.133.0.54:9000: connect: connection refused" Jun 11 18:41:19.914047 ip-10-0-130-170 kubenswrapper[2565]: I0611 18:41:19.913985 2565 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="78610def-7bd0-46ca-a55b-282e44c3c286" containerName="keycloak" probeResult="failure" output="Get \"http://10.133.0.54:9000/health/started\": dial tcp 10.133.0.54:9000: connect: connection refused" Jun 11 18:41:20.914281 ip-10-0-130-170 kubenswrapper[2565]: I0611 18:41:20.913505 2565 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="78610def-7bd0-46ca-a55b-282e44c3c286" containerName="keycloak" probeResult="failure" output="Get \"http://10.133.0.54:9000/health/started\": dial tcp 10.133.0.54:9000: connect: connection refused" Jun 11 18:41:21.914211 ip-10-0-130-170 kubenswrapper[2565]: I0611 18:41:21.914152 2565 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="78610def-7bd0-46ca-a55b-282e44c3c286" containerName="keycloak" probeResult="failure" output="Get \"http://10.133.0.54:9000/health/started\": dial tcp 10.133.0.54:9000: connect: connection refused" Jun 11 18:41:22.913747 ip-10-0-130-170 kubenswrapper[2565]: I0611 18:41:22.913700 2565 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="78610def-7bd0-46ca-a55b-282e44c3c286" containerName="keycloak" probeResult="failure" output="Get \"http://10.133.0.54:9000/health/started\": dial tcp 10.133.0.54:9000: connect: connection refused" Jun 11 18:41:23.913361 ip-10-0-130-170 kubenswrapper[2565]: I0611 18:41:23.913309 2565 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="78610def-7bd0-46ca-a55b-282e44c3c286" containerName="keycloak" probeResult="failure" output="Get \"http://10.133.0.54:9000/health/started\": dial tcp 10.133.0.54:9000: connect: connection refused" Jun 11 18:41:24.912994 ip-10-0-130-170 kubenswrapper[2565]: I0611 18:41:24.912950 2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="keycloak-system/maas-keycloak-0" Jun 11 18:41:24.913525 ip-10-0-130-170 kubenswrapper[2565]: I0611 18:41:24.913314 2565 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="78610def-7bd0-46ca-a55b-282e44c3c286" containerName="keycloak" probeResult="failure" output="Get \"http://10.133.0.54:9000/health/started\": dial tcp 10.133.0.54:9000: connect: connection refused" Jun 11 18:41:25.470463 ip-10-0-130-170 kubenswrapper[2565]: I0611 18:41:25.470431 2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-pre-processing-579785bc64-d9ctc" Jun 11 18:41:25.914063 ip-10-0-130-170 kubenswrapper[2565]: I0611 18:41:25.914017 2565 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="78610def-7bd0-46ca-a55b-282e44c3c286" containerName="keycloak" probeResult="failure" output="Get \"http://10.133.0.54:9000/health/started\": dial tcp 10.133.0.54:9000: connect: connection refused" Jun 11 18:41:26.914087 ip-10-0-130-170 kubenswrapper[2565]: I0611 18:41:26.914047 2565 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="78610def-7bd0-46ca-a55b-282e44c3c286" containerName="keycloak" probeResult="failure" output="Get \"http://10.133.0.54:9000/health/started\": dial tcp 10.133.0.54:9000: connect: connection refused" Jun 11 18:41:27.913688 ip-10-0-130-170 kubenswrapper[2565]: I0611 18:41:27.913622 2565 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="78610def-7bd0-46ca-a55b-282e44c3c286" containerName="keycloak" probeResult="failure" output="Get \"http://10.133.0.54:9000/health/started\": dial tcp 10.133.0.54:9000: connect: connection refused" Jun 11 18:41:29.017756 ip-10-0-130-170 kubenswrapper[2565]: I0611 18:41:29.017708 2565 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="keycloak-system/maas-keycloak-0" Jun 11 18:41:29.033774 ip-10-0-130-170 kubenswrapper[2565]: I0611 18:41:29.033643 2565 prober.go:120] "Probe failed" probeType="Readiness" pod="keycloak-system/maas-keycloak-0" podUID="78610def-7bd0-46ca-a55b-282e44c3c286" containerName="keycloak" probeResult="failure" output="HTTP probe failed with statuscode: 503" Jun 11 18:41:39.023383 ip-10-0-130-170 kubenswrapper[2565]: I0611 18:41:39.023333 2565 prober.go:120] "Probe failed" probeType="Readiness" pod="keycloak-system/maas-keycloak-0" podUID="78610def-7bd0-46ca-a55b-282e44c3c286" containerName="keycloak" probeResult="failure" output="HTTP probe failed with statuscode: 503" Jun 11 18:41:49.023930 ip-10-0-130-170 kubenswrapper[2565]: I0611 18:41:49.023895 2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="keycloak-system/maas-keycloak-0" Jun 11 18:41:59.751086 ip-10-0-130-170 kubenswrapper[2565]: I0611 18:41:59.751049 2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-59f85ccf7b-mthp8"] Jun 11 18:41:59.754948 ip-10-0-130-170 kubenswrapper[2565]: I0611 18:41:59.754925 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-59f85ccf7b-mthp8" Jun 11 18:41:59.757638 ip-10-0-130-170 kubenswrapper[2565]: I0611 18:41:59.757612 2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"authorino-oidc-ca\"" Jun 11 18:41:59.767349 ip-10-0-130-170 kubenswrapper[2565]: I0611 18:41:59.767325 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-59f85ccf7b-mthp8"] Jun 11 18:41:59.946691 ip-10-0-130-170 kubenswrapper[2565]: I0611 18:41:59.946651 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oidc-ca\" (UniqueName: \"kubernetes.io/configmap/90a842db-ff88-4a4c-88a4-fb8e117d7ab3-oidc-ca\") pod \"authorino-59f85ccf7b-mthp8\" (UID: \"90a842db-ff88-4a4c-88a4-fb8e117d7ab3\") " pod="kuadrant-system/authorino-59f85ccf7b-mthp8" Jun 11 18:41:59.946879 ip-10-0-130-170 kubenswrapper[2565]: I0611 18:41:59.946726 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/90a842db-ff88-4a4c-88a4-fb8e117d7ab3-tls-cert\") pod \"authorino-59f85ccf7b-mthp8\" (UID: \"90a842db-ff88-4a4c-88a4-fb8e117d7ab3\") " pod="kuadrant-system/authorino-59f85ccf7b-mthp8" Jun 11 18:41:59.946879 ip-10-0-130-170 kubenswrapper[2565]: I0611 18:41:59.946794 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zfvjj\" (UniqueName: \"kubernetes.io/projected/90a842db-ff88-4a4c-88a4-fb8e117d7ab3-kube-api-access-zfvjj\") pod \"authorino-59f85ccf7b-mthp8\" (UID: \"90a842db-ff88-4a4c-88a4-fb8e117d7ab3\") " pod="kuadrant-system/authorino-59f85ccf7b-mthp8" Jun 11 18:42:00.048127 ip-10-0-130-170 kubenswrapper[2565]: I0611 18:42:00.048024 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zfvjj\" (UniqueName: \"kubernetes.io/projected/90a842db-ff88-4a4c-88a4-fb8e117d7ab3-kube-api-access-zfvjj\") pod \"authorino-59f85ccf7b-mthp8\" (UID: \"90a842db-ff88-4a4c-88a4-fb8e117d7ab3\") " pod="kuadrant-system/authorino-59f85ccf7b-mthp8" Jun 11 18:42:00.048127 ip-10-0-130-170 kubenswrapper[2565]: I0611 18:42:00.048081 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oidc-ca\" (UniqueName: \"kubernetes.io/configmap/90a842db-ff88-4a4c-88a4-fb8e117d7ab3-oidc-ca\") pod \"authorino-59f85ccf7b-mthp8\" (UID: \"90a842db-ff88-4a4c-88a4-fb8e117d7ab3\") " pod="kuadrant-system/authorino-59f85ccf7b-mthp8" Jun 11 18:42:00.048127 ip-10-0-130-170 kubenswrapper[2565]: I0611 18:42:00.048114 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/90a842db-ff88-4a4c-88a4-fb8e117d7ab3-tls-cert\") pod \"authorino-59f85ccf7b-mthp8\" (UID: \"90a842db-ff88-4a4c-88a4-fb8e117d7ab3\") " pod="kuadrant-system/authorino-59f85ccf7b-mthp8" Jun 11 18:42:00.048771 ip-10-0-130-170 kubenswrapper[2565]: I0611 18:42:00.048750 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"oidc-ca\" (UniqueName: \"kubernetes.io/configmap/90a842db-ff88-4a4c-88a4-fb8e117d7ab3-oidc-ca\") pod \"authorino-59f85ccf7b-mthp8\" (UID: \"90a842db-ff88-4a4c-88a4-fb8e117d7ab3\") " pod="kuadrant-system/authorino-59f85ccf7b-mthp8" Jun 11 18:42:00.050694 ip-10-0-130-170 kubenswrapper[2565]: I0611 18:42:00.050673 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/90a842db-ff88-4a4c-88a4-fb8e117d7ab3-tls-cert\") pod \"authorino-59f85ccf7b-mthp8\" (UID: \"90a842db-ff88-4a4c-88a4-fb8e117d7ab3\") " pod="kuadrant-system/authorino-59f85ccf7b-mthp8" Jun 11 18:42:00.057895 ip-10-0-130-170 kubenswrapper[2565]: I0611 18:42:00.057872 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-zfvjj\" (UniqueName: \"kubernetes.io/projected/90a842db-ff88-4a4c-88a4-fb8e117d7ab3-kube-api-access-zfvjj\") pod \"authorino-59f85ccf7b-mthp8\" (UID: \"90a842db-ff88-4a4c-88a4-fb8e117d7ab3\") " pod="kuadrant-system/authorino-59f85ccf7b-mthp8" Jun 11 18:42:00.066228 ip-10-0-130-170 kubenswrapper[2565]: I0611 18:42:00.066205 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-59f85ccf7b-mthp8" Jun 11 18:42:00.206345 ip-10-0-130-170 kubenswrapper[2565]: I0611 18:42:00.206317 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-59f85ccf7b-mthp8"] Jun 11 18:42:00.207844 ip-10-0-130-170 kubenswrapper[2565]: W0611 18:42:00.207816 2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod90a842db_ff88_4a4c_88a4_fb8e117d7ab3.slice/crio-6560c06d858d0297c4979c0b99604993c3dfd998efe4d4254e33033761dbf80d WatchSource:0}: Error finding container 6560c06d858d0297c4979c0b99604993c3dfd998efe4d4254e33033761dbf80d: Status 404 returned error can't find the container with id 6560c06d858d0297c4979c0b99604993c3dfd998efe4d4254e33033761dbf80d Jun 11 18:42:00.853026 ip-10-0-130-170 kubenswrapper[2565]: I0611 18:42:00.852990 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-59f85ccf7b-mthp8" event={"ID":"90a842db-ff88-4a4c-88a4-fb8e117d7ab3","Type":"ContainerStarted","Data":"84445213ba70d034bc0ab145ff07b95b2dbe93ff180e7f37ef0f516581a1368a"} Jun 11 18:42:00.853456 ip-10-0-130-170 kubenswrapper[2565]: I0611 18:42:00.853038 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-59f85ccf7b-mthp8" event={"ID":"90a842db-ff88-4a4c-88a4-fb8e117d7ab3","Type":"ContainerStarted","Data":"6560c06d858d0297c4979c0b99604993c3dfd998efe4d4254e33033761dbf80d"} Jun 11 18:42:00.872900 ip-10-0-130-170 kubenswrapper[2565]: I0611 18:42:00.872849 2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/authorino-59f85ccf7b-mthp8" podStartSLOduration=1.423267818 podStartE2EDuration="1.872827715s" totalImagesPullingTime="449.559897ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-11 18:41:59 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-11 18:42:00.870236117 +0000 UTC m=+839.618922140" watchObservedRunningTime="2026-06-11 18:42:00.872827715 +0000 UTC m=+839.621513774" Jun 11 18:42:00.896766 ip-10-0-130-170 kubenswrapper[2565]: I0611 18:42:00.896731 2565 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-56f854f9d-l8pf8"] Jun 11 18:42:00.897015 ip-10-0-130-170 kubenswrapper[2565]: I0611 18:42:00.896981 2565 kuberuntime_container.go:872] "Killing container with a grace period" pod="kuadrant-system/authorino-56f854f9d-l8pf8" podUID="20286eda-0acf-44cf-8323-87b4594e0c23" containerName="authorino" containerID="cri-o://98758a3c0dd9930f5ed437c3f64abbe32e4492626bfaf9c425aef715aa3de87d" gracePeriod=30 Jun 11 18:42:01.149577 ip-10-0-130-170 kubenswrapper[2565]: I0611 18:42:01.149552 2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-56f854f9d-l8pf8" Jun 11 18:42:01.261962 ip-10-0-130-170 kubenswrapper[2565]: I0611 18:42:01.261861 2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/20286eda-0acf-44cf-8323-87b4594e0c23-tls-cert\") pod \"20286eda-0acf-44cf-8323-87b4594e0c23\" (UID: \"20286eda-0acf-44cf-8323-87b4594e0c23\") " Jun 11 18:42:01.261962 ip-10-0-130-170 kubenswrapper[2565]: I0611 18:42:01.261937 2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-bvpb9\" (UniqueName: \"kubernetes.io/projected/20286eda-0acf-44cf-8323-87b4594e0c23-kube-api-access-bvpb9\") pod \"20286eda-0acf-44cf-8323-87b4594e0c23\" (UID: \"20286eda-0acf-44cf-8323-87b4594e0c23\") " Jun 11 18:42:01.264138 ip-10-0-130-170 kubenswrapper[2565]: I0611 18:42:01.264111 2565 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/20286eda-0acf-44cf-8323-87b4594e0c23-kube-api-access-bvpb9" (OuterVolumeSpecName: "kube-api-access-bvpb9") pod "20286eda-0acf-44cf-8323-87b4594e0c23" (UID: "20286eda-0acf-44cf-8323-87b4594e0c23"). InnerVolumeSpecName "kube-api-access-bvpb9". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 11 18:42:01.272808 ip-10-0-130-170 kubenswrapper[2565]: I0611 18:42:01.272782 2565 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/20286eda-0acf-44cf-8323-87b4594e0c23-tls-cert" (OuterVolumeSpecName: "tls-cert") pod "20286eda-0acf-44cf-8323-87b4594e0c23" (UID: "20286eda-0acf-44cf-8323-87b4594e0c23"). InnerVolumeSpecName "tls-cert". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 11 18:42:01.363224 ip-10-0-130-170 kubenswrapper[2565]: I0611 18:42:01.363183 2565 reconciler_common.go:299] "Volume detached for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/20286eda-0acf-44cf-8323-87b4594e0c23-tls-cert\") on node \"ip-10-0-130-170.ec2.internal\" DevicePath \"\"" Jun 11 18:42:01.363224 ip-10-0-130-170 kubenswrapper[2565]: I0611 18:42:01.363216 2565 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-bvpb9\" (UniqueName: \"kubernetes.io/projected/20286eda-0acf-44cf-8323-87b4594e0c23-kube-api-access-bvpb9\") on node \"ip-10-0-130-170.ec2.internal\" DevicePath \"\"" Jun 11 18:42:01.860339 ip-10-0-130-170 kubenswrapper[2565]: I0611 18:42:01.860294 2565 generic.go:356] "Generic (PLEG): container finished" podID="20286eda-0acf-44cf-8323-87b4594e0c23" containerID="98758a3c0dd9930f5ed437c3f64abbe32e4492626bfaf9c425aef715aa3de87d" exitCode=0 Jun 11 18:42:01.860339 ip-10-0-130-170 kubenswrapper[2565]: I0611 18:42:01.860337 2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-56f854f9d-l8pf8" Jun 11 18:42:01.860880 ip-10-0-130-170 kubenswrapper[2565]: I0611 18:42:01.860373 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-56f854f9d-l8pf8" event={"ID":"20286eda-0acf-44cf-8323-87b4594e0c23","Type":"ContainerDied","Data":"98758a3c0dd9930f5ed437c3f64abbe32e4492626bfaf9c425aef715aa3de87d"} Jun 11 18:42:01.860880 ip-10-0-130-170 kubenswrapper[2565]: I0611 18:42:01.860420 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-56f854f9d-l8pf8" event={"ID":"20286eda-0acf-44cf-8323-87b4594e0c23","Type":"ContainerDied","Data":"08103347bed0b21d62dd81a414de40ac0154ab65284faf6156cad73442f53dd4"} Jun 11 18:42:01.860880 ip-10-0-130-170 kubenswrapper[2565]: I0611 18:42:01.860441 2565 scope.go:117] "RemoveContainer" containerID="98758a3c0dd9930f5ed437c3f64abbe32e4492626bfaf9c425aef715aa3de87d" Jun 11 18:42:01.870072 ip-10-0-130-170 kubenswrapper[2565]: I0611 18:42:01.870053 2565 scope.go:117] "RemoveContainer" containerID="98758a3c0dd9930f5ed437c3f64abbe32e4492626bfaf9c425aef715aa3de87d" Jun 11 18:42:01.870391 ip-10-0-130-170 kubenswrapper[2565]: E0611 18:42:01.870369 2565 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"98758a3c0dd9930f5ed437c3f64abbe32e4492626bfaf9c425aef715aa3de87d\": container with ID starting with 98758a3c0dd9930f5ed437c3f64abbe32e4492626bfaf9c425aef715aa3de87d not found: ID does not exist" containerID="98758a3c0dd9930f5ed437c3f64abbe32e4492626bfaf9c425aef715aa3de87d" Jun 11 18:42:01.870461 ip-10-0-130-170 kubenswrapper[2565]: I0611 18:42:01.870401 2565 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"98758a3c0dd9930f5ed437c3f64abbe32e4492626bfaf9c425aef715aa3de87d"} err="failed to get container status \"98758a3c0dd9930f5ed437c3f64abbe32e4492626bfaf9c425aef715aa3de87d\": rpc error: code = NotFound desc = could not find container \"98758a3c0dd9930f5ed437c3f64abbe32e4492626bfaf9c425aef715aa3de87d\": container with ID starting with 98758a3c0dd9930f5ed437c3f64abbe32e4492626bfaf9c425aef715aa3de87d not found: ID does not exist" Jun 11 18:42:01.883014 ip-10-0-130-170 kubenswrapper[2565]: I0611 18:42:01.882984 2565 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-56f854f9d-l8pf8"] Jun 11 18:42:01.888565 ip-10-0-130-170 kubenswrapper[2565]: I0611 18:42:01.888540 2565 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/authorino-56f854f9d-l8pf8"] Jun 11 18:42:03.749650 ip-10-0-130-170 kubenswrapper[2565]: I0611 18:42:03.749616 2565 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="20286eda-0acf-44cf-8323-87b4594e0c23" path="/var/lib/kubelet/pods/20286eda-0acf-44cf-8323-87b4594e0c23/volumes" Jun 11 18:42:09.189506 ip-10-0-130-170 kubenswrapper[2565]: I0611 18:42:09.189473 2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/e2e-distinct-2-simulated-kserve-f5c55bdc-fwhg5"] Jun 11 18:42:09.190053 ip-10-0-130-170 kubenswrapper[2565]: I0611 18:42:09.190033 2565 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="20286eda-0acf-44cf-8323-87b4594e0c23" containerName="authorino" Jun 11 18:42:09.190131 ip-10-0-130-170 kubenswrapper[2565]: I0611 18:42:09.190056 2565 state_mem.go:107] "Deleted CPUSet assignment" podUID="20286eda-0acf-44cf-8323-87b4594e0c23" containerName="authorino" Jun 11 18:42:09.190202 ip-10-0-130-170 kubenswrapper[2565]: I0611 18:42:09.190189 2565 memory_manager.go:368] "RemoveStaleState removing state" podUID="20286eda-0acf-44cf-8323-87b4594e0c23" containerName="authorino" Jun 11 18:42:09.195029 ip-10-0-130-170 kubenswrapper[2565]: I0611 18:42:09.195008 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-distinct-2-simulated-kserve-f5c55bdc-fwhg5" Jun 11 18:42:09.198836 ip-10-0-130-170 kubenswrapper[2565]: I0611 18:42:09.198811 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"default-dockercfg-9mwhp\"" Jun 11 18:42:09.198836 ip-10-0-130-170 kubenswrapper[2565]: I0611 18:42:09.198824 2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"llm\"/\"openshift-service-ca.crt\"" Jun 11 18:42:09.199036 ip-10-0-130-170 kubenswrapper[2565]: I0611 18:42:09.198893 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"e2e-distinct-2-simulated-kserve-self-signed-certs\"" Jun 11 18:42:09.199036 ip-10-0-130-170 kubenswrapper[2565]: I0611 18:42:09.198948 2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"llm\"/\"kube-root-ca.crt\"" Jun 11 18:42:09.206959 ip-10-0-130-170 kubenswrapper[2565]: I0611 18:42:09.206933 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-distinct-2-simulated-kserve-f5c55bdc-fwhg5"] Jun 11 18:42:09.221389 ip-10-0-130-170 kubenswrapper[2565]: I0611 18:42:09.221352 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/a7051158-f12c-48c2-ba7a-2cbf14d021be-model-cache\") pod \"e2e-distinct-2-simulated-kserve-f5c55bdc-fwhg5\" (UID: \"a7051158-f12c-48c2-ba7a-2cbf14d021be\") " pod="llm/e2e-distinct-2-simulated-kserve-f5c55bdc-fwhg5" Jun 11 18:42:09.221662 ip-10-0-130-170 kubenswrapper[2565]: I0611 18:42:09.221629 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/a7051158-f12c-48c2-ba7a-2cbf14d021be-tls-certs\") pod \"e2e-distinct-2-simulated-kserve-f5c55bdc-fwhg5\" (UID: \"a7051158-f12c-48c2-ba7a-2cbf14d021be\") " pod="llm/e2e-distinct-2-simulated-kserve-f5c55bdc-fwhg5" Jun 11 18:42:09.221870 ip-10-0-130-170 kubenswrapper[2565]: I0611 18:42:09.221853 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zpwt5\" (UniqueName: \"kubernetes.io/projected/a7051158-f12c-48c2-ba7a-2cbf14d021be-kube-api-access-zpwt5\") pod \"e2e-distinct-2-simulated-kserve-f5c55bdc-fwhg5\" (UID: \"a7051158-f12c-48c2-ba7a-2cbf14d021be\") " pod="llm/e2e-distinct-2-simulated-kserve-f5c55bdc-fwhg5" Jun 11 18:42:09.221991 ip-10-0-130-170 kubenswrapper[2565]: I0611 18:42:09.221977 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/a7051158-f12c-48c2-ba7a-2cbf14d021be-dshm\") pod \"e2e-distinct-2-simulated-kserve-f5c55bdc-fwhg5\" (UID: \"a7051158-f12c-48c2-ba7a-2cbf14d021be\") " pod="llm/e2e-distinct-2-simulated-kserve-f5c55bdc-fwhg5" Jun 11 18:42:09.222124 ip-10-0-130-170 kubenswrapper[2565]: I0611 18:42:09.222111 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/a7051158-f12c-48c2-ba7a-2cbf14d021be-home\") pod \"e2e-distinct-2-simulated-kserve-f5c55bdc-fwhg5\" (UID: \"a7051158-f12c-48c2-ba7a-2cbf14d021be\") " pod="llm/e2e-distinct-2-simulated-kserve-f5c55bdc-fwhg5" Jun 11 18:42:09.222337 ip-10-0-130-170 kubenswrapper[2565]: I0611 18:42:09.222320 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/a7051158-f12c-48c2-ba7a-2cbf14d021be-kserve-provision-location\") pod \"e2e-distinct-2-simulated-kserve-f5c55bdc-fwhg5\" (UID: \"a7051158-f12c-48c2-ba7a-2cbf14d021be\") " pod="llm/e2e-distinct-2-simulated-kserve-f5c55bdc-fwhg5" Jun 11 18:42:09.323368 ip-10-0-130-170 kubenswrapper[2565]: I0611 18:42:09.323323 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/a7051158-f12c-48c2-ba7a-2cbf14d021be-kserve-provision-location\") pod \"e2e-distinct-2-simulated-kserve-f5c55bdc-fwhg5\" (UID: \"a7051158-f12c-48c2-ba7a-2cbf14d021be\") " pod="llm/e2e-distinct-2-simulated-kserve-f5c55bdc-fwhg5" Jun 11 18:42:09.323368 ip-10-0-130-170 kubenswrapper[2565]: I0611 18:42:09.323375 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/a7051158-f12c-48c2-ba7a-2cbf14d021be-model-cache\") pod \"e2e-distinct-2-simulated-kserve-f5c55bdc-fwhg5\" (UID: \"a7051158-f12c-48c2-ba7a-2cbf14d021be\") " pod="llm/e2e-distinct-2-simulated-kserve-f5c55bdc-fwhg5" Jun 11 18:42:09.323592 ip-10-0-130-170 kubenswrapper[2565]: I0611 18:42:09.323396 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/a7051158-f12c-48c2-ba7a-2cbf14d021be-tls-certs\") pod \"e2e-distinct-2-simulated-kserve-f5c55bdc-fwhg5\" (UID: \"a7051158-f12c-48c2-ba7a-2cbf14d021be\") " pod="llm/e2e-distinct-2-simulated-kserve-f5c55bdc-fwhg5" Jun 11 18:42:09.323592 ip-10-0-130-170 kubenswrapper[2565]: I0611 18:42:09.323427 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zpwt5\" (UniqueName: \"kubernetes.io/projected/a7051158-f12c-48c2-ba7a-2cbf14d021be-kube-api-access-zpwt5\") pod \"e2e-distinct-2-simulated-kserve-f5c55bdc-fwhg5\" (UID: \"a7051158-f12c-48c2-ba7a-2cbf14d021be\") " pod="llm/e2e-distinct-2-simulated-kserve-f5c55bdc-fwhg5" Jun 11 18:42:09.323592 ip-10-0-130-170 kubenswrapper[2565]: I0611 18:42:09.323449 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/a7051158-f12c-48c2-ba7a-2cbf14d021be-dshm\") pod \"e2e-distinct-2-simulated-kserve-f5c55bdc-fwhg5\" (UID: \"a7051158-f12c-48c2-ba7a-2cbf14d021be\") " pod="llm/e2e-distinct-2-simulated-kserve-f5c55bdc-fwhg5" Jun 11 18:42:09.323592 ip-10-0-130-170 kubenswrapper[2565]: I0611 18:42:09.323486 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/a7051158-f12c-48c2-ba7a-2cbf14d021be-home\") pod \"e2e-distinct-2-simulated-kserve-f5c55bdc-fwhg5\" (UID: \"a7051158-f12c-48c2-ba7a-2cbf14d021be\") " pod="llm/e2e-distinct-2-simulated-kserve-f5c55bdc-fwhg5" Jun 11 18:42:09.323855 ip-10-0-130-170 kubenswrapper[2565]: I0611 18:42:09.323829 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/a7051158-f12c-48c2-ba7a-2cbf14d021be-model-cache\") pod \"e2e-distinct-2-simulated-kserve-f5c55bdc-fwhg5\" (UID: \"a7051158-f12c-48c2-ba7a-2cbf14d021be\") " pod="llm/e2e-distinct-2-simulated-kserve-f5c55bdc-fwhg5" Jun 11 18:42:09.323898 ip-10-0-130-170 kubenswrapper[2565]: I0611 18:42:09.323858 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/a7051158-f12c-48c2-ba7a-2cbf14d021be-kserve-provision-location\") pod \"e2e-distinct-2-simulated-kserve-f5c55bdc-fwhg5\" (UID: \"a7051158-f12c-48c2-ba7a-2cbf14d021be\") " pod="llm/e2e-distinct-2-simulated-kserve-f5c55bdc-fwhg5" Jun 11 18:42:09.323943 ip-10-0-130-170 kubenswrapper[2565]: I0611 18:42:09.323927 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/a7051158-f12c-48c2-ba7a-2cbf14d021be-home\") pod \"e2e-distinct-2-simulated-kserve-f5c55bdc-fwhg5\" (UID: \"a7051158-f12c-48c2-ba7a-2cbf14d021be\") " pod="llm/e2e-distinct-2-simulated-kserve-f5c55bdc-fwhg5" Jun 11 18:42:09.325944 ip-10-0-130-170 kubenswrapper[2565]: I0611 18:42:09.325924 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/a7051158-f12c-48c2-ba7a-2cbf14d021be-dshm\") pod \"e2e-distinct-2-simulated-kserve-f5c55bdc-fwhg5\" (UID: \"a7051158-f12c-48c2-ba7a-2cbf14d021be\") " pod="llm/e2e-distinct-2-simulated-kserve-f5c55bdc-fwhg5" Jun 11 18:42:09.326100 ip-10-0-130-170 kubenswrapper[2565]: I0611 18:42:09.326081 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/a7051158-f12c-48c2-ba7a-2cbf14d021be-tls-certs\") pod \"e2e-distinct-2-simulated-kserve-f5c55bdc-fwhg5\" (UID: \"a7051158-f12c-48c2-ba7a-2cbf14d021be\") " pod="llm/e2e-distinct-2-simulated-kserve-f5c55bdc-fwhg5" Jun 11 18:42:09.335568 ip-10-0-130-170 kubenswrapper[2565]: I0611 18:42:09.335516 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-zpwt5\" (UniqueName: \"kubernetes.io/projected/a7051158-f12c-48c2-ba7a-2cbf14d021be-kube-api-access-zpwt5\") pod \"e2e-distinct-2-simulated-kserve-f5c55bdc-fwhg5\" (UID: \"a7051158-f12c-48c2-ba7a-2cbf14d021be\") " pod="llm/e2e-distinct-2-simulated-kserve-f5c55bdc-fwhg5" Jun 11 18:42:09.507641 ip-10-0-130-170 kubenswrapper[2565]: I0611 18:42:09.507542 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-distinct-2-simulated-kserve-f5c55bdc-fwhg5" Jun 11 18:42:09.652811 ip-10-0-130-170 kubenswrapper[2565]: I0611 18:42:09.652700 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-distinct-2-simulated-kserve-f5c55bdc-fwhg5"] Jun 11 18:42:09.654170 ip-10-0-130-170 kubenswrapper[2565]: W0611 18:42:09.654142 2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda7051158_f12c_48c2_ba7a_2cbf14d021be.slice/crio-076e3596654586229c9881bb6804a1b2e540ee4f4b75890b53e8b9b0449a38e8 WatchSource:0}: Error finding container 076e3596654586229c9881bb6804a1b2e540ee4f4b75890b53e8b9b0449a38e8: Status 404 returned error can't find the container with id 076e3596654586229c9881bb6804a1b2e540ee4f4b75890b53e8b9b0449a38e8 Jun 11 18:42:09.915364 ip-10-0-130-170 kubenswrapper[2565]: I0611 18:42:09.915325 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-2-simulated-kserve-f5c55bdc-fwhg5" event={"ID":"a7051158-f12c-48c2-ba7a-2cbf14d021be","Type":"ContainerStarted","Data":"076e3596654586229c9881bb6804a1b2e540ee4f4b75890b53e8b9b0449a38e8"} Jun 11 18:42:13.944397 ip-10-0-130-170 kubenswrapper[2565]: I0611 18:42:13.944358 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-2-simulated-kserve-f5c55bdc-fwhg5" event={"ID":"a7051158-f12c-48c2-ba7a-2cbf14d021be","Type":"ContainerStarted","Data":"ebed0409b406e92841498d739ee431118c20aa42893ab561a1208ad8b001a66c"} Jun 11 18:42:22.922997 ip-10-0-130-170 kubenswrapper[2565]: I0611 18:42:22.922959 2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-shpcp"] Jun 11 18:42:22.928394 ip-10-0-130-170 kubenswrapper[2565]: I0611 18:42:22.928370 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-shpcp" Jun 11 18:42:22.933410 ip-10-0-130-170 kubenswrapper[2565]: I0611 18:42:22.933364 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"e2e-trlp-test-simulated-kserve-self-signed-certs\"" Jun 11 18:42:22.945675 ip-10-0-130-170 kubenswrapper[2565]: I0611 18:42:22.945644 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-shpcp"] Jun 11 18:42:23.045999 ip-10-0-130-170 kubenswrapper[2565]: I0611 18:42:23.045963 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-cnt26\" (UniqueName: \"kubernetes.io/projected/535174ab-057c-47de-b389-c3bea2fb6d0a-kube-api-access-cnt26\") pod \"e2e-trlp-test-simulated-kserve-68bb6c58d9-shpcp\" (UID: \"535174ab-057c-47de-b389-c3bea2fb6d0a\") " pod="llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-shpcp" Jun 11 18:42:23.045999 ip-10-0-130-170 kubenswrapper[2565]: I0611 18:42:23.046001 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/535174ab-057c-47de-b389-c3bea2fb6d0a-model-cache\") pod \"e2e-trlp-test-simulated-kserve-68bb6c58d9-shpcp\" (UID: \"535174ab-057c-47de-b389-c3bea2fb6d0a\") " pod="llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-shpcp" Jun 11 18:42:23.046228 ip-10-0-130-170 kubenswrapper[2565]: I0611 18:42:23.046021 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/535174ab-057c-47de-b389-c3bea2fb6d0a-tls-certs\") pod \"e2e-trlp-test-simulated-kserve-68bb6c58d9-shpcp\" (UID: \"535174ab-057c-47de-b389-c3bea2fb6d0a\") " pod="llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-shpcp" Jun 11 18:42:23.046228 ip-10-0-130-170 kubenswrapper[2565]: I0611 18:42:23.046070 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/535174ab-057c-47de-b389-c3bea2fb6d0a-home\") pod \"e2e-trlp-test-simulated-kserve-68bb6c58d9-shpcp\" (UID: \"535174ab-057c-47de-b389-c3bea2fb6d0a\") " pod="llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-shpcp" Jun 11 18:42:23.046228 ip-10-0-130-170 kubenswrapper[2565]: I0611 18:42:23.046087 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/535174ab-057c-47de-b389-c3bea2fb6d0a-dshm\") pod \"e2e-trlp-test-simulated-kserve-68bb6c58d9-shpcp\" (UID: \"535174ab-057c-47de-b389-c3bea2fb6d0a\") " pod="llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-shpcp" Jun 11 18:42:23.046228 ip-10-0-130-170 kubenswrapper[2565]: I0611 18:42:23.046101 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/535174ab-057c-47de-b389-c3bea2fb6d0a-kserve-provision-location\") pod \"e2e-trlp-test-simulated-kserve-68bb6c58d9-shpcp\" (UID: \"535174ab-057c-47de-b389-c3bea2fb6d0a\") " pod="llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-shpcp" Jun 11 18:42:23.147613 ip-10-0-130-170 kubenswrapper[2565]: I0611 18:42:23.147574 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-cnt26\" (UniqueName: \"kubernetes.io/projected/535174ab-057c-47de-b389-c3bea2fb6d0a-kube-api-access-cnt26\") pod \"e2e-trlp-test-simulated-kserve-68bb6c58d9-shpcp\" (UID: \"535174ab-057c-47de-b389-c3bea2fb6d0a\") " pod="llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-shpcp" Jun 11 18:42:23.147613 ip-10-0-130-170 kubenswrapper[2565]: I0611 18:42:23.147615 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/535174ab-057c-47de-b389-c3bea2fb6d0a-model-cache\") pod \"e2e-trlp-test-simulated-kserve-68bb6c58d9-shpcp\" (UID: \"535174ab-057c-47de-b389-c3bea2fb6d0a\") " pod="llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-shpcp" Jun 11 18:42:23.147887 ip-10-0-130-170 kubenswrapper[2565]: I0611 18:42:23.147649 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/535174ab-057c-47de-b389-c3bea2fb6d0a-tls-certs\") pod \"e2e-trlp-test-simulated-kserve-68bb6c58d9-shpcp\" (UID: \"535174ab-057c-47de-b389-c3bea2fb6d0a\") " pod="llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-shpcp" Jun 11 18:42:23.147887 ip-10-0-130-170 kubenswrapper[2565]: I0611 18:42:23.147822 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/535174ab-057c-47de-b389-c3bea2fb6d0a-home\") pod \"e2e-trlp-test-simulated-kserve-68bb6c58d9-shpcp\" (UID: \"535174ab-057c-47de-b389-c3bea2fb6d0a\") " pod="llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-shpcp" Jun 11 18:42:23.147887 ip-10-0-130-170 kubenswrapper[2565]: I0611 18:42:23.147859 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/535174ab-057c-47de-b389-c3bea2fb6d0a-dshm\") pod \"e2e-trlp-test-simulated-kserve-68bb6c58d9-shpcp\" (UID: \"535174ab-057c-47de-b389-c3bea2fb6d0a\") " pod="llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-shpcp" Jun 11 18:42:23.147887 ip-10-0-130-170 kubenswrapper[2565]: I0611 18:42:23.147876 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/535174ab-057c-47de-b389-c3bea2fb6d0a-kserve-provision-location\") pod \"e2e-trlp-test-simulated-kserve-68bb6c58d9-shpcp\" (UID: \"535174ab-057c-47de-b389-c3bea2fb6d0a\") " pod="llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-shpcp" Jun 11 18:42:23.148098 ip-10-0-130-170 kubenswrapper[2565]: I0611 18:42:23.148047 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/535174ab-057c-47de-b389-c3bea2fb6d0a-model-cache\") pod \"e2e-trlp-test-simulated-kserve-68bb6c58d9-shpcp\" (UID: \"535174ab-057c-47de-b389-c3bea2fb6d0a\") " pod="llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-shpcp" Jun 11 18:42:23.148162 ip-10-0-130-170 kubenswrapper[2565]: I0611 18:42:23.148132 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/535174ab-057c-47de-b389-c3bea2fb6d0a-home\") pod \"e2e-trlp-test-simulated-kserve-68bb6c58d9-shpcp\" (UID: \"535174ab-057c-47de-b389-c3bea2fb6d0a\") " pod="llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-shpcp" Jun 11 18:42:23.148238 ip-10-0-130-170 kubenswrapper[2565]: I0611 18:42:23.148220 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/535174ab-057c-47de-b389-c3bea2fb6d0a-kserve-provision-location\") pod \"e2e-trlp-test-simulated-kserve-68bb6c58d9-shpcp\" (UID: \"535174ab-057c-47de-b389-c3bea2fb6d0a\") " pod="llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-shpcp" Jun 11 18:42:23.150157 ip-10-0-130-170 kubenswrapper[2565]: I0611 18:42:23.150128 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/535174ab-057c-47de-b389-c3bea2fb6d0a-dshm\") pod \"e2e-trlp-test-simulated-kserve-68bb6c58d9-shpcp\" (UID: \"535174ab-057c-47de-b389-c3bea2fb6d0a\") " pod="llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-shpcp" Jun 11 18:42:23.150490 ip-10-0-130-170 kubenswrapper[2565]: I0611 18:42:23.150474 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/535174ab-057c-47de-b389-c3bea2fb6d0a-tls-certs\") pod \"e2e-trlp-test-simulated-kserve-68bb6c58d9-shpcp\" (UID: \"535174ab-057c-47de-b389-c3bea2fb6d0a\") " pod="llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-shpcp" Jun 11 18:42:23.157958 ip-10-0-130-170 kubenswrapper[2565]: I0611 18:42:23.157931 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-cnt26\" (UniqueName: \"kubernetes.io/projected/535174ab-057c-47de-b389-c3bea2fb6d0a-kube-api-access-cnt26\") pod \"e2e-trlp-test-simulated-kserve-68bb6c58d9-shpcp\" (UID: \"535174ab-057c-47de-b389-c3bea2fb6d0a\") " pod="llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-shpcp" Jun 11 18:42:23.241696 ip-10-0-130-170 kubenswrapper[2565]: I0611 18:42:23.241609 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-shpcp" Jun 11 18:42:23.386283 ip-10-0-130-170 kubenswrapper[2565]: I0611 18:42:23.386237 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-shpcp"] Jun 11 18:42:23.387321 ip-10-0-130-170 kubenswrapper[2565]: W0611 18:42:23.387293 2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod535174ab_057c_47de_b389_c3bea2fb6d0a.slice/crio-dbdfb7825c341f1cae8b66fdaa0b792683c4bf712a41c910dccf441901b67efb WatchSource:0}: Error finding container dbdfb7825c341f1cae8b66fdaa0b792683c4bf712a41c910dccf441901b67efb: Status 404 returned error can't find the container with id dbdfb7825c341f1cae8b66fdaa0b792683c4bf712a41c910dccf441901b67efb Jun 11 18:42:24.004215 ip-10-0-130-170 kubenswrapper[2565]: I0611 18:42:24.004181 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-shpcp" event={"ID":"535174ab-057c-47de-b389-c3bea2fb6d0a","Type":"ContainerStarted","Data":"998aed975c14b8f1a14e2cfe92d4095b3f1540f90afbf001ab76690d19b66230"} Jun 11 18:42:24.004609 ip-10-0-130-170 kubenswrapper[2565]: I0611 18:42:24.004242 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-shpcp" event={"ID":"535174ab-057c-47de-b389-c3bea2fb6d0a","Type":"ContainerStarted","Data":"dbdfb7825c341f1cae8b66fdaa0b792683c4bf712a41c910dccf441901b67efb"} Jun 11 18:42:38.778789 ip-10-0-130-170 kubenswrapper[2565]: I0611 18:42:38.778753 2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/facebook-opt-125m-simulated-kserve-6f969c879b-w2b4n"] Jun 11 18:42:38.784225 ip-10-0-130-170 kubenswrapper[2565]: I0611 18:42:38.784202 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/facebook-opt-125m-simulated-kserve-6f969c879b-w2b4n" Jun 11 18:42:38.789094 ip-10-0-130-170 kubenswrapper[2565]: I0611 18:42:38.789064 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"facebook-opt-125m-simulated-kserve-self-signed-certs\"" Jun 11 18:42:38.826387 ip-10-0-130-170 kubenswrapper[2565]: I0611 18:42:38.826352 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/facebook-opt-125m-simulated-kserve-6f969c879b-w2b4n"] Jun 11 18:42:38.895243 ip-10-0-130-170 kubenswrapper[2565]: I0611 18:42:38.895202 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/87aaa67f-f24d-47cb-b314-39d938d9a531-dshm\") pod \"facebook-opt-125m-simulated-kserve-6f969c879b-w2b4n\" (UID: \"87aaa67f-f24d-47cb-b314-39d938d9a531\") " pod="llm/facebook-opt-125m-simulated-kserve-6f969c879b-w2b4n" Jun 11 18:42:38.895454 ip-10-0-130-170 kubenswrapper[2565]: I0611 18:42:38.895297 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/87aaa67f-f24d-47cb-b314-39d938d9a531-kserve-provision-location\") pod \"facebook-opt-125m-simulated-kserve-6f969c879b-w2b4n\" (UID: \"87aaa67f-f24d-47cb-b314-39d938d9a531\") " pod="llm/facebook-opt-125m-simulated-kserve-6f969c879b-w2b4n" Jun 11 18:42:38.895454 ip-10-0-130-170 kubenswrapper[2565]: I0611 18:42:38.895373 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/87aaa67f-f24d-47cb-b314-39d938d9a531-model-cache\") pod \"facebook-opt-125m-simulated-kserve-6f969c879b-w2b4n\" (UID: \"87aaa67f-f24d-47cb-b314-39d938d9a531\") " pod="llm/facebook-opt-125m-simulated-kserve-6f969c879b-w2b4n" Jun 11 18:42:38.895454 ip-10-0-130-170 kubenswrapper[2565]: I0611 18:42:38.895425 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/87aaa67f-f24d-47cb-b314-39d938d9a531-home\") pod \"facebook-opt-125m-simulated-kserve-6f969c879b-w2b4n\" (UID: \"87aaa67f-f24d-47cb-b314-39d938d9a531\") " pod="llm/facebook-opt-125m-simulated-kserve-6f969c879b-w2b4n" Jun 11 18:42:38.895596 ip-10-0-130-170 kubenswrapper[2565]: I0611 18:42:38.895501 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-d4dqx\" (UniqueName: \"kubernetes.io/projected/87aaa67f-f24d-47cb-b314-39d938d9a531-kube-api-access-d4dqx\") pod \"facebook-opt-125m-simulated-kserve-6f969c879b-w2b4n\" (UID: \"87aaa67f-f24d-47cb-b314-39d938d9a531\") " pod="llm/facebook-opt-125m-simulated-kserve-6f969c879b-w2b4n" Jun 11 18:42:38.895596 ip-10-0-130-170 kubenswrapper[2565]: I0611 18:42:38.895540 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/87aaa67f-f24d-47cb-b314-39d938d9a531-tls-certs\") pod \"facebook-opt-125m-simulated-kserve-6f969c879b-w2b4n\" (UID: \"87aaa67f-f24d-47cb-b314-39d938d9a531\") " pod="llm/facebook-opt-125m-simulated-kserve-6f969c879b-w2b4n" Jun 11 18:42:38.996547 ip-10-0-130-170 kubenswrapper[2565]: I0611 18:42:38.996506 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/87aaa67f-f24d-47cb-b314-39d938d9a531-model-cache\") pod \"facebook-opt-125m-simulated-kserve-6f969c879b-w2b4n\" (UID: \"87aaa67f-f24d-47cb-b314-39d938d9a531\") " pod="llm/facebook-opt-125m-simulated-kserve-6f969c879b-w2b4n" Jun 11 18:42:38.996751 ip-10-0-130-170 kubenswrapper[2565]: I0611 18:42:38.996568 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/87aaa67f-f24d-47cb-b314-39d938d9a531-home\") pod \"facebook-opt-125m-simulated-kserve-6f969c879b-w2b4n\" (UID: \"87aaa67f-f24d-47cb-b314-39d938d9a531\") " pod="llm/facebook-opt-125m-simulated-kserve-6f969c879b-w2b4n" Jun 11 18:42:38.996751 ip-10-0-130-170 kubenswrapper[2565]: I0611 18:42:38.996609 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-d4dqx\" (UniqueName: \"kubernetes.io/projected/87aaa67f-f24d-47cb-b314-39d938d9a531-kube-api-access-d4dqx\") pod \"facebook-opt-125m-simulated-kserve-6f969c879b-w2b4n\" (UID: \"87aaa67f-f24d-47cb-b314-39d938d9a531\") " pod="llm/facebook-opt-125m-simulated-kserve-6f969c879b-w2b4n" Jun 11 18:42:38.996751 ip-10-0-130-170 kubenswrapper[2565]: I0611 18:42:38.996641 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/87aaa67f-f24d-47cb-b314-39d938d9a531-tls-certs\") pod \"facebook-opt-125m-simulated-kserve-6f969c879b-w2b4n\" (UID: \"87aaa67f-f24d-47cb-b314-39d938d9a531\") " pod="llm/facebook-opt-125m-simulated-kserve-6f969c879b-w2b4n" Jun 11 18:42:38.996751 ip-10-0-130-170 kubenswrapper[2565]: I0611 18:42:38.996678 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/87aaa67f-f24d-47cb-b314-39d938d9a531-dshm\") pod \"facebook-opt-125m-simulated-kserve-6f969c879b-w2b4n\" (UID: \"87aaa67f-f24d-47cb-b314-39d938d9a531\") " pod="llm/facebook-opt-125m-simulated-kserve-6f969c879b-w2b4n" Jun 11 18:42:38.996751 ip-10-0-130-170 kubenswrapper[2565]: I0611 18:42:38.996716 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/87aaa67f-f24d-47cb-b314-39d938d9a531-kserve-provision-location\") pod \"facebook-opt-125m-simulated-kserve-6f969c879b-w2b4n\" (UID: \"87aaa67f-f24d-47cb-b314-39d938d9a531\") " pod="llm/facebook-opt-125m-simulated-kserve-6f969c879b-w2b4n" Jun 11 18:42:38.997167 ip-10-0-130-170 kubenswrapper[2565]: I0611 18:42:38.996981 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/87aaa67f-f24d-47cb-b314-39d938d9a531-home\") pod \"facebook-opt-125m-simulated-kserve-6f969c879b-w2b4n\" (UID: \"87aaa67f-f24d-47cb-b314-39d938d9a531\") " pod="llm/facebook-opt-125m-simulated-kserve-6f969c879b-w2b4n" Jun 11 18:42:38.997167 ip-10-0-130-170 kubenswrapper[2565]: I0611 18:42:38.996983 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/87aaa67f-f24d-47cb-b314-39d938d9a531-model-cache\") pod \"facebook-opt-125m-simulated-kserve-6f969c879b-w2b4n\" (UID: \"87aaa67f-f24d-47cb-b314-39d938d9a531\") " pod="llm/facebook-opt-125m-simulated-kserve-6f969c879b-w2b4n" Jun 11 18:42:38.997167 ip-10-0-130-170 kubenswrapper[2565]: I0611 18:42:38.997113 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/87aaa67f-f24d-47cb-b314-39d938d9a531-kserve-provision-location\") pod \"facebook-opt-125m-simulated-kserve-6f969c879b-w2b4n\" (UID: \"87aaa67f-f24d-47cb-b314-39d938d9a531\") " pod="llm/facebook-opt-125m-simulated-kserve-6f969c879b-w2b4n" Jun 11 18:42:38.999122 ip-10-0-130-170 kubenswrapper[2565]: I0611 18:42:38.999087 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/87aaa67f-f24d-47cb-b314-39d938d9a531-dshm\") pod \"facebook-opt-125m-simulated-kserve-6f969c879b-w2b4n\" (UID: \"87aaa67f-f24d-47cb-b314-39d938d9a531\") " pod="llm/facebook-opt-125m-simulated-kserve-6f969c879b-w2b4n" Jun 11 18:42:38.999425 ip-10-0-130-170 kubenswrapper[2565]: I0611 18:42:38.999407 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/87aaa67f-f24d-47cb-b314-39d938d9a531-tls-certs\") pod \"facebook-opt-125m-simulated-kserve-6f969c879b-w2b4n\" (UID: \"87aaa67f-f24d-47cb-b314-39d938d9a531\") " pod="llm/facebook-opt-125m-simulated-kserve-6f969c879b-w2b4n" Jun 11 18:42:39.007554 ip-10-0-130-170 kubenswrapper[2565]: I0611 18:42:39.007525 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-d4dqx\" (UniqueName: \"kubernetes.io/projected/87aaa67f-f24d-47cb-b314-39d938d9a531-kube-api-access-d4dqx\") pod \"facebook-opt-125m-simulated-kserve-6f969c879b-w2b4n\" (UID: \"87aaa67f-f24d-47cb-b314-39d938d9a531\") " pod="llm/facebook-opt-125m-simulated-kserve-6f969c879b-w2b4n" Jun 11 18:42:39.117721 ip-10-0-130-170 kubenswrapper[2565]: I0611 18:42:39.117627 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/facebook-opt-125m-simulated-kserve-6f969c879b-w2b4n" Jun 11 18:42:39.276802 ip-10-0-130-170 kubenswrapper[2565]: I0611 18:42:39.276773 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/facebook-opt-125m-simulated-kserve-6f969c879b-w2b4n"] Jun 11 18:42:39.278664 ip-10-0-130-170 kubenswrapper[2565]: W0611 18:42:39.278633 2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod87aaa67f_f24d_47cb_b314_39d938d9a531.slice/crio-182e497a82b4076622172ebd7f3f96abcb21b4cc596e923719251c6ff342e48d WatchSource:0}: Error finding container 182e497a82b4076622172ebd7f3f96abcb21b4cc596e923719251c6ff342e48d: Status 404 returned error can't find the container with id 182e497a82b4076622172ebd7f3f96abcb21b4cc596e923719251c6ff342e48d Jun 11 18:42:40.098408 ip-10-0-130-170 kubenswrapper[2565]: I0611 18:42:40.098361 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/facebook-opt-125m-simulated-kserve-6f969c879b-w2b4n" event={"ID":"87aaa67f-f24d-47cb-b314-39d938d9a531","Type":"ContainerStarted","Data":"a96586d285766cb6cff38eb4d6149c30c924386f3e2949b9984d21c9a3877e7f"} Jun 11 18:42:40.098875 ip-10-0-130-170 kubenswrapper[2565]: I0611 18:42:40.098438 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/facebook-opt-125m-simulated-kserve-6f969c879b-w2b4n" event={"ID":"87aaa67f-f24d-47cb-b314-39d938d9a531","Type":"ContainerStarted","Data":"182e497a82b4076622172ebd7f3f96abcb21b4cc596e923719251c6ff342e48d"} Jun 11 18:43:01.776544 ip-10-0-130-170 kubenswrapper[2565]: I0611 18:43:01.776512 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-5dbbb5d744-vpdts_3329f4b1-ac8c-4472-b6a0-13bb76075957/console-operator/1.log" Jun 11 18:43:01.778796 ip-10-0-130-170 kubenswrapper[2565]: I0611 18:43:01.778776 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-5dbbb5d744-vpdts_3329f4b1-ac8c-4472-b6a0-13bb76075957/console-operator/1.log" Jun 11 18:43:01.784522 ip-10-0-130-170 kubenswrapper[2565]: I0611 18:43:01.784500 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-9xbcp_5f6a1d9d-054f-4a94-99a3-21b77d4995dd/ovn-acl-logging/0.log" Jun 11 18:43:01.786745 ip-10-0-130-170 kubenswrapper[2565]: I0611 18:43:01.786729 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-9xbcp_5f6a1d9d-054f-4a94-99a3-21b77d4995dd/ovn-acl-logging/0.log" Jun 11 18:43:21.335201 ip-10-0-130-170 kubenswrapper[2565]: I0611 18:43:21.335166 2565 generic.go:356] "Generic (PLEG): container finished" podID="535174ab-057c-47de-b389-c3bea2fb6d0a" containerID="998aed975c14b8f1a14e2cfe92d4095b3f1540f90afbf001ab76690d19b66230" exitCode=0 Jun 11 18:43:21.335708 ip-10-0-130-170 kubenswrapper[2565]: I0611 18:43:21.335215 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-shpcp" event={"ID":"535174ab-057c-47de-b389-c3bea2fb6d0a","Type":"ContainerDied","Data":"998aed975c14b8f1a14e2cfe92d4095b3f1540f90afbf001ab76690d19b66230"} Jun 11 18:43:23.349484 ip-10-0-130-170 kubenswrapper[2565]: I0611 18:43:23.349449 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-shpcp" event={"ID":"535174ab-057c-47de-b389-c3bea2fb6d0a","Type":"ContainerStarted","Data":"62f9d256e82937ff5c8f573721b5f2aa90d4e92856f8ec6e57d97bc6a72b6a76"} Jun 11 18:43:23.390001 ip-10-0-130-170 kubenswrapper[2565]: I0611 18:43:23.389937 2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-shpcp" podStartSLOduration=3.34518367 podStartE2EDuration="1m1.389920734s" totalImagesPullingTime="1.069987424s" totalInitContainerRuntime="56.97474964s" isStatefulPod=false podCreationTimestamp="2026-06-11 18:42:22 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-11 18:43:23.386581719 +0000 UTC m=+922.135267752" watchObservedRunningTime="2026-06-11 18:43:23.389920734 +0000 UTC m=+922.138606756" Jun 11 18:43:33.242307 ip-10-0-130-170 kubenswrapper[2565]: I0611 18:43:33.242242 2565 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-shpcp" Jun 11 18:43:33.242768 ip-10-0-130-170 kubenswrapper[2565]: I0611 18:43:33.242367 2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-shpcp" Jun 11 18:43:33.255085 ip-10-0-130-170 kubenswrapper[2565]: I0611 18:43:33.255062 2565 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-shpcp" Jun 11 18:43:33.421467 ip-10-0-130-170 kubenswrapper[2565]: I0611 18:43:33.421428 2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-shpcp" Jun 11 18:43:35.422558 ip-10-0-130-170 kubenswrapper[2565]: I0611 18:43:35.422527 2565 generic.go:356] "Generic (PLEG): container finished" podID="87aaa67f-f24d-47cb-b314-39d938d9a531" containerID="a96586d285766cb6cff38eb4d6149c30c924386f3e2949b9984d21c9a3877e7f" exitCode=0 Jun 11 18:43:35.422940 ip-10-0-130-170 kubenswrapper[2565]: I0611 18:43:35.422571 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/facebook-opt-125m-simulated-kserve-6f969c879b-w2b4n" event={"ID":"87aaa67f-f24d-47cb-b314-39d938d9a531","Type":"ContainerDied","Data":"a96586d285766cb6cff38eb4d6149c30c924386f3e2949b9984d21c9a3877e7f"} Jun 11 18:43:36.430784 ip-10-0-130-170 kubenswrapper[2565]: I0611 18:43:36.430745 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/facebook-opt-125m-simulated-kserve-6f969c879b-w2b4n" event={"ID":"87aaa67f-f24d-47cb-b314-39d938d9a531","Type":"ContainerStarted","Data":"d4d2f0d9104bd81fcc9dc58b86ad01b19537580fcc5d0d1938bfc565e08c9a7b"} Jun 11 18:43:36.451026 ip-10-0-130-170 kubenswrapper[2565]: I0611 18:43:36.450965 2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/facebook-opt-125m-simulated-kserve-6f969c879b-w2b4n" podStartSLOduration=2.523894522 podStartE2EDuration="58.45094565s" totalImagesPullingTime="185.801566ms" totalInitContainerRuntime="55.741249562s" isStatefulPod=false podCreationTimestamp="2026-06-11 18:42:38 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-11 18:43:36.450776314 +0000 UTC m=+935.199462373" watchObservedRunningTime="2026-06-11 18:43:36.45094565 +0000 UTC m=+935.199631673" Jun 11 18:43:39.118357 ip-10-0-130-170 kubenswrapper[2565]: I0611 18:43:39.118323 2565 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/facebook-opt-125m-simulated-kserve-6f969c879b-w2b4n" Jun 11 18:43:39.118741 ip-10-0-130-170 kubenswrapper[2565]: I0611 18:43:39.118375 2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/facebook-opt-125m-simulated-kserve-6f969c879b-w2b4n" Jun 11 18:43:39.131184 ip-10-0-130-170 kubenswrapper[2565]: I0611 18:43:39.131161 2565 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/facebook-opt-125m-simulated-kserve-6f969c879b-w2b4n" Jun 11 18:43:39.458954 ip-10-0-130-170 kubenswrapper[2565]: I0611 18:43:39.458917 2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/facebook-opt-125m-simulated-kserve-6f969c879b-w2b4n" Jun 11 18:43:53.750357 ip-10-0-130-170 kubenswrapper[2565]: I0611 18:43:53.750324 2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-847bb4f797-qbgzr"] Jun 11 18:43:53.755828 ip-10-0-130-170 kubenswrapper[2565]: I0611 18:43:53.755812 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-847bb4f797-qbgzr" Jun 11 18:43:53.766018 ip-10-0-130-170 kubenswrapper[2565]: I0611 18:43:53.765990 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-847bb4f797-qbgzr"] Jun 11 18:43:53.788087 ip-10-0-130-170 kubenswrapper[2565]: I0611 18:43:53.788053 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4rlr2\" (UniqueName: \"kubernetes.io/projected/734c15f2-f4e7-4b11-99d8-0019ee35a96d-kube-api-access-4rlr2\") pod \"authorino-847bb4f797-qbgzr\" (UID: \"734c15f2-f4e7-4b11-99d8-0019ee35a96d\") " pod="kuadrant-system/authorino-847bb4f797-qbgzr" Jun 11 18:43:53.788309 ip-10-0-130-170 kubenswrapper[2565]: I0611 18:43:53.788289 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/734c15f2-f4e7-4b11-99d8-0019ee35a96d-tls-cert\") pod \"authorino-847bb4f797-qbgzr\" (UID: \"734c15f2-f4e7-4b11-99d8-0019ee35a96d\") " pod="kuadrant-system/authorino-847bb4f797-qbgzr" Jun 11 18:43:53.788419 ip-10-0-130-170 kubenswrapper[2565]: I0611 18:43:53.788392 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oidc-ca\" (UniqueName: \"kubernetes.io/configmap/734c15f2-f4e7-4b11-99d8-0019ee35a96d-oidc-ca\") pod \"authorino-847bb4f797-qbgzr\" (UID: \"734c15f2-f4e7-4b11-99d8-0019ee35a96d\") " pod="kuadrant-system/authorino-847bb4f797-qbgzr" Jun 11 18:43:53.889871 ip-10-0-130-170 kubenswrapper[2565]: I0611 18:43:53.889836 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4rlr2\" (UniqueName: \"kubernetes.io/projected/734c15f2-f4e7-4b11-99d8-0019ee35a96d-kube-api-access-4rlr2\") pod \"authorino-847bb4f797-qbgzr\" (UID: \"734c15f2-f4e7-4b11-99d8-0019ee35a96d\") " pod="kuadrant-system/authorino-847bb4f797-qbgzr" Jun 11 18:43:53.890065 ip-10-0-130-170 kubenswrapper[2565]: I0611 18:43:53.889884 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/734c15f2-f4e7-4b11-99d8-0019ee35a96d-tls-cert\") pod \"authorino-847bb4f797-qbgzr\" (UID: \"734c15f2-f4e7-4b11-99d8-0019ee35a96d\") " pod="kuadrant-system/authorino-847bb4f797-qbgzr" Jun 11 18:43:53.890065 ip-10-0-130-170 kubenswrapper[2565]: I0611 18:43:53.889910 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oidc-ca\" (UniqueName: \"kubernetes.io/configmap/734c15f2-f4e7-4b11-99d8-0019ee35a96d-oidc-ca\") pod \"authorino-847bb4f797-qbgzr\" (UID: \"734c15f2-f4e7-4b11-99d8-0019ee35a96d\") " pod="kuadrant-system/authorino-847bb4f797-qbgzr" Jun 11 18:43:53.890682 ip-10-0-130-170 kubenswrapper[2565]: I0611 18:43:53.890588 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"oidc-ca\" (UniqueName: \"kubernetes.io/configmap/734c15f2-f4e7-4b11-99d8-0019ee35a96d-oidc-ca\") pod \"authorino-847bb4f797-qbgzr\" (UID: \"734c15f2-f4e7-4b11-99d8-0019ee35a96d\") " pod="kuadrant-system/authorino-847bb4f797-qbgzr" Jun 11 18:43:53.892525 ip-10-0-130-170 kubenswrapper[2565]: I0611 18:43:53.892504 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/734c15f2-f4e7-4b11-99d8-0019ee35a96d-tls-cert\") pod \"authorino-847bb4f797-qbgzr\" (UID: \"734c15f2-f4e7-4b11-99d8-0019ee35a96d\") " pod="kuadrant-system/authorino-847bb4f797-qbgzr" Jun 11 18:43:53.898911 ip-10-0-130-170 kubenswrapper[2565]: I0611 18:43:53.898887 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-4rlr2\" (UniqueName: \"kubernetes.io/projected/734c15f2-f4e7-4b11-99d8-0019ee35a96d-kube-api-access-4rlr2\") pod \"authorino-847bb4f797-qbgzr\" (UID: \"734c15f2-f4e7-4b11-99d8-0019ee35a96d\") " pod="kuadrant-system/authorino-847bb4f797-qbgzr" Jun 11 18:43:54.066540 ip-10-0-130-170 kubenswrapper[2565]: I0611 18:43:54.066450 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-847bb4f797-qbgzr" Jun 11 18:43:54.207971 ip-10-0-130-170 kubenswrapper[2565]: I0611 18:43:54.207936 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-847bb4f797-qbgzr"] Jun 11 18:43:54.208391 ip-10-0-130-170 kubenswrapper[2565]: W0611 18:43:54.208356 2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod734c15f2_f4e7_4b11_99d8_0019ee35a96d.slice/crio-6f0efd39b671e1a7f621cf3db808454820e3eb5794cb98ebe258c13931c14b4a WatchSource:0}: Error finding container 6f0efd39b671e1a7f621cf3db808454820e3eb5794cb98ebe258c13931c14b4a: Status 404 returned error can't find the container with id 6f0efd39b671e1a7f621cf3db808454820e3eb5794cb98ebe258c13931c14b4a Jun 11 18:43:54.539099 ip-10-0-130-170 kubenswrapper[2565]: I0611 18:43:54.539061 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-847bb4f797-qbgzr" event={"ID":"734c15f2-f4e7-4b11-99d8-0019ee35a96d","Type":"ContainerStarted","Data":"6f0efd39b671e1a7f621cf3db808454820e3eb5794cb98ebe258c13931c14b4a"} Jun 11 18:43:55.548611 ip-10-0-130-170 kubenswrapper[2565]: I0611 18:43:55.548561 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-847bb4f797-qbgzr" event={"ID":"734c15f2-f4e7-4b11-99d8-0019ee35a96d","Type":"ContainerStarted","Data":"0b4890a091d416780cd4eb1633c1aff8847131ec61b0d42e105a68674d50cc8d"} Jun 11 18:43:55.570345 ip-10-0-130-170 kubenswrapper[2565]: I0611 18:43:55.570249 2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/authorino-847bb4f797-qbgzr" podStartSLOduration=2.023595714 podStartE2EDuration="2.570227794s" totalImagesPullingTime="546.63208ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-11 18:43:53 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-11 18:43:55.569267357 +0000 UTC m=+954.317953371" watchObservedRunningTime="2026-06-11 18:43:55.570227794 +0000 UTC m=+954.318913816" Jun 11 18:43:55.607781 ip-10-0-130-170 kubenswrapper[2565]: I0611 18:43:55.607743 2565 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-59f85ccf7b-mthp8"] Jun 11 18:43:55.608009 ip-10-0-130-170 kubenswrapper[2565]: I0611 18:43:55.607979 2565 kuberuntime_container.go:872] "Killing container with a grace period" pod="kuadrant-system/authorino-59f85ccf7b-mthp8" podUID="90a842db-ff88-4a4c-88a4-fb8e117d7ab3" containerName="authorino" containerID="cri-o://84445213ba70d034bc0ab145ff07b95b2dbe93ff180e7f37ef0f516581a1368a" gracePeriod=30 Jun 11 18:43:55.889897 ip-10-0-130-170 kubenswrapper[2565]: I0611 18:43:55.889871 2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-59f85ccf7b-mthp8" Jun 11 18:43:56.011587 ip-10-0-130-170 kubenswrapper[2565]: I0611 18:43:56.011544 2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"oidc-ca\" (UniqueName: \"kubernetes.io/configmap/90a842db-ff88-4a4c-88a4-fb8e117d7ab3-oidc-ca\") pod \"90a842db-ff88-4a4c-88a4-fb8e117d7ab3\" (UID: \"90a842db-ff88-4a4c-88a4-fb8e117d7ab3\") " Jun 11 18:43:56.011587 ip-10-0-130-170 kubenswrapper[2565]: I0611 18:43:56.011592 2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-zfvjj\" (UniqueName: \"kubernetes.io/projected/90a842db-ff88-4a4c-88a4-fb8e117d7ab3-kube-api-access-zfvjj\") pod \"90a842db-ff88-4a4c-88a4-fb8e117d7ab3\" (UID: \"90a842db-ff88-4a4c-88a4-fb8e117d7ab3\") " Jun 11 18:43:56.011861 ip-10-0-130-170 kubenswrapper[2565]: I0611 18:43:56.011736 2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/90a842db-ff88-4a4c-88a4-fb8e117d7ab3-tls-cert\") pod \"90a842db-ff88-4a4c-88a4-fb8e117d7ab3\" (UID: \"90a842db-ff88-4a4c-88a4-fb8e117d7ab3\") " Jun 11 18:43:56.018763 ip-10-0-130-170 kubenswrapper[2565]: I0611 18:43:56.014173 2565 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/90a842db-ff88-4a4c-88a4-fb8e117d7ab3-kube-api-access-zfvjj" (OuterVolumeSpecName: "kube-api-access-zfvjj") pod "90a842db-ff88-4a4c-88a4-fb8e117d7ab3" (UID: "90a842db-ff88-4a4c-88a4-fb8e117d7ab3"). InnerVolumeSpecName "kube-api-access-zfvjj". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 11 18:43:56.019188 ip-10-0-130-170 kubenswrapper[2565]: I0611 18:43:56.019159 2565 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/90a842db-ff88-4a4c-88a4-fb8e117d7ab3-oidc-ca" (OuterVolumeSpecName: "oidc-ca") pod "90a842db-ff88-4a4c-88a4-fb8e117d7ab3" (UID: "90a842db-ff88-4a4c-88a4-fb8e117d7ab3"). InnerVolumeSpecName "oidc-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 11 18:43:56.027552 ip-10-0-130-170 kubenswrapper[2565]: I0611 18:43:56.027520 2565 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/90a842db-ff88-4a4c-88a4-fb8e117d7ab3-tls-cert" (OuterVolumeSpecName: "tls-cert") pod "90a842db-ff88-4a4c-88a4-fb8e117d7ab3" (UID: "90a842db-ff88-4a4c-88a4-fb8e117d7ab3"). InnerVolumeSpecName "tls-cert". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 11 18:43:56.113378 ip-10-0-130-170 kubenswrapper[2565]: I0611 18:43:56.113337 2565 reconciler_common.go:299] "Volume detached for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/90a842db-ff88-4a4c-88a4-fb8e117d7ab3-tls-cert\") on node \"ip-10-0-130-170.ec2.internal\" DevicePath \"\"" Jun 11 18:43:56.113378 ip-10-0-130-170 kubenswrapper[2565]: I0611 18:43:56.113375 2565 reconciler_common.go:299] "Volume detached for volume \"oidc-ca\" (UniqueName: \"kubernetes.io/configmap/90a842db-ff88-4a4c-88a4-fb8e117d7ab3-oidc-ca\") on node \"ip-10-0-130-170.ec2.internal\" DevicePath \"\"" Jun 11 18:43:56.113378 ip-10-0-130-170 kubenswrapper[2565]: I0611 18:43:56.113387 2565 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-zfvjj\" (UniqueName: \"kubernetes.io/projected/90a842db-ff88-4a4c-88a4-fb8e117d7ab3-kube-api-access-zfvjj\") on node \"ip-10-0-130-170.ec2.internal\" DevicePath \"\"" Jun 11 18:43:56.555940 ip-10-0-130-170 kubenswrapper[2565]: I0611 18:43:56.555905 2565 generic.go:356] "Generic (PLEG): container finished" podID="90a842db-ff88-4a4c-88a4-fb8e117d7ab3" containerID="84445213ba70d034bc0ab145ff07b95b2dbe93ff180e7f37ef0f516581a1368a" exitCode=0 Jun 11 18:43:56.556369 ip-10-0-130-170 kubenswrapper[2565]: I0611 18:43:56.555975 2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-59f85ccf7b-mthp8" Jun 11 18:43:56.556369 ip-10-0-130-170 kubenswrapper[2565]: I0611 18:43:56.555999 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-59f85ccf7b-mthp8" event={"ID":"90a842db-ff88-4a4c-88a4-fb8e117d7ab3","Type":"ContainerDied","Data":"84445213ba70d034bc0ab145ff07b95b2dbe93ff180e7f37ef0f516581a1368a"} Jun 11 18:43:56.556369 ip-10-0-130-170 kubenswrapper[2565]: I0611 18:43:56.556043 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-59f85ccf7b-mthp8" event={"ID":"90a842db-ff88-4a4c-88a4-fb8e117d7ab3","Type":"ContainerDied","Data":"6560c06d858d0297c4979c0b99604993c3dfd998efe4d4254e33033761dbf80d"} Jun 11 18:43:56.556369 ip-10-0-130-170 kubenswrapper[2565]: I0611 18:43:56.556060 2565 scope.go:117] "RemoveContainer" containerID="84445213ba70d034bc0ab145ff07b95b2dbe93ff180e7f37ef0f516581a1368a" Jun 11 18:43:56.566868 ip-10-0-130-170 kubenswrapper[2565]: I0611 18:43:56.566847 2565 scope.go:117] "RemoveContainer" containerID="84445213ba70d034bc0ab145ff07b95b2dbe93ff180e7f37ef0f516581a1368a" Jun 11 18:43:56.567126 ip-10-0-130-170 kubenswrapper[2565]: E0611 18:43:56.567109 2565 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"84445213ba70d034bc0ab145ff07b95b2dbe93ff180e7f37ef0f516581a1368a\": container with ID starting with 84445213ba70d034bc0ab145ff07b95b2dbe93ff180e7f37ef0f516581a1368a not found: ID does not exist" containerID="84445213ba70d034bc0ab145ff07b95b2dbe93ff180e7f37ef0f516581a1368a" Jun 11 18:43:56.567176 ip-10-0-130-170 kubenswrapper[2565]: I0611 18:43:56.567135 2565 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"84445213ba70d034bc0ab145ff07b95b2dbe93ff180e7f37ef0f516581a1368a"} err="failed to get container status \"84445213ba70d034bc0ab145ff07b95b2dbe93ff180e7f37ef0f516581a1368a\": rpc error: code = NotFound desc = could not find container \"84445213ba70d034bc0ab145ff07b95b2dbe93ff180e7f37ef0f516581a1368a\": container with ID starting with 84445213ba70d034bc0ab145ff07b95b2dbe93ff180e7f37ef0f516581a1368a not found: ID does not exist" Jun 11 18:43:56.580394 ip-10-0-130-170 kubenswrapper[2565]: I0611 18:43:56.580355 2565 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-59f85ccf7b-mthp8"] Jun 11 18:43:56.583798 ip-10-0-130-170 kubenswrapper[2565]: I0611 18:43:56.583772 2565 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/authorino-59f85ccf7b-mthp8"] Jun 11 18:43:57.749048 ip-10-0-130-170 kubenswrapper[2565]: I0611 18:43:57.749004 2565 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="90a842db-ff88-4a4c-88a4-fb8e117d7ab3" path="/var/lib/kubelet/pods/90a842db-ff88-4a4c-88a4-fb8e117d7ab3/volumes" Jun 11 18:45:22.338488 ip-10-0-130-170 kubenswrapper[2565]: I0611 18:45:22.338450 2565 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-controller-7478944844-gbqtz"] Jun 11 18:45:22.338986 ip-10-0-130-170 kubenswrapper[2565]: I0611 18:45:22.338670 2565 kuberuntime_container.go:872] "Killing container with a grace period" pod="opendatahub/maas-controller-7478944844-gbqtz" podUID="ebeb6c60-5943-4e1a-ad2e-3978698b144f" containerName="manager" containerID="cri-o://00d3dd64893fc620743a4582408da23f0937b1fa3591caf56d2e56112a5a8564" gracePeriod=30 Jun 11 18:45:22.597957 ip-10-0-130-170 kubenswrapper[2565]: I0611 18:45:22.597893 2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-7478944844-gbqtz" Jun 11 18:45:22.701381 ip-10-0-130-170 kubenswrapper[2565]: I0611 18:45:22.701349 2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/ebeb6c60-5943-4e1a-ad2e-3978698b144f-webhook-cert\") pod \"ebeb6c60-5943-4e1a-ad2e-3978698b144f\" (UID: \"ebeb6c60-5943-4e1a-ad2e-3978698b144f\") " Jun 11 18:45:22.701537 ip-10-0-130-170 kubenswrapper[2565]: I0611 18:45:22.701479 2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-p9swv\" (UniqueName: \"kubernetes.io/projected/ebeb6c60-5943-4e1a-ad2e-3978698b144f-kube-api-access-p9swv\") pod \"ebeb6c60-5943-4e1a-ad2e-3978698b144f\" (UID: \"ebeb6c60-5943-4e1a-ad2e-3978698b144f\") " Jun 11 18:45:22.703568 ip-10-0-130-170 kubenswrapper[2565]: I0611 18:45:22.703527 2565 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/ebeb6c60-5943-4e1a-ad2e-3978698b144f-webhook-cert" (OuterVolumeSpecName: "webhook-cert") pod "ebeb6c60-5943-4e1a-ad2e-3978698b144f" (UID: "ebeb6c60-5943-4e1a-ad2e-3978698b144f"). InnerVolumeSpecName "webhook-cert". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 11 18:45:22.703715 ip-10-0-130-170 kubenswrapper[2565]: I0611 18:45:22.703637 2565 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/ebeb6c60-5943-4e1a-ad2e-3978698b144f-kube-api-access-p9swv" (OuterVolumeSpecName: "kube-api-access-p9swv") pod "ebeb6c60-5943-4e1a-ad2e-3978698b144f" (UID: "ebeb6c60-5943-4e1a-ad2e-3978698b144f"). InnerVolumeSpecName "kube-api-access-p9swv". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 11 18:45:22.802428 ip-10-0-130-170 kubenswrapper[2565]: I0611 18:45:22.802390 2565 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-p9swv\" (UniqueName: \"kubernetes.io/projected/ebeb6c60-5943-4e1a-ad2e-3978698b144f-kube-api-access-p9swv\") on node \"ip-10-0-130-170.ec2.internal\" DevicePath \"\"" Jun 11 18:45:22.802428 ip-10-0-130-170 kubenswrapper[2565]: I0611 18:45:22.802422 2565 reconciler_common.go:299] "Volume detached for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/ebeb6c60-5943-4e1a-ad2e-3978698b144f-webhook-cert\") on node \"ip-10-0-130-170.ec2.internal\" DevicePath \"\"" Jun 11 18:45:23.063666 ip-10-0-130-170 kubenswrapper[2565]: I0611 18:45:23.063626 2565 generic.go:356] "Generic (PLEG): container finished" podID="ebeb6c60-5943-4e1a-ad2e-3978698b144f" containerID="00d3dd64893fc620743a4582408da23f0937b1fa3591caf56d2e56112a5a8564" exitCode=0 Jun 11 18:45:23.063867 ip-10-0-130-170 kubenswrapper[2565]: I0611 18:45:23.063682 2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-7478944844-gbqtz" Jun 11 18:45:23.063867 ip-10-0-130-170 kubenswrapper[2565]: I0611 18:45:23.063722 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-7478944844-gbqtz" event={"ID":"ebeb6c60-5943-4e1a-ad2e-3978698b144f","Type":"ContainerDied","Data":"00d3dd64893fc620743a4582408da23f0937b1fa3591caf56d2e56112a5a8564"} Jun 11 18:45:23.063867 ip-10-0-130-170 kubenswrapper[2565]: I0611 18:45:23.063776 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-7478944844-gbqtz" event={"ID":"ebeb6c60-5943-4e1a-ad2e-3978698b144f","Type":"ContainerDied","Data":"d444940ad256af048ecf464e0cbea175f3d1e6fccdb26b12904acf08e784b1c3"} Jun 11 18:45:23.063867 ip-10-0-130-170 kubenswrapper[2565]: I0611 18:45:23.063799 2565 scope.go:117] "RemoveContainer" containerID="00d3dd64893fc620743a4582408da23f0937b1fa3591caf56d2e56112a5a8564" Jun 11 18:45:23.073814 ip-10-0-130-170 kubenswrapper[2565]: I0611 18:45:23.073792 2565 scope.go:117] "RemoveContainer" containerID="00d3dd64893fc620743a4582408da23f0937b1fa3591caf56d2e56112a5a8564" Jun 11 18:45:23.074063 ip-10-0-130-170 kubenswrapper[2565]: E0611 18:45:23.074046 2565 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"00d3dd64893fc620743a4582408da23f0937b1fa3591caf56d2e56112a5a8564\": container with ID starting with 00d3dd64893fc620743a4582408da23f0937b1fa3591caf56d2e56112a5a8564 not found: ID does not exist" containerID="00d3dd64893fc620743a4582408da23f0937b1fa3591caf56d2e56112a5a8564" Jun 11 18:45:23.074115 ip-10-0-130-170 kubenswrapper[2565]: I0611 18:45:23.074071 2565 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"00d3dd64893fc620743a4582408da23f0937b1fa3591caf56d2e56112a5a8564"} err="failed to get container status \"00d3dd64893fc620743a4582408da23f0937b1fa3591caf56d2e56112a5a8564\": rpc error: code = NotFound desc = could not find container \"00d3dd64893fc620743a4582408da23f0937b1fa3591caf56d2e56112a5a8564\": container with ID starting with 00d3dd64893fc620743a4582408da23f0937b1fa3591caf56d2e56112a5a8564 not found: ID does not exist" Jun 11 18:45:23.083962 ip-10-0-130-170 kubenswrapper[2565]: I0611 18:45:23.083938 2565 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-controller-7478944844-gbqtz"] Jun 11 18:45:23.086340 ip-10-0-130-170 kubenswrapper[2565]: I0611 18:45:23.086320 2565 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/maas-controller-7478944844-gbqtz"] Jun 11 18:45:23.748583 ip-10-0-130-170 kubenswrapper[2565]: I0611 18:45:23.748550 2565 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="ebeb6c60-5943-4e1a-ad2e-3978698b144f" path="/var/lib/kubelet/pods/ebeb6c60-5943-4e1a-ad2e-3978698b144f/volumes" Jun 11 18:45:47.680765 ip-10-0-130-170 kubenswrapper[2565]: I0611 18:45:47.680662 2565 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-api-bb976594-c6jrm"] Jun 11 18:45:47.681226 ip-10-0-130-170 kubenswrapper[2565]: I0611 18:45:47.680963 2565 kuberuntime_container.go:872] "Killing container with a grace period" pod="opendatahub/maas-api-bb976594-c6jrm" podUID="f2534569-596b-4980-a79d-7694811a1967" containerName="maas-api" containerID="cri-o://75ab6582f0a963ea0a9299eecee5024ad0e979f57c2fffdd9bed17a063313576" gracePeriod=30 Jun 11 18:45:47.930528 ip-10-0-130-170 kubenswrapper[2565]: I0611 18:45:47.930502 2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-bb976594-c6jrm" Jun 11 18:45:48.033583 ip-10-0-130-170 kubenswrapper[2565]: I0611 18:45:48.033485 2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-xsb8q\" (UniqueName: \"kubernetes.io/projected/f2534569-596b-4980-a79d-7694811a1967-kube-api-access-xsb8q\") pod \"f2534569-596b-4980-a79d-7694811a1967\" (UID: \"f2534569-596b-4980-a79d-7694811a1967\") " Jun 11 18:45:48.033757 ip-10-0-130-170 kubenswrapper[2565]: I0611 18:45:48.033608 2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/f2534569-596b-4980-a79d-7694811a1967-maas-api-tls\") pod \"f2534569-596b-4980-a79d-7694811a1967\" (UID: \"f2534569-596b-4980-a79d-7694811a1967\") " Jun 11 18:45:48.033757 ip-10-0-130-170 kubenswrapper[2565]: I0611 18:45:48.033650 2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/f2534569-596b-4980-a79d-7694811a1967-openshift-service-ca\") pod \"f2534569-596b-4980-a79d-7694811a1967\" (UID: \"f2534569-596b-4980-a79d-7694811a1967\") " Jun 11 18:45:48.034098 ip-10-0-130-170 kubenswrapper[2565]: I0611 18:45:48.034072 2565 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/f2534569-596b-4980-a79d-7694811a1967-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "f2534569-596b-4980-a79d-7694811a1967" (UID: "f2534569-596b-4980-a79d-7694811a1967"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 11 18:45:48.035686 ip-10-0-130-170 kubenswrapper[2565]: I0611 18:45:48.035649 2565 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/f2534569-596b-4980-a79d-7694811a1967-kube-api-access-xsb8q" (OuterVolumeSpecName: "kube-api-access-xsb8q") pod "f2534569-596b-4980-a79d-7694811a1967" (UID: "f2534569-596b-4980-a79d-7694811a1967"). InnerVolumeSpecName "kube-api-access-xsb8q". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 11 18:45:48.035792 ip-10-0-130-170 kubenswrapper[2565]: I0611 18:45:48.035772 2565 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/f2534569-596b-4980-a79d-7694811a1967-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "f2534569-596b-4980-a79d-7694811a1967" (UID: "f2534569-596b-4980-a79d-7694811a1967"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 11 18:45:48.134499 ip-10-0-130-170 kubenswrapper[2565]: I0611 18:45:48.134463 2565 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/f2534569-596b-4980-a79d-7694811a1967-maas-api-tls\") on node \"ip-10-0-130-170.ec2.internal\" DevicePath \"\"" Jun 11 18:45:48.134499 ip-10-0-130-170 kubenswrapper[2565]: I0611 18:45:48.134492 2565 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/f2534569-596b-4980-a79d-7694811a1967-openshift-service-ca\") on node \"ip-10-0-130-170.ec2.internal\" DevicePath \"\"" Jun 11 18:45:48.134499 ip-10-0-130-170 kubenswrapper[2565]: I0611 18:45:48.134502 2565 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-xsb8q\" (UniqueName: \"kubernetes.io/projected/f2534569-596b-4980-a79d-7694811a1967-kube-api-access-xsb8q\") on node \"ip-10-0-130-170.ec2.internal\" DevicePath \"\"" Jun 11 18:45:48.215872 ip-10-0-130-170 kubenswrapper[2565]: I0611 18:45:48.215836 2565 generic.go:356] "Generic (PLEG): container finished" podID="f2534569-596b-4980-a79d-7694811a1967" containerID="75ab6582f0a963ea0a9299eecee5024ad0e979f57c2fffdd9bed17a063313576" exitCode=0 Jun 11 18:45:48.216031 ip-10-0-130-170 kubenswrapper[2565]: I0611 18:45:48.215882 2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-bb976594-c6jrm" Jun 11 18:45:48.216031 ip-10-0-130-170 kubenswrapper[2565]: I0611 18:45:48.215917 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-bb976594-c6jrm" event={"ID":"f2534569-596b-4980-a79d-7694811a1967","Type":"ContainerDied","Data":"75ab6582f0a963ea0a9299eecee5024ad0e979f57c2fffdd9bed17a063313576"} Jun 11 18:45:48.216031 ip-10-0-130-170 kubenswrapper[2565]: I0611 18:45:48.215970 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-bb976594-c6jrm" event={"ID":"f2534569-596b-4980-a79d-7694811a1967","Type":"ContainerDied","Data":"50213c4c5e9753e0f13ec2cd40e02eac2271154db5f40ac05aa3b3929cf3e0ef"} Jun 11 18:45:48.216031 ip-10-0-130-170 kubenswrapper[2565]: I0611 18:45:48.215991 2565 scope.go:117] "RemoveContainer" containerID="75ab6582f0a963ea0a9299eecee5024ad0e979f57c2fffdd9bed17a063313576" Jun 11 18:45:48.226137 ip-10-0-130-170 kubenswrapper[2565]: I0611 18:45:48.226117 2565 scope.go:117] "RemoveContainer" containerID="75ab6582f0a963ea0a9299eecee5024ad0e979f57c2fffdd9bed17a063313576" Jun 11 18:45:48.226435 ip-10-0-130-170 kubenswrapper[2565]: E0611 18:45:48.226412 2565 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"75ab6582f0a963ea0a9299eecee5024ad0e979f57c2fffdd9bed17a063313576\": container with ID starting with 75ab6582f0a963ea0a9299eecee5024ad0e979f57c2fffdd9bed17a063313576 not found: ID does not exist" containerID="75ab6582f0a963ea0a9299eecee5024ad0e979f57c2fffdd9bed17a063313576" Jun 11 18:45:48.226529 ip-10-0-130-170 kubenswrapper[2565]: I0611 18:45:48.226441 2565 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"75ab6582f0a963ea0a9299eecee5024ad0e979f57c2fffdd9bed17a063313576"} err="failed to get container status \"75ab6582f0a963ea0a9299eecee5024ad0e979f57c2fffdd9bed17a063313576\": rpc error: code = NotFound desc = could not find container \"75ab6582f0a963ea0a9299eecee5024ad0e979f57c2fffdd9bed17a063313576\": container with ID starting with 75ab6582f0a963ea0a9299eecee5024ad0e979f57c2fffdd9bed17a063313576 not found: ID does not exist" Jun 11 18:45:48.237911 ip-10-0-130-170 kubenswrapper[2565]: I0611 18:45:48.237884 2565 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-api-bb976594-c6jrm"] Jun 11 18:45:48.241847 ip-10-0-130-170 kubenswrapper[2565]: I0611 18:45:48.241822 2565 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/maas-api-bb976594-c6jrm"] Jun 11 18:45:49.750190 ip-10-0-130-170 kubenswrapper[2565]: I0611 18:45:49.750151 2565 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="f2534569-596b-4980-a79d-7694811a1967" path="/var/lib/kubelet/pods/f2534569-596b-4980-a79d-7694811a1967/volumes" Jun 11 18:47:55.223248 ip-10-0-130-170 kubenswrapper[2565]: I0611 18:47:55.223209 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-847bb4f797-qbgzr_734c15f2-f4e7-4b11-99d8-0019ee35a96d/authorino/0.log" Jun 11 18:48:00.857361 ip-10-0-130-170 kubenswrapper[2565]: I0611 18:48:00.857327 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-699bfcf455-j96zk_666c734e-668e-4b2e-a00c-8b10d199f510/copy-manifests/0.log" Jun 11 18:48:00.870307 ip-10-0-130-170 kubenswrapper[2565]: I0611 18:48:00.870280 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-699bfcf455-j96zk_666c734e-668e-4b2e-a00c-8b10d199f510/manager/0.log" Jun 11 18:48:00.988081 ip-10-0-130-170 kubenswrapper[2565]: I0611 18:48:00.988052 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_postgres-69fb4594cf-sgst5_470bf921-3acd-4689-9217-c858efd6b61e/postgres/0.log" Jun 11 18:48:01.742336 ip-10-0-130-170 kubenswrapper[2565]: I0611 18:48:01.742309 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7592jfrw_c1fb0eff-7b15-4d34-a1bc-79dd5d06e02d/util/0.log" Jun 11 18:48:01.749611 ip-10-0-130-170 kubenswrapper[2565]: I0611 18:48:01.749587 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7592jfrw_c1fb0eff-7b15-4d34-a1bc-79dd5d06e02d/pull/0.log" Jun 11 18:48:01.756738 ip-10-0-130-170 kubenswrapper[2565]: I0611 18:48:01.756716 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7592jfrw_c1fb0eff-7b15-4d34-a1bc-79dd5d06e02d/extract/0.log" Jun 11 18:48:01.818933 ip-10-0-130-170 kubenswrapper[2565]: I0611 18:48:01.818908 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-5dbbb5d744-vpdts_3329f4b1-ac8c-4472-b6a0-13bb76075957/console-operator/1.log" Jun 11 18:48:01.824838 ip-10-0-130-170 kubenswrapper[2565]: I0611 18:48:01.824808 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-5dbbb5d744-vpdts_3329f4b1-ac8c-4472-b6a0-13bb76075957/console-operator/1.log" Jun 11 18:48:01.830768 ip-10-0-130-170 kubenswrapper[2565]: I0611 18:48:01.830745 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-9xbcp_5f6a1d9d-054f-4a94-99a3-21b77d4995dd/ovn-acl-logging/0.log" Jun 11 18:48:01.833361 ip-10-0-130-170 kubenswrapper[2565]: I0611 18:48:01.833341 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-9xbcp_5f6a1d9d-054f-4a94-99a3-21b77d4995dd/ovn-acl-logging/0.log" Jun 11 18:48:01.867084 ip-10-0-130-170 kubenswrapper[2565]: I0611 18:48:01.867053 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0z9z8z_334df8f5-d1e1-43fb-9919-e28c647d6327/util/0.log" Jun 11 18:48:01.873818 ip-10-0-130-170 kubenswrapper[2565]: I0611 18:48:01.873796 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0z9z8z_334df8f5-d1e1-43fb-9919-e28c647d6327/pull/0.log" Jun 11 18:48:01.880344 ip-10-0-130-170 kubenswrapper[2565]: I0611 18:48:01.880327 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0z9z8z_334df8f5-d1e1-43fb-9919-e28c647d6327/extract/0.log" Jun 11 18:48:01.987137 ip-10-0-130-170 kubenswrapper[2565]: I0611 18:48:01.987108 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73kvjgf_cf3a06b1-22a2-43c8-a104-75ae129d04e1/util/0.log" Jun 11 18:48:01.993730 ip-10-0-130-170 kubenswrapper[2565]: I0611 18:48:01.993651 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73kvjgf_cf3a06b1-22a2-43c8-a104-75ae129d04e1/pull/0.log" Jun 11 18:48:01.999574 ip-10-0-130-170 kubenswrapper[2565]: I0611 18:48:01.999547 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73kvjgf_cf3a06b1-22a2-43c8-a104-75ae129d04e1/extract/0.log" Jun 11 18:48:02.111594 ip-10-0-130-170 kubenswrapper[2565]: I0611 18:48:02.111560 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef187nj6_10ee4034-8bda-47ea-ba8d-d79f6d8b66e9/util/0.log" Jun 11 18:48:02.118229 ip-10-0-130-170 kubenswrapper[2565]: I0611 18:48:02.118206 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef187nj6_10ee4034-8bda-47ea-ba8d-d79f6d8b66e9/pull/0.log" Jun 11 18:48:02.124284 ip-10-0-130-170 kubenswrapper[2565]: I0611 18:48:02.124243 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef187nj6_10ee4034-8bda-47ea-ba8d-d79f6d8b66e9/extract/0.log" Jun 11 18:48:02.235340 ip-10-0-130-170 kubenswrapper[2565]: I0611 18:48:02.235309 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-847bb4f797-qbgzr_734c15f2-f4e7-4b11-99d8-0019ee35a96d/authorino/0.log" Jun 11 18:48:02.570378 ip-10-0-130-170 kubenswrapper[2565]: I0611 18:48:02.570353 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-console-plugin-66b5774985-nbbh7_e7de33dc-d04d-4d11-9449-614482d8bf2e/kuadrant-console-plugin/0.log" Jun 11 18:48:03.721048 ip-10-0-130-170 kubenswrapper[2565]: I0611 18:48:03.721021 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-576bcbdbd6-w42kf_25f90e47-48bd-46f3-ad3c-9870b92d355e/kube-auth-proxy/0.log" Jun 11 18:48:03.951309 ip-10-0-130-170 kubenswrapper[2565]: I0611 18:48:03.951283 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-pre-processing-579785bc64-d9ctc_622f4f16-2d87-4bb3-8e2f-1231c35b2d39/payload-pre-processing/0.log" Jun 11 18:48:04.069616 ip-10-0-130-170 kubenswrapper[2565]: I0611 18:48:04.069539 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-processing-699b6cd6c-d2hv7_149996de-bcb1-4224-a05c-85b25a696aa3/payload-processing/0.log" Jun 11 18:48:04.515662 ip-10-0-130-170 kubenswrapper[2565]: I0611 18:48:04.515637 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-distinct-2-simulated-kserve-f5c55bdc-fwhg5_a7051158-f12c-48c2-ba7a-2cbf14d021be/storage-initializer/0.log" Jun 11 18:48:04.753050 ip-10-0-130-170 kubenswrapper[2565]: I0611 18:48:04.753021 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-trlp-test-simulated-kserve-68bb6c58d9-shpcp_535174ab-057c-47de-b389-c3bea2fb6d0a/main/0.log" Jun 11 18:48:04.759565 ip-10-0-130-170 kubenswrapper[2565]: I0611 18:48:04.759542 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-trlp-test-simulated-kserve-68bb6c58d9-shpcp_535174ab-057c-47de-b389-c3bea2fb6d0a/storage-initializer/0.log" Jun 11 18:48:04.984619 ip-10-0-130-170 kubenswrapper[2565]: I0611 18:48:04.984595 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_facebook-opt-125m-simulated-kserve-6f969c879b-w2b4n_87aaa67f-f24d-47cb-b314-39d938d9a531/main/0.log" Jun 11 18:48:04.993744 ip-10-0-130-170 kubenswrapper[2565]: I0611 18:48:04.993719 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_facebook-opt-125m-simulated-kserve-6f969c879b-w2b4n_87aaa67f-f24d-47cb-b314-39d938d9a531/storage-initializer/0.log" Jun 11 18:48:11.625451 ip-10-0-130-170 kubenswrapper[2565]: I0611 18:48:11.625419 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_global-pull-secret-syncer-wqbfv_1f1530cc-c788-4dc5-9e3d-7209386e9b94/global-pull-secret-syncer/0.log" Jun 11 18:48:11.721916 ip-10-0-130-170 kubenswrapper[2565]: I0611 18:48:11.721883 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_konnectivity-agent-rv8x7_b36592f7-5d47-450e-bb47-12b43070bbf1/konnectivity-agent/0.log" Jun 11 18:48:11.763462 ip-10-0-130-170 kubenswrapper[2565]: I0611 18:48:11.763434 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_kube-apiserver-proxy-ip-10-0-130-170.ec2.internal_cbc21c3b8650a365de338167fa32510b/haproxy/0.log" Jun 11 18:48:16.608987 ip-10-0-130-170 kubenswrapper[2565]: I0611 18:48:16.608957 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7592jfrw_c1fb0eff-7b15-4d34-a1bc-79dd5d06e02d/extract/0.log" Jun 11 18:48:16.636380 ip-10-0-130-170 kubenswrapper[2565]: I0611 18:48:16.636345 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7592jfrw_c1fb0eff-7b15-4d34-a1bc-79dd5d06e02d/util/0.log" Jun 11 18:48:16.669921 ip-10-0-130-170 kubenswrapper[2565]: I0611 18:48:16.669896 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7592jfrw_c1fb0eff-7b15-4d34-a1bc-79dd5d06e02d/pull/0.log" Jun 11 18:48:16.704624 ip-10-0-130-170 kubenswrapper[2565]: I0611 18:48:16.704600 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0z9z8z_334df8f5-d1e1-43fb-9919-e28c647d6327/extract/0.log" Jun 11 18:48:16.726332 ip-10-0-130-170 kubenswrapper[2565]: I0611 18:48:16.726310 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0z9z8z_334df8f5-d1e1-43fb-9919-e28c647d6327/util/0.log" Jun 11 18:48:16.748454 ip-10-0-130-170 kubenswrapper[2565]: I0611 18:48:16.748432 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0z9z8z_334df8f5-d1e1-43fb-9919-e28c647d6327/pull/0.log" Jun 11 18:48:16.777535 ip-10-0-130-170 kubenswrapper[2565]: I0611 18:48:16.777510 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73kvjgf_cf3a06b1-22a2-43c8-a104-75ae129d04e1/extract/0.log" Jun 11 18:48:16.801199 ip-10-0-130-170 kubenswrapper[2565]: I0611 18:48:16.801172 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73kvjgf_cf3a06b1-22a2-43c8-a104-75ae129d04e1/util/0.log" Jun 11 18:48:16.841714 ip-10-0-130-170 kubenswrapper[2565]: I0611 18:48:16.841683 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73kvjgf_cf3a06b1-22a2-43c8-a104-75ae129d04e1/pull/0.log" Jun 11 18:48:16.881379 ip-10-0-130-170 kubenswrapper[2565]: I0611 18:48:16.881339 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef187nj6_10ee4034-8bda-47ea-ba8d-d79f6d8b66e9/extract/0.log" Jun 11 18:48:16.914516 ip-10-0-130-170 kubenswrapper[2565]: I0611 18:48:16.914490 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef187nj6_10ee4034-8bda-47ea-ba8d-d79f6d8b66e9/util/0.log" Jun 11 18:48:16.940104 ip-10-0-130-170 kubenswrapper[2565]: I0611 18:48:16.940076 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef187nj6_10ee4034-8bda-47ea-ba8d-d79f6d8b66e9/pull/0.log" Jun 11 18:48:17.011540 ip-10-0-130-170 kubenswrapper[2565]: I0611 18:48:17.011508 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-847bb4f797-qbgzr_734c15f2-f4e7-4b11-99d8-0019ee35a96d/authorino/0.log" Jun 11 18:48:17.104886 ip-10-0-130-170 kubenswrapper[2565]: I0611 18:48:17.104858 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-console-plugin-66b5774985-nbbh7_e7de33dc-d04d-4d11-9449-614482d8bf2e/kuadrant-console-plugin/0.log" Jun 11 18:48:19.053322 ip-10-0-130-170 kubenswrapper[2565]: I0611 18:48:19.053297 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_a198f4a2-26ba-432c-adae-ce340c910fe0/alertmanager/0.log" Jun 11 18:48:19.078044 ip-10-0-130-170 kubenswrapper[2565]: I0611 18:48:19.078022 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_a198f4a2-26ba-432c-adae-ce340c910fe0/config-reloader/0.log" Jun 11 18:48:19.101107 ip-10-0-130-170 kubenswrapper[2565]: I0611 18:48:19.100776 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_a198f4a2-26ba-432c-adae-ce340c910fe0/kube-rbac-proxy-web/0.log" Jun 11 18:48:19.126037 ip-10-0-130-170 kubenswrapper[2565]: I0611 18:48:19.126006 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_a198f4a2-26ba-432c-adae-ce340c910fe0/kube-rbac-proxy/0.log" Jun 11 18:48:19.153671 ip-10-0-130-170 kubenswrapper[2565]: I0611 18:48:19.153646 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_a198f4a2-26ba-432c-adae-ce340c910fe0/kube-rbac-proxy-metric/0.log" Jun 11 18:48:19.181469 ip-10-0-130-170 kubenswrapper[2565]: I0611 18:48:19.181444 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_a198f4a2-26ba-432c-adae-ce340c910fe0/prom-label-proxy/0.log" Jun 11 18:48:19.210609 ip-10-0-130-170 kubenswrapper[2565]: I0611 18:48:19.210578 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_a198f4a2-26ba-432c-adae-ce340c910fe0/init-config-reloader/0.log" Jun 11 18:48:19.277533 ip-10-0-130-170 kubenswrapper[2565]: I0611 18:48:19.277498 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_kube-state-metrics-678bc549d7-89x49_11ac62e4-72e1-48d7-8b55-a615e80ea6ca/kube-state-metrics/0.log" Jun 11 18:48:19.296250 ip-10-0-130-170 kubenswrapper[2565]: I0611 18:48:19.296222 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_kube-state-metrics-678bc549d7-89x49_11ac62e4-72e1-48d7-8b55-a615e80ea6ca/kube-rbac-proxy-main/0.log" Jun 11 18:48:19.328588 ip-10-0-130-170 kubenswrapper[2565]: I0611 18:48:19.328518 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_kube-state-metrics-678bc549d7-89x49_11ac62e4-72e1-48d7-8b55-a615e80ea6ca/kube-rbac-proxy-self/0.log" Jun 11 18:48:19.393349 ip-10-0-130-170 kubenswrapper[2565]: I0611 18:48:19.393321 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_monitoring-plugin-589576dfc7-rxk8n_ed0fc27f-c5f2-4635-b24c-39acc6db3cab/monitoring-plugin/0.log" Jun 11 18:48:19.520374 ip-10-0-130-170 kubenswrapper[2565]: I0611 18:48:19.520342 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-jthcp_89eea2f5-d058-4ebf-b5f8-d6dbb8c40369/node-exporter/0.log" Jun 11 18:48:19.541753 ip-10-0-130-170 kubenswrapper[2565]: I0611 18:48:19.541723 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-jthcp_89eea2f5-d058-4ebf-b5f8-d6dbb8c40369/kube-rbac-proxy/0.log" Jun 11 18:48:19.563286 ip-10-0-130-170 kubenswrapper[2565]: I0611 18:48:19.563250 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-jthcp_89eea2f5-d058-4ebf-b5f8-d6dbb8c40369/init-textfile/0.log" Jun 11 18:48:19.673180 ip-10-0-130-170 kubenswrapper[2565]: I0611 18:48:19.673153 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_openshift-state-metrics-6b8d965dd5-wdstt_c9e106ea-f5bb-4fe9-9c47-b57141e42b07/kube-rbac-proxy-main/0.log" Jun 11 18:48:19.695337 ip-10-0-130-170 kubenswrapper[2565]: I0611 18:48:19.695308 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_openshift-state-metrics-6b8d965dd5-wdstt_c9e106ea-f5bb-4fe9-9c47-b57141e42b07/kube-rbac-proxy-self/0.log" Jun 11 18:48:19.718160 ip-10-0-130-170 kubenswrapper[2565]: I0611 18:48:19.718134 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_openshift-state-metrics-6b8d965dd5-wdstt_c9e106ea-f5bb-4fe9-9c47-b57141e42b07/openshift-state-metrics/0.log" Jun 11 18:48:19.993904 ip-10-0-130-170 kubenswrapper[2565]: I0611 18:48:19.993821 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-operator-admission-webhook-5cf667749c-xvt57_4b33b201-681a-4673-be4d-cdcf0eed397a/prometheus-operator-admission-webhook/0.log" Jun 11 18:48:21.438873 ip-10-0-130-170 kubenswrapper[2565]: I0611 18:48:21.438845 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-network-console_networking-console-plugin-867b76cb74-mbzpt_d9d950d8-2c16-43ec-a77c-8c0b870f52e6/networking-console-plugin/0.log" Jun 11 18:48:22.100707 ip-10-0-130-170 kubenswrapper[2565]: I0611 18:48:22.100669 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-5dbbb5d744-vpdts_3329f4b1-ac8c-4472-b6a0-13bb76075957/console-operator/1.log" Jun 11 18:48:22.108229 ip-10-0-130-170 kubenswrapper[2565]: I0611 18:48:22.108199 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-5dbbb5d744-vpdts_3329f4b1-ac8c-4472-b6a0-13bb76075957/console-operator/2.log" Jun 11 18:48:22.632734 ip-10-0-130-170 kubenswrapper[2565]: I0611 18:48:22.632698 2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-must-gather-mx5g9/perf-node-gather-daemonset-9cccc"] Jun 11 18:48:22.633175 ip-10-0-130-170 kubenswrapper[2565]: I0611 18:48:22.633160 2565 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="f2534569-596b-4980-a79d-7694811a1967" containerName="maas-api" Jun 11 18:48:22.633225 ip-10-0-130-170 kubenswrapper[2565]: I0611 18:48:22.633177 2565 state_mem.go:107] "Deleted CPUSet assignment" podUID="f2534569-596b-4980-a79d-7694811a1967" containerName="maas-api" Jun 11 18:48:22.633225 ip-10-0-130-170 kubenswrapper[2565]: I0611 18:48:22.633199 2565 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="90a842db-ff88-4a4c-88a4-fb8e117d7ab3" containerName="authorino" Jun 11 18:48:22.633225 ip-10-0-130-170 kubenswrapper[2565]: I0611 18:48:22.633205 2565 state_mem.go:107] "Deleted CPUSet assignment" podUID="90a842db-ff88-4a4c-88a4-fb8e117d7ab3" containerName="authorino" Jun 11 18:48:22.633225 ip-10-0-130-170 kubenswrapper[2565]: I0611 18:48:22.633211 2565 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="ebeb6c60-5943-4e1a-ad2e-3978698b144f" containerName="manager" Jun 11 18:48:22.633225 ip-10-0-130-170 kubenswrapper[2565]: I0611 18:48:22.633217 2565 state_mem.go:107] "Deleted CPUSet assignment" podUID="ebeb6c60-5943-4e1a-ad2e-3978698b144f" containerName="manager" Jun 11 18:48:22.633421 ip-10-0-130-170 kubenswrapper[2565]: I0611 18:48:22.633292 2565 memory_manager.go:368] "RemoveStaleState removing state" podUID="ebeb6c60-5943-4e1a-ad2e-3978698b144f" containerName="manager" Jun 11 18:48:22.633421 ip-10-0-130-170 kubenswrapper[2565]: I0611 18:48:22.633301 2565 memory_manager.go:368] "RemoveStaleState removing state" podUID="90a842db-ff88-4a4c-88a4-fb8e117d7ab3" containerName="authorino" Jun 11 18:48:22.633421 ip-10-0-130-170 kubenswrapper[2565]: I0611 18:48:22.633310 2565 memory_manager.go:368] "RemoveStaleState removing state" podUID="f2534569-596b-4980-a79d-7694811a1967" containerName="maas-api" Jun 11 18:48:22.636305 ip-10-0-130-170 kubenswrapper[2565]: I0611 18:48:22.636284 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-mx5g9/perf-node-gather-daemonset-9cccc" Jun 11 18:48:22.638773 ip-10-0-130-170 kubenswrapper[2565]: I0611 18:48:22.638749 2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-mx5g9\"/\"openshift-service-ca.crt\"" Jun 11 18:48:22.638905 ip-10-0-130-170 kubenswrapper[2565]: I0611 18:48:22.638827 2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-mx5g9\"/\"kube-root-ca.crt\"" Jun 11 18:48:22.639661 ip-10-0-130-170 kubenswrapper[2565]: I0611 18:48:22.639642 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-must-gather-mx5g9\"/\"default-dockercfg-xxwwp\"" Jun 11 18:48:22.645278 ip-10-0-130-170 kubenswrapper[2565]: I0611 18:48:22.645227 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-mx5g9/perf-node-gather-daemonset-9cccc"] Jun 11 18:48:22.762060 ip-10-0-130-170 kubenswrapper[2565]: I0611 18:48:22.762023 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xq2hc\" (UniqueName: \"kubernetes.io/projected/34d371c9-9081-442c-a123-a3a1be55c78b-kube-api-access-xq2hc\") pod \"perf-node-gather-daemonset-9cccc\" (UID: \"34d371c9-9081-442c-a123-a3a1be55c78b\") " pod="openshift-must-gather-mx5g9/perf-node-gather-daemonset-9cccc" Jun 11 18:48:22.762241 ip-10-0-130-170 kubenswrapper[2565]: I0611 18:48:22.762074 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/34d371c9-9081-442c-a123-a3a1be55c78b-proc\") pod \"perf-node-gather-daemonset-9cccc\" (UID: \"34d371c9-9081-442c-a123-a3a1be55c78b\") " pod="openshift-must-gather-mx5g9/perf-node-gather-daemonset-9cccc" Jun 11 18:48:22.762241 ip-10-0-130-170 kubenswrapper[2565]: I0611 18:48:22.762135 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/34d371c9-9081-442c-a123-a3a1be55c78b-podres\") pod \"perf-node-gather-daemonset-9cccc\" (UID: \"34d371c9-9081-442c-a123-a3a1be55c78b\") " pod="openshift-must-gather-mx5g9/perf-node-gather-daemonset-9cccc" Jun 11 18:48:22.762241 ip-10-0-130-170 kubenswrapper[2565]: I0611 18:48:22.762176 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/34d371c9-9081-442c-a123-a3a1be55c78b-lib-modules\") pod \"perf-node-gather-daemonset-9cccc\" (UID: \"34d371c9-9081-442c-a123-a3a1be55c78b\") " pod="openshift-must-gather-mx5g9/perf-node-gather-daemonset-9cccc" Jun 11 18:48:22.762241 ip-10-0-130-170 kubenswrapper[2565]: I0611 18:48:22.762211 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/34d371c9-9081-442c-a123-a3a1be55c78b-sys\") pod \"perf-node-gather-daemonset-9cccc\" (UID: \"34d371c9-9081-442c-a123-a3a1be55c78b\") " pod="openshift-must-gather-mx5g9/perf-node-gather-daemonset-9cccc" Jun 11 18:48:22.862800 ip-10-0-130-170 kubenswrapper[2565]: I0611 18:48:22.862747 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xq2hc\" (UniqueName: \"kubernetes.io/projected/34d371c9-9081-442c-a123-a3a1be55c78b-kube-api-access-xq2hc\") pod \"perf-node-gather-daemonset-9cccc\" (UID: \"34d371c9-9081-442c-a123-a3a1be55c78b\") " pod="openshift-must-gather-mx5g9/perf-node-gather-daemonset-9cccc" Jun 11 18:48:22.863006 ip-10-0-130-170 kubenswrapper[2565]: I0611 18:48:22.862819 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/34d371c9-9081-442c-a123-a3a1be55c78b-proc\") pod \"perf-node-gather-daemonset-9cccc\" (UID: \"34d371c9-9081-442c-a123-a3a1be55c78b\") " pod="openshift-must-gather-mx5g9/perf-node-gather-daemonset-9cccc" Jun 11 18:48:22.863006 ip-10-0-130-170 kubenswrapper[2565]: I0611 18:48:22.862847 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/34d371c9-9081-442c-a123-a3a1be55c78b-podres\") pod \"perf-node-gather-daemonset-9cccc\" (UID: \"34d371c9-9081-442c-a123-a3a1be55c78b\") " pod="openshift-must-gather-mx5g9/perf-node-gather-daemonset-9cccc" Jun 11 18:48:22.863006 ip-10-0-130-170 kubenswrapper[2565]: I0611 18:48:22.862874 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/34d371c9-9081-442c-a123-a3a1be55c78b-lib-modules\") pod \"perf-node-gather-daemonset-9cccc\" (UID: \"34d371c9-9081-442c-a123-a3a1be55c78b\") " pod="openshift-must-gather-mx5g9/perf-node-gather-daemonset-9cccc" Jun 11 18:48:22.863006 ip-10-0-130-170 kubenswrapper[2565]: I0611 18:48:22.862915 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/34d371c9-9081-442c-a123-a3a1be55c78b-sys\") pod \"perf-node-gather-daemonset-9cccc\" (UID: \"34d371c9-9081-442c-a123-a3a1be55c78b\") " pod="openshift-must-gather-mx5g9/perf-node-gather-daemonset-9cccc" Jun 11 18:48:22.863006 ip-10-0-130-170 kubenswrapper[2565]: I0611 18:48:22.862960 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/34d371c9-9081-442c-a123-a3a1be55c78b-proc\") pod \"perf-node-gather-daemonset-9cccc\" (UID: \"34d371c9-9081-442c-a123-a3a1be55c78b\") " pod="openshift-must-gather-mx5g9/perf-node-gather-daemonset-9cccc" Jun 11 18:48:22.863006 ip-10-0-130-170 kubenswrapper[2565]: I0611 18:48:22.863003 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/34d371c9-9081-442c-a123-a3a1be55c78b-podres\") pod \"perf-node-gather-daemonset-9cccc\" (UID: \"34d371c9-9081-442c-a123-a3a1be55c78b\") " pod="openshift-must-gather-mx5g9/perf-node-gather-daemonset-9cccc" Jun 11 18:48:22.863235 ip-10-0-130-170 kubenswrapper[2565]: I0611 18:48:22.863025 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/34d371c9-9081-442c-a123-a3a1be55c78b-sys\") pod \"perf-node-gather-daemonset-9cccc\" (UID: \"34d371c9-9081-442c-a123-a3a1be55c78b\") " pod="openshift-must-gather-mx5g9/perf-node-gather-daemonset-9cccc" Jun 11 18:48:22.863235 ip-10-0-130-170 kubenswrapper[2565]: I0611 18:48:22.863037 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/34d371c9-9081-442c-a123-a3a1be55c78b-lib-modules\") pod \"perf-node-gather-daemonset-9cccc\" (UID: \"34d371c9-9081-442c-a123-a3a1be55c78b\") " pod="openshift-must-gather-mx5g9/perf-node-gather-daemonset-9cccc" Jun 11 18:48:22.870846 ip-10-0-130-170 kubenswrapper[2565]: I0611 18:48:22.870822 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-xq2hc\" (UniqueName: \"kubernetes.io/projected/34d371c9-9081-442c-a123-a3a1be55c78b-kube-api-access-xq2hc\") pod \"perf-node-gather-daemonset-9cccc\" (UID: \"34d371c9-9081-442c-a123-a3a1be55c78b\") " pod="openshift-must-gather-mx5g9/perf-node-gather-daemonset-9cccc" Jun 11 18:48:22.947392 ip-10-0-130-170 kubenswrapper[2565]: I0611 18:48:22.947275 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-mx5g9/perf-node-gather-daemonset-9cccc" Jun 11 18:48:23.089881 ip-10-0-130-170 kubenswrapper[2565]: I0611 18:48:23.089844 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-mx5g9/perf-node-gather-daemonset-9cccc"] Jun 11 18:48:23.091117 ip-10-0-130-170 kubenswrapper[2565]: W0611 18:48:23.091088 2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-pod34d371c9_9081_442c_a123_a3a1be55c78b.slice/crio-53ce7284f1c5c5ed310132b8f98752ce8c808da8e65168dc85263f8214772446 WatchSource:0}: Error finding container 53ce7284f1c5c5ed310132b8f98752ce8c808da8e65168dc85263f8214772446: Status 404 returned error can't find the container with id 53ce7284f1c5c5ed310132b8f98752ce8c808da8e65168dc85263f8214772446 Jun 11 18:48:23.119967 ip-10-0-130-170 kubenswrapper[2565]: I0611 18:48:23.119932 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-mx5g9/perf-node-gather-daemonset-9cccc" event={"ID":"34d371c9-9081-442c-a123-a3a1be55c78b","Type":"ContainerStarted","Data":"53ce7284f1c5c5ed310132b8f98752ce8c808da8e65168dc85263f8214772446"} Jun 11 18:48:24.127446 ip-10-0-130-170 kubenswrapper[2565]: I0611 18:48:24.127401 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-mx5g9/perf-node-gather-daemonset-9cccc" event={"ID":"34d371c9-9081-442c-a123-a3a1be55c78b","Type":"ContainerStarted","Data":"690796d8d2bd084d0cc8d5da6d78a00a0b551f33ca695b1618a2e5d014db8d31"} Jun 11 18:48:24.127861 ip-10-0-130-170 kubenswrapper[2565]: I0611 18:48:24.127471 2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-must-gather-mx5g9/perf-node-gather-daemonset-9cccc" Jun 11 18:48:24.144264 ip-10-0-130-170 kubenswrapper[2565]: I0611 18:48:24.144211 2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-must-gather-mx5g9/perf-node-gather-daemonset-9cccc" podStartSLOduration=2.144195201 podStartE2EDuration="2.144195201s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-11 18:48:22 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-11 18:48:24.14296995 +0000 UTC m=+1222.891655969" watchObservedRunningTime="2026-06-11 18:48:24.144195201 +0000 UTC m=+1222.892881223" Jun 11 18:48:24.476610 ip-10-0-130-170 kubenswrapper[2565]: I0611 18:48:24.476583 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-4z9qr_41d85d95-09c6-46e3-990f-59c9ab3ad81f/dns/0.log" Jun 11 18:48:24.500636 ip-10-0-130-170 kubenswrapper[2565]: I0611 18:48:24.500607 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-4z9qr_41d85d95-09c6-46e3-990f-59c9ab3ad81f/kube-rbac-proxy/0.log" Jun 11 18:48:24.640088 ip-10-0-130-170 kubenswrapper[2565]: I0611 18:48:24.640056 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-ckltw_8e426e7d-dc89-476c-b72a-7cfc3b64a1f2/dns-node-resolver/0.log" Jun 11 18:48:25.237576 ip-10-0-130-170 kubenswrapper[2565]: I0611 18:48:25.237550 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-wwlkz_7f5f862b-4ec0-44cd-96f3-1554a1656229/node-ca/0.log" Jun 11 18:48:26.258709 ip-10-0-130-170 kubenswrapper[2565]: I0611 18:48:26.258682 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-576bcbdbd6-w42kf_25f90e47-48bd-46f3-ad3c-9870b92d355e/kube-auth-proxy/0.log" Jun 11 18:48:26.319055 ip-10-0-130-170 kubenswrapper[2565]: I0611 18:48:26.319022 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-pre-processing-579785bc64-d9ctc_622f4f16-2d87-4bb3-8e2f-1231c35b2d39/payload-pre-processing/0.log" Jun 11 18:48:26.352783 ip-10-0-130-170 kubenswrapper[2565]: I0611 18:48:26.352757 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-processing-699b6cd6c-d2hv7_149996de-bcb1-4224-a05c-85b25a696aa3/payload-processing/0.log" Jun 11 18:48:26.985565 ip-10-0-130-170 kubenswrapper[2565]: I0611 18:48:26.985539 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-czdq5_35a5e103-2756-40a3-ad29-bae095288d5b/serve-healthcheck-canary/0.log" Jun 11 18:48:27.541382 ip-10-0-130-170 kubenswrapper[2565]: I0611 18:48:27.541348 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-operator-5bbd86d6bd-xr2lr_41864c84-6359-4718-9e48-64baa8e95dbc/insights-operator/0.log" Jun 11 18:48:27.543028 ip-10-0-130-170 kubenswrapper[2565]: I0611 18:48:27.543008 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-operator-5bbd86d6bd-xr2lr_41864c84-6359-4718-9e48-64baa8e95dbc/insights-operator/1.log" Jun 11 18:48:27.628832 ip-10-0-130-170 kubenswrapper[2565]: I0611 18:48:27.628802 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-ncmzq_8bcf15d4-27a3-4749-9e68-ba74ffb6004a/kube-rbac-proxy/0.log" Jun 11 18:48:27.647906 ip-10-0-130-170 kubenswrapper[2565]: I0611 18:48:27.647883 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-ncmzq_8bcf15d4-27a3-4749-9e68-ba74ffb6004a/exporter/0.log" Jun 11 18:48:27.667596 ip-10-0-130-170 kubenswrapper[2565]: I0611 18:48:27.667560 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-ncmzq_8bcf15d4-27a3-4749-9e68-ba74ffb6004a/extractor/0.log" Jun 11 18:48:30.144738 ip-10-0-130-170 kubenswrapper[2565]: I0611 18:48:30.144711 2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-must-gather-mx5g9/perf-node-gather-daemonset-9cccc" Jun 11 18:48:30.238166 ip-10-0-130-170 kubenswrapper[2565]: I0611 18:48:30.238140 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-699bfcf455-j96zk_666c734e-668e-4b2e-a00c-8b10d199f510/manager/0.log" Jun 11 18:48:30.256036 ip-10-0-130-170 kubenswrapper[2565]: I0611 18:48:30.256014 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-699bfcf455-j96zk_666c734e-668e-4b2e-a00c-8b10d199f510/copy-manifests/0.log" Jun 11 18:48:30.281460 ip-10-0-130-170 kubenswrapper[2565]: I0611 18:48:30.281431 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_postgres-69fb4594cf-sgst5_470bf921-3acd-4689-9217-c858efd6b61e/postgres/0.log" Jun 11 18:48:31.957188 ip-10-0-130-170 kubenswrapper[2565]: I0611 18:48:31.957107 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-lws-operator_lws-controller-manager-6d68fdb559-jj7dc_a0525b53-c65a-41bb-86fc-fb007aa4590e/manager/0.log" Jun 11 18:48:36.955673 ip-10-0-130-170 kubenswrapper[2565]: I0611 18:48:36.955634 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-576bcbdbd6-w42kf_25f90e47-48bd-46f3-ad3c-9870b92d355e/kube-auth-proxy/0.log" Jun 11 18:48:36.995702 ip-10-0-130-170 kubenswrapper[2565]: I0611 18:48:36.995659 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-pre-processing-579785bc64-d9ctc_622f4f16-2d87-4bb3-8e2f-1231c35b2d39/payload-pre-processing/0.log" Jun 11 18:48:37.026239 ip-10-0-130-170 kubenswrapper[2565]: I0611 18:48:37.026211 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-processing-699b6cd6c-d2hv7_149996de-bcb1-4224-a05c-85b25a696aa3/payload-processing/0.log" Jun 11 18:48:37.342592 ip-10-0-130-170 kubenswrapper[2565]: I0611 18:48:37.342505 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator_migrator-d4bcd4867-mrrwt_419b22af-d1e6-4c34-a8ee-caefea3daa6f/migrator/0.log" Jun 11 18:48:37.378108 ip-10-0-130-170 kubenswrapper[2565]: I0611 18:48:37.378079 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator_migrator-d4bcd4867-mrrwt_419b22af-d1e6-4c34-a8ee-caefea3daa6f/graceful-termination/0.log" Jun 11 18:48:38.288401 ip-10-0-130-170 kubenswrapper[2565]: I0611 18:48:38.288371 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-576bcbdbd6-w42kf_25f90e47-48bd-46f3-ad3c-9870b92d355e/kube-auth-proxy/0.log" Jun 11 18:48:38.337357 ip-10-0-130-170 kubenswrapper[2565]: I0611 18:48:38.337324 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-pre-processing-579785bc64-d9ctc_622f4f16-2d87-4bb3-8e2f-1231c35b2d39/payload-pre-processing/0.log" Jun 11 18:48:38.366423 ip-10-0-130-170 kubenswrapper[2565]: I0611 18:48:38.366391 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-processing-699b6cd6c-d2hv7_149996de-bcb1-4224-a05c-85b25a696aa3/payload-processing/0.log" Jun 11 18:48:39.011177 ip-10-0-130-170 kubenswrapper[2565]: I0611 18:48:39.011149 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-7qn5t_0a391608-1cd7-4bb8-8907-2f8e7078bf68/kube-multus-additional-cni-plugins/0.log" Jun 11 18:48:39.034593 ip-10-0-130-170 kubenswrapper[2565]: I0611 18:48:39.034560 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-7qn5t_0a391608-1cd7-4bb8-8907-2f8e7078bf68/egress-router-binary-copy/0.log" Jun 11 18:48:39.054024 ip-10-0-130-170 kubenswrapper[2565]: I0611 18:48:39.054001 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-7qn5t_0a391608-1cd7-4bb8-8907-2f8e7078bf68/cni-plugins/0.log" Jun 11 18:48:39.074154 ip-10-0-130-170 kubenswrapper[2565]: I0611 18:48:39.074125 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-7qn5t_0a391608-1cd7-4bb8-8907-2f8e7078bf68/bond-cni-plugin/0.log" Jun 11 18:48:39.093669 ip-10-0-130-170 kubenswrapper[2565]: I0611 18:48:39.093644 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-7qn5t_0a391608-1cd7-4bb8-8907-2f8e7078bf68/routeoverride-cni/0.log" Jun 11 18:48:39.116412 ip-10-0-130-170 kubenswrapper[2565]: I0611 18:48:39.116386 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-7qn5t_0a391608-1cd7-4bb8-8907-2f8e7078bf68/whereabouts-cni-bincopy/0.log" Jun 11 18:48:39.136776 ip-10-0-130-170 kubenswrapper[2565]: I0611 18:48:39.136749 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-7qn5t_0a391608-1cd7-4bb8-8907-2f8e7078bf68/whereabouts-cni/0.log" Jun 11 18:48:39.507477 ip-10-0-130-170 kubenswrapper[2565]: I0611 18:48:39.507439 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-pfc8t_fbbe1b81-aba0-4a02-9e7e-b272155f08ff/kube-multus/0.log" Jun 11 18:48:39.657420 ip-10-0-130-170 kubenswrapper[2565]: I0611 18:48:39.657388 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_network-metrics-daemon-bvwxp_2f4a1ff8-558e-4d9b-9208-ca0211b2b4e1/network-metrics-daemon/0.log" Jun 11 18:48:39.675099 ip-10-0-130-170 kubenswrapper[2565]: I0611 18:48:39.675068 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_network-metrics-daemon-bvwxp_2f4a1ff8-558e-4d9b-9208-ca0211b2b4e1/kube-rbac-proxy/0.log" Jun 11 18:48:40.028482 ip-10-0-130-170 kubenswrapper[2565]: I0611 18:48:40.028450 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-576bcbdbd6-w42kf_25f90e47-48bd-46f3-ad3c-9870b92d355e/kube-auth-proxy/0.log" Jun 11 18:48:40.071479 ip-10-0-130-170 kubenswrapper[2565]: I0611 18:48:40.071450 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-pre-processing-579785bc64-d9ctc_622f4f16-2d87-4bb3-8e2f-1231c35b2d39/payload-pre-processing/0.log" Jun 11 18:48:40.098022 ip-10-0-130-170 kubenswrapper[2565]: I0611 18:48:40.097995 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-processing-699b6cd6c-d2hv7_149996de-bcb1-4224-a05c-85b25a696aa3/payload-processing/0.log"