Jun 09 15:01:25.026452 ip-10-0-133-239 systemd[1]: Starting Kubernetes Kubelet... Jun 09 15:01:25.447794 ip-10-0-133-239 kubenswrapper[2576]: Flag --container-runtime-endpoint has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Jun 09 15:01:25.447794 ip-10-0-133-239 kubenswrapper[2576]: Flag --minimum-container-ttl-duration has been deprecated, Use --eviction-hard or --eviction-soft instead. Will be removed in a future version. Jun 09 15:01:25.447794 ip-10-0-133-239 kubenswrapper[2576]: Flag --volume-plugin-dir has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Jun 09 15:01:25.447794 ip-10-0-133-239 kubenswrapper[2576]: Flag --pod-infra-container-image has been deprecated, will be removed in 1.35. Image garbage collector will get sandbox image information from CRI. Jun 09 15:01:25.447794 ip-10-0-133-239 kubenswrapper[2576]: Flag --system-reserved has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Jun 09 15:01:25.448498 ip-10-0-133-239 kubenswrapper[2576]: I0609 15:01:25.447876 2576 server.go:213] "--pod-infra-container-image will not be pruned by the image garbage collector in kubelet and should also be set in the remote runtime" Jun 09 15:01:25.453740 ip-10-0-133-239 kubenswrapper[2576]: W0609 15:01:25.453722 2576 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jun 09 15:01:25.453740 ip-10-0-133-239 kubenswrapper[2576]: W0609 15:01:25.453740 2576 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jun 09 15:01:25.453807 ip-10-0-133-239 kubenswrapper[2576]: W0609 15:01:25.453744 2576 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jun 09 15:01:25.453807 ip-10-0-133-239 kubenswrapper[2576]: W0609 15:01:25.453748 2576 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jun 09 15:01:25.453807 ip-10-0-133-239 kubenswrapper[2576]: W0609 15:01:25.453751 2576 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jun 09 15:01:25.453807 ip-10-0-133-239 kubenswrapper[2576]: W0609 15:01:25.453754 2576 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jun 09 15:01:25.453807 ip-10-0-133-239 kubenswrapper[2576]: W0609 15:01:25.453757 2576 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jun 09 15:01:25.453807 ip-10-0-133-239 kubenswrapper[2576]: W0609 15:01:25.453759 2576 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jun 09 15:01:25.453807 ip-10-0-133-239 kubenswrapper[2576]: W0609 15:01:25.453762 2576 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jun 09 15:01:25.453807 ip-10-0-133-239 kubenswrapper[2576]: W0609 15:01:25.453764 2576 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jun 09 15:01:25.453807 ip-10-0-133-239 kubenswrapper[2576]: W0609 15:01:25.453768 2576 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jun 09 15:01:25.453807 ip-10-0-133-239 kubenswrapper[2576]: W0609 15:01:25.453771 2576 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jun 09 15:01:25.453807 ip-10-0-133-239 kubenswrapper[2576]: W0609 15:01:25.453773 2576 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jun 09 15:01:25.453807 ip-10-0-133-239 kubenswrapper[2576]: W0609 15:01:25.453776 2576 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jun 09 15:01:25.453807 ip-10-0-133-239 kubenswrapper[2576]: W0609 15:01:25.453783 2576 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jun 09 15:01:25.453807 ip-10-0-133-239 kubenswrapper[2576]: W0609 15:01:25.453786 2576 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jun 09 15:01:25.453807 ip-10-0-133-239 kubenswrapper[2576]: W0609 15:01:25.453788 2576 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jun 09 15:01:25.453807 ip-10-0-133-239 kubenswrapper[2576]: W0609 15:01:25.453791 2576 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jun 09 15:01:25.453807 ip-10-0-133-239 kubenswrapper[2576]: W0609 15:01:25.453794 2576 feature_gate.go:328] unrecognized feature gate: SignatureStores Jun 09 15:01:25.453807 ip-10-0-133-239 kubenswrapper[2576]: W0609 15:01:25.453796 2576 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jun 09 15:01:25.453807 ip-10-0-133-239 kubenswrapper[2576]: W0609 15:01:25.453799 2576 feature_gate.go:328] unrecognized feature gate: OVNObservability Jun 09 15:01:25.453807 ip-10-0-133-239 kubenswrapper[2576]: W0609 15:01:25.453802 2576 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jun 09 15:01:25.454288 ip-10-0-133-239 kubenswrapper[2576]: W0609 15:01:25.453804 2576 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jun 09 15:01:25.454288 ip-10-0-133-239 kubenswrapper[2576]: W0609 15:01:25.453806 2576 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jun 09 15:01:25.454288 ip-10-0-133-239 kubenswrapper[2576]: W0609 15:01:25.453809 2576 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jun 09 15:01:25.454288 ip-10-0-133-239 kubenswrapper[2576]: W0609 15:01:25.453814 2576 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jun 09 15:01:25.454288 ip-10-0-133-239 kubenswrapper[2576]: W0609 15:01:25.453818 2576 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jun 09 15:01:25.454288 ip-10-0-133-239 kubenswrapper[2576]: W0609 15:01:25.453821 2576 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jun 09 15:01:25.454288 ip-10-0-133-239 kubenswrapper[2576]: W0609 15:01:25.453824 2576 feature_gate.go:328] unrecognized feature gate: OSStreams Jun 09 15:01:25.454288 ip-10-0-133-239 kubenswrapper[2576]: W0609 15:01:25.453827 2576 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jun 09 15:01:25.454288 ip-10-0-133-239 kubenswrapper[2576]: W0609 15:01:25.453830 2576 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jun 09 15:01:25.454288 ip-10-0-133-239 kubenswrapper[2576]: W0609 15:01:25.453833 2576 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jun 09 15:01:25.454288 ip-10-0-133-239 kubenswrapper[2576]: W0609 15:01:25.453837 2576 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jun 09 15:01:25.454288 ip-10-0-133-239 kubenswrapper[2576]: W0609 15:01:25.453840 2576 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jun 09 15:01:25.454288 ip-10-0-133-239 kubenswrapper[2576]: W0609 15:01:25.453842 2576 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jun 09 15:01:25.454288 ip-10-0-133-239 kubenswrapper[2576]: W0609 15:01:25.453845 2576 feature_gate.go:328] unrecognized feature gate: DualReplica Jun 09 15:01:25.454288 ip-10-0-133-239 kubenswrapper[2576]: W0609 15:01:25.453848 2576 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jun 09 15:01:25.454288 ip-10-0-133-239 kubenswrapper[2576]: W0609 15:01:25.453850 2576 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jun 09 15:01:25.454288 ip-10-0-133-239 kubenswrapper[2576]: W0609 15:01:25.453852 2576 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jun 09 15:01:25.454288 ip-10-0-133-239 kubenswrapper[2576]: W0609 15:01:25.453855 2576 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jun 09 15:01:25.454288 ip-10-0-133-239 kubenswrapper[2576]: W0609 15:01:25.453857 2576 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jun 09 15:01:25.454737 ip-10-0-133-239 kubenswrapper[2576]: W0609 15:01:25.453860 2576 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jun 09 15:01:25.454737 ip-10-0-133-239 kubenswrapper[2576]: W0609 15:01:25.453862 2576 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jun 09 15:01:25.454737 ip-10-0-133-239 kubenswrapper[2576]: W0609 15:01:25.453865 2576 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jun 09 15:01:25.454737 ip-10-0-133-239 kubenswrapper[2576]: W0609 15:01:25.453867 2576 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jun 09 15:01:25.454737 ip-10-0-133-239 kubenswrapper[2576]: W0609 15:01:25.453870 2576 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jun 09 15:01:25.454737 ip-10-0-133-239 kubenswrapper[2576]: W0609 15:01:25.453872 2576 feature_gate.go:328] unrecognized feature gate: Example2 Jun 09 15:01:25.454737 ip-10-0-133-239 kubenswrapper[2576]: W0609 15:01:25.453875 2576 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jun 09 15:01:25.454737 ip-10-0-133-239 kubenswrapper[2576]: W0609 15:01:25.453879 2576 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jun 09 15:01:25.454737 ip-10-0-133-239 kubenswrapper[2576]: W0609 15:01:25.453881 2576 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jun 09 15:01:25.454737 ip-10-0-133-239 kubenswrapper[2576]: W0609 15:01:25.453884 2576 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jun 09 15:01:25.454737 ip-10-0-133-239 kubenswrapper[2576]: W0609 15:01:25.453886 2576 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jun 09 15:01:25.454737 ip-10-0-133-239 kubenswrapper[2576]: W0609 15:01:25.453888 2576 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jun 09 15:01:25.454737 ip-10-0-133-239 kubenswrapper[2576]: W0609 15:01:25.453891 2576 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jun 09 15:01:25.454737 ip-10-0-133-239 kubenswrapper[2576]: W0609 15:01:25.453894 2576 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jun 09 15:01:25.454737 ip-10-0-133-239 kubenswrapper[2576]: W0609 15:01:25.453898 2576 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jun 09 15:01:25.454737 ip-10-0-133-239 kubenswrapper[2576]: W0609 15:01:25.453900 2576 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jun 09 15:01:25.454737 ip-10-0-133-239 kubenswrapper[2576]: W0609 15:01:25.453903 2576 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jun 09 15:01:25.454737 ip-10-0-133-239 kubenswrapper[2576]: W0609 15:01:25.453906 2576 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jun 09 15:01:25.454737 ip-10-0-133-239 kubenswrapper[2576]: W0609 15:01:25.453908 2576 feature_gate.go:328] unrecognized feature gate: PinnedImages Jun 09 15:01:25.454737 ip-10-0-133-239 kubenswrapper[2576]: W0609 15:01:25.453911 2576 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jun 09 15:01:25.455224 ip-10-0-133-239 kubenswrapper[2576]: W0609 15:01:25.453914 2576 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jun 09 15:01:25.455224 ip-10-0-133-239 kubenswrapper[2576]: W0609 15:01:25.453916 2576 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jun 09 15:01:25.455224 ip-10-0-133-239 kubenswrapper[2576]: W0609 15:01:25.453918 2576 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jun 09 15:01:25.455224 ip-10-0-133-239 kubenswrapper[2576]: W0609 15:01:25.453921 2576 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jun 09 15:01:25.455224 ip-10-0-133-239 kubenswrapper[2576]: W0609 15:01:25.453923 2576 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jun 09 15:01:25.455224 ip-10-0-133-239 kubenswrapper[2576]: W0609 15:01:25.453926 2576 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jun 09 15:01:25.455224 ip-10-0-133-239 kubenswrapper[2576]: W0609 15:01:25.453928 2576 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jun 09 15:01:25.455224 ip-10-0-133-239 kubenswrapper[2576]: W0609 15:01:25.453931 2576 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jun 09 15:01:25.455224 ip-10-0-133-239 kubenswrapper[2576]: W0609 15:01:25.453933 2576 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jun 09 15:01:25.455224 ip-10-0-133-239 kubenswrapper[2576]: W0609 15:01:25.453935 2576 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jun 09 15:01:25.455224 ip-10-0-133-239 kubenswrapper[2576]: W0609 15:01:25.453938 2576 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jun 09 15:01:25.455224 ip-10-0-133-239 kubenswrapper[2576]: W0609 15:01:25.453940 2576 feature_gate.go:328] unrecognized feature gate: NewOLM Jun 09 15:01:25.455224 ip-10-0-133-239 kubenswrapper[2576]: W0609 15:01:25.453943 2576 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jun 09 15:01:25.455224 ip-10-0-133-239 kubenswrapper[2576]: W0609 15:01:25.453945 2576 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jun 09 15:01:25.455224 ip-10-0-133-239 kubenswrapper[2576]: W0609 15:01:25.453948 2576 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jun 09 15:01:25.455224 ip-10-0-133-239 kubenswrapper[2576]: W0609 15:01:25.453951 2576 feature_gate.go:328] unrecognized feature gate: EventTTL Jun 09 15:01:25.455224 ip-10-0-133-239 kubenswrapper[2576]: W0609 15:01:25.453955 2576 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jun 09 15:01:25.455224 ip-10-0-133-239 kubenswrapper[2576]: W0609 15:01:25.453959 2576 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jun 09 15:01:25.455224 ip-10-0-133-239 kubenswrapper[2576]: W0609 15:01:25.453961 2576 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jun 09 15:01:25.455671 ip-10-0-133-239 kubenswrapper[2576]: W0609 15:01:25.453966 2576 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jun 09 15:01:25.455671 ip-10-0-133-239 kubenswrapper[2576]: W0609 15:01:25.453970 2576 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jun 09 15:01:25.455671 ip-10-0-133-239 kubenswrapper[2576]: W0609 15:01:25.453972 2576 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jun 09 15:01:25.455671 ip-10-0-133-239 kubenswrapper[2576]: W0609 15:01:25.453975 2576 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jun 09 15:01:25.455671 ip-10-0-133-239 kubenswrapper[2576]: W0609 15:01:25.453977 2576 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jun 09 15:01:25.455671 ip-10-0-133-239 kubenswrapper[2576]: W0609 15:01:25.453979 2576 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jun 09 15:01:25.455671 ip-10-0-133-239 kubenswrapper[2576]: W0609 15:01:25.453982 2576 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jun 09 15:01:25.455671 ip-10-0-133-239 kubenswrapper[2576]: W0609 15:01:25.453985 2576 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jun 09 15:01:25.455671 ip-10-0-133-239 kubenswrapper[2576]: W0609 15:01:25.453988 2576 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jun 09 15:01:25.455671 ip-10-0-133-239 kubenswrapper[2576]: W0609 15:01:25.453991 2576 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jun 09 15:01:25.455671 ip-10-0-133-239 kubenswrapper[2576]: W0609 15:01:25.453993 2576 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jun 09 15:01:25.455671 ip-10-0-133-239 kubenswrapper[2576]: W0609 15:01:25.453996 2576 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jun 09 15:01:25.455671 ip-10-0-133-239 kubenswrapper[2576]: W0609 15:01:25.453998 2576 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jun 09 15:01:25.455671 ip-10-0-133-239 kubenswrapper[2576]: W0609 15:01:25.454001 2576 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jun 09 15:01:25.455671 ip-10-0-133-239 kubenswrapper[2576]: W0609 15:01:25.454003 2576 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jun 09 15:01:25.455671 ip-10-0-133-239 kubenswrapper[2576]: W0609 15:01:25.454006 2576 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jun 09 15:01:25.455671 ip-10-0-133-239 kubenswrapper[2576]: W0609 15:01:25.454008 2576 feature_gate.go:328] unrecognized feature gate: Example Jun 09 15:01:25.455671 ip-10-0-133-239 kubenswrapper[2576]: W0609 15:01:25.454011 2576 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jun 09 15:01:25.455671 ip-10-0-133-239 kubenswrapper[2576]: W0609 15:01:25.454014 2576 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jun 09 15:01:25.455671 ip-10-0-133-239 kubenswrapper[2576]: W0609 15:01:25.454721 2576 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jun 09 15:01:25.456440 ip-10-0-133-239 kubenswrapper[2576]: W0609 15:01:25.454727 2576 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jun 09 15:01:25.456440 ip-10-0-133-239 kubenswrapper[2576]: W0609 15:01:25.454730 2576 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jun 09 15:01:25.456440 ip-10-0-133-239 kubenswrapper[2576]: W0609 15:01:25.454733 2576 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jun 09 15:01:25.456440 ip-10-0-133-239 kubenswrapper[2576]: W0609 15:01:25.454736 2576 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jun 09 15:01:25.456440 ip-10-0-133-239 kubenswrapper[2576]: W0609 15:01:25.454738 2576 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jun 09 15:01:25.456440 ip-10-0-133-239 kubenswrapper[2576]: W0609 15:01:25.454741 2576 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jun 09 15:01:25.456440 ip-10-0-133-239 kubenswrapper[2576]: W0609 15:01:25.454744 2576 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jun 09 15:01:25.456440 ip-10-0-133-239 kubenswrapper[2576]: W0609 15:01:25.454747 2576 feature_gate.go:328] unrecognized feature gate: DualReplica Jun 09 15:01:25.456440 ip-10-0-133-239 kubenswrapper[2576]: W0609 15:01:25.454750 2576 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jun 09 15:01:25.456440 ip-10-0-133-239 kubenswrapper[2576]: W0609 15:01:25.454753 2576 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jun 09 15:01:25.456440 ip-10-0-133-239 kubenswrapper[2576]: W0609 15:01:25.454755 2576 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jun 09 15:01:25.456440 ip-10-0-133-239 kubenswrapper[2576]: W0609 15:01:25.454758 2576 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jun 09 15:01:25.456440 ip-10-0-133-239 kubenswrapper[2576]: W0609 15:01:25.454761 2576 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jun 09 15:01:25.456440 ip-10-0-133-239 kubenswrapper[2576]: W0609 15:01:25.454764 2576 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jun 09 15:01:25.456440 ip-10-0-133-239 kubenswrapper[2576]: W0609 15:01:25.454766 2576 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jun 09 15:01:25.456440 ip-10-0-133-239 kubenswrapper[2576]: W0609 15:01:25.454769 2576 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jun 09 15:01:25.456440 ip-10-0-133-239 kubenswrapper[2576]: W0609 15:01:25.454772 2576 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jun 09 15:01:25.456440 ip-10-0-133-239 kubenswrapper[2576]: W0609 15:01:25.454774 2576 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jun 09 15:01:25.456440 ip-10-0-133-239 kubenswrapper[2576]: W0609 15:01:25.454777 2576 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jun 09 15:01:25.456916 ip-10-0-133-239 kubenswrapper[2576]: W0609 15:01:25.454780 2576 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jun 09 15:01:25.456916 ip-10-0-133-239 kubenswrapper[2576]: W0609 15:01:25.454783 2576 feature_gate.go:328] unrecognized feature gate: Example Jun 09 15:01:25.456916 ip-10-0-133-239 kubenswrapper[2576]: W0609 15:01:25.454786 2576 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jun 09 15:01:25.456916 ip-10-0-133-239 kubenswrapper[2576]: W0609 15:01:25.454788 2576 feature_gate.go:328] unrecognized feature gate: NewOLM Jun 09 15:01:25.456916 ip-10-0-133-239 kubenswrapper[2576]: W0609 15:01:25.454791 2576 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jun 09 15:01:25.456916 ip-10-0-133-239 kubenswrapper[2576]: W0609 15:01:25.454794 2576 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jun 09 15:01:25.456916 ip-10-0-133-239 kubenswrapper[2576]: W0609 15:01:25.454797 2576 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jun 09 15:01:25.456916 ip-10-0-133-239 kubenswrapper[2576]: W0609 15:01:25.454799 2576 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jun 09 15:01:25.456916 ip-10-0-133-239 kubenswrapper[2576]: W0609 15:01:25.454802 2576 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jun 09 15:01:25.456916 ip-10-0-133-239 kubenswrapper[2576]: W0609 15:01:25.454807 2576 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jun 09 15:01:25.456916 ip-10-0-133-239 kubenswrapper[2576]: W0609 15:01:25.454810 2576 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jun 09 15:01:25.456916 ip-10-0-133-239 kubenswrapper[2576]: W0609 15:01:25.454813 2576 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jun 09 15:01:25.456916 ip-10-0-133-239 kubenswrapper[2576]: W0609 15:01:25.454816 2576 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jun 09 15:01:25.456916 ip-10-0-133-239 kubenswrapper[2576]: W0609 15:01:25.454819 2576 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jun 09 15:01:25.456916 ip-10-0-133-239 kubenswrapper[2576]: W0609 15:01:25.454822 2576 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jun 09 15:01:25.456916 ip-10-0-133-239 kubenswrapper[2576]: W0609 15:01:25.454825 2576 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jun 09 15:01:25.456916 ip-10-0-133-239 kubenswrapper[2576]: W0609 15:01:25.454829 2576 feature_gate.go:328] unrecognized feature gate: OVNObservability Jun 09 15:01:25.456916 ip-10-0-133-239 kubenswrapper[2576]: W0609 15:01:25.454831 2576 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jun 09 15:01:25.456916 ip-10-0-133-239 kubenswrapper[2576]: W0609 15:01:25.454834 2576 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jun 09 15:01:25.457412 ip-10-0-133-239 kubenswrapper[2576]: W0609 15:01:25.454836 2576 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jun 09 15:01:25.457412 ip-10-0-133-239 kubenswrapper[2576]: W0609 15:01:25.454839 2576 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jun 09 15:01:25.457412 ip-10-0-133-239 kubenswrapper[2576]: W0609 15:01:25.454842 2576 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jun 09 15:01:25.457412 ip-10-0-133-239 kubenswrapper[2576]: W0609 15:01:25.454844 2576 feature_gate.go:328] unrecognized feature gate: Example2 Jun 09 15:01:25.457412 ip-10-0-133-239 kubenswrapper[2576]: W0609 15:01:25.454847 2576 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jun 09 15:01:25.457412 ip-10-0-133-239 kubenswrapper[2576]: W0609 15:01:25.454850 2576 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jun 09 15:01:25.457412 ip-10-0-133-239 kubenswrapper[2576]: W0609 15:01:25.454852 2576 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jun 09 15:01:25.457412 ip-10-0-133-239 kubenswrapper[2576]: W0609 15:01:25.454854 2576 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jun 09 15:01:25.457412 ip-10-0-133-239 kubenswrapper[2576]: W0609 15:01:25.454857 2576 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jun 09 15:01:25.457412 ip-10-0-133-239 kubenswrapper[2576]: W0609 15:01:25.454860 2576 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jun 09 15:01:25.457412 ip-10-0-133-239 kubenswrapper[2576]: W0609 15:01:25.454864 2576 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jun 09 15:01:25.457412 ip-10-0-133-239 kubenswrapper[2576]: W0609 15:01:25.454868 2576 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jun 09 15:01:25.457412 ip-10-0-133-239 kubenswrapper[2576]: W0609 15:01:25.454870 2576 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jun 09 15:01:25.457412 ip-10-0-133-239 kubenswrapper[2576]: W0609 15:01:25.454874 2576 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jun 09 15:01:25.457412 ip-10-0-133-239 kubenswrapper[2576]: W0609 15:01:25.454877 2576 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jun 09 15:01:25.457412 ip-10-0-133-239 kubenswrapper[2576]: W0609 15:01:25.454880 2576 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jun 09 15:01:25.457412 ip-10-0-133-239 kubenswrapper[2576]: W0609 15:01:25.454883 2576 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jun 09 15:01:25.457412 ip-10-0-133-239 kubenswrapper[2576]: W0609 15:01:25.454886 2576 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jun 09 15:01:25.457412 ip-10-0-133-239 kubenswrapper[2576]: W0609 15:01:25.454888 2576 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jun 09 15:01:25.457412 ip-10-0-133-239 kubenswrapper[2576]: W0609 15:01:25.454891 2576 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jun 09 15:01:25.457897 ip-10-0-133-239 kubenswrapper[2576]: W0609 15:01:25.454894 2576 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jun 09 15:01:25.457897 ip-10-0-133-239 kubenswrapper[2576]: W0609 15:01:25.454896 2576 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jun 09 15:01:25.457897 ip-10-0-133-239 kubenswrapper[2576]: W0609 15:01:25.454899 2576 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jun 09 15:01:25.457897 ip-10-0-133-239 kubenswrapper[2576]: W0609 15:01:25.454901 2576 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jun 09 15:01:25.457897 ip-10-0-133-239 kubenswrapper[2576]: W0609 15:01:25.454904 2576 feature_gate.go:328] unrecognized feature gate: OSStreams Jun 09 15:01:25.457897 ip-10-0-133-239 kubenswrapper[2576]: W0609 15:01:25.454906 2576 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jun 09 15:01:25.457897 ip-10-0-133-239 kubenswrapper[2576]: W0609 15:01:25.454909 2576 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jun 09 15:01:25.457897 ip-10-0-133-239 kubenswrapper[2576]: W0609 15:01:25.454911 2576 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jun 09 15:01:25.457897 ip-10-0-133-239 kubenswrapper[2576]: W0609 15:01:25.454914 2576 feature_gate.go:328] unrecognized feature gate: SignatureStores Jun 09 15:01:25.457897 ip-10-0-133-239 kubenswrapper[2576]: W0609 15:01:25.454916 2576 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jun 09 15:01:25.457897 ip-10-0-133-239 kubenswrapper[2576]: W0609 15:01:25.454919 2576 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jun 09 15:01:25.457897 ip-10-0-133-239 kubenswrapper[2576]: W0609 15:01:25.454921 2576 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jun 09 15:01:25.457897 ip-10-0-133-239 kubenswrapper[2576]: W0609 15:01:25.454925 2576 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jun 09 15:01:25.457897 ip-10-0-133-239 kubenswrapper[2576]: W0609 15:01:25.454927 2576 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jun 09 15:01:25.457897 ip-10-0-133-239 kubenswrapper[2576]: W0609 15:01:25.454930 2576 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jun 09 15:01:25.457897 ip-10-0-133-239 kubenswrapper[2576]: W0609 15:01:25.454932 2576 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jun 09 15:01:25.457897 ip-10-0-133-239 kubenswrapper[2576]: W0609 15:01:25.454935 2576 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jun 09 15:01:25.457897 ip-10-0-133-239 kubenswrapper[2576]: W0609 15:01:25.454938 2576 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jun 09 15:01:25.457897 ip-10-0-133-239 kubenswrapper[2576]: W0609 15:01:25.454941 2576 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jun 09 15:01:25.457897 ip-10-0-133-239 kubenswrapper[2576]: W0609 15:01:25.454944 2576 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jun 09 15:01:25.458396 ip-10-0-133-239 kubenswrapper[2576]: W0609 15:01:25.454946 2576 feature_gate.go:328] unrecognized feature gate: EventTTL Jun 09 15:01:25.458396 ip-10-0-133-239 kubenswrapper[2576]: W0609 15:01:25.454949 2576 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jun 09 15:01:25.458396 ip-10-0-133-239 kubenswrapper[2576]: W0609 15:01:25.454952 2576 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jun 09 15:01:25.458396 ip-10-0-133-239 kubenswrapper[2576]: W0609 15:01:25.454954 2576 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jun 09 15:01:25.458396 ip-10-0-133-239 kubenswrapper[2576]: W0609 15:01:25.454957 2576 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jun 09 15:01:25.458396 ip-10-0-133-239 kubenswrapper[2576]: W0609 15:01:25.454959 2576 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jun 09 15:01:25.458396 ip-10-0-133-239 kubenswrapper[2576]: W0609 15:01:25.454962 2576 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jun 09 15:01:25.458396 ip-10-0-133-239 kubenswrapper[2576]: W0609 15:01:25.454965 2576 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jun 09 15:01:25.458396 ip-10-0-133-239 kubenswrapper[2576]: W0609 15:01:25.454967 2576 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jun 09 15:01:25.458396 ip-10-0-133-239 kubenswrapper[2576]: W0609 15:01:25.454970 2576 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jun 09 15:01:25.458396 ip-10-0-133-239 kubenswrapper[2576]: W0609 15:01:25.454972 2576 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jun 09 15:01:25.458396 ip-10-0-133-239 kubenswrapper[2576]: W0609 15:01:25.454976 2576 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jun 09 15:01:25.458396 ip-10-0-133-239 kubenswrapper[2576]: W0609 15:01:25.454980 2576 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jun 09 15:01:25.458396 ip-10-0-133-239 kubenswrapper[2576]: W0609 15:01:25.454983 2576 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jun 09 15:01:25.458396 ip-10-0-133-239 kubenswrapper[2576]: W0609 15:01:25.454985 2576 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jun 09 15:01:25.458396 ip-10-0-133-239 kubenswrapper[2576]: W0609 15:01:25.454988 2576 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jun 09 15:01:25.458396 ip-10-0-133-239 kubenswrapper[2576]: W0609 15:01:25.454990 2576 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jun 09 15:01:25.458396 ip-10-0-133-239 kubenswrapper[2576]: W0609 15:01:25.454993 2576 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jun 09 15:01:25.458396 ip-10-0-133-239 kubenswrapper[2576]: W0609 15:01:25.454995 2576 feature_gate.go:328] unrecognized feature gate: PinnedImages Jun 09 15:01:25.458396 ip-10-0-133-239 kubenswrapper[2576]: W0609 15:01:25.454998 2576 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jun 09 15:01:25.458868 ip-10-0-133-239 kubenswrapper[2576]: W0609 15:01:25.455380 2576 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jun 09 15:01:25.458868 ip-10-0-133-239 kubenswrapper[2576]: W0609 15:01:25.455385 2576 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jun 09 15:01:25.458868 ip-10-0-133-239 kubenswrapper[2576]: W0609 15:01:25.455388 2576 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jun 09 15:01:25.458868 ip-10-0-133-239 kubenswrapper[2576]: W0609 15:01:25.455391 2576 feature_gate.go:328] unrecognized feature gate: OVNObservability Jun 09 15:01:25.458868 ip-10-0-133-239 kubenswrapper[2576]: W0609 15:01:25.455394 2576 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jun 09 15:01:25.458868 ip-10-0-133-239 kubenswrapper[2576]: W0609 15:01:25.455397 2576 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jun 09 15:01:25.458868 ip-10-0-133-239 kubenswrapper[2576]: W0609 15:01:25.455400 2576 feature_gate.go:328] unrecognized feature gate: DualReplica Jun 09 15:01:25.458868 ip-10-0-133-239 kubenswrapper[2576]: W0609 15:01:25.455402 2576 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jun 09 15:01:25.458868 ip-10-0-133-239 kubenswrapper[2576]: W0609 15:01:25.455405 2576 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jun 09 15:01:25.458868 ip-10-0-133-239 kubenswrapper[2576]: W0609 15:01:25.455408 2576 feature_gate.go:328] unrecognized feature gate: SignatureStores Jun 09 15:01:25.458868 ip-10-0-133-239 kubenswrapper[2576]: W0609 15:01:25.455410 2576 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jun 09 15:01:25.458868 ip-10-0-133-239 kubenswrapper[2576]: W0609 15:01:25.455413 2576 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jun 09 15:01:25.458868 ip-10-0-133-239 kubenswrapper[2576]: W0609 15:01:25.455416 2576 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jun 09 15:01:25.458868 ip-10-0-133-239 kubenswrapper[2576]: W0609 15:01:25.455421 2576 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jun 09 15:01:25.458868 ip-10-0-133-239 kubenswrapper[2576]: W0609 15:01:25.455423 2576 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jun 09 15:01:25.458868 ip-10-0-133-239 kubenswrapper[2576]: W0609 15:01:25.455426 2576 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jun 09 15:01:25.458868 ip-10-0-133-239 kubenswrapper[2576]: W0609 15:01:25.455429 2576 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jun 09 15:01:25.458868 ip-10-0-133-239 kubenswrapper[2576]: W0609 15:01:25.455431 2576 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jun 09 15:01:25.458868 ip-10-0-133-239 kubenswrapper[2576]: W0609 15:01:25.455434 2576 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jun 09 15:01:25.458868 ip-10-0-133-239 kubenswrapper[2576]: W0609 15:01:25.455437 2576 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jun 09 15:01:25.459365 ip-10-0-133-239 kubenswrapper[2576]: W0609 15:01:25.455439 2576 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jun 09 15:01:25.459365 ip-10-0-133-239 kubenswrapper[2576]: W0609 15:01:25.455442 2576 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jun 09 15:01:25.459365 ip-10-0-133-239 kubenswrapper[2576]: W0609 15:01:25.455444 2576 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jun 09 15:01:25.459365 ip-10-0-133-239 kubenswrapper[2576]: W0609 15:01:25.455447 2576 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jun 09 15:01:25.459365 ip-10-0-133-239 kubenswrapper[2576]: W0609 15:01:25.455450 2576 feature_gate.go:328] unrecognized feature gate: EventTTL Jun 09 15:01:25.459365 ip-10-0-133-239 kubenswrapper[2576]: W0609 15:01:25.455452 2576 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jun 09 15:01:25.459365 ip-10-0-133-239 kubenswrapper[2576]: W0609 15:01:25.455455 2576 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jun 09 15:01:25.459365 ip-10-0-133-239 kubenswrapper[2576]: W0609 15:01:25.455457 2576 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jun 09 15:01:25.459365 ip-10-0-133-239 kubenswrapper[2576]: W0609 15:01:25.455460 2576 feature_gate.go:328] unrecognized feature gate: PinnedImages Jun 09 15:01:25.459365 ip-10-0-133-239 kubenswrapper[2576]: W0609 15:01:25.455463 2576 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jun 09 15:01:25.459365 ip-10-0-133-239 kubenswrapper[2576]: W0609 15:01:25.455465 2576 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jun 09 15:01:25.459365 ip-10-0-133-239 kubenswrapper[2576]: W0609 15:01:25.455468 2576 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jun 09 15:01:25.459365 ip-10-0-133-239 kubenswrapper[2576]: W0609 15:01:25.455470 2576 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jun 09 15:01:25.459365 ip-10-0-133-239 kubenswrapper[2576]: W0609 15:01:25.455473 2576 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jun 09 15:01:25.459365 ip-10-0-133-239 kubenswrapper[2576]: W0609 15:01:25.455475 2576 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jun 09 15:01:25.459365 ip-10-0-133-239 kubenswrapper[2576]: W0609 15:01:25.455477 2576 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jun 09 15:01:25.459365 ip-10-0-133-239 kubenswrapper[2576]: W0609 15:01:25.455480 2576 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jun 09 15:01:25.459365 ip-10-0-133-239 kubenswrapper[2576]: W0609 15:01:25.455485 2576 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jun 09 15:01:25.459365 ip-10-0-133-239 kubenswrapper[2576]: W0609 15:01:25.455489 2576 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jun 09 15:01:25.459365 ip-10-0-133-239 kubenswrapper[2576]: W0609 15:01:25.455492 2576 feature_gate.go:328] unrecognized feature gate: NewOLM Jun 09 15:01:25.459837 ip-10-0-133-239 kubenswrapper[2576]: W0609 15:01:25.455495 2576 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jun 09 15:01:25.459837 ip-10-0-133-239 kubenswrapper[2576]: W0609 15:01:25.455498 2576 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jun 09 15:01:25.459837 ip-10-0-133-239 kubenswrapper[2576]: W0609 15:01:25.455501 2576 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jun 09 15:01:25.459837 ip-10-0-133-239 kubenswrapper[2576]: W0609 15:01:25.455504 2576 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jun 09 15:01:25.459837 ip-10-0-133-239 kubenswrapper[2576]: W0609 15:01:25.455507 2576 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jun 09 15:01:25.459837 ip-10-0-133-239 kubenswrapper[2576]: W0609 15:01:25.455510 2576 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jun 09 15:01:25.459837 ip-10-0-133-239 kubenswrapper[2576]: W0609 15:01:25.455513 2576 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jun 09 15:01:25.459837 ip-10-0-133-239 kubenswrapper[2576]: W0609 15:01:25.455515 2576 feature_gate.go:328] unrecognized feature gate: OSStreams Jun 09 15:01:25.459837 ip-10-0-133-239 kubenswrapper[2576]: W0609 15:01:25.455518 2576 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jun 09 15:01:25.459837 ip-10-0-133-239 kubenswrapper[2576]: W0609 15:01:25.455521 2576 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jun 09 15:01:25.459837 ip-10-0-133-239 kubenswrapper[2576]: W0609 15:01:25.455524 2576 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jun 09 15:01:25.459837 ip-10-0-133-239 kubenswrapper[2576]: W0609 15:01:25.455528 2576 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jun 09 15:01:25.459837 ip-10-0-133-239 kubenswrapper[2576]: W0609 15:01:25.455532 2576 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jun 09 15:01:25.459837 ip-10-0-133-239 kubenswrapper[2576]: W0609 15:01:25.455535 2576 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jun 09 15:01:25.459837 ip-10-0-133-239 kubenswrapper[2576]: W0609 15:01:25.455538 2576 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jun 09 15:01:25.459837 ip-10-0-133-239 kubenswrapper[2576]: W0609 15:01:25.455540 2576 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jun 09 15:01:25.459837 ip-10-0-133-239 kubenswrapper[2576]: W0609 15:01:25.455543 2576 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jun 09 15:01:25.459837 ip-10-0-133-239 kubenswrapper[2576]: W0609 15:01:25.455546 2576 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jun 09 15:01:25.459837 ip-10-0-133-239 kubenswrapper[2576]: W0609 15:01:25.455549 2576 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jun 09 15:01:25.460350 ip-10-0-133-239 kubenswrapper[2576]: W0609 15:01:25.455552 2576 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jun 09 15:01:25.460350 ip-10-0-133-239 kubenswrapper[2576]: W0609 15:01:25.455555 2576 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jun 09 15:01:25.460350 ip-10-0-133-239 kubenswrapper[2576]: W0609 15:01:25.455558 2576 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jun 09 15:01:25.460350 ip-10-0-133-239 kubenswrapper[2576]: W0609 15:01:25.455561 2576 feature_gate.go:328] unrecognized feature gate: Example2 Jun 09 15:01:25.460350 ip-10-0-133-239 kubenswrapper[2576]: W0609 15:01:25.455564 2576 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jun 09 15:01:25.460350 ip-10-0-133-239 kubenswrapper[2576]: W0609 15:01:25.455567 2576 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jun 09 15:01:25.460350 ip-10-0-133-239 kubenswrapper[2576]: W0609 15:01:25.455570 2576 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jun 09 15:01:25.460350 ip-10-0-133-239 kubenswrapper[2576]: W0609 15:01:25.455572 2576 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jun 09 15:01:25.460350 ip-10-0-133-239 kubenswrapper[2576]: W0609 15:01:25.455575 2576 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jun 09 15:01:25.460350 ip-10-0-133-239 kubenswrapper[2576]: W0609 15:01:25.455579 2576 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jun 09 15:01:25.460350 ip-10-0-133-239 kubenswrapper[2576]: W0609 15:01:25.455582 2576 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jun 09 15:01:25.460350 ip-10-0-133-239 kubenswrapper[2576]: W0609 15:01:25.455585 2576 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jun 09 15:01:25.460350 ip-10-0-133-239 kubenswrapper[2576]: W0609 15:01:25.455587 2576 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jun 09 15:01:25.460350 ip-10-0-133-239 kubenswrapper[2576]: W0609 15:01:25.455590 2576 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jun 09 15:01:25.460350 ip-10-0-133-239 kubenswrapper[2576]: W0609 15:01:25.455593 2576 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jun 09 15:01:25.460350 ip-10-0-133-239 kubenswrapper[2576]: W0609 15:01:25.455595 2576 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jun 09 15:01:25.460350 ip-10-0-133-239 kubenswrapper[2576]: W0609 15:01:25.455599 2576 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jun 09 15:01:25.460350 ip-10-0-133-239 kubenswrapper[2576]: W0609 15:01:25.455601 2576 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jun 09 15:01:25.460350 ip-10-0-133-239 kubenswrapper[2576]: W0609 15:01:25.455604 2576 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jun 09 15:01:25.460842 ip-10-0-133-239 kubenswrapper[2576]: W0609 15:01:25.455607 2576 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jun 09 15:01:25.460842 ip-10-0-133-239 kubenswrapper[2576]: W0609 15:01:25.455610 2576 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jun 09 15:01:25.460842 ip-10-0-133-239 kubenswrapper[2576]: W0609 15:01:25.455613 2576 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jun 09 15:01:25.460842 ip-10-0-133-239 kubenswrapper[2576]: W0609 15:01:25.455616 2576 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jun 09 15:01:25.460842 ip-10-0-133-239 kubenswrapper[2576]: W0609 15:01:25.455618 2576 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jun 09 15:01:25.460842 ip-10-0-133-239 kubenswrapper[2576]: W0609 15:01:25.455621 2576 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jun 09 15:01:25.460842 ip-10-0-133-239 kubenswrapper[2576]: W0609 15:01:25.455623 2576 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jun 09 15:01:25.460842 ip-10-0-133-239 kubenswrapper[2576]: W0609 15:01:25.455626 2576 feature_gate.go:328] unrecognized feature gate: Example Jun 09 15:01:25.460842 ip-10-0-133-239 kubenswrapper[2576]: W0609 15:01:25.455629 2576 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jun 09 15:01:25.460842 ip-10-0-133-239 kubenswrapper[2576]: W0609 15:01:25.455631 2576 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jun 09 15:01:25.460842 ip-10-0-133-239 kubenswrapper[2576]: W0609 15:01:25.455634 2576 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jun 09 15:01:25.460842 ip-10-0-133-239 kubenswrapper[2576]: W0609 15:01:25.455636 2576 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jun 09 15:01:25.460842 ip-10-0-133-239 kubenswrapper[2576]: W0609 15:01:25.455639 2576 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jun 09 15:01:25.460842 ip-10-0-133-239 kubenswrapper[2576]: W0609 15:01:25.455641 2576 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jun 09 15:01:25.460842 ip-10-0-133-239 kubenswrapper[2576]: W0609 15:01:25.455644 2576 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jun 09 15:01:25.460842 ip-10-0-133-239 kubenswrapper[2576]: W0609 15:01:25.455649 2576 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jun 09 15:01:25.460842 ip-10-0-133-239 kubenswrapper[2576]: W0609 15:01:25.455651 2576 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jun 09 15:01:25.460842 ip-10-0-133-239 kubenswrapper[2576]: W0609 15:01:25.455654 2576 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jun 09 15:01:25.460842 ip-10-0-133-239 kubenswrapper[2576]: W0609 15:01:25.455656 2576 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jun 09 15:01:25.460842 ip-10-0-133-239 kubenswrapper[2576]: W0609 15:01:25.455659 2576 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jun 09 15:01:25.461343 ip-10-0-133-239 kubenswrapper[2576]: W0609 15:01:25.455661 2576 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jun 09 15:01:25.461343 ip-10-0-133-239 kubenswrapper[2576]: I0609 15:01:25.455737 2576 flags.go:64] FLAG: --address="0.0.0.0" Jun 09 15:01:25.461343 ip-10-0-133-239 kubenswrapper[2576]: I0609 15:01:25.455745 2576 flags.go:64] FLAG: --allowed-unsafe-sysctls="[]" Jun 09 15:01:25.461343 ip-10-0-133-239 kubenswrapper[2576]: I0609 15:01:25.455751 2576 flags.go:64] FLAG: --anonymous-auth="true" Jun 09 15:01:25.461343 ip-10-0-133-239 kubenswrapper[2576]: I0609 15:01:25.455756 2576 flags.go:64] FLAG: --application-metrics-count-limit="100" Jun 09 15:01:25.461343 ip-10-0-133-239 kubenswrapper[2576]: I0609 15:01:25.455760 2576 flags.go:64] FLAG: --authentication-token-webhook="false" Jun 09 15:01:25.461343 ip-10-0-133-239 kubenswrapper[2576]: I0609 15:01:25.455763 2576 flags.go:64] FLAG: --authentication-token-webhook-cache-ttl="2m0s" Jun 09 15:01:25.461343 ip-10-0-133-239 kubenswrapper[2576]: I0609 15:01:25.455767 2576 flags.go:64] FLAG: --authorization-mode="AlwaysAllow" Jun 09 15:01:25.461343 ip-10-0-133-239 kubenswrapper[2576]: I0609 15:01:25.455772 2576 flags.go:64] FLAG: --authorization-webhook-cache-authorized-ttl="5m0s" Jun 09 15:01:25.461343 ip-10-0-133-239 kubenswrapper[2576]: I0609 15:01:25.455775 2576 flags.go:64] FLAG: --authorization-webhook-cache-unauthorized-ttl="30s" Jun 09 15:01:25.461343 ip-10-0-133-239 kubenswrapper[2576]: I0609 15:01:25.455778 2576 flags.go:64] FLAG: --boot-id-file="/proc/sys/kernel/random/boot_id" Jun 09 15:01:25.461343 ip-10-0-133-239 kubenswrapper[2576]: I0609 15:01:25.455781 2576 flags.go:64] FLAG: --bootstrap-kubeconfig="/etc/kubernetes/kubeconfig" Jun 09 15:01:25.461343 ip-10-0-133-239 kubenswrapper[2576]: I0609 15:01:25.455785 2576 flags.go:64] FLAG: --cert-dir="/var/lib/kubelet/pki" Jun 09 15:01:25.461343 ip-10-0-133-239 kubenswrapper[2576]: I0609 15:01:25.455788 2576 flags.go:64] FLAG: --cgroup-driver="cgroupfs" Jun 09 15:01:25.461343 ip-10-0-133-239 kubenswrapper[2576]: I0609 15:01:25.455792 2576 flags.go:64] FLAG: --cgroup-root="" Jun 09 15:01:25.461343 ip-10-0-133-239 kubenswrapper[2576]: I0609 15:01:25.455795 2576 flags.go:64] FLAG: --cgroups-per-qos="true" Jun 09 15:01:25.461343 ip-10-0-133-239 kubenswrapper[2576]: I0609 15:01:25.455798 2576 flags.go:64] FLAG: --client-ca-file="" Jun 09 15:01:25.461343 ip-10-0-133-239 kubenswrapper[2576]: I0609 15:01:25.455801 2576 flags.go:64] FLAG: --cloud-provider="external" Jun 09 15:01:25.461343 ip-10-0-133-239 kubenswrapper[2576]: I0609 15:01:25.455804 2576 flags.go:64] FLAG: --cluster-dns="[]" Jun 09 15:01:25.461343 ip-10-0-133-239 kubenswrapper[2576]: I0609 15:01:25.455809 2576 flags.go:64] FLAG: --cluster-domain="" Jun 09 15:01:25.461343 ip-10-0-133-239 kubenswrapper[2576]: I0609 15:01:25.455812 2576 flags.go:64] FLAG: --config="/etc/kubernetes/kubelet.conf" Jun 09 15:01:25.461343 ip-10-0-133-239 kubenswrapper[2576]: I0609 15:01:25.455815 2576 flags.go:64] FLAG: --config-dir="/etc/openshift/kubelet.conf.d" Jun 09 15:01:25.461343 ip-10-0-133-239 kubenswrapper[2576]: I0609 15:01:25.455818 2576 flags.go:64] FLAG: --container-hints="/etc/cadvisor/container_hints.json" Jun 09 15:01:25.461343 ip-10-0-133-239 kubenswrapper[2576]: I0609 15:01:25.455822 2576 flags.go:64] FLAG: --container-log-max-files="5" Jun 09 15:01:25.461912 ip-10-0-133-239 kubenswrapper[2576]: I0609 15:01:25.455825 2576 flags.go:64] FLAG: --container-log-max-size="10Mi" Jun 09 15:01:25.461912 ip-10-0-133-239 kubenswrapper[2576]: I0609 15:01:25.455828 2576 flags.go:64] FLAG: --container-runtime-endpoint="/var/run/crio/crio.sock" Jun 09 15:01:25.461912 ip-10-0-133-239 kubenswrapper[2576]: I0609 15:01:25.455832 2576 flags.go:64] FLAG: --containerd="/run/containerd/containerd.sock" Jun 09 15:01:25.461912 ip-10-0-133-239 kubenswrapper[2576]: I0609 15:01:25.455837 2576 flags.go:64] FLAG: --containerd-namespace="k8s.io" Jun 09 15:01:25.461912 ip-10-0-133-239 kubenswrapper[2576]: I0609 15:01:25.455840 2576 flags.go:64] FLAG: --contention-profiling="false" Jun 09 15:01:25.461912 ip-10-0-133-239 kubenswrapper[2576]: I0609 15:01:25.455843 2576 flags.go:64] FLAG: --cpu-cfs-quota="true" Jun 09 15:01:25.461912 ip-10-0-133-239 kubenswrapper[2576]: I0609 15:01:25.455846 2576 flags.go:64] FLAG: --cpu-cfs-quota-period="100ms" Jun 09 15:01:25.461912 ip-10-0-133-239 kubenswrapper[2576]: I0609 15:01:25.455849 2576 flags.go:64] FLAG: --cpu-manager-policy="none" Jun 09 15:01:25.461912 ip-10-0-133-239 kubenswrapper[2576]: I0609 15:01:25.455852 2576 flags.go:64] FLAG: --cpu-manager-policy-options="" Jun 09 15:01:25.461912 ip-10-0-133-239 kubenswrapper[2576]: I0609 15:01:25.455856 2576 flags.go:64] FLAG: --cpu-manager-reconcile-period="10s" Jun 09 15:01:25.461912 ip-10-0-133-239 kubenswrapper[2576]: I0609 15:01:25.455861 2576 flags.go:64] FLAG: --enable-controller-attach-detach="true" Jun 09 15:01:25.461912 ip-10-0-133-239 kubenswrapper[2576]: I0609 15:01:25.455864 2576 flags.go:64] FLAG: --enable-debugging-handlers="true" Jun 09 15:01:25.461912 ip-10-0-133-239 kubenswrapper[2576]: I0609 15:01:25.455867 2576 flags.go:64] FLAG: --enable-load-reader="false" Jun 09 15:01:25.461912 ip-10-0-133-239 kubenswrapper[2576]: I0609 15:01:25.455870 2576 flags.go:64] FLAG: --enable-server="true" Jun 09 15:01:25.461912 ip-10-0-133-239 kubenswrapper[2576]: I0609 15:01:25.455873 2576 flags.go:64] FLAG: --enforce-node-allocatable="[pods]" Jun 09 15:01:25.461912 ip-10-0-133-239 kubenswrapper[2576]: I0609 15:01:25.455878 2576 flags.go:64] FLAG: --event-burst="100" Jun 09 15:01:25.461912 ip-10-0-133-239 kubenswrapper[2576]: I0609 15:01:25.455881 2576 flags.go:64] FLAG: --event-qps="50" Jun 09 15:01:25.461912 ip-10-0-133-239 kubenswrapper[2576]: I0609 15:01:25.455884 2576 flags.go:64] FLAG: --event-storage-age-limit="default=0" Jun 09 15:01:25.461912 ip-10-0-133-239 kubenswrapper[2576]: I0609 15:01:25.455887 2576 flags.go:64] FLAG: --event-storage-event-limit="default=0" Jun 09 15:01:25.461912 ip-10-0-133-239 kubenswrapper[2576]: I0609 15:01:25.455890 2576 flags.go:64] FLAG: --eviction-hard="" Jun 09 15:01:25.461912 ip-10-0-133-239 kubenswrapper[2576]: I0609 15:01:25.455894 2576 flags.go:64] FLAG: --eviction-max-pod-grace-period="0" Jun 09 15:01:25.461912 ip-10-0-133-239 kubenswrapper[2576]: I0609 15:01:25.455896 2576 flags.go:64] FLAG: --eviction-minimum-reclaim="" Jun 09 15:01:25.461912 ip-10-0-133-239 kubenswrapper[2576]: I0609 15:01:25.455899 2576 flags.go:64] FLAG: --eviction-pressure-transition-period="5m0s" Jun 09 15:01:25.461912 ip-10-0-133-239 kubenswrapper[2576]: I0609 15:01:25.455903 2576 flags.go:64] FLAG: --eviction-soft="" Jun 09 15:01:25.461912 ip-10-0-133-239 kubenswrapper[2576]: I0609 15:01:25.455906 2576 flags.go:64] FLAG: --eviction-soft-grace-period="" Jun 09 15:01:25.462603 ip-10-0-133-239 kubenswrapper[2576]: I0609 15:01:25.455909 2576 flags.go:64] FLAG: --exit-on-lock-contention="false" Jun 09 15:01:25.462603 ip-10-0-133-239 kubenswrapper[2576]: I0609 15:01:25.455911 2576 flags.go:64] FLAG: --experimental-allocatable-ignore-eviction="false" Jun 09 15:01:25.462603 ip-10-0-133-239 kubenswrapper[2576]: I0609 15:01:25.455915 2576 flags.go:64] FLAG: --experimental-mounter-path="" Jun 09 15:01:25.462603 ip-10-0-133-239 kubenswrapper[2576]: I0609 15:01:25.455917 2576 flags.go:64] FLAG: --fail-cgroupv1="false" Jun 09 15:01:25.462603 ip-10-0-133-239 kubenswrapper[2576]: I0609 15:01:25.455920 2576 flags.go:64] FLAG: --fail-swap-on="true" Jun 09 15:01:25.462603 ip-10-0-133-239 kubenswrapper[2576]: I0609 15:01:25.455923 2576 flags.go:64] FLAG: --feature-gates="" Jun 09 15:01:25.462603 ip-10-0-133-239 kubenswrapper[2576]: I0609 15:01:25.455927 2576 flags.go:64] FLAG: --file-check-frequency="20s" Jun 09 15:01:25.462603 ip-10-0-133-239 kubenswrapper[2576]: I0609 15:01:25.455930 2576 flags.go:64] FLAG: --global-housekeeping-interval="1m0s" Jun 09 15:01:25.462603 ip-10-0-133-239 kubenswrapper[2576]: I0609 15:01:25.455932 2576 flags.go:64] FLAG: --hairpin-mode="promiscuous-bridge" Jun 09 15:01:25.462603 ip-10-0-133-239 kubenswrapper[2576]: I0609 15:01:25.455935 2576 flags.go:64] FLAG: --healthz-bind-address="127.0.0.1" Jun 09 15:01:25.462603 ip-10-0-133-239 kubenswrapper[2576]: I0609 15:01:25.455939 2576 flags.go:64] FLAG: --healthz-port="10248" Jun 09 15:01:25.462603 ip-10-0-133-239 kubenswrapper[2576]: I0609 15:01:25.455943 2576 flags.go:64] FLAG: --help="false" Jun 09 15:01:25.462603 ip-10-0-133-239 kubenswrapper[2576]: I0609 15:01:25.455945 2576 flags.go:64] FLAG: --hostname-override="ip-10-0-133-239.ec2.internal" Jun 09 15:01:25.462603 ip-10-0-133-239 kubenswrapper[2576]: I0609 15:01:25.455949 2576 flags.go:64] FLAG: --housekeeping-interval="10s" Jun 09 15:01:25.462603 ip-10-0-133-239 kubenswrapper[2576]: I0609 15:01:25.455952 2576 flags.go:64] FLAG: --http-check-frequency="20s" Jun 09 15:01:25.462603 ip-10-0-133-239 kubenswrapper[2576]: I0609 15:01:25.455954 2576 flags.go:64] FLAG: --image-credential-provider-bin-dir="/usr/libexec/kubelet-image-credential-provider-plugins" Jun 09 15:01:25.462603 ip-10-0-133-239 kubenswrapper[2576]: I0609 15:01:25.455958 2576 flags.go:64] FLAG: --image-credential-provider-config="/etc/kubernetes/credential-providers/ecr-credential-provider.yaml" Jun 09 15:01:25.462603 ip-10-0-133-239 kubenswrapper[2576]: I0609 15:01:25.455962 2576 flags.go:64] FLAG: --image-gc-high-threshold="85" Jun 09 15:01:25.462603 ip-10-0-133-239 kubenswrapper[2576]: I0609 15:01:25.455965 2576 flags.go:64] FLAG: --image-gc-low-threshold="80" Jun 09 15:01:25.462603 ip-10-0-133-239 kubenswrapper[2576]: I0609 15:01:25.455968 2576 flags.go:64] FLAG: --image-service-endpoint="" Jun 09 15:01:25.462603 ip-10-0-133-239 kubenswrapper[2576]: I0609 15:01:25.455971 2576 flags.go:64] FLAG: --kernel-memcg-notification="false" Jun 09 15:01:25.462603 ip-10-0-133-239 kubenswrapper[2576]: I0609 15:01:25.455974 2576 flags.go:64] FLAG: --kube-api-burst="100" Jun 09 15:01:25.462603 ip-10-0-133-239 kubenswrapper[2576]: I0609 15:01:25.455977 2576 flags.go:64] FLAG: --kube-api-content-type="application/vnd.kubernetes.protobuf" Jun 09 15:01:25.463436 ip-10-0-133-239 kubenswrapper[2576]: I0609 15:01:25.455980 2576 flags.go:64] FLAG: --kube-api-qps="50" Jun 09 15:01:25.463436 ip-10-0-133-239 kubenswrapper[2576]: I0609 15:01:25.455983 2576 flags.go:64] FLAG: --kube-reserved="" Jun 09 15:01:25.463436 ip-10-0-133-239 kubenswrapper[2576]: I0609 15:01:25.455986 2576 flags.go:64] FLAG: --kube-reserved-cgroup="" Jun 09 15:01:25.463436 ip-10-0-133-239 kubenswrapper[2576]: I0609 15:01:25.455989 2576 flags.go:64] FLAG: --kubeconfig="/var/lib/kubelet/kubeconfig" Jun 09 15:01:25.463436 ip-10-0-133-239 kubenswrapper[2576]: I0609 15:01:25.455992 2576 flags.go:64] FLAG: --kubelet-cgroups="" Jun 09 15:01:25.463436 ip-10-0-133-239 kubenswrapper[2576]: I0609 15:01:25.455994 2576 flags.go:64] FLAG: --local-storage-capacity-isolation="true" Jun 09 15:01:25.463436 ip-10-0-133-239 kubenswrapper[2576]: I0609 15:01:25.455997 2576 flags.go:64] FLAG: --lock-file="" Jun 09 15:01:25.463436 ip-10-0-133-239 kubenswrapper[2576]: I0609 15:01:25.456000 2576 flags.go:64] FLAG: --log-cadvisor-usage="false" Jun 09 15:01:25.463436 ip-10-0-133-239 kubenswrapper[2576]: I0609 15:01:25.456003 2576 flags.go:64] FLAG: --log-flush-frequency="5s" Jun 09 15:01:25.463436 ip-10-0-133-239 kubenswrapper[2576]: I0609 15:01:25.456006 2576 flags.go:64] FLAG: --log-json-info-buffer-size="0" Jun 09 15:01:25.463436 ip-10-0-133-239 kubenswrapper[2576]: I0609 15:01:25.456011 2576 flags.go:64] FLAG: --log-json-split-stream="false" Jun 09 15:01:25.463436 ip-10-0-133-239 kubenswrapper[2576]: I0609 15:01:25.456015 2576 flags.go:64] FLAG: --log-text-info-buffer-size="0" Jun 09 15:01:25.463436 ip-10-0-133-239 kubenswrapper[2576]: I0609 15:01:25.456017 2576 flags.go:64] FLAG: --log-text-split-stream="false" Jun 09 15:01:25.463436 ip-10-0-133-239 kubenswrapper[2576]: I0609 15:01:25.456020 2576 flags.go:64] FLAG: --logging-format="text" Jun 09 15:01:25.463436 ip-10-0-133-239 kubenswrapper[2576]: I0609 15:01:25.456023 2576 flags.go:64] FLAG: --machine-id-file="/etc/machine-id,/var/lib/dbus/machine-id" Jun 09 15:01:25.463436 ip-10-0-133-239 kubenswrapper[2576]: I0609 15:01:25.456026 2576 flags.go:64] FLAG: --make-iptables-util-chains="true" Jun 09 15:01:25.463436 ip-10-0-133-239 kubenswrapper[2576]: I0609 15:01:25.456029 2576 flags.go:64] FLAG: --manifest-url="" Jun 09 15:01:25.463436 ip-10-0-133-239 kubenswrapper[2576]: I0609 15:01:25.456031 2576 flags.go:64] FLAG: --manifest-url-header="" Jun 09 15:01:25.463436 ip-10-0-133-239 kubenswrapper[2576]: I0609 15:01:25.456036 2576 flags.go:64] FLAG: --max-housekeeping-interval="15s" Jun 09 15:01:25.463436 ip-10-0-133-239 kubenswrapper[2576]: I0609 15:01:25.456040 2576 flags.go:64] FLAG: --max-open-files="1000000" Jun 09 15:01:25.463436 ip-10-0-133-239 kubenswrapper[2576]: I0609 15:01:25.456044 2576 flags.go:64] FLAG: --max-pods="110" Jun 09 15:01:25.463436 ip-10-0-133-239 kubenswrapper[2576]: I0609 15:01:25.456047 2576 flags.go:64] FLAG: --maximum-dead-containers="-1" Jun 09 15:01:25.463436 ip-10-0-133-239 kubenswrapper[2576]: I0609 15:01:25.456050 2576 flags.go:64] FLAG: --maximum-dead-containers-per-container="1" Jun 09 15:01:25.463436 ip-10-0-133-239 kubenswrapper[2576]: I0609 15:01:25.456053 2576 flags.go:64] FLAG: --memory-manager-policy="None" Jun 09 15:01:25.463436 ip-10-0-133-239 kubenswrapper[2576]: I0609 15:01:25.456056 2576 flags.go:64] FLAG: --minimum-container-ttl-duration="6m0s" Jun 09 15:01:25.464052 ip-10-0-133-239 kubenswrapper[2576]: I0609 15:01:25.456059 2576 flags.go:64] FLAG: --minimum-image-ttl-duration="2m0s" Jun 09 15:01:25.464052 ip-10-0-133-239 kubenswrapper[2576]: I0609 15:01:25.456079 2576 flags.go:64] FLAG: --node-ip="0.0.0.0" Jun 09 15:01:25.464052 ip-10-0-133-239 kubenswrapper[2576]: I0609 15:01:25.456082 2576 flags.go:64] FLAG: --node-labels="node-role.kubernetes.io/worker=,node.openshift.io/os_id=rhel" Jun 09 15:01:25.464052 ip-10-0-133-239 kubenswrapper[2576]: I0609 15:01:25.456090 2576 flags.go:64] FLAG: --node-status-max-images="50" Jun 09 15:01:25.464052 ip-10-0-133-239 kubenswrapper[2576]: I0609 15:01:25.456093 2576 flags.go:64] FLAG: --node-status-update-frequency="10s" Jun 09 15:01:25.464052 ip-10-0-133-239 kubenswrapper[2576]: I0609 15:01:25.456096 2576 flags.go:64] FLAG: --oom-score-adj="-999" Jun 09 15:01:25.464052 ip-10-0-133-239 kubenswrapper[2576]: I0609 15:01:25.456099 2576 flags.go:64] FLAG: --pod-cidr="" Jun 09 15:01:25.464052 ip-10-0-133-239 kubenswrapper[2576]: I0609 15:01:25.456102 2576 flags.go:64] FLAG: --pod-infra-container-image="quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:746976bfb3a92b93dacc79c151b98fd4c932eef19c3e2c1516b14eebcac9184d" Jun 09 15:01:25.464052 ip-10-0-133-239 kubenswrapper[2576]: I0609 15:01:25.456107 2576 flags.go:64] FLAG: --pod-manifest-path="" Jun 09 15:01:25.464052 ip-10-0-133-239 kubenswrapper[2576]: I0609 15:01:25.456110 2576 flags.go:64] FLAG: --pod-max-pids="-1" Jun 09 15:01:25.464052 ip-10-0-133-239 kubenswrapper[2576]: I0609 15:01:25.456113 2576 flags.go:64] FLAG: --pods-per-core="0" Jun 09 15:01:25.464052 ip-10-0-133-239 kubenswrapper[2576]: I0609 15:01:25.456116 2576 flags.go:64] FLAG: --port="10250" Jun 09 15:01:25.464052 ip-10-0-133-239 kubenswrapper[2576]: I0609 15:01:25.456119 2576 flags.go:64] FLAG: --protect-kernel-defaults="false" Jun 09 15:01:25.464052 ip-10-0-133-239 kubenswrapper[2576]: I0609 15:01:25.456122 2576 flags.go:64] FLAG: --provider-id="aws:///us-east-1a/i-0c343cfb309e02e34" Jun 09 15:01:25.464052 ip-10-0-133-239 kubenswrapper[2576]: I0609 15:01:25.456125 2576 flags.go:64] FLAG: --qos-reserved="" Jun 09 15:01:25.464052 ip-10-0-133-239 kubenswrapper[2576]: I0609 15:01:25.456128 2576 flags.go:64] FLAG: --read-only-port="10255" Jun 09 15:01:25.464052 ip-10-0-133-239 kubenswrapper[2576]: I0609 15:01:25.456132 2576 flags.go:64] FLAG: --register-node="true" Jun 09 15:01:25.464052 ip-10-0-133-239 kubenswrapper[2576]: I0609 15:01:25.456135 2576 flags.go:64] FLAG: --register-with-taints="" Jun 09 15:01:25.464052 ip-10-0-133-239 kubenswrapper[2576]: I0609 15:01:25.456138 2576 flags.go:64] FLAG: --registry-burst="10" Jun 09 15:01:25.464052 ip-10-0-133-239 kubenswrapper[2576]: I0609 15:01:25.456141 2576 flags.go:64] FLAG: --registry-qps="5" Jun 09 15:01:25.464052 ip-10-0-133-239 kubenswrapper[2576]: I0609 15:01:25.456144 2576 flags.go:64] FLAG: --reserved-cpus="" Jun 09 15:01:25.464052 ip-10-0-133-239 kubenswrapper[2576]: I0609 15:01:25.456147 2576 flags.go:64] FLAG: --reserved-memory="" Jun 09 15:01:25.464052 ip-10-0-133-239 kubenswrapper[2576]: I0609 15:01:25.456150 2576 flags.go:64] FLAG: --resolv-conf="/etc/resolv.conf" Jun 09 15:01:25.464052 ip-10-0-133-239 kubenswrapper[2576]: I0609 15:01:25.456153 2576 flags.go:64] FLAG: --root-dir="/var/lib/kubelet" Jun 09 15:01:25.464052 ip-10-0-133-239 kubenswrapper[2576]: I0609 15:01:25.456156 2576 flags.go:64] FLAG: --rotate-certificates="false" Jun 09 15:01:25.464682 ip-10-0-133-239 kubenswrapper[2576]: I0609 15:01:25.456159 2576 flags.go:64] FLAG: --rotate-server-certificates="false" Jun 09 15:01:25.464682 ip-10-0-133-239 kubenswrapper[2576]: I0609 15:01:25.456167 2576 flags.go:64] FLAG: --runonce="false" Jun 09 15:01:25.464682 ip-10-0-133-239 kubenswrapper[2576]: I0609 15:01:25.456170 2576 flags.go:64] FLAG: --runtime-cgroups="/system.slice/crio.service" Jun 09 15:01:25.464682 ip-10-0-133-239 kubenswrapper[2576]: I0609 15:01:25.456173 2576 flags.go:64] FLAG: --runtime-request-timeout="2m0s" Jun 09 15:01:25.464682 ip-10-0-133-239 kubenswrapper[2576]: I0609 15:01:25.456176 2576 flags.go:64] FLAG: --seccomp-default="false" Jun 09 15:01:25.464682 ip-10-0-133-239 kubenswrapper[2576]: I0609 15:01:25.456179 2576 flags.go:64] FLAG: --serialize-image-pulls="true" Jun 09 15:01:25.464682 ip-10-0-133-239 kubenswrapper[2576]: I0609 15:01:25.456182 2576 flags.go:64] FLAG: --storage-driver-buffer-duration="1m0s" Jun 09 15:01:25.464682 ip-10-0-133-239 kubenswrapper[2576]: I0609 15:01:25.456185 2576 flags.go:64] FLAG: --storage-driver-db="cadvisor" Jun 09 15:01:25.464682 ip-10-0-133-239 kubenswrapper[2576]: I0609 15:01:25.456188 2576 flags.go:64] FLAG: --storage-driver-host="localhost:8086" Jun 09 15:01:25.464682 ip-10-0-133-239 kubenswrapper[2576]: I0609 15:01:25.456193 2576 flags.go:64] FLAG: --storage-driver-password="root" Jun 09 15:01:25.464682 ip-10-0-133-239 kubenswrapper[2576]: I0609 15:01:25.456196 2576 flags.go:64] FLAG: --storage-driver-secure="false" Jun 09 15:01:25.464682 ip-10-0-133-239 kubenswrapper[2576]: I0609 15:01:25.456199 2576 flags.go:64] FLAG: --storage-driver-table="stats" Jun 09 15:01:25.464682 ip-10-0-133-239 kubenswrapper[2576]: I0609 15:01:25.456202 2576 flags.go:64] FLAG: --storage-driver-user="root" Jun 09 15:01:25.464682 ip-10-0-133-239 kubenswrapper[2576]: I0609 15:01:25.456204 2576 flags.go:64] FLAG: --streaming-connection-idle-timeout="4h0m0s" Jun 09 15:01:25.464682 ip-10-0-133-239 kubenswrapper[2576]: I0609 15:01:25.456207 2576 flags.go:64] FLAG: --sync-frequency="1m0s" Jun 09 15:01:25.464682 ip-10-0-133-239 kubenswrapper[2576]: I0609 15:01:25.456210 2576 flags.go:64] FLAG: --system-cgroups="" Jun 09 15:01:25.464682 ip-10-0-133-239 kubenswrapper[2576]: I0609 15:01:25.456213 2576 flags.go:64] FLAG: --system-reserved="cpu=500m,ephemeral-storage=1Gi,memory=1Gi" Jun 09 15:01:25.464682 ip-10-0-133-239 kubenswrapper[2576]: I0609 15:01:25.456219 2576 flags.go:64] FLAG: --system-reserved-cgroup="" Jun 09 15:01:25.464682 ip-10-0-133-239 kubenswrapper[2576]: I0609 15:01:25.456221 2576 flags.go:64] FLAG: --tls-cert-file="" Jun 09 15:01:25.464682 ip-10-0-133-239 kubenswrapper[2576]: I0609 15:01:25.456224 2576 flags.go:64] FLAG: --tls-cipher-suites="[]" Jun 09 15:01:25.464682 ip-10-0-133-239 kubenswrapper[2576]: I0609 15:01:25.456229 2576 flags.go:64] FLAG: --tls-min-version="" Jun 09 15:01:25.464682 ip-10-0-133-239 kubenswrapper[2576]: I0609 15:01:25.456233 2576 flags.go:64] FLAG: --tls-private-key-file="" Jun 09 15:01:25.464682 ip-10-0-133-239 kubenswrapper[2576]: I0609 15:01:25.456235 2576 flags.go:64] FLAG: --topology-manager-policy="none" Jun 09 15:01:25.464682 ip-10-0-133-239 kubenswrapper[2576]: I0609 15:01:25.456238 2576 flags.go:64] FLAG: --topology-manager-policy-options="" Jun 09 15:01:25.464682 ip-10-0-133-239 kubenswrapper[2576]: I0609 15:01:25.456242 2576 flags.go:64] FLAG: --topology-manager-scope="container" Jun 09 15:01:25.465316 ip-10-0-133-239 kubenswrapper[2576]: I0609 15:01:25.456245 2576 flags.go:64] FLAG: --v="2" Jun 09 15:01:25.465316 ip-10-0-133-239 kubenswrapper[2576]: I0609 15:01:25.456249 2576 flags.go:64] FLAG: --version="false" Jun 09 15:01:25.465316 ip-10-0-133-239 kubenswrapper[2576]: I0609 15:01:25.456253 2576 flags.go:64] FLAG: --vmodule="" Jun 09 15:01:25.465316 ip-10-0-133-239 kubenswrapper[2576]: I0609 15:01:25.456257 2576 flags.go:64] FLAG: --volume-plugin-dir="/etc/kubernetes/kubelet-plugins/volume/exec" Jun 09 15:01:25.465316 ip-10-0-133-239 kubenswrapper[2576]: I0609 15:01:25.456260 2576 flags.go:64] FLAG: --volume-stats-agg-period="1m0s" Jun 09 15:01:25.465316 ip-10-0-133-239 kubenswrapper[2576]: W0609 15:01:25.456413 2576 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jun 09 15:01:25.465316 ip-10-0-133-239 kubenswrapper[2576]: W0609 15:01:25.456418 2576 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jun 09 15:01:25.465316 ip-10-0-133-239 kubenswrapper[2576]: W0609 15:01:25.456421 2576 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jun 09 15:01:25.465316 ip-10-0-133-239 kubenswrapper[2576]: W0609 15:01:25.456425 2576 feature_gate.go:328] unrecognized feature gate: DualReplica Jun 09 15:01:25.465316 ip-10-0-133-239 kubenswrapper[2576]: W0609 15:01:25.456428 2576 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jun 09 15:01:25.465316 ip-10-0-133-239 kubenswrapper[2576]: W0609 15:01:25.456430 2576 feature_gate.go:328] unrecognized feature gate: EventTTL Jun 09 15:01:25.465316 ip-10-0-133-239 kubenswrapper[2576]: W0609 15:01:25.456433 2576 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jun 09 15:01:25.465316 ip-10-0-133-239 kubenswrapper[2576]: W0609 15:01:25.456436 2576 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jun 09 15:01:25.465316 ip-10-0-133-239 kubenswrapper[2576]: W0609 15:01:25.456439 2576 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jun 09 15:01:25.465316 ip-10-0-133-239 kubenswrapper[2576]: W0609 15:01:25.456442 2576 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jun 09 15:01:25.465316 ip-10-0-133-239 kubenswrapper[2576]: W0609 15:01:25.456444 2576 feature_gate.go:328] unrecognized feature gate: SignatureStores Jun 09 15:01:25.465316 ip-10-0-133-239 kubenswrapper[2576]: W0609 15:01:25.456448 2576 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jun 09 15:01:25.465316 ip-10-0-133-239 kubenswrapper[2576]: W0609 15:01:25.456451 2576 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jun 09 15:01:25.465316 ip-10-0-133-239 kubenswrapper[2576]: W0609 15:01:25.456454 2576 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jun 09 15:01:25.465316 ip-10-0-133-239 kubenswrapper[2576]: W0609 15:01:25.456457 2576 feature_gate.go:328] unrecognized feature gate: OSStreams Jun 09 15:01:25.465316 ip-10-0-133-239 kubenswrapper[2576]: W0609 15:01:25.456459 2576 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jun 09 15:01:25.465834 ip-10-0-133-239 kubenswrapper[2576]: W0609 15:01:25.456462 2576 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jun 09 15:01:25.465834 ip-10-0-133-239 kubenswrapper[2576]: W0609 15:01:25.456464 2576 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jun 09 15:01:25.465834 ip-10-0-133-239 kubenswrapper[2576]: W0609 15:01:25.456467 2576 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jun 09 15:01:25.465834 ip-10-0-133-239 kubenswrapper[2576]: W0609 15:01:25.456471 2576 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jun 09 15:01:25.465834 ip-10-0-133-239 kubenswrapper[2576]: W0609 15:01:25.456475 2576 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jun 09 15:01:25.465834 ip-10-0-133-239 kubenswrapper[2576]: W0609 15:01:25.456477 2576 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jun 09 15:01:25.465834 ip-10-0-133-239 kubenswrapper[2576]: W0609 15:01:25.456480 2576 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jun 09 15:01:25.465834 ip-10-0-133-239 kubenswrapper[2576]: W0609 15:01:25.456483 2576 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jun 09 15:01:25.465834 ip-10-0-133-239 kubenswrapper[2576]: W0609 15:01:25.456485 2576 feature_gate.go:328] unrecognized feature gate: OVNObservability Jun 09 15:01:25.465834 ip-10-0-133-239 kubenswrapper[2576]: W0609 15:01:25.456488 2576 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jun 09 15:01:25.465834 ip-10-0-133-239 kubenswrapper[2576]: W0609 15:01:25.456491 2576 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jun 09 15:01:25.465834 ip-10-0-133-239 kubenswrapper[2576]: W0609 15:01:25.456494 2576 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jun 09 15:01:25.465834 ip-10-0-133-239 kubenswrapper[2576]: W0609 15:01:25.456496 2576 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jun 09 15:01:25.465834 ip-10-0-133-239 kubenswrapper[2576]: W0609 15:01:25.456499 2576 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jun 09 15:01:25.465834 ip-10-0-133-239 kubenswrapper[2576]: W0609 15:01:25.456502 2576 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jun 09 15:01:25.465834 ip-10-0-133-239 kubenswrapper[2576]: W0609 15:01:25.456505 2576 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jun 09 15:01:25.465834 ip-10-0-133-239 kubenswrapper[2576]: W0609 15:01:25.456507 2576 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jun 09 15:01:25.465834 ip-10-0-133-239 kubenswrapper[2576]: W0609 15:01:25.456510 2576 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jun 09 15:01:25.465834 ip-10-0-133-239 kubenswrapper[2576]: W0609 15:01:25.456512 2576 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jun 09 15:01:25.466309 ip-10-0-133-239 kubenswrapper[2576]: W0609 15:01:25.456516 2576 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jun 09 15:01:25.466309 ip-10-0-133-239 kubenswrapper[2576]: W0609 15:01:25.456518 2576 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jun 09 15:01:25.466309 ip-10-0-133-239 kubenswrapper[2576]: W0609 15:01:25.456521 2576 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jun 09 15:01:25.466309 ip-10-0-133-239 kubenswrapper[2576]: W0609 15:01:25.456523 2576 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jun 09 15:01:25.466309 ip-10-0-133-239 kubenswrapper[2576]: W0609 15:01:25.456526 2576 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jun 09 15:01:25.466309 ip-10-0-133-239 kubenswrapper[2576]: W0609 15:01:25.456528 2576 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jun 09 15:01:25.466309 ip-10-0-133-239 kubenswrapper[2576]: W0609 15:01:25.456531 2576 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jun 09 15:01:25.466309 ip-10-0-133-239 kubenswrapper[2576]: W0609 15:01:25.456533 2576 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jun 09 15:01:25.466309 ip-10-0-133-239 kubenswrapper[2576]: W0609 15:01:25.456537 2576 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jun 09 15:01:25.466309 ip-10-0-133-239 kubenswrapper[2576]: W0609 15:01:25.456540 2576 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jun 09 15:01:25.466309 ip-10-0-133-239 kubenswrapper[2576]: W0609 15:01:25.456543 2576 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jun 09 15:01:25.466309 ip-10-0-133-239 kubenswrapper[2576]: W0609 15:01:25.456546 2576 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jun 09 15:01:25.466309 ip-10-0-133-239 kubenswrapper[2576]: W0609 15:01:25.456548 2576 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jun 09 15:01:25.466309 ip-10-0-133-239 kubenswrapper[2576]: W0609 15:01:25.456551 2576 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jun 09 15:01:25.466309 ip-10-0-133-239 kubenswrapper[2576]: W0609 15:01:25.456553 2576 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jun 09 15:01:25.466309 ip-10-0-133-239 kubenswrapper[2576]: W0609 15:01:25.456556 2576 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jun 09 15:01:25.466309 ip-10-0-133-239 kubenswrapper[2576]: W0609 15:01:25.456559 2576 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jun 09 15:01:25.466309 ip-10-0-133-239 kubenswrapper[2576]: W0609 15:01:25.456561 2576 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jun 09 15:01:25.466309 ip-10-0-133-239 kubenswrapper[2576]: W0609 15:01:25.456564 2576 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jun 09 15:01:25.466309 ip-10-0-133-239 kubenswrapper[2576]: W0609 15:01:25.456566 2576 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jun 09 15:01:25.466801 ip-10-0-133-239 kubenswrapper[2576]: W0609 15:01:25.456569 2576 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jun 09 15:01:25.466801 ip-10-0-133-239 kubenswrapper[2576]: W0609 15:01:25.456571 2576 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jun 09 15:01:25.466801 ip-10-0-133-239 kubenswrapper[2576]: W0609 15:01:25.456574 2576 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jun 09 15:01:25.466801 ip-10-0-133-239 kubenswrapper[2576]: W0609 15:01:25.456576 2576 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jun 09 15:01:25.466801 ip-10-0-133-239 kubenswrapper[2576]: W0609 15:01:25.456579 2576 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jun 09 15:01:25.466801 ip-10-0-133-239 kubenswrapper[2576]: W0609 15:01:25.456583 2576 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jun 09 15:01:25.466801 ip-10-0-133-239 kubenswrapper[2576]: W0609 15:01:25.456587 2576 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jun 09 15:01:25.466801 ip-10-0-133-239 kubenswrapper[2576]: W0609 15:01:25.456590 2576 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jun 09 15:01:25.466801 ip-10-0-133-239 kubenswrapper[2576]: W0609 15:01:25.456593 2576 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jun 09 15:01:25.466801 ip-10-0-133-239 kubenswrapper[2576]: W0609 15:01:25.456596 2576 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jun 09 15:01:25.466801 ip-10-0-133-239 kubenswrapper[2576]: W0609 15:01:25.456599 2576 feature_gate.go:328] unrecognized feature gate: Example Jun 09 15:01:25.466801 ip-10-0-133-239 kubenswrapper[2576]: W0609 15:01:25.456601 2576 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jun 09 15:01:25.466801 ip-10-0-133-239 kubenswrapper[2576]: W0609 15:01:25.456605 2576 feature_gate.go:328] unrecognized feature gate: NewOLM Jun 09 15:01:25.466801 ip-10-0-133-239 kubenswrapper[2576]: W0609 15:01:25.456607 2576 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jun 09 15:01:25.466801 ip-10-0-133-239 kubenswrapper[2576]: W0609 15:01:25.456610 2576 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jun 09 15:01:25.466801 ip-10-0-133-239 kubenswrapper[2576]: W0609 15:01:25.456613 2576 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jun 09 15:01:25.466801 ip-10-0-133-239 kubenswrapper[2576]: W0609 15:01:25.456615 2576 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jun 09 15:01:25.466801 ip-10-0-133-239 kubenswrapper[2576]: W0609 15:01:25.456618 2576 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jun 09 15:01:25.466801 ip-10-0-133-239 kubenswrapper[2576]: W0609 15:01:25.456620 2576 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jun 09 15:01:25.466801 ip-10-0-133-239 kubenswrapper[2576]: W0609 15:01:25.456623 2576 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jun 09 15:01:25.467312 ip-10-0-133-239 kubenswrapper[2576]: W0609 15:01:25.456627 2576 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jun 09 15:01:25.467312 ip-10-0-133-239 kubenswrapper[2576]: W0609 15:01:25.456630 2576 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jun 09 15:01:25.467312 ip-10-0-133-239 kubenswrapper[2576]: W0609 15:01:25.456632 2576 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jun 09 15:01:25.467312 ip-10-0-133-239 kubenswrapper[2576]: W0609 15:01:25.456635 2576 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jun 09 15:01:25.467312 ip-10-0-133-239 kubenswrapper[2576]: W0609 15:01:25.456637 2576 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jun 09 15:01:25.467312 ip-10-0-133-239 kubenswrapper[2576]: W0609 15:01:25.456640 2576 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jun 09 15:01:25.467312 ip-10-0-133-239 kubenswrapper[2576]: W0609 15:01:25.456642 2576 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jun 09 15:01:25.467312 ip-10-0-133-239 kubenswrapper[2576]: W0609 15:01:25.456645 2576 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jun 09 15:01:25.467312 ip-10-0-133-239 kubenswrapper[2576]: W0609 15:01:25.456647 2576 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jun 09 15:01:25.467312 ip-10-0-133-239 kubenswrapper[2576]: W0609 15:01:25.456650 2576 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jun 09 15:01:25.467312 ip-10-0-133-239 kubenswrapper[2576]: W0609 15:01:25.456652 2576 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jun 09 15:01:25.467312 ip-10-0-133-239 kubenswrapper[2576]: W0609 15:01:25.456655 2576 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jun 09 15:01:25.467312 ip-10-0-133-239 kubenswrapper[2576]: W0609 15:01:25.456657 2576 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jun 09 15:01:25.467312 ip-10-0-133-239 kubenswrapper[2576]: W0609 15:01:25.456660 2576 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jun 09 15:01:25.467312 ip-10-0-133-239 kubenswrapper[2576]: W0609 15:01:25.456663 2576 feature_gate.go:328] unrecognized feature gate: PinnedImages Jun 09 15:01:25.467312 ip-10-0-133-239 kubenswrapper[2576]: W0609 15:01:25.456666 2576 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jun 09 15:01:25.467312 ip-10-0-133-239 kubenswrapper[2576]: W0609 15:01:25.456669 2576 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jun 09 15:01:25.467312 ip-10-0-133-239 kubenswrapper[2576]: W0609 15:01:25.456671 2576 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jun 09 15:01:25.467312 ip-10-0-133-239 kubenswrapper[2576]: W0609 15:01:25.456674 2576 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jun 09 15:01:25.467312 ip-10-0-133-239 kubenswrapper[2576]: W0609 15:01:25.456677 2576 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jun 09 15:01:25.467795 ip-10-0-133-239 kubenswrapper[2576]: W0609 15:01:25.456681 2576 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jun 09 15:01:25.467795 ip-10-0-133-239 kubenswrapper[2576]: W0609 15:01:25.456684 2576 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jun 09 15:01:25.467795 ip-10-0-133-239 kubenswrapper[2576]: W0609 15:01:25.456687 2576 feature_gate.go:328] unrecognized feature gate: Example2 Jun 09 15:01:25.467795 ip-10-0-133-239 kubenswrapper[2576]: W0609 15:01:25.456690 2576 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jun 09 15:01:25.467795 ip-10-0-133-239 kubenswrapper[2576]: I0609 15:01:25.457228 2576 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]} Jun 09 15:01:25.467795 ip-10-0-133-239 kubenswrapper[2576]: I0609 15:01:25.465926 2576 server.go:529] "Kubelet version" kubeletVersion="v1.34.8" Jun 09 15:01:25.467795 ip-10-0-133-239 kubenswrapper[2576]: I0609 15:01:25.465943 2576 server.go:531] "Golang settings" GOGC="" GOMAXPROCS="" GOTRACEBACK="" Jun 09 15:01:25.467795 ip-10-0-133-239 kubenswrapper[2576]: I0609 15:01:25.465959 2576 watchdog_linux.go:95] "Systemd watchdog is not enabled" Jun 09 15:01:25.467795 ip-10-0-133-239 kubenswrapper[2576]: I0609 15:01:25.465965 2576 watchdog_linux.go:137] "Systemd watchdog is not enabled or the interval is invalid, so health checking will not be started." Jun 09 15:01:25.467795 ip-10-0-133-239 kubenswrapper[2576]: W0609 15:01:25.466102 2576 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jun 09 15:01:25.467795 ip-10-0-133-239 kubenswrapper[2576]: W0609 15:01:25.466107 2576 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jun 09 15:01:25.467795 ip-10-0-133-239 kubenswrapper[2576]: W0609 15:01:25.466111 2576 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jun 09 15:01:25.467795 ip-10-0-133-239 kubenswrapper[2576]: W0609 15:01:25.466114 2576 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jun 09 15:01:25.467795 ip-10-0-133-239 kubenswrapper[2576]: W0609 15:01:25.466124 2576 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jun 09 15:01:25.468204 ip-10-0-133-239 kubenswrapper[2576]: W0609 15:01:25.466127 2576 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jun 09 15:01:25.468204 ip-10-0-133-239 kubenswrapper[2576]: W0609 15:01:25.466130 2576 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jun 09 15:01:25.468204 ip-10-0-133-239 kubenswrapper[2576]: W0609 15:01:25.466133 2576 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jun 09 15:01:25.468204 ip-10-0-133-239 kubenswrapper[2576]: W0609 15:01:25.466136 2576 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jun 09 15:01:25.468204 ip-10-0-133-239 kubenswrapper[2576]: W0609 15:01:25.466139 2576 feature_gate.go:328] unrecognized feature gate: OSStreams Jun 09 15:01:25.468204 ip-10-0-133-239 kubenswrapper[2576]: W0609 15:01:25.466141 2576 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jun 09 15:01:25.468204 ip-10-0-133-239 kubenswrapper[2576]: W0609 15:01:25.466147 2576 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jun 09 15:01:25.468204 ip-10-0-133-239 kubenswrapper[2576]: W0609 15:01:25.466150 2576 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jun 09 15:01:25.468204 ip-10-0-133-239 kubenswrapper[2576]: W0609 15:01:25.466153 2576 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jun 09 15:01:25.468204 ip-10-0-133-239 kubenswrapper[2576]: W0609 15:01:25.466156 2576 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jun 09 15:01:25.468204 ip-10-0-133-239 kubenswrapper[2576]: W0609 15:01:25.466159 2576 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jun 09 15:01:25.468204 ip-10-0-133-239 kubenswrapper[2576]: W0609 15:01:25.466162 2576 feature_gate.go:328] unrecognized feature gate: SignatureStores Jun 09 15:01:25.468204 ip-10-0-133-239 kubenswrapper[2576]: W0609 15:01:25.466164 2576 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jun 09 15:01:25.468204 ip-10-0-133-239 kubenswrapper[2576]: W0609 15:01:25.466168 2576 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jun 09 15:01:25.468204 ip-10-0-133-239 kubenswrapper[2576]: W0609 15:01:25.466170 2576 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jun 09 15:01:25.468204 ip-10-0-133-239 kubenswrapper[2576]: W0609 15:01:25.466173 2576 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jun 09 15:01:25.468204 ip-10-0-133-239 kubenswrapper[2576]: W0609 15:01:25.466182 2576 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jun 09 15:01:25.468204 ip-10-0-133-239 kubenswrapper[2576]: W0609 15:01:25.466185 2576 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jun 09 15:01:25.468204 ip-10-0-133-239 kubenswrapper[2576]: W0609 15:01:25.466190 2576 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jun 09 15:01:25.468204 ip-10-0-133-239 kubenswrapper[2576]: W0609 15:01:25.466193 2576 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jun 09 15:01:25.468691 ip-10-0-133-239 kubenswrapper[2576]: W0609 15:01:25.466196 2576 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jun 09 15:01:25.468691 ip-10-0-133-239 kubenswrapper[2576]: W0609 15:01:25.466198 2576 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jun 09 15:01:25.468691 ip-10-0-133-239 kubenswrapper[2576]: W0609 15:01:25.466201 2576 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jun 09 15:01:25.468691 ip-10-0-133-239 kubenswrapper[2576]: W0609 15:01:25.466204 2576 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jun 09 15:01:25.468691 ip-10-0-133-239 kubenswrapper[2576]: W0609 15:01:25.466207 2576 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jun 09 15:01:25.468691 ip-10-0-133-239 kubenswrapper[2576]: W0609 15:01:25.466210 2576 feature_gate.go:328] unrecognized feature gate: EventTTL Jun 09 15:01:25.468691 ip-10-0-133-239 kubenswrapper[2576]: W0609 15:01:25.466213 2576 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jun 09 15:01:25.468691 ip-10-0-133-239 kubenswrapper[2576]: W0609 15:01:25.466216 2576 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jun 09 15:01:25.468691 ip-10-0-133-239 kubenswrapper[2576]: W0609 15:01:25.466218 2576 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jun 09 15:01:25.468691 ip-10-0-133-239 kubenswrapper[2576]: W0609 15:01:25.466221 2576 feature_gate.go:328] unrecognized feature gate: PinnedImages Jun 09 15:01:25.468691 ip-10-0-133-239 kubenswrapper[2576]: W0609 15:01:25.466224 2576 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jun 09 15:01:25.468691 ip-10-0-133-239 kubenswrapper[2576]: W0609 15:01:25.466230 2576 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jun 09 15:01:25.468691 ip-10-0-133-239 kubenswrapper[2576]: W0609 15:01:25.466232 2576 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jun 09 15:01:25.468691 ip-10-0-133-239 kubenswrapper[2576]: W0609 15:01:25.466235 2576 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jun 09 15:01:25.468691 ip-10-0-133-239 kubenswrapper[2576]: W0609 15:01:25.466237 2576 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jun 09 15:01:25.468691 ip-10-0-133-239 kubenswrapper[2576]: W0609 15:01:25.466240 2576 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jun 09 15:01:25.468691 ip-10-0-133-239 kubenswrapper[2576]: W0609 15:01:25.466243 2576 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jun 09 15:01:25.468691 ip-10-0-133-239 kubenswrapper[2576]: W0609 15:01:25.466246 2576 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jun 09 15:01:25.468691 ip-10-0-133-239 kubenswrapper[2576]: W0609 15:01:25.466249 2576 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jun 09 15:01:25.468691 ip-10-0-133-239 kubenswrapper[2576]: W0609 15:01:25.466251 2576 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jun 09 15:01:25.469253 ip-10-0-133-239 kubenswrapper[2576]: W0609 15:01:25.466254 2576 feature_gate.go:328] unrecognized feature gate: Example Jun 09 15:01:25.469253 ip-10-0-133-239 kubenswrapper[2576]: W0609 15:01:25.466257 2576 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jun 09 15:01:25.469253 ip-10-0-133-239 kubenswrapper[2576]: W0609 15:01:25.466260 2576 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jun 09 15:01:25.469253 ip-10-0-133-239 kubenswrapper[2576]: W0609 15:01:25.466265 2576 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jun 09 15:01:25.469253 ip-10-0-133-239 kubenswrapper[2576]: W0609 15:01:25.466267 2576 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jun 09 15:01:25.469253 ip-10-0-133-239 kubenswrapper[2576]: W0609 15:01:25.466270 2576 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jun 09 15:01:25.469253 ip-10-0-133-239 kubenswrapper[2576]: W0609 15:01:25.466273 2576 feature_gate.go:328] unrecognized feature gate: Example2 Jun 09 15:01:25.469253 ip-10-0-133-239 kubenswrapper[2576]: W0609 15:01:25.466276 2576 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jun 09 15:01:25.469253 ip-10-0-133-239 kubenswrapper[2576]: W0609 15:01:25.466278 2576 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jun 09 15:01:25.469253 ip-10-0-133-239 kubenswrapper[2576]: W0609 15:01:25.466287 2576 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jun 09 15:01:25.469253 ip-10-0-133-239 kubenswrapper[2576]: W0609 15:01:25.466289 2576 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jun 09 15:01:25.469253 ip-10-0-133-239 kubenswrapper[2576]: W0609 15:01:25.466292 2576 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jun 09 15:01:25.469253 ip-10-0-133-239 kubenswrapper[2576]: W0609 15:01:25.466295 2576 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jun 09 15:01:25.469253 ip-10-0-133-239 kubenswrapper[2576]: W0609 15:01:25.466297 2576 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jun 09 15:01:25.469253 ip-10-0-133-239 kubenswrapper[2576]: W0609 15:01:25.466300 2576 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jun 09 15:01:25.469253 ip-10-0-133-239 kubenswrapper[2576]: W0609 15:01:25.466303 2576 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jun 09 15:01:25.469253 ip-10-0-133-239 kubenswrapper[2576]: W0609 15:01:25.466309 2576 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jun 09 15:01:25.469253 ip-10-0-133-239 kubenswrapper[2576]: W0609 15:01:25.466312 2576 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jun 09 15:01:25.469253 ip-10-0-133-239 kubenswrapper[2576]: W0609 15:01:25.466315 2576 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jun 09 15:01:25.469253 ip-10-0-133-239 kubenswrapper[2576]: W0609 15:01:25.466318 2576 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jun 09 15:01:25.469752 ip-10-0-133-239 kubenswrapper[2576]: W0609 15:01:25.466322 2576 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jun 09 15:01:25.469752 ip-10-0-133-239 kubenswrapper[2576]: W0609 15:01:25.466326 2576 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jun 09 15:01:25.469752 ip-10-0-133-239 kubenswrapper[2576]: W0609 15:01:25.466329 2576 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jun 09 15:01:25.469752 ip-10-0-133-239 kubenswrapper[2576]: W0609 15:01:25.466332 2576 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jun 09 15:01:25.469752 ip-10-0-133-239 kubenswrapper[2576]: W0609 15:01:25.466335 2576 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jun 09 15:01:25.469752 ip-10-0-133-239 kubenswrapper[2576]: W0609 15:01:25.466338 2576 feature_gate.go:328] unrecognized feature gate: DualReplica Jun 09 15:01:25.469752 ip-10-0-133-239 kubenswrapper[2576]: W0609 15:01:25.466340 2576 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jun 09 15:01:25.469752 ip-10-0-133-239 kubenswrapper[2576]: W0609 15:01:25.466343 2576 feature_gate.go:328] unrecognized feature gate: OVNObservability Jun 09 15:01:25.469752 ip-10-0-133-239 kubenswrapper[2576]: W0609 15:01:25.466349 2576 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jun 09 15:01:25.469752 ip-10-0-133-239 kubenswrapper[2576]: W0609 15:01:25.466351 2576 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jun 09 15:01:25.469752 ip-10-0-133-239 kubenswrapper[2576]: W0609 15:01:25.466354 2576 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jun 09 15:01:25.469752 ip-10-0-133-239 kubenswrapper[2576]: W0609 15:01:25.466356 2576 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jun 09 15:01:25.469752 ip-10-0-133-239 kubenswrapper[2576]: W0609 15:01:25.466359 2576 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jun 09 15:01:25.469752 ip-10-0-133-239 kubenswrapper[2576]: W0609 15:01:25.466362 2576 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jun 09 15:01:25.469752 ip-10-0-133-239 kubenswrapper[2576]: W0609 15:01:25.466365 2576 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jun 09 15:01:25.469752 ip-10-0-133-239 kubenswrapper[2576]: W0609 15:01:25.466367 2576 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jun 09 15:01:25.469752 ip-10-0-133-239 kubenswrapper[2576]: W0609 15:01:25.466370 2576 feature_gate.go:328] unrecognized feature gate: NewOLM Jun 09 15:01:25.469752 ip-10-0-133-239 kubenswrapper[2576]: W0609 15:01:25.466374 2576 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jun 09 15:01:25.469752 ip-10-0-133-239 kubenswrapper[2576]: W0609 15:01:25.466378 2576 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jun 09 15:01:25.470392 ip-10-0-133-239 kubenswrapper[2576]: W0609 15:01:25.466382 2576 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jun 09 15:01:25.470392 ip-10-0-133-239 kubenswrapper[2576]: W0609 15:01:25.466388 2576 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jun 09 15:01:25.470392 ip-10-0-133-239 kubenswrapper[2576]: W0609 15:01:25.466391 2576 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jun 09 15:01:25.470392 ip-10-0-133-239 kubenswrapper[2576]: W0609 15:01:25.466399 2576 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jun 09 15:01:25.470392 ip-10-0-133-239 kubenswrapper[2576]: W0609 15:01:25.466403 2576 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jun 09 15:01:25.470392 ip-10-0-133-239 kubenswrapper[2576]: W0609 15:01:25.466406 2576 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jun 09 15:01:25.470392 ip-10-0-133-239 kubenswrapper[2576]: W0609 15:01:25.466409 2576 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jun 09 15:01:25.470392 ip-10-0-133-239 kubenswrapper[2576]: W0609 15:01:25.466412 2576 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jun 09 15:01:25.470392 ip-10-0-133-239 kubenswrapper[2576]: W0609 15:01:25.466415 2576 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jun 09 15:01:25.470392 ip-10-0-133-239 kubenswrapper[2576]: W0609 15:01:25.466418 2576 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jun 09 15:01:25.470392 ip-10-0-133-239 kubenswrapper[2576]: W0609 15:01:25.466421 2576 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jun 09 15:01:25.470392 ip-10-0-133-239 kubenswrapper[2576]: W0609 15:01:25.466425 2576 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jun 09 15:01:25.470392 ip-10-0-133-239 kubenswrapper[2576]: W0609 15:01:25.466429 2576 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jun 09 15:01:25.470392 ip-10-0-133-239 kubenswrapper[2576]: W0609 15:01:25.466432 2576 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jun 09 15:01:25.470392 ip-10-0-133-239 kubenswrapper[2576]: W0609 15:01:25.466437 2576 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jun 09 15:01:25.470782 ip-10-0-133-239 kubenswrapper[2576]: I0609 15:01:25.466442 2576 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]} Jun 09 15:01:25.470782 ip-10-0-133-239 kubenswrapper[2576]: W0609 15:01:25.466711 2576 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jun 09 15:01:25.470782 ip-10-0-133-239 kubenswrapper[2576]: W0609 15:01:25.466716 2576 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jun 09 15:01:25.470782 ip-10-0-133-239 kubenswrapper[2576]: W0609 15:01:25.466719 2576 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jun 09 15:01:25.470782 ip-10-0-133-239 kubenswrapper[2576]: W0609 15:01:25.466722 2576 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jun 09 15:01:25.470782 ip-10-0-133-239 kubenswrapper[2576]: W0609 15:01:25.466725 2576 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jun 09 15:01:25.470782 ip-10-0-133-239 kubenswrapper[2576]: W0609 15:01:25.466728 2576 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jun 09 15:01:25.470782 ip-10-0-133-239 kubenswrapper[2576]: W0609 15:01:25.466731 2576 feature_gate.go:328] unrecognized feature gate: SignatureStores Jun 09 15:01:25.470782 ip-10-0-133-239 kubenswrapper[2576]: W0609 15:01:25.466734 2576 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jun 09 15:01:25.470782 ip-10-0-133-239 kubenswrapper[2576]: W0609 15:01:25.466740 2576 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jun 09 15:01:25.470782 ip-10-0-133-239 kubenswrapper[2576]: W0609 15:01:25.466743 2576 feature_gate.go:328] unrecognized feature gate: NewOLM Jun 09 15:01:25.470782 ip-10-0-133-239 kubenswrapper[2576]: W0609 15:01:25.466745 2576 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jun 09 15:01:25.470782 ip-10-0-133-239 kubenswrapper[2576]: W0609 15:01:25.466748 2576 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jun 09 15:01:25.470782 ip-10-0-133-239 kubenswrapper[2576]: W0609 15:01:25.466751 2576 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jun 09 15:01:25.470782 ip-10-0-133-239 kubenswrapper[2576]: W0609 15:01:25.466753 2576 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jun 09 15:01:25.471175 ip-10-0-133-239 kubenswrapper[2576]: W0609 15:01:25.466756 2576 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jun 09 15:01:25.471175 ip-10-0-133-239 kubenswrapper[2576]: W0609 15:01:25.466759 2576 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jun 09 15:01:25.471175 ip-10-0-133-239 kubenswrapper[2576]: W0609 15:01:25.466762 2576 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jun 09 15:01:25.471175 ip-10-0-133-239 kubenswrapper[2576]: W0609 15:01:25.466764 2576 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jun 09 15:01:25.471175 ip-10-0-133-239 kubenswrapper[2576]: W0609 15:01:25.466768 2576 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jun 09 15:01:25.471175 ip-10-0-133-239 kubenswrapper[2576]: W0609 15:01:25.466772 2576 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jun 09 15:01:25.471175 ip-10-0-133-239 kubenswrapper[2576]: W0609 15:01:25.466783 2576 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jun 09 15:01:25.471175 ip-10-0-133-239 kubenswrapper[2576]: W0609 15:01:25.466788 2576 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jun 09 15:01:25.471175 ip-10-0-133-239 kubenswrapper[2576]: W0609 15:01:25.466792 2576 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jun 09 15:01:25.471175 ip-10-0-133-239 kubenswrapper[2576]: W0609 15:01:25.466795 2576 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jun 09 15:01:25.471175 ip-10-0-133-239 kubenswrapper[2576]: W0609 15:01:25.466798 2576 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jun 09 15:01:25.471175 ip-10-0-133-239 kubenswrapper[2576]: W0609 15:01:25.466802 2576 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jun 09 15:01:25.471175 ip-10-0-133-239 kubenswrapper[2576]: W0609 15:01:25.466805 2576 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jun 09 15:01:25.471175 ip-10-0-133-239 kubenswrapper[2576]: W0609 15:01:25.466808 2576 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jun 09 15:01:25.471175 ip-10-0-133-239 kubenswrapper[2576]: W0609 15:01:25.466811 2576 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jun 09 15:01:25.471175 ip-10-0-133-239 kubenswrapper[2576]: W0609 15:01:25.466814 2576 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jun 09 15:01:25.471175 ip-10-0-133-239 kubenswrapper[2576]: W0609 15:01:25.466816 2576 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jun 09 15:01:25.471175 ip-10-0-133-239 kubenswrapper[2576]: W0609 15:01:25.466819 2576 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jun 09 15:01:25.471175 ip-10-0-133-239 kubenswrapper[2576]: W0609 15:01:25.466824 2576 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jun 09 15:01:25.471686 ip-10-0-133-239 kubenswrapper[2576]: W0609 15:01:25.466827 2576 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jun 09 15:01:25.471686 ip-10-0-133-239 kubenswrapper[2576]: W0609 15:01:25.466830 2576 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jun 09 15:01:25.471686 ip-10-0-133-239 kubenswrapper[2576]: W0609 15:01:25.466832 2576 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jun 09 15:01:25.471686 ip-10-0-133-239 kubenswrapper[2576]: W0609 15:01:25.466835 2576 feature_gate.go:328] unrecognized feature gate: OSStreams Jun 09 15:01:25.471686 ip-10-0-133-239 kubenswrapper[2576]: W0609 15:01:25.466838 2576 feature_gate.go:328] unrecognized feature gate: PinnedImages Jun 09 15:01:25.471686 ip-10-0-133-239 kubenswrapper[2576]: W0609 15:01:25.466841 2576 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jun 09 15:01:25.471686 ip-10-0-133-239 kubenswrapper[2576]: W0609 15:01:25.466843 2576 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jun 09 15:01:25.471686 ip-10-0-133-239 kubenswrapper[2576]: W0609 15:01:25.466846 2576 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jun 09 15:01:25.471686 ip-10-0-133-239 kubenswrapper[2576]: W0609 15:01:25.466849 2576 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jun 09 15:01:25.471686 ip-10-0-133-239 kubenswrapper[2576]: W0609 15:01:25.466851 2576 feature_gate.go:328] unrecognized feature gate: EventTTL Jun 09 15:01:25.471686 ip-10-0-133-239 kubenswrapper[2576]: W0609 15:01:25.466854 2576 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jun 09 15:01:25.471686 ip-10-0-133-239 kubenswrapper[2576]: W0609 15:01:25.466857 2576 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jun 09 15:01:25.471686 ip-10-0-133-239 kubenswrapper[2576]: W0609 15:01:25.466862 2576 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jun 09 15:01:25.471686 ip-10-0-133-239 kubenswrapper[2576]: W0609 15:01:25.466865 2576 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jun 09 15:01:25.471686 ip-10-0-133-239 kubenswrapper[2576]: W0609 15:01:25.466867 2576 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jun 09 15:01:25.471686 ip-10-0-133-239 kubenswrapper[2576]: W0609 15:01:25.466870 2576 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jun 09 15:01:25.471686 ip-10-0-133-239 kubenswrapper[2576]: W0609 15:01:25.466872 2576 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jun 09 15:01:25.471686 ip-10-0-133-239 kubenswrapper[2576]: W0609 15:01:25.466875 2576 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jun 09 15:01:25.471686 ip-10-0-133-239 kubenswrapper[2576]: W0609 15:01:25.466878 2576 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jun 09 15:01:25.472164 ip-10-0-133-239 kubenswrapper[2576]: W0609 15:01:25.466881 2576 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jun 09 15:01:25.472164 ip-10-0-133-239 kubenswrapper[2576]: W0609 15:01:25.466890 2576 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jun 09 15:01:25.472164 ip-10-0-133-239 kubenswrapper[2576]: W0609 15:01:25.466893 2576 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jun 09 15:01:25.472164 ip-10-0-133-239 kubenswrapper[2576]: W0609 15:01:25.466895 2576 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jun 09 15:01:25.472164 ip-10-0-133-239 kubenswrapper[2576]: W0609 15:01:25.466899 2576 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jun 09 15:01:25.472164 ip-10-0-133-239 kubenswrapper[2576]: W0609 15:01:25.466905 2576 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jun 09 15:01:25.472164 ip-10-0-133-239 kubenswrapper[2576]: W0609 15:01:25.466909 2576 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jun 09 15:01:25.472164 ip-10-0-133-239 kubenswrapper[2576]: W0609 15:01:25.466912 2576 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jun 09 15:01:25.472164 ip-10-0-133-239 kubenswrapper[2576]: W0609 15:01:25.466914 2576 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jun 09 15:01:25.472164 ip-10-0-133-239 kubenswrapper[2576]: W0609 15:01:25.466917 2576 feature_gate.go:328] unrecognized feature gate: DualReplica Jun 09 15:01:25.472164 ip-10-0-133-239 kubenswrapper[2576]: W0609 15:01:25.466920 2576 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jun 09 15:01:25.472164 ip-10-0-133-239 kubenswrapper[2576]: W0609 15:01:25.466923 2576 feature_gate.go:328] unrecognized feature gate: OVNObservability Jun 09 15:01:25.472164 ip-10-0-133-239 kubenswrapper[2576]: W0609 15:01:25.466925 2576 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jun 09 15:01:25.472164 ip-10-0-133-239 kubenswrapper[2576]: W0609 15:01:25.466928 2576 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jun 09 15:01:25.472164 ip-10-0-133-239 kubenswrapper[2576]: W0609 15:01:25.466930 2576 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jun 09 15:01:25.472164 ip-10-0-133-239 kubenswrapper[2576]: W0609 15:01:25.466933 2576 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jun 09 15:01:25.472164 ip-10-0-133-239 kubenswrapper[2576]: W0609 15:01:25.466936 2576 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jun 09 15:01:25.472164 ip-10-0-133-239 kubenswrapper[2576]: W0609 15:01:25.466938 2576 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jun 09 15:01:25.472164 ip-10-0-133-239 kubenswrapper[2576]: W0609 15:01:25.466943 2576 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jun 09 15:01:25.472686 ip-10-0-133-239 kubenswrapper[2576]: W0609 15:01:25.466946 2576 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jun 09 15:01:25.472686 ip-10-0-133-239 kubenswrapper[2576]: W0609 15:01:25.466949 2576 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jun 09 15:01:25.472686 ip-10-0-133-239 kubenswrapper[2576]: W0609 15:01:25.466951 2576 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jun 09 15:01:25.472686 ip-10-0-133-239 kubenswrapper[2576]: W0609 15:01:25.466954 2576 feature_gate.go:328] unrecognized feature gate: Example Jun 09 15:01:25.472686 ip-10-0-133-239 kubenswrapper[2576]: W0609 15:01:25.466957 2576 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jun 09 15:01:25.472686 ip-10-0-133-239 kubenswrapper[2576]: W0609 15:01:25.466960 2576 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jun 09 15:01:25.472686 ip-10-0-133-239 kubenswrapper[2576]: W0609 15:01:25.466962 2576 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jun 09 15:01:25.472686 ip-10-0-133-239 kubenswrapper[2576]: W0609 15:01:25.466965 2576 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jun 09 15:01:25.472686 ip-10-0-133-239 kubenswrapper[2576]: W0609 15:01:25.466968 2576 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jun 09 15:01:25.472686 ip-10-0-133-239 kubenswrapper[2576]: W0609 15:01:25.466970 2576 feature_gate.go:328] unrecognized feature gate: Example2 Jun 09 15:01:25.472686 ip-10-0-133-239 kubenswrapper[2576]: W0609 15:01:25.466973 2576 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jun 09 15:01:25.472686 ip-10-0-133-239 kubenswrapper[2576]: W0609 15:01:25.466978 2576 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jun 09 15:01:25.472686 ip-10-0-133-239 kubenswrapper[2576]: W0609 15:01:25.466981 2576 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jun 09 15:01:25.472686 ip-10-0-133-239 kubenswrapper[2576]: W0609 15:01:25.466984 2576 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jun 09 15:01:25.472686 ip-10-0-133-239 kubenswrapper[2576]: W0609 15:01:25.466986 2576 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jun 09 15:01:25.472686 ip-10-0-133-239 kubenswrapper[2576]: W0609 15:01:25.466995 2576 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jun 09 15:01:25.472686 ip-10-0-133-239 kubenswrapper[2576]: W0609 15:01:25.466997 2576 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jun 09 15:01:25.472686 ip-10-0-133-239 kubenswrapper[2576]: W0609 15:01:25.467000 2576 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jun 09 15:01:25.472686 ip-10-0-133-239 kubenswrapper[2576]: W0609 15:01:25.467003 2576 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jun 09 15:01:25.472686 ip-10-0-133-239 kubenswrapper[2576]: W0609 15:01:25.467006 2576 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jun 09 15:01:25.473221 ip-10-0-133-239 kubenswrapper[2576]: W0609 15:01:25.467008 2576 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jun 09 15:01:25.473221 ip-10-0-133-239 kubenswrapper[2576]: W0609 15:01:25.467011 2576 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jun 09 15:01:25.473221 ip-10-0-133-239 kubenswrapper[2576]: W0609 15:01:25.467014 2576 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jun 09 15:01:25.473221 ip-10-0-133-239 kubenswrapper[2576]: W0609 15:01:25.467016 2576 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jun 09 15:01:25.473221 ip-10-0-133-239 kubenswrapper[2576]: W0609 15:01:25.467021 2576 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jun 09 15:01:25.473221 ip-10-0-133-239 kubenswrapper[2576]: W0609 15:01:25.467024 2576 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jun 09 15:01:25.473221 ip-10-0-133-239 kubenswrapper[2576]: W0609 15:01:25.467027 2576 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jun 09 15:01:25.473221 ip-10-0-133-239 kubenswrapper[2576]: W0609 15:01:25.467029 2576 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jun 09 15:01:25.473221 ip-10-0-133-239 kubenswrapper[2576]: I0609 15:01:25.467034 2576 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]} Jun 09 15:01:25.473221 ip-10-0-133-239 kubenswrapper[2576]: I0609 15:01:25.467223 2576 server.go:962] "Client rotation is on, will bootstrap in background" Jun 09 15:01:25.473221 ip-10-0-133-239 kubenswrapper[2576]: I0609 15:01:25.469653 2576 bootstrap.go:101] "Use the bootstrap credentials to request a cert, and set kubeconfig to point to the certificate dir" Jun 09 15:01:25.473221 ip-10-0-133-239 kubenswrapper[2576]: I0609 15:01:25.471563 2576 server.go:1019] "Starting client certificate rotation" Jun 09 15:01:25.473221 ip-10-0-133-239 kubenswrapper[2576]: I0609 15:01:25.471667 2576 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kube-apiserver-client-kubelet" Jun 09 15:01:25.473221 ip-10-0-133-239 kubenswrapper[2576]: I0609 15:01:25.471696 2576 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kube-apiserver-client-kubelet" Jun 09 15:01:25.474107 ip-10-0-133-239 kubenswrapper[2576]: I0609 15:01:25.474090 2576 dynamic_cafile_content.go:123] "Loaded a new CA Bundle and Verifier" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt" Jun 09 15:01:25.475801 ip-10-0-133-239 kubenswrapper[2576]: I0609 15:01:25.475780 2576 dynamic_cafile_content.go:161] "Starting controller" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt" Jun 09 15:01:25.484979 ip-10-0-133-239 kubenswrapper[2576]: I0609 15:01:25.484962 2576 log.go:25] "Validated CRI v1 runtime API" Jun 09 15:01:25.487633 ip-10-0-133-239 kubenswrapper[2576]: I0609 15:01:25.487617 2576 log.go:25] "Validated CRI v1 image API" Jun 09 15:01:25.488455 ip-10-0-133-239 kubenswrapper[2576]: I0609 15:01:25.488440 2576 server.go:1429] "Using cgroup driver setting received from the CRI runtime" cgroupDriver="systemd" Jun 09 15:01:25.491737 ip-10-0-133-239 kubenswrapper[2576]: I0609 15:01:25.491711 2576 fs.go:135] Filesystem UUIDs: map[7660e83e-5e70-4534-89cb-007b835e33ad:/dev/nvme0n1p3 7B77-95E7:/dev/nvme0n1p2 a8609b96-143a-468c-a852-ffba67892bf0:/dev/nvme0n1p4] Jun 09 15:01:25.491806 ip-10-0-133-239 kubenswrapper[2576]: I0609 15:01:25.491738 2576 fs.go:136] Filesystem partitions: map[/dev/nvme0n1p3:{mountpoint:/boot major:259 minor:3 fsType:ext4 blockSize:0} /dev/nvme0n1p4:{mountpoint:/var major:259 minor:4 fsType:xfs blockSize:0} /dev/shm:{mountpoint:/dev/shm major:0 minor:22 fsType:tmpfs blockSize:0} /run:{mountpoint:/run major:0 minor:24 fsType:tmpfs blockSize:0} /tmp:{mountpoint:/tmp major:0 minor:31 fsType:tmpfs blockSize:0} composefs_0-33:{mountpoint:/ major:0 minor:33 fsType:overlay blockSize:0}] Jun 09 15:01:25.497349 ip-10-0-133-239 kubenswrapper[2576]: I0609 15:01:25.497220 2576 manager.go:216] Machine: {Timestamp:2026-06-09 15:01:25.495845639 +0000 UTC m=+0.350001890 CPUVendorID:GenuineIntel NumCores:8 NumPhysicalCores:4 NumSockets:1 CpuFrequency:3110297 MemoryCapacity:33164484608 SwapCapacity:0 MemoryByType:map[] NVMInfo:{MemoryModeCapacity:0 AppDirectModeCapacity:0 AvgPowerBudget:0} HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] MachineID:ec237ae82c2dc76d5106ce53c5b40678 SystemUUID:ec237ae8-2c2d-c76d-5106-ce53c5b40678 BootID:d17d4322-e540-4424-afdc-53c6a34ec547 Filesystems:[{Device:/run DeviceMajor:0 DeviceMinor:24 Capacity:6632898560 Type:vfs Inodes:819200 HasInodes:true} {Device:/dev/nvme0n1p4 DeviceMajor:259 DeviceMinor:4 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:composefs_0-33 DeviceMajor:0 DeviceMinor:33 Capacity:6107136 Type:vfs Inodes:18446744073709551615 HasInodes:true} {Device:/tmp DeviceMajor:0 DeviceMinor:31 Capacity:16582242304 Type:vfs Inodes:1048576 HasInodes:true} {Device:/dev/nvme0n1p3 DeviceMajor:259 DeviceMinor:3 Capacity:366869504 Type:vfs Inodes:98304 HasInodes:true} {Device:/dev/shm DeviceMajor:0 DeviceMinor:22 Capacity:16582242304 Type:vfs Inodes:4048399 HasInodes:true}] DiskMap:map[259:0:{Name:nvme0n1 Major:259 Minor:0 Size:128849018880 Scheduler:none}] NetworkDevices:[{Name:br-ex MacAddress:02:ab:f2:4e:89:8d Speed:0 Mtu:9001} {Name:ens5 MacAddress:02:ab:f2:4e:89:8d Speed:0 Mtu:9001} {Name:ovs-system MacAddress:56:b8:04:9e:ed:e3 Speed:0 Mtu:1500}] Topology:[{Id:0 Memory:33164484608 HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] Cores:[{Id:0 Threads:[0 4] Caches:[{Id:0 Size:32768 Type:Data Level:1} {Id:0 Size:32768 Type:Instruction Level:1} {Id:0 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:1 Threads:[1 5] Caches:[{Id:1 Size:32768 Type:Data Level:1} {Id:1 Size:32768 Type:Instruction Level:1} {Id:1 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:2 Threads:[2 6] Caches:[{Id:2 Size:32768 Type:Data Level:1} {Id:2 Size:32768 Type:Instruction Level:1} {Id:2 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:3 Threads:[3 7] Caches:[{Id:3 Size:32768 Type:Data Level:1} {Id:3 Size:32768 Type:Instruction Level:1} {Id:3 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:}] Caches:[{Id:0 Size:37486592 Type:Unified Level:3}] Distances:[10]}] CloudProvider:Unknown InstanceType:Unknown InstanceID:None} Jun 09 15:01:25.497349 ip-10-0-133-239 kubenswrapper[2576]: I0609 15:01:25.497336 2576 manager_no_libpfm.go:29] cAdvisor is build without cgo and/or libpfm support. Perf event counters are not available. Jun 09 15:01:25.497486 ip-10-0-133-239 kubenswrapper[2576]: I0609 15:01:25.497466 2576 manager.go:232] Version: {KernelVersion:5.14.0-570.118.1.el9_6.x86_64 ContainerOsVersion:Red Hat Enterprise Linux CoreOS 9.6.20260602-0 (Plow) DockerVersion: DockerAPIVersion: CadvisorVersion: CadvisorRevision:} Jun 09 15:01:25.500659 ip-10-0-133-239 kubenswrapper[2576]: I0609 15:01:25.500634 2576 container_manager_linux.go:273] "Container manager verified user specified cgroup-root exists" cgroupRoot=[] Jun 09 15:01:25.500814 ip-10-0-133-239 kubenswrapper[2576]: I0609 15:01:25.500668 2576 container_manager_linux.go:278] "Creating Container Manager object based on Node Config" nodeConfig={"NodeName":"ip-10-0-133-239.ec2.internal","RuntimeCgroupsName":"/system.slice/crio.service","SystemCgroupsName":"/system.slice","KubeletCgroupsName":"","KubeletOOMScoreAdj":-999,"ContainerRuntime":"","CgroupsPerQOS":true,"CgroupRoot":"/","CgroupDriver":"systemd","KubeletRootDir":"/var/lib/kubelet","ProtectKernelDefaults":true,"KubeReservedCgroupName":"","SystemReservedCgroupName":"","ReservedSystemCPUs":{},"EnforceNodeAllocatable":{"pods":{}},"KubeReserved":null,"SystemReserved":{"cpu":"500m","ephemeral-storage":"1Gi","memory":"1Gi"},"HardEvictionThresholds":[{"Signal":"nodefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.15},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"memory.available","Operator":"LessThan","Value":{"Quantity":"100Mi","Percentage":0},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.1},"GracePeriod":0,"MinReclaim":null}],"QOSReserved":{},"CPUManagerPolicy":"none","CPUManagerPolicyOptions":null,"TopologyManagerScope":"container","CPUManagerReconcilePeriod":10000000000,"MemoryManagerPolicy":"None","MemoryManagerReservedMemory":null,"PodPidsLimit":4096,"EnforceCPULimits":true,"CPUCFSQuotaPeriod":100000000,"TopologyManagerPolicy":"none","TopologyManagerPolicyOptions":null,"CgroupVersion":2} Jun 09 15:01:25.501912 ip-10-0-133-239 kubenswrapper[2576]: I0609 15:01:25.501902 2576 topology_manager.go:138] "Creating topology manager with none policy" Jun 09 15:01:25.501945 ip-10-0-133-239 kubenswrapper[2576]: I0609 15:01:25.501915 2576 container_manager_linux.go:309] "Creating device plugin manager" Jun 09 15:01:25.501945 ip-10-0-133-239 kubenswrapper[2576]: I0609 15:01:25.501924 2576 manager.go:141] "Creating Device Plugin manager" path="/var/lib/kubelet/device-plugins/kubelet.sock" Jun 09 15:01:25.502623 ip-10-0-133-239 kubenswrapper[2576]: I0609 15:01:25.502613 2576 server.go:74] "Creating device plugin registration server" version="v1beta1" socket="/var/lib/kubelet/device-plugins/kubelet.sock" Jun 09 15:01:25.503401 ip-10-0-133-239 kubenswrapper[2576]: I0609 15:01:25.503392 2576 container_manager_linux.go:318] "Creating Dynamic Resource Allocation (DRA) manager" Jun 09 15:01:25.506310 ip-10-0-133-239 kubenswrapper[2576]: I0609 15:01:25.506295 2576 state_mem.go:36] "Initialized new in-memory state store" Jun 09 15:01:25.506432 ip-10-0-133-239 kubenswrapper[2576]: I0609 15:01:25.506422 2576 server.go:1240] "Using root directory" path="/var/lib/kubelet" Jun 09 15:01:25.506487 ip-10-0-133-239 kubenswrapper[2576]: I0609 15:01:25.506455 2576 kubelet.go:486] "Attempting to sync node with API server" Jun 09 15:01:25.506532 ip-10-0-133-239 kubenswrapper[2576]: I0609 15:01:25.506500 2576 kubelet.go:387] "Adding static pod path" path="/etc/kubernetes/manifests" Jun 09 15:01:25.506532 ip-10-0-133-239 kubenswrapper[2576]: I0609 15:01:25.506514 2576 file.go:69] "Watching path" path="/etc/kubernetes/manifests" Jun 09 15:01:25.506532 ip-10-0-133-239 kubenswrapper[2576]: I0609 15:01:25.506524 2576 kubelet.go:398] "Adding apiserver pod source" Jun 09 15:01:25.506655 ip-10-0-133-239 kubenswrapper[2576]: I0609 15:01:25.506533 2576 apiserver.go:42] "Waiting for node sync before watching apiserver pods" Jun 09 15:01:25.506958 ip-10-0-133-239 kubenswrapper[2576]: I0609 15:01:25.506939 2576 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking" Jun 09 15:01:25.506958 ip-10-0-133-239 kubenswrapper[2576]: I0609 15:01:25.506962 2576 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking" Jun 09 15:01:25.509749 ip-10-0-133-239 kubenswrapper[2576]: I0609 15:01:25.509730 2576 kuberuntime_manager.go:301] "Container runtime initialized" containerRuntime="cri-o" version="1.34.8-3.rhaos4.21.git91b4b0b.el9" apiVersion="v1" Jun 09 15:01:25.512903 ip-10-0-133-239 kubenswrapper[2576]: I0609 15:01:25.512882 2576 reflector.go:439] "Caches populated" logger="kubernetes.io/kube-apiserver-client-kubelet" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162" Jun 09 15:01:25.514654 ip-10-0-133-239 kubenswrapper[2576]: I0609 15:01:25.514637 2576 kubelet.go:960] "Not starting ClusterTrustBundle informer because we are in static kubelet mode or the ClusterTrustBundleProjection featuregate is disabled" Jun 09 15:01:25.514725 ip-10-0-133-239 kubenswrapper[2576]: I0609 15:01:25.514668 2576 kubelet.go:984] "Not starting PodCertificateRequest manager because we are in static kubelet mode or the PodCertificateProjection feature gate is disabled" Jun 09 15:01:25.515299 ip-10-0-133-239 kubenswrapper[2576]: I0609 15:01:25.515288 2576 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/portworx-volume" Jun 09 15:01:25.515337 ip-10-0-133-239 kubenswrapper[2576]: I0609 15:01:25.515306 2576 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/empty-dir" Jun 09 15:01:25.515337 ip-10-0-133-239 kubenswrapper[2576]: I0609 15:01:25.515313 2576 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/git-repo" Jun 09 15:01:25.515337 ip-10-0-133-239 kubenswrapper[2576]: I0609 15:01:25.515318 2576 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/host-path" Jun 09 15:01:25.515337 ip-10-0-133-239 kubenswrapper[2576]: I0609 15:01:25.515329 2576 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/nfs" Jun 09 15:01:25.515337 ip-10-0-133-239 kubenswrapper[2576]: I0609 15:01:25.515338 2576 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/secret" Jun 09 15:01:25.515464 ip-10-0-133-239 kubenswrapper[2576]: I0609 15:01:25.515382 2576 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/iscsi" Jun 09 15:01:25.515464 ip-10-0-133-239 kubenswrapper[2576]: I0609 15:01:25.515389 2576 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/downward-api" Jun 09 15:01:25.515464 ip-10-0-133-239 kubenswrapper[2576]: I0609 15:01:25.515396 2576 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/fc" Jun 09 15:01:25.515464 ip-10-0-133-239 kubenswrapper[2576]: I0609 15:01:25.515402 2576 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/configmap" Jun 09 15:01:25.515464 ip-10-0-133-239 kubenswrapper[2576]: I0609 15:01:25.515410 2576 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/projected" Jun 09 15:01:25.515464 ip-10-0-133-239 kubenswrapper[2576]: I0609 15:01:25.515418 2576 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/local-volume" Jun 09 15:01:25.516199 ip-10-0-133-239 kubenswrapper[2576]: E0609 15:01:25.516170 2576 reflector.go:205] "Failed to watch" err="failed to list *v1.Service: services is forbidden: User \"system:anonymous\" cannot list resource \"services\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Service" Jun 09 15:01:25.516199 ip-10-0-133-239 kubenswrapper[2576]: I0609 15:01:25.516194 2576 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/csi" Jun 09 15:01:25.516199 ip-10-0-133-239 kubenswrapper[2576]: E0609 15:01:25.516171 2576 reflector.go:205] "Failed to watch" err="failed to list *v1.Node: nodes \"ip-10-0-133-239.ec2.internal\" is forbidden: User \"system:anonymous\" cannot list resource \"nodes\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Node" Jun 09 15:01:25.516353 ip-10-0-133-239 kubenswrapper[2576]: I0609 15:01:25.516203 2576 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/image" Jun 09 15:01:25.519387 ip-10-0-133-239 kubenswrapper[2576]: I0609 15:01:25.519372 2576 server.go:1268] "Started kubelet" Jun 09 15:01:25.519524 ip-10-0-133-239 kubenswrapper[2576]: I0609 15:01:25.519499 2576 server.go:180] "Starting to listen" address="0.0.0.0" port=10250 Jun 09 15:01:25.519585 ip-10-0-133-239 kubenswrapper[2576]: I0609 15:01:25.519504 2576 ratelimit.go:56] "Setting rate limiting for endpoint" service="podresources" qps=100 burstTokens=10 Jun 09 15:01:25.519585 ip-10-0-133-239 kubenswrapper[2576]: I0609 15:01:25.519575 2576 server_v1.go:49] "podresources" method="list" useActivePods=true Jun 09 15:01:25.520215 ip-10-0-133-239 systemd[1]: Started Kubernetes Kubelet. Jun 09 15:01:25.521564 ip-10-0-133-239 kubenswrapper[2576]: I0609 15:01:25.521552 2576 server.go:310] "Adding debug handlers to kubelet server" Jun 09 15:01:25.523592 ip-10-0-133-239 kubenswrapper[2576]: I0609 15:01:25.523574 2576 server.go:249] "Starting to serve the podresources API" endpoint="unix:/var/lib/kubelet/pod-resources/kubelet.sock" Jun 09 15:01:25.525350 ip-10-0-133-239 kubenswrapper[2576]: I0609 15:01:25.525329 2576 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-lf5z8" Jun 09 15:01:25.526147 ip-10-0-133-239 kubenswrapper[2576]: I0609 15:01:25.526133 2576 csi_plugin.go:990] Failed to contact API server when waiting for CSINode publishing: csinodes.storage.k8s.io "ip-10-0-133-239.ec2.internal" is forbidden: User "system:anonymous" cannot get resource "csinodes" in API group "storage.k8s.io" at the cluster scope Jun 09 15:01:25.526891 ip-10-0-133-239 kubenswrapper[2576]: E0609 15:01:25.525941 2576 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-133-239.ec2.internal.18b771c8f23604fc default 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-133-239.ec2.internal,UID:ip-10-0-133-239.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:Starting,Message:Starting kubelet.,Source:EventSource{Component:kubelet,Host:ip-10-0-133-239.ec2.internal,},FirstTimestamp:2026-06-09 15:01:25.519344892 +0000 UTC m=+0.373501161,LastTimestamp:2026-06-09 15:01:25.519344892 +0000 UTC m=+0.373501161,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-133-239.ec2.internal,}" Jun 09 15:01:25.527673 ip-10-0-133-239 kubenswrapper[2576]: E0609 15:01:25.527657 2576 kubelet.go:1638] "Image garbage collection failed once. Stats initialization may not have completed yet" err="failed to get imageFs info: unable to find data in memory cache" Jun 09 15:01:25.529355 ip-10-0-133-239 kubenswrapper[2576]: I0609 15:01:25.529336 2576 fs_resource_analyzer.go:67] "Starting FS ResourceAnalyzer" Jun 09 15:01:25.529447 ip-10-0-133-239 kubenswrapper[2576]: I0609 15:01:25.529354 2576 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kubelet-serving" Jun 09 15:01:25.529924 ip-10-0-133-239 kubenswrapper[2576]: E0609 15:01:25.529518 2576 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-133-239.ec2.internal\" not found" Jun 09 15:01:25.529924 ip-10-0-133-239 kubenswrapper[2576]: I0609 15:01:25.529884 2576 desired_state_of_world_populator.go:146] "Desired state populator starts to run" Jun 09 15:01:25.529924 ip-10-0-133-239 kubenswrapper[2576]: I0609 15:01:25.529886 2576 volume_manager.go:311] "The desired_state_of_world populator starts" Jun 09 15:01:25.529924 ip-10-0-133-239 kubenswrapper[2576]: I0609 15:01:25.529904 2576 volume_manager.go:313] "Starting Kubelet Volume Manager" Jun 09 15:01:25.530172 ip-10-0-133-239 kubenswrapper[2576]: I0609 15:01:25.530060 2576 reconstruct.go:97] "Volume reconstruction finished" Jun 09 15:01:25.530172 ip-10-0-133-239 kubenswrapper[2576]: I0609 15:01:25.530081 2576 reconciler.go:29] "Reconciler: start to sync state" Jun 09 15:01:25.530610 ip-10-0-133-239 kubenswrapper[2576]: I0609 15:01:25.530591 2576 factory.go:55] Registering systemd factory Jun 09 15:01:25.530677 ip-10-0-133-239 kubenswrapper[2576]: I0609 15:01:25.530621 2576 factory.go:223] Registration of the systemd container factory successfully Jun 09 15:01:25.530866 ip-10-0-133-239 kubenswrapper[2576]: I0609 15:01:25.530853 2576 factory.go:153] Registering CRI-O factory Jun 09 15:01:25.530920 ip-10-0-133-239 kubenswrapper[2576]: I0609 15:01:25.530868 2576 factory.go:223] Registration of the crio container factory successfully Jun 09 15:01:25.530958 ip-10-0-133-239 kubenswrapper[2576]: I0609 15:01:25.530931 2576 factory.go:221] Registration of the containerd container factory failed: unable to create containerd client: containerd: cannot unix dial containerd api service: dial unix /run/containerd/containerd.sock: connect: no such file or directory Jun 09 15:01:25.530958 ip-10-0-133-239 kubenswrapper[2576]: I0609 15:01:25.530956 2576 factory.go:103] Registering Raw factory Jun 09 15:01:25.531055 ip-10-0-133-239 kubenswrapper[2576]: I0609 15:01:25.530970 2576 manager.go:1196] Started watching for new ooms in manager Jun 09 15:01:25.531224 ip-10-0-133-239 kubenswrapper[2576]: E0609 15:01:25.531196 2576 controller.go:145] "Failed to ensure lease exists, will retry" err="leases.coordination.k8s.io \"ip-10-0-133-239.ec2.internal\" is forbidden: User \"system:anonymous\" cannot get resource \"leases\" in API group \"coordination.k8s.io\" in the namespace \"kube-node-lease\"" interval="200ms" Jun 09 15:01:25.531326 ip-10-0-133-239 kubenswrapper[2576]: E0609 15:01:25.531238 2576 reflector.go:205] "Failed to watch" err="failed to list *v1.CSIDriver: csidrivers.storage.k8s.io is forbidden: User \"system:anonymous\" cannot list resource \"csidrivers\" in API group \"storage.k8s.io\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.CSIDriver" Jun 09 15:01:25.531462 ip-10-0-133-239 kubenswrapper[2576]: I0609 15:01:25.531440 2576 manager.go:349] Starting recovery of all containers Jun 09 15:01:25.532007 ip-10-0-133-239 kubenswrapper[2576]: I0609 15:01:25.531985 2576 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-lf5z8" Jun 09 15:01:25.542003 ip-10-0-133-239 kubenswrapper[2576]: I0609 15:01:25.541986 2576 manager.go:354] Recovery completed Jun 09 15:01:25.546254 ip-10-0-133-239 kubenswrapper[2576]: I0609 15:01:25.546241 2576 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jun 09 15:01:25.548501 ip-10-0-133-239 kubenswrapper[2576]: I0609 15:01:25.548485 2576 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-133-239.ec2.internal" event="NodeHasSufficientMemory" Jun 09 15:01:25.548579 ip-10-0-133-239 kubenswrapper[2576]: I0609 15:01:25.548518 2576 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-133-239.ec2.internal" event="NodeHasNoDiskPressure" Jun 09 15:01:25.548579 ip-10-0-133-239 kubenswrapper[2576]: I0609 15:01:25.548532 2576 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-133-239.ec2.internal" event="NodeHasSufficientPID" Jun 09 15:01:25.548971 ip-10-0-133-239 kubenswrapper[2576]: I0609 15:01:25.548954 2576 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jun 09 15:01:25.549086 ip-10-0-133-239 kubenswrapper[2576]: I0609 15:01:25.548956 2576 cpu_manager.go:222] "Starting CPU manager" policy="none" Jun 09 15:01:25.549086 ip-10-0-133-239 kubenswrapper[2576]: I0609 15:01:25.548991 2576 cpu_manager.go:223] "Reconciling" reconcilePeriod="10s" Jun 09 15:01:25.549086 ip-10-0-133-239 kubenswrapper[2576]: I0609 15:01:25.549007 2576 state_mem.go:36] "Initialized new in-memory state store" Jun 09 15:01:25.549606 ip-10-0-133-239 kubenswrapper[2576]: I0609 15:01:25.549591 2576 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-133-239.ec2.internal" event="NodeHasSufficientMemory" Jun 09 15:01:25.549656 ip-10-0-133-239 kubenswrapper[2576]: I0609 15:01:25.549623 2576 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-133-239.ec2.internal" event="NodeHasNoDiskPressure" Jun 09 15:01:25.549656 ip-10-0-133-239 kubenswrapper[2576]: I0609 15:01:25.549637 2576 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-133-239.ec2.internal" event="NodeHasSufficientPID" Jun 09 15:01:25.550267 ip-10-0-133-239 kubenswrapper[2576]: I0609 15:01:25.550252 2576 policy_none.go:49] "None policy: Start" Jun 09 15:01:25.550267 ip-10-0-133-239 kubenswrapper[2576]: I0609 15:01:25.550267 2576 memory_manager.go:187] "Starting memorymanager" policy="None" Jun 09 15:01:25.550388 ip-10-0-133-239 kubenswrapper[2576]: I0609 15:01:25.550277 2576 state_mem.go:36] "Initializing new in-memory state store" logger="Memory Manager state checkpoint" Jun 09 15:01:25.551453 ip-10-0-133-239 kubenswrapper[2576]: I0609 15:01:25.551442 2576 policy_none.go:47] "Start" Jun 09 15:01:25.584661 ip-10-0-133-239 kubenswrapper[2576]: I0609 15:01:25.584645 2576 manager.go:337] "Starting Device Plugin manager" Jun 09 15:01:25.598655 ip-10-0-133-239 kubenswrapper[2576]: E0609 15:01:25.584677 2576 manager.go:513] "Failed to read data from checkpoint" err="checkpoint is not found" checkpoint="kubelet_internal_checkpoint" Jun 09 15:01:25.598655 ip-10-0-133-239 kubenswrapper[2576]: I0609 15:01:25.584686 2576 server.go:87] "Starting device plugin registration server" Jun 09 15:01:25.598655 ip-10-0-133-239 kubenswrapper[2576]: I0609 15:01:25.584901 2576 eviction_manager.go:189] "Eviction manager: starting control loop" Jun 09 15:01:25.598655 ip-10-0-133-239 kubenswrapper[2576]: I0609 15:01:25.584913 2576 container_log_manager.go:146] "Initializing container log rotate workers" workers=1 monitorPeriod="10s" Jun 09 15:01:25.598655 ip-10-0-133-239 kubenswrapper[2576]: I0609 15:01:25.585012 2576 plugin_watcher.go:51] "Plugin Watcher Start" path="/var/lib/kubelet/plugins_registry" Jun 09 15:01:25.598655 ip-10-0-133-239 kubenswrapper[2576]: I0609 15:01:25.585115 2576 plugin_manager.go:116] "The desired_state_of_world populator (plugin watcher) starts" Jun 09 15:01:25.598655 ip-10-0-133-239 kubenswrapper[2576]: I0609 15:01:25.585125 2576 plugin_manager.go:118] "Starting Kubelet Plugin Manager" Jun 09 15:01:25.598655 ip-10-0-133-239 kubenswrapper[2576]: E0609 15:01:25.585719 2576 eviction_manager.go:267] "eviction manager: failed to check if we have separate container filesystem. Ignoring." err="non-existent label \"crio-containers\"" Jun 09 15:01:25.598655 ip-10-0-133-239 kubenswrapper[2576]: E0609 15:01:25.585772 2576 eviction_manager.go:292] "Eviction manager: failed to get summary stats" err="failed to get node info: node \"ip-10-0-133-239.ec2.internal\" not found" Jun 09 15:01:25.598655 ip-10-0-133-239 kubenswrapper[2576]: I0609 15:01:25.596142 2576 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv4" Jun 09 15:01:25.598655 ip-10-0-133-239 kubenswrapper[2576]: I0609 15:01:25.597479 2576 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv6" Jun 09 15:01:25.598655 ip-10-0-133-239 kubenswrapper[2576]: I0609 15:01:25.597512 2576 status_manager.go:244] "Starting to sync pod status with apiserver" Jun 09 15:01:25.598655 ip-10-0-133-239 kubenswrapper[2576]: I0609 15:01:25.597536 2576 kubelet.go:2448] "Starting kubelet main sync loop" Jun 09 15:01:25.598655 ip-10-0-133-239 kubenswrapper[2576]: E0609 15:01:25.597599 2576 kubelet.go:2472] "Skipping pod synchronization" err="PLEG is not healthy: pleg has yet to be successful" Jun 09 15:01:25.599344 ip-10-0-133-239 kubenswrapper[2576]: I0609 15:01:25.599324 2576 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160" Jun 09 15:01:25.685313 ip-10-0-133-239 kubenswrapper[2576]: I0609 15:01:25.685282 2576 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jun 09 15:01:25.686276 ip-10-0-133-239 kubenswrapper[2576]: I0609 15:01:25.686259 2576 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-133-239.ec2.internal" event="NodeHasSufficientMemory" Jun 09 15:01:25.686385 ip-10-0-133-239 kubenswrapper[2576]: I0609 15:01:25.686288 2576 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-133-239.ec2.internal" event="NodeHasNoDiskPressure" Jun 09 15:01:25.686385 ip-10-0-133-239 kubenswrapper[2576]: I0609 15:01:25.686299 2576 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-133-239.ec2.internal" event="NodeHasSufficientPID" Jun 09 15:01:25.686385 ip-10-0-133-239 kubenswrapper[2576]: I0609 15:01:25.686321 2576 kubelet_node_status.go:78] "Attempting to register node" node="ip-10-0-133-239.ec2.internal" Jun 09 15:01:25.695933 ip-10-0-133-239 kubenswrapper[2576]: I0609 15:01:25.695916 2576 kubelet_node_status.go:81] "Successfully registered node" node="ip-10-0-133-239.ec2.internal" Jun 09 15:01:25.695986 ip-10-0-133-239 kubenswrapper[2576]: E0609 15:01:25.695938 2576 kubelet_node_status.go:536] "Error updating node status, will retry" err="error getting node \"ip-10-0-133-239.ec2.internal\": node \"ip-10-0-133-239.ec2.internal\" not found" Jun 09 15:01:25.698689 ip-10-0-133-239 kubenswrapper[2576]: I0609 15:01:25.698647 2576 kubelet.go:2535] "SyncLoop ADD" source="file" pods=["kube-system/kube-apiserver-proxy-ip-10-0-133-239.ec2.internal","openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-133-239.ec2.internal"] Jun 09 15:01:25.698748 ip-10-0-133-239 kubenswrapper[2576]: I0609 15:01:25.698699 2576 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jun 09 15:01:25.699541 ip-10-0-133-239 kubenswrapper[2576]: I0609 15:01:25.699527 2576 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-133-239.ec2.internal" event="NodeHasSufficientMemory" Jun 09 15:01:25.699610 ip-10-0-133-239 kubenswrapper[2576]: I0609 15:01:25.699556 2576 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-133-239.ec2.internal" event="NodeHasNoDiskPressure" Jun 09 15:01:25.699610 ip-10-0-133-239 kubenswrapper[2576]: I0609 15:01:25.699566 2576 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-133-239.ec2.internal" event="NodeHasSufficientPID" Jun 09 15:01:25.700739 ip-10-0-133-239 kubenswrapper[2576]: I0609 15:01:25.700726 2576 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jun 09 15:01:25.700831 ip-10-0-133-239 kubenswrapper[2576]: I0609 15:01:25.700817 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-133-239.ec2.internal" Jun 09 15:01:25.700870 ip-10-0-133-239 kubenswrapper[2576]: I0609 15:01:25.700844 2576 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jun 09 15:01:25.701444 ip-10-0-133-239 kubenswrapper[2576]: I0609 15:01:25.701424 2576 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-133-239.ec2.internal" event="NodeHasSufficientMemory" Jun 09 15:01:25.701509 ip-10-0-133-239 kubenswrapper[2576]: I0609 15:01:25.701452 2576 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-133-239.ec2.internal" event="NodeHasNoDiskPressure" Jun 09 15:01:25.701509 ip-10-0-133-239 kubenswrapper[2576]: I0609 15:01:25.701452 2576 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-133-239.ec2.internal" event="NodeHasSufficientMemory" Jun 09 15:01:25.701509 ip-10-0-133-239 kubenswrapper[2576]: I0609 15:01:25.701462 2576 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-133-239.ec2.internal" event="NodeHasSufficientPID" Jun 09 15:01:25.701509 ip-10-0-133-239 kubenswrapper[2576]: I0609 15:01:25.701470 2576 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-133-239.ec2.internal" event="NodeHasNoDiskPressure" Jun 09 15:01:25.701509 ip-10-0-133-239 kubenswrapper[2576]: I0609 15:01:25.701480 2576 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-133-239.ec2.internal" event="NodeHasSufficientPID" Jun 09 15:01:25.702588 ip-10-0-133-239 kubenswrapper[2576]: I0609 15:01:25.702573 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-133-239.ec2.internal" Jun 09 15:01:25.702668 ip-10-0-133-239 kubenswrapper[2576]: I0609 15:01:25.702615 2576 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jun 09 15:01:25.703214 ip-10-0-133-239 kubenswrapper[2576]: I0609 15:01:25.703193 2576 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-133-239.ec2.internal" event="NodeHasSufficientMemory" Jun 09 15:01:25.703282 ip-10-0-133-239 kubenswrapper[2576]: I0609 15:01:25.703225 2576 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-133-239.ec2.internal" event="NodeHasNoDiskPressure" Jun 09 15:01:25.703282 ip-10-0-133-239 kubenswrapper[2576]: I0609 15:01:25.703252 2576 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-133-239.ec2.internal" event="NodeHasSufficientPID" Jun 09 15:01:25.715995 ip-10-0-133-239 kubenswrapper[2576]: E0609 15:01:25.715831 2576 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-133-239.ec2.internal\" not found" Jun 09 15:01:25.725835 ip-10-0-133-239 kubenswrapper[2576]: E0609 15:01:25.725820 2576 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-133-239.ec2.internal\" not found" node="ip-10-0-133-239.ec2.internal" Jun 09 15:01:25.730361 ip-10-0-133-239 kubenswrapper[2576]: E0609 15:01:25.730346 2576 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-133-239.ec2.internal\" not found" node="ip-10-0-133-239.ec2.internal" Jun 09 15:01:25.731399 ip-10-0-133-239 kubenswrapper[2576]: I0609 15:01:25.731381 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/a6e9ba50990866073fec99b72c3ac279-config\") pod \"kube-apiserver-proxy-ip-10-0-133-239.ec2.internal\" (UID: \"a6e9ba50990866073fec99b72c3ac279\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-133-239.ec2.internal" Jun 09 15:01:25.731450 ip-10-0-133-239 kubenswrapper[2576]: I0609 15:01:25.731406 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/da1523b16a47c8ff940157f0e5b95b64-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-133-239.ec2.internal\" (UID: \"da1523b16a47c8ff940157f0e5b95b64\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-133-239.ec2.internal" Jun 09 15:01:25.731450 ip-10-0-133-239 kubenswrapper[2576]: I0609 15:01:25.731426 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/da1523b16a47c8ff940157f0e5b95b64-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-133-239.ec2.internal\" (UID: \"da1523b16a47c8ff940157f0e5b95b64\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-133-239.ec2.internal" Jun 09 15:01:25.816270 ip-10-0-133-239 kubenswrapper[2576]: E0609 15:01:25.816234 2576 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-133-239.ec2.internal\" not found" Jun 09 15:01:25.831573 ip-10-0-133-239 kubenswrapper[2576]: I0609 15:01:25.831539 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/a6e9ba50990866073fec99b72c3ac279-config\") pod \"kube-apiserver-proxy-ip-10-0-133-239.ec2.internal\" (UID: \"a6e9ba50990866073fec99b72c3ac279\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-133-239.ec2.internal" Jun 09 15:01:25.831685 ip-10-0-133-239 kubenswrapper[2576]: I0609 15:01:25.831575 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/da1523b16a47c8ff940157f0e5b95b64-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-133-239.ec2.internal\" (UID: \"da1523b16a47c8ff940157f0e5b95b64\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-133-239.ec2.internal" Jun 09 15:01:25.831685 ip-10-0-133-239 kubenswrapper[2576]: I0609 15:01:25.831597 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/da1523b16a47c8ff940157f0e5b95b64-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-133-239.ec2.internal\" (UID: \"da1523b16a47c8ff940157f0e5b95b64\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-133-239.ec2.internal" Jun 09 15:01:25.831685 ip-10-0-133-239 kubenswrapper[2576]: I0609 15:01:25.831635 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/host-path/a6e9ba50990866073fec99b72c3ac279-config\") pod \"kube-apiserver-proxy-ip-10-0-133-239.ec2.internal\" (UID: \"a6e9ba50990866073fec99b72c3ac279\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-133-239.ec2.internal" Jun 09 15:01:25.831685 ip-10-0-133-239 kubenswrapper[2576]: I0609 15:01:25.831655 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/da1523b16a47c8ff940157f0e5b95b64-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-133-239.ec2.internal\" (UID: \"da1523b16a47c8ff940157f0e5b95b64\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-133-239.ec2.internal" Jun 09 15:01:25.831685 ip-10-0-133-239 kubenswrapper[2576]: I0609 15:01:25.831635 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/da1523b16a47c8ff940157f0e5b95b64-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-133-239.ec2.internal\" (UID: \"da1523b16a47c8ff940157f0e5b95b64\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-133-239.ec2.internal" Jun 09 15:01:25.916736 ip-10-0-133-239 kubenswrapper[2576]: E0609 15:01:25.916695 2576 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-133-239.ec2.internal\" not found" Jun 09 15:01:26.017475 ip-10-0-133-239 kubenswrapper[2576]: E0609 15:01:26.017414 2576 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-133-239.ec2.internal\" not found" Jun 09 15:01:26.030614 ip-10-0-133-239 kubenswrapper[2576]: I0609 15:01:26.030591 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-133-239.ec2.internal" Jun 09 15:01:26.034894 ip-10-0-133-239 kubenswrapper[2576]: I0609 15:01:26.034878 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-133-239.ec2.internal" Jun 09 15:01:26.117837 ip-10-0-133-239 kubenswrapper[2576]: E0609 15:01:26.117796 2576 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-133-239.ec2.internal\" not found" Jun 09 15:01:26.218298 ip-10-0-133-239 kubenswrapper[2576]: E0609 15:01:26.218259 2576 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-133-239.ec2.internal\" not found" Jun 09 15:01:26.318853 ip-10-0-133-239 kubenswrapper[2576]: E0609 15:01:26.318757 2576 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-133-239.ec2.internal\" not found" Jun 09 15:01:26.419334 ip-10-0-133-239 kubenswrapper[2576]: E0609 15:01:26.419301 2576 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-133-239.ec2.internal\" not found" Jun 09 15:01:26.437584 ip-10-0-133-239 kubenswrapper[2576]: I0609 15:01:26.437554 2576 reflector.go:439] "Caches populated" type="*v1.Service" reflector="k8s.io/client-go/informers/factory.go:160" Jun 09 15:01:26.470492 ip-10-0-133-239 kubenswrapper[2576]: I0609 15:01:26.470452 2576 transport.go:147] "Certificate rotation detected, shutting down client connections to start using new credentials" Jun 09 15:01:26.471157 ip-10-0-133-239 kubenswrapper[2576]: I0609 15:01:26.470617 2576 reflector.go:571] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.RuntimeClass" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received" Jun 09 15:01:26.471157 ip-10-0-133-239 kubenswrapper[2576]: I0609 15:01:26.470622 2576 reflector.go:571] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Service" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received" Jun 09 15:01:26.512605 ip-10-0-133-239 kubenswrapper[2576]: W0609 15:01:26.512563 2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda6e9ba50990866073fec99b72c3ac279.slice/crio-98b514f8dcfd13f403d96c486c0870530edf99c60eca52e5e445fb3812c429d4 WatchSource:0}: Error finding container 98b514f8dcfd13f403d96c486c0870530edf99c60eca52e5e445fb3812c429d4: Status 404 returned error can't find the container with id 98b514f8dcfd13f403d96c486c0870530edf99c60eca52e5e445fb3812c429d4 Jun 09 15:01:26.513001 ip-10-0-133-239 kubenswrapper[2576]: W0609 15:01:26.512977 2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podda1523b16a47c8ff940157f0e5b95b64.slice/crio-695155b133644d941c6d51c381a566801fe997b263f57cc151c2e3ee826f25f3 WatchSource:0}: Error finding container 695155b133644d941c6d51c381a566801fe997b263f57cc151c2e3ee826f25f3: Status 404 returned error can't find the container with id 695155b133644d941c6d51c381a566801fe997b263f57cc151c2e3ee826f25f3 Jun 09 15:01:26.519541 ip-10-0-133-239 kubenswrapper[2576]: E0609 15:01:26.519523 2576 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-133-239.ec2.internal\" not found" Jun 09 15:01:26.519592 ip-10-0-133-239 kubenswrapper[2576]: I0609 15:01:26.519579 2576 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jun 09 15:01:26.534778 ip-10-0-133-239 kubenswrapper[2576]: I0609 15:01:26.534729 2576 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kube-apiserver-client-kubelet" expiration="2028-06-08 14:56:25 +0000 UTC" deadline="2028-02-19 01:23:18.342894952 +0000 UTC" Jun 09 15:01:26.534778 ip-10-0-133-239 kubenswrapper[2576]: I0609 15:01:26.534771 2576 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kube-apiserver-client-kubelet" sleep="14866h21m51.808128345s" Jun 09 15:01:26.601737 ip-10-0-133-239 kubenswrapper[2576]: I0609 15:01:26.601594 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-133-239.ec2.internal" event={"ID":"a6e9ba50990866073fec99b72c3ac279","Type":"ContainerStarted","Data":"98b514f8dcfd13f403d96c486c0870530edf99c60eca52e5e445fb3812c429d4"} Jun 09 15:01:26.602590 ip-10-0-133-239 kubenswrapper[2576]: I0609 15:01:26.602569 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-133-239.ec2.internal" event={"ID":"da1523b16a47c8ff940157f0e5b95b64","Type":"ContainerStarted","Data":"695155b133644d941c6d51c381a566801fe997b263f57cc151c2e3ee826f25f3"} Jun 09 15:01:26.619747 ip-10-0-133-239 kubenswrapper[2576]: E0609 15:01:26.619724 2576 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-133-239.ec2.internal\" not found" Jun 09 15:01:26.720337 ip-10-0-133-239 kubenswrapper[2576]: E0609 15:01:26.720302 2576 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-133-239.ec2.internal\" not found" Jun 09 15:01:26.820851 ip-10-0-133-239 kubenswrapper[2576]: E0609 15:01:26.820806 2576 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-133-239.ec2.internal\" not found" Jun 09 15:01:26.921384 ip-10-0-133-239 kubenswrapper[2576]: E0609 15:01:26.921295 2576 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-133-239.ec2.internal\" not found" Jun 09 15:01:26.933762 ip-10-0-133-239 kubenswrapper[2576]: I0609 15:01:26.933735 2576 reflector.go:439] "Caches populated" type="*v1.CSIDriver" reflector="k8s.io/client-go/informers/factory.go:160" Jun 09 15:01:27.022112 ip-10-0-133-239 kubenswrapper[2576]: E0609 15:01:27.022079 2576 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-133-239.ec2.internal\" not found" Jun 09 15:01:27.086974 ip-10-0-133-239 kubenswrapper[2576]: I0609 15:01:27.086946 2576 reflector.go:439] "Caches populated" type="*v1.Node" reflector="k8s.io/client-go/informers/factory.go:160" Jun 09 15:01:27.130012 ip-10-0-133-239 kubenswrapper[2576]: I0609 15:01:27.129984 2576 kubelet.go:3248] "Creating a mirror pod for static pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-133-239.ec2.internal" Jun 09 15:01:27.140731 ip-10-0-133-239 kubenswrapper[2576]: I0609 15:01:27.140700 2576 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]" Jun 09 15:01:27.141826 ip-10-0-133-239 kubenswrapper[2576]: I0609 15:01:27.141802 2576 kubelet.go:3248] "Creating a mirror pod for static pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-133-239.ec2.internal" Jun 09 15:01:27.155793 ip-10-0-133-239 kubenswrapper[2576]: I0609 15:01:27.155761 2576 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]" Jun 09 15:01:27.508077 ip-10-0-133-239 kubenswrapper[2576]: I0609 15:01:27.508025 2576 apiserver.go:52] "Watching apiserver" Jun 09 15:01:27.515891 ip-10-0-133-239 kubenswrapper[2576]: I0609 15:01:27.515862 2576 reflector.go:439] "Caches populated" type="*v1.Pod" reflector="pkg/kubelet/config/apiserver.go:66" Jun 09 15:01:27.516342 ip-10-0-133-239 kubenswrapper[2576]: I0609 15:01:27.516318 2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-cluster-node-tuning-operator/tuned-hplk7","openshift-image-registry/node-ca-n4qqs","openshift-network-diagnostics/network-check-target-p6wz2","openshift-ovn-kubernetes/ovnkube-node-n4c97","kube-system/kube-apiserver-proxy-ip-10-0-133-239.ec2.internal","openshift-dns/node-resolver-d5rht","openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-133-239.ec2.internal","openshift-multus/multus-96jh2","openshift-multus/multus-additional-cni-plugins-rvk7p","openshift-multus/network-metrics-daemon-rw24f","openshift-network-operator/iptables-alerter-db5nc","kube-system/global-pull-secret-syncer-256sj","kube-system/konnectivity-agent-tz8c7","openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-f7pk9"] Jun 09 15:01:27.517844 ip-10-0-133-239 kubenswrapper[2576]: I0609 15:01:27.517822 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-96jh2" Jun 09 15:01:27.518957 ip-10-0-133-239 kubenswrapper[2576]: I0609 15:01:27.518937 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-n4qqs" Jun 09 15:01:27.520123 ip-10-0-133-239 kubenswrapper[2576]: I0609 15:01:27.520101 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"openshift-service-ca.crt\"" Jun 09 15:01:27.520226 ip-10-0-133-239 kubenswrapper[2576]: I0609 15:01:27.520154 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-f7pk9" Jun 09 15:01:27.520284 ip-10-0-133-239 kubenswrapper[2576]: I0609 15:01:27.520239 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"multus-daemon-config\"" Jun 09 15:01:27.520675 ip-10-0-133-239 kubenswrapper[2576]: I0609 15:01:27.520656 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"kube-root-ca.crt\"" Jun 09 15:01:27.520882 ip-10-0-133-239 kubenswrapper[2576]: I0609 15:01:27.520864 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"cni-copy-resources\"" Jun 09 15:01:27.520999 ip-10-0-133-239 kubenswrapper[2576]: I0609 15:01:27.520975 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"default-dockercfg-l4vdm\"" Jun 09 15:01:27.521723 ip-10-0-133-239 kubenswrapper[2576]: I0609 15:01:27.521282 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"openshift-service-ca.crt\"" Jun 09 15:01:27.521723 ip-10-0-133-239 kubenswrapper[2576]: I0609 15:01:27.521406 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-db5nc" Jun 09 15:01:27.521723 ip-10-0-133-239 kubenswrapper[2576]: I0609 15:01:27.521460 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"image-registry-certificates\"" Jun 09 15:01:27.521723 ip-10-0-133-239 kubenswrapper[2576]: I0609 15:01:27.521501 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"kube-root-ca.crt\"" Jun 09 15:01:27.521723 ip-10-0-133-239 kubenswrapper[2576]: I0609 15:01:27.521681 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"node-ca-dockercfg-2wbwn\"" Jun 09 15:01:27.523508 ip-10-0-133-239 kubenswrapper[2576]: I0609 15:01:27.523476 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-sa-dockercfg-bkg26\"" Jun 09 15:01:27.524274 ip-10-0-133-239 kubenswrapper[2576]: I0609 15:01:27.523771 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"openshift-service-ca.crt\"" Jun 09 15:01:27.524274 ip-10-0-133-239 kubenswrapper[2576]: I0609 15:01:27.523860 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"kube-root-ca.crt\"" Jun 09 15:01:27.524274 ip-10-0-133-239 kubenswrapper[2576]: I0609 15:01:27.523890 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-script\"" Jun 09 15:01:27.524274 ip-10-0-133-239 kubenswrapper[2576]: I0609 15:01:27.524017 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"openshift-service-ca.crt\"" Jun 09 15:01:27.524274 ip-10-0-133-239 kubenswrapper[2576]: I0609 15:01:27.524156 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-metrics-serving-cert\"" Jun 09 15:01:27.525012 ip-10-0-133-239 kubenswrapper[2576]: I0609 15:01:27.524991 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"kube-root-ca.crt\"" Jun 09 15:01:27.525502 ip-10-0-133-239 kubenswrapper[2576]: I0609 15:01:27.525440 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-dockercfg-fx2fm\"" Jun 09 15:01:27.526558 ip-10-0-133-239 kubenswrapper[2576]: I0609 15:01:27.526530 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-hplk7" Jun 09 15:01:27.528011 ip-10-0-133-239 kubenswrapper[2576]: I0609 15:01:27.527989 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-rvk7p" Jun 09 15:01:27.528598 ip-10-0-133-239 kubenswrapper[2576]: I0609 15:01:27.528578 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"openshift-service-ca.crt\"" Jun 09 15:01:27.528733 ip-10-0-133-239 kubenswrapper[2576]: I0609 15:01:27.528637 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"tuned-dockercfg-hrqdw\"" Jun 09 15:01:27.528733 ip-10-0-133-239 kubenswrapper[2576]: I0609 15:01:27.528720 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"kube-root-ca.crt\"" Jun 09 15:01:27.529217 ip-10-0-133-239 kubenswrapper[2576]: I0609 15:01:27.529202 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-rw24f" Jun 09 15:01:27.529312 ip-10-0-133-239 kubenswrapper[2576]: E0609 15:01:27.529272 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-rw24f" podUID="64cfa4da-d67f-413d-b01d-161226f943e7" Jun 09 15:01:27.529955 ip-10-0-133-239 kubenswrapper[2576]: I0609 15:01:27.529940 2576 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kubelet-serving" Jun 09 15:01:27.530492 ip-10-0-133-239 kubenswrapper[2576]: I0609 15:01:27.530445 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-d5rht" Jun 09 15:01:27.532018 ip-10-0-133-239 kubenswrapper[2576]: I0609 15:01:27.532003 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-n4c97" Jun 09 15:01:27.532160 ip-10-0-133-239 kubenswrapper[2576]: I0609 15:01:27.532123 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"default-cni-sysctl-allowlist\"" Jun 09 15:01:27.532420 ip-10-0-133-239 kubenswrapper[2576]: I0609 15:01:27.532045 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"whereabouts-flatfile-config\"" Jun 09 15:01:27.532759 ip-10-0-133-239 kubenswrapper[2576]: I0609 15:01:27.532739 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"openshift-service-ca.crt\"" Jun 09 15:01:27.532759 ip-10-0-133-239 kubenswrapper[2576]: I0609 15:01:27.532739 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"node-resolver-dockercfg-wqqlj\"" Jun 09 15:01:27.532889 ip-10-0-133-239 kubenswrapper[2576]: I0609 15:01:27.532777 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"kube-root-ca.crt\"" Jun 09 15:01:27.532889 ip-10-0-133-239 kubenswrapper[2576]: I0609 15:01:27.532792 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"multus-ancillary-tools-dockercfg-6xshf\"" Jun 09 15:01:27.533395 ip-10-0-133-239 kubenswrapper[2576]: I0609 15:01:27.533316 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-256sj" Jun 09 15:01:27.533472 ip-10-0-133-239 kubenswrapper[2576]: E0609 15:01:27.533396 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-256sj" podUID="14860286-bb9d-4f00-864f-c2b041a3b160" Jun 09 15:01:27.534578 ip-10-0-133-239 kubenswrapper[2576]: I0609 15:01:27.534441 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-tz8c7" Jun 09 15:01:27.535515 ip-10-0-133-239 kubenswrapper[2576]: I0609 15:01:27.535496 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-p6wz2" Jun 09 15:01:27.535593 ip-10-0-133-239 kubenswrapper[2576]: E0609 15:01:27.535553 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-p6wz2" podUID="95bb5504-8d73-44b5-84c6-4312e96be459" Jun 09 15:01:27.536783 ip-10-0-133-239 kubenswrapper[2576]: I0609 15:01:27.536715 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"openshift-service-ca.crt\"" Jun 09 15:01:27.536977 ip-10-0-133-239 kubenswrapper[2576]: I0609 15:01:27.536955 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-kubernetes-node-dockercfg-5csn5\"" Jun 09 15:01:27.537156 ip-10-0-133-239 kubenswrapper[2576]: I0609 15:01:27.537140 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-script-lib\"" Jun 09 15:01:27.537377 ip-10-0-133-239 kubenswrapper[2576]: I0609 15:01:27.537357 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"kube-root-ca.crt\"" Jun 09 15:01:27.537465 ip-10-0-133-239 kubenswrapper[2576]: I0609 15:01:27.537420 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kube-system\"/\"konnectivity-ca-bundle\"" Jun 09 15:01:27.537649 ip-10-0-133-239 kubenswrapper[2576]: I0609 15:01:27.537634 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-node-metrics-cert\"" Jun 09 15:01:27.537716 ip-10-0-133-239 kubenswrapper[2576]: I0609 15:01:27.537699 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-config\"" Jun 09 15:01:27.537768 ip-10-0-133-239 kubenswrapper[2576]: I0609 15:01:27.537750 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"env-overrides\"" Jun 09 15:01:27.537768 ip-10-0-133-239 kubenswrapper[2576]: I0609 15:01:27.537699 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"default-dockercfg-4f7dj\"" Jun 09 15:01:27.537995 ip-10-0-133-239 kubenswrapper[2576]: I0609 15:01:27.537981 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"konnectivity-agent\"" Jun 09 15:01:27.540807 ip-10-0-133-239 kubenswrapper[2576]: I0609 15:01:27.540786 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/d5a7276b-a84f-4a88-b220-eb46f36768a0-host-run-multus-certs\") pod \"multus-96jh2\" (UID: \"d5a7276b-a84f-4a88-b220-eb46f36768a0\") " pod="openshift-multus/multus-96jh2" Jun 09 15:01:27.540895 ip-10-0-133-239 kubenswrapper[2576]: I0609 15:01:27.540822 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jlwm5\" (UniqueName: \"kubernetes.io/projected/d5a7276b-a84f-4a88-b220-eb46f36768a0-kube-api-access-jlwm5\") pod \"multus-96jh2\" (UID: \"d5a7276b-a84f-4a88-b220-eb46f36768a0\") " pod="openshift-multus/multus-96jh2" Jun 09 15:01:27.540895 ip-10-0-133-239 kubenswrapper[2576]: I0609 15:01:27.540846 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/ab1b7146-38f5-4c67-b79c-d98d8f1734e8-host\") pod \"node-ca-n4qqs\" (UID: \"ab1b7146-38f5-4c67-b79c-d98d8f1734e8\") " pod="openshift-image-registry/node-ca-n4qqs" Jun 09 15:01:27.540994 ip-10-0-133-239 kubenswrapper[2576]: I0609 15:01:27.540890 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6kb67\" (UniqueName: \"kubernetes.io/projected/ab1b7146-38f5-4c67-b79c-d98d8f1734e8-kube-api-access-6kb67\") pod \"node-ca-n4qqs\" (UID: \"ab1b7146-38f5-4c67-b79c-d98d8f1734e8\") " pod="openshift-image-registry/node-ca-n4qqs" Jun 09 15:01:27.540994 ip-10-0-133-239 kubenswrapper[2576]: I0609 15:01:27.540933 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/ab1b7146-38f5-4c67-b79c-d98d8f1734e8-serviceca\") pod \"node-ca-n4qqs\" (UID: \"ab1b7146-38f5-4c67-b79c-d98d8f1734e8\") " pod="openshift-image-registry/node-ca-n4qqs" Jun 09 15:01:27.540994 ip-10-0-133-239 kubenswrapper[2576]: I0609 15:01:27.540959 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-csrg4\" (UniqueName: \"kubernetes.io/projected/70b6eb4f-8b63-4ca7-ad8c-b558c1f71ad8-kube-api-access-csrg4\") pod \"tuned-hplk7\" (UID: \"70b6eb4f-8b63-4ca7-ad8c-b558c1f71ad8\") " pod="openshift-cluster-node-tuning-operator/tuned-hplk7" Jun 09 15:01:27.540994 ip-10-0-133-239 kubenswrapper[2576]: I0609 15:01:27.540990 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/819c59d4-2dfd-40f7-8018-dc29890cc325-hosts-file\") pod \"node-resolver-d5rht\" (UID: \"819c59d4-2dfd-40f7-8018-dc29890cc325\") " pod="openshift-dns/node-resolver-d5rht" Jun 09 15:01:27.541210 ip-10-0-133-239 kubenswrapper[2576]: I0609 15:01:27.541012 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/d5a7276b-a84f-4a88-b220-eb46f36768a0-host-var-lib-kubelet\") pod \"multus-96jh2\" (UID: \"d5a7276b-a84f-4a88-b220-eb46f36768a0\") " pod="openshift-multus/multus-96jh2" Jun 09 15:01:27.541210 ip-10-0-133-239 kubenswrapper[2576]: I0609 15:01:27.541042 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/70b6eb4f-8b63-4ca7-ad8c-b558c1f71ad8-var-lib-kubelet\") pod \"tuned-hplk7\" (UID: \"70b6eb4f-8b63-4ca7-ad8c-b558c1f71ad8\") " pod="openshift-cluster-node-tuning-operator/tuned-hplk7" Jun 09 15:01:27.541210 ip-10-0-133-239 kubenswrapper[2576]: I0609 15:01:27.541092 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/70b6eb4f-8b63-4ca7-ad8c-b558c1f71ad8-etc-sysctl-d\") pod \"tuned-hplk7\" (UID: \"70b6eb4f-8b63-4ca7-ad8c-b558c1f71ad8\") " pod="openshift-cluster-node-tuning-operator/tuned-hplk7" Jun 09 15:01:27.541210 ip-10-0-133-239 kubenswrapper[2576]: I0609 15:01:27.541128 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/64cfa4da-d67f-413d-b01d-161226f943e7-metrics-certs\") pod \"network-metrics-daemon-rw24f\" (UID: \"64cfa4da-d67f-413d-b01d-161226f943e7\") " pod="openshift-multus/network-metrics-daemon-rw24f" Jun 09 15:01:27.541210 ip-10-0-133-239 kubenswrapper[2576]: I0609 15:01:27.541150 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/d5a7276b-a84f-4a88-b220-eb46f36768a0-cnibin\") pod \"multus-96jh2\" (UID: \"d5a7276b-a84f-4a88-b220-eb46f36768a0\") " pod="openshift-multus/multus-96jh2" Jun 09 15:01:27.541210 ip-10-0-133-239 kubenswrapper[2576]: I0609 15:01:27.541165 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/d5a7276b-a84f-4a88-b220-eb46f36768a0-hostroot\") pod \"multus-96jh2\" (UID: \"d5a7276b-a84f-4a88-b220-eb46f36768a0\") " pod="openshift-multus/multus-96jh2" Jun 09 15:01:27.541210 ip-10-0-133-239 kubenswrapper[2576]: I0609 15:01:27.541180 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/d5a7276b-a84f-4a88-b220-eb46f36768a0-multus-conf-dir\") pod \"multus-96jh2\" (UID: \"d5a7276b-a84f-4a88-b220-eb46f36768a0\") " pod="openshift-multus/multus-96jh2" Jun 09 15:01:27.541210 ip-10-0-133-239 kubenswrapper[2576]: I0609 15:01:27.541202 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/70b6eb4f-8b63-4ca7-ad8c-b558c1f71ad8-etc-systemd\") pod \"tuned-hplk7\" (UID: \"70b6eb4f-8b63-4ca7-ad8c-b558c1f71ad8\") " pod="openshift-cluster-node-tuning-operator/tuned-hplk7" Jun 09 15:01:27.541549 ip-10-0-133-239 kubenswrapper[2576]: I0609 15:01:27.541236 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-94gpp\" (UniqueName: \"kubernetes.io/projected/65d781cf-2987-4208-9e71-64260d0bb38a-kube-api-access-94gpp\") pod \"aws-ebs-csi-driver-node-f7pk9\" (UID: \"65d781cf-2987-4208-9e71-64260d0bb38a\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-f7pk9" Jun 09 15:01:27.541549 ip-10-0-133-239 kubenswrapper[2576]: I0609 15:01:27.541267 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/d5a7276b-a84f-4a88-b220-eb46f36768a0-multus-cni-dir\") pod \"multus-96jh2\" (UID: \"d5a7276b-a84f-4a88-b220-eb46f36768a0\") " pod="openshift-multus/multus-96jh2" Jun 09 15:01:27.541549 ip-10-0-133-239 kubenswrapper[2576]: I0609 15:01:27.541292 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/d5a7276b-a84f-4a88-b220-eb46f36768a0-multus-socket-dir-parent\") pod \"multus-96jh2\" (UID: \"d5a7276b-a84f-4a88-b220-eb46f36768a0\") " pod="openshift-multus/multus-96jh2" Jun 09 15:01:27.541549 ip-10-0-133-239 kubenswrapper[2576]: I0609 15:01:27.541313 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/d5a7276b-a84f-4a88-b220-eb46f36768a0-etc-kubernetes\") pod \"multus-96jh2\" (UID: \"d5a7276b-a84f-4a88-b220-eb46f36768a0\") " pod="openshift-multus/multus-96jh2" Jun 09 15:01:27.541549 ip-10-0-133-239 kubenswrapper[2576]: I0609 15:01:27.541327 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/70b6eb4f-8b63-4ca7-ad8c-b558c1f71ad8-host\") pod \"tuned-hplk7\" (UID: \"70b6eb4f-8b63-4ca7-ad8c-b558c1f71ad8\") " pod="openshift-cluster-node-tuning-operator/tuned-hplk7" Jun 09 15:01:27.541549 ip-10-0-133-239 kubenswrapper[2576]: I0609 15:01:27.541348 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/70b6eb4f-8b63-4ca7-ad8c-b558c1f71ad8-etc-modprobe-d\") pod \"tuned-hplk7\" (UID: \"70b6eb4f-8b63-4ca7-ad8c-b558c1f71ad8\") " pod="openshift-cluster-node-tuning-operator/tuned-hplk7" Jun 09 15:01:27.541549 ip-10-0-133-239 kubenswrapper[2576]: I0609 15:01:27.541372 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/70b6eb4f-8b63-4ca7-ad8c-b558c1f71ad8-etc-sysconfig\") pod \"tuned-hplk7\" (UID: \"70b6eb4f-8b63-4ca7-ad8c-b558c1f71ad8\") " pod="openshift-cluster-node-tuning-operator/tuned-hplk7" Jun 09 15:01:27.541549 ip-10-0-133-239 kubenswrapper[2576]: I0609 15:01:27.541393 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/70b6eb4f-8b63-4ca7-ad8c-b558c1f71ad8-sys\") pod \"tuned-hplk7\" (UID: \"70b6eb4f-8b63-4ca7-ad8c-b558c1f71ad8\") " pod="openshift-cluster-node-tuning-operator/tuned-hplk7" Jun 09 15:01:27.541549 ip-10-0-133-239 kubenswrapper[2576]: I0609 15:01:27.541415 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/77714a52-c22d-45f0-939d-b2a256bd511e-cnibin\") pod \"multus-additional-cni-plugins-rvk7p\" (UID: \"77714a52-c22d-45f0-939d-b2a256bd511e\") " pod="openshift-multus/multus-additional-cni-plugins-rvk7p" Jun 09 15:01:27.541549 ip-10-0-133-239 kubenswrapper[2576]: I0609 15:01:27.541454 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/d5a7276b-a84f-4a88-b220-eb46f36768a0-host-var-lib-cni-bin\") pod \"multus-96jh2\" (UID: \"d5a7276b-a84f-4a88-b220-eb46f36768a0\") " pod="openshift-multus/multus-96jh2" Jun 09 15:01:27.541549 ip-10-0-133-239 kubenswrapper[2576]: I0609 15:01:27.541482 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/70b6eb4f-8b63-4ca7-ad8c-b558c1f71ad8-tmp\") pod \"tuned-hplk7\" (UID: \"70b6eb4f-8b63-4ca7-ad8c-b558c1f71ad8\") " pod="openshift-cluster-node-tuning-operator/tuned-hplk7" Jun 09 15:01:27.541549 ip-10-0-133-239 kubenswrapper[2576]: I0609 15:01:27.541505 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/65d781cf-2987-4208-9e71-64260d0bb38a-socket-dir\") pod \"aws-ebs-csi-driver-node-f7pk9\" (UID: \"65d781cf-2987-4208-9e71-64260d0bb38a\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-f7pk9" Jun 09 15:01:27.542130 ip-10-0-133-239 kubenswrapper[2576]: I0609 15:01:27.541571 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/65d781cf-2987-4208-9e71-64260d0bb38a-device-dir\") pod \"aws-ebs-csi-driver-node-f7pk9\" (UID: \"65d781cf-2987-4208-9e71-64260d0bb38a\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-f7pk9" Jun 09 15:01:27.542130 ip-10-0-133-239 kubenswrapper[2576]: I0609 15:01:27.541605 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/d5a7276b-a84f-4a88-b220-eb46f36768a0-host-var-lib-cni-multus\") pod \"multus-96jh2\" (UID: \"d5a7276b-a84f-4a88-b220-eb46f36768a0\") " pod="openshift-multus/multus-96jh2" Jun 09 15:01:27.542130 ip-10-0-133-239 kubenswrapper[2576]: I0609 15:01:27.541622 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-r99vl\" (UniqueName: \"kubernetes.io/projected/77714a52-c22d-45f0-939d-b2a256bd511e-kube-api-access-r99vl\") pod \"multus-additional-cni-plugins-rvk7p\" (UID: \"77714a52-c22d-45f0-939d-b2a256bd511e\") " pod="openshift-multus/multus-additional-cni-plugins-rvk7p" Jun 09 15:01:27.542130 ip-10-0-133-239 kubenswrapper[2576]: I0609 15:01:27.541646 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/16507eac-27c4-4ac4-b8a7-16d36c11a8d9-iptables-alerter-script\") pod \"iptables-alerter-db5nc\" (UID: \"16507eac-27c4-4ac4-b8a7-16d36c11a8d9\") " pod="openshift-network-operator/iptables-alerter-db5nc" Jun 09 15:01:27.542130 ip-10-0-133-239 kubenswrapper[2576]: I0609 15:01:27.541662 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/16507eac-27c4-4ac4-b8a7-16d36c11a8d9-host-slash\") pod \"iptables-alerter-db5nc\" (UID: \"16507eac-27c4-4ac4-b8a7-16d36c11a8d9\") " pod="openshift-network-operator/iptables-alerter-db5nc" Jun 09 15:01:27.542130 ip-10-0-133-239 kubenswrapper[2576]: I0609 15:01:27.541676 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-79x7h\" (UniqueName: \"kubernetes.io/projected/16507eac-27c4-4ac4-b8a7-16d36c11a8d9-kube-api-access-79x7h\") pod \"iptables-alerter-db5nc\" (UID: \"16507eac-27c4-4ac4-b8a7-16d36c11a8d9\") " pod="openshift-network-operator/iptables-alerter-db5nc" Jun 09 15:01:27.542130 ip-10-0-133-239 kubenswrapper[2576]: I0609 15:01:27.541699 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/70b6eb4f-8b63-4ca7-ad8c-b558c1f71ad8-etc-kubernetes\") pod \"tuned-hplk7\" (UID: \"70b6eb4f-8b63-4ca7-ad8c-b558c1f71ad8\") " pod="openshift-cluster-node-tuning-operator/tuned-hplk7" Jun 09 15:01:27.542130 ip-10-0-133-239 kubenswrapper[2576]: I0609 15:01:27.541720 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/70b6eb4f-8b63-4ca7-ad8c-b558c1f71ad8-lib-modules\") pod \"tuned-hplk7\" (UID: \"70b6eb4f-8b63-4ca7-ad8c-b558c1f71ad8\") " pod="openshift-cluster-node-tuning-operator/tuned-hplk7" Jun 09 15:01:27.542130 ip-10-0-133-239 kubenswrapper[2576]: I0609 15:01:27.541743 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/65d781cf-2987-4208-9e71-64260d0bb38a-registration-dir\") pod \"aws-ebs-csi-driver-node-f7pk9\" (UID: \"65d781cf-2987-4208-9e71-64260d0bb38a\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-f7pk9" Jun 09 15:01:27.542130 ip-10-0-133-239 kubenswrapper[2576]: I0609 15:01:27.541769 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/77714a52-c22d-45f0-939d-b2a256bd511e-cni-binary-copy\") pod \"multus-additional-cni-plugins-rvk7p\" (UID: \"77714a52-c22d-45f0-939d-b2a256bd511e\") " pod="openshift-multus/multus-additional-cni-plugins-rvk7p" Jun 09 15:01:27.542130 ip-10-0-133-239 kubenswrapper[2576]: I0609 15:01:27.541784 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/70b6eb4f-8b63-4ca7-ad8c-b558c1f71ad8-etc-tuned\") pod \"tuned-hplk7\" (UID: \"70b6eb4f-8b63-4ca7-ad8c-b558c1f71ad8\") " pod="openshift-cluster-node-tuning-operator/tuned-hplk7" Jun 09 15:01:27.542130 ip-10-0-133-239 kubenswrapper[2576]: I0609 15:01:27.541804 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-sx8kd\" (UniqueName: \"kubernetes.io/projected/64cfa4da-d67f-413d-b01d-161226f943e7-kube-api-access-sx8kd\") pod \"network-metrics-daemon-rw24f\" (UID: \"64cfa4da-d67f-413d-b01d-161226f943e7\") " pod="openshift-multus/network-metrics-daemon-rw24f" Jun 09 15:01:27.542130 ip-10-0-133-239 kubenswrapper[2576]: I0609 15:01:27.541828 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/77714a52-c22d-45f0-939d-b2a256bd511e-os-release\") pod \"multus-additional-cni-plugins-rvk7p\" (UID: \"77714a52-c22d-45f0-939d-b2a256bd511e\") " pod="openshift-multus/multus-additional-cni-plugins-rvk7p" Jun 09 15:01:27.542130 ip-10-0-133-239 kubenswrapper[2576]: I0609 15:01:27.541853 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/77714a52-c22d-45f0-939d-b2a256bd511e-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-rvk7p\" (UID: \"77714a52-c22d-45f0-939d-b2a256bd511e\") " pod="openshift-multus/multus-additional-cni-plugins-rvk7p" Jun 09 15:01:27.542130 ip-10-0-133-239 kubenswrapper[2576]: I0609 15:01:27.541874 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/d5a7276b-a84f-4a88-b220-eb46f36768a0-os-release\") pod \"multus-96jh2\" (UID: \"d5a7276b-a84f-4a88-b220-eb46f36768a0\") " pod="openshift-multus/multus-96jh2" Jun 09 15:01:27.542130 ip-10-0-133-239 kubenswrapper[2576]: I0609 15:01:27.541899 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/d5a7276b-a84f-4a88-b220-eb46f36768a0-multus-daemon-config\") pod \"multus-96jh2\" (UID: \"d5a7276b-a84f-4a88-b220-eb46f36768a0\") " pod="openshift-multus/multus-96jh2" Jun 09 15:01:27.542887 ip-10-0-133-239 kubenswrapper[2576]: I0609 15:01:27.541914 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/70b6eb4f-8b63-4ca7-ad8c-b558c1f71ad8-etc-sysctl-conf\") pod \"tuned-hplk7\" (UID: \"70b6eb4f-8b63-4ca7-ad8c-b558c1f71ad8\") " pod="openshift-cluster-node-tuning-operator/tuned-hplk7" Jun 09 15:01:27.542887 ip-10-0-133-239 kubenswrapper[2576]: I0609 15:01:27.541946 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/65d781cf-2987-4208-9e71-64260d0bb38a-sys-fs\") pod \"aws-ebs-csi-driver-node-f7pk9\" (UID: \"65d781cf-2987-4208-9e71-64260d0bb38a\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-f7pk9" Jun 09 15:01:27.542887 ip-10-0-133-239 kubenswrapper[2576]: I0609 15:01:27.541969 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/77714a52-c22d-45f0-939d-b2a256bd511e-system-cni-dir\") pod \"multus-additional-cni-plugins-rvk7p\" (UID: \"77714a52-c22d-45f0-939d-b2a256bd511e\") " pod="openshift-multus/multus-additional-cni-plugins-rvk7p" Jun 09 15:01:27.542887 ip-10-0-133-239 kubenswrapper[2576]: I0609 15:01:27.541993 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/77714a52-c22d-45f0-939d-b2a256bd511e-tuning-conf-dir\") pod \"multus-additional-cni-plugins-rvk7p\" (UID: \"77714a52-c22d-45f0-939d-b2a256bd511e\") " pod="openshift-multus/multus-additional-cni-plugins-rvk7p" Jun 09 15:01:27.542887 ip-10-0-133-239 kubenswrapper[2576]: I0609 15:01:27.542009 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/d5a7276b-a84f-4a88-b220-eb46f36768a0-cni-binary-copy\") pod \"multus-96jh2\" (UID: \"d5a7276b-a84f-4a88-b220-eb46f36768a0\") " pod="openshift-multus/multus-96jh2" Jun 09 15:01:27.542887 ip-10-0-133-239 kubenswrapper[2576]: I0609 15:01:27.542026 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/70b6eb4f-8b63-4ca7-ad8c-b558c1f71ad8-run\") pod \"tuned-hplk7\" (UID: \"70b6eb4f-8b63-4ca7-ad8c-b558c1f71ad8\") " pod="openshift-cluster-node-tuning-operator/tuned-hplk7" Jun 09 15:01:27.542887 ip-10-0-133-239 kubenswrapper[2576]: I0609 15:01:27.542048 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/77714a52-c22d-45f0-939d-b2a256bd511e-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-rvk7p\" (UID: \"77714a52-c22d-45f0-939d-b2a256bd511e\") " pod="openshift-multus/multus-additional-cni-plugins-rvk7p" Jun 09 15:01:27.542887 ip-10-0-133-239 kubenswrapper[2576]: I0609 15:01:27.542081 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/d5a7276b-a84f-4a88-b220-eb46f36768a0-host-run-k8s-cni-cncf-io\") pod \"multus-96jh2\" (UID: \"d5a7276b-a84f-4a88-b220-eb46f36768a0\") " pod="openshift-multus/multus-96jh2" Jun 09 15:01:27.542887 ip-10-0-133-239 kubenswrapper[2576]: I0609 15:01:27.542101 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/819c59d4-2dfd-40f7-8018-dc29890cc325-tmp-dir\") pod \"node-resolver-d5rht\" (UID: \"819c59d4-2dfd-40f7-8018-dc29890cc325\") " pod="openshift-dns/node-resolver-d5rht" Jun 09 15:01:27.542887 ip-10-0-133-239 kubenswrapper[2576]: I0609 15:01:27.542121 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-j2f5b\" (UniqueName: \"kubernetes.io/projected/819c59d4-2dfd-40f7-8018-dc29890cc325-kube-api-access-j2f5b\") pod \"node-resolver-d5rht\" (UID: \"819c59d4-2dfd-40f7-8018-dc29890cc325\") " pod="openshift-dns/node-resolver-d5rht" Jun 09 15:01:27.542887 ip-10-0-133-239 kubenswrapper[2576]: I0609 15:01:27.542155 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/65d781cf-2987-4208-9e71-64260d0bb38a-kubelet-dir\") pod \"aws-ebs-csi-driver-node-f7pk9\" (UID: \"65d781cf-2987-4208-9e71-64260d0bb38a\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-f7pk9" Jun 09 15:01:27.542887 ip-10-0-133-239 kubenswrapper[2576]: I0609 15:01:27.542179 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/d5a7276b-a84f-4a88-b220-eb46f36768a0-system-cni-dir\") pod \"multus-96jh2\" (UID: \"d5a7276b-a84f-4a88-b220-eb46f36768a0\") " pod="openshift-multus/multus-96jh2" Jun 09 15:01:27.542887 ip-10-0-133-239 kubenswrapper[2576]: I0609 15:01:27.542198 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/65d781cf-2987-4208-9e71-64260d0bb38a-etc-selinux\") pod \"aws-ebs-csi-driver-node-f7pk9\" (UID: \"65d781cf-2987-4208-9e71-64260d0bb38a\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-f7pk9" Jun 09 15:01:27.542887 ip-10-0-133-239 kubenswrapper[2576]: I0609 15:01:27.542236 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/d5a7276b-a84f-4a88-b220-eb46f36768a0-host-run-netns\") pod \"multus-96jh2\" (UID: \"d5a7276b-a84f-4a88-b220-eb46f36768a0\") " pod="openshift-multus/multus-96jh2" Jun 09 15:01:27.543830 ip-10-0-133-239 kubenswrapper[2576]: I0609 15:01:27.543806 2576 reflector.go:439] "Caches populated" logger="kubernetes.io/kubelet-serving" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162" Jun 09 15:01:27.562123 ip-10-0-133-239 kubenswrapper[2576]: I0609 15:01:27.562075 2576 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kubelet-serving" csr="csr-fpb2s" Jun 09 15:01:27.569822 ip-10-0-133-239 kubenswrapper[2576]: I0609 15:01:27.569793 2576 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kubelet-serving" csr="csr-fpb2s" Jun 09 15:01:27.631020 ip-10-0-133-239 kubenswrapper[2576]: I0609 15:01:27.630985 2576 desired_state_of_world_populator.go:154] "Finished populating initial desired state of world" Jun 09 15:01:27.642401 ip-10-0-133-239 kubenswrapper[2576]: I0609 15:01:27.642366 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/70b6eb4f-8b63-4ca7-ad8c-b558c1f71ad8-run\") pod \"tuned-hplk7\" (UID: \"70b6eb4f-8b63-4ca7-ad8c-b558c1f71ad8\") " pod="openshift-cluster-node-tuning-operator/tuned-hplk7" Jun 09 15:01:27.642401 ip-10-0-133-239 kubenswrapper[2576]: I0609 15:01:27.642401 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/77714a52-c22d-45f0-939d-b2a256bd511e-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-rvk7p\" (UID: \"77714a52-c22d-45f0-939d-b2a256bd511e\") " pod="openshift-multus/multus-additional-cni-plugins-rvk7p" Jun 09 15:01:27.642629 ip-10-0-133-239 kubenswrapper[2576]: I0609 15:01:27.642428 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/d5a7276b-a84f-4a88-b220-eb46f36768a0-host-run-k8s-cni-cncf-io\") pod \"multus-96jh2\" (UID: \"d5a7276b-a84f-4a88-b220-eb46f36768a0\") " pod="openshift-multus/multus-96jh2" Jun 09 15:01:27.642629 ip-10-0-133-239 kubenswrapper[2576]: I0609 15:01:27.642446 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/819c59d4-2dfd-40f7-8018-dc29890cc325-tmp-dir\") pod \"node-resolver-d5rht\" (UID: \"819c59d4-2dfd-40f7-8018-dc29890cc325\") " pod="openshift-dns/node-resolver-d5rht" Jun 09 15:01:27.642629 ip-10-0-133-239 kubenswrapper[2576]: I0609 15:01:27.642466 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/441b2a74-d62c-4e3c-9e0f-b133cd4364be-ovn-node-metrics-cert\") pod \"ovnkube-node-n4c97\" (UID: \"441b2a74-d62c-4e3c-9e0f-b133cd4364be\") " pod="openshift-ovn-kubernetes/ovnkube-node-n4c97" Jun 09 15:01:27.642629 ip-10-0-133-239 kubenswrapper[2576]: I0609 15:01:27.642475 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run\" (UniqueName: \"kubernetes.io/host-path/70b6eb4f-8b63-4ca7-ad8c-b558c1f71ad8-run\") pod \"tuned-hplk7\" (UID: \"70b6eb4f-8b63-4ca7-ad8c-b558c1f71ad8\") " pod="openshift-cluster-node-tuning-operator/tuned-hplk7" Jun 09 15:01:27.642629 ip-10-0-133-239 kubenswrapper[2576]: I0609 15:01:27.642491 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-j2f5b\" (UniqueName: \"kubernetes.io/projected/819c59d4-2dfd-40f7-8018-dc29890cc325-kube-api-access-j2f5b\") pod \"node-resolver-d5rht\" (UID: \"819c59d4-2dfd-40f7-8018-dc29890cc325\") " pod="openshift-dns/node-resolver-d5rht" Jun 09 15:01:27.642629 ip-10-0-133-239 kubenswrapper[2576]: I0609 15:01:27.642516 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/65d781cf-2987-4208-9e71-64260d0bb38a-kubelet-dir\") pod \"aws-ebs-csi-driver-node-f7pk9\" (UID: \"65d781cf-2987-4208-9e71-64260d0bb38a\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-f7pk9" Jun 09 15:01:27.642629 ip-10-0-133-239 kubenswrapper[2576]: I0609 15:01:27.642540 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/d5a7276b-a84f-4a88-b220-eb46f36768a0-system-cni-dir\") pod \"multus-96jh2\" (UID: \"d5a7276b-a84f-4a88-b220-eb46f36768a0\") " pod="openshift-multus/multus-96jh2" Jun 09 15:01:27.642629 ip-10-0-133-239 kubenswrapper[2576]: I0609 15:01:27.642536 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/d5a7276b-a84f-4a88-b220-eb46f36768a0-host-run-k8s-cni-cncf-io\") pod \"multus-96jh2\" (UID: \"d5a7276b-a84f-4a88-b220-eb46f36768a0\") " pod="openshift-multus/multus-96jh2" Jun 09 15:01:27.642629 ip-10-0-133-239 kubenswrapper[2576]: I0609 15:01:27.642562 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/441b2a74-d62c-4e3c-9e0f-b133cd4364be-host-run-netns\") pod \"ovnkube-node-n4c97\" (UID: \"441b2a74-d62c-4e3c-9e0f-b133cd4364be\") " pod="openshift-ovn-kubernetes/ovnkube-node-n4c97" Jun 09 15:01:27.642629 ip-10-0-133-239 kubenswrapper[2576]: I0609 15:01:27.642584 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/441b2a74-d62c-4e3c-9e0f-b133cd4364be-run-systemd\") pod \"ovnkube-node-n4c97\" (UID: \"441b2a74-d62c-4e3c-9e0f-b133cd4364be\") " pod="openshift-ovn-kubernetes/ovnkube-node-n4c97" Jun 09 15:01:27.642629 ip-10-0-133-239 kubenswrapper[2576]: I0609 15:01:27.642615 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/65d781cf-2987-4208-9e71-64260d0bb38a-kubelet-dir\") pod \"aws-ebs-csi-driver-node-f7pk9\" (UID: \"65d781cf-2987-4208-9e71-64260d0bb38a\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-f7pk9" Jun 09 15:01:27.642629 ip-10-0-133-239 kubenswrapper[2576]: I0609 15:01:27.642609 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/65d781cf-2987-4208-9e71-64260d0bb38a-etc-selinux\") pod \"aws-ebs-csi-driver-node-f7pk9\" (UID: \"65d781cf-2987-4208-9e71-64260d0bb38a\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-f7pk9" Jun 09 15:01:27.643182 ip-10-0-133-239 kubenswrapper[2576]: I0609 15:01:27.642660 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/d5a7276b-a84f-4a88-b220-eb46f36768a0-host-run-netns\") pod \"multus-96jh2\" (UID: \"d5a7276b-a84f-4a88-b220-eb46f36768a0\") " pod="openshift-multus/multus-96jh2" Jun 09 15:01:27.643182 ip-10-0-133-239 kubenswrapper[2576]: I0609 15:01:27.642689 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-l6z46\" (UniqueName: \"kubernetes.io/projected/95bb5504-8d73-44b5-84c6-4312e96be459-kube-api-access-l6z46\") pod \"network-check-target-p6wz2\" (UID: \"95bb5504-8d73-44b5-84c6-4312e96be459\") " pod="openshift-network-diagnostics/network-check-target-p6wz2" Jun 09 15:01:27.643182 ip-10-0-133-239 kubenswrapper[2576]: I0609 15:01:27.642699 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/d5a7276b-a84f-4a88-b220-eb46f36768a0-system-cni-dir\") pod \"multus-96jh2\" (UID: \"d5a7276b-a84f-4a88-b220-eb46f36768a0\") " pod="openshift-multus/multus-96jh2" Jun 09 15:01:27.643182 ip-10-0-133-239 kubenswrapper[2576]: I0609 15:01:27.642717 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/441b2a74-d62c-4e3c-9e0f-b133cd4364be-host-kubelet\") pod \"ovnkube-node-n4c97\" (UID: \"441b2a74-d62c-4e3c-9e0f-b133cd4364be\") " pod="openshift-ovn-kubernetes/ovnkube-node-n4c97" Jun 09 15:01:27.643182 ip-10-0-133-239 kubenswrapper[2576]: I0609 15:01:27.642741 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/441b2a74-d62c-4e3c-9e0f-b133cd4364be-log-socket\") pod \"ovnkube-node-n4c97\" (UID: \"441b2a74-d62c-4e3c-9e0f-b133cd4364be\") " pod="openshift-ovn-kubernetes/ovnkube-node-n4c97" Jun 09 15:01:27.643182 ip-10-0-133-239 kubenswrapper[2576]: I0609 15:01:27.642747 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/65d781cf-2987-4208-9e71-64260d0bb38a-etc-selinux\") pod \"aws-ebs-csi-driver-node-f7pk9\" (UID: \"65d781cf-2987-4208-9e71-64260d0bb38a\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-f7pk9" Jun 09 15:01:27.643182 ip-10-0-133-239 kubenswrapper[2576]: I0609 15:01:27.642769 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/819c59d4-2dfd-40f7-8018-dc29890cc325-tmp-dir\") pod \"node-resolver-d5rht\" (UID: \"819c59d4-2dfd-40f7-8018-dc29890cc325\") " pod="openshift-dns/node-resolver-d5rht" Jun 09 15:01:27.643182 ip-10-0-133-239 kubenswrapper[2576]: I0609 15:01:27.642782 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/d5a7276b-a84f-4a88-b220-eb46f36768a0-host-run-netns\") pod \"multus-96jh2\" (UID: \"d5a7276b-a84f-4a88-b220-eb46f36768a0\") " pod="openshift-multus/multus-96jh2" Jun 09 15:01:27.643182 ip-10-0-133-239 kubenswrapper[2576]: I0609 15:01:27.642791 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/441b2a74-d62c-4e3c-9e0f-b133cd4364be-var-lib-openvswitch\") pod \"ovnkube-node-n4c97\" (UID: \"441b2a74-d62c-4e3c-9e0f-b133cd4364be\") " pod="openshift-ovn-kubernetes/ovnkube-node-n4c97" Jun 09 15:01:27.643182 ip-10-0-133-239 kubenswrapper[2576]: I0609 15:01:27.642822 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/441b2a74-d62c-4e3c-9e0f-b133cd4364be-host-run-ovn-kubernetes\") pod \"ovnkube-node-n4c97\" (UID: \"441b2a74-d62c-4e3c-9e0f-b133cd4364be\") " pod="openshift-ovn-kubernetes/ovnkube-node-n4c97" Jun 09 15:01:27.643182 ip-10-0-133-239 kubenswrapper[2576]: I0609 15:01:27.642843 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/d5a7276b-a84f-4a88-b220-eb46f36768a0-host-run-multus-certs\") pod \"multus-96jh2\" (UID: \"d5a7276b-a84f-4a88-b220-eb46f36768a0\") " pod="openshift-multus/multus-96jh2" Jun 09 15:01:27.643182 ip-10-0-133-239 kubenswrapper[2576]: I0609 15:01:27.642870 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jlwm5\" (UniqueName: \"kubernetes.io/projected/d5a7276b-a84f-4a88-b220-eb46f36768a0-kube-api-access-jlwm5\") pod \"multus-96jh2\" (UID: \"d5a7276b-a84f-4a88-b220-eb46f36768a0\") " pod="openshift-multus/multus-96jh2" Jun 09 15:01:27.643182 ip-10-0-133-239 kubenswrapper[2576]: I0609 15:01:27.642892 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/ab1b7146-38f5-4c67-b79c-d98d8f1734e8-host\") pod \"node-ca-n4qqs\" (UID: \"ab1b7146-38f5-4c67-b79c-d98d8f1734e8\") " pod="openshift-image-registry/node-ca-n4qqs" Jun 09 15:01:27.643182 ip-10-0-133-239 kubenswrapper[2576]: I0609 15:01:27.642906 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/d5a7276b-a84f-4a88-b220-eb46f36768a0-host-run-multus-certs\") pod \"multus-96jh2\" (UID: \"d5a7276b-a84f-4a88-b220-eb46f36768a0\") " pod="openshift-multus/multus-96jh2" Jun 09 15:01:27.643182 ip-10-0-133-239 kubenswrapper[2576]: I0609 15:01:27.642915 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6kb67\" (UniqueName: \"kubernetes.io/projected/ab1b7146-38f5-4c67-b79c-d98d8f1734e8-kube-api-access-6kb67\") pod \"node-ca-n4qqs\" (UID: \"ab1b7146-38f5-4c67-b79c-d98d8f1734e8\") " pod="openshift-image-registry/node-ca-n4qqs" Jun 09 15:01:27.643182 ip-10-0-133-239 kubenswrapper[2576]: I0609 15:01:27.642969 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/aed341a8-0a84-498b-9b3c-75a83a8279bb-konnectivity-ca\") pod \"konnectivity-agent-tz8c7\" (UID: \"aed341a8-0a84-498b-9b3c-75a83a8279bb\") " pod="kube-system/konnectivity-agent-tz8c7" Jun 09 15:01:27.643182 ip-10-0-133-239 kubenswrapper[2576]: I0609 15:01:27.642974 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/ab1b7146-38f5-4c67-b79c-d98d8f1734e8-host\") pod \"node-ca-n4qqs\" (UID: \"ab1b7146-38f5-4c67-b79c-d98d8f1734e8\") " pod="openshift-image-registry/node-ca-n4qqs" Jun 09 15:01:27.643952 ip-10-0-133-239 kubenswrapper[2576]: I0609 15:01:27.642999 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/441b2a74-d62c-4e3c-9e0f-b133cd4364be-host-slash\") pod \"ovnkube-node-n4c97\" (UID: \"441b2a74-d62c-4e3c-9e0f-b133cd4364be\") " pod="openshift-ovn-kubernetes/ovnkube-node-n4c97" Jun 09 15:01:27.643952 ip-10-0-133-239 kubenswrapper[2576]: I0609 15:01:27.643018 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/77714a52-c22d-45f0-939d-b2a256bd511e-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-rvk7p\" (UID: \"77714a52-c22d-45f0-939d-b2a256bd511e\") " pod="openshift-multus/multus-additional-cni-plugins-rvk7p" Jun 09 15:01:27.643952 ip-10-0-133-239 kubenswrapper[2576]: I0609 15:01:27.643029 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/ab1b7146-38f5-4c67-b79c-d98d8f1734e8-serviceca\") pod \"node-ca-n4qqs\" (UID: \"ab1b7146-38f5-4c67-b79c-d98d8f1734e8\") " pod="openshift-image-registry/node-ca-n4qqs" Jun 09 15:01:27.643952 ip-10-0-133-239 kubenswrapper[2576]: I0609 15:01:27.643057 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-csrg4\" (UniqueName: \"kubernetes.io/projected/70b6eb4f-8b63-4ca7-ad8c-b558c1f71ad8-kube-api-access-csrg4\") pod \"tuned-hplk7\" (UID: \"70b6eb4f-8b63-4ca7-ad8c-b558c1f71ad8\") " pod="openshift-cluster-node-tuning-operator/tuned-hplk7" Jun 09 15:01:27.643952 ip-10-0-133-239 kubenswrapper[2576]: I0609 15:01:27.643096 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/819c59d4-2dfd-40f7-8018-dc29890cc325-hosts-file\") pod \"node-resolver-d5rht\" (UID: \"819c59d4-2dfd-40f7-8018-dc29890cc325\") " pod="openshift-dns/node-resolver-d5rht" Jun 09 15:01:27.643952 ip-10-0-133-239 kubenswrapper[2576]: I0609 15:01:27.643113 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/441b2a74-d62c-4e3c-9e0f-b133cd4364be-systemd-units\") pod \"ovnkube-node-n4c97\" (UID: \"441b2a74-d62c-4e3c-9e0f-b133cd4364be\") " pod="openshift-ovn-kubernetes/ovnkube-node-n4c97" Jun 09 15:01:27.643952 ip-10-0-133-239 kubenswrapper[2576]: I0609 15:01:27.643127 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/441b2a74-d62c-4e3c-9e0f-b133cd4364be-etc-openvswitch\") pod \"ovnkube-node-n4c97\" (UID: \"441b2a74-d62c-4e3c-9e0f-b133cd4364be\") " pod="openshift-ovn-kubernetes/ovnkube-node-n4c97" Jun 09 15:01:27.643952 ip-10-0-133-239 kubenswrapper[2576]: I0609 15:01:27.643147 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/d5a7276b-a84f-4a88-b220-eb46f36768a0-host-var-lib-kubelet\") pod \"multus-96jh2\" (UID: \"d5a7276b-a84f-4a88-b220-eb46f36768a0\") " pod="openshift-multus/multus-96jh2" Jun 09 15:01:27.643952 ip-10-0-133-239 kubenswrapper[2576]: I0609 15:01:27.643198 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/819c59d4-2dfd-40f7-8018-dc29890cc325-hosts-file\") pod \"node-resolver-d5rht\" (UID: \"819c59d4-2dfd-40f7-8018-dc29890cc325\") " pod="openshift-dns/node-resolver-d5rht" Jun 09 15:01:27.643952 ip-10-0-133-239 kubenswrapper[2576]: I0609 15:01:27.643255 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/d5a7276b-a84f-4a88-b220-eb46f36768a0-host-var-lib-kubelet\") pod \"multus-96jh2\" (UID: \"d5a7276b-a84f-4a88-b220-eb46f36768a0\") " pod="openshift-multus/multus-96jh2" Jun 09 15:01:27.643952 ip-10-0-133-239 kubenswrapper[2576]: I0609 15:01:27.643255 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/70b6eb4f-8b63-4ca7-ad8c-b558c1f71ad8-var-lib-kubelet\") pod \"tuned-hplk7\" (UID: \"70b6eb4f-8b63-4ca7-ad8c-b558c1f71ad8\") " pod="openshift-cluster-node-tuning-operator/tuned-hplk7" Jun 09 15:01:27.643952 ip-10-0-133-239 kubenswrapper[2576]: I0609 15:01:27.643367 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/70b6eb4f-8b63-4ca7-ad8c-b558c1f71ad8-var-lib-kubelet\") pod \"tuned-hplk7\" (UID: \"70b6eb4f-8b63-4ca7-ad8c-b558c1f71ad8\") " pod="openshift-cluster-node-tuning-operator/tuned-hplk7" Jun 09 15:01:27.643952 ip-10-0-133-239 kubenswrapper[2576]: I0609 15:01:27.643381 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/70b6eb4f-8b63-4ca7-ad8c-b558c1f71ad8-etc-sysctl-d\") pod \"tuned-hplk7\" (UID: \"70b6eb4f-8b63-4ca7-ad8c-b558c1f71ad8\") " pod="openshift-cluster-node-tuning-operator/tuned-hplk7" Jun 09 15:01:27.643952 ip-10-0-133-239 kubenswrapper[2576]: I0609 15:01:27.643428 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/64cfa4da-d67f-413d-b01d-161226f943e7-metrics-certs\") pod \"network-metrics-daemon-rw24f\" (UID: \"64cfa4da-d67f-413d-b01d-161226f943e7\") " pod="openshift-multus/network-metrics-daemon-rw24f" Jun 09 15:01:27.643952 ip-10-0-133-239 kubenswrapper[2576]: I0609 15:01:27.643437 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/ab1b7146-38f5-4c67-b79c-d98d8f1734e8-serviceca\") pod \"node-ca-n4qqs\" (UID: \"ab1b7146-38f5-4c67-b79c-d98d8f1734e8\") " pod="openshift-image-registry/node-ca-n4qqs" Jun 09 15:01:27.643952 ip-10-0-133-239 kubenswrapper[2576]: I0609 15:01:27.643453 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/d5a7276b-a84f-4a88-b220-eb46f36768a0-cnibin\") pod \"multus-96jh2\" (UID: \"d5a7276b-a84f-4a88-b220-eb46f36768a0\") " pod="openshift-multus/multus-96jh2" Jun 09 15:01:27.643952 ip-10-0-133-239 kubenswrapper[2576]: I0609 15:01:27.643477 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/d5a7276b-a84f-4a88-b220-eb46f36768a0-hostroot\") pod \"multus-96jh2\" (UID: \"d5a7276b-a84f-4a88-b220-eb46f36768a0\") " pod="openshift-multus/multus-96jh2" Jun 09 15:01:27.643952 ip-10-0-133-239 kubenswrapper[2576]: I0609 15:01:27.643490 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/70b6eb4f-8b63-4ca7-ad8c-b558c1f71ad8-etc-sysctl-d\") pod \"tuned-hplk7\" (UID: \"70b6eb4f-8b63-4ca7-ad8c-b558c1f71ad8\") " pod="openshift-cluster-node-tuning-operator/tuned-hplk7" Jun 09 15:01:27.644804 ip-10-0-133-239 kubenswrapper[2576]: I0609 15:01:27.643501 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/d5a7276b-a84f-4a88-b220-eb46f36768a0-multus-conf-dir\") pod \"multus-96jh2\" (UID: \"d5a7276b-a84f-4a88-b220-eb46f36768a0\") " pod="openshift-multus/multus-96jh2" Jun 09 15:01:27.644804 ip-10-0-133-239 kubenswrapper[2576]: I0609 15:01:27.643514 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/d5a7276b-a84f-4a88-b220-eb46f36768a0-cnibin\") pod \"multus-96jh2\" (UID: \"d5a7276b-a84f-4a88-b220-eb46f36768a0\") " pod="openshift-multus/multus-96jh2" Jun 09 15:01:27.644804 ip-10-0-133-239 kubenswrapper[2576]: I0609 15:01:27.643535 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/d5a7276b-a84f-4a88-b220-eb46f36768a0-hostroot\") pod \"multus-96jh2\" (UID: \"d5a7276b-a84f-4a88-b220-eb46f36768a0\") " pod="openshift-multus/multus-96jh2" Jun 09 15:01:27.644804 ip-10-0-133-239 kubenswrapper[2576]: E0609 15:01:27.643539 2576 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jun 09 15:01:27.644804 ip-10-0-133-239 kubenswrapper[2576]: I0609 15:01:27.643551 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/d5a7276b-a84f-4a88-b220-eb46f36768a0-multus-conf-dir\") pod \"multus-96jh2\" (UID: \"d5a7276b-a84f-4a88-b220-eb46f36768a0\") " pod="openshift-multus/multus-96jh2" Jun 09 15:01:27.644804 ip-10-0-133-239 kubenswrapper[2576]: I0609 15:01:27.643535 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/70b6eb4f-8b63-4ca7-ad8c-b558c1f71ad8-etc-systemd\") pod \"tuned-hplk7\" (UID: \"70b6eb4f-8b63-4ca7-ad8c-b558c1f71ad8\") " pod="openshift-cluster-node-tuning-operator/tuned-hplk7" Jun 09 15:01:27.644804 ip-10-0-133-239 kubenswrapper[2576]: I0609 15:01:27.643611 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/70b6eb4f-8b63-4ca7-ad8c-b558c1f71ad8-etc-systemd\") pod \"tuned-hplk7\" (UID: \"70b6eb4f-8b63-4ca7-ad8c-b558c1f71ad8\") " pod="openshift-cluster-node-tuning-operator/tuned-hplk7" Jun 09 15:01:27.644804 ip-10-0-133-239 kubenswrapper[2576]: E0609 15:01:27.643638 2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/64cfa4da-d67f-413d-b01d-161226f943e7-metrics-certs podName:64cfa4da-d67f-413d-b01d-161226f943e7 nodeName:}" failed. No retries permitted until 2026-06-09 15:01:28.14360895 +0000 UTC m=+2.997765181 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/64cfa4da-d67f-413d-b01d-161226f943e7-metrics-certs") pod "network-metrics-daemon-rw24f" (UID: "64cfa4da-d67f-413d-b01d-161226f943e7") : object "openshift-multus"/"metrics-daemon-secret" not registered Jun 09 15:01:27.644804 ip-10-0-133-239 kubenswrapper[2576]: I0609 15:01:27.643656 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-94gpp\" (UniqueName: \"kubernetes.io/projected/65d781cf-2987-4208-9e71-64260d0bb38a-kube-api-access-94gpp\") pod \"aws-ebs-csi-driver-node-f7pk9\" (UID: \"65d781cf-2987-4208-9e71-64260d0bb38a\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-f7pk9" Jun 09 15:01:27.644804 ip-10-0-133-239 kubenswrapper[2576]: I0609 15:01:27.643682 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/d5a7276b-a84f-4a88-b220-eb46f36768a0-multus-cni-dir\") pod \"multus-96jh2\" (UID: \"d5a7276b-a84f-4a88-b220-eb46f36768a0\") " pod="openshift-multus/multus-96jh2" Jun 09 15:01:27.644804 ip-10-0-133-239 kubenswrapper[2576]: I0609 15:01:27.643705 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/d5a7276b-a84f-4a88-b220-eb46f36768a0-multus-socket-dir-parent\") pod \"multus-96jh2\" (UID: \"d5a7276b-a84f-4a88-b220-eb46f36768a0\") " pod="openshift-multus/multus-96jh2" Jun 09 15:01:27.644804 ip-10-0-133-239 kubenswrapper[2576]: I0609 15:01:27.643760 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/d5a7276b-a84f-4a88-b220-eb46f36768a0-multus-cni-dir\") pod \"multus-96jh2\" (UID: \"d5a7276b-a84f-4a88-b220-eb46f36768a0\") " pod="openshift-multus/multus-96jh2" Jun 09 15:01:27.644804 ip-10-0-133-239 kubenswrapper[2576]: I0609 15:01:27.643768 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/441b2a74-d62c-4e3c-9e0f-b133cd4364be-env-overrides\") pod \"ovnkube-node-n4c97\" (UID: \"441b2a74-d62c-4e3c-9e0f-b133cd4364be\") " pod="openshift-ovn-kubernetes/ovnkube-node-n4c97" Jun 09 15:01:27.644804 ip-10-0-133-239 kubenswrapper[2576]: I0609 15:01:27.643794 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/d5a7276b-a84f-4a88-b220-eb46f36768a0-etc-kubernetes\") pod \"multus-96jh2\" (UID: \"d5a7276b-a84f-4a88-b220-eb46f36768a0\") " pod="openshift-multus/multus-96jh2" Jun 09 15:01:27.644804 ip-10-0-133-239 kubenswrapper[2576]: I0609 15:01:27.643818 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/70b6eb4f-8b63-4ca7-ad8c-b558c1f71ad8-host\") pod \"tuned-hplk7\" (UID: \"70b6eb4f-8b63-4ca7-ad8c-b558c1f71ad8\") " pod="openshift-cluster-node-tuning-operator/tuned-hplk7" Jun 09 15:01:27.644804 ip-10-0-133-239 kubenswrapper[2576]: I0609 15:01:27.643843 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/70b6eb4f-8b63-4ca7-ad8c-b558c1f71ad8-etc-modprobe-d\") pod \"tuned-hplk7\" (UID: \"70b6eb4f-8b63-4ca7-ad8c-b558c1f71ad8\") " pod="openshift-cluster-node-tuning-operator/tuned-hplk7" Jun 09 15:01:27.644804 ip-10-0-133-239 kubenswrapper[2576]: I0609 15:01:27.643862 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/d5a7276b-a84f-4a88-b220-eb46f36768a0-etc-kubernetes\") pod \"multus-96jh2\" (UID: \"d5a7276b-a84f-4a88-b220-eb46f36768a0\") " pod="openshift-multus/multus-96jh2" Jun 09 15:01:27.644804 ip-10-0-133-239 kubenswrapper[2576]: I0609 15:01:27.643880 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/70b6eb4f-8b63-4ca7-ad8c-b558c1f71ad8-host\") pod \"tuned-hplk7\" (UID: \"70b6eb4f-8b63-4ca7-ad8c-b558c1f71ad8\") " pod="openshift-cluster-node-tuning-operator/tuned-hplk7" Jun 09 15:01:27.645659 ip-10-0-133-239 kubenswrapper[2576]: I0609 15:01:27.643903 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/70b6eb4f-8b63-4ca7-ad8c-b558c1f71ad8-etc-sysconfig\") pod \"tuned-hplk7\" (UID: \"70b6eb4f-8b63-4ca7-ad8c-b558c1f71ad8\") " pod="openshift-cluster-node-tuning-operator/tuned-hplk7" Jun 09 15:01:27.645659 ip-10-0-133-239 kubenswrapper[2576]: I0609 15:01:27.643867 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/70b6eb4f-8b63-4ca7-ad8c-b558c1f71ad8-etc-sysconfig\") pod \"tuned-hplk7\" (UID: \"70b6eb4f-8b63-4ca7-ad8c-b558c1f71ad8\") " pod="openshift-cluster-node-tuning-operator/tuned-hplk7" Jun 09 15:01:27.645659 ip-10-0-133-239 kubenswrapper[2576]: I0609 15:01:27.643843 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/d5a7276b-a84f-4a88-b220-eb46f36768a0-multus-socket-dir-parent\") pod \"multus-96jh2\" (UID: \"d5a7276b-a84f-4a88-b220-eb46f36768a0\") " pod="openshift-multus/multus-96jh2" Jun 09 15:01:27.645659 ip-10-0-133-239 kubenswrapper[2576]: I0609 15:01:27.643936 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/70b6eb4f-8b63-4ca7-ad8c-b558c1f71ad8-sys\") pod \"tuned-hplk7\" (UID: \"70b6eb4f-8b63-4ca7-ad8c-b558c1f71ad8\") " pod="openshift-cluster-node-tuning-operator/tuned-hplk7" Jun 09 15:01:27.645659 ip-10-0-133-239 kubenswrapper[2576]: I0609 15:01:27.643957 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/70b6eb4f-8b63-4ca7-ad8c-b558c1f71ad8-etc-modprobe-d\") pod \"tuned-hplk7\" (UID: \"70b6eb4f-8b63-4ca7-ad8c-b558c1f71ad8\") " pod="openshift-cluster-node-tuning-operator/tuned-hplk7" Jun 09 15:01:27.645659 ip-10-0-133-239 kubenswrapper[2576]: I0609 15:01:27.643961 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/77714a52-c22d-45f0-939d-b2a256bd511e-cnibin\") pod \"multus-additional-cni-plugins-rvk7p\" (UID: \"77714a52-c22d-45f0-939d-b2a256bd511e\") " pod="openshift-multus/multus-additional-cni-plugins-rvk7p" Jun 09 15:01:27.645659 ip-10-0-133-239 kubenswrapper[2576]: I0609 15:01:27.643987 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/d5a7276b-a84f-4a88-b220-eb46f36768a0-host-var-lib-cni-bin\") pod \"multus-96jh2\" (UID: \"d5a7276b-a84f-4a88-b220-eb46f36768a0\") " pod="openshift-multus/multus-96jh2" Jun 09 15:01:27.645659 ip-10-0-133-239 kubenswrapper[2576]: I0609 15:01:27.644019 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/441b2a74-d62c-4e3c-9e0f-b133cd4364be-run-ovn\") pod \"ovnkube-node-n4c97\" (UID: \"441b2a74-d62c-4e3c-9e0f-b133cd4364be\") " pod="openshift-ovn-kubernetes/ovnkube-node-n4c97" Jun 09 15:01:27.645659 ip-10-0-133-239 kubenswrapper[2576]: I0609 15:01:27.644008 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/70b6eb4f-8b63-4ca7-ad8c-b558c1f71ad8-sys\") pod \"tuned-hplk7\" (UID: \"70b6eb4f-8b63-4ca7-ad8c-b558c1f71ad8\") " pod="openshift-cluster-node-tuning-operator/tuned-hplk7" Jun 09 15:01:27.645659 ip-10-0-133-239 kubenswrapper[2576]: I0609 15:01:27.644058 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/77714a52-c22d-45f0-939d-b2a256bd511e-cnibin\") pod \"multus-additional-cni-plugins-rvk7p\" (UID: \"77714a52-c22d-45f0-939d-b2a256bd511e\") " pod="openshift-multus/multus-additional-cni-plugins-rvk7p" Jun 09 15:01:27.645659 ip-10-0-133-239 kubenswrapper[2576]: I0609 15:01:27.644089 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/d5a7276b-a84f-4a88-b220-eb46f36768a0-host-var-lib-cni-bin\") pod \"multus-96jh2\" (UID: \"d5a7276b-a84f-4a88-b220-eb46f36768a0\") " pod="openshift-multus/multus-96jh2" Jun 09 15:01:27.645659 ip-10-0-133-239 kubenswrapper[2576]: I0609 15:01:27.644100 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/70b6eb4f-8b63-4ca7-ad8c-b558c1f71ad8-tmp\") pod \"tuned-hplk7\" (UID: \"70b6eb4f-8b63-4ca7-ad8c-b558c1f71ad8\") " pod="openshift-cluster-node-tuning-operator/tuned-hplk7" Jun 09 15:01:27.645659 ip-10-0-133-239 kubenswrapper[2576]: I0609 15:01:27.644137 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/65d781cf-2987-4208-9e71-64260d0bb38a-socket-dir\") pod \"aws-ebs-csi-driver-node-f7pk9\" (UID: \"65d781cf-2987-4208-9e71-64260d0bb38a\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-f7pk9" Jun 09 15:01:27.645659 ip-10-0-133-239 kubenswrapper[2576]: I0609 15:01:27.644162 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/65d781cf-2987-4208-9e71-64260d0bb38a-device-dir\") pod \"aws-ebs-csi-driver-node-f7pk9\" (UID: \"65d781cf-2987-4208-9e71-64260d0bb38a\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-f7pk9" Jun 09 15:01:27.645659 ip-10-0-133-239 kubenswrapper[2576]: I0609 15:01:27.644194 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/d5a7276b-a84f-4a88-b220-eb46f36768a0-host-var-lib-cni-multus\") pod \"multus-96jh2\" (UID: \"d5a7276b-a84f-4a88-b220-eb46f36768a0\") " pod="openshift-multus/multus-96jh2" Jun 09 15:01:27.645659 ip-10-0-133-239 kubenswrapper[2576]: I0609 15:01:27.644219 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/441b2a74-d62c-4e3c-9e0f-b133cd4364be-node-log\") pod \"ovnkube-node-n4c97\" (UID: \"441b2a74-d62c-4e3c-9e0f-b133cd4364be\") " pod="openshift-ovn-kubernetes/ovnkube-node-n4c97" Jun 09 15:01:27.645659 ip-10-0-133-239 kubenswrapper[2576]: I0609 15:01:27.644231 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/65d781cf-2987-4208-9e71-64260d0bb38a-device-dir\") pod \"aws-ebs-csi-driver-node-f7pk9\" (UID: \"65d781cf-2987-4208-9e71-64260d0bb38a\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-f7pk9" Jun 09 15:01:27.646284 ip-10-0-133-239 kubenswrapper[2576]: I0609 15:01:27.644243 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/14860286-bb9d-4f00-864f-c2b041a3b160-dbus\") pod \"global-pull-secret-syncer-256sj\" (UID: \"14860286-bb9d-4f00-864f-c2b041a3b160\") " pod="kube-system/global-pull-secret-syncer-256sj" Jun 09 15:01:27.646284 ip-10-0-133-239 kubenswrapper[2576]: I0609 15:01:27.644250 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/d5a7276b-a84f-4a88-b220-eb46f36768a0-host-var-lib-cni-multus\") pod \"multus-96jh2\" (UID: \"d5a7276b-a84f-4a88-b220-eb46f36768a0\") " pod="openshift-multus/multus-96jh2" Jun 09 15:01:27.646284 ip-10-0-133-239 kubenswrapper[2576]: I0609 15:01:27.644268 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/441b2a74-d62c-4e3c-9e0f-b133cd4364be-host-cni-bin\") pod \"ovnkube-node-n4c97\" (UID: \"441b2a74-d62c-4e3c-9e0f-b133cd4364be\") " pod="openshift-ovn-kubernetes/ovnkube-node-n4c97" Jun 09 15:01:27.646284 ip-10-0-133-239 kubenswrapper[2576]: I0609 15:01:27.644293 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/14860286-bb9d-4f00-864f-c2b041a3b160-kubelet-config\") pod \"global-pull-secret-syncer-256sj\" (UID: \"14860286-bb9d-4f00-864f-c2b041a3b160\") " pod="kube-system/global-pull-secret-syncer-256sj" Jun 09 15:01:27.646284 ip-10-0-133-239 kubenswrapper[2576]: I0609 15:01:27.644321 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-r99vl\" (UniqueName: \"kubernetes.io/projected/77714a52-c22d-45f0-939d-b2a256bd511e-kube-api-access-r99vl\") pod \"multus-additional-cni-plugins-rvk7p\" (UID: \"77714a52-c22d-45f0-939d-b2a256bd511e\") " pod="openshift-multus/multus-additional-cni-plugins-rvk7p" Jun 09 15:01:27.646284 ip-10-0-133-239 kubenswrapper[2576]: I0609 15:01:27.644347 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/16507eac-27c4-4ac4-b8a7-16d36c11a8d9-iptables-alerter-script\") pod \"iptables-alerter-db5nc\" (UID: \"16507eac-27c4-4ac4-b8a7-16d36c11a8d9\") " pod="openshift-network-operator/iptables-alerter-db5nc" Jun 09 15:01:27.646284 ip-10-0-133-239 kubenswrapper[2576]: I0609 15:01:27.644369 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/65d781cf-2987-4208-9e71-64260d0bb38a-socket-dir\") pod \"aws-ebs-csi-driver-node-f7pk9\" (UID: \"65d781cf-2987-4208-9e71-64260d0bb38a\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-f7pk9" Jun 09 15:01:27.646284 ip-10-0-133-239 kubenswrapper[2576]: I0609 15:01:27.644371 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/16507eac-27c4-4ac4-b8a7-16d36c11a8d9-host-slash\") pod \"iptables-alerter-db5nc\" (UID: \"16507eac-27c4-4ac4-b8a7-16d36c11a8d9\") " pod="openshift-network-operator/iptables-alerter-db5nc" Jun 09 15:01:27.646284 ip-10-0-133-239 kubenswrapper[2576]: I0609 15:01:27.644392 2576 swap_util.go:74] "error creating dir to test if tmpfs noswap is enabled. Assuming not supported" mount path="" error="stat /var/lib/kubelet/plugins/kubernetes.io/empty-dir: no such file or directory" Jun 09 15:01:27.646284 ip-10-0-133-239 kubenswrapper[2576]: I0609 15:01:27.644415 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/16507eac-27c4-4ac4-b8a7-16d36c11a8d9-host-slash\") pod \"iptables-alerter-db5nc\" (UID: \"16507eac-27c4-4ac4-b8a7-16d36c11a8d9\") " pod="openshift-network-operator/iptables-alerter-db5nc" Jun 09 15:01:27.646284 ip-10-0-133-239 kubenswrapper[2576]: I0609 15:01:27.644434 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-79x7h\" (UniqueName: \"kubernetes.io/projected/16507eac-27c4-4ac4-b8a7-16d36c11a8d9-kube-api-access-79x7h\") pod \"iptables-alerter-db5nc\" (UID: \"16507eac-27c4-4ac4-b8a7-16d36c11a8d9\") " pod="openshift-network-operator/iptables-alerter-db5nc" Jun 09 15:01:27.646284 ip-10-0-133-239 kubenswrapper[2576]: I0609 15:01:27.644455 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/441b2a74-d62c-4e3c-9e0f-b133cd4364be-host-cni-netd\") pod \"ovnkube-node-n4c97\" (UID: \"441b2a74-d62c-4e3c-9e0f-b133cd4364be\") " pod="openshift-ovn-kubernetes/ovnkube-node-n4c97" Jun 09 15:01:27.646284 ip-10-0-133-239 kubenswrapper[2576]: I0609 15:01:27.644516 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/70b6eb4f-8b63-4ca7-ad8c-b558c1f71ad8-etc-kubernetes\") pod \"tuned-hplk7\" (UID: \"70b6eb4f-8b63-4ca7-ad8c-b558c1f71ad8\") " pod="openshift-cluster-node-tuning-operator/tuned-hplk7" Jun 09 15:01:27.646284 ip-10-0-133-239 kubenswrapper[2576]: I0609 15:01:27.644543 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/70b6eb4f-8b63-4ca7-ad8c-b558c1f71ad8-lib-modules\") pod \"tuned-hplk7\" (UID: \"70b6eb4f-8b63-4ca7-ad8c-b558c1f71ad8\") " pod="openshift-cluster-node-tuning-operator/tuned-hplk7" Jun 09 15:01:27.646284 ip-10-0-133-239 kubenswrapper[2576]: I0609 15:01:27.644566 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/65d781cf-2987-4208-9e71-64260d0bb38a-registration-dir\") pod \"aws-ebs-csi-driver-node-f7pk9\" (UID: \"65d781cf-2987-4208-9e71-64260d0bb38a\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-f7pk9" Jun 09 15:01:27.646284 ip-10-0-133-239 kubenswrapper[2576]: I0609 15:01:27.644611 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/77714a52-c22d-45f0-939d-b2a256bd511e-cni-binary-copy\") pod \"multus-additional-cni-plugins-rvk7p\" (UID: \"77714a52-c22d-45f0-939d-b2a256bd511e\") " pod="openshift-multus/multus-additional-cni-plugins-rvk7p" Jun 09 15:01:27.646284 ip-10-0-133-239 kubenswrapper[2576]: I0609 15:01:27.644643 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/70b6eb4f-8b63-4ca7-ad8c-b558c1f71ad8-etc-kubernetes\") pod \"tuned-hplk7\" (UID: \"70b6eb4f-8b63-4ca7-ad8c-b558c1f71ad8\") " pod="openshift-cluster-node-tuning-operator/tuned-hplk7" Jun 09 15:01:27.646758 ip-10-0-133-239 kubenswrapper[2576]: I0609 15:01:27.644652 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/441b2a74-d62c-4e3c-9e0f-b133cd4364be-run-openvswitch\") pod \"ovnkube-node-n4c97\" (UID: \"441b2a74-d62c-4e3c-9e0f-b133cd4364be\") " pod="openshift-ovn-kubernetes/ovnkube-node-n4c97" Jun 09 15:01:27.646758 ip-10-0-133-239 kubenswrapper[2576]: I0609 15:01:27.644681 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vbm4m\" (UniqueName: \"kubernetes.io/projected/441b2a74-d62c-4e3c-9e0f-b133cd4364be-kube-api-access-vbm4m\") pod \"ovnkube-node-n4c97\" (UID: \"441b2a74-d62c-4e3c-9e0f-b133cd4364be\") " pod="openshift-ovn-kubernetes/ovnkube-node-n4c97" Jun 09 15:01:27.646758 ip-10-0-133-239 kubenswrapper[2576]: I0609 15:01:27.644706 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/70b6eb4f-8b63-4ca7-ad8c-b558c1f71ad8-etc-tuned\") pod \"tuned-hplk7\" (UID: \"70b6eb4f-8b63-4ca7-ad8c-b558c1f71ad8\") " pod="openshift-cluster-node-tuning-operator/tuned-hplk7" Jun 09 15:01:27.646758 ip-10-0-133-239 kubenswrapper[2576]: I0609 15:01:27.644708 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/65d781cf-2987-4208-9e71-64260d0bb38a-registration-dir\") pod \"aws-ebs-csi-driver-node-f7pk9\" (UID: \"65d781cf-2987-4208-9e71-64260d0bb38a\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-f7pk9" Jun 09 15:01:27.646758 ip-10-0-133-239 kubenswrapper[2576]: I0609 15:01:27.644735 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/70b6eb4f-8b63-4ca7-ad8c-b558c1f71ad8-lib-modules\") pod \"tuned-hplk7\" (UID: \"70b6eb4f-8b63-4ca7-ad8c-b558c1f71ad8\") " pod="openshift-cluster-node-tuning-operator/tuned-hplk7" Jun 09 15:01:27.646758 ip-10-0-133-239 kubenswrapper[2576]: I0609 15:01:27.644744 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-sx8kd\" (UniqueName: \"kubernetes.io/projected/64cfa4da-d67f-413d-b01d-161226f943e7-kube-api-access-sx8kd\") pod \"network-metrics-daemon-rw24f\" (UID: \"64cfa4da-d67f-413d-b01d-161226f943e7\") " pod="openshift-multus/network-metrics-daemon-rw24f" Jun 09 15:01:27.646758 ip-10-0-133-239 kubenswrapper[2576]: I0609 15:01:27.644775 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/77714a52-c22d-45f0-939d-b2a256bd511e-os-release\") pod \"multus-additional-cni-plugins-rvk7p\" (UID: \"77714a52-c22d-45f0-939d-b2a256bd511e\") " pod="openshift-multus/multus-additional-cni-plugins-rvk7p" Jun 09 15:01:27.646758 ip-10-0-133-239 kubenswrapper[2576]: I0609 15:01:27.644802 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/77714a52-c22d-45f0-939d-b2a256bd511e-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-rvk7p\" (UID: \"77714a52-c22d-45f0-939d-b2a256bd511e\") " pod="openshift-multus/multus-additional-cni-plugins-rvk7p" Jun 09 15:01:27.646758 ip-10-0-133-239 kubenswrapper[2576]: I0609 15:01:27.644825 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/d5a7276b-a84f-4a88-b220-eb46f36768a0-os-release\") pod \"multus-96jh2\" (UID: \"d5a7276b-a84f-4a88-b220-eb46f36768a0\") " pod="openshift-multus/multus-96jh2" Jun 09 15:01:27.646758 ip-10-0-133-239 kubenswrapper[2576]: I0609 15:01:27.644876 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/aed341a8-0a84-498b-9b3c-75a83a8279bb-agent-certs\") pod \"konnectivity-agent-tz8c7\" (UID: \"aed341a8-0a84-498b-9b3c-75a83a8279bb\") " pod="kube-system/konnectivity-agent-tz8c7" Jun 09 15:01:27.646758 ip-10-0-133-239 kubenswrapper[2576]: I0609 15:01:27.644902 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/16507eac-27c4-4ac4-b8a7-16d36c11a8d9-iptables-alerter-script\") pod \"iptables-alerter-db5nc\" (UID: \"16507eac-27c4-4ac4-b8a7-16d36c11a8d9\") " pod="openshift-network-operator/iptables-alerter-db5nc" Jun 09 15:01:27.646758 ip-10-0-133-239 kubenswrapper[2576]: I0609 15:01:27.644906 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/441b2a74-d62c-4e3c-9e0f-b133cd4364be-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-n4c97\" (UID: \"441b2a74-d62c-4e3c-9e0f-b133cd4364be\") " pod="openshift-ovn-kubernetes/ovnkube-node-n4c97" Jun 09 15:01:27.646758 ip-10-0-133-239 kubenswrapper[2576]: I0609 15:01:27.644950 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/14860286-bb9d-4f00-864f-c2b041a3b160-original-pull-secret\") pod \"global-pull-secret-syncer-256sj\" (UID: \"14860286-bb9d-4f00-864f-c2b041a3b160\") " pod="kube-system/global-pull-secret-syncer-256sj" Jun 09 15:01:27.646758 ip-10-0-133-239 kubenswrapper[2576]: I0609 15:01:27.644967 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/77714a52-c22d-45f0-939d-b2a256bd511e-os-release\") pod \"multus-additional-cni-plugins-rvk7p\" (UID: \"77714a52-c22d-45f0-939d-b2a256bd511e\") " pod="openshift-multus/multus-additional-cni-plugins-rvk7p" Jun 09 15:01:27.646758 ip-10-0-133-239 kubenswrapper[2576]: I0609 15:01:27.645016 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/d5a7276b-a84f-4a88-b220-eb46f36768a0-os-release\") pod \"multus-96jh2\" (UID: \"d5a7276b-a84f-4a88-b220-eb46f36768a0\") " pod="openshift-multus/multus-96jh2" Jun 09 15:01:27.646758 ip-10-0-133-239 kubenswrapper[2576]: I0609 15:01:27.645058 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/d5a7276b-a84f-4a88-b220-eb46f36768a0-multus-daemon-config\") pod \"multus-96jh2\" (UID: \"d5a7276b-a84f-4a88-b220-eb46f36768a0\") " pod="openshift-multus/multus-96jh2" Jun 09 15:01:27.646758 ip-10-0-133-239 kubenswrapper[2576]: I0609 15:01:27.645143 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/70b6eb4f-8b63-4ca7-ad8c-b558c1f71ad8-etc-sysctl-conf\") pod \"tuned-hplk7\" (UID: \"70b6eb4f-8b63-4ca7-ad8c-b558c1f71ad8\") " pod="openshift-cluster-node-tuning-operator/tuned-hplk7" Jun 09 15:01:27.647314 ip-10-0-133-239 kubenswrapper[2576]: I0609 15:01:27.645192 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/65d781cf-2987-4208-9e71-64260d0bb38a-sys-fs\") pod \"aws-ebs-csi-driver-node-f7pk9\" (UID: \"65d781cf-2987-4208-9e71-64260d0bb38a\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-f7pk9" Jun 09 15:01:27.647314 ip-10-0-133-239 kubenswrapper[2576]: I0609 15:01:27.645198 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/77714a52-c22d-45f0-939d-b2a256bd511e-cni-binary-copy\") pod \"multus-additional-cni-plugins-rvk7p\" (UID: \"77714a52-c22d-45f0-939d-b2a256bd511e\") " pod="openshift-multus/multus-additional-cni-plugins-rvk7p" Jun 09 15:01:27.647314 ip-10-0-133-239 kubenswrapper[2576]: I0609 15:01:27.645218 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/77714a52-c22d-45f0-939d-b2a256bd511e-system-cni-dir\") pod \"multus-additional-cni-plugins-rvk7p\" (UID: \"77714a52-c22d-45f0-939d-b2a256bd511e\") " pod="openshift-multus/multus-additional-cni-plugins-rvk7p" Jun 09 15:01:27.647314 ip-10-0-133-239 kubenswrapper[2576]: I0609 15:01:27.645245 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/77714a52-c22d-45f0-939d-b2a256bd511e-tuning-conf-dir\") pod \"multus-additional-cni-plugins-rvk7p\" (UID: \"77714a52-c22d-45f0-939d-b2a256bd511e\") " pod="openshift-multus/multus-additional-cni-plugins-rvk7p" Jun 09 15:01:27.647314 ip-10-0-133-239 kubenswrapper[2576]: I0609 15:01:27.645267 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/d5a7276b-a84f-4a88-b220-eb46f36768a0-cni-binary-copy\") pod \"multus-96jh2\" (UID: \"d5a7276b-a84f-4a88-b220-eb46f36768a0\") " pod="openshift-multus/multus-96jh2" Jun 09 15:01:27.647314 ip-10-0-133-239 kubenswrapper[2576]: I0609 15:01:27.645297 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/441b2a74-d62c-4e3c-9e0f-b133cd4364be-ovnkube-config\") pod \"ovnkube-node-n4c97\" (UID: \"441b2a74-d62c-4e3c-9e0f-b133cd4364be\") " pod="openshift-ovn-kubernetes/ovnkube-node-n4c97" Jun 09 15:01:27.647314 ip-10-0-133-239 kubenswrapper[2576]: I0609 15:01:27.645309 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/70b6eb4f-8b63-4ca7-ad8c-b558c1f71ad8-etc-sysctl-conf\") pod \"tuned-hplk7\" (UID: \"70b6eb4f-8b63-4ca7-ad8c-b558c1f71ad8\") " pod="openshift-cluster-node-tuning-operator/tuned-hplk7" Jun 09 15:01:27.647314 ip-10-0-133-239 kubenswrapper[2576]: I0609 15:01:27.645323 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/441b2a74-d62c-4e3c-9e0f-b133cd4364be-ovnkube-script-lib\") pod \"ovnkube-node-n4c97\" (UID: \"441b2a74-d62c-4e3c-9e0f-b133cd4364be\") " pod="openshift-ovn-kubernetes/ovnkube-node-n4c97" Jun 09 15:01:27.647314 ip-10-0-133-239 kubenswrapper[2576]: I0609 15:01:27.645435 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/77714a52-c22d-45f0-939d-b2a256bd511e-tuning-conf-dir\") pod \"multus-additional-cni-plugins-rvk7p\" (UID: \"77714a52-c22d-45f0-939d-b2a256bd511e\") " pod="openshift-multus/multus-additional-cni-plugins-rvk7p" Jun 09 15:01:27.647314 ip-10-0-133-239 kubenswrapper[2576]: I0609 15:01:27.645479 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/65d781cf-2987-4208-9e71-64260d0bb38a-sys-fs\") pod \"aws-ebs-csi-driver-node-f7pk9\" (UID: \"65d781cf-2987-4208-9e71-64260d0bb38a\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-f7pk9" Jun 09 15:01:27.647314 ip-10-0-133-239 kubenswrapper[2576]: I0609 15:01:27.645479 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/77714a52-c22d-45f0-939d-b2a256bd511e-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-rvk7p\" (UID: \"77714a52-c22d-45f0-939d-b2a256bd511e\") " pod="openshift-multus/multus-additional-cni-plugins-rvk7p" Jun 09 15:01:27.647314 ip-10-0-133-239 kubenswrapper[2576]: I0609 15:01:27.645510 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/77714a52-c22d-45f0-939d-b2a256bd511e-system-cni-dir\") pod \"multus-additional-cni-plugins-rvk7p\" (UID: \"77714a52-c22d-45f0-939d-b2a256bd511e\") " pod="openshift-multus/multus-additional-cni-plugins-rvk7p" Jun 09 15:01:27.647314 ip-10-0-133-239 kubenswrapper[2576]: I0609 15:01:27.645525 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/d5a7276b-a84f-4a88-b220-eb46f36768a0-multus-daemon-config\") pod \"multus-96jh2\" (UID: \"d5a7276b-a84f-4a88-b220-eb46f36768a0\") " pod="openshift-multus/multus-96jh2" Jun 09 15:01:27.647314 ip-10-0-133-239 kubenswrapper[2576]: I0609 15:01:27.645836 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/d5a7276b-a84f-4a88-b220-eb46f36768a0-cni-binary-copy\") pod \"multus-96jh2\" (UID: \"d5a7276b-a84f-4a88-b220-eb46f36768a0\") " pod="openshift-multus/multus-96jh2" Jun 09 15:01:27.647719 ip-10-0-133-239 kubenswrapper[2576]: I0609 15:01:27.647523 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/70b6eb4f-8b63-4ca7-ad8c-b558c1f71ad8-tmp\") pod \"tuned-hplk7\" (UID: \"70b6eb4f-8b63-4ca7-ad8c-b558c1f71ad8\") " pod="openshift-cluster-node-tuning-operator/tuned-hplk7" Jun 09 15:01:27.647719 ip-10-0-133-239 kubenswrapper[2576]: I0609 15:01:27.647556 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/70b6eb4f-8b63-4ca7-ad8c-b558c1f71ad8-etc-tuned\") pod \"tuned-hplk7\" (UID: \"70b6eb4f-8b63-4ca7-ad8c-b558c1f71ad8\") " pod="openshift-cluster-node-tuning-operator/tuned-hplk7" Jun 09 15:01:27.650839 ip-10-0-133-239 kubenswrapper[2576]: I0609 15:01:27.650812 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-j2f5b\" (UniqueName: \"kubernetes.io/projected/819c59d4-2dfd-40f7-8018-dc29890cc325-kube-api-access-j2f5b\") pod \"node-resolver-d5rht\" (UID: \"819c59d4-2dfd-40f7-8018-dc29890cc325\") " pod="openshift-dns/node-resolver-d5rht" Jun 09 15:01:27.656159 ip-10-0-133-239 kubenswrapper[2576]: I0609 15:01:27.656132 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-csrg4\" (UniqueName: \"kubernetes.io/projected/70b6eb4f-8b63-4ca7-ad8c-b558c1f71ad8-kube-api-access-csrg4\") pod \"tuned-hplk7\" (UID: \"70b6eb4f-8b63-4ca7-ad8c-b558c1f71ad8\") " pod="openshift-cluster-node-tuning-operator/tuned-hplk7" Jun 09 15:01:27.656304 ip-10-0-133-239 kubenswrapper[2576]: I0609 15:01:27.656163 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-94gpp\" (UniqueName: \"kubernetes.io/projected/65d781cf-2987-4208-9e71-64260d0bb38a-kube-api-access-94gpp\") pod \"aws-ebs-csi-driver-node-f7pk9\" (UID: \"65d781cf-2987-4208-9e71-64260d0bb38a\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-f7pk9" Jun 09 15:01:27.656689 ip-10-0-133-239 kubenswrapper[2576]: I0609 15:01:27.656661 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-sx8kd\" (UniqueName: \"kubernetes.io/projected/64cfa4da-d67f-413d-b01d-161226f943e7-kube-api-access-sx8kd\") pod \"network-metrics-daemon-rw24f\" (UID: \"64cfa4da-d67f-413d-b01d-161226f943e7\") " pod="openshift-multus/network-metrics-daemon-rw24f" Jun 09 15:01:27.657348 ip-10-0-133-239 kubenswrapper[2576]: I0609 15:01:27.657324 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-6kb67\" (UniqueName: \"kubernetes.io/projected/ab1b7146-38f5-4c67-b79c-d98d8f1734e8-kube-api-access-6kb67\") pod \"node-ca-n4qqs\" (UID: \"ab1b7146-38f5-4c67-b79c-d98d8f1734e8\") " pod="openshift-image-registry/node-ca-n4qqs" Jun 09 15:01:27.657473 ip-10-0-133-239 kubenswrapper[2576]: I0609 15:01:27.657414 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-r99vl\" (UniqueName: \"kubernetes.io/projected/77714a52-c22d-45f0-939d-b2a256bd511e-kube-api-access-r99vl\") pod \"multus-additional-cni-plugins-rvk7p\" (UID: \"77714a52-c22d-45f0-939d-b2a256bd511e\") " pod="openshift-multus/multus-additional-cni-plugins-rvk7p" Jun 09 15:01:27.657606 ip-10-0-133-239 kubenswrapper[2576]: I0609 15:01:27.657587 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-jlwm5\" (UniqueName: \"kubernetes.io/projected/d5a7276b-a84f-4a88-b220-eb46f36768a0-kube-api-access-jlwm5\") pod \"multus-96jh2\" (UID: \"d5a7276b-a84f-4a88-b220-eb46f36768a0\") " pod="openshift-multus/multus-96jh2" Jun 09 15:01:27.657840 ip-10-0-133-239 kubenswrapper[2576]: I0609 15:01:27.657821 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-79x7h\" (UniqueName: \"kubernetes.io/projected/16507eac-27c4-4ac4-b8a7-16d36c11a8d9-kube-api-access-79x7h\") pod \"iptables-alerter-db5nc\" (UID: \"16507eac-27c4-4ac4-b8a7-16d36c11a8d9\") " pod="openshift-network-operator/iptables-alerter-db5nc" Jun 09 15:01:27.732549 ip-10-0-133-239 kubenswrapper[2576]: I0609 15:01:27.732503 2576 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160" Jun 09 15:01:27.745842 ip-10-0-133-239 kubenswrapper[2576]: I0609 15:01:27.745804 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/441b2a74-d62c-4e3c-9e0f-b133cd4364be-var-lib-openvswitch\") pod \"ovnkube-node-n4c97\" (UID: \"441b2a74-d62c-4e3c-9e0f-b133cd4364be\") " pod="openshift-ovn-kubernetes/ovnkube-node-n4c97" Jun 09 15:01:27.746014 ip-10-0-133-239 kubenswrapper[2576]: I0609 15:01:27.745893 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/441b2a74-d62c-4e3c-9e0f-b133cd4364be-var-lib-openvswitch\") pod \"ovnkube-node-n4c97\" (UID: \"441b2a74-d62c-4e3c-9e0f-b133cd4364be\") " pod="openshift-ovn-kubernetes/ovnkube-node-n4c97" Jun 09 15:01:27.746014 ip-10-0-133-239 kubenswrapper[2576]: I0609 15:01:27.745938 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/441b2a74-d62c-4e3c-9e0f-b133cd4364be-host-run-ovn-kubernetes\") pod \"ovnkube-node-n4c97\" (UID: \"441b2a74-d62c-4e3c-9e0f-b133cd4364be\") " pod="openshift-ovn-kubernetes/ovnkube-node-n4c97" Jun 09 15:01:27.746014 ip-10-0-133-239 kubenswrapper[2576]: I0609 15:01:27.745976 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/aed341a8-0a84-498b-9b3c-75a83a8279bb-konnectivity-ca\") pod \"konnectivity-agent-tz8c7\" (UID: \"aed341a8-0a84-498b-9b3c-75a83a8279bb\") " pod="kube-system/konnectivity-agent-tz8c7" Jun 09 15:01:27.746014 ip-10-0-133-239 kubenswrapper[2576]: I0609 15:01:27.745999 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/441b2a74-d62c-4e3c-9e0f-b133cd4364be-host-slash\") pod \"ovnkube-node-n4c97\" (UID: \"441b2a74-d62c-4e3c-9e0f-b133cd4364be\") " pod="openshift-ovn-kubernetes/ovnkube-node-n4c97" Jun 09 15:01:27.746211 ip-10-0-133-239 kubenswrapper[2576]: I0609 15:01:27.746018 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/441b2a74-d62c-4e3c-9e0f-b133cd4364be-systemd-units\") pod \"ovnkube-node-n4c97\" (UID: \"441b2a74-d62c-4e3c-9e0f-b133cd4364be\") " pod="openshift-ovn-kubernetes/ovnkube-node-n4c97" Jun 09 15:01:27.746211 ip-10-0-133-239 kubenswrapper[2576]: I0609 15:01:27.746025 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/441b2a74-d62c-4e3c-9e0f-b133cd4364be-host-run-ovn-kubernetes\") pod \"ovnkube-node-n4c97\" (UID: \"441b2a74-d62c-4e3c-9e0f-b133cd4364be\") " pod="openshift-ovn-kubernetes/ovnkube-node-n4c97" Jun 09 15:01:27.746211 ip-10-0-133-239 kubenswrapper[2576]: I0609 15:01:27.746032 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/441b2a74-d62c-4e3c-9e0f-b133cd4364be-etc-openvswitch\") pod \"ovnkube-node-n4c97\" (UID: \"441b2a74-d62c-4e3c-9e0f-b133cd4364be\") " pod="openshift-ovn-kubernetes/ovnkube-node-n4c97" Jun 09 15:01:27.746211 ip-10-0-133-239 kubenswrapper[2576]: I0609 15:01:27.746077 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/441b2a74-d62c-4e3c-9e0f-b133cd4364be-etc-openvswitch\") pod \"ovnkube-node-n4c97\" (UID: \"441b2a74-d62c-4e3c-9e0f-b133cd4364be\") " pod="openshift-ovn-kubernetes/ovnkube-node-n4c97" Jun 09 15:01:27.746211 ip-10-0-133-239 kubenswrapper[2576]: I0609 15:01:27.746104 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/441b2a74-d62c-4e3c-9e0f-b133cd4364be-host-slash\") pod \"ovnkube-node-n4c97\" (UID: \"441b2a74-d62c-4e3c-9e0f-b133cd4364be\") " pod="openshift-ovn-kubernetes/ovnkube-node-n4c97" Jun 09 15:01:27.746211 ip-10-0-133-239 kubenswrapper[2576]: I0609 15:01:27.746113 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/441b2a74-d62c-4e3c-9e0f-b133cd4364be-env-overrides\") pod \"ovnkube-node-n4c97\" (UID: \"441b2a74-d62c-4e3c-9e0f-b133cd4364be\") " pod="openshift-ovn-kubernetes/ovnkube-node-n4c97" Jun 09 15:01:27.746211 ip-10-0-133-239 kubenswrapper[2576]: I0609 15:01:27.746119 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/441b2a74-d62c-4e3c-9e0f-b133cd4364be-systemd-units\") pod \"ovnkube-node-n4c97\" (UID: \"441b2a74-d62c-4e3c-9e0f-b133cd4364be\") " pod="openshift-ovn-kubernetes/ovnkube-node-n4c97" Jun 09 15:01:27.746211 ip-10-0-133-239 kubenswrapper[2576]: I0609 15:01:27.746143 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/441b2a74-d62c-4e3c-9e0f-b133cd4364be-run-ovn\") pod \"ovnkube-node-n4c97\" (UID: \"441b2a74-d62c-4e3c-9e0f-b133cd4364be\") " pod="openshift-ovn-kubernetes/ovnkube-node-n4c97" Jun 09 15:01:27.746211 ip-10-0-133-239 kubenswrapper[2576]: I0609 15:01:27.746187 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/441b2a74-d62c-4e3c-9e0f-b133cd4364be-run-ovn\") pod \"ovnkube-node-n4c97\" (UID: \"441b2a74-d62c-4e3c-9e0f-b133cd4364be\") " pod="openshift-ovn-kubernetes/ovnkube-node-n4c97" Jun 09 15:01:27.746211 ip-10-0-133-239 kubenswrapper[2576]: I0609 15:01:27.746204 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/441b2a74-d62c-4e3c-9e0f-b133cd4364be-node-log\") pod \"ovnkube-node-n4c97\" (UID: \"441b2a74-d62c-4e3c-9e0f-b133cd4364be\") " pod="openshift-ovn-kubernetes/ovnkube-node-n4c97" Jun 09 15:01:27.746594 ip-10-0-133-239 kubenswrapper[2576]: I0609 15:01:27.746230 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/14860286-bb9d-4f00-864f-c2b041a3b160-dbus\") pod \"global-pull-secret-syncer-256sj\" (UID: \"14860286-bb9d-4f00-864f-c2b041a3b160\") " pod="kube-system/global-pull-secret-syncer-256sj" Jun 09 15:01:27.746594 ip-10-0-133-239 kubenswrapper[2576]: I0609 15:01:27.746250 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/441b2a74-d62c-4e3c-9e0f-b133cd4364be-host-cni-bin\") pod \"ovnkube-node-n4c97\" (UID: \"441b2a74-d62c-4e3c-9e0f-b133cd4364be\") " pod="openshift-ovn-kubernetes/ovnkube-node-n4c97" Jun 09 15:01:27.746594 ip-10-0-133-239 kubenswrapper[2576]: I0609 15:01:27.746272 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/14860286-bb9d-4f00-864f-c2b041a3b160-kubelet-config\") pod \"global-pull-secret-syncer-256sj\" (UID: \"14860286-bb9d-4f00-864f-c2b041a3b160\") " pod="kube-system/global-pull-secret-syncer-256sj" Jun 09 15:01:27.746594 ip-10-0-133-239 kubenswrapper[2576]: I0609 15:01:27.746299 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/441b2a74-d62c-4e3c-9e0f-b133cd4364be-host-cni-netd\") pod \"ovnkube-node-n4c97\" (UID: \"441b2a74-d62c-4e3c-9e0f-b133cd4364be\") " pod="openshift-ovn-kubernetes/ovnkube-node-n4c97" Jun 09 15:01:27.746594 ip-10-0-133-239 kubenswrapper[2576]: I0609 15:01:27.746326 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/441b2a74-d62c-4e3c-9e0f-b133cd4364be-run-openvswitch\") pod \"ovnkube-node-n4c97\" (UID: \"441b2a74-d62c-4e3c-9e0f-b133cd4364be\") " pod="openshift-ovn-kubernetes/ovnkube-node-n4c97" Jun 09 15:01:27.746594 ip-10-0-133-239 kubenswrapper[2576]: I0609 15:01:27.746332 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/14860286-bb9d-4f00-864f-c2b041a3b160-dbus\") pod \"global-pull-secret-syncer-256sj\" (UID: \"14860286-bb9d-4f00-864f-c2b041a3b160\") " pod="kube-system/global-pull-secret-syncer-256sj" Jun 09 15:01:27.746594 ip-10-0-133-239 kubenswrapper[2576]: I0609 15:01:27.746348 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vbm4m\" (UniqueName: \"kubernetes.io/projected/441b2a74-d62c-4e3c-9e0f-b133cd4364be-kube-api-access-vbm4m\") pod \"ovnkube-node-n4c97\" (UID: \"441b2a74-d62c-4e3c-9e0f-b133cd4364be\") " pod="openshift-ovn-kubernetes/ovnkube-node-n4c97" Jun 09 15:01:27.746594 ip-10-0-133-239 kubenswrapper[2576]: I0609 15:01:27.746376 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/aed341a8-0a84-498b-9b3c-75a83a8279bb-agent-certs\") pod \"konnectivity-agent-tz8c7\" (UID: \"aed341a8-0a84-498b-9b3c-75a83a8279bb\") " pod="kube-system/konnectivity-agent-tz8c7" Jun 09 15:01:27.746594 ip-10-0-133-239 kubenswrapper[2576]: I0609 15:01:27.746403 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/441b2a74-d62c-4e3c-9e0f-b133cd4364be-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-n4c97\" (UID: \"441b2a74-d62c-4e3c-9e0f-b133cd4364be\") " pod="openshift-ovn-kubernetes/ovnkube-node-n4c97" Jun 09 15:01:27.746594 ip-10-0-133-239 kubenswrapper[2576]: I0609 15:01:27.746432 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/14860286-bb9d-4f00-864f-c2b041a3b160-original-pull-secret\") pod \"global-pull-secret-syncer-256sj\" (UID: \"14860286-bb9d-4f00-864f-c2b041a3b160\") " pod="kube-system/global-pull-secret-syncer-256sj" Jun 09 15:01:27.746594 ip-10-0-133-239 kubenswrapper[2576]: I0609 15:01:27.746437 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/441b2a74-d62c-4e3c-9e0f-b133cd4364be-host-cni-bin\") pod \"ovnkube-node-n4c97\" (UID: \"441b2a74-d62c-4e3c-9e0f-b133cd4364be\") " pod="openshift-ovn-kubernetes/ovnkube-node-n4c97" Jun 09 15:01:27.746594 ip-10-0-133-239 kubenswrapper[2576]: I0609 15:01:27.746460 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/441b2a74-d62c-4e3c-9e0f-b133cd4364be-ovnkube-config\") pod \"ovnkube-node-n4c97\" (UID: \"441b2a74-d62c-4e3c-9e0f-b133cd4364be\") " pod="openshift-ovn-kubernetes/ovnkube-node-n4c97" Jun 09 15:01:27.746594 ip-10-0-133-239 kubenswrapper[2576]: I0609 15:01:27.746483 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/14860286-bb9d-4f00-864f-c2b041a3b160-kubelet-config\") pod \"global-pull-secret-syncer-256sj\" (UID: \"14860286-bb9d-4f00-864f-c2b041a3b160\") " pod="kube-system/global-pull-secret-syncer-256sj" Jun 09 15:01:27.746594 ip-10-0-133-239 kubenswrapper[2576]: I0609 15:01:27.746485 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/441b2a74-d62c-4e3c-9e0f-b133cd4364be-ovnkube-script-lib\") pod \"ovnkube-node-n4c97\" (UID: \"441b2a74-d62c-4e3c-9e0f-b133cd4364be\") " pod="openshift-ovn-kubernetes/ovnkube-node-n4c97" Jun 09 15:01:27.746594 ip-10-0-133-239 kubenswrapper[2576]: I0609 15:01:27.746521 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/441b2a74-d62c-4e3c-9e0f-b133cd4364be-ovn-node-metrics-cert\") pod \"ovnkube-node-n4c97\" (UID: \"441b2a74-d62c-4e3c-9e0f-b133cd4364be\") " pod="openshift-ovn-kubernetes/ovnkube-node-n4c97" Jun 09 15:01:27.746594 ip-10-0-133-239 kubenswrapper[2576]: I0609 15:01:27.746548 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/441b2a74-d62c-4e3c-9e0f-b133cd4364be-host-run-netns\") pod \"ovnkube-node-n4c97\" (UID: \"441b2a74-d62c-4e3c-9e0f-b133cd4364be\") " pod="openshift-ovn-kubernetes/ovnkube-node-n4c97" Jun 09 15:01:27.746594 ip-10-0-133-239 kubenswrapper[2576]: I0609 15:01:27.746570 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/441b2a74-d62c-4e3c-9e0f-b133cd4364be-run-systemd\") pod \"ovnkube-node-n4c97\" (UID: \"441b2a74-d62c-4e3c-9e0f-b133cd4364be\") " pod="openshift-ovn-kubernetes/ovnkube-node-n4c97" Jun 09 15:01:27.747279 ip-10-0-133-239 kubenswrapper[2576]: I0609 15:01:27.746596 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-l6z46\" (UniqueName: \"kubernetes.io/projected/95bb5504-8d73-44b5-84c6-4312e96be459-kube-api-access-l6z46\") pod \"network-check-target-p6wz2\" (UID: \"95bb5504-8d73-44b5-84c6-4312e96be459\") " pod="openshift-network-diagnostics/network-check-target-p6wz2" Jun 09 15:01:27.747279 ip-10-0-133-239 kubenswrapper[2576]: I0609 15:01:27.746607 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/441b2a74-d62c-4e3c-9e0f-b133cd4364be-env-overrides\") pod \"ovnkube-node-n4c97\" (UID: \"441b2a74-d62c-4e3c-9e0f-b133cd4364be\") " pod="openshift-ovn-kubernetes/ovnkube-node-n4c97" Jun 09 15:01:27.747279 ip-10-0-133-239 kubenswrapper[2576]: I0609 15:01:27.746618 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/441b2a74-d62c-4e3c-9e0f-b133cd4364be-host-kubelet\") pod \"ovnkube-node-n4c97\" (UID: \"441b2a74-d62c-4e3c-9e0f-b133cd4364be\") " pod="openshift-ovn-kubernetes/ovnkube-node-n4c97" Jun 09 15:01:27.747279 ip-10-0-133-239 kubenswrapper[2576]: I0609 15:01:27.746377 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/441b2a74-d62c-4e3c-9e0f-b133cd4364be-node-log\") pod \"ovnkube-node-n4c97\" (UID: \"441b2a74-d62c-4e3c-9e0f-b133cd4364be\") " pod="openshift-ovn-kubernetes/ovnkube-node-n4c97" Jun 09 15:01:27.747279 ip-10-0-133-239 kubenswrapper[2576]: I0609 15:01:27.746642 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/aed341a8-0a84-498b-9b3c-75a83a8279bb-konnectivity-ca\") pod \"konnectivity-agent-tz8c7\" (UID: \"aed341a8-0a84-498b-9b3c-75a83a8279bb\") " pod="kube-system/konnectivity-agent-tz8c7" Jun 09 15:01:27.747279 ip-10-0-133-239 kubenswrapper[2576]: I0609 15:01:27.746656 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/441b2a74-d62c-4e3c-9e0f-b133cd4364be-log-socket\") pod \"ovnkube-node-n4c97\" (UID: \"441b2a74-d62c-4e3c-9e0f-b133cd4364be\") " pod="openshift-ovn-kubernetes/ovnkube-node-n4c97" Jun 09 15:01:27.747279 ip-10-0-133-239 kubenswrapper[2576]: I0609 15:01:27.746688 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/441b2a74-d62c-4e3c-9e0f-b133cd4364be-run-systemd\") pod \"ovnkube-node-n4c97\" (UID: \"441b2a74-d62c-4e3c-9e0f-b133cd4364be\") " pod="openshift-ovn-kubernetes/ovnkube-node-n4c97" Jun 09 15:01:27.747279 ip-10-0-133-239 kubenswrapper[2576]: I0609 15:01:27.746717 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/441b2a74-d62c-4e3c-9e0f-b133cd4364be-host-run-netns\") pod \"ovnkube-node-n4c97\" (UID: \"441b2a74-d62c-4e3c-9e0f-b133cd4364be\") " pod="openshift-ovn-kubernetes/ovnkube-node-n4c97" Jun 09 15:01:27.747279 ip-10-0-133-239 kubenswrapper[2576]: I0609 15:01:27.746407 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/441b2a74-d62c-4e3c-9e0f-b133cd4364be-host-cni-netd\") pod \"ovnkube-node-n4c97\" (UID: \"441b2a74-d62c-4e3c-9e0f-b133cd4364be\") " pod="openshift-ovn-kubernetes/ovnkube-node-n4c97" Jun 09 15:01:27.747279 ip-10-0-133-239 kubenswrapper[2576]: I0609 15:01:27.746727 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/441b2a74-d62c-4e3c-9e0f-b133cd4364be-run-openvswitch\") pod \"ovnkube-node-n4c97\" (UID: \"441b2a74-d62c-4e3c-9e0f-b133cd4364be\") " pod="openshift-ovn-kubernetes/ovnkube-node-n4c97" Jun 09 15:01:27.747279 ip-10-0-133-239 kubenswrapper[2576]: I0609 15:01:27.746762 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/441b2a74-d62c-4e3c-9e0f-b133cd4364be-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-n4c97\" (UID: \"441b2a74-d62c-4e3c-9e0f-b133cd4364be\") " pod="openshift-ovn-kubernetes/ovnkube-node-n4c97" Jun 09 15:01:27.747279 ip-10-0-133-239 kubenswrapper[2576]: I0609 15:01:27.746769 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/441b2a74-d62c-4e3c-9e0f-b133cd4364be-log-socket\") pod \"ovnkube-node-n4c97\" (UID: \"441b2a74-d62c-4e3c-9e0f-b133cd4364be\") " pod="openshift-ovn-kubernetes/ovnkube-node-n4c97" Jun 09 15:01:27.747279 ip-10-0-133-239 kubenswrapper[2576]: E0609 15:01:27.746824 2576 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jun 09 15:01:27.747279 ip-10-0-133-239 kubenswrapper[2576]: E0609 15:01:27.746866 2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/14860286-bb9d-4f00-864f-c2b041a3b160-original-pull-secret podName:14860286-bb9d-4f00-864f-c2b041a3b160 nodeName:}" failed. No retries permitted until 2026-06-09 15:01:28.24685364 +0000 UTC m=+3.101009858 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/14860286-bb9d-4f00-864f-c2b041a3b160-original-pull-secret") pod "global-pull-secret-syncer-256sj" (UID: "14860286-bb9d-4f00-864f-c2b041a3b160") : object "kube-system"/"original-pull-secret" not registered Jun 09 15:01:27.747279 ip-10-0-133-239 kubenswrapper[2576]: I0609 15:01:27.746974 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/441b2a74-d62c-4e3c-9e0f-b133cd4364be-ovnkube-script-lib\") pod \"ovnkube-node-n4c97\" (UID: \"441b2a74-d62c-4e3c-9e0f-b133cd4364be\") " pod="openshift-ovn-kubernetes/ovnkube-node-n4c97" Jun 09 15:01:27.747279 ip-10-0-133-239 kubenswrapper[2576]: I0609 15:01:27.747035 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/441b2a74-d62c-4e3c-9e0f-b133cd4364be-host-kubelet\") pod \"ovnkube-node-n4c97\" (UID: \"441b2a74-d62c-4e3c-9e0f-b133cd4364be\") " pod="openshift-ovn-kubernetes/ovnkube-node-n4c97" Jun 09 15:01:27.747730 ip-10-0-133-239 kubenswrapper[2576]: I0609 15:01:27.747370 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/441b2a74-d62c-4e3c-9e0f-b133cd4364be-ovnkube-config\") pod \"ovnkube-node-n4c97\" (UID: \"441b2a74-d62c-4e3c-9e0f-b133cd4364be\") " pod="openshift-ovn-kubernetes/ovnkube-node-n4c97" Jun 09 15:01:27.749076 ip-10-0-133-239 kubenswrapper[2576]: I0609 15:01:27.749036 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/441b2a74-d62c-4e3c-9e0f-b133cd4364be-ovn-node-metrics-cert\") pod \"ovnkube-node-n4c97\" (UID: \"441b2a74-d62c-4e3c-9e0f-b133cd4364be\") " pod="openshift-ovn-kubernetes/ovnkube-node-n4c97" Jun 09 15:01:27.749359 ip-10-0-133-239 kubenswrapper[2576]: I0609 15:01:27.749338 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/aed341a8-0a84-498b-9b3c-75a83a8279bb-agent-certs\") pod \"konnectivity-agent-tz8c7\" (UID: \"aed341a8-0a84-498b-9b3c-75a83a8279bb\") " pod="kube-system/konnectivity-agent-tz8c7" Jun 09 15:01:27.752527 ip-10-0-133-239 kubenswrapper[2576]: E0609 15:01:27.752504 2576 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jun 09 15:01:27.752630 ip-10-0-133-239 kubenswrapper[2576]: E0609 15:01:27.752533 2576 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jun 09 15:01:27.752630 ip-10-0-133-239 kubenswrapper[2576]: E0609 15:01:27.752547 2576 projected.go:196] Error preparing data for projected volume kube-api-access-l6z46 for pod openshift-network-diagnostics/network-check-target-p6wz2: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 09 15:01:27.752717 ip-10-0-133-239 kubenswrapper[2576]: E0609 15:01:27.752634 2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/95bb5504-8d73-44b5-84c6-4312e96be459-kube-api-access-l6z46 podName:95bb5504-8d73-44b5-84c6-4312e96be459 nodeName:}" failed. No retries permitted until 2026-06-09 15:01:28.252614753 +0000 UTC m=+3.106771003 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-api-access-l6z46" (UniqueName: "kubernetes.io/projected/95bb5504-8d73-44b5-84c6-4312e96be459-kube-api-access-l6z46") pod "network-check-target-p6wz2" (UID: "95bb5504-8d73-44b5-84c6-4312e96be459") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 09 15:01:27.754663 ip-10-0-133-239 kubenswrapper[2576]: I0609 15:01:27.754642 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-vbm4m\" (UniqueName: \"kubernetes.io/projected/441b2a74-d62c-4e3c-9e0f-b133cd4364be-kube-api-access-vbm4m\") pod \"ovnkube-node-n4c97\" (UID: \"441b2a74-d62c-4e3c-9e0f-b133cd4364be\") " pod="openshift-ovn-kubernetes/ovnkube-node-n4c97" Jun 09 15:01:27.831076 ip-10-0-133-239 kubenswrapper[2576]: I0609 15:01:27.830986 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-96jh2" Jun 09 15:01:27.838544 ip-10-0-133-239 kubenswrapper[2576]: I0609 15:01:27.838512 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-n4qqs" Jun 09 15:01:27.847275 ip-10-0-133-239 kubenswrapper[2576]: I0609 15:01:27.847249 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-f7pk9" Jun 09 15:01:27.852869 ip-10-0-133-239 kubenswrapper[2576]: I0609 15:01:27.852848 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-db5nc" Jun 09 15:01:27.858487 ip-10-0-133-239 kubenswrapper[2576]: I0609 15:01:27.858464 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-hplk7" Jun 09 15:01:27.866231 ip-10-0-133-239 kubenswrapper[2576]: I0609 15:01:27.866205 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-rvk7p" Jun 09 15:01:27.874834 ip-10-0-133-239 kubenswrapper[2576]: I0609 15:01:27.874812 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-d5rht" Jun 09 15:01:27.880651 ip-10-0-133-239 kubenswrapper[2576]: I0609 15:01:27.880630 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-n4c97" Jun 09 15:01:27.886445 ip-10-0-133-239 kubenswrapper[2576]: I0609 15:01:27.886420 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-tz8c7" Jun 09 15:01:28.131048 ip-10-0-133-239 kubenswrapper[2576]: I0609 15:01:28.130969 2576 reflector.go:439] "Caches populated" type="*v1.Service" reflector="k8s.io/client-go/informers/factory.go:160" Jun 09 15:01:28.149218 ip-10-0-133-239 kubenswrapper[2576]: I0609 15:01:28.149184 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/64cfa4da-d67f-413d-b01d-161226f943e7-metrics-certs\") pod \"network-metrics-daemon-rw24f\" (UID: \"64cfa4da-d67f-413d-b01d-161226f943e7\") " pod="openshift-multus/network-metrics-daemon-rw24f" Jun 09 15:01:28.149407 ip-10-0-133-239 kubenswrapper[2576]: E0609 15:01:28.149341 2576 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jun 09 15:01:28.149485 ip-10-0-133-239 kubenswrapper[2576]: E0609 15:01:28.149409 2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/64cfa4da-d67f-413d-b01d-161226f943e7-metrics-certs podName:64cfa4da-d67f-413d-b01d-161226f943e7 nodeName:}" failed. No retries permitted until 2026-06-09 15:01:29.149389108 +0000 UTC m=+4.003545328 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/64cfa4da-d67f-413d-b01d-161226f943e7-metrics-certs") pod "network-metrics-daemon-rw24f" (UID: "64cfa4da-d67f-413d-b01d-161226f943e7") : object "openshift-multus"/"metrics-daemon-secret" not registered Jun 09 15:01:28.249825 ip-10-0-133-239 kubenswrapper[2576]: I0609 15:01:28.249793 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/14860286-bb9d-4f00-864f-c2b041a3b160-original-pull-secret\") pod \"global-pull-secret-syncer-256sj\" (UID: \"14860286-bb9d-4f00-864f-c2b041a3b160\") " pod="kube-system/global-pull-secret-syncer-256sj" Jun 09 15:01:28.249997 ip-10-0-133-239 kubenswrapper[2576]: E0609 15:01:28.249944 2576 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jun 09 15:01:28.250059 ip-10-0-133-239 kubenswrapper[2576]: E0609 15:01:28.250003 2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/14860286-bb9d-4f00-864f-c2b041a3b160-original-pull-secret podName:14860286-bb9d-4f00-864f-c2b041a3b160 nodeName:}" failed. No retries permitted until 2026-06-09 15:01:29.249986328 +0000 UTC m=+4.104142556 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/14860286-bb9d-4f00-864f-c2b041a3b160-original-pull-secret") pod "global-pull-secret-syncer-256sj" (UID: "14860286-bb9d-4f00-864f-c2b041a3b160") : object "kube-system"/"original-pull-secret" not registered Jun 09 15:01:28.323328 ip-10-0-133-239 kubenswrapper[2576]: W0609 15:01:28.323303 2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podab1b7146_38f5_4c67_b79c_d98d8f1734e8.slice/crio-4423ce38b0657adffa3d4bdb146e5e9961c4fcf7b1d8a4fb34773fb91ba6ac8b WatchSource:0}: Error finding container 4423ce38b0657adffa3d4bdb146e5e9961c4fcf7b1d8a4fb34773fb91ba6ac8b: Status 404 returned error can't find the container with id 4423ce38b0657adffa3d4bdb146e5e9961c4fcf7b1d8a4fb34773fb91ba6ac8b Jun 09 15:01:28.324687 ip-10-0-133-239 kubenswrapper[2576]: W0609 15:01:28.324668 2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd5a7276b_a84f_4a88_b220_eb46f36768a0.slice/crio-ab2330fb67401218a810c6ecff59072fa9d23af246d82f8671922ce876609308 WatchSource:0}: Error finding container ab2330fb67401218a810c6ecff59072fa9d23af246d82f8671922ce876609308: Status 404 returned error can't find the container with id ab2330fb67401218a810c6ecff59072fa9d23af246d82f8671922ce876609308 Jun 09 15:01:28.326816 ip-10-0-133-239 kubenswrapper[2576]: W0609 15:01:28.326794 2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod441b2a74_d62c_4e3c_9e0f_b133cd4364be.slice/crio-d81c9b02ea1da879985fa504a14d2602b2b5bd31aff2c0c9269a5c3119ee4b7a WatchSource:0}: Error finding container d81c9b02ea1da879985fa504a14d2602b2b5bd31aff2c0c9269a5c3119ee4b7a: Status 404 returned error can't find the container with id d81c9b02ea1da879985fa504a14d2602b2b5bd31aff2c0c9269a5c3119ee4b7a Jun 09 15:01:28.330975 ip-10-0-133-239 kubenswrapper[2576]: W0609 15:01:28.330953 2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod65d781cf_2987_4208_9e71_64260d0bb38a.slice/crio-2f8bc977d265916d1e06e125e347164e3b31ac4adc9934b5565d71c40ace88ee WatchSource:0}: Error finding container 2f8bc977d265916d1e06e125e347164e3b31ac4adc9934b5565d71c40ace88ee: Status 404 returned error can't find the container with id 2f8bc977d265916d1e06e125e347164e3b31ac4adc9934b5565d71c40ace88ee Jun 09 15:01:28.331639 ip-10-0-133-239 kubenswrapper[2576]: W0609 15:01:28.331621 2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod70b6eb4f_8b63_4ca7_ad8c_b558c1f71ad8.slice/crio-8352edfd9504d65bbcd1c66fe9ad297fd70a7977985379d7a84f5f56faf0f34e WatchSource:0}: Error finding container 8352edfd9504d65bbcd1c66fe9ad297fd70a7977985379d7a84f5f56faf0f34e: Status 404 returned error can't find the container with id 8352edfd9504d65bbcd1c66fe9ad297fd70a7977985379d7a84f5f56faf0f34e Jun 09 15:01:28.333267 ip-10-0-133-239 kubenswrapper[2576]: W0609 15:01:28.333160 2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podaed341a8_0a84_498b_9b3c_75a83a8279bb.slice/crio-b24a20589c9284d91afd5210f1ad154a437301e30ad0b6c69a62864de30272a7 WatchSource:0}: Error finding container b24a20589c9284d91afd5210f1ad154a437301e30ad0b6c69a62864de30272a7: Status 404 returned error can't find the container with id b24a20589c9284d91afd5210f1ad154a437301e30ad0b6c69a62864de30272a7 Jun 09 15:01:28.334025 ip-10-0-133-239 kubenswrapper[2576]: W0609 15:01:28.333998 2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod16507eac_27c4_4ac4_b8a7_16d36c11a8d9.slice/crio-2e8901cf3e9e6a5e4269d6f94711bdf29b2337adbc3f07e8e7c01848b963e8c5 WatchSource:0}: Error finding container 2e8901cf3e9e6a5e4269d6f94711bdf29b2337adbc3f07e8e7c01848b963e8c5: Status 404 returned error can't find the container with id 2e8901cf3e9e6a5e4269d6f94711bdf29b2337adbc3f07e8e7c01848b963e8c5 Jun 09 15:01:28.334971 ip-10-0-133-239 kubenswrapper[2576]: W0609 15:01:28.334886 2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod819c59d4_2dfd_40f7_8018_dc29890cc325.slice/crio-82d33f70a27daeab5828c149edd3ae572d2ee190bd2313a26a68fce1709b26b4 WatchSource:0}: Error finding container 82d33f70a27daeab5828c149edd3ae572d2ee190bd2313a26a68fce1709b26b4: Status 404 returned error can't find the container with id 82d33f70a27daeab5828c149edd3ae572d2ee190bd2313a26a68fce1709b26b4 Jun 09 15:01:28.336365 ip-10-0-133-239 kubenswrapper[2576]: W0609 15:01:28.335987 2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod77714a52_c22d_45f0_939d_b2a256bd511e.slice/crio-2fa14af64e9a21998e0c9cf1118558e8ae25f1ee958214f308cca7eabed8dbd7 WatchSource:0}: Error finding container 2fa14af64e9a21998e0c9cf1118558e8ae25f1ee958214f308cca7eabed8dbd7: Status 404 returned error can't find the container with id 2fa14af64e9a21998e0c9cf1118558e8ae25f1ee958214f308cca7eabed8dbd7 Jun 09 15:01:28.350243 ip-10-0-133-239 kubenswrapper[2576]: I0609 15:01:28.350218 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-l6z46\" (UniqueName: \"kubernetes.io/projected/95bb5504-8d73-44b5-84c6-4312e96be459-kube-api-access-l6z46\") pod \"network-check-target-p6wz2\" (UID: \"95bb5504-8d73-44b5-84c6-4312e96be459\") " pod="openshift-network-diagnostics/network-check-target-p6wz2" Jun 09 15:01:28.350360 ip-10-0-133-239 kubenswrapper[2576]: E0609 15:01:28.350342 2576 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jun 09 15:01:28.350457 ip-10-0-133-239 kubenswrapper[2576]: E0609 15:01:28.350367 2576 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jun 09 15:01:28.350457 ip-10-0-133-239 kubenswrapper[2576]: E0609 15:01:28.350376 2576 projected.go:196] Error preparing data for projected volume kube-api-access-l6z46 for pod openshift-network-diagnostics/network-check-target-p6wz2: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 09 15:01:28.350457 ip-10-0-133-239 kubenswrapper[2576]: E0609 15:01:28.350449 2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/95bb5504-8d73-44b5-84c6-4312e96be459-kube-api-access-l6z46 podName:95bb5504-8d73-44b5-84c6-4312e96be459 nodeName:}" failed. No retries permitted until 2026-06-09 15:01:29.350435848 +0000 UTC m=+4.204592078 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-api-access-l6z46" (UniqueName: "kubernetes.io/projected/95bb5504-8d73-44b5-84c6-4312e96be459-kube-api-access-l6z46") pod "network-check-target-p6wz2" (UID: "95bb5504-8d73-44b5-84c6-4312e96be459") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 09 15:01:28.572757 ip-10-0-133-239 kubenswrapper[2576]: I0609 15:01:28.572502 2576 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-06-08 14:56:27 +0000 UTC" deadline="2028-01-15 03:43:02.925142024 +0000 UTC" Jun 09 15:01:28.573243 ip-10-0-133-239 kubenswrapper[2576]: I0609 15:01:28.572867 2576 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="14028h41m34.352284042s" Jun 09 15:01:28.607359 ip-10-0-133-239 kubenswrapper[2576]: I0609 15:01:28.607322 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-133-239.ec2.internal" event={"ID":"a6e9ba50990866073fec99b72c3ac279","Type":"ContainerStarted","Data":"6324dc100db60a7ed17722ff89c954e96cc8261308dabe993dbcea4ab7b2d47e"} Jun 09 15:01:28.608860 ip-10-0-133-239 kubenswrapper[2576]: I0609 15:01:28.608835 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-133-239.ec2.internal" event={"ID":"da1523b16a47c8ff940157f0e5b95b64","Type":"ContainerStarted","Data":"dddf1b56d333122a344f7123c712fac391335d3275707796d4619ab1b6edc260"} Jun 09 15:01:28.609987 ip-10-0-133-239 kubenswrapper[2576]: I0609 15:01:28.609966 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-db5nc" event={"ID":"16507eac-27c4-4ac4-b8a7-16d36c11a8d9","Type":"ContainerStarted","Data":"2e8901cf3e9e6a5e4269d6f94711bdf29b2337adbc3f07e8e7c01848b963e8c5"} Jun 09 15:01:28.611112 ip-10-0-133-239 kubenswrapper[2576]: I0609 15:01:28.611090 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-tz8c7" event={"ID":"aed341a8-0a84-498b-9b3c-75a83a8279bb","Type":"ContainerStarted","Data":"b24a20589c9284d91afd5210f1ad154a437301e30ad0b6c69a62864de30272a7"} Jun 09 15:01:28.612111 ip-10-0-133-239 kubenswrapper[2576]: I0609 15:01:28.612088 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-hplk7" event={"ID":"70b6eb4f-8b63-4ca7-ad8c-b558c1f71ad8","Type":"ContainerStarted","Data":"8352edfd9504d65bbcd1c66fe9ad297fd70a7977985379d7a84f5f56faf0f34e"} Jun 09 15:01:28.613141 ip-10-0-133-239 kubenswrapper[2576]: I0609 15:01:28.613120 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-n4c97" event={"ID":"441b2a74-d62c-4e3c-9e0f-b133cd4364be","Type":"ContainerStarted","Data":"d81c9b02ea1da879985fa504a14d2602b2b5bd31aff2c0c9269a5c3119ee4b7a"} Jun 09 15:01:28.614044 ip-10-0-133-239 kubenswrapper[2576]: I0609 15:01:28.614026 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-96jh2" event={"ID":"d5a7276b-a84f-4a88-b220-eb46f36768a0","Type":"ContainerStarted","Data":"ab2330fb67401218a810c6ecff59072fa9d23af246d82f8671922ce876609308"} Jun 09 15:01:28.614937 ip-10-0-133-239 kubenswrapper[2576]: I0609 15:01:28.614920 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-rvk7p" event={"ID":"77714a52-c22d-45f0-939d-b2a256bd511e","Type":"ContainerStarted","Data":"2fa14af64e9a21998e0c9cf1118558e8ae25f1ee958214f308cca7eabed8dbd7"} Jun 09 15:01:28.616011 ip-10-0-133-239 kubenswrapper[2576]: I0609 15:01:28.615989 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-d5rht" event={"ID":"819c59d4-2dfd-40f7-8018-dc29890cc325","Type":"ContainerStarted","Data":"82d33f70a27daeab5828c149edd3ae572d2ee190bd2313a26a68fce1709b26b4"} Jun 09 15:01:28.616966 ip-10-0-133-239 kubenswrapper[2576]: I0609 15:01:28.616940 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-f7pk9" event={"ID":"65d781cf-2987-4208-9e71-64260d0bb38a","Type":"ContainerStarted","Data":"2f8bc977d265916d1e06e125e347164e3b31ac4adc9934b5565d71c40ace88ee"} Jun 09 15:01:28.617795 ip-10-0-133-239 kubenswrapper[2576]: I0609 15:01:28.617775 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-n4qqs" event={"ID":"ab1b7146-38f5-4c67-b79c-d98d8f1734e8","Type":"ContainerStarted","Data":"4423ce38b0657adffa3d4bdb146e5e9961c4fcf7b1d8a4fb34773fb91ba6ac8b"} Jun 09 15:01:28.620933 ip-10-0-133-239 kubenswrapper[2576]: I0609 15:01:28.620885 2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/kube-apiserver-proxy-ip-10-0-133-239.ec2.internal" podStartSLOduration=1.62087172 podStartE2EDuration="1.62087172s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-09 15:01:27 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-09 15:01:28.620733824 +0000 UTC m=+3.474890063" watchObservedRunningTime="2026-06-09 15:01:28.62087172 +0000 UTC m=+3.475027972" Jun 09 15:01:29.157404 ip-10-0-133-239 kubenswrapper[2576]: I0609 15:01:29.157295 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/64cfa4da-d67f-413d-b01d-161226f943e7-metrics-certs\") pod \"network-metrics-daemon-rw24f\" (UID: \"64cfa4da-d67f-413d-b01d-161226f943e7\") " pod="openshift-multus/network-metrics-daemon-rw24f" Jun 09 15:01:29.157629 ip-10-0-133-239 kubenswrapper[2576]: E0609 15:01:29.157475 2576 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jun 09 15:01:29.157629 ip-10-0-133-239 kubenswrapper[2576]: E0609 15:01:29.157540 2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/64cfa4da-d67f-413d-b01d-161226f943e7-metrics-certs podName:64cfa4da-d67f-413d-b01d-161226f943e7 nodeName:}" failed. No retries permitted until 2026-06-09 15:01:31.157520427 +0000 UTC m=+6.011676647 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/64cfa4da-d67f-413d-b01d-161226f943e7-metrics-certs") pod "network-metrics-daemon-rw24f" (UID: "64cfa4da-d67f-413d-b01d-161226f943e7") : object "openshift-multus"/"metrics-daemon-secret" not registered Jun 09 15:01:29.257923 ip-10-0-133-239 kubenswrapper[2576]: I0609 15:01:29.257883 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/14860286-bb9d-4f00-864f-c2b041a3b160-original-pull-secret\") pod \"global-pull-secret-syncer-256sj\" (UID: \"14860286-bb9d-4f00-864f-c2b041a3b160\") " pod="kube-system/global-pull-secret-syncer-256sj" Jun 09 15:01:29.258129 ip-10-0-133-239 kubenswrapper[2576]: E0609 15:01:29.258084 2576 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jun 09 15:01:29.258193 ip-10-0-133-239 kubenswrapper[2576]: E0609 15:01:29.258145 2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/14860286-bb9d-4f00-864f-c2b041a3b160-original-pull-secret podName:14860286-bb9d-4f00-864f-c2b041a3b160 nodeName:}" failed. No retries permitted until 2026-06-09 15:01:31.258128826 +0000 UTC m=+6.112285047 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/14860286-bb9d-4f00-864f-c2b041a3b160-original-pull-secret") pod "global-pull-secret-syncer-256sj" (UID: "14860286-bb9d-4f00-864f-c2b041a3b160") : object "kube-system"/"original-pull-secret" not registered Jun 09 15:01:29.359039 ip-10-0-133-239 kubenswrapper[2576]: I0609 15:01:29.359004 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-l6z46\" (UniqueName: \"kubernetes.io/projected/95bb5504-8d73-44b5-84c6-4312e96be459-kube-api-access-l6z46\") pod \"network-check-target-p6wz2\" (UID: \"95bb5504-8d73-44b5-84c6-4312e96be459\") " pod="openshift-network-diagnostics/network-check-target-p6wz2" Jun 09 15:01:29.359219 ip-10-0-133-239 kubenswrapper[2576]: E0609 15:01:29.359178 2576 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jun 09 15:01:29.359219 ip-10-0-133-239 kubenswrapper[2576]: E0609 15:01:29.359198 2576 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jun 09 15:01:29.359219 ip-10-0-133-239 kubenswrapper[2576]: E0609 15:01:29.359211 2576 projected.go:196] Error preparing data for projected volume kube-api-access-l6z46 for pod openshift-network-diagnostics/network-check-target-p6wz2: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 09 15:01:29.359358 ip-10-0-133-239 kubenswrapper[2576]: E0609 15:01:29.359286 2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/95bb5504-8d73-44b5-84c6-4312e96be459-kube-api-access-l6z46 podName:95bb5504-8d73-44b5-84c6-4312e96be459 nodeName:}" failed. No retries permitted until 2026-06-09 15:01:31.35926625 +0000 UTC m=+6.213422479 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-api-access-l6z46" (UniqueName: "kubernetes.io/projected/95bb5504-8d73-44b5-84c6-4312e96be459-kube-api-access-l6z46") pod "network-check-target-p6wz2" (UID: "95bb5504-8d73-44b5-84c6-4312e96be459") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 09 15:01:29.573225 ip-10-0-133-239 kubenswrapper[2576]: I0609 15:01:29.573136 2576 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-06-08 14:56:27 +0000 UTC" deadline="2028-02-27 03:11:21.623772112 +0000 UTC" Jun 09 15:01:29.573225 ip-10-0-133-239 kubenswrapper[2576]: I0609 15:01:29.573175 2576 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="15060h9m52.050601171s" Jun 09 15:01:29.600338 ip-10-0-133-239 kubenswrapper[2576]: I0609 15:01:29.600307 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-p6wz2" Jun 09 15:01:29.600480 ip-10-0-133-239 kubenswrapper[2576]: E0609 15:01:29.600430 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-p6wz2" podUID="95bb5504-8d73-44b5-84c6-4312e96be459" Jun 09 15:01:29.600835 ip-10-0-133-239 kubenswrapper[2576]: I0609 15:01:29.600809 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-rw24f" Jun 09 15:01:29.600947 ip-10-0-133-239 kubenswrapper[2576]: E0609 15:01:29.600915 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-rw24f" podUID="64cfa4da-d67f-413d-b01d-161226f943e7" Jun 09 15:01:29.601017 ip-10-0-133-239 kubenswrapper[2576]: I0609 15:01:29.600977 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-256sj" Jun 09 15:01:29.601089 ip-10-0-133-239 kubenswrapper[2576]: E0609 15:01:29.601052 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-256sj" podUID="14860286-bb9d-4f00-864f-c2b041a3b160" Jun 09 15:01:29.656772 ip-10-0-133-239 kubenswrapper[2576]: I0609 15:01:29.656737 2576 generic.go:356] "Generic (PLEG): container finished" podID="da1523b16a47c8ff940157f0e5b95b64" containerID="dddf1b56d333122a344f7123c712fac391335d3275707796d4619ab1b6edc260" exitCode=0 Jun 09 15:01:29.656953 ip-10-0-133-239 kubenswrapper[2576]: I0609 15:01:29.656842 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-133-239.ec2.internal" event={"ID":"da1523b16a47c8ff940157f0e5b95b64","Type":"ContainerDied","Data":"dddf1b56d333122a344f7123c712fac391335d3275707796d4619ab1b6edc260"} Jun 09 15:01:30.689363 ip-10-0-133-239 kubenswrapper[2576]: I0609 15:01:30.689327 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-133-239.ec2.internal" event={"ID":"da1523b16a47c8ff940157f0e5b95b64","Type":"ContainerStarted","Data":"d42aae92319051777436b1e7a66fb8ec0eeebadca17fbe68ca755344bdab8195"} Jun 09 15:01:30.712632 ip-10-0-133-239 kubenswrapper[2576]: I0609 15:01:30.711604 2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-133-239.ec2.internal" podStartSLOduration=3.71158309 podStartE2EDuration="3.71158309s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-09 15:01:27 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-09 15:01:30.711358804 +0000 UTC m=+5.565515046" watchObservedRunningTime="2026-06-09 15:01:30.71158309 +0000 UTC m=+5.565739330" Jun 09 15:01:31.178207 ip-10-0-133-239 kubenswrapper[2576]: I0609 15:01:31.178115 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/64cfa4da-d67f-413d-b01d-161226f943e7-metrics-certs\") pod \"network-metrics-daemon-rw24f\" (UID: \"64cfa4da-d67f-413d-b01d-161226f943e7\") " pod="openshift-multus/network-metrics-daemon-rw24f" Jun 09 15:01:31.178358 ip-10-0-133-239 kubenswrapper[2576]: E0609 15:01:31.178273 2576 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jun 09 15:01:31.178358 ip-10-0-133-239 kubenswrapper[2576]: E0609 15:01:31.178340 2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/64cfa4da-d67f-413d-b01d-161226f943e7-metrics-certs podName:64cfa4da-d67f-413d-b01d-161226f943e7 nodeName:}" failed. No retries permitted until 2026-06-09 15:01:35.178320257 +0000 UTC m=+10.032476493 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/64cfa4da-d67f-413d-b01d-161226f943e7-metrics-certs") pod "network-metrics-daemon-rw24f" (UID: "64cfa4da-d67f-413d-b01d-161226f943e7") : object "openshift-multus"/"metrics-daemon-secret" not registered Jun 09 15:01:31.279465 ip-10-0-133-239 kubenswrapper[2576]: I0609 15:01:31.279426 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/14860286-bb9d-4f00-864f-c2b041a3b160-original-pull-secret\") pod \"global-pull-secret-syncer-256sj\" (UID: \"14860286-bb9d-4f00-864f-c2b041a3b160\") " pod="kube-system/global-pull-secret-syncer-256sj" Jun 09 15:01:31.279671 ip-10-0-133-239 kubenswrapper[2576]: E0609 15:01:31.279629 2576 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jun 09 15:01:31.279789 ip-10-0-133-239 kubenswrapper[2576]: E0609 15:01:31.279691 2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/14860286-bb9d-4f00-864f-c2b041a3b160-original-pull-secret podName:14860286-bb9d-4f00-864f-c2b041a3b160 nodeName:}" failed. No retries permitted until 2026-06-09 15:01:35.279673354 +0000 UTC m=+10.133829578 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/14860286-bb9d-4f00-864f-c2b041a3b160-original-pull-secret") pod "global-pull-secret-syncer-256sj" (UID: "14860286-bb9d-4f00-864f-c2b041a3b160") : object "kube-system"/"original-pull-secret" not registered Jun 09 15:01:31.380759 ip-10-0-133-239 kubenswrapper[2576]: I0609 15:01:31.380672 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-l6z46\" (UniqueName: \"kubernetes.io/projected/95bb5504-8d73-44b5-84c6-4312e96be459-kube-api-access-l6z46\") pod \"network-check-target-p6wz2\" (UID: \"95bb5504-8d73-44b5-84c6-4312e96be459\") " pod="openshift-network-diagnostics/network-check-target-p6wz2" Jun 09 15:01:31.380938 ip-10-0-133-239 kubenswrapper[2576]: E0609 15:01:31.380889 2576 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jun 09 15:01:31.380938 ip-10-0-133-239 kubenswrapper[2576]: E0609 15:01:31.380910 2576 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jun 09 15:01:31.380938 ip-10-0-133-239 kubenswrapper[2576]: E0609 15:01:31.380923 2576 projected.go:196] Error preparing data for projected volume kube-api-access-l6z46 for pod openshift-network-diagnostics/network-check-target-p6wz2: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 09 15:01:31.381165 ip-10-0-133-239 kubenswrapper[2576]: E0609 15:01:31.380982 2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/95bb5504-8d73-44b5-84c6-4312e96be459-kube-api-access-l6z46 podName:95bb5504-8d73-44b5-84c6-4312e96be459 nodeName:}" failed. No retries permitted until 2026-06-09 15:01:35.380964445 +0000 UTC m=+10.235120667 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-api-access-l6z46" (UniqueName: "kubernetes.io/projected/95bb5504-8d73-44b5-84c6-4312e96be459-kube-api-access-l6z46") pod "network-check-target-p6wz2" (UID: "95bb5504-8d73-44b5-84c6-4312e96be459") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 09 15:01:31.598424 ip-10-0-133-239 kubenswrapper[2576]: I0609 15:01:31.598347 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-p6wz2" Jun 09 15:01:31.598424 ip-10-0-133-239 kubenswrapper[2576]: I0609 15:01:31.598389 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-256sj" Jun 09 15:01:31.598635 ip-10-0-133-239 kubenswrapper[2576]: I0609 15:01:31.598359 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-rw24f" Jun 09 15:01:31.598635 ip-10-0-133-239 kubenswrapper[2576]: E0609 15:01:31.598480 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-p6wz2" podUID="95bb5504-8d73-44b5-84c6-4312e96be459" Jun 09 15:01:31.598635 ip-10-0-133-239 kubenswrapper[2576]: E0609 15:01:31.598562 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-rw24f" podUID="64cfa4da-d67f-413d-b01d-161226f943e7" Jun 09 15:01:31.598635 ip-10-0-133-239 kubenswrapper[2576]: E0609 15:01:31.598623 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-256sj" podUID="14860286-bb9d-4f00-864f-c2b041a3b160" Jun 09 15:01:33.598552 ip-10-0-133-239 kubenswrapper[2576]: I0609 15:01:33.598520 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-p6wz2" Jun 09 15:01:33.598978 ip-10-0-133-239 kubenswrapper[2576]: I0609 15:01:33.598520 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-rw24f" Jun 09 15:01:33.598978 ip-10-0-133-239 kubenswrapper[2576]: E0609 15:01:33.598661 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-p6wz2" podUID="95bb5504-8d73-44b5-84c6-4312e96be459" Jun 09 15:01:33.598978 ip-10-0-133-239 kubenswrapper[2576]: E0609 15:01:33.598738 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-rw24f" podUID="64cfa4da-d67f-413d-b01d-161226f943e7" Jun 09 15:01:33.598978 ip-10-0-133-239 kubenswrapper[2576]: I0609 15:01:33.598804 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-256sj" Jun 09 15:01:33.598978 ip-10-0-133-239 kubenswrapper[2576]: E0609 15:01:33.598889 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-256sj" podUID="14860286-bb9d-4f00-864f-c2b041a3b160" Jun 09 15:01:35.215183 ip-10-0-133-239 kubenswrapper[2576]: I0609 15:01:35.215121 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/64cfa4da-d67f-413d-b01d-161226f943e7-metrics-certs\") pod \"network-metrics-daemon-rw24f\" (UID: \"64cfa4da-d67f-413d-b01d-161226f943e7\") " pod="openshift-multus/network-metrics-daemon-rw24f" Jun 09 15:01:35.215645 ip-10-0-133-239 kubenswrapper[2576]: E0609 15:01:35.215291 2576 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jun 09 15:01:35.215645 ip-10-0-133-239 kubenswrapper[2576]: E0609 15:01:35.215360 2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/64cfa4da-d67f-413d-b01d-161226f943e7-metrics-certs podName:64cfa4da-d67f-413d-b01d-161226f943e7 nodeName:}" failed. No retries permitted until 2026-06-09 15:01:43.215339453 +0000 UTC m=+18.069495676 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/64cfa4da-d67f-413d-b01d-161226f943e7-metrics-certs") pod "network-metrics-daemon-rw24f" (UID: "64cfa4da-d67f-413d-b01d-161226f943e7") : object "openshift-multus"/"metrics-daemon-secret" not registered Jun 09 15:01:35.316037 ip-10-0-133-239 kubenswrapper[2576]: I0609 15:01:35.315980 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/14860286-bb9d-4f00-864f-c2b041a3b160-original-pull-secret\") pod \"global-pull-secret-syncer-256sj\" (UID: \"14860286-bb9d-4f00-864f-c2b041a3b160\") " pod="kube-system/global-pull-secret-syncer-256sj" Jun 09 15:01:35.316242 ip-10-0-133-239 kubenswrapper[2576]: E0609 15:01:35.316164 2576 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jun 09 15:01:35.316304 ip-10-0-133-239 kubenswrapper[2576]: E0609 15:01:35.316251 2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/14860286-bb9d-4f00-864f-c2b041a3b160-original-pull-secret podName:14860286-bb9d-4f00-864f-c2b041a3b160 nodeName:}" failed. No retries permitted until 2026-06-09 15:01:43.316229971 +0000 UTC m=+18.170386190 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/14860286-bb9d-4f00-864f-c2b041a3b160-original-pull-secret") pod "global-pull-secret-syncer-256sj" (UID: "14860286-bb9d-4f00-864f-c2b041a3b160") : object "kube-system"/"original-pull-secret" not registered Jun 09 15:01:35.416394 ip-10-0-133-239 kubenswrapper[2576]: I0609 15:01:35.416357 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-l6z46\" (UniqueName: \"kubernetes.io/projected/95bb5504-8d73-44b5-84c6-4312e96be459-kube-api-access-l6z46\") pod \"network-check-target-p6wz2\" (UID: \"95bb5504-8d73-44b5-84c6-4312e96be459\") " pod="openshift-network-diagnostics/network-check-target-p6wz2" Jun 09 15:01:35.416596 ip-10-0-133-239 kubenswrapper[2576]: E0609 15:01:35.416570 2576 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jun 09 15:01:35.416741 ip-10-0-133-239 kubenswrapper[2576]: E0609 15:01:35.416604 2576 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jun 09 15:01:35.416741 ip-10-0-133-239 kubenswrapper[2576]: E0609 15:01:35.416620 2576 projected.go:196] Error preparing data for projected volume kube-api-access-l6z46 for pod openshift-network-diagnostics/network-check-target-p6wz2: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 09 15:01:35.416741 ip-10-0-133-239 kubenswrapper[2576]: E0609 15:01:35.416691 2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/95bb5504-8d73-44b5-84c6-4312e96be459-kube-api-access-l6z46 podName:95bb5504-8d73-44b5-84c6-4312e96be459 nodeName:}" failed. No retries permitted until 2026-06-09 15:01:43.416669885 +0000 UTC m=+18.270826120 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-api-access-l6z46" (UniqueName: "kubernetes.io/projected/95bb5504-8d73-44b5-84c6-4312e96be459-kube-api-access-l6z46") pod "network-check-target-p6wz2" (UID: "95bb5504-8d73-44b5-84c6-4312e96be459") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 09 15:01:35.607481 ip-10-0-133-239 kubenswrapper[2576]: I0609 15:01:35.607407 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-256sj" Jun 09 15:01:35.607764 ip-10-0-133-239 kubenswrapper[2576]: I0609 15:01:35.607424 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-p6wz2" Jun 09 15:01:35.607867 ip-10-0-133-239 kubenswrapper[2576]: E0609 15:01:35.607757 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-256sj" podUID="14860286-bb9d-4f00-864f-c2b041a3b160" Jun 09 15:01:35.607951 ip-10-0-133-239 kubenswrapper[2576]: E0609 15:01:35.607852 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-p6wz2" podUID="95bb5504-8d73-44b5-84c6-4312e96be459" Jun 09 15:01:35.608015 ip-10-0-133-239 kubenswrapper[2576]: I0609 15:01:35.607501 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-rw24f" Jun 09 15:01:35.608198 ip-10-0-133-239 kubenswrapper[2576]: E0609 15:01:35.608170 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-rw24f" podUID="64cfa4da-d67f-413d-b01d-161226f943e7" Jun 09 15:01:37.598264 ip-10-0-133-239 kubenswrapper[2576]: I0609 15:01:37.598230 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-rw24f" Jun 09 15:01:37.598870 ip-10-0-133-239 kubenswrapper[2576]: I0609 15:01:37.598232 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-256sj" Jun 09 15:01:37.598870 ip-10-0-133-239 kubenswrapper[2576]: I0609 15:01:37.598389 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-p6wz2" Jun 09 15:01:37.598870 ip-10-0-133-239 kubenswrapper[2576]: E0609 15:01:37.598405 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-rw24f" podUID="64cfa4da-d67f-413d-b01d-161226f943e7" Jun 09 15:01:37.598870 ip-10-0-133-239 kubenswrapper[2576]: E0609 15:01:37.598500 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-p6wz2" podUID="95bb5504-8d73-44b5-84c6-4312e96be459" Jun 09 15:01:37.598870 ip-10-0-133-239 kubenswrapper[2576]: E0609 15:01:37.598583 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-256sj" podUID="14860286-bb9d-4f00-864f-c2b041a3b160" Jun 09 15:01:39.598478 ip-10-0-133-239 kubenswrapper[2576]: I0609 15:01:39.598442 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-p6wz2" Jun 09 15:01:39.598924 ip-10-0-133-239 kubenswrapper[2576]: I0609 15:01:39.598441 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-rw24f" Jun 09 15:01:39.598924 ip-10-0-133-239 kubenswrapper[2576]: I0609 15:01:39.598584 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-256sj" Jun 09 15:01:39.598924 ip-10-0-133-239 kubenswrapper[2576]: E0609 15:01:39.598583 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-p6wz2" podUID="95bb5504-8d73-44b5-84c6-4312e96be459" Jun 09 15:01:39.598924 ip-10-0-133-239 kubenswrapper[2576]: E0609 15:01:39.598690 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-rw24f" podUID="64cfa4da-d67f-413d-b01d-161226f943e7" Jun 09 15:01:39.598924 ip-10-0-133-239 kubenswrapper[2576]: E0609 15:01:39.598757 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-256sj" podUID="14860286-bb9d-4f00-864f-c2b041a3b160" Jun 09 15:01:41.598644 ip-10-0-133-239 kubenswrapper[2576]: I0609 15:01:41.598606 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-p6wz2" Jun 09 15:01:41.598644 ip-10-0-133-239 kubenswrapper[2576]: I0609 15:01:41.598627 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-rw24f" Jun 09 15:01:41.599305 ip-10-0-133-239 kubenswrapper[2576]: E0609 15:01:41.598730 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-p6wz2" podUID="95bb5504-8d73-44b5-84c6-4312e96be459" Jun 09 15:01:41.599305 ip-10-0-133-239 kubenswrapper[2576]: E0609 15:01:41.598821 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-rw24f" podUID="64cfa4da-d67f-413d-b01d-161226f943e7" Jun 09 15:01:41.599305 ip-10-0-133-239 kubenswrapper[2576]: I0609 15:01:41.598858 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-256sj" Jun 09 15:01:41.599305 ip-10-0-133-239 kubenswrapper[2576]: E0609 15:01:41.598958 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-256sj" podUID="14860286-bb9d-4f00-864f-c2b041a3b160" Jun 09 15:01:43.274423 ip-10-0-133-239 kubenswrapper[2576]: I0609 15:01:43.274382 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/64cfa4da-d67f-413d-b01d-161226f943e7-metrics-certs\") pod \"network-metrics-daemon-rw24f\" (UID: \"64cfa4da-d67f-413d-b01d-161226f943e7\") " pod="openshift-multus/network-metrics-daemon-rw24f" Jun 09 15:01:43.274929 ip-10-0-133-239 kubenswrapper[2576]: E0609 15:01:43.274520 2576 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jun 09 15:01:43.274929 ip-10-0-133-239 kubenswrapper[2576]: E0609 15:01:43.274573 2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/64cfa4da-d67f-413d-b01d-161226f943e7-metrics-certs podName:64cfa4da-d67f-413d-b01d-161226f943e7 nodeName:}" failed. No retries permitted until 2026-06-09 15:01:59.2745592 +0000 UTC m=+34.128715429 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/64cfa4da-d67f-413d-b01d-161226f943e7-metrics-certs") pod "network-metrics-daemon-rw24f" (UID: "64cfa4da-d67f-413d-b01d-161226f943e7") : object "openshift-multus"/"metrics-daemon-secret" not registered Jun 09 15:01:43.375458 ip-10-0-133-239 kubenswrapper[2576]: I0609 15:01:43.375422 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/14860286-bb9d-4f00-864f-c2b041a3b160-original-pull-secret\") pod \"global-pull-secret-syncer-256sj\" (UID: \"14860286-bb9d-4f00-864f-c2b041a3b160\") " pod="kube-system/global-pull-secret-syncer-256sj" Jun 09 15:01:43.375649 ip-10-0-133-239 kubenswrapper[2576]: E0609 15:01:43.375584 2576 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jun 09 15:01:43.375649 ip-10-0-133-239 kubenswrapper[2576]: E0609 15:01:43.375647 2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/14860286-bb9d-4f00-864f-c2b041a3b160-original-pull-secret podName:14860286-bb9d-4f00-864f-c2b041a3b160 nodeName:}" failed. No retries permitted until 2026-06-09 15:01:59.3756328 +0000 UTC m=+34.229789017 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/14860286-bb9d-4f00-864f-c2b041a3b160-original-pull-secret") pod "global-pull-secret-syncer-256sj" (UID: "14860286-bb9d-4f00-864f-c2b041a3b160") : object "kube-system"/"original-pull-secret" not registered Jun 09 15:01:43.475962 ip-10-0-133-239 kubenswrapper[2576]: I0609 15:01:43.475916 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-l6z46\" (UniqueName: \"kubernetes.io/projected/95bb5504-8d73-44b5-84c6-4312e96be459-kube-api-access-l6z46\") pod \"network-check-target-p6wz2\" (UID: \"95bb5504-8d73-44b5-84c6-4312e96be459\") " pod="openshift-network-diagnostics/network-check-target-p6wz2" Jun 09 15:01:43.476187 ip-10-0-133-239 kubenswrapper[2576]: E0609 15:01:43.476095 2576 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jun 09 15:01:43.476187 ip-10-0-133-239 kubenswrapper[2576]: E0609 15:01:43.476117 2576 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jun 09 15:01:43.476187 ip-10-0-133-239 kubenswrapper[2576]: E0609 15:01:43.476128 2576 projected.go:196] Error preparing data for projected volume kube-api-access-l6z46 for pod openshift-network-diagnostics/network-check-target-p6wz2: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 09 15:01:43.476362 ip-10-0-133-239 kubenswrapper[2576]: E0609 15:01:43.476192 2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/95bb5504-8d73-44b5-84c6-4312e96be459-kube-api-access-l6z46 podName:95bb5504-8d73-44b5-84c6-4312e96be459 nodeName:}" failed. No retries permitted until 2026-06-09 15:01:59.476170735 +0000 UTC m=+34.330326953 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "kube-api-access-l6z46" (UniqueName: "kubernetes.io/projected/95bb5504-8d73-44b5-84c6-4312e96be459-kube-api-access-l6z46") pod "network-check-target-p6wz2" (UID: "95bb5504-8d73-44b5-84c6-4312e96be459") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 09 15:01:43.598020 ip-10-0-133-239 kubenswrapper[2576]: I0609 15:01:43.597943 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-256sj" Jun 09 15:01:43.598201 ip-10-0-133-239 kubenswrapper[2576]: I0609 15:01:43.597948 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-p6wz2" Jun 09 15:01:43.598201 ip-10-0-133-239 kubenswrapper[2576]: E0609 15:01:43.598051 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-256sj" podUID="14860286-bb9d-4f00-864f-c2b041a3b160" Jun 09 15:01:43.598201 ip-10-0-133-239 kubenswrapper[2576]: I0609 15:01:43.597955 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-rw24f" Jun 09 15:01:43.598201 ip-10-0-133-239 kubenswrapper[2576]: E0609 15:01:43.598149 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-p6wz2" podUID="95bb5504-8d73-44b5-84c6-4312e96be459" Jun 09 15:01:43.598366 ip-10-0-133-239 kubenswrapper[2576]: E0609 15:01:43.598222 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-rw24f" podUID="64cfa4da-d67f-413d-b01d-161226f943e7" Jun 09 15:01:45.599362 ip-10-0-133-239 kubenswrapper[2576]: I0609 15:01:45.599333 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-rw24f" Jun 09 15:01:45.599810 ip-10-0-133-239 kubenswrapper[2576]: I0609 15:01:45.599457 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-256sj" Jun 09 15:01:45.599810 ip-10-0-133-239 kubenswrapper[2576]: E0609 15:01:45.599563 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-256sj" podUID="14860286-bb9d-4f00-864f-c2b041a3b160" Jun 09 15:01:45.599810 ip-10-0-133-239 kubenswrapper[2576]: E0609 15:01:45.599449 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-rw24f" podUID="64cfa4da-d67f-413d-b01d-161226f943e7" Jun 09 15:01:45.599810 ip-10-0-133-239 kubenswrapper[2576]: I0609 15:01:45.599626 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-p6wz2" Jun 09 15:01:45.599810 ip-10-0-133-239 kubenswrapper[2576]: E0609 15:01:45.599692 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-p6wz2" podUID="95bb5504-8d73-44b5-84c6-4312e96be459" Jun 09 15:01:47.598461 ip-10-0-133-239 kubenswrapper[2576]: I0609 15:01:47.598168 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-256sj" Jun 09 15:01:47.598926 ip-10-0-133-239 kubenswrapper[2576]: I0609 15:01:47.598167 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-p6wz2" Jun 09 15:01:47.598926 ip-10-0-133-239 kubenswrapper[2576]: E0609 15:01:47.598570 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-256sj" podUID="14860286-bb9d-4f00-864f-c2b041a3b160" Jun 09 15:01:47.598926 ip-10-0-133-239 kubenswrapper[2576]: I0609 15:01:47.598201 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-rw24f" Jun 09 15:01:47.598926 ip-10-0-133-239 kubenswrapper[2576]: E0609 15:01:47.598604 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-p6wz2" podUID="95bb5504-8d73-44b5-84c6-4312e96be459" Jun 09 15:01:47.598926 ip-10-0-133-239 kubenswrapper[2576]: E0609 15:01:47.598718 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-rw24f" podUID="64cfa4da-d67f-413d-b01d-161226f943e7" Jun 09 15:01:47.726112 ip-10-0-133-239 kubenswrapper[2576]: I0609 15:01:47.726021 2576 generic.go:356] "Generic (PLEG): container finished" podID="77714a52-c22d-45f0-939d-b2a256bd511e" containerID="28b2147153eb110eb23865770737b0c237bb4caa61630e4bb3bdad03ca6e0470" exitCode=0 Jun 09 15:01:47.726263 ip-10-0-133-239 kubenswrapper[2576]: I0609 15:01:47.726127 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-rvk7p" event={"ID":"77714a52-c22d-45f0-939d-b2a256bd511e","Type":"ContainerDied","Data":"28b2147153eb110eb23865770737b0c237bb4caa61630e4bb3bdad03ca6e0470"} Jun 09 15:01:47.728375 ip-10-0-133-239 kubenswrapper[2576]: I0609 15:01:47.728341 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-d5rht" event={"ID":"819c59d4-2dfd-40f7-8018-dc29890cc325","Type":"ContainerStarted","Data":"8ccb839408eebc4b52462dc6de21370f452b9135675f1b0db4aef152e33fa4f7"} Jun 09 15:01:47.730455 ip-10-0-133-239 kubenswrapper[2576]: I0609 15:01:47.730426 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-f7pk9" event={"ID":"65d781cf-2987-4208-9e71-64260d0bb38a","Type":"ContainerStarted","Data":"6ad3469e796f4752e2efb3b857bcc24afbe2884361581f0eccb25ec65f602740"} Jun 09 15:01:47.732569 ip-10-0-133-239 kubenswrapper[2576]: I0609 15:01:47.732247 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-n4qqs" event={"ID":"ab1b7146-38f5-4c67-b79c-d98d8f1734e8","Type":"ContainerStarted","Data":"169270f5e4c0ea7e55884fee732fddab3dd509e3dd1ef4580bdbe25329d1ebb8"} Jun 09 15:01:47.733837 ip-10-0-133-239 kubenswrapper[2576]: I0609 15:01:47.733789 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-tz8c7" event={"ID":"aed341a8-0a84-498b-9b3c-75a83a8279bb","Type":"ContainerStarted","Data":"860b16273ff42b99db53d74ba383009fd93d77b48ddecdc3e7e22c917bfcdaa7"} Jun 09 15:01:47.735512 ip-10-0-133-239 kubenswrapper[2576]: I0609 15:01:47.735492 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-hplk7" event={"ID":"70b6eb4f-8b63-4ca7-ad8c-b558c1f71ad8","Type":"ContainerStarted","Data":"a596bd91385ec8ae571ae60bd7b54aa6dde6c6e04cc92800e3fa7c690b86fed2"} Jun 09 15:01:47.739059 ip-10-0-133-239 kubenswrapper[2576]: I0609 15:01:47.739041 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-n4c97_441b2a74-d62c-4e3c-9e0f-b133cd4364be/ovn-acl-logging/0.log" Jun 09 15:01:47.739424 ip-10-0-133-239 kubenswrapper[2576]: I0609 15:01:47.739401 2576 generic.go:356] "Generic (PLEG): container finished" podID="441b2a74-d62c-4e3c-9e0f-b133cd4364be" containerID="63ff84e4cee20f1bfa8b827f7aca24e3999155ac8f969450361cee05c0ffba34" exitCode=1 Jun 09 15:01:47.739523 ip-10-0-133-239 kubenswrapper[2576]: I0609 15:01:47.739471 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-n4c97" event={"ID":"441b2a74-d62c-4e3c-9e0f-b133cd4364be","Type":"ContainerStarted","Data":"0ece99c5f3703123ad1271e3a74c11de918c91cd3dbc7f5ee0e975e59b2159f4"} Jun 09 15:01:47.739583 ip-10-0-133-239 kubenswrapper[2576]: I0609 15:01:47.739538 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-n4c97" event={"ID":"441b2a74-d62c-4e3c-9e0f-b133cd4364be","Type":"ContainerStarted","Data":"ceff763b87f604cd3cd42fe3aace1feaa53b863b486a4a553e271bf5eb04b667"} Jun 09 15:01:47.739638 ip-10-0-133-239 kubenswrapper[2576]: I0609 15:01:47.739593 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-n4c97" event={"ID":"441b2a74-d62c-4e3c-9e0f-b133cd4364be","Type":"ContainerStarted","Data":"886c13d11f5aa8914e28be80591046bf11946e525404a9865fc8abe204ae6eb3"} Jun 09 15:01:47.739689 ip-10-0-133-239 kubenswrapper[2576]: I0609 15:01:47.739639 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-n4c97" event={"ID":"441b2a74-d62c-4e3c-9e0f-b133cd4364be","Type":"ContainerStarted","Data":"787885f452f000803263df859052bb0b3e087970ab686e0fede00397da0ee8ad"} Jun 09 15:01:47.739744 ip-10-0-133-239 kubenswrapper[2576]: I0609 15:01:47.739686 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-n4c97" event={"ID":"441b2a74-d62c-4e3c-9e0f-b133cd4364be","Type":"ContainerDied","Data":"63ff84e4cee20f1bfa8b827f7aca24e3999155ac8f969450361cee05c0ffba34"} Jun 09 15:01:47.739744 ip-10-0-133-239 kubenswrapper[2576]: I0609 15:01:47.739731 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-n4c97" event={"ID":"441b2a74-d62c-4e3c-9e0f-b133cd4364be","Type":"ContainerStarted","Data":"3bdd15c08c3ab4554dbf4e302989c68912d172984af006776108e17ae98adaf6"} Jun 09 15:01:47.741331 ip-10-0-133-239 kubenswrapper[2576]: I0609 15:01:47.740966 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-96jh2" event={"ID":"d5a7276b-a84f-4a88-b220-eb46f36768a0","Type":"ContainerStarted","Data":"d9876597a6658cfdc24ab19e93050a15b7419251cadbb4bdef685130a2a1e779"} Jun 09 15:01:47.763481 ip-10-0-133-239 kubenswrapper[2576]: I0609 15:01:47.763436 2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/node-resolver-d5rht" podStartSLOduration=3.275313786 podStartE2EDuration="21.763421891s" totalImagesPullingTime="18.488108105s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-09 15:01:26 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-09 15:01:47.762847319 +0000 UTC m=+22.617003559" watchObservedRunningTime="2026-06-09 15:01:47.763421891 +0000 UTC m=+22.617578130" Jun 09 15:01:47.776873 ip-10-0-133-239 kubenswrapper[2576]: I0609 15:01:47.776816 2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/konnectivity-agent-tz8c7" podStartSLOduration=8.009857441 podStartE2EDuration="21.776794408s" totalImagesPullingTime="13.766936967s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-09 15:01:26 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-09 15:01:47.776626526 +0000 UTC m=+22.630782777" watchObservedRunningTime="2026-06-09 15:01:47.776794408 +0000 UTC m=+22.630950648" Jun 09 15:01:47.794088 ip-10-0-133-239 kubenswrapper[2576]: I0609 15:01:47.794024 2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-96jh2" podStartSLOduration=4.272361578 podStartE2EDuration="22.794007857s" totalImagesPullingTime="18.521646279s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-09 15:01:25 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-09 15:01:47.793288099 +0000 UTC m=+22.647444338" watchObservedRunningTime="2026-06-09 15:01:47.794007857 +0000 UTC m=+22.648164097" Jun 09 15:01:47.807115 ip-10-0-133-239 kubenswrapper[2576]: I0609 15:01:47.807059 2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/node-ca-n4qqs" podStartSLOduration=9.031929268 podStartE2EDuration="22.807046142s" totalImagesPullingTime="13.775116874s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-09 15:01:25 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-09 15:01:47.806764913 +0000 UTC m=+22.660921151" watchObservedRunningTime="2026-06-09 15:01:47.807046142 +0000 UTC m=+22.661202381" Jun 09 15:01:47.825679 ip-10-0-133-239 kubenswrapper[2576]: I0609 15:01:47.825634 2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-node-tuning-operator/tuned-hplk7" podStartSLOduration=4.311262189 podStartE2EDuration="22.825620425s" totalImagesPullingTime="18.514358236s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-09 15:01:25 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-09 15:01:47.825589742 +0000 UTC m=+22.679745981" watchObservedRunningTime="2026-06-09 15:01:47.825620425 +0000 UTC m=+22.679776663" Jun 09 15:01:48.602616 ip-10-0-133-239 kubenswrapper[2576]: I0609 15:01:48.602588 2576 plugin_watcher.go:194] "Adding socket path or updating timestamp to desired state cache" path="/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock" Jun 09 15:01:48.745734 ip-10-0-133-239 kubenswrapper[2576]: I0609 15:01:48.745648 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-f7pk9" event={"ID":"65d781cf-2987-4208-9e71-64260d0bb38a","Type":"ContainerStarted","Data":"c92722668f296602760ca7e362a319cbec0b9d1f5b726b656cbb9c75e713fec6"} Jun 09 15:01:48.747264 ip-10-0-133-239 kubenswrapper[2576]: I0609 15:01:48.747225 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-db5nc" event={"ID":"16507eac-27c4-4ac4-b8a7-16d36c11a8d9","Type":"ContainerStarted","Data":"ea7e258bc2bfb4fafa8968564bcd191de4bdac4994dec640ab843bd301aade04"} Jun 09 15:01:48.763715 ip-10-0-133-239 kubenswrapper[2576]: I0609 15:01:48.763674 2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-operator/iptables-alerter-db5nc" podStartSLOduration=9.997655018 podStartE2EDuration="23.763658911s" totalImagesPullingTime="13.766003893s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-09 15:01:25 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-09 15:01:48.763074814 +0000 UTC m=+23.617231045" watchObservedRunningTime="2026-06-09 15:01:48.763658911 +0000 UTC m=+23.617815200" Jun 09 15:01:49.598920 ip-10-0-133-239 kubenswrapper[2576]: I0609 15:01:49.598651 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-rw24f" Jun 09 15:01:49.598920 ip-10-0-133-239 kubenswrapper[2576]: I0609 15:01:49.598651 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-256sj" Jun 09 15:01:49.598920 ip-10-0-133-239 kubenswrapper[2576]: I0609 15:01:49.598790 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-p6wz2" Jun 09 15:01:49.598920 ip-10-0-133-239 kubenswrapper[2576]: E0609 15:01:49.598784 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-rw24f" podUID="64cfa4da-d67f-413d-b01d-161226f943e7" Jun 09 15:01:49.598920 ip-10-0-133-239 kubenswrapper[2576]: E0609 15:01:49.598878 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-256sj" podUID="14860286-bb9d-4f00-864f-c2b041a3b160" Jun 09 15:01:49.599328 ip-10-0-133-239 kubenswrapper[2576]: E0609 15:01:49.598940 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-p6wz2" podUID="95bb5504-8d73-44b5-84c6-4312e96be459" Jun 09 15:01:49.602038 ip-10-0-133-239 kubenswrapper[2576]: I0609 15:01:49.601949 2576 reconciler.go:161] "OperationExecutor.RegisterPlugin started" plugin={"SocketPath":"/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock","Timestamp":"2026-06-09T15:01:48.602610002Z","UUID":"d4096b0d-f2b8-439e-9ab8-372e9a880614","Handler":null,"Name":"","Endpoint":""} Jun 09 15:01:49.603671 ip-10-0-133-239 kubenswrapper[2576]: I0609 15:01:49.603650 2576 csi_plugin.go:106] kubernetes.io/csi: Trying to validate a new CSI Driver with name: ebs.csi.aws.com endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock versions: 1.0.0 Jun 09 15:01:49.604234 ip-10-0-133-239 kubenswrapper[2576]: I0609 15:01:49.603694 2576 csi_plugin.go:119] kubernetes.io/csi: Register new plugin with name: ebs.csi.aws.com at endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock Jun 09 15:01:49.766370 ip-10-0-133-239 kubenswrapper[2576]: I0609 15:01:49.766342 2576 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="kube-system/konnectivity-agent-tz8c7" Jun 09 15:01:49.767010 ip-10-0-133-239 kubenswrapper[2576]: I0609 15:01:49.766988 2576 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="kube-system/konnectivity-agent-tz8c7" Jun 09 15:01:50.755424 ip-10-0-133-239 kubenswrapper[2576]: I0609 15:01:50.755353 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-n4c97_441b2a74-d62c-4e3c-9e0f-b133cd4364be/ovn-acl-logging/0.log" Jun 09 15:01:50.755892 ip-10-0-133-239 kubenswrapper[2576]: I0609 15:01:50.755697 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-n4c97" event={"ID":"441b2a74-d62c-4e3c-9e0f-b133cd4364be","Type":"ContainerStarted","Data":"f2f05e67efc9cbdd72114fbeb3e11c868bcf8f666667b0713049a772ba1f3303"} Jun 09 15:01:50.757538 ip-10-0-133-239 kubenswrapper[2576]: I0609 15:01:50.757509 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-f7pk9" event={"ID":"65d781cf-2987-4208-9e71-64260d0bb38a","Type":"ContainerStarted","Data":"3aa1b275f5b585f462d5edb7f76d835870d0764fafc32fa9c8e8356c4719591f"} Jun 09 15:01:50.774969 ip-10-0-133-239 kubenswrapper[2576]: I0609 15:01:50.774924 2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-f7pk9" podStartSLOduration=4.292013645 podStartE2EDuration="25.774910615s" totalImagesPullingTime="21.48289697s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-09 15:01:25 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-09 15:01:50.77451355 +0000 UTC m=+25.628669789" watchObservedRunningTime="2026-06-09 15:01:50.774910615 +0000 UTC m=+25.629066853" Jun 09 15:01:51.598334 ip-10-0-133-239 kubenswrapper[2576]: I0609 15:01:51.598303 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-rw24f" Jun 09 15:01:51.598522 ip-10-0-133-239 kubenswrapper[2576]: I0609 15:01:51.598303 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-p6wz2" Jun 09 15:01:51.598522 ip-10-0-133-239 kubenswrapper[2576]: I0609 15:01:51.598312 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-256sj" Jun 09 15:01:51.598522 ip-10-0-133-239 kubenswrapper[2576]: E0609 15:01:51.598490 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-rw24f" podUID="64cfa4da-d67f-413d-b01d-161226f943e7" Jun 09 15:01:51.598666 ip-10-0-133-239 kubenswrapper[2576]: E0609 15:01:51.598591 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-p6wz2" podUID="95bb5504-8d73-44b5-84c6-4312e96be459" Jun 09 15:01:51.598717 ip-10-0-133-239 kubenswrapper[2576]: E0609 15:01:51.598683 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-256sj" podUID="14860286-bb9d-4f00-864f-c2b041a3b160" Jun 09 15:01:52.537543 ip-10-0-133-239 kubenswrapper[2576]: I0609 15:01:52.537370 2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kube-system/konnectivity-agent-tz8c7" Jun 09 15:01:52.537831 ip-10-0-133-239 kubenswrapper[2576]: I0609 15:01:52.537631 2576 prober_manager.go:312] "Failed to trigger a manual run" probe="Readiness" Jun 09 15:01:52.538147 ip-10-0-133-239 kubenswrapper[2576]: I0609 15:01:52.538123 2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kube-system/konnectivity-agent-tz8c7" Jun 09 15:01:52.766319 ip-10-0-133-239 kubenswrapper[2576]: I0609 15:01:52.766290 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-n4c97_441b2a74-d62c-4e3c-9e0f-b133cd4364be/ovn-acl-logging/0.log" Jun 09 15:01:52.766686 ip-10-0-133-239 kubenswrapper[2576]: I0609 15:01:52.766663 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-n4c97" event={"ID":"441b2a74-d62c-4e3c-9e0f-b133cd4364be","Type":"ContainerStarted","Data":"e18bf125cea42ae6e8b051b349c467bbc746b04ece3420ec438430ba0f9766bf"} Jun 09 15:01:52.766959 ip-10-0-133-239 kubenswrapper[2576]: I0609 15:01:52.766940 2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-n4c97" Jun 09 15:01:52.767708 ip-10-0-133-239 kubenswrapper[2576]: I0609 15:01:52.767269 2576 scope.go:117] "RemoveContainer" containerID="63ff84e4cee20f1bfa8b827f7aca24e3999155ac8f969450361cee05c0ffba34" Jun 09 15:01:52.768978 ip-10-0-133-239 kubenswrapper[2576]: I0609 15:01:52.768777 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-rvk7p" event={"ID":"77714a52-c22d-45f0-939d-b2a256bd511e","Type":"ContainerStarted","Data":"13e780f1be4d7e181ecb3c462a9429ea648749f3405a116003e3cdb588625449"} Jun 09 15:01:52.783712 ip-10-0-133-239 kubenswrapper[2576]: I0609 15:01:52.783695 2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-n4c97" Jun 09 15:01:53.598061 ip-10-0-133-239 kubenswrapper[2576]: I0609 15:01:53.598029 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-p6wz2" Jun 09 15:01:53.598574 ip-10-0-133-239 kubenswrapper[2576]: E0609 15:01:53.598147 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-p6wz2" podUID="95bb5504-8d73-44b5-84c6-4312e96be459" Jun 09 15:01:53.598574 ip-10-0-133-239 kubenswrapper[2576]: I0609 15:01:53.598029 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-rw24f" Jun 09 15:01:53.598574 ip-10-0-133-239 kubenswrapper[2576]: I0609 15:01:53.598179 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-256sj" Jun 09 15:01:53.598574 ip-10-0-133-239 kubenswrapper[2576]: E0609 15:01:53.598227 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-rw24f" podUID="64cfa4da-d67f-413d-b01d-161226f943e7" Jun 09 15:01:53.598574 ip-10-0-133-239 kubenswrapper[2576]: E0609 15:01:53.598293 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-256sj" podUID="14860286-bb9d-4f00-864f-c2b041a3b160" Jun 09 15:01:53.774496 ip-10-0-133-239 kubenswrapper[2576]: I0609 15:01:53.774477 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-n4c97_441b2a74-d62c-4e3c-9e0f-b133cd4364be/ovn-acl-logging/0.log" Jun 09 15:01:53.774886 ip-10-0-133-239 kubenswrapper[2576]: I0609 15:01:53.774857 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-n4c97" event={"ID":"441b2a74-d62c-4e3c-9e0f-b133cd4364be","Type":"ContainerStarted","Data":"d4bd5f09e8b88b23e13178564808b480c2b55772cc6ab1ae26b6fc5a5f6d07c2"} Jun 09 15:01:53.774976 ip-10-0-133-239 kubenswrapper[2576]: I0609 15:01:53.774923 2576 prober_manager.go:312] "Failed to trigger a manual run" probe="Readiness" Jun 09 15:01:53.775282 ip-10-0-133-239 kubenswrapper[2576]: I0609 15:01:53.775196 2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-n4c97" Jun 09 15:01:53.776869 ip-10-0-133-239 kubenswrapper[2576]: I0609 15:01:53.776848 2576 generic.go:356] "Generic (PLEG): container finished" podID="77714a52-c22d-45f0-939d-b2a256bd511e" containerID="13e780f1be4d7e181ecb3c462a9429ea648749f3405a116003e3cdb588625449" exitCode=0 Jun 09 15:01:53.776957 ip-10-0-133-239 kubenswrapper[2576]: I0609 15:01:53.776892 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-rvk7p" event={"ID":"77714a52-c22d-45f0-939d-b2a256bd511e","Type":"ContainerDied","Data":"13e780f1be4d7e181ecb3c462a9429ea648749f3405a116003e3cdb588625449"} Jun 09 15:01:53.790621 ip-10-0-133-239 kubenswrapper[2576]: I0609 15:01:53.790470 2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-n4c97" Jun 09 15:01:53.807857 ip-10-0-133-239 kubenswrapper[2576]: I0609 15:01:53.807812 2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ovn-kubernetes/ovnkube-node-n4c97" podStartSLOduration=9.226577278 podStartE2EDuration="27.80779883s" totalImagesPullingTime="18.581221552s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-09 15:01:26 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-09 15:01:53.80378836 +0000 UTC m=+28.657944598" watchObservedRunningTime="2026-06-09 15:01:53.80779883 +0000 UTC m=+28.661955062" Jun 09 15:01:54.469158 ip-10-0-133-239 kubenswrapper[2576]: I0609 15:01:54.469128 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-p6wz2"] Jun 09 15:01:54.469332 ip-10-0-133-239 kubenswrapper[2576]: I0609 15:01:54.469287 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-p6wz2" Jun 09 15:01:54.469382 ip-10-0-133-239 kubenswrapper[2576]: E0609 15:01:54.469368 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-p6wz2" podUID="95bb5504-8d73-44b5-84c6-4312e96be459" Jun 09 15:01:54.472621 ip-10-0-133-239 kubenswrapper[2576]: I0609 15:01:54.472587 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-256sj"] Jun 09 15:01:54.472796 ip-10-0-133-239 kubenswrapper[2576]: I0609 15:01:54.472696 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-256sj" Jun 09 15:01:54.472868 ip-10-0-133-239 kubenswrapper[2576]: E0609 15:01:54.472802 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-256sj" podUID="14860286-bb9d-4f00-864f-c2b041a3b160" Jun 09 15:01:54.473280 ip-10-0-133-239 kubenswrapper[2576]: I0609 15:01:54.473259 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-rw24f"] Jun 09 15:01:54.473384 ip-10-0-133-239 kubenswrapper[2576]: I0609 15:01:54.473352 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-rw24f" Jun 09 15:01:54.473477 ip-10-0-133-239 kubenswrapper[2576]: E0609 15:01:54.473446 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-rw24f" podUID="64cfa4da-d67f-413d-b01d-161226f943e7" Jun 09 15:01:54.781082 ip-10-0-133-239 kubenswrapper[2576]: I0609 15:01:54.781044 2576 generic.go:356] "Generic (PLEG): container finished" podID="77714a52-c22d-45f0-939d-b2a256bd511e" containerID="a968159c06e2f405d582cb1d74b1e88fdd18e688816a179c264e6173d910b2f7" exitCode=0 Jun 09 15:01:54.781648 ip-10-0-133-239 kubenswrapper[2576]: I0609 15:01:54.781129 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-rvk7p" event={"ID":"77714a52-c22d-45f0-939d-b2a256bd511e","Type":"ContainerDied","Data":"a968159c06e2f405d582cb1d74b1e88fdd18e688816a179c264e6173d910b2f7"} Jun 09 15:01:54.781648 ip-10-0-133-239 kubenswrapper[2576]: I0609 15:01:54.781243 2576 prober_manager.go:312] "Failed to trigger a manual run" probe="Readiness" Jun 09 15:01:55.407469 ip-10-0-133-239 kubenswrapper[2576]: I0609 15:01:55.407436 2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-n4c97" Jun 09 15:01:55.598553 ip-10-0-133-239 kubenswrapper[2576]: I0609 15:01:55.598526 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-p6wz2" Jun 09 15:01:55.598703 ip-10-0-133-239 kubenswrapper[2576]: E0609 15:01:55.598604 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-p6wz2" podUID="95bb5504-8d73-44b5-84c6-4312e96be459" Jun 09 15:01:56.598046 ip-10-0-133-239 kubenswrapper[2576]: I0609 15:01:56.598017 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-256sj" Jun 09 15:01:56.598046 ip-10-0-133-239 kubenswrapper[2576]: I0609 15:01:56.598055 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-rw24f" Jun 09 15:01:56.598527 ip-10-0-133-239 kubenswrapper[2576]: E0609 15:01:56.598164 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-256sj" podUID="14860286-bb9d-4f00-864f-c2b041a3b160" Jun 09 15:01:56.598527 ip-10-0-133-239 kubenswrapper[2576]: E0609 15:01:56.598276 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-rw24f" podUID="64cfa4da-d67f-413d-b01d-161226f943e7" Jun 09 15:01:56.788444 ip-10-0-133-239 kubenswrapper[2576]: I0609 15:01:56.788362 2576 generic.go:356] "Generic (PLEG): container finished" podID="77714a52-c22d-45f0-939d-b2a256bd511e" containerID="9e601595ed74157c4fdf6a5602ecd06b70566cabcabbe4353c15387b9801798d" exitCode=0 Jun 09 15:01:56.788595 ip-10-0-133-239 kubenswrapper[2576]: I0609 15:01:56.788443 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-rvk7p" event={"ID":"77714a52-c22d-45f0-939d-b2a256bd511e","Type":"ContainerDied","Data":"9e601595ed74157c4fdf6a5602ecd06b70566cabcabbe4353c15387b9801798d"} Jun 09 15:01:57.598051 ip-10-0-133-239 kubenswrapper[2576]: I0609 15:01:57.597833 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-p6wz2" Jun 09 15:01:57.598231 ip-10-0-133-239 kubenswrapper[2576]: E0609 15:01:57.598165 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-p6wz2" podUID="95bb5504-8d73-44b5-84c6-4312e96be459" Jun 09 15:01:58.597981 ip-10-0-133-239 kubenswrapper[2576]: I0609 15:01:58.597869 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-256sj" Jun 09 15:01:58.597981 ip-10-0-133-239 kubenswrapper[2576]: I0609 15:01:58.597914 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-rw24f" Jun 09 15:01:58.598218 ip-10-0-133-239 kubenswrapper[2576]: E0609 15:01:58.598002 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-256sj" podUID="14860286-bb9d-4f00-864f-c2b041a3b160" Jun 09 15:01:58.598218 ip-10-0-133-239 kubenswrapper[2576]: E0609 15:01:58.598164 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-rw24f" podUID="64cfa4da-d67f-413d-b01d-161226f943e7" Jun 09 15:01:59.297571 ip-10-0-133-239 kubenswrapper[2576]: I0609 15:01:59.297542 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/64cfa4da-d67f-413d-b01d-161226f943e7-metrics-certs\") pod \"network-metrics-daemon-rw24f\" (UID: \"64cfa4da-d67f-413d-b01d-161226f943e7\") " pod="openshift-multus/network-metrics-daemon-rw24f" Jun 09 15:01:59.297757 ip-10-0-133-239 kubenswrapper[2576]: E0609 15:01:59.297660 2576 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jun 09 15:01:59.297757 ip-10-0-133-239 kubenswrapper[2576]: E0609 15:01:59.297721 2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/64cfa4da-d67f-413d-b01d-161226f943e7-metrics-certs podName:64cfa4da-d67f-413d-b01d-161226f943e7 nodeName:}" failed. No retries permitted until 2026-06-09 15:02:31.297701205 +0000 UTC m=+66.151857425 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/64cfa4da-d67f-413d-b01d-161226f943e7-metrics-certs") pod "network-metrics-daemon-rw24f" (UID: "64cfa4da-d67f-413d-b01d-161226f943e7") : object "openshift-multus"/"metrics-daemon-secret" not registered Jun 09 15:01:59.397852 ip-10-0-133-239 kubenswrapper[2576]: I0609 15:01:59.397821 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/14860286-bb9d-4f00-864f-c2b041a3b160-original-pull-secret\") pod \"global-pull-secret-syncer-256sj\" (UID: \"14860286-bb9d-4f00-864f-c2b041a3b160\") " pod="kube-system/global-pull-secret-syncer-256sj" Jun 09 15:01:59.398017 ip-10-0-133-239 kubenswrapper[2576]: E0609 15:01:59.397977 2576 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jun 09 15:01:59.398108 ip-10-0-133-239 kubenswrapper[2576]: E0609 15:01:59.398051 2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/14860286-bb9d-4f00-864f-c2b041a3b160-original-pull-secret podName:14860286-bb9d-4f00-864f-c2b041a3b160 nodeName:}" failed. No retries permitted until 2026-06-09 15:02:31.398031444 +0000 UTC m=+66.252187684 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/14860286-bb9d-4f00-864f-c2b041a3b160-original-pull-secret") pod "global-pull-secret-syncer-256sj" (UID: "14860286-bb9d-4f00-864f-c2b041a3b160") : object "kube-system"/"original-pull-secret" not registered Jun 09 15:01:59.498194 ip-10-0-133-239 kubenswrapper[2576]: I0609 15:01:59.498159 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-l6z46\" (UniqueName: \"kubernetes.io/projected/95bb5504-8d73-44b5-84c6-4312e96be459-kube-api-access-l6z46\") pod \"network-check-target-p6wz2\" (UID: \"95bb5504-8d73-44b5-84c6-4312e96be459\") " pod="openshift-network-diagnostics/network-check-target-p6wz2" Jun 09 15:01:59.498350 ip-10-0-133-239 kubenswrapper[2576]: E0609 15:01:59.498327 2576 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jun 09 15:01:59.498350 ip-10-0-133-239 kubenswrapper[2576]: E0609 15:01:59.498348 2576 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jun 09 15:01:59.498468 ip-10-0-133-239 kubenswrapper[2576]: E0609 15:01:59.498359 2576 projected.go:196] Error preparing data for projected volume kube-api-access-l6z46 for pod openshift-network-diagnostics/network-check-target-p6wz2: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 09 15:01:59.498468 ip-10-0-133-239 kubenswrapper[2576]: E0609 15:01:59.498412 2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/95bb5504-8d73-44b5-84c6-4312e96be459-kube-api-access-l6z46 podName:95bb5504-8d73-44b5-84c6-4312e96be459 nodeName:}" failed. No retries permitted until 2026-06-09 15:02:31.498398371 +0000 UTC m=+66.352554605 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "kube-api-access-l6z46" (UniqueName: "kubernetes.io/projected/95bb5504-8d73-44b5-84c6-4312e96be459-kube-api-access-l6z46") pod "network-check-target-p6wz2" (UID: "95bb5504-8d73-44b5-84c6-4312e96be459") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 09 15:01:59.598564 ip-10-0-133-239 kubenswrapper[2576]: I0609 15:01:59.598338 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-p6wz2" Jun 09 15:01:59.598564 ip-10-0-133-239 kubenswrapper[2576]: E0609 15:01:59.598464 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-p6wz2" podUID="95bb5504-8d73-44b5-84c6-4312e96be459" Jun 09 15:01:59.947653 ip-10-0-133-239 kubenswrapper[2576]: I0609 15:01:59.947582 2576 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-133-239.ec2.internal" event="NodeReady" Jun 09 15:01:59.947847 ip-10-0-133-239 kubenswrapper[2576]: I0609 15:01:59.947702 2576 kubelet_node_status.go:489] "Fast updating node status as it just became ready" Jun 09 15:01:59.995784 ip-10-0-133-239 kubenswrapper[2576]: I0609 15:01:59.995737 2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-dns/dns-default-lhz9k"] Jun 09 15:02:00.025411 ip-10-0-133-239 kubenswrapper[2576]: I0609 15:02:00.025376 2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress-canary/ingress-canary-7s82g"] Jun 09 15:02:00.025556 ip-10-0-133-239 kubenswrapper[2576]: I0609 15:02:00.025503 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-lhz9k" Jun 09 15:02:00.027896 ip-10-0-133-239 kubenswrapper[2576]: I0609 15:02:00.027868 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-zkrcb\"" Jun 09 15:02:00.028023 ip-10-0-133-239 kubenswrapper[2576]: I0609 15:02:00.027929 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"dns-default\"" Jun 09 15:02:00.028023 ip-10-0-133-239 kubenswrapper[2576]: I0609 15:02:00.027994 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-default-metrics-tls\"" Jun 09 15:02:00.039808 ip-10-0-133-239 kubenswrapper[2576]: I0609 15:02:00.039791 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-7s82g"] Jun 09 15:02:00.039917 ip-10-0-133-239 kubenswrapper[2576]: I0609 15:02:00.039820 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-lhz9k"] Jun 09 15:02:00.040026 ip-10-0-133-239 kubenswrapper[2576]: I0609 15:02:00.039915 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-7s82g" Jun 09 15:02:00.043670 ip-10-0-133-239 kubenswrapper[2576]: I0609 15:02:00.043649 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"kube-root-ca.crt\"" Jun 09 15:02:00.043968 ip-10-0-133-239 kubenswrapper[2576]: I0609 15:02:00.043886 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"default-dockercfg-k4tsw\"" Jun 09 15:02:00.044032 ip-10-0-133-239 kubenswrapper[2576]: I0609 15:02:00.044018 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"canary-serving-cert\"" Jun 09 15:02:00.044589 ip-10-0-133-239 kubenswrapper[2576]: I0609 15:02:00.044570 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"openshift-service-ca.crt\"" Jun 09 15:02:00.202608 ip-10-0-133-239 kubenswrapper[2576]: I0609 15:02:00.202523 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/6bcbe45d-fd30-4df1-a753-d8ed92e1a980-tmp-dir\") pod \"dns-default-lhz9k\" (UID: \"6bcbe45d-fd30-4df1-a753-d8ed92e1a980\") " pod="openshift-dns/dns-default-lhz9k" Jun 09 15:02:00.202608 ip-10-0-133-239 kubenswrapper[2576]: I0609 15:02:00.202566 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/539bda9e-91a8-417f-91ff-8ccd3219cfd1-cert\") pod \"ingress-canary-7s82g\" (UID: \"539bda9e-91a8-417f-91ff-8ccd3219cfd1\") " pod="openshift-ingress-canary/ingress-canary-7s82g" Jun 09 15:02:00.202608 ip-10-0-133-239 kubenswrapper[2576]: I0609 15:02:00.202586 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-plcxj\" (UniqueName: \"kubernetes.io/projected/6bcbe45d-fd30-4df1-a753-d8ed92e1a980-kube-api-access-plcxj\") pod \"dns-default-lhz9k\" (UID: \"6bcbe45d-fd30-4df1-a753-d8ed92e1a980\") " pod="openshift-dns/dns-default-lhz9k" Jun 09 15:02:00.202870 ip-10-0-133-239 kubenswrapper[2576]: I0609 15:02:00.202687 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/6bcbe45d-fd30-4df1-a753-d8ed92e1a980-config-volume\") pod \"dns-default-lhz9k\" (UID: \"6bcbe45d-fd30-4df1-a753-d8ed92e1a980\") " pod="openshift-dns/dns-default-lhz9k" Jun 09 15:02:00.202870 ip-10-0-133-239 kubenswrapper[2576]: I0609 15:02:00.202718 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/6bcbe45d-fd30-4df1-a753-d8ed92e1a980-metrics-tls\") pod \"dns-default-lhz9k\" (UID: \"6bcbe45d-fd30-4df1-a753-d8ed92e1a980\") " pod="openshift-dns/dns-default-lhz9k" Jun 09 15:02:00.202870 ip-10-0-133-239 kubenswrapper[2576]: I0609 15:02:00.202743 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-pdc8j\" (UniqueName: \"kubernetes.io/projected/539bda9e-91a8-417f-91ff-8ccd3219cfd1-kube-api-access-pdc8j\") pod \"ingress-canary-7s82g\" (UID: \"539bda9e-91a8-417f-91ff-8ccd3219cfd1\") " pod="openshift-ingress-canary/ingress-canary-7s82g" Jun 09 15:02:00.303890 ip-10-0-133-239 kubenswrapper[2576]: I0609 15:02:00.303855 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/6bcbe45d-fd30-4df1-a753-d8ed92e1a980-config-volume\") pod \"dns-default-lhz9k\" (UID: \"6bcbe45d-fd30-4df1-a753-d8ed92e1a980\") " pod="openshift-dns/dns-default-lhz9k" Jun 09 15:02:00.303890 ip-10-0-133-239 kubenswrapper[2576]: I0609 15:02:00.303893 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/6bcbe45d-fd30-4df1-a753-d8ed92e1a980-metrics-tls\") pod \"dns-default-lhz9k\" (UID: \"6bcbe45d-fd30-4df1-a753-d8ed92e1a980\") " pod="openshift-dns/dns-default-lhz9k" Jun 09 15:02:00.304147 ip-10-0-133-239 kubenswrapper[2576]: I0609 15:02:00.303913 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-pdc8j\" (UniqueName: \"kubernetes.io/projected/539bda9e-91a8-417f-91ff-8ccd3219cfd1-kube-api-access-pdc8j\") pod \"ingress-canary-7s82g\" (UID: \"539bda9e-91a8-417f-91ff-8ccd3219cfd1\") " pod="openshift-ingress-canary/ingress-canary-7s82g" Jun 09 15:02:00.304147 ip-10-0-133-239 kubenswrapper[2576]: I0609 15:02:00.303962 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/6bcbe45d-fd30-4df1-a753-d8ed92e1a980-tmp-dir\") pod \"dns-default-lhz9k\" (UID: \"6bcbe45d-fd30-4df1-a753-d8ed92e1a980\") " pod="openshift-dns/dns-default-lhz9k" Jun 09 15:02:00.304147 ip-10-0-133-239 kubenswrapper[2576]: I0609 15:02:00.303985 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/539bda9e-91a8-417f-91ff-8ccd3219cfd1-cert\") pod \"ingress-canary-7s82g\" (UID: \"539bda9e-91a8-417f-91ff-8ccd3219cfd1\") " pod="openshift-ingress-canary/ingress-canary-7s82g" Jun 09 15:02:00.304147 ip-10-0-133-239 kubenswrapper[2576]: I0609 15:02:00.304003 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-plcxj\" (UniqueName: \"kubernetes.io/projected/6bcbe45d-fd30-4df1-a753-d8ed92e1a980-kube-api-access-plcxj\") pod \"dns-default-lhz9k\" (UID: \"6bcbe45d-fd30-4df1-a753-d8ed92e1a980\") " pod="openshift-dns/dns-default-lhz9k" Jun 09 15:02:00.304147 ip-10-0-133-239 kubenswrapper[2576]: E0609 15:02:00.304030 2576 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jun 09 15:02:00.304147 ip-10-0-133-239 kubenswrapper[2576]: E0609 15:02:00.304122 2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/6bcbe45d-fd30-4df1-a753-d8ed92e1a980-metrics-tls podName:6bcbe45d-fd30-4df1-a753-d8ed92e1a980 nodeName:}" failed. No retries permitted until 2026-06-09 15:02:00.804104585 +0000 UTC m=+35.658260823 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/6bcbe45d-fd30-4df1-a753-d8ed92e1a980-metrics-tls") pod "dns-default-lhz9k" (UID: "6bcbe45d-fd30-4df1-a753-d8ed92e1a980") : secret "dns-default-metrics-tls" not found Jun 09 15:02:00.304450 ip-10-0-133-239 kubenswrapper[2576]: I0609 15:02:00.304375 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/6bcbe45d-fd30-4df1-a753-d8ed92e1a980-tmp-dir\") pod \"dns-default-lhz9k\" (UID: \"6bcbe45d-fd30-4df1-a753-d8ed92e1a980\") " pod="openshift-dns/dns-default-lhz9k" Jun 09 15:02:00.304588 ip-10-0-133-239 kubenswrapper[2576]: I0609 15:02:00.304557 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/6bcbe45d-fd30-4df1-a753-d8ed92e1a980-config-volume\") pod \"dns-default-lhz9k\" (UID: \"6bcbe45d-fd30-4df1-a753-d8ed92e1a980\") " pod="openshift-dns/dns-default-lhz9k" Jun 09 15:02:00.308702 ip-10-0-133-239 kubenswrapper[2576]: I0609 15:02:00.308679 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/539bda9e-91a8-417f-91ff-8ccd3219cfd1-cert\") pod \"ingress-canary-7s82g\" (UID: \"539bda9e-91a8-417f-91ff-8ccd3219cfd1\") " pod="openshift-ingress-canary/ingress-canary-7s82g" Jun 09 15:02:00.313155 ip-10-0-133-239 kubenswrapper[2576]: I0609 15:02:00.313130 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-plcxj\" (UniqueName: \"kubernetes.io/projected/6bcbe45d-fd30-4df1-a753-d8ed92e1a980-kube-api-access-plcxj\") pod \"dns-default-lhz9k\" (UID: \"6bcbe45d-fd30-4df1-a753-d8ed92e1a980\") " pod="openshift-dns/dns-default-lhz9k" Jun 09 15:02:00.313682 ip-10-0-133-239 kubenswrapper[2576]: I0609 15:02:00.313659 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-pdc8j\" (UniqueName: \"kubernetes.io/projected/539bda9e-91a8-417f-91ff-8ccd3219cfd1-kube-api-access-pdc8j\") pod \"ingress-canary-7s82g\" (UID: \"539bda9e-91a8-417f-91ff-8ccd3219cfd1\") " pod="openshift-ingress-canary/ingress-canary-7s82g" Jun 09 15:02:00.351494 ip-10-0-133-239 kubenswrapper[2576]: I0609 15:02:00.351464 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-7s82g" Jun 09 15:02:00.598164 ip-10-0-133-239 kubenswrapper[2576]: I0609 15:02:00.598130 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-256sj" Jun 09 15:02:00.598315 ip-10-0-133-239 kubenswrapper[2576]: I0609 15:02:00.598135 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-rw24f" Jun 09 15:02:00.600747 ip-10-0-133-239 kubenswrapper[2576]: I0609 15:02:00.600717 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\"" Jun 09 15:02:00.601137 ip-10-0-133-239 kubenswrapper[2576]: I0609 15:02:00.600912 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-x45km\"" Jun 09 15:02:00.601137 ip-10-0-133-239 kubenswrapper[2576]: I0609 15:02:00.600974 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\"" Jun 09 15:02:00.807814 ip-10-0-133-239 kubenswrapper[2576]: I0609 15:02:00.807784 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/6bcbe45d-fd30-4df1-a753-d8ed92e1a980-metrics-tls\") pod \"dns-default-lhz9k\" (UID: \"6bcbe45d-fd30-4df1-a753-d8ed92e1a980\") " pod="openshift-dns/dns-default-lhz9k" Jun 09 15:02:00.807984 ip-10-0-133-239 kubenswrapper[2576]: E0609 15:02:00.807969 2576 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jun 09 15:02:00.808052 ip-10-0-133-239 kubenswrapper[2576]: E0609 15:02:00.808035 2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/6bcbe45d-fd30-4df1-a753-d8ed92e1a980-metrics-tls podName:6bcbe45d-fd30-4df1-a753-d8ed92e1a980 nodeName:}" failed. No retries permitted until 2026-06-09 15:02:01.808015846 +0000 UTC m=+36.662172067 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/6bcbe45d-fd30-4df1-a753-d8ed92e1a980-metrics-tls") pod "dns-default-lhz9k" (UID: "6bcbe45d-fd30-4df1-a753-d8ed92e1a980") : secret "dns-default-metrics-tls" not found Jun 09 15:02:01.031969 ip-10-0-133-239 kubenswrapper[2576]: I0609 15:02:01.031934 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-7s82g"] Jun 09 15:02:01.035685 ip-10-0-133-239 kubenswrapper[2576]: W0609 15:02:01.035658 2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod539bda9e_91a8_417f_91ff_8ccd3219cfd1.slice/crio-7ba0ad2ab109c3a84bc7a88622691b51311ada6aa1e797b964d13a1dd9a24267 WatchSource:0}: Error finding container 7ba0ad2ab109c3a84bc7a88622691b51311ada6aa1e797b964d13a1dd9a24267: Status 404 returned error can't find the container with id 7ba0ad2ab109c3a84bc7a88622691b51311ada6aa1e797b964d13a1dd9a24267 Jun 09 15:02:01.598908 ip-10-0-133-239 kubenswrapper[2576]: I0609 15:02:01.598670 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-p6wz2" Jun 09 15:02:01.601700 ip-10-0-133-239 kubenswrapper[2576]: I0609 15:02:01.601677 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\"" Jun 09 15:02:01.602094 ip-10-0-133-239 kubenswrapper[2576]: I0609 15:02:01.601736 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-whcd4\"" Jun 09 15:02:01.602094 ip-10-0-133-239 kubenswrapper[2576]: I0609 15:02:01.601815 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\"" Jun 09 15:02:01.800975 ip-10-0-133-239 kubenswrapper[2576]: I0609 15:02:01.800940 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-7s82g" event={"ID":"539bda9e-91a8-417f-91ff-8ccd3219cfd1","Type":"ContainerStarted","Data":"7ba0ad2ab109c3a84bc7a88622691b51311ada6aa1e797b964d13a1dd9a24267"} Jun 09 15:02:01.804020 ip-10-0-133-239 kubenswrapper[2576]: I0609 15:02:01.803996 2576 generic.go:356] "Generic (PLEG): container finished" podID="77714a52-c22d-45f0-939d-b2a256bd511e" containerID="4ca4dd383102d812376d45a7b7a45884b558422dbf6b50042cf5578cedfe419e" exitCode=0 Jun 09 15:02:01.804147 ip-10-0-133-239 kubenswrapper[2576]: I0609 15:02:01.804038 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-rvk7p" event={"ID":"77714a52-c22d-45f0-939d-b2a256bd511e","Type":"ContainerDied","Data":"4ca4dd383102d812376d45a7b7a45884b558422dbf6b50042cf5578cedfe419e"} Jun 09 15:02:01.816099 ip-10-0-133-239 kubenswrapper[2576]: I0609 15:02:01.816047 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/6bcbe45d-fd30-4df1-a753-d8ed92e1a980-metrics-tls\") pod \"dns-default-lhz9k\" (UID: \"6bcbe45d-fd30-4df1-a753-d8ed92e1a980\") " pod="openshift-dns/dns-default-lhz9k" Jun 09 15:02:01.816234 ip-10-0-133-239 kubenswrapper[2576]: E0609 15:02:01.816215 2576 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jun 09 15:02:01.816294 ip-10-0-133-239 kubenswrapper[2576]: E0609 15:02:01.816282 2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/6bcbe45d-fd30-4df1-a753-d8ed92e1a980-metrics-tls podName:6bcbe45d-fd30-4df1-a753-d8ed92e1a980 nodeName:}" failed. No retries permitted until 2026-06-09 15:02:03.816262632 +0000 UTC m=+38.670418862 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/6bcbe45d-fd30-4df1-a753-d8ed92e1a980-metrics-tls") pod "dns-default-lhz9k" (UID: "6bcbe45d-fd30-4df1-a753-d8ed92e1a980") : secret "dns-default-metrics-tls" not found Jun 09 15:02:02.811261 ip-10-0-133-239 kubenswrapper[2576]: I0609 15:02:02.811227 2576 generic.go:356] "Generic (PLEG): container finished" podID="77714a52-c22d-45f0-939d-b2a256bd511e" containerID="f066ecb303006f6a9e121c41ccc7b307cd520b4c5ae78b7c8088a7763ff23914" exitCode=0 Jun 09 15:02:02.811700 ip-10-0-133-239 kubenswrapper[2576]: I0609 15:02:02.811282 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-rvk7p" event={"ID":"77714a52-c22d-45f0-939d-b2a256bd511e","Type":"ContainerDied","Data":"f066ecb303006f6a9e121c41ccc7b307cd520b4c5ae78b7c8088a7763ff23914"} Jun 09 15:02:03.815201 ip-10-0-133-239 kubenswrapper[2576]: I0609 15:02:03.815160 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-7s82g" event={"ID":"539bda9e-91a8-417f-91ff-8ccd3219cfd1","Type":"ContainerStarted","Data":"7ccba2725882e0754f0127f9fbf0998d8f20a2ad29ea2a2bf72e7a8b885fee34"} Jun 09 15:02:03.818624 ip-10-0-133-239 kubenswrapper[2576]: I0609 15:02:03.818594 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-rvk7p" event={"ID":"77714a52-c22d-45f0-939d-b2a256bd511e","Type":"ContainerStarted","Data":"bbeef568d498147710498f0342367435e1e8c60442cd812a0f095311afb422f3"} Jun 09 15:02:03.829620 ip-10-0-133-239 kubenswrapper[2576]: I0609 15:02:03.829594 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/6bcbe45d-fd30-4df1-a753-d8ed92e1a980-metrics-tls\") pod \"dns-default-lhz9k\" (UID: \"6bcbe45d-fd30-4df1-a753-d8ed92e1a980\") " pod="openshift-dns/dns-default-lhz9k" Jun 09 15:02:03.829777 ip-10-0-133-239 kubenswrapper[2576]: E0609 15:02:03.829740 2576 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jun 09 15:02:03.829845 ip-10-0-133-239 kubenswrapper[2576]: E0609 15:02:03.829797 2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/6bcbe45d-fd30-4df1-a753-d8ed92e1a980-metrics-tls podName:6bcbe45d-fd30-4df1-a753-d8ed92e1a980 nodeName:}" failed. No retries permitted until 2026-06-09 15:02:07.829779709 +0000 UTC m=+42.683935926 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/6bcbe45d-fd30-4df1-a753-d8ed92e1a980-metrics-tls") pod "dns-default-lhz9k" (UID: "6bcbe45d-fd30-4df1-a753-d8ed92e1a980") : secret "dns-default-metrics-tls" not found Jun 09 15:02:03.829938 ip-10-0-133-239 kubenswrapper[2576]: I0609 15:02:03.829905 2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress-canary/ingress-canary-7s82g" podStartSLOduration=3.015140257 podStartE2EDuration="4.829892675s" totalImagesPullingTime="1.814752418s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-09 15:01:59 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-09 15:02:03.829506886 +0000 UTC m=+38.683663129" watchObservedRunningTime="2026-06-09 15:02:03.829892675 +0000 UTC m=+38.684048892" Jun 09 15:02:03.849972 ip-10-0-133-239 kubenswrapper[2576]: I0609 15:02:03.849921 2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-additional-cni-plugins-rvk7p" podStartSLOduration=9.641833266999999 podStartE2EDuration="38.849903877s" totalImagesPullingTime="29.20807061s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-09 15:01:25 +0000 UTC" imagePullSessionsCount=5 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-09 15:02:03.848933801 +0000 UTC m=+38.703090041" watchObservedRunningTime="2026-06-09 15:02:03.849903877 +0000 UTC m=+38.704060118" Jun 09 15:02:07.858717 ip-10-0-133-239 kubenswrapper[2576]: I0609 15:02:07.858684 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/6bcbe45d-fd30-4df1-a753-d8ed92e1a980-metrics-tls\") pod \"dns-default-lhz9k\" (UID: \"6bcbe45d-fd30-4df1-a753-d8ed92e1a980\") " pod="openshift-dns/dns-default-lhz9k" Jun 09 15:02:07.859241 ip-10-0-133-239 kubenswrapper[2576]: E0609 15:02:07.858826 2576 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jun 09 15:02:07.859241 ip-10-0-133-239 kubenswrapper[2576]: E0609 15:02:07.858883 2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/6bcbe45d-fd30-4df1-a753-d8ed92e1a980-metrics-tls podName:6bcbe45d-fd30-4df1-a753-d8ed92e1a980 nodeName:}" failed. No retries permitted until 2026-06-09 15:02:15.858868338 +0000 UTC m=+50.713024555 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/6bcbe45d-fd30-4df1-a753-d8ed92e1a980-metrics-tls") pod "dns-default-lhz9k" (UID: "6bcbe45d-fd30-4df1-a753-d8ed92e1a980") : secret "dns-default-metrics-tls" not found Jun 09 15:02:15.907323 ip-10-0-133-239 kubenswrapper[2576]: I0609 15:02:15.907285 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/6bcbe45d-fd30-4df1-a753-d8ed92e1a980-metrics-tls\") pod \"dns-default-lhz9k\" (UID: \"6bcbe45d-fd30-4df1-a753-d8ed92e1a980\") " pod="openshift-dns/dns-default-lhz9k" Jun 09 15:02:15.907797 ip-10-0-133-239 kubenswrapper[2576]: E0609 15:02:15.907450 2576 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jun 09 15:02:15.907797 ip-10-0-133-239 kubenswrapper[2576]: E0609 15:02:15.907515 2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/6bcbe45d-fd30-4df1-a753-d8ed92e1a980-metrics-tls podName:6bcbe45d-fd30-4df1-a753-d8ed92e1a980 nodeName:}" failed. No retries permitted until 2026-06-09 15:02:31.907498538 +0000 UTC m=+66.761654755 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/6bcbe45d-fd30-4df1-a753-d8ed92e1a980-metrics-tls") pod "dns-default-lhz9k" (UID: "6bcbe45d-fd30-4df1-a753-d8ed92e1a980") : secret "dns-default-metrics-tls" not found Jun 09 15:02:26.798455 ip-10-0-133-239 kubenswrapper[2576]: I0609 15:02:26.798429 2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-n4c97" Jun 09 15:02:31.303243 ip-10-0-133-239 kubenswrapper[2576]: I0609 15:02:31.303188 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/64cfa4da-d67f-413d-b01d-161226f943e7-metrics-certs\") pod \"network-metrics-daemon-rw24f\" (UID: \"64cfa4da-d67f-413d-b01d-161226f943e7\") " pod="openshift-multus/network-metrics-daemon-rw24f" Jun 09 15:02:31.305702 ip-10-0-133-239 kubenswrapper[2576]: I0609 15:02:31.305685 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\"" Jun 09 15:02:31.313882 ip-10-0-133-239 kubenswrapper[2576]: E0609 15:02:31.313859 2576 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: secret "metrics-daemon-secret" not found Jun 09 15:02:31.313947 ip-10-0-133-239 kubenswrapper[2576]: E0609 15:02:31.313937 2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/64cfa4da-d67f-413d-b01d-161226f943e7-metrics-certs podName:64cfa4da-d67f-413d-b01d-161226f943e7 nodeName:}" failed. No retries permitted until 2026-06-09 15:03:35.313915889 +0000 UTC m=+130.168072121 (durationBeforeRetry 1m4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/64cfa4da-d67f-413d-b01d-161226f943e7-metrics-certs") pod "network-metrics-daemon-rw24f" (UID: "64cfa4da-d67f-413d-b01d-161226f943e7") : secret "metrics-daemon-secret" not found Jun 09 15:02:31.404553 ip-10-0-133-239 kubenswrapper[2576]: I0609 15:02:31.404515 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/14860286-bb9d-4f00-864f-c2b041a3b160-original-pull-secret\") pod \"global-pull-secret-syncer-256sj\" (UID: \"14860286-bb9d-4f00-864f-c2b041a3b160\") " pod="kube-system/global-pull-secret-syncer-256sj" Jun 09 15:02:31.406986 ip-10-0-133-239 kubenswrapper[2576]: I0609 15:02:31.406965 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\"" Jun 09 15:02:31.418237 ip-10-0-133-239 kubenswrapper[2576]: I0609 15:02:31.418205 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/14860286-bb9d-4f00-864f-c2b041a3b160-original-pull-secret\") pod \"global-pull-secret-syncer-256sj\" (UID: \"14860286-bb9d-4f00-864f-c2b041a3b160\") " pod="kube-system/global-pull-secret-syncer-256sj" Jun 09 15:02:31.505310 ip-10-0-133-239 kubenswrapper[2576]: I0609 15:02:31.505276 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-l6z46\" (UniqueName: \"kubernetes.io/projected/95bb5504-8d73-44b5-84c6-4312e96be459-kube-api-access-l6z46\") pod \"network-check-target-p6wz2\" (UID: \"95bb5504-8d73-44b5-84c6-4312e96be459\") " pod="openshift-network-diagnostics/network-check-target-p6wz2" Jun 09 15:02:31.507957 ip-10-0-133-239 kubenswrapper[2576]: I0609 15:02:31.507934 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\"" Jun 09 15:02:31.509006 ip-10-0-133-239 kubenswrapper[2576]: I0609 15:02:31.508989 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-256sj" Jun 09 15:02:31.518286 ip-10-0-133-239 kubenswrapper[2576]: I0609 15:02:31.518271 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\"" Jun 09 15:02:31.529617 ip-10-0-133-239 kubenswrapper[2576]: I0609 15:02:31.529592 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-l6z46\" (UniqueName: \"kubernetes.io/projected/95bb5504-8d73-44b5-84c6-4312e96be459-kube-api-access-l6z46\") pod \"network-check-target-p6wz2\" (UID: \"95bb5504-8d73-44b5-84c6-4312e96be459\") " pod="openshift-network-diagnostics/network-check-target-p6wz2" Jun 09 15:02:31.611613 ip-10-0-133-239 kubenswrapper[2576]: I0609 15:02:31.611587 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-whcd4\"" Jun 09 15:02:31.619478 ip-10-0-133-239 kubenswrapper[2576]: I0609 15:02:31.619456 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-p6wz2" Jun 09 15:02:31.628085 ip-10-0-133-239 kubenswrapper[2576]: I0609 15:02:31.628045 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-256sj"] Jun 09 15:02:31.737521 ip-10-0-133-239 kubenswrapper[2576]: I0609 15:02:31.737489 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-p6wz2"] Jun 09 15:02:31.740228 ip-10-0-133-239 kubenswrapper[2576]: W0609 15:02:31.740197 2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod95bb5504_8d73_44b5_84c6_4312e96be459.slice/crio-6114e3c7b4004ced897297567bcdb30d05cb98180e8f67f64f19930746b31995 WatchSource:0}: Error finding container 6114e3c7b4004ced897297567bcdb30d05cb98180e8f67f64f19930746b31995: Status 404 returned error can't find the container with id 6114e3c7b4004ced897297567bcdb30d05cb98180e8f67f64f19930746b31995 Jun 09 15:02:31.882420 ip-10-0-133-239 kubenswrapper[2576]: I0609 15:02:31.882334 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-p6wz2" event={"ID":"95bb5504-8d73-44b5-84c6-4312e96be459","Type":"ContainerStarted","Data":"6114e3c7b4004ced897297567bcdb30d05cb98180e8f67f64f19930746b31995"} Jun 09 15:02:31.883318 ip-10-0-133-239 kubenswrapper[2576]: I0609 15:02:31.883299 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-256sj" event={"ID":"14860286-bb9d-4f00-864f-c2b041a3b160","Type":"ContainerStarted","Data":"65125ed132d67b0d05d9d870e4f0bbfd39ab08b3be14f73a59136e151ea21440"} Jun 09 15:02:31.907842 ip-10-0-133-239 kubenswrapper[2576]: I0609 15:02:31.907806 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/6bcbe45d-fd30-4df1-a753-d8ed92e1a980-metrics-tls\") pod \"dns-default-lhz9k\" (UID: \"6bcbe45d-fd30-4df1-a753-d8ed92e1a980\") " pod="openshift-dns/dns-default-lhz9k" Jun 09 15:02:31.908002 ip-10-0-133-239 kubenswrapper[2576]: E0609 15:02:31.907932 2576 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jun 09 15:02:31.908002 ip-10-0-133-239 kubenswrapper[2576]: E0609 15:02:31.907983 2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/6bcbe45d-fd30-4df1-a753-d8ed92e1a980-metrics-tls podName:6bcbe45d-fd30-4df1-a753-d8ed92e1a980 nodeName:}" failed. No retries permitted until 2026-06-09 15:03:03.907970666 +0000 UTC m=+98.762126884 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/6bcbe45d-fd30-4df1-a753-d8ed92e1a980-metrics-tls") pod "dns-default-lhz9k" (UID: "6bcbe45d-fd30-4df1-a753-d8ed92e1a980") : secret "dns-default-metrics-tls" not found Jun 09 15:02:36.898955 ip-10-0-133-239 kubenswrapper[2576]: I0609 15:02:36.898919 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-p6wz2" event={"ID":"95bb5504-8d73-44b5-84c6-4312e96be459","Type":"ContainerStarted","Data":"c4b84261a7227e9e98f192b1ad7b1a45c00691bdadf38e4e2a80170a1d40ec28"} Jun 09 15:02:36.899351 ip-10-0-133-239 kubenswrapper[2576]: I0609 15:02:36.899058 2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-network-diagnostics/network-check-target-p6wz2" Jun 09 15:02:36.900313 ip-10-0-133-239 kubenswrapper[2576]: I0609 15:02:36.900294 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-256sj" event={"ID":"14860286-bb9d-4f00-864f-c2b041a3b160","Type":"ContainerStarted","Data":"f199e322f038eceed7721f0cd84f0ece5bee85bd6fcb448b752fbb3ee70c3437"} Jun 09 15:02:36.921094 ip-10-0-133-239 kubenswrapper[2576]: I0609 15:02:36.921033 2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-diagnostics/network-check-target-p6wz2" podStartSLOduration=66.194900505 podStartE2EDuration="1m10.921015769s" totalImagesPullingTime="4.726115264s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-09 15:01:26 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-09 15:02:36.920829738 +0000 UTC m=+71.774985980" watchObservedRunningTime="2026-06-09 15:02:36.921015769 +0000 UTC m=+71.775172006" Jun 09 15:02:36.936355 ip-10-0-133-239 kubenswrapper[2576]: I0609 15:02:36.936312 2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/global-pull-secret-syncer-256sj" podStartSLOduration=66.09761962 podStartE2EDuration="1m10.93629985s" totalImagesPullingTime="4.83868023s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-09 15:01:26 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-09 15:02:36.935922852 +0000 UTC m=+71.790079091" watchObservedRunningTime="2026-06-09 15:02:36.93629985 +0000 UTC m=+71.790456113" Jun 09 15:03:03.926573 ip-10-0-133-239 kubenswrapper[2576]: I0609 15:03:03.926536 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/6bcbe45d-fd30-4df1-a753-d8ed92e1a980-metrics-tls\") pod \"dns-default-lhz9k\" (UID: \"6bcbe45d-fd30-4df1-a753-d8ed92e1a980\") " pod="openshift-dns/dns-default-lhz9k" Jun 09 15:03:03.927108 ip-10-0-133-239 kubenswrapper[2576]: E0609 15:03:03.926683 2576 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jun 09 15:03:03.927108 ip-10-0-133-239 kubenswrapper[2576]: E0609 15:03:03.926755 2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/6bcbe45d-fd30-4df1-a753-d8ed92e1a980-metrics-tls podName:6bcbe45d-fd30-4df1-a753-d8ed92e1a980 nodeName:}" failed. No retries permitted until 2026-06-09 15:04:07.926738663 +0000 UTC m=+162.780894880 (durationBeforeRetry 1m4s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/6bcbe45d-fd30-4df1-a753-d8ed92e1a980-metrics-tls") pod "dns-default-lhz9k" (UID: "6bcbe45d-fd30-4df1-a753-d8ed92e1a980") : secret "dns-default-metrics-tls" not found Jun 09 15:03:07.905391 ip-10-0-133-239 kubenswrapper[2576]: I0609 15:03:07.905363 2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-network-diagnostics/network-check-target-p6wz2" Jun 09 15:03:35.332955 ip-10-0-133-239 kubenswrapper[2576]: I0609 15:03:35.332901 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/64cfa4da-d67f-413d-b01d-161226f943e7-metrics-certs\") pod \"network-metrics-daemon-rw24f\" (UID: \"64cfa4da-d67f-413d-b01d-161226f943e7\") " pod="openshift-multus/network-metrics-daemon-rw24f" Jun 09 15:03:35.333479 ip-10-0-133-239 kubenswrapper[2576]: E0609 15:03:35.333051 2576 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: secret "metrics-daemon-secret" not found Jun 09 15:03:35.333479 ip-10-0-133-239 kubenswrapper[2576]: E0609 15:03:35.333134 2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/64cfa4da-d67f-413d-b01d-161226f943e7-metrics-certs podName:64cfa4da-d67f-413d-b01d-161226f943e7 nodeName:}" failed. No retries permitted until 2026-06-09 15:05:37.333115518 +0000 UTC m=+252.187271750 (durationBeforeRetry 2m2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/64cfa4da-d67f-413d-b01d-161226f943e7-metrics-certs") pod "network-metrics-daemon-rw24f" (UID: "64cfa4da-d67f-413d-b01d-161226f943e7") : secret "metrics-daemon-secret" not found Jun 09 15:04:03.036060 ip-10-0-133-239 kubenswrapper[2576]: E0609 15:04:03.036015 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[metrics-tls], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-dns/dns-default-lhz9k" podUID="6bcbe45d-fd30-4df1-a753-d8ed92e1a980" Jun 09 15:04:03.093895 ip-10-0-133-239 kubenswrapper[2576]: I0609 15:04:03.093870 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-lhz9k" Jun 09 15:04:03.614752 ip-10-0-133-239 kubenswrapper[2576]: E0609 15:04:03.614715 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[metrics-certs], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-multus/network-metrics-daemon-rw24f" podUID="64cfa4da-d67f-413d-b01d-161226f943e7" Jun 09 15:04:07.939751 ip-10-0-133-239 kubenswrapper[2576]: I0609 15:04:07.939656 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/6bcbe45d-fd30-4df1-a753-d8ed92e1a980-metrics-tls\") pod \"dns-default-lhz9k\" (UID: \"6bcbe45d-fd30-4df1-a753-d8ed92e1a980\") " pod="openshift-dns/dns-default-lhz9k" Jun 09 15:04:07.940272 ip-10-0-133-239 kubenswrapper[2576]: E0609 15:04:07.939815 2576 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jun 09 15:04:07.940272 ip-10-0-133-239 kubenswrapper[2576]: E0609 15:04:07.939898 2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/6bcbe45d-fd30-4df1-a753-d8ed92e1a980-metrics-tls podName:6bcbe45d-fd30-4df1-a753-d8ed92e1a980 nodeName:}" failed. No retries permitted until 2026-06-09 15:06:09.939875152 +0000 UTC m=+284.794031383 (durationBeforeRetry 2m2s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/6bcbe45d-fd30-4df1-a753-d8ed92e1a980-metrics-tls") pod "dns-default-lhz9k" (UID: "6bcbe45d-fd30-4df1-a753-d8ed92e1a980") : secret "dns-default-metrics-tls" not found Jun 09 15:04:18.598282 ip-10-0-133-239 kubenswrapper[2576]: I0609 15:04:18.598232 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-rw24f" Jun 09 15:04:26.378934 ip-10-0-133-239 kubenswrapper[2576]: I0609 15:04:26.378903 2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-cluster-storage-operator/volume-data-source-validator-78dd696465-twbjk"] Jun 09 15:04:26.380753 ip-10-0-133-239 kubenswrapper[2576]: I0609 15:04:26.380736 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-storage-operator/volume-data-source-validator-78dd696465-twbjk" Jun 09 15:04:26.381550 ip-10-0-133-239 kubenswrapper[2576]: I0609 15:04:26.381526 2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-service-ca-operator/service-ca-operator-6bc5ff68f5-7xfz8"] Jun 09 15:04:26.383160 ip-10-0-133-239 kubenswrapper[2576]: I0609 15:04:26.383136 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-storage-operator\"/\"openshift-service-ca.crt\"" Jun 09 15:04:26.383263 ip-10-0-133-239 kubenswrapper[2576]: I0609 15:04:26.383198 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-storage-operator\"/\"volume-data-source-validator-dockercfg-s5kw5\"" Jun 09 15:04:26.383322 ip-10-0-133-239 kubenswrapper[2576]: I0609 15:04:26.383281 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-service-ca-operator/service-ca-operator-6bc5ff68f5-7xfz8" Jun 09 15:04:26.384039 ip-10-0-133-239 kubenswrapper[2576]: I0609 15:04:26.384022 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-storage-operator\"/\"kube-root-ca.crt\"" Jun 09 15:04:26.385253 ip-10-0-133-239 kubenswrapper[2576]: I0609 15:04:26.385235 2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console-operator/console-operator-668fdbf85c-wmg5x"] Jun 09 15:04:26.385344 ip-10-0-133-239 kubenswrapper[2576]: I0609 15:04:26.385326 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca-operator\"/\"service-ca-operator-config\"" Jun 09 15:04:26.385634 ip-10-0-133-239 kubenswrapper[2576]: I0609 15:04:26.385617 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-service-ca-operator\"/\"serving-cert\"" Jun 09 15:04:26.385887 ip-10-0-133-239 kubenswrapper[2576]: I0609 15:04:26.385867 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-service-ca-operator\"/\"service-ca-operator-dockercfg-fzz75\"" Jun 09 15:04:26.385978 ip-10-0-133-239 kubenswrapper[2576]: I0609 15:04:26.385927 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca-operator\"/\"kube-root-ca.crt\"" Jun 09 15:04:26.386033 ip-10-0-133-239 kubenswrapper[2576]: I0609 15:04:26.385978 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca-operator\"/\"openshift-service-ca.crt\"" Jun 09 15:04:26.387082 ip-10-0-133-239 kubenswrapper[2576]: I0609 15:04:26.387050 2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-network-console/networking-console-plugin-d5d5bb78b-jlv7n"] Jun 09 15:04:26.387160 ip-10-0-133-239 kubenswrapper[2576]: I0609 15:04:26.387145 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console-operator/console-operator-668fdbf85c-wmg5x" Jun 09 15:04:26.388917 ip-10-0-133-239 kubenswrapper[2576]: I0609 15:04:26.388902 2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/router-default-6f8c669b97-fzsft"] Jun 09 15:04:26.389078 ip-10-0-133-239 kubenswrapper[2576]: I0609 15:04:26.389048 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-console/networking-console-plugin-d5d5bb78b-jlv7n" Jun 09 15:04:26.390016 ip-10-0-133-239 kubenswrapper[2576]: I0609 15:04:26.389999 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console-operator\"/\"console-operator-config\"" Jun 09 15:04:26.390112 ip-10-0-133-239 kubenswrapper[2576]: I0609 15:04:26.390029 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console-operator\"/\"serving-cert\"" Jun 09 15:04:26.390563 ip-10-0-133-239 kubenswrapper[2576]: I0609 15:04:26.390547 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console-operator\"/\"kube-root-ca.crt\"" Jun 09 15:04:26.390656 ip-10-0-133-239 kubenswrapper[2576]: I0609 15:04:26.390546 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console-operator\"/\"openshift-service-ca.crt\"" Jun 09 15:04:26.390750 ip-10-0-133-239 kubenswrapper[2576]: I0609 15:04:26.390736 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/router-default-6f8c669b97-fzsft" Jun 09 15:04:26.391356 ip-10-0-133-239 kubenswrapper[2576]: I0609 15:04:26.391332 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console-operator\"/\"console-operator-dockercfg-q54ts\"" Jun 09 15:04:26.392444 ip-10-0-133-239 kubenswrapper[2576]: I0609 15:04:26.392431 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-console\"/\"networking-console-plugin-cert\"" Jun 09 15:04:26.392644 ip-10-0-133-239 kubenswrapper[2576]: I0609 15:04:26.392624 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-console\"/\"networking-console-plugin\"" Jun 09 15:04:26.392740 ip-10-0-133-239 kubenswrapper[2576]: I0609 15:04:26.392687 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-console\"/\"default-dockercfg-ssvgl\"" Jun 09 15:04:26.393058 ip-10-0-133-239 kubenswrapper[2576]: I0609 15:04:26.393039 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-cluster-storage-operator/volume-data-source-validator-78dd696465-twbjk"] Jun 09 15:04:26.393652 ip-10-0-133-239 kubenswrapper[2576]: I0609 15:04:26.393501 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"router-metrics-certs-default\"" Jun 09 15:04:26.393652 ip-10-0-133-239 kubenswrapper[2576]: I0609 15:04:26.393514 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"default-ingress-cert\"" Jun 09 15:04:26.393652 ip-10-0-133-239 kubenswrapper[2576]: I0609 15:04:26.393517 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"router-stats-default\"" Jun 09 15:04:26.393652 ip-10-0-133-239 kubenswrapper[2576]: I0609 15:04:26.393506 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"kube-root-ca.crt\"" Jun 09 15:04:26.393885 ip-10-0-133-239 kubenswrapper[2576]: I0609 15:04:26.393666 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"router-dockercfg-dlcv9\"" Jun 09 15:04:26.394231 ip-10-0-133-239 kubenswrapper[2576]: I0609 15:04:26.394211 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"service-ca-bundle\"" Jun 09 15:04:26.394328 ip-10-0-133-239 kubenswrapper[2576]: I0609 15:04:26.394290 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-service-ca.crt\"" Jun 09 15:04:26.397100 ip-10-0-133-239 kubenswrapper[2576]: I0609 15:04:26.397081 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console-operator\"/\"trusted-ca\"" Jun 09 15:04:26.398136 ip-10-0-133-239 kubenswrapper[2576]: I0609 15:04:26.398111 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-service-ca-operator/service-ca-operator-6bc5ff68f5-7xfz8"] Jun 09 15:04:26.403330 ip-10-0-133-239 kubenswrapper[2576]: I0609 15:04:26.403292 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console-operator/console-operator-668fdbf85c-wmg5x"] Jun 09 15:04:26.414780 ip-10-0-133-239 kubenswrapper[2576]: I0609 15:04:26.414742 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-console/networking-console-plugin-d5d5bb78b-jlv7n"] Jun 09 15:04:26.417629 ip-10-0-133-239 kubenswrapper[2576]: I0609 15:04:26.417609 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/router-default-6f8c669b97-fzsft"] Jun 09 15:04:26.453638 ip-10-0-133-239 kubenswrapper[2576]: I0609 15:04:26.453611 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-pt87b\" (UniqueName: \"kubernetes.io/projected/7d51209c-a257-422b-b29a-87eb78afc8d9-kube-api-access-pt87b\") pod \"router-default-6f8c669b97-fzsft\" (UID: \"7d51209c-a257-422b-b29a-87eb78afc8d9\") " pod="openshift-ingress/router-default-6f8c669b97-fzsft" Jun 09 15:04:26.453742 ip-10-0-133-239 kubenswrapper[2576]: I0609 15:04:26.453650 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-tgcvh\" (UniqueName: \"kubernetes.io/projected/692623b7-ba08-4085-830a-8361352824ff-kube-api-access-tgcvh\") pod \"service-ca-operator-6bc5ff68f5-7xfz8\" (UID: \"692623b7-ba08-4085-830a-8361352824ff\") " pod="openshift-service-ca-operator/service-ca-operator-6bc5ff68f5-7xfz8" Jun 09 15:04:26.453742 ip-10-0-133-239 kubenswrapper[2576]: I0609 15:04:26.453682 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/7d51209c-a257-422b-b29a-87eb78afc8d9-service-ca-bundle\") pod \"router-default-6f8c669b97-fzsft\" (UID: \"7d51209c-a257-422b-b29a-87eb78afc8d9\") " pod="openshift-ingress/router-default-6f8c669b97-fzsft" Jun 09 15:04:26.453742 ip-10-0-133-239 kubenswrapper[2576]: I0609 15:04:26.453732 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/37922842-1a2e-44d7-861f-edca166e718b-serving-cert\") pod \"console-operator-668fdbf85c-wmg5x\" (UID: \"37922842-1a2e-44d7-861f-edca166e718b\") " pod="openshift-console-operator/console-operator-668fdbf85c-wmg5x" Jun 09 15:04:26.453852 ip-10-0-133-239 kubenswrapper[2576]: I0609 15:04:26.453767 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/739fbbc7-e701-4fac-8903-5f6a0d03ecb1-nginx-conf\") pod \"networking-console-plugin-d5d5bb78b-jlv7n\" (UID: \"739fbbc7-e701-4fac-8903-5f6a0d03ecb1\") " pod="openshift-network-console/networking-console-plugin-d5d5bb78b-jlv7n" Jun 09 15:04:26.453852 ip-10-0-133-239 kubenswrapper[2576]: I0609 15:04:26.453788 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/739fbbc7-e701-4fac-8903-5f6a0d03ecb1-networking-console-plugin-cert\") pod \"networking-console-plugin-d5d5bb78b-jlv7n\" (UID: \"739fbbc7-e701-4fac-8903-5f6a0d03ecb1\") " pod="openshift-network-console/networking-console-plugin-d5d5bb78b-jlv7n" Jun 09 15:04:26.453852 ip-10-0-133-239 kubenswrapper[2576]: I0609 15:04:26.453807 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"stats-auth\" (UniqueName: \"kubernetes.io/secret/7d51209c-a257-422b-b29a-87eb78afc8d9-stats-auth\") pod \"router-default-6f8c669b97-fzsft\" (UID: \"7d51209c-a257-422b-b29a-87eb78afc8d9\") " pod="openshift-ingress/router-default-6f8c669b97-fzsft" Jun 09 15:04:26.453852 ip-10-0-133-239 kubenswrapper[2576]: I0609 15:04:26.453836 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/692623b7-ba08-4085-830a-8361352824ff-serving-cert\") pod \"service-ca-operator-6bc5ff68f5-7xfz8\" (UID: \"692623b7-ba08-4085-830a-8361352824ff\") " pod="openshift-service-ca-operator/service-ca-operator-6bc5ff68f5-7xfz8" Jun 09 15:04:26.453852 ip-10-0-133-239 kubenswrapper[2576]: I0609 15:04:26.453850 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/37922842-1a2e-44d7-861f-edca166e718b-trusted-ca\") pod \"console-operator-668fdbf85c-wmg5x\" (UID: \"37922842-1a2e-44d7-861f-edca166e718b\") " pod="openshift-console-operator/console-operator-668fdbf85c-wmg5x" Jun 09 15:04:26.454052 ip-10-0-133-239 kubenswrapper[2576]: I0609 15:04:26.453872 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6r59k\" (UniqueName: \"kubernetes.io/projected/2384a6e0-9bea-42f1-883c-bac4c0bb9658-kube-api-access-6r59k\") pod \"volume-data-source-validator-78dd696465-twbjk\" (UID: \"2384a6e0-9bea-42f1-883c-bac4c0bb9658\") " pod="openshift-cluster-storage-operator/volume-data-source-validator-78dd696465-twbjk" Jun 09 15:04:26.454052 ip-10-0-133-239 kubenswrapper[2576]: I0609 15:04:26.453932 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/37922842-1a2e-44d7-861f-edca166e718b-config\") pod \"console-operator-668fdbf85c-wmg5x\" (UID: \"37922842-1a2e-44d7-861f-edca166e718b\") " pod="openshift-console-operator/console-operator-668fdbf85c-wmg5x" Jun 09 15:04:26.454052 ip-10-0-133-239 kubenswrapper[2576]: I0609 15:04:26.453955 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-h7tp6\" (UniqueName: \"kubernetes.io/projected/37922842-1a2e-44d7-861f-edca166e718b-kube-api-access-h7tp6\") pod \"console-operator-668fdbf85c-wmg5x\" (UID: \"37922842-1a2e-44d7-861f-edca166e718b\") " pod="openshift-console-operator/console-operator-668fdbf85c-wmg5x" Jun 09 15:04:26.454052 ip-10-0-133-239 kubenswrapper[2576]: I0609 15:04:26.453973 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"default-certificate\" (UniqueName: \"kubernetes.io/secret/7d51209c-a257-422b-b29a-87eb78afc8d9-default-certificate\") pod \"router-default-6f8c669b97-fzsft\" (UID: \"7d51209c-a257-422b-b29a-87eb78afc8d9\") " pod="openshift-ingress/router-default-6f8c669b97-fzsft" Jun 09 15:04:26.454052 ip-10-0-133-239 kubenswrapper[2576]: I0609 15:04:26.453990 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/692623b7-ba08-4085-830a-8361352824ff-config\") pod \"service-ca-operator-6bc5ff68f5-7xfz8\" (UID: \"692623b7-ba08-4085-830a-8361352824ff\") " pod="openshift-service-ca-operator/service-ca-operator-6bc5ff68f5-7xfz8" Jun 09 15:04:26.454052 ip-10-0-133-239 kubenswrapper[2576]: I0609 15:04:26.454018 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/7d51209c-a257-422b-b29a-87eb78afc8d9-metrics-certs\") pod \"router-default-6f8c669b97-fzsft\" (UID: \"7d51209c-a257-422b-b29a-87eb78afc8d9\") " pod="openshift-ingress/router-default-6f8c669b97-fzsft" Jun 09 15:04:26.479638 ip-10-0-133-239 kubenswrapper[2576]: I0609 15:04:26.479608 2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-cluster-samples-operator/cluster-samples-operator-854f8b96b6-xl9mj"] Jun 09 15:04:26.481617 ip-10-0-133-239 kubenswrapper[2576]: I0609 15:04:26.481603 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-samples-operator/cluster-samples-operator-854f8b96b6-xl9mj" Jun 09 15:04:26.485920 ip-10-0-133-239 kubenswrapper[2576]: I0609 15:04:26.485903 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-samples-operator\"/\"samples-operator-tls\"" Jun 09 15:04:26.486682 ip-10-0-133-239 kubenswrapper[2576]: I0609 15:04:26.486663 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-samples-operator\"/\"openshift-service-ca.crt\"" Jun 09 15:04:26.486928 ip-10-0-133-239 kubenswrapper[2576]: I0609 15:04:26.486911 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-samples-operator\"/\"kube-root-ca.crt\"" Jun 09 15:04:26.487017 ip-10-0-133-239 kubenswrapper[2576]: I0609 15:04:26.486938 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-samples-operator\"/\"cluster-samples-operator-dockercfg-zd6vd\"" Jun 09 15:04:26.488312 ip-10-0-133-239 kubenswrapper[2576]: I0609 15:04:26.488293 2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-image-registry/image-registry-7fdd896478-qmlv4"] Jun 09 15:04:26.490319 ip-10-0-133-239 kubenswrapper[2576]: I0609 15:04:26.490303 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-7fdd896478-qmlv4" Jun 09 15:04:26.492854 ip-10-0-133-239 kubenswrapper[2576]: I0609 15:04:26.492837 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"registry-dockercfg-2x6bf\"" Jun 09 15:04:26.493181 ip-10-0-133-239 kubenswrapper[2576]: I0609 15:04:26.493167 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"installation-pull-secrets\"" Jun 09 15:04:26.493263 ip-10-0-133-239 kubenswrapper[2576]: I0609 15:04:26.493207 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-tls\"" Jun 09 15:04:26.493330 ip-10-0-133-239 kubenswrapper[2576]: I0609 15:04:26.493313 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-private-configuration\"" Jun 09 15:04:26.498805 ip-10-0-133-239 kubenswrapper[2576]: I0609 15:04:26.498784 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-cluster-samples-operator/cluster-samples-operator-854f8b96b6-xl9mj"] Jun 09 15:04:26.504394 ip-10-0-133-239 kubenswrapper[2576]: I0609 15:04:26.504371 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"trusted-ca\"" Jun 09 15:04:26.511899 ip-10-0-133-239 kubenswrapper[2576]: I0609 15:04:26.511878 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-7fdd896478-qmlv4"] Jun 09 15:04:26.554948 ip-10-0-133-239 kubenswrapper[2576]: I0609 15:04:26.554925 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/692623b7-ba08-4085-830a-8361352824ff-config\") pod \"service-ca-operator-6bc5ff68f5-7xfz8\" (UID: \"692623b7-ba08-4085-830a-8361352824ff\") " pod="openshift-service-ca-operator/service-ca-operator-6bc5ff68f5-7xfz8" Jun 09 15:04:26.555048 ip-10-0-133-239 kubenswrapper[2576]: I0609 15:04:26.554950 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/7d51209c-a257-422b-b29a-87eb78afc8d9-metrics-certs\") pod \"router-default-6f8c669b97-fzsft\" (UID: \"7d51209c-a257-422b-b29a-87eb78afc8d9\") " pod="openshift-ingress/router-default-6f8c669b97-fzsft" Jun 09 15:04:26.555048 ip-10-0-133-239 kubenswrapper[2576]: I0609 15:04:26.554971 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/ae8018cf-563e-4d3e-a432-ad1d33fb5496-bound-sa-token\") pod \"image-registry-7fdd896478-qmlv4\" (UID: \"ae8018cf-563e-4d3e-a432-ad1d33fb5496\") " pod="openshift-image-registry/image-registry-7fdd896478-qmlv4" Jun 09 15:04:26.555048 ip-10-0-133-239 kubenswrapper[2576]: I0609 15:04:26.554988 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-tgcvh\" (UniqueName: \"kubernetes.io/projected/692623b7-ba08-4085-830a-8361352824ff-kube-api-access-tgcvh\") pod \"service-ca-operator-6bc5ff68f5-7xfz8\" (UID: \"692623b7-ba08-4085-830a-8361352824ff\") " pod="openshift-service-ca-operator/service-ca-operator-6bc5ff68f5-7xfz8" Jun 09 15:04:26.555048 ip-10-0-133-239 kubenswrapper[2576]: I0609 15:04:26.555003 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/ae8018cf-563e-4d3e-a432-ad1d33fb5496-trusted-ca\") pod \"image-registry-7fdd896478-qmlv4\" (UID: \"ae8018cf-563e-4d3e-a432-ad1d33fb5496\") " pod="openshift-image-registry/image-registry-7fdd896478-qmlv4" Jun 09 15:04:26.555048 ip-10-0-133-239 kubenswrapper[2576]: I0609 15:04:26.555022 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/7d51209c-a257-422b-b29a-87eb78afc8d9-service-ca-bundle\") pod \"router-default-6f8c669b97-fzsft\" (UID: \"7d51209c-a257-422b-b29a-87eb78afc8d9\") " pod="openshift-ingress/router-default-6f8c669b97-fzsft" Jun 09 15:04:26.555275 ip-10-0-133-239 kubenswrapper[2576]: I0609 15:04:26.555090 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-w4bm2\" (UniqueName: \"kubernetes.io/projected/ae8018cf-563e-4d3e-a432-ad1d33fb5496-kube-api-access-w4bm2\") pod \"image-registry-7fdd896478-qmlv4\" (UID: \"ae8018cf-563e-4d3e-a432-ad1d33fb5496\") " pod="openshift-image-registry/image-registry-7fdd896478-qmlv4" Jun 09 15:04:26.555275 ip-10-0-133-239 kubenswrapper[2576]: E0609 15:04:26.555094 2576 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found Jun 09 15:04:26.555275 ip-10-0-133-239 kubenswrapper[2576]: I0609 15:04:26.555122 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/ae8018cf-563e-4d3e-a432-ad1d33fb5496-registry-tls\") pod \"image-registry-7fdd896478-qmlv4\" (UID: \"ae8018cf-563e-4d3e-a432-ad1d33fb5496\") " pod="openshift-image-registry/image-registry-7fdd896478-qmlv4" Jun 09 15:04:26.555275 ip-10-0-133-239 kubenswrapper[2576]: I0609 15:04:26.555143 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/ae8018cf-563e-4d3e-a432-ad1d33fb5496-image-registry-private-configuration\") pod \"image-registry-7fdd896478-qmlv4\" (UID: \"ae8018cf-563e-4d3e-a432-ad1d33fb5496\") " pod="openshift-image-registry/image-registry-7fdd896478-qmlv4" Jun 09 15:04:26.555275 ip-10-0-133-239 kubenswrapper[2576]: E0609 15:04:26.555166 2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/7d51209c-a257-422b-b29a-87eb78afc8d9-service-ca-bundle podName:7d51209c-a257-422b-b29a-87eb78afc8d9 nodeName:}" failed. No retries permitted until 2026-06-09 15:04:27.055145118 +0000 UTC m=+181.909301369 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/7d51209c-a257-422b-b29a-87eb78afc8d9-service-ca-bundle") pod "router-default-6f8c669b97-fzsft" (UID: "7d51209c-a257-422b-b29a-87eb78afc8d9") : configmap references non-existent config key: service-ca.crt Jun 09 15:04:26.555275 ip-10-0-133-239 kubenswrapper[2576]: E0609 15:04:26.555197 2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/7d51209c-a257-422b-b29a-87eb78afc8d9-metrics-certs podName:7d51209c-a257-422b-b29a-87eb78afc8d9 nodeName:}" failed. No retries permitted until 2026-06-09 15:04:27.055181644 +0000 UTC m=+181.909337864 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/7d51209c-a257-422b-b29a-87eb78afc8d9-metrics-certs") pod "router-default-6f8c669b97-fzsft" (UID: "7d51209c-a257-422b-b29a-87eb78afc8d9") : secret "router-metrics-certs-default" not found Jun 09 15:04:26.555471 ip-10-0-133-239 kubenswrapper[2576]: I0609 15:04:26.555266 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/692623b7-ba08-4085-830a-8361352824ff-serving-cert\") pod \"service-ca-operator-6bc5ff68f5-7xfz8\" (UID: \"692623b7-ba08-4085-830a-8361352824ff\") " pod="openshift-service-ca-operator/service-ca-operator-6bc5ff68f5-7xfz8" Jun 09 15:04:26.555471 ip-10-0-133-239 kubenswrapper[2576]: I0609 15:04:26.555328 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/37922842-1a2e-44d7-861f-edca166e718b-trusted-ca\") pod \"console-operator-668fdbf85c-wmg5x\" (UID: \"37922842-1a2e-44d7-861f-edca166e718b\") " pod="openshift-console-operator/console-operator-668fdbf85c-wmg5x" Jun 09 15:04:26.555471 ip-10-0-133-239 kubenswrapper[2576]: I0609 15:04:26.555365 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/37922842-1a2e-44d7-861f-edca166e718b-config\") pod \"console-operator-668fdbf85c-wmg5x\" (UID: \"37922842-1a2e-44d7-861f-edca166e718b\") " pod="openshift-console-operator/console-operator-668fdbf85c-wmg5x" Jun 09 15:04:26.555471 ip-10-0-133-239 kubenswrapper[2576]: I0609 15:04:26.555393 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-h7tp6\" (UniqueName: \"kubernetes.io/projected/37922842-1a2e-44d7-861f-edca166e718b-kube-api-access-h7tp6\") pod \"console-operator-668fdbf85c-wmg5x\" (UID: \"37922842-1a2e-44d7-861f-edca166e718b\") " pod="openshift-console-operator/console-operator-668fdbf85c-wmg5x" Jun 09 15:04:26.555471 ip-10-0-133-239 kubenswrapper[2576]: I0609 15:04:26.555424 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/ae8018cf-563e-4d3e-a432-ad1d33fb5496-installation-pull-secrets\") pod \"image-registry-7fdd896478-qmlv4\" (UID: \"ae8018cf-563e-4d3e-a432-ad1d33fb5496\") " pod="openshift-image-registry/image-registry-7fdd896478-qmlv4" Jun 09 15:04:26.555471 ip-10-0-133-239 kubenswrapper[2576]: I0609 15:04:26.555454 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-pt87b\" (UniqueName: \"kubernetes.io/projected/7d51209c-a257-422b-b29a-87eb78afc8d9-kube-api-access-pt87b\") pod \"router-default-6f8c669b97-fzsft\" (UID: \"7d51209c-a257-422b-b29a-87eb78afc8d9\") " pod="openshift-ingress/router-default-6f8c669b97-fzsft" Jun 09 15:04:26.555750 ip-10-0-133-239 kubenswrapper[2576]: I0609 15:04:26.555487 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/89ebb4ed-a80f-4b9c-9dd1-71bd2d13aeec-samples-operator-tls\") pod \"cluster-samples-operator-854f8b96b6-xl9mj\" (UID: \"89ebb4ed-a80f-4b9c-9dd1-71bd2d13aeec\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-854f8b96b6-xl9mj" Jun 09 15:04:26.555750 ip-10-0-133-239 kubenswrapper[2576]: I0609 15:04:26.555514 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/37922842-1a2e-44d7-861f-edca166e718b-serving-cert\") pod \"console-operator-668fdbf85c-wmg5x\" (UID: \"37922842-1a2e-44d7-861f-edca166e718b\") " pod="openshift-console-operator/console-operator-668fdbf85c-wmg5x" Jun 09 15:04:26.555750 ip-10-0-133-239 kubenswrapper[2576]: I0609 15:04:26.555516 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/configmap/692623b7-ba08-4085-830a-8361352824ff-config\") pod \"service-ca-operator-6bc5ff68f5-7xfz8\" (UID: \"692623b7-ba08-4085-830a-8361352824ff\") " pod="openshift-service-ca-operator/service-ca-operator-6bc5ff68f5-7xfz8" Jun 09 15:04:26.555750 ip-10-0-133-239 kubenswrapper[2576]: I0609 15:04:26.555549 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/739fbbc7-e701-4fac-8903-5f6a0d03ecb1-nginx-conf\") pod \"networking-console-plugin-d5d5bb78b-jlv7n\" (UID: \"739fbbc7-e701-4fac-8903-5f6a0d03ecb1\") " pod="openshift-network-console/networking-console-plugin-d5d5bb78b-jlv7n" Jun 09 15:04:26.555750 ip-10-0-133-239 kubenswrapper[2576]: I0609 15:04:26.555574 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/739fbbc7-e701-4fac-8903-5f6a0d03ecb1-networking-console-plugin-cert\") pod \"networking-console-plugin-d5d5bb78b-jlv7n\" (UID: \"739fbbc7-e701-4fac-8903-5f6a0d03ecb1\") " pod="openshift-network-console/networking-console-plugin-d5d5bb78b-jlv7n" Jun 09 15:04:26.555750 ip-10-0-133-239 kubenswrapper[2576]: I0609 15:04:26.555596 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"stats-auth\" (UniqueName: \"kubernetes.io/secret/7d51209c-a257-422b-b29a-87eb78afc8d9-stats-auth\") pod \"router-default-6f8c669b97-fzsft\" (UID: \"7d51209c-a257-422b-b29a-87eb78afc8d9\") " pod="openshift-ingress/router-default-6f8c669b97-fzsft" Jun 09 15:04:26.555750 ip-10-0-133-239 kubenswrapper[2576]: I0609 15:04:26.555624 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6r59k\" (UniqueName: \"kubernetes.io/projected/2384a6e0-9bea-42f1-883c-bac4c0bb9658-kube-api-access-6r59k\") pod \"volume-data-source-validator-78dd696465-twbjk\" (UID: \"2384a6e0-9bea-42f1-883c-bac4c0bb9658\") " pod="openshift-cluster-storage-operator/volume-data-source-validator-78dd696465-twbjk" Jun 09 15:04:26.555750 ip-10-0-133-239 kubenswrapper[2576]: I0609 15:04:26.555658 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rxxdh\" (UniqueName: \"kubernetes.io/projected/89ebb4ed-a80f-4b9c-9dd1-71bd2d13aeec-kube-api-access-rxxdh\") pod \"cluster-samples-operator-854f8b96b6-xl9mj\" (UID: \"89ebb4ed-a80f-4b9c-9dd1-71bd2d13aeec\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-854f8b96b6-xl9mj" Jun 09 15:04:26.555750 ip-10-0-133-239 kubenswrapper[2576]: E0609 15:04:26.555696 2576 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found Jun 09 15:04:26.556204 ip-10-0-133-239 kubenswrapper[2576]: E0609 15:04:26.555765 2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/739fbbc7-e701-4fac-8903-5f6a0d03ecb1-networking-console-plugin-cert podName:739fbbc7-e701-4fac-8903-5f6a0d03ecb1 nodeName:}" failed. No retries permitted until 2026-06-09 15:04:27.055750539 +0000 UTC m=+181.909906758 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/739fbbc7-e701-4fac-8903-5f6a0d03ecb1-networking-console-plugin-cert") pod "networking-console-plugin-d5d5bb78b-jlv7n" (UID: "739fbbc7-e701-4fac-8903-5f6a0d03ecb1") : secret "networking-console-plugin-cert" not found Jun 09 15:04:26.556204 ip-10-0-133-239 kubenswrapper[2576]: I0609 15:04:26.555702 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/ae8018cf-563e-4d3e-a432-ad1d33fb5496-ca-trust-extracted\") pod \"image-registry-7fdd896478-qmlv4\" (UID: \"ae8018cf-563e-4d3e-a432-ad1d33fb5496\") " pod="openshift-image-registry/image-registry-7fdd896478-qmlv4" Jun 09 15:04:26.556204 ip-10-0-133-239 kubenswrapper[2576]: I0609 15:04:26.555943 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/ae8018cf-563e-4d3e-a432-ad1d33fb5496-registry-certificates\") pod \"image-registry-7fdd896478-qmlv4\" (UID: \"ae8018cf-563e-4d3e-a432-ad1d33fb5496\") " pod="openshift-image-registry/image-registry-7fdd896478-qmlv4" Jun 09 15:04:26.556204 ip-10-0-133-239 kubenswrapper[2576]: I0609 15:04:26.555980 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"default-certificate\" (UniqueName: \"kubernetes.io/secret/7d51209c-a257-422b-b29a-87eb78afc8d9-default-certificate\") pod \"router-default-6f8c669b97-fzsft\" (UID: \"7d51209c-a257-422b-b29a-87eb78afc8d9\") " pod="openshift-ingress/router-default-6f8c669b97-fzsft" Jun 09 15:04:26.556381 ip-10-0-133-239 kubenswrapper[2576]: I0609 15:04:26.556238 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/37922842-1a2e-44d7-861f-edca166e718b-trusted-ca\") pod \"console-operator-668fdbf85c-wmg5x\" (UID: \"37922842-1a2e-44d7-861f-edca166e718b\") " pod="openshift-console-operator/console-operator-668fdbf85c-wmg5x" Jun 09 15:04:26.556381 ip-10-0-133-239 kubenswrapper[2576]: I0609 15:04:26.556271 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/configmap/37922842-1a2e-44d7-861f-edca166e718b-config\") pod \"console-operator-668fdbf85c-wmg5x\" (UID: \"37922842-1a2e-44d7-861f-edca166e718b\") " pod="openshift-console-operator/console-operator-668fdbf85c-wmg5x" Jun 09 15:04:26.556465 ip-10-0-133-239 kubenswrapper[2576]: I0609 15:04:26.556442 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/739fbbc7-e701-4fac-8903-5f6a0d03ecb1-nginx-conf\") pod \"networking-console-plugin-d5d5bb78b-jlv7n\" (UID: \"739fbbc7-e701-4fac-8903-5f6a0d03ecb1\") " pod="openshift-network-console/networking-console-plugin-d5d5bb78b-jlv7n" Jun 09 15:04:26.557722 ip-10-0-133-239 kubenswrapper[2576]: I0609 15:04:26.557699 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/692623b7-ba08-4085-830a-8361352824ff-serving-cert\") pod \"service-ca-operator-6bc5ff68f5-7xfz8\" (UID: \"692623b7-ba08-4085-830a-8361352824ff\") " pod="openshift-service-ca-operator/service-ca-operator-6bc5ff68f5-7xfz8" Jun 09 15:04:26.558232 ip-10-0-133-239 kubenswrapper[2576]: I0609 15:04:26.558213 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"default-certificate\" (UniqueName: \"kubernetes.io/secret/7d51209c-a257-422b-b29a-87eb78afc8d9-default-certificate\") pod \"router-default-6f8c669b97-fzsft\" (UID: \"7d51209c-a257-422b-b29a-87eb78afc8d9\") " pod="openshift-ingress/router-default-6f8c669b97-fzsft" Jun 09 15:04:26.558307 ip-10-0-133-239 kubenswrapper[2576]: I0609 15:04:26.558283 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/37922842-1a2e-44d7-861f-edca166e718b-serving-cert\") pod \"console-operator-668fdbf85c-wmg5x\" (UID: \"37922842-1a2e-44d7-861f-edca166e718b\") " pod="openshift-console-operator/console-operator-668fdbf85c-wmg5x" Jun 09 15:04:26.558307 ip-10-0-133-239 kubenswrapper[2576]: I0609 15:04:26.558292 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"stats-auth\" (UniqueName: \"kubernetes.io/secret/7d51209c-a257-422b-b29a-87eb78afc8d9-stats-auth\") pod \"router-default-6f8c669b97-fzsft\" (UID: \"7d51209c-a257-422b-b29a-87eb78afc8d9\") " pod="openshift-ingress/router-default-6f8c669b97-fzsft" Jun 09 15:04:26.566750 ip-10-0-133-239 kubenswrapper[2576]: I0609 15:04:26.566721 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-h7tp6\" (UniqueName: \"kubernetes.io/projected/37922842-1a2e-44d7-861f-edca166e718b-kube-api-access-h7tp6\") pod \"console-operator-668fdbf85c-wmg5x\" (UID: \"37922842-1a2e-44d7-861f-edca166e718b\") " pod="openshift-console-operator/console-operator-668fdbf85c-wmg5x" Jun 09 15:04:26.567785 ip-10-0-133-239 kubenswrapper[2576]: I0609 15:04:26.567765 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-tgcvh\" (UniqueName: \"kubernetes.io/projected/692623b7-ba08-4085-830a-8361352824ff-kube-api-access-tgcvh\") pod \"service-ca-operator-6bc5ff68f5-7xfz8\" (UID: \"692623b7-ba08-4085-830a-8361352824ff\") " pod="openshift-service-ca-operator/service-ca-operator-6bc5ff68f5-7xfz8" Jun 09 15:04:26.569143 ip-10-0-133-239 kubenswrapper[2576]: I0609 15:04:26.569124 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-pt87b\" (UniqueName: \"kubernetes.io/projected/7d51209c-a257-422b-b29a-87eb78afc8d9-kube-api-access-pt87b\") pod \"router-default-6f8c669b97-fzsft\" (UID: \"7d51209c-a257-422b-b29a-87eb78afc8d9\") " pod="openshift-ingress/router-default-6f8c669b97-fzsft" Jun 09 15:04:26.569208 ip-10-0-133-239 kubenswrapper[2576]: I0609 15:04:26.569192 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-6r59k\" (UniqueName: \"kubernetes.io/projected/2384a6e0-9bea-42f1-883c-bac4c0bb9658-kube-api-access-6r59k\") pod \"volume-data-source-validator-78dd696465-twbjk\" (UID: \"2384a6e0-9bea-42f1-883c-bac4c0bb9658\") " pod="openshift-cluster-storage-operator/volume-data-source-validator-78dd696465-twbjk" Jun 09 15:04:26.656666 ip-10-0-133-239 kubenswrapper[2576]: I0609 15:04:26.656571 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rxxdh\" (UniqueName: \"kubernetes.io/projected/89ebb4ed-a80f-4b9c-9dd1-71bd2d13aeec-kube-api-access-rxxdh\") pod \"cluster-samples-operator-854f8b96b6-xl9mj\" (UID: \"89ebb4ed-a80f-4b9c-9dd1-71bd2d13aeec\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-854f8b96b6-xl9mj" Jun 09 15:04:26.656666 ip-10-0-133-239 kubenswrapper[2576]: I0609 15:04:26.656631 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/ae8018cf-563e-4d3e-a432-ad1d33fb5496-ca-trust-extracted\") pod \"image-registry-7fdd896478-qmlv4\" (UID: \"ae8018cf-563e-4d3e-a432-ad1d33fb5496\") " pod="openshift-image-registry/image-registry-7fdd896478-qmlv4" Jun 09 15:04:26.656666 ip-10-0-133-239 kubenswrapper[2576]: I0609 15:04:26.656649 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/ae8018cf-563e-4d3e-a432-ad1d33fb5496-registry-certificates\") pod \"image-registry-7fdd896478-qmlv4\" (UID: \"ae8018cf-563e-4d3e-a432-ad1d33fb5496\") " pod="openshift-image-registry/image-registry-7fdd896478-qmlv4" Jun 09 15:04:26.656943 ip-10-0-133-239 kubenswrapper[2576]: I0609 15:04:26.656673 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/ae8018cf-563e-4d3e-a432-ad1d33fb5496-bound-sa-token\") pod \"image-registry-7fdd896478-qmlv4\" (UID: \"ae8018cf-563e-4d3e-a432-ad1d33fb5496\") " pod="openshift-image-registry/image-registry-7fdd896478-qmlv4" Jun 09 15:04:26.656943 ip-10-0-133-239 kubenswrapper[2576]: I0609 15:04:26.656690 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/ae8018cf-563e-4d3e-a432-ad1d33fb5496-trusted-ca\") pod \"image-registry-7fdd896478-qmlv4\" (UID: \"ae8018cf-563e-4d3e-a432-ad1d33fb5496\") " pod="openshift-image-registry/image-registry-7fdd896478-qmlv4" Jun 09 15:04:26.656943 ip-10-0-133-239 kubenswrapper[2576]: I0609 15:04:26.656722 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-w4bm2\" (UniqueName: \"kubernetes.io/projected/ae8018cf-563e-4d3e-a432-ad1d33fb5496-kube-api-access-w4bm2\") pod \"image-registry-7fdd896478-qmlv4\" (UID: \"ae8018cf-563e-4d3e-a432-ad1d33fb5496\") " pod="openshift-image-registry/image-registry-7fdd896478-qmlv4" Jun 09 15:04:26.656943 ip-10-0-133-239 kubenswrapper[2576]: I0609 15:04:26.656755 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/ae8018cf-563e-4d3e-a432-ad1d33fb5496-registry-tls\") pod \"image-registry-7fdd896478-qmlv4\" (UID: \"ae8018cf-563e-4d3e-a432-ad1d33fb5496\") " pod="openshift-image-registry/image-registry-7fdd896478-qmlv4" Jun 09 15:04:26.656943 ip-10-0-133-239 kubenswrapper[2576]: I0609 15:04:26.656787 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/ae8018cf-563e-4d3e-a432-ad1d33fb5496-image-registry-private-configuration\") pod \"image-registry-7fdd896478-qmlv4\" (UID: \"ae8018cf-563e-4d3e-a432-ad1d33fb5496\") " pod="openshift-image-registry/image-registry-7fdd896478-qmlv4" Jun 09 15:04:26.656943 ip-10-0-133-239 kubenswrapper[2576]: I0609 15:04:26.656826 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/ae8018cf-563e-4d3e-a432-ad1d33fb5496-installation-pull-secrets\") pod \"image-registry-7fdd896478-qmlv4\" (UID: \"ae8018cf-563e-4d3e-a432-ad1d33fb5496\") " pod="openshift-image-registry/image-registry-7fdd896478-qmlv4" Jun 09 15:04:26.656943 ip-10-0-133-239 kubenswrapper[2576]: E0609 15:04:26.656846 2576 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jun 09 15:04:26.656943 ip-10-0-133-239 kubenswrapper[2576]: E0609 15:04:26.656868 2576 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-7fdd896478-qmlv4: secret "image-registry-tls" not found Jun 09 15:04:26.656943 ip-10-0-133-239 kubenswrapper[2576]: E0609 15:04:26.656930 2576 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found Jun 09 15:04:26.656943 ip-10-0-133-239 kubenswrapper[2576]: E0609 15:04:26.656937 2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/ae8018cf-563e-4d3e-a432-ad1d33fb5496-registry-tls podName:ae8018cf-563e-4d3e-a432-ad1d33fb5496 nodeName:}" failed. No retries permitted until 2026-06-09 15:04:27.15691761 +0000 UTC m=+182.011073845 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/ae8018cf-563e-4d3e-a432-ad1d33fb5496-registry-tls") pod "image-registry-7fdd896478-qmlv4" (UID: "ae8018cf-563e-4d3e-a432-ad1d33fb5496") : secret "image-registry-tls" not found Jun 09 15:04:26.657454 ip-10-0-133-239 kubenswrapper[2576]: E0609 15:04:26.657002 2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/89ebb4ed-a80f-4b9c-9dd1-71bd2d13aeec-samples-operator-tls podName:89ebb4ed-a80f-4b9c-9dd1-71bd2d13aeec nodeName:}" failed. No retries permitted until 2026-06-09 15:04:27.156985406 +0000 UTC m=+182.011141626 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/89ebb4ed-a80f-4b9c-9dd1-71bd2d13aeec-samples-operator-tls") pod "cluster-samples-operator-854f8b96b6-xl9mj" (UID: "89ebb4ed-a80f-4b9c-9dd1-71bd2d13aeec") : secret "samples-operator-tls" not found Jun 09 15:04:26.657454 ip-10-0-133-239 kubenswrapper[2576]: I0609 15:04:26.656867 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/89ebb4ed-a80f-4b9c-9dd1-71bd2d13aeec-samples-operator-tls\") pod \"cluster-samples-operator-854f8b96b6-xl9mj\" (UID: \"89ebb4ed-a80f-4b9c-9dd1-71bd2d13aeec\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-854f8b96b6-xl9mj" Jun 09 15:04:26.657454 ip-10-0-133-239 kubenswrapper[2576]: I0609 15:04:26.657241 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/ae8018cf-563e-4d3e-a432-ad1d33fb5496-ca-trust-extracted\") pod \"image-registry-7fdd896478-qmlv4\" (UID: \"ae8018cf-563e-4d3e-a432-ad1d33fb5496\") " pod="openshift-image-registry/image-registry-7fdd896478-qmlv4" Jun 09 15:04:26.657454 ip-10-0-133-239 kubenswrapper[2576]: I0609 15:04:26.657386 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/ae8018cf-563e-4d3e-a432-ad1d33fb5496-registry-certificates\") pod \"image-registry-7fdd896478-qmlv4\" (UID: \"ae8018cf-563e-4d3e-a432-ad1d33fb5496\") " pod="openshift-image-registry/image-registry-7fdd896478-qmlv4" Jun 09 15:04:26.657739 ip-10-0-133-239 kubenswrapper[2576]: I0609 15:04:26.657721 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/ae8018cf-563e-4d3e-a432-ad1d33fb5496-trusted-ca\") pod \"image-registry-7fdd896478-qmlv4\" (UID: \"ae8018cf-563e-4d3e-a432-ad1d33fb5496\") " pod="openshift-image-registry/image-registry-7fdd896478-qmlv4" Jun 09 15:04:26.659227 ip-10-0-133-239 kubenswrapper[2576]: I0609 15:04:26.659208 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/ae8018cf-563e-4d3e-a432-ad1d33fb5496-image-registry-private-configuration\") pod \"image-registry-7fdd896478-qmlv4\" (UID: \"ae8018cf-563e-4d3e-a432-ad1d33fb5496\") " pod="openshift-image-registry/image-registry-7fdd896478-qmlv4" Jun 09 15:04:26.659306 ip-10-0-133-239 kubenswrapper[2576]: I0609 15:04:26.659279 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/ae8018cf-563e-4d3e-a432-ad1d33fb5496-installation-pull-secrets\") pod \"image-registry-7fdd896478-qmlv4\" (UID: \"ae8018cf-563e-4d3e-a432-ad1d33fb5496\") " pod="openshift-image-registry/image-registry-7fdd896478-qmlv4" Jun 09 15:04:26.668395 ip-10-0-133-239 kubenswrapper[2576]: I0609 15:04:26.668376 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-rxxdh\" (UniqueName: \"kubernetes.io/projected/89ebb4ed-a80f-4b9c-9dd1-71bd2d13aeec-kube-api-access-rxxdh\") pod \"cluster-samples-operator-854f8b96b6-xl9mj\" (UID: \"89ebb4ed-a80f-4b9c-9dd1-71bd2d13aeec\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-854f8b96b6-xl9mj" Jun 09 15:04:26.672319 ip-10-0-133-239 kubenswrapper[2576]: I0609 15:04:26.672291 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-w4bm2\" (UniqueName: \"kubernetes.io/projected/ae8018cf-563e-4d3e-a432-ad1d33fb5496-kube-api-access-w4bm2\") pod \"image-registry-7fdd896478-qmlv4\" (UID: \"ae8018cf-563e-4d3e-a432-ad1d33fb5496\") " pod="openshift-image-registry/image-registry-7fdd896478-qmlv4" Jun 09 15:04:26.673138 ip-10-0-133-239 kubenswrapper[2576]: I0609 15:04:26.673120 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/ae8018cf-563e-4d3e-a432-ad1d33fb5496-bound-sa-token\") pod \"image-registry-7fdd896478-qmlv4\" (UID: \"ae8018cf-563e-4d3e-a432-ad1d33fb5496\") " pod="openshift-image-registry/image-registry-7fdd896478-qmlv4" Jun 09 15:04:26.691022 ip-10-0-133-239 kubenswrapper[2576]: I0609 15:04:26.691004 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-storage-operator/volume-data-source-validator-78dd696465-twbjk" Jun 09 15:04:26.699689 ip-10-0-133-239 kubenswrapper[2576]: I0609 15:04:26.699669 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-service-ca-operator/service-ca-operator-6bc5ff68f5-7xfz8" Jun 09 15:04:26.707368 ip-10-0-133-239 kubenswrapper[2576]: I0609 15:04:26.707349 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console-operator/console-operator-668fdbf85c-wmg5x" Jun 09 15:04:26.824916 ip-10-0-133-239 kubenswrapper[2576]: I0609 15:04:26.824857 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-cluster-storage-operator/volume-data-source-validator-78dd696465-twbjk"] Jun 09 15:04:26.829929 ip-10-0-133-239 kubenswrapper[2576]: W0609 15:04:26.829902 2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2384a6e0_9bea_42f1_883c_bac4c0bb9658.slice/crio-eb120a4e6c70f680beca69168ac53e5238c8039da5a2c1bd1fee24c2fd2720f8 WatchSource:0}: Error finding container eb120a4e6c70f680beca69168ac53e5238c8039da5a2c1bd1fee24c2fd2720f8: Status 404 returned error can't find the container with id eb120a4e6c70f680beca69168ac53e5238c8039da5a2c1bd1fee24c2fd2720f8 Jun 09 15:04:26.845440 ip-10-0-133-239 kubenswrapper[2576]: I0609 15:04:26.845413 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-service-ca-operator/service-ca-operator-6bc5ff68f5-7xfz8"] Jun 09 15:04:26.849660 ip-10-0-133-239 kubenswrapper[2576]: W0609 15:04:26.849637 2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod692623b7_ba08_4085_830a_8361352824ff.slice/crio-9471957a3804c5251017fedbfca73c1b60f41849693ace969477b8324f0363a6 WatchSource:0}: Error finding container 9471957a3804c5251017fedbfca73c1b60f41849693ace969477b8324f0363a6: Status 404 returned error can't find the container with id 9471957a3804c5251017fedbfca73c1b60f41849693ace969477b8324f0363a6 Jun 09 15:04:26.863795 ip-10-0-133-239 kubenswrapper[2576]: I0609 15:04:26.863770 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console-operator/console-operator-668fdbf85c-wmg5x"] Jun 09 15:04:26.867572 ip-10-0-133-239 kubenswrapper[2576]: W0609 15:04:26.867551 2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod37922842_1a2e_44d7_861f_edca166e718b.slice/crio-ec8392a99207185d28850d3cdc37d4040112b07f3c628625f29aea6de8abba4e WatchSource:0}: Error finding container ec8392a99207185d28850d3cdc37d4040112b07f3c628625f29aea6de8abba4e: Status 404 returned error can't find the container with id ec8392a99207185d28850d3cdc37d4040112b07f3c628625f29aea6de8abba4e Jun 09 15:04:27.061959 ip-10-0-133-239 kubenswrapper[2576]: I0609 15:04:27.061931 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/7d51209c-a257-422b-b29a-87eb78afc8d9-service-ca-bundle\") pod \"router-default-6f8c669b97-fzsft\" (UID: \"7d51209c-a257-422b-b29a-87eb78afc8d9\") " pod="openshift-ingress/router-default-6f8c669b97-fzsft" Jun 09 15:04:27.062143 ip-10-0-133-239 kubenswrapper[2576]: I0609 15:04:27.062009 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/739fbbc7-e701-4fac-8903-5f6a0d03ecb1-networking-console-plugin-cert\") pod \"networking-console-plugin-d5d5bb78b-jlv7n\" (UID: \"739fbbc7-e701-4fac-8903-5f6a0d03ecb1\") " pod="openshift-network-console/networking-console-plugin-d5d5bb78b-jlv7n" Jun 09 15:04:27.062143 ip-10-0-133-239 kubenswrapper[2576]: I0609 15:04:27.062044 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/7d51209c-a257-422b-b29a-87eb78afc8d9-metrics-certs\") pod \"router-default-6f8c669b97-fzsft\" (UID: \"7d51209c-a257-422b-b29a-87eb78afc8d9\") " pod="openshift-ingress/router-default-6f8c669b97-fzsft" Jun 09 15:04:27.062143 ip-10-0-133-239 kubenswrapper[2576]: E0609 15:04:27.062121 2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/7d51209c-a257-422b-b29a-87eb78afc8d9-service-ca-bundle podName:7d51209c-a257-422b-b29a-87eb78afc8d9 nodeName:}" failed. No retries permitted until 2026-06-09 15:04:28.062099204 +0000 UTC m=+182.916255431 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/7d51209c-a257-422b-b29a-87eb78afc8d9-service-ca-bundle") pod "router-default-6f8c669b97-fzsft" (UID: "7d51209c-a257-422b-b29a-87eb78afc8d9") : configmap references non-existent config key: service-ca.crt Jun 09 15:04:27.062143 ip-10-0-133-239 kubenswrapper[2576]: E0609 15:04:27.062138 2576 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found Jun 09 15:04:27.062293 ip-10-0-133-239 kubenswrapper[2576]: E0609 15:04:27.062159 2576 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found Jun 09 15:04:27.062293 ip-10-0-133-239 kubenswrapper[2576]: E0609 15:04:27.062176 2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/7d51209c-a257-422b-b29a-87eb78afc8d9-metrics-certs podName:7d51209c-a257-422b-b29a-87eb78afc8d9 nodeName:}" failed. No retries permitted until 2026-06-09 15:04:28.062165897 +0000 UTC m=+182.916322113 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/7d51209c-a257-422b-b29a-87eb78afc8d9-metrics-certs") pod "router-default-6f8c669b97-fzsft" (UID: "7d51209c-a257-422b-b29a-87eb78afc8d9") : secret "router-metrics-certs-default" not found Jun 09 15:04:27.062293 ip-10-0-133-239 kubenswrapper[2576]: E0609 15:04:27.062214 2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/739fbbc7-e701-4fac-8903-5f6a0d03ecb1-networking-console-plugin-cert podName:739fbbc7-e701-4fac-8903-5f6a0d03ecb1 nodeName:}" failed. No retries permitted until 2026-06-09 15:04:28.062202753 +0000 UTC m=+182.916358970 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/739fbbc7-e701-4fac-8903-5f6a0d03ecb1-networking-console-plugin-cert") pod "networking-console-plugin-d5d5bb78b-jlv7n" (UID: "739fbbc7-e701-4fac-8903-5f6a0d03ecb1") : secret "networking-console-plugin-cert" not found Jun 09 15:04:27.148890 ip-10-0-133-239 kubenswrapper[2576]: I0609 15:04:27.148855 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-668fdbf85c-wmg5x" event={"ID":"37922842-1a2e-44d7-861f-edca166e718b","Type":"ContainerStarted","Data":"ec8392a99207185d28850d3cdc37d4040112b07f3c628625f29aea6de8abba4e"} Jun 09 15:04:27.149813 ip-10-0-133-239 kubenswrapper[2576]: I0609 15:04:27.149790 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca-operator/service-ca-operator-6bc5ff68f5-7xfz8" event={"ID":"692623b7-ba08-4085-830a-8361352824ff","Type":"ContainerStarted","Data":"9471957a3804c5251017fedbfca73c1b60f41849693ace969477b8324f0363a6"} Jun 09 15:04:27.150790 ip-10-0-133-239 kubenswrapper[2576]: I0609 15:04:27.150772 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-storage-operator/volume-data-source-validator-78dd696465-twbjk" event={"ID":"2384a6e0-9bea-42f1-883c-bac4c0bb9658","Type":"ContainerStarted","Data":"eb120a4e6c70f680beca69168ac53e5238c8039da5a2c1bd1fee24c2fd2720f8"} Jun 09 15:04:27.162703 ip-10-0-133-239 kubenswrapper[2576]: I0609 15:04:27.162681 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/ae8018cf-563e-4d3e-a432-ad1d33fb5496-registry-tls\") pod \"image-registry-7fdd896478-qmlv4\" (UID: \"ae8018cf-563e-4d3e-a432-ad1d33fb5496\") " pod="openshift-image-registry/image-registry-7fdd896478-qmlv4" Jun 09 15:04:27.162786 ip-10-0-133-239 kubenswrapper[2576]: I0609 15:04:27.162731 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/89ebb4ed-a80f-4b9c-9dd1-71bd2d13aeec-samples-operator-tls\") pod \"cluster-samples-operator-854f8b96b6-xl9mj\" (UID: \"89ebb4ed-a80f-4b9c-9dd1-71bd2d13aeec\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-854f8b96b6-xl9mj" Jun 09 15:04:27.162867 ip-10-0-133-239 kubenswrapper[2576]: E0609 15:04:27.162817 2576 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jun 09 15:04:27.162867 ip-10-0-133-239 kubenswrapper[2576]: E0609 15:04:27.162833 2576 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-7fdd896478-qmlv4: secret "image-registry-tls" not found Jun 09 15:04:27.162867 ip-10-0-133-239 kubenswrapper[2576]: E0609 15:04:27.162859 2576 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found Jun 09 15:04:27.162953 ip-10-0-133-239 kubenswrapper[2576]: E0609 15:04:27.162880 2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/ae8018cf-563e-4d3e-a432-ad1d33fb5496-registry-tls podName:ae8018cf-563e-4d3e-a432-ad1d33fb5496 nodeName:}" failed. No retries permitted until 2026-06-09 15:04:28.16286611 +0000 UTC m=+183.017022328 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/ae8018cf-563e-4d3e-a432-ad1d33fb5496-registry-tls") pod "image-registry-7fdd896478-qmlv4" (UID: "ae8018cf-563e-4d3e-a432-ad1d33fb5496") : secret "image-registry-tls" not found Jun 09 15:04:27.162953 ip-10-0-133-239 kubenswrapper[2576]: E0609 15:04:27.162900 2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/89ebb4ed-a80f-4b9c-9dd1-71bd2d13aeec-samples-operator-tls podName:89ebb4ed-a80f-4b9c-9dd1-71bd2d13aeec nodeName:}" failed. No retries permitted until 2026-06-09 15:04:28.162885436 +0000 UTC m=+183.017041670 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/89ebb4ed-a80f-4b9c-9dd1-71bd2d13aeec-samples-operator-tls") pod "cluster-samples-operator-854f8b96b6-xl9mj" (UID: "89ebb4ed-a80f-4b9c-9dd1-71bd2d13aeec") : secret "samples-operator-tls" not found Jun 09 15:04:28.070633 ip-10-0-133-239 kubenswrapper[2576]: I0609 15:04:28.070595 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/7d51209c-a257-422b-b29a-87eb78afc8d9-metrics-certs\") pod \"router-default-6f8c669b97-fzsft\" (UID: \"7d51209c-a257-422b-b29a-87eb78afc8d9\") " pod="openshift-ingress/router-default-6f8c669b97-fzsft" Jun 09 15:04:28.071112 ip-10-0-133-239 kubenswrapper[2576]: I0609 15:04:28.070654 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/7d51209c-a257-422b-b29a-87eb78afc8d9-service-ca-bundle\") pod \"router-default-6f8c669b97-fzsft\" (UID: \"7d51209c-a257-422b-b29a-87eb78afc8d9\") " pod="openshift-ingress/router-default-6f8c669b97-fzsft" Jun 09 15:04:28.071112 ip-10-0-133-239 kubenswrapper[2576]: E0609 15:04:28.070761 2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/7d51209c-a257-422b-b29a-87eb78afc8d9-service-ca-bundle podName:7d51209c-a257-422b-b29a-87eb78afc8d9 nodeName:}" failed. No retries permitted until 2026-06-09 15:04:30.070748416 +0000 UTC m=+184.924904636 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/7d51209c-a257-422b-b29a-87eb78afc8d9-service-ca-bundle") pod "router-default-6f8c669b97-fzsft" (UID: "7d51209c-a257-422b-b29a-87eb78afc8d9") : configmap references non-existent config key: service-ca.crt Jun 09 15:04:28.071112 ip-10-0-133-239 kubenswrapper[2576]: E0609 15:04:28.070759 2576 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found Jun 09 15:04:28.071112 ip-10-0-133-239 kubenswrapper[2576]: E0609 15:04:28.070815 2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/7d51209c-a257-422b-b29a-87eb78afc8d9-metrics-certs podName:7d51209c-a257-422b-b29a-87eb78afc8d9 nodeName:}" failed. No retries permitted until 2026-06-09 15:04:30.070798056 +0000 UTC m=+184.924954273 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/7d51209c-a257-422b-b29a-87eb78afc8d9-metrics-certs") pod "router-default-6f8c669b97-fzsft" (UID: "7d51209c-a257-422b-b29a-87eb78afc8d9") : secret "router-metrics-certs-default" not found Jun 09 15:04:28.071112 ip-10-0-133-239 kubenswrapper[2576]: I0609 15:04:28.070898 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/739fbbc7-e701-4fac-8903-5f6a0d03ecb1-networking-console-plugin-cert\") pod \"networking-console-plugin-d5d5bb78b-jlv7n\" (UID: \"739fbbc7-e701-4fac-8903-5f6a0d03ecb1\") " pod="openshift-network-console/networking-console-plugin-d5d5bb78b-jlv7n" Jun 09 15:04:28.071112 ip-10-0-133-239 kubenswrapper[2576]: E0609 15:04:28.070992 2576 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found Jun 09 15:04:28.071112 ip-10-0-133-239 kubenswrapper[2576]: E0609 15:04:28.071052 2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/739fbbc7-e701-4fac-8903-5f6a0d03ecb1-networking-console-plugin-cert podName:739fbbc7-e701-4fac-8903-5f6a0d03ecb1 nodeName:}" failed. No retries permitted until 2026-06-09 15:04:30.071042269 +0000 UTC m=+184.925198486 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/739fbbc7-e701-4fac-8903-5f6a0d03ecb1-networking-console-plugin-cert") pod "networking-console-plugin-d5d5bb78b-jlv7n" (UID: "739fbbc7-e701-4fac-8903-5f6a0d03ecb1") : secret "networking-console-plugin-cert" not found Jun 09 15:04:28.171430 ip-10-0-133-239 kubenswrapper[2576]: I0609 15:04:28.171399 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/ae8018cf-563e-4d3e-a432-ad1d33fb5496-registry-tls\") pod \"image-registry-7fdd896478-qmlv4\" (UID: \"ae8018cf-563e-4d3e-a432-ad1d33fb5496\") " pod="openshift-image-registry/image-registry-7fdd896478-qmlv4" Jun 09 15:04:28.171599 ip-10-0-133-239 kubenswrapper[2576]: I0609 15:04:28.171451 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/89ebb4ed-a80f-4b9c-9dd1-71bd2d13aeec-samples-operator-tls\") pod \"cluster-samples-operator-854f8b96b6-xl9mj\" (UID: \"89ebb4ed-a80f-4b9c-9dd1-71bd2d13aeec\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-854f8b96b6-xl9mj" Jun 09 15:04:28.171599 ip-10-0-133-239 kubenswrapper[2576]: E0609 15:04:28.171558 2576 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found Jun 09 15:04:28.171717 ip-10-0-133-239 kubenswrapper[2576]: E0609 15:04:28.171615 2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/89ebb4ed-a80f-4b9c-9dd1-71bd2d13aeec-samples-operator-tls podName:89ebb4ed-a80f-4b9c-9dd1-71bd2d13aeec nodeName:}" failed. No retries permitted until 2026-06-09 15:04:30.171599455 +0000 UTC m=+185.025755672 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/89ebb4ed-a80f-4b9c-9dd1-71bd2d13aeec-samples-operator-tls") pod "cluster-samples-operator-854f8b96b6-xl9mj" (UID: "89ebb4ed-a80f-4b9c-9dd1-71bd2d13aeec") : secret "samples-operator-tls" not found Jun 09 15:04:28.171717 ip-10-0-133-239 kubenswrapper[2576]: E0609 15:04:28.171563 2576 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jun 09 15:04:28.171717 ip-10-0-133-239 kubenswrapper[2576]: E0609 15:04:28.171652 2576 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-7fdd896478-qmlv4: secret "image-registry-tls" not found Jun 09 15:04:28.171717 ip-10-0-133-239 kubenswrapper[2576]: E0609 15:04:28.171701 2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/ae8018cf-563e-4d3e-a432-ad1d33fb5496-registry-tls podName:ae8018cf-563e-4d3e-a432-ad1d33fb5496 nodeName:}" failed. No retries permitted until 2026-06-09 15:04:30.171688242 +0000 UTC m=+185.025844477 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/ae8018cf-563e-4d3e-a432-ad1d33fb5496-registry-tls") pod "image-registry-7fdd896478-qmlv4" (UID: "ae8018cf-563e-4d3e-a432-ad1d33fb5496") : secret "image-registry-tls" not found Jun 09 15:04:29.157732 ip-10-0-133-239 kubenswrapper[2576]: I0609 15:04:29.157694 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-storage-operator/volume-data-source-validator-78dd696465-twbjk" event={"ID":"2384a6e0-9bea-42f1-883c-bac4c0bb9658","Type":"ContainerStarted","Data":"11f279aae38c64b11c1609a2fcf81f9f0d752bf553bc5dcc40355bbbf61a465b"} Jun 09 15:04:29.172979 ip-10-0-133-239 kubenswrapper[2576]: I0609 15:04:29.172891 2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-storage-operator/volume-data-source-validator-78dd696465-twbjk" podStartSLOduration=1.770798254 podStartE2EDuration="3.172873374s" totalImagesPullingTime="1.40207512s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-09 15:04:26 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-09 15:04:29.172699766 +0000 UTC m=+184.026856016" watchObservedRunningTime="2026-06-09 15:04:29.172873374 +0000 UTC m=+184.027029614" Jun 09 15:04:30.087427 ip-10-0-133-239 kubenswrapper[2576]: I0609 15:04:30.087394 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/739fbbc7-e701-4fac-8903-5f6a0d03ecb1-networking-console-plugin-cert\") pod \"networking-console-plugin-d5d5bb78b-jlv7n\" (UID: \"739fbbc7-e701-4fac-8903-5f6a0d03ecb1\") " pod="openshift-network-console/networking-console-plugin-d5d5bb78b-jlv7n" Jun 09 15:04:30.087619 ip-10-0-133-239 kubenswrapper[2576]: I0609 15:04:30.087457 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/7d51209c-a257-422b-b29a-87eb78afc8d9-metrics-certs\") pod \"router-default-6f8c669b97-fzsft\" (UID: \"7d51209c-a257-422b-b29a-87eb78afc8d9\") " pod="openshift-ingress/router-default-6f8c669b97-fzsft" Jun 09 15:04:30.087619 ip-10-0-133-239 kubenswrapper[2576]: I0609 15:04:30.087494 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/7d51209c-a257-422b-b29a-87eb78afc8d9-service-ca-bundle\") pod \"router-default-6f8c669b97-fzsft\" (UID: \"7d51209c-a257-422b-b29a-87eb78afc8d9\") " pod="openshift-ingress/router-default-6f8c669b97-fzsft" Jun 09 15:04:30.087619 ip-10-0-133-239 kubenswrapper[2576]: E0609 15:04:30.087574 2576 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found Jun 09 15:04:30.087768 ip-10-0-133-239 kubenswrapper[2576]: E0609 15:04:30.087631 2576 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found Jun 09 15:04:30.087768 ip-10-0-133-239 kubenswrapper[2576]: E0609 15:04:30.087649 2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/739fbbc7-e701-4fac-8903-5f6a0d03ecb1-networking-console-plugin-cert podName:739fbbc7-e701-4fac-8903-5f6a0d03ecb1 nodeName:}" failed. No retries permitted until 2026-06-09 15:04:34.087628142 +0000 UTC m=+188.941784364 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/739fbbc7-e701-4fac-8903-5f6a0d03ecb1-networking-console-plugin-cert") pod "networking-console-plugin-d5d5bb78b-jlv7n" (UID: "739fbbc7-e701-4fac-8903-5f6a0d03ecb1") : secret "networking-console-plugin-cert" not found Jun 09 15:04:30.087768 ip-10-0-133-239 kubenswrapper[2576]: E0609 15:04:30.087684 2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/7d51209c-a257-422b-b29a-87eb78afc8d9-metrics-certs podName:7d51209c-a257-422b-b29a-87eb78afc8d9 nodeName:}" failed. No retries permitted until 2026-06-09 15:04:34.087668324 +0000 UTC m=+188.941824562 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/7d51209c-a257-422b-b29a-87eb78afc8d9-metrics-certs") pod "router-default-6f8c669b97-fzsft" (UID: "7d51209c-a257-422b-b29a-87eb78afc8d9") : secret "router-metrics-certs-default" not found Jun 09 15:04:30.087768 ip-10-0-133-239 kubenswrapper[2576]: E0609 15:04:30.087710 2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/7d51209c-a257-422b-b29a-87eb78afc8d9-service-ca-bundle podName:7d51209c-a257-422b-b29a-87eb78afc8d9 nodeName:}" failed. No retries permitted until 2026-06-09 15:04:34.087702622 +0000 UTC m=+188.941858839 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/7d51209c-a257-422b-b29a-87eb78afc8d9-service-ca-bundle") pod "router-default-6f8c669b97-fzsft" (UID: "7d51209c-a257-422b-b29a-87eb78afc8d9") : configmap references non-existent config key: service-ca.crt Jun 09 15:04:30.188420 ip-10-0-133-239 kubenswrapper[2576]: I0609 15:04:30.188378 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/89ebb4ed-a80f-4b9c-9dd1-71bd2d13aeec-samples-operator-tls\") pod \"cluster-samples-operator-854f8b96b6-xl9mj\" (UID: \"89ebb4ed-a80f-4b9c-9dd1-71bd2d13aeec\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-854f8b96b6-xl9mj" Jun 09 15:04:30.188826 ip-10-0-133-239 kubenswrapper[2576]: E0609 15:04:30.188543 2576 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found Jun 09 15:04:30.188826 ip-10-0-133-239 kubenswrapper[2576]: E0609 15:04:30.188609 2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/89ebb4ed-a80f-4b9c-9dd1-71bd2d13aeec-samples-operator-tls podName:89ebb4ed-a80f-4b9c-9dd1-71bd2d13aeec nodeName:}" failed. No retries permitted until 2026-06-09 15:04:34.188588643 +0000 UTC m=+189.042744861 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/89ebb4ed-a80f-4b9c-9dd1-71bd2d13aeec-samples-operator-tls") pod "cluster-samples-operator-854f8b96b6-xl9mj" (UID: "89ebb4ed-a80f-4b9c-9dd1-71bd2d13aeec") : secret "samples-operator-tls" not found Jun 09 15:04:30.188826 ip-10-0-133-239 kubenswrapper[2576]: I0609 15:04:30.188683 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/ae8018cf-563e-4d3e-a432-ad1d33fb5496-registry-tls\") pod \"image-registry-7fdd896478-qmlv4\" (UID: \"ae8018cf-563e-4d3e-a432-ad1d33fb5496\") " pod="openshift-image-registry/image-registry-7fdd896478-qmlv4" Jun 09 15:04:30.188826 ip-10-0-133-239 kubenswrapper[2576]: E0609 15:04:30.188786 2576 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jun 09 15:04:30.188826 ip-10-0-133-239 kubenswrapper[2576]: E0609 15:04:30.188799 2576 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-7fdd896478-qmlv4: secret "image-registry-tls" not found Jun 09 15:04:30.189046 ip-10-0-133-239 kubenswrapper[2576]: E0609 15:04:30.188845 2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/ae8018cf-563e-4d3e-a432-ad1d33fb5496-registry-tls podName:ae8018cf-563e-4d3e-a432-ad1d33fb5496 nodeName:}" failed. No retries permitted until 2026-06-09 15:04:34.188831838 +0000 UTC m=+189.042988055 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/ae8018cf-563e-4d3e-a432-ad1d33fb5496-registry-tls") pod "image-registry-7fdd896478-qmlv4" (UID: "ae8018cf-563e-4d3e-a432-ad1d33fb5496") : secret "image-registry-tls" not found Jun 09 15:04:31.164637 ip-10-0-133-239 kubenswrapper[2576]: I0609 15:04:31.164608 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-668fdbf85c-wmg5x_37922842-1a2e-44d7-861f-edca166e718b/console-operator/0.log" Jun 09 15:04:31.164809 ip-10-0-133-239 kubenswrapper[2576]: I0609 15:04:31.164651 2576 generic.go:356] "Generic (PLEG): container finished" podID="37922842-1a2e-44d7-861f-edca166e718b" containerID="a628d45a9df13980702cb48e40661696abc90f89421b4becea018888343fba1a" exitCode=255 Jun 09 15:04:31.164809 ip-10-0-133-239 kubenswrapper[2576]: I0609 15:04:31.164739 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-668fdbf85c-wmg5x" event={"ID":"37922842-1a2e-44d7-861f-edca166e718b","Type":"ContainerDied","Data":"a628d45a9df13980702cb48e40661696abc90f89421b4becea018888343fba1a"} Jun 09 15:04:31.164944 ip-10-0-133-239 kubenswrapper[2576]: I0609 15:04:31.164927 2576 scope.go:117] "RemoveContainer" containerID="a628d45a9df13980702cb48e40661696abc90f89421b4becea018888343fba1a" Jun 09 15:04:31.166113 ip-10-0-133-239 kubenswrapper[2576]: I0609 15:04:31.166089 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca-operator/service-ca-operator-6bc5ff68f5-7xfz8" event={"ID":"692623b7-ba08-4085-830a-8361352824ff","Type":"ContainerStarted","Data":"0bbedfc6a8a3ee621551001a32418e7b6a8abde29316242bd1650afb009248fa"} Jun 09 15:04:31.197526 ip-10-0-133-239 kubenswrapper[2576]: I0609 15:04:31.197486 2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-service-ca-operator/service-ca-operator-6bc5ff68f5-7xfz8" podStartSLOduration=1.341778736 podStartE2EDuration="5.197473051s" totalImagesPullingTime="3.855694315s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-09 15:04:26 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-09 15:04:31.196345302 +0000 UTC m=+186.050501541" watchObservedRunningTime="2026-06-09 15:04:31.197473051 +0000 UTC m=+186.051629290" Jun 09 15:04:31.708154 ip-10-0-133-239 kubenswrapper[2576]: I0609 15:04:31.708124 2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-kube-storage-version-migrator/migrator-955ffdf5f-mwvhb"] Jun 09 15:04:31.710152 ip-10-0-133-239 kubenswrapper[2576]: I0609 15:04:31.710137 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-storage-version-migrator/migrator-955ffdf5f-mwvhb" Jun 09 15:04:31.712762 ip-10-0-133-239 kubenswrapper[2576]: I0609 15:04:31.712743 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-kube-storage-version-migrator\"/\"kube-storage-version-migrator-sa-dockercfg-4hz52\"" Jun 09 15:04:31.712762 ip-10-0-133-239 kubenswrapper[2576]: I0609 15:04:31.712744 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator\"/\"kube-root-ca.crt\"" Jun 09 15:04:31.712999 ip-10-0-133-239 kubenswrapper[2576]: I0609 15:04:31.712984 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator\"/\"openshift-service-ca.crt\"" Jun 09 15:04:31.725783 ip-10-0-133-239 kubenswrapper[2576]: I0609 15:04:31.725760 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-kube-storage-version-migrator/migrator-955ffdf5f-mwvhb"] Jun 09 15:04:31.802137 ip-10-0-133-239 kubenswrapper[2576]: I0609 15:04:31.802106 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-pssh9\" (UniqueName: \"kubernetes.io/projected/5433a9b5-4ef5-494d-b418-3c1c2973a7c1-kube-api-access-pssh9\") pod \"migrator-955ffdf5f-mwvhb\" (UID: \"5433a9b5-4ef5-494d-b418-3c1c2973a7c1\") " pod="openshift-kube-storage-version-migrator/migrator-955ffdf5f-mwvhb" Jun 09 15:04:31.903127 ip-10-0-133-239 kubenswrapper[2576]: I0609 15:04:31.903100 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-pssh9\" (UniqueName: \"kubernetes.io/projected/5433a9b5-4ef5-494d-b418-3c1c2973a7c1-kube-api-access-pssh9\") pod \"migrator-955ffdf5f-mwvhb\" (UID: \"5433a9b5-4ef5-494d-b418-3c1c2973a7c1\") " pod="openshift-kube-storage-version-migrator/migrator-955ffdf5f-mwvhb" Jun 09 15:04:31.912245 ip-10-0-133-239 kubenswrapper[2576]: I0609 15:04:31.912222 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-pssh9\" (UniqueName: \"kubernetes.io/projected/5433a9b5-4ef5-494d-b418-3c1c2973a7c1-kube-api-access-pssh9\") pod \"migrator-955ffdf5f-mwvhb\" (UID: \"5433a9b5-4ef5-494d-b418-3c1c2973a7c1\") " pod="openshift-kube-storage-version-migrator/migrator-955ffdf5f-mwvhb" Jun 09 15:04:32.019081 ip-10-0-133-239 kubenswrapper[2576]: I0609 15:04:32.019031 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-storage-version-migrator/migrator-955ffdf5f-mwvhb" Jun 09 15:04:32.138722 ip-10-0-133-239 kubenswrapper[2576]: I0609 15:04:32.138666 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-kube-storage-version-migrator/migrator-955ffdf5f-mwvhb"] Jun 09 15:04:32.170433 ip-10-0-133-239 kubenswrapper[2576]: I0609 15:04:32.170403 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator/migrator-955ffdf5f-mwvhb" event={"ID":"5433a9b5-4ef5-494d-b418-3c1c2973a7c1","Type":"ContainerStarted","Data":"23732913d48031b59bcf67ed13160d63df89de779260eea2dc13c9cbe5bd2d13"} Jun 09 15:04:32.171722 ip-10-0-133-239 kubenswrapper[2576]: I0609 15:04:32.171708 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-668fdbf85c-wmg5x_37922842-1a2e-44d7-861f-edca166e718b/console-operator/1.log" Jun 09 15:04:32.172060 ip-10-0-133-239 kubenswrapper[2576]: I0609 15:04:32.172044 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-668fdbf85c-wmg5x_37922842-1a2e-44d7-861f-edca166e718b/console-operator/0.log" Jun 09 15:04:32.172122 ip-10-0-133-239 kubenswrapper[2576]: I0609 15:04:32.172102 2576 generic.go:356] "Generic (PLEG): container finished" podID="37922842-1a2e-44d7-861f-edca166e718b" containerID="10e9dee1642eaa8ff9a33b3931c3dddc47e0df26ad3423feff8a0e4c813035ca" exitCode=255 Jun 09 15:04:32.172187 ip-10-0-133-239 kubenswrapper[2576]: I0609 15:04:32.172173 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-668fdbf85c-wmg5x" event={"ID":"37922842-1a2e-44d7-861f-edca166e718b","Type":"ContainerDied","Data":"10e9dee1642eaa8ff9a33b3931c3dddc47e0df26ad3423feff8a0e4c813035ca"} Jun 09 15:04:32.172228 ip-10-0-133-239 kubenswrapper[2576]: I0609 15:04:32.172217 2576 scope.go:117] "RemoveContainer" containerID="a628d45a9df13980702cb48e40661696abc90f89421b4becea018888343fba1a" Jun 09 15:04:32.172434 ip-10-0-133-239 kubenswrapper[2576]: I0609 15:04:32.172421 2576 scope.go:117] "RemoveContainer" containerID="10e9dee1642eaa8ff9a33b3931c3dddc47e0df26ad3423feff8a0e4c813035ca" Jun 09 15:04:32.172593 ip-10-0-133-239 kubenswrapper[2576]: E0609 15:04:32.172569 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"console-operator\" with CrashLoopBackOff: \"back-off 10s restarting failed container=console-operator pod=console-operator-668fdbf85c-wmg5x_openshift-console-operator(37922842-1a2e-44d7-861f-edca166e718b)\"" pod="openshift-console-operator/console-operator-668fdbf85c-wmg5x" podUID="37922842-1a2e-44d7-861f-edca166e718b" Jun 09 15:04:32.595826 ip-10-0-133-239 kubenswrapper[2576]: I0609 15:04:32.595791 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-d5rht_819c59d4-2dfd-40f7-8018-dc29890cc325/dns-node-resolver/0.log" Jun 09 15:04:33.177965 ip-10-0-133-239 kubenswrapper[2576]: I0609 15:04:33.177946 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-668fdbf85c-wmg5x_37922842-1a2e-44d7-861f-edca166e718b/console-operator/1.log" Jun 09 15:04:33.178298 ip-10-0-133-239 kubenswrapper[2576]: I0609 15:04:33.178280 2576 scope.go:117] "RemoveContainer" containerID="10e9dee1642eaa8ff9a33b3931c3dddc47e0df26ad3423feff8a0e4c813035ca" Jun 09 15:04:33.179359 ip-10-0-133-239 kubenswrapper[2576]: E0609 15:04:33.179337 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"console-operator\" with CrashLoopBackOff: \"back-off 10s restarting failed container=console-operator pod=console-operator-668fdbf85c-wmg5x_openshift-console-operator(37922842-1a2e-44d7-861f-edca166e718b)\"" pod="openshift-console-operator/console-operator-668fdbf85c-wmg5x" podUID="37922842-1a2e-44d7-861f-edca166e718b" Jun 09 15:04:33.995591 ip-10-0-133-239 kubenswrapper[2576]: I0609 15:04:33.995565 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-n4qqs_ab1b7146-38f5-4c67-b79c-d98d8f1734e8/node-ca/0.log" Jun 09 15:04:34.122519 ip-10-0-133-239 kubenswrapper[2576]: I0609 15:04:34.122485 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/7d51209c-a257-422b-b29a-87eb78afc8d9-service-ca-bundle\") pod \"router-default-6f8c669b97-fzsft\" (UID: \"7d51209c-a257-422b-b29a-87eb78afc8d9\") " pod="openshift-ingress/router-default-6f8c669b97-fzsft" Jun 09 15:04:34.122690 ip-10-0-133-239 kubenswrapper[2576]: I0609 15:04:34.122568 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/739fbbc7-e701-4fac-8903-5f6a0d03ecb1-networking-console-plugin-cert\") pod \"networking-console-plugin-d5d5bb78b-jlv7n\" (UID: \"739fbbc7-e701-4fac-8903-5f6a0d03ecb1\") " pod="openshift-network-console/networking-console-plugin-d5d5bb78b-jlv7n" Jun 09 15:04:34.122690 ip-10-0-133-239 kubenswrapper[2576]: I0609 15:04:34.122606 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/7d51209c-a257-422b-b29a-87eb78afc8d9-metrics-certs\") pod \"router-default-6f8c669b97-fzsft\" (UID: \"7d51209c-a257-422b-b29a-87eb78afc8d9\") " pod="openshift-ingress/router-default-6f8c669b97-fzsft" Jun 09 15:04:34.122690 ip-10-0-133-239 kubenswrapper[2576]: E0609 15:04:34.122677 2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/7d51209c-a257-422b-b29a-87eb78afc8d9-service-ca-bundle podName:7d51209c-a257-422b-b29a-87eb78afc8d9 nodeName:}" failed. No retries permitted until 2026-06-09 15:04:42.122655029 +0000 UTC m=+196.976811262 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/7d51209c-a257-422b-b29a-87eb78afc8d9-service-ca-bundle") pod "router-default-6f8c669b97-fzsft" (UID: "7d51209c-a257-422b-b29a-87eb78afc8d9") : configmap references non-existent config key: service-ca.crt Jun 09 15:04:34.122849 ip-10-0-133-239 kubenswrapper[2576]: E0609 15:04:34.122703 2576 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found Jun 09 15:04:34.122849 ip-10-0-133-239 kubenswrapper[2576]: E0609 15:04:34.122750 2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/7d51209c-a257-422b-b29a-87eb78afc8d9-metrics-certs podName:7d51209c-a257-422b-b29a-87eb78afc8d9 nodeName:}" failed. No retries permitted until 2026-06-09 15:04:42.122738907 +0000 UTC m=+196.976895124 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/7d51209c-a257-422b-b29a-87eb78afc8d9-metrics-certs") pod "router-default-6f8c669b97-fzsft" (UID: "7d51209c-a257-422b-b29a-87eb78afc8d9") : secret "router-metrics-certs-default" not found Jun 09 15:04:34.122849 ip-10-0-133-239 kubenswrapper[2576]: E0609 15:04:34.122703 2576 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found Jun 09 15:04:34.122849 ip-10-0-133-239 kubenswrapper[2576]: E0609 15:04:34.122783 2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/739fbbc7-e701-4fac-8903-5f6a0d03ecb1-networking-console-plugin-cert podName:739fbbc7-e701-4fac-8903-5f6a0d03ecb1 nodeName:}" failed. No retries permitted until 2026-06-09 15:04:42.122773724 +0000 UTC m=+196.976929977 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/739fbbc7-e701-4fac-8903-5f6a0d03ecb1-networking-console-plugin-cert") pod "networking-console-plugin-d5d5bb78b-jlv7n" (UID: "739fbbc7-e701-4fac-8903-5f6a0d03ecb1") : secret "networking-console-plugin-cert" not found Jun 09 15:04:34.183217 ip-10-0-133-239 kubenswrapper[2576]: I0609 15:04:34.183178 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator/migrator-955ffdf5f-mwvhb" event={"ID":"5433a9b5-4ef5-494d-b418-3c1c2973a7c1","Type":"ContainerStarted","Data":"53d6d44cab7527ec79e77439a0de44ba2e2ed23eb0e3e41d413a81edaa2dd88d"} Jun 09 15:04:34.183349 ip-10-0-133-239 kubenswrapper[2576]: I0609 15:04:34.183234 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator/migrator-955ffdf5f-mwvhb" event={"ID":"5433a9b5-4ef5-494d-b418-3c1c2973a7c1","Type":"ContainerStarted","Data":"b128fece2cf94b1f9a8141a5965fc4666a945f0efff9ceacc9d7b44da2c5f87b"} Jun 09 15:04:34.198216 ip-10-0-133-239 kubenswrapper[2576]: I0609 15:04:34.198170 2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-kube-storage-version-migrator/migrator-955ffdf5f-mwvhb" podStartSLOduration=2.2160787 podStartE2EDuration="3.198156181s" totalImagesPullingTime="982.077481ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-09 15:04:31 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-09 15:04:34.197291987 +0000 UTC m=+189.051448219" watchObservedRunningTime="2026-06-09 15:04:34.198156181 +0000 UTC m=+189.052312419" Jun 09 15:04:34.222992 ip-10-0-133-239 kubenswrapper[2576]: I0609 15:04:34.222970 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/ae8018cf-563e-4d3e-a432-ad1d33fb5496-registry-tls\") pod \"image-registry-7fdd896478-qmlv4\" (UID: \"ae8018cf-563e-4d3e-a432-ad1d33fb5496\") " pod="openshift-image-registry/image-registry-7fdd896478-qmlv4" Jun 09 15:04:34.223126 ip-10-0-133-239 kubenswrapper[2576]: I0609 15:04:34.223019 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/89ebb4ed-a80f-4b9c-9dd1-71bd2d13aeec-samples-operator-tls\") pod \"cluster-samples-operator-854f8b96b6-xl9mj\" (UID: \"89ebb4ed-a80f-4b9c-9dd1-71bd2d13aeec\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-854f8b96b6-xl9mj" Jun 09 15:04:34.223126 ip-10-0-133-239 kubenswrapper[2576]: E0609 15:04:34.223117 2576 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jun 09 15:04:34.223236 ip-10-0-133-239 kubenswrapper[2576]: E0609 15:04:34.223132 2576 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-7fdd896478-qmlv4: secret "image-registry-tls" not found Jun 09 15:04:34.223236 ip-10-0-133-239 kubenswrapper[2576]: E0609 15:04:34.223140 2576 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found Jun 09 15:04:34.223236 ip-10-0-133-239 kubenswrapper[2576]: E0609 15:04:34.223183 2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/ae8018cf-563e-4d3e-a432-ad1d33fb5496-registry-tls podName:ae8018cf-563e-4d3e-a432-ad1d33fb5496 nodeName:}" failed. No retries permitted until 2026-06-09 15:04:42.223165814 +0000 UTC m=+197.077322031 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/ae8018cf-563e-4d3e-a432-ad1d33fb5496-registry-tls") pod "image-registry-7fdd896478-qmlv4" (UID: "ae8018cf-563e-4d3e-a432-ad1d33fb5496") : secret "image-registry-tls" not found Jun 09 15:04:34.223236 ip-10-0-133-239 kubenswrapper[2576]: E0609 15:04:34.223200 2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/89ebb4ed-a80f-4b9c-9dd1-71bd2d13aeec-samples-operator-tls podName:89ebb4ed-a80f-4b9c-9dd1-71bd2d13aeec nodeName:}" failed. No retries permitted until 2026-06-09 15:04:42.223192141 +0000 UTC m=+197.077348359 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/89ebb4ed-a80f-4b9c-9dd1-71bd2d13aeec-samples-operator-tls") pod "cluster-samples-operator-854f8b96b6-xl9mj" (UID: "89ebb4ed-a80f-4b9c-9dd1-71bd2d13aeec") : secret "samples-operator-tls" not found Jun 09 15:04:34.395534 ip-10-0-133-239 kubenswrapper[2576]: I0609 15:04:34.395495 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-7s82g_539bda9e-91a8-417f-91ff-8ccd3219cfd1/serve-healthcheck-canary/0.log" Jun 09 15:04:36.708056 ip-10-0-133-239 kubenswrapper[2576]: I0609 15:04:36.708023 2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console-operator/console-operator-668fdbf85c-wmg5x" Jun 09 15:04:36.708448 ip-10-0-133-239 kubenswrapper[2576]: I0609 15:04:36.708120 2576 kubelet.go:2654] "SyncLoop (probe)" probe="liveness" status="unhealthy" pod="openshift-console-operator/console-operator-668fdbf85c-wmg5x" Jun 09 15:04:36.708448 ip-10-0-133-239 kubenswrapper[2576]: I0609 15:04:36.708428 2576 scope.go:117] "RemoveContainer" containerID="10e9dee1642eaa8ff9a33b3931c3dddc47e0df26ad3423feff8a0e4c813035ca" Jun 09 15:04:36.708583 ip-10-0-133-239 kubenswrapper[2576]: E0609 15:04:36.708562 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"console-operator\" with CrashLoopBackOff: \"back-off 10s restarting failed container=console-operator pod=console-operator-668fdbf85c-wmg5x_openshift-console-operator(37922842-1a2e-44d7-861f-edca166e718b)\"" pod="openshift-console-operator/console-operator-668fdbf85c-wmg5x" podUID="37922842-1a2e-44d7-861f-edca166e718b" Jun 09 15:04:42.185732 ip-10-0-133-239 kubenswrapper[2576]: I0609 15:04:42.185682 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/739fbbc7-e701-4fac-8903-5f6a0d03ecb1-networking-console-plugin-cert\") pod \"networking-console-plugin-d5d5bb78b-jlv7n\" (UID: \"739fbbc7-e701-4fac-8903-5f6a0d03ecb1\") " pod="openshift-network-console/networking-console-plugin-d5d5bb78b-jlv7n" Jun 09 15:04:42.186181 ip-10-0-133-239 kubenswrapper[2576]: I0609 15:04:42.185751 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/7d51209c-a257-422b-b29a-87eb78afc8d9-metrics-certs\") pod \"router-default-6f8c669b97-fzsft\" (UID: \"7d51209c-a257-422b-b29a-87eb78afc8d9\") " pod="openshift-ingress/router-default-6f8c669b97-fzsft" Jun 09 15:04:42.186181 ip-10-0-133-239 kubenswrapper[2576]: I0609 15:04:42.185776 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/7d51209c-a257-422b-b29a-87eb78afc8d9-service-ca-bundle\") pod \"router-default-6f8c669b97-fzsft\" (UID: \"7d51209c-a257-422b-b29a-87eb78afc8d9\") " pod="openshift-ingress/router-default-6f8c669b97-fzsft" Jun 09 15:04:42.186181 ip-10-0-133-239 kubenswrapper[2576]: E0609 15:04:42.185843 2576 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found Jun 09 15:04:42.186181 ip-10-0-133-239 kubenswrapper[2576]: E0609 15:04:42.185890 2576 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found Jun 09 15:04:42.186181 ip-10-0-133-239 kubenswrapper[2576]: E0609 15:04:42.185913 2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/7d51209c-a257-422b-b29a-87eb78afc8d9-service-ca-bundle podName:7d51209c-a257-422b-b29a-87eb78afc8d9 nodeName:}" failed. No retries permitted until 2026-06-09 15:04:58.185899965 +0000 UTC m=+213.040056181 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/7d51209c-a257-422b-b29a-87eb78afc8d9-service-ca-bundle") pod "router-default-6f8c669b97-fzsft" (UID: "7d51209c-a257-422b-b29a-87eb78afc8d9") : configmap references non-existent config key: service-ca.crt Jun 09 15:04:42.186181 ip-10-0-133-239 kubenswrapper[2576]: E0609 15:04:42.185935 2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/7d51209c-a257-422b-b29a-87eb78afc8d9-metrics-certs podName:7d51209c-a257-422b-b29a-87eb78afc8d9 nodeName:}" failed. No retries permitted until 2026-06-09 15:04:58.185919904 +0000 UTC m=+213.040076130 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/7d51209c-a257-422b-b29a-87eb78afc8d9-metrics-certs") pod "router-default-6f8c669b97-fzsft" (UID: "7d51209c-a257-422b-b29a-87eb78afc8d9") : secret "router-metrics-certs-default" not found Jun 09 15:04:42.186181 ip-10-0-133-239 kubenswrapper[2576]: E0609 15:04:42.185955 2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/739fbbc7-e701-4fac-8903-5f6a0d03ecb1-networking-console-plugin-cert podName:739fbbc7-e701-4fac-8903-5f6a0d03ecb1 nodeName:}" failed. No retries permitted until 2026-06-09 15:04:58.185946386 +0000 UTC m=+213.040102606 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/739fbbc7-e701-4fac-8903-5f6a0d03ecb1-networking-console-plugin-cert") pod "networking-console-plugin-d5d5bb78b-jlv7n" (UID: "739fbbc7-e701-4fac-8903-5f6a0d03ecb1") : secret "networking-console-plugin-cert" not found Jun 09 15:04:42.287146 ip-10-0-133-239 kubenswrapper[2576]: I0609 15:04:42.287108 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/89ebb4ed-a80f-4b9c-9dd1-71bd2d13aeec-samples-operator-tls\") pod \"cluster-samples-operator-854f8b96b6-xl9mj\" (UID: \"89ebb4ed-a80f-4b9c-9dd1-71bd2d13aeec\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-854f8b96b6-xl9mj" Jun 09 15:04:42.287320 ip-10-0-133-239 kubenswrapper[2576]: I0609 15:04:42.287216 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/ae8018cf-563e-4d3e-a432-ad1d33fb5496-registry-tls\") pod \"image-registry-7fdd896478-qmlv4\" (UID: \"ae8018cf-563e-4d3e-a432-ad1d33fb5496\") " pod="openshift-image-registry/image-registry-7fdd896478-qmlv4" Jun 09 15:04:42.287364 ip-10-0-133-239 kubenswrapper[2576]: E0609 15:04:42.287339 2576 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jun 09 15:04:42.287364 ip-10-0-133-239 kubenswrapper[2576]: E0609 15:04:42.287352 2576 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-7fdd896478-qmlv4: secret "image-registry-tls" not found Jun 09 15:04:42.287432 ip-10-0-133-239 kubenswrapper[2576]: E0609 15:04:42.287403 2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/ae8018cf-563e-4d3e-a432-ad1d33fb5496-registry-tls podName:ae8018cf-563e-4d3e-a432-ad1d33fb5496 nodeName:}" failed. No retries permitted until 2026-06-09 15:04:58.287384392 +0000 UTC m=+213.141540631 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/ae8018cf-563e-4d3e-a432-ad1d33fb5496-registry-tls") pod "image-registry-7fdd896478-qmlv4" (UID: "ae8018cf-563e-4d3e-a432-ad1d33fb5496") : secret "image-registry-tls" not found Jun 09 15:04:42.289473 ip-10-0-133-239 kubenswrapper[2576]: I0609 15:04:42.289450 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/89ebb4ed-a80f-4b9c-9dd1-71bd2d13aeec-samples-operator-tls\") pod \"cluster-samples-operator-854f8b96b6-xl9mj\" (UID: \"89ebb4ed-a80f-4b9c-9dd1-71bd2d13aeec\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-854f8b96b6-xl9mj" Jun 09 15:04:42.390005 ip-10-0-133-239 kubenswrapper[2576]: I0609 15:04:42.389974 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-samples-operator/cluster-samples-operator-854f8b96b6-xl9mj" Jun 09 15:04:42.506462 ip-10-0-133-239 kubenswrapper[2576]: I0609 15:04:42.506431 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-cluster-samples-operator/cluster-samples-operator-854f8b96b6-xl9mj"] Jun 09 15:04:43.208373 ip-10-0-133-239 kubenswrapper[2576]: I0609 15:04:43.208342 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-samples-operator/cluster-samples-operator-854f8b96b6-xl9mj" event={"ID":"89ebb4ed-a80f-4b9c-9dd1-71bd2d13aeec","Type":"ContainerStarted","Data":"593a9848c52e9ef537bd2ca7b6f1691b372502c03c2f2b41433729644f16359f"} Jun 09 15:04:45.216381 ip-10-0-133-239 kubenswrapper[2576]: I0609 15:04:45.216343 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-samples-operator/cluster-samples-operator-854f8b96b6-xl9mj" event={"ID":"89ebb4ed-a80f-4b9c-9dd1-71bd2d13aeec","Type":"ContainerStarted","Data":"1507c17f40a2d655b826858542410b146efcd554b581382c7537d57db84b0fa1"} Jun 09 15:04:45.216731 ip-10-0-133-239 kubenswrapper[2576]: I0609 15:04:45.216407 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-samples-operator/cluster-samples-operator-854f8b96b6-xl9mj" event={"ID":"89ebb4ed-a80f-4b9c-9dd1-71bd2d13aeec","Type":"ContainerStarted","Data":"2a199c34055eb97481f993081a86907cae92ebe53b4e4491f47b3c8e9bc74b6b"} Jun 09 15:04:45.239874 ip-10-0-133-239 kubenswrapper[2576]: I0609 15:04:45.239819 2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-samples-operator/cluster-samples-operator-854f8b96b6-xl9mj" podStartSLOduration=17.227881816 podStartE2EDuration="19.239806287s" totalImagesPullingTime="2.011924471s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-09 15:04:26 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-09 15:04:45.238428905 +0000 UTC m=+200.092585163" watchObservedRunningTime="2026-06-09 15:04:45.239806287 +0000 UTC m=+200.093962554" Jun 09 15:04:47.598493 ip-10-0-133-239 kubenswrapper[2576]: I0609 15:04:47.598456 2576 scope.go:117] "RemoveContainer" containerID="10e9dee1642eaa8ff9a33b3931c3dddc47e0df26ad3423feff8a0e4c813035ca" Jun 09 15:04:48.225723 ip-10-0-133-239 kubenswrapper[2576]: I0609 15:04:48.225696 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-668fdbf85c-wmg5x_37922842-1a2e-44d7-861f-edca166e718b/console-operator/2.log" Jun 09 15:04:48.226103 ip-10-0-133-239 kubenswrapper[2576]: I0609 15:04:48.226089 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-668fdbf85c-wmg5x_37922842-1a2e-44d7-861f-edca166e718b/console-operator/1.log" Jun 09 15:04:48.226155 ip-10-0-133-239 kubenswrapper[2576]: I0609 15:04:48.226120 2576 generic.go:356] "Generic (PLEG): container finished" podID="37922842-1a2e-44d7-861f-edca166e718b" containerID="71409b3a87ee8073a3bc1fff90579c77cd8412197dd189e2d33544d7adec7863" exitCode=255 Jun 09 15:04:48.226185 ip-10-0-133-239 kubenswrapper[2576]: I0609 15:04:48.226150 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-668fdbf85c-wmg5x" event={"ID":"37922842-1a2e-44d7-861f-edca166e718b","Type":"ContainerDied","Data":"71409b3a87ee8073a3bc1fff90579c77cd8412197dd189e2d33544d7adec7863"} Jun 09 15:04:48.226229 ip-10-0-133-239 kubenswrapper[2576]: I0609 15:04:48.226218 2576 scope.go:117] "RemoveContainer" containerID="10e9dee1642eaa8ff9a33b3931c3dddc47e0df26ad3423feff8a0e4c813035ca" Jun 09 15:04:48.226520 ip-10-0-133-239 kubenswrapper[2576]: I0609 15:04:48.226505 2576 scope.go:117] "RemoveContainer" containerID="71409b3a87ee8073a3bc1fff90579c77cd8412197dd189e2d33544d7adec7863" Jun 09 15:04:48.226672 ip-10-0-133-239 kubenswrapper[2576]: E0609 15:04:48.226655 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"console-operator\" with CrashLoopBackOff: \"back-off 20s restarting failed container=console-operator pod=console-operator-668fdbf85c-wmg5x_openshift-console-operator(37922842-1a2e-44d7-861f-edca166e718b)\"" pod="openshift-console-operator/console-operator-668fdbf85c-wmg5x" podUID="37922842-1a2e-44d7-861f-edca166e718b" Jun 09 15:04:49.230658 ip-10-0-133-239 kubenswrapper[2576]: I0609 15:04:49.230627 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-668fdbf85c-wmg5x_37922842-1a2e-44d7-861f-edca166e718b/console-operator/2.log" Jun 09 15:04:55.951044 ip-10-0-133-239 kubenswrapper[2576]: I0609 15:04:55.950999 2576 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-image-registry/image-registry-7fdd896478-qmlv4"] Jun 09 15:04:55.952218 ip-10-0-133-239 kubenswrapper[2576]: E0609 15:04:55.952177 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[registry-tls], unattached volumes=[], failed to process volumes=[]: context canceled" pod="openshift-image-registry/image-registry-7fdd896478-qmlv4" podUID="ae8018cf-563e-4d3e-a432-ad1d33fb5496" Jun 09 15:04:55.981981 ip-10-0-133-239 kubenswrapper[2576]: I0609 15:04:55.981956 2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-image-registry/image-registry-748c5bf95-tkxxb"] Jun 09 15:04:55.984810 ip-10-0-133-239 kubenswrapper[2576]: I0609 15:04:55.984793 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-748c5bf95-tkxxb" Jun 09 15:04:56.002220 ip-10-0-133-239 kubenswrapper[2576]: I0609 15:04:56.002200 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-748c5bf95-tkxxb"] Jun 09 15:04:56.005438 ip-10-0-133-239 kubenswrapper[2576]: I0609 15:04:56.005417 2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-insights/insights-runtime-extractor-5nnc4"] Jun 09 15:04:56.007711 ip-10-0-133-239 kubenswrapper[2576]: I0609 15:04:56.007693 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-5nnc4" Jun 09 15:04:56.011254 ip-10-0-133-239 kubenswrapper[2576]: I0609 15:04:56.011230 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-root-ca.crt\"" Jun 09 15:04:56.011370 ip-10-0-133-239 kubenswrapper[2576]: I0609 15:04:56.011329 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-sa-dockercfg-qhg89\"" Jun 09 15:04:56.011516 ip-10-0-133-239 kubenswrapper[2576]: I0609 15:04:56.011500 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"openshift-service-ca.crt\"" Jun 09 15:04:56.011986 ip-10-0-133-239 kubenswrapper[2576]: I0609 15:04:56.011971 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-tls\"" Jun 09 15:04:56.012692 ip-10-0-133-239 kubenswrapper[2576]: I0609 15:04:56.012676 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-rbac-proxy\"" Jun 09 15:04:56.023988 ip-10-0-133-239 kubenswrapper[2576]: I0609 15:04:56.023964 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-5nnc4"] Jun 09 15:04:56.101679 ip-10-0-133-239 kubenswrapper[2576]: I0609 15:04:56.101654 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/a0bcff7d-3e5b-4cdf-ad5c-73ce22659d3d-registry-certificates\") pod \"image-registry-748c5bf95-tkxxb\" (UID: \"a0bcff7d-3e5b-4cdf-ad5c-73ce22659d3d\") " pod="openshift-image-registry/image-registry-748c5bf95-tkxxb" Jun 09 15:04:56.101679 ip-10-0-133-239 kubenswrapper[2576]: I0609 15:04:56.101682 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/a0bcff7d-3e5b-4cdf-ad5c-73ce22659d3d-trusted-ca\") pod \"image-registry-748c5bf95-tkxxb\" (UID: \"a0bcff7d-3e5b-4cdf-ad5c-73ce22659d3d\") " pod="openshift-image-registry/image-registry-748c5bf95-tkxxb" Jun 09 15:04:56.101850 ip-10-0-133-239 kubenswrapper[2576]: I0609 15:04:56.101701 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/68871c9a-6546-44db-b2bd-89e2857697a9-crio-socket\") pod \"insights-runtime-extractor-5nnc4\" (UID: \"68871c9a-6546-44db-b2bd-89e2857697a9\") " pod="openshift-insights/insights-runtime-extractor-5nnc4" Jun 09 15:04:56.101850 ip-10-0-133-239 kubenswrapper[2576]: I0609 15:04:56.101726 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/68871c9a-6546-44db-b2bd-89e2857697a9-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-5nnc4\" (UID: \"68871c9a-6546-44db-b2bd-89e2857697a9\") " pod="openshift-insights/insights-runtime-extractor-5nnc4" Jun 09 15:04:56.101850 ip-10-0-133-239 kubenswrapper[2576]: I0609 15:04:56.101754 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/a0bcff7d-3e5b-4cdf-ad5c-73ce22659d3d-image-registry-private-configuration\") pod \"image-registry-748c5bf95-tkxxb\" (UID: \"a0bcff7d-3e5b-4cdf-ad5c-73ce22659d3d\") " pod="openshift-image-registry/image-registry-748c5bf95-tkxxb" Jun 09 15:04:56.101850 ip-10-0-133-239 kubenswrapper[2576]: I0609 15:04:56.101788 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/a0bcff7d-3e5b-4cdf-ad5c-73ce22659d3d-registry-tls\") pod \"image-registry-748c5bf95-tkxxb\" (UID: \"a0bcff7d-3e5b-4cdf-ad5c-73ce22659d3d\") " pod="openshift-image-registry/image-registry-748c5bf95-tkxxb" Jun 09 15:04:56.101850 ip-10-0-133-239 kubenswrapper[2576]: I0609 15:04:56.101803 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/a0bcff7d-3e5b-4cdf-ad5c-73ce22659d3d-bound-sa-token\") pod \"image-registry-748c5bf95-tkxxb\" (UID: \"a0bcff7d-3e5b-4cdf-ad5c-73ce22659d3d\") " pod="openshift-image-registry/image-registry-748c5bf95-tkxxb" Jun 09 15:04:56.101850 ip-10-0-133-239 kubenswrapper[2576]: I0609 15:04:56.101848 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2zz7v\" (UniqueName: \"kubernetes.io/projected/a0bcff7d-3e5b-4cdf-ad5c-73ce22659d3d-kube-api-access-2zz7v\") pod \"image-registry-748c5bf95-tkxxb\" (UID: \"a0bcff7d-3e5b-4cdf-ad5c-73ce22659d3d\") " pod="openshift-image-registry/image-registry-748c5bf95-tkxxb" Jun 09 15:04:56.102029 ip-10-0-133-239 kubenswrapper[2576]: I0609 15:04:56.101874 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/68871c9a-6546-44db-b2bd-89e2857697a9-data-volume\") pod \"insights-runtime-extractor-5nnc4\" (UID: \"68871c9a-6546-44db-b2bd-89e2857697a9\") " pod="openshift-insights/insights-runtime-extractor-5nnc4" Jun 09 15:04:56.102029 ip-10-0-133-239 kubenswrapper[2576]: I0609 15:04:56.101888 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/a0bcff7d-3e5b-4cdf-ad5c-73ce22659d3d-installation-pull-secrets\") pod \"image-registry-748c5bf95-tkxxb\" (UID: \"a0bcff7d-3e5b-4cdf-ad5c-73ce22659d3d\") " pod="openshift-image-registry/image-registry-748c5bf95-tkxxb" Jun 09 15:04:56.102029 ip-10-0-133-239 kubenswrapper[2576]: I0609 15:04:56.101974 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/68871c9a-6546-44db-b2bd-89e2857697a9-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-5nnc4\" (UID: \"68871c9a-6546-44db-b2bd-89e2857697a9\") " pod="openshift-insights/insights-runtime-extractor-5nnc4" Jun 09 15:04:56.102029 ip-10-0-133-239 kubenswrapper[2576]: I0609 15:04:56.102006 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-n4n2v\" (UniqueName: \"kubernetes.io/projected/68871c9a-6546-44db-b2bd-89e2857697a9-kube-api-access-n4n2v\") pod \"insights-runtime-extractor-5nnc4\" (UID: \"68871c9a-6546-44db-b2bd-89e2857697a9\") " pod="openshift-insights/insights-runtime-extractor-5nnc4" Jun 09 15:04:56.102165 ip-10-0-133-239 kubenswrapper[2576]: I0609 15:04:56.102029 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/a0bcff7d-3e5b-4cdf-ad5c-73ce22659d3d-ca-trust-extracted\") pod \"image-registry-748c5bf95-tkxxb\" (UID: \"a0bcff7d-3e5b-4cdf-ad5c-73ce22659d3d\") " pod="openshift-image-registry/image-registry-748c5bf95-tkxxb" Jun 09 15:04:56.202932 ip-10-0-133-239 kubenswrapper[2576]: I0609 15:04:56.202844 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/68871c9a-6546-44db-b2bd-89e2857697a9-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-5nnc4\" (UID: \"68871c9a-6546-44db-b2bd-89e2857697a9\") " pod="openshift-insights/insights-runtime-extractor-5nnc4" Jun 09 15:04:56.202932 ip-10-0-133-239 kubenswrapper[2576]: I0609 15:04:56.202884 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-n4n2v\" (UniqueName: \"kubernetes.io/projected/68871c9a-6546-44db-b2bd-89e2857697a9-kube-api-access-n4n2v\") pod \"insights-runtime-extractor-5nnc4\" (UID: \"68871c9a-6546-44db-b2bd-89e2857697a9\") " pod="openshift-insights/insights-runtime-extractor-5nnc4" Jun 09 15:04:56.202932 ip-10-0-133-239 kubenswrapper[2576]: I0609 15:04:56.202903 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/a0bcff7d-3e5b-4cdf-ad5c-73ce22659d3d-ca-trust-extracted\") pod \"image-registry-748c5bf95-tkxxb\" (UID: \"a0bcff7d-3e5b-4cdf-ad5c-73ce22659d3d\") " pod="openshift-image-registry/image-registry-748c5bf95-tkxxb" Jun 09 15:04:56.202932 ip-10-0-133-239 kubenswrapper[2576]: I0609 15:04:56.202924 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/a0bcff7d-3e5b-4cdf-ad5c-73ce22659d3d-registry-certificates\") pod \"image-registry-748c5bf95-tkxxb\" (UID: \"a0bcff7d-3e5b-4cdf-ad5c-73ce22659d3d\") " pod="openshift-image-registry/image-registry-748c5bf95-tkxxb" Jun 09 15:04:56.203268 ip-10-0-133-239 kubenswrapper[2576]: I0609 15:04:56.202949 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/a0bcff7d-3e5b-4cdf-ad5c-73ce22659d3d-trusted-ca\") pod \"image-registry-748c5bf95-tkxxb\" (UID: \"a0bcff7d-3e5b-4cdf-ad5c-73ce22659d3d\") " pod="openshift-image-registry/image-registry-748c5bf95-tkxxb" Jun 09 15:04:56.203268 ip-10-0-133-239 kubenswrapper[2576]: I0609 15:04:56.202974 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/68871c9a-6546-44db-b2bd-89e2857697a9-crio-socket\") pod \"insights-runtime-extractor-5nnc4\" (UID: \"68871c9a-6546-44db-b2bd-89e2857697a9\") " pod="openshift-insights/insights-runtime-extractor-5nnc4" Jun 09 15:04:56.203268 ip-10-0-133-239 kubenswrapper[2576]: I0609 15:04:56.203006 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/68871c9a-6546-44db-b2bd-89e2857697a9-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-5nnc4\" (UID: \"68871c9a-6546-44db-b2bd-89e2857697a9\") " pod="openshift-insights/insights-runtime-extractor-5nnc4" Jun 09 15:04:56.203268 ip-10-0-133-239 kubenswrapper[2576]: I0609 15:04:56.203029 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/a0bcff7d-3e5b-4cdf-ad5c-73ce22659d3d-image-registry-private-configuration\") pod \"image-registry-748c5bf95-tkxxb\" (UID: \"a0bcff7d-3e5b-4cdf-ad5c-73ce22659d3d\") " pod="openshift-image-registry/image-registry-748c5bf95-tkxxb" Jun 09 15:04:56.203268 ip-10-0-133-239 kubenswrapper[2576]: I0609 15:04:56.203095 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/a0bcff7d-3e5b-4cdf-ad5c-73ce22659d3d-registry-tls\") pod \"image-registry-748c5bf95-tkxxb\" (UID: \"a0bcff7d-3e5b-4cdf-ad5c-73ce22659d3d\") " pod="openshift-image-registry/image-registry-748c5bf95-tkxxb" Jun 09 15:04:56.203268 ip-10-0-133-239 kubenswrapper[2576]: I0609 15:04:56.203119 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/a0bcff7d-3e5b-4cdf-ad5c-73ce22659d3d-bound-sa-token\") pod \"image-registry-748c5bf95-tkxxb\" (UID: \"a0bcff7d-3e5b-4cdf-ad5c-73ce22659d3d\") " pod="openshift-image-registry/image-registry-748c5bf95-tkxxb" Jun 09 15:04:56.203268 ip-10-0-133-239 kubenswrapper[2576]: I0609 15:04:56.203129 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/68871c9a-6546-44db-b2bd-89e2857697a9-crio-socket\") pod \"insights-runtime-extractor-5nnc4\" (UID: \"68871c9a-6546-44db-b2bd-89e2857697a9\") " pod="openshift-insights/insights-runtime-extractor-5nnc4" Jun 09 15:04:56.203268 ip-10-0-133-239 kubenswrapper[2576]: I0609 15:04:56.203165 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2zz7v\" (UniqueName: \"kubernetes.io/projected/a0bcff7d-3e5b-4cdf-ad5c-73ce22659d3d-kube-api-access-2zz7v\") pod \"image-registry-748c5bf95-tkxxb\" (UID: \"a0bcff7d-3e5b-4cdf-ad5c-73ce22659d3d\") " pod="openshift-image-registry/image-registry-748c5bf95-tkxxb" Jun 09 15:04:56.203268 ip-10-0-133-239 kubenswrapper[2576]: I0609 15:04:56.203201 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/68871c9a-6546-44db-b2bd-89e2857697a9-data-volume\") pod \"insights-runtime-extractor-5nnc4\" (UID: \"68871c9a-6546-44db-b2bd-89e2857697a9\") " pod="openshift-insights/insights-runtime-extractor-5nnc4" Jun 09 15:04:56.203268 ip-10-0-133-239 kubenswrapper[2576]: I0609 15:04:56.203225 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/a0bcff7d-3e5b-4cdf-ad5c-73ce22659d3d-installation-pull-secrets\") pod \"image-registry-748c5bf95-tkxxb\" (UID: \"a0bcff7d-3e5b-4cdf-ad5c-73ce22659d3d\") " pod="openshift-image-registry/image-registry-748c5bf95-tkxxb" Jun 09 15:04:56.203812 ip-10-0-133-239 kubenswrapper[2576]: I0609 15:04:56.203473 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/68871c9a-6546-44db-b2bd-89e2857697a9-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-5nnc4\" (UID: \"68871c9a-6546-44db-b2bd-89e2857697a9\") " pod="openshift-insights/insights-runtime-extractor-5nnc4" Jun 09 15:04:56.203812 ip-10-0-133-239 kubenswrapper[2576]: I0609 15:04:56.203685 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/a0bcff7d-3e5b-4cdf-ad5c-73ce22659d3d-ca-trust-extracted\") pod \"image-registry-748c5bf95-tkxxb\" (UID: \"a0bcff7d-3e5b-4cdf-ad5c-73ce22659d3d\") " pod="openshift-image-registry/image-registry-748c5bf95-tkxxb" Jun 09 15:04:56.203915 ip-10-0-133-239 kubenswrapper[2576]: I0609 15:04:56.203849 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/68871c9a-6546-44db-b2bd-89e2857697a9-data-volume\") pod \"insights-runtime-extractor-5nnc4\" (UID: \"68871c9a-6546-44db-b2bd-89e2857697a9\") " pod="openshift-insights/insights-runtime-extractor-5nnc4" Jun 09 15:04:56.204194 ip-10-0-133-239 kubenswrapper[2576]: I0609 15:04:56.204168 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/a0bcff7d-3e5b-4cdf-ad5c-73ce22659d3d-registry-certificates\") pod \"image-registry-748c5bf95-tkxxb\" (UID: \"a0bcff7d-3e5b-4cdf-ad5c-73ce22659d3d\") " pod="openshift-image-registry/image-registry-748c5bf95-tkxxb" Jun 09 15:04:56.204529 ip-10-0-133-239 kubenswrapper[2576]: I0609 15:04:56.204506 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/a0bcff7d-3e5b-4cdf-ad5c-73ce22659d3d-trusted-ca\") pod \"image-registry-748c5bf95-tkxxb\" (UID: \"a0bcff7d-3e5b-4cdf-ad5c-73ce22659d3d\") " pod="openshift-image-registry/image-registry-748c5bf95-tkxxb" Jun 09 15:04:56.205711 ip-10-0-133-239 kubenswrapper[2576]: I0609 15:04:56.205685 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/68871c9a-6546-44db-b2bd-89e2857697a9-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-5nnc4\" (UID: \"68871c9a-6546-44db-b2bd-89e2857697a9\") " pod="openshift-insights/insights-runtime-extractor-5nnc4" Jun 09 15:04:56.206096 ip-10-0-133-239 kubenswrapper[2576]: I0609 15:04:56.206076 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/a0bcff7d-3e5b-4cdf-ad5c-73ce22659d3d-installation-pull-secrets\") pod \"image-registry-748c5bf95-tkxxb\" (UID: \"a0bcff7d-3e5b-4cdf-ad5c-73ce22659d3d\") " pod="openshift-image-registry/image-registry-748c5bf95-tkxxb" Jun 09 15:04:56.206192 ip-10-0-133-239 kubenswrapper[2576]: I0609 15:04:56.206111 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/a0bcff7d-3e5b-4cdf-ad5c-73ce22659d3d-image-registry-private-configuration\") pod \"image-registry-748c5bf95-tkxxb\" (UID: \"a0bcff7d-3e5b-4cdf-ad5c-73ce22659d3d\") " pod="openshift-image-registry/image-registry-748c5bf95-tkxxb" Jun 09 15:04:56.206192 ip-10-0-133-239 kubenswrapper[2576]: I0609 15:04:56.206154 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/a0bcff7d-3e5b-4cdf-ad5c-73ce22659d3d-registry-tls\") pod \"image-registry-748c5bf95-tkxxb\" (UID: \"a0bcff7d-3e5b-4cdf-ad5c-73ce22659d3d\") " pod="openshift-image-registry/image-registry-748c5bf95-tkxxb" Jun 09 15:04:56.214759 ip-10-0-133-239 kubenswrapper[2576]: I0609 15:04:56.214735 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/a0bcff7d-3e5b-4cdf-ad5c-73ce22659d3d-bound-sa-token\") pod \"image-registry-748c5bf95-tkxxb\" (UID: \"a0bcff7d-3e5b-4cdf-ad5c-73ce22659d3d\") " pod="openshift-image-registry/image-registry-748c5bf95-tkxxb" Jun 09 15:04:56.223061 ip-10-0-133-239 kubenswrapper[2576]: I0609 15:04:56.223039 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-2zz7v\" (UniqueName: \"kubernetes.io/projected/a0bcff7d-3e5b-4cdf-ad5c-73ce22659d3d-kube-api-access-2zz7v\") pod \"image-registry-748c5bf95-tkxxb\" (UID: \"a0bcff7d-3e5b-4cdf-ad5c-73ce22659d3d\") " pod="openshift-image-registry/image-registry-748c5bf95-tkxxb" Jun 09 15:04:56.223152 ip-10-0-133-239 kubenswrapper[2576]: I0609 15:04:56.223118 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-n4n2v\" (UniqueName: \"kubernetes.io/projected/68871c9a-6546-44db-b2bd-89e2857697a9-kube-api-access-n4n2v\") pod \"insights-runtime-extractor-5nnc4\" (UID: \"68871c9a-6546-44db-b2bd-89e2857697a9\") " pod="openshift-insights/insights-runtime-extractor-5nnc4" Jun 09 15:04:56.251410 ip-10-0-133-239 kubenswrapper[2576]: I0609 15:04:56.251387 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-7fdd896478-qmlv4" Jun 09 15:04:56.257384 ip-10-0-133-239 kubenswrapper[2576]: I0609 15:04:56.257368 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-7fdd896478-qmlv4" Jun 09 15:04:56.294815 ip-10-0-133-239 kubenswrapper[2576]: I0609 15:04:56.294791 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-748c5bf95-tkxxb" Jun 09 15:04:56.315852 ip-10-0-133-239 kubenswrapper[2576]: I0609 15:04:56.315831 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-5nnc4" Jun 09 15:04:56.404600 ip-10-0-133-239 kubenswrapper[2576]: I0609 15:04:56.404575 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/ae8018cf-563e-4d3e-a432-ad1d33fb5496-image-registry-private-configuration\") pod \"ae8018cf-563e-4d3e-a432-ad1d33fb5496\" (UID: \"ae8018cf-563e-4d3e-a432-ad1d33fb5496\") " Jun 09 15:04:56.404733 ip-10-0-133-239 kubenswrapper[2576]: I0609 15:04:56.404635 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/ae8018cf-563e-4d3e-a432-ad1d33fb5496-bound-sa-token\") pod \"ae8018cf-563e-4d3e-a432-ad1d33fb5496\" (UID: \"ae8018cf-563e-4d3e-a432-ad1d33fb5496\") " Jun 09 15:04:56.404733 ip-10-0-133-239 kubenswrapper[2576]: I0609 15:04:56.404664 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/ae8018cf-563e-4d3e-a432-ad1d33fb5496-registry-certificates\") pod \"ae8018cf-563e-4d3e-a432-ad1d33fb5496\" (UID: \"ae8018cf-563e-4d3e-a432-ad1d33fb5496\") " Jun 09 15:04:56.404733 ip-10-0-133-239 kubenswrapper[2576]: I0609 15:04:56.404700 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-w4bm2\" (UniqueName: \"kubernetes.io/projected/ae8018cf-563e-4d3e-a432-ad1d33fb5496-kube-api-access-w4bm2\") pod \"ae8018cf-563e-4d3e-a432-ad1d33fb5496\" (UID: \"ae8018cf-563e-4d3e-a432-ad1d33fb5496\") " Jun 09 15:04:56.404733 ip-10-0-133-239 kubenswrapper[2576]: I0609 15:04:56.404725 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/ae8018cf-563e-4d3e-a432-ad1d33fb5496-installation-pull-secrets\") pod \"ae8018cf-563e-4d3e-a432-ad1d33fb5496\" (UID: \"ae8018cf-563e-4d3e-a432-ad1d33fb5496\") " Jun 09 15:04:56.404926 ip-10-0-133-239 kubenswrapper[2576]: I0609 15:04:56.404765 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/ae8018cf-563e-4d3e-a432-ad1d33fb5496-trusted-ca\") pod \"ae8018cf-563e-4d3e-a432-ad1d33fb5496\" (UID: \"ae8018cf-563e-4d3e-a432-ad1d33fb5496\") " Jun 09 15:04:56.404926 ip-10-0-133-239 kubenswrapper[2576]: I0609 15:04:56.404844 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/ae8018cf-563e-4d3e-a432-ad1d33fb5496-ca-trust-extracted\") pod \"ae8018cf-563e-4d3e-a432-ad1d33fb5496\" (UID: \"ae8018cf-563e-4d3e-a432-ad1d33fb5496\") " Jun 09 15:04:56.405115 ip-10-0-133-239 kubenswrapper[2576]: I0609 15:04:56.405060 2576 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/ae8018cf-563e-4d3e-a432-ad1d33fb5496-registry-certificates" (OuterVolumeSpecName: "registry-certificates") pod "ae8018cf-563e-4d3e-a432-ad1d33fb5496" (UID: "ae8018cf-563e-4d3e-a432-ad1d33fb5496"). InnerVolumeSpecName "registry-certificates". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 09 15:04:56.405348 ip-10-0-133-239 kubenswrapper[2576]: I0609 15:04:56.405320 2576 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/ae8018cf-563e-4d3e-a432-ad1d33fb5496-ca-trust-extracted" (OuterVolumeSpecName: "ca-trust-extracted") pod "ae8018cf-563e-4d3e-a432-ad1d33fb5496" (UID: "ae8018cf-563e-4d3e-a432-ad1d33fb5496"). InnerVolumeSpecName "ca-trust-extracted". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 09 15:04:56.405460 ip-10-0-133-239 kubenswrapper[2576]: I0609 15:04:56.405373 2576 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/ae8018cf-563e-4d3e-a432-ad1d33fb5496-trusted-ca" (OuterVolumeSpecName: "trusted-ca") pod "ae8018cf-563e-4d3e-a432-ad1d33fb5496" (UID: "ae8018cf-563e-4d3e-a432-ad1d33fb5496"). InnerVolumeSpecName "trusted-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 09 15:04:56.407899 ip-10-0-133-239 kubenswrapper[2576]: I0609 15:04:56.407877 2576 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/ae8018cf-563e-4d3e-a432-ad1d33fb5496-kube-api-access-w4bm2" (OuterVolumeSpecName: "kube-api-access-w4bm2") pod "ae8018cf-563e-4d3e-a432-ad1d33fb5496" (UID: "ae8018cf-563e-4d3e-a432-ad1d33fb5496"). InnerVolumeSpecName "kube-api-access-w4bm2". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 09 15:04:56.408013 ip-10-0-133-239 kubenswrapper[2576]: I0609 15:04:56.407996 2576 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/ae8018cf-563e-4d3e-a432-ad1d33fb5496-bound-sa-token" (OuterVolumeSpecName: "bound-sa-token") pod "ae8018cf-563e-4d3e-a432-ad1d33fb5496" (UID: "ae8018cf-563e-4d3e-a432-ad1d33fb5496"). InnerVolumeSpecName "bound-sa-token". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 09 15:04:56.408082 ip-10-0-133-239 kubenswrapper[2576]: I0609 15:04:56.407996 2576 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/ae8018cf-563e-4d3e-a432-ad1d33fb5496-installation-pull-secrets" (OuterVolumeSpecName: "installation-pull-secrets") pod "ae8018cf-563e-4d3e-a432-ad1d33fb5496" (UID: "ae8018cf-563e-4d3e-a432-ad1d33fb5496"). InnerVolumeSpecName "installation-pull-secrets". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 09 15:04:56.408253 ip-10-0-133-239 kubenswrapper[2576]: I0609 15:04:56.408227 2576 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/ae8018cf-563e-4d3e-a432-ad1d33fb5496-image-registry-private-configuration" (OuterVolumeSpecName: "image-registry-private-configuration") pod "ae8018cf-563e-4d3e-a432-ad1d33fb5496" (UID: "ae8018cf-563e-4d3e-a432-ad1d33fb5496"). InnerVolumeSpecName "image-registry-private-configuration". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 09 15:04:56.421617 ip-10-0-133-239 kubenswrapper[2576]: I0609 15:04:56.421594 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-748c5bf95-tkxxb"] Jun 09 15:04:56.424801 ip-10-0-133-239 kubenswrapper[2576]: W0609 15:04:56.424776 2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda0bcff7d_3e5b_4cdf_ad5c_73ce22659d3d.slice/crio-5e67587600824933930f7e579a05dfc7ef2d0d373fd244503f24e25b43da15c2 WatchSource:0}: Error finding container 5e67587600824933930f7e579a05dfc7ef2d0d373fd244503f24e25b43da15c2: Status 404 returned error can't find the container with id 5e67587600824933930f7e579a05dfc7ef2d0d373fd244503f24e25b43da15c2 Jun 09 15:04:56.443432 ip-10-0-133-239 kubenswrapper[2576]: I0609 15:04:56.443411 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-5nnc4"] Jun 09 15:04:56.456060 ip-10-0-133-239 kubenswrapper[2576]: W0609 15:04:56.456029 2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod68871c9a_6546_44db_b2bd_89e2857697a9.slice/crio-d926598bec0e0d3a6b826504372f771fb40515558bb819cf41ad758f1afc74fe WatchSource:0}: Error finding container d926598bec0e0d3a6b826504372f771fb40515558bb819cf41ad758f1afc74fe: Status 404 returned error can't find the container with id d926598bec0e0d3a6b826504372f771fb40515558bb819cf41ad758f1afc74fe Jun 09 15:04:56.506517 ip-10-0-133-239 kubenswrapper[2576]: I0609 15:04:56.506481 2576 reconciler_common.go:299] "Volume detached for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/ae8018cf-563e-4d3e-a432-ad1d33fb5496-ca-trust-extracted\") on node \"ip-10-0-133-239.ec2.internal\" DevicePath \"\"" Jun 09 15:04:56.506623 ip-10-0-133-239 kubenswrapper[2576]: I0609 15:04:56.506522 2576 reconciler_common.go:299] "Volume detached for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/ae8018cf-563e-4d3e-a432-ad1d33fb5496-image-registry-private-configuration\") on node \"ip-10-0-133-239.ec2.internal\" DevicePath \"\"" Jun 09 15:04:56.506623 ip-10-0-133-239 kubenswrapper[2576]: I0609 15:04:56.506538 2576 reconciler_common.go:299] "Volume detached for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/ae8018cf-563e-4d3e-a432-ad1d33fb5496-bound-sa-token\") on node \"ip-10-0-133-239.ec2.internal\" DevicePath \"\"" Jun 09 15:04:56.506623 ip-10-0-133-239 kubenswrapper[2576]: I0609 15:04:56.506553 2576 reconciler_common.go:299] "Volume detached for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/ae8018cf-563e-4d3e-a432-ad1d33fb5496-registry-certificates\") on node \"ip-10-0-133-239.ec2.internal\" DevicePath \"\"" Jun 09 15:04:56.506623 ip-10-0-133-239 kubenswrapper[2576]: I0609 15:04:56.506567 2576 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-w4bm2\" (UniqueName: \"kubernetes.io/projected/ae8018cf-563e-4d3e-a432-ad1d33fb5496-kube-api-access-w4bm2\") on node \"ip-10-0-133-239.ec2.internal\" DevicePath \"\"" Jun 09 15:04:56.506623 ip-10-0-133-239 kubenswrapper[2576]: I0609 15:04:56.506580 2576 reconciler_common.go:299] "Volume detached for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/ae8018cf-563e-4d3e-a432-ad1d33fb5496-installation-pull-secrets\") on node \"ip-10-0-133-239.ec2.internal\" DevicePath \"\"" Jun 09 15:04:56.506623 ip-10-0-133-239 kubenswrapper[2576]: I0609 15:04:56.506594 2576 reconciler_common.go:299] "Volume detached for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/ae8018cf-563e-4d3e-a432-ad1d33fb5496-trusted-ca\") on node \"ip-10-0-133-239.ec2.internal\" DevicePath \"\"" Jun 09 15:04:56.708463 ip-10-0-133-239 kubenswrapper[2576]: I0609 15:04:56.708368 2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console-operator/console-operator-668fdbf85c-wmg5x" Jun 09 15:04:56.708463 ip-10-0-133-239 kubenswrapper[2576]: I0609 15:04:56.708432 2576 kubelet.go:2654] "SyncLoop (probe)" probe="liveness" status="unhealthy" pod="openshift-console-operator/console-operator-668fdbf85c-wmg5x" Jun 09 15:04:56.708774 ip-10-0-133-239 kubenswrapper[2576]: I0609 15:04:56.708759 2576 scope.go:117] "RemoveContainer" containerID="71409b3a87ee8073a3bc1fff90579c77cd8412197dd189e2d33544d7adec7863" Jun 09 15:04:56.708909 ip-10-0-133-239 kubenswrapper[2576]: E0609 15:04:56.708890 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"console-operator\" with CrashLoopBackOff: \"back-off 20s restarting failed container=console-operator pod=console-operator-668fdbf85c-wmg5x_openshift-console-operator(37922842-1a2e-44d7-861f-edca166e718b)\"" pod="openshift-console-operator/console-operator-668fdbf85c-wmg5x" podUID="37922842-1a2e-44d7-861f-edca166e718b" Jun 09 15:04:57.256115 ip-10-0-133-239 kubenswrapper[2576]: I0609 15:04:57.256015 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-5nnc4" event={"ID":"68871c9a-6546-44db-b2bd-89e2857697a9","Type":"ContainerStarted","Data":"6bcc97d2f2559dabd8d725d32f85d15860e16b118560e859a2d9e259ba9d1b77"} Jun 09 15:04:57.256115 ip-10-0-133-239 kubenswrapper[2576]: I0609 15:04:57.256091 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-5nnc4" event={"ID":"68871c9a-6546-44db-b2bd-89e2857697a9","Type":"ContainerStarted","Data":"d8a3ab3cddf67b33b3a53eddd36c303d29d90bcc605f0ed9710ab6fd8521dec2"} Jun 09 15:04:57.256115 ip-10-0-133-239 kubenswrapper[2576]: I0609 15:04:57.256113 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-5nnc4" event={"ID":"68871c9a-6546-44db-b2bd-89e2857697a9","Type":"ContainerStarted","Data":"d926598bec0e0d3a6b826504372f771fb40515558bb819cf41ad758f1afc74fe"} Jun 09 15:04:57.257389 ip-10-0-133-239 kubenswrapper[2576]: I0609 15:04:57.257370 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-7fdd896478-qmlv4" Jun 09 15:04:57.257481 ip-10-0-133-239 kubenswrapper[2576]: I0609 15:04:57.257388 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-748c5bf95-tkxxb" event={"ID":"a0bcff7d-3e5b-4cdf-ad5c-73ce22659d3d","Type":"ContainerStarted","Data":"e0a2b46534c228b0c874fc47e70a6c6464b36679d850ee01e9741f348b9c08d1"} Jun 09 15:04:57.257481 ip-10-0-133-239 kubenswrapper[2576]: I0609 15:04:57.257429 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-748c5bf95-tkxxb" event={"ID":"a0bcff7d-3e5b-4cdf-ad5c-73ce22659d3d","Type":"ContainerStarted","Data":"5e67587600824933930f7e579a05dfc7ef2d0d373fd244503f24e25b43da15c2"} Jun 09 15:04:57.257481 ip-10-0-133-239 kubenswrapper[2576]: I0609 15:04:57.257472 2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-image-registry/image-registry-748c5bf95-tkxxb" Jun 09 15:04:57.281121 ip-10-0-133-239 kubenswrapper[2576]: I0609 15:04:57.281058 2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/image-registry-748c5bf95-tkxxb" podStartSLOduration=2.281043028 podStartE2EDuration="2.281043028s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-09 15:04:55 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-09 15:04:57.28075835 +0000 UTC m=+212.134914588" watchObservedRunningTime="2026-06-09 15:04:57.281043028 +0000 UTC m=+212.135199266" Jun 09 15:04:57.309352 ip-10-0-133-239 kubenswrapper[2576]: I0609 15:04:57.309324 2576 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-image-registry/image-registry-7fdd896478-qmlv4"] Jun 09 15:04:57.315842 ip-10-0-133-239 kubenswrapper[2576]: I0609 15:04:57.315818 2576 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-image-registry/image-registry-7fdd896478-qmlv4"] Jun 09 15:04:57.416140 ip-10-0-133-239 kubenswrapper[2576]: I0609 15:04:57.415807 2576 reconciler_common.go:299] "Volume detached for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/ae8018cf-563e-4d3e-a432-ad1d33fb5496-registry-tls\") on node \"ip-10-0-133-239.ec2.internal\" DevicePath \"\"" Jun 09 15:04:57.602494 ip-10-0-133-239 kubenswrapper[2576]: I0609 15:04:57.602459 2576 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="ae8018cf-563e-4d3e-a432-ad1d33fb5496" path="/var/lib/kubelet/pods/ae8018cf-563e-4d3e-a432-ad1d33fb5496/volumes" Jun 09 15:04:58.223858 ip-10-0-133-239 kubenswrapper[2576]: I0609 15:04:58.223817 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/739fbbc7-e701-4fac-8903-5f6a0d03ecb1-networking-console-plugin-cert\") pod \"networking-console-plugin-d5d5bb78b-jlv7n\" (UID: \"739fbbc7-e701-4fac-8903-5f6a0d03ecb1\") " pod="openshift-network-console/networking-console-plugin-d5d5bb78b-jlv7n" Jun 09 15:04:58.224055 ip-10-0-133-239 kubenswrapper[2576]: I0609 15:04:58.223888 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/7d51209c-a257-422b-b29a-87eb78afc8d9-metrics-certs\") pod \"router-default-6f8c669b97-fzsft\" (UID: \"7d51209c-a257-422b-b29a-87eb78afc8d9\") " pod="openshift-ingress/router-default-6f8c669b97-fzsft" Jun 09 15:04:58.224055 ip-10-0-133-239 kubenswrapper[2576]: I0609 15:04:58.223925 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/7d51209c-a257-422b-b29a-87eb78afc8d9-service-ca-bundle\") pod \"router-default-6f8c669b97-fzsft\" (UID: \"7d51209c-a257-422b-b29a-87eb78afc8d9\") " pod="openshift-ingress/router-default-6f8c669b97-fzsft" Jun 09 15:04:58.224608 ip-10-0-133-239 kubenswrapper[2576]: I0609 15:04:58.224582 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/7d51209c-a257-422b-b29a-87eb78afc8d9-service-ca-bundle\") pod \"router-default-6f8c669b97-fzsft\" (UID: \"7d51209c-a257-422b-b29a-87eb78afc8d9\") " pod="openshift-ingress/router-default-6f8c669b97-fzsft" Jun 09 15:04:58.226824 ip-10-0-133-239 kubenswrapper[2576]: I0609 15:04:58.226803 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/7d51209c-a257-422b-b29a-87eb78afc8d9-metrics-certs\") pod \"router-default-6f8c669b97-fzsft\" (UID: \"7d51209c-a257-422b-b29a-87eb78afc8d9\") " pod="openshift-ingress/router-default-6f8c669b97-fzsft" Jun 09 15:04:58.226929 ip-10-0-133-239 kubenswrapper[2576]: I0609 15:04:58.226880 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/739fbbc7-e701-4fac-8903-5f6a0d03ecb1-networking-console-plugin-cert\") pod \"networking-console-plugin-d5d5bb78b-jlv7n\" (UID: \"739fbbc7-e701-4fac-8903-5f6a0d03ecb1\") " pod="openshift-network-console/networking-console-plugin-d5d5bb78b-jlv7n" Jun 09 15:04:58.512429 ip-10-0-133-239 kubenswrapper[2576]: I0609 15:04:58.512395 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-console/networking-console-plugin-d5d5bb78b-jlv7n" Jun 09 15:04:58.517623 ip-10-0-133-239 kubenswrapper[2576]: I0609 15:04:58.517595 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/router-default-6f8c669b97-fzsft" Jun 09 15:04:58.746380 ip-10-0-133-239 kubenswrapper[2576]: I0609 15:04:58.746360 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/router-default-6f8c669b97-fzsft"] Jun 09 15:04:58.749391 ip-10-0-133-239 kubenswrapper[2576]: W0609 15:04:58.749345 2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7d51209c_a257_422b_b29a_87eb78afc8d9.slice/crio-b1cb6f6bd77aa872ff1440f8b1ea5197ba9d6ca958343a905da7342ab5ac65cf WatchSource:0}: Error finding container b1cb6f6bd77aa872ff1440f8b1ea5197ba9d6ca958343a905da7342ab5ac65cf: Status 404 returned error can't find the container with id b1cb6f6bd77aa872ff1440f8b1ea5197ba9d6ca958343a905da7342ab5ac65cf Jun 09 15:04:58.759947 ip-10-0-133-239 kubenswrapper[2576]: I0609 15:04:58.759923 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-console/networking-console-plugin-d5d5bb78b-jlv7n"] Jun 09 15:04:58.762344 ip-10-0-133-239 kubenswrapper[2576]: W0609 15:04:58.762325 2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod739fbbc7_e701_4fac_8903_5f6a0d03ecb1.slice/crio-82bacd1c2e1a666358be5a1122c1050a009c1e40024a163c2c3e89c31956a06b WatchSource:0}: Error finding container 82bacd1c2e1a666358be5a1122c1050a009c1e40024a163c2c3e89c31956a06b: Status 404 returned error can't find the container with id 82bacd1c2e1a666358be5a1122c1050a009c1e40024a163c2c3e89c31956a06b Jun 09 15:04:59.267794 ip-10-0-133-239 kubenswrapper[2576]: I0609 15:04:59.267766 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-5nnc4" event={"ID":"68871c9a-6546-44db-b2bd-89e2857697a9","Type":"ContainerStarted","Data":"93dc40f2094ebf964560f6d0129303d72a061f880278a142d9b7fe2ee9d6104a"} Jun 09 15:04:59.269231 ip-10-0-133-239 kubenswrapper[2576]: I0609 15:04:59.269202 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/router-default-6f8c669b97-fzsft" event={"ID":"7d51209c-a257-422b-b29a-87eb78afc8d9","Type":"ContainerStarted","Data":"a63756c3ecd79b5e862bc15ec93b2a84f6293e8be8021f120bc9681abc834677"} Jun 09 15:04:59.269388 ip-10-0-133-239 kubenswrapper[2576]: I0609 15:04:59.269251 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/router-default-6f8c669b97-fzsft" event={"ID":"7d51209c-a257-422b-b29a-87eb78afc8d9","Type":"ContainerStarted","Data":"b1cb6f6bd77aa872ff1440f8b1ea5197ba9d6ca958343a905da7342ab5ac65cf"} Jun 09 15:04:59.270291 ip-10-0-133-239 kubenswrapper[2576]: I0609 15:04:59.270232 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-console/networking-console-plugin-d5d5bb78b-jlv7n" event={"ID":"739fbbc7-e701-4fac-8903-5f6a0d03ecb1","Type":"ContainerStarted","Data":"82bacd1c2e1a666358be5a1122c1050a009c1e40024a163c2c3e89c31956a06b"} Jun 09 15:04:59.284809 ip-10-0-133-239 kubenswrapper[2576]: I0609 15:04:59.284736 2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-insights/insights-runtime-extractor-5nnc4" podStartSLOduration=1.831822107 podStartE2EDuration="4.284723573s" totalImagesPullingTime="2.452901466s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-09 15:04:55 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-09 15:04:59.283289819 +0000 UTC m=+214.137446060" watchObservedRunningTime="2026-06-09 15:04:59.284723573 +0000 UTC m=+214.138879812" Jun 09 15:04:59.300611 ip-10-0-133-239 kubenswrapper[2576]: I0609 15:04:59.300573 2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/router-default-6f8c669b97-fzsft" podStartSLOduration=33.300562314 podStartE2EDuration="33.300562314s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-09 15:04:26 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-09 15:04:59.299895324 +0000 UTC m=+214.154051565" watchObservedRunningTime="2026-06-09 15:04:59.300562314 +0000 UTC m=+214.154718531" Jun 09 15:04:59.518578 ip-10-0-133-239 kubenswrapper[2576]: I0609 15:04:59.518547 2576 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/router-default-6f8c669b97-fzsft" Jun 09 15:04:59.521207 ip-10-0-133-239 kubenswrapper[2576]: I0609 15:04:59.521182 2576 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/router-default-6f8c669b97-fzsft" Jun 09 15:05:00.275472 ip-10-0-133-239 kubenswrapper[2576]: I0609 15:05:00.275439 2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/router-default-6f8c669b97-fzsft" Jun 09 15:05:00.276874 ip-10-0-133-239 kubenswrapper[2576]: I0609 15:05:00.276848 2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/router-default-6f8c669b97-fzsft" Jun 09 15:05:01.279012 ip-10-0-133-239 kubenswrapper[2576]: I0609 15:05:01.278974 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-console/networking-console-plugin-d5d5bb78b-jlv7n" event={"ID":"739fbbc7-e701-4fac-8903-5f6a0d03ecb1","Type":"ContainerStarted","Data":"97f6ec36ba5ca32a711e857469c081174fab6ec52472c527b7a4dc187d0eec20"} Jun 09 15:05:04.340056 ip-10-0-133-239 kubenswrapper[2576]: I0609 15:05:04.339953 2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-console/networking-console-plugin-d5d5bb78b-jlv7n" podStartSLOduration=36.485965619 podStartE2EDuration="38.339935585s" totalImagesPullingTime="1.853969966s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-09 15:04:26 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-09 15:05:01.302029176 +0000 UTC m=+216.156185415" watchObservedRunningTime="2026-06-09 15:05:04.339935585 +0000 UTC m=+219.194091832" Jun 09 15:05:04.340734 ip-10-0-133-239 kubenswrapper[2576]: I0609 15:05:04.340718 2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/prometheus-operator-7f7d445d84-wmnvp"] Jun 09 15:05:04.342699 ip-10-0-133-239 kubenswrapper[2576]: I0609 15:05:04.342684 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-7f7d445d84-wmnvp" Jun 09 15:05:04.345187 ip-10-0-133-239 kubenswrapper[2576]: I0609 15:05:04.345165 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-kube-rbac-proxy-config\"" Jun 09 15:05:04.346077 ip-10-0-133-239 kubenswrapper[2576]: I0609 15:05:04.346032 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-dockercfg-wqq74\"" Jun 09 15:05:04.346077 ip-10-0-133-239 kubenswrapper[2576]: I0609 15:05:04.346049 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-tls\"" Jun 09 15:05:04.346077 ip-10-0-133-239 kubenswrapper[2576]: I0609 15:05:04.346051 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"openshift-service-ca.crt\"" Jun 09 15:05:04.346270 ip-10-0-133-239 kubenswrapper[2576]: I0609 15:05:04.346152 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"metrics-client-ca\"" Jun 09 15:05:04.346410 ip-10-0-133-239 kubenswrapper[2576]: I0609 15:05:04.346392 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kube-root-ca.crt\"" Jun 09 15:05:04.353649 ip-10-0-133-239 kubenswrapper[2576]: I0609 15:05:04.353626 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-7f7d445d84-wmnvp"] Jun 09 15:05:04.474623 ip-10-0-133-239 kubenswrapper[2576]: I0609 15:05:04.474589 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-operator-tls\" (UniqueName: \"kubernetes.io/secret/fd8562f1-3884-400e-9e8d-479dcdd4c9bc-prometheus-operator-tls\") pod \"prometheus-operator-7f7d445d84-wmnvp\" (UID: \"fd8562f1-3884-400e-9e8d-479dcdd4c9bc\") " pod="openshift-monitoring/prometheus-operator-7f7d445d84-wmnvp" Jun 09 15:05:04.474766 ip-10-0-133-239 kubenswrapper[2576]: I0609 15:05:04.474628 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7ksjg\" (UniqueName: \"kubernetes.io/projected/fd8562f1-3884-400e-9e8d-479dcdd4c9bc-kube-api-access-7ksjg\") pod \"prometheus-operator-7f7d445d84-wmnvp\" (UID: \"fd8562f1-3884-400e-9e8d-479dcdd4c9bc\") " pod="openshift-monitoring/prometheus-operator-7f7d445d84-wmnvp" Jun 09 15:05:04.474766 ip-10-0-133-239 kubenswrapper[2576]: I0609 15:05:04.474669 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/fd8562f1-3884-400e-9e8d-479dcdd4c9bc-metrics-client-ca\") pod \"prometheus-operator-7f7d445d84-wmnvp\" (UID: \"fd8562f1-3884-400e-9e8d-479dcdd4c9bc\") " pod="openshift-monitoring/prometheus-operator-7f7d445d84-wmnvp" Jun 09 15:05:04.474766 ip-10-0-133-239 kubenswrapper[2576]: I0609 15:05:04.474713 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-operator-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/fd8562f1-3884-400e-9e8d-479dcdd4c9bc-prometheus-operator-kube-rbac-proxy-config\") pod \"prometheus-operator-7f7d445d84-wmnvp\" (UID: \"fd8562f1-3884-400e-9e8d-479dcdd4c9bc\") " pod="openshift-monitoring/prometheus-operator-7f7d445d84-wmnvp" Jun 09 15:05:04.576007 ip-10-0-133-239 kubenswrapper[2576]: I0609 15:05:04.575968 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-operator-tls\" (UniqueName: \"kubernetes.io/secret/fd8562f1-3884-400e-9e8d-479dcdd4c9bc-prometheus-operator-tls\") pod \"prometheus-operator-7f7d445d84-wmnvp\" (UID: \"fd8562f1-3884-400e-9e8d-479dcdd4c9bc\") " pod="openshift-monitoring/prometheus-operator-7f7d445d84-wmnvp" Jun 09 15:05:04.576171 ip-10-0-133-239 kubenswrapper[2576]: I0609 15:05:04.576021 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7ksjg\" (UniqueName: \"kubernetes.io/projected/fd8562f1-3884-400e-9e8d-479dcdd4c9bc-kube-api-access-7ksjg\") pod \"prometheus-operator-7f7d445d84-wmnvp\" (UID: \"fd8562f1-3884-400e-9e8d-479dcdd4c9bc\") " pod="openshift-monitoring/prometheus-operator-7f7d445d84-wmnvp" Jun 09 15:05:04.576171 ip-10-0-133-239 kubenswrapper[2576]: I0609 15:05:04.576089 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/fd8562f1-3884-400e-9e8d-479dcdd4c9bc-metrics-client-ca\") pod \"prometheus-operator-7f7d445d84-wmnvp\" (UID: \"fd8562f1-3884-400e-9e8d-479dcdd4c9bc\") " pod="openshift-monitoring/prometheus-operator-7f7d445d84-wmnvp" Jun 09 15:05:04.576171 ip-10-0-133-239 kubenswrapper[2576]: I0609 15:05:04.576117 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-operator-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/fd8562f1-3884-400e-9e8d-479dcdd4c9bc-prometheus-operator-kube-rbac-proxy-config\") pod \"prometheus-operator-7f7d445d84-wmnvp\" (UID: \"fd8562f1-3884-400e-9e8d-479dcdd4c9bc\") " pod="openshift-monitoring/prometheus-operator-7f7d445d84-wmnvp" Jun 09 15:05:04.576171 ip-10-0-133-239 kubenswrapper[2576]: E0609 15:05:04.576142 2576 secret.go:189] Couldn't get secret openshift-monitoring/prometheus-operator-tls: secret "prometheus-operator-tls" not found Jun 09 15:05:04.576396 ip-10-0-133-239 kubenswrapper[2576]: E0609 15:05:04.576215 2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/fd8562f1-3884-400e-9e8d-479dcdd4c9bc-prometheus-operator-tls podName:fd8562f1-3884-400e-9e8d-479dcdd4c9bc nodeName:}" failed. No retries permitted until 2026-06-09 15:05:05.076196582 +0000 UTC m=+219.930352806 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "prometheus-operator-tls" (UniqueName: "kubernetes.io/secret/fd8562f1-3884-400e-9e8d-479dcdd4c9bc-prometheus-operator-tls") pod "prometheus-operator-7f7d445d84-wmnvp" (UID: "fd8562f1-3884-400e-9e8d-479dcdd4c9bc") : secret "prometheus-operator-tls" not found Jun 09 15:05:04.576810 ip-10-0-133-239 kubenswrapper[2576]: I0609 15:05:04.576786 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/fd8562f1-3884-400e-9e8d-479dcdd4c9bc-metrics-client-ca\") pod \"prometheus-operator-7f7d445d84-wmnvp\" (UID: \"fd8562f1-3884-400e-9e8d-479dcdd4c9bc\") " pod="openshift-monitoring/prometheus-operator-7f7d445d84-wmnvp" Jun 09 15:05:04.578464 ip-10-0-133-239 kubenswrapper[2576]: I0609 15:05:04.578446 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-operator-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/fd8562f1-3884-400e-9e8d-479dcdd4c9bc-prometheus-operator-kube-rbac-proxy-config\") pod \"prometheus-operator-7f7d445d84-wmnvp\" (UID: \"fd8562f1-3884-400e-9e8d-479dcdd4c9bc\") " pod="openshift-monitoring/prometheus-operator-7f7d445d84-wmnvp" Jun 09 15:05:04.586392 ip-10-0-133-239 kubenswrapper[2576]: I0609 15:05:04.586367 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-7ksjg\" (UniqueName: \"kubernetes.io/projected/fd8562f1-3884-400e-9e8d-479dcdd4c9bc-kube-api-access-7ksjg\") pod \"prometheus-operator-7f7d445d84-wmnvp\" (UID: \"fd8562f1-3884-400e-9e8d-479dcdd4c9bc\") " pod="openshift-monitoring/prometheus-operator-7f7d445d84-wmnvp" Jun 09 15:05:05.080004 ip-10-0-133-239 kubenswrapper[2576]: I0609 15:05:05.079960 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-operator-tls\" (UniqueName: \"kubernetes.io/secret/fd8562f1-3884-400e-9e8d-479dcdd4c9bc-prometheus-operator-tls\") pod \"prometheus-operator-7f7d445d84-wmnvp\" (UID: \"fd8562f1-3884-400e-9e8d-479dcdd4c9bc\") " pod="openshift-monitoring/prometheus-operator-7f7d445d84-wmnvp" Jun 09 15:05:05.082314 ip-10-0-133-239 kubenswrapper[2576]: I0609 15:05:05.082295 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-operator-tls\" (UniqueName: \"kubernetes.io/secret/fd8562f1-3884-400e-9e8d-479dcdd4c9bc-prometheus-operator-tls\") pod \"prometheus-operator-7f7d445d84-wmnvp\" (UID: \"fd8562f1-3884-400e-9e8d-479dcdd4c9bc\") " pod="openshift-monitoring/prometheus-operator-7f7d445d84-wmnvp" Jun 09 15:05:05.251868 ip-10-0-133-239 kubenswrapper[2576]: I0609 15:05:05.251825 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-7f7d445d84-wmnvp" Jun 09 15:05:05.376705 ip-10-0-133-239 kubenswrapper[2576]: I0609 15:05:05.376674 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-7f7d445d84-wmnvp"] Jun 09 15:05:05.379135 ip-10-0-133-239 kubenswrapper[2576]: W0609 15:05:05.379098 2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podfd8562f1_3884_400e_9e8d_479dcdd4c9bc.slice/crio-8c883383bc62e98ede280967af72bfa545d843881b126f8ddcd961e26444d965 WatchSource:0}: Error finding container 8c883383bc62e98ede280967af72bfa545d843881b126f8ddcd961e26444d965: Status 404 returned error can't find the container with id 8c883383bc62e98ede280967af72bfa545d843881b126f8ddcd961e26444d965 Jun 09 15:05:06.297810 ip-10-0-133-239 kubenswrapper[2576]: I0609 15:05:06.297770 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-7f7d445d84-wmnvp" event={"ID":"fd8562f1-3884-400e-9e8d-479dcdd4c9bc","Type":"ContainerStarted","Data":"8c883383bc62e98ede280967af72bfa545d843881b126f8ddcd961e26444d965"} Jun 09 15:05:07.303031 ip-10-0-133-239 kubenswrapper[2576]: I0609 15:05:07.302993 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-7f7d445d84-wmnvp" event={"ID":"fd8562f1-3884-400e-9e8d-479dcdd4c9bc","Type":"ContainerStarted","Data":"bf0f592e4504674dae49d9ebbe93e2da7b0b2fd7e2488eafdba4540426b3593a"} Jun 09 15:05:07.303424 ip-10-0-133-239 kubenswrapper[2576]: I0609 15:05:07.303042 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-7f7d445d84-wmnvp" event={"ID":"fd8562f1-3884-400e-9e8d-479dcdd4c9bc","Type":"ContainerStarted","Data":"4cfaaa1b03d29edfeb8949fca188197eb4d8fab8048c86bf1bbe4cb8dec318ad"} Jun 09 15:05:07.323601 ip-10-0-133-239 kubenswrapper[2576]: I0609 15:05:07.323558 2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/prometheus-operator-7f7d445d84-wmnvp" podStartSLOduration=2.136242547 podStartE2EDuration="3.323540489s" totalImagesPullingTime="1.187297942s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-09 15:05:04 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-09 15:05:07.321556816 +0000 UTC m=+222.175713049" watchObservedRunningTime="2026-06-09 15:05:07.323540489 +0000 UTC m=+222.177696728" Jun 09 15:05:07.598247 ip-10-0-133-239 kubenswrapper[2576]: I0609 15:05:07.598172 2576 scope.go:117] "RemoveContainer" containerID="71409b3a87ee8073a3bc1fff90579c77cd8412197dd189e2d33544d7adec7863" Jun 09 15:05:07.598381 ip-10-0-133-239 kubenswrapper[2576]: E0609 15:05:07.598325 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"console-operator\" with CrashLoopBackOff: \"back-off 20s restarting failed container=console-operator pod=console-operator-668fdbf85c-wmg5x_openshift-console-operator(37922842-1a2e-44d7-861f-edca166e718b)\"" pod="openshift-console-operator/console-operator-668fdbf85c-wmg5x" podUID="37922842-1a2e-44d7-861f-edca166e718b" Jun 09 15:05:13.425222 ip-10-0-133-239 kubenswrapper[2576]: I0609 15:05:13.425191 2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/node-exporter-k2l2b"] Jun 09 15:05:13.428303 ip-10-0-133-239 kubenswrapper[2576]: I0609 15:05:13.428275 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-k2l2b" Jun 09 15:05:13.430635 ip-10-0-133-239 kubenswrapper[2576]: I0609 15:05:13.430611 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-kube-rbac-proxy-config\"" Jun 09 15:05:13.430745 ip-10-0-133-239 kubenswrapper[2576]: I0609 15:05:13.430667 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"node-exporter-accelerators-collector-config\"" Jun 09 15:05:13.430745 ip-10-0-133-239 kubenswrapper[2576]: I0609 15:05:13.430624 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-dockercfg-4m2mf\"" Jun 09 15:05:13.430867 ip-10-0-133-239 kubenswrapper[2576]: I0609 15:05:13.430794 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-tls\"" Jun 09 15:05:13.539625 ip-10-0-133-239 kubenswrapper[2576]: I0609 15:05:13.539584 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/0603dfe2-38eb-42ab-adef-cfe4867128af-node-exporter-accelerators-collector-config\") pod \"node-exporter-k2l2b\" (UID: \"0603dfe2-38eb-42ab-adef-cfe4867128af\") " pod="openshift-monitoring/node-exporter-k2l2b" Jun 09 15:05:13.539625 ip-10-0-133-239 kubenswrapper[2576]: I0609 15:05:13.539627 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/0603dfe2-38eb-42ab-adef-cfe4867128af-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-k2l2b\" (UID: \"0603dfe2-38eb-42ab-adef-cfe4867128af\") " pod="openshift-monitoring/node-exporter-k2l2b" Jun 09 15:05:13.539828 ip-10-0-133-239 kubenswrapper[2576]: I0609 15:05:13.539667 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-tv9r5\" (UniqueName: \"kubernetes.io/projected/0603dfe2-38eb-42ab-adef-cfe4867128af-kube-api-access-tv9r5\") pod \"node-exporter-k2l2b\" (UID: \"0603dfe2-38eb-42ab-adef-cfe4867128af\") " pod="openshift-monitoring/node-exporter-k2l2b" Jun 09 15:05:13.539828 ip-10-0-133-239 kubenswrapper[2576]: I0609 15:05:13.539756 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/0603dfe2-38eb-42ab-adef-cfe4867128af-sys\") pod \"node-exporter-k2l2b\" (UID: \"0603dfe2-38eb-42ab-adef-cfe4867128af\") " pod="openshift-monitoring/node-exporter-k2l2b" Jun 09 15:05:13.539828 ip-10-0-133-239 kubenswrapper[2576]: I0609 15:05:13.539782 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/0603dfe2-38eb-42ab-adef-cfe4867128af-node-exporter-tls\") pod \"node-exporter-k2l2b\" (UID: \"0603dfe2-38eb-42ab-adef-cfe4867128af\") " pod="openshift-monitoring/node-exporter-k2l2b" Jun 09 15:05:13.539828 ip-10-0-133-239 kubenswrapper[2576]: I0609 15:05:13.539812 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/0603dfe2-38eb-42ab-adef-cfe4867128af-metrics-client-ca\") pod \"node-exporter-k2l2b\" (UID: \"0603dfe2-38eb-42ab-adef-cfe4867128af\") " pod="openshift-monitoring/node-exporter-k2l2b" Jun 09 15:05:13.539951 ip-10-0-133-239 kubenswrapper[2576]: I0609 15:05:13.539843 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/0603dfe2-38eb-42ab-adef-cfe4867128af-node-exporter-wtmp\") pod \"node-exporter-k2l2b\" (UID: \"0603dfe2-38eb-42ab-adef-cfe4867128af\") " pod="openshift-monitoring/node-exporter-k2l2b" Jun 09 15:05:13.539951 ip-10-0-133-239 kubenswrapper[2576]: I0609 15:05:13.539865 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/0603dfe2-38eb-42ab-adef-cfe4867128af-node-exporter-textfile\") pod \"node-exporter-k2l2b\" (UID: \"0603dfe2-38eb-42ab-adef-cfe4867128af\") " pod="openshift-monitoring/node-exporter-k2l2b" Jun 09 15:05:13.539951 ip-10-0-133-239 kubenswrapper[2576]: I0609 15:05:13.539897 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/0603dfe2-38eb-42ab-adef-cfe4867128af-root\") pod \"node-exporter-k2l2b\" (UID: \"0603dfe2-38eb-42ab-adef-cfe4867128af\") " pod="openshift-monitoring/node-exporter-k2l2b" Jun 09 15:05:13.641051 ip-10-0-133-239 kubenswrapper[2576]: I0609 15:05:13.641019 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/0603dfe2-38eb-42ab-adef-cfe4867128af-sys\") pod \"node-exporter-k2l2b\" (UID: \"0603dfe2-38eb-42ab-adef-cfe4867128af\") " pod="openshift-monitoring/node-exporter-k2l2b" Jun 09 15:05:13.641051 ip-10-0-133-239 kubenswrapper[2576]: I0609 15:05:13.641051 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/0603dfe2-38eb-42ab-adef-cfe4867128af-node-exporter-tls\") pod \"node-exporter-k2l2b\" (UID: \"0603dfe2-38eb-42ab-adef-cfe4867128af\") " pod="openshift-monitoring/node-exporter-k2l2b" Jun 09 15:05:13.641257 ip-10-0-133-239 kubenswrapper[2576]: I0609 15:05:13.641157 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/0603dfe2-38eb-42ab-adef-cfe4867128af-sys\") pod \"node-exporter-k2l2b\" (UID: \"0603dfe2-38eb-42ab-adef-cfe4867128af\") " pod="openshift-monitoring/node-exporter-k2l2b" Jun 09 15:05:13.641257 ip-10-0-133-239 kubenswrapper[2576]: E0609 15:05:13.641175 2576 secret.go:189] Couldn't get secret openshift-monitoring/node-exporter-tls: secret "node-exporter-tls" not found Jun 09 15:05:13.641257 ip-10-0-133-239 kubenswrapper[2576]: I0609 15:05:13.641201 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/0603dfe2-38eb-42ab-adef-cfe4867128af-metrics-client-ca\") pod \"node-exporter-k2l2b\" (UID: \"0603dfe2-38eb-42ab-adef-cfe4867128af\") " pod="openshift-monitoring/node-exporter-k2l2b" Jun 09 15:05:13.641257 ip-10-0-133-239 kubenswrapper[2576]: E0609 15:05:13.641222 2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/0603dfe2-38eb-42ab-adef-cfe4867128af-node-exporter-tls podName:0603dfe2-38eb-42ab-adef-cfe4867128af nodeName:}" failed. No retries permitted until 2026-06-09 15:05:14.141208738 +0000 UTC m=+228.995364955 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "node-exporter-tls" (UniqueName: "kubernetes.io/secret/0603dfe2-38eb-42ab-adef-cfe4867128af-node-exporter-tls") pod "node-exporter-k2l2b" (UID: "0603dfe2-38eb-42ab-adef-cfe4867128af") : secret "node-exporter-tls" not found Jun 09 15:05:13.641257 ip-10-0-133-239 kubenswrapper[2576]: I0609 15:05:13.641247 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/0603dfe2-38eb-42ab-adef-cfe4867128af-node-exporter-wtmp\") pod \"node-exporter-k2l2b\" (UID: \"0603dfe2-38eb-42ab-adef-cfe4867128af\") " pod="openshift-monitoring/node-exporter-k2l2b" Jun 09 15:05:13.641465 ip-10-0-133-239 kubenswrapper[2576]: I0609 15:05:13.641279 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/0603dfe2-38eb-42ab-adef-cfe4867128af-node-exporter-textfile\") pod \"node-exporter-k2l2b\" (UID: \"0603dfe2-38eb-42ab-adef-cfe4867128af\") " pod="openshift-monitoring/node-exporter-k2l2b" Jun 09 15:05:13.641465 ip-10-0-133-239 kubenswrapper[2576]: I0609 15:05:13.641299 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/0603dfe2-38eb-42ab-adef-cfe4867128af-root\") pod \"node-exporter-k2l2b\" (UID: \"0603dfe2-38eb-42ab-adef-cfe4867128af\") " pod="openshift-monitoring/node-exporter-k2l2b" Jun 09 15:05:13.641465 ip-10-0-133-239 kubenswrapper[2576]: I0609 15:05:13.641330 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/0603dfe2-38eb-42ab-adef-cfe4867128af-node-exporter-accelerators-collector-config\") pod \"node-exporter-k2l2b\" (UID: \"0603dfe2-38eb-42ab-adef-cfe4867128af\") " pod="openshift-monitoring/node-exporter-k2l2b" Jun 09 15:05:13.641465 ip-10-0-133-239 kubenswrapper[2576]: I0609 15:05:13.641361 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/0603dfe2-38eb-42ab-adef-cfe4867128af-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-k2l2b\" (UID: \"0603dfe2-38eb-42ab-adef-cfe4867128af\") " pod="openshift-monitoring/node-exporter-k2l2b" Jun 09 15:05:13.641465 ip-10-0-133-239 kubenswrapper[2576]: I0609 15:05:13.641384 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"root\" (UniqueName: \"kubernetes.io/host-path/0603dfe2-38eb-42ab-adef-cfe4867128af-root\") pod \"node-exporter-k2l2b\" (UID: \"0603dfe2-38eb-42ab-adef-cfe4867128af\") " pod="openshift-monitoring/node-exporter-k2l2b" Jun 09 15:05:13.641465 ip-10-0-133-239 kubenswrapper[2576]: I0609 15:05:13.641429 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-tv9r5\" (UniqueName: \"kubernetes.io/projected/0603dfe2-38eb-42ab-adef-cfe4867128af-kube-api-access-tv9r5\") pod \"node-exporter-k2l2b\" (UID: \"0603dfe2-38eb-42ab-adef-cfe4867128af\") " pod="openshift-monitoring/node-exporter-k2l2b" Jun 09 15:05:13.641465 ip-10-0-133-239 kubenswrapper[2576]: I0609 15:05:13.641434 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/0603dfe2-38eb-42ab-adef-cfe4867128af-node-exporter-wtmp\") pod \"node-exporter-k2l2b\" (UID: \"0603dfe2-38eb-42ab-adef-cfe4867128af\") " pod="openshift-monitoring/node-exporter-k2l2b" Jun 09 15:05:13.641803 ip-10-0-133-239 kubenswrapper[2576]: I0609 15:05:13.641737 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/0603dfe2-38eb-42ab-adef-cfe4867128af-node-exporter-textfile\") pod \"node-exporter-k2l2b\" (UID: \"0603dfe2-38eb-42ab-adef-cfe4867128af\") " pod="openshift-monitoring/node-exporter-k2l2b" Jun 09 15:05:13.641803 ip-10-0-133-239 kubenswrapper[2576]: I0609 15:05:13.641786 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/0603dfe2-38eb-42ab-adef-cfe4867128af-metrics-client-ca\") pod \"node-exporter-k2l2b\" (UID: \"0603dfe2-38eb-42ab-adef-cfe4867128af\") " pod="openshift-monitoring/node-exporter-k2l2b" Jun 09 15:05:13.641945 ip-10-0-133-239 kubenswrapper[2576]: I0609 15:05:13.641927 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/0603dfe2-38eb-42ab-adef-cfe4867128af-node-exporter-accelerators-collector-config\") pod \"node-exporter-k2l2b\" (UID: \"0603dfe2-38eb-42ab-adef-cfe4867128af\") " pod="openshift-monitoring/node-exporter-k2l2b" Jun 09 15:05:13.643630 ip-10-0-133-239 kubenswrapper[2576]: I0609 15:05:13.643604 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/0603dfe2-38eb-42ab-adef-cfe4867128af-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-k2l2b\" (UID: \"0603dfe2-38eb-42ab-adef-cfe4867128af\") " pod="openshift-monitoring/node-exporter-k2l2b" Jun 09 15:05:13.649512 ip-10-0-133-239 kubenswrapper[2576]: I0609 15:05:13.649492 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-tv9r5\" (UniqueName: \"kubernetes.io/projected/0603dfe2-38eb-42ab-adef-cfe4867128af-kube-api-access-tv9r5\") pod \"node-exporter-k2l2b\" (UID: \"0603dfe2-38eb-42ab-adef-cfe4867128af\") " pod="openshift-monitoring/node-exporter-k2l2b" Jun 09 15:05:14.146023 ip-10-0-133-239 kubenswrapper[2576]: I0609 15:05:14.145993 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/0603dfe2-38eb-42ab-adef-cfe4867128af-node-exporter-tls\") pod \"node-exporter-k2l2b\" (UID: \"0603dfe2-38eb-42ab-adef-cfe4867128af\") " pod="openshift-monitoring/node-exporter-k2l2b" Jun 09 15:05:14.146210 ip-10-0-133-239 kubenswrapper[2576]: E0609 15:05:14.146117 2576 secret.go:189] Couldn't get secret openshift-monitoring/node-exporter-tls: secret "node-exporter-tls" not found Jun 09 15:05:14.146210 ip-10-0-133-239 kubenswrapper[2576]: E0609 15:05:14.146178 2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/0603dfe2-38eb-42ab-adef-cfe4867128af-node-exporter-tls podName:0603dfe2-38eb-42ab-adef-cfe4867128af nodeName:}" failed. No retries permitted until 2026-06-09 15:05:15.146164007 +0000 UTC m=+230.000320224 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "node-exporter-tls" (UniqueName: "kubernetes.io/secret/0603dfe2-38eb-42ab-adef-cfe4867128af-node-exporter-tls") pod "node-exporter-k2l2b" (UID: "0603dfe2-38eb-42ab-adef-cfe4867128af") : secret "node-exporter-tls" not found Jun 09 15:05:15.154204 ip-10-0-133-239 kubenswrapper[2576]: I0609 15:05:15.154175 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/0603dfe2-38eb-42ab-adef-cfe4867128af-node-exporter-tls\") pod \"node-exporter-k2l2b\" (UID: \"0603dfe2-38eb-42ab-adef-cfe4867128af\") " pod="openshift-monitoring/node-exporter-k2l2b" Jun 09 15:05:15.157503 ip-10-0-133-239 kubenswrapper[2576]: I0609 15:05:15.157479 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/0603dfe2-38eb-42ab-adef-cfe4867128af-node-exporter-tls\") pod \"node-exporter-k2l2b\" (UID: \"0603dfe2-38eb-42ab-adef-cfe4867128af\") " pod="openshift-monitoring/node-exporter-k2l2b" Jun 09 15:05:15.237192 ip-10-0-133-239 kubenswrapper[2576]: I0609 15:05:15.237166 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-k2l2b" Jun 09 15:05:15.246520 ip-10-0-133-239 kubenswrapper[2576]: W0609 15:05:15.246496 2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0603dfe2_38eb_42ab_adef_cfe4867128af.slice/crio-428b5c0294ec08b87410b1372bceb4f8c4f3caad8733e5767be6e14aefed4c57 WatchSource:0}: Error finding container 428b5c0294ec08b87410b1372bceb4f8c4f3caad8733e5767be6e14aefed4c57: Status 404 returned error can't find the container with id 428b5c0294ec08b87410b1372bceb4f8c4f3caad8733e5767be6e14aefed4c57 Jun 09 15:05:15.329038 ip-10-0-133-239 kubenswrapper[2576]: I0609 15:05:15.328989 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-k2l2b" event={"ID":"0603dfe2-38eb-42ab-adef-cfe4867128af","Type":"ContainerStarted","Data":"428b5c0294ec08b87410b1372bceb4f8c4f3caad8733e5767be6e14aefed4c57"} Jun 09 15:05:16.299763 ip-10-0-133-239 kubenswrapper[2576]: I0609 15:05:16.299726 2576 patch_prober.go:28] interesting pod/image-registry-748c5bf95-tkxxb container/registry namespace/openshift-image-registry: Liveness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body={"errors":[{"code":"UNAVAILABLE","message":"service unavailable","detail":"health check failed: please see /debug/health"}]} Jun 09 15:05:16.300218 ip-10-0-133-239 kubenswrapper[2576]: I0609 15:05:16.299777 2576 prober.go:120] "Probe failed" probeType="Liveness" pod="openshift-image-registry/image-registry-748c5bf95-tkxxb" podUID="a0bcff7d-3e5b-4cdf-ad5c-73ce22659d3d" containerName="registry" probeResult="failure" output="HTTP probe failed with statuscode: 503" Jun 09 15:05:16.334678 ip-10-0-133-239 kubenswrapper[2576]: I0609 15:05:16.334641 2576 generic.go:356] "Generic (PLEG): container finished" podID="0603dfe2-38eb-42ab-adef-cfe4867128af" containerID="bed6b1c550424201428a8d29f1a3465927b86a9e1c6abbff99d953160a00cc3e" exitCode=0 Jun 09 15:05:16.334860 ip-10-0-133-239 kubenswrapper[2576]: I0609 15:05:16.334691 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-k2l2b" event={"ID":"0603dfe2-38eb-42ab-adef-cfe4867128af","Type":"ContainerDied","Data":"bed6b1c550424201428a8d29f1a3465927b86a9e1c6abbff99d953160a00cc3e"} Jun 09 15:05:17.339520 ip-10-0-133-239 kubenswrapper[2576]: I0609 15:05:17.339485 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-k2l2b" event={"ID":"0603dfe2-38eb-42ab-adef-cfe4867128af","Type":"ContainerStarted","Data":"41c2e831151a1c3d1dafd65aca102d481257e39ce770c740045190de9434d4c5"} Jun 09 15:05:17.339883 ip-10-0-133-239 kubenswrapper[2576]: I0609 15:05:17.339569 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-k2l2b" event={"ID":"0603dfe2-38eb-42ab-adef-cfe4867128af","Type":"ContainerStarted","Data":"7b9793c6c4ee3de11845b1699a05b11e24a51c6c96e4031daeccda195ab60ea2"} Jun 09 15:05:17.359656 ip-10-0-133-239 kubenswrapper[2576]: I0609 15:05:17.359617 2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/node-exporter-k2l2b" podStartSLOduration=3.534316866 podStartE2EDuration="4.359602568s" totalImagesPullingTime="761.76912ms" totalInitContainerRuntime="63.516582ms" isStatefulPod=true podCreationTimestamp="2026-06-09 15:05:13 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-09 15:05:17.357672571 +0000 UTC m=+232.211828810" watchObservedRunningTime="2026-06-09 15:05:17.359602568 +0000 UTC m=+232.213758806" Jun 09 15:05:17.707969 ip-10-0-133-239 kubenswrapper[2576]: I0609 15:05:17.707895 2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/metrics-server-69788964dc-cp5jb"] Jun 09 15:05:17.709900 ip-10-0-133-239 kubenswrapper[2576]: I0609 15:05:17.709880 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/metrics-server-69788964dc-cp5jb" Jun 09 15:05:17.713907 ip-10-0-133-239 kubenswrapper[2576]: I0609 15:05:17.713689 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-dockercfg-gptkd\"" Jun 09 15:05:17.713907 ip-10-0-133-239 kubenswrapper[2576]: I0609 15:05:17.713693 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-client-certs\"" Jun 09 15:05:17.713907 ip-10-0-133-239 kubenswrapper[2576]: I0609 15:05:17.713742 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kubelet-serving-ca-bundle\"" Jun 09 15:05:17.713907 ip-10-0-133-239 kubenswrapper[2576]: I0609 15:05:17.713763 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-tls\"" Jun 09 15:05:17.713907 ip-10-0-133-239 kubenswrapper[2576]: I0609 15:05:17.713771 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"metrics-server-audit-profiles\"" Jun 09 15:05:17.713907 ip-10-0-133-239 kubenswrapper[2576]: I0609 15:05:17.713742 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-utir8j0c3phe\"" Jun 09 15:05:17.720749 ip-10-0-133-239 kubenswrapper[2576]: I0609 15:05:17.720730 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/metrics-server-69788964dc-cp5jb"] Jun 09 15:05:17.774319 ip-10-0-133-239 kubenswrapper[2576]: I0609 15:05:17.774295 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-metrics-server-client-certs\" (UniqueName: \"kubernetes.io/secret/ac303dbd-2e2f-47f8-8858-d478771abd39-secret-metrics-server-client-certs\") pod \"metrics-server-69788964dc-cp5jb\" (UID: \"ac303dbd-2e2f-47f8-8858-d478771abd39\") " pod="openshift-monitoring/metrics-server-69788964dc-cp5jb" Jun 09 15:05:17.774420 ip-10-0-133-239 kubenswrapper[2576]: I0609 15:05:17.774366 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"audit-log\" (UniqueName: \"kubernetes.io/empty-dir/ac303dbd-2e2f-47f8-8858-d478771abd39-audit-log\") pod \"metrics-server-69788964dc-cp5jb\" (UID: \"ac303dbd-2e2f-47f8-8858-d478771abd39\") " pod="openshift-monitoring/metrics-server-69788964dc-cp5jb" Jun 09 15:05:17.774420 ip-10-0-133-239 kubenswrapper[2576]: I0609 15:05:17.774406 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/ac303dbd-2e2f-47f8-8858-d478771abd39-configmap-kubelet-serving-ca-bundle\") pod \"metrics-server-69788964dc-cp5jb\" (UID: \"ac303dbd-2e2f-47f8-8858-d478771abd39\") " pod="openshift-monitoring/metrics-server-69788964dc-cp5jb" Jun 09 15:05:17.774492 ip-10-0-133-239 kubenswrapper[2576]: I0609 15:05:17.774427 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"client-ca-bundle\" (UniqueName: \"kubernetes.io/secret/ac303dbd-2e2f-47f8-8858-d478771abd39-client-ca-bundle\") pod \"metrics-server-69788964dc-cp5jb\" (UID: \"ac303dbd-2e2f-47f8-8858-d478771abd39\") " pod="openshift-monitoring/metrics-server-69788964dc-cp5jb" Jun 09 15:05:17.774492 ip-10-0-133-239 kubenswrapper[2576]: I0609 15:05:17.774454 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-metrics-server-tls\" (UniqueName: \"kubernetes.io/secret/ac303dbd-2e2f-47f8-8858-d478771abd39-secret-metrics-server-tls\") pod \"metrics-server-69788964dc-cp5jb\" (UID: \"ac303dbd-2e2f-47f8-8858-d478771abd39\") " pod="openshift-monitoring/metrics-server-69788964dc-cp5jb" Jun 09 15:05:17.774492 ip-10-0-133-239 kubenswrapper[2576]: I0609 15:05:17.774482 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-server-audit-profiles\" (UniqueName: \"kubernetes.io/configmap/ac303dbd-2e2f-47f8-8858-d478771abd39-metrics-server-audit-profiles\") pod \"metrics-server-69788964dc-cp5jb\" (UID: \"ac303dbd-2e2f-47f8-8858-d478771abd39\") " pod="openshift-monitoring/metrics-server-69788964dc-cp5jb" Jun 09 15:05:17.774578 ip-10-0-133-239 kubenswrapper[2576]: I0609 15:05:17.774515 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9r5qf\" (UniqueName: \"kubernetes.io/projected/ac303dbd-2e2f-47f8-8858-d478771abd39-kube-api-access-9r5qf\") pod \"metrics-server-69788964dc-cp5jb\" (UID: \"ac303dbd-2e2f-47f8-8858-d478771abd39\") " pod="openshift-monitoring/metrics-server-69788964dc-cp5jb" Jun 09 15:05:17.875020 ip-10-0-133-239 kubenswrapper[2576]: I0609 15:05:17.874987 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-metrics-server-tls\" (UniqueName: \"kubernetes.io/secret/ac303dbd-2e2f-47f8-8858-d478771abd39-secret-metrics-server-tls\") pod \"metrics-server-69788964dc-cp5jb\" (UID: \"ac303dbd-2e2f-47f8-8858-d478771abd39\") " pod="openshift-monitoring/metrics-server-69788964dc-cp5jb" Jun 09 15:05:17.875176 ip-10-0-133-239 kubenswrapper[2576]: I0609 15:05:17.875034 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-server-audit-profiles\" (UniqueName: \"kubernetes.io/configmap/ac303dbd-2e2f-47f8-8858-d478771abd39-metrics-server-audit-profiles\") pod \"metrics-server-69788964dc-cp5jb\" (UID: \"ac303dbd-2e2f-47f8-8858-d478771abd39\") " pod="openshift-monitoring/metrics-server-69788964dc-cp5jb" Jun 09 15:05:17.875176 ip-10-0-133-239 kubenswrapper[2576]: I0609 15:05:17.875151 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9r5qf\" (UniqueName: \"kubernetes.io/projected/ac303dbd-2e2f-47f8-8858-d478771abd39-kube-api-access-9r5qf\") pod \"metrics-server-69788964dc-cp5jb\" (UID: \"ac303dbd-2e2f-47f8-8858-d478771abd39\") " pod="openshift-monitoring/metrics-server-69788964dc-cp5jb" Jun 09 15:05:17.875257 ip-10-0-133-239 kubenswrapper[2576]: I0609 15:05:17.875198 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-metrics-server-client-certs\" (UniqueName: \"kubernetes.io/secret/ac303dbd-2e2f-47f8-8858-d478771abd39-secret-metrics-server-client-certs\") pod \"metrics-server-69788964dc-cp5jb\" (UID: \"ac303dbd-2e2f-47f8-8858-d478771abd39\") " pod="openshift-monitoring/metrics-server-69788964dc-cp5jb" Jun 09 15:05:17.875306 ip-10-0-133-239 kubenswrapper[2576]: I0609 15:05:17.875272 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"audit-log\" (UniqueName: \"kubernetes.io/empty-dir/ac303dbd-2e2f-47f8-8858-d478771abd39-audit-log\") pod \"metrics-server-69788964dc-cp5jb\" (UID: \"ac303dbd-2e2f-47f8-8858-d478771abd39\") " pod="openshift-monitoring/metrics-server-69788964dc-cp5jb" Jun 09 15:05:17.875426 ip-10-0-133-239 kubenswrapper[2576]: I0609 15:05:17.875401 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/ac303dbd-2e2f-47f8-8858-d478771abd39-configmap-kubelet-serving-ca-bundle\") pod \"metrics-server-69788964dc-cp5jb\" (UID: \"ac303dbd-2e2f-47f8-8858-d478771abd39\") " pod="openshift-monitoring/metrics-server-69788964dc-cp5jb" Jun 09 15:05:17.875488 ip-10-0-133-239 kubenswrapper[2576]: I0609 15:05:17.875443 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"client-ca-bundle\" (UniqueName: \"kubernetes.io/secret/ac303dbd-2e2f-47f8-8858-d478771abd39-client-ca-bundle\") pod \"metrics-server-69788964dc-cp5jb\" (UID: \"ac303dbd-2e2f-47f8-8858-d478771abd39\") " pod="openshift-monitoring/metrics-server-69788964dc-cp5jb" Jun 09 15:05:17.875594 ip-10-0-133-239 kubenswrapper[2576]: I0609 15:05:17.875574 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"audit-log\" (UniqueName: \"kubernetes.io/empty-dir/ac303dbd-2e2f-47f8-8858-d478771abd39-audit-log\") pod \"metrics-server-69788964dc-cp5jb\" (UID: \"ac303dbd-2e2f-47f8-8858-d478771abd39\") " pod="openshift-monitoring/metrics-server-69788964dc-cp5jb" Jun 09 15:05:17.876020 ip-10-0-133-239 kubenswrapper[2576]: I0609 15:05:17.875998 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-server-audit-profiles\" (UniqueName: \"kubernetes.io/configmap/ac303dbd-2e2f-47f8-8858-d478771abd39-metrics-server-audit-profiles\") pod \"metrics-server-69788964dc-cp5jb\" (UID: \"ac303dbd-2e2f-47f8-8858-d478771abd39\") " pod="openshift-monitoring/metrics-server-69788964dc-cp5jb" Jun 09 15:05:17.876136 ip-10-0-133-239 kubenswrapper[2576]: I0609 15:05:17.876038 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/ac303dbd-2e2f-47f8-8858-d478771abd39-configmap-kubelet-serving-ca-bundle\") pod \"metrics-server-69788964dc-cp5jb\" (UID: \"ac303dbd-2e2f-47f8-8858-d478771abd39\") " pod="openshift-monitoring/metrics-server-69788964dc-cp5jb" Jun 09 15:05:17.877726 ip-10-0-133-239 kubenswrapper[2576]: I0609 15:05:17.877704 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-metrics-server-client-certs\" (UniqueName: \"kubernetes.io/secret/ac303dbd-2e2f-47f8-8858-d478771abd39-secret-metrics-server-client-certs\") pod \"metrics-server-69788964dc-cp5jb\" (UID: \"ac303dbd-2e2f-47f8-8858-d478771abd39\") " pod="openshift-monitoring/metrics-server-69788964dc-cp5jb" Jun 09 15:05:17.877777 ip-10-0-133-239 kubenswrapper[2576]: I0609 15:05:17.877736 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-metrics-server-tls\" (UniqueName: \"kubernetes.io/secret/ac303dbd-2e2f-47f8-8858-d478771abd39-secret-metrics-server-tls\") pod \"metrics-server-69788964dc-cp5jb\" (UID: \"ac303dbd-2e2f-47f8-8858-d478771abd39\") " pod="openshift-monitoring/metrics-server-69788964dc-cp5jb" Jun 09 15:05:17.877809 ip-10-0-133-239 kubenswrapper[2576]: I0609 15:05:17.877783 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"client-ca-bundle\" (UniqueName: \"kubernetes.io/secret/ac303dbd-2e2f-47f8-8858-d478771abd39-client-ca-bundle\") pod \"metrics-server-69788964dc-cp5jb\" (UID: \"ac303dbd-2e2f-47f8-8858-d478771abd39\") " pod="openshift-monitoring/metrics-server-69788964dc-cp5jb" Jun 09 15:05:17.882859 ip-10-0-133-239 kubenswrapper[2576]: I0609 15:05:17.882840 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-9r5qf\" (UniqueName: \"kubernetes.io/projected/ac303dbd-2e2f-47f8-8858-d478771abd39-kube-api-access-9r5qf\") pod \"metrics-server-69788964dc-cp5jb\" (UID: \"ac303dbd-2e2f-47f8-8858-d478771abd39\") " pod="openshift-monitoring/metrics-server-69788964dc-cp5jb" Jun 09 15:05:18.019898 ip-10-0-133-239 kubenswrapper[2576]: I0609 15:05:18.019864 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/metrics-server-69788964dc-cp5jb" Jun 09 15:05:18.149617 ip-10-0-133-239 kubenswrapper[2576]: I0609 15:05:18.149592 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/metrics-server-69788964dc-cp5jb"] Jun 09 15:05:18.152346 ip-10-0-133-239 kubenswrapper[2576]: W0609 15:05:18.152316 2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podac303dbd_2e2f_47f8_8858_d478771abd39.slice/crio-135c0be84f5712c4d4bf19958cf5ff519eab7d0a4a4f1d0916a41d968e5489aa WatchSource:0}: Error finding container 135c0be84f5712c4d4bf19958cf5ff519eab7d0a4a4f1d0916a41d968e5489aa: Status 404 returned error can't find the container with id 135c0be84f5712c4d4bf19958cf5ff519eab7d0a4a4f1d0916a41d968e5489aa Jun 09 15:05:18.152999 ip-10-0-133-239 kubenswrapper[2576]: I0609 15:05:18.152977 2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/monitoring-plugin-76b68cc874-4nmh7"] Jun 09 15:05:18.155859 ip-10-0-133-239 kubenswrapper[2576]: I0609 15:05:18.155844 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/monitoring-plugin-76b68cc874-4nmh7" Jun 09 15:05:18.158278 ip-10-0-133-239 kubenswrapper[2576]: I0609 15:05:18.158261 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"monitoring-plugin-dockercfg-w66pt\"" Jun 09 15:05:18.158371 ip-10-0-133-239 kubenswrapper[2576]: I0609 15:05:18.158303 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"monitoring-plugin-cert\"" Jun 09 15:05:18.163863 ip-10-0-133-239 kubenswrapper[2576]: I0609 15:05:18.163836 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/monitoring-plugin-76b68cc874-4nmh7"] Jun 09 15:05:18.176650 ip-10-0-133-239 kubenswrapper[2576]: I0609 15:05:18.176626 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"monitoring-plugin-cert\" (UniqueName: \"kubernetes.io/secret/f1c81500-c25f-41f2-804a-3db0f8bde628-monitoring-plugin-cert\") pod \"monitoring-plugin-76b68cc874-4nmh7\" (UID: \"f1c81500-c25f-41f2-804a-3db0f8bde628\") " pod="openshift-monitoring/monitoring-plugin-76b68cc874-4nmh7" Jun 09 15:05:18.176792 ip-10-0-133-239 kubenswrapper[2576]: I0609 15:05:18.176722 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-n7jrz\" (UniqueName: \"kubernetes.io/projected/f1c81500-c25f-41f2-804a-3db0f8bde628-kube-api-access-n7jrz\") pod \"monitoring-plugin-76b68cc874-4nmh7\" (UID: \"f1c81500-c25f-41f2-804a-3db0f8bde628\") " pod="openshift-monitoring/monitoring-plugin-76b68cc874-4nmh7" Jun 09 15:05:18.264645 ip-10-0-133-239 kubenswrapper[2576]: I0609 15:05:18.264615 2576 patch_prober.go:28] interesting pod/image-registry-748c5bf95-tkxxb container/registry namespace/openshift-image-registry: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body={"errors":[{"code":"UNAVAILABLE","message":"service unavailable","detail":"health check failed: please see /debug/health"}]} Jun 09 15:05:18.264735 ip-10-0-133-239 kubenswrapper[2576]: I0609 15:05:18.264659 2576 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-image-registry/image-registry-748c5bf95-tkxxb" podUID="a0bcff7d-3e5b-4cdf-ad5c-73ce22659d3d" containerName="registry" probeResult="failure" output="HTTP probe failed with statuscode: 503" Jun 09 15:05:18.278019 ip-10-0-133-239 kubenswrapper[2576]: I0609 15:05:18.277970 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-n7jrz\" (UniqueName: \"kubernetes.io/projected/f1c81500-c25f-41f2-804a-3db0f8bde628-kube-api-access-n7jrz\") pod \"monitoring-plugin-76b68cc874-4nmh7\" (UID: \"f1c81500-c25f-41f2-804a-3db0f8bde628\") " pod="openshift-monitoring/monitoring-plugin-76b68cc874-4nmh7" Jun 09 15:05:18.278128 ip-10-0-133-239 kubenswrapper[2576]: I0609 15:05:18.278018 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"monitoring-plugin-cert\" (UniqueName: \"kubernetes.io/secret/f1c81500-c25f-41f2-804a-3db0f8bde628-monitoring-plugin-cert\") pod \"monitoring-plugin-76b68cc874-4nmh7\" (UID: \"f1c81500-c25f-41f2-804a-3db0f8bde628\") " pod="openshift-monitoring/monitoring-plugin-76b68cc874-4nmh7" Jun 09 15:05:18.280266 ip-10-0-133-239 kubenswrapper[2576]: I0609 15:05:18.280247 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"monitoring-plugin-cert\" (UniqueName: \"kubernetes.io/secret/f1c81500-c25f-41f2-804a-3db0f8bde628-monitoring-plugin-cert\") pod \"monitoring-plugin-76b68cc874-4nmh7\" (UID: \"f1c81500-c25f-41f2-804a-3db0f8bde628\") " pod="openshift-monitoring/monitoring-plugin-76b68cc874-4nmh7" Jun 09 15:05:18.284829 ip-10-0-133-239 kubenswrapper[2576]: I0609 15:05:18.284808 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-n7jrz\" (UniqueName: \"kubernetes.io/projected/f1c81500-c25f-41f2-804a-3db0f8bde628-kube-api-access-n7jrz\") pod \"monitoring-plugin-76b68cc874-4nmh7\" (UID: \"f1c81500-c25f-41f2-804a-3db0f8bde628\") " pod="openshift-monitoring/monitoring-plugin-76b68cc874-4nmh7" Jun 09 15:05:18.343925 ip-10-0-133-239 kubenswrapper[2576]: I0609 15:05:18.343903 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/metrics-server-69788964dc-cp5jb" event={"ID":"ac303dbd-2e2f-47f8-8858-d478771abd39","Type":"ContainerStarted","Data":"135c0be84f5712c4d4bf19958cf5ff519eab7d0a4a4f1d0916a41d968e5489aa"} Jun 09 15:05:18.466761 ip-10-0-133-239 kubenswrapper[2576]: I0609 15:05:18.466719 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/monitoring-plugin-76b68cc874-4nmh7" Jun 09 15:05:18.587410 ip-10-0-133-239 kubenswrapper[2576]: I0609 15:05:18.587383 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/monitoring-plugin-76b68cc874-4nmh7"] Jun 09 15:05:18.589529 ip-10-0-133-239 kubenswrapper[2576]: W0609 15:05:18.589506 2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf1c81500_c25f_41f2_804a_3db0f8bde628.slice/crio-4b8945b42b1f701bfb6cc631f3a5b427086bfd0dfd44ef69ab516ce3d6998196 WatchSource:0}: Error finding container 4b8945b42b1f701bfb6cc631f3a5b427086bfd0dfd44ef69ab516ce3d6998196: Status 404 returned error can't find the container with id 4b8945b42b1f701bfb6cc631f3a5b427086bfd0dfd44ef69ab516ce3d6998196 Jun 09 15:05:18.598142 ip-10-0-133-239 kubenswrapper[2576]: I0609 15:05:18.598125 2576 scope.go:117] "RemoveContainer" containerID="71409b3a87ee8073a3bc1fff90579c77cd8412197dd189e2d33544d7adec7863" Jun 09 15:05:19.348213 ip-10-0-133-239 kubenswrapper[2576]: I0609 15:05:19.348176 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/monitoring-plugin-76b68cc874-4nmh7" event={"ID":"f1c81500-c25f-41f2-804a-3db0f8bde628","Type":"ContainerStarted","Data":"4b8945b42b1f701bfb6cc631f3a5b427086bfd0dfd44ef69ab516ce3d6998196"} Jun 09 15:05:19.349972 ip-10-0-133-239 kubenswrapper[2576]: I0609 15:05:19.349953 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-668fdbf85c-wmg5x_37922842-1a2e-44d7-861f-edca166e718b/console-operator/2.log" Jun 09 15:05:19.350078 ip-10-0-133-239 kubenswrapper[2576]: I0609 15:05:19.350006 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-668fdbf85c-wmg5x" event={"ID":"37922842-1a2e-44d7-861f-edca166e718b","Type":"ContainerStarted","Data":"871274dce17a56b0b6c98befd62acac5fa2c548bb6f40237b98ef16ca8477ead"} Jun 09 15:05:19.350299 ip-10-0-133-239 kubenswrapper[2576]: I0609 15:05:19.350277 2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console-operator/console-operator-668fdbf85c-wmg5x" Jun 09 15:05:19.369124 ip-10-0-133-239 kubenswrapper[2576]: I0609 15:05:19.368801 2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console-operator/console-operator-668fdbf85c-wmg5x" podStartSLOduration=49.533478765 podStartE2EDuration="53.368780248s" totalImagesPullingTime="3.835301483s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-09 15:04:26 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-09 15:05:19.367730616 +0000 UTC m=+234.221886860" watchObservedRunningTime="2026-06-09 15:05:19.368780248 +0000 UTC m=+234.222936488" Jun 09 15:05:19.437021 ip-10-0-133-239 kubenswrapper[2576]: I0609 15:05:19.436800 2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console-operator/console-operator-668fdbf85c-wmg5x" Jun 09 15:05:19.625804 ip-10-0-133-239 kubenswrapper[2576]: I0609 15:05:19.625667 2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/downloads-6657875f97-kkdcv"] Jun 09 15:05:19.628693 ip-10-0-133-239 kubenswrapper[2576]: I0609 15:05:19.628670 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/downloads-6657875f97-kkdcv" Jun 09 15:05:19.631330 ip-10-0-133-239 kubenswrapper[2576]: I0609 15:05:19.631260 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"kube-root-ca.crt\"" Jun 09 15:05:19.631487 ip-10-0-133-239 kubenswrapper[2576]: I0609 15:05:19.631356 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"default-dockercfg-4pnk4\"" Jun 09 15:05:19.631487 ip-10-0-133-239 kubenswrapper[2576]: I0609 15:05:19.631371 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"openshift-service-ca.crt\"" Jun 09 15:05:19.644546 ip-10-0-133-239 kubenswrapper[2576]: I0609 15:05:19.644508 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/downloads-6657875f97-kkdcv"] Jun 09 15:05:19.691949 ip-10-0-133-239 kubenswrapper[2576]: I0609 15:05:19.691784 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mqllw\" (UniqueName: \"kubernetes.io/projected/fc31830e-79df-444e-83bd-0ab9f716750c-kube-api-access-mqllw\") pod \"downloads-6657875f97-kkdcv\" (UID: \"fc31830e-79df-444e-83bd-0ab9f716750c\") " pod="openshift-console/downloads-6657875f97-kkdcv" Jun 09 15:05:19.793288 ip-10-0-133-239 kubenswrapper[2576]: I0609 15:05:19.793249 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mqllw\" (UniqueName: \"kubernetes.io/projected/fc31830e-79df-444e-83bd-0ab9f716750c-kube-api-access-mqllw\") pod \"downloads-6657875f97-kkdcv\" (UID: \"fc31830e-79df-444e-83bd-0ab9f716750c\") " pod="openshift-console/downloads-6657875f97-kkdcv" Jun 09 15:05:19.801586 ip-10-0-133-239 kubenswrapper[2576]: I0609 15:05:19.801542 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-mqllw\" (UniqueName: \"kubernetes.io/projected/fc31830e-79df-444e-83bd-0ab9f716750c-kube-api-access-mqllw\") pod \"downloads-6657875f97-kkdcv\" (UID: \"fc31830e-79df-444e-83bd-0ab9f716750c\") " pod="openshift-console/downloads-6657875f97-kkdcv" Jun 09 15:05:19.941480 ip-10-0-133-239 kubenswrapper[2576]: I0609 15:05:19.941083 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/downloads-6657875f97-kkdcv" Jun 09 15:05:20.602392 ip-10-0-133-239 kubenswrapper[2576]: I0609 15:05:20.602369 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/downloads-6657875f97-kkdcv"] Jun 09 15:05:20.604087 ip-10-0-133-239 kubenswrapper[2576]: W0609 15:05:20.604042 2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podfc31830e_79df_444e_83bd_0ab9f716750c.slice/crio-d881d0fc7ef34fe598c79bf0697a61f3c9926a2e93293837f040f833695b0793 WatchSource:0}: Error finding container d881d0fc7ef34fe598c79bf0697a61f3c9926a2e93293837f040f833695b0793: Status 404 returned error can't find the container with id d881d0fc7ef34fe598c79bf0697a61f3c9926a2e93293837f040f833695b0793 Jun 09 15:05:21.360048 ip-10-0-133-239 kubenswrapper[2576]: I0609 15:05:21.359990 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/metrics-server-69788964dc-cp5jb" event={"ID":"ac303dbd-2e2f-47f8-8858-d478771abd39","Type":"ContainerStarted","Data":"29aa05481cf1cdb16c6efc277d80d996381507bd54ec15195f817938d09cef35"} Jun 09 15:05:21.361876 ip-10-0-133-239 kubenswrapper[2576]: I0609 15:05:21.361810 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/monitoring-plugin-76b68cc874-4nmh7" event={"ID":"f1c81500-c25f-41f2-804a-3db0f8bde628","Type":"ContainerStarted","Data":"fc6cadf3ff7a65adf3ca23557cfcef85c951775433b42298d293081d6c25b729"} Jun 09 15:05:21.362025 ip-10-0-133-239 kubenswrapper[2576]: I0609 15:05:21.362009 2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/monitoring-plugin-76b68cc874-4nmh7" Jun 09 15:05:21.363210 ip-10-0-133-239 kubenswrapper[2576]: I0609 15:05:21.363162 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/downloads-6657875f97-kkdcv" event={"ID":"fc31830e-79df-444e-83bd-0ab9f716750c","Type":"ContainerStarted","Data":"d881d0fc7ef34fe598c79bf0697a61f3c9926a2e93293837f040f833695b0793"} Jun 09 15:05:21.367303 ip-10-0-133-239 kubenswrapper[2576]: I0609 15:05:21.367284 2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/monitoring-plugin-76b68cc874-4nmh7" Jun 09 15:05:21.379355 ip-10-0-133-239 kubenswrapper[2576]: I0609 15:05:21.379314 2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/metrics-server-69788964dc-cp5jb" podStartSLOduration=2.060006581 podStartE2EDuration="4.379302417s" totalImagesPullingTime="2.319295836s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-09 15:05:17 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-09 15:05:21.378679461 +0000 UTC m=+236.232835701" watchObservedRunningTime="2026-06-09 15:05:21.379302417 +0000 UTC m=+236.233458656" Jun 09 15:05:21.393995 ip-10-0-133-239 kubenswrapper[2576]: I0609 15:05:21.393959 2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/monitoring-plugin-76b68cc874-4nmh7" podStartSLOduration=1.508169676 podStartE2EDuration="3.393947872s" totalImagesPullingTime="1.885778196s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-09 15:05:18 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-09 15:05:21.393619363 +0000 UTC m=+236.247775613" watchObservedRunningTime="2026-06-09 15:05:21.393947872 +0000 UTC m=+236.248104140" Jun 09 15:05:26.298961 ip-10-0-133-239 kubenswrapper[2576]: I0609 15:05:26.298930 2576 patch_prober.go:28] interesting pod/image-registry-748c5bf95-tkxxb container/registry namespace/openshift-image-registry: Liveness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body={"errors":[{"code":"UNAVAILABLE","message":"service unavailable","detail":"health check failed: please see /debug/health"}]} Jun 09 15:05:26.299350 ip-10-0-133-239 kubenswrapper[2576]: I0609 15:05:26.298994 2576 prober.go:120] "Probe failed" probeType="Liveness" pod="openshift-image-registry/image-registry-748c5bf95-tkxxb" podUID="a0bcff7d-3e5b-4cdf-ad5c-73ce22659d3d" containerName="registry" probeResult="failure" output="HTTP probe failed with statuscode: 503" Jun 09 15:05:28.265275 ip-10-0-133-239 kubenswrapper[2576]: I0609 15:05:28.265238 2576 patch_prober.go:28] interesting pod/image-registry-748c5bf95-tkxxb container/registry namespace/openshift-image-registry: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body={"errors":[{"code":"UNAVAILABLE","message":"service unavailable","detail":"health check failed: please see /debug/health"}]} Jun 09 15:05:28.265710 ip-10-0-133-239 kubenswrapper[2576]: I0609 15:05:28.265303 2576 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-image-registry/image-registry-748c5bf95-tkxxb" podUID="a0bcff7d-3e5b-4cdf-ad5c-73ce22659d3d" containerName="registry" probeResult="failure" output="HTTP probe failed with statuscode: 503" Jun 09 15:05:36.300260 ip-10-0-133-239 kubenswrapper[2576]: I0609 15:05:36.300176 2576 patch_prober.go:28] interesting pod/image-registry-748c5bf95-tkxxb container/registry namespace/openshift-image-registry: Liveness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body={"errors":[{"code":"UNAVAILABLE","message":"service unavailable","detail":"health check failed: please see /debug/health"}]} Jun 09 15:05:36.300260 ip-10-0-133-239 kubenswrapper[2576]: I0609 15:05:36.300228 2576 prober.go:120] "Probe failed" probeType="Liveness" pod="openshift-image-registry/image-registry-748c5bf95-tkxxb" podUID="a0bcff7d-3e5b-4cdf-ad5c-73ce22659d3d" containerName="registry" probeResult="failure" output="HTTP probe failed with statuscode: 503" Jun 09 15:05:36.300876 ip-10-0-133-239 kubenswrapper[2576]: I0609 15:05:36.300269 2576 kubelet.go:2654] "SyncLoop (probe)" probe="liveness" status="unhealthy" pod="openshift-image-registry/image-registry-748c5bf95-tkxxb" Jun 09 15:05:36.300876 ip-10-0-133-239 kubenswrapper[2576]: I0609 15:05:36.300754 2576 kuberuntime_manager.go:1192] "Message for Container of pod" containerName="registry" containerStatusID={"Type":"cri-o","ID":"e0a2b46534c228b0c874fc47e70a6c6464b36679d850ee01e9741f348b9c08d1"} pod="openshift-image-registry/image-registry-748c5bf95-tkxxb" containerMessage="Container registry failed liveness probe, will be restarted" Jun 09 15:05:36.305147 ip-10-0-133-239 kubenswrapper[2576]: I0609 15:05:36.305121 2576 patch_prober.go:28] interesting pod/image-registry-748c5bf95-tkxxb container/registry namespace/openshift-image-registry: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body={"errors":[{"code":"UNAVAILABLE","message":"service unavailable","detail":"health check failed: please see /debug/health"}]} Jun 09 15:05:36.305273 ip-10-0-133-239 kubenswrapper[2576]: I0609 15:05:36.305162 2576 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-image-registry/image-registry-748c5bf95-tkxxb" podUID="a0bcff7d-3e5b-4cdf-ad5c-73ce22659d3d" containerName="registry" probeResult="failure" output="HTTP probe failed with statuscode: 503" Jun 09 15:05:37.343252 ip-10-0-133-239 kubenswrapper[2576]: I0609 15:05:37.343195 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/64cfa4da-d67f-413d-b01d-161226f943e7-metrics-certs\") pod \"network-metrics-daemon-rw24f\" (UID: \"64cfa4da-d67f-413d-b01d-161226f943e7\") " pod="openshift-multus/network-metrics-daemon-rw24f" Jun 09 15:05:37.345876 ip-10-0-133-239 kubenswrapper[2576]: I0609 15:05:37.345849 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/64cfa4da-d67f-413d-b01d-161226f943e7-metrics-certs\") pod \"network-metrics-daemon-rw24f\" (UID: \"64cfa4da-d67f-413d-b01d-161226f943e7\") " pod="openshift-multus/network-metrics-daemon-rw24f" Jun 09 15:05:37.428171 ip-10-0-133-239 kubenswrapper[2576]: I0609 15:05:37.428129 2576 generic.go:356] "Generic (PLEG): container finished" podID="692623b7-ba08-4085-830a-8361352824ff" containerID="0bbedfc6a8a3ee621551001a32418e7b6a8abde29316242bd1650afb009248fa" exitCode=0 Jun 09 15:05:37.428354 ip-10-0-133-239 kubenswrapper[2576]: I0609 15:05:37.428177 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca-operator/service-ca-operator-6bc5ff68f5-7xfz8" event={"ID":"692623b7-ba08-4085-830a-8361352824ff","Type":"ContainerDied","Data":"0bbedfc6a8a3ee621551001a32418e7b6a8abde29316242bd1650afb009248fa"} Jun 09 15:05:37.428587 ip-10-0-133-239 kubenswrapper[2576]: I0609 15:05:37.428571 2576 scope.go:117] "RemoveContainer" containerID="0bbedfc6a8a3ee621551001a32418e7b6a8abde29316242bd1650afb009248fa" Jun 09 15:05:37.502251 ip-10-0-133-239 kubenswrapper[2576]: I0609 15:05:37.502221 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-x45km\"" Jun 09 15:05:37.510566 ip-10-0-133-239 kubenswrapper[2576]: I0609 15:05:37.510533 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-rw24f" Jun 09 15:05:38.020197 ip-10-0-133-239 kubenswrapper[2576]: I0609 15:05:38.020158 2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/metrics-server-69788964dc-cp5jb" Jun 09 15:05:38.020398 ip-10-0-133-239 kubenswrapper[2576]: I0609 15:05:38.020232 2576 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-monitoring/metrics-server-69788964dc-cp5jb" Jun 09 15:05:44.045363 ip-10-0-133-239 kubenswrapper[2576]: I0609 15:05:44.045338 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-rw24f"] Jun 09 15:05:44.048785 ip-10-0-133-239 kubenswrapper[2576]: W0609 15:05:44.048756 2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod64cfa4da_d67f_413d_b01d_161226f943e7.slice/crio-e8b0ea083e1be4c7ad015dc41a5acdb5b5dddb0ab7a6d704aee6bf1e909a2b6e WatchSource:0}: Error finding container e8b0ea083e1be4c7ad015dc41a5acdb5b5dddb0ab7a6d704aee6bf1e909a2b6e: Status 404 returned error can't find the container with id e8b0ea083e1be4c7ad015dc41a5acdb5b5dddb0ab7a6d704aee6bf1e909a2b6e Jun 09 15:05:44.457114 ip-10-0-133-239 kubenswrapper[2576]: I0609 15:05:44.457037 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca-operator/service-ca-operator-6bc5ff68f5-7xfz8" event={"ID":"692623b7-ba08-4085-830a-8361352824ff","Type":"ContainerStarted","Data":"99c6754f83f1227245307744bdb687aff5f833eb5c7aa83b76cb5cb26cfc9c1d"} Jun 09 15:05:44.458514 ip-10-0-133-239 kubenswrapper[2576]: I0609 15:05:44.458479 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-rw24f" event={"ID":"64cfa4da-d67f-413d-b01d-161226f943e7","Type":"ContainerStarted","Data":"e8b0ea083e1be4c7ad015dc41a5acdb5b5dddb0ab7a6d704aee6bf1e909a2b6e"} Jun 09 15:05:44.460274 ip-10-0-133-239 kubenswrapper[2576]: I0609 15:05:44.460251 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/downloads-6657875f97-kkdcv" event={"ID":"fc31830e-79df-444e-83bd-0ab9f716750c","Type":"ContainerStarted","Data":"39bf05ea6a09c9d13776c07a975ea8af38df2666878d9095d579eed6d8eef5c0"} Jun 09 15:05:44.460564 ip-10-0-133-239 kubenswrapper[2576]: I0609 15:05:44.460534 2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/downloads-6657875f97-kkdcv" Jun 09 15:05:44.474455 ip-10-0-133-239 kubenswrapper[2576]: I0609 15:05:44.473980 2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/downloads-6657875f97-kkdcv" Jun 09 15:05:44.489305 ip-10-0-133-239 kubenswrapper[2576]: I0609 15:05:44.489249 2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/downloads-6657875f97-kkdcv" podStartSLOduration=2.104151728 podStartE2EDuration="25.489227758s" totalImagesPullingTime="23.38507603s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-09 15:05:19 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-09 15:05:44.488681574 +0000 UTC m=+259.342837846" watchObservedRunningTime="2026-06-09 15:05:44.489227758 +0000 UTC m=+259.343384000" Jun 09 15:05:45.467221 ip-10-0-133-239 kubenswrapper[2576]: I0609 15:05:45.467127 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-rw24f" event={"ID":"64cfa4da-d67f-413d-b01d-161226f943e7","Type":"ContainerStarted","Data":"d41b55cabc3b9a7bce3e591c3c9e930474419630e6492a99958065bfd138339b"} Jun 09 15:05:45.467221 ip-10-0-133-239 kubenswrapper[2576]: I0609 15:05:45.467192 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-rw24f" event={"ID":"64cfa4da-d67f-413d-b01d-161226f943e7","Type":"ContainerStarted","Data":"71f06ae8a2fdbe03c918e7898810bd444af39b1970aa1475bdc5cc4d8118426a"} Jun 09 15:05:45.483727 ip-10-0-133-239 kubenswrapper[2576]: I0609 15:05:45.483669 2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/network-metrics-daemon-rw24f" podStartSLOduration=258.408435878 podStartE2EDuration="4m19.483648964s" totalImagesPullingTime="1.075213086s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-09 15:01:26 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-09 15:05:45.48258182 +0000 UTC m=+260.336738061" watchObservedRunningTime="2026-06-09 15:05:45.483648964 +0000 UTC m=+260.337805204" Jun 09 15:05:46.255709 ip-10-0-133-239 kubenswrapper[2576]: I0609 15:05:46.255680 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_metrics-server-69788964dc-cp5jb_ac303dbd-2e2f-47f8-8858-d478771abd39/metrics-server/0.log" Jun 09 15:05:46.305159 ip-10-0-133-239 kubenswrapper[2576]: I0609 15:05:46.305127 2576 patch_prober.go:28] interesting pod/image-registry-748c5bf95-tkxxb container/registry namespace/openshift-image-registry: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body={"errors":[{"code":"UNAVAILABLE","message":"service unavailable","detail":"health check failed: please see /debug/health"}]} Jun 09 15:05:46.305318 ip-10-0-133-239 kubenswrapper[2576]: I0609 15:05:46.305185 2576 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-image-registry/image-registry-748c5bf95-tkxxb" podUID="a0bcff7d-3e5b-4cdf-ad5c-73ce22659d3d" containerName="registry" probeResult="failure" output="HTTP probe failed with statuscode: 503" Jun 09 15:05:46.455836 ip-10-0-133-239 kubenswrapper[2576]: I0609 15:05:46.455800 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_monitoring-plugin-76b68cc874-4nmh7_f1c81500-c25f-41f2-804a-3db0f8bde628/monitoring-plugin/0.log" Jun 09 15:05:47.256452 ip-10-0-133-239 kubenswrapper[2576]: I0609 15:05:47.256424 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-k2l2b_0603dfe2-38eb-42ab-adef-cfe4867128af/init-textfile/0.log" Jun 09 15:05:47.456250 ip-10-0-133-239 kubenswrapper[2576]: I0609 15:05:47.456226 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-k2l2b_0603dfe2-38eb-42ab-adef-cfe4867128af/node-exporter/0.log" Jun 09 15:05:47.655602 ip-10-0-133-239 kubenswrapper[2576]: I0609 15:05:47.655575 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-k2l2b_0603dfe2-38eb-42ab-adef-cfe4867128af/kube-rbac-proxy/0.log" Jun 09 15:05:50.459545 ip-10-0-133-239 kubenswrapper[2576]: I0609 15:05:50.459514 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-operator-7f7d445d84-wmnvp_fd8562f1-3884-400e-9e8d-479dcdd4c9bc/prometheus-operator/0.log" Jun 09 15:05:50.655342 ip-10-0-133-239 kubenswrapper[2576]: I0609 15:05:50.655309 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-operator-7f7d445d84-wmnvp_fd8562f1-3884-400e-9e8d-479dcdd4c9bc/kube-rbac-proxy/0.log" Jun 09 15:05:52.856409 ip-10-0-133-239 kubenswrapper[2576]: I0609 15:05:52.856371 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-network-console_networking-console-plugin-d5d5bb78b-jlv7n_739fbbc7-e701-4fac-8903-5f6a0d03ecb1/networking-console-plugin/0.log" Jun 09 15:05:53.055820 ip-10-0-133-239 kubenswrapper[2576]: I0609 15:05:53.055786 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-668fdbf85c-wmg5x_37922842-1a2e-44d7-861f-edca166e718b/console-operator/2.log" Jun 09 15:05:53.256878 ip-10-0-133-239 kubenswrapper[2576]: I0609 15:05:53.256803 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-668fdbf85c-wmg5x_37922842-1a2e-44d7-861f-edca166e718b/console-operator/3.log" Jun 09 15:05:53.856685 ip-10-0-133-239 kubenswrapper[2576]: I0609 15:05:53.856659 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console_downloads-6657875f97-kkdcv_fc31830e-79df-444e-83bd-0ab9f716750c/download-server/0.log" Jun 09 15:05:55.255160 ip-10-0-133-239 kubenswrapper[2576]: I0609 15:05:55.255130 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-d5rht_819c59d4-2dfd-40f7-8018-dc29890cc325/dns-node-resolver/0.log" Jun 09 15:05:56.056016 ip-10-0-133-239 kubenswrapper[2576]: I0609 15:05:56.055988 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_image-registry-748c5bf95-tkxxb_a0bcff7d-3e5b-4cdf-ad5c-73ce22659d3d/registry/0.log" Jun 09 15:05:56.304501 ip-10-0-133-239 kubenswrapper[2576]: I0609 15:05:56.304470 2576 patch_prober.go:28] interesting pod/image-registry-748c5bf95-tkxxb container/registry namespace/openshift-image-registry: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body={"errors":[{"code":"UNAVAILABLE","message":"service unavailable","detail":"health check failed: please see /debug/health"}]} Jun 09 15:05:56.304869 ip-10-0-133-239 kubenswrapper[2576]: I0609 15:05:56.304518 2576 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-image-registry/image-registry-748c5bf95-tkxxb" podUID="a0bcff7d-3e5b-4cdf-ad5c-73ce22659d3d" containerName="registry" probeResult="failure" output="HTTP probe failed with statuscode: 503" Jun 09 15:05:56.656386 ip-10-0-133-239 kubenswrapper[2576]: I0609 15:05:56.656360 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-n4qqs_ab1b7146-38f5-4c67-b79c-d98d8f1734e8/node-ca/0.log" Jun 09 15:05:56.859162 ip-10-0-133-239 kubenswrapper[2576]: I0609 15:05:56.859126 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_router-default-6f8c669b97-fzsft_7d51209c-a257-422b-b29a-87eb78afc8d9/router/0.log" Jun 09 15:05:57.056101 ip-10-0-133-239 kubenswrapper[2576]: I0609 15:05:57.056058 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-7s82g_539bda9e-91a8-417f-91ff-8ccd3219cfd1/serve-healthcheck-canary/0.log" Jun 09 15:05:58.028386 ip-10-0-133-239 kubenswrapper[2576]: I0609 15:05:58.028358 2576 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-monitoring/metrics-server-69788964dc-cp5jb" Jun 09 15:05:58.033263 ip-10-0-133-239 kubenswrapper[2576]: I0609 15:05:58.033240 2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/metrics-server-69788964dc-cp5jb" Jun 09 15:06:01.324029 ip-10-0-133-239 kubenswrapper[2576]: I0609 15:06:01.323989 2576 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-image-registry/image-registry-748c5bf95-tkxxb" podUID="a0bcff7d-3e5b-4cdf-ad5c-73ce22659d3d" containerName="registry" containerID="cri-o://e0a2b46534c228b0c874fc47e70a6c6464b36679d850ee01e9741f348b9c08d1" gracePeriod=30 Jun 09 15:06:02.546151 ip-10-0-133-239 kubenswrapper[2576]: I0609 15:06:02.546116 2576 generic.go:356] "Generic (PLEG): container finished" podID="a0bcff7d-3e5b-4cdf-ad5c-73ce22659d3d" containerID="e0a2b46534c228b0c874fc47e70a6c6464b36679d850ee01e9741f348b9c08d1" exitCode=0 Jun 09 15:06:02.546510 ip-10-0-133-239 kubenswrapper[2576]: I0609 15:06:02.546182 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-748c5bf95-tkxxb" event={"ID":"a0bcff7d-3e5b-4cdf-ad5c-73ce22659d3d","Type":"ContainerDied","Data":"e0a2b46534c228b0c874fc47e70a6c6464b36679d850ee01e9741f348b9c08d1"} Jun 09 15:06:03.551175 ip-10-0-133-239 kubenswrapper[2576]: I0609 15:06:03.551142 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-748c5bf95-tkxxb" event={"ID":"a0bcff7d-3e5b-4cdf-ad5c-73ce22659d3d","Type":"ContainerStarted","Data":"e4f2b38bcf65586e809e359b1490786e8b4f47f76f7873baaaa9a398f6d9bc36"} Jun 09 15:06:03.551549 ip-10-0-133-239 kubenswrapper[2576]: I0609 15:06:03.551269 2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-image-registry/image-registry-748c5bf95-tkxxb" Jun 09 15:06:06.094810 ip-10-0-133-239 kubenswrapper[2576]: E0609 15:06:06.094755 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[metrics-tls], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-dns/dns-default-lhz9k" podUID="6bcbe45d-fd30-4df1-a753-d8ed92e1a980" Jun 09 15:06:06.563037 ip-10-0-133-239 kubenswrapper[2576]: I0609 15:06:06.563009 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-lhz9k" Jun 09 15:06:10.022391 ip-10-0-133-239 kubenswrapper[2576]: I0609 15:06:10.022355 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/6bcbe45d-fd30-4df1-a753-d8ed92e1a980-metrics-tls\") pod \"dns-default-lhz9k\" (UID: \"6bcbe45d-fd30-4df1-a753-d8ed92e1a980\") " pod="openshift-dns/dns-default-lhz9k" Jun 09 15:06:10.024756 ip-10-0-133-239 kubenswrapper[2576]: I0609 15:06:10.024731 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/6bcbe45d-fd30-4df1-a753-d8ed92e1a980-metrics-tls\") pod \"dns-default-lhz9k\" (UID: \"6bcbe45d-fd30-4df1-a753-d8ed92e1a980\") " pod="openshift-dns/dns-default-lhz9k" Jun 09 15:06:10.166604 ip-10-0-133-239 kubenswrapper[2576]: I0609 15:06:10.166577 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-zkrcb\"" Jun 09 15:06:10.174858 ip-10-0-133-239 kubenswrapper[2576]: I0609 15:06:10.174832 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-lhz9k" Jun 09 15:06:10.339207 ip-10-0-133-239 kubenswrapper[2576]: I0609 15:06:10.339184 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-lhz9k"] Jun 09 15:06:10.343791 ip-10-0-133-239 kubenswrapper[2576]: W0609 15:06:10.343765 2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6bcbe45d_fd30_4df1_a753_d8ed92e1a980.slice/crio-755665c26c98594a7e63f088001264e53ccff26efca91a1c82f712998512233d WatchSource:0}: Error finding container 755665c26c98594a7e63f088001264e53ccff26efca91a1c82f712998512233d: Status 404 returned error can't find the container with id 755665c26c98594a7e63f088001264e53ccff26efca91a1c82f712998512233d Jun 09 15:06:10.577940 ip-10-0-133-239 kubenswrapper[2576]: I0609 15:06:10.577862 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-lhz9k" event={"ID":"6bcbe45d-fd30-4df1-a753-d8ed92e1a980","Type":"ContainerStarted","Data":"755665c26c98594a7e63f088001264e53ccff26efca91a1c82f712998512233d"} Jun 09 15:06:13.590303 ip-10-0-133-239 kubenswrapper[2576]: I0609 15:06:13.590265 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-lhz9k" event={"ID":"6bcbe45d-fd30-4df1-a753-d8ed92e1a980","Type":"ContainerStarted","Data":"867201f1e0a6606c53ac0ae8bb2341731286e7c4f23275b23766a2c394610bfe"} Jun 09 15:06:13.590705 ip-10-0-133-239 kubenswrapper[2576]: I0609 15:06:13.590342 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-lhz9k" event={"ID":"6bcbe45d-fd30-4df1-a753-d8ed92e1a980","Type":"ContainerStarted","Data":"c1e7901a7c5e0828d5eb7123fe8c979e95a8b0fa420fadd0f56c6ae4286ebe81"} Jun 09 15:06:13.590705 ip-10-0-133-239 kubenswrapper[2576]: I0609 15:06:13.590376 2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-dns/dns-default-lhz9k" Jun 09 15:06:13.609488 ip-10-0-133-239 kubenswrapper[2576]: I0609 15:06:13.609441 2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/dns-default-lhz9k" podStartSLOduration=252.052642474 podStartE2EDuration="4m14.609426741s" totalImagesPullingTime="2.556784267s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-09 15:01:59 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-09 15:06:13.608167532 +0000 UTC m=+288.462323771" watchObservedRunningTime="2026-06-09 15:06:13.609426741 +0000 UTC m=+288.463582980" Jun 09 15:06:23.596693 ip-10-0-133-239 kubenswrapper[2576]: I0609 15:06:23.596664 2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-dns/dns-default-lhz9k" Jun 09 15:06:24.561171 ip-10-0-133-239 kubenswrapper[2576]: I0609 15:06:24.561146 2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-image-registry/image-registry-748c5bf95-tkxxb" Jun 09 15:06:25.542102 ip-10-0-133-239 kubenswrapper[2576]: I0609 15:06:25.542061 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-668fdbf85c-wmg5x_37922842-1a2e-44d7-861f-edca166e718b/console-operator/2.log" Jun 09 15:06:25.545707 ip-10-0-133-239 kubenswrapper[2576]: I0609 15:06:25.545665 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-668fdbf85c-wmg5x_37922842-1a2e-44d7-861f-edca166e718b/console-operator/2.log" Jun 09 15:06:25.556805 ip-10-0-133-239 kubenswrapper[2576]: I0609 15:06:25.556782 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-n4c97_441b2a74-d62c-4e3c-9e0f-b133cd4364be/ovn-acl-logging/0.log" Jun 09 15:06:25.557853 ip-10-0-133-239 kubenswrapper[2576]: I0609 15:06:25.557834 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-n4c97_441b2a74-d62c-4e3c-9e0f-b133cd4364be/ovn-acl-logging/0.log" Jun 09 15:06:25.560900 ip-10-0-133-239 kubenswrapper[2576]: I0609 15:06:25.560887 2576 kubelet.go:1648] "Image garbage collection succeeded" Jun 09 15:07:41.903430 ip-10-0-133-239 kubenswrapper[2576]: I0609 15:07:41.903355 2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dbgh9x"] Jun 09 15:07:41.905690 ip-10-0-133-239 kubenswrapper[2576]: I0609 15:07:41.905674 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dbgh9x" Jun 09 15:07:41.910430 ip-10-0-133-239 kubenswrapper[2576]: I0609 15:07:41.910409 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"openshift-service-ca.crt\"" Jun 09 15:07:41.911385 ip-10-0-133-239 kubenswrapper[2576]: I0609 15:07:41.911365 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-marketplace\"/\"default-dockercfg-sjd8c\"" Jun 09 15:07:41.911495 ip-10-0-133-239 kubenswrapper[2576]: I0609 15:07:41.911373 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"kube-root-ca.crt\"" Jun 09 15:07:41.933284 ip-10-0-133-239 kubenswrapper[2576]: I0609 15:07:41.933261 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dbgh9x"] Jun 09 15:07:42.018900 ip-10-0-133-239 kubenswrapper[2576]: I0609 15:07:42.018869 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/ba906546-9977-4466-8ca3-c513ccf9faf9-bundle\") pod \"2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dbgh9x\" (UID: \"ba906546-9977-4466-8ca3-c513ccf9faf9\") " pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dbgh9x" Jun 09 15:07:42.019054 ip-10-0-133-239 kubenswrapper[2576]: I0609 15:07:42.018905 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rzvnw\" (UniqueName: \"kubernetes.io/projected/ba906546-9977-4466-8ca3-c513ccf9faf9-kube-api-access-rzvnw\") pod \"2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dbgh9x\" (UID: \"ba906546-9977-4466-8ca3-c513ccf9faf9\") " pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dbgh9x" Jun 09 15:07:42.019054 ip-10-0-133-239 kubenswrapper[2576]: I0609 15:07:42.018928 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/ba906546-9977-4466-8ca3-c513ccf9faf9-util\") pod \"2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dbgh9x\" (UID: \"ba906546-9977-4466-8ca3-c513ccf9faf9\") " pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dbgh9x" Jun 09 15:07:42.120160 ip-10-0-133-239 kubenswrapper[2576]: I0609 15:07:42.120128 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/ba906546-9977-4466-8ca3-c513ccf9faf9-bundle\") pod \"2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dbgh9x\" (UID: \"ba906546-9977-4466-8ca3-c513ccf9faf9\") " pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dbgh9x" Jun 09 15:07:42.120315 ip-10-0-133-239 kubenswrapper[2576]: I0609 15:07:42.120167 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rzvnw\" (UniqueName: \"kubernetes.io/projected/ba906546-9977-4466-8ca3-c513ccf9faf9-kube-api-access-rzvnw\") pod \"2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dbgh9x\" (UID: \"ba906546-9977-4466-8ca3-c513ccf9faf9\") " pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dbgh9x" Jun 09 15:07:42.120315 ip-10-0-133-239 kubenswrapper[2576]: I0609 15:07:42.120189 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/ba906546-9977-4466-8ca3-c513ccf9faf9-util\") pod \"2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dbgh9x\" (UID: \"ba906546-9977-4466-8ca3-c513ccf9faf9\") " pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dbgh9x" Jun 09 15:07:42.120516 ip-10-0-133-239 kubenswrapper[2576]: I0609 15:07:42.120502 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/ba906546-9977-4466-8ca3-c513ccf9faf9-util\") pod \"2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dbgh9x\" (UID: \"ba906546-9977-4466-8ca3-c513ccf9faf9\") " pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dbgh9x" Jun 09 15:07:42.120603 ip-10-0-133-239 kubenswrapper[2576]: I0609 15:07:42.120584 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/ba906546-9977-4466-8ca3-c513ccf9faf9-bundle\") pod \"2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dbgh9x\" (UID: \"ba906546-9977-4466-8ca3-c513ccf9faf9\") " pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dbgh9x" Jun 09 15:07:42.127844 ip-10-0-133-239 kubenswrapper[2576]: I0609 15:07:42.127813 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-rzvnw\" (UniqueName: \"kubernetes.io/projected/ba906546-9977-4466-8ca3-c513ccf9faf9-kube-api-access-rzvnw\") pod \"2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dbgh9x\" (UID: \"ba906546-9977-4466-8ca3-c513ccf9faf9\") " pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dbgh9x" Jun 09 15:07:42.214409 ip-10-0-133-239 kubenswrapper[2576]: I0609 15:07:42.214336 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dbgh9x" Jun 09 15:07:42.340037 ip-10-0-133-239 kubenswrapper[2576]: I0609 15:07:42.340012 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dbgh9x"] Jun 09 15:07:42.342583 ip-10-0-133-239 kubenswrapper[2576]: W0609 15:07:42.342558 2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podba906546_9977_4466_8ca3_c513ccf9faf9.slice/crio-89b0d68ecbba263aa34e9d264c7f1c3ff9007ec6a7fe63f2635b08a189e6f876 WatchSource:0}: Error finding container 89b0d68ecbba263aa34e9d264c7f1c3ff9007ec6a7fe63f2635b08a189e6f876: Status 404 returned error can't find the container with id 89b0d68ecbba263aa34e9d264c7f1c3ff9007ec6a7fe63f2635b08a189e6f876 Jun 09 15:07:42.344808 ip-10-0-133-239 kubenswrapper[2576]: I0609 15:07:42.344793 2576 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jun 09 15:07:42.913912 ip-10-0-133-239 kubenswrapper[2576]: I0609 15:07:42.913878 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dbgh9x" event={"ID":"ba906546-9977-4466-8ca3-c513ccf9faf9","Type":"ContainerStarted","Data":"89b0d68ecbba263aa34e9d264c7f1c3ff9007ec6a7fe63f2635b08a189e6f876"} Jun 09 15:07:52.959328 ip-10-0-133-239 kubenswrapper[2576]: I0609 15:07:52.959292 2576 generic.go:356] "Generic (PLEG): container finished" podID="ba906546-9977-4466-8ca3-c513ccf9faf9" containerID="f44686d66146cefa59b26d16afbdecb4b1d47b00258ef792b725049f16287c91" exitCode=0 Jun 09 15:07:52.959711 ip-10-0-133-239 kubenswrapper[2576]: I0609 15:07:52.959375 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dbgh9x" event={"ID":"ba906546-9977-4466-8ca3-c513ccf9faf9","Type":"ContainerDied","Data":"f44686d66146cefa59b26d16afbdecb4b1d47b00258ef792b725049f16287c91"} Jun 09 15:07:55.973141 ip-10-0-133-239 kubenswrapper[2576]: I0609 15:07:55.973106 2576 generic.go:356] "Generic (PLEG): container finished" podID="ba906546-9977-4466-8ca3-c513ccf9faf9" containerID="4fdb8c6c9644ceae91922ebc876fd4056ba1f4d6738ac1918ea681ee90838ae7" exitCode=0 Jun 09 15:07:55.973542 ip-10-0-133-239 kubenswrapper[2576]: I0609 15:07:55.973195 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dbgh9x" event={"ID":"ba906546-9977-4466-8ca3-c513ccf9faf9","Type":"ContainerDied","Data":"4fdb8c6c9644ceae91922ebc876fd4056ba1f4d6738ac1918ea681ee90838ae7"} Jun 09 15:08:05.010708 ip-10-0-133-239 kubenswrapper[2576]: I0609 15:08:05.010673 2576 generic.go:356] "Generic (PLEG): container finished" podID="ba906546-9977-4466-8ca3-c513ccf9faf9" containerID="78278a2b295ec41af7a944f1174d24d46aa361474200ec804675d04a818a2f47" exitCode=0 Jun 09 15:08:05.011085 ip-10-0-133-239 kubenswrapper[2576]: I0609 15:08:05.010717 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dbgh9x" event={"ID":"ba906546-9977-4466-8ca3-c513ccf9faf9","Type":"ContainerDied","Data":"78278a2b295ec41af7a944f1174d24d46aa361474200ec804675d04a818a2f47"} Jun 09 15:08:06.154795 ip-10-0-133-239 kubenswrapper[2576]: I0609 15:08:06.154768 2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dbgh9x" Jun 09 15:08:06.231098 ip-10-0-133-239 kubenswrapper[2576]: I0609 15:08:06.231055 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/ba906546-9977-4466-8ca3-c513ccf9faf9-bundle\") pod \"ba906546-9977-4466-8ca3-c513ccf9faf9\" (UID: \"ba906546-9977-4466-8ca3-c513ccf9faf9\") " Jun 09 15:08:06.231697 ip-10-0-133-239 kubenswrapper[2576]: I0609 15:08:06.231674 2576 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/ba906546-9977-4466-8ca3-c513ccf9faf9-bundle" (OuterVolumeSpecName: "bundle") pod "ba906546-9977-4466-8ca3-c513ccf9faf9" (UID: "ba906546-9977-4466-8ca3-c513ccf9faf9"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 09 15:08:06.331844 ip-10-0-133-239 kubenswrapper[2576]: I0609 15:08:06.331764 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/ba906546-9977-4466-8ca3-c513ccf9faf9-util\") pod \"ba906546-9977-4466-8ca3-c513ccf9faf9\" (UID: \"ba906546-9977-4466-8ca3-c513ccf9faf9\") " Jun 09 15:08:06.331844 ip-10-0-133-239 kubenswrapper[2576]: I0609 15:08:06.331805 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-rzvnw\" (UniqueName: \"kubernetes.io/projected/ba906546-9977-4466-8ca3-c513ccf9faf9-kube-api-access-rzvnw\") pod \"ba906546-9977-4466-8ca3-c513ccf9faf9\" (UID: \"ba906546-9977-4466-8ca3-c513ccf9faf9\") " Jun 09 15:08:06.332031 ip-10-0-133-239 kubenswrapper[2576]: I0609 15:08:06.331970 2576 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/ba906546-9977-4466-8ca3-c513ccf9faf9-bundle\") on node \"ip-10-0-133-239.ec2.internal\" DevicePath \"\"" Jun 09 15:08:06.333919 ip-10-0-133-239 kubenswrapper[2576]: I0609 15:08:06.333872 2576 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/ba906546-9977-4466-8ca3-c513ccf9faf9-kube-api-access-rzvnw" (OuterVolumeSpecName: "kube-api-access-rzvnw") pod "ba906546-9977-4466-8ca3-c513ccf9faf9" (UID: "ba906546-9977-4466-8ca3-c513ccf9faf9"). InnerVolumeSpecName "kube-api-access-rzvnw". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 09 15:08:06.338175 ip-10-0-133-239 kubenswrapper[2576]: I0609 15:08:06.338145 2576 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/ba906546-9977-4466-8ca3-c513ccf9faf9-util" (OuterVolumeSpecName: "util") pod "ba906546-9977-4466-8ca3-c513ccf9faf9" (UID: "ba906546-9977-4466-8ca3-c513ccf9faf9"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 09 15:08:06.432639 ip-10-0-133-239 kubenswrapper[2576]: I0609 15:08:06.432608 2576 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/ba906546-9977-4466-8ca3-c513ccf9faf9-util\") on node \"ip-10-0-133-239.ec2.internal\" DevicePath \"\"" Jun 09 15:08:06.432639 ip-10-0-133-239 kubenswrapper[2576]: I0609 15:08:06.432637 2576 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-rzvnw\" (UniqueName: \"kubernetes.io/projected/ba906546-9977-4466-8ca3-c513ccf9faf9-kube-api-access-rzvnw\") on node \"ip-10-0-133-239.ec2.internal\" DevicePath \"\"" Jun 09 15:08:07.019060 ip-10-0-133-239 kubenswrapper[2576]: I0609 15:08:07.019027 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dbgh9x" event={"ID":"ba906546-9977-4466-8ca3-c513ccf9faf9","Type":"ContainerDied","Data":"89b0d68ecbba263aa34e9d264c7f1c3ff9007ec6a7fe63f2635b08a189e6f876"} Jun 09 15:08:07.019060 ip-10-0-133-239 kubenswrapper[2576]: I0609 15:08:07.019049 2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dbgh9x" Jun 09 15:08:07.019269 ip-10-0-133-239 kubenswrapper[2576]: I0609 15:08:07.019101 2576 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="89b0d68ecbba263aa34e9d264c7f1c3ff9007ec6a7fe63f2635b08a189e6f876" Jun 09 15:08:14.847584 ip-10-0-133-239 kubenswrapper[2576]: I0609 15:08:14.847552 2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["cert-manager-operator/cert-manager-operator-controller-manager-57757f7cfc-2wscr"] Jun 09 15:08:14.848035 ip-10-0-133-239 kubenswrapper[2576]: I0609 15:08:14.847822 2576 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="ba906546-9977-4466-8ca3-c513ccf9faf9" containerName="pull" Jun 09 15:08:14.848035 ip-10-0-133-239 kubenswrapper[2576]: I0609 15:08:14.847833 2576 state_mem.go:107] "Deleted CPUSet assignment" podUID="ba906546-9977-4466-8ca3-c513ccf9faf9" containerName="pull" Jun 09 15:08:14.848035 ip-10-0-133-239 kubenswrapper[2576]: I0609 15:08:14.847843 2576 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="ba906546-9977-4466-8ca3-c513ccf9faf9" containerName="extract" Jun 09 15:08:14.848035 ip-10-0-133-239 kubenswrapper[2576]: I0609 15:08:14.847849 2576 state_mem.go:107] "Deleted CPUSet assignment" podUID="ba906546-9977-4466-8ca3-c513ccf9faf9" containerName="extract" Jun 09 15:08:14.848035 ip-10-0-133-239 kubenswrapper[2576]: I0609 15:08:14.847865 2576 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="ba906546-9977-4466-8ca3-c513ccf9faf9" containerName="util" Jun 09 15:08:14.848035 ip-10-0-133-239 kubenswrapper[2576]: I0609 15:08:14.847870 2576 state_mem.go:107] "Deleted CPUSet assignment" podUID="ba906546-9977-4466-8ca3-c513ccf9faf9" containerName="util" Jun 09 15:08:14.848035 ip-10-0-133-239 kubenswrapper[2576]: I0609 15:08:14.847923 2576 memory_manager.go:368] "RemoveStaleState removing state" podUID="ba906546-9977-4466-8ca3-c513ccf9faf9" containerName="extract" Jun 09 15:08:14.850059 ip-10-0-133-239 kubenswrapper[2576]: I0609 15:08:14.850044 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager-operator/cert-manager-operator-controller-manager-57757f7cfc-2wscr" Jun 09 15:08:14.852758 ip-10-0-133-239 kubenswrapper[2576]: I0609 15:08:14.852736 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager-operator\"/\"openshift-service-ca.crt\"" Jun 09 15:08:14.852853 ip-10-0-133-239 kubenswrapper[2576]: I0609 15:08:14.852773 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager-operator\"/\"kube-root-ca.crt\"" Jun 09 15:08:14.853015 ip-10-0-133-239 kubenswrapper[2576]: I0609 15:08:14.853002 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"cert-manager-operator\"/\"cert-manager-operator-controller-manager-dockercfg-mdg7k\"" Jun 09 15:08:14.864902 ip-10-0-133-239 kubenswrapper[2576]: I0609 15:08:14.864882 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager-operator/cert-manager-operator-controller-manager-57757f7cfc-2wscr"] Jun 09 15:08:14.999036 ip-10-0-133-239 kubenswrapper[2576]: I0609 15:08:14.999000 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2sw75\" (UniqueName: \"kubernetes.io/projected/611b06da-d638-4c77-8496-668b18c60204-kube-api-access-2sw75\") pod \"cert-manager-operator-controller-manager-57757f7cfc-2wscr\" (UID: \"611b06da-d638-4c77-8496-668b18c60204\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-57757f7cfc-2wscr" Jun 09 15:08:14.999036 ip-10-0-133-239 kubenswrapper[2576]: I0609 15:08:14.999039 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/611b06da-d638-4c77-8496-668b18c60204-tmp\") pod \"cert-manager-operator-controller-manager-57757f7cfc-2wscr\" (UID: \"611b06da-d638-4c77-8496-668b18c60204\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-57757f7cfc-2wscr" Jun 09 15:08:15.099964 ip-10-0-133-239 kubenswrapper[2576]: I0609 15:08:15.099883 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2sw75\" (UniqueName: \"kubernetes.io/projected/611b06da-d638-4c77-8496-668b18c60204-kube-api-access-2sw75\") pod \"cert-manager-operator-controller-manager-57757f7cfc-2wscr\" (UID: \"611b06da-d638-4c77-8496-668b18c60204\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-57757f7cfc-2wscr" Jun 09 15:08:15.099964 ip-10-0-133-239 kubenswrapper[2576]: I0609 15:08:15.099918 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/611b06da-d638-4c77-8496-668b18c60204-tmp\") pod \"cert-manager-operator-controller-manager-57757f7cfc-2wscr\" (UID: \"611b06da-d638-4c77-8496-668b18c60204\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-57757f7cfc-2wscr" Jun 09 15:08:15.100272 ip-10-0-133-239 kubenswrapper[2576]: I0609 15:08:15.100253 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/611b06da-d638-4c77-8496-668b18c60204-tmp\") pod \"cert-manager-operator-controller-manager-57757f7cfc-2wscr\" (UID: \"611b06da-d638-4c77-8496-668b18c60204\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-57757f7cfc-2wscr" Jun 09 15:08:15.109051 ip-10-0-133-239 kubenswrapper[2576]: I0609 15:08:15.109028 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-2sw75\" (UniqueName: \"kubernetes.io/projected/611b06da-d638-4c77-8496-668b18c60204-kube-api-access-2sw75\") pod \"cert-manager-operator-controller-manager-57757f7cfc-2wscr\" (UID: \"611b06da-d638-4c77-8496-668b18c60204\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-57757f7cfc-2wscr" Jun 09 15:08:15.158920 ip-10-0-133-239 kubenswrapper[2576]: I0609 15:08:15.158894 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager-operator/cert-manager-operator-controller-manager-57757f7cfc-2wscr" Jun 09 15:08:15.289112 ip-10-0-133-239 kubenswrapper[2576]: I0609 15:08:15.289087 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager-operator/cert-manager-operator-controller-manager-57757f7cfc-2wscr"] Jun 09 15:08:15.291976 ip-10-0-133-239 kubenswrapper[2576]: W0609 15:08:15.291950 2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod611b06da_d638_4c77_8496_668b18c60204.slice/crio-f780f5cbd76ff76ac652395432af73131cdca2a042cefd57e006ed1409a6be71 WatchSource:0}: Error finding container f780f5cbd76ff76ac652395432af73131cdca2a042cefd57e006ed1409a6be71: Status 404 returned error can't find the container with id f780f5cbd76ff76ac652395432af73131cdca2a042cefd57e006ed1409a6be71 Jun 09 15:08:16.053346 ip-10-0-133-239 kubenswrapper[2576]: I0609 15:08:16.053305 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager-operator/cert-manager-operator-controller-manager-57757f7cfc-2wscr" event={"ID":"611b06da-d638-4c77-8496-668b18c60204","Type":"ContainerStarted","Data":"f780f5cbd76ff76ac652395432af73131cdca2a042cefd57e006ed1409a6be71"} Jun 09 15:08:17.059280 ip-10-0-133-239 kubenswrapper[2576]: I0609 15:08:17.059248 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager-operator/cert-manager-operator-controller-manager-57757f7cfc-2wscr" event={"ID":"611b06da-d638-4c77-8496-668b18c60204","Type":"ContainerStarted","Data":"be8c4b378d003d46f30ba90e6186ff2d38c51cd16f572909a3a97585272346ad"} Jun 09 15:08:17.099510 ip-10-0-133-239 kubenswrapper[2576]: I0609 15:08:17.099464 2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="cert-manager-operator/cert-manager-operator-controller-manager-57757f7cfc-2wscr" podStartSLOduration=1.505609371 podStartE2EDuration="3.099448784s" totalImagesPullingTime="1.593839413s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-09 15:08:14 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-09 15:08:17.096646608 +0000 UTC m=+411.950802846" watchObservedRunningTime="2026-06-09 15:08:17.099448784 +0000 UTC m=+411.953605024" Jun 09 15:08:18.989756 ip-10-0-133-239 kubenswrapper[2576]: I0609 15:08:18.989723 2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fvdblj"] Jun 09 15:08:18.992046 ip-10-0-133-239 kubenswrapper[2576]: I0609 15:08:18.992030 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fvdblj" Jun 09 15:08:18.995134 ip-10-0-133-239 kubenswrapper[2576]: I0609 15:08:18.995100 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"openshift-service-ca.crt\"" Jun 09 15:08:18.995869 ip-10-0-133-239 kubenswrapper[2576]: I0609 15:08:18.995854 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-marketplace\"/\"default-dockercfg-sjd8c\"" Jun 09 15:08:18.995983 ip-10-0-133-239 kubenswrapper[2576]: I0609 15:08:18.995854 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"kube-root-ca.crt\"" Jun 09 15:08:19.005018 ip-10-0-133-239 kubenswrapper[2576]: I0609 15:08:19.004996 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fvdblj"] Jun 09 15:08:19.030960 ip-10-0-133-239 kubenswrapper[2576]: I0609 15:08:19.030926 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6ff7w\" (UniqueName: \"kubernetes.io/projected/96311453-a609-4932-9913-5e1fa28d1d7a-kube-api-access-6ff7w\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fvdblj\" (UID: \"96311453-a609-4932-9913-5e1fa28d1d7a\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fvdblj" Jun 09 15:08:19.030960 ip-10-0-133-239 kubenswrapper[2576]: I0609 15:08:19.030961 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/96311453-a609-4932-9913-5e1fa28d1d7a-bundle\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fvdblj\" (UID: \"96311453-a609-4932-9913-5e1fa28d1d7a\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fvdblj" Jun 09 15:08:19.031147 ip-10-0-133-239 kubenswrapper[2576]: I0609 15:08:19.030983 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/96311453-a609-4932-9913-5e1fa28d1d7a-util\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fvdblj\" (UID: \"96311453-a609-4932-9913-5e1fa28d1d7a\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fvdblj" Jun 09 15:08:19.132168 ip-10-0-133-239 kubenswrapper[2576]: I0609 15:08:19.132136 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/96311453-a609-4932-9913-5e1fa28d1d7a-bundle\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fvdblj\" (UID: \"96311453-a609-4932-9913-5e1fa28d1d7a\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fvdblj" Jun 09 15:08:19.132168 ip-10-0-133-239 kubenswrapper[2576]: I0609 15:08:19.132175 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/96311453-a609-4932-9913-5e1fa28d1d7a-util\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fvdblj\" (UID: \"96311453-a609-4932-9913-5e1fa28d1d7a\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fvdblj" Jun 09 15:08:19.132387 ip-10-0-133-239 kubenswrapper[2576]: I0609 15:08:19.132234 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6ff7w\" (UniqueName: \"kubernetes.io/projected/96311453-a609-4932-9913-5e1fa28d1d7a-kube-api-access-6ff7w\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fvdblj\" (UID: \"96311453-a609-4932-9913-5e1fa28d1d7a\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fvdblj" Jun 09 15:08:19.132523 ip-10-0-133-239 kubenswrapper[2576]: I0609 15:08:19.132505 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/96311453-a609-4932-9913-5e1fa28d1d7a-bundle\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fvdblj\" (UID: \"96311453-a609-4932-9913-5e1fa28d1d7a\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fvdblj" Jun 09 15:08:19.132563 ip-10-0-133-239 kubenswrapper[2576]: I0609 15:08:19.132526 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/96311453-a609-4932-9913-5e1fa28d1d7a-util\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fvdblj\" (UID: \"96311453-a609-4932-9913-5e1fa28d1d7a\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fvdblj" Jun 09 15:08:19.140299 ip-10-0-133-239 kubenswrapper[2576]: I0609 15:08:19.140267 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-6ff7w\" (UniqueName: \"kubernetes.io/projected/96311453-a609-4932-9913-5e1fa28d1d7a-kube-api-access-6ff7w\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fvdblj\" (UID: \"96311453-a609-4932-9913-5e1fa28d1d7a\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fvdblj" Jun 09 15:08:19.300883 ip-10-0-133-239 kubenswrapper[2576]: I0609 15:08:19.300859 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fvdblj" Jun 09 15:08:19.428751 ip-10-0-133-239 kubenswrapper[2576]: I0609 15:08:19.428703 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fvdblj"] Jun 09 15:08:19.430789 ip-10-0-133-239 kubenswrapper[2576]: W0609 15:08:19.430759 2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod96311453_a609_4932_9913_5e1fa28d1d7a.slice/crio-14cceff40dd8526ad3ae58497e81888a66a0affe57658d3ba1430b8fcdb35e52 WatchSource:0}: Error finding container 14cceff40dd8526ad3ae58497e81888a66a0affe57658d3ba1430b8fcdb35e52: Status 404 returned error can't find the container with id 14cceff40dd8526ad3ae58497e81888a66a0affe57658d3ba1430b8fcdb35e52 Jun 09 15:08:20.074817 ip-10-0-133-239 kubenswrapper[2576]: I0609 15:08:20.074788 2576 generic.go:356] "Generic (PLEG): container finished" podID="96311453-a609-4932-9913-5e1fa28d1d7a" containerID="3ebc0a1b9263cf599ea1fdbf30efb3e6e0871eda0b35bacf7905ea039f7a876d" exitCode=0 Jun 09 15:08:20.075228 ip-10-0-133-239 kubenswrapper[2576]: I0609 15:08:20.074827 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fvdblj" event={"ID":"96311453-a609-4932-9913-5e1fa28d1d7a","Type":"ContainerDied","Data":"3ebc0a1b9263cf599ea1fdbf30efb3e6e0871eda0b35bacf7905ea039f7a876d"} Jun 09 15:08:20.075228 ip-10-0-133-239 kubenswrapper[2576]: I0609 15:08:20.074861 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fvdblj" event={"ID":"96311453-a609-4932-9913-5e1fa28d1d7a","Type":"ContainerStarted","Data":"14cceff40dd8526ad3ae58497e81888a66a0affe57658d3ba1430b8fcdb35e52"} Jun 09 15:08:22.089869 ip-10-0-133-239 kubenswrapper[2576]: I0609 15:08:22.089832 2576 generic.go:356] "Generic (PLEG): container finished" podID="96311453-a609-4932-9913-5e1fa28d1d7a" containerID="d8108a15b7be57950d599a23407ede53d8c90df5b40ab8ef3730fed9267bf34b" exitCode=0 Jun 09 15:08:22.090231 ip-10-0-133-239 kubenswrapper[2576]: I0609 15:08:22.089883 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fvdblj" event={"ID":"96311453-a609-4932-9913-5e1fa28d1d7a","Type":"ContainerDied","Data":"d8108a15b7be57950d599a23407ede53d8c90df5b40ab8ef3730fed9267bf34b"} Jun 09 15:08:23.095897 ip-10-0-133-239 kubenswrapper[2576]: I0609 15:08:23.095864 2576 generic.go:356] "Generic (PLEG): container finished" podID="96311453-a609-4932-9913-5e1fa28d1d7a" containerID="b13080233ad623a778109fd6f5390b961c0eaa4a4f4763d2eb4d538615ef3cf9" exitCode=0 Jun 09 15:08:23.096341 ip-10-0-133-239 kubenswrapper[2576]: I0609 15:08:23.095943 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fvdblj" event={"ID":"96311453-a609-4932-9913-5e1fa28d1d7a","Type":"ContainerDied","Data":"b13080233ad623a778109fd6f5390b961c0eaa4a4f4763d2eb4d538615ef3cf9"} Jun 09 15:08:24.218493 ip-10-0-133-239 kubenswrapper[2576]: I0609 15:08:24.218468 2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fvdblj" Jun 09 15:08:24.271245 ip-10-0-133-239 kubenswrapper[2576]: I0609 15:08:24.271211 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/96311453-a609-4932-9913-5e1fa28d1d7a-bundle\") pod \"96311453-a609-4932-9913-5e1fa28d1d7a\" (UID: \"96311453-a609-4932-9913-5e1fa28d1d7a\") " Jun 09 15:08:24.271245 ip-10-0-133-239 kubenswrapper[2576]: I0609 15:08:24.271249 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/96311453-a609-4932-9913-5e1fa28d1d7a-util\") pod \"96311453-a609-4932-9913-5e1fa28d1d7a\" (UID: \"96311453-a609-4932-9913-5e1fa28d1d7a\") " Jun 09 15:08:24.271471 ip-10-0-133-239 kubenswrapper[2576]: I0609 15:08:24.271328 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-6ff7w\" (UniqueName: \"kubernetes.io/projected/96311453-a609-4932-9913-5e1fa28d1d7a-kube-api-access-6ff7w\") pod \"96311453-a609-4932-9913-5e1fa28d1d7a\" (UID: \"96311453-a609-4932-9913-5e1fa28d1d7a\") " Jun 09 15:08:24.271634 ip-10-0-133-239 kubenswrapper[2576]: I0609 15:08:24.271613 2576 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/96311453-a609-4932-9913-5e1fa28d1d7a-bundle" (OuterVolumeSpecName: "bundle") pod "96311453-a609-4932-9913-5e1fa28d1d7a" (UID: "96311453-a609-4932-9913-5e1fa28d1d7a"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 09 15:08:24.273524 ip-10-0-133-239 kubenswrapper[2576]: I0609 15:08:24.273500 2576 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/96311453-a609-4932-9913-5e1fa28d1d7a-kube-api-access-6ff7w" (OuterVolumeSpecName: "kube-api-access-6ff7w") pod "96311453-a609-4932-9913-5e1fa28d1d7a" (UID: "96311453-a609-4932-9913-5e1fa28d1d7a"). InnerVolumeSpecName "kube-api-access-6ff7w". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 09 15:08:24.276671 ip-10-0-133-239 kubenswrapper[2576]: I0609 15:08:24.276653 2576 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/96311453-a609-4932-9913-5e1fa28d1d7a-util" (OuterVolumeSpecName: "util") pod "96311453-a609-4932-9913-5e1fa28d1d7a" (UID: "96311453-a609-4932-9913-5e1fa28d1d7a"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 09 15:08:24.372577 ip-10-0-133-239 kubenswrapper[2576]: I0609 15:08:24.372493 2576 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/96311453-a609-4932-9913-5e1fa28d1d7a-bundle\") on node \"ip-10-0-133-239.ec2.internal\" DevicePath \"\"" Jun 09 15:08:24.372577 ip-10-0-133-239 kubenswrapper[2576]: I0609 15:08:24.372522 2576 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/96311453-a609-4932-9913-5e1fa28d1d7a-util\") on node \"ip-10-0-133-239.ec2.internal\" DevicePath \"\"" Jun 09 15:08:24.372577 ip-10-0-133-239 kubenswrapper[2576]: I0609 15:08:24.372532 2576 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-6ff7w\" (UniqueName: \"kubernetes.io/projected/96311453-a609-4932-9913-5e1fa28d1d7a-kube-api-access-6ff7w\") on node \"ip-10-0-133-239.ec2.internal\" DevicePath \"\"" Jun 09 15:08:25.106263 ip-10-0-133-239 kubenswrapper[2576]: I0609 15:08:25.106228 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fvdblj" event={"ID":"96311453-a609-4932-9913-5e1fa28d1d7a","Type":"ContainerDied","Data":"14cceff40dd8526ad3ae58497e81888a66a0affe57658d3ba1430b8fcdb35e52"} Jun 09 15:08:25.106425 ip-10-0-133-239 kubenswrapper[2576]: I0609 15:08:25.106270 2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fvdblj" Jun 09 15:08:25.106425 ip-10-0-133-239 kubenswrapper[2576]: I0609 15:08:25.106278 2576 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="14cceff40dd8526ad3ae58497e81888a66a0affe57658d3ba1430b8fcdb35e52" Jun 09 15:08:25.416058 ip-10-0-133-239 kubenswrapper[2576]: I0609 15:08:25.415976 2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["cert-manager/cert-manager-cainjector-5d99449ffd-9dfv9"] Jun 09 15:08:25.416438 ip-10-0-133-239 kubenswrapper[2576]: I0609 15:08:25.416269 2576 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="96311453-a609-4932-9913-5e1fa28d1d7a" containerName="pull" Jun 09 15:08:25.416438 ip-10-0-133-239 kubenswrapper[2576]: I0609 15:08:25.416279 2576 state_mem.go:107] "Deleted CPUSet assignment" podUID="96311453-a609-4932-9913-5e1fa28d1d7a" containerName="pull" Jun 09 15:08:25.416438 ip-10-0-133-239 kubenswrapper[2576]: I0609 15:08:25.416289 2576 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="96311453-a609-4932-9913-5e1fa28d1d7a" containerName="util" Jun 09 15:08:25.416438 ip-10-0-133-239 kubenswrapper[2576]: I0609 15:08:25.416295 2576 state_mem.go:107] "Deleted CPUSet assignment" podUID="96311453-a609-4932-9913-5e1fa28d1d7a" containerName="util" Jun 09 15:08:25.416438 ip-10-0-133-239 kubenswrapper[2576]: I0609 15:08:25.416310 2576 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="96311453-a609-4932-9913-5e1fa28d1d7a" containerName="extract" Jun 09 15:08:25.416438 ip-10-0-133-239 kubenswrapper[2576]: I0609 15:08:25.416325 2576 state_mem.go:107] "Deleted CPUSet assignment" podUID="96311453-a609-4932-9913-5e1fa28d1d7a" containerName="extract" Jun 09 15:08:25.416438 ip-10-0-133-239 kubenswrapper[2576]: I0609 15:08:25.416372 2576 memory_manager.go:368] "RemoveStaleState removing state" podUID="96311453-a609-4932-9913-5e1fa28d1d7a" containerName="extract" Jun 09 15:08:25.418342 ip-10-0-133-239 kubenswrapper[2576]: I0609 15:08:25.418324 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-cainjector-5d99449ffd-9dfv9" Jun 09 15:08:25.420844 ip-10-0-133-239 kubenswrapper[2576]: I0609 15:08:25.420826 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager\"/\"kube-root-ca.crt\"" Jun 09 15:08:25.421097 ip-10-0-133-239 kubenswrapper[2576]: I0609 15:08:25.421083 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager\"/\"openshift-service-ca.crt\"" Jun 09 15:08:25.421155 ip-10-0-133-239 kubenswrapper[2576]: I0609 15:08:25.421138 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"cert-manager\"/\"cert-manager-cainjector-dockercfg-4jng5\"" Jun 09 15:08:25.429887 ip-10-0-133-239 kubenswrapper[2576]: I0609 15:08:25.429866 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-cainjector-5d99449ffd-9dfv9"] Jun 09 15:08:25.479261 ip-10-0-133-239 kubenswrapper[2576]: I0609 15:08:25.479233 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-cbhw9\" (UniqueName: \"kubernetes.io/projected/0c336389-2e19-4316-9c2b-3458d4932b5a-kube-api-access-cbhw9\") pod \"cert-manager-cainjector-5d99449ffd-9dfv9\" (UID: \"0c336389-2e19-4316-9c2b-3458d4932b5a\") " pod="cert-manager/cert-manager-cainjector-5d99449ffd-9dfv9" Jun 09 15:08:25.479375 ip-10-0-133-239 kubenswrapper[2576]: I0609 15:08:25.479315 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/0c336389-2e19-4316-9c2b-3458d4932b5a-bound-sa-token\") pod \"cert-manager-cainjector-5d99449ffd-9dfv9\" (UID: \"0c336389-2e19-4316-9c2b-3458d4932b5a\") " pod="cert-manager/cert-manager-cainjector-5d99449ffd-9dfv9" Jun 09 15:08:25.579873 ip-10-0-133-239 kubenswrapper[2576]: I0609 15:08:25.579845 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-cbhw9\" (UniqueName: \"kubernetes.io/projected/0c336389-2e19-4316-9c2b-3458d4932b5a-kube-api-access-cbhw9\") pod \"cert-manager-cainjector-5d99449ffd-9dfv9\" (UID: \"0c336389-2e19-4316-9c2b-3458d4932b5a\") " pod="cert-manager/cert-manager-cainjector-5d99449ffd-9dfv9" Jun 09 15:08:25.579995 ip-10-0-133-239 kubenswrapper[2576]: I0609 15:08:25.579905 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/0c336389-2e19-4316-9c2b-3458d4932b5a-bound-sa-token\") pod \"cert-manager-cainjector-5d99449ffd-9dfv9\" (UID: \"0c336389-2e19-4316-9c2b-3458d4932b5a\") " pod="cert-manager/cert-manager-cainjector-5d99449ffd-9dfv9" Jun 09 15:08:25.587728 ip-10-0-133-239 kubenswrapper[2576]: I0609 15:08:25.587706 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager\"/\"kube-root-ca.crt\"" Jun 09 15:08:25.587830 ip-10-0-133-239 kubenswrapper[2576]: I0609 15:08:25.587708 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/0c336389-2e19-4316-9c2b-3458d4932b5a-bound-sa-token\") pod \"cert-manager-cainjector-5d99449ffd-9dfv9\" (UID: \"0c336389-2e19-4316-9c2b-3458d4932b5a\") " pod="cert-manager/cert-manager-cainjector-5d99449ffd-9dfv9" Jun 09 15:08:25.599089 ip-10-0-133-239 kubenswrapper[2576]: I0609 15:08:25.599056 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager\"/\"openshift-service-ca.crt\"" Jun 09 15:08:25.608919 ip-10-0-133-239 kubenswrapper[2576]: I0609 15:08:25.608899 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-cbhw9\" (UniqueName: \"kubernetes.io/projected/0c336389-2e19-4316-9c2b-3458d4932b5a-kube-api-access-cbhw9\") pod \"cert-manager-cainjector-5d99449ffd-9dfv9\" (UID: \"0c336389-2e19-4316-9c2b-3458d4932b5a\") " pod="cert-manager/cert-manager-cainjector-5d99449ffd-9dfv9" Jun 09 15:08:25.738047 ip-10-0-133-239 kubenswrapper[2576]: I0609 15:08:25.737976 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"cert-manager\"/\"cert-manager-cainjector-dockercfg-4jng5\"" Jun 09 15:08:25.746127 ip-10-0-133-239 kubenswrapper[2576]: I0609 15:08:25.746112 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-cainjector-5d99449ffd-9dfv9" Jun 09 15:08:25.870936 ip-10-0-133-239 kubenswrapper[2576]: I0609 15:08:25.870914 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-cainjector-5d99449ffd-9dfv9"] Jun 09 15:08:25.875407 ip-10-0-133-239 kubenswrapper[2576]: W0609 15:08:25.873001 2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod0c336389_2e19_4316_9c2b_3458d4932b5a.slice/crio-3c69996471bbb468336491cf51fd42f3db788a4d9c59d9ef9c05865a0fedd8ce WatchSource:0}: Error finding container 3c69996471bbb468336491cf51fd42f3db788a4d9c59d9ef9c05865a0fedd8ce: Status 404 returned error can't find the container with id 3c69996471bbb468336491cf51fd42f3db788a4d9c59d9ef9c05865a0fedd8ce Jun 09 15:08:26.111332 ip-10-0-133-239 kubenswrapper[2576]: I0609 15:08:26.111301 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-cainjector-5d99449ffd-9dfv9" event={"ID":"0c336389-2e19-4316-9c2b-3458d4932b5a","Type":"ContainerStarted","Data":"3c69996471bbb468336491cf51fd42f3db788a4d9c59d9ef9c05865a0fedd8ce"} Jun 09 15:08:29.127257 ip-10-0-133-239 kubenswrapper[2576]: I0609 15:08:29.127217 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-cainjector-5d99449ffd-9dfv9" event={"ID":"0c336389-2e19-4316-9c2b-3458d4932b5a","Type":"ContainerStarted","Data":"ab430e8752e56c7f3fb2bbafb9d42d94f606e587c9c5a03d7e465eb7e9e8b3b5"} Jun 09 15:08:29.142034 ip-10-0-133-239 kubenswrapper[2576]: I0609 15:08:29.141989 2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="cert-manager/cert-manager-cainjector-5d99449ffd-9dfv9" podStartSLOduration=1.759988754 podStartE2EDuration="4.141974494s" totalImagesPullingTime="2.38198574s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-09 15:08:25 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-09 15:08:29.141017047 +0000 UTC m=+423.995173285" watchObservedRunningTime="2026-06-09 15:08:29.141974494 +0000 UTC m=+423.996130732" Jun 09 15:08:40.232222 ip-10-0-133-239 kubenswrapper[2576]: I0609 15:08:40.232138 2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-marketplace/410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cdjtw7d"] Jun 09 15:08:40.234692 ip-10-0-133-239 kubenswrapper[2576]: I0609 15:08:40.234670 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cdjtw7d" Jun 09 15:08:40.237022 ip-10-0-133-239 kubenswrapper[2576]: I0609 15:08:40.237000 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"kube-root-ca.crt\"" Jun 09 15:08:40.237149 ip-10-0-133-239 kubenswrapper[2576]: I0609 15:08:40.237093 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"openshift-service-ca.crt\"" Jun 09 15:08:40.238114 ip-10-0-133-239 kubenswrapper[2576]: I0609 15:08:40.238099 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-marketplace\"/\"default-dockercfg-sjd8c\"" Jun 09 15:08:40.243308 ip-10-0-133-239 kubenswrapper[2576]: I0609 15:08:40.243286 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cdjtw7d"] Jun 09 15:08:40.297656 ip-10-0-133-239 kubenswrapper[2576]: I0609 15:08:40.297628 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/cacb0e23-9d08-4921-8942-b448b12385ff-bundle\") pod \"410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cdjtw7d\" (UID: \"cacb0e23-9d08-4921-8942-b448b12385ff\") " pod="openshift-marketplace/410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cdjtw7d" Jun 09 15:08:40.297784 ip-10-0-133-239 kubenswrapper[2576]: I0609 15:08:40.297728 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/cacb0e23-9d08-4921-8942-b448b12385ff-util\") pod \"410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cdjtw7d\" (UID: \"cacb0e23-9d08-4921-8942-b448b12385ff\") " pod="openshift-marketplace/410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cdjtw7d" Jun 09 15:08:40.297784 ip-10-0-133-239 kubenswrapper[2576]: I0609 15:08:40.297747 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5fbwc\" (UniqueName: \"kubernetes.io/projected/cacb0e23-9d08-4921-8942-b448b12385ff-kube-api-access-5fbwc\") pod \"410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cdjtw7d\" (UID: \"cacb0e23-9d08-4921-8942-b448b12385ff\") " pod="openshift-marketplace/410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cdjtw7d" Jun 09 15:08:40.398733 ip-10-0-133-239 kubenswrapper[2576]: I0609 15:08:40.398697 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/cacb0e23-9d08-4921-8942-b448b12385ff-util\") pod \"410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cdjtw7d\" (UID: \"cacb0e23-9d08-4921-8942-b448b12385ff\") " pod="openshift-marketplace/410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cdjtw7d" Jun 09 15:08:40.398733 ip-10-0-133-239 kubenswrapper[2576]: I0609 15:08:40.398735 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5fbwc\" (UniqueName: \"kubernetes.io/projected/cacb0e23-9d08-4921-8942-b448b12385ff-kube-api-access-5fbwc\") pod \"410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cdjtw7d\" (UID: \"cacb0e23-9d08-4921-8942-b448b12385ff\") " pod="openshift-marketplace/410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cdjtw7d" Jun 09 15:08:40.398928 ip-10-0-133-239 kubenswrapper[2576]: I0609 15:08:40.398764 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/cacb0e23-9d08-4921-8942-b448b12385ff-bundle\") pod \"410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cdjtw7d\" (UID: \"cacb0e23-9d08-4921-8942-b448b12385ff\") " pod="openshift-marketplace/410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cdjtw7d" Jun 09 15:08:40.399106 ip-10-0-133-239 kubenswrapper[2576]: I0609 15:08:40.399088 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/cacb0e23-9d08-4921-8942-b448b12385ff-util\") pod \"410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cdjtw7d\" (UID: \"cacb0e23-9d08-4921-8942-b448b12385ff\") " pod="openshift-marketplace/410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cdjtw7d" Jun 09 15:08:40.399151 ip-10-0-133-239 kubenswrapper[2576]: I0609 15:08:40.399122 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/cacb0e23-9d08-4921-8942-b448b12385ff-bundle\") pod \"410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cdjtw7d\" (UID: \"cacb0e23-9d08-4921-8942-b448b12385ff\") " pod="openshift-marketplace/410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cdjtw7d" Jun 09 15:08:40.406985 ip-10-0-133-239 kubenswrapper[2576]: I0609 15:08:40.406968 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-5fbwc\" (UniqueName: \"kubernetes.io/projected/cacb0e23-9d08-4921-8942-b448b12385ff-kube-api-access-5fbwc\") pod \"410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cdjtw7d\" (UID: \"cacb0e23-9d08-4921-8942-b448b12385ff\") " pod="openshift-marketplace/410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cdjtw7d" Jun 09 15:08:40.544873 ip-10-0-133-239 kubenswrapper[2576]: I0609 15:08:40.544849 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cdjtw7d" Jun 09 15:08:40.672657 ip-10-0-133-239 kubenswrapper[2576]: I0609 15:08:40.672630 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cdjtw7d"] Jun 09 15:08:40.674142 ip-10-0-133-239 kubenswrapper[2576]: W0609 15:08:40.674117 2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podcacb0e23_9d08_4921_8942_b448b12385ff.slice/crio-d4c70f57449bd1d4b3bbebb7c3d0ba03bcb569d9d4efc3f16f61f075a3a2c8c7 WatchSource:0}: Error finding container d4c70f57449bd1d4b3bbebb7c3d0ba03bcb569d9d4efc3f16f61f075a3a2c8c7: Status 404 returned error can't find the container with id d4c70f57449bd1d4b3bbebb7c3d0ba03bcb569d9d4efc3f16f61f075a3a2c8c7 Jun 09 15:08:41.178671 ip-10-0-133-239 kubenswrapper[2576]: I0609 15:08:41.178634 2576 generic.go:356] "Generic (PLEG): container finished" podID="cacb0e23-9d08-4921-8942-b448b12385ff" containerID="9934ba12acca4aa4e7a3372bb3581204b4b170208abb1d86b2d5382c399cd470" exitCode=0 Jun 09 15:08:41.178855 ip-10-0-133-239 kubenswrapper[2576]: I0609 15:08:41.178732 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cdjtw7d" event={"ID":"cacb0e23-9d08-4921-8942-b448b12385ff","Type":"ContainerDied","Data":"9934ba12acca4aa4e7a3372bb3581204b4b170208abb1d86b2d5382c399cd470"} Jun 09 15:08:41.178855 ip-10-0-133-239 kubenswrapper[2576]: I0609 15:08:41.178778 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cdjtw7d" event={"ID":"cacb0e23-9d08-4921-8942-b448b12385ff","Type":"ContainerStarted","Data":"d4c70f57449bd1d4b3bbebb7c3d0ba03bcb569d9d4efc3f16f61f075a3a2c8c7"} Jun 09 15:08:42.184380 ip-10-0-133-239 kubenswrapper[2576]: I0609 15:08:42.184348 2576 generic.go:356] "Generic (PLEG): container finished" podID="cacb0e23-9d08-4921-8942-b448b12385ff" containerID="759f3a9cc7697dc31dfa5b70a02c4b3385e007d5e67a244dfb16e3df2f69496e" exitCode=0 Jun 09 15:08:42.184772 ip-10-0-133-239 kubenswrapper[2576]: I0609 15:08:42.184384 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cdjtw7d" event={"ID":"cacb0e23-9d08-4921-8942-b448b12385ff","Type":"ContainerDied","Data":"759f3a9cc7697dc31dfa5b70a02c4b3385e007d5e67a244dfb16e3df2f69496e"} Jun 09 15:08:43.190205 ip-10-0-133-239 kubenswrapper[2576]: I0609 15:08:43.190173 2576 generic.go:356] "Generic (PLEG): container finished" podID="cacb0e23-9d08-4921-8942-b448b12385ff" containerID="82d350bb6ed47ba7a291bdad2fccf055cc253a36274bf86890c7f67fa4f36b81" exitCode=0 Jun 09 15:08:43.190549 ip-10-0-133-239 kubenswrapper[2576]: I0609 15:08:43.190226 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cdjtw7d" event={"ID":"cacb0e23-9d08-4921-8942-b448b12385ff","Type":"ContainerDied","Data":"82d350bb6ed47ba7a291bdad2fccf055cc253a36274bf86890c7f67fa4f36b81"} Jun 09 15:08:44.338503 ip-10-0-133-239 kubenswrapper[2576]: I0609 15:08:44.338476 2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cdjtw7d" Jun 09 15:08:44.437014 ip-10-0-133-239 kubenswrapper[2576]: I0609 15:08:44.436983 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/cacb0e23-9d08-4921-8942-b448b12385ff-util\") pod \"cacb0e23-9d08-4921-8942-b448b12385ff\" (UID: \"cacb0e23-9d08-4921-8942-b448b12385ff\") " Jun 09 15:08:44.437214 ip-10-0-133-239 kubenswrapper[2576]: I0609 15:08:44.437088 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/cacb0e23-9d08-4921-8942-b448b12385ff-bundle\") pod \"cacb0e23-9d08-4921-8942-b448b12385ff\" (UID: \"cacb0e23-9d08-4921-8942-b448b12385ff\") " Jun 09 15:08:44.437214 ip-10-0-133-239 kubenswrapper[2576]: I0609 15:08:44.437152 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-5fbwc\" (UniqueName: \"kubernetes.io/projected/cacb0e23-9d08-4921-8942-b448b12385ff-kube-api-access-5fbwc\") pod \"cacb0e23-9d08-4921-8942-b448b12385ff\" (UID: \"cacb0e23-9d08-4921-8942-b448b12385ff\") " Jun 09 15:08:44.437872 ip-10-0-133-239 kubenswrapper[2576]: I0609 15:08:44.437847 2576 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/cacb0e23-9d08-4921-8942-b448b12385ff-bundle" (OuterVolumeSpecName: "bundle") pod "cacb0e23-9d08-4921-8942-b448b12385ff" (UID: "cacb0e23-9d08-4921-8942-b448b12385ff"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 09 15:08:44.439146 ip-10-0-133-239 kubenswrapper[2576]: I0609 15:08:44.439121 2576 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/cacb0e23-9d08-4921-8942-b448b12385ff-kube-api-access-5fbwc" (OuterVolumeSpecName: "kube-api-access-5fbwc") pod "cacb0e23-9d08-4921-8942-b448b12385ff" (UID: "cacb0e23-9d08-4921-8942-b448b12385ff"). InnerVolumeSpecName "kube-api-access-5fbwc". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 09 15:08:44.442606 ip-10-0-133-239 kubenswrapper[2576]: I0609 15:08:44.442585 2576 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/cacb0e23-9d08-4921-8942-b448b12385ff-util" (OuterVolumeSpecName: "util") pod "cacb0e23-9d08-4921-8942-b448b12385ff" (UID: "cacb0e23-9d08-4921-8942-b448b12385ff"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 09 15:08:44.538517 ip-10-0-133-239 kubenswrapper[2576]: I0609 15:08:44.538490 2576 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-5fbwc\" (UniqueName: \"kubernetes.io/projected/cacb0e23-9d08-4921-8942-b448b12385ff-kube-api-access-5fbwc\") on node \"ip-10-0-133-239.ec2.internal\" DevicePath \"\"" Jun 09 15:08:44.538517 ip-10-0-133-239 kubenswrapper[2576]: I0609 15:08:44.538515 2576 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/cacb0e23-9d08-4921-8942-b448b12385ff-util\") on node \"ip-10-0-133-239.ec2.internal\" DevicePath \"\"" Jun 09 15:08:44.538682 ip-10-0-133-239 kubenswrapper[2576]: I0609 15:08:44.538526 2576 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/cacb0e23-9d08-4921-8942-b448b12385ff-bundle\") on node \"ip-10-0-133-239.ec2.internal\" DevicePath \"\"" Jun 09 15:08:45.200170 ip-10-0-133-239 kubenswrapper[2576]: I0609 15:08:45.200136 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cdjtw7d" event={"ID":"cacb0e23-9d08-4921-8942-b448b12385ff","Type":"ContainerDied","Data":"d4c70f57449bd1d4b3bbebb7c3d0ba03bcb569d9d4efc3f16f61f075a3a2c8c7"} Jun 09 15:08:45.200170 ip-10-0-133-239 kubenswrapper[2576]: I0609 15:08:45.200167 2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cdjtw7d" Jun 09 15:08:45.200441 ip-10-0-133-239 kubenswrapper[2576]: I0609 15:08:45.200182 2576 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="d4c70f57449bd1d4b3bbebb7c3d0ba03bcb569d9d4efc3f16f61f075a3a2c8c7" Jun 09 15:08:52.414137 ip-10-0-133-239 kubenswrapper[2576]: I0609 15:08:52.414107 2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-568b7788b7-ddt5f"] Jun 09 15:08:52.414490 ip-10-0-133-239 kubenswrapper[2576]: I0609 15:08:52.414409 2576 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="cacb0e23-9d08-4921-8942-b448b12385ff" containerName="pull" Jun 09 15:08:52.414490 ip-10-0-133-239 kubenswrapper[2576]: I0609 15:08:52.414421 2576 state_mem.go:107] "Deleted CPUSet assignment" podUID="cacb0e23-9d08-4921-8942-b448b12385ff" containerName="pull" Jun 09 15:08:52.414490 ip-10-0-133-239 kubenswrapper[2576]: I0609 15:08:52.414432 2576 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="cacb0e23-9d08-4921-8942-b448b12385ff" containerName="extract" Jun 09 15:08:52.414490 ip-10-0-133-239 kubenswrapper[2576]: I0609 15:08:52.414437 2576 state_mem.go:107] "Deleted CPUSet assignment" podUID="cacb0e23-9d08-4921-8942-b448b12385ff" containerName="extract" Jun 09 15:08:52.414490 ip-10-0-133-239 kubenswrapper[2576]: I0609 15:08:52.414447 2576 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="cacb0e23-9d08-4921-8942-b448b12385ff" containerName="util" Jun 09 15:08:52.414490 ip-10-0-133-239 kubenswrapper[2576]: I0609 15:08:52.414453 2576 state_mem.go:107] "Deleted CPUSet assignment" podUID="cacb0e23-9d08-4921-8942-b448b12385ff" containerName="util" Jun 09 15:08:52.414690 ip-10-0-133-239 kubenswrapper[2576]: I0609 15:08:52.414508 2576 memory_manager.go:368] "RemoveStaleState removing state" podUID="cacb0e23-9d08-4921-8942-b448b12385ff" containerName="extract" Jun 09 15:08:52.418731 ip-10-0-133-239 kubenswrapper[2576]: I0609 15:08:52.418713 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-568b7788b7-ddt5f" Jun 09 15:08:52.421053 ip-10-0-133-239 kubenswrapper[2576]: I0609 15:08:52.421035 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-service-cert\"" Jun 09 15:08:52.421310 ip-10-0-133-239 kubenswrapper[2576]: I0609 15:08:52.421296 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"openshift-service-ca.crt\"" Jun 09 15:08:52.421467 ip-10-0-133-239 kubenswrapper[2576]: I0609 15:08:52.421448 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"kube-root-ca.crt\"" Jun 09 15:08:52.421525 ip-10-0-133-239 kubenswrapper[2576]: I0609 15:08:52.421456 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-dockercfg-z5fwv\"" Jun 09 15:08:52.421673 ip-10-0-133-239 kubenswrapper[2576]: I0609 15:08:52.421659 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-webhook-cert\"" Jun 09 15:08:52.428087 ip-10-0-133-239 kubenswrapper[2576]: I0609 15:08:52.428047 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-568b7788b7-ddt5f"] Jun 09 15:08:52.502905 ip-10-0-133-239 kubenswrapper[2576]: I0609 15:08:52.502873 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/c3e37a2f-b0ac-42cd-b0fb-29981e7273df-apiservice-cert\") pod \"opendatahub-operator-controller-manager-568b7788b7-ddt5f\" (UID: \"c3e37a2f-b0ac-42cd-b0fb-29981e7273df\") " pod="opendatahub/opendatahub-operator-controller-manager-568b7788b7-ddt5f" Jun 09 15:08:52.502905 ip-10-0-133-239 kubenswrapper[2576]: I0609 15:08:52.502905 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/c3e37a2f-b0ac-42cd-b0fb-29981e7273df-tmp\") pod \"opendatahub-operator-controller-manager-568b7788b7-ddt5f\" (UID: \"c3e37a2f-b0ac-42cd-b0fb-29981e7273df\") " pod="opendatahub/opendatahub-operator-controller-manager-568b7788b7-ddt5f" Jun 09 15:08:52.503218 ip-10-0-133-239 kubenswrapper[2576]: I0609 15:08:52.502924 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/c3e37a2f-b0ac-42cd-b0fb-29981e7273df-webhook-cert\") pod \"opendatahub-operator-controller-manager-568b7788b7-ddt5f\" (UID: \"c3e37a2f-b0ac-42cd-b0fb-29981e7273df\") " pod="opendatahub/opendatahub-operator-controller-manager-568b7788b7-ddt5f" Jun 09 15:08:52.503218 ip-10-0-133-239 kubenswrapper[2576]: I0609 15:08:52.502981 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/c3e37a2f-b0ac-42cd-b0fb-29981e7273df-manifests\") pod \"opendatahub-operator-controller-manager-568b7788b7-ddt5f\" (UID: \"c3e37a2f-b0ac-42cd-b0fb-29981e7273df\") " pod="opendatahub/opendatahub-operator-controller-manager-568b7788b7-ddt5f" Jun 09 15:08:52.503218 ip-10-0-133-239 kubenswrapper[2576]: I0609 15:08:52.503088 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9ck6j\" (UniqueName: \"kubernetes.io/projected/c3e37a2f-b0ac-42cd-b0fb-29981e7273df-kube-api-access-9ck6j\") pod \"opendatahub-operator-controller-manager-568b7788b7-ddt5f\" (UID: \"c3e37a2f-b0ac-42cd-b0fb-29981e7273df\") " pod="opendatahub/opendatahub-operator-controller-manager-568b7788b7-ddt5f" Jun 09 15:08:52.603839 ip-10-0-133-239 kubenswrapper[2576]: I0609 15:08:52.603805 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9ck6j\" (UniqueName: \"kubernetes.io/projected/c3e37a2f-b0ac-42cd-b0fb-29981e7273df-kube-api-access-9ck6j\") pod \"opendatahub-operator-controller-manager-568b7788b7-ddt5f\" (UID: \"c3e37a2f-b0ac-42cd-b0fb-29981e7273df\") " pod="opendatahub/opendatahub-operator-controller-manager-568b7788b7-ddt5f" Jun 09 15:08:52.604018 ip-10-0-133-239 kubenswrapper[2576]: I0609 15:08:52.603848 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/c3e37a2f-b0ac-42cd-b0fb-29981e7273df-apiservice-cert\") pod \"opendatahub-operator-controller-manager-568b7788b7-ddt5f\" (UID: \"c3e37a2f-b0ac-42cd-b0fb-29981e7273df\") " pod="opendatahub/opendatahub-operator-controller-manager-568b7788b7-ddt5f" Jun 09 15:08:52.604018 ip-10-0-133-239 kubenswrapper[2576]: I0609 15:08:52.603867 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/c3e37a2f-b0ac-42cd-b0fb-29981e7273df-tmp\") pod \"opendatahub-operator-controller-manager-568b7788b7-ddt5f\" (UID: \"c3e37a2f-b0ac-42cd-b0fb-29981e7273df\") " pod="opendatahub/opendatahub-operator-controller-manager-568b7788b7-ddt5f" Jun 09 15:08:52.604018 ip-10-0-133-239 kubenswrapper[2576]: I0609 15:08:52.603992 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/c3e37a2f-b0ac-42cd-b0fb-29981e7273df-webhook-cert\") pod \"opendatahub-operator-controller-manager-568b7788b7-ddt5f\" (UID: \"c3e37a2f-b0ac-42cd-b0fb-29981e7273df\") " pod="opendatahub/opendatahub-operator-controller-manager-568b7788b7-ddt5f" Jun 09 15:08:52.604219 ip-10-0-133-239 kubenswrapper[2576]: I0609 15:08:52.604049 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/c3e37a2f-b0ac-42cd-b0fb-29981e7273df-manifests\") pod \"opendatahub-operator-controller-manager-568b7788b7-ddt5f\" (UID: \"c3e37a2f-b0ac-42cd-b0fb-29981e7273df\") " pod="opendatahub/opendatahub-operator-controller-manager-568b7788b7-ddt5f" Jun 09 15:08:52.604354 ip-10-0-133-239 kubenswrapper[2576]: I0609 15:08:52.604335 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/c3e37a2f-b0ac-42cd-b0fb-29981e7273df-manifests\") pod \"opendatahub-operator-controller-manager-568b7788b7-ddt5f\" (UID: \"c3e37a2f-b0ac-42cd-b0fb-29981e7273df\") " pod="opendatahub/opendatahub-operator-controller-manager-568b7788b7-ddt5f" Jun 09 15:08:52.610720 ip-10-0-133-239 kubenswrapper[2576]: I0609 15:08:52.606479 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/c3e37a2f-b0ac-42cd-b0fb-29981e7273df-tmp\") pod \"opendatahub-operator-controller-manager-568b7788b7-ddt5f\" (UID: \"c3e37a2f-b0ac-42cd-b0fb-29981e7273df\") " pod="opendatahub/opendatahub-operator-controller-manager-568b7788b7-ddt5f" Jun 09 15:08:52.611354 ip-10-0-133-239 kubenswrapper[2576]: I0609 15:08:52.611332 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/c3e37a2f-b0ac-42cd-b0fb-29981e7273df-webhook-cert\") pod \"opendatahub-operator-controller-manager-568b7788b7-ddt5f\" (UID: \"c3e37a2f-b0ac-42cd-b0fb-29981e7273df\") " pod="opendatahub/opendatahub-operator-controller-manager-568b7788b7-ddt5f" Jun 09 15:08:52.611444 ip-10-0-133-239 kubenswrapper[2576]: I0609 15:08:52.611368 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/c3e37a2f-b0ac-42cd-b0fb-29981e7273df-apiservice-cert\") pod \"opendatahub-operator-controller-manager-568b7788b7-ddt5f\" (UID: \"c3e37a2f-b0ac-42cd-b0fb-29981e7273df\") " pod="opendatahub/opendatahub-operator-controller-manager-568b7788b7-ddt5f" Jun 09 15:08:52.616861 ip-10-0-133-239 kubenswrapper[2576]: I0609 15:08:52.616842 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-9ck6j\" (UniqueName: \"kubernetes.io/projected/c3e37a2f-b0ac-42cd-b0fb-29981e7273df-kube-api-access-9ck6j\") pod \"opendatahub-operator-controller-manager-568b7788b7-ddt5f\" (UID: \"c3e37a2f-b0ac-42cd-b0fb-29981e7273df\") " pod="opendatahub/opendatahub-operator-controller-manager-568b7788b7-ddt5f" Jun 09 15:08:52.730059 ip-10-0-133-239 kubenswrapper[2576]: I0609 15:08:52.729972 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-568b7788b7-ddt5f" Jun 09 15:08:52.867280 ip-10-0-133-239 kubenswrapper[2576]: I0609 15:08:52.867240 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-568b7788b7-ddt5f"] Jun 09 15:08:52.869984 ip-10-0-133-239 kubenswrapper[2576]: W0609 15:08:52.869960 2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc3e37a2f_b0ac_42cd_b0fb_29981e7273df.slice/crio-c2f6d66893344fee0a547dcd66d889e8e4ec32461f104d2623dac5dec5bad11d WatchSource:0}: Error finding container c2f6d66893344fee0a547dcd66d889e8e4ec32461f104d2623dac5dec5bad11d: Status 404 returned error can't find the container with id c2f6d66893344fee0a547dcd66d889e8e4ec32461f104d2623dac5dec5bad11d Jun 09 15:08:53.235379 ip-10-0-133-239 kubenswrapper[2576]: I0609 15:08:53.235344 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-568b7788b7-ddt5f" event={"ID":"c3e37a2f-b0ac-42cd-b0fb-29981e7273df","Type":"ContainerStarted","Data":"c2f6d66893344fee0a547dcd66d889e8e4ec32461f104d2623dac5dec5bad11d"} Jun 09 15:08:56.251173 ip-10-0-133-239 kubenswrapper[2576]: I0609 15:08:56.251130 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-568b7788b7-ddt5f" event={"ID":"c3e37a2f-b0ac-42cd-b0fb-29981e7273df","Type":"ContainerStarted","Data":"23abeb6b341c079c112193003a2f291054c8f0d24e3e21a985516e1b18fc672e"} Jun 09 15:08:57.257489 ip-10-0-133-239 kubenswrapper[2576]: I0609 15:08:57.257452 2576 generic.go:356] "Generic (PLEG): container finished" podID="c3e37a2f-b0ac-42cd-b0fb-29981e7273df" containerID="23abeb6b341c079c112193003a2f291054c8f0d24e3e21a985516e1b18fc672e" exitCode=0 Jun 09 15:08:57.257982 ip-10-0-133-239 kubenswrapper[2576]: I0609 15:08:57.257500 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-568b7788b7-ddt5f" event={"ID":"c3e37a2f-b0ac-42cd-b0fb-29981e7273df","Type":"ContainerDied","Data":"23abeb6b341c079c112193003a2f291054c8f0d24e3e21a985516e1b18fc672e"} Jun 09 15:08:58.265410 ip-10-0-133-239 kubenswrapper[2576]: I0609 15:08:58.265369 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-568b7788b7-ddt5f" event={"ID":"c3e37a2f-b0ac-42cd-b0fb-29981e7273df","Type":"ContainerStarted","Data":"1a16e3e830efb7291bf64a7bc1ae8fa515321379ac9a5b1f2315797530c6edf5"} Jun 09 15:08:58.265788 ip-10-0-133-239 kubenswrapper[2576]: I0609 15:08:58.265465 2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/opendatahub-operator-controller-manager-568b7788b7-ddt5f" Jun 09 15:08:58.286645 ip-10-0-133-239 kubenswrapper[2576]: I0609 15:08:58.286600 2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/opendatahub-operator-controller-manager-568b7788b7-ddt5f" podStartSLOduration=1.8687739319999999 podStartE2EDuration="6.286584549s" totalImagesPullingTime="3.472103384s" totalInitContainerRuntime="945.707233ms" isStatefulPod=false podCreationTimestamp="2026-06-09 15:08:52 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-09 15:08:58.285505609 +0000 UTC m=+453.139661847" watchObservedRunningTime="2026-06-09 15:08:58.286584549 +0000 UTC m=+453.140740779" Jun 09 15:09:09.272208 ip-10-0-133-239 kubenswrapper[2576]: I0609 15:09:09.272175 2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/opendatahub-operator-controller-manager-568b7788b7-ddt5f" Jun 09 15:09:11.844683 ip-10-0-133-239 kubenswrapper[2576]: I0609 15:09:11.844650 2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/kube-auth-proxy-ccff6cfb8-jqj95"] Jun 09 15:09:11.848172 ip-10-0-133-239 kubenswrapper[2576]: I0609 15:09:11.848152 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/kube-auth-proxy-ccff6cfb8-jqj95" Jun 09 15:09:11.849737 ip-10-0-133-239 kubenswrapper[2576]: I0609 15:09:11.849714 2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-marketplace/4258531154569488b4b06856545cf53ed48b82e88ddd64b4ce22efab06rm4j2"] Jun 09 15:09:11.850768 ip-10-0-133-239 kubenswrapper[2576]: I0609 15:09:11.850745 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-dockercfg-4jhlw\"" Jun 09 15:09:11.850876 ip-10-0-133-239 kubenswrapper[2576]: I0609 15:09:11.850779 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-creds\"" Jun 09 15:09:11.851790 ip-10-0-133-239 kubenswrapper[2576]: I0609 15:09:11.851770 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-tls\"" Jun 09 15:09:11.853474 ip-10-0-133-239 kubenswrapper[2576]: I0609 15:09:11.853456 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/4258531154569488b4b06856545cf53ed48b82e88ddd64b4ce22efab06rm4j2" Jun 09 15:09:11.855531 ip-10-0-133-239 kubenswrapper[2576]: I0609 15:09:11.855506 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-marketplace\"/\"default-dockercfg-sjd8c\"" Jun 09 15:09:11.855942 ip-10-0-133-239 kubenswrapper[2576]: I0609 15:09:11.855530 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"kube-root-ca.crt\"" Jun 09 15:09:11.855942 ip-10-0-133-239 kubenswrapper[2576]: I0609 15:09:11.855877 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"openshift-service-ca.crt\"" Jun 09 15:09:11.875463 ip-10-0-133-239 kubenswrapper[2576]: I0609 15:09:11.875430 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/kube-auth-proxy-ccff6cfb8-jqj95"] Jun 09 15:09:11.877755 ip-10-0-133-239 kubenswrapper[2576]: I0609 15:09:11.877738 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/4258531154569488b4b06856545cf53ed48b82e88ddd64b4ce22efab06rm4j2"] Jun 09 15:09:11.925306 ip-10-0-133-239 kubenswrapper[2576]: I0609 15:09:11.925278 2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/odh-model-controller-6dc94f689f-z2vjj"] Jun 09 15:09:11.928661 ip-10-0-133-239 kubenswrapper[2576]: I0609 15:09:11.928625 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/odh-model-controller-6dc94f689f-z2vjj" Jun 09 15:09:11.930891 ip-10-0-133-239 kubenswrapper[2576]: I0609 15:09:11.930868 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"odh-model-controller-webhook-cert\"" Jun 09 15:09:11.930990 ip-10-0-133-239 kubenswrapper[2576]: I0609 15:09:11.930875 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"odh-model-controller-dockercfg-wsdxb\"" Jun 09 15:09:11.942376 ip-10-0-133-239 kubenswrapper[2576]: I0609 15:09:11.942353 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/odh-model-controller-6dc94f689f-z2vjj"] Jun 09 15:09:11.964466 ip-10-0-133-239 kubenswrapper[2576]: I0609 15:09:11.964444 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/f3f09014-a8c9-4937-b4b8-8dcf0bff7ef2-bundle\") pod \"4258531154569488b4b06856545cf53ed48b82e88ddd64b4ce22efab06rm4j2\" (UID: \"f3f09014-a8c9-4937-b4b8-8dcf0bff7ef2\") " pod="openshift-marketplace/4258531154569488b4b06856545cf53ed48b82e88ddd64b4ce22efab06rm4j2" Jun 09 15:09:11.964591 ip-10-0-133-239 kubenswrapper[2576]: I0609 15:09:11.964476 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-whrxh\" (UniqueName: \"kubernetes.io/projected/f3f09014-a8c9-4937-b4b8-8dcf0bff7ef2-kube-api-access-whrxh\") pod \"4258531154569488b4b06856545cf53ed48b82e88ddd64b4ce22efab06rm4j2\" (UID: \"f3f09014-a8c9-4937-b4b8-8dcf0bff7ef2\") " pod="openshift-marketplace/4258531154569488b4b06856545cf53ed48b82e88ddd64b4ce22efab06rm4j2" Jun 09 15:09:11.964591 ip-10-0-133-239 kubenswrapper[2576]: I0609 15:09:11.964510 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/f3f09014-a8c9-4937-b4b8-8dcf0bff7ef2-util\") pod \"4258531154569488b4b06856545cf53ed48b82e88ddd64b4ce22efab06rm4j2\" (UID: \"f3f09014-a8c9-4937-b4b8-8dcf0bff7ef2\") " pod="openshift-marketplace/4258531154569488b4b06856545cf53ed48b82e88ddd64b4ce22efab06rm4j2" Jun 09 15:09:11.964591 ip-10-0-133-239 kubenswrapper[2576]: I0609 15:09:11.964557 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6z4mg\" (UniqueName: \"kubernetes.io/projected/7dc1c3ee-d724-4eb5-af0c-8425f99c30df-kube-api-access-6z4mg\") pod \"kube-auth-proxy-ccff6cfb8-jqj95\" (UID: \"7dc1c3ee-d724-4eb5-af0c-8425f99c30df\") " pod="openshift-ingress/kube-auth-proxy-ccff6cfb8-jqj95" Jun 09 15:09:11.964716 ip-10-0-133-239 kubenswrapper[2576]: I0609 15:09:11.964673 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/7dc1c3ee-d724-4eb5-af0c-8425f99c30df-tmp\") pod \"kube-auth-proxy-ccff6cfb8-jqj95\" (UID: \"7dc1c3ee-d724-4eb5-af0c-8425f99c30df\") " pod="openshift-ingress/kube-auth-proxy-ccff6cfb8-jqj95" Jun 09 15:09:11.964760 ip-10-0-133-239 kubenswrapper[2576]: I0609 15:09:11.964734 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/7dc1c3ee-d724-4eb5-af0c-8425f99c30df-tls-certs\") pod \"kube-auth-proxy-ccff6cfb8-jqj95\" (UID: \"7dc1c3ee-d724-4eb5-af0c-8425f99c30df\") " pod="openshift-ingress/kube-auth-proxy-ccff6cfb8-jqj95" Jun 09 15:09:12.066146 ip-10-0-133-239 kubenswrapper[2576]: I0609 15:09:12.066113 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/7dc1c3ee-d724-4eb5-af0c-8425f99c30df-tmp\") pod \"kube-auth-proxy-ccff6cfb8-jqj95\" (UID: \"7dc1c3ee-d724-4eb5-af0c-8425f99c30df\") " pod="openshift-ingress/kube-auth-proxy-ccff6cfb8-jqj95" Jun 09 15:09:12.066332 ip-10-0-133-239 kubenswrapper[2576]: I0609 15:09:12.066160 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hhjc9\" (UniqueName: \"kubernetes.io/projected/6177fcda-a66c-4a79-b71c-b2c694782679-kube-api-access-hhjc9\") pod \"odh-model-controller-6dc94f689f-z2vjj\" (UID: \"6177fcda-a66c-4a79-b71c-b2c694782679\") " pod="opendatahub/odh-model-controller-6dc94f689f-z2vjj" Jun 09 15:09:12.066332 ip-10-0-133-239 kubenswrapper[2576]: I0609 15:09:12.066200 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/6177fcda-a66c-4a79-b71c-b2c694782679-cert\") pod \"odh-model-controller-6dc94f689f-z2vjj\" (UID: \"6177fcda-a66c-4a79-b71c-b2c694782679\") " pod="opendatahub/odh-model-controller-6dc94f689f-z2vjj" Jun 09 15:09:12.066332 ip-10-0-133-239 kubenswrapper[2576]: I0609 15:09:12.066235 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/7dc1c3ee-d724-4eb5-af0c-8425f99c30df-tls-certs\") pod \"kube-auth-proxy-ccff6cfb8-jqj95\" (UID: \"7dc1c3ee-d724-4eb5-af0c-8425f99c30df\") " pod="openshift-ingress/kube-auth-proxy-ccff6cfb8-jqj95" Jun 09 15:09:12.066332 ip-10-0-133-239 kubenswrapper[2576]: I0609 15:09:12.066280 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/f3f09014-a8c9-4937-b4b8-8dcf0bff7ef2-bundle\") pod \"4258531154569488b4b06856545cf53ed48b82e88ddd64b4ce22efab06rm4j2\" (UID: \"f3f09014-a8c9-4937-b4b8-8dcf0bff7ef2\") " pod="openshift-marketplace/4258531154569488b4b06856545cf53ed48b82e88ddd64b4ce22efab06rm4j2" Jun 09 15:09:12.066332 ip-10-0-133-239 kubenswrapper[2576]: I0609 15:09:12.066310 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-whrxh\" (UniqueName: \"kubernetes.io/projected/f3f09014-a8c9-4937-b4b8-8dcf0bff7ef2-kube-api-access-whrxh\") pod \"4258531154569488b4b06856545cf53ed48b82e88ddd64b4ce22efab06rm4j2\" (UID: \"f3f09014-a8c9-4937-b4b8-8dcf0bff7ef2\") " pod="openshift-marketplace/4258531154569488b4b06856545cf53ed48b82e88ddd64b4ce22efab06rm4j2" Jun 09 15:09:12.066578 ip-10-0-133-239 kubenswrapper[2576]: I0609 15:09:12.066355 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/f3f09014-a8c9-4937-b4b8-8dcf0bff7ef2-util\") pod \"4258531154569488b4b06856545cf53ed48b82e88ddd64b4ce22efab06rm4j2\" (UID: \"f3f09014-a8c9-4937-b4b8-8dcf0bff7ef2\") " pod="openshift-marketplace/4258531154569488b4b06856545cf53ed48b82e88ddd64b4ce22efab06rm4j2" Jun 09 15:09:12.066578 ip-10-0-133-239 kubenswrapper[2576]: I0609 15:09:12.066386 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6z4mg\" (UniqueName: \"kubernetes.io/projected/7dc1c3ee-d724-4eb5-af0c-8425f99c30df-kube-api-access-6z4mg\") pod \"kube-auth-proxy-ccff6cfb8-jqj95\" (UID: \"7dc1c3ee-d724-4eb5-af0c-8425f99c30df\") " pod="openshift-ingress/kube-auth-proxy-ccff6cfb8-jqj95" Jun 09 15:09:12.066702 ip-10-0-133-239 kubenswrapper[2576]: I0609 15:09:12.066676 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/f3f09014-a8c9-4937-b4b8-8dcf0bff7ef2-bundle\") pod \"4258531154569488b4b06856545cf53ed48b82e88ddd64b4ce22efab06rm4j2\" (UID: \"f3f09014-a8c9-4937-b4b8-8dcf0bff7ef2\") " pod="openshift-marketplace/4258531154569488b4b06856545cf53ed48b82e88ddd64b4ce22efab06rm4j2" Jun 09 15:09:12.066764 ip-10-0-133-239 kubenswrapper[2576]: I0609 15:09:12.066724 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/f3f09014-a8c9-4937-b4b8-8dcf0bff7ef2-util\") pod \"4258531154569488b4b06856545cf53ed48b82e88ddd64b4ce22efab06rm4j2\" (UID: \"f3f09014-a8c9-4937-b4b8-8dcf0bff7ef2\") " pod="openshift-marketplace/4258531154569488b4b06856545cf53ed48b82e88ddd64b4ce22efab06rm4j2" Jun 09 15:09:12.068553 ip-10-0-133-239 kubenswrapper[2576]: I0609 15:09:12.068529 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/7dc1c3ee-d724-4eb5-af0c-8425f99c30df-tmp\") pod \"kube-auth-proxy-ccff6cfb8-jqj95\" (UID: \"7dc1c3ee-d724-4eb5-af0c-8425f99c30df\") " pod="openshift-ingress/kube-auth-proxy-ccff6cfb8-jqj95" Jun 09 15:09:12.068666 ip-10-0-133-239 kubenswrapper[2576]: I0609 15:09:12.068650 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/7dc1c3ee-d724-4eb5-af0c-8425f99c30df-tls-certs\") pod \"kube-auth-proxy-ccff6cfb8-jqj95\" (UID: \"7dc1c3ee-d724-4eb5-af0c-8425f99c30df\") " pod="openshift-ingress/kube-auth-proxy-ccff6cfb8-jqj95" Jun 09 15:09:12.074521 ip-10-0-133-239 kubenswrapper[2576]: I0609 15:09:12.074497 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-6z4mg\" (UniqueName: \"kubernetes.io/projected/7dc1c3ee-d724-4eb5-af0c-8425f99c30df-kube-api-access-6z4mg\") pod \"kube-auth-proxy-ccff6cfb8-jqj95\" (UID: \"7dc1c3ee-d724-4eb5-af0c-8425f99c30df\") " pod="openshift-ingress/kube-auth-proxy-ccff6cfb8-jqj95" Jun 09 15:09:12.074618 ip-10-0-133-239 kubenswrapper[2576]: I0609 15:09:12.074541 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-whrxh\" (UniqueName: \"kubernetes.io/projected/f3f09014-a8c9-4937-b4b8-8dcf0bff7ef2-kube-api-access-whrxh\") pod \"4258531154569488b4b06856545cf53ed48b82e88ddd64b4ce22efab06rm4j2\" (UID: \"f3f09014-a8c9-4937-b4b8-8dcf0bff7ef2\") " pod="openshift-marketplace/4258531154569488b4b06856545cf53ed48b82e88ddd64b4ce22efab06rm4j2" Jun 09 15:09:12.159674 ip-10-0-133-239 kubenswrapper[2576]: I0609 15:09:12.159579 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/kube-auth-proxy-ccff6cfb8-jqj95" Jun 09 15:09:12.164841 ip-10-0-133-239 kubenswrapper[2576]: I0609 15:09:12.164815 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/4258531154569488b4b06856545cf53ed48b82e88ddd64b4ce22efab06rm4j2" Jun 09 15:09:12.167237 ip-10-0-133-239 kubenswrapper[2576]: I0609 15:09:12.167208 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hhjc9\" (UniqueName: \"kubernetes.io/projected/6177fcda-a66c-4a79-b71c-b2c694782679-kube-api-access-hhjc9\") pod \"odh-model-controller-6dc94f689f-z2vjj\" (UID: \"6177fcda-a66c-4a79-b71c-b2c694782679\") " pod="opendatahub/odh-model-controller-6dc94f689f-z2vjj" Jun 09 15:09:12.167365 ip-10-0-133-239 kubenswrapper[2576]: I0609 15:09:12.167261 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/6177fcda-a66c-4a79-b71c-b2c694782679-cert\") pod \"odh-model-controller-6dc94f689f-z2vjj\" (UID: \"6177fcda-a66c-4a79-b71c-b2c694782679\") " pod="opendatahub/odh-model-controller-6dc94f689f-z2vjj" Jun 09 15:09:12.167431 ip-10-0-133-239 kubenswrapper[2576]: E0609 15:09:12.167384 2576 secret.go:189] Couldn't get secret opendatahub/odh-model-controller-webhook-cert: secret "odh-model-controller-webhook-cert" not found Jun 09 15:09:12.167489 ip-10-0-133-239 kubenswrapper[2576]: E0609 15:09:12.167452 2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/6177fcda-a66c-4a79-b71c-b2c694782679-cert podName:6177fcda-a66c-4a79-b71c-b2c694782679 nodeName:}" failed. No retries permitted until 2026-06-09 15:09:12.667432998 +0000 UTC m=+467.521589215 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/6177fcda-a66c-4a79-b71c-b2c694782679-cert") pod "odh-model-controller-6dc94f689f-z2vjj" (UID: "6177fcda-a66c-4a79-b71c-b2c694782679") : secret "odh-model-controller-webhook-cert" not found Jun 09 15:09:12.178892 ip-10-0-133-239 kubenswrapper[2576]: I0609 15:09:12.178861 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-hhjc9\" (UniqueName: \"kubernetes.io/projected/6177fcda-a66c-4a79-b71c-b2c694782679-kube-api-access-hhjc9\") pod \"odh-model-controller-6dc94f689f-z2vjj\" (UID: \"6177fcda-a66c-4a79-b71c-b2c694782679\") " pod="opendatahub/odh-model-controller-6dc94f689f-z2vjj" Jun 09 15:09:12.309624 ip-10-0-133-239 kubenswrapper[2576]: I0609 15:09:12.309585 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/kube-auth-proxy-ccff6cfb8-jqj95"] Jun 09 15:09:12.312608 ip-10-0-133-239 kubenswrapper[2576]: W0609 15:09:12.312583 2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7dc1c3ee_d724_4eb5_af0c_8425f99c30df.slice/crio-cd2ef6ea15fe9ab52da3a4ef2aa1b947ea2f2ef5d4a2d0ba079e0c2271f70c21 WatchSource:0}: Error finding container cd2ef6ea15fe9ab52da3a4ef2aa1b947ea2f2ef5d4a2d0ba079e0c2271f70c21: Status 404 returned error can't find the container with id cd2ef6ea15fe9ab52da3a4ef2aa1b947ea2f2ef5d4a2d0ba079e0c2271f70c21 Jun 09 15:09:12.333580 ip-10-0-133-239 kubenswrapper[2576]: I0609 15:09:12.333560 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/4258531154569488b4b06856545cf53ed48b82e88ddd64b4ce22efab06rm4j2"] Jun 09 15:09:12.336153 ip-10-0-133-239 kubenswrapper[2576]: W0609 15:09:12.336115 2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf3f09014_a8c9_4937_b4b8_8dcf0bff7ef2.slice/crio-2587d4ee790530b052948728db2331bc86e7770c5d618c3343d8962c483edc34 WatchSource:0}: Error finding container 2587d4ee790530b052948728db2331bc86e7770c5d618c3343d8962c483edc34: Status 404 returned error can't find the container with id 2587d4ee790530b052948728db2331bc86e7770c5d618c3343d8962c483edc34 Jun 09 15:09:12.336266 ip-10-0-133-239 kubenswrapper[2576]: I0609 15:09:12.336214 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/kube-auth-proxy-ccff6cfb8-jqj95" event={"ID":"7dc1c3ee-d724-4eb5-af0c-8425f99c30df","Type":"ContainerStarted","Data":"cd2ef6ea15fe9ab52da3a4ef2aa1b947ea2f2ef5d4a2d0ba079e0c2271f70c21"} Jun 09 15:09:12.512531 ip-10-0-133-239 kubenswrapper[2576]: I0609 15:09:12.512501 2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/model-serving-api-5dd488fc48-l6khg"] Jun 09 15:09:12.515654 ip-10-0-133-239 kubenswrapper[2576]: I0609 15:09:12.515630 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/model-serving-api-5dd488fc48-l6khg" Jun 09 15:09:12.518758 ip-10-0-133-239 kubenswrapper[2576]: I0609 15:09:12.518739 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"model-serving-api-tls\"" Jun 09 15:09:12.518849 ip-10-0-133-239 kubenswrapper[2576]: I0609 15:09:12.518834 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"model-serving-api-dockercfg-wncrv\"" Jun 09 15:09:12.527282 ip-10-0-133-239 kubenswrapper[2576]: I0609 15:09:12.527259 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/model-serving-api-5dd488fc48-l6khg"] Jun 09 15:09:12.672762 ip-10-0-133-239 kubenswrapper[2576]: I0609 15:09:12.672724 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-pvgbt\" (UniqueName: \"kubernetes.io/projected/d4365ffd-5d22-45bd-b101-054db6b8e567-kube-api-access-pvgbt\") pod \"model-serving-api-5dd488fc48-l6khg\" (UID: \"d4365ffd-5d22-45bd-b101-054db6b8e567\") " pod="opendatahub/model-serving-api-5dd488fc48-l6khg" Jun 09 15:09:12.672918 ip-10-0-133-239 kubenswrapper[2576]: I0609 15:09:12.672896 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/6177fcda-a66c-4a79-b71c-b2c694782679-cert\") pod \"odh-model-controller-6dc94f689f-z2vjj\" (UID: \"6177fcda-a66c-4a79-b71c-b2c694782679\") " pod="opendatahub/odh-model-controller-6dc94f689f-z2vjj" Jun 09 15:09:12.672960 ip-10-0-133-239 kubenswrapper[2576]: I0609 15:09:12.672924 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/d4365ffd-5d22-45bd-b101-054db6b8e567-tls-certs\") pod \"model-serving-api-5dd488fc48-l6khg\" (UID: \"d4365ffd-5d22-45bd-b101-054db6b8e567\") " pod="opendatahub/model-serving-api-5dd488fc48-l6khg" Jun 09 15:09:12.675658 ip-10-0-133-239 kubenswrapper[2576]: I0609 15:09:12.675626 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/6177fcda-a66c-4a79-b71c-b2c694782679-cert\") pod \"odh-model-controller-6dc94f689f-z2vjj\" (UID: \"6177fcda-a66c-4a79-b71c-b2c694782679\") " pod="opendatahub/odh-model-controller-6dc94f689f-z2vjj" Jun 09 15:09:12.773573 ip-10-0-133-239 kubenswrapper[2576]: I0609 15:09:12.773543 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-pvgbt\" (UniqueName: \"kubernetes.io/projected/d4365ffd-5d22-45bd-b101-054db6b8e567-kube-api-access-pvgbt\") pod \"model-serving-api-5dd488fc48-l6khg\" (UID: \"d4365ffd-5d22-45bd-b101-054db6b8e567\") " pod="opendatahub/model-serving-api-5dd488fc48-l6khg" Jun 09 15:09:12.773770 ip-10-0-133-239 kubenswrapper[2576]: I0609 15:09:12.773665 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/d4365ffd-5d22-45bd-b101-054db6b8e567-tls-certs\") pod \"model-serving-api-5dd488fc48-l6khg\" (UID: \"d4365ffd-5d22-45bd-b101-054db6b8e567\") " pod="opendatahub/model-serving-api-5dd488fc48-l6khg" Jun 09 15:09:12.776040 ip-10-0-133-239 kubenswrapper[2576]: I0609 15:09:12.776014 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/d4365ffd-5d22-45bd-b101-054db6b8e567-tls-certs\") pod \"model-serving-api-5dd488fc48-l6khg\" (UID: \"d4365ffd-5d22-45bd-b101-054db6b8e567\") " pod="opendatahub/model-serving-api-5dd488fc48-l6khg" Jun 09 15:09:12.784043 ip-10-0-133-239 kubenswrapper[2576]: I0609 15:09:12.784019 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-pvgbt\" (UniqueName: \"kubernetes.io/projected/d4365ffd-5d22-45bd-b101-054db6b8e567-kube-api-access-pvgbt\") pod \"model-serving-api-5dd488fc48-l6khg\" (UID: \"d4365ffd-5d22-45bd-b101-054db6b8e567\") " pod="opendatahub/model-serving-api-5dd488fc48-l6khg" Jun 09 15:09:12.826052 ip-10-0-133-239 kubenswrapper[2576]: I0609 15:09:12.826017 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/model-serving-api-5dd488fc48-l6khg" Jun 09 15:09:12.840802 ip-10-0-133-239 kubenswrapper[2576]: I0609 15:09:12.840773 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/odh-model-controller-6dc94f689f-z2vjj" Jun 09 15:09:12.931100 ip-10-0-133-239 kubenswrapper[2576]: I0609 15:09:12.929283 2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-lws-operator/lws-controller-manager-7647c5764b-clqwf"] Jun 09 15:09:12.934794 ip-10-0-133-239 kubenswrapper[2576]: I0609 15:09:12.934447 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/lws-controller-manager-7647c5764b-clqwf" Jun 09 15:09:12.942914 ip-10-0-133-239 kubenswrapper[2576]: I0609 15:09:12.942892 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"kube-root-ca.crt\"" Jun 09 15:09:12.943148 ip-10-0-133-239 kubenswrapper[2576]: I0609 15:09:12.943126 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"openshift-service-ca.crt\"" Jun 09 15:09:12.943384 ip-10-0-133-239 kubenswrapper[2576]: I0609 15:09:12.943364 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"metrics-server-cert\"" Jun 09 15:09:12.943737 ip-10-0-133-239 kubenswrapper[2576]: I0609 15:09:12.943021 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"lws-controller-manager-dockercfg-wcscs\"" Jun 09 15:09:12.943737 ip-10-0-133-239 kubenswrapper[2576]: I0609 15:09:12.942961 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"webhook-server-cert\"" Jun 09 15:09:12.943914 ip-10-0-133-239 kubenswrapper[2576]: I0609 15:09:12.943238 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"lws-manager-config\"" Jun 09 15:09:12.945550 ip-10-0-133-239 kubenswrapper[2576]: I0609 15:09:12.945485 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/lws-controller-manager-7647c5764b-clqwf"] Jun 09 15:09:12.998730 ip-10-0-133-239 kubenswrapper[2576]: I0609 15:09:12.998699 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/model-serving-api-5dd488fc48-l6khg"] Jun 09 15:09:13.011225 ip-10-0-133-239 kubenswrapper[2576]: W0609 15:09:13.011152 2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd4365ffd_5d22_45bd_b101_054db6b8e567.slice/crio-981dd40ec5226575ad207be2a3741a786e03b3d93f050fd8027d793fc6c6f525 WatchSource:0}: Error finding container 981dd40ec5226575ad207be2a3741a786e03b3d93f050fd8027d793fc6c6f525: Status 404 returned error can't find the container with id 981dd40ec5226575ad207be2a3741a786e03b3d93f050fd8027d793fc6c6f525 Jun 09 15:09:13.021707 ip-10-0-133-239 kubenswrapper[2576]: I0609 15:09:13.021678 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/odh-model-controller-6dc94f689f-z2vjj"] Jun 09 15:09:13.023884 ip-10-0-133-239 kubenswrapper[2576]: W0609 15:09:13.023823 2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6177fcda_a66c_4a79_b71c_b2c694782679.slice/crio-70128b2577dac9a85d16fd1bbb76c066e51ad66f53aa72bea1ed7a0e9e5bef1e WatchSource:0}: Error finding container 70128b2577dac9a85d16fd1bbb76c066e51ad66f53aa72bea1ed7a0e9e5bef1e: Status 404 returned error can't find the container with id 70128b2577dac9a85d16fd1bbb76c066e51ad66f53aa72bea1ed7a0e9e5bef1e Jun 09 15:09:13.076452 ip-10-0-133-239 kubenswrapper[2576]: I0609 15:09:13.076319 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/947044cd-b534-40cb-9ee4-71877772b00b-cert\") pod \"lws-controller-manager-7647c5764b-clqwf\" (UID: \"947044cd-b534-40cb-9ee4-71877772b00b\") " pod="openshift-lws-operator/lws-controller-manager-7647c5764b-clqwf" Jun 09 15:09:13.076452 ip-10-0-133-239 kubenswrapper[2576]: I0609 15:09:13.076398 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/947044cd-b534-40cb-9ee4-71877772b00b-metrics-cert\") pod \"lws-controller-manager-7647c5764b-clqwf\" (UID: \"947044cd-b534-40cb-9ee4-71877772b00b\") " pod="openshift-lws-operator/lws-controller-manager-7647c5764b-clqwf" Jun 09 15:09:13.076452 ip-10-0-133-239 kubenswrapper[2576]: I0609 15:09:13.076431 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/947044cd-b534-40cb-9ee4-71877772b00b-manager-config\") pod \"lws-controller-manager-7647c5764b-clqwf\" (UID: \"947044cd-b534-40cb-9ee4-71877772b00b\") " pod="openshift-lws-operator/lws-controller-manager-7647c5764b-clqwf" Jun 09 15:09:13.076739 ip-10-0-133-239 kubenswrapper[2576]: I0609 15:09:13.076556 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vddbh\" (UniqueName: \"kubernetes.io/projected/947044cd-b534-40cb-9ee4-71877772b00b-kube-api-access-vddbh\") pod \"lws-controller-manager-7647c5764b-clqwf\" (UID: \"947044cd-b534-40cb-9ee4-71877772b00b\") " pod="openshift-lws-operator/lws-controller-manager-7647c5764b-clqwf" Jun 09 15:09:13.177515 ip-10-0-133-239 kubenswrapper[2576]: I0609 15:09:13.177467 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vddbh\" (UniqueName: \"kubernetes.io/projected/947044cd-b534-40cb-9ee4-71877772b00b-kube-api-access-vddbh\") pod \"lws-controller-manager-7647c5764b-clqwf\" (UID: \"947044cd-b534-40cb-9ee4-71877772b00b\") " pod="openshift-lws-operator/lws-controller-manager-7647c5764b-clqwf" Jun 09 15:09:13.177696 ip-10-0-133-239 kubenswrapper[2576]: I0609 15:09:13.177543 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/947044cd-b534-40cb-9ee4-71877772b00b-cert\") pod \"lws-controller-manager-7647c5764b-clqwf\" (UID: \"947044cd-b534-40cb-9ee4-71877772b00b\") " pod="openshift-lws-operator/lws-controller-manager-7647c5764b-clqwf" Jun 09 15:09:13.177696 ip-10-0-133-239 kubenswrapper[2576]: I0609 15:09:13.177589 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/947044cd-b534-40cb-9ee4-71877772b00b-metrics-cert\") pod \"lws-controller-manager-7647c5764b-clqwf\" (UID: \"947044cd-b534-40cb-9ee4-71877772b00b\") " pod="openshift-lws-operator/lws-controller-manager-7647c5764b-clqwf" Jun 09 15:09:13.177696 ip-10-0-133-239 kubenswrapper[2576]: I0609 15:09:13.177612 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/947044cd-b534-40cb-9ee4-71877772b00b-manager-config\") pod \"lws-controller-manager-7647c5764b-clqwf\" (UID: \"947044cd-b534-40cb-9ee4-71877772b00b\") " pod="openshift-lws-operator/lws-controller-manager-7647c5764b-clqwf" Jun 09 15:09:13.178397 ip-10-0-133-239 kubenswrapper[2576]: I0609 15:09:13.178369 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/947044cd-b534-40cb-9ee4-71877772b00b-manager-config\") pod \"lws-controller-manager-7647c5764b-clqwf\" (UID: \"947044cd-b534-40cb-9ee4-71877772b00b\") " pod="openshift-lws-operator/lws-controller-manager-7647c5764b-clqwf" Jun 09 15:09:13.180753 ip-10-0-133-239 kubenswrapper[2576]: I0609 15:09:13.180728 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/947044cd-b534-40cb-9ee4-71877772b00b-metrics-cert\") pod \"lws-controller-manager-7647c5764b-clqwf\" (UID: \"947044cd-b534-40cb-9ee4-71877772b00b\") " pod="openshift-lws-operator/lws-controller-manager-7647c5764b-clqwf" Jun 09 15:09:13.180861 ip-10-0-133-239 kubenswrapper[2576]: I0609 15:09:13.180728 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/947044cd-b534-40cb-9ee4-71877772b00b-cert\") pod \"lws-controller-manager-7647c5764b-clqwf\" (UID: \"947044cd-b534-40cb-9ee4-71877772b00b\") " pod="openshift-lws-operator/lws-controller-manager-7647c5764b-clqwf" Jun 09 15:09:13.188906 ip-10-0-133-239 kubenswrapper[2576]: I0609 15:09:13.188882 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-vddbh\" (UniqueName: \"kubernetes.io/projected/947044cd-b534-40cb-9ee4-71877772b00b-kube-api-access-vddbh\") pod \"lws-controller-manager-7647c5764b-clqwf\" (UID: \"947044cd-b534-40cb-9ee4-71877772b00b\") " pod="openshift-lws-operator/lws-controller-manager-7647c5764b-clqwf" Jun 09 15:09:13.252166 ip-10-0-133-239 kubenswrapper[2576]: I0609 15:09:13.251893 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/lws-controller-manager-7647c5764b-clqwf" Jun 09 15:09:13.344817 ip-10-0-133-239 kubenswrapper[2576]: I0609 15:09:13.344740 2576 generic.go:356] "Generic (PLEG): container finished" podID="f3f09014-a8c9-4937-b4b8-8dcf0bff7ef2" containerID="b3e8dc4136cadba52f308a56a079bae7f6de8f4919723fdbb2c553555f8d4719" exitCode=0 Jun 09 15:09:13.344817 ip-10-0-133-239 kubenswrapper[2576]: I0609 15:09:13.344804 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/4258531154569488b4b06856545cf53ed48b82e88ddd64b4ce22efab06rm4j2" event={"ID":"f3f09014-a8c9-4937-b4b8-8dcf0bff7ef2","Type":"ContainerDied","Data":"b3e8dc4136cadba52f308a56a079bae7f6de8f4919723fdbb2c553555f8d4719"} Jun 09 15:09:13.345044 ip-10-0-133-239 kubenswrapper[2576]: I0609 15:09:13.344865 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/4258531154569488b4b06856545cf53ed48b82e88ddd64b4ce22efab06rm4j2" event={"ID":"f3f09014-a8c9-4937-b4b8-8dcf0bff7ef2","Type":"ContainerStarted","Data":"2587d4ee790530b052948728db2331bc86e7770c5d618c3343d8962c483edc34"} Jun 09 15:09:13.347507 ip-10-0-133-239 kubenswrapper[2576]: I0609 15:09:13.346927 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/odh-model-controller-6dc94f689f-z2vjj" event={"ID":"6177fcda-a66c-4a79-b71c-b2c694782679","Type":"ContainerStarted","Data":"70128b2577dac9a85d16fd1bbb76c066e51ad66f53aa72bea1ed7a0e9e5bef1e"} Jun 09 15:09:13.350184 ip-10-0-133-239 kubenswrapper[2576]: I0609 15:09:13.350139 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/model-serving-api-5dd488fc48-l6khg" event={"ID":"d4365ffd-5d22-45bd-b101-054db6b8e567","Type":"ContainerStarted","Data":"981dd40ec5226575ad207be2a3741a786e03b3d93f050fd8027d793fc6c6f525"} Jun 09 15:09:13.425430 ip-10-0-133-239 kubenswrapper[2576]: I0609 15:09:13.425359 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/lws-controller-manager-7647c5764b-clqwf"] Jun 09 15:09:13.428564 ip-10-0-133-239 kubenswrapper[2576]: W0609 15:09:13.428532 2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod947044cd_b534_40cb_9ee4_71877772b00b.slice/crio-730d3b2fb7a9ed75cfc00a407b0320533b2866c064102805ebbf2670fd156e7e WatchSource:0}: Error finding container 730d3b2fb7a9ed75cfc00a407b0320533b2866c064102805ebbf2670fd156e7e: Status 404 returned error can't find the container with id 730d3b2fb7a9ed75cfc00a407b0320533b2866c064102805ebbf2670fd156e7e Jun 09 15:09:14.366717 ip-10-0-133-239 kubenswrapper[2576]: I0609 15:09:14.366373 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/lws-controller-manager-7647c5764b-clqwf" event={"ID":"947044cd-b534-40cb-9ee4-71877772b00b","Type":"ContainerStarted","Data":"730d3b2fb7a9ed75cfc00a407b0320533b2866c064102805ebbf2670fd156e7e"} Jun 09 15:09:18.389265 ip-10-0-133-239 kubenswrapper[2576]: I0609 15:09:18.389234 2576 generic.go:356] "Generic (PLEG): container finished" podID="f3f09014-a8c9-4937-b4b8-8dcf0bff7ef2" containerID="8488b359fa912641d54e5cc9b34fde601aff9a45d3cde8599c19d1da157dd544" exitCode=0 Jun 09 15:09:18.389642 ip-10-0-133-239 kubenswrapper[2576]: I0609 15:09:18.389305 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/4258531154569488b4b06856545cf53ed48b82e88ddd64b4ce22efab06rm4j2" event={"ID":"f3f09014-a8c9-4937-b4b8-8dcf0bff7ef2","Type":"ContainerDied","Data":"8488b359fa912641d54e5cc9b34fde601aff9a45d3cde8599c19d1da157dd544"} Jun 09 15:09:18.391711 ip-10-0-133-239 kubenswrapper[2576]: I0609 15:09:18.391605 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/kube-auth-proxy-ccff6cfb8-jqj95" event={"ID":"7dc1c3ee-d724-4eb5-af0c-8425f99c30df","Type":"ContainerStarted","Data":"4f5711fa1bc75276855d06000af878c560e62249d144bc3f6c9c4476cd04c0f6"} Jun 09 15:09:18.393541 ip-10-0-133-239 kubenswrapper[2576]: I0609 15:09:18.393450 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/model-serving-api-5dd488fc48-l6khg" event={"ID":"d4365ffd-5d22-45bd-b101-054db6b8e567","Type":"ContainerStarted","Data":"2e2ce319fea077ef022172f053a55ff8a99bb97788fd96ff1497b3d3eb1ab291"} Jun 09 15:09:18.395294 ip-10-0-133-239 kubenswrapper[2576]: I0609 15:09:18.395053 2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/model-serving-api-5dd488fc48-l6khg" Jun 09 15:09:18.395365 ip-10-0-133-239 kubenswrapper[2576]: I0609 15:09:18.395295 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/lws-controller-manager-7647c5764b-clqwf" event={"ID":"947044cd-b534-40cb-9ee4-71877772b00b","Type":"ContainerStarted","Data":"de8cbd715154a22444f6a90d9991fb7b90c2fc86478a9e1c6affc3850f00fe07"} Jun 09 15:09:18.395508 ip-10-0-133-239 kubenswrapper[2576]: I0609 15:09:18.395488 2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-lws-operator/lws-controller-manager-7647c5764b-clqwf" Jun 09 15:09:18.422704 ip-10-0-133-239 kubenswrapper[2576]: I0609 15:09:18.422656 2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-lws-operator/lws-controller-manager-7647c5764b-clqwf" podStartSLOduration=1.6277768670000001 podStartE2EDuration="6.422636234s" totalImagesPullingTime="4.794859367s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-09 15:09:12 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-09 15:09:18.421882781 +0000 UTC m=+473.276039012" watchObservedRunningTime="2026-06-09 15:09:18.422636234 +0000 UTC m=+473.276792475" Jun 09 15:09:18.437680 ip-10-0-133-239 kubenswrapper[2576]: I0609 15:09:18.437636 2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/kube-auth-proxy-ccff6cfb8-jqj95" podStartSLOduration=1.525806923 podStartE2EDuration="7.437620101s" totalImagesPullingTime="5.911813178s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-09 15:09:11 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-09 15:09:18.436523252 +0000 UTC m=+473.290679491" watchObservedRunningTime="2026-06-09 15:09:18.437620101 +0000 UTC m=+473.291776340" Jun 09 15:09:19.401600 ip-10-0-133-239 kubenswrapper[2576]: I0609 15:09:19.401561 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/odh-model-controller-6dc94f689f-z2vjj" event={"ID":"6177fcda-a66c-4a79-b71c-b2c694782679","Type":"ContainerStarted","Data":"0a6cdbb9bbde73d5bac235db84846831b1d14480a76cea704acc0d9c1de726b9"} Jun 09 15:09:19.402045 ip-10-0-133-239 kubenswrapper[2576]: I0609 15:09:19.401727 2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/odh-model-controller-6dc94f689f-z2vjj" Jun 09 15:09:19.403745 ip-10-0-133-239 kubenswrapper[2576]: I0609 15:09:19.403714 2576 generic.go:356] "Generic (PLEG): container finished" podID="f3f09014-a8c9-4937-b4b8-8dcf0bff7ef2" containerID="77e7e92f06d32780d6bca28236e0c33a6aedb2fb7a9d4873c96d664090c3060c" exitCode=0 Jun 09 15:09:19.403852 ip-10-0-133-239 kubenswrapper[2576]: I0609 15:09:19.403803 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/4258531154569488b4b06856545cf53ed48b82e88ddd64b4ce22efab06rm4j2" event={"ID":"f3f09014-a8c9-4937-b4b8-8dcf0bff7ef2","Type":"ContainerDied","Data":"77e7e92f06d32780d6bca28236e0c33a6aedb2fb7a9d4873c96d664090c3060c"} Jun 09 15:09:19.418024 ip-10-0-133-239 kubenswrapper[2576]: I0609 15:09:19.417985 2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/odh-model-controller-6dc94f689f-z2vjj" podStartSLOduration=3.135154246 podStartE2EDuration="8.417969696s" totalImagesPullingTime="5.28281545s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-09 15:09:11 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-09 15:09:19.417949347 +0000 UTC m=+474.272105587" watchObservedRunningTime="2026-06-09 15:09:19.417969696 +0000 UTC m=+474.272125932" Jun 09 15:09:19.418159 ip-10-0-133-239 kubenswrapper[2576]: I0609 15:09:19.418085 2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/model-serving-api-5dd488fc48-l6khg" podStartSLOduration=2.195327411 podStartE2EDuration="7.418077942s" totalImagesPullingTime="5.222750531s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-09 15:09:12 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-09 15:09:18.453817548 +0000 UTC m=+473.307973789" watchObservedRunningTime="2026-06-09 15:09:19.418077942 +0000 UTC m=+474.272234181" Jun 09 15:09:20.551355 ip-10-0-133-239 kubenswrapper[2576]: I0609 15:09:20.551324 2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/4258531154569488b4b06856545cf53ed48b82e88ddd64b4ce22efab06rm4j2" Jun 09 15:09:20.643768 ip-10-0-133-239 kubenswrapper[2576]: I0609 15:09:20.643739 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/f3f09014-a8c9-4937-b4b8-8dcf0bff7ef2-bundle\") pod \"f3f09014-a8c9-4937-b4b8-8dcf0bff7ef2\" (UID: \"f3f09014-a8c9-4937-b4b8-8dcf0bff7ef2\") " Jun 09 15:09:20.643942 ip-10-0-133-239 kubenswrapper[2576]: I0609 15:09:20.643781 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/f3f09014-a8c9-4937-b4b8-8dcf0bff7ef2-util\") pod \"f3f09014-a8c9-4937-b4b8-8dcf0bff7ef2\" (UID: \"f3f09014-a8c9-4937-b4b8-8dcf0bff7ef2\") " Jun 09 15:09:20.643942 ip-10-0-133-239 kubenswrapper[2576]: I0609 15:09:20.643804 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-whrxh\" (UniqueName: \"kubernetes.io/projected/f3f09014-a8c9-4937-b4b8-8dcf0bff7ef2-kube-api-access-whrxh\") pod \"f3f09014-a8c9-4937-b4b8-8dcf0bff7ef2\" (UID: \"f3f09014-a8c9-4937-b4b8-8dcf0bff7ef2\") " Jun 09 15:09:20.644709 ip-10-0-133-239 kubenswrapper[2576]: I0609 15:09:20.644678 2576 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/f3f09014-a8c9-4937-b4b8-8dcf0bff7ef2-bundle" (OuterVolumeSpecName: "bundle") pod "f3f09014-a8c9-4937-b4b8-8dcf0bff7ef2" (UID: "f3f09014-a8c9-4937-b4b8-8dcf0bff7ef2"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 09 15:09:20.645994 ip-10-0-133-239 kubenswrapper[2576]: I0609 15:09:20.645967 2576 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/f3f09014-a8c9-4937-b4b8-8dcf0bff7ef2-kube-api-access-whrxh" (OuterVolumeSpecName: "kube-api-access-whrxh") pod "f3f09014-a8c9-4937-b4b8-8dcf0bff7ef2" (UID: "f3f09014-a8c9-4937-b4b8-8dcf0bff7ef2"). InnerVolumeSpecName "kube-api-access-whrxh". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 09 15:09:20.651487 ip-10-0-133-239 kubenswrapper[2576]: I0609 15:09:20.651462 2576 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/f3f09014-a8c9-4937-b4b8-8dcf0bff7ef2-util" (OuterVolumeSpecName: "util") pod "f3f09014-a8c9-4937-b4b8-8dcf0bff7ef2" (UID: "f3f09014-a8c9-4937-b4b8-8dcf0bff7ef2"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 09 15:09:20.745255 ip-10-0-133-239 kubenswrapper[2576]: I0609 15:09:20.745169 2576 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-whrxh\" (UniqueName: \"kubernetes.io/projected/f3f09014-a8c9-4937-b4b8-8dcf0bff7ef2-kube-api-access-whrxh\") on node \"ip-10-0-133-239.ec2.internal\" DevicePath \"\"" Jun 09 15:09:20.745255 ip-10-0-133-239 kubenswrapper[2576]: I0609 15:09:20.745196 2576 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/f3f09014-a8c9-4937-b4b8-8dcf0bff7ef2-bundle\") on node \"ip-10-0-133-239.ec2.internal\" DevicePath \"\"" Jun 09 15:09:20.745255 ip-10-0-133-239 kubenswrapper[2576]: I0609 15:09:20.745206 2576 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/f3f09014-a8c9-4937-b4b8-8dcf0bff7ef2-util\") on node \"ip-10-0-133-239.ec2.internal\" DevicePath \"\"" Jun 09 15:09:21.414902 ip-10-0-133-239 kubenswrapper[2576]: I0609 15:09:21.414876 2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/4258531154569488b4b06856545cf53ed48b82e88ddd64b4ce22efab06rm4j2" Jun 09 15:09:21.415082 ip-10-0-133-239 kubenswrapper[2576]: I0609 15:09:21.414905 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/4258531154569488b4b06856545cf53ed48b82e88ddd64b4ce22efab06rm4j2" event={"ID":"f3f09014-a8c9-4937-b4b8-8dcf0bff7ef2","Type":"ContainerDied","Data":"2587d4ee790530b052948728db2331bc86e7770c5d618c3343d8962c483edc34"} Jun 09 15:09:21.415082 ip-10-0-133-239 kubenswrapper[2576]: I0609 15:09:21.414952 2576 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="2587d4ee790530b052948728db2331bc86e7770c5d618c3343d8962c483edc34" Jun 09 15:09:25.728172 ip-10-0-133-239 kubenswrapper[2576]: I0609 15:09:25.728139 2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762aqw6px"] Jun 09 15:09:25.728549 ip-10-0-133-239 kubenswrapper[2576]: I0609 15:09:25.728457 2576 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="f3f09014-a8c9-4937-b4b8-8dcf0bff7ef2" containerName="extract" Jun 09 15:09:25.728549 ip-10-0-133-239 kubenswrapper[2576]: I0609 15:09:25.728469 2576 state_mem.go:107] "Deleted CPUSet assignment" podUID="f3f09014-a8c9-4937-b4b8-8dcf0bff7ef2" containerName="extract" Jun 09 15:09:25.728549 ip-10-0-133-239 kubenswrapper[2576]: I0609 15:09:25.728479 2576 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="f3f09014-a8c9-4937-b4b8-8dcf0bff7ef2" containerName="util" Jun 09 15:09:25.728549 ip-10-0-133-239 kubenswrapper[2576]: I0609 15:09:25.728484 2576 state_mem.go:107] "Deleted CPUSet assignment" podUID="f3f09014-a8c9-4937-b4b8-8dcf0bff7ef2" containerName="util" Jun 09 15:09:25.728549 ip-10-0-133-239 kubenswrapper[2576]: I0609 15:09:25.728495 2576 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="f3f09014-a8c9-4937-b4b8-8dcf0bff7ef2" containerName="pull" Jun 09 15:09:25.728549 ip-10-0-133-239 kubenswrapper[2576]: I0609 15:09:25.728502 2576 state_mem.go:107] "Deleted CPUSet assignment" podUID="f3f09014-a8c9-4937-b4b8-8dcf0bff7ef2" containerName="pull" Jun 09 15:09:25.728718 ip-10-0-133-239 kubenswrapper[2576]: I0609 15:09:25.728562 2576 memory_manager.go:368] "RemoveStaleState removing state" podUID="f3f09014-a8c9-4937-b4b8-8dcf0bff7ef2" containerName="extract" Jun 09 15:09:25.803489 ip-10-0-133-239 kubenswrapper[2576]: I0609 15:09:25.803447 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762aqw6px"] Jun 09 15:09:25.803641 ip-10-0-133-239 kubenswrapper[2576]: I0609 15:09:25.803582 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762aqw6px" Jun 09 15:09:25.844627 ip-10-0-133-239 kubenswrapper[2576]: I0609 15:09:25.844601 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"kube-root-ca.crt\"" Jun 09 15:09:25.844793 ip-10-0-133-239 kubenswrapper[2576]: I0609 15:09:25.844687 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"openshift-service-ca.crt\"" Jun 09 15:09:25.845423 ip-10-0-133-239 kubenswrapper[2576]: I0609 15:09:25.845393 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-marketplace\"/\"default-dockercfg-sjd8c\"" Jun 09 15:09:25.879879 ip-10-0-133-239 kubenswrapper[2576]: I0609 15:09:25.879847 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/a6174916-5107-429f-9a4a-0e71595f68bb-util\") pod \"c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762aqw6px\" (UID: \"a6174916-5107-429f-9a4a-0e71595f68bb\") " pod="openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762aqw6px" Jun 09 15:09:25.879999 ip-10-0-133-239 kubenswrapper[2576]: I0609 15:09:25.879920 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jrwjr\" (UniqueName: \"kubernetes.io/projected/a6174916-5107-429f-9a4a-0e71595f68bb-kube-api-access-jrwjr\") pod \"c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762aqw6px\" (UID: \"a6174916-5107-429f-9a4a-0e71595f68bb\") " pod="openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762aqw6px" Jun 09 15:09:25.879999 ip-10-0-133-239 kubenswrapper[2576]: I0609 15:09:25.879974 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/a6174916-5107-429f-9a4a-0e71595f68bb-bundle\") pod \"c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762aqw6px\" (UID: \"a6174916-5107-429f-9a4a-0e71595f68bb\") " pod="openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762aqw6px" Jun 09 15:09:25.980515 ip-10-0-133-239 kubenswrapper[2576]: I0609 15:09:25.980441 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jrwjr\" (UniqueName: \"kubernetes.io/projected/a6174916-5107-429f-9a4a-0e71595f68bb-kube-api-access-jrwjr\") pod \"c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762aqw6px\" (UID: \"a6174916-5107-429f-9a4a-0e71595f68bb\") " pod="openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762aqw6px" Jun 09 15:09:25.980515 ip-10-0-133-239 kubenswrapper[2576]: I0609 15:09:25.980487 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/a6174916-5107-429f-9a4a-0e71595f68bb-bundle\") pod \"c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762aqw6px\" (UID: \"a6174916-5107-429f-9a4a-0e71595f68bb\") " pod="openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762aqw6px" Jun 09 15:09:25.980729 ip-10-0-133-239 kubenswrapper[2576]: I0609 15:09:25.980552 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/a6174916-5107-429f-9a4a-0e71595f68bb-util\") pod \"c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762aqw6px\" (UID: \"a6174916-5107-429f-9a4a-0e71595f68bb\") " pod="openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762aqw6px" Jun 09 15:09:25.980954 ip-10-0-133-239 kubenswrapper[2576]: I0609 15:09:25.980933 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/a6174916-5107-429f-9a4a-0e71595f68bb-util\") pod \"c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762aqw6px\" (UID: \"a6174916-5107-429f-9a4a-0e71595f68bb\") " pod="openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762aqw6px" Jun 09 15:09:25.981023 ip-10-0-133-239 kubenswrapper[2576]: I0609 15:09:25.980958 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/a6174916-5107-429f-9a4a-0e71595f68bb-bundle\") pod \"c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762aqw6px\" (UID: \"a6174916-5107-429f-9a4a-0e71595f68bb\") " pod="openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762aqw6px" Jun 09 15:09:26.009956 ip-10-0-133-239 kubenswrapper[2576]: I0609 15:09:26.009921 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-jrwjr\" (UniqueName: \"kubernetes.io/projected/a6174916-5107-429f-9a4a-0e71595f68bb-kube-api-access-jrwjr\") pod \"c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762aqw6px\" (UID: \"a6174916-5107-429f-9a4a-0e71595f68bb\") " pod="openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762aqw6px" Jun 09 15:09:26.112286 ip-10-0-133-239 kubenswrapper[2576]: I0609 15:09:26.112254 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762aqw6px" Jun 09 15:09:26.294122 ip-10-0-133-239 kubenswrapper[2576]: I0609 15:09:26.293923 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762aqw6px"] Jun 09 15:09:26.296603 ip-10-0-133-239 kubenswrapper[2576]: W0609 15:09:26.296568 2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda6174916_5107_429f_9a4a_0e71595f68bb.slice/crio-7b786a581dbc5eb82d35c949ef50cdb99c1fa1849c4b05fa785d1799bf35144a WatchSource:0}: Error finding container 7b786a581dbc5eb82d35c949ef50cdb99c1fa1849c4b05fa785d1799bf35144a: Status 404 returned error can't find the container with id 7b786a581dbc5eb82d35c949ef50cdb99c1fa1849c4b05fa785d1799bf35144a Jun 09 15:09:26.445229 ip-10-0-133-239 kubenswrapper[2576]: I0609 15:09:26.445195 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762aqw6px" event={"ID":"a6174916-5107-429f-9a4a-0e71595f68bb","Type":"ContainerStarted","Data":"c74e3a88c95dcb04420bcd4845cd126e4ce1d5f977204fc0fb0bd994b3dc1f4d"} Jun 09 15:09:26.445364 ip-10-0-133-239 kubenswrapper[2576]: I0609 15:09:26.445243 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762aqw6px" event={"ID":"a6174916-5107-429f-9a4a-0e71595f68bb","Type":"ContainerStarted","Data":"7b786a581dbc5eb82d35c949ef50cdb99c1fa1849c4b05fa785d1799bf35144a"} Jun 09 15:09:27.451539 ip-10-0-133-239 kubenswrapper[2576]: I0609 15:09:27.451457 2576 generic.go:356] "Generic (PLEG): container finished" podID="a6174916-5107-429f-9a4a-0e71595f68bb" containerID="c74e3a88c95dcb04420bcd4845cd126e4ce1d5f977204fc0fb0bd994b3dc1f4d" exitCode=0 Jun 09 15:09:27.451539 ip-10-0-133-239 kubenswrapper[2576]: I0609 15:09:27.451496 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762aqw6px" event={"ID":"a6174916-5107-429f-9a4a-0e71595f68bb","Type":"ContainerDied","Data":"c74e3a88c95dcb04420bcd4845cd126e4ce1d5f977204fc0fb0bd994b3dc1f4d"} Jun 09 15:09:29.406235 ip-10-0-133-239 kubenswrapper[2576]: I0609 15:09:29.406203 2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-lws-operator/lws-controller-manager-7647c5764b-clqwf" Jun 09 15:09:29.409238 ip-10-0-133-239 kubenswrapper[2576]: I0609 15:09:29.409217 2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/model-serving-api-5dd488fc48-l6khg" Jun 09 15:09:29.466777 ip-10-0-133-239 kubenswrapper[2576]: I0609 15:09:29.466745 2576 generic.go:356] "Generic (PLEG): container finished" podID="a6174916-5107-429f-9a4a-0e71595f68bb" containerID="1de8afb8aa8a7c901b7dff05c28227f6b7593c4ad6f01d1a9759d2fe060c63b8" exitCode=0 Jun 09 15:09:29.467081 ip-10-0-133-239 kubenswrapper[2576]: I0609 15:09:29.466829 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762aqw6px" event={"ID":"a6174916-5107-429f-9a4a-0e71595f68bb","Type":"ContainerDied","Data":"1de8afb8aa8a7c901b7dff05c28227f6b7593c4ad6f01d1a9759d2fe060c63b8"} Jun 09 15:09:30.410566 ip-10-0-133-239 kubenswrapper[2576]: I0609 15:09:30.410532 2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/odh-model-controller-6dc94f689f-z2vjj" Jun 09 15:09:30.481939 ip-10-0-133-239 kubenswrapper[2576]: I0609 15:09:30.481905 2576 generic.go:356] "Generic (PLEG): container finished" podID="a6174916-5107-429f-9a4a-0e71595f68bb" containerID="8e1d06576d1dcf49d7a83f33e64641997d03f608e480d9e4de7dc0a1e520a26d" exitCode=0 Jun 09 15:09:30.482132 ip-10-0-133-239 kubenswrapper[2576]: I0609 15:09:30.481995 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762aqw6px" event={"ID":"a6174916-5107-429f-9a4a-0e71595f68bb","Type":"ContainerDied","Data":"8e1d06576d1dcf49d7a83f33e64641997d03f608e480d9e4de7dc0a1e520a26d"} Jun 09 15:09:31.619840 ip-10-0-133-239 kubenswrapper[2576]: I0609 15:09:31.619813 2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762aqw6px" Jun 09 15:09:31.725438 ip-10-0-133-239 kubenswrapper[2576]: I0609 15:09:31.725402 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/a6174916-5107-429f-9a4a-0e71595f68bb-bundle\") pod \"a6174916-5107-429f-9a4a-0e71595f68bb\" (UID: \"a6174916-5107-429f-9a4a-0e71595f68bb\") " Jun 09 15:09:31.725620 ip-10-0-133-239 kubenswrapper[2576]: I0609 15:09:31.725456 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/a6174916-5107-429f-9a4a-0e71595f68bb-util\") pod \"a6174916-5107-429f-9a4a-0e71595f68bb\" (UID: \"a6174916-5107-429f-9a4a-0e71595f68bb\") " Jun 09 15:09:31.725620 ip-10-0-133-239 kubenswrapper[2576]: I0609 15:09:31.725488 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-jrwjr\" (UniqueName: \"kubernetes.io/projected/a6174916-5107-429f-9a4a-0e71595f68bb-kube-api-access-jrwjr\") pod \"a6174916-5107-429f-9a4a-0e71595f68bb\" (UID: \"a6174916-5107-429f-9a4a-0e71595f68bb\") " Jun 09 15:09:31.726490 ip-10-0-133-239 kubenswrapper[2576]: I0609 15:09:31.726464 2576 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/a6174916-5107-429f-9a4a-0e71595f68bb-bundle" (OuterVolumeSpecName: "bundle") pod "a6174916-5107-429f-9a4a-0e71595f68bb" (UID: "a6174916-5107-429f-9a4a-0e71595f68bb"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 09 15:09:31.727745 ip-10-0-133-239 kubenswrapper[2576]: I0609 15:09:31.727723 2576 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/a6174916-5107-429f-9a4a-0e71595f68bb-kube-api-access-jrwjr" (OuterVolumeSpecName: "kube-api-access-jrwjr") pod "a6174916-5107-429f-9a4a-0e71595f68bb" (UID: "a6174916-5107-429f-9a4a-0e71595f68bb"). InnerVolumeSpecName "kube-api-access-jrwjr". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 09 15:09:31.730589 ip-10-0-133-239 kubenswrapper[2576]: I0609 15:09:31.730547 2576 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/a6174916-5107-429f-9a4a-0e71595f68bb-util" (OuterVolumeSpecName: "util") pod "a6174916-5107-429f-9a4a-0e71595f68bb" (UID: "a6174916-5107-429f-9a4a-0e71595f68bb"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 09 15:09:31.827112 ip-10-0-133-239 kubenswrapper[2576]: I0609 15:09:31.827062 2576 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/a6174916-5107-429f-9a4a-0e71595f68bb-util\") on node \"ip-10-0-133-239.ec2.internal\" DevicePath \"\"" Jun 09 15:09:31.827112 ip-10-0-133-239 kubenswrapper[2576]: I0609 15:09:31.827099 2576 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-jrwjr\" (UniqueName: \"kubernetes.io/projected/a6174916-5107-429f-9a4a-0e71595f68bb-kube-api-access-jrwjr\") on node \"ip-10-0-133-239.ec2.internal\" DevicePath \"\"" Jun 09 15:09:31.827112 ip-10-0-133-239 kubenswrapper[2576]: I0609 15:09:31.827113 2576 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/a6174916-5107-429f-9a4a-0e71595f68bb-bundle\") on node \"ip-10-0-133-239.ec2.internal\" DevicePath \"\"" Jun 09 15:09:32.493862 ip-10-0-133-239 kubenswrapper[2576]: I0609 15:09:32.493836 2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762aqw6px" Jun 09 15:09:32.493862 ip-10-0-133-239 kubenswrapper[2576]: I0609 15:09:32.493859 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762aqw6px" event={"ID":"a6174916-5107-429f-9a4a-0e71595f68bb","Type":"ContainerDied","Data":"7b786a581dbc5eb82d35c949ef50cdb99c1fa1849c4b05fa785d1799bf35144a"} Jun 09 15:09:32.494088 ip-10-0-133-239 kubenswrapper[2576]: I0609 15:09:32.493898 2576 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="7b786a581dbc5eb82d35c949ef50cdb99c1fa1849c4b05fa785d1799bf35144a" Jun 09 15:10:28.191726 ip-10-0-133-239 kubenswrapper[2576]: I0609 15:10:28.191649 2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73d8lbp"] Jun 09 15:10:28.192166 ip-10-0-133-239 kubenswrapper[2576]: I0609 15:10:28.192022 2576 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="a6174916-5107-429f-9a4a-0e71595f68bb" containerName="pull" Jun 09 15:10:28.192166 ip-10-0-133-239 kubenswrapper[2576]: I0609 15:10:28.192035 2576 state_mem.go:107] "Deleted CPUSet assignment" podUID="a6174916-5107-429f-9a4a-0e71595f68bb" containerName="pull" Jun 09 15:10:28.192166 ip-10-0-133-239 kubenswrapper[2576]: I0609 15:10:28.192047 2576 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="a6174916-5107-429f-9a4a-0e71595f68bb" containerName="extract" Jun 09 15:10:28.192166 ip-10-0-133-239 kubenswrapper[2576]: I0609 15:10:28.192052 2576 state_mem.go:107] "Deleted CPUSet assignment" podUID="a6174916-5107-429f-9a4a-0e71595f68bb" containerName="extract" Jun 09 15:10:28.192166 ip-10-0-133-239 kubenswrapper[2576]: I0609 15:10:28.192062 2576 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="a6174916-5107-429f-9a4a-0e71595f68bb" containerName="util" Jun 09 15:10:28.192166 ip-10-0-133-239 kubenswrapper[2576]: I0609 15:10:28.192092 2576 state_mem.go:107] "Deleted CPUSet assignment" podUID="a6174916-5107-429f-9a4a-0e71595f68bb" containerName="util" Jun 09 15:10:28.192363 ip-10-0-133-239 kubenswrapper[2576]: I0609 15:10:28.192175 2576 memory_manager.go:368] "RemoveStaleState removing state" podUID="a6174916-5107-429f-9a4a-0e71595f68bb" containerName="extract" Jun 09 15:10:28.194288 ip-10-0-133-239 kubenswrapper[2576]: I0609 15:10:28.194269 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73d8lbp" Jun 09 15:10:28.196836 ip-10-0-133-239 kubenswrapper[2576]: I0609 15:10:28.196810 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"openshift-service-ca.crt\"" Jun 09 15:10:28.196962 ip-10-0-133-239 kubenswrapper[2576]: I0609 15:10:28.196835 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"kube-root-ca.crt\"" Jun 09 15:10:28.196962 ip-10-0-133-239 kubenswrapper[2576]: I0609 15:10:28.196945 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"default-dockercfg-pk677\"" Jun 09 15:10:28.205325 ip-10-0-133-239 kubenswrapper[2576]: I0609 15:10:28.205304 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73d8lbp"] Jun 09 15:10:28.298198 ip-10-0-133-239 kubenswrapper[2576]: I0609 15:10:28.298174 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/ceacecbb-c7f8-493b-ab8d-7a68be32a1bb-bundle\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73d8lbp\" (UID: \"ceacecbb-c7f8-493b-ab8d-7a68be32a1bb\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73d8lbp" Jun 09 15:10:28.298322 ip-10-0-133-239 kubenswrapper[2576]: I0609 15:10:28.298211 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-kvtk7\" (UniqueName: \"kubernetes.io/projected/ceacecbb-c7f8-493b-ab8d-7a68be32a1bb-kube-api-access-kvtk7\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73d8lbp\" (UID: \"ceacecbb-c7f8-493b-ab8d-7a68be32a1bb\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73d8lbp" Jun 09 15:10:28.298322 ip-10-0-133-239 kubenswrapper[2576]: I0609 15:10:28.298243 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/ceacecbb-c7f8-493b-ab8d-7a68be32a1bb-util\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73d8lbp\" (UID: \"ceacecbb-c7f8-493b-ab8d-7a68be32a1bb\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73d8lbp" Jun 09 15:10:28.399236 ip-10-0-133-239 kubenswrapper[2576]: I0609 15:10:28.399203 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/ceacecbb-c7f8-493b-ab8d-7a68be32a1bb-bundle\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73d8lbp\" (UID: \"ceacecbb-c7f8-493b-ab8d-7a68be32a1bb\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73d8lbp" Jun 09 15:10:28.399363 ip-10-0-133-239 kubenswrapper[2576]: I0609 15:10:28.399244 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-kvtk7\" (UniqueName: \"kubernetes.io/projected/ceacecbb-c7f8-493b-ab8d-7a68be32a1bb-kube-api-access-kvtk7\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73d8lbp\" (UID: \"ceacecbb-c7f8-493b-ab8d-7a68be32a1bb\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73d8lbp" Jun 09 15:10:28.399363 ip-10-0-133-239 kubenswrapper[2576]: I0609 15:10:28.399266 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/ceacecbb-c7f8-493b-ab8d-7a68be32a1bb-util\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73d8lbp\" (UID: \"ceacecbb-c7f8-493b-ab8d-7a68be32a1bb\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73d8lbp" Jun 09 15:10:28.399565 ip-10-0-133-239 kubenswrapper[2576]: I0609 15:10:28.399549 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/ceacecbb-c7f8-493b-ab8d-7a68be32a1bb-util\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73d8lbp\" (UID: \"ceacecbb-c7f8-493b-ab8d-7a68be32a1bb\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73d8lbp" Jun 09 15:10:28.399657 ip-10-0-133-239 kubenswrapper[2576]: I0609 15:10:28.399638 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/ceacecbb-c7f8-493b-ab8d-7a68be32a1bb-bundle\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73d8lbp\" (UID: \"ceacecbb-c7f8-493b-ab8d-7a68be32a1bb\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73d8lbp" Jun 09 15:10:28.407471 ip-10-0-133-239 kubenswrapper[2576]: I0609 15:10:28.407443 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-kvtk7\" (UniqueName: \"kubernetes.io/projected/ceacecbb-c7f8-493b-ab8d-7a68be32a1bb-kube-api-access-kvtk7\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73d8lbp\" (UID: \"ceacecbb-c7f8-493b-ab8d-7a68be32a1bb\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73d8lbp" Jun 09 15:10:28.503777 ip-10-0-133-239 kubenswrapper[2576]: I0609 15:10:28.503697 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73d8lbp" Jun 09 15:10:28.588370 ip-10-0-133-239 kubenswrapper[2576]: I0609 15:10:28.588328 2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1nlw9j"] Jun 09 15:10:28.591247 ip-10-0-133-239 kubenswrapper[2576]: I0609 15:10:28.591225 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1nlw9j" Jun 09 15:10:28.601602 ip-10-0-133-239 kubenswrapper[2576]: I0609 15:10:28.601562 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1nlw9j"] Jun 09 15:10:28.634408 ip-10-0-133-239 kubenswrapper[2576]: I0609 15:10:28.634378 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73d8lbp"] Jun 09 15:10:28.637807 ip-10-0-133-239 kubenswrapper[2576]: W0609 15:10:28.637779 2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podceacecbb_c7f8_493b_ab8d_7a68be32a1bb.slice/crio-ee2e8b5c066ae9f32045c5cd5cc181cd906619d433c944e41a3660134b85079c WatchSource:0}: Error finding container ee2e8b5c066ae9f32045c5cd5cc181cd906619d433c944e41a3660134b85079c: Status 404 returned error can't find the container with id ee2e8b5c066ae9f32045c5cd5cc181cd906619d433c944e41a3660134b85079c Jun 09 15:10:28.702923 ip-10-0-133-239 kubenswrapper[2576]: I0609 15:10:28.702901 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4mx69\" (UniqueName: \"kubernetes.io/projected/756f7736-ed1a-4229-ad38-f68f6243250f-kube-api-access-4mx69\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1nlw9j\" (UID: \"756f7736-ed1a-4229-ad38-f68f6243250f\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1nlw9j" Jun 09 15:10:28.703006 ip-10-0-133-239 kubenswrapper[2576]: I0609 15:10:28.702936 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/756f7736-ed1a-4229-ad38-f68f6243250f-bundle\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1nlw9j\" (UID: \"756f7736-ed1a-4229-ad38-f68f6243250f\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1nlw9j" Jun 09 15:10:28.703006 ip-10-0-133-239 kubenswrapper[2576]: I0609 15:10:28.702994 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/756f7736-ed1a-4229-ad38-f68f6243250f-util\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1nlw9j\" (UID: \"756f7736-ed1a-4229-ad38-f68f6243250f\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1nlw9j" Jun 09 15:10:28.771150 ip-10-0-133-239 kubenswrapper[2576]: I0609 15:10:28.771121 2576 generic.go:356] "Generic (PLEG): container finished" podID="ceacecbb-c7f8-493b-ab8d-7a68be32a1bb" containerID="ce99984a3d7883d5c781463de21f6ff83bfe45ab8f1773e5658bb19d2c9ba1ea" exitCode=0 Jun 09 15:10:28.771291 ip-10-0-133-239 kubenswrapper[2576]: I0609 15:10:28.771209 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73d8lbp" event={"ID":"ceacecbb-c7f8-493b-ab8d-7a68be32a1bb","Type":"ContainerDied","Data":"ce99984a3d7883d5c781463de21f6ff83bfe45ab8f1773e5658bb19d2c9ba1ea"} Jun 09 15:10:28.771291 ip-10-0-133-239 kubenswrapper[2576]: I0609 15:10:28.771259 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73d8lbp" event={"ID":"ceacecbb-c7f8-493b-ab8d-7a68be32a1bb","Type":"ContainerStarted","Data":"ee2e8b5c066ae9f32045c5cd5cc181cd906619d433c944e41a3660134b85079c"} Jun 09 15:10:28.804048 ip-10-0-133-239 kubenswrapper[2576]: I0609 15:10:28.804024 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/756f7736-ed1a-4229-ad38-f68f6243250f-util\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1nlw9j\" (UID: \"756f7736-ed1a-4229-ad38-f68f6243250f\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1nlw9j" Jun 09 15:10:28.804173 ip-10-0-133-239 kubenswrapper[2576]: I0609 15:10:28.804123 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4mx69\" (UniqueName: \"kubernetes.io/projected/756f7736-ed1a-4229-ad38-f68f6243250f-kube-api-access-4mx69\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1nlw9j\" (UID: \"756f7736-ed1a-4229-ad38-f68f6243250f\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1nlw9j" Jun 09 15:10:28.804173 ip-10-0-133-239 kubenswrapper[2576]: I0609 15:10:28.804152 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/756f7736-ed1a-4229-ad38-f68f6243250f-bundle\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1nlw9j\" (UID: \"756f7736-ed1a-4229-ad38-f68f6243250f\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1nlw9j" Jun 09 15:10:28.804451 ip-10-0-133-239 kubenswrapper[2576]: I0609 15:10:28.804435 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/756f7736-ed1a-4229-ad38-f68f6243250f-bundle\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1nlw9j\" (UID: \"756f7736-ed1a-4229-ad38-f68f6243250f\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1nlw9j" Jun 09 15:10:28.804489 ip-10-0-133-239 kubenswrapper[2576]: I0609 15:10:28.804440 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/756f7736-ed1a-4229-ad38-f68f6243250f-util\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1nlw9j\" (UID: \"756f7736-ed1a-4229-ad38-f68f6243250f\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1nlw9j" Jun 09 15:10:28.813351 ip-10-0-133-239 kubenswrapper[2576]: I0609 15:10:28.813323 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-4mx69\" (UniqueName: \"kubernetes.io/projected/756f7736-ed1a-4229-ad38-f68f6243250f-kube-api-access-4mx69\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1nlw9j\" (UID: \"756f7736-ed1a-4229-ad38-f68f6243250f\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1nlw9j" Jun 09 15:10:28.904648 ip-10-0-133-239 kubenswrapper[2576]: I0609 15:10:28.904618 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1nlw9j" Jun 09 15:10:29.044559 ip-10-0-133-239 kubenswrapper[2576]: I0609 15:10:29.044519 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1nlw9j"] Jun 09 15:10:29.046640 ip-10-0-133-239 kubenswrapper[2576]: W0609 15:10:29.046614 2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod756f7736_ed1a_4229_ad38_f68f6243250f.slice/crio-32ed50649ae9520fc420f7f99903aee130c96d087284313786f8dac970b89b03 WatchSource:0}: Error finding container 32ed50649ae9520fc420f7f99903aee130c96d087284313786f8dac970b89b03: Status 404 returned error can't find the container with id 32ed50649ae9520fc420f7f99903aee130c96d087284313786f8dac970b89b03 Jun 09 15:10:29.190468 ip-10-0-133-239 kubenswrapper[2576]: I0609 15:10:29.190441 2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759f9mhh"] Jun 09 15:10:29.192923 ip-10-0-133-239 kubenswrapper[2576]: I0609 15:10:29.192906 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759f9mhh" Jun 09 15:10:29.201427 ip-10-0-133-239 kubenswrapper[2576]: I0609 15:10:29.201403 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759f9mhh"] Jun 09 15:10:29.320909 ip-10-0-133-239 kubenswrapper[2576]: I0609 15:10:29.320830 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/f47c8158-dcad-4be3-9661-055f1f37bf85-util\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759f9mhh\" (UID: \"f47c8158-dcad-4be3-9661-055f1f37bf85\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759f9mhh" Jun 09 15:10:29.320909 ip-10-0-133-239 kubenswrapper[2576]: I0609 15:10:29.320864 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/f47c8158-dcad-4be3-9661-055f1f37bf85-bundle\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759f9mhh\" (UID: \"f47c8158-dcad-4be3-9661-055f1f37bf85\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759f9mhh" Jun 09 15:10:29.321107 ip-10-0-133-239 kubenswrapper[2576]: I0609 15:10:29.320957 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-sqctv\" (UniqueName: \"kubernetes.io/projected/f47c8158-dcad-4be3-9661-055f1f37bf85-kube-api-access-sqctv\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759f9mhh\" (UID: \"f47c8158-dcad-4be3-9661-055f1f37bf85\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759f9mhh" Jun 09 15:10:29.422075 ip-10-0-133-239 kubenswrapper[2576]: I0609 15:10:29.422038 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/f47c8158-dcad-4be3-9661-055f1f37bf85-bundle\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759f9mhh\" (UID: \"f47c8158-dcad-4be3-9661-055f1f37bf85\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759f9mhh" Jun 09 15:10:29.422185 ip-10-0-133-239 kubenswrapper[2576]: I0609 15:10:29.422130 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-sqctv\" (UniqueName: \"kubernetes.io/projected/f47c8158-dcad-4be3-9661-055f1f37bf85-kube-api-access-sqctv\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759f9mhh\" (UID: \"f47c8158-dcad-4be3-9661-055f1f37bf85\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759f9mhh" Jun 09 15:10:29.422185 ip-10-0-133-239 kubenswrapper[2576]: I0609 15:10:29.422162 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/f47c8158-dcad-4be3-9661-055f1f37bf85-util\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759f9mhh\" (UID: \"f47c8158-dcad-4be3-9661-055f1f37bf85\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759f9mhh" Jun 09 15:10:29.422485 ip-10-0-133-239 kubenswrapper[2576]: I0609 15:10:29.422463 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/f47c8158-dcad-4be3-9661-055f1f37bf85-bundle\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759f9mhh\" (UID: \"f47c8158-dcad-4be3-9661-055f1f37bf85\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759f9mhh" Jun 09 15:10:29.422523 ip-10-0-133-239 kubenswrapper[2576]: I0609 15:10:29.422480 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/f47c8158-dcad-4be3-9661-055f1f37bf85-util\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759f9mhh\" (UID: \"f47c8158-dcad-4be3-9661-055f1f37bf85\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759f9mhh" Jun 09 15:10:29.430663 ip-10-0-133-239 kubenswrapper[2576]: I0609 15:10:29.430639 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-sqctv\" (UniqueName: \"kubernetes.io/projected/f47c8158-dcad-4be3-9661-055f1f37bf85-kube-api-access-sqctv\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759f9mhh\" (UID: \"f47c8158-dcad-4be3-9661-055f1f37bf85\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759f9mhh" Jun 09 15:10:29.513691 ip-10-0-133-239 kubenswrapper[2576]: I0609 15:10:29.513651 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759f9mhh" Jun 09 15:10:29.657160 ip-10-0-133-239 kubenswrapper[2576]: I0609 15:10:29.657139 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759f9mhh"] Jun 09 15:10:29.694859 ip-10-0-133-239 kubenswrapper[2576]: W0609 15:10:29.694823 2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf47c8158_dcad_4be3_9661_055f1f37bf85.slice/crio-2442cd8d51ddc8dbfc5d779698f8cdb56ca94302f342324bb2c772505617bcfe WatchSource:0}: Error finding container 2442cd8d51ddc8dbfc5d779698f8cdb56ca94302f342324bb2c772505617bcfe: Status 404 returned error can't find the container with id 2442cd8d51ddc8dbfc5d779698f8cdb56ca94302f342324bb2c772505617bcfe Jun 09 15:10:29.778140 ip-10-0-133-239 kubenswrapper[2576]: I0609 15:10:29.778112 2576 generic.go:356] "Generic (PLEG): container finished" podID="ceacecbb-c7f8-493b-ab8d-7a68be32a1bb" containerID="87d1ba7868acedf04fb524541ce68633a6394f826c82aaf7cbddbc02dd52cf1a" exitCode=0 Jun 09 15:10:29.778309 ip-10-0-133-239 kubenswrapper[2576]: I0609 15:10:29.778196 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73d8lbp" event={"ID":"ceacecbb-c7f8-493b-ab8d-7a68be32a1bb","Type":"ContainerDied","Data":"87d1ba7868acedf04fb524541ce68633a6394f826c82aaf7cbddbc02dd52cf1a"} Jun 09 15:10:29.780034 ip-10-0-133-239 kubenswrapper[2576]: I0609 15:10:29.780004 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759f9mhh" event={"ID":"f47c8158-dcad-4be3-9661-055f1f37bf85","Type":"ContainerStarted","Data":"60ec6edf264d9a83ed52f2caabdd02212e46413ae03e6d73df2f7b91f3f59cea"} Jun 09 15:10:29.780163 ip-10-0-133-239 kubenswrapper[2576]: I0609 15:10:29.780051 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759f9mhh" event={"ID":"f47c8158-dcad-4be3-9661-055f1f37bf85","Type":"ContainerStarted","Data":"2442cd8d51ddc8dbfc5d779698f8cdb56ca94302f342324bb2c772505617bcfe"} Jun 09 15:10:29.781663 ip-10-0-133-239 kubenswrapper[2576]: I0609 15:10:29.781634 2576 generic.go:356] "Generic (PLEG): container finished" podID="756f7736-ed1a-4229-ad38-f68f6243250f" containerID="0d4a5f76c7b4b2cd4b0ceae6f9c338ed6e9535b78489832d3b3656ae616820f9" exitCode=0 Jun 09 15:10:29.781785 ip-10-0-133-239 kubenswrapper[2576]: I0609 15:10:29.781679 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1nlw9j" event={"ID":"756f7736-ed1a-4229-ad38-f68f6243250f","Type":"ContainerDied","Data":"0d4a5f76c7b4b2cd4b0ceae6f9c338ed6e9535b78489832d3b3656ae616820f9"} Jun 09 15:10:29.781785 ip-10-0-133-239 kubenswrapper[2576]: I0609 15:10:29.781721 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1nlw9j" event={"ID":"756f7736-ed1a-4229-ad38-f68f6243250f","Type":"ContainerStarted","Data":"32ed50649ae9520fc420f7f99903aee130c96d087284313786f8dac970b89b03"} Jun 09 15:10:29.786881 ip-10-0-133-239 kubenswrapper[2576]: I0609 15:10:29.786859 2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0dmc2s"] Jun 09 15:10:29.789705 ip-10-0-133-239 kubenswrapper[2576]: I0609 15:10:29.789640 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0dmc2s" Jun 09 15:10:29.800535 ip-10-0-133-239 kubenswrapper[2576]: I0609 15:10:29.800515 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0dmc2s"] Jun 09 15:10:29.826448 ip-10-0-133-239 kubenswrapper[2576]: I0609 15:10:29.826395 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/839b5ef3-1f59-4ea9-bf56-c3cd84a6c7b2-bundle\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0dmc2s\" (UID: \"839b5ef3-1f59-4ea9-bf56-c3cd84a6c7b2\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0dmc2s" Jun 09 15:10:29.826448 ip-10-0-133-239 kubenswrapper[2576]: I0609 15:10:29.826445 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/839b5ef3-1f59-4ea9-bf56-c3cd84a6c7b2-util\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0dmc2s\" (UID: \"839b5ef3-1f59-4ea9-bf56-c3cd84a6c7b2\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0dmc2s" Jun 09 15:10:29.826635 ip-10-0-133-239 kubenswrapper[2576]: I0609 15:10:29.826617 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wc6nl\" (UniqueName: \"kubernetes.io/projected/839b5ef3-1f59-4ea9-bf56-c3cd84a6c7b2-kube-api-access-wc6nl\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0dmc2s\" (UID: \"839b5ef3-1f59-4ea9-bf56-c3cd84a6c7b2\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0dmc2s" Jun 09 15:10:29.927764 ip-10-0-133-239 kubenswrapper[2576]: I0609 15:10:29.927734 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wc6nl\" (UniqueName: \"kubernetes.io/projected/839b5ef3-1f59-4ea9-bf56-c3cd84a6c7b2-kube-api-access-wc6nl\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0dmc2s\" (UID: \"839b5ef3-1f59-4ea9-bf56-c3cd84a6c7b2\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0dmc2s" Jun 09 15:10:29.927914 ip-10-0-133-239 kubenswrapper[2576]: I0609 15:10:29.927795 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/839b5ef3-1f59-4ea9-bf56-c3cd84a6c7b2-bundle\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0dmc2s\" (UID: \"839b5ef3-1f59-4ea9-bf56-c3cd84a6c7b2\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0dmc2s" Jun 09 15:10:29.927914 ip-10-0-133-239 kubenswrapper[2576]: I0609 15:10:29.927828 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/839b5ef3-1f59-4ea9-bf56-c3cd84a6c7b2-util\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0dmc2s\" (UID: \"839b5ef3-1f59-4ea9-bf56-c3cd84a6c7b2\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0dmc2s" Jun 09 15:10:29.928188 ip-10-0-133-239 kubenswrapper[2576]: I0609 15:10:29.928169 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/839b5ef3-1f59-4ea9-bf56-c3cd84a6c7b2-bundle\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0dmc2s\" (UID: \"839b5ef3-1f59-4ea9-bf56-c3cd84a6c7b2\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0dmc2s" Jun 09 15:10:29.928188 ip-10-0-133-239 kubenswrapper[2576]: I0609 15:10:29.928183 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/839b5ef3-1f59-4ea9-bf56-c3cd84a6c7b2-util\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0dmc2s\" (UID: \"839b5ef3-1f59-4ea9-bf56-c3cd84a6c7b2\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0dmc2s" Jun 09 15:10:29.936295 ip-10-0-133-239 kubenswrapper[2576]: I0609 15:10:29.936269 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-wc6nl\" (UniqueName: \"kubernetes.io/projected/839b5ef3-1f59-4ea9-bf56-c3cd84a6c7b2-kube-api-access-wc6nl\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0dmc2s\" (UID: \"839b5ef3-1f59-4ea9-bf56-c3cd84a6c7b2\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0dmc2s" Jun 09 15:10:30.168412 ip-10-0-133-239 kubenswrapper[2576]: I0609 15:10:30.168343 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0dmc2s" Jun 09 15:10:30.296938 ip-10-0-133-239 kubenswrapper[2576]: I0609 15:10:30.296914 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0dmc2s"] Jun 09 15:10:30.297756 ip-10-0-133-239 kubenswrapper[2576]: W0609 15:10:30.297735 2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod839b5ef3_1f59_4ea9_bf56_c3cd84a6c7b2.slice/crio-5555af64aa63dc2dd718dfcc9d169ace1f0795cf7ee4a0cc173dc3702e1423a6 WatchSource:0}: Error finding container 5555af64aa63dc2dd718dfcc9d169ace1f0795cf7ee4a0cc173dc3702e1423a6: Status 404 returned error can't find the container with id 5555af64aa63dc2dd718dfcc9d169ace1f0795cf7ee4a0cc173dc3702e1423a6 Jun 09 15:10:30.790273 ip-10-0-133-239 kubenswrapper[2576]: I0609 15:10:30.790245 2576 generic.go:356] "Generic (PLEG): container finished" podID="f47c8158-dcad-4be3-9661-055f1f37bf85" containerID="60ec6edf264d9a83ed52f2caabdd02212e46413ae03e6d73df2f7b91f3f59cea" exitCode=0 Jun 09 15:10:30.790447 ip-10-0-133-239 kubenswrapper[2576]: I0609 15:10:30.790318 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759f9mhh" event={"ID":"f47c8158-dcad-4be3-9661-055f1f37bf85","Type":"ContainerDied","Data":"60ec6edf264d9a83ed52f2caabdd02212e46413ae03e6d73df2f7b91f3f59cea"} Jun 09 15:10:30.792214 ip-10-0-133-239 kubenswrapper[2576]: I0609 15:10:30.792189 2576 generic.go:356] "Generic (PLEG): container finished" podID="756f7736-ed1a-4229-ad38-f68f6243250f" containerID="1c0c29cbfeb87c65dc485230da517a43a28427be9ebb8389ef475b8cada247a5" exitCode=0 Jun 09 15:10:30.792320 ip-10-0-133-239 kubenswrapper[2576]: I0609 15:10:30.792272 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1nlw9j" event={"ID":"756f7736-ed1a-4229-ad38-f68f6243250f","Type":"ContainerDied","Data":"1c0c29cbfeb87c65dc485230da517a43a28427be9ebb8389ef475b8cada247a5"} Jun 09 15:10:30.793907 ip-10-0-133-239 kubenswrapper[2576]: I0609 15:10:30.793887 2576 generic.go:356] "Generic (PLEG): container finished" podID="839b5ef3-1f59-4ea9-bf56-c3cd84a6c7b2" containerID="b6134cb7e8f77e86dbbd4f14991e717decbecb0ffef97e36e5763d4ef9d1fac8" exitCode=0 Jun 09 15:10:30.794003 ip-10-0-133-239 kubenswrapper[2576]: I0609 15:10:30.793978 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0dmc2s" event={"ID":"839b5ef3-1f59-4ea9-bf56-c3cd84a6c7b2","Type":"ContainerDied","Data":"b6134cb7e8f77e86dbbd4f14991e717decbecb0ffef97e36e5763d4ef9d1fac8"} Jun 09 15:10:30.794084 ip-10-0-133-239 kubenswrapper[2576]: I0609 15:10:30.794019 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0dmc2s" event={"ID":"839b5ef3-1f59-4ea9-bf56-c3cd84a6c7b2","Type":"ContainerStarted","Data":"5555af64aa63dc2dd718dfcc9d169ace1f0795cf7ee4a0cc173dc3702e1423a6"} Jun 09 15:10:30.796399 ip-10-0-133-239 kubenswrapper[2576]: I0609 15:10:30.796377 2576 generic.go:356] "Generic (PLEG): container finished" podID="ceacecbb-c7f8-493b-ab8d-7a68be32a1bb" containerID="67c10269e3998a66142151afba778cdaa2a6f960e95683ffff7c918ed1117616" exitCode=0 Jun 09 15:10:30.796501 ip-10-0-133-239 kubenswrapper[2576]: I0609 15:10:30.796412 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73d8lbp" event={"ID":"ceacecbb-c7f8-493b-ab8d-7a68be32a1bb","Type":"ContainerDied","Data":"67c10269e3998a66142151afba778cdaa2a6f960e95683ffff7c918ed1117616"} Jun 09 15:10:31.802946 ip-10-0-133-239 kubenswrapper[2576]: I0609 15:10:31.802918 2576 generic.go:356] "Generic (PLEG): container finished" podID="f47c8158-dcad-4be3-9661-055f1f37bf85" containerID="1f94f23e4620c50431f067e4ad156b71a0c779fb15b8a6e5b55ade35412a4042" exitCode=0 Jun 09 15:10:31.803311 ip-10-0-133-239 kubenswrapper[2576]: I0609 15:10:31.802989 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759f9mhh" event={"ID":"f47c8158-dcad-4be3-9661-055f1f37bf85","Type":"ContainerDied","Data":"1f94f23e4620c50431f067e4ad156b71a0c779fb15b8a6e5b55ade35412a4042"} Jun 09 15:10:31.805343 ip-10-0-133-239 kubenswrapper[2576]: I0609 15:10:31.805322 2576 generic.go:356] "Generic (PLEG): container finished" podID="756f7736-ed1a-4229-ad38-f68f6243250f" containerID="093f051773163bdfd6d5bf3a8f035f10d190f7e394399c9b1a07f7cbd01c9dd7" exitCode=0 Jun 09 15:10:31.805445 ip-10-0-133-239 kubenswrapper[2576]: I0609 15:10:31.805412 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1nlw9j" event={"ID":"756f7736-ed1a-4229-ad38-f68f6243250f","Type":"ContainerDied","Data":"093f051773163bdfd6d5bf3a8f035f10d190f7e394399c9b1a07f7cbd01c9dd7"} Jun 09 15:10:31.927519 ip-10-0-133-239 kubenswrapper[2576]: I0609 15:10:31.927494 2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73d8lbp" Jun 09 15:10:32.048908 ip-10-0-133-239 kubenswrapper[2576]: I0609 15:10:32.048883 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/ceacecbb-c7f8-493b-ab8d-7a68be32a1bb-util\") pod \"ceacecbb-c7f8-493b-ab8d-7a68be32a1bb\" (UID: \"ceacecbb-c7f8-493b-ab8d-7a68be32a1bb\") " Jun 09 15:10:32.049062 ip-10-0-133-239 kubenswrapper[2576]: I0609 15:10:32.048925 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/ceacecbb-c7f8-493b-ab8d-7a68be32a1bb-bundle\") pod \"ceacecbb-c7f8-493b-ab8d-7a68be32a1bb\" (UID: \"ceacecbb-c7f8-493b-ab8d-7a68be32a1bb\") " Jun 09 15:10:32.049062 ip-10-0-133-239 kubenswrapper[2576]: I0609 15:10:32.048949 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-kvtk7\" (UniqueName: \"kubernetes.io/projected/ceacecbb-c7f8-493b-ab8d-7a68be32a1bb-kube-api-access-kvtk7\") pod \"ceacecbb-c7f8-493b-ab8d-7a68be32a1bb\" (UID: \"ceacecbb-c7f8-493b-ab8d-7a68be32a1bb\") " Jun 09 15:10:32.049578 ip-10-0-133-239 kubenswrapper[2576]: I0609 15:10:32.049549 2576 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/ceacecbb-c7f8-493b-ab8d-7a68be32a1bb-bundle" (OuterVolumeSpecName: "bundle") pod "ceacecbb-c7f8-493b-ab8d-7a68be32a1bb" (UID: "ceacecbb-c7f8-493b-ab8d-7a68be32a1bb"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 09 15:10:32.051051 ip-10-0-133-239 kubenswrapper[2576]: I0609 15:10:32.051033 2576 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/ceacecbb-c7f8-493b-ab8d-7a68be32a1bb-kube-api-access-kvtk7" (OuterVolumeSpecName: "kube-api-access-kvtk7") pod "ceacecbb-c7f8-493b-ab8d-7a68be32a1bb" (UID: "ceacecbb-c7f8-493b-ab8d-7a68be32a1bb"). InnerVolumeSpecName "kube-api-access-kvtk7". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 09 15:10:32.054631 ip-10-0-133-239 kubenswrapper[2576]: I0609 15:10:32.054612 2576 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/ceacecbb-c7f8-493b-ab8d-7a68be32a1bb-util" (OuterVolumeSpecName: "util") pod "ceacecbb-c7f8-493b-ab8d-7a68be32a1bb" (UID: "ceacecbb-c7f8-493b-ab8d-7a68be32a1bb"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 09 15:10:32.149779 ip-10-0-133-239 kubenswrapper[2576]: I0609 15:10:32.149750 2576 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/ceacecbb-c7f8-493b-ab8d-7a68be32a1bb-util\") on node \"ip-10-0-133-239.ec2.internal\" DevicePath \"\"" Jun 09 15:10:32.149779 ip-10-0-133-239 kubenswrapper[2576]: I0609 15:10:32.149772 2576 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/ceacecbb-c7f8-493b-ab8d-7a68be32a1bb-bundle\") on node \"ip-10-0-133-239.ec2.internal\" DevicePath \"\"" Jun 09 15:10:32.149779 ip-10-0-133-239 kubenswrapper[2576]: I0609 15:10:32.149781 2576 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-kvtk7\" (UniqueName: \"kubernetes.io/projected/ceacecbb-c7f8-493b-ab8d-7a68be32a1bb-kube-api-access-kvtk7\") on node \"ip-10-0-133-239.ec2.internal\" DevicePath \"\"" Jun 09 15:10:32.811851 ip-10-0-133-239 kubenswrapper[2576]: I0609 15:10:32.811822 2576 generic.go:356] "Generic (PLEG): container finished" podID="839b5ef3-1f59-4ea9-bf56-c3cd84a6c7b2" containerID="603e2d0b205704d8d9dc4b4b81bc6cd741462877bbdc13efdfa9aecff6536b41" exitCode=0 Jun 09 15:10:32.812299 ip-10-0-133-239 kubenswrapper[2576]: I0609 15:10:32.811892 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0dmc2s" event={"ID":"839b5ef3-1f59-4ea9-bf56-c3cd84a6c7b2","Type":"ContainerDied","Data":"603e2d0b205704d8d9dc4b4b81bc6cd741462877bbdc13efdfa9aecff6536b41"} Jun 09 15:10:32.813873 ip-10-0-133-239 kubenswrapper[2576]: I0609 15:10:32.813854 2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73d8lbp" Jun 09 15:10:32.813966 ip-10-0-133-239 kubenswrapper[2576]: I0609 15:10:32.813853 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73d8lbp" event={"ID":"ceacecbb-c7f8-493b-ab8d-7a68be32a1bb","Type":"ContainerDied","Data":"ee2e8b5c066ae9f32045c5cd5cc181cd906619d433c944e41a3660134b85079c"} Jun 09 15:10:32.813966 ip-10-0-133-239 kubenswrapper[2576]: I0609 15:10:32.813962 2576 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="ee2e8b5c066ae9f32045c5cd5cc181cd906619d433c944e41a3660134b85079c" Jun 09 15:10:32.816145 ip-10-0-133-239 kubenswrapper[2576]: I0609 15:10:32.816124 2576 generic.go:356] "Generic (PLEG): container finished" podID="f47c8158-dcad-4be3-9661-055f1f37bf85" containerID="db6c68a78b35ec26543cc3baab13630d9f87cb3e94bcf7f16aad4b70c8f1463f" exitCode=0 Jun 09 15:10:32.816238 ip-10-0-133-239 kubenswrapper[2576]: I0609 15:10:32.816198 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759f9mhh" event={"ID":"f47c8158-dcad-4be3-9661-055f1f37bf85","Type":"ContainerDied","Data":"db6c68a78b35ec26543cc3baab13630d9f87cb3e94bcf7f16aad4b70c8f1463f"} Jun 09 15:10:33.021000 ip-10-0-133-239 kubenswrapper[2576]: I0609 15:10:33.020976 2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1nlw9j" Jun 09 15:10:33.157478 ip-10-0-133-239 kubenswrapper[2576]: I0609 15:10:33.157389 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-4mx69\" (UniqueName: \"kubernetes.io/projected/756f7736-ed1a-4229-ad38-f68f6243250f-kube-api-access-4mx69\") pod \"756f7736-ed1a-4229-ad38-f68f6243250f\" (UID: \"756f7736-ed1a-4229-ad38-f68f6243250f\") " Jun 09 15:10:33.157478 ip-10-0-133-239 kubenswrapper[2576]: I0609 15:10:33.157451 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/756f7736-ed1a-4229-ad38-f68f6243250f-util\") pod \"756f7736-ed1a-4229-ad38-f68f6243250f\" (UID: \"756f7736-ed1a-4229-ad38-f68f6243250f\") " Jun 09 15:10:33.157693 ip-10-0-133-239 kubenswrapper[2576]: I0609 15:10:33.157551 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/756f7736-ed1a-4229-ad38-f68f6243250f-bundle\") pod \"756f7736-ed1a-4229-ad38-f68f6243250f\" (UID: \"756f7736-ed1a-4229-ad38-f68f6243250f\") " Jun 09 15:10:33.157990 ip-10-0-133-239 kubenswrapper[2576]: I0609 15:10:33.157971 2576 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/756f7736-ed1a-4229-ad38-f68f6243250f-bundle" (OuterVolumeSpecName: "bundle") pod "756f7736-ed1a-4229-ad38-f68f6243250f" (UID: "756f7736-ed1a-4229-ad38-f68f6243250f"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 09 15:10:33.159573 ip-10-0-133-239 kubenswrapper[2576]: I0609 15:10:33.159554 2576 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/756f7736-ed1a-4229-ad38-f68f6243250f-kube-api-access-4mx69" (OuterVolumeSpecName: "kube-api-access-4mx69") pod "756f7736-ed1a-4229-ad38-f68f6243250f" (UID: "756f7736-ed1a-4229-ad38-f68f6243250f"). InnerVolumeSpecName "kube-api-access-4mx69". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 09 15:10:33.163217 ip-10-0-133-239 kubenswrapper[2576]: I0609 15:10:33.163184 2576 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/756f7736-ed1a-4229-ad38-f68f6243250f-util" (OuterVolumeSpecName: "util") pod "756f7736-ed1a-4229-ad38-f68f6243250f" (UID: "756f7736-ed1a-4229-ad38-f68f6243250f"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 09 15:10:33.258998 ip-10-0-133-239 kubenswrapper[2576]: I0609 15:10:33.258971 2576 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/756f7736-ed1a-4229-ad38-f68f6243250f-bundle\") on node \"ip-10-0-133-239.ec2.internal\" DevicePath \"\"" Jun 09 15:10:33.258998 ip-10-0-133-239 kubenswrapper[2576]: I0609 15:10:33.258993 2576 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-4mx69\" (UniqueName: \"kubernetes.io/projected/756f7736-ed1a-4229-ad38-f68f6243250f-kube-api-access-4mx69\") on node \"ip-10-0-133-239.ec2.internal\" DevicePath \"\"" Jun 09 15:10:33.259175 ip-10-0-133-239 kubenswrapper[2576]: I0609 15:10:33.259004 2576 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/756f7736-ed1a-4229-ad38-f68f6243250f-util\") on node \"ip-10-0-133-239.ec2.internal\" DevicePath \"\"" Jun 09 15:10:33.827019 ip-10-0-133-239 kubenswrapper[2576]: I0609 15:10:33.826978 2576 generic.go:356] "Generic (PLEG): container finished" podID="839b5ef3-1f59-4ea9-bf56-c3cd84a6c7b2" containerID="f93281f8dc7afbebd2219c077037980aa0c59eba2a8c602e61a82d65ede5bf31" exitCode=0 Jun 09 15:10:33.827418 ip-10-0-133-239 kubenswrapper[2576]: I0609 15:10:33.827056 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0dmc2s" event={"ID":"839b5ef3-1f59-4ea9-bf56-c3cd84a6c7b2","Type":"ContainerDied","Data":"f93281f8dc7afbebd2219c077037980aa0c59eba2a8c602e61a82d65ede5bf31"} Jun 09 15:10:33.829000 ip-10-0-133-239 kubenswrapper[2576]: I0609 15:10:33.828983 2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1nlw9j" Jun 09 15:10:33.829108 ip-10-0-133-239 kubenswrapper[2576]: I0609 15:10:33.829014 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1nlw9j" event={"ID":"756f7736-ed1a-4229-ad38-f68f6243250f","Type":"ContainerDied","Data":"32ed50649ae9520fc420f7f99903aee130c96d087284313786f8dac970b89b03"} Jun 09 15:10:33.829108 ip-10-0-133-239 kubenswrapper[2576]: I0609 15:10:33.829046 2576 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="32ed50649ae9520fc420f7f99903aee130c96d087284313786f8dac970b89b03" Jun 09 15:10:33.958106 ip-10-0-133-239 kubenswrapper[2576]: I0609 15:10:33.958078 2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759f9mhh" Jun 09 15:10:34.065966 ip-10-0-133-239 kubenswrapper[2576]: I0609 15:10:34.065934 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/f47c8158-dcad-4be3-9661-055f1f37bf85-util\") pod \"f47c8158-dcad-4be3-9661-055f1f37bf85\" (UID: \"f47c8158-dcad-4be3-9661-055f1f37bf85\") " Jun 09 15:10:34.066162 ip-10-0-133-239 kubenswrapper[2576]: I0609 15:10:34.065971 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-sqctv\" (UniqueName: \"kubernetes.io/projected/f47c8158-dcad-4be3-9661-055f1f37bf85-kube-api-access-sqctv\") pod \"f47c8158-dcad-4be3-9661-055f1f37bf85\" (UID: \"f47c8158-dcad-4be3-9661-055f1f37bf85\") " Jun 09 15:10:34.066162 ip-10-0-133-239 kubenswrapper[2576]: I0609 15:10:34.066091 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/f47c8158-dcad-4be3-9661-055f1f37bf85-bundle\") pod \"f47c8158-dcad-4be3-9661-055f1f37bf85\" (UID: \"f47c8158-dcad-4be3-9661-055f1f37bf85\") " Jun 09 15:10:34.066509 ip-10-0-133-239 kubenswrapper[2576]: I0609 15:10:34.066487 2576 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/f47c8158-dcad-4be3-9661-055f1f37bf85-bundle" (OuterVolumeSpecName: "bundle") pod "f47c8158-dcad-4be3-9661-055f1f37bf85" (UID: "f47c8158-dcad-4be3-9661-055f1f37bf85"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 09 15:10:34.068452 ip-10-0-133-239 kubenswrapper[2576]: I0609 15:10:34.068427 2576 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/f47c8158-dcad-4be3-9661-055f1f37bf85-kube-api-access-sqctv" (OuterVolumeSpecName: "kube-api-access-sqctv") pod "f47c8158-dcad-4be3-9661-055f1f37bf85" (UID: "f47c8158-dcad-4be3-9661-055f1f37bf85"). InnerVolumeSpecName "kube-api-access-sqctv". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 09 15:10:34.072489 ip-10-0-133-239 kubenswrapper[2576]: I0609 15:10:34.072467 2576 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/f47c8158-dcad-4be3-9661-055f1f37bf85-util" (OuterVolumeSpecName: "util") pod "f47c8158-dcad-4be3-9661-055f1f37bf85" (UID: "f47c8158-dcad-4be3-9661-055f1f37bf85"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 09 15:10:34.167460 ip-10-0-133-239 kubenswrapper[2576]: I0609 15:10:34.167400 2576 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/f47c8158-dcad-4be3-9661-055f1f37bf85-util\") on node \"ip-10-0-133-239.ec2.internal\" DevicePath \"\"" Jun 09 15:10:34.167460 ip-10-0-133-239 kubenswrapper[2576]: I0609 15:10:34.167422 2576 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-sqctv\" (UniqueName: \"kubernetes.io/projected/f47c8158-dcad-4be3-9661-055f1f37bf85-kube-api-access-sqctv\") on node \"ip-10-0-133-239.ec2.internal\" DevicePath \"\"" Jun 09 15:10:34.167460 ip-10-0-133-239 kubenswrapper[2576]: I0609 15:10:34.167433 2576 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/f47c8158-dcad-4be3-9661-055f1f37bf85-bundle\") on node \"ip-10-0-133-239.ec2.internal\" DevicePath \"\"" Jun 09 15:10:34.836659 ip-10-0-133-239 kubenswrapper[2576]: I0609 15:10:34.836627 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759f9mhh" event={"ID":"f47c8158-dcad-4be3-9661-055f1f37bf85","Type":"ContainerDied","Data":"2442cd8d51ddc8dbfc5d779698f8cdb56ca94302f342324bb2c772505617bcfe"} Jun 09 15:10:34.836659 ip-10-0-133-239 kubenswrapper[2576]: I0609 15:10:34.836652 2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759f9mhh" Jun 09 15:10:34.837102 ip-10-0-133-239 kubenswrapper[2576]: I0609 15:10:34.836674 2576 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="2442cd8d51ddc8dbfc5d779698f8cdb56ca94302f342324bb2c772505617bcfe" Jun 09 15:10:34.973112 ip-10-0-133-239 kubenswrapper[2576]: I0609 15:10:34.973088 2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0dmc2s" Jun 09 15:10:35.075219 ip-10-0-133-239 kubenswrapper[2576]: I0609 15:10:35.075189 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/839b5ef3-1f59-4ea9-bf56-c3cd84a6c7b2-bundle\") pod \"839b5ef3-1f59-4ea9-bf56-c3cd84a6c7b2\" (UID: \"839b5ef3-1f59-4ea9-bf56-c3cd84a6c7b2\") " Jun 09 15:10:35.075376 ip-10-0-133-239 kubenswrapper[2576]: I0609 15:10:35.075232 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-wc6nl\" (UniqueName: \"kubernetes.io/projected/839b5ef3-1f59-4ea9-bf56-c3cd84a6c7b2-kube-api-access-wc6nl\") pod \"839b5ef3-1f59-4ea9-bf56-c3cd84a6c7b2\" (UID: \"839b5ef3-1f59-4ea9-bf56-c3cd84a6c7b2\") " Jun 09 15:10:35.075376 ip-10-0-133-239 kubenswrapper[2576]: I0609 15:10:35.075283 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/839b5ef3-1f59-4ea9-bf56-c3cd84a6c7b2-util\") pod \"839b5ef3-1f59-4ea9-bf56-c3cd84a6c7b2\" (UID: \"839b5ef3-1f59-4ea9-bf56-c3cd84a6c7b2\") " Jun 09 15:10:35.075683 ip-10-0-133-239 kubenswrapper[2576]: I0609 15:10:35.075647 2576 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/839b5ef3-1f59-4ea9-bf56-c3cd84a6c7b2-bundle" (OuterVolumeSpecName: "bundle") pod "839b5ef3-1f59-4ea9-bf56-c3cd84a6c7b2" (UID: "839b5ef3-1f59-4ea9-bf56-c3cd84a6c7b2"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 09 15:10:35.077368 ip-10-0-133-239 kubenswrapper[2576]: I0609 15:10:35.077346 2576 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/839b5ef3-1f59-4ea9-bf56-c3cd84a6c7b2-kube-api-access-wc6nl" (OuterVolumeSpecName: "kube-api-access-wc6nl") pod "839b5ef3-1f59-4ea9-bf56-c3cd84a6c7b2" (UID: "839b5ef3-1f59-4ea9-bf56-c3cd84a6c7b2"). InnerVolumeSpecName "kube-api-access-wc6nl". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 09 15:10:35.080281 ip-10-0-133-239 kubenswrapper[2576]: I0609 15:10:35.080263 2576 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/839b5ef3-1f59-4ea9-bf56-c3cd84a6c7b2-util" (OuterVolumeSpecName: "util") pod "839b5ef3-1f59-4ea9-bf56-c3cd84a6c7b2" (UID: "839b5ef3-1f59-4ea9-bf56-c3cd84a6c7b2"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 09 15:10:35.176769 ip-10-0-133-239 kubenswrapper[2576]: I0609 15:10:35.176708 2576 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/839b5ef3-1f59-4ea9-bf56-c3cd84a6c7b2-bundle\") on node \"ip-10-0-133-239.ec2.internal\" DevicePath \"\"" Jun 09 15:10:35.176769 ip-10-0-133-239 kubenswrapper[2576]: I0609 15:10:35.176732 2576 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-wc6nl\" (UniqueName: \"kubernetes.io/projected/839b5ef3-1f59-4ea9-bf56-c3cd84a6c7b2-kube-api-access-wc6nl\") on node \"ip-10-0-133-239.ec2.internal\" DevicePath \"\"" Jun 09 15:10:35.176769 ip-10-0-133-239 kubenswrapper[2576]: I0609 15:10:35.176741 2576 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/839b5ef3-1f59-4ea9-bf56-c3cd84a6c7b2-util\") on node \"ip-10-0-133-239.ec2.internal\" DevicePath \"\"" Jun 09 15:10:35.850418 ip-10-0-133-239 kubenswrapper[2576]: I0609 15:10:35.850387 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0dmc2s" event={"ID":"839b5ef3-1f59-4ea9-bf56-c3cd84a6c7b2","Type":"ContainerDied","Data":"5555af64aa63dc2dd718dfcc9d169ace1f0795cf7ee4a0cc173dc3702e1423a6"} Jun 09 15:10:35.850418 ip-10-0-133-239 kubenswrapper[2576]: I0609 15:10:35.850403 2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0dmc2s" Jun 09 15:10:35.850801 ip-10-0-133-239 kubenswrapper[2576]: I0609 15:10:35.850433 2576 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="5555af64aa63dc2dd718dfcc9d169ace1f0795cf7ee4a0cc173dc3702e1423a6" Jun 09 15:11:05.338474 ip-10-0-133-239 kubenswrapper[2576]: I0609 15:11:05.338440 2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-console-plugin-66b5774985-cz65c"] Jun 09 15:11:05.338876 ip-10-0-133-239 kubenswrapper[2576]: I0609 15:11:05.338749 2576 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="756f7736-ed1a-4229-ad38-f68f6243250f" containerName="util" Jun 09 15:11:05.338876 ip-10-0-133-239 kubenswrapper[2576]: I0609 15:11:05.338760 2576 state_mem.go:107] "Deleted CPUSet assignment" podUID="756f7736-ed1a-4229-ad38-f68f6243250f" containerName="util" Jun 09 15:11:05.338876 ip-10-0-133-239 kubenswrapper[2576]: I0609 15:11:05.338767 2576 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="ceacecbb-c7f8-493b-ab8d-7a68be32a1bb" containerName="pull" Jun 09 15:11:05.338876 ip-10-0-133-239 kubenswrapper[2576]: I0609 15:11:05.338780 2576 state_mem.go:107] "Deleted CPUSet assignment" podUID="ceacecbb-c7f8-493b-ab8d-7a68be32a1bb" containerName="pull" Jun 09 15:11:05.338876 ip-10-0-133-239 kubenswrapper[2576]: I0609 15:11:05.338787 2576 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="f47c8158-dcad-4be3-9661-055f1f37bf85" containerName="util" Jun 09 15:11:05.338876 ip-10-0-133-239 kubenswrapper[2576]: I0609 15:11:05.338793 2576 state_mem.go:107] "Deleted CPUSet assignment" podUID="f47c8158-dcad-4be3-9661-055f1f37bf85" containerName="util" Jun 09 15:11:05.338876 ip-10-0-133-239 kubenswrapper[2576]: I0609 15:11:05.338801 2576 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="f47c8158-dcad-4be3-9661-055f1f37bf85" containerName="pull" Jun 09 15:11:05.338876 ip-10-0-133-239 kubenswrapper[2576]: I0609 15:11:05.338806 2576 state_mem.go:107] "Deleted CPUSet assignment" podUID="f47c8158-dcad-4be3-9661-055f1f37bf85" containerName="pull" Jun 09 15:11:05.338876 ip-10-0-133-239 kubenswrapper[2576]: I0609 15:11:05.338814 2576 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="f47c8158-dcad-4be3-9661-055f1f37bf85" containerName="extract" Jun 09 15:11:05.338876 ip-10-0-133-239 kubenswrapper[2576]: I0609 15:11:05.338819 2576 state_mem.go:107] "Deleted CPUSet assignment" podUID="f47c8158-dcad-4be3-9661-055f1f37bf85" containerName="extract" Jun 09 15:11:05.338876 ip-10-0-133-239 kubenswrapper[2576]: I0609 15:11:05.338826 2576 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="839b5ef3-1f59-4ea9-bf56-c3cd84a6c7b2" containerName="util" Jun 09 15:11:05.338876 ip-10-0-133-239 kubenswrapper[2576]: I0609 15:11:05.338830 2576 state_mem.go:107] "Deleted CPUSet assignment" podUID="839b5ef3-1f59-4ea9-bf56-c3cd84a6c7b2" containerName="util" Jun 09 15:11:05.338876 ip-10-0-133-239 kubenswrapper[2576]: I0609 15:11:05.338835 2576 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="756f7736-ed1a-4229-ad38-f68f6243250f" containerName="extract" Jun 09 15:11:05.338876 ip-10-0-133-239 kubenswrapper[2576]: I0609 15:11:05.338840 2576 state_mem.go:107] "Deleted CPUSet assignment" podUID="756f7736-ed1a-4229-ad38-f68f6243250f" containerName="extract" Jun 09 15:11:05.338876 ip-10-0-133-239 kubenswrapper[2576]: I0609 15:11:05.338846 2576 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="ceacecbb-c7f8-493b-ab8d-7a68be32a1bb" containerName="extract" Jun 09 15:11:05.338876 ip-10-0-133-239 kubenswrapper[2576]: I0609 15:11:05.338850 2576 state_mem.go:107] "Deleted CPUSet assignment" podUID="ceacecbb-c7f8-493b-ab8d-7a68be32a1bb" containerName="extract" Jun 09 15:11:05.338876 ip-10-0-133-239 kubenswrapper[2576]: I0609 15:11:05.338858 2576 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="756f7736-ed1a-4229-ad38-f68f6243250f" containerName="pull" Jun 09 15:11:05.338876 ip-10-0-133-239 kubenswrapper[2576]: I0609 15:11:05.338863 2576 state_mem.go:107] "Deleted CPUSet assignment" podUID="756f7736-ed1a-4229-ad38-f68f6243250f" containerName="pull" Jun 09 15:11:05.338876 ip-10-0-133-239 kubenswrapper[2576]: I0609 15:11:05.338873 2576 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="839b5ef3-1f59-4ea9-bf56-c3cd84a6c7b2" containerName="extract" Jun 09 15:11:05.338876 ip-10-0-133-239 kubenswrapper[2576]: I0609 15:11:05.338879 2576 state_mem.go:107] "Deleted CPUSet assignment" podUID="839b5ef3-1f59-4ea9-bf56-c3cd84a6c7b2" containerName="extract" Jun 09 15:11:05.338876 ip-10-0-133-239 kubenswrapper[2576]: I0609 15:11:05.338886 2576 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="ceacecbb-c7f8-493b-ab8d-7a68be32a1bb" containerName="util" Jun 09 15:11:05.339499 ip-10-0-133-239 kubenswrapper[2576]: I0609 15:11:05.338890 2576 state_mem.go:107] "Deleted CPUSet assignment" podUID="ceacecbb-c7f8-493b-ab8d-7a68be32a1bb" containerName="util" Jun 09 15:11:05.339499 ip-10-0-133-239 kubenswrapper[2576]: I0609 15:11:05.338895 2576 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="839b5ef3-1f59-4ea9-bf56-c3cd84a6c7b2" containerName="pull" Jun 09 15:11:05.339499 ip-10-0-133-239 kubenswrapper[2576]: I0609 15:11:05.338900 2576 state_mem.go:107] "Deleted CPUSet assignment" podUID="839b5ef3-1f59-4ea9-bf56-c3cd84a6c7b2" containerName="pull" Jun 09 15:11:05.339499 ip-10-0-133-239 kubenswrapper[2576]: I0609 15:11:05.338974 2576 memory_manager.go:368] "RemoveStaleState removing state" podUID="839b5ef3-1f59-4ea9-bf56-c3cd84a6c7b2" containerName="extract" Jun 09 15:11:05.339499 ip-10-0-133-239 kubenswrapper[2576]: I0609 15:11:05.338982 2576 memory_manager.go:368] "RemoveStaleState removing state" podUID="756f7736-ed1a-4229-ad38-f68f6243250f" containerName="extract" Jun 09 15:11:05.339499 ip-10-0-133-239 kubenswrapper[2576]: I0609 15:11:05.338989 2576 memory_manager.go:368] "RemoveStaleState removing state" podUID="f47c8158-dcad-4be3-9661-055f1f37bf85" containerName="extract" Jun 09 15:11:05.339499 ip-10-0-133-239 kubenswrapper[2576]: I0609 15:11:05.338994 2576 memory_manager.go:368] "RemoveStaleState removing state" podUID="ceacecbb-c7f8-493b-ab8d-7a68be32a1bb" containerName="extract" Jun 09 15:11:05.343338 ip-10-0-133-239 kubenswrapper[2576]: I0609 15:11:05.343317 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-console-plugin-66b5774985-cz65c" Jun 09 15:11:05.346183 ip-10-0-133-239 kubenswrapper[2576]: I0609 15:11:05.346167 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"kuadrant-console-nginx-conf\"" Jun 09 15:11:05.346426 ip-10-0-133-239 kubenswrapper[2576]: I0609 15:11:05.346413 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"default-dockercfg-pk677\"" Jun 09 15:11:05.346595 ip-10-0-133-239 kubenswrapper[2576]: I0609 15:11:05.346572 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"plugin-serving-cert\"" Jun 09 15:11:05.351169 ip-10-0-133-239 kubenswrapper[2576]: I0609 15:11:05.347854 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"kube-root-ca.crt\"" Jun 09 15:11:05.351169 ip-10-0-133-239 kubenswrapper[2576]: I0609 15:11:05.348137 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"openshift-service-ca.crt\"" Jun 09 15:11:05.358484 ip-10-0-133-239 kubenswrapper[2576]: I0609 15:11:05.358466 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-console-plugin-66b5774985-cz65c"] Jun 09 15:11:05.431752 ip-10-0-133-239 kubenswrapper[2576]: I0609 15:11:05.431718 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/42505a9e-c2d9-4993-a1ec-7fe9ac068b9a-nginx-conf\") pod \"kuadrant-console-plugin-66b5774985-cz65c\" (UID: \"42505a9e-c2d9-4993-a1ec-7fe9ac068b9a\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-cz65c" Jun 09 15:11:05.431919 ip-10-0-133-239 kubenswrapper[2576]: I0609 15:11:05.431768 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugin-serving-cert\" (UniqueName: \"kubernetes.io/secret/42505a9e-c2d9-4993-a1ec-7fe9ac068b9a-plugin-serving-cert\") pod \"kuadrant-console-plugin-66b5774985-cz65c\" (UID: \"42505a9e-c2d9-4993-a1ec-7fe9ac068b9a\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-cz65c" Jun 09 15:11:05.431919 ip-10-0-133-239 kubenswrapper[2576]: I0609 15:11:05.431797 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jrzzs\" (UniqueName: \"kubernetes.io/projected/42505a9e-c2d9-4993-a1ec-7fe9ac068b9a-kube-api-access-jrzzs\") pod \"kuadrant-console-plugin-66b5774985-cz65c\" (UID: \"42505a9e-c2d9-4993-a1ec-7fe9ac068b9a\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-cz65c" Jun 09 15:11:05.532590 ip-10-0-133-239 kubenswrapper[2576]: I0609 15:11:05.532559 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/42505a9e-c2d9-4993-a1ec-7fe9ac068b9a-nginx-conf\") pod \"kuadrant-console-plugin-66b5774985-cz65c\" (UID: \"42505a9e-c2d9-4993-a1ec-7fe9ac068b9a\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-cz65c" Jun 09 15:11:05.532759 ip-10-0-133-239 kubenswrapper[2576]: I0609 15:11:05.532612 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugin-serving-cert\" (UniqueName: \"kubernetes.io/secret/42505a9e-c2d9-4993-a1ec-7fe9ac068b9a-plugin-serving-cert\") pod \"kuadrant-console-plugin-66b5774985-cz65c\" (UID: \"42505a9e-c2d9-4993-a1ec-7fe9ac068b9a\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-cz65c" Jun 09 15:11:05.532759 ip-10-0-133-239 kubenswrapper[2576]: I0609 15:11:05.532638 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jrzzs\" (UniqueName: \"kubernetes.io/projected/42505a9e-c2d9-4993-a1ec-7fe9ac068b9a-kube-api-access-jrzzs\") pod \"kuadrant-console-plugin-66b5774985-cz65c\" (UID: \"42505a9e-c2d9-4993-a1ec-7fe9ac068b9a\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-cz65c" Jun 09 15:11:05.533199 ip-10-0-133-239 kubenswrapper[2576]: I0609 15:11:05.533180 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/42505a9e-c2d9-4993-a1ec-7fe9ac068b9a-nginx-conf\") pod \"kuadrant-console-plugin-66b5774985-cz65c\" (UID: \"42505a9e-c2d9-4993-a1ec-7fe9ac068b9a\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-cz65c" Jun 09 15:11:05.535001 ip-10-0-133-239 kubenswrapper[2576]: I0609 15:11:05.534979 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"plugin-serving-cert\" (UniqueName: \"kubernetes.io/secret/42505a9e-c2d9-4993-a1ec-7fe9ac068b9a-plugin-serving-cert\") pod \"kuadrant-console-plugin-66b5774985-cz65c\" (UID: \"42505a9e-c2d9-4993-a1ec-7fe9ac068b9a\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-cz65c" Jun 09 15:11:05.543341 ip-10-0-133-239 kubenswrapper[2576]: I0609 15:11:05.543316 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-jrzzs\" (UniqueName: \"kubernetes.io/projected/42505a9e-c2d9-4993-a1ec-7fe9ac068b9a-kube-api-access-jrzzs\") pod \"kuadrant-console-plugin-66b5774985-cz65c\" (UID: \"42505a9e-c2d9-4993-a1ec-7fe9ac068b9a\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-cz65c" Jun 09 15:11:05.657826 ip-10-0-133-239 kubenswrapper[2576]: I0609 15:11:05.657754 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-console-plugin-66b5774985-cz65c" Jun 09 15:11:05.794972 ip-10-0-133-239 kubenswrapper[2576]: I0609 15:11:05.794948 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-console-plugin-66b5774985-cz65c"] Jun 09 15:11:05.796510 ip-10-0-133-239 kubenswrapper[2576]: W0609 15:11:05.796485 2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod42505a9e_c2d9_4993_a1ec_7fe9ac068b9a.slice/crio-72ded90978dc365800bd75514f81c9de27a66498356537d23578d6f5557cd5bd WatchSource:0}: Error finding container 72ded90978dc365800bd75514f81c9de27a66498356537d23578d6f5557cd5bd: Status 404 returned error can't find the container with id 72ded90978dc365800bd75514f81c9de27a66498356537d23578d6f5557cd5bd Jun 09 15:11:05.997708 ip-10-0-133-239 kubenswrapper[2576]: I0609 15:11:05.997622 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-console-plugin-66b5774985-cz65c" event={"ID":"42505a9e-c2d9-4993-a1ec-7fe9ac068b9a","Type":"ContainerStarted","Data":"72ded90978dc365800bd75514f81c9de27a66498356537d23578d6f5557cd5bd"} Jun 09 15:11:32.603035 ip-10-0-133-239 kubenswrapper[2576]: I0609 15:11:32.603010 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-668fdbf85c-wmg5x_37922842-1a2e-44d7-861f-edca166e718b/console-operator/2.log" Jun 09 15:11:32.603508 ip-10-0-133-239 kubenswrapper[2576]: I0609 15:11:32.603047 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-668fdbf85c-wmg5x_37922842-1a2e-44d7-861f-edca166e718b/console-operator/2.log" Jun 09 15:11:32.609778 ip-10-0-133-239 kubenswrapper[2576]: I0609 15:11:32.609760 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-n4c97_441b2a74-d62c-4e3c-9e0f-b133cd4364be/ovn-acl-logging/0.log" Jun 09 15:11:32.609903 ip-10-0-133-239 kubenswrapper[2576]: I0609 15:11:32.609827 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-n4c97_441b2a74-d62c-4e3c-9e0f-b133cd4364be/ovn-acl-logging/0.log" Jun 09 15:11:33.153381 ip-10-0-133-239 kubenswrapper[2576]: I0609 15:11:33.153345 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-console-plugin-66b5774985-cz65c" event={"ID":"42505a9e-c2d9-4993-a1ec-7fe9ac068b9a","Type":"ContainerStarted","Data":"90d53250fb8b35ef557ac891f2299bbe905f335ab86e7a0c487528c10cc40504"} Jun 09 15:11:33.177035 ip-10-0-133-239 kubenswrapper[2576]: I0609 15:11:33.176986 2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-console-plugin-66b5774985-cz65c" podStartSLOduration=1.334984927 podStartE2EDuration="28.176971395s" totalImagesPullingTime="26.841986468s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-09 15:11:05 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-09 15:11:33.174560054 +0000 UTC m=+608.028716302" watchObservedRunningTime="2026-06-09 15:11:33.176971395 +0000 UTC m=+608.031127633" Jun 09 15:12:01.604080 ip-10-0-133-239 kubenswrapper[2576]: I0609 15:12:01.604038 2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-58cd955675-8vnqm"] Jun 09 15:12:01.706881 ip-10-0-133-239 kubenswrapper[2576]: I0609 15:12:01.706852 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-58cd955675-8vnqm"] Jun 09 15:12:01.707036 ip-10-0-133-239 kubenswrapper[2576]: I0609 15:12:01.706931 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-58cd955675-8vnqm" Jun 09 15:12:01.710955 ip-10-0-133-239 kubenswrapper[2576]: I0609 15:12:01.710933 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"authorino-authorino-dockercfg-fm7r2\"" Jun 09 15:12:01.797444 ip-10-0-133-239 kubenswrapper[2576]: I0609 15:12:01.797411 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-js746\" (UniqueName: \"kubernetes.io/projected/577adc59-f557-4da9-8605-d22a902be3f8-kube-api-access-js746\") pod \"authorino-58cd955675-8vnqm\" (UID: \"577adc59-f557-4da9-8605-d22a902be3f8\") " pod="kuadrant-system/authorino-58cd955675-8vnqm" Jun 09 15:12:01.898324 ip-10-0-133-239 kubenswrapper[2576]: I0609 15:12:01.898232 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-js746\" (UniqueName: \"kubernetes.io/projected/577adc59-f557-4da9-8605-d22a902be3f8-kube-api-access-js746\") pod \"authorino-58cd955675-8vnqm\" (UID: \"577adc59-f557-4da9-8605-d22a902be3f8\") " pod="kuadrant-system/authorino-58cd955675-8vnqm" Jun 09 15:12:01.915555 ip-10-0-133-239 kubenswrapper[2576]: I0609 15:12:01.915521 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-js746\" (UniqueName: \"kubernetes.io/projected/577adc59-f557-4da9-8605-d22a902be3f8-kube-api-access-js746\") pod \"authorino-58cd955675-8vnqm\" (UID: \"577adc59-f557-4da9-8605-d22a902be3f8\") " pod="kuadrant-system/authorino-58cd955675-8vnqm" Jun 09 15:12:02.002578 ip-10-0-133-239 kubenswrapper[2576]: I0609 15:12:02.002546 2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-75d556bd77-plccn"] Jun 09 15:12:02.015641 ip-10-0-133-239 kubenswrapper[2576]: I0609 15:12:02.015606 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-58cd955675-8vnqm" Jun 09 15:12:02.036271 ip-10-0-133-239 kubenswrapper[2576]: I0609 15:12:02.036244 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-75d556bd77-plccn"] Jun 09 15:12:02.036423 ip-10-0-133-239 kubenswrapper[2576]: I0609 15:12:02.036310 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-75d556bd77-plccn" Jun 09 15:12:02.100335 ip-10-0-133-239 kubenswrapper[2576]: I0609 15:12:02.100296 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-pzr9h\" (UniqueName: \"kubernetes.io/projected/28139b0e-7a04-4751-bc0c-de3147fcfad1-kube-api-access-pzr9h\") pod \"authorino-75d556bd77-plccn\" (UID: \"28139b0e-7a04-4751-bc0c-de3147fcfad1\") " pod="kuadrant-system/authorino-75d556bd77-plccn" Jun 09 15:12:02.200884 ip-10-0-133-239 kubenswrapper[2576]: I0609 15:12:02.200796 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-pzr9h\" (UniqueName: \"kubernetes.io/projected/28139b0e-7a04-4751-bc0c-de3147fcfad1-kube-api-access-pzr9h\") pod \"authorino-75d556bd77-plccn\" (UID: \"28139b0e-7a04-4751-bc0c-de3147fcfad1\") " pod="kuadrant-system/authorino-75d556bd77-plccn" Jun 09 15:12:02.212664 ip-10-0-133-239 kubenswrapper[2576]: W0609 15:12:02.212638 2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod577adc59_f557_4da9_8605_d22a902be3f8.slice/crio-da58eda9946819171c45bdb8a75d92f9ed1dc84b3df173d12857f3bf87073c37 WatchSource:0}: Error finding container da58eda9946819171c45bdb8a75d92f9ed1dc84b3df173d12857f3bf87073c37: Status 404 returned error can't find the container with id da58eda9946819171c45bdb8a75d92f9ed1dc84b3df173d12857f3bf87073c37 Jun 09 15:12:02.215084 ip-10-0-133-239 kubenswrapper[2576]: I0609 15:12:02.215042 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-58cd955675-8vnqm"] Jun 09 15:12:02.220562 ip-10-0-133-239 kubenswrapper[2576]: I0609 15:12:02.220541 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-pzr9h\" (UniqueName: \"kubernetes.io/projected/28139b0e-7a04-4751-bc0c-de3147fcfad1-kube-api-access-pzr9h\") pod \"authorino-75d556bd77-plccn\" (UID: \"28139b0e-7a04-4751-bc0c-de3147fcfad1\") " pod="kuadrant-system/authorino-75d556bd77-plccn" Jun 09 15:12:02.302344 ip-10-0-133-239 kubenswrapper[2576]: I0609 15:12:02.302309 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-58cd955675-8vnqm" event={"ID":"577adc59-f557-4da9-8605-d22a902be3f8","Type":"ContainerStarted","Data":"da58eda9946819171c45bdb8a75d92f9ed1dc84b3df173d12857f3bf87073c37"} Jun 09 15:12:02.369634 ip-10-0-133-239 kubenswrapper[2576]: I0609 15:12:02.369600 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-75d556bd77-plccn" Jun 09 15:12:02.533051 ip-10-0-133-239 kubenswrapper[2576]: I0609 15:12:02.533019 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-75d556bd77-plccn"] Jun 09 15:12:02.534217 ip-10-0-133-239 kubenswrapper[2576]: W0609 15:12:02.534175 2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod28139b0e_7a04_4751_bc0c_de3147fcfad1.slice/crio-89a1e64fd93f9b1893ea41b5a2422a6a9c1ad2c71f28d1f0561b0b1ae7139885 WatchSource:0}: Error finding container 89a1e64fd93f9b1893ea41b5a2422a6a9c1ad2c71f28d1f0561b0b1ae7139885: Status 404 returned error can't find the container with id 89a1e64fd93f9b1893ea41b5a2422a6a9c1ad2c71f28d1f0561b0b1ae7139885 Jun 09 15:12:03.313618 ip-10-0-133-239 kubenswrapper[2576]: I0609 15:12:03.313558 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-75d556bd77-plccn" event={"ID":"28139b0e-7a04-4751-bc0c-de3147fcfad1","Type":"ContainerStarted","Data":"89a1e64fd93f9b1893ea41b5a2422a6a9c1ad2c71f28d1f0561b0b1ae7139885"} Jun 09 15:12:06.335526 ip-10-0-133-239 kubenswrapper[2576]: I0609 15:12:06.335355 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-75d556bd77-plccn" event={"ID":"28139b0e-7a04-4751-bc0c-de3147fcfad1","Type":"ContainerStarted","Data":"6a4a3c56e58c7e10cee84d9d4f742a106042304e7de020807226f2addaec7e10"} Jun 09 15:12:06.336985 ip-10-0-133-239 kubenswrapper[2576]: I0609 15:12:06.336960 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-58cd955675-8vnqm" event={"ID":"577adc59-f557-4da9-8605-d22a902be3f8","Type":"ContainerStarted","Data":"0fe434c7100accca0be6997945dd9f046c5052d4569b618f168365cea674880d"} Jun 09 15:12:06.358844 ip-10-0-133-239 kubenswrapper[2576]: I0609 15:12:06.358795 2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/authorino-75d556bd77-plccn" podStartSLOduration=1.839537932 podStartE2EDuration="5.358780777s" totalImagesPullingTime="3.519242845s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-09 15:12:01 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-09 15:12:06.356097368 +0000 UTC m=+641.210253602" watchObservedRunningTime="2026-06-09 15:12:06.358780777 +0000 UTC m=+641.212937078" Jun 09 15:12:06.387408 ip-10-0-133-239 kubenswrapper[2576]: I0609 15:12:06.387365 2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/authorino-58cd955675-8vnqm" podStartSLOduration=1.5573357049999998 podStartE2EDuration="5.387350493s" totalImagesPullingTime="3.830014788s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-09 15:12:01 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-09 15:12:06.384787105 +0000 UTC m=+641.238943346" watchObservedRunningTime="2026-06-09 15:12:06.387350493 +0000 UTC m=+641.241506760" Jun 09 15:12:06.438134 ip-10-0-133-239 kubenswrapper[2576]: I0609 15:12:06.438102 2576 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-58cd955675-8vnqm"] Jun 09 15:12:08.347820 ip-10-0-133-239 kubenswrapper[2576]: I0609 15:12:08.347777 2576 kuberuntime_container.go:872] "Killing container with a grace period" pod="kuadrant-system/authorino-58cd955675-8vnqm" podUID="577adc59-f557-4da9-8605-d22a902be3f8" containerName="authorino" containerID="cri-o://0fe434c7100accca0be6997945dd9f046c5052d4569b618f168365cea674880d" gracePeriod=30 Jun 09 15:12:08.591562 ip-10-0-133-239 kubenswrapper[2576]: I0609 15:12:08.591538 2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-58cd955675-8vnqm" Jun 09 15:12:08.660162 ip-10-0-133-239 kubenswrapper[2576]: I0609 15:12:08.660092 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-js746\" (UniqueName: \"kubernetes.io/projected/577adc59-f557-4da9-8605-d22a902be3f8-kube-api-access-js746\") pod \"577adc59-f557-4da9-8605-d22a902be3f8\" (UID: \"577adc59-f557-4da9-8605-d22a902be3f8\") " Jun 09 15:12:08.662116 ip-10-0-133-239 kubenswrapper[2576]: I0609 15:12:08.662082 2576 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/577adc59-f557-4da9-8605-d22a902be3f8-kube-api-access-js746" (OuterVolumeSpecName: "kube-api-access-js746") pod "577adc59-f557-4da9-8605-d22a902be3f8" (UID: "577adc59-f557-4da9-8605-d22a902be3f8"). InnerVolumeSpecName "kube-api-access-js746". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 09 15:12:08.761416 ip-10-0-133-239 kubenswrapper[2576]: I0609 15:12:08.761382 2576 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-js746\" (UniqueName: \"kubernetes.io/projected/577adc59-f557-4da9-8605-d22a902be3f8-kube-api-access-js746\") on node \"ip-10-0-133-239.ec2.internal\" DevicePath \"\"" Jun 09 15:12:09.354458 ip-10-0-133-239 kubenswrapper[2576]: I0609 15:12:09.354424 2576 generic.go:356] "Generic (PLEG): container finished" podID="577adc59-f557-4da9-8605-d22a902be3f8" containerID="0fe434c7100accca0be6997945dd9f046c5052d4569b618f168365cea674880d" exitCode=0 Jun 09 15:12:09.354458 ip-10-0-133-239 kubenswrapper[2576]: I0609 15:12:09.354459 2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-58cd955675-8vnqm" Jun 09 15:12:09.354891 ip-10-0-133-239 kubenswrapper[2576]: I0609 15:12:09.354507 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-58cd955675-8vnqm" event={"ID":"577adc59-f557-4da9-8605-d22a902be3f8","Type":"ContainerDied","Data":"0fe434c7100accca0be6997945dd9f046c5052d4569b618f168365cea674880d"} Jun 09 15:12:09.354891 ip-10-0-133-239 kubenswrapper[2576]: I0609 15:12:09.354546 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-58cd955675-8vnqm" event={"ID":"577adc59-f557-4da9-8605-d22a902be3f8","Type":"ContainerDied","Data":"da58eda9946819171c45bdb8a75d92f9ed1dc84b3df173d12857f3bf87073c37"} Jun 09 15:12:09.354891 ip-10-0-133-239 kubenswrapper[2576]: I0609 15:12:09.354565 2576 scope.go:117] "RemoveContainer" containerID="0fe434c7100accca0be6997945dd9f046c5052d4569b618f168365cea674880d" Jun 09 15:12:09.364257 ip-10-0-133-239 kubenswrapper[2576]: I0609 15:12:09.364238 2576 scope.go:117] "RemoveContainer" containerID="0fe434c7100accca0be6997945dd9f046c5052d4569b618f168365cea674880d" Jun 09 15:12:09.364562 ip-10-0-133-239 kubenswrapper[2576]: E0609 15:12:09.364536 2576 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"0fe434c7100accca0be6997945dd9f046c5052d4569b618f168365cea674880d\": container with ID starting with 0fe434c7100accca0be6997945dd9f046c5052d4569b618f168365cea674880d not found: ID does not exist" containerID="0fe434c7100accca0be6997945dd9f046c5052d4569b618f168365cea674880d" Jun 09 15:12:09.364618 ip-10-0-133-239 kubenswrapper[2576]: I0609 15:12:09.364572 2576 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"0fe434c7100accca0be6997945dd9f046c5052d4569b618f168365cea674880d"} err="failed to get container status \"0fe434c7100accca0be6997945dd9f046c5052d4569b618f168365cea674880d\": rpc error: code = NotFound desc = could not find container \"0fe434c7100accca0be6997945dd9f046c5052d4569b618f168365cea674880d\": container with ID starting with 0fe434c7100accca0be6997945dd9f046c5052d4569b618f168365cea674880d not found: ID does not exist" Jun 09 15:12:09.377797 ip-10-0-133-239 kubenswrapper[2576]: I0609 15:12:09.377771 2576 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-58cd955675-8vnqm"] Jun 09 15:12:09.384418 ip-10-0-133-239 kubenswrapper[2576]: I0609 15:12:09.384398 2576 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/authorino-58cd955675-8vnqm"] Jun 09 15:12:09.603905 ip-10-0-133-239 kubenswrapper[2576]: I0609 15:12:09.603873 2576 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="577adc59-f557-4da9-8605-d22a902be3f8" path="/var/lib/kubelet/pods/577adc59-f557-4da9-8605-d22a902be3f8/volumes" Jun 09 15:12:35.651324 ip-10-0-133-239 kubenswrapper[2576]: I0609 15:12:35.651296 2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-marketplace/0228a3cc79630676fae641e6a38dab1752e85a08a4a9edc59ccf0da748lhq28"] Jun 09 15:12:35.651742 ip-10-0-133-239 kubenswrapper[2576]: I0609 15:12:35.651601 2576 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="577adc59-f557-4da9-8605-d22a902be3f8" containerName="authorino" Jun 09 15:12:35.651742 ip-10-0-133-239 kubenswrapper[2576]: I0609 15:12:35.651612 2576 state_mem.go:107] "Deleted CPUSet assignment" podUID="577adc59-f557-4da9-8605-d22a902be3f8" containerName="authorino" Jun 09 15:12:35.651742 ip-10-0-133-239 kubenswrapper[2576]: I0609 15:12:35.651673 2576 memory_manager.go:368] "RemoveStaleState removing state" podUID="577adc59-f557-4da9-8605-d22a902be3f8" containerName="authorino" Jun 09 15:12:35.656026 ip-10-0-133-239 kubenswrapper[2576]: I0609 15:12:35.656007 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/0228a3cc79630676fae641e6a38dab1752e85a08a4a9edc59ccf0da748lhq28" Jun 09 15:12:35.659171 ip-10-0-133-239 kubenswrapper[2576]: E0609 15:12:35.659135 2576 status_manager.go:1018] "Failed to get status for pod" err="pods \"0228a3cc79630676fae641e6a38dab1752e85a08a4a9edc59ccf0da748lhq28\" is forbidden: User \"system:node:ip-10-0-133-239.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"openshift-marketplace\": no relationship found between node 'ip-10-0-133-239.ec2.internal' and this object" podUID="8159f313-9478-4f2b-9fe0-88cd90644963" pod="openshift-marketplace/0228a3cc79630676fae641e6a38dab1752e85a08a4a9edc59ccf0da748lhq28" Jun 09 15:12:35.659171 ip-10-0-133-239 kubenswrapper[2576]: I0609 15:12:35.659163 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-marketplace\"/\"default-dockercfg-sjd8c\"" Jun 09 15:12:35.659340 ip-10-0-133-239 kubenswrapper[2576]: I0609 15:12:35.659248 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"openshift-service-ca.crt\"" Jun 09 15:12:35.659979 ip-10-0-133-239 kubenswrapper[2576]: I0609 15:12:35.659965 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"kube-root-ca.crt\"" Jun 09 15:12:35.689549 ip-10-0-133-239 kubenswrapper[2576]: I0609 15:12:35.689521 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/0228a3cc79630676fae641e6a38dab1752e85a08a4a9edc59ccf0da748lhq28"] Jun 09 15:12:35.800722 ip-10-0-133-239 kubenswrapper[2576]: I0609 15:12:35.800675 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qbggd\" (UniqueName: \"kubernetes.io/projected/8159f313-9478-4f2b-9fe0-88cd90644963-kube-api-access-qbggd\") pod \"0228a3cc79630676fae641e6a38dab1752e85a08a4a9edc59ccf0da748lhq28\" (UID: \"8159f313-9478-4f2b-9fe0-88cd90644963\") " pod="openshift-marketplace/0228a3cc79630676fae641e6a38dab1752e85a08a4a9edc59ccf0da748lhq28" Jun 09 15:12:35.800899 ip-10-0-133-239 kubenswrapper[2576]: I0609 15:12:35.800732 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/8159f313-9478-4f2b-9fe0-88cd90644963-util\") pod \"0228a3cc79630676fae641e6a38dab1752e85a08a4a9edc59ccf0da748lhq28\" (UID: \"8159f313-9478-4f2b-9fe0-88cd90644963\") " pod="openshift-marketplace/0228a3cc79630676fae641e6a38dab1752e85a08a4a9edc59ccf0da748lhq28" Jun 09 15:12:35.800899 ip-10-0-133-239 kubenswrapper[2576]: I0609 15:12:35.800822 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/8159f313-9478-4f2b-9fe0-88cd90644963-bundle\") pod \"0228a3cc79630676fae641e6a38dab1752e85a08a4a9edc59ccf0da748lhq28\" (UID: \"8159f313-9478-4f2b-9fe0-88cd90644963\") " pod="openshift-marketplace/0228a3cc79630676fae641e6a38dab1752e85a08a4a9edc59ccf0da748lhq28" Jun 09 15:12:35.901759 ip-10-0-133-239 kubenswrapper[2576]: I0609 15:12:35.901678 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/8159f313-9478-4f2b-9fe0-88cd90644963-bundle\") pod \"0228a3cc79630676fae641e6a38dab1752e85a08a4a9edc59ccf0da748lhq28\" (UID: \"8159f313-9478-4f2b-9fe0-88cd90644963\") " pod="openshift-marketplace/0228a3cc79630676fae641e6a38dab1752e85a08a4a9edc59ccf0da748lhq28" Jun 09 15:12:35.901759 ip-10-0-133-239 kubenswrapper[2576]: I0609 15:12:35.901741 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qbggd\" (UniqueName: \"kubernetes.io/projected/8159f313-9478-4f2b-9fe0-88cd90644963-kube-api-access-qbggd\") pod \"0228a3cc79630676fae641e6a38dab1752e85a08a4a9edc59ccf0da748lhq28\" (UID: \"8159f313-9478-4f2b-9fe0-88cd90644963\") " pod="openshift-marketplace/0228a3cc79630676fae641e6a38dab1752e85a08a4a9edc59ccf0da748lhq28" Jun 09 15:12:35.901759 ip-10-0-133-239 kubenswrapper[2576]: I0609 15:12:35.901764 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/8159f313-9478-4f2b-9fe0-88cd90644963-util\") pod \"0228a3cc79630676fae641e6a38dab1752e85a08a4a9edc59ccf0da748lhq28\" (UID: \"8159f313-9478-4f2b-9fe0-88cd90644963\") " pod="openshift-marketplace/0228a3cc79630676fae641e6a38dab1752e85a08a4a9edc59ccf0da748lhq28" Jun 09 15:12:35.902046 ip-10-0-133-239 kubenswrapper[2576]: I0609 15:12:35.902027 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/8159f313-9478-4f2b-9fe0-88cd90644963-bundle\") pod \"0228a3cc79630676fae641e6a38dab1752e85a08a4a9edc59ccf0da748lhq28\" (UID: \"8159f313-9478-4f2b-9fe0-88cd90644963\") " pod="openshift-marketplace/0228a3cc79630676fae641e6a38dab1752e85a08a4a9edc59ccf0da748lhq28" Jun 09 15:12:35.902118 ip-10-0-133-239 kubenswrapper[2576]: I0609 15:12:35.902094 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/8159f313-9478-4f2b-9fe0-88cd90644963-util\") pod \"0228a3cc79630676fae641e6a38dab1752e85a08a4a9edc59ccf0da748lhq28\" (UID: \"8159f313-9478-4f2b-9fe0-88cd90644963\") " pod="openshift-marketplace/0228a3cc79630676fae641e6a38dab1752e85a08a4a9edc59ccf0da748lhq28" Jun 09 15:12:35.911639 ip-10-0-133-239 kubenswrapper[2576]: I0609 15:12:35.911619 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-qbggd\" (UniqueName: \"kubernetes.io/projected/8159f313-9478-4f2b-9fe0-88cd90644963-kube-api-access-qbggd\") pod \"0228a3cc79630676fae641e6a38dab1752e85a08a4a9edc59ccf0da748lhq28\" (UID: \"8159f313-9478-4f2b-9fe0-88cd90644963\") " pod="openshift-marketplace/0228a3cc79630676fae641e6a38dab1752e85a08a4a9edc59ccf0da748lhq28" Jun 09 15:12:35.965401 ip-10-0-133-239 kubenswrapper[2576]: I0609 15:12:35.965378 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/0228a3cc79630676fae641e6a38dab1752e85a08a4a9edc59ccf0da748lhq28" Jun 09 15:12:36.098971 ip-10-0-133-239 kubenswrapper[2576]: I0609 15:12:36.098945 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/0228a3cc79630676fae641e6a38dab1752e85a08a4a9edc59ccf0da748lhq28"] Jun 09 15:12:36.100791 ip-10-0-133-239 kubenswrapper[2576]: W0609 15:12:36.100762 2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8159f313_9478_4f2b_9fe0_88cd90644963.slice/crio-3e48a83544ed3f65aabd1e06b046f73fdc9447f715d7d9df8f603b8025e89521 WatchSource:0}: Error finding container 3e48a83544ed3f65aabd1e06b046f73fdc9447f715d7d9df8f603b8025e89521: Status 404 returned error can't find the container with id 3e48a83544ed3f65aabd1e06b046f73fdc9447f715d7d9df8f603b8025e89521 Jun 09 15:12:36.500241 ip-10-0-133-239 kubenswrapper[2576]: I0609 15:12:36.500146 2576 generic.go:356] "Generic (PLEG): container finished" podID="8159f313-9478-4f2b-9fe0-88cd90644963" containerID="5d71c1a0467d74135c725fa45cb8631f42b44539644a00cbcd61a44db6e0d54c" exitCode=0 Jun 09 15:12:36.500376 ip-10-0-133-239 kubenswrapper[2576]: I0609 15:12:36.500238 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/0228a3cc79630676fae641e6a38dab1752e85a08a4a9edc59ccf0da748lhq28" event={"ID":"8159f313-9478-4f2b-9fe0-88cd90644963","Type":"ContainerDied","Data":"5d71c1a0467d74135c725fa45cb8631f42b44539644a00cbcd61a44db6e0d54c"} Jun 09 15:12:36.500376 ip-10-0-133-239 kubenswrapper[2576]: I0609 15:12:36.500286 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/0228a3cc79630676fae641e6a38dab1752e85a08a4a9edc59ccf0da748lhq28" event={"ID":"8159f313-9478-4f2b-9fe0-88cd90644963","Type":"ContainerStarted","Data":"3e48a83544ed3f65aabd1e06b046f73fdc9447f715d7d9df8f603b8025e89521"} Jun 09 15:12:37.507104 ip-10-0-133-239 kubenswrapper[2576]: I0609 15:12:37.507001 2576 generic.go:356] "Generic (PLEG): container finished" podID="8159f313-9478-4f2b-9fe0-88cd90644963" containerID="21b6516b052219aa0182160772a59db3c5f60ab33fedb1f7c0fadbbc47236f3c" exitCode=0 Jun 09 15:12:37.507104 ip-10-0-133-239 kubenswrapper[2576]: I0609 15:12:37.507051 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/0228a3cc79630676fae641e6a38dab1752e85a08a4a9edc59ccf0da748lhq28" event={"ID":"8159f313-9478-4f2b-9fe0-88cd90644963","Type":"ContainerDied","Data":"21b6516b052219aa0182160772a59db3c5f60ab33fedb1f7c0fadbbc47236f3c"} Jun 09 15:12:38.513785 ip-10-0-133-239 kubenswrapper[2576]: I0609 15:12:38.513753 2576 generic.go:356] "Generic (PLEG): container finished" podID="8159f313-9478-4f2b-9fe0-88cd90644963" containerID="09199dcec59dfef14f12d0fd87df86117da2f18e86b7db31943e507063eac28c" exitCode=0 Jun 09 15:12:38.514164 ip-10-0-133-239 kubenswrapper[2576]: I0609 15:12:38.513833 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/0228a3cc79630676fae641e6a38dab1752e85a08a4a9edc59ccf0da748lhq28" event={"ID":"8159f313-9478-4f2b-9fe0-88cd90644963","Type":"ContainerDied","Data":"09199dcec59dfef14f12d0fd87df86117da2f18e86b7db31943e507063eac28c"} Jun 09 15:12:39.658219 ip-10-0-133-239 kubenswrapper[2576]: I0609 15:12:39.658192 2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/0228a3cc79630676fae641e6a38dab1752e85a08a4a9edc59ccf0da748lhq28" Jun 09 15:12:39.837813 ip-10-0-133-239 kubenswrapper[2576]: I0609 15:12:39.837739 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/8159f313-9478-4f2b-9fe0-88cd90644963-util\") pod \"8159f313-9478-4f2b-9fe0-88cd90644963\" (UID: \"8159f313-9478-4f2b-9fe0-88cd90644963\") " Jun 09 15:12:39.837813 ip-10-0-133-239 kubenswrapper[2576]: I0609 15:12:39.837772 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/8159f313-9478-4f2b-9fe0-88cd90644963-bundle\") pod \"8159f313-9478-4f2b-9fe0-88cd90644963\" (UID: \"8159f313-9478-4f2b-9fe0-88cd90644963\") " Jun 09 15:12:39.838007 ip-10-0-133-239 kubenswrapper[2576]: I0609 15:12:39.837825 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-qbggd\" (UniqueName: \"kubernetes.io/projected/8159f313-9478-4f2b-9fe0-88cd90644963-kube-api-access-qbggd\") pod \"8159f313-9478-4f2b-9fe0-88cd90644963\" (UID: \"8159f313-9478-4f2b-9fe0-88cd90644963\") " Jun 09 15:12:39.838311 ip-10-0-133-239 kubenswrapper[2576]: I0609 15:12:39.838281 2576 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/8159f313-9478-4f2b-9fe0-88cd90644963-bundle" (OuterVolumeSpecName: "bundle") pod "8159f313-9478-4f2b-9fe0-88cd90644963" (UID: "8159f313-9478-4f2b-9fe0-88cd90644963"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 09 15:12:39.839889 ip-10-0-133-239 kubenswrapper[2576]: I0609 15:12:39.839869 2576 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/8159f313-9478-4f2b-9fe0-88cd90644963-kube-api-access-qbggd" (OuterVolumeSpecName: "kube-api-access-qbggd") pod "8159f313-9478-4f2b-9fe0-88cd90644963" (UID: "8159f313-9478-4f2b-9fe0-88cd90644963"). InnerVolumeSpecName "kube-api-access-qbggd". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 09 15:12:39.843945 ip-10-0-133-239 kubenswrapper[2576]: I0609 15:12:39.843903 2576 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/8159f313-9478-4f2b-9fe0-88cd90644963-util" (OuterVolumeSpecName: "util") pod "8159f313-9478-4f2b-9fe0-88cd90644963" (UID: "8159f313-9478-4f2b-9fe0-88cd90644963"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 09 15:12:39.938511 ip-10-0-133-239 kubenswrapper[2576]: I0609 15:12:39.938479 2576 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/8159f313-9478-4f2b-9fe0-88cd90644963-util\") on node \"ip-10-0-133-239.ec2.internal\" DevicePath \"\"" Jun 09 15:12:39.938511 ip-10-0-133-239 kubenswrapper[2576]: I0609 15:12:39.938504 2576 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/8159f313-9478-4f2b-9fe0-88cd90644963-bundle\") on node \"ip-10-0-133-239.ec2.internal\" DevicePath \"\"" Jun 09 15:12:39.938511 ip-10-0-133-239 kubenswrapper[2576]: I0609 15:12:39.938516 2576 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-qbggd\" (UniqueName: \"kubernetes.io/projected/8159f313-9478-4f2b-9fe0-88cd90644963-kube-api-access-qbggd\") on node \"ip-10-0-133-239.ec2.internal\" DevicePath \"\"" Jun 09 15:12:40.527137 ip-10-0-133-239 kubenswrapper[2576]: I0609 15:12:40.527099 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/0228a3cc79630676fae641e6a38dab1752e85a08a4a9edc59ccf0da748lhq28" event={"ID":"8159f313-9478-4f2b-9fe0-88cd90644963","Type":"ContainerDied","Data":"3e48a83544ed3f65aabd1e06b046f73fdc9447f715d7d9df8f603b8025e89521"} Jun 09 15:12:40.527137 ip-10-0-133-239 kubenswrapper[2576]: I0609 15:12:40.527120 2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/0228a3cc79630676fae641e6a38dab1752e85a08a4a9edc59ccf0da748lhq28" Jun 09 15:12:40.527137 ip-10-0-133-239 kubenswrapper[2576]: I0609 15:12:40.527148 2576 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="3e48a83544ed3f65aabd1e06b046f73fdc9447f715d7d9df8f603b8025e89521" Jun 09 15:13:01.993722 ip-10-0-133-239 kubenswrapper[2576]: I0609 15:13:01.993688 2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["keycloak-system/maas-keycloak-0"] Jun 09 15:13:01.994125 ip-10-0-133-239 kubenswrapper[2576]: I0609 15:13:01.994005 2576 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="8159f313-9478-4f2b-9fe0-88cd90644963" containerName="extract" Jun 09 15:13:01.994125 ip-10-0-133-239 kubenswrapper[2576]: I0609 15:13:01.994020 2576 state_mem.go:107] "Deleted CPUSet assignment" podUID="8159f313-9478-4f2b-9fe0-88cd90644963" containerName="extract" Jun 09 15:13:01.994125 ip-10-0-133-239 kubenswrapper[2576]: I0609 15:13:01.994035 2576 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="8159f313-9478-4f2b-9fe0-88cd90644963" containerName="util" Jun 09 15:13:01.994125 ip-10-0-133-239 kubenswrapper[2576]: I0609 15:13:01.994042 2576 state_mem.go:107] "Deleted CPUSet assignment" podUID="8159f313-9478-4f2b-9fe0-88cd90644963" containerName="util" Jun 09 15:13:01.994125 ip-10-0-133-239 kubenswrapper[2576]: I0609 15:13:01.994053 2576 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="8159f313-9478-4f2b-9fe0-88cd90644963" containerName="pull" Jun 09 15:13:01.994125 ip-10-0-133-239 kubenswrapper[2576]: I0609 15:13:01.994060 2576 state_mem.go:107] "Deleted CPUSet assignment" podUID="8159f313-9478-4f2b-9fe0-88cd90644963" containerName="pull" Jun 09 15:13:01.994350 ip-10-0-133-239 kubenswrapper[2576]: I0609 15:13:01.994142 2576 memory_manager.go:368] "RemoveStaleState removing state" podUID="8159f313-9478-4f2b-9fe0-88cd90644963" containerName="extract" Jun 09 15:13:01.996845 ip-10-0-133-239 kubenswrapper[2576]: I0609 15:13:01.996826 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="keycloak-system/maas-keycloak-0" Jun 09 15:13:02.006134 ip-10-0-133-239 kubenswrapper[2576]: I0609 15:13:02.006114 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"keycloak-system\"/\"maas-keycloak-initial-admin\"" Jun 09 15:13:02.006241 ip-10-0-133-239 kubenswrapper[2576]: I0609 15:13:02.006115 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"keycloak-system\"/\"kube-root-ca.crt\"" Jun 09 15:13:02.006427 ip-10-0-133-239 kubenswrapper[2576]: I0609 15:13:02.006410 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"keycloak-system\"/\"default-dockercfg-sjf2t\"" Jun 09 15:13:02.006496 ip-10-0-133-239 kubenswrapper[2576]: I0609 15:13:02.006471 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"keycloak-system\"/\"openshift-service-ca.crt\"" Jun 09 15:13:02.023170 ip-10-0-133-239 kubenswrapper[2576]: I0609 15:13:02.023148 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["keycloak-system/maas-keycloak-0"] Jun 09 15:13:02.125249 ip-10-0-133-239 kubenswrapper[2576]: I0609 15:13:02.125210 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jtj65\" (UniqueName: \"kubernetes.io/projected/d366bd75-3098-4e3e-bef6-237b318eac61-kube-api-access-jtj65\") pod \"maas-keycloak-0\" (UID: \"d366bd75-3098-4e3e-bef6-237b318eac61\") " pod="keycloak-system/maas-keycloak-0" Jun 09 15:13:02.226062 ip-10-0-133-239 kubenswrapper[2576]: I0609 15:13:02.226022 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jtj65\" (UniqueName: \"kubernetes.io/projected/d366bd75-3098-4e3e-bef6-237b318eac61-kube-api-access-jtj65\") pod \"maas-keycloak-0\" (UID: \"d366bd75-3098-4e3e-bef6-237b318eac61\") " pod="keycloak-system/maas-keycloak-0" Jun 09 15:13:02.235778 ip-10-0-133-239 kubenswrapper[2576]: I0609 15:13:02.235755 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-jtj65\" (UniqueName: \"kubernetes.io/projected/d366bd75-3098-4e3e-bef6-237b318eac61-kube-api-access-jtj65\") pod \"maas-keycloak-0\" (UID: \"d366bd75-3098-4e3e-bef6-237b318eac61\") " pod="keycloak-system/maas-keycloak-0" Jun 09 15:13:02.305735 ip-10-0-133-239 kubenswrapper[2576]: I0609 15:13:02.305683 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="keycloak-system/maas-keycloak-0" Jun 09 15:13:02.451121 ip-10-0-133-239 kubenswrapper[2576]: I0609 15:13:02.451093 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["keycloak-system/maas-keycloak-0"] Jun 09 15:13:02.452755 ip-10-0-133-239 kubenswrapper[2576]: W0609 15:13:02.452725 2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd366bd75_3098_4e3e_bef6_237b318eac61.slice/crio-1657e8ae9ec5e724e27b0b924f96a9c967df3116aff39077b43e420968b21139 WatchSource:0}: Error finding container 1657e8ae9ec5e724e27b0b924f96a9c967df3116aff39077b43e420968b21139: Status 404 returned error can't find the container with id 1657e8ae9ec5e724e27b0b924f96a9c967df3116aff39077b43e420968b21139 Jun 09 15:13:02.454218 ip-10-0-133-239 kubenswrapper[2576]: I0609 15:13:02.454197 2576 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jun 09 15:13:02.641283 ip-10-0-133-239 kubenswrapper[2576]: I0609 15:13:02.641202 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="keycloak-system/maas-keycloak-0" event={"ID":"d366bd75-3098-4e3e-bef6-237b318eac61","Type":"ContainerStarted","Data":"1657e8ae9ec5e724e27b0b924f96a9c967df3116aff39077b43e420968b21139"} Jun 09 15:13:08.683605 ip-10-0-133-239 kubenswrapper[2576]: I0609 15:13:08.683569 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="keycloak-system/maas-keycloak-0" event={"ID":"d366bd75-3098-4e3e-bef6-237b318eac61","Type":"ContainerStarted","Data":"15e5fc02542604da987d0d0ca95a19f2c1424de51390bbc6aa4f25ad4660e4cb"} Jun 09 15:13:08.708308 ip-10-0-133-239 kubenswrapper[2576]: I0609 15:13:08.708253 2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="keycloak-system/maas-keycloak-0" podStartSLOduration=2.2997128780000002 podStartE2EDuration="7.708236946s" totalImagesPullingTime="5.408524068s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-09 15:13:01 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-09 15:13:08.70611461 +0000 UTC m=+703.560270852" watchObservedRunningTime="2026-06-09 15:13:08.708236946 +0000 UTC m=+703.562393184" Jun 09 15:13:09.306509 ip-10-0-133-239 kubenswrapper[2576]: I0609 15:13:09.306465 2576 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="keycloak-system/maas-keycloak-0" Jun 09 15:13:09.308279 ip-10-0-133-239 kubenswrapper[2576]: I0609 15:13:09.308237 2576 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="d366bd75-3098-4e3e-bef6-237b318eac61" containerName="keycloak" probeResult="failure" output="Get \"http://10.134.0.42:9000/health/started\": dial tcp 10.134.0.42:9000: connect: connection refused" Jun 09 15:13:10.306810 ip-10-0-133-239 kubenswrapper[2576]: I0609 15:13:10.306767 2576 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="d366bd75-3098-4e3e-bef6-237b318eac61" containerName="keycloak" probeResult="failure" output="Get \"http://10.134.0.42:9000/health/started\": dial tcp 10.134.0.42:9000: connect: connection refused" Jun 09 15:13:11.306348 ip-10-0-133-239 kubenswrapper[2576]: I0609 15:13:11.306295 2576 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="d366bd75-3098-4e3e-bef6-237b318eac61" containerName="keycloak" probeResult="failure" output="Get \"http://10.134.0.42:9000/health/started\": dial tcp 10.134.0.42:9000: connect: connection refused" Jun 09 15:13:12.306278 ip-10-0-133-239 kubenswrapper[2576]: I0609 15:13:12.306236 2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="keycloak-system/maas-keycloak-0" Jun 09 15:13:12.306910 ip-10-0-133-239 kubenswrapper[2576]: I0609 15:13:12.306865 2576 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="d366bd75-3098-4e3e-bef6-237b318eac61" containerName="keycloak" probeResult="failure" output="Get \"http://10.134.0.42:9000/health/started\": dial tcp 10.134.0.42:9000: connect: connection refused" Jun 09 15:13:13.306373 ip-10-0-133-239 kubenswrapper[2576]: I0609 15:13:13.306319 2576 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="d366bd75-3098-4e3e-bef6-237b318eac61" containerName="keycloak" probeResult="failure" output="Get \"http://10.134.0.42:9000/health/started\": dial tcp 10.134.0.42:9000: connect: connection refused" Jun 09 15:13:14.306888 ip-10-0-133-239 kubenswrapper[2576]: I0609 15:13:14.306835 2576 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="d366bd75-3098-4e3e-bef6-237b318eac61" containerName="keycloak" probeResult="failure" output="Get \"http://10.134.0.42:9000/health/started\": dial tcp 10.134.0.42:9000: connect: connection refused" Jun 09 15:13:15.306632 ip-10-0-133-239 kubenswrapper[2576]: I0609 15:13:15.306583 2576 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="d366bd75-3098-4e3e-bef6-237b318eac61" containerName="keycloak" probeResult="failure" output="Get \"http://10.134.0.42:9000/health/started\": dial tcp 10.134.0.42:9000: connect: connection refused" Jun 09 15:13:16.306433 ip-10-0-133-239 kubenswrapper[2576]: I0609 15:13:16.306390 2576 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="d366bd75-3098-4e3e-bef6-237b318eac61" containerName="keycloak" probeResult="failure" output="Get \"http://10.134.0.42:9000/health/started\": dial tcp 10.134.0.42:9000: connect: connection refused" Jun 09 15:13:17.307822 ip-10-0-133-239 kubenswrapper[2576]: I0609 15:13:17.306545 2576 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="d366bd75-3098-4e3e-bef6-237b318eac61" containerName="keycloak" probeResult="failure" output="Get \"http://10.134.0.42:9000/health/started\": dial tcp 10.134.0.42:9000: connect: connection refused" Jun 09 15:13:18.306679 ip-10-0-133-239 kubenswrapper[2576]: I0609 15:13:18.306627 2576 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="d366bd75-3098-4e3e-bef6-237b318eac61" containerName="keycloak" probeResult="failure" output="Get \"http://10.134.0.42:9000/health/started\": dial tcp 10.134.0.42:9000: connect: connection refused" Jun 09 15:13:19.306641 ip-10-0-133-239 kubenswrapper[2576]: I0609 15:13:19.306592 2576 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="d366bd75-3098-4e3e-bef6-237b318eac61" containerName="keycloak" probeResult="failure" output="Get \"http://10.134.0.42:9000/health/started\": dial tcp 10.134.0.42:9000: connect: connection refused" Jun 09 15:13:20.306165 ip-10-0-133-239 kubenswrapper[2576]: I0609 15:13:20.306129 2576 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="d366bd75-3098-4e3e-bef6-237b318eac61" containerName="keycloak" probeResult="failure" output="Get \"http://10.134.0.42:9000/health/started\": dial tcp 10.134.0.42:9000: connect: connection refused" Jun 09 15:13:21.429057 ip-10-0-133-239 kubenswrapper[2576]: I0609 15:13:21.429025 2576 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="keycloak-system/maas-keycloak-0" Jun 09 15:13:21.447173 ip-10-0-133-239 kubenswrapper[2576]: I0609 15:13:21.447126 2576 prober.go:120] "Probe failed" probeType="Readiness" pod="keycloak-system/maas-keycloak-0" podUID="d366bd75-3098-4e3e-bef6-237b318eac61" containerName="keycloak" probeResult="failure" output="HTTP probe failed with statuscode: 503" Jun 09 15:13:31.434933 ip-10-0-133-239 kubenswrapper[2576]: I0609 15:13:31.434900 2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="keycloak-system/maas-keycloak-0" Jun 09 15:13:32.358246 ip-10-0-133-239 kubenswrapper[2576]: I0609 15:13:32.358204 2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-5d4b67c446-vs7hs"] Jun 09 15:13:32.366279 ip-10-0-133-239 kubenswrapper[2576]: I0609 15:13:32.366253 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-5d4b67c446-vs7hs" Jun 09 15:13:32.387827 ip-10-0-133-239 kubenswrapper[2576]: I0609 15:13:32.387796 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-5d4b67c446-vs7hs"] Jun 09 15:13:32.413521 ip-10-0-133-239 kubenswrapper[2576]: I0609 15:13:32.413493 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vhj7j\" (UniqueName: \"kubernetes.io/projected/c9d36fbc-fce9-4406-9a78-7ce9e6f12db9-kube-api-access-vhj7j\") pod \"authorino-5d4b67c446-vs7hs\" (UID: \"c9d36fbc-fce9-4406-9a78-7ce9e6f12db9\") " pod="kuadrant-system/authorino-5d4b67c446-vs7hs" Jun 09 15:13:32.514268 ip-10-0-133-239 kubenswrapper[2576]: I0609 15:13:32.514241 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vhj7j\" (UniqueName: \"kubernetes.io/projected/c9d36fbc-fce9-4406-9a78-7ce9e6f12db9-kube-api-access-vhj7j\") pod \"authorino-5d4b67c446-vs7hs\" (UID: \"c9d36fbc-fce9-4406-9a78-7ce9e6f12db9\") " pod="kuadrant-system/authorino-5d4b67c446-vs7hs" Jun 09 15:13:32.532667 ip-10-0-133-239 kubenswrapper[2576]: I0609 15:13:32.532638 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-vhj7j\" (UniqueName: \"kubernetes.io/projected/c9d36fbc-fce9-4406-9a78-7ce9e6f12db9-kube-api-access-vhj7j\") pod \"authorino-5d4b67c446-vs7hs\" (UID: \"c9d36fbc-fce9-4406-9a78-7ce9e6f12db9\") " pod="kuadrant-system/authorino-5d4b67c446-vs7hs" Jun 09 15:13:32.598771 ip-10-0-133-239 kubenswrapper[2576]: I0609 15:13:32.598742 2576 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-5d4b67c446-vs7hs"] Jun 09 15:13:32.599024 ip-10-0-133-239 kubenswrapper[2576]: I0609 15:13:32.599012 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-5d4b67c446-vs7hs" Jun 09 15:13:32.635389 ip-10-0-133-239 kubenswrapper[2576]: I0609 15:13:32.635353 2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-5cd4ffd8df-4vs6c"] Jun 09 15:13:32.639388 ip-10-0-133-239 kubenswrapper[2576]: I0609 15:13:32.639361 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-5cd4ffd8df-4vs6c" Jun 09 15:13:32.653141 ip-10-0-133-239 kubenswrapper[2576]: I0609 15:13:32.653113 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-5cd4ffd8df-4vs6c"] Jun 09 15:13:32.716794 ip-10-0-133-239 kubenswrapper[2576]: I0609 15:13:32.716765 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2vb4c\" (UniqueName: \"kubernetes.io/projected/01ef3f4c-096b-4234-9499-e7c5d617b101-kube-api-access-2vb4c\") pod \"authorino-5cd4ffd8df-4vs6c\" (UID: \"01ef3f4c-096b-4234-9499-e7c5d617b101\") " pod="kuadrant-system/authorino-5cd4ffd8df-4vs6c" Jun 09 15:13:32.736237 ip-10-0-133-239 kubenswrapper[2576]: I0609 15:13:32.736212 2576 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-5d4b67c446-vs7hs"] Jun 09 15:13:32.737586 ip-10-0-133-239 kubenswrapper[2576]: W0609 15:13:32.737557 2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podc9d36fbc_fce9_4406_9a78_7ce9e6f12db9.slice/crio-98dcac57487039544b651ad7620dea32df4f599a5b5c37e26dad65ec84b65b3c WatchSource:0}: Error finding container 98dcac57487039544b651ad7620dea32df4f599a5b5c37e26dad65ec84b65b3c: Status 404 returned error can't find the container with id 98dcac57487039544b651ad7620dea32df4f599a5b5c37e26dad65ec84b65b3c Jun 09 15:13:32.817611 ip-10-0-133-239 kubenswrapper[2576]: I0609 15:13:32.817582 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2vb4c\" (UniqueName: \"kubernetes.io/projected/01ef3f4c-096b-4234-9499-e7c5d617b101-kube-api-access-2vb4c\") pod \"authorino-5cd4ffd8df-4vs6c\" (UID: \"01ef3f4c-096b-4234-9499-e7c5d617b101\") " pod="kuadrant-system/authorino-5cd4ffd8df-4vs6c" Jun 09 15:13:32.827849 ip-10-0-133-239 kubenswrapper[2576]: I0609 15:13:32.827823 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-2vb4c\" (UniqueName: \"kubernetes.io/projected/01ef3f4c-096b-4234-9499-e7c5d617b101-kube-api-access-2vb4c\") pod \"authorino-5cd4ffd8df-4vs6c\" (UID: \"01ef3f4c-096b-4234-9499-e7c5d617b101\") " pod="kuadrant-system/authorino-5cd4ffd8df-4vs6c" Jun 09 15:13:32.850280 ip-10-0-133-239 kubenswrapper[2576]: I0609 15:13:32.850244 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-5d4b67c446-vs7hs" event={"ID":"c9d36fbc-fce9-4406-9a78-7ce9e6f12db9","Type":"ContainerStarted","Data":"98dcac57487039544b651ad7620dea32df4f599a5b5c37e26dad65ec84b65b3c"} Jun 09 15:13:32.943863 ip-10-0-133-239 kubenswrapper[2576]: I0609 15:13:32.943786 2576 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-5cd4ffd8df-4vs6c"] Jun 09 15:13:32.944101 ip-10-0-133-239 kubenswrapper[2576]: I0609 15:13:32.944089 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-5cd4ffd8df-4vs6c" Jun 09 15:13:32.999514 ip-10-0-133-239 kubenswrapper[2576]: I0609 15:13:32.999482 2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-765689c4d9-m8tkb"] Jun 09 15:13:33.003136 ip-10-0-133-239 kubenswrapper[2576]: I0609 15:13:33.003114 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-765689c4d9-m8tkb" Jun 09 15:13:33.012644 ip-10-0-133-239 kubenswrapper[2576]: I0609 15:13:33.012625 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"authorino-server-cert\"" Jun 09 15:13:33.018952 ip-10-0-133-239 kubenswrapper[2576]: I0609 15:13:33.018933 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/45b7c1f9-8b13-4612-97f6-e5840f9beb90-tls-cert\") pod \"authorino-765689c4d9-m8tkb\" (UID: \"45b7c1f9-8b13-4612-97f6-e5840f9beb90\") " pod="kuadrant-system/authorino-765689c4d9-m8tkb" Jun 09 15:13:33.019059 ip-10-0-133-239 kubenswrapper[2576]: I0609 15:13:33.018973 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4xlx4\" (UniqueName: \"kubernetes.io/projected/45b7c1f9-8b13-4612-97f6-e5840f9beb90-kube-api-access-4xlx4\") pod \"authorino-765689c4d9-m8tkb\" (UID: \"45b7c1f9-8b13-4612-97f6-e5840f9beb90\") " pod="kuadrant-system/authorino-765689c4d9-m8tkb" Jun 09 15:13:33.030435 ip-10-0-133-239 kubenswrapper[2576]: I0609 15:13:33.030413 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-765689c4d9-m8tkb"] Jun 09 15:13:33.090953 ip-10-0-133-239 kubenswrapper[2576]: W0609 15:13:33.090927 2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod01ef3f4c_096b_4234_9499_e7c5d617b101.slice/crio-0908226f2c4b421763269f4847c88187698ba884cc77fb22859c914697974758 WatchSource:0}: Error finding container 0908226f2c4b421763269f4847c88187698ba884cc77fb22859c914697974758: Status 404 returned error can't find the container with id 0908226f2c4b421763269f4847c88187698ba884cc77fb22859c914697974758 Jun 09 15:13:33.091076 ip-10-0-133-239 kubenswrapper[2576]: I0609 15:13:33.090991 2576 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-5cd4ffd8df-4vs6c"] Jun 09 15:13:33.120396 ip-10-0-133-239 kubenswrapper[2576]: I0609 15:13:33.120376 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/45b7c1f9-8b13-4612-97f6-e5840f9beb90-tls-cert\") pod \"authorino-765689c4d9-m8tkb\" (UID: \"45b7c1f9-8b13-4612-97f6-e5840f9beb90\") " pod="kuadrant-system/authorino-765689c4d9-m8tkb" Jun 09 15:13:33.120495 ip-10-0-133-239 kubenswrapper[2576]: I0609 15:13:33.120420 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4xlx4\" (UniqueName: \"kubernetes.io/projected/45b7c1f9-8b13-4612-97f6-e5840f9beb90-kube-api-access-4xlx4\") pod \"authorino-765689c4d9-m8tkb\" (UID: \"45b7c1f9-8b13-4612-97f6-e5840f9beb90\") " pod="kuadrant-system/authorino-765689c4d9-m8tkb" Jun 09 15:13:33.122612 ip-10-0-133-239 kubenswrapper[2576]: I0609 15:13:33.122594 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/45b7c1f9-8b13-4612-97f6-e5840f9beb90-tls-cert\") pod \"authorino-765689c4d9-m8tkb\" (UID: \"45b7c1f9-8b13-4612-97f6-e5840f9beb90\") " pod="kuadrant-system/authorino-765689c4d9-m8tkb" Jun 09 15:13:33.134646 ip-10-0-133-239 kubenswrapper[2576]: I0609 15:13:33.134624 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-4xlx4\" (UniqueName: \"kubernetes.io/projected/45b7c1f9-8b13-4612-97f6-e5840f9beb90-kube-api-access-4xlx4\") pod \"authorino-765689c4d9-m8tkb\" (UID: \"45b7c1f9-8b13-4612-97f6-e5840f9beb90\") " pod="kuadrant-system/authorino-765689c4d9-m8tkb" Jun 09 15:13:33.313479 ip-10-0-133-239 kubenswrapper[2576]: I0609 15:13:33.313444 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-765689c4d9-m8tkb" Jun 09 15:13:33.452999 ip-10-0-133-239 kubenswrapper[2576]: I0609 15:13:33.452972 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-765689c4d9-m8tkb"] Jun 09 15:13:33.454288 ip-10-0-133-239 kubenswrapper[2576]: W0609 15:13:33.454261 2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod45b7c1f9_8b13_4612_97f6_e5840f9beb90.slice/crio-530ef221ccb47d4dcba2064d3c4eaa47cdb863a8223900139b0aee9ae1a3a093 WatchSource:0}: Error finding container 530ef221ccb47d4dcba2064d3c4eaa47cdb863a8223900139b0aee9ae1a3a093: Status 404 returned error can't find the container with id 530ef221ccb47d4dcba2064d3c4eaa47cdb863a8223900139b0aee9ae1a3a093 Jun 09 15:13:33.857954 ip-10-0-133-239 kubenswrapper[2576]: I0609 15:13:33.857906 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-5d4b67c446-vs7hs" event={"ID":"c9d36fbc-fce9-4406-9a78-7ce9e6f12db9","Type":"ContainerStarted","Data":"a32d13c0784b3f92565dce2b8bbcac3ca8278ba364f405118132761d9865f7f6"} Jun 09 15:13:33.858438 ip-10-0-133-239 kubenswrapper[2576]: I0609 15:13:33.857980 2576 kuberuntime_container.go:872] "Killing container with a grace period" pod="kuadrant-system/authorino-5d4b67c446-vs7hs" podUID="c9d36fbc-fce9-4406-9a78-7ce9e6f12db9" containerName="authorino" containerID="cri-o://a32d13c0784b3f92565dce2b8bbcac3ca8278ba364f405118132761d9865f7f6" gracePeriod=30 Jun 09 15:13:33.860349 ip-10-0-133-239 kubenswrapper[2576]: I0609 15:13:33.859796 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-765689c4d9-m8tkb" event={"ID":"45b7c1f9-8b13-4612-97f6-e5840f9beb90","Type":"ContainerStarted","Data":"cd1016c7a1b8d6638dd3ffd21255b0fe8d2f7829174623b4371bd16b0f2238f8"} Jun 09 15:13:33.860349 ip-10-0-133-239 kubenswrapper[2576]: I0609 15:13:33.859839 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-765689c4d9-m8tkb" event={"ID":"45b7c1f9-8b13-4612-97f6-e5840f9beb90","Type":"ContainerStarted","Data":"530ef221ccb47d4dcba2064d3c4eaa47cdb863a8223900139b0aee9ae1a3a093"} Jun 09 15:13:33.862125 ip-10-0-133-239 kubenswrapper[2576]: I0609 15:13:33.862095 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-5cd4ffd8df-4vs6c" event={"ID":"01ef3f4c-096b-4234-9499-e7c5d617b101","Type":"ContainerStarted","Data":"50689d207bf7955c3a8a7568fffd76bbbcbcbb13eb091b0e9373fd04ff7d28ce"} Jun 09 15:13:33.862248 ip-10-0-133-239 kubenswrapper[2576]: I0609 15:13:33.862146 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-5cd4ffd8df-4vs6c" event={"ID":"01ef3f4c-096b-4234-9499-e7c5d617b101","Type":"ContainerStarted","Data":"0908226f2c4b421763269f4847c88187698ba884cc77fb22859c914697974758"} Jun 09 15:13:33.862248 ip-10-0-133-239 kubenswrapper[2576]: I0609 15:13:33.862148 2576 kuberuntime_container.go:872] "Killing container with a grace period" pod="kuadrant-system/authorino-5cd4ffd8df-4vs6c" podUID="01ef3f4c-096b-4234-9499-e7c5d617b101" containerName="authorino" containerID="cri-o://50689d207bf7955c3a8a7568fffd76bbbcbcbb13eb091b0e9373fd04ff7d28ce" gracePeriod=30 Jun 09 15:13:33.879603 ip-10-0-133-239 kubenswrapper[2576]: I0609 15:13:33.879564 2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/authorino-5d4b67c446-vs7hs" podStartSLOduration=1.518618698 podStartE2EDuration="1.879550671s" totalImagesPullingTime="360.931973ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-09 15:13:32 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-09 15:13:33.877832631 +0000 UTC m=+728.731988872" watchObservedRunningTime="2026-06-09 15:13:33.879550671 +0000 UTC m=+728.733706934" Jun 09 15:13:33.902839 ip-10-0-133-239 kubenswrapper[2576]: I0609 15:13:33.902789 2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/authorino-765689c4d9-m8tkb" podStartSLOduration=1.611569102 podStartE2EDuration="1.902775168s" totalImagesPullingTime="291.206066ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-09 15:13:32 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-09 15:13:33.901126049 +0000 UTC m=+728.755282289" watchObservedRunningTime="2026-06-09 15:13:33.902775168 +0000 UTC m=+728.756931407" Jun 09 15:13:33.921309 ip-10-0-133-239 kubenswrapper[2576]: I0609 15:13:33.921268 2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/authorino-5cd4ffd8df-4vs6c" podStartSLOduration=1.6167206969999999 podStartE2EDuration="1.921252915s" totalImagesPullingTime="304.532218ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-09 15:13:32 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-09 15:13:33.920674314 +0000 UTC m=+728.774830553" watchObservedRunningTime="2026-06-09 15:13:33.921252915 +0000 UTC m=+728.775409145" Jun 09 15:13:33.939230 ip-10-0-133-239 kubenswrapper[2576]: I0609 15:13:33.939207 2576 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-75d556bd77-plccn"] Jun 09 15:13:33.939441 ip-10-0-133-239 kubenswrapper[2576]: I0609 15:13:33.939420 2576 kuberuntime_container.go:872] "Killing container with a grace period" pod="kuadrant-system/authorino-75d556bd77-plccn" podUID="28139b0e-7a04-4751-bc0c-de3147fcfad1" containerName="authorino" containerID="cri-o://6a4a3c56e58c7e10cee84d9d4f742a106042304e7de020807226f2addaec7e10" gracePeriod=30 Jun 09 15:13:34.184118 ip-10-0-133-239 kubenswrapper[2576]: I0609 15:13:34.184090 2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-5cd4ffd8df-4vs6c" Jun 09 15:13:34.229935 ip-10-0-133-239 kubenswrapper[2576]: I0609 15:13:34.229909 2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-75d556bd77-plccn" Jun 09 15:13:34.230387 ip-10-0-133-239 kubenswrapper[2576]: I0609 15:13:34.230363 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-2vb4c\" (UniqueName: \"kubernetes.io/projected/01ef3f4c-096b-4234-9499-e7c5d617b101-kube-api-access-2vb4c\") pod \"01ef3f4c-096b-4234-9499-e7c5d617b101\" (UID: \"01ef3f4c-096b-4234-9499-e7c5d617b101\") " Jun 09 15:13:34.232484 ip-10-0-133-239 kubenswrapper[2576]: I0609 15:13:34.232461 2576 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/01ef3f4c-096b-4234-9499-e7c5d617b101-kube-api-access-2vb4c" (OuterVolumeSpecName: "kube-api-access-2vb4c") pod "01ef3f4c-096b-4234-9499-e7c5d617b101" (UID: "01ef3f4c-096b-4234-9499-e7c5d617b101"). InnerVolumeSpecName "kube-api-access-2vb4c". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 09 15:13:34.241284 ip-10-0-133-239 kubenswrapper[2576]: I0609 15:13:34.241261 2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-5d4b67c446-vs7hs" Jun 09 15:13:34.330984 ip-10-0-133-239 kubenswrapper[2576]: I0609 15:13:34.330900 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-pzr9h\" (UniqueName: \"kubernetes.io/projected/28139b0e-7a04-4751-bc0c-de3147fcfad1-kube-api-access-pzr9h\") pod \"28139b0e-7a04-4751-bc0c-de3147fcfad1\" (UID: \"28139b0e-7a04-4751-bc0c-de3147fcfad1\") " Jun 09 15:13:34.330984 ip-10-0-133-239 kubenswrapper[2576]: I0609 15:13:34.330946 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-vhj7j\" (UniqueName: \"kubernetes.io/projected/c9d36fbc-fce9-4406-9a78-7ce9e6f12db9-kube-api-access-vhj7j\") pod \"c9d36fbc-fce9-4406-9a78-7ce9e6f12db9\" (UID: \"c9d36fbc-fce9-4406-9a78-7ce9e6f12db9\") " Jun 09 15:13:34.331192 ip-10-0-133-239 kubenswrapper[2576]: I0609 15:13:34.331149 2576 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-2vb4c\" (UniqueName: \"kubernetes.io/projected/01ef3f4c-096b-4234-9499-e7c5d617b101-kube-api-access-2vb4c\") on node \"ip-10-0-133-239.ec2.internal\" DevicePath \"\"" Jun 09 15:13:34.333020 ip-10-0-133-239 kubenswrapper[2576]: I0609 15:13:34.332995 2576 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/28139b0e-7a04-4751-bc0c-de3147fcfad1-kube-api-access-pzr9h" (OuterVolumeSpecName: "kube-api-access-pzr9h") pod "28139b0e-7a04-4751-bc0c-de3147fcfad1" (UID: "28139b0e-7a04-4751-bc0c-de3147fcfad1"). InnerVolumeSpecName "kube-api-access-pzr9h". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 09 15:13:34.333156 ip-10-0-133-239 kubenswrapper[2576]: I0609 15:13:34.333040 2576 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/c9d36fbc-fce9-4406-9a78-7ce9e6f12db9-kube-api-access-vhj7j" (OuterVolumeSpecName: "kube-api-access-vhj7j") pod "c9d36fbc-fce9-4406-9a78-7ce9e6f12db9" (UID: "c9d36fbc-fce9-4406-9a78-7ce9e6f12db9"). InnerVolumeSpecName "kube-api-access-vhj7j". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 09 15:13:34.432414 ip-10-0-133-239 kubenswrapper[2576]: I0609 15:13:34.432361 2576 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-pzr9h\" (UniqueName: \"kubernetes.io/projected/28139b0e-7a04-4751-bc0c-de3147fcfad1-kube-api-access-pzr9h\") on node \"ip-10-0-133-239.ec2.internal\" DevicePath \"\"" Jun 09 15:13:34.432414 ip-10-0-133-239 kubenswrapper[2576]: I0609 15:13:34.432402 2576 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-vhj7j\" (UniqueName: \"kubernetes.io/projected/c9d36fbc-fce9-4406-9a78-7ce9e6f12db9-kube-api-access-vhj7j\") on node \"ip-10-0-133-239.ec2.internal\" DevicePath \"\"" Jun 09 15:13:34.868689 ip-10-0-133-239 kubenswrapper[2576]: I0609 15:13:34.868657 2576 generic.go:356] "Generic (PLEG): container finished" podID="c9d36fbc-fce9-4406-9a78-7ce9e6f12db9" containerID="a32d13c0784b3f92565dce2b8bbcac3ca8278ba364f405118132761d9865f7f6" exitCode=0 Jun 09 15:13:34.869131 ip-10-0-133-239 kubenswrapper[2576]: I0609 15:13:34.868695 2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-5d4b67c446-vs7hs" Jun 09 15:13:34.869131 ip-10-0-133-239 kubenswrapper[2576]: I0609 15:13:34.868747 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-5d4b67c446-vs7hs" event={"ID":"c9d36fbc-fce9-4406-9a78-7ce9e6f12db9","Type":"ContainerDied","Data":"a32d13c0784b3f92565dce2b8bbcac3ca8278ba364f405118132761d9865f7f6"} Jun 09 15:13:34.869131 ip-10-0-133-239 kubenswrapper[2576]: I0609 15:13:34.868786 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-5d4b67c446-vs7hs" event={"ID":"c9d36fbc-fce9-4406-9a78-7ce9e6f12db9","Type":"ContainerDied","Data":"98dcac57487039544b651ad7620dea32df4f599a5b5c37e26dad65ec84b65b3c"} Jun 09 15:13:34.869131 ip-10-0-133-239 kubenswrapper[2576]: I0609 15:13:34.868804 2576 scope.go:117] "RemoveContainer" containerID="a32d13c0784b3f92565dce2b8bbcac3ca8278ba364f405118132761d9865f7f6" Jun 09 15:13:34.870207 ip-10-0-133-239 kubenswrapper[2576]: I0609 15:13:34.870181 2576 generic.go:356] "Generic (PLEG): container finished" podID="01ef3f4c-096b-4234-9499-e7c5d617b101" containerID="50689d207bf7955c3a8a7568fffd76bbbcbcbb13eb091b0e9373fd04ff7d28ce" exitCode=0 Jun 09 15:13:34.870350 ip-10-0-133-239 kubenswrapper[2576]: I0609 15:13:34.870212 2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-5cd4ffd8df-4vs6c" Jun 09 15:13:34.870350 ip-10-0-133-239 kubenswrapper[2576]: I0609 15:13:34.870261 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-5cd4ffd8df-4vs6c" event={"ID":"01ef3f4c-096b-4234-9499-e7c5d617b101","Type":"ContainerDied","Data":"50689d207bf7955c3a8a7568fffd76bbbcbcbb13eb091b0e9373fd04ff7d28ce"} Jun 09 15:13:34.870350 ip-10-0-133-239 kubenswrapper[2576]: I0609 15:13:34.870293 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-5cd4ffd8df-4vs6c" event={"ID":"01ef3f4c-096b-4234-9499-e7c5d617b101","Type":"ContainerDied","Data":"0908226f2c4b421763269f4847c88187698ba884cc77fb22859c914697974758"} Jun 09 15:13:34.871680 ip-10-0-133-239 kubenswrapper[2576]: I0609 15:13:34.871658 2576 generic.go:356] "Generic (PLEG): container finished" podID="28139b0e-7a04-4751-bc0c-de3147fcfad1" containerID="6a4a3c56e58c7e10cee84d9d4f742a106042304e7de020807226f2addaec7e10" exitCode=0 Jun 09 15:13:34.871783 ip-10-0-133-239 kubenswrapper[2576]: I0609 15:13:34.871691 2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-75d556bd77-plccn" Jun 09 15:13:34.871783 ip-10-0-133-239 kubenswrapper[2576]: I0609 15:13:34.871724 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-75d556bd77-plccn" event={"ID":"28139b0e-7a04-4751-bc0c-de3147fcfad1","Type":"ContainerDied","Data":"6a4a3c56e58c7e10cee84d9d4f742a106042304e7de020807226f2addaec7e10"} Jun 09 15:13:34.871783 ip-10-0-133-239 kubenswrapper[2576]: I0609 15:13:34.871755 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-75d556bd77-plccn" event={"ID":"28139b0e-7a04-4751-bc0c-de3147fcfad1","Type":"ContainerDied","Data":"89a1e64fd93f9b1893ea41b5a2422a6a9c1ad2c71f28d1f0561b0b1ae7139885"} Jun 09 15:13:34.878650 ip-10-0-133-239 kubenswrapper[2576]: I0609 15:13:34.878629 2576 scope.go:117] "RemoveContainer" containerID="a32d13c0784b3f92565dce2b8bbcac3ca8278ba364f405118132761d9865f7f6" Jun 09 15:13:34.878892 ip-10-0-133-239 kubenswrapper[2576]: E0609 15:13:34.878869 2576 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"a32d13c0784b3f92565dce2b8bbcac3ca8278ba364f405118132761d9865f7f6\": container with ID starting with a32d13c0784b3f92565dce2b8bbcac3ca8278ba364f405118132761d9865f7f6 not found: ID does not exist" containerID="a32d13c0784b3f92565dce2b8bbcac3ca8278ba364f405118132761d9865f7f6" Jun 09 15:13:34.878976 ip-10-0-133-239 kubenswrapper[2576]: I0609 15:13:34.878912 2576 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"a32d13c0784b3f92565dce2b8bbcac3ca8278ba364f405118132761d9865f7f6"} err="failed to get container status \"a32d13c0784b3f92565dce2b8bbcac3ca8278ba364f405118132761d9865f7f6\": rpc error: code = NotFound desc = could not find container \"a32d13c0784b3f92565dce2b8bbcac3ca8278ba364f405118132761d9865f7f6\": container with ID starting with a32d13c0784b3f92565dce2b8bbcac3ca8278ba364f405118132761d9865f7f6 not found: ID does not exist" Jun 09 15:13:34.878976 ip-10-0-133-239 kubenswrapper[2576]: I0609 15:13:34.878933 2576 scope.go:117] "RemoveContainer" containerID="50689d207bf7955c3a8a7568fffd76bbbcbcbb13eb091b0e9373fd04ff7d28ce" Jun 09 15:13:34.887893 ip-10-0-133-239 kubenswrapper[2576]: I0609 15:13:34.887877 2576 scope.go:117] "RemoveContainer" containerID="50689d207bf7955c3a8a7568fffd76bbbcbcbb13eb091b0e9373fd04ff7d28ce" Jun 09 15:13:34.888160 ip-10-0-133-239 kubenswrapper[2576]: E0609 15:13:34.888129 2576 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"50689d207bf7955c3a8a7568fffd76bbbcbcbb13eb091b0e9373fd04ff7d28ce\": container with ID starting with 50689d207bf7955c3a8a7568fffd76bbbcbcbb13eb091b0e9373fd04ff7d28ce not found: ID does not exist" containerID="50689d207bf7955c3a8a7568fffd76bbbcbcbb13eb091b0e9373fd04ff7d28ce" Jun 09 15:13:34.888228 ip-10-0-133-239 kubenswrapper[2576]: I0609 15:13:34.888160 2576 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"50689d207bf7955c3a8a7568fffd76bbbcbcbb13eb091b0e9373fd04ff7d28ce"} err="failed to get container status \"50689d207bf7955c3a8a7568fffd76bbbcbcbb13eb091b0e9373fd04ff7d28ce\": rpc error: code = NotFound desc = could not find container \"50689d207bf7955c3a8a7568fffd76bbbcbcbb13eb091b0e9373fd04ff7d28ce\": container with ID starting with 50689d207bf7955c3a8a7568fffd76bbbcbcbb13eb091b0e9373fd04ff7d28ce not found: ID does not exist" Jun 09 15:13:34.888228 ip-10-0-133-239 kubenswrapper[2576]: I0609 15:13:34.888174 2576 scope.go:117] "RemoveContainer" containerID="6a4a3c56e58c7e10cee84d9d4f742a106042304e7de020807226f2addaec7e10" Jun 09 15:13:34.895420 ip-10-0-133-239 kubenswrapper[2576]: I0609 15:13:34.895398 2576 scope.go:117] "RemoveContainer" containerID="6a4a3c56e58c7e10cee84d9d4f742a106042304e7de020807226f2addaec7e10" Jun 09 15:13:34.895639 ip-10-0-133-239 kubenswrapper[2576]: E0609 15:13:34.895622 2576 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"6a4a3c56e58c7e10cee84d9d4f742a106042304e7de020807226f2addaec7e10\": container with ID starting with 6a4a3c56e58c7e10cee84d9d4f742a106042304e7de020807226f2addaec7e10 not found: ID does not exist" containerID="6a4a3c56e58c7e10cee84d9d4f742a106042304e7de020807226f2addaec7e10" Jun 09 15:13:34.895690 ip-10-0-133-239 kubenswrapper[2576]: I0609 15:13:34.895645 2576 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"6a4a3c56e58c7e10cee84d9d4f742a106042304e7de020807226f2addaec7e10"} err="failed to get container status \"6a4a3c56e58c7e10cee84d9d4f742a106042304e7de020807226f2addaec7e10\": rpc error: code = NotFound desc = could not find container \"6a4a3c56e58c7e10cee84d9d4f742a106042304e7de020807226f2addaec7e10\": container with ID starting with 6a4a3c56e58c7e10cee84d9d4f742a106042304e7de020807226f2addaec7e10 not found: ID does not exist" Jun 09 15:13:34.901727 ip-10-0-133-239 kubenswrapper[2576]: I0609 15:13:34.901705 2576 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-5d4b67c446-vs7hs"] Jun 09 15:13:34.903863 ip-10-0-133-239 kubenswrapper[2576]: I0609 15:13:34.903846 2576 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/authorino-5d4b67c446-vs7hs"] Jun 09 15:13:34.913220 ip-10-0-133-239 kubenswrapper[2576]: I0609 15:13:34.913203 2576 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-5cd4ffd8df-4vs6c"] Jun 09 15:13:34.916651 ip-10-0-133-239 kubenswrapper[2576]: I0609 15:13:34.916635 2576 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/authorino-5cd4ffd8df-4vs6c"] Jun 09 15:13:34.929538 ip-10-0-133-239 kubenswrapper[2576]: I0609 15:13:34.929521 2576 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-75d556bd77-plccn"] Jun 09 15:13:34.933103 ip-10-0-133-239 kubenswrapper[2576]: I0609 15:13:34.933086 2576 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/authorino-75d556bd77-plccn"] Jun 09 15:13:35.604027 ip-10-0-133-239 kubenswrapper[2576]: I0609 15:13:35.604000 2576 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="01ef3f4c-096b-4234-9499-e7c5d617b101" path="/var/lib/kubelet/pods/01ef3f4c-096b-4234-9499-e7c5d617b101/volumes" Jun 09 15:13:35.604355 ip-10-0-133-239 kubenswrapper[2576]: I0609 15:13:35.604334 2576 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="28139b0e-7a04-4751-bc0c-de3147fcfad1" path="/var/lib/kubelet/pods/28139b0e-7a04-4751-bc0c-de3147fcfad1/volumes" Jun 09 15:13:35.604630 ip-10-0-133-239 kubenswrapper[2576]: I0609 15:13:35.604619 2576 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="c9d36fbc-fce9-4406-9a78-7ce9e6f12db9" path="/var/lib/kubelet/pods/c9d36fbc-fce9-4406-9a78-7ce9e6f12db9/volumes" Jun 09 15:13:37.737880 ip-10-0-133-239 kubenswrapper[2576]: I0609 15:13:37.737847 2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/maas-controller-7dc49f7b7c-npzg7"] Jun 09 15:13:37.738257 ip-10-0-133-239 kubenswrapper[2576]: I0609 15:13:37.738176 2576 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="28139b0e-7a04-4751-bc0c-de3147fcfad1" containerName="authorino" Jun 09 15:13:37.738257 ip-10-0-133-239 kubenswrapper[2576]: I0609 15:13:37.738187 2576 state_mem.go:107] "Deleted CPUSet assignment" podUID="28139b0e-7a04-4751-bc0c-de3147fcfad1" containerName="authorino" Jun 09 15:13:37.738257 ip-10-0-133-239 kubenswrapper[2576]: I0609 15:13:37.738207 2576 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="c9d36fbc-fce9-4406-9a78-7ce9e6f12db9" containerName="authorino" Jun 09 15:13:37.738257 ip-10-0-133-239 kubenswrapper[2576]: I0609 15:13:37.738213 2576 state_mem.go:107] "Deleted CPUSet assignment" podUID="c9d36fbc-fce9-4406-9a78-7ce9e6f12db9" containerName="authorino" Jun 09 15:13:37.738257 ip-10-0-133-239 kubenswrapper[2576]: I0609 15:13:37.738226 2576 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="01ef3f4c-096b-4234-9499-e7c5d617b101" containerName="authorino" Jun 09 15:13:37.738257 ip-10-0-133-239 kubenswrapper[2576]: I0609 15:13:37.738232 2576 state_mem.go:107] "Deleted CPUSet assignment" podUID="01ef3f4c-096b-4234-9499-e7c5d617b101" containerName="authorino" Jun 09 15:13:37.738442 ip-10-0-133-239 kubenswrapper[2576]: I0609 15:13:37.738281 2576 memory_manager.go:368] "RemoveStaleState removing state" podUID="28139b0e-7a04-4751-bc0c-de3147fcfad1" containerName="authorino" Jun 09 15:13:37.738442 ip-10-0-133-239 kubenswrapper[2576]: I0609 15:13:37.738291 2576 memory_manager.go:368] "RemoveStaleState removing state" podUID="c9d36fbc-fce9-4406-9a78-7ce9e6f12db9" containerName="authorino" Jun 09 15:13:37.738442 ip-10-0-133-239 kubenswrapper[2576]: I0609 15:13:37.738298 2576 memory_manager.go:368] "RemoveStaleState removing state" podUID="01ef3f4c-096b-4234-9499-e7c5d617b101" containerName="authorino" Jun 09 15:13:37.740785 ip-10-0-133-239 kubenswrapper[2576]: I0609 15:13:37.740760 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-7dc49f7b7c-npzg7" Jun 09 15:13:37.745787 ip-10-0-133-239 kubenswrapper[2576]: I0609 15:13:37.745768 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-controller-dockercfg-nfbkm\"" Jun 09 15:13:37.745983 ip-10-0-133-239 kubenswrapper[2576]: I0609 15:13:37.745963 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-controller-webhook-cert\"" Jun 09 15:13:37.746715 ip-10-0-133-239 kubenswrapper[2576]: I0609 15:13:37.746689 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"maas-parameters\"" Jun 09 15:13:37.759289 ip-10-0-133-239 kubenswrapper[2576]: I0609 15:13:37.759269 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-dr2ld\" (UniqueName: \"kubernetes.io/projected/6f498f42-b13a-4792-a065-91839851123c-kube-api-access-dr2ld\") pod \"maas-controller-7dc49f7b7c-npzg7\" (UID: \"6f498f42-b13a-4792-a065-91839851123c\") " pod="opendatahub/maas-controller-7dc49f7b7c-npzg7" Jun 09 15:13:37.759394 ip-10-0-133-239 kubenswrapper[2576]: I0609 15:13:37.759321 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/6f498f42-b13a-4792-a065-91839851123c-webhook-cert\") pod \"maas-controller-7dc49f7b7c-npzg7\" (UID: \"6f498f42-b13a-4792-a065-91839851123c\") " pod="opendatahub/maas-controller-7dc49f7b7c-npzg7" Jun 09 15:13:37.772672 ip-10-0-133-239 kubenswrapper[2576]: I0609 15:13:37.772649 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-7dc49f7b7c-npzg7"] Jun 09 15:13:37.860466 ip-10-0-133-239 kubenswrapper[2576]: I0609 15:13:37.860433 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-dr2ld\" (UniqueName: \"kubernetes.io/projected/6f498f42-b13a-4792-a065-91839851123c-kube-api-access-dr2ld\") pod \"maas-controller-7dc49f7b7c-npzg7\" (UID: \"6f498f42-b13a-4792-a065-91839851123c\") " pod="opendatahub/maas-controller-7dc49f7b7c-npzg7" Jun 09 15:13:37.860606 ip-10-0-133-239 kubenswrapper[2576]: I0609 15:13:37.860483 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/6f498f42-b13a-4792-a065-91839851123c-webhook-cert\") pod \"maas-controller-7dc49f7b7c-npzg7\" (UID: \"6f498f42-b13a-4792-a065-91839851123c\") " pod="opendatahub/maas-controller-7dc49f7b7c-npzg7" Jun 09 15:13:37.860606 ip-10-0-133-239 kubenswrapper[2576]: E0609 15:13:37.860585 2576 secret.go:189] Couldn't get secret opendatahub/maas-controller-webhook-cert: secret "maas-controller-webhook-cert" not found Jun 09 15:13:37.860699 ip-10-0-133-239 kubenswrapper[2576]: E0609 15:13:37.860635 2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/6f498f42-b13a-4792-a065-91839851123c-webhook-cert podName:6f498f42-b13a-4792-a065-91839851123c nodeName:}" failed. No retries permitted until 2026-06-09 15:13:38.36062034 +0000 UTC m=+733.214776557 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "webhook-cert" (UniqueName: "kubernetes.io/secret/6f498f42-b13a-4792-a065-91839851123c-webhook-cert") pod "maas-controller-7dc49f7b7c-npzg7" (UID: "6f498f42-b13a-4792-a065-91839851123c") : secret "maas-controller-webhook-cert" not found Jun 09 15:13:37.873138 ip-10-0-133-239 kubenswrapper[2576]: I0609 15:13:37.873103 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-dr2ld\" (UniqueName: \"kubernetes.io/projected/6f498f42-b13a-4792-a065-91839851123c-kube-api-access-dr2ld\") pod \"maas-controller-7dc49f7b7c-npzg7\" (UID: \"6f498f42-b13a-4792-a065-91839851123c\") " pod="opendatahub/maas-controller-7dc49f7b7c-npzg7" Jun 09 15:13:37.951164 ip-10-0-133-239 kubenswrapper[2576]: I0609 15:13:37.951131 2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/maas-controller-6968d6768f-v8cpj"] Jun 09 15:13:37.956731 ip-10-0-133-239 kubenswrapper[2576]: I0609 15:13:37.956700 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-6968d6768f-v8cpj" Jun 09 15:13:37.971234 ip-10-0-133-239 kubenswrapper[2576]: I0609 15:13:37.971209 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-6968d6768f-v8cpj"] Jun 09 15:13:38.062158 ip-10-0-133-239 kubenswrapper[2576]: I0609 15:13:38.062125 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/72b56109-3d7c-4d5d-8e8b-d1c301c4bc53-webhook-cert\") pod \"maas-controller-6968d6768f-v8cpj\" (UID: \"72b56109-3d7c-4d5d-8e8b-d1c301c4bc53\") " pod="opendatahub/maas-controller-6968d6768f-v8cpj" Jun 09 15:13:38.062326 ip-10-0-133-239 kubenswrapper[2576]: I0609 15:13:38.062197 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rl2hd\" (UniqueName: \"kubernetes.io/projected/72b56109-3d7c-4d5d-8e8b-d1c301c4bc53-kube-api-access-rl2hd\") pod \"maas-controller-6968d6768f-v8cpj\" (UID: \"72b56109-3d7c-4d5d-8e8b-d1c301c4bc53\") " pod="opendatahub/maas-controller-6968d6768f-v8cpj" Jun 09 15:13:38.163158 ip-10-0-133-239 kubenswrapper[2576]: I0609 15:13:38.163130 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rl2hd\" (UniqueName: \"kubernetes.io/projected/72b56109-3d7c-4d5d-8e8b-d1c301c4bc53-kube-api-access-rl2hd\") pod \"maas-controller-6968d6768f-v8cpj\" (UID: \"72b56109-3d7c-4d5d-8e8b-d1c301c4bc53\") " pod="opendatahub/maas-controller-6968d6768f-v8cpj" Jun 09 15:13:38.163314 ip-10-0-133-239 kubenswrapper[2576]: I0609 15:13:38.163199 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/72b56109-3d7c-4d5d-8e8b-d1c301c4bc53-webhook-cert\") pod \"maas-controller-6968d6768f-v8cpj\" (UID: \"72b56109-3d7c-4d5d-8e8b-d1c301c4bc53\") " pod="opendatahub/maas-controller-6968d6768f-v8cpj" Jun 09 15:13:38.165539 ip-10-0-133-239 kubenswrapper[2576]: I0609 15:13:38.165513 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/72b56109-3d7c-4d5d-8e8b-d1c301c4bc53-webhook-cert\") pod \"maas-controller-6968d6768f-v8cpj\" (UID: \"72b56109-3d7c-4d5d-8e8b-d1c301c4bc53\") " pod="opendatahub/maas-controller-6968d6768f-v8cpj" Jun 09 15:13:38.171880 ip-10-0-133-239 kubenswrapper[2576]: I0609 15:13:38.171856 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-rl2hd\" (UniqueName: \"kubernetes.io/projected/72b56109-3d7c-4d5d-8e8b-d1c301c4bc53-kube-api-access-rl2hd\") pod \"maas-controller-6968d6768f-v8cpj\" (UID: \"72b56109-3d7c-4d5d-8e8b-d1c301c4bc53\") " pod="opendatahub/maas-controller-6968d6768f-v8cpj" Jun 09 15:13:38.267955 ip-10-0-133-239 kubenswrapper[2576]: I0609 15:13:38.267926 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-6968d6768f-v8cpj" Jun 09 15:13:38.364931 ip-10-0-133-239 kubenswrapper[2576]: I0609 15:13:38.364900 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/6f498f42-b13a-4792-a065-91839851123c-webhook-cert\") pod \"maas-controller-7dc49f7b7c-npzg7\" (UID: \"6f498f42-b13a-4792-a065-91839851123c\") " pod="opendatahub/maas-controller-7dc49f7b7c-npzg7" Jun 09 15:13:38.367273 ip-10-0-133-239 kubenswrapper[2576]: I0609 15:13:38.367250 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/6f498f42-b13a-4792-a065-91839851123c-webhook-cert\") pod \"maas-controller-7dc49f7b7c-npzg7\" (UID: \"6f498f42-b13a-4792-a065-91839851123c\") " pod="opendatahub/maas-controller-7dc49f7b7c-npzg7" Jun 09 15:13:38.403379 ip-10-0-133-239 kubenswrapper[2576]: I0609 15:13:38.403349 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-6968d6768f-v8cpj"] Jun 09 15:13:38.406090 ip-10-0-133-239 kubenswrapper[2576]: W0609 15:13:38.406048 2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod72b56109_3d7c_4d5d_8e8b_d1c301c4bc53.slice/crio-70d2b4774b075ea78cca73cb890056d9c10fe51c4af91a975388f1787b9e1059 WatchSource:0}: Error finding container 70d2b4774b075ea78cca73cb890056d9c10fe51c4af91a975388f1787b9e1059: Status 404 returned error can't find the container with id 70d2b4774b075ea78cca73cb890056d9c10fe51c4af91a975388f1787b9e1059 Jun 09 15:13:38.650739 ip-10-0-133-239 kubenswrapper[2576]: I0609 15:13:38.650650 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-7dc49f7b7c-npzg7" Jun 09 15:13:38.804474 ip-10-0-133-239 kubenswrapper[2576]: I0609 15:13:38.804447 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-7dc49f7b7c-npzg7"] Jun 09 15:13:38.805578 ip-10-0-133-239 kubenswrapper[2576]: W0609 15:13:38.805545 2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6f498f42_b13a_4792_a065_91839851123c.slice/crio-08dfd72fcba84a313f832a3d56419f54f6e64fb05e7a94a0ff3514c8ad545b3b WatchSource:0}: Error finding container 08dfd72fcba84a313f832a3d56419f54f6e64fb05e7a94a0ff3514c8ad545b3b: Status 404 returned error can't find the container with id 08dfd72fcba84a313f832a3d56419f54f6e64fb05e7a94a0ff3514c8ad545b3b Jun 09 15:13:38.901239 ip-10-0-133-239 kubenswrapper[2576]: I0609 15:13:38.901158 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-7dc49f7b7c-npzg7" event={"ID":"6f498f42-b13a-4792-a065-91839851123c","Type":"ContainerStarted","Data":"08dfd72fcba84a313f832a3d56419f54f6e64fb05e7a94a0ff3514c8ad545b3b"} Jun 09 15:13:38.902335 ip-10-0-133-239 kubenswrapper[2576]: I0609 15:13:38.902308 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-6968d6768f-v8cpj" event={"ID":"72b56109-3d7c-4d5d-8e8b-d1c301c4bc53","Type":"ContainerStarted","Data":"70d2b4774b075ea78cca73cb890056d9c10fe51c4af91a975388f1787b9e1059"} Jun 09 15:13:41.926284 ip-10-0-133-239 kubenswrapper[2576]: I0609 15:13:41.926249 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-6968d6768f-v8cpj" event={"ID":"72b56109-3d7c-4d5d-8e8b-d1c301c4bc53","Type":"ContainerStarted","Data":"679320ce61fa2d3e2edc4b6add9ba99317893cdc2ac83f63e594e56d0c4f6aab"} Jun 09 15:13:41.926737 ip-10-0-133-239 kubenswrapper[2576]: I0609 15:13:41.926330 2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/maas-controller-6968d6768f-v8cpj" Jun 09 15:13:41.927784 ip-10-0-133-239 kubenswrapper[2576]: I0609 15:13:41.927763 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-7dc49f7b7c-npzg7" event={"ID":"6f498f42-b13a-4792-a065-91839851123c","Type":"ContainerStarted","Data":"937104949d11e3fb327315f5a6ef334f27117b2045673e6f3be3bdd586f73877"} Jun 09 15:13:41.927890 ip-10-0-133-239 kubenswrapper[2576]: I0609 15:13:41.927867 2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/maas-controller-7dc49f7b7c-npzg7" Jun 09 15:13:41.959497 ip-10-0-133-239 kubenswrapper[2576]: I0609 15:13:41.959447 2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/maas-controller-6968d6768f-v8cpj" podStartSLOduration=2.35596966 podStartE2EDuration="4.95943386s" totalImagesPullingTime="2.6034642s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-09 15:13:37 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-09 15:13:41.956468032 +0000 UTC m=+736.810624270" watchObservedRunningTime="2026-06-09 15:13:41.95943386 +0000 UTC m=+736.813590098" Jun 09 15:13:42.004044 ip-10-0-133-239 kubenswrapper[2576]: I0609 15:13:42.003981 2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/maas-controller-7dc49f7b7c-npzg7" podStartSLOduration=2.788604639 podStartE2EDuration="5.003966878s" totalImagesPullingTime="2.215362239s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-09 15:13:37 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-09 15:13:42.001868868 +0000 UTC m=+736.856025108" watchObservedRunningTime="2026-06-09 15:13:42.003966878 +0000 UTC m=+736.858123116" Jun 09 15:13:52.939430 ip-10-0-133-239 kubenswrapper[2576]: I0609 15:13:52.939392 2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/maas-controller-6968d6768f-v8cpj" Jun 09 15:13:52.939892 ip-10-0-133-239 kubenswrapper[2576]: I0609 15:13:52.939870 2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/maas-controller-7dc49f7b7c-npzg7" Jun 09 15:13:53.012186 ip-10-0-133-239 kubenswrapper[2576]: I0609 15:13:53.012155 2576 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-controller-7dc49f7b7c-npzg7"] Jun 09 15:13:53.012403 ip-10-0-133-239 kubenswrapper[2576]: I0609 15:13:53.012371 2576 kuberuntime_container.go:872] "Killing container with a grace period" pod="opendatahub/maas-controller-7dc49f7b7c-npzg7" podUID="6f498f42-b13a-4792-a065-91839851123c" containerName="manager" containerID="cri-o://937104949d11e3fb327315f5a6ef334f27117b2045673e6f3be3bdd586f73877" gracePeriod=30 Jun 09 15:13:53.258144 ip-10-0-133-239 kubenswrapper[2576]: I0609 15:13:53.258118 2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-7dc49f7b7c-npzg7" Jun 09 15:13:53.403059 ip-10-0-133-239 kubenswrapper[2576]: I0609 15:13:53.403020 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/6f498f42-b13a-4792-a065-91839851123c-webhook-cert\") pod \"6f498f42-b13a-4792-a065-91839851123c\" (UID: \"6f498f42-b13a-4792-a065-91839851123c\") " Jun 09 15:13:53.403275 ip-10-0-133-239 kubenswrapper[2576]: I0609 15:13:53.403182 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-dr2ld\" (UniqueName: \"kubernetes.io/projected/6f498f42-b13a-4792-a065-91839851123c-kube-api-access-dr2ld\") pod \"6f498f42-b13a-4792-a065-91839851123c\" (UID: \"6f498f42-b13a-4792-a065-91839851123c\") " Jun 09 15:13:53.405229 ip-10-0-133-239 kubenswrapper[2576]: I0609 15:13:53.405200 2576 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/6f498f42-b13a-4792-a065-91839851123c-webhook-cert" (OuterVolumeSpecName: "webhook-cert") pod "6f498f42-b13a-4792-a065-91839851123c" (UID: "6f498f42-b13a-4792-a065-91839851123c"). InnerVolumeSpecName "webhook-cert". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 09 15:13:53.405229 ip-10-0-133-239 kubenswrapper[2576]: I0609 15:13:53.405205 2576 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/6f498f42-b13a-4792-a065-91839851123c-kube-api-access-dr2ld" (OuterVolumeSpecName: "kube-api-access-dr2ld") pod "6f498f42-b13a-4792-a065-91839851123c" (UID: "6f498f42-b13a-4792-a065-91839851123c"). InnerVolumeSpecName "kube-api-access-dr2ld". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 09 15:13:53.503989 ip-10-0-133-239 kubenswrapper[2576]: I0609 15:13:53.503903 2576 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-dr2ld\" (UniqueName: \"kubernetes.io/projected/6f498f42-b13a-4792-a065-91839851123c-kube-api-access-dr2ld\") on node \"ip-10-0-133-239.ec2.internal\" DevicePath \"\"" Jun 09 15:13:53.503989 ip-10-0-133-239 kubenswrapper[2576]: I0609 15:13:53.503935 2576 reconciler_common.go:299] "Volume detached for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/6f498f42-b13a-4792-a065-91839851123c-webhook-cert\") on node \"ip-10-0-133-239.ec2.internal\" DevicePath \"\"" Jun 09 15:13:53.997919 ip-10-0-133-239 kubenswrapper[2576]: I0609 15:13:53.997887 2576 generic.go:356] "Generic (PLEG): container finished" podID="6f498f42-b13a-4792-a065-91839851123c" containerID="937104949d11e3fb327315f5a6ef334f27117b2045673e6f3be3bdd586f73877" exitCode=0 Jun 09 15:13:53.998354 ip-10-0-133-239 kubenswrapper[2576]: I0609 15:13:53.997930 2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-7dc49f7b7c-npzg7" Jun 09 15:13:53.998354 ip-10-0-133-239 kubenswrapper[2576]: I0609 15:13:53.997948 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-7dc49f7b7c-npzg7" event={"ID":"6f498f42-b13a-4792-a065-91839851123c","Type":"ContainerDied","Data":"937104949d11e3fb327315f5a6ef334f27117b2045673e6f3be3bdd586f73877"} Jun 09 15:13:53.998354 ip-10-0-133-239 kubenswrapper[2576]: I0609 15:13:53.997993 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-7dc49f7b7c-npzg7" event={"ID":"6f498f42-b13a-4792-a065-91839851123c","Type":"ContainerDied","Data":"08dfd72fcba84a313f832a3d56419f54f6e64fb05e7a94a0ff3514c8ad545b3b"} Jun 09 15:13:53.998354 ip-10-0-133-239 kubenswrapper[2576]: I0609 15:13:53.998018 2576 scope.go:117] "RemoveContainer" containerID="937104949d11e3fb327315f5a6ef334f27117b2045673e6f3be3bdd586f73877" Jun 09 15:13:54.006991 ip-10-0-133-239 kubenswrapper[2576]: I0609 15:13:54.006974 2576 scope.go:117] "RemoveContainer" containerID="937104949d11e3fb327315f5a6ef334f27117b2045673e6f3be3bdd586f73877" Jun 09 15:13:54.007285 ip-10-0-133-239 kubenswrapper[2576]: E0609 15:13:54.007264 2576 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"937104949d11e3fb327315f5a6ef334f27117b2045673e6f3be3bdd586f73877\": container with ID starting with 937104949d11e3fb327315f5a6ef334f27117b2045673e6f3be3bdd586f73877 not found: ID does not exist" containerID="937104949d11e3fb327315f5a6ef334f27117b2045673e6f3be3bdd586f73877" Jun 09 15:13:54.007383 ip-10-0-133-239 kubenswrapper[2576]: I0609 15:13:54.007289 2576 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"937104949d11e3fb327315f5a6ef334f27117b2045673e6f3be3bdd586f73877"} err="failed to get container status \"937104949d11e3fb327315f5a6ef334f27117b2045673e6f3be3bdd586f73877\": rpc error: code = NotFound desc = could not find container \"937104949d11e3fb327315f5a6ef334f27117b2045673e6f3be3bdd586f73877\": container with ID starting with 937104949d11e3fb327315f5a6ef334f27117b2045673e6f3be3bdd586f73877 not found: ID does not exist" Jun 09 15:13:54.016359 ip-10-0-133-239 kubenswrapper[2576]: I0609 15:13:54.016336 2576 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-controller-7dc49f7b7c-npzg7"] Jun 09 15:13:54.020335 ip-10-0-133-239 kubenswrapper[2576]: I0609 15:13:54.020314 2576 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/maas-controller-7dc49f7b7c-npzg7"] Jun 09 15:13:55.604840 ip-10-0-133-239 kubenswrapper[2576]: I0609 15:13:55.604801 2576 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="6f498f42-b13a-4792-a065-91839851123c" path="/var/lib/kubelet/pods/6f498f42-b13a-4792-a065-91839851123c/volumes" Jun 09 15:14:14.085239 ip-10-0-133-239 kubenswrapper[2576]: I0609 15:14:14.085192 2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["redhat-ai-gateway-infra/maas-api-746566c6c4-htqnx"] Jun 09 15:14:14.085729 ip-10-0-133-239 kubenswrapper[2576]: I0609 15:14:14.085574 2576 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="6f498f42-b13a-4792-a065-91839851123c" containerName="manager" Jun 09 15:14:14.085729 ip-10-0-133-239 kubenswrapper[2576]: I0609 15:14:14.085586 2576 state_mem.go:107] "Deleted CPUSet assignment" podUID="6f498f42-b13a-4792-a065-91839851123c" containerName="manager" Jun 09 15:14:14.085729 ip-10-0-133-239 kubenswrapper[2576]: I0609 15:14:14.085636 2576 memory_manager.go:368] "RemoveStaleState removing state" podUID="6f498f42-b13a-4792-a065-91839851123c" containerName="manager" Jun 09 15:14:14.090714 ip-10-0-133-239 kubenswrapper[2576]: I0609 15:14:14.090694 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="redhat-ai-gateway-infra/maas-api-746566c6c4-htqnx" Jun 09 15:14:14.096159 ip-10-0-133-239 kubenswrapper[2576]: I0609 15:14:14.096137 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"redhat-ai-gateway-infra\"/\"maas-api-dockercfg-lslwr\"" Jun 09 15:14:14.096293 ip-10-0-133-239 kubenswrapper[2576]: I0609 15:14:14.096200 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"redhat-ai-gateway-infra\"/\"openshift-service-ca.crt\"" Jun 09 15:14:14.097153 ip-10-0-133-239 kubenswrapper[2576]: I0609 15:14:14.097130 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"redhat-ai-gateway-infra\"/\"maas-api-serving-cert\"" Jun 09 15:14:14.097963 ip-10-0-133-239 kubenswrapper[2576]: I0609 15:14:14.097701 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"redhat-ai-gateway-infra\"/\"kube-root-ca.crt\"" Jun 09 15:14:14.109014 ip-10-0-133-239 kubenswrapper[2576]: I0609 15:14:14.108981 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["redhat-ai-gateway-infra/maas-api-746566c6c4-htqnx"] Jun 09 15:14:14.179877 ip-10-0-133-239 kubenswrapper[2576]: I0609 15:14:14.179846 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/41501f9d-2b02-4bed-9f49-d2944f4aabe6-maas-api-tls\") pod \"maas-api-746566c6c4-htqnx\" (UID: \"41501f9d-2b02-4bed-9f49-d2944f4aabe6\") " pod="redhat-ai-gateway-infra/maas-api-746566c6c4-htqnx" Jun 09 15:14:14.180088 ip-10-0-133-239 kubenswrapper[2576]: I0609 15:14:14.179901 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-55jq9\" (UniqueName: \"kubernetes.io/projected/41501f9d-2b02-4bed-9f49-d2944f4aabe6-kube-api-access-55jq9\") pod \"maas-api-746566c6c4-htqnx\" (UID: \"41501f9d-2b02-4bed-9f49-d2944f4aabe6\") " pod="redhat-ai-gateway-infra/maas-api-746566c6c4-htqnx" Jun 09 15:14:14.281415 ip-10-0-133-239 kubenswrapper[2576]: I0609 15:14:14.281382 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/41501f9d-2b02-4bed-9f49-d2944f4aabe6-maas-api-tls\") pod \"maas-api-746566c6c4-htqnx\" (UID: \"41501f9d-2b02-4bed-9f49-d2944f4aabe6\") " pod="redhat-ai-gateway-infra/maas-api-746566c6c4-htqnx" Jun 09 15:14:14.281594 ip-10-0-133-239 kubenswrapper[2576]: I0609 15:14:14.281492 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-55jq9\" (UniqueName: \"kubernetes.io/projected/41501f9d-2b02-4bed-9f49-d2944f4aabe6-kube-api-access-55jq9\") pod \"maas-api-746566c6c4-htqnx\" (UID: \"41501f9d-2b02-4bed-9f49-d2944f4aabe6\") " pod="redhat-ai-gateway-infra/maas-api-746566c6c4-htqnx" Jun 09 15:14:14.283974 ip-10-0-133-239 kubenswrapper[2576]: I0609 15:14:14.283947 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/41501f9d-2b02-4bed-9f49-d2944f4aabe6-maas-api-tls\") pod \"maas-api-746566c6c4-htqnx\" (UID: \"41501f9d-2b02-4bed-9f49-d2944f4aabe6\") " pod="redhat-ai-gateway-infra/maas-api-746566c6c4-htqnx" Jun 09 15:14:14.290031 ip-10-0-133-239 kubenswrapper[2576]: I0609 15:14:14.290000 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-55jq9\" (UniqueName: \"kubernetes.io/projected/41501f9d-2b02-4bed-9f49-d2944f4aabe6-kube-api-access-55jq9\") pod \"maas-api-746566c6c4-htqnx\" (UID: \"41501f9d-2b02-4bed-9f49-d2944f4aabe6\") " pod="redhat-ai-gateway-infra/maas-api-746566c6c4-htqnx" Jun 09 15:14:14.401519 ip-10-0-133-239 kubenswrapper[2576]: I0609 15:14:14.401426 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="redhat-ai-gateway-infra/maas-api-746566c6c4-htqnx" Jun 09 15:14:14.550738 ip-10-0-133-239 kubenswrapper[2576]: I0609 15:14:14.550169 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["redhat-ai-gateway-infra/maas-api-746566c6c4-htqnx"] Jun 09 15:14:14.680223 ip-10-0-133-239 kubenswrapper[2576]: I0609 15:14:14.680145 2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-pre-processing-67d7689b65-77xlk"] Jun 09 15:14:14.683314 ip-10-0-133-239 kubenswrapper[2576]: I0609 15:14:14.683299 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-67d7689b65-77xlk" Jun 09 15:14:14.686917 ip-10-0-133-239 kubenswrapper[2576]: I0609 15:14:14.686895 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins\"" Jun 09 15:14:14.687024 ip-10-0-133-239 kubenswrapper[2576]: I0609 15:14:14.686929 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-dockercfg-794vj\"" Jun 09 15:14:14.697418 ip-10-0-133-239 kubenswrapper[2576]: I0609 15:14:14.697398 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-67d7689b65-77xlk"] Jun 09 15:14:14.785498 ip-10-0-133-239 kubenswrapper[2576]: I0609 15:14:14.785462 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-lz69r\" (UniqueName: \"kubernetes.io/projected/a85d5905-be82-45d0-939e-84031108f4c8-kube-api-access-lz69r\") pod \"payload-pre-processing-67d7689b65-77xlk\" (UID: \"a85d5905-be82-45d0-939e-84031108f4c8\") " pod="openshift-ingress/payload-pre-processing-67d7689b65-77xlk" Jun 09 15:14:14.886907 ip-10-0-133-239 kubenswrapper[2576]: I0609 15:14:14.886870 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-lz69r\" (UniqueName: \"kubernetes.io/projected/a85d5905-be82-45d0-939e-84031108f4c8-kube-api-access-lz69r\") pod \"payload-pre-processing-67d7689b65-77xlk\" (UID: \"a85d5905-be82-45d0-939e-84031108f4c8\") " pod="openshift-ingress/payload-pre-processing-67d7689b65-77xlk" Jun 09 15:14:14.897698 ip-10-0-133-239 kubenswrapper[2576]: I0609 15:14:14.897671 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-lz69r\" (UniqueName: \"kubernetes.io/projected/a85d5905-be82-45d0-939e-84031108f4c8-kube-api-access-lz69r\") pod \"payload-pre-processing-67d7689b65-77xlk\" (UID: \"a85d5905-be82-45d0-939e-84031108f4c8\") " pod="openshift-ingress/payload-pre-processing-67d7689b65-77xlk" Jun 09 15:14:14.993529 ip-10-0-133-239 kubenswrapper[2576]: I0609 15:14:14.993444 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-67d7689b65-77xlk" Jun 09 15:14:15.113900 ip-10-0-133-239 kubenswrapper[2576]: I0609 15:14:15.113864 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="redhat-ai-gateway-infra/maas-api-746566c6c4-htqnx" event={"ID":"41501f9d-2b02-4bed-9f49-d2944f4aabe6","Type":"ContainerStarted","Data":"6f08451c641642fee0bba480608d42cbc96b50158b3655af6e90665c96145872"} Jun 09 15:14:15.127126 ip-10-0-133-239 kubenswrapper[2576]: I0609 15:14:15.127099 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-67d7689b65-77xlk"] Jun 09 15:14:15.128767 ip-10-0-133-239 kubenswrapper[2576]: W0609 15:14:15.128743 2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda85d5905_be82_45d0_939e_84031108f4c8.slice/crio-cb0eaae520e04ca0f6cb8abbd307721aa0f050be64fd20b911f8eef9934c6b22 WatchSource:0}: Error finding container cb0eaae520e04ca0f6cb8abbd307721aa0f050be64fd20b911f8eef9934c6b22: Status 404 returned error can't find the container with id cb0eaae520e04ca0f6cb8abbd307721aa0f050be64fd20b911f8eef9934c6b22 Jun 09 15:14:16.123693 ip-10-0-133-239 kubenswrapper[2576]: I0609 15:14:16.123662 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-67d7689b65-77xlk" event={"ID":"a85d5905-be82-45d0-939e-84031108f4c8","Type":"ContainerStarted","Data":"cb0eaae520e04ca0f6cb8abbd307721aa0f050be64fd20b911f8eef9934c6b22"} Jun 09 15:14:17.130647 ip-10-0-133-239 kubenswrapper[2576]: I0609 15:14:17.130561 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-67d7689b65-77xlk" event={"ID":"a85d5905-be82-45d0-939e-84031108f4c8","Type":"ContainerStarted","Data":"6d4f9db910fa5da175cf5da97a37f2024a821d87804cbe558d52511739d21b76"} Jun 09 15:14:17.130647 ip-10-0-133-239 kubenswrapper[2576]: I0609 15:14:17.130644 2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-pre-processing-67d7689b65-77xlk" Jun 09 15:14:17.132215 ip-10-0-133-239 kubenswrapper[2576]: I0609 15:14:17.132194 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="redhat-ai-gateway-infra/maas-api-746566c6c4-htqnx" event={"ID":"41501f9d-2b02-4bed-9f49-d2944f4aabe6","Type":"ContainerStarted","Data":"9aab714e34c2e00b871bd1bba86ad26a99b56e15bf8491f64d5f3cf9acfd94a7"} Jun 09 15:14:17.132283 ip-10-0-133-239 kubenswrapper[2576]: I0609 15:14:17.132258 2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="redhat-ai-gateway-infra/maas-api-746566c6c4-htqnx" Jun 09 15:14:17.148114 ip-10-0-133-239 kubenswrapper[2576]: I0609 15:14:17.148055 2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-pre-processing-67d7689b65-77xlk" podStartSLOduration=1.5092066320000002 podStartE2EDuration="3.148041111s" totalImagesPullingTime="1.638834479s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-09 15:14:14 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-09 15:14:17.145828858 +0000 UTC m=+771.999985121" watchObservedRunningTime="2026-06-09 15:14:17.148041111 +0000 UTC m=+772.002197349" Jun 09 15:14:17.162031 ip-10-0-133-239 kubenswrapper[2576]: I0609 15:14:17.161992 2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="redhat-ai-gateway-infra/maas-api-746566c6c4-htqnx" podStartSLOduration=0.944440243 podStartE2EDuration="3.161975723s" totalImagesPullingTime="2.21753548s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-09 15:14:14 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-09 15:14:17.161685683 +0000 UTC m=+772.015841922" watchObservedRunningTime="2026-06-09 15:14:17.161975723 +0000 UTC m=+772.016131962" Jun 09 15:14:23.144423 ip-10-0-133-239 kubenswrapper[2576]: I0609 15:14:23.144388 2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="redhat-ai-gateway-infra/maas-api-746566c6c4-htqnx" Jun 09 15:14:25.730868 ip-10-0-133-239 kubenswrapper[2576]: I0609 15:14:25.730839 2576 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["keycloak-system/maas-keycloak-0"] Jun 09 15:14:25.731207 ip-10-0-133-239 kubenswrapper[2576]: I0609 15:14:25.731055 2576 kuberuntime_container.go:872] "Killing container with a grace period" pod="keycloak-system/maas-keycloak-0" podUID="d366bd75-3098-4e3e-bef6-237b318eac61" containerName="keycloak" containerID="cri-o://15e5fc02542604da987d0d0ca95a19f2c1424de51390bbc6aa4f25ad4660e4cb" gracePeriod=30 Jun 09 15:14:27.189295 ip-10-0-133-239 kubenswrapper[2576]: I0609 15:14:27.189264 2576 generic.go:356] "Generic (PLEG): container finished" podID="d366bd75-3098-4e3e-bef6-237b318eac61" containerID="15e5fc02542604da987d0d0ca95a19f2c1424de51390bbc6aa4f25ad4660e4cb" exitCode=143 Jun 09 15:14:27.189635 ip-10-0-133-239 kubenswrapper[2576]: I0609 15:14:27.189325 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="keycloak-system/maas-keycloak-0" event={"ID":"d366bd75-3098-4e3e-bef6-237b318eac61","Type":"ContainerDied","Data":"15e5fc02542604da987d0d0ca95a19f2c1424de51390bbc6aa4f25ad4660e4cb"} Jun 09 15:14:27.293907 ip-10-0-133-239 kubenswrapper[2576]: I0609 15:14:27.293877 2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="keycloak-system/maas-keycloak-0" Jun 09 15:14:27.394978 ip-10-0-133-239 kubenswrapper[2576]: I0609 15:14:27.394892 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-jtj65\" (UniqueName: \"kubernetes.io/projected/d366bd75-3098-4e3e-bef6-237b318eac61-kube-api-access-jtj65\") pod \"d366bd75-3098-4e3e-bef6-237b318eac61\" (UID: \"d366bd75-3098-4e3e-bef6-237b318eac61\") " Jun 09 15:14:27.397051 ip-10-0-133-239 kubenswrapper[2576]: I0609 15:14:27.397016 2576 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/d366bd75-3098-4e3e-bef6-237b318eac61-kube-api-access-jtj65" (OuterVolumeSpecName: "kube-api-access-jtj65") pod "d366bd75-3098-4e3e-bef6-237b318eac61" (UID: "d366bd75-3098-4e3e-bef6-237b318eac61"). InnerVolumeSpecName "kube-api-access-jtj65". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 09 15:14:27.495493 ip-10-0-133-239 kubenswrapper[2576]: I0609 15:14:27.495458 2576 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-jtj65\" (UniqueName: \"kubernetes.io/projected/d366bd75-3098-4e3e-bef6-237b318eac61-kube-api-access-jtj65\") on node \"ip-10-0-133-239.ec2.internal\" DevicePath \"\"" Jun 09 15:14:27.629154 ip-10-0-133-239 kubenswrapper[2576]: E0609 15:14:27.629127 2576 cadvisor_stats_provider.go:567] "Partial failure issuing cadvisor.ContainerInfoV2" err="partial failures: [\"/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd366bd75_3098_4e3e_bef6_237b318eac61.slice/crio-1657e8ae9ec5e724e27b0b924f96a9c967df3116aff39077b43e420968b21139\": RecentStats: unable to find data in memory cache]" Jun 09 15:14:28.141637 ip-10-0-133-239 kubenswrapper[2576]: I0609 15:14:28.141609 2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-pre-processing-67d7689b65-77xlk" Jun 09 15:14:28.197131 ip-10-0-133-239 kubenswrapper[2576]: I0609 15:14:28.197098 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="keycloak-system/maas-keycloak-0" event={"ID":"d366bd75-3098-4e3e-bef6-237b318eac61","Type":"ContainerDied","Data":"1657e8ae9ec5e724e27b0b924f96a9c967df3116aff39077b43e420968b21139"} Jun 09 15:14:28.197563 ip-10-0-133-239 kubenswrapper[2576]: I0609 15:14:28.197169 2576 scope.go:117] "RemoveContainer" containerID="15e5fc02542604da987d0d0ca95a19f2c1424de51390bbc6aa4f25ad4660e4cb" Jun 09 15:14:28.197563 ip-10-0-133-239 kubenswrapper[2576]: I0609 15:14:28.197109 2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="keycloak-system/maas-keycloak-0" Jun 09 15:14:28.217434 ip-10-0-133-239 kubenswrapper[2576]: I0609 15:14:28.217400 2576 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["keycloak-system/maas-keycloak-0"] Jun 09 15:14:28.220670 ip-10-0-133-239 kubenswrapper[2576]: I0609 15:14:28.220649 2576 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["keycloak-system/maas-keycloak-0"] Jun 09 15:14:28.242879 ip-10-0-133-239 kubenswrapper[2576]: I0609 15:14:28.242856 2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["keycloak-system/maas-keycloak-0"] Jun 09 15:14:28.243213 ip-10-0-133-239 kubenswrapper[2576]: I0609 15:14:28.243200 2576 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="d366bd75-3098-4e3e-bef6-237b318eac61" containerName="keycloak" Jun 09 15:14:28.243252 ip-10-0-133-239 kubenswrapper[2576]: I0609 15:14:28.243215 2576 state_mem.go:107] "Deleted CPUSet assignment" podUID="d366bd75-3098-4e3e-bef6-237b318eac61" containerName="keycloak" Jun 09 15:14:28.243293 ip-10-0-133-239 kubenswrapper[2576]: I0609 15:14:28.243275 2576 memory_manager.go:368] "RemoveStaleState removing state" podUID="d366bd75-3098-4e3e-bef6-237b318eac61" containerName="keycloak" Jun 09 15:14:28.245909 ip-10-0-133-239 kubenswrapper[2576]: I0609 15:14:28.245894 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="keycloak-system/maas-keycloak-0" Jun 09 15:14:28.248714 ip-10-0-133-239 kubenswrapper[2576]: I0609 15:14:28.248696 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"keycloak-system\"/\"kube-root-ca.crt\"" Jun 09 15:14:28.248878 ip-10-0-133-239 kubenswrapper[2576]: I0609 15:14:28.248859 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"keycloak-system\"/\"openshift-service-ca.crt\"" Jun 09 15:14:28.249042 ip-10-0-133-239 kubenswrapper[2576]: I0609 15:14:28.249013 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"keycloak-system\"/\"keycloak-test-realms\"" Jun 09 15:14:28.249121 ip-10-0-133-239 kubenswrapper[2576]: I0609 15:14:28.249042 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"keycloak-system\"/\"default-dockercfg-sjf2t\"" Jun 09 15:14:28.249121 ip-10-0-133-239 kubenswrapper[2576]: I0609 15:14:28.249014 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"keycloak-system\"/\"maas-keycloak-initial-admin\"" Jun 09 15:14:28.256679 ip-10-0-133-239 kubenswrapper[2576]: I0609 15:14:28.256657 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["keycloak-system/maas-keycloak-0"] Jun 09 15:14:28.302158 ip-10-0-133-239 kubenswrapper[2576]: I0609 15:14:28.302121 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-tfm4j\" (UniqueName: \"kubernetes.io/projected/4cec3400-4ed7-4a14-a456-312c705dfe86-kube-api-access-tfm4j\") pod \"maas-keycloak-0\" (UID: \"4cec3400-4ed7-4a14-a456-312c705dfe86\") " pod="keycloak-system/maas-keycloak-0" Jun 09 15:14:28.302275 ip-10-0-133-239 kubenswrapper[2576]: I0609 15:14:28.302186 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"test-realms\" (UniqueName: \"kubernetes.io/configmap/4cec3400-4ed7-4a14-a456-312c705dfe86-test-realms\") pod \"maas-keycloak-0\" (UID: \"4cec3400-4ed7-4a14-a456-312c705dfe86\") " pod="keycloak-system/maas-keycloak-0" Jun 09 15:14:28.403436 ip-10-0-133-239 kubenswrapper[2576]: I0609 15:14:28.403365 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-tfm4j\" (UniqueName: \"kubernetes.io/projected/4cec3400-4ed7-4a14-a456-312c705dfe86-kube-api-access-tfm4j\") pod \"maas-keycloak-0\" (UID: \"4cec3400-4ed7-4a14-a456-312c705dfe86\") " pod="keycloak-system/maas-keycloak-0" Jun 09 15:14:28.403436 ip-10-0-133-239 kubenswrapper[2576]: I0609 15:14:28.403407 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"test-realms\" (UniqueName: \"kubernetes.io/configmap/4cec3400-4ed7-4a14-a456-312c705dfe86-test-realms\") pod \"maas-keycloak-0\" (UID: \"4cec3400-4ed7-4a14-a456-312c705dfe86\") " pod="keycloak-system/maas-keycloak-0" Jun 09 15:14:28.404098 ip-10-0-133-239 kubenswrapper[2576]: I0609 15:14:28.404081 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"test-realms\" (UniqueName: \"kubernetes.io/configmap/4cec3400-4ed7-4a14-a456-312c705dfe86-test-realms\") pod \"maas-keycloak-0\" (UID: \"4cec3400-4ed7-4a14-a456-312c705dfe86\") " pod="keycloak-system/maas-keycloak-0" Jun 09 15:14:28.412730 ip-10-0-133-239 kubenswrapper[2576]: I0609 15:14:28.412704 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-tfm4j\" (UniqueName: \"kubernetes.io/projected/4cec3400-4ed7-4a14-a456-312c705dfe86-kube-api-access-tfm4j\") pod \"maas-keycloak-0\" (UID: \"4cec3400-4ed7-4a14-a456-312c705dfe86\") " pod="keycloak-system/maas-keycloak-0" Jun 09 15:14:28.555689 ip-10-0-133-239 kubenswrapper[2576]: I0609 15:14:28.555656 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="keycloak-system/maas-keycloak-0" Jun 09 15:14:28.689908 ip-10-0-133-239 kubenswrapper[2576]: I0609 15:14:28.689872 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["keycloak-system/maas-keycloak-0"] Jun 09 15:14:28.690278 ip-10-0-133-239 kubenswrapper[2576]: W0609 15:14:28.690255 2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4cec3400_4ed7_4a14_a456_312c705dfe86.slice/crio-882bbc2f43e3219781aae1de39de70653cdc5f32d9803106dc4a6c5f982ef787 WatchSource:0}: Error finding container 882bbc2f43e3219781aae1de39de70653cdc5f32d9803106dc4a6c5f982ef787: Status 404 returned error can't find the container with id 882bbc2f43e3219781aae1de39de70653cdc5f32d9803106dc4a6c5f982ef787 Jun 09 15:14:29.205163 ip-10-0-133-239 kubenswrapper[2576]: I0609 15:14:29.205134 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="keycloak-system/maas-keycloak-0" event={"ID":"4cec3400-4ed7-4a14-a456-312c705dfe86","Type":"ContainerStarted","Data":"415cb2b7aec749cf5faa0bd3695f8a4830849b38b6ad9e1bf11a8323350f9704"} Jun 09 15:14:29.205472 ip-10-0-133-239 kubenswrapper[2576]: I0609 15:14:29.205211 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="keycloak-system/maas-keycloak-0" event={"ID":"4cec3400-4ed7-4a14-a456-312c705dfe86","Type":"ContainerStarted","Data":"882bbc2f43e3219781aae1de39de70653cdc5f32d9803106dc4a6c5f982ef787"} Jun 09 15:14:29.225878 ip-10-0-133-239 kubenswrapper[2576]: I0609 15:14:29.225833 2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="keycloak-system/maas-keycloak-0" podStartSLOduration=0.798888417 podStartE2EDuration="1.22581858s" totalImagesPullingTime="426.930163ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-09 15:14:28 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-09 15:14:29.222851206 +0000 UTC m=+784.077007476" watchObservedRunningTime="2026-06-09 15:14:29.22581858 +0000 UTC m=+784.079974818" Jun 09 15:14:29.556694 ip-10-0-133-239 kubenswrapper[2576]: I0609 15:14:29.556658 2576 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="keycloak-system/maas-keycloak-0" Jun 09 15:14:29.558585 ip-10-0-133-239 kubenswrapper[2576]: I0609 15:14:29.558553 2576 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="4cec3400-4ed7-4a14-a456-312c705dfe86" containerName="keycloak" probeResult="failure" output="Get \"http://10.134.0.50:9000/health/started\": dial tcp 10.134.0.50:9000: connect: connection refused" Jun 09 15:14:29.608340 ip-10-0-133-239 kubenswrapper[2576]: I0609 15:14:29.608301 2576 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="d366bd75-3098-4e3e-bef6-237b318eac61" path="/var/lib/kubelet/pods/d366bd75-3098-4e3e-bef6-237b318eac61/volumes" Jun 09 15:14:30.556727 ip-10-0-133-239 kubenswrapper[2576]: I0609 15:14:30.556673 2576 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="4cec3400-4ed7-4a14-a456-312c705dfe86" containerName="keycloak" probeResult="failure" output="Get \"http://10.134.0.50:9000/health/started\": dial tcp 10.134.0.50:9000: connect: connection refused" Jun 09 15:14:31.556582 ip-10-0-133-239 kubenswrapper[2576]: I0609 15:14:31.556534 2576 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="4cec3400-4ed7-4a14-a456-312c705dfe86" containerName="keycloak" probeResult="failure" output="Get \"http://10.134.0.50:9000/health/started\": dial tcp 10.134.0.50:9000: connect: connection refused" Jun 09 15:14:32.557267 ip-10-0-133-239 kubenswrapper[2576]: I0609 15:14:32.557217 2576 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="4cec3400-4ed7-4a14-a456-312c705dfe86" containerName="keycloak" probeResult="failure" output="Get \"http://10.134.0.50:9000/health/started\": dial tcp 10.134.0.50:9000: connect: connection refused" Jun 09 15:14:33.556661 ip-10-0-133-239 kubenswrapper[2576]: I0609 15:14:33.556614 2576 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="4cec3400-4ed7-4a14-a456-312c705dfe86" containerName="keycloak" probeResult="failure" output="Get \"http://10.134.0.50:9000/health/started\": dial tcp 10.134.0.50:9000: connect: connection refused" Jun 09 15:14:34.556356 ip-10-0-133-239 kubenswrapper[2576]: I0609 15:14:34.556305 2576 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="4cec3400-4ed7-4a14-a456-312c705dfe86" containerName="keycloak" probeResult="failure" output="Get \"http://10.134.0.50:9000/health/started\": dial tcp 10.134.0.50:9000: connect: connection refused" Jun 09 15:14:35.556980 ip-10-0-133-239 kubenswrapper[2576]: I0609 15:14:35.556933 2576 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="4cec3400-4ed7-4a14-a456-312c705dfe86" containerName="keycloak" probeResult="failure" output="Get \"http://10.134.0.50:9000/health/started\": dial tcp 10.134.0.50:9000: connect: connection refused" Jun 09 15:14:36.556169 ip-10-0-133-239 kubenswrapper[2576]: I0609 15:14:36.556118 2576 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="4cec3400-4ed7-4a14-a456-312c705dfe86" containerName="keycloak" probeResult="failure" output="Get \"http://10.134.0.50:9000/health/started\": dial tcp 10.134.0.50:9000: connect: connection refused" Jun 09 15:14:37.556763 ip-10-0-133-239 kubenswrapper[2576]: I0609 15:14:37.556714 2576 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="4cec3400-4ed7-4a14-a456-312c705dfe86" containerName="keycloak" probeResult="failure" output="Get \"http://10.134.0.50:9000/health/started\": dial tcp 10.134.0.50:9000: connect: connection refused" Jun 09 15:14:38.556076 ip-10-0-133-239 kubenswrapper[2576]: I0609 15:14:38.556031 2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="keycloak-system/maas-keycloak-0" Jun 09 15:14:38.556372 ip-10-0-133-239 kubenswrapper[2576]: I0609 15:14:38.556341 2576 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="4cec3400-4ed7-4a14-a456-312c705dfe86" containerName="keycloak" probeResult="failure" output="Get \"http://10.134.0.50:9000/health/started\": dial tcp 10.134.0.50:9000: connect: connection refused" Jun 09 15:14:39.557004 ip-10-0-133-239 kubenswrapper[2576]: I0609 15:14:39.556950 2576 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="4cec3400-4ed7-4a14-a456-312c705dfe86" containerName="keycloak" probeResult="failure" output="Get \"http://10.134.0.50:9000/health/started\": dial tcp 10.134.0.50:9000: connect: connection refused" Jun 09 15:14:40.556832 ip-10-0-133-239 kubenswrapper[2576]: I0609 15:14:40.556778 2576 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="4cec3400-4ed7-4a14-a456-312c705dfe86" containerName="keycloak" probeResult="failure" output="Get \"http://10.134.0.50:9000/health/started\": dial tcp 10.134.0.50:9000: connect: connection refused" Jun 09 15:14:41.556253 ip-10-0-133-239 kubenswrapper[2576]: I0609 15:14:41.556202 2576 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="4cec3400-4ed7-4a14-a456-312c705dfe86" containerName="keycloak" probeResult="failure" output="Get \"http://10.134.0.50:9000/health/started\": dial tcp 10.134.0.50:9000: connect: connection refused" Jun 09 15:14:42.688649 ip-10-0-133-239 kubenswrapper[2576]: I0609 15:14:42.688598 2576 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="keycloak-system/maas-keycloak-0" Jun 09 15:14:42.706115 ip-10-0-133-239 kubenswrapper[2576]: I0609 15:14:42.706041 2576 prober.go:120] "Probe failed" probeType="Readiness" pod="keycloak-system/maas-keycloak-0" podUID="4cec3400-4ed7-4a14-a456-312c705dfe86" containerName="keycloak" probeResult="failure" output="HTTP probe failed with statuscode: 503" Jun 09 15:14:52.695975 ip-10-0-133-239 kubenswrapper[2576]: I0609 15:14:52.695937 2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="keycloak-system/maas-keycloak-0" Jun 09 15:15:05.654143 ip-10-0-133-239 kubenswrapper[2576]: I0609 15:15:05.654107 2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-7586b4b9b5-2js8z"] Jun 09 15:15:05.659577 ip-10-0-133-239 kubenswrapper[2576]: I0609 15:15:05.659554 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-7586b4b9b5-2js8z" Jun 09 15:15:05.662379 ip-10-0-133-239 kubenswrapper[2576]: I0609 15:15:05.662359 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"authorino-oidc-ca\"" Jun 09 15:15:05.667483 ip-10-0-133-239 kubenswrapper[2576]: I0609 15:15:05.667456 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oidc-ca\" (UniqueName: \"kubernetes.io/configmap/477adaba-5d68-445a-9dda-f7ff70254419-oidc-ca\") pod \"authorino-7586b4b9b5-2js8z\" (UID: \"477adaba-5d68-445a-9dda-f7ff70254419\") " pod="kuadrant-system/authorino-7586b4b9b5-2js8z" Jun 09 15:15:05.667611 ip-10-0-133-239 kubenswrapper[2576]: I0609 15:15:05.667511 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/477adaba-5d68-445a-9dda-f7ff70254419-tls-cert\") pod \"authorino-7586b4b9b5-2js8z\" (UID: \"477adaba-5d68-445a-9dda-f7ff70254419\") " pod="kuadrant-system/authorino-7586b4b9b5-2js8z" Jun 09 15:15:05.667680 ip-10-0-133-239 kubenswrapper[2576]: I0609 15:15:05.667645 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-gn47x\" (UniqueName: \"kubernetes.io/projected/477adaba-5d68-445a-9dda-f7ff70254419-kube-api-access-gn47x\") pod \"authorino-7586b4b9b5-2js8z\" (UID: \"477adaba-5d68-445a-9dda-f7ff70254419\") " pod="kuadrant-system/authorino-7586b4b9b5-2js8z" Jun 09 15:15:05.668978 ip-10-0-133-239 kubenswrapper[2576]: I0609 15:15:05.668952 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-7586b4b9b5-2js8z"] Jun 09 15:15:05.768404 ip-10-0-133-239 kubenswrapper[2576]: I0609 15:15:05.768365 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oidc-ca\" (UniqueName: \"kubernetes.io/configmap/477adaba-5d68-445a-9dda-f7ff70254419-oidc-ca\") pod \"authorino-7586b4b9b5-2js8z\" (UID: \"477adaba-5d68-445a-9dda-f7ff70254419\") " pod="kuadrant-system/authorino-7586b4b9b5-2js8z" Jun 09 15:15:05.768609 ip-10-0-133-239 kubenswrapper[2576]: I0609 15:15:05.768414 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/477adaba-5d68-445a-9dda-f7ff70254419-tls-cert\") pod \"authorino-7586b4b9b5-2js8z\" (UID: \"477adaba-5d68-445a-9dda-f7ff70254419\") " pod="kuadrant-system/authorino-7586b4b9b5-2js8z" Jun 09 15:15:05.768609 ip-10-0-133-239 kubenswrapper[2576]: I0609 15:15:05.768464 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-gn47x\" (UniqueName: \"kubernetes.io/projected/477adaba-5d68-445a-9dda-f7ff70254419-kube-api-access-gn47x\") pod \"authorino-7586b4b9b5-2js8z\" (UID: \"477adaba-5d68-445a-9dda-f7ff70254419\") " pod="kuadrant-system/authorino-7586b4b9b5-2js8z" Jun 09 15:15:05.769012 ip-10-0-133-239 kubenswrapper[2576]: I0609 15:15:05.768990 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"oidc-ca\" (UniqueName: \"kubernetes.io/configmap/477adaba-5d68-445a-9dda-f7ff70254419-oidc-ca\") pod \"authorino-7586b4b9b5-2js8z\" (UID: \"477adaba-5d68-445a-9dda-f7ff70254419\") " pod="kuadrant-system/authorino-7586b4b9b5-2js8z" Jun 09 15:15:05.770789 ip-10-0-133-239 kubenswrapper[2576]: I0609 15:15:05.770762 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/477adaba-5d68-445a-9dda-f7ff70254419-tls-cert\") pod \"authorino-7586b4b9b5-2js8z\" (UID: \"477adaba-5d68-445a-9dda-f7ff70254419\") " pod="kuadrant-system/authorino-7586b4b9b5-2js8z" Jun 09 15:15:05.777978 ip-10-0-133-239 kubenswrapper[2576]: I0609 15:15:05.777952 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-gn47x\" (UniqueName: \"kubernetes.io/projected/477adaba-5d68-445a-9dda-f7ff70254419-kube-api-access-gn47x\") pod \"authorino-7586b4b9b5-2js8z\" (UID: \"477adaba-5d68-445a-9dda-f7ff70254419\") " pod="kuadrant-system/authorino-7586b4b9b5-2js8z" Jun 09 15:15:05.970041 ip-10-0-133-239 kubenswrapper[2576]: I0609 15:15:05.969959 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-7586b4b9b5-2js8z" Jun 09 15:15:06.103830 ip-10-0-133-239 kubenswrapper[2576]: I0609 15:15:06.103792 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-7586b4b9b5-2js8z"] Jun 09 15:15:06.105132 ip-10-0-133-239 kubenswrapper[2576]: W0609 15:15:06.105097 2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod477adaba_5d68_445a_9dda_f7ff70254419.slice/crio-87a515c5fab72c5ce10344de2fb812bc84b89548489777dea3d24a271b9e305d WatchSource:0}: Error finding container 87a515c5fab72c5ce10344de2fb812bc84b89548489777dea3d24a271b9e305d: Status 404 returned error can't find the container with id 87a515c5fab72c5ce10344de2fb812bc84b89548489777dea3d24a271b9e305d Jun 09 15:15:06.449542 ip-10-0-133-239 kubenswrapper[2576]: I0609 15:15:06.449509 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-7586b4b9b5-2js8z" event={"ID":"477adaba-5d68-445a-9dda-f7ff70254419","Type":"ContainerStarted","Data":"87a515c5fab72c5ce10344de2fb812bc84b89548489777dea3d24a271b9e305d"} Jun 09 15:15:07.456309 ip-10-0-133-239 kubenswrapper[2576]: I0609 15:15:07.456267 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-7586b4b9b5-2js8z" event={"ID":"477adaba-5d68-445a-9dda-f7ff70254419","Type":"ContainerStarted","Data":"02103f4a6d48e7e1e791ad8ef0c71b8a1588964bd2f5b962d4cda8058ea66f81"} Jun 09 15:15:07.481441 ip-10-0-133-239 kubenswrapper[2576]: I0609 15:15:07.481388 2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/authorino-7586b4b9b5-2js8z" podStartSLOduration=2.018383293 podStartE2EDuration="2.481373223s" totalImagesPullingTime="462.98993ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-09 15:15:05 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-09 15:15:07.479839664 +0000 UTC m=+822.333995904" watchObservedRunningTime="2026-06-09 15:15:07.481373223 +0000 UTC m=+822.335529488" Jun 09 15:15:07.523036 ip-10-0-133-239 kubenswrapper[2576]: I0609 15:15:07.523002 2576 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-765689c4d9-m8tkb"] Jun 09 15:15:07.523308 ip-10-0-133-239 kubenswrapper[2576]: I0609 15:15:07.523281 2576 kuberuntime_container.go:872] "Killing container with a grace period" pod="kuadrant-system/authorino-765689c4d9-m8tkb" podUID="45b7c1f9-8b13-4612-97f6-e5840f9beb90" containerName="authorino" containerID="cri-o://cd1016c7a1b8d6638dd3ffd21255b0fe8d2f7829174623b4371bd16b0f2238f8" gracePeriod=30 Jun 09 15:15:07.768613 ip-10-0-133-239 kubenswrapper[2576]: I0609 15:15:07.768586 2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-765689c4d9-m8tkb" Jun 09 15:15:07.787995 ip-10-0-133-239 kubenswrapper[2576]: I0609 15:15:07.787972 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/45b7c1f9-8b13-4612-97f6-e5840f9beb90-tls-cert\") pod \"45b7c1f9-8b13-4612-97f6-e5840f9beb90\" (UID: \"45b7c1f9-8b13-4612-97f6-e5840f9beb90\") " Jun 09 15:15:07.788123 ip-10-0-133-239 kubenswrapper[2576]: I0609 15:15:07.788008 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-4xlx4\" (UniqueName: \"kubernetes.io/projected/45b7c1f9-8b13-4612-97f6-e5840f9beb90-kube-api-access-4xlx4\") pod \"45b7c1f9-8b13-4612-97f6-e5840f9beb90\" (UID: \"45b7c1f9-8b13-4612-97f6-e5840f9beb90\") " Jun 09 15:15:07.790012 ip-10-0-133-239 kubenswrapper[2576]: I0609 15:15:07.789988 2576 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/45b7c1f9-8b13-4612-97f6-e5840f9beb90-kube-api-access-4xlx4" (OuterVolumeSpecName: "kube-api-access-4xlx4") pod "45b7c1f9-8b13-4612-97f6-e5840f9beb90" (UID: "45b7c1f9-8b13-4612-97f6-e5840f9beb90"). InnerVolumeSpecName "kube-api-access-4xlx4". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 09 15:15:07.798199 ip-10-0-133-239 kubenswrapper[2576]: I0609 15:15:07.798164 2576 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/45b7c1f9-8b13-4612-97f6-e5840f9beb90-tls-cert" (OuterVolumeSpecName: "tls-cert") pod "45b7c1f9-8b13-4612-97f6-e5840f9beb90" (UID: "45b7c1f9-8b13-4612-97f6-e5840f9beb90"). InnerVolumeSpecName "tls-cert". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 09 15:15:07.889566 ip-10-0-133-239 kubenswrapper[2576]: I0609 15:15:07.889534 2576 reconciler_common.go:299] "Volume detached for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/45b7c1f9-8b13-4612-97f6-e5840f9beb90-tls-cert\") on node \"ip-10-0-133-239.ec2.internal\" DevicePath \"\"" Jun 09 15:15:07.889566 ip-10-0-133-239 kubenswrapper[2576]: I0609 15:15:07.889561 2576 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-4xlx4\" (UniqueName: \"kubernetes.io/projected/45b7c1f9-8b13-4612-97f6-e5840f9beb90-kube-api-access-4xlx4\") on node \"ip-10-0-133-239.ec2.internal\" DevicePath \"\"" Jun 09 15:15:08.463146 ip-10-0-133-239 kubenswrapper[2576]: I0609 15:15:08.463109 2576 generic.go:356] "Generic (PLEG): container finished" podID="45b7c1f9-8b13-4612-97f6-e5840f9beb90" containerID="cd1016c7a1b8d6638dd3ffd21255b0fe8d2f7829174623b4371bd16b0f2238f8" exitCode=0 Jun 09 15:15:08.463578 ip-10-0-133-239 kubenswrapper[2576]: I0609 15:15:08.463156 2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-765689c4d9-m8tkb" Jun 09 15:15:08.463578 ip-10-0-133-239 kubenswrapper[2576]: I0609 15:15:08.463187 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-765689c4d9-m8tkb" event={"ID":"45b7c1f9-8b13-4612-97f6-e5840f9beb90","Type":"ContainerDied","Data":"cd1016c7a1b8d6638dd3ffd21255b0fe8d2f7829174623b4371bd16b0f2238f8"} Jun 09 15:15:08.463578 ip-10-0-133-239 kubenswrapper[2576]: I0609 15:15:08.463224 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-765689c4d9-m8tkb" event={"ID":"45b7c1f9-8b13-4612-97f6-e5840f9beb90","Type":"ContainerDied","Data":"530ef221ccb47d4dcba2064d3c4eaa47cdb863a8223900139b0aee9ae1a3a093"} Jun 09 15:15:08.463578 ip-10-0-133-239 kubenswrapper[2576]: I0609 15:15:08.463246 2576 scope.go:117] "RemoveContainer" containerID="cd1016c7a1b8d6638dd3ffd21255b0fe8d2f7829174623b4371bd16b0f2238f8" Jun 09 15:15:08.472828 ip-10-0-133-239 kubenswrapper[2576]: I0609 15:15:08.472808 2576 scope.go:117] "RemoveContainer" containerID="cd1016c7a1b8d6638dd3ffd21255b0fe8d2f7829174623b4371bd16b0f2238f8" Jun 09 15:15:08.473079 ip-10-0-133-239 kubenswrapper[2576]: E0609 15:15:08.473045 2576 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"cd1016c7a1b8d6638dd3ffd21255b0fe8d2f7829174623b4371bd16b0f2238f8\": container with ID starting with cd1016c7a1b8d6638dd3ffd21255b0fe8d2f7829174623b4371bd16b0f2238f8 not found: ID does not exist" containerID="cd1016c7a1b8d6638dd3ffd21255b0fe8d2f7829174623b4371bd16b0f2238f8" Jun 09 15:15:08.473151 ip-10-0-133-239 kubenswrapper[2576]: I0609 15:15:08.473097 2576 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"cd1016c7a1b8d6638dd3ffd21255b0fe8d2f7829174623b4371bd16b0f2238f8"} err="failed to get container status \"cd1016c7a1b8d6638dd3ffd21255b0fe8d2f7829174623b4371bd16b0f2238f8\": rpc error: code = NotFound desc = could not find container \"cd1016c7a1b8d6638dd3ffd21255b0fe8d2f7829174623b4371bd16b0f2238f8\": container with ID starting with cd1016c7a1b8d6638dd3ffd21255b0fe8d2f7829174623b4371bd16b0f2238f8 not found: ID does not exist" Jun 09 15:15:08.492603 ip-10-0-133-239 kubenswrapper[2576]: I0609 15:15:08.492579 2576 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-765689c4d9-m8tkb"] Jun 09 15:15:08.497421 ip-10-0-133-239 kubenswrapper[2576]: I0609 15:15:08.497402 2576 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/authorino-765689c4d9-m8tkb"] Jun 09 15:15:09.604539 ip-10-0-133-239 kubenswrapper[2576]: I0609 15:15:09.604502 2576 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="45b7c1f9-8b13-4612-97f6-e5840f9beb90" path="/var/lib/kubelet/pods/45b7c1f9-8b13-4612-97f6-e5840f9beb90/volumes" Jun 09 15:15:41.464185 ip-10-0-133-239 kubenswrapper[2576]: I0609 15:15:41.464146 2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/e2e-distinct-simulated-kserve-5cdff5474d-97gtv"] Jun 09 15:15:41.464812 ip-10-0-133-239 kubenswrapper[2576]: I0609 15:15:41.464789 2576 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="45b7c1f9-8b13-4612-97f6-e5840f9beb90" containerName="authorino" Jun 09 15:15:41.464812 ip-10-0-133-239 kubenswrapper[2576]: I0609 15:15:41.464814 2576 state_mem.go:107] "Deleted CPUSet assignment" podUID="45b7c1f9-8b13-4612-97f6-e5840f9beb90" containerName="authorino" Jun 09 15:15:41.465027 ip-10-0-133-239 kubenswrapper[2576]: I0609 15:15:41.464924 2576 memory_manager.go:368] "RemoveStaleState removing state" podUID="45b7c1f9-8b13-4612-97f6-e5840f9beb90" containerName="authorino" Jun 09 15:15:41.468364 ip-10-0-133-239 kubenswrapper[2576]: I0609 15:15:41.468345 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-distinct-simulated-kserve-5cdff5474d-97gtv" Jun 09 15:15:41.471006 ip-10-0-133-239 kubenswrapper[2576]: I0609 15:15:41.470986 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"llm\"/\"openshift-service-ca.crt\"" Jun 09 15:15:41.471122 ip-10-0-133-239 kubenswrapper[2576]: I0609 15:15:41.471104 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"default-dockercfg-p9nz7\"" Jun 09 15:15:41.472019 ip-10-0-133-239 kubenswrapper[2576]: I0609 15:15:41.472002 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"e2e-distinct-simulated-kserve-self-signed-certs\"" Jun 09 15:15:41.472131 ip-10-0-133-239 kubenswrapper[2576]: I0609 15:15:41.472005 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"llm\"/\"kube-root-ca.crt\"" Jun 09 15:15:41.478399 ip-10-0-133-239 kubenswrapper[2576]: I0609 15:15:41.478381 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-distinct-simulated-kserve-5cdff5474d-97gtv"] Jun 09 15:15:41.501132 ip-10-0-133-239 kubenswrapper[2576]: I0609 15:15:41.501113 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/f55ce3c8-a3be-4131-9eaa-07c047a5f633-kserve-provision-location\") pod \"e2e-distinct-simulated-kserve-5cdff5474d-97gtv\" (UID: \"f55ce3c8-a3be-4131-9eaa-07c047a5f633\") " pod="llm/e2e-distinct-simulated-kserve-5cdff5474d-97gtv" Jun 09 15:15:41.501241 ip-10-0-133-239 kubenswrapper[2576]: I0609 15:15:41.501142 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/f55ce3c8-a3be-4131-9eaa-07c047a5f633-home\") pod \"e2e-distinct-simulated-kserve-5cdff5474d-97gtv\" (UID: \"f55ce3c8-a3be-4131-9eaa-07c047a5f633\") " pod="llm/e2e-distinct-simulated-kserve-5cdff5474d-97gtv" Jun 09 15:15:41.501241 ip-10-0-133-239 kubenswrapper[2576]: I0609 15:15:41.501190 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/f55ce3c8-a3be-4131-9eaa-07c047a5f633-tls-certs\") pod \"e2e-distinct-simulated-kserve-5cdff5474d-97gtv\" (UID: \"f55ce3c8-a3be-4131-9eaa-07c047a5f633\") " pod="llm/e2e-distinct-simulated-kserve-5cdff5474d-97gtv" Jun 09 15:15:41.501241 ip-10-0-133-239 kubenswrapper[2576]: I0609 15:15:41.501229 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/f55ce3c8-a3be-4131-9eaa-07c047a5f633-model-cache\") pod \"e2e-distinct-simulated-kserve-5cdff5474d-97gtv\" (UID: \"f55ce3c8-a3be-4131-9eaa-07c047a5f633\") " pod="llm/e2e-distinct-simulated-kserve-5cdff5474d-97gtv" Jun 09 15:15:41.501404 ip-10-0-133-239 kubenswrapper[2576]: I0609 15:15:41.501248 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/f55ce3c8-a3be-4131-9eaa-07c047a5f633-dshm\") pod \"e2e-distinct-simulated-kserve-5cdff5474d-97gtv\" (UID: \"f55ce3c8-a3be-4131-9eaa-07c047a5f633\") " pod="llm/e2e-distinct-simulated-kserve-5cdff5474d-97gtv" Jun 09 15:15:41.501404 ip-10-0-133-239 kubenswrapper[2576]: I0609 15:15:41.501322 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6wb2v\" (UniqueName: \"kubernetes.io/projected/f55ce3c8-a3be-4131-9eaa-07c047a5f633-kube-api-access-6wb2v\") pod \"e2e-distinct-simulated-kserve-5cdff5474d-97gtv\" (UID: \"f55ce3c8-a3be-4131-9eaa-07c047a5f633\") " pod="llm/e2e-distinct-simulated-kserve-5cdff5474d-97gtv" Jun 09 15:15:41.602085 ip-10-0-133-239 kubenswrapper[2576]: I0609 15:15:41.602048 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/f55ce3c8-a3be-4131-9eaa-07c047a5f633-tls-certs\") pod \"e2e-distinct-simulated-kserve-5cdff5474d-97gtv\" (UID: \"f55ce3c8-a3be-4131-9eaa-07c047a5f633\") " pod="llm/e2e-distinct-simulated-kserve-5cdff5474d-97gtv" Jun 09 15:15:41.602266 ip-10-0-133-239 kubenswrapper[2576]: I0609 15:15:41.602111 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/f55ce3c8-a3be-4131-9eaa-07c047a5f633-model-cache\") pod \"e2e-distinct-simulated-kserve-5cdff5474d-97gtv\" (UID: \"f55ce3c8-a3be-4131-9eaa-07c047a5f633\") " pod="llm/e2e-distinct-simulated-kserve-5cdff5474d-97gtv" Jun 09 15:15:41.602266 ip-10-0-133-239 kubenswrapper[2576]: I0609 15:15:41.602136 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/f55ce3c8-a3be-4131-9eaa-07c047a5f633-dshm\") pod \"e2e-distinct-simulated-kserve-5cdff5474d-97gtv\" (UID: \"f55ce3c8-a3be-4131-9eaa-07c047a5f633\") " pod="llm/e2e-distinct-simulated-kserve-5cdff5474d-97gtv" Jun 09 15:15:41.602266 ip-10-0-133-239 kubenswrapper[2576]: I0609 15:15:41.602181 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6wb2v\" (UniqueName: \"kubernetes.io/projected/f55ce3c8-a3be-4131-9eaa-07c047a5f633-kube-api-access-6wb2v\") pod \"e2e-distinct-simulated-kserve-5cdff5474d-97gtv\" (UID: \"f55ce3c8-a3be-4131-9eaa-07c047a5f633\") " pod="llm/e2e-distinct-simulated-kserve-5cdff5474d-97gtv" Jun 09 15:15:41.602266 ip-10-0-133-239 kubenswrapper[2576]: I0609 15:15:41.602220 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/f55ce3c8-a3be-4131-9eaa-07c047a5f633-kserve-provision-location\") pod \"e2e-distinct-simulated-kserve-5cdff5474d-97gtv\" (UID: \"f55ce3c8-a3be-4131-9eaa-07c047a5f633\") " pod="llm/e2e-distinct-simulated-kserve-5cdff5474d-97gtv" Jun 09 15:15:41.602266 ip-10-0-133-239 kubenswrapper[2576]: I0609 15:15:41.602251 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/f55ce3c8-a3be-4131-9eaa-07c047a5f633-home\") pod \"e2e-distinct-simulated-kserve-5cdff5474d-97gtv\" (UID: \"f55ce3c8-a3be-4131-9eaa-07c047a5f633\") " pod="llm/e2e-distinct-simulated-kserve-5cdff5474d-97gtv" Jun 09 15:15:41.602586 ip-10-0-133-239 kubenswrapper[2576]: I0609 15:15:41.602557 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/f55ce3c8-a3be-4131-9eaa-07c047a5f633-model-cache\") pod \"e2e-distinct-simulated-kserve-5cdff5474d-97gtv\" (UID: \"f55ce3c8-a3be-4131-9eaa-07c047a5f633\") " pod="llm/e2e-distinct-simulated-kserve-5cdff5474d-97gtv" Jun 09 15:15:41.602656 ip-10-0-133-239 kubenswrapper[2576]: I0609 15:15:41.602633 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/f55ce3c8-a3be-4131-9eaa-07c047a5f633-kserve-provision-location\") pod \"e2e-distinct-simulated-kserve-5cdff5474d-97gtv\" (UID: \"f55ce3c8-a3be-4131-9eaa-07c047a5f633\") " pod="llm/e2e-distinct-simulated-kserve-5cdff5474d-97gtv" Jun 09 15:15:41.602713 ip-10-0-133-239 kubenswrapper[2576]: I0609 15:15:41.602672 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/f55ce3c8-a3be-4131-9eaa-07c047a5f633-home\") pod \"e2e-distinct-simulated-kserve-5cdff5474d-97gtv\" (UID: \"f55ce3c8-a3be-4131-9eaa-07c047a5f633\") " pod="llm/e2e-distinct-simulated-kserve-5cdff5474d-97gtv" Jun 09 15:15:41.604445 ip-10-0-133-239 kubenswrapper[2576]: I0609 15:15:41.604425 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/f55ce3c8-a3be-4131-9eaa-07c047a5f633-dshm\") pod \"e2e-distinct-simulated-kserve-5cdff5474d-97gtv\" (UID: \"f55ce3c8-a3be-4131-9eaa-07c047a5f633\") " pod="llm/e2e-distinct-simulated-kserve-5cdff5474d-97gtv" Jun 09 15:15:41.604620 ip-10-0-133-239 kubenswrapper[2576]: I0609 15:15:41.604603 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/f55ce3c8-a3be-4131-9eaa-07c047a5f633-tls-certs\") pod \"e2e-distinct-simulated-kserve-5cdff5474d-97gtv\" (UID: \"f55ce3c8-a3be-4131-9eaa-07c047a5f633\") " pod="llm/e2e-distinct-simulated-kserve-5cdff5474d-97gtv" Jun 09 15:15:41.610580 ip-10-0-133-239 kubenswrapper[2576]: I0609 15:15:41.610550 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-6wb2v\" (UniqueName: \"kubernetes.io/projected/f55ce3c8-a3be-4131-9eaa-07c047a5f633-kube-api-access-6wb2v\") pod \"e2e-distinct-simulated-kserve-5cdff5474d-97gtv\" (UID: \"f55ce3c8-a3be-4131-9eaa-07c047a5f633\") " pod="llm/e2e-distinct-simulated-kserve-5cdff5474d-97gtv" Jun 09 15:15:41.780434 ip-10-0-133-239 kubenswrapper[2576]: I0609 15:15:41.780399 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-distinct-simulated-kserve-5cdff5474d-97gtv" Jun 09 15:15:41.933907 ip-10-0-133-239 kubenswrapper[2576]: I0609 15:15:41.933876 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-distinct-simulated-kserve-5cdff5474d-97gtv"] Jun 09 15:15:41.935368 ip-10-0-133-239 kubenswrapper[2576]: W0609 15:15:41.935340 2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf55ce3c8_a3be_4131_9eaa_07c047a5f633.slice/crio-ef52c6ca51c795186732d7444dc615bbe58da603914e83e10f73d2d29c02255e WatchSource:0}: Error finding container ef52c6ca51c795186732d7444dc615bbe58da603914e83e10f73d2d29c02255e: Status 404 returned error can't find the container with id ef52c6ca51c795186732d7444dc615bbe58da603914e83e10f73d2d29c02255e Jun 09 15:15:42.664100 ip-10-0-133-239 kubenswrapper[2576]: I0609 15:15:42.664047 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-simulated-kserve-5cdff5474d-97gtv" event={"ID":"f55ce3c8-a3be-4131-9eaa-07c047a5f633","Type":"ContainerStarted","Data":"ef52c6ca51c795186732d7444dc615bbe58da603914e83e10f73d2d29c02255e"} Jun 09 15:15:45.685761 ip-10-0-133-239 kubenswrapper[2576]: I0609 15:15:45.685726 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-simulated-kserve-5cdff5474d-97gtv" event={"ID":"f55ce3c8-a3be-4131-9eaa-07c047a5f633","Type":"ContainerStarted","Data":"15e9bb9df24903e814018eb4022c3e31338eac771759b3f43bb2d91b572ed4a9"} Jun 09 15:15:46.692750 ip-10-0-133-239 kubenswrapper[2576]: I0609 15:15:46.692705 2576 generic.go:356] "Generic (PLEG): container finished" podID="f55ce3c8-a3be-4131-9eaa-07c047a5f633" containerID="15e9bb9df24903e814018eb4022c3e31338eac771759b3f43bb2d91b572ed4a9" exitCode=0 Jun 09 15:15:46.692750 ip-10-0-133-239 kubenswrapper[2576]: I0609 15:15:46.692750 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-simulated-kserve-5cdff5474d-97gtv" event={"ID":"f55ce3c8-a3be-4131-9eaa-07c047a5f633","Type":"ContainerDied","Data":"15e9bb9df24903e814018eb4022c3e31338eac771759b3f43bb2d91b572ed4a9"} Jun 09 15:15:48.707095 ip-10-0-133-239 kubenswrapper[2576]: I0609 15:15:48.706974 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-simulated-kserve-5cdff5474d-97gtv" event={"ID":"f55ce3c8-a3be-4131-9eaa-07c047a5f633","Type":"ContainerStarted","Data":"c7792632e60762becd832f8d53960e8ea32b1e0e25daa20868b081202dc91e4d"} Jun 09 15:15:48.729438 ip-10-0-133-239 kubenswrapper[2576]: I0609 15:15:48.729386 2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/e2e-distinct-simulated-kserve-5cdff5474d-97gtv" podStartSLOduration=2.00915598 podStartE2EDuration="7.729370072s" totalImagesPullingTime="4.446728905s" totalInitContainerRuntime="1.273485187s" isStatefulPod=false podCreationTimestamp="2026-06-09 15:15:41 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-09 15:15:48.727925446 +0000 UTC m=+863.582081685" watchObservedRunningTime="2026-06-09 15:15:48.729370072 +0000 UTC m=+863.583526311" Jun 09 15:15:51.781445 ip-10-0-133-239 kubenswrapper[2576]: I0609 15:15:51.781410 2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/e2e-distinct-simulated-kserve-5cdff5474d-97gtv" Jun 09 15:15:51.781840 ip-10-0-133-239 kubenswrapper[2576]: I0609 15:15:51.781471 2576 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/e2e-distinct-simulated-kserve-5cdff5474d-97gtv" Jun 09 15:15:51.794171 ip-10-0-133-239 kubenswrapper[2576]: I0609 15:15:51.794149 2576 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/e2e-distinct-simulated-kserve-5cdff5474d-97gtv" Jun 09 15:15:52.740053 ip-10-0-133-239 kubenswrapper[2576]: I0609 15:15:52.740025 2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/e2e-distinct-simulated-kserve-5cdff5474d-97gtv" Jun 09 15:15:54.966025 ip-10-0-133-239 kubenswrapper[2576]: I0609 15:15:54.965989 2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-cvm9j"] Jun 09 15:15:54.971077 ip-10-0-133-239 kubenswrapper[2576]: I0609 15:15:54.971044 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-cvm9j" Jun 09 15:15:54.973786 ip-10-0-133-239 kubenswrapper[2576]: I0609 15:15:54.973758 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"e2e-trlp-test-simulated-kserve-self-signed-certs\"" Jun 09 15:15:54.978959 ip-10-0-133-239 kubenswrapper[2576]: I0609 15:15:54.978937 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-cvm9j"] Jun 09 15:15:55.025727 ip-10-0-133-239 kubenswrapper[2576]: I0609 15:15:55.025693 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/1a2d71c3-3c4f-43ad-89c1-2321434e200d-tls-certs\") pod \"e2e-trlp-test-simulated-kserve-68bb6c58d9-cvm9j\" (UID: \"1a2d71c3-3c4f-43ad-89c1-2321434e200d\") " pod="llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-cvm9j" Jun 09 15:15:55.025887 ip-10-0-133-239 kubenswrapper[2576]: I0609 15:15:55.025735 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/1a2d71c3-3c4f-43ad-89c1-2321434e200d-home\") pod \"e2e-trlp-test-simulated-kserve-68bb6c58d9-cvm9j\" (UID: \"1a2d71c3-3c4f-43ad-89c1-2321434e200d\") " pod="llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-cvm9j" Jun 09 15:15:55.025887 ip-10-0-133-239 kubenswrapper[2576]: I0609 15:15:55.025810 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/1a2d71c3-3c4f-43ad-89c1-2321434e200d-kserve-provision-location\") pod \"e2e-trlp-test-simulated-kserve-68bb6c58d9-cvm9j\" (UID: \"1a2d71c3-3c4f-43ad-89c1-2321434e200d\") " pod="llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-cvm9j" Jun 09 15:15:55.025887 ip-10-0-133-239 kubenswrapper[2576]: I0609 15:15:55.025833 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-76j9k\" (UniqueName: \"kubernetes.io/projected/1a2d71c3-3c4f-43ad-89c1-2321434e200d-kube-api-access-76j9k\") pod \"e2e-trlp-test-simulated-kserve-68bb6c58d9-cvm9j\" (UID: \"1a2d71c3-3c4f-43ad-89c1-2321434e200d\") " pod="llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-cvm9j" Jun 09 15:15:55.025887 ip-10-0-133-239 kubenswrapper[2576]: I0609 15:15:55.025867 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/1a2d71c3-3c4f-43ad-89c1-2321434e200d-dshm\") pod \"e2e-trlp-test-simulated-kserve-68bb6c58d9-cvm9j\" (UID: \"1a2d71c3-3c4f-43ad-89c1-2321434e200d\") " pod="llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-cvm9j" Jun 09 15:15:55.025887 ip-10-0-133-239 kubenswrapper[2576]: I0609 15:15:55.025884 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/1a2d71c3-3c4f-43ad-89c1-2321434e200d-model-cache\") pod \"e2e-trlp-test-simulated-kserve-68bb6c58d9-cvm9j\" (UID: \"1a2d71c3-3c4f-43ad-89c1-2321434e200d\") " pod="llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-cvm9j" Jun 09 15:15:55.127357 ip-10-0-133-239 kubenswrapper[2576]: I0609 15:15:55.127235 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/1a2d71c3-3c4f-43ad-89c1-2321434e200d-dshm\") pod \"e2e-trlp-test-simulated-kserve-68bb6c58d9-cvm9j\" (UID: \"1a2d71c3-3c4f-43ad-89c1-2321434e200d\") " pod="llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-cvm9j" Jun 09 15:15:55.127357 ip-10-0-133-239 kubenswrapper[2576]: I0609 15:15:55.127284 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/1a2d71c3-3c4f-43ad-89c1-2321434e200d-model-cache\") pod \"e2e-trlp-test-simulated-kserve-68bb6c58d9-cvm9j\" (UID: \"1a2d71c3-3c4f-43ad-89c1-2321434e200d\") " pod="llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-cvm9j" Jun 09 15:15:55.127357 ip-10-0-133-239 kubenswrapper[2576]: I0609 15:15:55.127330 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/1a2d71c3-3c4f-43ad-89c1-2321434e200d-tls-certs\") pod \"e2e-trlp-test-simulated-kserve-68bb6c58d9-cvm9j\" (UID: \"1a2d71c3-3c4f-43ad-89c1-2321434e200d\") " pod="llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-cvm9j" Jun 09 15:15:55.127624 ip-10-0-133-239 kubenswrapper[2576]: I0609 15:15:55.127370 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/1a2d71c3-3c4f-43ad-89c1-2321434e200d-home\") pod \"e2e-trlp-test-simulated-kserve-68bb6c58d9-cvm9j\" (UID: \"1a2d71c3-3c4f-43ad-89c1-2321434e200d\") " pod="llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-cvm9j" Jun 09 15:15:55.127624 ip-10-0-133-239 kubenswrapper[2576]: I0609 15:15:55.127487 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/1a2d71c3-3c4f-43ad-89c1-2321434e200d-kserve-provision-location\") pod \"e2e-trlp-test-simulated-kserve-68bb6c58d9-cvm9j\" (UID: \"1a2d71c3-3c4f-43ad-89c1-2321434e200d\") " pod="llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-cvm9j" Jun 09 15:15:55.127624 ip-10-0-133-239 kubenswrapper[2576]: I0609 15:15:55.127523 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-76j9k\" (UniqueName: \"kubernetes.io/projected/1a2d71c3-3c4f-43ad-89c1-2321434e200d-kube-api-access-76j9k\") pod \"e2e-trlp-test-simulated-kserve-68bb6c58d9-cvm9j\" (UID: \"1a2d71c3-3c4f-43ad-89c1-2321434e200d\") " pod="llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-cvm9j" Jun 09 15:15:55.128001 ip-10-0-133-239 kubenswrapper[2576]: I0609 15:15:55.127958 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/1a2d71c3-3c4f-43ad-89c1-2321434e200d-home\") pod \"e2e-trlp-test-simulated-kserve-68bb6c58d9-cvm9j\" (UID: \"1a2d71c3-3c4f-43ad-89c1-2321434e200d\") " pod="llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-cvm9j" Jun 09 15:15:55.128125 ip-10-0-133-239 kubenswrapper[2576]: I0609 15:15:55.128084 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/1a2d71c3-3c4f-43ad-89c1-2321434e200d-kserve-provision-location\") pod \"e2e-trlp-test-simulated-kserve-68bb6c58d9-cvm9j\" (UID: \"1a2d71c3-3c4f-43ad-89c1-2321434e200d\") " pod="llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-cvm9j" Jun 09 15:15:55.128180 ip-10-0-133-239 kubenswrapper[2576]: I0609 15:15:55.128123 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/1a2d71c3-3c4f-43ad-89c1-2321434e200d-model-cache\") pod \"e2e-trlp-test-simulated-kserve-68bb6c58d9-cvm9j\" (UID: \"1a2d71c3-3c4f-43ad-89c1-2321434e200d\") " pod="llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-cvm9j" Jun 09 15:15:55.129736 ip-10-0-133-239 kubenswrapper[2576]: I0609 15:15:55.129714 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/1a2d71c3-3c4f-43ad-89c1-2321434e200d-dshm\") pod \"e2e-trlp-test-simulated-kserve-68bb6c58d9-cvm9j\" (UID: \"1a2d71c3-3c4f-43ad-89c1-2321434e200d\") " pod="llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-cvm9j" Jun 09 15:15:55.130025 ip-10-0-133-239 kubenswrapper[2576]: I0609 15:15:55.129999 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/1a2d71c3-3c4f-43ad-89c1-2321434e200d-tls-certs\") pod \"e2e-trlp-test-simulated-kserve-68bb6c58d9-cvm9j\" (UID: \"1a2d71c3-3c4f-43ad-89c1-2321434e200d\") " pod="llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-cvm9j" Jun 09 15:15:55.137648 ip-10-0-133-239 kubenswrapper[2576]: I0609 15:15:55.137628 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-76j9k\" (UniqueName: \"kubernetes.io/projected/1a2d71c3-3c4f-43ad-89c1-2321434e200d-kube-api-access-76j9k\") pod \"e2e-trlp-test-simulated-kserve-68bb6c58d9-cvm9j\" (UID: \"1a2d71c3-3c4f-43ad-89c1-2321434e200d\") " pod="llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-cvm9j" Jun 09 15:15:55.281800 ip-10-0-133-239 kubenswrapper[2576]: I0609 15:15:55.281763 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-cvm9j" Jun 09 15:15:55.423753 ip-10-0-133-239 kubenswrapper[2576]: I0609 15:15:55.423726 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-cvm9j"] Jun 09 15:15:55.424733 ip-10-0-133-239 kubenswrapper[2576]: W0609 15:15:55.424711 2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1a2d71c3_3c4f_43ad_89c1_2321434e200d.slice/crio-6ba64d8c2d99342c16135bce7aa99c3f4a0d085f9e2c930ee7f5f19a297cfe43 WatchSource:0}: Error finding container 6ba64d8c2d99342c16135bce7aa99c3f4a0d085f9e2c930ee7f5f19a297cfe43: Status 404 returned error can't find the container with id 6ba64d8c2d99342c16135bce7aa99c3f4a0d085f9e2c930ee7f5f19a297cfe43 Jun 09 15:15:55.746486 ip-10-0-133-239 kubenswrapper[2576]: I0609 15:15:55.746386 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-cvm9j" event={"ID":"1a2d71c3-3c4f-43ad-89c1-2321434e200d","Type":"ContainerStarted","Data":"06ea765568f654049ac3f25385162938b481cfc945df715ce8ee04a036565015"} Jun 09 15:15:55.746486 ip-10-0-133-239 kubenswrapper[2576]: I0609 15:15:55.746469 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-cvm9j" event={"ID":"1a2d71c3-3c4f-43ad-89c1-2321434e200d","Type":"ContainerStarted","Data":"6ba64d8c2d99342c16135bce7aa99c3f4a0d085f9e2c930ee7f5f19a297cfe43"} Jun 09 15:16:06.653617 ip-10-0-133-239 kubenswrapper[2576]: I0609 15:16:06.653540 2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477c86nvv"] Jun 09 15:16:06.670914 ip-10-0-133-239 kubenswrapper[2576]: I0609 15:16:06.670888 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477c86nvv" Jun 09 15:16:06.672801 ip-10-0-133-239 kubenswrapper[2576]: I0609 15:16:06.672768 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477c86nvv"] Jun 09 15:16:06.673336 ip-10-0-133-239 kubenswrapper[2576]: I0609 15:16:06.673315 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"e2e-unab60ef4d3a239b5143b412cab04acac3-kserve-self-signed-certs\"" Jun 09 15:16:06.727948 ip-10-0-133-239 kubenswrapper[2576]: I0609 15:16:06.727918 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/845649db-bd22-4d8c-a4a9-e1e5fc5fc2b7-kserve-provision-location\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477c86nvv\" (UID: \"845649db-bd22-4d8c-a4a9-e1e5fc5fc2b7\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477c86nvv" Jun 09 15:16:06.728112 ip-10-0-133-239 kubenswrapper[2576]: I0609 15:16:06.727976 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/845649db-bd22-4d8c-a4a9-e1e5fc5fc2b7-model-cache\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477c86nvv\" (UID: \"845649db-bd22-4d8c-a4a9-e1e5fc5fc2b7\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477c86nvv" Jun 09 15:16:06.728112 ip-10-0-133-239 kubenswrapper[2576]: I0609 15:16:06.728049 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/845649db-bd22-4d8c-a4a9-e1e5fc5fc2b7-dshm\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477c86nvv\" (UID: \"845649db-bd22-4d8c-a4a9-e1e5fc5fc2b7\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477c86nvv" Jun 09 15:16:06.728274 ip-10-0-133-239 kubenswrapper[2576]: I0609 15:16:06.728118 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/845649db-bd22-4d8c-a4a9-e1e5fc5fc2b7-home\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477c86nvv\" (UID: \"845649db-bd22-4d8c-a4a9-e1e5fc5fc2b7\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477c86nvv" Jun 09 15:16:06.728274 ip-10-0-133-239 kubenswrapper[2576]: I0609 15:16:06.728203 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xg675\" (UniqueName: \"kubernetes.io/projected/845649db-bd22-4d8c-a4a9-e1e5fc5fc2b7-kube-api-access-xg675\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477c86nvv\" (UID: \"845649db-bd22-4d8c-a4a9-e1e5fc5fc2b7\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477c86nvv" Jun 09 15:16:06.728379 ip-10-0-133-239 kubenswrapper[2576]: I0609 15:16:06.728276 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/845649db-bd22-4d8c-a4a9-e1e5fc5fc2b7-tls-certs\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477c86nvv\" (UID: \"845649db-bd22-4d8c-a4a9-e1e5fc5fc2b7\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477c86nvv" Jun 09 15:16:06.829398 ip-10-0-133-239 kubenswrapper[2576]: I0609 15:16:06.829370 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/845649db-bd22-4d8c-a4a9-e1e5fc5fc2b7-kserve-provision-location\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477c86nvv\" (UID: \"845649db-bd22-4d8c-a4a9-e1e5fc5fc2b7\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477c86nvv" Jun 09 15:16:06.829585 ip-10-0-133-239 kubenswrapper[2576]: I0609 15:16:06.829423 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/845649db-bd22-4d8c-a4a9-e1e5fc5fc2b7-model-cache\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477c86nvv\" (UID: \"845649db-bd22-4d8c-a4a9-e1e5fc5fc2b7\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477c86nvv" Jun 09 15:16:06.829585 ip-10-0-133-239 kubenswrapper[2576]: I0609 15:16:06.829466 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/845649db-bd22-4d8c-a4a9-e1e5fc5fc2b7-dshm\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477c86nvv\" (UID: \"845649db-bd22-4d8c-a4a9-e1e5fc5fc2b7\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477c86nvv" Jun 09 15:16:06.829585 ip-10-0-133-239 kubenswrapper[2576]: I0609 15:16:06.829504 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/845649db-bd22-4d8c-a4a9-e1e5fc5fc2b7-home\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477c86nvv\" (UID: \"845649db-bd22-4d8c-a4a9-e1e5fc5fc2b7\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477c86nvv" Jun 09 15:16:06.829822 ip-10-0-133-239 kubenswrapper[2576]: I0609 15:16:06.829647 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xg675\" (UniqueName: \"kubernetes.io/projected/845649db-bd22-4d8c-a4a9-e1e5fc5fc2b7-kube-api-access-xg675\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477c86nvv\" (UID: \"845649db-bd22-4d8c-a4a9-e1e5fc5fc2b7\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477c86nvv" Jun 09 15:16:06.829975 ip-10-0-133-239 kubenswrapper[2576]: I0609 15:16:06.829936 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/845649db-bd22-4d8c-a4a9-e1e5fc5fc2b7-kserve-provision-location\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477c86nvv\" (UID: \"845649db-bd22-4d8c-a4a9-e1e5fc5fc2b7\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477c86nvv" Jun 09 15:16:06.830119 ip-10-0-133-239 kubenswrapper[2576]: I0609 15:16:06.830090 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/845649db-bd22-4d8c-a4a9-e1e5fc5fc2b7-tls-certs\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477c86nvv\" (UID: \"845649db-bd22-4d8c-a4a9-e1e5fc5fc2b7\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477c86nvv" Jun 09 15:16:06.830486 ip-10-0-133-239 kubenswrapper[2576]: I0609 15:16:06.830459 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/845649db-bd22-4d8c-a4a9-e1e5fc5fc2b7-model-cache\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477c86nvv\" (UID: \"845649db-bd22-4d8c-a4a9-e1e5fc5fc2b7\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477c86nvv" Jun 09 15:16:06.838042 ip-10-0-133-239 kubenswrapper[2576]: I0609 15:16:06.830732 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/845649db-bd22-4d8c-a4a9-e1e5fc5fc2b7-home\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477c86nvv\" (UID: \"845649db-bd22-4d8c-a4a9-e1e5fc5fc2b7\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477c86nvv" Jun 09 15:16:06.838042 ip-10-0-133-239 kubenswrapper[2576]: I0609 15:16:06.833209 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/845649db-bd22-4d8c-a4a9-e1e5fc5fc2b7-tls-certs\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477c86nvv\" (UID: \"845649db-bd22-4d8c-a4a9-e1e5fc5fc2b7\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477c86nvv" Jun 09 15:16:06.838042 ip-10-0-133-239 kubenswrapper[2576]: I0609 15:16:06.837090 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/845649db-bd22-4d8c-a4a9-e1e5fc5fc2b7-dshm\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477c86nvv\" (UID: \"845649db-bd22-4d8c-a4a9-e1e5fc5fc2b7\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477c86nvv" Jun 09 15:16:06.839803 ip-10-0-133-239 kubenswrapper[2576]: I0609 15:16:06.839782 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-xg675\" (UniqueName: \"kubernetes.io/projected/845649db-bd22-4d8c-a4a9-e1e5fc5fc2b7-kube-api-access-xg675\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477c86nvv\" (UID: \"845649db-bd22-4d8c-a4a9-e1e5fc5fc2b7\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477c86nvv" Jun 09 15:16:06.991580 ip-10-0-133-239 kubenswrapper[2576]: I0609 15:16:06.991497 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477c86nvv" Jun 09 15:16:07.123301 ip-10-0-133-239 kubenswrapper[2576]: I0609 15:16:07.123272 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477c86nvv"] Jun 09 15:16:07.123772 ip-10-0-133-239 kubenswrapper[2576]: W0609 15:16:07.123749 2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod845649db_bd22_4d8c_a4a9_e1e5fc5fc2b7.slice/crio-998740c1906ebcc20bbac38d927e06cfe7c79dfbee3d84aa1119478f4a9e8ee5 WatchSource:0}: Error finding container 998740c1906ebcc20bbac38d927e06cfe7c79dfbee3d84aa1119478f4a9e8ee5: Status 404 returned error can't find the container with id 998740c1906ebcc20bbac38d927e06cfe7c79dfbee3d84aa1119478f4a9e8ee5 Jun 09 15:16:07.814716 ip-10-0-133-239 kubenswrapper[2576]: I0609 15:16:07.814681 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477c86nvv" event={"ID":"845649db-bd22-4d8c-a4a9-e1e5fc5fc2b7","Type":"ContainerStarted","Data":"6b43dfbc73ed79dc449561754db2ea070f10e201ef66eed335117be9c1ba80c0"} Jun 09 15:16:07.815171 ip-10-0-133-239 kubenswrapper[2576]: I0609 15:16:07.814741 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477c86nvv" event={"ID":"845649db-bd22-4d8c-a4a9-e1e5fc5fc2b7","Type":"ContainerStarted","Data":"998740c1906ebcc20bbac38d927e06cfe7c79dfbee3d84aa1119478f4a9e8ee5"} Jun 09 15:16:32.646324 ip-10-0-133-239 kubenswrapper[2576]: I0609 15:16:32.646294 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-668fdbf85c-wmg5x_37922842-1a2e-44d7-861f-edca166e718b/console-operator/2.log" Jun 09 15:16:32.648320 ip-10-0-133-239 kubenswrapper[2576]: I0609 15:16:32.648300 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-668fdbf85c-wmg5x_37922842-1a2e-44d7-861f-edca166e718b/console-operator/2.log" Jun 09 15:16:32.652517 ip-10-0-133-239 kubenswrapper[2576]: I0609 15:16:32.652497 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-n4c97_441b2a74-d62c-4e3c-9e0f-b133cd4364be/ovn-acl-logging/0.log" Jun 09 15:16:32.654837 ip-10-0-133-239 kubenswrapper[2576]: I0609 15:16:32.654821 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-n4c97_441b2a74-d62c-4e3c-9e0f-b133cd4364be/ovn-acl-logging/0.log" Jun 09 15:16:47.031820 ip-10-0-133-239 kubenswrapper[2576]: I0609 15:16:47.031785 2576 generic.go:356] "Generic (PLEG): container finished" podID="1a2d71c3-3c4f-43ad-89c1-2321434e200d" containerID="06ea765568f654049ac3f25385162938b481cfc945df715ce8ee04a036565015" exitCode=0 Jun 09 15:16:47.032223 ip-10-0-133-239 kubenswrapper[2576]: I0609 15:16:47.031857 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-cvm9j" event={"ID":"1a2d71c3-3c4f-43ad-89c1-2321434e200d","Type":"ContainerDied","Data":"06ea765568f654049ac3f25385162938b481cfc945df715ce8ee04a036565015"} Jun 09 15:16:48.038830 ip-10-0-133-239 kubenswrapper[2576]: I0609 15:16:48.038798 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-cvm9j" event={"ID":"1a2d71c3-3c4f-43ad-89c1-2321434e200d","Type":"ContainerStarted","Data":"10ff313716959d6f39dd9b7ac63a30c64c09736dc1d73f35ad3415f0f93f467e"} Jun 09 15:16:48.061630 ip-10-0-133-239 kubenswrapper[2576]: I0609 15:16:48.061374 2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-cvm9j" podStartSLOduration=2.329899093 podStartE2EDuration="54.06135518s" totalImagesPullingTime="289.772653ms" totalInitContainerRuntime="51.441683434s" isStatefulPod=false podCreationTimestamp="2026-06-09 15:15:54 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-09 15:16:48.060712945 +0000 UTC m=+922.914869207" watchObservedRunningTime="2026-06-09 15:16:48.06135518 +0000 UTC m=+922.915511420" Jun 09 15:16:55.281888 ip-10-0-133-239 kubenswrapper[2576]: I0609 15:16:55.281849 2576 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-cvm9j" Jun 09 15:16:55.282308 ip-10-0-133-239 kubenswrapper[2576]: I0609 15:16:55.281976 2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-cvm9j" Jun 09 15:16:55.294257 ip-10-0-133-239 kubenswrapper[2576]: I0609 15:16:55.294238 2576 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-cvm9j" Jun 09 15:16:56.094041 ip-10-0-133-239 kubenswrapper[2576]: I0609 15:16:56.094013 2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-cvm9j" Jun 09 15:17:29.337715 ip-10-0-133-239 kubenswrapper[2576]: I0609 15:17:29.337675 2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-6867455b8-2nnrl"] Jun 09 15:17:29.341266 ip-10-0-133-239 kubenswrapper[2576]: I0609 15:17:29.341247 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-6867455b8-2nnrl" Jun 09 15:17:29.349807 ip-10-0-133-239 kubenswrapper[2576]: I0609 15:17:29.349783 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-6867455b8-2nnrl"] Jun 09 15:17:29.368894 ip-10-0-133-239 kubenswrapper[2576]: I0609 15:17:29.368867 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/0d083dd1-bbb2-463b-896d-b204d372bb81-tls-cert\") pod \"authorino-6867455b8-2nnrl\" (UID: \"0d083dd1-bbb2-463b-896d-b204d372bb81\") " pod="kuadrant-system/authorino-6867455b8-2nnrl" Jun 09 15:17:29.368894 ip-10-0-133-239 kubenswrapper[2576]: I0609 15:17:29.368895 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9nc9s\" (UniqueName: \"kubernetes.io/projected/0d083dd1-bbb2-463b-896d-b204d372bb81-kube-api-access-9nc9s\") pod \"authorino-6867455b8-2nnrl\" (UID: \"0d083dd1-bbb2-463b-896d-b204d372bb81\") " pod="kuadrant-system/authorino-6867455b8-2nnrl" Jun 09 15:17:29.369054 ip-10-0-133-239 kubenswrapper[2576]: I0609 15:17:29.368950 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oidc-ca\" (UniqueName: \"kubernetes.io/configmap/0d083dd1-bbb2-463b-896d-b204d372bb81-oidc-ca\") pod \"authorino-6867455b8-2nnrl\" (UID: \"0d083dd1-bbb2-463b-896d-b204d372bb81\") " pod="kuadrant-system/authorino-6867455b8-2nnrl" Jun 09 15:17:29.469875 ip-10-0-133-239 kubenswrapper[2576]: I0609 15:17:29.469835 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oidc-ca\" (UniqueName: \"kubernetes.io/configmap/0d083dd1-bbb2-463b-896d-b204d372bb81-oidc-ca\") pod \"authorino-6867455b8-2nnrl\" (UID: \"0d083dd1-bbb2-463b-896d-b204d372bb81\") " pod="kuadrant-system/authorino-6867455b8-2nnrl" Jun 09 15:17:29.470031 ip-10-0-133-239 kubenswrapper[2576]: I0609 15:17:29.469918 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/0d083dd1-bbb2-463b-896d-b204d372bb81-tls-cert\") pod \"authorino-6867455b8-2nnrl\" (UID: \"0d083dd1-bbb2-463b-896d-b204d372bb81\") " pod="kuadrant-system/authorino-6867455b8-2nnrl" Jun 09 15:17:29.470031 ip-10-0-133-239 kubenswrapper[2576]: I0609 15:17:29.469935 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9nc9s\" (UniqueName: \"kubernetes.io/projected/0d083dd1-bbb2-463b-896d-b204d372bb81-kube-api-access-9nc9s\") pod \"authorino-6867455b8-2nnrl\" (UID: \"0d083dd1-bbb2-463b-896d-b204d372bb81\") " pod="kuadrant-system/authorino-6867455b8-2nnrl" Jun 09 15:17:29.470510 ip-10-0-133-239 kubenswrapper[2576]: I0609 15:17:29.470493 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"oidc-ca\" (UniqueName: \"kubernetes.io/configmap/0d083dd1-bbb2-463b-896d-b204d372bb81-oidc-ca\") pod \"authorino-6867455b8-2nnrl\" (UID: \"0d083dd1-bbb2-463b-896d-b204d372bb81\") " pod="kuadrant-system/authorino-6867455b8-2nnrl" Jun 09 15:17:29.472420 ip-10-0-133-239 kubenswrapper[2576]: I0609 15:17:29.472399 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/0d083dd1-bbb2-463b-896d-b204d372bb81-tls-cert\") pod \"authorino-6867455b8-2nnrl\" (UID: \"0d083dd1-bbb2-463b-896d-b204d372bb81\") " pod="kuadrant-system/authorino-6867455b8-2nnrl" Jun 09 15:17:29.480600 ip-10-0-133-239 kubenswrapper[2576]: I0609 15:17:29.480571 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-9nc9s\" (UniqueName: \"kubernetes.io/projected/0d083dd1-bbb2-463b-896d-b204d372bb81-kube-api-access-9nc9s\") pod \"authorino-6867455b8-2nnrl\" (UID: \"0d083dd1-bbb2-463b-896d-b204d372bb81\") " pod="kuadrant-system/authorino-6867455b8-2nnrl" Jun 09 15:17:29.652013 ip-10-0-133-239 kubenswrapper[2576]: I0609 15:17:29.651939 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-6867455b8-2nnrl" Jun 09 15:17:29.785392 ip-10-0-133-239 kubenswrapper[2576]: I0609 15:17:29.785368 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-6867455b8-2nnrl"] Jun 09 15:17:29.787351 ip-10-0-133-239 kubenswrapper[2576]: W0609 15:17:29.787317 2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod0d083dd1_bbb2_463b_896d_b204d372bb81.slice/crio-06796e750562a27e91d4207d3bcfe1eb195a86f088b3af8dda8b05bc6f48f653 WatchSource:0}: Error finding container 06796e750562a27e91d4207d3bcfe1eb195a86f088b3af8dda8b05bc6f48f653: Status 404 returned error can't find the container with id 06796e750562a27e91d4207d3bcfe1eb195a86f088b3af8dda8b05bc6f48f653 Jun 09 15:17:30.273266 ip-10-0-133-239 kubenswrapper[2576]: I0609 15:17:30.273238 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-6867455b8-2nnrl" event={"ID":"0d083dd1-bbb2-463b-896d-b204d372bb81","Type":"ContainerStarted","Data":"06796e750562a27e91d4207d3bcfe1eb195a86f088b3af8dda8b05bc6f48f653"} Jun 09 15:17:31.280332 ip-10-0-133-239 kubenswrapper[2576]: I0609 15:17:31.280298 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-6867455b8-2nnrl" event={"ID":"0d083dd1-bbb2-463b-896d-b204d372bb81","Type":"ContainerStarted","Data":"ae83c141370436eaf56056e2429b7c703f8349e52a4430d12cda97f61d8f2412"} Jun 09 15:17:31.301524 ip-10-0-133-239 kubenswrapper[2576]: I0609 15:17:31.301472 2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/authorino-6867455b8-2nnrl" podStartSLOduration=1.876307863 podStartE2EDuration="2.301457434s" totalImagesPullingTime="425.149571ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-09 15:17:29 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-09 15:17:31.299752718 +0000 UTC m=+966.153908959" watchObservedRunningTime="2026-06-09 15:17:31.301457434 +0000 UTC m=+966.155613696" Jun 09 15:17:31.336832 ip-10-0-133-239 kubenswrapper[2576]: I0609 15:17:31.336800 2576 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-7586b4b9b5-2js8z"] Jun 09 15:17:31.337045 ip-10-0-133-239 kubenswrapper[2576]: I0609 15:17:31.337022 2576 kuberuntime_container.go:872] "Killing container with a grace period" pod="kuadrant-system/authorino-7586b4b9b5-2js8z" podUID="477adaba-5d68-445a-9dda-f7ff70254419" containerName="authorino" containerID="cri-o://02103f4a6d48e7e1e791ad8ef0c71b8a1588964bd2f5b962d4cda8058ea66f81" gracePeriod=30 Jun 09 15:17:31.594244 ip-10-0-133-239 kubenswrapper[2576]: I0609 15:17:31.594220 2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-7586b4b9b5-2js8z" Jun 09 15:17:31.692052 ip-10-0-133-239 kubenswrapper[2576]: I0609 15:17:31.692021 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"oidc-ca\" (UniqueName: \"kubernetes.io/configmap/477adaba-5d68-445a-9dda-f7ff70254419-oidc-ca\") pod \"477adaba-5d68-445a-9dda-f7ff70254419\" (UID: \"477adaba-5d68-445a-9dda-f7ff70254419\") " Jun 09 15:17:31.692052 ip-10-0-133-239 kubenswrapper[2576]: I0609 15:17:31.692054 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/477adaba-5d68-445a-9dda-f7ff70254419-tls-cert\") pod \"477adaba-5d68-445a-9dda-f7ff70254419\" (UID: \"477adaba-5d68-445a-9dda-f7ff70254419\") " Jun 09 15:17:31.692307 ip-10-0-133-239 kubenswrapper[2576]: I0609 15:17:31.692153 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-gn47x\" (UniqueName: \"kubernetes.io/projected/477adaba-5d68-445a-9dda-f7ff70254419-kube-api-access-gn47x\") pod \"477adaba-5d68-445a-9dda-f7ff70254419\" (UID: \"477adaba-5d68-445a-9dda-f7ff70254419\") " Jun 09 15:17:31.694545 ip-10-0-133-239 kubenswrapper[2576]: I0609 15:17:31.694523 2576 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/477adaba-5d68-445a-9dda-f7ff70254419-kube-api-access-gn47x" (OuterVolumeSpecName: "kube-api-access-gn47x") pod "477adaba-5d68-445a-9dda-f7ff70254419" (UID: "477adaba-5d68-445a-9dda-f7ff70254419"). InnerVolumeSpecName "kube-api-access-gn47x". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 09 15:17:31.697004 ip-10-0-133-239 kubenswrapper[2576]: I0609 15:17:31.696979 2576 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/477adaba-5d68-445a-9dda-f7ff70254419-oidc-ca" (OuterVolumeSpecName: "oidc-ca") pod "477adaba-5d68-445a-9dda-f7ff70254419" (UID: "477adaba-5d68-445a-9dda-f7ff70254419"). InnerVolumeSpecName "oidc-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 09 15:17:31.702288 ip-10-0-133-239 kubenswrapper[2576]: I0609 15:17:31.702265 2576 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/477adaba-5d68-445a-9dda-f7ff70254419-tls-cert" (OuterVolumeSpecName: "tls-cert") pod "477adaba-5d68-445a-9dda-f7ff70254419" (UID: "477adaba-5d68-445a-9dda-f7ff70254419"). InnerVolumeSpecName "tls-cert". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 09 15:17:31.793176 ip-10-0-133-239 kubenswrapper[2576]: I0609 15:17:31.793146 2576 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-gn47x\" (UniqueName: \"kubernetes.io/projected/477adaba-5d68-445a-9dda-f7ff70254419-kube-api-access-gn47x\") on node \"ip-10-0-133-239.ec2.internal\" DevicePath \"\"" Jun 09 15:17:31.793176 ip-10-0-133-239 kubenswrapper[2576]: I0609 15:17:31.793169 2576 reconciler_common.go:299] "Volume detached for volume \"oidc-ca\" (UniqueName: \"kubernetes.io/configmap/477adaba-5d68-445a-9dda-f7ff70254419-oidc-ca\") on node \"ip-10-0-133-239.ec2.internal\" DevicePath \"\"" Jun 09 15:17:31.793176 ip-10-0-133-239 kubenswrapper[2576]: I0609 15:17:31.793179 2576 reconciler_common.go:299] "Volume detached for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/477adaba-5d68-445a-9dda-f7ff70254419-tls-cert\") on node \"ip-10-0-133-239.ec2.internal\" DevicePath \"\"" Jun 09 15:17:32.287088 ip-10-0-133-239 kubenswrapper[2576]: I0609 15:17:32.287033 2576 generic.go:356] "Generic (PLEG): container finished" podID="477adaba-5d68-445a-9dda-f7ff70254419" containerID="02103f4a6d48e7e1e791ad8ef0c71b8a1588964bd2f5b962d4cda8058ea66f81" exitCode=0 Jun 09 15:17:32.287501 ip-10-0-133-239 kubenswrapper[2576]: I0609 15:17:32.287108 2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-7586b4b9b5-2js8z" Jun 09 15:17:32.287501 ip-10-0-133-239 kubenswrapper[2576]: I0609 15:17:32.287117 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-7586b4b9b5-2js8z" event={"ID":"477adaba-5d68-445a-9dda-f7ff70254419","Type":"ContainerDied","Data":"02103f4a6d48e7e1e791ad8ef0c71b8a1588964bd2f5b962d4cda8058ea66f81"} Jun 09 15:17:32.287501 ip-10-0-133-239 kubenswrapper[2576]: I0609 15:17:32.287162 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-7586b4b9b5-2js8z" event={"ID":"477adaba-5d68-445a-9dda-f7ff70254419","Type":"ContainerDied","Data":"87a515c5fab72c5ce10344de2fb812bc84b89548489777dea3d24a271b9e305d"} Jun 09 15:17:32.287501 ip-10-0-133-239 kubenswrapper[2576]: I0609 15:17:32.287186 2576 scope.go:117] "RemoveContainer" containerID="02103f4a6d48e7e1e791ad8ef0c71b8a1588964bd2f5b962d4cda8058ea66f81" Jun 09 15:17:32.297126 ip-10-0-133-239 kubenswrapper[2576]: I0609 15:17:32.297109 2576 scope.go:117] "RemoveContainer" containerID="02103f4a6d48e7e1e791ad8ef0c71b8a1588964bd2f5b962d4cda8058ea66f81" Jun 09 15:17:32.297363 ip-10-0-133-239 kubenswrapper[2576]: E0609 15:17:32.297345 2576 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"02103f4a6d48e7e1e791ad8ef0c71b8a1588964bd2f5b962d4cda8058ea66f81\": container with ID starting with 02103f4a6d48e7e1e791ad8ef0c71b8a1588964bd2f5b962d4cda8058ea66f81 not found: ID does not exist" containerID="02103f4a6d48e7e1e791ad8ef0c71b8a1588964bd2f5b962d4cda8058ea66f81" Jun 09 15:17:32.297422 ip-10-0-133-239 kubenswrapper[2576]: I0609 15:17:32.297371 2576 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"02103f4a6d48e7e1e791ad8ef0c71b8a1588964bd2f5b962d4cda8058ea66f81"} err="failed to get container status \"02103f4a6d48e7e1e791ad8ef0c71b8a1588964bd2f5b962d4cda8058ea66f81\": rpc error: code = NotFound desc = could not find container \"02103f4a6d48e7e1e791ad8ef0c71b8a1588964bd2f5b962d4cda8058ea66f81\": container with ID starting with 02103f4a6d48e7e1e791ad8ef0c71b8a1588964bd2f5b962d4cda8058ea66f81 not found: ID does not exist" Jun 09 15:17:32.315890 ip-10-0-133-239 kubenswrapper[2576]: I0609 15:17:32.315826 2576 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-7586b4b9b5-2js8z"] Jun 09 15:17:32.315890 ip-10-0-133-239 kubenswrapper[2576]: I0609 15:17:32.315885 2576 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/authorino-7586b4b9b5-2js8z"] Jun 09 15:17:33.604790 ip-10-0-133-239 kubenswrapper[2576]: I0609 15:17:33.604759 2576 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="477adaba-5d68-445a-9dda-f7ff70254419" path="/var/lib/kubelet/pods/477adaba-5d68-445a-9dda-f7ff70254419/volumes" Jun 09 15:18:43.685486 ip-10-0-133-239 kubenswrapper[2576]: I0609 15:18:43.685454 2576 generic.go:356] "Generic (PLEG): container finished" podID="845649db-bd22-4d8c-a4a9-e1e5fc5fc2b7" containerID="6b43dfbc73ed79dc449561754db2ea070f10e201ef66eed335117be9c1ba80c0" exitCode=0 Jun 09 15:18:43.685883 ip-10-0-133-239 kubenswrapper[2576]: I0609 15:18:43.685527 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477c86nvv" event={"ID":"845649db-bd22-4d8c-a4a9-e1e5fc5fc2b7","Type":"ContainerDied","Data":"6b43dfbc73ed79dc449561754db2ea070f10e201ef66eed335117be9c1ba80c0"} Jun 09 15:18:43.686122 ip-10-0-133-239 kubenswrapper[2576]: I0609 15:18:43.686109 2576 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jun 09 15:18:44.693408 ip-10-0-133-239 kubenswrapper[2576]: I0609 15:18:44.693378 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477c86nvv" event={"ID":"845649db-bd22-4d8c-a4a9-e1e5fc5fc2b7","Type":"ContainerStarted","Data":"408cd3929deb1d5ccc153230d6679c7f220936953ec8573b9d55143145b8276d"} Jun 09 15:18:44.718015 ip-10-0-133-239 kubenswrapper[2576]: I0609 15:18:44.717973 2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477c86nvv" podStartSLOduration=2.120006789 podStartE2EDuration="2m38.717958404s" totalImagesPullingTime="294.717651ms" totalInitContainerRuntime="2m36.303233964s" isStatefulPod=false podCreationTimestamp="2026-06-09 15:16:06 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-09 15:18:44.714492226 +0000 UTC m=+1039.568648465" watchObservedRunningTime="2026-06-09 15:18:44.717958404 +0000 UTC m=+1039.572114643" Jun 09 15:18:46.991849 ip-10-0-133-239 kubenswrapper[2576]: I0609 15:18:46.991810 2576 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477c86nvv" Jun 09 15:18:46.992347 ip-10-0-133-239 kubenswrapper[2576]: I0609 15:18:46.991877 2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477c86nvv" Jun 09 15:18:47.004563 ip-10-0-133-239 kubenswrapper[2576]: I0609 15:18:47.004536 2576 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477c86nvv" Jun 09 15:18:47.720206 ip-10-0-133-239 kubenswrapper[2576]: I0609 15:18:47.720179 2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477c86nvv" Jun 09 15:20:53.258120 ip-10-0-133-239 kubenswrapper[2576]: I0609 15:20:53.258083 2576 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-controller-6968d6768f-v8cpj"] Jun 09 15:20:53.258611 ip-10-0-133-239 kubenswrapper[2576]: I0609 15:20:53.258273 2576 kuberuntime_container.go:872] "Killing container with a grace period" pod="opendatahub/maas-controller-6968d6768f-v8cpj" podUID="72b56109-3d7c-4d5d-8e8b-d1c301c4bc53" containerName="manager" containerID="cri-o://679320ce61fa2d3e2edc4b6add9ba99317893cdc2ac83f63e594e56d0c4f6aab" gracePeriod=30 Jun 09 15:20:53.419357 ip-10-0-133-239 kubenswrapper[2576]: I0609 15:20:53.419327 2576 generic.go:356] "Generic (PLEG): container finished" podID="72b56109-3d7c-4d5d-8e8b-d1c301c4bc53" containerID="679320ce61fa2d3e2edc4b6add9ba99317893cdc2ac83f63e594e56d0c4f6aab" exitCode=0 Jun 09 15:20:53.419526 ip-10-0-133-239 kubenswrapper[2576]: I0609 15:20:53.419399 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-6968d6768f-v8cpj" event={"ID":"72b56109-3d7c-4d5d-8e8b-d1c301c4bc53","Type":"ContainerDied","Data":"679320ce61fa2d3e2edc4b6add9ba99317893cdc2ac83f63e594e56d0c4f6aab"} Jun 09 15:20:53.512184 ip-10-0-133-239 kubenswrapper[2576]: I0609 15:20:53.512125 2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-6968d6768f-v8cpj" Jun 09 15:20:53.638989 ip-10-0-133-239 kubenswrapper[2576]: I0609 15:20:53.638959 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/72b56109-3d7c-4d5d-8e8b-d1c301c4bc53-webhook-cert\") pod \"72b56109-3d7c-4d5d-8e8b-d1c301c4bc53\" (UID: \"72b56109-3d7c-4d5d-8e8b-d1c301c4bc53\") " Jun 09 15:20:53.639159 ip-10-0-133-239 kubenswrapper[2576]: I0609 15:20:53.639022 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-rl2hd\" (UniqueName: \"kubernetes.io/projected/72b56109-3d7c-4d5d-8e8b-d1c301c4bc53-kube-api-access-rl2hd\") pod \"72b56109-3d7c-4d5d-8e8b-d1c301c4bc53\" (UID: \"72b56109-3d7c-4d5d-8e8b-d1c301c4bc53\") " Jun 09 15:20:53.641100 ip-10-0-133-239 kubenswrapper[2576]: I0609 15:20:53.641044 2576 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/72b56109-3d7c-4d5d-8e8b-d1c301c4bc53-kube-api-access-rl2hd" (OuterVolumeSpecName: "kube-api-access-rl2hd") pod "72b56109-3d7c-4d5d-8e8b-d1c301c4bc53" (UID: "72b56109-3d7c-4d5d-8e8b-d1c301c4bc53"). InnerVolumeSpecName "kube-api-access-rl2hd". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 09 15:20:53.641100 ip-10-0-133-239 kubenswrapper[2576]: I0609 15:20:53.641060 2576 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/72b56109-3d7c-4d5d-8e8b-d1c301c4bc53-webhook-cert" (OuterVolumeSpecName: "webhook-cert") pod "72b56109-3d7c-4d5d-8e8b-d1c301c4bc53" (UID: "72b56109-3d7c-4d5d-8e8b-d1c301c4bc53"). InnerVolumeSpecName "webhook-cert". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 09 15:20:53.739949 ip-10-0-133-239 kubenswrapper[2576]: I0609 15:20:53.739918 2576 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-rl2hd\" (UniqueName: \"kubernetes.io/projected/72b56109-3d7c-4d5d-8e8b-d1c301c4bc53-kube-api-access-rl2hd\") on node \"ip-10-0-133-239.ec2.internal\" DevicePath \"\"" Jun 09 15:20:53.739949 ip-10-0-133-239 kubenswrapper[2576]: I0609 15:20:53.739945 2576 reconciler_common.go:299] "Volume detached for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/72b56109-3d7c-4d5d-8e8b-d1c301c4bc53-webhook-cert\") on node \"ip-10-0-133-239.ec2.internal\" DevicePath \"\"" Jun 09 15:20:54.426906 ip-10-0-133-239 kubenswrapper[2576]: I0609 15:20:54.426877 2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-6968d6768f-v8cpj" Jun 09 15:20:54.427314 ip-10-0-133-239 kubenswrapper[2576]: I0609 15:20:54.426924 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-6968d6768f-v8cpj" event={"ID":"72b56109-3d7c-4d5d-8e8b-d1c301c4bc53","Type":"ContainerDied","Data":"70d2b4774b075ea78cca73cb890056d9c10fe51c4af91a975388f1787b9e1059"} Jun 09 15:20:54.428626 ip-10-0-133-239 kubenswrapper[2576]: I0609 15:20:54.426983 2576 scope.go:117] "RemoveContainer" containerID="679320ce61fa2d3e2edc4b6add9ba99317893cdc2ac83f63e594e56d0c4f6aab" Jun 09 15:20:54.453842 ip-10-0-133-239 kubenswrapper[2576]: I0609 15:20:54.453805 2576 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-controller-6968d6768f-v8cpj"] Jun 09 15:20:54.459485 ip-10-0-133-239 kubenswrapper[2576]: I0609 15:20:54.459455 2576 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/maas-controller-6968d6768f-v8cpj"] Jun 09 15:20:55.221471 ip-10-0-133-239 kubenswrapper[2576]: I0609 15:20:55.221432 2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/maas-controller-6968d6768f-sgs8q"] Jun 09 15:20:55.221924 ip-10-0-133-239 kubenswrapper[2576]: I0609 15:20:55.221907 2576 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="477adaba-5d68-445a-9dda-f7ff70254419" containerName="authorino" Jun 09 15:20:55.221991 ip-10-0-133-239 kubenswrapper[2576]: I0609 15:20:55.221926 2576 state_mem.go:107] "Deleted CPUSet assignment" podUID="477adaba-5d68-445a-9dda-f7ff70254419" containerName="authorino" Jun 09 15:20:55.221991 ip-10-0-133-239 kubenswrapper[2576]: I0609 15:20:55.221943 2576 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="72b56109-3d7c-4d5d-8e8b-d1c301c4bc53" containerName="manager" Jun 09 15:20:55.221991 ip-10-0-133-239 kubenswrapper[2576]: I0609 15:20:55.221949 2576 state_mem.go:107] "Deleted CPUSet assignment" podUID="72b56109-3d7c-4d5d-8e8b-d1c301c4bc53" containerName="manager" Jun 09 15:20:55.222108 ip-10-0-133-239 kubenswrapper[2576]: I0609 15:20:55.222031 2576 memory_manager.go:368] "RemoveStaleState removing state" podUID="72b56109-3d7c-4d5d-8e8b-d1c301c4bc53" containerName="manager" Jun 09 15:20:55.222108 ip-10-0-133-239 kubenswrapper[2576]: I0609 15:20:55.222040 2576 memory_manager.go:368] "RemoveStaleState removing state" podUID="477adaba-5d68-445a-9dda-f7ff70254419" containerName="authorino" Jun 09 15:20:55.226176 ip-10-0-133-239 kubenswrapper[2576]: I0609 15:20:55.226158 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-6968d6768f-sgs8q" Jun 09 15:20:55.228622 ip-10-0-133-239 kubenswrapper[2576]: I0609 15:20:55.228596 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"maas-parameters\"" Jun 09 15:20:55.229600 ip-10-0-133-239 kubenswrapper[2576]: I0609 15:20:55.229582 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-controller-dockercfg-nfbkm\"" Jun 09 15:20:55.229698 ip-10-0-133-239 kubenswrapper[2576]: I0609 15:20:55.229589 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-controller-webhook-cert\"" Jun 09 15:20:55.238164 ip-10-0-133-239 kubenswrapper[2576]: I0609 15:20:55.238141 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-6968d6768f-sgs8q"] Jun 09 15:20:55.356085 ip-10-0-133-239 kubenswrapper[2576]: I0609 15:20:55.356028 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/4499a964-ae76-46b0-9572-f62a795b225c-webhook-cert\") pod \"maas-controller-6968d6768f-sgs8q\" (UID: \"4499a964-ae76-46b0-9572-f62a795b225c\") " pod="opendatahub/maas-controller-6968d6768f-sgs8q" Jun 09 15:20:55.356262 ip-10-0-133-239 kubenswrapper[2576]: I0609 15:20:55.356174 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jjcxh\" (UniqueName: \"kubernetes.io/projected/4499a964-ae76-46b0-9572-f62a795b225c-kube-api-access-jjcxh\") pod \"maas-controller-6968d6768f-sgs8q\" (UID: \"4499a964-ae76-46b0-9572-f62a795b225c\") " pod="opendatahub/maas-controller-6968d6768f-sgs8q" Jun 09 15:20:55.457137 ip-10-0-133-239 kubenswrapper[2576]: I0609 15:20:55.457102 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/4499a964-ae76-46b0-9572-f62a795b225c-webhook-cert\") pod \"maas-controller-6968d6768f-sgs8q\" (UID: \"4499a964-ae76-46b0-9572-f62a795b225c\") " pod="opendatahub/maas-controller-6968d6768f-sgs8q" Jun 09 15:20:55.457517 ip-10-0-133-239 kubenswrapper[2576]: I0609 15:20:55.457192 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jjcxh\" (UniqueName: \"kubernetes.io/projected/4499a964-ae76-46b0-9572-f62a795b225c-kube-api-access-jjcxh\") pod \"maas-controller-6968d6768f-sgs8q\" (UID: \"4499a964-ae76-46b0-9572-f62a795b225c\") " pod="opendatahub/maas-controller-6968d6768f-sgs8q" Jun 09 15:20:55.459645 ip-10-0-133-239 kubenswrapper[2576]: I0609 15:20:55.459623 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/4499a964-ae76-46b0-9572-f62a795b225c-webhook-cert\") pod \"maas-controller-6968d6768f-sgs8q\" (UID: \"4499a964-ae76-46b0-9572-f62a795b225c\") " pod="opendatahub/maas-controller-6968d6768f-sgs8q" Jun 09 15:20:55.466315 ip-10-0-133-239 kubenswrapper[2576]: I0609 15:20:55.466291 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-jjcxh\" (UniqueName: \"kubernetes.io/projected/4499a964-ae76-46b0-9572-f62a795b225c-kube-api-access-jjcxh\") pod \"maas-controller-6968d6768f-sgs8q\" (UID: \"4499a964-ae76-46b0-9572-f62a795b225c\") " pod="opendatahub/maas-controller-6968d6768f-sgs8q" Jun 09 15:20:55.536789 ip-10-0-133-239 kubenswrapper[2576]: I0609 15:20:55.536763 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-6968d6768f-sgs8q" Jun 09 15:20:55.605231 ip-10-0-133-239 kubenswrapper[2576]: I0609 15:20:55.605205 2576 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="72b56109-3d7c-4d5d-8e8b-d1c301c4bc53" path="/var/lib/kubelet/pods/72b56109-3d7c-4d5d-8e8b-d1c301c4bc53/volumes" Jun 09 15:20:55.669694 ip-10-0-133-239 kubenswrapper[2576]: I0609 15:20:55.669662 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-6968d6768f-sgs8q"] Jun 09 15:20:55.670375 ip-10-0-133-239 kubenswrapper[2576]: W0609 15:20:55.670351 2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4499a964_ae76_46b0_9572_f62a795b225c.slice/crio-9d6a45c953d4a833ca12fcc0bc46788b41c3e552a5916aa579befc2b6806bd58 WatchSource:0}: Error finding container 9d6a45c953d4a833ca12fcc0bc46788b41c3e552a5916aa579befc2b6806bd58: Status 404 returned error can't find the container with id 9d6a45c953d4a833ca12fcc0bc46788b41c3e552a5916aa579befc2b6806bd58 Jun 09 15:20:56.440482 ip-10-0-133-239 kubenswrapper[2576]: I0609 15:20:56.440442 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-6968d6768f-sgs8q" event={"ID":"4499a964-ae76-46b0-9572-f62a795b225c","Type":"ContainerStarted","Data":"cc10367af1f734854f96e8e62fc2d4fe17376d9958189cb312235a2fe02230a2"} Jun 09 15:20:56.440640 ip-10-0-133-239 kubenswrapper[2576]: I0609 15:20:56.440492 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-6968d6768f-sgs8q" event={"ID":"4499a964-ae76-46b0-9572-f62a795b225c","Type":"ContainerStarted","Data":"9d6a45c953d4a833ca12fcc0bc46788b41c3e552a5916aa579befc2b6806bd58"} Jun 09 15:20:56.440640 ip-10-0-133-239 kubenswrapper[2576]: I0609 15:20:56.440539 2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/maas-controller-6968d6768f-sgs8q" Jun 09 15:20:56.458673 ip-10-0-133-239 kubenswrapper[2576]: I0609 15:20:56.458593 2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/maas-controller-6968d6768f-sgs8q" podStartSLOduration=0.929721685 podStartE2EDuration="1.458579585s" totalImagesPullingTime="528.8579ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-09 15:20:55 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-09 15:20:56.458117829 +0000 UTC m=+1171.312274068" watchObservedRunningTime="2026-06-09 15:20:56.458579585 +0000 UTC m=+1171.312735823" Jun 09 15:21:07.453203 ip-10-0-133-239 kubenswrapper[2576]: I0609 15:21:07.453164 2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/maas-controller-6968d6768f-sgs8q" Jun 09 15:21:32.682905 ip-10-0-133-239 kubenswrapper[2576]: I0609 15:21:32.682874 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-668fdbf85c-wmg5x_37922842-1a2e-44d7-861f-edca166e718b/console-operator/2.log" Jun 09 15:21:32.687199 ip-10-0-133-239 kubenswrapper[2576]: I0609 15:21:32.687180 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-668fdbf85c-wmg5x_37922842-1a2e-44d7-861f-edca166e718b/console-operator/2.log" Jun 09 15:21:32.689831 ip-10-0-133-239 kubenswrapper[2576]: I0609 15:21:32.689814 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-n4c97_441b2a74-d62c-4e3c-9e0f-b133cd4364be/ovn-acl-logging/0.log" Jun 09 15:21:32.694409 ip-10-0-133-239 kubenswrapper[2576]: I0609 15:21:32.694390 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-n4c97_441b2a74-d62c-4e3c-9e0f-b133cd4364be/ovn-acl-logging/0.log" Jun 09 15:23:53.387871 ip-10-0-133-239 kubenswrapper[2576]: I0609 15:23:53.387837 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-6867455b8-2nnrl_0d083dd1-bbb2-463b-896d-b204d372bb81/authorino/0.log" Jun 09 15:23:58.279219 ip-10-0-133-239 kubenswrapper[2576]: I0609 15:23:58.279193 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_maas-controller-6968d6768f-sgs8q_4499a964-ae76-46b0-9572-f62a795b225c/manager/0.log" Jun 09 15:23:58.384743 ip-10-0-133-239 kubenswrapper[2576]: I0609 15:23:58.384712 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_model-serving-api-5dd488fc48-l6khg_d4365ffd-5d22-45bd-b101-054db6b8e567/server/0.log" Jun 09 15:23:58.494356 ip-10-0-133-239 kubenswrapper[2576]: I0609 15:23:58.494326 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_odh-model-controller-6dc94f689f-z2vjj_6177fcda-a66c-4a79-b71c-b2c694782679/manager/0.log" Jun 09 15:23:58.604167 ip-10-0-133-239 kubenswrapper[2576]: I0609 15:23:58.604093 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-568b7788b7-ddt5f_c3e37a2f-b0ac-42cd-b0fb-29981e7273df/copy-manifests/0.log" Jun 09 15:23:58.618436 ip-10-0-133-239 kubenswrapper[2576]: I0609 15:23:58.618404 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-568b7788b7-ddt5f_c3e37a2f-b0ac-42cd-b0fb-29981e7273df/manager/0.log" Jun 09 15:23:59.593356 ip-10-0-133-239 kubenswrapper[2576]: I0609 15:23:59.593322 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759f9mhh_f47c8158-dcad-4be3-9661-055f1f37bf85/util/0.log" Jun 09 15:23:59.599317 ip-10-0-133-239 kubenswrapper[2576]: I0609 15:23:59.599292 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759f9mhh_f47c8158-dcad-4be3-9661-055f1f37bf85/pull/0.log" Jun 09 15:23:59.604886 ip-10-0-133-239 kubenswrapper[2576]: I0609 15:23:59.604866 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759f9mhh_f47c8158-dcad-4be3-9661-055f1f37bf85/extract/0.log" Jun 09 15:23:59.708036 ip-10-0-133-239 kubenswrapper[2576]: I0609 15:23:59.708006 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0dmc2s_839b5ef3-1f59-4ea9-bf56-c3cd84a6c7b2/pull/0.log" Jun 09 15:23:59.714939 ip-10-0-133-239 kubenswrapper[2576]: I0609 15:23:59.714920 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0dmc2s_839b5ef3-1f59-4ea9-bf56-c3cd84a6c7b2/extract/0.log" Jun 09 15:23:59.720227 ip-10-0-133-239 kubenswrapper[2576]: I0609 15:23:59.720212 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0dmc2s_839b5ef3-1f59-4ea9-bf56-c3cd84a6c7b2/util/0.log" Jun 09 15:23:59.824902 ip-10-0-133-239 kubenswrapper[2576]: I0609 15:23:59.824868 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73d8lbp_ceacecbb-c7f8-493b-ab8d-7a68be32a1bb/util/0.log" Jun 09 15:23:59.830955 ip-10-0-133-239 kubenswrapper[2576]: I0609 15:23:59.830935 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73d8lbp_ceacecbb-c7f8-493b-ab8d-7a68be32a1bb/pull/0.log" Jun 09 15:23:59.837307 ip-10-0-133-239 kubenswrapper[2576]: I0609 15:23:59.837288 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73d8lbp_ceacecbb-c7f8-493b-ab8d-7a68be32a1bb/extract/0.log" Jun 09 15:23:59.948379 ip-10-0-133-239 kubenswrapper[2576]: I0609 15:23:59.948304 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1nlw9j_756f7736-ed1a-4229-ad38-f68f6243250f/extract/0.log" Jun 09 15:23:59.954370 ip-10-0-133-239 kubenswrapper[2576]: I0609 15:23:59.954343 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1nlw9j_756f7736-ed1a-4229-ad38-f68f6243250f/util/0.log" Jun 09 15:23:59.960002 ip-10-0-133-239 kubenswrapper[2576]: I0609 15:23:59.959983 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1nlw9j_756f7736-ed1a-4229-ad38-f68f6243250f/pull/0.log" Jun 09 15:24:00.070643 ip-10-0-133-239 kubenswrapper[2576]: I0609 15:24:00.070620 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-6867455b8-2nnrl_0d083dd1-bbb2-463b-896d-b204d372bb81/authorino/0.log" Jun 09 15:24:00.400190 ip-10-0-133-239 kubenswrapper[2576]: I0609 15:24:00.400164 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-console-plugin-66b5774985-cz65c_42505a9e-c2d9-4993-a1ec-7fe9ac068b9a/kuadrant-console-plugin/0.log" Jun 09 15:24:01.421669 ip-10-0-133-239 kubenswrapper[2576]: I0609 15:24:01.421645 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-ccff6cfb8-jqj95_7dc1c3ee-d724-4eb5-af0c-8425f99c30df/kube-auth-proxy/0.log" Jun 09 15:24:01.756877 ip-10-0-133-239 kubenswrapper[2576]: I0609 15:24:01.756797 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-pre-processing-67d7689b65-77xlk_a85d5905-be82-45d0-939e-84031108f4c8/payload-pre-processing/0.log" Jun 09 15:24:01.981028 ip-10-0-133-239 kubenswrapper[2576]: I0609 15:24:01.980986 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_router-default-6f8c669b97-fzsft_7d51209c-a257-422b-b29a-87eb78afc8d9/router/0.log" Jun 09 15:24:02.424838 ip-10-0-133-239 kubenswrapper[2576]: I0609 15:24:02.424806 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-distinct-simulated-kserve-5cdff5474d-97gtv_f55ce3c8-a3be-4131-9eaa-07c047a5f633/storage-initializer/0.log" Jun 09 15:24:02.438974 ip-10-0-133-239 kubenswrapper[2576]: I0609 15:24:02.438952 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-distinct-simulated-kserve-5cdff5474d-97gtv_f55ce3c8-a3be-4131-9eaa-07c047a5f633/main/0.log" Jun 09 15:24:02.543749 ip-10-0-133-239 kubenswrapper[2576]: I0609 15:24:02.543720 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-trlp-test-simulated-kserve-68bb6c58d9-cvm9j_1a2d71c3-3c4f-43ad-89c1-2321434e200d/storage-initializer/0.log" Jun 09 15:24:02.550963 ip-10-0-133-239 kubenswrapper[2576]: I0609 15:24:02.550942 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-trlp-test-simulated-kserve-68bb6c58d9-cvm9j_1a2d71c3-3c4f-43ad-89c1-2321434e200d/main/0.log" Jun 09 15:24:02.659808 ip-10-0-133-239 kubenswrapper[2576]: I0609 15:24:02.659775 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477c86nvv_845649db-bd22-4d8c-a4a9-e1e5fc5fc2b7/storage-initializer/0.log" Jun 09 15:24:02.666015 ip-10-0-133-239 kubenswrapper[2576]: I0609 15:24:02.665995 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477c86nvv_845649db-bd22-4d8c-a4a9-e1e5fc5fc2b7/main/0.log" Jun 09 15:24:09.728037 ip-10-0-133-239 kubenswrapper[2576]: I0609 15:24:09.728002 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_global-pull-secret-syncer-256sj_14860286-bb9d-4f00-864f-c2b041a3b160/global-pull-secret-syncer/0.log" Jun 09 15:24:09.871977 ip-10-0-133-239 kubenswrapper[2576]: I0609 15:24:09.871948 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_konnectivity-agent-tz8c7_aed341a8-0a84-498b-9b3c-75a83a8279bb/konnectivity-agent/0.log" Jun 09 15:24:09.942865 ip-10-0-133-239 kubenswrapper[2576]: I0609 15:24:09.942836 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_kube-apiserver-proxy-ip-10-0-133-239.ec2.internal_a6e9ba50990866073fec99b72c3ac279/haproxy/0.log" Jun 09 15:24:14.329878 ip-10-0-133-239 kubenswrapper[2576]: I0609 15:24:14.329793 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759f9mhh_f47c8158-dcad-4be3-9661-055f1f37bf85/extract/0.log" Jun 09 15:24:14.350699 ip-10-0-133-239 kubenswrapper[2576]: I0609 15:24:14.350681 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759f9mhh_f47c8158-dcad-4be3-9661-055f1f37bf85/util/0.log" Jun 09 15:24:14.376448 ip-10-0-133-239 kubenswrapper[2576]: I0609 15:24:14.376428 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759f9mhh_f47c8158-dcad-4be3-9661-055f1f37bf85/pull/0.log" Jun 09 15:24:14.409547 ip-10-0-133-239 kubenswrapper[2576]: I0609 15:24:14.409526 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0dmc2s_839b5ef3-1f59-4ea9-bf56-c3cd84a6c7b2/extract/0.log" Jun 09 15:24:14.429496 ip-10-0-133-239 kubenswrapper[2576]: I0609 15:24:14.429473 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0dmc2s_839b5ef3-1f59-4ea9-bf56-c3cd84a6c7b2/util/0.log" Jun 09 15:24:14.449306 ip-10-0-133-239 kubenswrapper[2576]: I0609 15:24:14.449288 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0dmc2s_839b5ef3-1f59-4ea9-bf56-c3cd84a6c7b2/pull/0.log" Jun 09 15:24:14.510114 ip-10-0-133-239 kubenswrapper[2576]: I0609 15:24:14.510093 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73d8lbp_ceacecbb-c7f8-493b-ab8d-7a68be32a1bb/extract/0.log" Jun 09 15:24:14.531666 ip-10-0-133-239 kubenswrapper[2576]: I0609 15:24:14.531646 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73d8lbp_ceacecbb-c7f8-493b-ab8d-7a68be32a1bb/util/0.log" Jun 09 15:24:14.552572 ip-10-0-133-239 kubenswrapper[2576]: I0609 15:24:14.552554 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73d8lbp_ceacecbb-c7f8-493b-ab8d-7a68be32a1bb/pull/0.log" Jun 09 15:24:14.580298 ip-10-0-133-239 kubenswrapper[2576]: I0609 15:24:14.580246 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1nlw9j_756f7736-ed1a-4229-ad38-f68f6243250f/extract/0.log" Jun 09 15:24:14.613551 ip-10-0-133-239 kubenswrapper[2576]: I0609 15:24:14.613525 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1nlw9j_756f7736-ed1a-4229-ad38-f68f6243250f/util/0.log" Jun 09 15:24:14.633236 ip-10-0-133-239 kubenswrapper[2576]: I0609 15:24:14.633217 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1nlw9j_756f7736-ed1a-4229-ad38-f68f6243250f/pull/0.log" Jun 09 15:24:14.691160 ip-10-0-133-239 kubenswrapper[2576]: I0609 15:24:14.691137 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-6867455b8-2nnrl_0d083dd1-bbb2-463b-896d-b204d372bb81/authorino/0.log" Jun 09 15:24:14.838271 ip-10-0-133-239 kubenswrapper[2576]: I0609 15:24:14.838196 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-console-plugin-66b5774985-cz65c_42505a9e-c2d9-4993-a1ec-7fe9ac068b9a/kuadrant-console-plugin/0.log" Jun 09 15:24:17.323122 ip-10-0-133-239 kubenswrapper[2576]: I0609 15:24:17.323059 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_metrics-server-69788964dc-cp5jb_ac303dbd-2e2f-47f8-8858-d478771abd39/metrics-server/0.log" Jun 09 15:24:17.352928 ip-10-0-133-239 kubenswrapper[2576]: I0609 15:24:17.352902 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_monitoring-plugin-76b68cc874-4nmh7_f1c81500-c25f-41f2-804a-3db0f8bde628/monitoring-plugin/0.log" Jun 09 15:24:17.482237 ip-10-0-133-239 kubenswrapper[2576]: I0609 15:24:17.482194 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-k2l2b_0603dfe2-38eb-42ab-adef-cfe4867128af/node-exporter/0.log" Jun 09 15:24:17.512379 ip-10-0-133-239 kubenswrapper[2576]: I0609 15:24:17.512357 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-k2l2b_0603dfe2-38eb-42ab-adef-cfe4867128af/kube-rbac-proxy/0.log" Jun 09 15:24:17.543956 ip-10-0-133-239 kubenswrapper[2576]: I0609 15:24:17.543932 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-k2l2b_0603dfe2-38eb-42ab-adef-cfe4867128af/init-textfile/0.log" Jun 09 15:24:18.032794 ip-10-0-133-239 kubenswrapper[2576]: I0609 15:24:18.032757 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-operator-7f7d445d84-wmnvp_fd8562f1-3884-400e-9e8d-479dcdd4c9bc/prometheus-operator/0.log" Jun 09 15:24:18.053401 ip-10-0-133-239 kubenswrapper[2576]: I0609 15:24:18.053321 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-operator-7f7d445d84-wmnvp_fd8562f1-3884-400e-9e8d-479dcdd4c9bc/kube-rbac-proxy/0.log" Jun 09 15:24:19.759899 ip-10-0-133-239 kubenswrapper[2576]: I0609 15:24:19.759869 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-network-console_networking-console-plugin-d5d5bb78b-jlv7n_739fbbc7-e701-4fac-8903-5f6a0d03ecb1/networking-console-plugin/0.log" Jun 09 15:24:20.425082 ip-10-0-133-239 kubenswrapper[2576]: I0609 15:24:20.424985 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-668fdbf85c-wmg5x_37922842-1a2e-44d7-861f-edca166e718b/console-operator/2.log" Jun 09 15:24:20.429951 ip-10-0-133-239 kubenswrapper[2576]: I0609 15:24:20.429928 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-668fdbf85c-wmg5x_37922842-1a2e-44d7-861f-edca166e718b/console-operator/3.log" Jun 09 15:24:20.971154 ip-10-0-133-239 kubenswrapper[2576]: I0609 15:24:20.971112 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console_downloads-6657875f97-kkdcv_fc31830e-79df-444e-83bd-0ab9f716750c/download-server/0.log" Jun 09 15:24:21.409645 ip-10-0-133-239 kubenswrapper[2576]: I0609 15:24:21.409612 2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-must-gather-4rnqb/perf-node-gather-daemonset-8hjjn"] Jun 09 15:24:21.413054 ip-10-0-133-239 kubenswrapper[2576]: I0609 15:24:21.413038 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-4rnqb/perf-node-gather-daemonset-8hjjn" Jun 09 15:24:21.415393 ip-10-0-133-239 kubenswrapper[2576]: I0609 15:24:21.415365 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-4rnqb\"/\"kube-root-ca.crt\"" Jun 09 15:24:21.415393 ip-10-0-133-239 kubenswrapper[2576]: I0609 15:24:21.415372 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-4rnqb\"/\"openshift-service-ca.crt\"" Jun 09 15:24:21.416244 ip-10-0-133-239 kubenswrapper[2576]: I0609 15:24:21.416231 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-must-gather-4rnqb\"/\"default-dockercfg-dwcff\"" Jun 09 15:24:21.420059 ip-10-0-133-239 kubenswrapper[2576]: I0609 15:24:21.419851 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-4rnqb/perf-node-gather-daemonset-8hjjn"] Jun 09 15:24:21.498010 ip-10-0-133-239 kubenswrapper[2576]: I0609 15:24:21.497974 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/b74499bc-badc-4702-93b9-560f1863fbf7-sys\") pod \"perf-node-gather-daemonset-8hjjn\" (UID: \"b74499bc-badc-4702-93b9-560f1863fbf7\") " pod="openshift-must-gather-4rnqb/perf-node-gather-daemonset-8hjjn" Jun 09 15:24:21.498206 ip-10-0-133-239 kubenswrapper[2576]: I0609 15:24:21.498041 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/b74499bc-badc-4702-93b9-560f1863fbf7-proc\") pod \"perf-node-gather-daemonset-8hjjn\" (UID: \"b74499bc-badc-4702-93b9-560f1863fbf7\") " pod="openshift-must-gather-4rnqb/perf-node-gather-daemonset-8hjjn" Jun 09 15:24:21.498206 ip-10-0-133-239 kubenswrapper[2576]: I0609 15:24:21.498058 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/b74499bc-badc-4702-93b9-560f1863fbf7-podres\") pod \"perf-node-gather-daemonset-8hjjn\" (UID: \"b74499bc-badc-4702-93b9-560f1863fbf7\") " pod="openshift-must-gather-4rnqb/perf-node-gather-daemonset-8hjjn" Jun 09 15:24:21.498206 ip-10-0-133-239 kubenswrapper[2576]: I0609 15:24:21.498106 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/b74499bc-badc-4702-93b9-560f1863fbf7-lib-modules\") pod \"perf-node-gather-daemonset-8hjjn\" (UID: \"b74499bc-badc-4702-93b9-560f1863fbf7\") " pod="openshift-must-gather-4rnqb/perf-node-gather-daemonset-8hjjn" Jun 09 15:24:21.498206 ip-10-0-133-239 kubenswrapper[2576]: I0609 15:24:21.498141 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9tz95\" (UniqueName: \"kubernetes.io/projected/b74499bc-badc-4702-93b9-560f1863fbf7-kube-api-access-9tz95\") pod \"perf-node-gather-daemonset-8hjjn\" (UID: \"b74499bc-badc-4702-93b9-560f1863fbf7\") " pod="openshift-must-gather-4rnqb/perf-node-gather-daemonset-8hjjn" Jun 09 15:24:21.598535 ip-10-0-133-239 kubenswrapper[2576]: I0609 15:24:21.598504 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/b74499bc-badc-4702-93b9-560f1863fbf7-proc\") pod \"perf-node-gather-daemonset-8hjjn\" (UID: \"b74499bc-badc-4702-93b9-560f1863fbf7\") " pod="openshift-must-gather-4rnqb/perf-node-gather-daemonset-8hjjn" Jun 09 15:24:21.598535 ip-10-0-133-239 kubenswrapper[2576]: I0609 15:24:21.598538 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/b74499bc-badc-4702-93b9-560f1863fbf7-podres\") pod \"perf-node-gather-daemonset-8hjjn\" (UID: \"b74499bc-badc-4702-93b9-560f1863fbf7\") " pod="openshift-must-gather-4rnqb/perf-node-gather-daemonset-8hjjn" Jun 09 15:24:21.598781 ip-10-0-133-239 kubenswrapper[2576]: I0609 15:24:21.598557 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/b74499bc-badc-4702-93b9-560f1863fbf7-lib-modules\") pod \"perf-node-gather-daemonset-8hjjn\" (UID: \"b74499bc-badc-4702-93b9-560f1863fbf7\") " pod="openshift-must-gather-4rnqb/perf-node-gather-daemonset-8hjjn" Jun 09 15:24:21.598781 ip-10-0-133-239 kubenswrapper[2576]: I0609 15:24:21.598600 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9tz95\" (UniqueName: \"kubernetes.io/projected/b74499bc-badc-4702-93b9-560f1863fbf7-kube-api-access-9tz95\") pod \"perf-node-gather-daemonset-8hjjn\" (UID: \"b74499bc-badc-4702-93b9-560f1863fbf7\") " pod="openshift-must-gather-4rnqb/perf-node-gather-daemonset-8hjjn" Jun 09 15:24:21.598781 ip-10-0-133-239 kubenswrapper[2576]: I0609 15:24:21.598633 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/b74499bc-badc-4702-93b9-560f1863fbf7-proc\") pod \"perf-node-gather-daemonset-8hjjn\" (UID: \"b74499bc-badc-4702-93b9-560f1863fbf7\") " pod="openshift-must-gather-4rnqb/perf-node-gather-daemonset-8hjjn" Jun 09 15:24:21.598781 ip-10-0-133-239 kubenswrapper[2576]: I0609 15:24:21.598640 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/b74499bc-badc-4702-93b9-560f1863fbf7-sys\") pod \"perf-node-gather-daemonset-8hjjn\" (UID: \"b74499bc-badc-4702-93b9-560f1863fbf7\") " pod="openshift-must-gather-4rnqb/perf-node-gather-daemonset-8hjjn" Jun 09 15:24:21.598781 ip-10-0-133-239 kubenswrapper[2576]: I0609 15:24:21.598685 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/b74499bc-badc-4702-93b9-560f1863fbf7-sys\") pod \"perf-node-gather-daemonset-8hjjn\" (UID: \"b74499bc-badc-4702-93b9-560f1863fbf7\") " pod="openshift-must-gather-4rnqb/perf-node-gather-daemonset-8hjjn" Jun 09 15:24:21.598781 ip-10-0-133-239 kubenswrapper[2576]: I0609 15:24:21.598695 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/b74499bc-badc-4702-93b9-560f1863fbf7-podres\") pod \"perf-node-gather-daemonset-8hjjn\" (UID: \"b74499bc-badc-4702-93b9-560f1863fbf7\") " pod="openshift-must-gather-4rnqb/perf-node-gather-daemonset-8hjjn" Jun 09 15:24:21.598781 ip-10-0-133-239 kubenswrapper[2576]: I0609 15:24:21.598706 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/b74499bc-badc-4702-93b9-560f1863fbf7-lib-modules\") pod \"perf-node-gather-daemonset-8hjjn\" (UID: \"b74499bc-badc-4702-93b9-560f1863fbf7\") " pod="openshift-must-gather-4rnqb/perf-node-gather-daemonset-8hjjn" Jun 09 15:24:21.606288 ip-10-0-133-239 kubenswrapper[2576]: I0609 15:24:21.606266 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-9tz95\" (UniqueName: \"kubernetes.io/projected/b74499bc-badc-4702-93b9-560f1863fbf7-kube-api-access-9tz95\") pod \"perf-node-gather-daemonset-8hjjn\" (UID: \"b74499bc-badc-4702-93b9-560f1863fbf7\") " pod="openshift-must-gather-4rnqb/perf-node-gather-daemonset-8hjjn" Jun 09 15:24:21.661849 ip-10-0-133-239 kubenswrapper[2576]: I0609 15:24:21.661778 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-cluster-storage-operator_volume-data-source-validator-78dd696465-twbjk_2384a6e0-9bea-42f1-883c-bac4c0bb9658/volume-data-source-validator/0.log" Jun 09 15:24:21.724745 ip-10-0-133-239 kubenswrapper[2576]: I0609 15:24:21.724717 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-4rnqb/perf-node-gather-daemonset-8hjjn" Jun 09 15:24:21.860647 ip-10-0-133-239 kubenswrapper[2576]: I0609 15:24:21.860621 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-4rnqb/perf-node-gather-daemonset-8hjjn"] Jun 09 15:24:21.862331 ip-10-0-133-239 kubenswrapper[2576]: W0609 15:24:21.862305 2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-podb74499bc_badc_4702_93b9_560f1863fbf7.slice/crio-67eeeb0915afc76948ceb72d485f2fa40d32532cb7de703fb5ae912583957524 WatchSource:0}: Error finding container 67eeeb0915afc76948ceb72d485f2fa40d32532cb7de703fb5ae912583957524: Status 404 returned error can't find the container with id 67eeeb0915afc76948ceb72d485f2fa40d32532cb7de703fb5ae912583957524 Jun 09 15:24:22.580625 ip-10-0-133-239 kubenswrapper[2576]: I0609 15:24:22.580587 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-4rnqb/perf-node-gather-daemonset-8hjjn" event={"ID":"b74499bc-badc-4702-93b9-560f1863fbf7","Type":"ContainerStarted","Data":"e01028387da70c6ccb75bbd5b5324942e00c6dd8b0015a959f7000b0ce66d3b9"} Jun 09 15:24:22.581004 ip-10-0-133-239 kubenswrapper[2576]: I0609 15:24:22.580640 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-4rnqb/perf-node-gather-daemonset-8hjjn" event={"ID":"b74499bc-badc-4702-93b9-560f1863fbf7","Type":"ContainerStarted","Data":"67eeeb0915afc76948ceb72d485f2fa40d32532cb7de703fb5ae912583957524"} Jun 09 15:24:22.581004 ip-10-0-133-239 kubenswrapper[2576]: I0609 15:24:22.580699 2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-must-gather-4rnqb/perf-node-gather-daemonset-8hjjn" Jun 09 15:24:22.597992 ip-10-0-133-239 kubenswrapper[2576]: I0609 15:24:22.597943 2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-must-gather-4rnqb/perf-node-gather-daemonset-8hjjn" podStartSLOduration=1.597926282 podStartE2EDuration="1.597926282s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-09 15:24:21 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-09 15:24:22.595453382 +0000 UTC m=+1377.449609621" watchObservedRunningTime="2026-06-09 15:24:22.597926282 +0000 UTC m=+1377.452082522" Jun 09 15:24:22.917815 ip-10-0-133-239 kubenswrapper[2576]: I0609 15:24:22.917723 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-lhz9k_6bcbe45d-fd30-4df1-a753-d8ed92e1a980/dns/0.log" Jun 09 15:24:22.938788 ip-10-0-133-239 kubenswrapper[2576]: I0609 15:24:22.938762 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-lhz9k_6bcbe45d-fd30-4df1-a753-d8ed92e1a980/kube-rbac-proxy/0.log" Jun 09 15:24:23.045555 ip-10-0-133-239 kubenswrapper[2576]: I0609 15:24:23.045529 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-d5rht_819c59d4-2dfd-40f7-8018-dc29890cc325/dns-node-resolver/0.log" Jun 09 15:24:23.604737 ip-10-0-133-239 kubenswrapper[2576]: I0609 15:24:23.604708 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_image-registry-748c5bf95-tkxxb_a0bcff7d-3e5b-4cdf-ad5c-73ce22659d3d/registry/0.log" Jun 09 15:24:23.608654 ip-10-0-133-239 kubenswrapper[2576]: I0609 15:24:23.608634 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_image-registry-748c5bf95-tkxxb_a0bcff7d-3e5b-4cdf-ad5c-73ce22659d3d/registry/1.log" Jun 09 15:24:23.671524 ip-10-0-133-239 kubenswrapper[2576]: I0609 15:24:23.671495 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-n4qqs_ab1b7146-38f5-4c67-b79c-d98d8f1734e8/node-ca/0.log" Jun 09 15:24:24.668134 ip-10-0-133-239 kubenswrapper[2576]: I0609 15:24:24.668099 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-ccff6cfb8-jqj95_7dc1c3ee-d724-4eb5-af0c-8425f99c30df/kube-auth-proxy/0.log" Jun 09 15:24:24.769746 ip-10-0-133-239 kubenswrapper[2576]: I0609 15:24:24.769704 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-pre-processing-67d7689b65-77xlk_a85d5905-be82-45d0-939e-84031108f4c8/payload-pre-processing/0.log" Jun 09 15:24:24.823025 ip-10-0-133-239 kubenswrapper[2576]: I0609 15:24:24.823001 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_router-default-6f8c669b97-fzsft_7d51209c-a257-422b-b29a-87eb78afc8d9/router/0.log" Jun 09 15:24:25.441832 ip-10-0-133-239 kubenswrapper[2576]: I0609 15:24:25.441793 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-7s82g_539bda9e-91a8-417f-91ff-8ccd3219cfd1/serve-healthcheck-canary/0.log" Jun 09 15:24:26.013355 ip-10-0-133-239 kubenswrapper[2576]: I0609 15:24:26.013331 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-5nnc4_68871c9a-6546-44db-b2bd-89e2857697a9/kube-rbac-proxy/0.log" Jun 09 15:24:26.048836 ip-10-0-133-239 kubenswrapper[2576]: I0609 15:24:26.048808 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-5nnc4_68871c9a-6546-44db-b2bd-89e2857697a9/exporter/0.log" Jun 09 15:24:26.073741 ip-10-0-133-239 kubenswrapper[2576]: I0609 15:24:26.073721 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-5nnc4_68871c9a-6546-44db-b2bd-89e2857697a9/extractor/0.log" Jun 09 15:24:28.505650 ip-10-0-133-239 kubenswrapper[2576]: I0609 15:24:28.505620 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_maas-controller-6968d6768f-sgs8q_4499a964-ae76-46b0-9572-f62a795b225c/manager/0.log" Jun 09 15:24:28.527449 ip-10-0-133-239 kubenswrapper[2576]: I0609 15:24:28.527428 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_model-serving-api-5dd488fc48-l6khg_d4365ffd-5d22-45bd-b101-054db6b8e567/server/0.log" Jun 09 15:24:28.572382 ip-10-0-133-239 kubenswrapper[2576]: I0609 15:24:28.572358 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_odh-model-controller-6dc94f689f-z2vjj_6177fcda-a66c-4a79-b71c-b2c694782679/manager/0.log" Jun 09 15:24:28.596525 ip-10-0-133-239 kubenswrapper[2576]: I0609 15:24:28.596505 2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-must-gather-4rnqb/perf-node-gather-daemonset-8hjjn" Jun 09 15:24:28.625658 ip-10-0-133-239 kubenswrapper[2576]: I0609 15:24:28.625638 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-568b7788b7-ddt5f_c3e37a2f-b0ac-42cd-b0fb-29981e7273df/manager/0.log" Jun 09 15:24:28.644924 ip-10-0-133-239 kubenswrapper[2576]: I0609 15:24:28.644903 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-568b7788b7-ddt5f_c3e37a2f-b0ac-42cd-b0fb-29981e7273df/copy-manifests/0.log" Jun 09 15:24:30.291228 ip-10-0-133-239 kubenswrapper[2576]: I0609 15:24:30.291205 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-lws-operator_lws-controller-manager-7647c5764b-clqwf_947044cd-b534-40cb-9ee4-71877772b00b/manager/0.log" Jun 09 15:24:35.807584 ip-10-0-133-239 kubenswrapper[2576]: I0609 15:24:35.807552 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator_migrator-955ffdf5f-mwvhb_5433a9b5-4ef5-494d-b418-3c1c2973a7c1/migrator/0.log" Jun 09 15:24:35.830828 ip-10-0-133-239 kubenswrapper[2576]: I0609 15:24:35.830806 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator_migrator-955ffdf5f-mwvhb_5433a9b5-4ef5-494d-b418-3c1c2973a7c1/graceful-termination/0.log" Jun 09 15:24:35.876892 ip-10-0-133-239 kubenswrapper[2576]: I0609 15:24:35.876868 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-ccff6cfb8-jqj95_7dc1c3ee-d724-4eb5-af0c-8425f99c30df/kube-auth-proxy/0.log" Jun 09 15:24:35.951316 ip-10-0-133-239 kubenswrapper[2576]: I0609 15:24:35.951288 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-pre-processing-67d7689b65-77xlk_a85d5905-be82-45d0-939e-84031108f4c8/payload-pre-processing/0.log" Jun 09 15:24:35.984652 ip-10-0-133-239 kubenswrapper[2576]: I0609 15:24:35.984622 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_router-default-6f8c669b97-fzsft_7d51209c-a257-422b-b29a-87eb78afc8d9/router/0.log" Jun 09 15:24:37.202865 ip-10-0-133-239 kubenswrapper[2576]: I0609 15:24:37.202842 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-ccff6cfb8-jqj95_7dc1c3ee-d724-4eb5-af0c-8425f99c30df/kube-auth-proxy/0.log" Jun 09 15:24:37.306789 ip-10-0-133-239 kubenswrapper[2576]: I0609 15:24:37.306765 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-pre-processing-67d7689b65-77xlk_a85d5905-be82-45d0-939e-84031108f4c8/payload-pre-processing/0.log" Jun 09 15:24:37.354108 ip-10-0-133-239 kubenswrapper[2576]: I0609 15:24:37.354080 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_router-default-6f8c669b97-fzsft_7d51209c-a257-422b-b29a-87eb78afc8d9/router/0.log" Jun 09 15:24:37.548060 ip-10-0-133-239 kubenswrapper[2576]: I0609 15:24:37.548034 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-96jh2_d5a7276b-a84f-4a88-b220-eb46f36768a0/kube-multus/0.log" Jun 09 15:24:37.930390 ip-10-0-133-239 kubenswrapper[2576]: I0609 15:24:37.930319 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-rvk7p_77714a52-c22d-45f0-939d-b2a256bd511e/kube-multus-additional-cni-plugins/0.log" Jun 09 15:24:37.966157 ip-10-0-133-239 kubenswrapper[2576]: I0609 15:24:37.966128 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-rvk7p_77714a52-c22d-45f0-939d-b2a256bd511e/egress-router-binary-copy/0.log" Jun 09 15:24:37.999218 ip-10-0-133-239 kubenswrapper[2576]: I0609 15:24:37.999192 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-rvk7p_77714a52-c22d-45f0-939d-b2a256bd511e/cni-plugins/0.log" Jun 09 15:24:38.038269 ip-10-0-133-239 kubenswrapper[2576]: I0609 15:24:38.038251 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-rvk7p_77714a52-c22d-45f0-939d-b2a256bd511e/bond-cni-plugin/0.log" Jun 09 15:24:38.073751 ip-10-0-133-239 kubenswrapper[2576]: I0609 15:24:38.073729 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-rvk7p_77714a52-c22d-45f0-939d-b2a256bd511e/routeoverride-cni/0.log" Jun 09 15:24:38.109291 ip-10-0-133-239 kubenswrapper[2576]: I0609 15:24:38.109265 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-rvk7p_77714a52-c22d-45f0-939d-b2a256bd511e/whereabouts-cni-bincopy/0.log" Jun 09 15:24:38.142216 ip-10-0-133-239 kubenswrapper[2576]: I0609 15:24:38.142192 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-rvk7p_77714a52-c22d-45f0-939d-b2a256bd511e/whereabouts-cni/0.log" Jun 09 15:24:38.208079 ip-10-0-133-239 kubenswrapper[2576]: I0609 15:24:38.207995 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_network-metrics-daemon-rw24f_64cfa4da-d67f-413d-b01d-161226f943e7/network-metrics-daemon/0.log" Jun 09 15:24:38.238484 ip-10-0-133-239 kubenswrapper[2576]: I0609 15:24:38.238461 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_network-metrics-daemon-rw24f_64cfa4da-d67f-413d-b01d-161226f943e7/kube-rbac-proxy/0.log" Jun 09 15:24:38.933552 ip-10-0-133-239 kubenswrapper[2576]: I0609 15:24:38.933530 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-ccff6cfb8-jqj95_7dc1c3ee-d724-4eb5-af0c-8425f99c30df/kube-auth-proxy/0.log" Jun 09 15:24:39.012659 ip-10-0-133-239 kubenswrapper[2576]: I0609 15:24:39.012634 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-pre-processing-67d7689b65-77xlk_a85d5905-be82-45d0-939e-84031108f4c8/payload-pre-processing/0.log" Jun 09 15:24:39.054702 ip-10-0-133-239 kubenswrapper[2576]: I0609 15:24:39.054679 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_router-default-6f8c669b97-fzsft_7d51209c-a257-422b-b29a-87eb78afc8d9/router/0.log"