Jun 14 14:39:22.543393 ip-10-0-129-116 systemd[1]: Starting Kubernetes Kubelet... Jun 14 14:39:22.986450 ip-10-0-129-116 kubenswrapper[2546]: Flag --container-runtime-endpoint has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Jun 14 14:39:22.986450 ip-10-0-129-116 kubenswrapper[2546]: Flag --minimum-container-ttl-duration has been deprecated, Use --eviction-hard or --eviction-soft instead. Will be removed in a future version. Jun 14 14:39:22.986450 ip-10-0-129-116 kubenswrapper[2546]: Flag --volume-plugin-dir has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Jun 14 14:39:22.986450 ip-10-0-129-116 kubenswrapper[2546]: Flag --pod-infra-container-image has been deprecated, will be removed in 1.35. Image garbage collector will get sandbox image information from CRI. Jun 14 14:39:22.986450 ip-10-0-129-116 kubenswrapper[2546]: Flag --system-reserved has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Jun 14 14:39:22.989324 ip-10-0-129-116 kubenswrapper[2546]: I0614 14:39:22.989238 2546 server.go:213] "--pod-infra-container-image will not be pruned by the image garbage collector in kubelet and should also be set in the remote runtime" Jun 14 14:39:22.996927 ip-10-0-129-116 kubenswrapper[2546]: W0614 14:39:22.996907 2546 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jun 14 14:39:22.996927 ip-10-0-129-116 kubenswrapper[2546]: W0614 14:39:22.996924 2546 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jun 14 14:39:22.996927 ip-10-0-129-116 kubenswrapper[2546]: W0614 14:39:22.996928 2546 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jun 14 14:39:22.996927 ip-10-0-129-116 kubenswrapper[2546]: W0614 14:39:22.996932 2546 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jun 14 14:39:22.997051 ip-10-0-129-116 kubenswrapper[2546]: W0614 14:39:22.996935 2546 feature_gate.go:328] unrecognized feature gate: OVNObservability Jun 14 14:39:22.997051 ip-10-0-129-116 kubenswrapper[2546]: W0614 14:39:22.996938 2546 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jun 14 14:39:22.997051 ip-10-0-129-116 kubenswrapper[2546]: W0614 14:39:22.996941 2546 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jun 14 14:39:22.997051 ip-10-0-129-116 kubenswrapper[2546]: W0614 14:39:22.996943 2546 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jun 14 14:39:22.997051 ip-10-0-129-116 kubenswrapper[2546]: W0614 14:39:22.996946 2546 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jun 14 14:39:22.997051 ip-10-0-129-116 kubenswrapper[2546]: W0614 14:39:22.996949 2546 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jun 14 14:39:22.997051 ip-10-0-129-116 kubenswrapper[2546]: W0614 14:39:22.996951 2546 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jun 14 14:39:22.997051 ip-10-0-129-116 kubenswrapper[2546]: W0614 14:39:22.996955 2546 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jun 14 14:39:22.997051 ip-10-0-129-116 kubenswrapper[2546]: W0614 14:39:22.996958 2546 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jun 14 14:39:22.997051 ip-10-0-129-116 kubenswrapper[2546]: W0614 14:39:22.996960 2546 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jun 14 14:39:22.997051 ip-10-0-129-116 kubenswrapper[2546]: W0614 14:39:22.996963 2546 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jun 14 14:39:22.997051 ip-10-0-129-116 kubenswrapper[2546]: W0614 14:39:22.996965 2546 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jun 14 14:39:22.997051 ip-10-0-129-116 kubenswrapper[2546]: W0614 14:39:22.996969 2546 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jun 14 14:39:22.997051 ip-10-0-129-116 kubenswrapper[2546]: W0614 14:39:22.996971 2546 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jun 14 14:39:22.997051 ip-10-0-129-116 kubenswrapper[2546]: W0614 14:39:22.996974 2546 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jun 14 14:39:22.997051 ip-10-0-129-116 kubenswrapper[2546]: W0614 14:39:22.996976 2546 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jun 14 14:39:22.997051 ip-10-0-129-116 kubenswrapper[2546]: W0614 14:39:22.996979 2546 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jun 14 14:39:22.997051 ip-10-0-129-116 kubenswrapper[2546]: W0614 14:39:22.996981 2546 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jun 14 14:39:22.997051 ip-10-0-129-116 kubenswrapper[2546]: W0614 14:39:22.996984 2546 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jun 14 14:39:22.997051 ip-10-0-129-116 kubenswrapper[2546]: W0614 14:39:22.996986 2546 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jun 14 14:39:22.997563 ip-10-0-129-116 kubenswrapper[2546]: W0614 14:39:22.996989 2546 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jun 14 14:39:22.997563 ip-10-0-129-116 kubenswrapper[2546]: W0614 14:39:22.996992 2546 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jun 14 14:39:22.997563 ip-10-0-129-116 kubenswrapper[2546]: W0614 14:39:22.996994 2546 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jun 14 14:39:22.997563 ip-10-0-129-116 kubenswrapper[2546]: W0614 14:39:22.996997 2546 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jun 14 14:39:22.997563 ip-10-0-129-116 kubenswrapper[2546]: W0614 14:39:22.997000 2546 feature_gate.go:328] unrecognized feature gate: EventTTL Jun 14 14:39:22.997563 ip-10-0-129-116 kubenswrapper[2546]: W0614 14:39:22.997002 2546 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jun 14 14:39:22.997563 ip-10-0-129-116 kubenswrapper[2546]: W0614 14:39:22.997006 2546 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jun 14 14:39:22.997563 ip-10-0-129-116 kubenswrapper[2546]: W0614 14:39:22.997009 2546 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jun 14 14:39:22.997563 ip-10-0-129-116 kubenswrapper[2546]: W0614 14:39:22.997011 2546 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jun 14 14:39:22.997563 ip-10-0-129-116 kubenswrapper[2546]: W0614 14:39:22.997014 2546 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jun 14 14:39:22.997563 ip-10-0-129-116 kubenswrapper[2546]: W0614 14:39:22.997016 2546 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jun 14 14:39:22.997563 ip-10-0-129-116 kubenswrapper[2546]: W0614 14:39:22.997019 2546 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jun 14 14:39:22.997563 ip-10-0-129-116 kubenswrapper[2546]: W0614 14:39:22.997021 2546 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jun 14 14:39:22.997563 ip-10-0-129-116 kubenswrapper[2546]: W0614 14:39:22.997024 2546 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jun 14 14:39:22.997563 ip-10-0-129-116 kubenswrapper[2546]: W0614 14:39:22.997027 2546 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jun 14 14:39:22.997563 ip-10-0-129-116 kubenswrapper[2546]: W0614 14:39:22.997030 2546 feature_gate.go:328] unrecognized feature gate: OSStreams Jun 14 14:39:22.997563 ip-10-0-129-116 kubenswrapper[2546]: W0614 14:39:22.997032 2546 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jun 14 14:39:22.997563 ip-10-0-129-116 kubenswrapper[2546]: W0614 14:39:22.997036 2546 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jun 14 14:39:22.997563 ip-10-0-129-116 kubenswrapper[2546]: W0614 14:39:22.997038 2546 feature_gate.go:328] unrecognized feature gate: DualReplica Jun 14 14:39:22.997563 ip-10-0-129-116 kubenswrapper[2546]: W0614 14:39:22.997041 2546 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jun 14 14:39:22.998054 ip-10-0-129-116 kubenswrapper[2546]: W0614 14:39:22.997043 2546 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jun 14 14:39:22.998054 ip-10-0-129-116 kubenswrapper[2546]: W0614 14:39:22.997046 2546 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jun 14 14:39:22.998054 ip-10-0-129-116 kubenswrapper[2546]: W0614 14:39:22.997049 2546 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jun 14 14:39:22.998054 ip-10-0-129-116 kubenswrapper[2546]: W0614 14:39:22.997052 2546 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jun 14 14:39:22.998054 ip-10-0-129-116 kubenswrapper[2546]: W0614 14:39:22.997054 2546 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jun 14 14:39:22.998054 ip-10-0-129-116 kubenswrapper[2546]: W0614 14:39:22.997057 2546 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jun 14 14:39:22.998054 ip-10-0-129-116 kubenswrapper[2546]: W0614 14:39:22.997060 2546 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jun 14 14:39:22.998054 ip-10-0-129-116 kubenswrapper[2546]: W0614 14:39:22.997063 2546 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jun 14 14:39:22.998054 ip-10-0-129-116 kubenswrapper[2546]: W0614 14:39:22.997067 2546 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jun 14 14:39:22.998054 ip-10-0-129-116 kubenswrapper[2546]: W0614 14:39:22.997072 2546 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jun 14 14:39:22.998054 ip-10-0-129-116 kubenswrapper[2546]: W0614 14:39:22.997075 2546 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jun 14 14:39:22.998054 ip-10-0-129-116 kubenswrapper[2546]: W0614 14:39:22.997078 2546 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jun 14 14:39:22.998054 ip-10-0-129-116 kubenswrapper[2546]: W0614 14:39:22.997103 2546 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jun 14 14:39:22.998054 ip-10-0-129-116 kubenswrapper[2546]: W0614 14:39:22.997108 2546 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jun 14 14:39:22.998054 ip-10-0-129-116 kubenswrapper[2546]: W0614 14:39:22.997112 2546 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jun 14 14:39:22.998054 ip-10-0-129-116 kubenswrapper[2546]: W0614 14:39:22.997115 2546 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jun 14 14:39:22.998054 ip-10-0-129-116 kubenswrapper[2546]: W0614 14:39:22.997118 2546 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jun 14 14:39:22.998054 ip-10-0-129-116 kubenswrapper[2546]: W0614 14:39:22.997121 2546 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jun 14 14:39:22.998054 ip-10-0-129-116 kubenswrapper[2546]: W0614 14:39:22.997123 2546 feature_gate.go:328] unrecognized feature gate: SignatureStores Jun 14 14:39:22.998522 ip-10-0-129-116 kubenswrapper[2546]: W0614 14:39:22.997126 2546 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jun 14 14:39:22.998522 ip-10-0-129-116 kubenswrapper[2546]: W0614 14:39:22.997130 2546 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jun 14 14:39:22.998522 ip-10-0-129-116 kubenswrapper[2546]: W0614 14:39:22.997134 2546 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jun 14 14:39:22.998522 ip-10-0-129-116 kubenswrapper[2546]: W0614 14:39:22.997138 2546 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jun 14 14:39:22.998522 ip-10-0-129-116 kubenswrapper[2546]: W0614 14:39:22.997141 2546 feature_gate.go:328] unrecognized feature gate: NewOLM Jun 14 14:39:22.998522 ip-10-0-129-116 kubenswrapper[2546]: W0614 14:39:22.997143 2546 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jun 14 14:39:22.998522 ip-10-0-129-116 kubenswrapper[2546]: W0614 14:39:22.997148 2546 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jun 14 14:39:22.998522 ip-10-0-129-116 kubenswrapper[2546]: W0614 14:39:22.997150 2546 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jun 14 14:39:22.998522 ip-10-0-129-116 kubenswrapper[2546]: W0614 14:39:22.997153 2546 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jun 14 14:39:22.998522 ip-10-0-129-116 kubenswrapper[2546]: W0614 14:39:22.997156 2546 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jun 14 14:39:22.998522 ip-10-0-129-116 kubenswrapper[2546]: W0614 14:39:22.997159 2546 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jun 14 14:39:22.998522 ip-10-0-129-116 kubenswrapper[2546]: W0614 14:39:22.997161 2546 feature_gate.go:328] unrecognized feature gate: Example2 Jun 14 14:39:22.998522 ip-10-0-129-116 kubenswrapper[2546]: W0614 14:39:22.997164 2546 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jun 14 14:39:22.998522 ip-10-0-129-116 kubenswrapper[2546]: W0614 14:39:22.997166 2546 feature_gate.go:328] unrecognized feature gate: PinnedImages Jun 14 14:39:22.998522 ip-10-0-129-116 kubenswrapper[2546]: W0614 14:39:22.997169 2546 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jun 14 14:39:22.998522 ip-10-0-129-116 kubenswrapper[2546]: W0614 14:39:22.997172 2546 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jun 14 14:39:22.998522 ip-10-0-129-116 kubenswrapper[2546]: W0614 14:39:22.997174 2546 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jun 14 14:39:22.998522 ip-10-0-129-116 kubenswrapper[2546]: W0614 14:39:22.997177 2546 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jun 14 14:39:22.998522 ip-10-0-129-116 kubenswrapper[2546]: W0614 14:39:22.997179 2546 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jun 14 14:39:22.998522 ip-10-0-129-116 kubenswrapper[2546]: W0614 14:39:22.997182 2546 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jun 14 14:39:22.999042 ip-10-0-129-116 kubenswrapper[2546]: W0614 14:39:22.997184 2546 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jun 14 14:39:22.999042 ip-10-0-129-116 kubenswrapper[2546]: W0614 14:39:22.997187 2546 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jun 14 14:39:22.999042 ip-10-0-129-116 kubenswrapper[2546]: W0614 14:39:22.997190 2546 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jun 14 14:39:22.999042 ip-10-0-129-116 kubenswrapper[2546]: W0614 14:39:22.997193 2546 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jun 14 14:39:22.999042 ip-10-0-129-116 kubenswrapper[2546]: W0614 14:39:22.997195 2546 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jun 14 14:39:22.999042 ip-10-0-129-116 kubenswrapper[2546]: W0614 14:39:22.997198 2546 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jun 14 14:39:22.999042 ip-10-0-129-116 kubenswrapper[2546]: W0614 14:39:22.997201 2546 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jun 14 14:39:22.999042 ip-10-0-129-116 kubenswrapper[2546]: W0614 14:39:22.997203 2546 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jun 14 14:39:22.999042 ip-10-0-129-116 kubenswrapper[2546]: W0614 14:39:22.997206 2546 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jun 14 14:39:22.999042 ip-10-0-129-116 kubenswrapper[2546]: W0614 14:39:22.997208 2546 feature_gate.go:328] unrecognized feature gate: Example Jun 14 14:39:22.999042 ip-10-0-129-116 kubenswrapper[2546]: W0614 14:39:22.997211 2546 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jun 14 14:39:22.999042 ip-10-0-129-116 kubenswrapper[2546]: W0614 14:39:22.997214 2546 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jun 14 14:39:22.999042 ip-10-0-129-116 kubenswrapper[2546]: W0614 14:39:22.997217 2546 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jun 14 14:39:22.999042 ip-10-0-129-116 kubenswrapper[2546]: W0614 14:39:22.997220 2546 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jun 14 14:39:22.999042 ip-10-0-129-116 kubenswrapper[2546]: W0614 14:39:22.997223 2546 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jun 14 14:39:22.999042 ip-10-0-129-116 kubenswrapper[2546]: W0614 14:39:22.997225 2546 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jun 14 14:39:22.999042 ip-10-0-129-116 kubenswrapper[2546]: W0614 14:39:22.997924 2546 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jun 14 14:39:22.999042 ip-10-0-129-116 kubenswrapper[2546]: W0614 14:39:22.997930 2546 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jun 14 14:39:22.999042 ip-10-0-129-116 kubenswrapper[2546]: W0614 14:39:22.997933 2546 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jun 14 14:39:22.999042 ip-10-0-129-116 kubenswrapper[2546]: W0614 14:39:22.997936 2546 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jun 14 14:39:22.999534 ip-10-0-129-116 kubenswrapper[2546]: W0614 14:39:22.997939 2546 feature_gate.go:328] unrecognized feature gate: Example Jun 14 14:39:22.999534 ip-10-0-129-116 kubenswrapper[2546]: W0614 14:39:22.997943 2546 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jun 14 14:39:22.999534 ip-10-0-129-116 kubenswrapper[2546]: W0614 14:39:22.997946 2546 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jun 14 14:39:22.999534 ip-10-0-129-116 kubenswrapper[2546]: W0614 14:39:22.997948 2546 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jun 14 14:39:22.999534 ip-10-0-129-116 kubenswrapper[2546]: W0614 14:39:22.997951 2546 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jun 14 14:39:22.999534 ip-10-0-129-116 kubenswrapper[2546]: W0614 14:39:22.997953 2546 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jun 14 14:39:22.999534 ip-10-0-129-116 kubenswrapper[2546]: W0614 14:39:22.997956 2546 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jun 14 14:39:22.999534 ip-10-0-129-116 kubenswrapper[2546]: W0614 14:39:22.997960 2546 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jun 14 14:39:22.999534 ip-10-0-129-116 kubenswrapper[2546]: W0614 14:39:22.997963 2546 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jun 14 14:39:22.999534 ip-10-0-129-116 kubenswrapper[2546]: W0614 14:39:22.997966 2546 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jun 14 14:39:22.999534 ip-10-0-129-116 kubenswrapper[2546]: W0614 14:39:22.997969 2546 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jun 14 14:39:22.999534 ip-10-0-129-116 kubenswrapper[2546]: W0614 14:39:22.997972 2546 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jun 14 14:39:22.999534 ip-10-0-129-116 kubenswrapper[2546]: W0614 14:39:22.997975 2546 feature_gate.go:328] unrecognized feature gate: DualReplica Jun 14 14:39:22.999534 ip-10-0-129-116 kubenswrapper[2546]: W0614 14:39:22.997977 2546 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jun 14 14:39:22.999534 ip-10-0-129-116 kubenswrapper[2546]: W0614 14:39:22.997980 2546 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jun 14 14:39:22.999534 ip-10-0-129-116 kubenswrapper[2546]: W0614 14:39:22.997983 2546 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jun 14 14:39:22.999534 ip-10-0-129-116 kubenswrapper[2546]: W0614 14:39:22.997986 2546 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jun 14 14:39:22.999534 ip-10-0-129-116 kubenswrapper[2546]: W0614 14:39:22.997988 2546 feature_gate.go:328] unrecognized feature gate: SignatureStores Jun 14 14:39:22.999534 ip-10-0-129-116 kubenswrapper[2546]: W0614 14:39:22.997991 2546 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jun 14 14:39:22.999534 ip-10-0-129-116 kubenswrapper[2546]: W0614 14:39:22.997993 2546 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jun 14 14:39:23.000017 ip-10-0-129-116 kubenswrapper[2546]: W0614 14:39:22.997997 2546 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jun 14 14:39:23.000017 ip-10-0-129-116 kubenswrapper[2546]: W0614 14:39:22.997999 2546 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jun 14 14:39:23.000017 ip-10-0-129-116 kubenswrapper[2546]: W0614 14:39:22.998002 2546 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jun 14 14:39:23.000017 ip-10-0-129-116 kubenswrapper[2546]: W0614 14:39:22.998005 2546 feature_gate.go:328] unrecognized feature gate: OVNObservability Jun 14 14:39:23.000017 ip-10-0-129-116 kubenswrapper[2546]: W0614 14:39:22.998008 2546 feature_gate.go:328] unrecognized feature gate: OSStreams Jun 14 14:39:23.000017 ip-10-0-129-116 kubenswrapper[2546]: W0614 14:39:22.998011 2546 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jun 14 14:39:23.000017 ip-10-0-129-116 kubenswrapper[2546]: W0614 14:39:22.998014 2546 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jun 14 14:39:23.000017 ip-10-0-129-116 kubenswrapper[2546]: W0614 14:39:22.998017 2546 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jun 14 14:39:23.000017 ip-10-0-129-116 kubenswrapper[2546]: W0614 14:39:22.998020 2546 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jun 14 14:39:23.000017 ip-10-0-129-116 kubenswrapper[2546]: W0614 14:39:22.998022 2546 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jun 14 14:39:23.000017 ip-10-0-129-116 kubenswrapper[2546]: W0614 14:39:22.998025 2546 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jun 14 14:39:23.000017 ip-10-0-129-116 kubenswrapper[2546]: W0614 14:39:22.998028 2546 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jun 14 14:39:23.000017 ip-10-0-129-116 kubenswrapper[2546]: W0614 14:39:22.998030 2546 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jun 14 14:39:23.000017 ip-10-0-129-116 kubenswrapper[2546]: W0614 14:39:22.998033 2546 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jun 14 14:39:23.000017 ip-10-0-129-116 kubenswrapper[2546]: W0614 14:39:22.998035 2546 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jun 14 14:39:23.000017 ip-10-0-129-116 kubenswrapper[2546]: W0614 14:39:22.998038 2546 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jun 14 14:39:23.000017 ip-10-0-129-116 kubenswrapper[2546]: W0614 14:39:22.998040 2546 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jun 14 14:39:23.000017 ip-10-0-129-116 kubenswrapper[2546]: W0614 14:39:22.998043 2546 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jun 14 14:39:23.000017 ip-10-0-129-116 kubenswrapper[2546]: W0614 14:39:22.998046 2546 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jun 14 14:39:23.000511 ip-10-0-129-116 kubenswrapper[2546]: W0614 14:39:22.998048 2546 feature_gate.go:328] unrecognized feature gate: NewOLM Jun 14 14:39:23.000511 ip-10-0-129-116 kubenswrapper[2546]: W0614 14:39:22.998051 2546 feature_gate.go:328] unrecognized feature gate: Example2 Jun 14 14:39:23.000511 ip-10-0-129-116 kubenswrapper[2546]: W0614 14:39:22.998053 2546 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jun 14 14:39:23.000511 ip-10-0-129-116 kubenswrapper[2546]: W0614 14:39:22.998056 2546 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jun 14 14:39:23.000511 ip-10-0-129-116 kubenswrapper[2546]: W0614 14:39:22.998058 2546 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jun 14 14:39:23.000511 ip-10-0-129-116 kubenswrapper[2546]: W0614 14:39:22.998061 2546 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jun 14 14:39:23.000511 ip-10-0-129-116 kubenswrapper[2546]: W0614 14:39:22.998064 2546 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jun 14 14:39:23.000511 ip-10-0-129-116 kubenswrapper[2546]: W0614 14:39:22.998067 2546 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jun 14 14:39:23.000511 ip-10-0-129-116 kubenswrapper[2546]: W0614 14:39:22.998069 2546 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jun 14 14:39:23.000511 ip-10-0-129-116 kubenswrapper[2546]: W0614 14:39:22.998072 2546 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jun 14 14:39:23.000511 ip-10-0-129-116 kubenswrapper[2546]: W0614 14:39:22.998074 2546 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jun 14 14:39:23.000511 ip-10-0-129-116 kubenswrapper[2546]: W0614 14:39:22.998077 2546 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jun 14 14:39:23.000511 ip-10-0-129-116 kubenswrapper[2546]: W0614 14:39:22.998079 2546 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jun 14 14:39:23.000511 ip-10-0-129-116 kubenswrapper[2546]: W0614 14:39:22.998082 2546 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jun 14 14:39:23.000511 ip-10-0-129-116 kubenswrapper[2546]: W0614 14:39:22.998085 2546 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jun 14 14:39:23.000511 ip-10-0-129-116 kubenswrapper[2546]: W0614 14:39:22.998088 2546 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jun 14 14:39:23.000511 ip-10-0-129-116 kubenswrapper[2546]: W0614 14:39:22.998107 2546 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jun 14 14:39:23.000511 ip-10-0-129-116 kubenswrapper[2546]: W0614 14:39:22.998110 2546 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jun 14 14:39:23.000511 ip-10-0-129-116 kubenswrapper[2546]: W0614 14:39:22.998113 2546 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jun 14 14:39:23.000511 ip-10-0-129-116 kubenswrapper[2546]: W0614 14:39:22.998116 2546 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jun 14 14:39:23.001004 ip-10-0-129-116 kubenswrapper[2546]: W0614 14:39:22.998119 2546 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jun 14 14:39:23.001004 ip-10-0-129-116 kubenswrapper[2546]: W0614 14:39:22.998122 2546 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jun 14 14:39:23.001004 ip-10-0-129-116 kubenswrapper[2546]: W0614 14:39:22.998124 2546 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jun 14 14:39:23.001004 ip-10-0-129-116 kubenswrapper[2546]: W0614 14:39:22.998127 2546 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jun 14 14:39:23.001004 ip-10-0-129-116 kubenswrapper[2546]: W0614 14:39:22.998129 2546 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jun 14 14:39:23.001004 ip-10-0-129-116 kubenswrapper[2546]: W0614 14:39:22.998132 2546 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jun 14 14:39:23.001004 ip-10-0-129-116 kubenswrapper[2546]: W0614 14:39:22.998134 2546 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jun 14 14:39:23.001004 ip-10-0-129-116 kubenswrapper[2546]: W0614 14:39:22.998137 2546 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jun 14 14:39:23.001004 ip-10-0-129-116 kubenswrapper[2546]: W0614 14:39:22.998139 2546 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jun 14 14:39:23.001004 ip-10-0-129-116 kubenswrapper[2546]: W0614 14:39:22.998143 2546 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jun 14 14:39:23.001004 ip-10-0-129-116 kubenswrapper[2546]: W0614 14:39:22.998147 2546 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jun 14 14:39:23.001004 ip-10-0-129-116 kubenswrapper[2546]: W0614 14:39:22.998150 2546 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jun 14 14:39:23.001004 ip-10-0-129-116 kubenswrapper[2546]: W0614 14:39:22.998154 2546 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jun 14 14:39:23.001004 ip-10-0-129-116 kubenswrapper[2546]: W0614 14:39:22.998157 2546 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jun 14 14:39:23.001004 ip-10-0-129-116 kubenswrapper[2546]: W0614 14:39:22.998160 2546 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jun 14 14:39:23.001004 ip-10-0-129-116 kubenswrapper[2546]: W0614 14:39:22.998162 2546 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jun 14 14:39:23.001004 ip-10-0-129-116 kubenswrapper[2546]: W0614 14:39:22.998165 2546 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jun 14 14:39:23.001004 ip-10-0-129-116 kubenswrapper[2546]: W0614 14:39:22.998168 2546 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jun 14 14:39:23.001004 ip-10-0-129-116 kubenswrapper[2546]: W0614 14:39:22.998171 2546 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jun 14 14:39:23.001535 ip-10-0-129-116 kubenswrapper[2546]: W0614 14:39:22.998174 2546 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jun 14 14:39:23.001535 ip-10-0-129-116 kubenswrapper[2546]: W0614 14:39:22.998177 2546 feature_gate.go:328] unrecognized feature gate: EventTTL Jun 14 14:39:23.001535 ip-10-0-129-116 kubenswrapper[2546]: W0614 14:39:22.998180 2546 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jun 14 14:39:23.001535 ip-10-0-129-116 kubenswrapper[2546]: W0614 14:39:22.998183 2546 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jun 14 14:39:23.001535 ip-10-0-129-116 kubenswrapper[2546]: W0614 14:39:22.998187 2546 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jun 14 14:39:23.001535 ip-10-0-129-116 kubenswrapper[2546]: W0614 14:39:22.998190 2546 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jun 14 14:39:23.001535 ip-10-0-129-116 kubenswrapper[2546]: W0614 14:39:22.998192 2546 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jun 14 14:39:23.001535 ip-10-0-129-116 kubenswrapper[2546]: W0614 14:39:22.998195 2546 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jun 14 14:39:23.001535 ip-10-0-129-116 kubenswrapper[2546]: W0614 14:39:22.998197 2546 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jun 14 14:39:23.001535 ip-10-0-129-116 kubenswrapper[2546]: W0614 14:39:22.998200 2546 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jun 14 14:39:23.001535 ip-10-0-129-116 kubenswrapper[2546]: W0614 14:39:22.998203 2546 feature_gate.go:328] unrecognized feature gate: PinnedImages Jun 14 14:39:23.001535 ip-10-0-129-116 kubenswrapper[2546]: W0614 14:39:22.998205 2546 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jun 14 14:39:23.001535 ip-10-0-129-116 kubenswrapper[2546]: W0614 14:39:22.998208 2546 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jun 14 14:39:23.001535 ip-10-0-129-116 kubenswrapper[2546]: W0614 14:39:22.998210 2546 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jun 14 14:39:23.001535 ip-10-0-129-116 kubenswrapper[2546]: W0614 14:39:22.998214 2546 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jun 14 14:39:23.001535 ip-10-0-129-116 kubenswrapper[2546]: W0614 14:39:22.998216 2546 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jun 14 14:39:23.001535 ip-10-0-129-116 kubenswrapper[2546]: W0614 14:39:22.998219 2546 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jun 14 14:39:23.001535 ip-10-0-129-116 kubenswrapper[2546]: W0614 14:39:22.999421 2546 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jun 14 14:39:23.001535 ip-10-0-129-116 kubenswrapper[2546]: W0614 14:39:22.999427 2546 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jun 14 14:39:23.002050 ip-10-0-129-116 kubenswrapper[2546]: W0614 14:39:22.999431 2546 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jun 14 14:39:23.002050 ip-10-0-129-116 kubenswrapper[2546]: W0614 14:39:22.999434 2546 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jun 14 14:39:23.002050 ip-10-0-129-116 kubenswrapper[2546]: W0614 14:39:22.999437 2546 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jun 14 14:39:23.002050 ip-10-0-129-116 kubenswrapper[2546]: W0614 14:39:22.999440 2546 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jun 14 14:39:23.002050 ip-10-0-129-116 kubenswrapper[2546]: W0614 14:39:22.999442 2546 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jun 14 14:39:23.002050 ip-10-0-129-116 kubenswrapper[2546]: W0614 14:39:22.999445 2546 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jun 14 14:39:23.002050 ip-10-0-129-116 kubenswrapper[2546]: W0614 14:39:22.999448 2546 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jun 14 14:39:23.002050 ip-10-0-129-116 kubenswrapper[2546]: W0614 14:39:22.999450 2546 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jun 14 14:39:23.002050 ip-10-0-129-116 kubenswrapper[2546]: W0614 14:39:22.999453 2546 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jun 14 14:39:23.002050 ip-10-0-129-116 kubenswrapper[2546]: W0614 14:39:22.999456 2546 feature_gate.go:328] unrecognized feature gate: OSStreams Jun 14 14:39:23.002050 ip-10-0-129-116 kubenswrapper[2546]: W0614 14:39:22.999458 2546 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jun 14 14:39:23.002050 ip-10-0-129-116 kubenswrapper[2546]: W0614 14:39:22.999461 2546 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jun 14 14:39:23.002050 ip-10-0-129-116 kubenswrapper[2546]: W0614 14:39:22.999464 2546 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jun 14 14:39:23.002050 ip-10-0-129-116 kubenswrapper[2546]: W0614 14:39:22.999467 2546 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jun 14 14:39:23.002050 ip-10-0-129-116 kubenswrapper[2546]: W0614 14:39:22.999474 2546 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jun 14 14:39:23.002050 ip-10-0-129-116 kubenswrapper[2546]: W0614 14:39:22.999477 2546 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jun 14 14:39:23.002050 ip-10-0-129-116 kubenswrapper[2546]: W0614 14:39:22.999479 2546 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jun 14 14:39:23.002050 ip-10-0-129-116 kubenswrapper[2546]: W0614 14:39:22.999482 2546 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jun 14 14:39:23.002050 ip-10-0-129-116 kubenswrapper[2546]: W0614 14:39:22.999485 2546 feature_gate.go:328] unrecognized feature gate: EventTTL Jun 14 14:39:23.002050 ip-10-0-129-116 kubenswrapper[2546]: W0614 14:39:22.999488 2546 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jun 14 14:39:23.002548 ip-10-0-129-116 kubenswrapper[2546]: W0614 14:39:22.999490 2546 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jun 14 14:39:23.002548 ip-10-0-129-116 kubenswrapper[2546]: W0614 14:39:22.999493 2546 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jun 14 14:39:23.002548 ip-10-0-129-116 kubenswrapper[2546]: W0614 14:39:22.999495 2546 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jun 14 14:39:23.002548 ip-10-0-129-116 kubenswrapper[2546]: W0614 14:39:22.999498 2546 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jun 14 14:39:23.002548 ip-10-0-129-116 kubenswrapper[2546]: W0614 14:39:22.999501 2546 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jun 14 14:39:23.002548 ip-10-0-129-116 kubenswrapper[2546]: W0614 14:39:22.999503 2546 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jun 14 14:39:23.002548 ip-10-0-129-116 kubenswrapper[2546]: W0614 14:39:22.999506 2546 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jun 14 14:39:23.002548 ip-10-0-129-116 kubenswrapper[2546]: W0614 14:39:22.999510 2546 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jun 14 14:39:23.002548 ip-10-0-129-116 kubenswrapper[2546]: W0614 14:39:22.999513 2546 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jun 14 14:39:23.002548 ip-10-0-129-116 kubenswrapper[2546]: W0614 14:39:22.999516 2546 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jun 14 14:39:23.002548 ip-10-0-129-116 kubenswrapper[2546]: W0614 14:39:22.999518 2546 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jun 14 14:39:23.002548 ip-10-0-129-116 kubenswrapper[2546]: W0614 14:39:22.999521 2546 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jun 14 14:39:23.002548 ip-10-0-129-116 kubenswrapper[2546]: W0614 14:39:22.999523 2546 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jun 14 14:39:23.002548 ip-10-0-129-116 kubenswrapper[2546]: W0614 14:39:22.999525 2546 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jun 14 14:39:23.002548 ip-10-0-129-116 kubenswrapper[2546]: W0614 14:39:22.999530 2546 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jun 14 14:39:23.002548 ip-10-0-129-116 kubenswrapper[2546]: W0614 14:39:22.999533 2546 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jun 14 14:39:23.002548 ip-10-0-129-116 kubenswrapper[2546]: W0614 14:39:22.999536 2546 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jun 14 14:39:23.002548 ip-10-0-129-116 kubenswrapper[2546]: W0614 14:39:22.999539 2546 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jun 14 14:39:23.002548 ip-10-0-129-116 kubenswrapper[2546]: W0614 14:39:22.999542 2546 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jun 14 14:39:23.003008 ip-10-0-129-116 kubenswrapper[2546]: W0614 14:39:22.999545 2546 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jun 14 14:39:23.003008 ip-10-0-129-116 kubenswrapper[2546]: W0614 14:39:22.999547 2546 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jun 14 14:39:23.003008 ip-10-0-129-116 kubenswrapper[2546]: W0614 14:39:22.999550 2546 feature_gate.go:328] unrecognized feature gate: OVNObservability Jun 14 14:39:23.003008 ip-10-0-129-116 kubenswrapper[2546]: W0614 14:39:22.999554 2546 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jun 14 14:39:23.003008 ip-10-0-129-116 kubenswrapper[2546]: W0614 14:39:22.999557 2546 feature_gate.go:328] unrecognized feature gate: NewOLM Jun 14 14:39:23.003008 ip-10-0-129-116 kubenswrapper[2546]: W0614 14:39:22.999560 2546 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jun 14 14:39:23.003008 ip-10-0-129-116 kubenswrapper[2546]: W0614 14:39:22.999563 2546 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jun 14 14:39:23.003008 ip-10-0-129-116 kubenswrapper[2546]: W0614 14:39:22.999567 2546 feature_gate.go:328] unrecognized feature gate: PinnedImages Jun 14 14:39:23.003008 ip-10-0-129-116 kubenswrapper[2546]: W0614 14:39:22.999570 2546 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jun 14 14:39:23.003008 ip-10-0-129-116 kubenswrapper[2546]: W0614 14:39:22.999573 2546 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jun 14 14:39:23.003008 ip-10-0-129-116 kubenswrapper[2546]: W0614 14:39:22.999575 2546 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jun 14 14:39:23.003008 ip-10-0-129-116 kubenswrapper[2546]: W0614 14:39:22.999578 2546 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jun 14 14:39:23.003008 ip-10-0-129-116 kubenswrapper[2546]: W0614 14:39:22.999580 2546 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jun 14 14:39:23.003008 ip-10-0-129-116 kubenswrapper[2546]: W0614 14:39:22.999583 2546 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jun 14 14:39:23.003008 ip-10-0-129-116 kubenswrapper[2546]: W0614 14:39:22.999585 2546 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jun 14 14:39:23.003008 ip-10-0-129-116 kubenswrapper[2546]: W0614 14:39:22.999588 2546 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jun 14 14:39:23.003008 ip-10-0-129-116 kubenswrapper[2546]: W0614 14:39:22.999592 2546 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jun 14 14:39:23.003008 ip-10-0-129-116 kubenswrapper[2546]: W0614 14:39:22.999595 2546 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jun 14 14:39:23.003008 ip-10-0-129-116 kubenswrapper[2546]: W0614 14:39:22.999598 2546 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jun 14 14:39:23.003490 ip-10-0-129-116 kubenswrapper[2546]: W0614 14:39:22.999601 2546 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jun 14 14:39:23.003490 ip-10-0-129-116 kubenswrapper[2546]: W0614 14:39:22.999604 2546 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jun 14 14:39:23.003490 ip-10-0-129-116 kubenswrapper[2546]: W0614 14:39:22.999607 2546 feature_gate.go:328] unrecognized feature gate: DualReplica Jun 14 14:39:23.003490 ip-10-0-129-116 kubenswrapper[2546]: W0614 14:39:22.999609 2546 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jun 14 14:39:23.003490 ip-10-0-129-116 kubenswrapper[2546]: W0614 14:39:22.999612 2546 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jun 14 14:39:23.003490 ip-10-0-129-116 kubenswrapper[2546]: W0614 14:39:22.999614 2546 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jun 14 14:39:23.003490 ip-10-0-129-116 kubenswrapper[2546]: W0614 14:39:22.999617 2546 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jun 14 14:39:23.003490 ip-10-0-129-116 kubenswrapper[2546]: W0614 14:39:22.999619 2546 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jun 14 14:39:23.003490 ip-10-0-129-116 kubenswrapper[2546]: W0614 14:39:22.999622 2546 feature_gate.go:328] unrecognized feature gate: Example Jun 14 14:39:23.003490 ip-10-0-129-116 kubenswrapper[2546]: W0614 14:39:22.999624 2546 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jun 14 14:39:23.003490 ip-10-0-129-116 kubenswrapper[2546]: W0614 14:39:22.999627 2546 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jun 14 14:39:23.003490 ip-10-0-129-116 kubenswrapper[2546]: W0614 14:39:22.999629 2546 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jun 14 14:39:23.003490 ip-10-0-129-116 kubenswrapper[2546]: W0614 14:39:22.999632 2546 feature_gate.go:328] unrecognized feature gate: SignatureStores Jun 14 14:39:23.003490 ip-10-0-129-116 kubenswrapper[2546]: W0614 14:39:22.999634 2546 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jun 14 14:39:23.003490 ip-10-0-129-116 kubenswrapper[2546]: W0614 14:39:22.999637 2546 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jun 14 14:39:23.003490 ip-10-0-129-116 kubenswrapper[2546]: W0614 14:39:22.999640 2546 feature_gate.go:328] unrecognized feature gate: Example2 Jun 14 14:39:23.003490 ip-10-0-129-116 kubenswrapper[2546]: W0614 14:39:22.999642 2546 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jun 14 14:39:23.003490 ip-10-0-129-116 kubenswrapper[2546]: W0614 14:39:22.999645 2546 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jun 14 14:39:23.003490 ip-10-0-129-116 kubenswrapper[2546]: W0614 14:39:22.999648 2546 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jun 14 14:39:23.003948 ip-10-0-129-116 kubenswrapper[2546]: W0614 14:39:22.999651 2546 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jun 14 14:39:23.003948 ip-10-0-129-116 kubenswrapper[2546]: W0614 14:39:22.999655 2546 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jun 14 14:39:23.003948 ip-10-0-129-116 kubenswrapper[2546]: W0614 14:39:22.999657 2546 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jun 14 14:39:23.003948 ip-10-0-129-116 kubenswrapper[2546]: W0614 14:39:22.999660 2546 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jun 14 14:39:23.003948 ip-10-0-129-116 kubenswrapper[2546]: W0614 14:39:22.999662 2546 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jun 14 14:39:23.003948 ip-10-0-129-116 kubenswrapper[2546]: W0614 14:39:22.999665 2546 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jun 14 14:39:23.003948 ip-10-0-129-116 kubenswrapper[2546]: W0614 14:39:22.999667 2546 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jun 14 14:39:23.003948 ip-10-0-129-116 kubenswrapper[2546]: W0614 14:39:22.999670 2546 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jun 14 14:39:23.003948 ip-10-0-129-116 kubenswrapper[2546]: W0614 14:39:22.999672 2546 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jun 14 14:39:23.003948 ip-10-0-129-116 kubenswrapper[2546]: W0614 14:39:22.999675 2546 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jun 14 14:39:23.003948 ip-10-0-129-116 kubenswrapper[2546]: W0614 14:39:22.999677 2546 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jun 14 14:39:23.003948 ip-10-0-129-116 kubenswrapper[2546]: W0614 14:39:22.999680 2546 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jun 14 14:39:23.003948 ip-10-0-129-116 kubenswrapper[2546]: W0614 14:39:22.999683 2546 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jun 14 14:39:23.003948 ip-10-0-129-116 kubenswrapper[2546]: W0614 14:39:22.999685 2546 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jun 14 14:39:23.003948 ip-10-0-129-116 kubenswrapper[2546]: W0614 14:39:22.999688 2546 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jun 14 14:39:23.003948 ip-10-0-129-116 kubenswrapper[2546]: W0614 14:39:22.999690 2546 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jun 14 14:39:23.003948 ip-10-0-129-116 kubenswrapper[2546]: W0614 14:39:22.999693 2546 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jun 14 14:39:23.003948 ip-10-0-129-116 kubenswrapper[2546]: W0614 14:39:22.999696 2546 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jun 14 14:39:23.003948 ip-10-0-129-116 kubenswrapper[2546]: W0614 14:39:22.999698 2546 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jun 14 14:39:23.003948 ip-10-0-129-116 kubenswrapper[2546]: W0614 14:39:22.999701 2546 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jun 14 14:39:23.004444 ip-10-0-129-116 kubenswrapper[2546]: I0614 14:39:22.999773 2546 flags.go:64] FLAG: --address="0.0.0.0" Jun 14 14:39:23.004444 ip-10-0-129-116 kubenswrapper[2546]: I0614 14:39:22.999782 2546 flags.go:64] FLAG: --allowed-unsafe-sysctls="[]" Jun 14 14:39:23.004444 ip-10-0-129-116 kubenswrapper[2546]: I0614 14:39:22.999791 2546 flags.go:64] FLAG: --anonymous-auth="true" Jun 14 14:39:23.004444 ip-10-0-129-116 kubenswrapper[2546]: I0614 14:39:22.999797 2546 flags.go:64] FLAG: --application-metrics-count-limit="100" Jun 14 14:39:23.004444 ip-10-0-129-116 kubenswrapper[2546]: I0614 14:39:22.999804 2546 flags.go:64] FLAG: --authentication-token-webhook="false" Jun 14 14:39:23.004444 ip-10-0-129-116 kubenswrapper[2546]: I0614 14:39:22.999809 2546 flags.go:64] FLAG: --authentication-token-webhook-cache-ttl="2m0s" Jun 14 14:39:23.004444 ip-10-0-129-116 kubenswrapper[2546]: I0614 14:39:22.999814 2546 flags.go:64] FLAG: --authorization-mode="AlwaysAllow" Jun 14 14:39:23.004444 ip-10-0-129-116 kubenswrapper[2546]: I0614 14:39:22.999819 2546 flags.go:64] FLAG: --authorization-webhook-cache-authorized-ttl="5m0s" Jun 14 14:39:23.004444 ip-10-0-129-116 kubenswrapper[2546]: I0614 14:39:22.999822 2546 flags.go:64] FLAG: --authorization-webhook-cache-unauthorized-ttl="30s" Jun 14 14:39:23.004444 ip-10-0-129-116 kubenswrapper[2546]: I0614 14:39:22.999825 2546 flags.go:64] FLAG: --boot-id-file="/proc/sys/kernel/random/boot_id" Jun 14 14:39:23.004444 ip-10-0-129-116 kubenswrapper[2546]: I0614 14:39:22.999829 2546 flags.go:64] FLAG: --bootstrap-kubeconfig="/etc/kubernetes/kubeconfig" Jun 14 14:39:23.004444 ip-10-0-129-116 kubenswrapper[2546]: I0614 14:39:22.999838 2546 flags.go:64] FLAG: --cert-dir="/var/lib/kubelet/pki" Jun 14 14:39:23.004444 ip-10-0-129-116 kubenswrapper[2546]: I0614 14:39:22.999841 2546 flags.go:64] FLAG: --cgroup-driver="cgroupfs" Jun 14 14:39:23.004444 ip-10-0-129-116 kubenswrapper[2546]: I0614 14:39:22.999845 2546 flags.go:64] FLAG: --cgroup-root="" Jun 14 14:39:23.004444 ip-10-0-129-116 kubenswrapper[2546]: I0614 14:39:22.999848 2546 flags.go:64] FLAG: --cgroups-per-qos="true" Jun 14 14:39:23.004444 ip-10-0-129-116 kubenswrapper[2546]: I0614 14:39:22.999851 2546 flags.go:64] FLAG: --client-ca-file="" Jun 14 14:39:23.004444 ip-10-0-129-116 kubenswrapper[2546]: I0614 14:39:22.999854 2546 flags.go:64] FLAG: --cloud-provider="external" Jun 14 14:39:23.004444 ip-10-0-129-116 kubenswrapper[2546]: I0614 14:39:22.999857 2546 flags.go:64] FLAG: --cluster-dns="[]" Jun 14 14:39:23.004444 ip-10-0-129-116 kubenswrapper[2546]: I0614 14:39:22.999862 2546 flags.go:64] FLAG: --cluster-domain="" Jun 14 14:39:23.004444 ip-10-0-129-116 kubenswrapper[2546]: I0614 14:39:22.999864 2546 flags.go:64] FLAG: --config="/etc/kubernetes/kubelet.conf" Jun 14 14:39:23.004444 ip-10-0-129-116 kubenswrapper[2546]: I0614 14:39:22.999867 2546 flags.go:64] FLAG: --config-dir="/etc/openshift/kubelet.conf.d" Jun 14 14:39:23.004444 ip-10-0-129-116 kubenswrapper[2546]: I0614 14:39:22.999870 2546 flags.go:64] FLAG: --container-hints="/etc/cadvisor/container_hints.json" Jun 14 14:39:23.004444 ip-10-0-129-116 kubenswrapper[2546]: I0614 14:39:22.999874 2546 flags.go:64] FLAG: --container-log-max-files="5" Jun 14 14:39:23.004444 ip-10-0-129-116 kubenswrapper[2546]: I0614 14:39:22.999877 2546 flags.go:64] FLAG: --container-log-max-size="10Mi" Jun 14 14:39:23.005008 ip-10-0-129-116 kubenswrapper[2546]: I0614 14:39:22.999880 2546 flags.go:64] FLAG: --container-runtime-endpoint="/var/run/crio/crio.sock" Jun 14 14:39:23.005008 ip-10-0-129-116 kubenswrapper[2546]: I0614 14:39:22.999883 2546 flags.go:64] FLAG: --containerd="/run/containerd/containerd.sock" Jun 14 14:39:23.005008 ip-10-0-129-116 kubenswrapper[2546]: I0614 14:39:22.999887 2546 flags.go:64] FLAG: --containerd-namespace="k8s.io" Jun 14 14:39:23.005008 ip-10-0-129-116 kubenswrapper[2546]: I0614 14:39:22.999890 2546 flags.go:64] FLAG: --contention-profiling="false" Jun 14 14:39:23.005008 ip-10-0-129-116 kubenswrapper[2546]: I0614 14:39:22.999892 2546 flags.go:64] FLAG: --cpu-cfs-quota="true" Jun 14 14:39:23.005008 ip-10-0-129-116 kubenswrapper[2546]: I0614 14:39:22.999896 2546 flags.go:64] FLAG: --cpu-cfs-quota-period="100ms" Jun 14 14:39:23.005008 ip-10-0-129-116 kubenswrapper[2546]: I0614 14:39:22.999899 2546 flags.go:64] FLAG: --cpu-manager-policy="none" Jun 14 14:39:23.005008 ip-10-0-129-116 kubenswrapper[2546]: I0614 14:39:22.999903 2546 flags.go:64] FLAG: --cpu-manager-policy-options="" Jun 14 14:39:23.005008 ip-10-0-129-116 kubenswrapper[2546]: I0614 14:39:22.999911 2546 flags.go:64] FLAG: --cpu-manager-reconcile-period="10s" Jun 14 14:39:23.005008 ip-10-0-129-116 kubenswrapper[2546]: I0614 14:39:22.999914 2546 flags.go:64] FLAG: --enable-controller-attach-detach="true" Jun 14 14:39:23.005008 ip-10-0-129-116 kubenswrapper[2546]: I0614 14:39:22.999917 2546 flags.go:64] FLAG: --enable-debugging-handlers="true" Jun 14 14:39:23.005008 ip-10-0-129-116 kubenswrapper[2546]: I0614 14:39:22.999920 2546 flags.go:64] FLAG: --enable-load-reader="false" Jun 14 14:39:23.005008 ip-10-0-129-116 kubenswrapper[2546]: I0614 14:39:22.999923 2546 flags.go:64] FLAG: --enable-server="true" Jun 14 14:39:23.005008 ip-10-0-129-116 kubenswrapper[2546]: I0614 14:39:22.999925 2546 flags.go:64] FLAG: --enforce-node-allocatable="[pods]" Jun 14 14:39:23.005008 ip-10-0-129-116 kubenswrapper[2546]: I0614 14:39:22.999929 2546 flags.go:64] FLAG: --event-burst="100" Jun 14 14:39:23.005008 ip-10-0-129-116 kubenswrapper[2546]: I0614 14:39:22.999932 2546 flags.go:64] FLAG: --event-qps="50" Jun 14 14:39:23.005008 ip-10-0-129-116 kubenswrapper[2546]: I0614 14:39:22.999935 2546 flags.go:64] FLAG: --event-storage-age-limit="default=0" Jun 14 14:39:23.005008 ip-10-0-129-116 kubenswrapper[2546]: I0614 14:39:22.999938 2546 flags.go:64] FLAG: --event-storage-event-limit="default=0" Jun 14 14:39:23.005008 ip-10-0-129-116 kubenswrapper[2546]: I0614 14:39:22.999941 2546 flags.go:64] FLAG: --eviction-hard="" Jun 14 14:39:23.005008 ip-10-0-129-116 kubenswrapper[2546]: I0614 14:39:22.999946 2546 flags.go:64] FLAG: --eviction-max-pod-grace-period="0" Jun 14 14:39:23.005008 ip-10-0-129-116 kubenswrapper[2546]: I0614 14:39:22.999949 2546 flags.go:64] FLAG: --eviction-minimum-reclaim="" Jun 14 14:39:23.005008 ip-10-0-129-116 kubenswrapper[2546]: I0614 14:39:22.999953 2546 flags.go:64] FLAG: --eviction-pressure-transition-period="5m0s" Jun 14 14:39:23.005008 ip-10-0-129-116 kubenswrapper[2546]: I0614 14:39:22.999956 2546 flags.go:64] FLAG: --eviction-soft="" Jun 14 14:39:23.005008 ip-10-0-129-116 kubenswrapper[2546]: I0614 14:39:22.999959 2546 flags.go:64] FLAG: --eviction-soft-grace-period="" Jun 14 14:39:23.005008 ip-10-0-129-116 kubenswrapper[2546]: I0614 14:39:22.999962 2546 flags.go:64] FLAG: --exit-on-lock-contention="false" Jun 14 14:39:23.005681 ip-10-0-129-116 kubenswrapper[2546]: I0614 14:39:22.999964 2546 flags.go:64] FLAG: --experimental-allocatable-ignore-eviction="false" Jun 14 14:39:23.005681 ip-10-0-129-116 kubenswrapper[2546]: I0614 14:39:22.999967 2546 flags.go:64] FLAG: --experimental-mounter-path="" Jun 14 14:39:23.005681 ip-10-0-129-116 kubenswrapper[2546]: I0614 14:39:22.999970 2546 flags.go:64] FLAG: --fail-cgroupv1="false" Jun 14 14:39:23.005681 ip-10-0-129-116 kubenswrapper[2546]: I0614 14:39:22.999973 2546 flags.go:64] FLAG: --fail-swap-on="true" Jun 14 14:39:23.005681 ip-10-0-129-116 kubenswrapper[2546]: I0614 14:39:22.999976 2546 flags.go:64] FLAG: --feature-gates="" Jun 14 14:39:23.005681 ip-10-0-129-116 kubenswrapper[2546]: I0614 14:39:22.999980 2546 flags.go:64] FLAG: --file-check-frequency="20s" Jun 14 14:39:23.005681 ip-10-0-129-116 kubenswrapper[2546]: I0614 14:39:22.999982 2546 flags.go:64] FLAG: --global-housekeeping-interval="1m0s" Jun 14 14:39:23.005681 ip-10-0-129-116 kubenswrapper[2546]: I0614 14:39:22.999986 2546 flags.go:64] FLAG: --hairpin-mode="promiscuous-bridge" Jun 14 14:39:23.005681 ip-10-0-129-116 kubenswrapper[2546]: I0614 14:39:22.999989 2546 flags.go:64] FLAG: --healthz-bind-address="127.0.0.1" Jun 14 14:39:23.005681 ip-10-0-129-116 kubenswrapper[2546]: I0614 14:39:22.999992 2546 flags.go:64] FLAG: --healthz-port="10248" Jun 14 14:39:23.005681 ip-10-0-129-116 kubenswrapper[2546]: I0614 14:39:22.999995 2546 flags.go:64] FLAG: --help="false" Jun 14 14:39:23.005681 ip-10-0-129-116 kubenswrapper[2546]: I0614 14:39:22.999997 2546 flags.go:64] FLAG: --hostname-override="ip-10-0-129-116.ec2.internal" Jun 14 14:39:23.005681 ip-10-0-129-116 kubenswrapper[2546]: I0614 14:39:23.000000 2546 flags.go:64] FLAG: --housekeeping-interval="10s" Jun 14 14:39:23.005681 ip-10-0-129-116 kubenswrapper[2546]: I0614 14:39:23.000004 2546 flags.go:64] FLAG: --http-check-frequency="20s" Jun 14 14:39:23.005681 ip-10-0-129-116 kubenswrapper[2546]: I0614 14:39:23.000006 2546 flags.go:64] FLAG: --image-credential-provider-bin-dir="/usr/libexec/kubelet-image-credential-provider-plugins" Jun 14 14:39:23.005681 ip-10-0-129-116 kubenswrapper[2546]: I0614 14:39:23.000010 2546 flags.go:64] FLAG: --image-credential-provider-config="/etc/kubernetes/credential-providers/ecr-credential-provider.yaml" Jun 14 14:39:23.005681 ip-10-0-129-116 kubenswrapper[2546]: I0614 14:39:23.000013 2546 flags.go:64] FLAG: --image-gc-high-threshold="85" Jun 14 14:39:23.005681 ip-10-0-129-116 kubenswrapper[2546]: I0614 14:39:23.000016 2546 flags.go:64] FLAG: --image-gc-low-threshold="80" Jun 14 14:39:23.005681 ip-10-0-129-116 kubenswrapper[2546]: I0614 14:39:23.000018 2546 flags.go:64] FLAG: --image-service-endpoint="" Jun 14 14:39:23.005681 ip-10-0-129-116 kubenswrapper[2546]: I0614 14:39:23.000021 2546 flags.go:64] FLAG: --kernel-memcg-notification="false" Jun 14 14:39:23.005681 ip-10-0-129-116 kubenswrapper[2546]: I0614 14:39:23.000024 2546 flags.go:64] FLAG: --kube-api-burst="100" Jun 14 14:39:23.005681 ip-10-0-129-116 kubenswrapper[2546]: I0614 14:39:23.000027 2546 flags.go:64] FLAG: --kube-api-content-type="application/vnd.kubernetes.protobuf" Jun 14 14:39:23.005681 ip-10-0-129-116 kubenswrapper[2546]: I0614 14:39:23.000030 2546 flags.go:64] FLAG: --kube-api-qps="50" Jun 14 14:39:23.005681 ip-10-0-129-116 kubenswrapper[2546]: I0614 14:39:23.000034 2546 flags.go:64] FLAG: --kube-reserved="" Jun 14 14:39:23.006341 ip-10-0-129-116 kubenswrapper[2546]: I0614 14:39:23.000037 2546 flags.go:64] FLAG: --kube-reserved-cgroup="" Jun 14 14:39:23.006341 ip-10-0-129-116 kubenswrapper[2546]: I0614 14:39:23.000039 2546 flags.go:64] FLAG: --kubeconfig="/var/lib/kubelet/kubeconfig" Jun 14 14:39:23.006341 ip-10-0-129-116 kubenswrapper[2546]: I0614 14:39:23.000043 2546 flags.go:64] FLAG: --kubelet-cgroups="" Jun 14 14:39:23.006341 ip-10-0-129-116 kubenswrapper[2546]: I0614 14:39:23.000047 2546 flags.go:64] FLAG: --local-storage-capacity-isolation="true" Jun 14 14:39:23.006341 ip-10-0-129-116 kubenswrapper[2546]: I0614 14:39:23.000050 2546 flags.go:64] FLAG: --lock-file="" Jun 14 14:39:23.006341 ip-10-0-129-116 kubenswrapper[2546]: I0614 14:39:23.000053 2546 flags.go:64] FLAG: --log-cadvisor-usage="false" Jun 14 14:39:23.006341 ip-10-0-129-116 kubenswrapper[2546]: I0614 14:39:23.000056 2546 flags.go:64] FLAG: --log-flush-frequency="5s" Jun 14 14:39:23.006341 ip-10-0-129-116 kubenswrapper[2546]: I0614 14:39:23.000058 2546 flags.go:64] FLAG: --log-json-info-buffer-size="0" Jun 14 14:39:23.006341 ip-10-0-129-116 kubenswrapper[2546]: I0614 14:39:23.000064 2546 flags.go:64] FLAG: --log-json-split-stream="false" Jun 14 14:39:23.006341 ip-10-0-129-116 kubenswrapper[2546]: I0614 14:39:23.000067 2546 flags.go:64] FLAG: --log-text-info-buffer-size="0" Jun 14 14:39:23.006341 ip-10-0-129-116 kubenswrapper[2546]: I0614 14:39:23.000069 2546 flags.go:64] FLAG: --log-text-split-stream="false" Jun 14 14:39:23.006341 ip-10-0-129-116 kubenswrapper[2546]: I0614 14:39:23.000072 2546 flags.go:64] FLAG: --logging-format="text" Jun 14 14:39:23.006341 ip-10-0-129-116 kubenswrapper[2546]: I0614 14:39:23.000075 2546 flags.go:64] FLAG: --machine-id-file="/etc/machine-id,/var/lib/dbus/machine-id" Jun 14 14:39:23.006341 ip-10-0-129-116 kubenswrapper[2546]: I0614 14:39:23.000078 2546 flags.go:64] FLAG: --make-iptables-util-chains="true" Jun 14 14:39:23.006341 ip-10-0-129-116 kubenswrapper[2546]: I0614 14:39:23.000081 2546 flags.go:64] FLAG: --manifest-url="" Jun 14 14:39:23.006341 ip-10-0-129-116 kubenswrapper[2546]: I0614 14:39:23.000084 2546 flags.go:64] FLAG: --manifest-url-header="" Jun 14 14:39:23.006341 ip-10-0-129-116 kubenswrapper[2546]: I0614 14:39:23.000100 2546 flags.go:64] FLAG: --max-housekeeping-interval="15s" Jun 14 14:39:23.006341 ip-10-0-129-116 kubenswrapper[2546]: I0614 14:39:23.000104 2546 flags.go:64] FLAG: --max-open-files="1000000" Jun 14 14:39:23.006341 ip-10-0-129-116 kubenswrapper[2546]: I0614 14:39:23.000108 2546 flags.go:64] FLAG: --max-pods="110" Jun 14 14:39:23.006341 ip-10-0-129-116 kubenswrapper[2546]: I0614 14:39:23.000110 2546 flags.go:64] FLAG: --maximum-dead-containers="-1" Jun 14 14:39:23.006341 ip-10-0-129-116 kubenswrapper[2546]: I0614 14:39:23.000113 2546 flags.go:64] FLAG: --maximum-dead-containers-per-container="1" Jun 14 14:39:23.006341 ip-10-0-129-116 kubenswrapper[2546]: I0614 14:39:23.000116 2546 flags.go:64] FLAG: --memory-manager-policy="None" Jun 14 14:39:23.006341 ip-10-0-129-116 kubenswrapper[2546]: I0614 14:39:23.000119 2546 flags.go:64] FLAG: --minimum-container-ttl-duration="6m0s" Jun 14 14:39:23.006341 ip-10-0-129-116 kubenswrapper[2546]: I0614 14:39:23.000122 2546 flags.go:64] FLAG: --minimum-image-ttl-duration="2m0s" Jun 14 14:39:23.006341 ip-10-0-129-116 kubenswrapper[2546]: I0614 14:39:23.000125 2546 flags.go:64] FLAG: --node-ip="0.0.0.0" Jun 14 14:39:23.006946 ip-10-0-129-116 kubenswrapper[2546]: I0614 14:39:23.000128 2546 flags.go:64] FLAG: --node-labels="node-role.kubernetes.io/worker=,node.openshift.io/os_id=rhel" Jun 14 14:39:23.006946 ip-10-0-129-116 kubenswrapper[2546]: I0614 14:39:23.000136 2546 flags.go:64] FLAG: --node-status-max-images="50" Jun 14 14:39:23.006946 ip-10-0-129-116 kubenswrapper[2546]: I0614 14:39:23.000139 2546 flags.go:64] FLAG: --node-status-update-frequency="10s" Jun 14 14:39:23.006946 ip-10-0-129-116 kubenswrapper[2546]: I0614 14:39:23.000142 2546 flags.go:64] FLAG: --oom-score-adj="-999" Jun 14 14:39:23.006946 ip-10-0-129-116 kubenswrapper[2546]: I0614 14:39:23.000144 2546 flags.go:64] FLAG: --pod-cidr="" Jun 14 14:39:23.006946 ip-10-0-129-116 kubenswrapper[2546]: I0614 14:39:23.000148 2546 flags.go:64] FLAG: --pod-infra-container-image="quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:4a2e90c8ef7d783e4d635e24fb09435f5e1f6e954583512c0944f9e57bc77b52" Jun 14 14:39:23.006946 ip-10-0-129-116 kubenswrapper[2546]: I0614 14:39:23.000153 2546 flags.go:64] FLAG: --pod-manifest-path="" Jun 14 14:39:23.006946 ip-10-0-129-116 kubenswrapper[2546]: I0614 14:39:23.000156 2546 flags.go:64] FLAG: --pod-max-pids="-1" Jun 14 14:39:23.006946 ip-10-0-129-116 kubenswrapper[2546]: I0614 14:39:23.000159 2546 flags.go:64] FLAG: --pods-per-core="0" Jun 14 14:39:23.006946 ip-10-0-129-116 kubenswrapper[2546]: I0614 14:39:23.000164 2546 flags.go:64] FLAG: --port="10250" Jun 14 14:39:23.006946 ip-10-0-129-116 kubenswrapper[2546]: I0614 14:39:23.000167 2546 flags.go:64] FLAG: --protect-kernel-defaults="false" Jun 14 14:39:23.006946 ip-10-0-129-116 kubenswrapper[2546]: I0614 14:39:23.000170 2546 flags.go:64] FLAG: --provider-id="aws:///us-east-1a/i-004c55b4d904108e4" Jun 14 14:39:23.006946 ip-10-0-129-116 kubenswrapper[2546]: I0614 14:39:23.000174 2546 flags.go:64] FLAG: --qos-reserved="" Jun 14 14:39:23.006946 ip-10-0-129-116 kubenswrapper[2546]: I0614 14:39:23.000177 2546 flags.go:64] FLAG: --read-only-port="10255" Jun 14 14:39:23.006946 ip-10-0-129-116 kubenswrapper[2546]: I0614 14:39:23.000180 2546 flags.go:64] FLAG: --register-node="true" Jun 14 14:39:23.006946 ip-10-0-129-116 kubenswrapper[2546]: I0614 14:39:23.000183 2546 flags.go:64] FLAG: --register-with-taints="" Jun 14 14:39:23.006946 ip-10-0-129-116 kubenswrapper[2546]: I0614 14:39:23.000186 2546 flags.go:64] FLAG: --registry-burst="10" Jun 14 14:39:23.006946 ip-10-0-129-116 kubenswrapper[2546]: I0614 14:39:23.000189 2546 flags.go:64] FLAG: --registry-qps="5" Jun 14 14:39:23.006946 ip-10-0-129-116 kubenswrapper[2546]: I0614 14:39:23.000192 2546 flags.go:64] FLAG: --reserved-cpus="" Jun 14 14:39:23.006946 ip-10-0-129-116 kubenswrapper[2546]: I0614 14:39:23.000195 2546 flags.go:64] FLAG: --reserved-memory="" Jun 14 14:39:23.006946 ip-10-0-129-116 kubenswrapper[2546]: I0614 14:39:23.000198 2546 flags.go:64] FLAG: --resolv-conf="/etc/resolv.conf" Jun 14 14:39:23.006946 ip-10-0-129-116 kubenswrapper[2546]: I0614 14:39:23.000201 2546 flags.go:64] FLAG: --root-dir="/var/lib/kubelet" Jun 14 14:39:23.006946 ip-10-0-129-116 kubenswrapper[2546]: I0614 14:39:23.000204 2546 flags.go:64] FLAG: --rotate-certificates="false" Jun 14 14:39:23.006946 ip-10-0-129-116 kubenswrapper[2546]: I0614 14:39:23.000207 2546 flags.go:64] FLAG: --rotate-server-certificates="false" Jun 14 14:39:23.006946 ip-10-0-129-116 kubenswrapper[2546]: I0614 14:39:23.000210 2546 flags.go:64] FLAG: --runonce="false" Jun 14 14:39:23.007895 ip-10-0-129-116 kubenswrapper[2546]: I0614 14:39:23.000212 2546 flags.go:64] FLAG: --runtime-cgroups="/system.slice/crio.service" Jun 14 14:39:23.007895 ip-10-0-129-116 kubenswrapper[2546]: I0614 14:39:23.000215 2546 flags.go:64] FLAG: --runtime-request-timeout="2m0s" Jun 14 14:39:23.007895 ip-10-0-129-116 kubenswrapper[2546]: I0614 14:39:23.000218 2546 flags.go:64] FLAG: --seccomp-default="false" Jun 14 14:39:23.007895 ip-10-0-129-116 kubenswrapper[2546]: I0614 14:39:23.000221 2546 flags.go:64] FLAG: --serialize-image-pulls="true" Jun 14 14:39:23.007895 ip-10-0-129-116 kubenswrapper[2546]: I0614 14:39:23.000224 2546 flags.go:64] FLAG: --storage-driver-buffer-duration="1m0s" Jun 14 14:39:23.007895 ip-10-0-129-116 kubenswrapper[2546]: I0614 14:39:23.000227 2546 flags.go:64] FLAG: --storage-driver-db="cadvisor" Jun 14 14:39:23.007895 ip-10-0-129-116 kubenswrapper[2546]: I0614 14:39:23.000230 2546 flags.go:64] FLAG: --storage-driver-host="localhost:8086" Jun 14 14:39:23.007895 ip-10-0-129-116 kubenswrapper[2546]: I0614 14:39:23.000233 2546 flags.go:64] FLAG: --storage-driver-password="root" Jun 14 14:39:23.007895 ip-10-0-129-116 kubenswrapper[2546]: I0614 14:39:23.000236 2546 flags.go:64] FLAG: --storage-driver-secure="false" Jun 14 14:39:23.007895 ip-10-0-129-116 kubenswrapper[2546]: I0614 14:39:23.000239 2546 flags.go:64] FLAG: --storage-driver-table="stats" Jun 14 14:39:23.007895 ip-10-0-129-116 kubenswrapper[2546]: I0614 14:39:23.000241 2546 flags.go:64] FLAG: --storage-driver-user="root" Jun 14 14:39:23.007895 ip-10-0-129-116 kubenswrapper[2546]: I0614 14:39:23.000244 2546 flags.go:64] FLAG: --streaming-connection-idle-timeout="4h0m0s" Jun 14 14:39:23.007895 ip-10-0-129-116 kubenswrapper[2546]: I0614 14:39:23.000247 2546 flags.go:64] FLAG: --sync-frequency="1m0s" Jun 14 14:39:23.007895 ip-10-0-129-116 kubenswrapper[2546]: I0614 14:39:23.000250 2546 flags.go:64] FLAG: --system-cgroups="" Jun 14 14:39:23.007895 ip-10-0-129-116 kubenswrapper[2546]: I0614 14:39:23.000253 2546 flags.go:64] FLAG: --system-reserved="cpu=500m,ephemeral-storage=1Gi,memory=1Gi" Jun 14 14:39:23.007895 ip-10-0-129-116 kubenswrapper[2546]: I0614 14:39:23.000258 2546 flags.go:64] FLAG: --system-reserved-cgroup="" Jun 14 14:39:23.007895 ip-10-0-129-116 kubenswrapper[2546]: I0614 14:39:23.000262 2546 flags.go:64] FLAG: --tls-cert-file="" Jun 14 14:39:23.007895 ip-10-0-129-116 kubenswrapper[2546]: I0614 14:39:23.000265 2546 flags.go:64] FLAG: --tls-cipher-suites="[]" Jun 14 14:39:23.007895 ip-10-0-129-116 kubenswrapper[2546]: I0614 14:39:23.000268 2546 flags.go:64] FLAG: --tls-min-version="" Jun 14 14:39:23.007895 ip-10-0-129-116 kubenswrapper[2546]: I0614 14:39:23.000271 2546 flags.go:64] FLAG: --tls-private-key-file="" Jun 14 14:39:23.007895 ip-10-0-129-116 kubenswrapper[2546]: I0614 14:39:23.000274 2546 flags.go:64] FLAG: --topology-manager-policy="none" Jun 14 14:39:23.007895 ip-10-0-129-116 kubenswrapper[2546]: I0614 14:39:23.000277 2546 flags.go:64] FLAG: --topology-manager-policy-options="" Jun 14 14:39:23.007895 ip-10-0-129-116 kubenswrapper[2546]: I0614 14:39:23.000280 2546 flags.go:64] FLAG: --topology-manager-scope="container" Jun 14 14:39:23.007895 ip-10-0-129-116 kubenswrapper[2546]: I0614 14:39:23.000282 2546 flags.go:64] FLAG: --v="2" Jun 14 14:39:23.007895 ip-10-0-129-116 kubenswrapper[2546]: I0614 14:39:23.000286 2546 flags.go:64] FLAG: --version="false" Jun 14 14:39:23.008935 ip-10-0-129-116 kubenswrapper[2546]: I0614 14:39:23.000290 2546 flags.go:64] FLAG: --vmodule="" Jun 14 14:39:23.008935 ip-10-0-129-116 kubenswrapper[2546]: I0614 14:39:23.000294 2546 flags.go:64] FLAG: --volume-plugin-dir="/etc/kubernetes/kubelet-plugins/volume/exec" Jun 14 14:39:23.008935 ip-10-0-129-116 kubenswrapper[2546]: I0614 14:39:23.000297 2546 flags.go:64] FLAG: --volume-stats-agg-period="1m0s" Jun 14 14:39:23.008935 ip-10-0-129-116 kubenswrapper[2546]: W0614 14:39:23.000424 2546 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jun 14 14:39:23.008935 ip-10-0-129-116 kubenswrapper[2546]: W0614 14:39:23.000428 2546 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jun 14 14:39:23.008935 ip-10-0-129-116 kubenswrapper[2546]: W0614 14:39:23.000431 2546 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jun 14 14:39:23.008935 ip-10-0-129-116 kubenswrapper[2546]: W0614 14:39:23.000434 2546 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jun 14 14:39:23.008935 ip-10-0-129-116 kubenswrapper[2546]: W0614 14:39:23.000437 2546 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jun 14 14:39:23.008935 ip-10-0-129-116 kubenswrapper[2546]: W0614 14:39:23.000440 2546 feature_gate.go:328] unrecognized feature gate: DualReplica Jun 14 14:39:23.008935 ip-10-0-129-116 kubenswrapper[2546]: W0614 14:39:23.000442 2546 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jun 14 14:39:23.008935 ip-10-0-129-116 kubenswrapper[2546]: W0614 14:39:23.000445 2546 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jun 14 14:39:23.008935 ip-10-0-129-116 kubenswrapper[2546]: W0614 14:39:23.000448 2546 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jun 14 14:39:23.008935 ip-10-0-129-116 kubenswrapper[2546]: W0614 14:39:23.000451 2546 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jun 14 14:39:23.008935 ip-10-0-129-116 kubenswrapper[2546]: W0614 14:39:23.000454 2546 feature_gate.go:328] unrecognized feature gate: NewOLM Jun 14 14:39:23.008935 ip-10-0-129-116 kubenswrapper[2546]: W0614 14:39:23.000456 2546 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jun 14 14:39:23.008935 ip-10-0-129-116 kubenswrapper[2546]: W0614 14:39:23.000459 2546 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jun 14 14:39:23.008935 ip-10-0-129-116 kubenswrapper[2546]: W0614 14:39:23.000462 2546 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jun 14 14:39:23.008935 ip-10-0-129-116 kubenswrapper[2546]: W0614 14:39:23.000464 2546 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jun 14 14:39:23.008935 ip-10-0-129-116 kubenswrapper[2546]: W0614 14:39:23.000467 2546 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jun 14 14:39:23.008935 ip-10-0-129-116 kubenswrapper[2546]: W0614 14:39:23.000470 2546 feature_gate.go:328] unrecognized feature gate: SignatureStores Jun 14 14:39:23.008935 ip-10-0-129-116 kubenswrapper[2546]: W0614 14:39:23.000472 2546 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jun 14 14:39:23.009678 ip-10-0-129-116 kubenswrapper[2546]: W0614 14:39:23.000475 2546 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jun 14 14:39:23.009678 ip-10-0-129-116 kubenswrapper[2546]: W0614 14:39:23.000477 2546 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jun 14 14:39:23.009678 ip-10-0-129-116 kubenswrapper[2546]: W0614 14:39:23.000481 2546 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jun 14 14:39:23.009678 ip-10-0-129-116 kubenswrapper[2546]: W0614 14:39:23.000483 2546 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jun 14 14:39:23.009678 ip-10-0-129-116 kubenswrapper[2546]: W0614 14:39:23.000486 2546 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jun 14 14:39:23.009678 ip-10-0-129-116 kubenswrapper[2546]: W0614 14:39:23.000488 2546 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jun 14 14:39:23.009678 ip-10-0-129-116 kubenswrapper[2546]: W0614 14:39:23.000491 2546 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jun 14 14:39:23.009678 ip-10-0-129-116 kubenswrapper[2546]: W0614 14:39:23.000493 2546 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jun 14 14:39:23.009678 ip-10-0-129-116 kubenswrapper[2546]: W0614 14:39:23.000496 2546 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jun 14 14:39:23.009678 ip-10-0-129-116 kubenswrapper[2546]: W0614 14:39:23.000498 2546 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jun 14 14:39:23.009678 ip-10-0-129-116 kubenswrapper[2546]: W0614 14:39:23.000501 2546 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jun 14 14:39:23.009678 ip-10-0-129-116 kubenswrapper[2546]: W0614 14:39:23.000503 2546 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jun 14 14:39:23.009678 ip-10-0-129-116 kubenswrapper[2546]: W0614 14:39:23.000506 2546 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jun 14 14:39:23.009678 ip-10-0-129-116 kubenswrapper[2546]: W0614 14:39:23.000508 2546 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jun 14 14:39:23.009678 ip-10-0-129-116 kubenswrapper[2546]: W0614 14:39:23.000511 2546 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jun 14 14:39:23.009678 ip-10-0-129-116 kubenswrapper[2546]: W0614 14:39:23.000514 2546 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jun 14 14:39:23.009678 ip-10-0-129-116 kubenswrapper[2546]: W0614 14:39:23.000516 2546 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jun 14 14:39:23.009678 ip-10-0-129-116 kubenswrapper[2546]: W0614 14:39:23.000519 2546 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jun 14 14:39:23.009678 ip-10-0-129-116 kubenswrapper[2546]: W0614 14:39:23.000522 2546 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jun 14 14:39:23.009678 ip-10-0-129-116 kubenswrapper[2546]: W0614 14:39:23.000524 2546 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jun 14 14:39:23.010208 ip-10-0-129-116 kubenswrapper[2546]: W0614 14:39:23.000527 2546 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jun 14 14:39:23.010208 ip-10-0-129-116 kubenswrapper[2546]: W0614 14:39:23.000529 2546 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jun 14 14:39:23.010208 ip-10-0-129-116 kubenswrapper[2546]: W0614 14:39:23.000532 2546 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jun 14 14:39:23.010208 ip-10-0-129-116 kubenswrapper[2546]: W0614 14:39:23.000535 2546 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jun 14 14:39:23.010208 ip-10-0-129-116 kubenswrapper[2546]: W0614 14:39:23.000538 2546 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jun 14 14:39:23.010208 ip-10-0-129-116 kubenswrapper[2546]: W0614 14:39:23.000541 2546 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jun 14 14:39:23.010208 ip-10-0-129-116 kubenswrapper[2546]: W0614 14:39:23.000543 2546 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jun 14 14:39:23.010208 ip-10-0-129-116 kubenswrapper[2546]: W0614 14:39:23.000546 2546 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jun 14 14:39:23.010208 ip-10-0-129-116 kubenswrapper[2546]: W0614 14:39:23.000548 2546 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jun 14 14:39:23.010208 ip-10-0-129-116 kubenswrapper[2546]: W0614 14:39:23.000551 2546 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jun 14 14:39:23.010208 ip-10-0-129-116 kubenswrapper[2546]: W0614 14:39:23.000553 2546 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jun 14 14:39:23.010208 ip-10-0-129-116 kubenswrapper[2546]: W0614 14:39:23.000557 2546 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jun 14 14:39:23.010208 ip-10-0-129-116 kubenswrapper[2546]: W0614 14:39:23.000559 2546 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jun 14 14:39:23.010208 ip-10-0-129-116 kubenswrapper[2546]: W0614 14:39:23.000562 2546 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jun 14 14:39:23.010208 ip-10-0-129-116 kubenswrapper[2546]: W0614 14:39:23.000565 2546 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jun 14 14:39:23.010208 ip-10-0-129-116 kubenswrapper[2546]: W0614 14:39:23.000568 2546 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jun 14 14:39:23.010208 ip-10-0-129-116 kubenswrapper[2546]: W0614 14:39:23.000570 2546 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jun 14 14:39:23.010208 ip-10-0-129-116 kubenswrapper[2546]: W0614 14:39:23.000574 2546 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jun 14 14:39:23.010208 ip-10-0-129-116 kubenswrapper[2546]: W0614 14:39:23.000577 2546 feature_gate.go:328] unrecognized feature gate: Example2 Jun 14 14:39:23.010208 ip-10-0-129-116 kubenswrapper[2546]: W0614 14:39:23.000580 2546 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jun 14 14:39:23.010708 ip-10-0-129-116 kubenswrapper[2546]: W0614 14:39:23.000583 2546 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jun 14 14:39:23.010708 ip-10-0-129-116 kubenswrapper[2546]: W0614 14:39:23.000585 2546 feature_gate.go:328] unrecognized feature gate: Example Jun 14 14:39:23.010708 ip-10-0-129-116 kubenswrapper[2546]: W0614 14:39:23.000588 2546 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jun 14 14:39:23.010708 ip-10-0-129-116 kubenswrapper[2546]: W0614 14:39:23.000590 2546 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jun 14 14:39:23.010708 ip-10-0-129-116 kubenswrapper[2546]: W0614 14:39:23.000593 2546 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jun 14 14:39:23.010708 ip-10-0-129-116 kubenswrapper[2546]: W0614 14:39:23.000595 2546 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jun 14 14:39:23.010708 ip-10-0-129-116 kubenswrapper[2546]: W0614 14:39:23.000598 2546 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jun 14 14:39:23.010708 ip-10-0-129-116 kubenswrapper[2546]: W0614 14:39:23.000601 2546 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jun 14 14:39:23.010708 ip-10-0-129-116 kubenswrapper[2546]: W0614 14:39:23.000603 2546 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jun 14 14:39:23.010708 ip-10-0-129-116 kubenswrapper[2546]: W0614 14:39:23.000606 2546 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jun 14 14:39:23.010708 ip-10-0-129-116 kubenswrapper[2546]: W0614 14:39:23.000608 2546 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jun 14 14:39:23.010708 ip-10-0-129-116 kubenswrapper[2546]: W0614 14:39:23.000611 2546 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jun 14 14:39:23.010708 ip-10-0-129-116 kubenswrapper[2546]: W0614 14:39:23.000613 2546 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jun 14 14:39:23.010708 ip-10-0-129-116 kubenswrapper[2546]: W0614 14:39:23.000616 2546 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jun 14 14:39:23.010708 ip-10-0-129-116 kubenswrapper[2546]: W0614 14:39:23.000618 2546 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jun 14 14:39:23.010708 ip-10-0-129-116 kubenswrapper[2546]: W0614 14:39:23.000621 2546 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jun 14 14:39:23.010708 ip-10-0-129-116 kubenswrapper[2546]: W0614 14:39:23.000623 2546 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jun 14 14:39:23.010708 ip-10-0-129-116 kubenswrapper[2546]: W0614 14:39:23.000626 2546 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jun 14 14:39:23.010708 ip-10-0-129-116 kubenswrapper[2546]: W0614 14:39:23.000629 2546 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jun 14 14:39:23.011197 ip-10-0-129-116 kubenswrapper[2546]: W0614 14:39:23.000632 2546 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jun 14 14:39:23.011197 ip-10-0-129-116 kubenswrapper[2546]: W0614 14:39:23.000634 2546 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jun 14 14:39:23.011197 ip-10-0-129-116 kubenswrapper[2546]: W0614 14:39:23.000637 2546 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jun 14 14:39:23.011197 ip-10-0-129-116 kubenswrapper[2546]: W0614 14:39:23.000639 2546 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jun 14 14:39:23.011197 ip-10-0-129-116 kubenswrapper[2546]: W0614 14:39:23.000643 2546 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jun 14 14:39:23.011197 ip-10-0-129-116 kubenswrapper[2546]: W0614 14:39:23.000645 2546 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jun 14 14:39:23.011197 ip-10-0-129-116 kubenswrapper[2546]: W0614 14:39:23.000648 2546 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jun 14 14:39:23.011197 ip-10-0-129-116 kubenswrapper[2546]: W0614 14:39:23.000650 2546 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jun 14 14:39:23.011197 ip-10-0-129-116 kubenswrapper[2546]: W0614 14:39:23.000653 2546 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jun 14 14:39:23.011197 ip-10-0-129-116 kubenswrapper[2546]: W0614 14:39:23.000657 2546 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jun 14 14:39:23.011197 ip-10-0-129-116 kubenswrapper[2546]: W0614 14:39:23.000661 2546 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jun 14 14:39:23.011197 ip-10-0-129-116 kubenswrapper[2546]: W0614 14:39:23.000664 2546 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jun 14 14:39:23.011197 ip-10-0-129-116 kubenswrapper[2546]: W0614 14:39:23.000667 2546 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jun 14 14:39:23.011197 ip-10-0-129-116 kubenswrapper[2546]: W0614 14:39:23.000671 2546 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jun 14 14:39:23.011197 ip-10-0-129-116 kubenswrapper[2546]: W0614 14:39:23.000674 2546 feature_gate.go:328] unrecognized feature gate: OSStreams Jun 14 14:39:23.011197 ip-10-0-129-116 kubenswrapper[2546]: W0614 14:39:23.000677 2546 feature_gate.go:328] unrecognized feature gate: PinnedImages Jun 14 14:39:23.011197 ip-10-0-129-116 kubenswrapper[2546]: W0614 14:39:23.000680 2546 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jun 14 14:39:23.011197 ip-10-0-129-116 kubenswrapper[2546]: W0614 14:39:23.000683 2546 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jun 14 14:39:23.011197 ip-10-0-129-116 kubenswrapper[2546]: W0614 14:39:23.000685 2546 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jun 14 14:39:23.011689 ip-10-0-129-116 kubenswrapper[2546]: W0614 14:39:23.000688 2546 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jun 14 14:39:23.011689 ip-10-0-129-116 kubenswrapper[2546]: W0614 14:39:23.000691 2546 feature_gate.go:328] unrecognized feature gate: OVNObservability Jun 14 14:39:23.011689 ip-10-0-129-116 kubenswrapper[2546]: W0614 14:39:23.000694 2546 feature_gate.go:328] unrecognized feature gate: EventTTL Jun 14 14:39:23.011689 ip-10-0-129-116 kubenswrapper[2546]: I0614 14:39:23.001565 2546 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]} Jun 14 14:39:23.011689 ip-10-0-129-116 kubenswrapper[2546]: I0614 14:39:23.010685 2546 server.go:529] "Kubelet version" kubeletVersion="v1.34.8" Jun 14 14:39:23.011689 ip-10-0-129-116 kubenswrapper[2546]: I0614 14:39:23.010702 2546 server.go:531] "Golang settings" GOGC="" GOMAXPROCS="" GOTRACEBACK="" Jun 14 14:39:23.011689 ip-10-0-129-116 kubenswrapper[2546]: I0614 14:39:23.010723 2546 watchdog_linux.go:95] "Systemd watchdog is not enabled" Jun 14 14:39:23.011689 ip-10-0-129-116 kubenswrapper[2546]: I0614 14:39:23.010732 2546 watchdog_linux.go:137] "Systemd watchdog is not enabled or the interval is invalid, so health checking will not be started." Jun 14 14:39:23.011689 ip-10-0-129-116 kubenswrapper[2546]: W0614 14:39:23.010791 2546 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jun 14 14:39:23.011689 ip-10-0-129-116 kubenswrapper[2546]: W0614 14:39:23.010795 2546 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jun 14 14:39:23.011689 ip-10-0-129-116 kubenswrapper[2546]: W0614 14:39:23.010798 2546 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jun 14 14:39:23.011689 ip-10-0-129-116 kubenswrapper[2546]: W0614 14:39:23.010802 2546 feature_gate.go:328] unrecognized feature gate: OSStreams Jun 14 14:39:23.011689 ip-10-0-129-116 kubenswrapper[2546]: W0614 14:39:23.010805 2546 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jun 14 14:39:23.011689 ip-10-0-129-116 kubenswrapper[2546]: W0614 14:39:23.010808 2546 feature_gate.go:328] unrecognized feature gate: OVNObservability Jun 14 14:39:23.011689 ip-10-0-129-116 kubenswrapper[2546]: W0614 14:39:23.010811 2546 feature_gate.go:328] unrecognized feature gate: PinnedImages Jun 14 14:39:23.012068 ip-10-0-129-116 kubenswrapper[2546]: W0614 14:39:23.010813 2546 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jun 14 14:39:23.012068 ip-10-0-129-116 kubenswrapper[2546]: W0614 14:39:23.010816 2546 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jun 14 14:39:23.012068 ip-10-0-129-116 kubenswrapper[2546]: W0614 14:39:23.010818 2546 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jun 14 14:39:23.012068 ip-10-0-129-116 kubenswrapper[2546]: W0614 14:39:23.010821 2546 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jun 14 14:39:23.012068 ip-10-0-129-116 kubenswrapper[2546]: W0614 14:39:23.010824 2546 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jun 14 14:39:23.012068 ip-10-0-129-116 kubenswrapper[2546]: W0614 14:39:23.010828 2546 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jun 14 14:39:23.012068 ip-10-0-129-116 kubenswrapper[2546]: W0614 14:39:23.010832 2546 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jun 14 14:39:23.012068 ip-10-0-129-116 kubenswrapper[2546]: W0614 14:39:23.010836 2546 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jun 14 14:39:23.012068 ip-10-0-129-116 kubenswrapper[2546]: W0614 14:39:23.010840 2546 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jun 14 14:39:23.012068 ip-10-0-129-116 kubenswrapper[2546]: W0614 14:39:23.010842 2546 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jun 14 14:39:23.012068 ip-10-0-129-116 kubenswrapper[2546]: W0614 14:39:23.010846 2546 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jun 14 14:39:23.012068 ip-10-0-129-116 kubenswrapper[2546]: W0614 14:39:23.010848 2546 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jun 14 14:39:23.012068 ip-10-0-129-116 kubenswrapper[2546]: W0614 14:39:23.010852 2546 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jun 14 14:39:23.012068 ip-10-0-129-116 kubenswrapper[2546]: W0614 14:39:23.010856 2546 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jun 14 14:39:23.012068 ip-10-0-129-116 kubenswrapper[2546]: W0614 14:39:23.010859 2546 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jun 14 14:39:23.012068 ip-10-0-129-116 kubenswrapper[2546]: W0614 14:39:23.010862 2546 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jun 14 14:39:23.012068 ip-10-0-129-116 kubenswrapper[2546]: W0614 14:39:23.010864 2546 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jun 14 14:39:23.012068 ip-10-0-129-116 kubenswrapper[2546]: W0614 14:39:23.010867 2546 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jun 14 14:39:23.012068 ip-10-0-129-116 kubenswrapper[2546]: W0614 14:39:23.010870 2546 feature_gate.go:328] unrecognized feature gate: DualReplica Jun 14 14:39:23.012547 ip-10-0-129-116 kubenswrapper[2546]: W0614 14:39:23.010873 2546 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jun 14 14:39:23.012547 ip-10-0-129-116 kubenswrapper[2546]: W0614 14:39:23.010875 2546 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jun 14 14:39:23.012547 ip-10-0-129-116 kubenswrapper[2546]: W0614 14:39:23.010878 2546 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jun 14 14:39:23.012547 ip-10-0-129-116 kubenswrapper[2546]: W0614 14:39:23.010882 2546 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jun 14 14:39:23.012547 ip-10-0-129-116 kubenswrapper[2546]: W0614 14:39:23.010884 2546 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jun 14 14:39:23.012547 ip-10-0-129-116 kubenswrapper[2546]: W0614 14:39:23.010887 2546 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jun 14 14:39:23.012547 ip-10-0-129-116 kubenswrapper[2546]: W0614 14:39:23.010890 2546 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jun 14 14:39:23.012547 ip-10-0-129-116 kubenswrapper[2546]: W0614 14:39:23.010893 2546 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jun 14 14:39:23.012547 ip-10-0-129-116 kubenswrapper[2546]: W0614 14:39:23.010896 2546 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jun 14 14:39:23.012547 ip-10-0-129-116 kubenswrapper[2546]: W0614 14:39:23.010898 2546 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jun 14 14:39:23.012547 ip-10-0-129-116 kubenswrapper[2546]: W0614 14:39:23.010901 2546 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jun 14 14:39:23.012547 ip-10-0-129-116 kubenswrapper[2546]: W0614 14:39:23.010903 2546 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jun 14 14:39:23.012547 ip-10-0-129-116 kubenswrapper[2546]: W0614 14:39:23.010906 2546 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jun 14 14:39:23.012547 ip-10-0-129-116 kubenswrapper[2546]: W0614 14:39:23.010909 2546 feature_gate.go:328] unrecognized feature gate: EventTTL Jun 14 14:39:23.012547 ip-10-0-129-116 kubenswrapper[2546]: W0614 14:39:23.010911 2546 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jun 14 14:39:23.012547 ip-10-0-129-116 kubenswrapper[2546]: W0614 14:39:23.010914 2546 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jun 14 14:39:23.012547 ip-10-0-129-116 kubenswrapper[2546]: W0614 14:39:23.010916 2546 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jun 14 14:39:23.012547 ip-10-0-129-116 kubenswrapper[2546]: W0614 14:39:23.010919 2546 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jun 14 14:39:23.012547 ip-10-0-129-116 kubenswrapper[2546]: W0614 14:39:23.010922 2546 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jun 14 14:39:23.012547 ip-10-0-129-116 kubenswrapper[2546]: W0614 14:39:23.010925 2546 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jun 14 14:39:23.013016 ip-10-0-129-116 kubenswrapper[2546]: W0614 14:39:23.010927 2546 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jun 14 14:39:23.013016 ip-10-0-129-116 kubenswrapper[2546]: W0614 14:39:23.010930 2546 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jun 14 14:39:23.013016 ip-10-0-129-116 kubenswrapper[2546]: W0614 14:39:23.010933 2546 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jun 14 14:39:23.013016 ip-10-0-129-116 kubenswrapper[2546]: W0614 14:39:23.010935 2546 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jun 14 14:39:23.013016 ip-10-0-129-116 kubenswrapper[2546]: W0614 14:39:23.010938 2546 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jun 14 14:39:23.013016 ip-10-0-129-116 kubenswrapper[2546]: W0614 14:39:23.010940 2546 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jun 14 14:39:23.013016 ip-10-0-129-116 kubenswrapper[2546]: W0614 14:39:23.010942 2546 feature_gate.go:328] unrecognized feature gate: Example2 Jun 14 14:39:23.013016 ip-10-0-129-116 kubenswrapper[2546]: W0614 14:39:23.010946 2546 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jun 14 14:39:23.013016 ip-10-0-129-116 kubenswrapper[2546]: W0614 14:39:23.010948 2546 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jun 14 14:39:23.013016 ip-10-0-129-116 kubenswrapper[2546]: W0614 14:39:23.010951 2546 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jun 14 14:39:23.013016 ip-10-0-129-116 kubenswrapper[2546]: W0614 14:39:23.010954 2546 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jun 14 14:39:23.013016 ip-10-0-129-116 kubenswrapper[2546]: W0614 14:39:23.010957 2546 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jun 14 14:39:23.013016 ip-10-0-129-116 kubenswrapper[2546]: W0614 14:39:23.010959 2546 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jun 14 14:39:23.013016 ip-10-0-129-116 kubenswrapper[2546]: W0614 14:39:23.010962 2546 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jun 14 14:39:23.013016 ip-10-0-129-116 kubenswrapper[2546]: W0614 14:39:23.010964 2546 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jun 14 14:39:23.013016 ip-10-0-129-116 kubenswrapper[2546]: W0614 14:39:23.010968 2546 feature_gate.go:328] unrecognized feature gate: Example Jun 14 14:39:23.013016 ip-10-0-129-116 kubenswrapper[2546]: W0614 14:39:23.010971 2546 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jun 14 14:39:23.013016 ip-10-0-129-116 kubenswrapper[2546]: W0614 14:39:23.010973 2546 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jun 14 14:39:23.013016 ip-10-0-129-116 kubenswrapper[2546]: W0614 14:39:23.010976 2546 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jun 14 14:39:23.013016 ip-10-0-129-116 kubenswrapper[2546]: W0614 14:39:23.010978 2546 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jun 14 14:39:23.013519 ip-10-0-129-116 kubenswrapper[2546]: W0614 14:39:23.010981 2546 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jun 14 14:39:23.013519 ip-10-0-129-116 kubenswrapper[2546]: W0614 14:39:23.010984 2546 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jun 14 14:39:23.013519 ip-10-0-129-116 kubenswrapper[2546]: W0614 14:39:23.010986 2546 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jun 14 14:39:23.013519 ip-10-0-129-116 kubenswrapper[2546]: W0614 14:39:23.010989 2546 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jun 14 14:39:23.013519 ip-10-0-129-116 kubenswrapper[2546]: W0614 14:39:23.010991 2546 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jun 14 14:39:23.013519 ip-10-0-129-116 kubenswrapper[2546]: W0614 14:39:23.010994 2546 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jun 14 14:39:23.013519 ip-10-0-129-116 kubenswrapper[2546]: W0614 14:39:23.010997 2546 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jun 14 14:39:23.013519 ip-10-0-129-116 kubenswrapper[2546]: W0614 14:39:23.011000 2546 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jun 14 14:39:23.013519 ip-10-0-129-116 kubenswrapper[2546]: W0614 14:39:23.011002 2546 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jun 14 14:39:23.013519 ip-10-0-129-116 kubenswrapper[2546]: W0614 14:39:23.011004 2546 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jun 14 14:39:23.013519 ip-10-0-129-116 kubenswrapper[2546]: W0614 14:39:23.011007 2546 feature_gate.go:328] unrecognized feature gate: NewOLM Jun 14 14:39:23.013519 ip-10-0-129-116 kubenswrapper[2546]: W0614 14:39:23.011009 2546 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jun 14 14:39:23.013519 ip-10-0-129-116 kubenswrapper[2546]: W0614 14:39:23.011012 2546 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jun 14 14:39:23.013519 ip-10-0-129-116 kubenswrapper[2546]: W0614 14:39:23.011015 2546 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jun 14 14:39:23.013519 ip-10-0-129-116 kubenswrapper[2546]: W0614 14:39:23.011017 2546 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jun 14 14:39:23.013519 ip-10-0-129-116 kubenswrapper[2546]: W0614 14:39:23.011020 2546 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jun 14 14:39:23.013519 ip-10-0-129-116 kubenswrapper[2546]: W0614 14:39:23.011022 2546 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jun 14 14:39:23.013519 ip-10-0-129-116 kubenswrapper[2546]: W0614 14:39:23.011025 2546 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jun 14 14:39:23.013519 ip-10-0-129-116 kubenswrapper[2546]: W0614 14:39:23.011027 2546 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jun 14 14:39:23.013519 ip-10-0-129-116 kubenswrapper[2546]: W0614 14:39:23.011030 2546 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jun 14 14:39:23.013985 ip-10-0-129-116 kubenswrapper[2546]: W0614 14:39:23.011033 2546 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jun 14 14:39:23.013985 ip-10-0-129-116 kubenswrapper[2546]: W0614 14:39:23.011035 2546 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jun 14 14:39:23.013985 ip-10-0-129-116 kubenswrapper[2546]: W0614 14:39:23.011038 2546 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jun 14 14:39:23.013985 ip-10-0-129-116 kubenswrapper[2546]: W0614 14:39:23.011040 2546 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jun 14 14:39:23.013985 ip-10-0-129-116 kubenswrapper[2546]: W0614 14:39:23.011043 2546 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jun 14 14:39:23.013985 ip-10-0-129-116 kubenswrapper[2546]: W0614 14:39:23.011045 2546 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jun 14 14:39:23.013985 ip-10-0-129-116 kubenswrapper[2546]: W0614 14:39:23.011048 2546 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jun 14 14:39:23.013985 ip-10-0-129-116 kubenswrapper[2546]: W0614 14:39:23.011051 2546 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jun 14 14:39:23.013985 ip-10-0-129-116 kubenswrapper[2546]: W0614 14:39:23.011054 2546 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jun 14 14:39:23.013985 ip-10-0-129-116 kubenswrapper[2546]: W0614 14:39:23.011056 2546 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jun 14 14:39:23.013985 ip-10-0-129-116 kubenswrapper[2546]: W0614 14:39:23.011059 2546 feature_gate.go:328] unrecognized feature gate: SignatureStores Jun 14 14:39:23.013985 ip-10-0-129-116 kubenswrapper[2546]: W0614 14:39:23.011061 2546 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jun 14 14:39:23.013985 ip-10-0-129-116 kubenswrapper[2546]: W0614 14:39:23.011064 2546 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jun 14 14:39:23.013985 ip-10-0-129-116 kubenswrapper[2546]: I0614 14:39:23.011069 2546 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]} Jun 14 14:39:23.013985 ip-10-0-129-116 kubenswrapper[2546]: W0614 14:39:23.011199 2546 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jun 14 14:39:23.014374 ip-10-0-129-116 kubenswrapper[2546]: W0614 14:39:23.011204 2546 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jun 14 14:39:23.014374 ip-10-0-129-116 kubenswrapper[2546]: W0614 14:39:23.011207 2546 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jun 14 14:39:23.014374 ip-10-0-129-116 kubenswrapper[2546]: W0614 14:39:23.011210 2546 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jun 14 14:39:23.014374 ip-10-0-129-116 kubenswrapper[2546]: W0614 14:39:23.011213 2546 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jun 14 14:39:23.014374 ip-10-0-129-116 kubenswrapper[2546]: W0614 14:39:23.011216 2546 feature_gate.go:328] unrecognized feature gate: OSStreams Jun 14 14:39:23.014374 ip-10-0-129-116 kubenswrapper[2546]: W0614 14:39:23.011218 2546 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jun 14 14:39:23.014374 ip-10-0-129-116 kubenswrapper[2546]: W0614 14:39:23.011221 2546 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jun 14 14:39:23.014374 ip-10-0-129-116 kubenswrapper[2546]: W0614 14:39:23.011223 2546 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jun 14 14:39:23.014374 ip-10-0-129-116 kubenswrapper[2546]: W0614 14:39:23.011227 2546 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jun 14 14:39:23.014374 ip-10-0-129-116 kubenswrapper[2546]: W0614 14:39:23.011230 2546 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jun 14 14:39:23.014374 ip-10-0-129-116 kubenswrapper[2546]: W0614 14:39:23.011233 2546 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jun 14 14:39:23.014374 ip-10-0-129-116 kubenswrapper[2546]: W0614 14:39:23.011237 2546 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jun 14 14:39:23.014374 ip-10-0-129-116 kubenswrapper[2546]: W0614 14:39:23.011241 2546 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jun 14 14:39:23.014374 ip-10-0-129-116 kubenswrapper[2546]: W0614 14:39:23.011245 2546 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jun 14 14:39:23.014374 ip-10-0-129-116 kubenswrapper[2546]: W0614 14:39:23.011248 2546 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jun 14 14:39:23.014374 ip-10-0-129-116 kubenswrapper[2546]: W0614 14:39:23.011251 2546 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jun 14 14:39:23.014374 ip-10-0-129-116 kubenswrapper[2546]: W0614 14:39:23.011254 2546 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jun 14 14:39:23.014374 ip-10-0-129-116 kubenswrapper[2546]: W0614 14:39:23.011257 2546 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jun 14 14:39:23.014374 ip-10-0-129-116 kubenswrapper[2546]: W0614 14:39:23.011259 2546 feature_gate.go:328] unrecognized feature gate: EventTTL Jun 14 14:39:23.014831 ip-10-0-129-116 kubenswrapper[2546]: W0614 14:39:23.011262 2546 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jun 14 14:39:23.014831 ip-10-0-129-116 kubenswrapper[2546]: W0614 14:39:23.011265 2546 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jun 14 14:39:23.014831 ip-10-0-129-116 kubenswrapper[2546]: W0614 14:39:23.011267 2546 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jun 14 14:39:23.014831 ip-10-0-129-116 kubenswrapper[2546]: W0614 14:39:23.011270 2546 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jun 14 14:39:23.014831 ip-10-0-129-116 kubenswrapper[2546]: W0614 14:39:23.011272 2546 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jun 14 14:39:23.014831 ip-10-0-129-116 kubenswrapper[2546]: W0614 14:39:23.011275 2546 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jun 14 14:39:23.014831 ip-10-0-129-116 kubenswrapper[2546]: W0614 14:39:23.011278 2546 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jun 14 14:39:23.014831 ip-10-0-129-116 kubenswrapper[2546]: W0614 14:39:23.011281 2546 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jun 14 14:39:23.014831 ip-10-0-129-116 kubenswrapper[2546]: W0614 14:39:23.011283 2546 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jun 14 14:39:23.014831 ip-10-0-129-116 kubenswrapper[2546]: W0614 14:39:23.011286 2546 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jun 14 14:39:23.014831 ip-10-0-129-116 kubenswrapper[2546]: W0614 14:39:23.011288 2546 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jun 14 14:39:23.014831 ip-10-0-129-116 kubenswrapper[2546]: W0614 14:39:23.011291 2546 feature_gate.go:328] unrecognized feature gate: Example Jun 14 14:39:23.014831 ip-10-0-129-116 kubenswrapper[2546]: W0614 14:39:23.011293 2546 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jun 14 14:39:23.014831 ip-10-0-129-116 kubenswrapper[2546]: W0614 14:39:23.011296 2546 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jun 14 14:39:23.014831 ip-10-0-129-116 kubenswrapper[2546]: W0614 14:39:23.011299 2546 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jun 14 14:39:23.014831 ip-10-0-129-116 kubenswrapper[2546]: W0614 14:39:23.011301 2546 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jun 14 14:39:23.014831 ip-10-0-129-116 kubenswrapper[2546]: W0614 14:39:23.011304 2546 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jun 14 14:39:23.014831 ip-10-0-129-116 kubenswrapper[2546]: W0614 14:39:23.011306 2546 feature_gate.go:328] unrecognized feature gate: NewOLM Jun 14 14:39:23.014831 ip-10-0-129-116 kubenswrapper[2546]: W0614 14:39:23.011309 2546 feature_gate.go:328] unrecognized feature gate: PinnedImages Jun 14 14:39:23.014831 ip-10-0-129-116 kubenswrapper[2546]: W0614 14:39:23.011311 2546 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jun 14 14:39:23.015421 ip-10-0-129-116 kubenswrapper[2546]: W0614 14:39:23.011314 2546 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jun 14 14:39:23.015421 ip-10-0-129-116 kubenswrapper[2546]: W0614 14:39:23.011316 2546 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jun 14 14:39:23.015421 ip-10-0-129-116 kubenswrapper[2546]: W0614 14:39:23.011319 2546 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jun 14 14:39:23.015421 ip-10-0-129-116 kubenswrapper[2546]: W0614 14:39:23.011322 2546 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jun 14 14:39:23.015421 ip-10-0-129-116 kubenswrapper[2546]: W0614 14:39:23.011324 2546 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jun 14 14:39:23.015421 ip-10-0-129-116 kubenswrapper[2546]: W0614 14:39:23.011328 2546 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jun 14 14:39:23.015421 ip-10-0-129-116 kubenswrapper[2546]: W0614 14:39:23.011330 2546 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jun 14 14:39:23.015421 ip-10-0-129-116 kubenswrapper[2546]: W0614 14:39:23.011332 2546 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jun 14 14:39:23.015421 ip-10-0-129-116 kubenswrapper[2546]: W0614 14:39:23.011335 2546 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jun 14 14:39:23.015421 ip-10-0-129-116 kubenswrapper[2546]: W0614 14:39:23.011338 2546 feature_gate.go:328] unrecognized feature gate: OVNObservability Jun 14 14:39:23.015421 ip-10-0-129-116 kubenswrapper[2546]: W0614 14:39:23.011340 2546 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jun 14 14:39:23.015421 ip-10-0-129-116 kubenswrapper[2546]: W0614 14:39:23.011343 2546 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jun 14 14:39:23.015421 ip-10-0-129-116 kubenswrapper[2546]: W0614 14:39:23.011345 2546 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jun 14 14:39:23.015421 ip-10-0-129-116 kubenswrapper[2546]: W0614 14:39:23.011347 2546 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jun 14 14:39:23.015421 ip-10-0-129-116 kubenswrapper[2546]: W0614 14:39:23.011350 2546 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jun 14 14:39:23.015421 ip-10-0-129-116 kubenswrapper[2546]: W0614 14:39:23.011352 2546 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jun 14 14:39:23.015421 ip-10-0-129-116 kubenswrapper[2546]: W0614 14:39:23.011355 2546 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jun 14 14:39:23.015421 ip-10-0-129-116 kubenswrapper[2546]: W0614 14:39:23.011358 2546 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jun 14 14:39:23.015421 ip-10-0-129-116 kubenswrapper[2546]: W0614 14:39:23.011360 2546 feature_gate.go:328] unrecognized feature gate: Example2 Jun 14 14:39:23.015421 ip-10-0-129-116 kubenswrapper[2546]: W0614 14:39:23.011363 2546 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jun 14 14:39:23.015903 ip-10-0-129-116 kubenswrapper[2546]: W0614 14:39:23.011365 2546 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jun 14 14:39:23.015903 ip-10-0-129-116 kubenswrapper[2546]: W0614 14:39:23.011368 2546 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jun 14 14:39:23.015903 ip-10-0-129-116 kubenswrapper[2546]: W0614 14:39:23.011370 2546 feature_gate.go:328] unrecognized feature gate: DualReplica Jun 14 14:39:23.015903 ip-10-0-129-116 kubenswrapper[2546]: W0614 14:39:23.011373 2546 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jun 14 14:39:23.015903 ip-10-0-129-116 kubenswrapper[2546]: W0614 14:39:23.011375 2546 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jun 14 14:39:23.015903 ip-10-0-129-116 kubenswrapper[2546]: W0614 14:39:23.011377 2546 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jun 14 14:39:23.015903 ip-10-0-129-116 kubenswrapper[2546]: W0614 14:39:23.011380 2546 feature_gate.go:328] unrecognized feature gate: SignatureStores Jun 14 14:39:23.015903 ip-10-0-129-116 kubenswrapper[2546]: W0614 14:39:23.011382 2546 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jun 14 14:39:23.015903 ip-10-0-129-116 kubenswrapper[2546]: W0614 14:39:23.011385 2546 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jun 14 14:39:23.015903 ip-10-0-129-116 kubenswrapper[2546]: W0614 14:39:23.011388 2546 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jun 14 14:39:23.015903 ip-10-0-129-116 kubenswrapper[2546]: W0614 14:39:23.011390 2546 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jun 14 14:39:23.015903 ip-10-0-129-116 kubenswrapper[2546]: W0614 14:39:23.011393 2546 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jun 14 14:39:23.015903 ip-10-0-129-116 kubenswrapper[2546]: W0614 14:39:23.011397 2546 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jun 14 14:39:23.015903 ip-10-0-129-116 kubenswrapper[2546]: W0614 14:39:23.011400 2546 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jun 14 14:39:23.015903 ip-10-0-129-116 kubenswrapper[2546]: W0614 14:39:23.011404 2546 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jun 14 14:39:23.015903 ip-10-0-129-116 kubenswrapper[2546]: W0614 14:39:23.011407 2546 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jun 14 14:39:23.015903 ip-10-0-129-116 kubenswrapper[2546]: W0614 14:39:23.011410 2546 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jun 14 14:39:23.015903 ip-10-0-129-116 kubenswrapper[2546]: W0614 14:39:23.011413 2546 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jun 14 14:39:23.015903 ip-10-0-129-116 kubenswrapper[2546]: W0614 14:39:23.011416 2546 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jun 14 14:39:23.016377 ip-10-0-129-116 kubenswrapper[2546]: W0614 14:39:23.011419 2546 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jun 14 14:39:23.016377 ip-10-0-129-116 kubenswrapper[2546]: W0614 14:39:23.011422 2546 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jun 14 14:39:23.016377 ip-10-0-129-116 kubenswrapper[2546]: W0614 14:39:23.011424 2546 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jun 14 14:39:23.016377 ip-10-0-129-116 kubenswrapper[2546]: W0614 14:39:23.011426 2546 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jun 14 14:39:23.016377 ip-10-0-129-116 kubenswrapper[2546]: W0614 14:39:23.011429 2546 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jun 14 14:39:23.016377 ip-10-0-129-116 kubenswrapper[2546]: W0614 14:39:23.011431 2546 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jun 14 14:39:23.016377 ip-10-0-129-116 kubenswrapper[2546]: W0614 14:39:23.011434 2546 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jun 14 14:39:23.016377 ip-10-0-129-116 kubenswrapper[2546]: W0614 14:39:23.011437 2546 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jun 14 14:39:23.016377 ip-10-0-129-116 kubenswrapper[2546]: W0614 14:39:23.011439 2546 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jun 14 14:39:23.016377 ip-10-0-129-116 kubenswrapper[2546]: W0614 14:39:23.011442 2546 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jun 14 14:39:23.016377 ip-10-0-129-116 kubenswrapper[2546]: W0614 14:39:23.011444 2546 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jun 14 14:39:23.016377 ip-10-0-129-116 kubenswrapper[2546]: W0614 14:39:23.011447 2546 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jun 14 14:39:23.016377 ip-10-0-129-116 kubenswrapper[2546]: W0614 14:39:23.011449 2546 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jun 14 14:39:23.016377 ip-10-0-129-116 kubenswrapper[2546]: W0614 14:39:23.011452 2546 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jun 14 14:39:23.016377 ip-10-0-129-116 kubenswrapper[2546]: W0614 14:39:23.011454 2546 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jun 14 14:39:23.016377 ip-10-0-129-116 kubenswrapper[2546]: W0614 14:39:23.011457 2546 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jun 14 14:39:23.016377 ip-10-0-129-116 kubenswrapper[2546]: W0614 14:39:23.011459 2546 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jun 14 14:39:23.016377 ip-10-0-129-116 kubenswrapper[2546]: W0614 14:39:23.011462 2546 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jun 14 14:39:23.016377 ip-10-0-129-116 kubenswrapper[2546]: W0614 14:39:23.011464 2546 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jun 14 14:39:23.016833 ip-10-0-129-116 kubenswrapper[2546]: W0614 14:39:23.011467 2546 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jun 14 14:39:23.016833 ip-10-0-129-116 kubenswrapper[2546]: I0614 14:39:23.011472 2546 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]} Jun 14 14:39:23.016833 ip-10-0-129-116 kubenswrapper[2546]: I0614 14:39:23.011588 2546 server.go:962] "Client rotation is on, will bootstrap in background" Jun 14 14:39:23.016833 ip-10-0-129-116 kubenswrapper[2546]: I0614 14:39:23.014035 2546 bootstrap.go:101] "Use the bootstrap credentials to request a cert, and set kubeconfig to point to the certificate dir" Jun 14 14:39:23.016833 ip-10-0-129-116 kubenswrapper[2546]: I0614 14:39:23.015711 2546 server.go:1019] "Starting client certificate rotation" Jun 14 14:39:23.016833 ip-10-0-129-116 kubenswrapper[2546]: I0614 14:39:23.015808 2546 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kube-apiserver-client-kubelet" Jun 14 14:39:23.016833 ip-10-0-129-116 kubenswrapper[2546]: I0614 14:39:23.015839 2546 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kube-apiserver-client-kubelet" Jun 14 14:39:23.019365 ip-10-0-129-116 kubenswrapper[2546]: I0614 14:39:23.019351 2546 dynamic_cafile_content.go:123] "Loaded a new CA Bundle and Verifier" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt" Jun 14 14:39:23.021609 ip-10-0-129-116 kubenswrapper[2546]: I0614 14:39:23.021587 2546 dynamic_cafile_content.go:161] "Starting controller" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt" Jun 14 14:39:23.036807 ip-10-0-129-116 kubenswrapper[2546]: I0614 14:39:23.036788 2546 log.go:25] "Validated CRI v1 runtime API" Jun 14 14:39:23.041104 ip-10-0-129-116 kubenswrapper[2546]: I0614 14:39:23.041063 2546 log.go:25] "Validated CRI v1 image API" Jun 14 14:39:23.041862 ip-10-0-129-116 kubenswrapper[2546]: I0614 14:39:23.041842 2546 server.go:1429] "Using cgroup driver setting received from the CRI runtime" cgroupDriver="systemd" Jun 14 14:39:23.044495 ip-10-0-129-116 kubenswrapper[2546]: I0614 14:39:23.044473 2546 fs.go:135] Filesystem UUIDs: map[7B77-95E7:/dev/nvme0n1p2 ed3b04ef-6fbb-4ea4-a14b-7a92ea900f83:/dev/nvme0n1p3 fa780058-d019-408d-89d0-c8474d58016c:/dev/nvme0n1p4] Jun 14 14:39:23.044563 ip-10-0-129-116 kubenswrapper[2546]: I0614 14:39:23.044496 2546 fs.go:136] Filesystem partitions: map[/dev/nvme0n1p3:{mountpoint:/boot major:259 minor:3 fsType:ext4 blockSize:0} /dev/nvme0n1p4:{mountpoint:/var major:259 minor:4 fsType:xfs blockSize:0} /dev/shm:{mountpoint:/dev/shm major:0 minor:22 fsType:tmpfs blockSize:0} /run:{mountpoint:/run major:0 minor:24 fsType:tmpfs blockSize:0} /tmp:{mountpoint:/tmp major:0 minor:31 fsType:tmpfs blockSize:0} composefs_0-33:{mountpoint:/ major:0 minor:33 fsType:overlay blockSize:0}] Jun 14 14:39:23.044797 ip-10-0-129-116 kubenswrapper[2546]: I0614 14:39:23.044779 2546 reflector.go:439] "Caches populated" logger="kubernetes.io/kube-apiserver-client-kubelet" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162" Jun 14 14:39:23.050106 ip-10-0-129-116 kubenswrapper[2546]: I0614 14:39:23.049989 2546 manager.go:216] Machine: {Timestamp:2026-06-14 14:39:23.048556791 +0000 UTC m=+0.376938908 CPUVendorID:GenuineIntel NumCores:8 NumPhysicalCores:4 NumSockets:1 CpuFrequency:3102349 MemoryCapacity:33164500992 SwapCapacity:0 MemoryByType:map[] NVMInfo:{MemoryModeCapacity:0 AppDirectModeCapacity:0 AvgPowerBudget:0} HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] MachineID:ec291885bf6cdaedfcc776bd9b61a6c0 SystemUUID:ec291885-bf6c-daed-fcc7-76bd9b61a6c0 BootID:55d3e082-df32-4f7c-8250-97d12fcff7b3 Filesystems:[{Device:/dev/nvme0n1p3 DeviceMajor:259 DeviceMinor:3 Capacity:366869504 Type:vfs Inodes:98304 HasInodes:true} {Device:/dev/shm DeviceMajor:0 DeviceMinor:22 Capacity:16582250496 Type:vfs Inodes:4048401 HasInodes:true} {Device:/run DeviceMajor:0 DeviceMinor:24 Capacity:6632902656 Type:vfs Inodes:819200 HasInodes:true} {Device:/dev/nvme0n1p4 DeviceMajor:259 DeviceMinor:4 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:composefs_0-33 DeviceMajor:0 DeviceMinor:33 Capacity:6107136 Type:vfs Inodes:18446744073709551615 HasInodes:true} {Device:/tmp DeviceMajor:0 DeviceMinor:31 Capacity:16582250496 Type:vfs Inodes:1048576 HasInodes:true}] DiskMap:map[259:0:{Name:nvme0n1 Major:259 Minor:0 Size:128849018880 Scheduler:none}] NetworkDevices:[{Name:br-ex MacAddress:02:6f:fa:ee:1a:95 Speed:0 Mtu:9001} {Name:ens5 MacAddress:02:6f:fa:ee:1a:95 Speed:0 Mtu:9001} {Name:ovs-system MacAddress:66:ad:77:8e:0d:69 Speed:0 Mtu:1500}] Topology:[{Id:0 Memory:33164500992 HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] Cores:[{Id:0 Threads:[0 4] Caches:[{Id:0 Size:32768 Type:Data Level:1} {Id:0 Size:32768 Type:Instruction Level:1} {Id:0 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:1 Threads:[1 5] Caches:[{Id:1 Size:32768 Type:Data Level:1} {Id:1 Size:32768 Type:Instruction Level:1} {Id:1 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:2 Threads:[2 6] Caches:[{Id:2 Size:32768 Type:Data Level:1} {Id:2 Size:32768 Type:Instruction Level:1} {Id:2 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:3 Threads:[3 7] Caches:[{Id:3 Size:32768 Type:Data Level:1} {Id:3 Size:32768 Type:Instruction Level:1} {Id:3 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:}] Caches:[{Id:0 Size:37486592 Type:Unified Level:3}] Distances:[10]}] CloudProvider:Unknown InstanceType:Unknown InstanceID:None} Jun 14 14:39:23.050106 ip-10-0-129-116 kubenswrapper[2546]: I0614 14:39:23.050104 2546 manager_no_libpfm.go:29] cAdvisor is build without cgo and/or libpfm support. Perf event counters are not available. Jun 14 14:39:23.050221 ip-10-0-129-116 kubenswrapper[2546]: I0614 14:39:23.050186 2546 manager.go:232] Version: {KernelVersion:5.14.0-570.120.1.el9_6.x86_64 ContainerOsVersion:Red Hat Enterprise Linux CoreOS 9.6.20260608-0 (Plow) DockerVersion: DockerAPIVersion: CadvisorVersion: CadvisorRevision:} Jun 14 14:39:23.053689 ip-10-0-129-116 kubenswrapper[2546]: I0614 14:39:23.053667 2546 container_manager_linux.go:273] "Container manager verified user specified cgroup-root exists" cgroupRoot=[] Jun 14 14:39:23.053822 ip-10-0-129-116 kubenswrapper[2546]: I0614 14:39:23.053693 2546 container_manager_linux.go:278] "Creating Container Manager object based on Node Config" nodeConfig={"NodeName":"ip-10-0-129-116.ec2.internal","RuntimeCgroupsName":"/system.slice/crio.service","SystemCgroupsName":"/system.slice","KubeletCgroupsName":"","KubeletOOMScoreAdj":-999,"ContainerRuntime":"","CgroupsPerQOS":true,"CgroupRoot":"/","CgroupDriver":"systemd","KubeletRootDir":"/var/lib/kubelet","ProtectKernelDefaults":true,"KubeReservedCgroupName":"","SystemReservedCgroupName":"","ReservedSystemCPUs":{},"EnforceNodeAllocatable":{"pods":{}},"KubeReserved":null,"SystemReserved":{"cpu":"500m","ephemeral-storage":"1Gi","memory":"1Gi"},"HardEvictionThresholds":[{"Signal":"nodefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.1},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.15},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"memory.available","Operator":"LessThan","Value":{"Quantity":"100Mi","Percentage":0},"GracePeriod":0,"MinReclaim":null}],"QOSReserved":{},"CPUManagerPolicy":"none","CPUManagerPolicyOptions":null,"TopologyManagerScope":"container","CPUManagerReconcilePeriod":10000000000,"MemoryManagerPolicy":"None","MemoryManagerReservedMemory":null,"PodPidsLimit":4096,"EnforceCPULimits":true,"CPUCFSQuotaPeriod":100000000,"TopologyManagerPolicy":"none","TopologyManagerPolicyOptions":null,"CgroupVersion":2} Jun 14 14:39:23.054516 ip-10-0-129-116 kubenswrapper[2546]: I0614 14:39:23.054506 2546 topology_manager.go:138] "Creating topology manager with none policy" Jun 14 14:39:23.054557 ip-10-0-129-116 kubenswrapper[2546]: I0614 14:39:23.054519 2546 container_manager_linux.go:309] "Creating device plugin manager" Jun 14 14:39:23.054557 ip-10-0-129-116 kubenswrapper[2546]: I0614 14:39:23.054527 2546 manager.go:141] "Creating Device Plugin manager" path="/var/lib/kubelet/device-plugins/kubelet.sock" Jun 14 14:39:23.054557 ip-10-0-129-116 kubenswrapper[2546]: I0614 14:39:23.054541 2546 server.go:74] "Creating device plugin registration server" version="v1beta1" socket="/var/lib/kubelet/device-plugins/kubelet.sock" Jun 14 14:39:23.056437 ip-10-0-129-116 kubenswrapper[2546]: I0614 14:39:23.056427 2546 container_manager_linux.go:318] "Creating Dynamic Resource Allocation (DRA) manager" Jun 14 14:39:23.061006 ip-10-0-129-116 kubenswrapper[2546]: I0614 14:39:23.060994 2546 state_mem.go:36] "Initialized new in-memory state store" Jun 14 14:39:23.061143 ip-10-0-129-116 kubenswrapper[2546]: I0614 14:39:23.061134 2546 server.go:1240] "Using root directory" path="/var/lib/kubelet" Jun 14 14:39:23.061182 ip-10-0-129-116 kubenswrapper[2546]: I0614 14:39:23.061165 2546 kubelet.go:486] "Attempting to sync node with API server" Jun 14 14:39:23.061182 ip-10-0-129-116 kubenswrapper[2546]: I0614 14:39:23.061178 2546 kubelet.go:387] "Adding static pod path" path="/etc/kubernetes/manifests" Jun 14 14:39:23.061241 ip-10-0-129-116 kubenswrapper[2546]: I0614 14:39:23.061193 2546 file.go:69] "Watching path" path="/etc/kubernetes/manifests" Jun 14 14:39:23.061241 ip-10-0-129-116 kubenswrapper[2546]: I0614 14:39:23.061203 2546 kubelet.go:398] "Adding apiserver pod source" Jun 14 14:39:23.061241 ip-10-0-129-116 kubenswrapper[2546]: I0614 14:39:23.061212 2546 apiserver.go:42] "Waiting for node sync before watching apiserver pods" Jun 14 14:39:23.062760 ip-10-0-129-116 kubenswrapper[2546]: I0614 14:39:23.062743 2546 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking" Jun 14 14:39:23.062829 ip-10-0-129-116 kubenswrapper[2546]: I0614 14:39:23.062773 2546 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking" Jun 14 14:39:23.093314 ip-10-0-129-116 kubenswrapper[2546]: I0614 14:39:23.093272 2546 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-zrjpd" Jun 14 14:39:23.094812 ip-10-0-129-116 kubenswrapper[2546]: I0614 14:39:23.094795 2546 kuberuntime_manager.go:301] "Container runtime initialized" containerRuntime="cri-o" version="1.34.8-3.rhaos4.21.git91b4b0b.el9" apiVersion="v1" Jun 14 14:39:23.095761 ip-10-0-129-116 kubenswrapper[2546]: E0614 14:39:23.095738 2546 reflector.go:205] "Failed to watch" err="failed to list *v1.Service: services is forbidden: User \"system:anonymous\" cannot list resource \"services\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Service" Jun 14 14:39:23.095761 ip-10-0-129-116 kubenswrapper[2546]: E0614 14:39:23.095737 2546 reflector.go:205] "Failed to watch" err="failed to list *v1.Node: nodes \"ip-10-0-129-116.ec2.internal\" is forbidden: User \"system:anonymous\" cannot list resource \"nodes\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Node" Jun 14 14:39:23.097243 ip-10-0-129-116 kubenswrapper[2546]: I0614 14:39:23.097229 2546 kubelet.go:960] "Not starting ClusterTrustBundle informer because we are in static kubelet mode or the ClusterTrustBundleProjection featuregate is disabled" Jun 14 14:39:23.097295 ip-10-0-129-116 kubenswrapper[2546]: I0614 14:39:23.097259 2546 kubelet.go:984] "Not starting PodCertificateRequest manager because we are in static kubelet mode or the PodCertificateProjection feature gate is disabled" Jun 14 14:39:23.097621 ip-10-0-129-116 kubenswrapper[2546]: I0614 14:39:23.097606 2546 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-zrjpd" Jun 14 14:39:23.098024 ip-10-0-129-116 kubenswrapper[2546]: I0614 14:39:23.098013 2546 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/portworx-volume" Jun 14 14:39:23.098057 ip-10-0-129-116 kubenswrapper[2546]: I0614 14:39:23.098029 2546 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/empty-dir" Jun 14 14:39:23.098057 ip-10-0-129-116 kubenswrapper[2546]: I0614 14:39:23.098035 2546 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/git-repo" Jun 14 14:39:23.098057 ip-10-0-129-116 kubenswrapper[2546]: I0614 14:39:23.098041 2546 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/host-path" Jun 14 14:39:23.098057 ip-10-0-129-116 kubenswrapper[2546]: I0614 14:39:23.098049 2546 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/nfs" Jun 14 14:39:23.098057 ip-10-0-129-116 kubenswrapper[2546]: I0614 14:39:23.098054 2546 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/secret" Jun 14 14:39:23.098225 ip-10-0-129-116 kubenswrapper[2546]: I0614 14:39:23.098127 2546 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/iscsi" Jun 14 14:39:23.098225 ip-10-0-129-116 kubenswrapper[2546]: I0614 14:39:23.098134 2546 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/downward-api" Jun 14 14:39:23.098225 ip-10-0-129-116 kubenswrapper[2546]: I0614 14:39:23.098142 2546 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/fc" Jun 14 14:39:23.098225 ip-10-0-129-116 kubenswrapper[2546]: I0614 14:39:23.098147 2546 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/configmap" Jun 14 14:39:23.098225 ip-10-0-129-116 kubenswrapper[2546]: I0614 14:39:23.098156 2546 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/projected" Jun 14 14:39:23.098225 ip-10-0-129-116 kubenswrapper[2546]: I0614 14:39:23.098163 2546 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/local-volume" Jun 14 14:39:23.099041 ip-10-0-129-116 kubenswrapper[2546]: I0614 14:39:23.099031 2546 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/csi" Jun 14 14:39:23.099041 ip-10-0-129-116 kubenswrapper[2546]: I0614 14:39:23.099040 2546 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/image" Jun 14 14:39:23.101065 ip-10-0-129-116 kubenswrapper[2546]: I0614 14:39:23.101043 2546 csi_plugin.go:990] Failed to contact API server when waiting for CSINode publishing: csinodes.storage.k8s.io "ip-10-0-129-116.ec2.internal" is forbidden: User "system:anonymous" cannot get resource "csinodes" in API group "storage.k8s.io" at the cluster scope Jun 14 14:39:23.102399 ip-10-0-129-116 kubenswrapper[2546]: I0614 14:39:23.102385 2546 server.go:1268] "Started kubelet" Jun 14 14:39:23.102498 ip-10-0-129-116 kubenswrapper[2546]: I0614 14:39:23.102468 2546 server.go:180] "Starting to listen" address="0.0.0.0" port=10250 Jun 14 14:39:23.102557 ip-10-0-129-116 kubenswrapper[2546]: I0614 14:39:23.102476 2546 ratelimit.go:56] "Setting rate limiting for endpoint" service="podresources" qps=100 burstTokens=10 Jun 14 14:39:23.102597 ip-10-0-129-116 kubenswrapper[2546]: I0614 14:39:23.102582 2546 server_v1.go:49] "podresources" method="list" useActivePods=true Jun 14 14:39:23.103041 ip-10-0-129-116 kubenswrapper[2546]: I0614 14:39:23.103024 2546 server.go:249] "Starting to serve the podresources API" endpoint="unix:/var/lib/kubelet/pod-resources/kubelet.sock" Jun 14 14:39:23.103464 ip-10-0-129-116 systemd[1]: Started Kubernetes Kubelet. Jun 14 14:39:23.104844 ip-10-0-129-116 kubenswrapper[2546]: I0614 14:39:23.104831 2546 server.go:310] "Adding debug handlers to kubelet server" Jun 14 14:39:23.110221 ip-10-0-129-116 kubenswrapper[2546]: E0614 14:39:23.110204 2546 kubelet.go:1638] "Image garbage collection failed once. Stats initialization may not have completed yet" err="failed to get imageFs info: unable to find data in memory cache" Jun 14 14:39:23.111807 ip-10-0-129-116 kubenswrapper[2546]: I0614 14:39:23.111792 2546 fs_resource_analyzer.go:67] "Starting FS ResourceAnalyzer" Jun 14 14:39:23.111963 ip-10-0-129-116 kubenswrapper[2546]: I0614 14:39:23.111795 2546 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kubelet-serving" Jun 14 14:39:23.111963 ip-10-0-129-116 kubenswrapper[2546]: E0614 14:39:23.111905 2546 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-129-116.ec2.internal\" not found" Jun 14 14:39:23.112670 ip-10-0-129-116 kubenswrapper[2546]: I0614 14:39:23.112518 2546 volume_manager.go:311] "The desired_state_of_world populator starts" Jun 14 14:39:23.112670 ip-10-0-129-116 kubenswrapper[2546]: I0614 14:39:23.112536 2546 volume_manager.go:313] "Starting Kubelet Volume Manager" Jun 14 14:39:23.112670 ip-10-0-129-116 kubenswrapper[2546]: I0614 14:39:23.112519 2546 desired_state_of_world_populator.go:146] "Desired state populator starts to run" Jun 14 14:39:23.112670 ip-10-0-129-116 kubenswrapper[2546]: I0614 14:39:23.112621 2546 factory.go:55] Registering systemd factory Jun 14 14:39:23.112670 ip-10-0-129-116 kubenswrapper[2546]: I0614 14:39:23.112633 2546 factory.go:223] Registration of the systemd container factory successfully Jun 14 14:39:23.112670 ip-10-0-129-116 kubenswrapper[2546]: I0614 14:39:23.112623 2546 reconstruct.go:97] "Volume reconstruction finished" Jun 14 14:39:23.112969 ip-10-0-129-116 kubenswrapper[2546]: I0614 14:39:23.112686 2546 reconciler.go:29] "Reconciler: start to sync state" Jun 14 14:39:23.112969 ip-10-0-129-116 kubenswrapper[2546]: I0614 14:39:23.112874 2546 factory.go:153] Registering CRI-O factory Jun 14 14:39:23.112969 ip-10-0-129-116 kubenswrapper[2546]: I0614 14:39:23.112887 2546 factory.go:223] Registration of the crio container factory successfully Jun 14 14:39:23.112969 ip-10-0-129-116 kubenswrapper[2546]: I0614 14:39:23.112936 2546 factory.go:221] Registration of the containerd container factory failed: unable to create containerd client: containerd: cannot unix dial containerd api service: dial unix /run/containerd/containerd.sock: connect: no such file or directory Jun 14 14:39:23.112969 ip-10-0-129-116 kubenswrapper[2546]: I0614 14:39:23.112960 2546 factory.go:103] Registering Raw factory Jun 14 14:39:23.112969 ip-10-0-129-116 kubenswrapper[2546]: I0614 14:39:23.112974 2546 manager.go:1196] Started watching for new ooms in manager Jun 14 14:39:23.113509 ip-10-0-129-116 kubenswrapper[2546]: I0614 14:39:23.113487 2546 manager.go:349] Starting recovery of all containers Jun 14 14:39:23.117117 ip-10-0-129-116 kubenswrapper[2546]: I0614 14:39:23.117067 2546 reflector.go:439] "Caches populated" type="*v1.CSIDriver" reflector="k8s.io/client-go/informers/factory.go:160" Jun 14 14:39:23.121782 ip-10-0-129-116 kubenswrapper[2546]: E0614 14:39:23.121625 2546 nodelease.go:49] "Failed to get node when trying to set owner ref to the node lease" err="nodes \"ip-10-0-129-116.ec2.internal\" not found" node="ip-10-0-129-116.ec2.internal" Jun 14 14:39:23.123965 ip-10-0-129-116 kubenswrapper[2546]: I0614 14:39:23.123780 2546 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv6" Jun 14 14:39:23.124231 ip-10-0-129-116 kubenswrapper[2546]: I0614 14:39:23.124215 2546 manager.go:354] Recovery completed Jun 14 14:39:23.129775 ip-10-0-129-116 kubenswrapper[2546]: I0614 14:39:23.129762 2546 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jun 14 14:39:23.131523 ip-10-0-129-116 kubenswrapper[2546]: I0614 14:39:23.131506 2546 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-129-116.ec2.internal" event="NodeHasSufficientMemory" Jun 14 14:39:23.131575 ip-10-0-129-116 kubenswrapper[2546]: I0614 14:39:23.131536 2546 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-129-116.ec2.internal" event="NodeHasNoDiskPressure" Jun 14 14:39:23.131575 ip-10-0-129-116 kubenswrapper[2546]: I0614 14:39:23.131548 2546 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-129-116.ec2.internal" event="NodeHasSufficientPID" Jun 14 14:39:23.132059 ip-10-0-129-116 kubenswrapper[2546]: I0614 14:39:23.132046 2546 cpu_manager.go:222] "Starting CPU manager" policy="none" Jun 14 14:39:23.132059 ip-10-0-129-116 kubenswrapper[2546]: I0614 14:39:23.132057 2546 cpu_manager.go:223] "Reconciling" reconcilePeriod="10s" Jun 14 14:39:23.132187 ip-10-0-129-116 kubenswrapper[2546]: I0614 14:39:23.132073 2546 state_mem.go:36] "Initialized new in-memory state store" Jun 14 14:39:23.132187 ip-10-0-129-116 kubenswrapper[2546]: I0614 14:39:23.132117 2546 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jun 14 14:39:23.132775 ip-10-0-129-116 kubenswrapper[2546]: I0614 14:39:23.132763 2546 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-129-116.ec2.internal" event="NodeHasSufficientMemory" Jun 14 14:39:23.132827 ip-10-0-129-116 kubenswrapper[2546]: I0614 14:39:23.132784 2546 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-129-116.ec2.internal" event="NodeHasNoDiskPressure" Jun 14 14:39:23.132827 ip-10-0-129-116 kubenswrapper[2546]: I0614 14:39:23.132793 2546 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-129-116.ec2.internal" event="NodeHasSufficientPID" Jun 14 14:39:23.134293 ip-10-0-129-116 kubenswrapper[2546]: I0614 14:39:23.134281 2546 policy_none.go:49] "None policy: Start" Jun 14 14:39:23.134337 ip-10-0-129-116 kubenswrapper[2546]: I0614 14:39:23.134296 2546 memory_manager.go:187] "Starting memorymanager" policy="None" Jun 14 14:39:23.134337 ip-10-0-129-116 kubenswrapper[2546]: I0614 14:39:23.134307 2546 state_mem.go:36] "Initializing new in-memory state store" logger="Memory Manager state checkpoint" Jun 14 14:39:23.136277 ip-10-0-129-116 kubenswrapper[2546]: I0614 14:39:23.136267 2546 policy_none.go:47] "Start" Jun 14 14:39:23.192318 ip-10-0-129-116 kubenswrapper[2546]: I0614 14:39:23.172245 2546 manager.go:337] "Starting Device Plugin manager" Jun 14 14:39:23.192318 ip-10-0-129-116 kubenswrapper[2546]: E0614 14:39:23.172278 2546 manager.go:513] "Failed to read data from checkpoint" err="checkpoint is not found" checkpoint="kubelet_internal_checkpoint" Jun 14 14:39:23.192318 ip-10-0-129-116 kubenswrapper[2546]: I0614 14:39:23.172288 2546 server.go:87] "Starting device plugin registration server" Jun 14 14:39:23.192318 ip-10-0-129-116 kubenswrapper[2546]: I0614 14:39:23.172496 2546 eviction_manager.go:189] "Eviction manager: starting control loop" Jun 14 14:39:23.192318 ip-10-0-129-116 kubenswrapper[2546]: I0614 14:39:23.172512 2546 container_log_manager.go:146] "Initializing container log rotate workers" workers=1 monitorPeriod="10s" Jun 14 14:39:23.192318 ip-10-0-129-116 kubenswrapper[2546]: I0614 14:39:23.172585 2546 plugin_watcher.go:51] "Plugin Watcher Start" path="/var/lib/kubelet/plugins_registry" Jun 14 14:39:23.192318 ip-10-0-129-116 kubenswrapper[2546]: I0614 14:39:23.172665 2546 plugin_manager.go:116] "The desired_state_of_world populator (plugin watcher) starts" Jun 14 14:39:23.192318 ip-10-0-129-116 kubenswrapper[2546]: I0614 14:39:23.172674 2546 plugin_manager.go:118] "Starting Kubelet Plugin Manager" Jun 14 14:39:23.192318 ip-10-0-129-116 kubenswrapper[2546]: E0614 14:39:23.173178 2546 eviction_manager.go:267] "eviction manager: failed to check if we have separate container filesystem. Ignoring." err="non-existent label \"crio-containers\"" Jun 14 14:39:23.192318 ip-10-0-129-116 kubenswrapper[2546]: E0614 14:39:23.173218 2546 eviction_manager.go:292] "Eviction manager: failed to get summary stats" err="failed to get node info: node \"ip-10-0-129-116.ec2.internal\" not found" Jun 14 14:39:23.192318 ip-10-0-129-116 kubenswrapper[2546]: I0614 14:39:23.183576 2546 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv4" Jun 14 14:39:23.192318 ip-10-0-129-116 kubenswrapper[2546]: I0614 14:39:23.183609 2546 status_manager.go:244] "Starting to sync pod status with apiserver" Jun 14 14:39:23.192318 ip-10-0-129-116 kubenswrapper[2546]: I0614 14:39:23.183626 2546 kubelet.go:2448] "Starting kubelet main sync loop" Jun 14 14:39:23.192318 ip-10-0-129-116 kubenswrapper[2546]: E0614 14:39:23.183652 2546 kubelet.go:2472] "Skipping pod synchronization" err="PLEG is not healthy: pleg has yet to be successful" Jun 14 14:39:23.192318 ip-10-0-129-116 kubenswrapper[2546]: I0614 14:39:23.185905 2546 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160" Jun 14 14:39:23.273540 ip-10-0-129-116 kubenswrapper[2546]: I0614 14:39:23.273460 2546 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jun 14 14:39:23.274428 ip-10-0-129-116 kubenswrapper[2546]: I0614 14:39:23.274411 2546 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-129-116.ec2.internal" event="NodeHasSufficientMemory" Jun 14 14:39:23.274536 ip-10-0-129-116 kubenswrapper[2546]: I0614 14:39:23.274440 2546 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-129-116.ec2.internal" event="NodeHasNoDiskPressure" Jun 14 14:39:23.274536 ip-10-0-129-116 kubenswrapper[2546]: I0614 14:39:23.274453 2546 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-129-116.ec2.internal" event="NodeHasSufficientPID" Jun 14 14:39:23.274536 ip-10-0-129-116 kubenswrapper[2546]: I0614 14:39:23.274476 2546 kubelet_node_status.go:78] "Attempting to register node" node="ip-10-0-129-116.ec2.internal" Jun 14 14:39:23.284316 ip-10-0-129-116 kubenswrapper[2546]: I0614 14:39:23.284293 2546 kubelet.go:2535] "SyncLoop ADD" source="file" pods=["openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-129-116.ec2.internal","kube-system/kube-apiserver-proxy-ip-10-0-129-116.ec2.internal"] Jun 14 14:39:23.284395 ip-10-0-129-116 kubenswrapper[2546]: I0614 14:39:23.284364 2546 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jun 14 14:39:23.285590 ip-10-0-129-116 kubenswrapper[2546]: I0614 14:39:23.285575 2546 kubelet_node_status.go:81] "Successfully registered node" node="ip-10-0-129-116.ec2.internal" Jun 14 14:39:23.285656 ip-10-0-129-116 kubenswrapper[2546]: E0614 14:39:23.285599 2546 kubelet_node_status.go:536] "Error updating node status, will retry" err="error getting node \"ip-10-0-129-116.ec2.internal\": node \"ip-10-0-129-116.ec2.internal\" not found" Jun 14 14:39:23.285911 ip-10-0-129-116 kubenswrapper[2546]: I0614 14:39:23.285895 2546 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-129-116.ec2.internal" event="NodeHasSufficientMemory" Jun 14 14:39:23.285967 ip-10-0-129-116 kubenswrapper[2546]: I0614 14:39:23.285925 2546 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-129-116.ec2.internal" event="NodeHasNoDiskPressure" Jun 14 14:39:23.285967 ip-10-0-129-116 kubenswrapper[2546]: I0614 14:39:23.285935 2546 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-129-116.ec2.internal" event="NodeHasSufficientPID" Jun 14 14:39:23.288269 ip-10-0-129-116 kubenswrapper[2546]: I0614 14:39:23.288253 2546 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jun 14 14:39:23.288360 ip-10-0-129-116 kubenswrapper[2546]: I0614 14:39:23.288345 2546 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-129-116.ec2.internal" Jun 14 14:39:23.288422 ip-10-0-129-116 kubenswrapper[2546]: I0614 14:39:23.288378 2546 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jun 14 14:39:23.288964 ip-10-0-129-116 kubenswrapper[2546]: I0614 14:39:23.288946 2546 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-129-116.ec2.internal" event="NodeHasSufficientMemory" Jun 14 14:39:23.288964 ip-10-0-129-116 kubenswrapper[2546]: I0614 14:39:23.288953 2546 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-129-116.ec2.internal" event="NodeHasSufficientMemory" Jun 14 14:39:23.289087 ip-10-0-129-116 kubenswrapper[2546]: I0614 14:39:23.288972 2546 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-129-116.ec2.internal" event="NodeHasNoDiskPressure" Jun 14 14:39:23.289087 ip-10-0-129-116 kubenswrapper[2546]: I0614 14:39:23.288977 2546 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-129-116.ec2.internal" event="NodeHasNoDiskPressure" Jun 14 14:39:23.289087 ip-10-0-129-116 kubenswrapper[2546]: I0614 14:39:23.288981 2546 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-129-116.ec2.internal" event="NodeHasSufficientPID" Jun 14 14:39:23.289087 ip-10-0-129-116 kubenswrapper[2546]: I0614 14:39:23.288991 2546 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-129-116.ec2.internal" event="NodeHasSufficientPID" Jun 14 14:39:23.291384 ip-10-0-129-116 kubenswrapper[2546]: I0614 14:39:23.291367 2546 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-129-116.ec2.internal" Jun 14 14:39:23.291442 ip-10-0-129-116 kubenswrapper[2546]: I0614 14:39:23.291400 2546 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jun 14 14:39:23.292004 ip-10-0-129-116 kubenswrapper[2546]: I0614 14:39:23.291989 2546 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-129-116.ec2.internal" event="NodeHasSufficientMemory" Jun 14 14:39:23.292078 ip-10-0-129-116 kubenswrapper[2546]: I0614 14:39:23.292012 2546 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-129-116.ec2.internal" event="NodeHasNoDiskPressure" Jun 14 14:39:23.292078 ip-10-0-129-116 kubenswrapper[2546]: I0614 14:39:23.292026 2546 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-129-116.ec2.internal" event="NodeHasSufficientPID" Jun 14 14:39:23.305448 ip-10-0-129-116 kubenswrapper[2546]: E0614 14:39:23.305434 2546 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-129-116.ec2.internal\" not found" Jun 14 14:39:23.311647 ip-10-0-129-116 kubenswrapper[2546]: E0614 14:39:23.311626 2546 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-129-116.ec2.internal\" not found" node="ip-10-0-129-116.ec2.internal" Jun 14 14:39:23.316154 ip-10-0-129-116 kubenswrapper[2546]: E0614 14:39:23.316138 2546 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-129-116.ec2.internal\" not found" node="ip-10-0-129-116.ec2.internal" Jun 14 14:39:23.406265 ip-10-0-129-116 kubenswrapper[2546]: E0614 14:39:23.406234 2546 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-129-116.ec2.internal\" not found" Jun 14 14:39:23.414592 ip-10-0-129-116 kubenswrapper[2546]: I0614 14:39:23.414569 2546 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/b5ab8648909b6097cc4bd39cce0c18f1-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-129-116.ec2.internal\" (UID: \"b5ab8648909b6097cc4bd39cce0c18f1\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-129-116.ec2.internal" Jun 14 14:39:23.414678 ip-10-0-129-116 kubenswrapper[2546]: I0614 14:39:23.414595 2546 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/b5ab8648909b6097cc4bd39cce0c18f1-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-129-116.ec2.internal\" (UID: \"b5ab8648909b6097cc4bd39cce0c18f1\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-129-116.ec2.internal" Jun 14 14:39:23.414678 ip-10-0-129-116 kubenswrapper[2546]: I0614 14:39:23.414613 2546 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/b68f1280995218345affbc9fee0e8f68-config\") pod \"kube-apiserver-proxy-ip-10-0-129-116.ec2.internal\" (UID: \"b68f1280995218345affbc9fee0e8f68\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-129-116.ec2.internal" Jun 14 14:39:23.506766 ip-10-0-129-116 kubenswrapper[2546]: E0614 14:39:23.506736 2546 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-129-116.ec2.internal\" not found" Jun 14 14:39:23.515041 ip-10-0-129-116 kubenswrapper[2546]: I0614 14:39:23.515018 2546 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/b5ab8648909b6097cc4bd39cce0c18f1-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-129-116.ec2.internal\" (UID: \"b5ab8648909b6097cc4bd39cce0c18f1\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-129-116.ec2.internal" Jun 14 14:39:23.515129 ip-10-0-129-116 kubenswrapper[2546]: I0614 14:39:23.515080 2546 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/b5ab8648909b6097cc4bd39cce0c18f1-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-129-116.ec2.internal\" (UID: \"b5ab8648909b6097cc4bd39cce0c18f1\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-129-116.ec2.internal" Jun 14 14:39:23.515129 ip-10-0-129-116 kubenswrapper[2546]: I0614 14:39:23.515113 2546 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/b68f1280995218345affbc9fee0e8f68-config\") pod \"kube-apiserver-proxy-ip-10-0-129-116.ec2.internal\" (UID: \"b68f1280995218345affbc9fee0e8f68\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-129-116.ec2.internal" Jun 14 14:39:23.515221 ip-10-0-129-116 kubenswrapper[2546]: I0614 14:39:23.515138 2546 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/host-path/b68f1280995218345affbc9fee0e8f68-config\") pod \"kube-apiserver-proxy-ip-10-0-129-116.ec2.internal\" (UID: \"b68f1280995218345affbc9fee0e8f68\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-129-116.ec2.internal" Jun 14 14:39:23.515221 ip-10-0-129-116 kubenswrapper[2546]: I0614 14:39:23.515137 2546 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/b5ab8648909b6097cc4bd39cce0c18f1-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-129-116.ec2.internal\" (UID: \"b5ab8648909b6097cc4bd39cce0c18f1\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-129-116.ec2.internal" Jun 14 14:39:23.515221 ip-10-0-129-116 kubenswrapper[2546]: I0614 14:39:23.515203 2546 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/b5ab8648909b6097cc4bd39cce0c18f1-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-129-116.ec2.internal\" (UID: \"b5ab8648909b6097cc4bd39cce0c18f1\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-129-116.ec2.internal" Jun 14 14:39:23.607530 ip-10-0-129-116 kubenswrapper[2546]: E0614 14:39:23.607465 2546 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-129-116.ec2.internal\" not found" Jun 14 14:39:23.615775 ip-10-0-129-116 kubenswrapper[2546]: I0614 14:39:23.615752 2546 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-129-116.ec2.internal" Jun 14 14:39:23.620524 ip-10-0-129-116 kubenswrapper[2546]: I0614 14:39:23.620346 2546 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-129-116.ec2.internal" Jun 14 14:39:23.707848 ip-10-0-129-116 kubenswrapper[2546]: E0614 14:39:23.707805 2546 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-129-116.ec2.internal\" not found" Jun 14 14:39:23.808321 ip-10-0-129-116 kubenswrapper[2546]: E0614 14:39:23.808284 2546 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-129-116.ec2.internal\" not found" Jun 14 14:39:23.908904 ip-10-0-129-116 kubenswrapper[2546]: E0614 14:39:23.908822 2546 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-129-116.ec2.internal\" not found" Jun 14 14:39:24.009366 ip-10-0-129-116 kubenswrapper[2546]: E0614 14:39:24.009324 2546 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-129-116.ec2.internal\" not found" Jun 14 14:39:24.014637 ip-10-0-129-116 kubenswrapper[2546]: I0614 14:39:24.014615 2546 transport.go:147] "Certificate rotation detected, shutting down client connections to start using new credentials" Jun 14 14:39:24.014772 ip-10-0-129-116 kubenswrapper[2546]: I0614 14:39:24.014754 2546 reflector.go:571] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.CSIDriver" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received" Jun 14 14:39:24.014828 ip-10-0-129-116 kubenswrapper[2546]: I0614 14:39:24.014786 2546 reflector.go:571] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.RuntimeClass" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received" Jun 14 14:39:24.097244 ip-10-0-129-116 kubenswrapper[2546]: I0614 14:39:24.097222 2546 reflector.go:439] "Caches populated" type="*v1.Node" reflector="k8s.io/client-go/informers/factory.go:160" Jun 14 14:39:24.104024 ip-10-0-129-116 kubenswrapper[2546]: I0614 14:39:24.103991 2546 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kube-apiserver-client-kubelet" expiration="2028-06-13 14:34:23 +0000 UTC" deadline="2028-03-16 20:00:03.983856898 +0000 UTC" Jun 14 14:39:24.104024 ip-10-0-129-116 kubenswrapper[2546]: I0614 14:39:24.104024 2546 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kube-apiserver-client-kubelet" sleep="15389h20m39.879836297s" Jun 14 14:39:24.112338 ip-10-0-129-116 kubenswrapper[2546]: I0614 14:39:24.112319 2546 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kubelet-serving" Jun 14 14:39:24.112338 ip-10-0-129-116 kubenswrapper[2546]: I0614 14:39:24.112330 2546 kubelet.go:3248] "Creating a mirror pod for static pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-129-116.ec2.internal" Jun 14 14:39:24.123059 ip-10-0-129-116 kubenswrapper[2546]: I0614 14:39:24.123040 2546 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]" Jun 14 14:39:24.125003 ip-10-0-129-116 kubenswrapper[2546]: I0614 14:39:24.124985 2546 kubelet.go:3248] "Creating a mirror pod for static pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-129-116.ec2.internal" Jun 14 14:39:24.125602 ip-10-0-129-116 kubenswrapper[2546]: I0614 14:39:24.125585 2546 reflector.go:439] "Caches populated" logger="kubernetes.io/kubelet-serving" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162" Jun 14 14:39:24.136961 ip-10-0-129-116 kubenswrapper[2546]: I0614 14:39:24.136945 2546 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]" Jun 14 14:39:24.144772 ip-10-0-129-116 kubenswrapper[2546]: I0614 14:39:24.144754 2546 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kubelet-serving" csr="csr-zk4xr" Jun 14 14:39:24.150291 ip-10-0-129-116 kubenswrapper[2546]: I0614 14:39:24.150275 2546 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kubelet-serving" csr="csr-zk4xr" Jun 14 14:39:24.269045 ip-10-0-129-116 kubenswrapper[2546]: W0614 14:39:24.269011 2546 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb5ab8648909b6097cc4bd39cce0c18f1.slice/crio-35fca2b67c21d250300ca68487257d3cdd6f8a8b8e7cd8a4e6c93cbb6bd7ad06 WatchSource:0}: Error finding container 35fca2b67c21d250300ca68487257d3cdd6f8a8b8e7cd8a4e6c93cbb6bd7ad06: Status 404 returned error can't find the container with id 35fca2b67c21d250300ca68487257d3cdd6f8a8b8e7cd8a4e6c93cbb6bd7ad06 Jun 14 14:39:24.269469 ip-10-0-129-116 kubenswrapper[2546]: W0614 14:39:24.269446 2546 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb68f1280995218345affbc9fee0e8f68.slice/crio-fe5e8705f9c6ed53998d2062e6474a5859eb6afafc09c3a31210c4563a7179ae WatchSource:0}: Error finding container fe5e8705f9c6ed53998d2062e6474a5859eb6afafc09c3a31210c4563a7179ae: Status 404 returned error can't find the container with id fe5e8705f9c6ed53998d2062e6474a5859eb6afafc09c3a31210c4563a7179ae Jun 14 14:39:24.273902 ip-10-0-129-116 kubenswrapper[2546]: I0614 14:39:24.273882 2546 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jun 14 14:39:24.456830 ip-10-0-129-116 kubenswrapper[2546]: I0614 14:39:24.456804 2546 reflector.go:439] "Caches populated" type="*v1.Service" reflector="k8s.io/client-go/informers/factory.go:160" Jun 14 14:39:24.898600 ip-10-0-129-116 kubenswrapper[2546]: I0614 14:39:24.898566 2546 reflector.go:439] "Caches populated" type="*v1.CSIDriver" reflector="k8s.io/client-go/informers/factory.go:160" Jun 14 14:39:25.062997 ip-10-0-129-116 kubenswrapper[2546]: I0614 14:39:25.062962 2546 apiserver.go:52] "Watching apiserver" Jun 14 14:39:25.070858 ip-10-0-129-116 kubenswrapper[2546]: I0614 14:39:25.070833 2546 reflector.go:439] "Caches populated" type="*v1.Pod" reflector="pkg/kubelet/config/apiserver.go:66" Jun 14 14:39:25.071260 ip-10-0-129-116 kubenswrapper[2546]: I0614 14:39:25.071231 2546 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kube-system/kube-apiserver-proxy-ip-10-0-129-116.ec2.internal","openshift-dns/node-resolver-ptpcx","openshift-image-registry/node-ca-dshlf","openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-129-116.ec2.internal","openshift-multus/multus-additional-cni-plugins-r4gvc","openshift-multus/multus-cghhz","openshift-network-diagnostics/network-check-target-m6zq8","kube-system/global-pull-secret-syncer-dlk5b","openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-mrqb6","openshift-cluster-node-tuning-operator/tuned-84jgl","openshift-multus/network-metrics-daemon-lt4g2","openshift-network-operator/iptables-alerter-qfjpp","openshift-ovn-kubernetes/ovnkube-node-zgckr","kube-system/konnectivity-agent-c96gx"] Jun 14 14:39:25.073760 ip-10-0-129-116 kubenswrapper[2546]: I0614 14:39:25.073737 2546 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-84jgl" Jun 14 14:39:25.076117 ip-10-0-129-116 kubenswrapper[2546]: I0614 14:39:25.076082 2546 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-zgckr" Jun 14 14:39:25.077231 ip-10-0-129-116 kubenswrapper[2546]: I0614 14:39:25.077190 2546 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"tuned-dockercfg-vn789\"" Jun 14 14:39:25.077336 ip-10-0-129-116 kubenswrapper[2546]: I0614 14:39:25.077245 2546 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"kube-root-ca.crt\"" Jun 14 14:39:25.077422 ip-10-0-129-116 kubenswrapper[2546]: I0614 14:39:25.077403 2546 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"openshift-service-ca.crt\"" Jun 14 14:39:25.078620 ip-10-0-129-116 kubenswrapper[2546]: I0614 14:39:25.078601 2546 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-script-lib\"" Jun 14 14:39:25.078759 ip-10-0-129-116 kubenswrapper[2546]: I0614 14:39:25.078731 2546 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-dshlf" Jun 14 14:39:25.078858 ip-10-0-129-116 kubenswrapper[2546]: I0614 14:39:25.078843 2546 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-node-metrics-cert\"" Jun 14 14:39:25.078976 ip-10-0-129-116 kubenswrapper[2546]: I0614 14:39:25.078959 2546 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-config\"" Jun 14 14:39:25.079211 ip-10-0-129-116 kubenswrapper[2546]: I0614 14:39:25.079042 2546 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-kubernetes-node-dockercfg-zb7w9\"" Jun 14 14:39:25.079646 ip-10-0-129-116 kubenswrapper[2546]: I0614 14:39:25.079630 2546 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"kube-root-ca.crt\"" Jun 14 14:39:25.079843 ip-10-0-129-116 kubenswrapper[2546]: I0614 14:39:25.079829 2546 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"openshift-service-ca.crt\"" Jun 14 14:39:25.080021 ip-10-0-129-116 kubenswrapper[2546]: I0614 14:39:25.080008 2546 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"env-overrides\"" Jun 14 14:39:25.080981 ip-10-0-129-116 kubenswrapper[2546]: I0614 14:39:25.080958 2546 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"openshift-service-ca.crt\"" Jun 14 14:39:25.081345 ip-10-0-129-116 kubenswrapper[2546]: I0614 14:39:25.081330 2546 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-c96gx" Jun 14 14:39:25.081468 ip-10-0-129-116 kubenswrapper[2546]: I0614 14:39:25.081444 2546 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"node-ca-dockercfg-f9xbs\"" Jun 14 14:39:25.081848 ip-10-0-129-116 kubenswrapper[2546]: I0614 14:39:25.081816 2546 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"image-registry-certificates\"" Jun 14 14:39:25.082384 ip-10-0-129-116 kubenswrapper[2546]: I0614 14:39:25.082365 2546 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"kube-root-ca.crt\"" Jun 14 14:39:25.083894 ip-10-0-129-116 kubenswrapper[2546]: I0614 14:39:25.083569 2546 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-r4gvc" Jun 14 14:39:25.083894 ip-10-0-129-116 kubenswrapper[2546]: I0614 14:39:25.083704 2546 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kube-system\"/\"konnectivity-ca-bundle\"" Jun 14 14:39:25.083894 ip-10-0-129-116 kubenswrapper[2546]: I0614 14:39:25.083786 2546 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"default-dockercfg-88nbh\"" Jun 14 14:39:25.084256 ip-10-0-129-116 kubenswrapper[2546]: I0614 14:39:25.084234 2546 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"konnectivity-agent\"" Jun 14 14:39:25.086079 ip-10-0-129-116 kubenswrapper[2546]: I0614 14:39:25.085934 2546 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"whereabouts-flatfile-config\"" Jun 14 14:39:25.086079 ip-10-0-129-116 kubenswrapper[2546]: I0614 14:39:25.085963 2546 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"multus-ancillary-tools-dockercfg-bssvr\"" Jun 14 14:39:25.086079 ip-10-0-129-116 kubenswrapper[2546]: I0614 14:39:25.085983 2546 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"openshift-service-ca.crt\"" Jun 14 14:39:25.086079 ip-10-0-129-116 kubenswrapper[2546]: I0614 14:39:25.085997 2546 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-cghhz" Jun 14 14:39:25.086533 ip-10-0-129-116 kubenswrapper[2546]: I0614 14:39:25.086511 2546 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"cni-copy-resources\"" Jun 14 14:39:25.086533 ip-10-0-129-116 kubenswrapper[2546]: I0614 14:39:25.086529 2546 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"kube-root-ca.crt\"" Jun 14 14:39:25.086681 ip-10-0-129-116 kubenswrapper[2546]: I0614 14:39:25.086664 2546 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"default-cni-sysctl-allowlist\"" Jun 14 14:39:25.088220 ip-10-0-129-116 kubenswrapper[2546]: I0614 14:39:25.088203 2546 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"default-dockercfg-6r9ck\"" Jun 14 14:39:25.089830 ip-10-0-129-116 kubenswrapper[2546]: I0614 14:39:25.088972 2546 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-mrqb6" Jun 14 14:39:25.089830 ip-10-0-129-116 kubenswrapper[2546]: I0614 14:39:25.089197 2546 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"multus-daemon-config\"" Jun 14 14:39:25.091759 ip-10-0-129-116 kubenswrapper[2546]: I0614 14:39:25.091734 2546 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-sa-dockercfg-jzk65\"" Jun 14 14:39:25.092176 ip-10-0-129-116 kubenswrapper[2546]: I0614 14:39:25.092154 2546 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"openshift-service-ca.crt\"" Jun 14 14:39:25.092268 ip-10-0-129-116 kubenswrapper[2546]: I0614 14:39:25.092256 2546 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"kube-root-ca.crt\"" Jun 14 14:39:25.092756 ip-10-0-129-116 kubenswrapper[2546]: I0614 14:39:25.092561 2546 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-metrics-serving-cert\"" Jun 14 14:39:25.092997 ip-10-0-129-116 kubenswrapper[2546]: I0614 14:39:25.092879 2546 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-m6zq8" Jun 14 14:39:25.093071 ip-10-0-129-116 kubenswrapper[2546]: E0614 14:39:25.092987 2546 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-m6zq8" podUID="726e808e-de0a-4f4f-809c-8f7e7cc45432" Jun 14 14:39:25.096429 ip-10-0-129-116 kubenswrapper[2546]: I0614 14:39:25.096408 2546 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-ptpcx" Jun 14 14:39:25.099217 ip-10-0-129-116 kubenswrapper[2546]: I0614 14:39:25.098799 2546 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"openshift-service-ca.crt\"" Jun 14 14:39:25.099217 ip-10-0-129-116 kubenswrapper[2546]: I0614 14:39:25.098859 2546 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"node-resolver-dockercfg-h96q6\"" Jun 14 14:39:25.099217 ip-10-0-129-116 kubenswrapper[2546]: I0614 14:39:25.099001 2546 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"kube-root-ca.crt\"" Jun 14 14:39:25.099371 ip-10-0-129-116 kubenswrapper[2546]: I0614 14:39:25.099282 2546 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-dlk5b" Jun 14 14:39:25.099371 ip-10-0-129-116 kubenswrapper[2546]: E0614 14:39:25.099349 2546 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-dlk5b" podUID="6446f965-15fc-40d5-85e7-20cec0d42549" Jun 14 14:39:25.101609 ip-10-0-129-116 kubenswrapper[2546]: I0614 14:39:25.101584 2546 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-lt4g2" Jun 14 14:39:25.101691 ip-10-0-129-116 kubenswrapper[2546]: E0614 14:39:25.101658 2546 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-lt4g2" podUID="aa4feed6-27ad-493a-baa3-8d0d96cb5309" Jun 14 14:39:25.104467 ip-10-0-129-116 kubenswrapper[2546]: I0614 14:39:25.104449 2546 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-qfjpp" Jun 14 14:39:25.107273 ip-10-0-129-116 kubenswrapper[2546]: I0614 14:39:25.107244 2546 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"openshift-service-ca.crt\"" Jun 14 14:39:25.107644 ip-10-0-129-116 kubenswrapper[2546]: I0614 14:39:25.107596 2546 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-dockercfg-l2qhr\"" Jun 14 14:39:25.107937 ip-10-0-129-116 kubenswrapper[2546]: I0614 14:39:25.107856 2546 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"kube-root-ca.crt\"" Jun 14 14:39:25.108319 ip-10-0-129-116 kubenswrapper[2546]: I0614 14:39:25.108114 2546 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-script\"" Jun 14 14:39:25.113960 ip-10-0-129-116 kubenswrapper[2546]: I0614 14:39:25.113942 2546 desired_state_of_world_populator.go:154] "Finished populating initial desired state of world" Jun 14 14:39:25.122305 ip-10-0-129-116 kubenswrapper[2546]: I0614 14:39:25.122280 2546 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/3cb1d703-5bee-4d7e-8879-ba67f7129fed-host-var-lib-cni-bin\") pod \"multus-cghhz\" (UID: \"3cb1d703-5bee-4d7e-8879-ba67f7129fed\") " pod="openshift-multus/multus-cghhz" Jun 14 14:39:25.122409 ip-10-0-129-116 kubenswrapper[2546]: I0614 14:39:25.122317 2546 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/e8d897b0-a5b7-4f7e-a664-7c7a45a1c5de-etc-systemd\") pod \"tuned-84jgl\" (UID: \"e8d897b0-a5b7-4f7e-a664-7c7a45a1c5de\") " pod="openshift-cluster-node-tuning-operator/tuned-84jgl" Jun 14 14:39:25.122409 ip-10-0-129-116 kubenswrapper[2546]: I0614 14:39:25.122342 2546 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/c154f741-4d88-4933-b24b-9fa582917964-host-slash\") pod \"ovnkube-node-zgckr\" (UID: \"c154f741-4d88-4933-b24b-9fa582917964\") " pod="openshift-ovn-kubernetes/ovnkube-node-zgckr" Jun 14 14:39:25.122409 ip-10-0-129-116 kubenswrapper[2546]: I0614 14:39:25.122366 2546 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/c154f741-4d88-4933-b24b-9fa582917964-run-openvswitch\") pod \"ovnkube-node-zgckr\" (UID: \"c154f741-4d88-4933-b24b-9fa582917964\") " pod="openshift-ovn-kubernetes/ovnkube-node-zgckr" Jun 14 14:39:25.122409 ip-10-0-129-116 kubenswrapper[2546]: I0614 14:39:25.122390 2546 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/3cb1d703-5bee-4d7e-8879-ba67f7129fed-host-run-k8s-cni-cncf-io\") pod \"multus-cghhz\" (UID: \"3cb1d703-5bee-4d7e-8879-ba67f7129fed\") " pod="openshift-multus/multus-cghhz" Jun 14 14:39:25.122669 ip-10-0-129-116 kubenswrapper[2546]: I0614 14:39:25.122413 2546 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/3cb1d703-5bee-4d7e-8879-ba67f7129fed-host-var-lib-kubelet\") pod \"multus-cghhz\" (UID: \"3cb1d703-5bee-4d7e-8879-ba67f7129fed\") " pod="openshift-multus/multus-cghhz" Jun 14 14:39:25.122669 ip-10-0-129-116 kubenswrapper[2546]: I0614 14:39:25.122436 2546 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/4df84aa4-08f2-487d-a8fb-fa2fe8144da8-serviceca\") pod \"node-ca-dshlf\" (UID: \"4df84aa4-08f2-487d-a8fb-fa2fe8144da8\") " pod="openshift-image-registry/node-ca-dshlf" Jun 14 14:39:25.122669 ip-10-0-129-116 kubenswrapper[2546]: I0614 14:39:25.122456 2546 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/6446f965-15fc-40d5-85e7-20cec0d42549-dbus\") pod \"global-pull-secret-syncer-dlk5b\" (UID: \"6446f965-15fc-40d5-85e7-20cec0d42549\") " pod="kube-system/global-pull-secret-syncer-dlk5b" Jun 14 14:39:25.122669 ip-10-0-129-116 kubenswrapper[2546]: I0614 14:39:25.122470 2546 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/c154f741-4d88-4933-b24b-9fa582917964-env-overrides\") pod \"ovnkube-node-zgckr\" (UID: \"c154f741-4d88-4933-b24b-9fa582917964\") " pod="openshift-ovn-kubernetes/ovnkube-node-zgckr" Jun 14 14:39:25.122669 ip-10-0-129-116 kubenswrapper[2546]: I0614 14:39:25.122506 2546 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/c154f741-4d88-4933-b24b-9fa582917964-ovn-node-metrics-cert\") pod \"ovnkube-node-zgckr\" (UID: \"c154f741-4d88-4933-b24b-9fa582917964\") " pod="openshift-ovn-kubernetes/ovnkube-node-zgckr" Jun 14 14:39:25.122669 ip-10-0-129-116 kubenswrapper[2546]: I0614 14:39:25.122542 2546 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/3cb1d703-5bee-4d7e-8879-ba67f7129fed-multus-conf-dir\") pod \"multus-cghhz\" (UID: \"3cb1d703-5bee-4d7e-8879-ba67f7129fed\") " pod="openshift-multus/multus-cghhz" Jun 14 14:39:25.122669 ip-10-0-129-116 kubenswrapper[2546]: I0614 14:39:25.122567 2546 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-lh8nq\" (UniqueName: \"kubernetes.io/projected/d6890b61-860c-4e6c-8138-26bc128905c5-kube-api-access-lh8nq\") pod \"iptables-alerter-qfjpp\" (UID: \"d6890b61-860c-4e6c-8138-26bc128905c5\") " pod="openshift-network-operator/iptables-alerter-qfjpp" Jun 14 14:39:25.122669 ip-10-0-129-116 kubenswrapper[2546]: I0614 14:39:25.122589 2546 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/c154f741-4d88-4933-b24b-9fa582917964-systemd-units\") pod \"ovnkube-node-zgckr\" (UID: \"c154f741-4d88-4933-b24b-9fa582917964\") " pod="openshift-ovn-kubernetes/ovnkube-node-zgckr" Jun 14 14:39:25.122669 ip-10-0-129-116 kubenswrapper[2546]: I0614 14:39:25.122612 2546 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/c154f741-4d88-4933-b24b-9fa582917964-run-ovn\") pod \"ovnkube-node-zgckr\" (UID: \"c154f741-4d88-4933-b24b-9fa582917964\") " pod="openshift-ovn-kubernetes/ovnkube-node-zgckr" Jun 14 14:39:25.122669 ip-10-0-129-116 kubenswrapper[2546]: I0614 14:39:25.122634 2546 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/c154f741-4d88-4933-b24b-9fa582917964-node-log\") pod \"ovnkube-node-zgckr\" (UID: \"c154f741-4d88-4933-b24b-9fa582917964\") " pod="openshift-ovn-kubernetes/ovnkube-node-zgckr" Jun 14 14:39:25.122669 ip-10-0-129-116 kubenswrapper[2546]: I0614 14:39:25.122658 2546 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wtv6b\" (UniqueName: \"kubernetes.io/projected/c154f741-4d88-4933-b24b-9fa582917964-kube-api-access-wtv6b\") pod \"ovnkube-node-zgckr\" (UID: \"c154f741-4d88-4933-b24b-9fa582917964\") " pod="openshift-ovn-kubernetes/ovnkube-node-zgckr" Jun 14 14:39:25.123204 ip-10-0-129-116 kubenswrapper[2546]: I0614 14:39:25.122710 2546 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/3cb1d703-5bee-4d7e-8879-ba67f7129fed-system-cni-dir\") pod \"multus-cghhz\" (UID: \"3cb1d703-5bee-4d7e-8879-ba67f7129fed\") " pod="openshift-multus/multus-cghhz" Jun 14 14:39:25.123204 ip-10-0-129-116 kubenswrapper[2546]: I0614 14:39:25.122748 2546 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/3cb1d703-5bee-4d7e-8879-ba67f7129fed-cni-binary-copy\") pod \"multus-cghhz\" (UID: \"3cb1d703-5bee-4d7e-8879-ba67f7129fed\") " pod="openshift-multus/multus-cghhz" Jun 14 14:39:25.123204 ip-10-0-129-116 kubenswrapper[2546]: I0614 14:39:25.122774 2546 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-z2kjr\" (UniqueName: \"kubernetes.io/projected/3cb1d703-5bee-4d7e-8879-ba67f7129fed-kube-api-access-z2kjr\") pod \"multus-cghhz\" (UID: \"3cb1d703-5bee-4d7e-8879-ba67f7129fed\") " pod="openshift-multus/multus-cghhz" Jun 14 14:39:25.123204 ip-10-0-129-116 kubenswrapper[2546]: I0614 14:39:25.122799 2546 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/e8d897b0-a5b7-4f7e-a664-7c7a45a1c5de-sys\") pod \"tuned-84jgl\" (UID: \"e8d897b0-a5b7-4f7e-a664-7c7a45a1c5de\") " pod="openshift-cluster-node-tuning-operator/tuned-84jgl" Jun 14 14:39:25.123204 ip-10-0-129-116 kubenswrapper[2546]: I0614 14:39:25.122837 2546 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/c154f741-4d88-4933-b24b-9fa582917964-host-run-netns\") pod \"ovnkube-node-zgckr\" (UID: \"c154f741-4d88-4933-b24b-9fa582917964\") " pod="openshift-ovn-kubernetes/ovnkube-node-zgckr" Jun 14 14:39:25.123204 ip-10-0-129-116 kubenswrapper[2546]: I0614 14:39:25.122868 2546 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/32b27404-1251-4372-a3b9-de131b817153-socket-dir\") pod \"aws-ebs-csi-driver-node-mrqb6\" (UID: \"32b27404-1251-4372-a3b9-de131b817153\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-mrqb6" Jun 14 14:39:25.123204 ip-10-0-129-116 kubenswrapper[2546]: I0614 14:39:25.122894 2546 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-gkw2d\" (UniqueName: \"kubernetes.io/projected/32b27404-1251-4372-a3b9-de131b817153-kube-api-access-gkw2d\") pod \"aws-ebs-csi-driver-node-mrqb6\" (UID: \"32b27404-1251-4372-a3b9-de131b817153\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-mrqb6" Jun 14 14:39:25.123204 ip-10-0-129-116 kubenswrapper[2546]: I0614 14:39:25.122919 2546 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/30e02c92-21a3-43cd-a129-a21a3a3ccb37-tmp-dir\") pod \"node-resolver-ptpcx\" (UID: \"30e02c92-21a3-43cd-a129-a21a3a3ccb37\") " pod="openshift-dns/node-resolver-ptpcx" Jun 14 14:39:25.123204 ip-10-0-129-116 kubenswrapper[2546]: I0614 14:39:25.122942 2546 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/e8d897b0-a5b7-4f7e-a664-7c7a45a1c5de-etc-kubernetes\") pod \"tuned-84jgl\" (UID: \"e8d897b0-a5b7-4f7e-a664-7c7a45a1c5de\") " pod="openshift-cluster-node-tuning-operator/tuned-84jgl" Jun 14 14:39:25.123204 ip-10-0-129-116 kubenswrapper[2546]: I0614 14:39:25.122963 2546 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/e8d897b0-a5b7-4f7e-a664-7c7a45a1c5de-etc-sysctl-conf\") pod \"tuned-84jgl\" (UID: \"e8d897b0-a5b7-4f7e-a664-7c7a45a1c5de\") " pod="openshift-cluster-node-tuning-operator/tuned-84jgl" Jun 14 14:39:25.123204 ip-10-0-129-116 kubenswrapper[2546]: I0614 14:39:25.122984 2546 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/c154f741-4d88-4933-b24b-9fa582917964-run-systemd\") pod \"ovnkube-node-zgckr\" (UID: \"c154f741-4d88-4933-b24b-9fa582917964\") " pod="openshift-ovn-kubernetes/ovnkube-node-zgckr" Jun 14 14:39:25.123204 ip-10-0-129-116 kubenswrapper[2546]: I0614 14:39:25.123005 2546 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/c154f741-4d88-4933-b24b-9fa582917964-var-lib-openvswitch\") pod \"ovnkube-node-zgckr\" (UID: \"c154f741-4d88-4933-b24b-9fa582917964\") " pod="openshift-ovn-kubernetes/ovnkube-node-zgckr" Jun 14 14:39:25.123204 ip-10-0-129-116 kubenswrapper[2546]: I0614 14:39:25.123029 2546 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/c154f741-4d88-4933-b24b-9fa582917964-host-run-ovn-kubernetes\") pod \"ovnkube-node-zgckr\" (UID: \"c154f741-4d88-4933-b24b-9fa582917964\") " pod="openshift-ovn-kubernetes/ovnkube-node-zgckr" Jun 14 14:39:25.123204 ip-10-0-129-116 kubenswrapper[2546]: I0614 14:39:25.123052 2546 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/8da319a4-be6d-4245-aed1-aa1fdaf8ca66-os-release\") pod \"multus-additional-cni-plugins-r4gvc\" (UID: \"8da319a4-be6d-4245-aed1-aa1fdaf8ca66\") " pod="openshift-multus/multus-additional-cni-plugins-r4gvc" Jun 14 14:39:25.123204 ip-10-0-129-116 kubenswrapper[2546]: I0614 14:39:25.123075 2546 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/3cb1d703-5bee-4d7e-8879-ba67f7129fed-multus-daemon-config\") pod \"multus-cghhz\" (UID: \"3cb1d703-5bee-4d7e-8879-ba67f7129fed\") " pod="openshift-multus/multus-cghhz" Jun 14 14:39:25.123204 ip-10-0-129-116 kubenswrapper[2546]: I0614 14:39:25.123117 2546 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/e8d897b0-a5b7-4f7e-a664-7c7a45a1c5de-var-lib-kubelet\") pod \"tuned-84jgl\" (UID: \"e8d897b0-a5b7-4f7e-a664-7c7a45a1c5de\") " pod="openshift-cluster-node-tuning-operator/tuned-84jgl" Jun 14 14:39:25.123924 ip-10-0-129-116 kubenswrapper[2546]: I0614 14:39:25.123144 2546 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/c154f741-4d88-4933-b24b-9fa582917964-log-socket\") pod \"ovnkube-node-zgckr\" (UID: \"c154f741-4d88-4933-b24b-9fa582917964\") " pod="openshift-ovn-kubernetes/ovnkube-node-zgckr" Jun 14 14:39:25.123924 ip-10-0-129-116 kubenswrapper[2546]: I0614 14:39:25.123171 2546 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/32b27404-1251-4372-a3b9-de131b817153-registration-dir\") pod \"aws-ebs-csi-driver-node-mrqb6\" (UID: \"32b27404-1251-4372-a3b9-de131b817153\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-mrqb6" Jun 14 14:39:25.123924 ip-10-0-129-116 kubenswrapper[2546]: I0614 14:39:25.123200 2546 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/e8d897b0-a5b7-4f7e-a664-7c7a45a1c5de-etc-sysconfig\") pod \"tuned-84jgl\" (UID: \"e8d897b0-a5b7-4f7e-a664-7c7a45a1c5de\") " pod="openshift-cluster-node-tuning-operator/tuned-84jgl" Jun 14 14:39:25.123924 ip-10-0-129-116 kubenswrapper[2546]: I0614 14:39:25.123222 2546 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/e8d897b0-a5b7-4f7e-a664-7c7a45a1c5de-etc-sysctl-d\") pod \"tuned-84jgl\" (UID: \"e8d897b0-a5b7-4f7e-a664-7c7a45a1c5de\") " pod="openshift-cluster-node-tuning-operator/tuned-84jgl" Jun 14 14:39:25.123924 ip-10-0-129-116 kubenswrapper[2546]: I0614 14:39:25.123245 2546 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/c154f741-4d88-4933-b24b-9fa582917964-host-kubelet\") pod \"ovnkube-node-zgckr\" (UID: \"c154f741-4d88-4933-b24b-9fa582917964\") " pod="openshift-ovn-kubernetes/ovnkube-node-zgckr" Jun 14 14:39:25.123924 ip-10-0-129-116 kubenswrapper[2546]: I0614 14:39:25.123299 2546 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/c154f741-4d88-4933-b24b-9fa582917964-ovnkube-config\") pod \"ovnkube-node-zgckr\" (UID: \"c154f741-4d88-4933-b24b-9fa582917964\") " pod="openshift-ovn-kubernetes/ovnkube-node-zgckr" Jun 14 14:39:25.123924 ip-10-0-129-116 kubenswrapper[2546]: I0614 14:39:25.123327 2546 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/8da319a4-be6d-4245-aed1-aa1fdaf8ca66-cni-binary-copy\") pod \"multus-additional-cni-plugins-r4gvc\" (UID: \"8da319a4-be6d-4245-aed1-aa1fdaf8ca66\") " pod="openshift-multus/multus-additional-cni-plugins-r4gvc" Jun 14 14:39:25.123924 ip-10-0-129-116 kubenswrapper[2546]: I0614 14:39:25.123351 2546 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/3cb1d703-5bee-4d7e-8879-ba67f7129fed-multus-cni-dir\") pod \"multus-cghhz\" (UID: \"3cb1d703-5bee-4d7e-8879-ba67f7129fed\") " pod="openshift-multus/multus-cghhz" Jun 14 14:39:25.123924 ip-10-0-129-116 kubenswrapper[2546]: I0614 14:39:25.123377 2546 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/3cb1d703-5bee-4d7e-8879-ba67f7129fed-os-release\") pod \"multus-cghhz\" (UID: \"3cb1d703-5bee-4d7e-8879-ba67f7129fed\") " pod="openshift-multus/multus-cghhz" Jun 14 14:39:25.123924 ip-10-0-129-116 kubenswrapper[2546]: I0614 14:39:25.123402 2546 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/3cb1d703-5bee-4d7e-8879-ba67f7129fed-multus-socket-dir-parent\") pod \"multus-cghhz\" (UID: \"3cb1d703-5bee-4d7e-8879-ba67f7129fed\") " pod="openshift-multus/multus-cghhz" Jun 14 14:39:25.123924 ip-10-0-129-116 kubenswrapper[2546]: I0614 14:39:25.123444 2546 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/e8d897b0-a5b7-4f7e-a664-7c7a45a1c5de-tmp\") pod \"tuned-84jgl\" (UID: \"e8d897b0-a5b7-4f7e-a664-7c7a45a1c5de\") " pod="openshift-cluster-node-tuning-operator/tuned-84jgl" Jun 14 14:39:25.123924 ip-10-0-129-116 kubenswrapper[2546]: I0614 14:39:25.123473 2546 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/c154f741-4d88-4933-b24b-9fa582917964-host-cni-netd\") pod \"ovnkube-node-zgckr\" (UID: \"c154f741-4d88-4933-b24b-9fa582917964\") " pod="openshift-ovn-kubernetes/ovnkube-node-zgckr" Jun 14 14:39:25.123924 ip-10-0-129-116 kubenswrapper[2546]: I0614 14:39:25.123510 2546 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/105377da-c223-41ad-b033-546cb01239c4-konnectivity-ca\") pod \"konnectivity-agent-c96gx\" (UID: \"105377da-c223-41ad-b033-546cb01239c4\") " pod="kube-system/konnectivity-agent-c96gx" Jun 14 14:39:25.123924 ip-10-0-129-116 kubenswrapper[2546]: I0614 14:39:25.123533 2546 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/32b27404-1251-4372-a3b9-de131b817153-etc-selinux\") pod \"aws-ebs-csi-driver-node-mrqb6\" (UID: \"32b27404-1251-4372-a3b9-de131b817153\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-mrqb6" Jun 14 14:39:25.123924 ip-10-0-129-116 kubenswrapper[2546]: I0614 14:39:25.123560 2546 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-lhb84\" (UniqueName: \"kubernetes.io/projected/4df84aa4-08f2-487d-a8fb-fa2fe8144da8-kube-api-access-lhb84\") pod \"node-ca-dshlf\" (UID: \"4df84aa4-08f2-487d-a8fb-fa2fe8144da8\") " pod="openshift-image-registry/node-ca-dshlf" Jun 14 14:39:25.123924 ip-10-0-129-116 kubenswrapper[2546]: I0614 14:39:25.123581 2546 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/e8d897b0-a5b7-4f7e-a664-7c7a45a1c5de-run\") pod \"tuned-84jgl\" (UID: \"e8d897b0-a5b7-4f7e-a664-7c7a45a1c5de\") " pod="openshift-cluster-node-tuning-operator/tuned-84jgl" Jun 14 14:39:25.124525 ip-10-0-129-116 kubenswrapper[2546]: I0614 14:39:25.123604 2546 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-lwsd5\" (UniqueName: \"kubernetes.io/projected/e8d897b0-a5b7-4f7e-a664-7c7a45a1c5de-kube-api-access-lwsd5\") pod \"tuned-84jgl\" (UID: \"e8d897b0-a5b7-4f7e-a664-7c7a45a1c5de\") " pod="openshift-cluster-node-tuning-operator/tuned-84jgl" Jun 14 14:39:25.124525 ip-10-0-129-116 kubenswrapper[2546]: I0614 14:39:25.123627 2546 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/c154f741-4d88-4933-b24b-9fa582917964-etc-openvswitch\") pod \"ovnkube-node-zgckr\" (UID: \"c154f741-4d88-4933-b24b-9fa582917964\") " pod="openshift-ovn-kubernetes/ovnkube-node-zgckr" Jun 14 14:39:25.124525 ip-10-0-129-116 kubenswrapper[2546]: I0614 14:39:25.123650 2546 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/8da319a4-be6d-4245-aed1-aa1fdaf8ca66-tuning-conf-dir\") pod \"multus-additional-cni-plugins-r4gvc\" (UID: \"8da319a4-be6d-4245-aed1-aa1fdaf8ca66\") " pod="openshift-multus/multus-additional-cni-plugins-r4gvc" Jun 14 14:39:25.124525 ip-10-0-129-116 kubenswrapper[2546]: I0614 14:39:25.123689 2546 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-nbjrn\" (UniqueName: \"kubernetes.io/projected/8da319a4-be6d-4245-aed1-aa1fdaf8ca66-kube-api-access-nbjrn\") pod \"multus-additional-cni-plugins-r4gvc\" (UID: \"8da319a4-be6d-4245-aed1-aa1fdaf8ca66\") " pod="openshift-multus/multus-additional-cni-plugins-r4gvc" Jun 14 14:39:25.124525 ip-10-0-129-116 kubenswrapper[2546]: I0614 14:39:25.123733 2546 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/3cb1d703-5bee-4d7e-8879-ba67f7129fed-host-var-lib-cni-multus\") pod \"multus-cghhz\" (UID: \"3cb1d703-5bee-4d7e-8879-ba67f7129fed\") " pod="openshift-multus/multus-cghhz" Jun 14 14:39:25.124525 ip-10-0-129-116 kubenswrapper[2546]: I0614 14:39:25.123767 2546 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-t9bks\" (UniqueName: \"kubernetes.io/projected/726e808e-de0a-4f4f-809c-8f7e7cc45432-kube-api-access-t9bks\") pod \"network-check-target-m6zq8\" (UID: \"726e808e-de0a-4f4f-809c-8f7e7cc45432\") " pod="openshift-network-diagnostics/network-check-target-m6zq8" Jun 14 14:39:25.124525 ip-10-0-129-116 kubenswrapper[2546]: I0614 14:39:25.123792 2546 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wlw7s\" (UniqueName: \"kubernetes.io/projected/30e02c92-21a3-43cd-a129-a21a3a3ccb37-kube-api-access-wlw7s\") pod \"node-resolver-ptpcx\" (UID: \"30e02c92-21a3-43cd-a129-a21a3a3ccb37\") " pod="openshift-dns/node-resolver-ptpcx" Jun 14 14:39:25.124525 ip-10-0-129-116 kubenswrapper[2546]: I0614 14:39:25.123815 2546 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/d6890b61-860c-4e6c-8138-26bc128905c5-iptables-alerter-script\") pod \"iptables-alerter-qfjpp\" (UID: \"d6890b61-860c-4e6c-8138-26bc128905c5\") " pod="openshift-network-operator/iptables-alerter-qfjpp" Jun 14 14:39:25.124525 ip-10-0-129-116 kubenswrapper[2546]: I0614 14:39:25.123838 2546 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/e8d897b0-a5b7-4f7e-a664-7c7a45a1c5de-lib-modules\") pod \"tuned-84jgl\" (UID: \"e8d897b0-a5b7-4f7e-a664-7c7a45a1c5de\") " pod="openshift-cluster-node-tuning-operator/tuned-84jgl" Jun 14 14:39:25.124525 ip-10-0-129-116 kubenswrapper[2546]: I0614 14:39:25.123862 2546 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/8da319a4-be6d-4245-aed1-aa1fdaf8ca66-system-cni-dir\") pod \"multus-additional-cni-plugins-r4gvc\" (UID: \"8da319a4-be6d-4245-aed1-aa1fdaf8ca66\") " pod="openshift-multus/multus-additional-cni-plugins-r4gvc" Jun 14 14:39:25.124525 ip-10-0-129-116 kubenswrapper[2546]: I0614 14:39:25.123896 2546 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/3cb1d703-5bee-4d7e-8879-ba67f7129fed-host-run-multus-certs\") pod \"multus-cghhz\" (UID: \"3cb1d703-5bee-4d7e-8879-ba67f7129fed\") " pod="openshift-multus/multus-cghhz" Jun 14 14:39:25.124525 ip-10-0-129-116 kubenswrapper[2546]: I0614 14:39:25.123945 2546 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/4df84aa4-08f2-487d-a8fb-fa2fe8144da8-host\") pod \"node-ca-dshlf\" (UID: \"4df84aa4-08f2-487d-a8fb-fa2fe8144da8\") " pod="openshift-image-registry/node-ca-dshlf" Jun 14 14:39:25.124525 ip-10-0-129-116 kubenswrapper[2546]: I0614 14:39:25.123967 2546 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/30e02c92-21a3-43cd-a129-a21a3a3ccb37-hosts-file\") pod \"node-resolver-ptpcx\" (UID: \"30e02c92-21a3-43cd-a129-a21a3a3ccb37\") " pod="openshift-dns/node-resolver-ptpcx" Jun 14 14:39:25.124525 ip-10-0-129-116 kubenswrapper[2546]: I0614 14:39:25.123992 2546 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/8da319a4-be6d-4245-aed1-aa1fdaf8ca66-cnibin\") pod \"multus-additional-cni-plugins-r4gvc\" (UID: \"8da319a4-be6d-4245-aed1-aa1fdaf8ca66\") " pod="openshift-multus/multus-additional-cni-plugins-r4gvc" Jun 14 14:39:25.124525 ip-10-0-129-116 kubenswrapper[2546]: I0614 14:39:25.124013 2546 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/3cb1d703-5bee-4d7e-8879-ba67f7129fed-cnibin\") pod \"multus-cghhz\" (UID: \"3cb1d703-5bee-4d7e-8879-ba67f7129fed\") " pod="openshift-multus/multus-cghhz" Jun 14 14:39:25.124525 ip-10-0-129-116 kubenswrapper[2546]: I0614 14:39:25.124034 2546 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/3cb1d703-5bee-4d7e-8879-ba67f7129fed-etc-kubernetes\") pod \"multus-cghhz\" (UID: \"3cb1d703-5bee-4d7e-8879-ba67f7129fed\") " pod="openshift-multus/multus-cghhz" Jun 14 14:39:25.125334 ip-10-0-129-116 kubenswrapper[2546]: I0614 14:39:25.124062 2546 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/32b27404-1251-4372-a3b9-de131b817153-kubelet-dir\") pod \"aws-ebs-csi-driver-node-mrqb6\" (UID: \"32b27404-1251-4372-a3b9-de131b817153\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-mrqb6" Jun 14 14:39:25.125334 ip-10-0-129-116 kubenswrapper[2546]: I0614 14:39:25.124109 2546 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/6446f965-15fc-40d5-85e7-20cec0d42549-kubelet-config\") pod \"global-pull-secret-syncer-dlk5b\" (UID: \"6446f965-15fc-40d5-85e7-20cec0d42549\") " pod="kube-system/global-pull-secret-syncer-dlk5b" Jun 14 14:39:25.125334 ip-10-0-129-116 kubenswrapper[2546]: I0614 14:39:25.124133 2546 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/6446f965-15fc-40d5-85e7-20cec0d42549-original-pull-secret\") pod \"global-pull-secret-syncer-dlk5b\" (UID: \"6446f965-15fc-40d5-85e7-20cec0d42549\") " pod="kube-system/global-pull-secret-syncer-dlk5b" Jun 14 14:39:25.125334 ip-10-0-129-116 kubenswrapper[2546]: I0614 14:39:25.124158 2546 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-smz42\" (UniqueName: \"kubernetes.io/projected/aa4feed6-27ad-493a-baa3-8d0d96cb5309-kube-api-access-smz42\") pod \"network-metrics-daemon-lt4g2\" (UID: \"aa4feed6-27ad-493a-baa3-8d0d96cb5309\") " pod="openshift-multus/network-metrics-daemon-lt4g2" Jun 14 14:39:25.125334 ip-10-0-129-116 kubenswrapper[2546]: I0614 14:39:25.124178 2546 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/e8d897b0-a5b7-4f7e-a664-7c7a45a1c5de-host\") pod \"tuned-84jgl\" (UID: \"e8d897b0-a5b7-4f7e-a664-7c7a45a1c5de\") " pod="openshift-cluster-node-tuning-operator/tuned-84jgl" Jun 14 14:39:25.125334 ip-10-0-129-116 kubenswrapper[2546]: I0614 14:39:25.124202 2546 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/8da319a4-be6d-4245-aed1-aa1fdaf8ca66-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-r4gvc\" (UID: \"8da319a4-be6d-4245-aed1-aa1fdaf8ca66\") " pod="openshift-multus/multus-additional-cni-plugins-r4gvc" Jun 14 14:39:25.125334 ip-10-0-129-116 kubenswrapper[2546]: I0614 14:39:25.124236 2546 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/8da319a4-be6d-4245-aed1-aa1fdaf8ca66-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-r4gvc\" (UID: \"8da319a4-be6d-4245-aed1-aa1fdaf8ca66\") " pod="openshift-multus/multus-additional-cni-plugins-r4gvc" Jun 14 14:39:25.125334 ip-10-0-129-116 kubenswrapper[2546]: I0614 14:39:25.124271 2546 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/e8d897b0-a5b7-4f7e-a664-7c7a45a1c5de-etc-tuned\") pod \"tuned-84jgl\" (UID: \"e8d897b0-a5b7-4f7e-a664-7c7a45a1c5de\") " pod="openshift-cluster-node-tuning-operator/tuned-84jgl" Jun 14 14:39:25.125334 ip-10-0-129-116 kubenswrapper[2546]: I0614 14:39:25.124303 2546 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/105377da-c223-41ad-b033-546cb01239c4-agent-certs\") pod \"konnectivity-agent-c96gx\" (UID: \"105377da-c223-41ad-b033-546cb01239c4\") " pod="kube-system/konnectivity-agent-c96gx" Jun 14 14:39:25.125334 ip-10-0-129-116 kubenswrapper[2546]: I0614 14:39:25.124330 2546 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/3cb1d703-5bee-4d7e-8879-ba67f7129fed-hostroot\") pod \"multus-cghhz\" (UID: \"3cb1d703-5bee-4d7e-8879-ba67f7129fed\") " pod="openshift-multus/multus-cghhz" Jun 14 14:39:25.125334 ip-10-0-129-116 kubenswrapper[2546]: I0614 14:39:25.124349 2546 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/32b27404-1251-4372-a3b9-de131b817153-sys-fs\") pod \"aws-ebs-csi-driver-node-mrqb6\" (UID: \"32b27404-1251-4372-a3b9-de131b817153\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-mrqb6" Jun 14 14:39:25.125334 ip-10-0-129-116 kubenswrapper[2546]: I0614 14:39:25.124369 2546 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/d6890b61-860c-4e6c-8138-26bc128905c5-host-slash\") pod \"iptables-alerter-qfjpp\" (UID: \"d6890b61-860c-4e6c-8138-26bc128905c5\") " pod="openshift-network-operator/iptables-alerter-qfjpp" Jun 14 14:39:25.125334 ip-10-0-129-116 kubenswrapper[2546]: I0614 14:39:25.124394 2546 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/e8d897b0-a5b7-4f7e-a664-7c7a45a1c5de-etc-modprobe-d\") pod \"tuned-84jgl\" (UID: \"e8d897b0-a5b7-4f7e-a664-7c7a45a1c5de\") " pod="openshift-cluster-node-tuning-operator/tuned-84jgl" Jun 14 14:39:25.125334 ip-10-0-129-116 kubenswrapper[2546]: I0614 14:39:25.124436 2546 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/32b27404-1251-4372-a3b9-de131b817153-device-dir\") pod \"aws-ebs-csi-driver-node-mrqb6\" (UID: \"32b27404-1251-4372-a3b9-de131b817153\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-mrqb6" Jun 14 14:39:25.125334 ip-10-0-129-116 kubenswrapper[2546]: I0614 14:39:25.124458 2546 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/aa4feed6-27ad-493a-baa3-8d0d96cb5309-metrics-certs\") pod \"network-metrics-daemon-lt4g2\" (UID: \"aa4feed6-27ad-493a-baa3-8d0d96cb5309\") " pod="openshift-multus/network-metrics-daemon-lt4g2" Jun 14 14:39:25.125334 ip-10-0-129-116 kubenswrapper[2546]: I0614 14:39:25.124479 2546 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/c154f741-4d88-4933-b24b-9fa582917964-host-cni-bin\") pod \"ovnkube-node-zgckr\" (UID: \"c154f741-4d88-4933-b24b-9fa582917964\") " pod="openshift-ovn-kubernetes/ovnkube-node-zgckr" Jun 14 14:39:25.126106 ip-10-0-129-116 kubenswrapper[2546]: I0614 14:39:25.124509 2546 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/c154f741-4d88-4933-b24b-9fa582917964-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-zgckr\" (UID: \"c154f741-4d88-4933-b24b-9fa582917964\") " pod="openshift-ovn-kubernetes/ovnkube-node-zgckr" Jun 14 14:39:25.126106 ip-10-0-129-116 kubenswrapper[2546]: I0614 14:39:25.124542 2546 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/c154f741-4d88-4933-b24b-9fa582917964-ovnkube-script-lib\") pod \"ovnkube-node-zgckr\" (UID: \"c154f741-4d88-4933-b24b-9fa582917964\") " pod="openshift-ovn-kubernetes/ovnkube-node-zgckr" Jun 14 14:39:25.126106 ip-10-0-129-116 kubenswrapper[2546]: I0614 14:39:25.124566 2546 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/3cb1d703-5bee-4d7e-8879-ba67f7129fed-host-run-netns\") pod \"multus-cghhz\" (UID: \"3cb1d703-5bee-4d7e-8879-ba67f7129fed\") " pod="openshift-multus/multus-cghhz" Jun 14 14:39:25.152971 ip-10-0-129-116 kubenswrapper[2546]: I0614 14:39:25.152871 2546 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-06-13 14:34:24 +0000 UTC" deadline="2028-01-13 17:27:08.001498188 +0000 UTC" Jun 14 14:39:25.152971 ip-10-0-129-116 kubenswrapper[2546]: I0614 14:39:25.152917 2546 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="13874h47m42.848584874s" Jun 14 14:39:25.189175 ip-10-0-129-116 kubenswrapper[2546]: I0614 14:39:25.189116 2546 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-129-116.ec2.internal" event={"ID":"b68f1280995218345affbc9fee0e8f68","Type":"ContainerStarted","Data":"fe5e8705f9c6ed53998d2062e6474a5859eb6afafc09c3a31210c4563a7179ae"} Jun 14 14:39:25.191890 ip-10-0-129-116 kubenswrapper[2546]: I0614 14:39:25.191856 2546 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-129-116.ec2.internal" event={"ID":"b5ab8648909b6097cc4bd39cce0c18f1","Type":"ContainerStarted","Data":"35fca2b67c21d250300ca68487257d3cdd6f8a8b8e7cd8a4e6c93cbb6bd7ad06"} Jun 14 14:39:25.225480 ip-10-0-129-116 kubenswrapper[2546]: I0614 14:39:25.225445 2546 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/aa4feed6-27ad-493a-baa3-8d0d96cb5309-metrics-certs\") pod \"network-metrics-daemon-lt4g2\" (UID: \"aa4feed6-27ad-493a-baa3-8d0d96cb5309\") " pod="openshift-multus/network-metrics-daemon-lt4g2" Jun 14 14:39:25.225480 ip-10-0-129-116 kubenswrapper[2546]: I0614 14:39:25.225483 2546 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/c154f741-4d88-4933-b24b-9fa582917964-host-cni-bin\") pod \"ovnkube-node-zgckr\" (UID: \"c154f741-4d88-4933-b24b-9fa582917964\") " pod="openshift-ovn-kubernetes/ovnkube-node-zgckr" Jun 14 14:39:25.225684 ip-10-0-129-116 kubenswrapper[2546]: I0614 14:39:25.225501 2546 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/c154f741-4d88-4933-b24b-9fa582917964-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-zgckr\" (UID: \"c154f741-4d88-4933-b24b-9fa582917964\") " pod="openshift-ovn-kubernetes/ovnkube-node-zgckr" Jun 14 14:39:25.225684 ip-10-0-129-116 kubenswrapper[2546]: I0614 14:39:25.225518 2546 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/c154f741-4d88-4933-b24b-9fa582917964-ovnkube-script-lib\") pod \"ovnkube-node-zgckr\" (UID: \"c154f741-4d88-4933-b24b-9fa582917964\") " pod="openshift-ovn-kubernetes/ovnkube-node-zgckr" Jun 14 14:39:25.225684 ip-10-0-129-116 kubenswrapper[2546]: I0614 14:39:25.225573 2546 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/3cb1d703-5bee-4d7e-8879-ba67f7129fed-host-run-netns\") pod \"multus-cghhz\" (UID: \"3cb1d703-5bee-4d7e-8879-ba67f7129fed\") " pod="openshift-multus/multus-cghhz" Jun 14 14:39:25.225684 ip-10-0-129-116 kubenswrapper[2546]: I0614 14:39:25.225589 2546 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/c154f741-4d88-4933-b24b-9fa582917964-host-cni-bin\") pod \"ovnkube-node-zgckr\" (UID: \"c154f741-4d88-4933-b24b-9fa582917964\") " pod="openshift-ovn-kubernetes/ovnkube-node-zgckr" Jun 14 14:39:25.225684 ip-10-0-129-116 kubenswrapper[2546]: I0614 14:39:25.225614 2546 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/3cb1d703-5bee-4d7e-8879-ba67f7129fed-host-var-lib-cni-bin\") pod \"multus-cghhz\" (UID: \"3cb1d703-5bee-4d7e-8879-ba67f7129fed\") " pod="openshift-multus/multus-cghhz" Jun 14 14:39:25.225684 ip-10-0-129-116 kubenswrapper[2546]: I0614 14:39:25.225635 2546 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/e8d897b0-a5b7-4f7e-a664-7c7a45a1c5de-etc-systemd\") pod \"tuned-84jgl\" (UID: \"e8d897b0-a5b7-4f7e-a664-7c7a45a1c5de\") " pod="openshift-cluster-node-tuning-operator/tuned-84jgl" Jun 14 14:39:25.225684 ip-10-0-129-116 kubenswrapper[2546]: E0614 14:39:25.225647 2546 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jun 14 14:39:25.225684 ip-10-0-129-116 kubenswrapper[2546]: I0614 14:39:25.225658 2546 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/3cb1d703-5bee-4d7e-8879-ba67f7129fed-host-run-netns\") pod \"multus-cghhz\" (UID: \"3cb1d703-5bee-4d7e-8879-ba67f7129fed\") " pod="openshift-multus/multus-cghhz" Jun 14 14:39:25.225684 ip-10-0-129-116 kubenswrapper[2546]: I0614 14:39:25.225660 2546 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/c154f741-4d88-4933-b24b-9fa582917964-host-slash\") pod \"ovnkube-node-zgckr\" (UID: \"c154f741-4d88-4933-b24b-9fa582917964\") " pod="openshift-ovn-kubernetes/ovnkube-node-zgckr" Jun 14 14:39:25.226127 ip-10-0-129-116 kubenswrapper[2546]: I0614 14:39:25.225700 2546 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/c154f741-4d88-4933-b24b-9fa582917964-host-slash\") pod \"ovnkube-node-zgckr\" (UID: \"c154f741-4d88-4933-b24b-9fa582917964\") " pod="openshift-ovn-kubernetes/ovnkube-node-zgckr" Jun 14 14:39:25.226127 ip-10-0-129-116 kubenswrapper[2546]: I0614 14:39:25.225698 2546 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/c154f741-4d88-4933-b24b-9fa582917964-run-openvswitch\") pod \"ovnkube-node-zgckr\" (UID: \"c154f741-4d88-4933-b24b-9fa582917964\") " pod="openshift-ovn-kubernetes/ovnkube-node-zgckr" Jun 14 14:39:25.226127 ip-10-0-129-116 kubenswrapper[2546]: I0614 14:39:25.225578 2546 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/c154f741-4d88-4933-b24b-9fa582917964-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-zgckr\" (UID: \"c154f741-4d88-4933-b24b-9fa582917964\") " pod="openshift-ovn-kubernetes/ovnkube-node-zgckr" Jun 14 14:39:25.226127 ip-10-0-129-116 kubenswrapper[2546]: E0614 14:39:25.225720 2546 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/aa4feed6-27ad-493a-baa3-8d0d96cb5309-metrics-certs podName:aa4feed6-27ad-493a-baa3-8d0d96cb5309 nodeName:}" failed. No retries permitted until 2026-06-14 14:39:25.725695915 +0000 UTC m=+3.054078038 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/aa4feed6-27ad-493a-baa3-8d0d96cb5309-metrics-certs") pod "network-metrics-daemon-lt4g2" (UID: "aa4feed6-27ad-493a-baa3-8d0d96cb5309") : object "openshift-multus"/"metrics-daemon-secret" not registered Jun 14 14:39:25.226127 ip-10-0-129-116 kubenswrapper[2546]: I0614 14:39:25.225734 2546 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/c154f741-4d88-4933-b24b-9fa582917964-run-openvswitch\") pod \"ovnkube-node-zgckr\" (UID: \"c154f741-4d88-4933-b24b-9fa582917964\") " pod="openshift-ovn-kubernetes/ovnkube-node-zgckr" Jun 14 14:39:25.226127 ip-10-0-129-116 kubenswrapper[2546]: I0614 14:39:25.225744 2546 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/3cb1d703-5bee-4d7e-8879-ba67f7129fed-host-var-lib-cni-bin\") pod \"multus-cghhz\" (UID: \"3cb1d703-5bee-4d7e-8879-ba67f7129fed\") " pod="openshift-multus/multus-cghhz" Jun 14 14:39:25.226127 ip-10-0-129-116 kubenswrapper[2546]: I0614 14:39:25.225770 2546 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/3cb1d703-5bee-4d7e-8879-ba67f7129fed-host-run-k8s-cni-cncf-io\") pod \"multus-cghhz\" (UID: \"3cb1d703-5bee-4d7e-8879-ba67f7129fed\") " pod="openshift-multus/multus-cghhz" Jun 14 14:39:25.226127 ip-10-0-129-116 kubenswrapper[2546]: I0614 14:39:25.225795 2546 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/3cb1d703-5bee-4d7e-8879-ba67f7129fed-host-var-lib-kubelet\") pod \"multus-cghhz\" (UID: \"3cb1d703-5bee-4d7e-8879-ba67f7129fed\") " pod="openshift-multus/multus-cghhz" Jun 14 14:39:25.226127 ip-10-0-129-116 kubenswrapper[2546]: I0614 14:39:25.225818 2546 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/4df84aa4-08f2-487d-a8fb-fa2fe8144da8-serviceca\") pod \"node-ca-dshlf\" (UID: \"4df84aa4-08f2-487d-a8fb-fa2fe8144da8\") " pod="openshift-image-registry/node-ca-dshlf" Jun 14 14:39:25.226127 ip-10-0-129-116 kubenswrapper[2546]: I0614 14:39:25.225842 2546 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/6446f965-15fc-40d5-85e7-20cec0d42549-dbus\") pod \"global-pull-secret-syncer-dlk5b\" (UID: \"6446f965-15fc-40d5-85e7-20cec0d42549\") " pod="kube-system/global-pull-secret-syncer-dlk5b" Jun 14 14:39:25.226127 ip-10-0-129-116 kubenswrapper[2546]: I0614 14:39:25.225856 2546 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/3cb1d703-5bee-4d7e-8879-ba67f7129fed-host-run-k8s-cni-cncf-io\") pod \"multus-cghhz\" (UID: \"3cb1d703-5bee-4d7e-8879-ba67f7129fed\") " pod="openshift-multus/multus-cghhz" Jun 14 14:39:25.226127 ip-10-0-129-116 kubenswrapper[2546]: I0614 14:39:25.225865 2546 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/c154f741-4d88-4933-b24b-9fa582917964-env-overrides\") pod \"ovnkube-node-zgckr\" (UID: \"c154f741-4d88-4933-b24b-9fa582917964\") " pod="openshift-ovn-kubernetes/ovnkube-node-zgckr" Jun 14 14:39:25.226127 ip-10-0-129-116 kubenswrapper[2546]: I0614 14:39:25.225885 2546 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/c154f741-4d88-4933-b24b-9fa582917964-ovn-node-metrics-cert\") pod \"ovnkube-node-zgckr\" (UID: \"c154f741-4d88-4933-b24b-9fa582917964\") " pod="openshift-ovn-kubernetes/ovnkube-node-zgckr" Jun 14 14:39:25.226127 ip-10-0-129-116 kubenswrapper[2546]: I0614 14:39:25.225900 2546 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/3cb1d703-5bee-4d7e-8879-ba67f7129fed-multus-conf-dir\") pod \"multus-cghhz\" (UID: \"3cb1d703-5bee-4d7e-8879-ba67f7129fed\") " pod="openshift-multus/multus-cghhz" Jun 14 14:39:25.226127 ip-10-0-129-116 kubenswrapper[2546]: I0614 14:39:25.225926 2546 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/6446f965-15fc-40d5-85e7-20cec0d42549-dbus\") pod \"global-pull-secret-syncer-dlk5b\" (UID: \"6446f965-15fc-40d5-85e7-20cec0d42549\") " pod="kube-system/global-pull-secret-syncer-dlk5b" Jun 14 14:39:25.226127 ip-10-0-129-116 kubenswrapper[2546]: I0614 14:39:25.225933 2546 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/3cb1d703-5bee-4d7e-8879-ba67f7129fed-multus-conf-dir\") pod \"multus-cghhz\" (UID: \"3cb1d703-5bee-4d7e-8879-ba67f7129fed\") " pod="openshift-multus/multus-cghhz" Jun 14 14:39:25.226127 ip-10-0-129-116 kubenswrapper[2546]: I0614 14:39:25.225813 2546 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/e8d897b0-a5b7-4f7e-a664-7c7a45a1c5de-etc-systemd\") pod \"tuned-84jgl\" (UID: \"e8d897b0-a5b7-4f7e-a664-7c7a45a1c5de\") " pod="openshift-cluster-node-tuning-operator/tuned-84jgl" Jun 14 14:39:25.226892 ip-10-0-129-116 kubenswrapper[2546]: I0614 14:39:25.225979 2546 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/3cb1d703-5bee-4d7e-8879-ba67f7129fed-host-var-lib-kubelet\") pod \"multus-cghhz\" (UID: \"3cb1d703-5bee-4d7e-8879-ba67f7129fed\") " pod="openshift-multus/multus-cghhz" Jun 14 14:39:25.226892 ip-10-0-129-116 kubenswrapper[2546]: I0614 14:39:25.226011 2546 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-lh8nq\" (UniqueName: \"kubernetes.io/projected/d6890b61-860c-4e6c-8138-26bc128905c5-kube-api-access-lh8nq\") pod \"iptables-alerter-qfjpp\" (UID: \"d6890b61-860c-4e6c-8138-26bc128905c5\") " pod="openshift-network-operator/iptables-alerter-qfjpp" Jun 14 14:39:25.226892 ip-10-0-129-116 kubenswrapper[2546]: I0614 14:39:25.226038 2546 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/c154f741-4d88-4933-b24b-9fa582917964-systemd-units\") pod \"ovnkube-node-zgckr\" (UID: \"c154f741-4d88-4933-b24b-9fa582917964\") " pod="openshift-ovn-kubernetes/ovnkube-node-zgckr" Jun 14 14:39:25.226892 ip-10-0-129-116 kubenswrapper[2546]: I0614 14:39:25.226062 2546 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/c154f741-4d88-4933-b24b-9fa582917964-run-ovn\") pod \"ovnkube-node-zgckr\" (UID: \"c154f741-4d88-4933-b24b-9fa582917964\") " pod="openshift-ovn-kubernetes/ovnkube-node-zgckr" Jun 14 14:39:25.226892 ip-10-0-129-116 kubenswrapper[2546]: I0614 14:39:25.226084 2546 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/c154f741-4d88-4933-b24b-9fa582917964-node-log\") pod \"ovnkube-node-zgckr\" (UID: \"c154f741-4d88-4933-b24b-9fa582917964\") " pod="openshift-ovn-kubernetes/ovnkube-node-zgckr" Jun 14 14:39:25.226892 ip-10-0-129-116 kubenswrapper[2546]: I0614 14:39:25.226125 2546 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wtv6b\" (UniqueName: \"kubernetes.io/projected/c154f741-4d88-4933-b24b-9fa582917964-kube-api-access-wtv6b\") pod \"ovnkube-node-zgckr\" (UID: \"c154f741-4d88-4933-b24b-9fa582917964\") " pod="openshift-ovn-kubernetes/ovnkube-node-zgckr" Jun 14 14:39:25.226892 ip-10-0-129-116 kubenswrapper[2546]: I0614 14:39:25.226126 2546 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/c154f741-4d88-4933-b24b-9fa582917964-ovnkube-script-lib\") pod \"ovnkube-node-zgckr\" (UID: \"c154f741-4d88-4933-b24b-9fa582917964\") " pod="openshift-ovn-kubernetes/ovnkube-node-zgckr" Jun 14 14:39:25.226892 ip-10-0-129-116 kubenswrapper[2546]: I0614 14:39:25.226147 2546 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/3cb1d703-5bee-4d7e-8879-ba67f7129fed-system-cni-dir\") pod \"multus-cghhz\" (UID: \"3cb1d703-5bee-4d7e-8879-ba67f7129fed\") " pod="openshift-multus/multus-cghhz" Jun 14 14:39:25.226892 ip-10-0-129-116 kubenswrapper[2546]: I0614 14:39:25.226171 2546 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/3cb1d703-5bee-4d7e-8879-ba67f7129fed-cni-binary-copy\") pod \"multus-cghhz\" (UID: \"3cb1d703-5bee-4d7e-8879-ba67f7129fed\") " pod="openshift-multus/multus-cghhz" Jun 14 14:39:25.226892 ip-10-0-129-116 kubenswrapper[2546]: I0614 14:39:25.226194 2546 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-z2kjr\" (UniqueName: \"kubernetes.io/projected/3cb1d703-5bee-4d7e-8879-ba67f7129fed-kube-api-access-z2kjr\") pod \"multus-cghhz\" (UID: \"3cb1d703-5bee-4d7e-8879-ba67f7129fed\") " pod="openshift-multus/multus-cghhz" Jun 14 14:39:25.226892 ip-10-0-129-116 kubenswrapper[2546]: I0614 14:39:25.226216 2546 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/e8d897b0-a5b7-4f7e-a664-7c7a45a1c5de-sys\") pod \"tuned-84jgl\" (UID: \"e8d897b0-a5b7-4f7e-a664-7c7a45a1c5de\") " pod="openshift-cluster-node-tuning-operator/tuned-84jgl" Jun 14 14:39:25.226892 ip-10-0-129-116 kubenswrapper[2546]: I0614 14:39:25.226216 2546 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/c154f741-4d88-4933-b24b-9fa582917964-run-ovn\") pod \"ovnkube-node-zgckr\" (UID: \"c154f741-4d88-4933-b24b-9fa582917964\") " pod="openshift-ovn-kubernetes/ovnkube-node-zgckr" Jun 14 14:39:25.226892 ip-10-0-129-116 kubenswrapper[2546]: I0614 14:39:25.226257 2546 swap_util.go:74] "error creating dir to test if tmpfs noswap is enabled. Assuming not supported" mount path="" error="stat /var/lib/kubelet/plugins/kubernetes.io/empty-dir: no such file or directory" Jun 14 14:39:25.226892 ip-10-0-129-116 kubenswrapper[2546]: I0614 14:39:25.226324 2546 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/4df84aa4-08f2-487d-a8fb-fa2fe8144da8-serviceca\") pod \"node-ca-dshlf\" (UID: \"4df84aa4-08f2-487d-a8fb-fa2fe8144da8\") " pod="openshift-image-registry/node-ca-dshlf" Jun 14 14:39:25.226892 ip-10-0-129-116 kubenswrapper[2546]: I0614 14:39:25.226333 2546 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/c154f741-4d88-4933-b24b-9fa582917964-systemd-units\") pod \"ovnkube-node-zgckr\" (UID: \"c154f741-4d88-4933-b24b-9fa582917964\") " pod="openshift-ovn-kubernetes/ovnkube-node-zgckr" Jun 14 14:39:25.226892 ip-10-0-129-116 kubenswrapper[2546]: I0614 14:39:25.226325 2546 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/c154f741-4d88-4933-b24b-9fa582917964-env-overrides\") pod \"ovnkube-node-zgckr\" (UID: \"c154f741-4d88-4933-b24b-9fa582917964\") " pod="openshift-ovn-kubernetes/ovnkube-node-zgckr" Jun 14 14:39:25.226892 ip-10-0-129-116 kubenswrapper[2546]: I0614 14:39:25.226346 2546 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/c154f741-4d88-4933-b24b-9fa582917964-host-run-netns\") pod \"ovnkube-node-zgckr\" (UID: \"c154f741-4d88-4933-b24b-9fa582917964\") " pod="openshift-ovn-kubernetes/ovnkube-node-zgckr" Jun 14 14:39:25.226892 ip-10-0-129-116 kubenswrapper[2546]: I0614 14:39:25.226382 2546 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/32b27404-1251-4372-a3b9-de131b817153-socket-dir\") pod \"aws-ebs-csi-driver-node-mrqb6\" (UID: \"32b27404-1251-4372-a3b9-de131b817153\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-mrqb6" Jun 14 14:39:25.227736 ip-10-0-129-116 kubenswrapper[2546]: I0614 14:39:25.226393 2546 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/c154f741-4d88-4933-b24b-9fa582917964-host-run-netns\") pod \"ovnkube-node-zgckr\" (UID: \"c154f741-4d88-4933-b24b-9fa582917964\") " pod="openshift-ovn-kubernetes/ovnkube-node-zgckr" Jun 14 14:39:25.227736 ip-10-0-129-116 kubenswrapper[2546]: I0614 14:39:25.226411 2546 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-gkw2d\" (UniqueName: \"kubernetes.io/projected/32b27404-1251-4372-a3b9-de131b817153-kube-api-access-gkw2d\") pod \"aws-ebs-csi-driver-node-mrqb6\" (UID: \"32b27404-1251-4372-a3b9-de131b817153\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-mrqb6" Jun 14 14:39:25.227736 ip-10-0-129-116 kubenswrapper[2546]: I0614 14:39:25.226438 2546 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/30e02c92-21a3-43cd-a129-a21a3a3ccb37-tmp-dir\") pod \"node-resolver-ptpcx\" (UID: \"30e02c92-21a3-43cd-a129-a21a3a3ccb37\") " pod="openshift-dns/node-resolver-ptpcx" Jun 14 14:39:25.227736 ip-10-0-129-116 kubenswrapper[2546]: I0614 14:39:25.226446 2546 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/e8d897b0-a5b7-4f7e-a664-7c7a45a1c5de-sys\") pod \"tuned-84jgl\" (UID: \"e8d897b0-a5b7-4f7e-a664-7c7a45a1c5de\") " pod="openshift-cluster-node-tuning-operator/tuned-84jgl" Jun 14 14:39:25.227736 ip-10-0-129-116 kubenswrapper[2546]: I0614 14:39:25.226462 2546 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/e8d897b0-a5b7-4f7e-a664-7c7a45a1c5de-etc-kubernetes\") pod \"tuned-84jgl\" (UID: \"e8d897b0-a5b7-4f7e-a664-7c7a45a1c5de\") " pod="openshift-cluster-node-tuning-operator/tuned-84jgl" Jun 14 14:39:25.227736 ip-10-0-129-116 kubenswrapper[2546]: I0614 14:39:25.226486 2546 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/e8d897b0-a5b7-4f7e-a664-7c7a45a1c5de-etc-sysctl-conf\") pod \"tuned-84jgl\" (UID: \"e8d897b0-a5b7-4f7e-a664-7c7a45a1c5de\") " pod="openshift-cluster-node-tuning-operator/tuned-84jgl" Jun 14 14:39:25.227736 ip-10-0-129-116 kubenswrapper[2546]: I0614 14:39:25.226508 2546 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/c154f741-4d88-4933-b24b-9fa582917964-run-systemd\") pod \"ovnkube-node-zgckr\" (UID: \"c154f741-4d88-4933-b24b-9fa582917964\") " pod="openshift-ovn-kubernetes/ovnkube-node-zgckr" Jun 14 14:39:25.227736 ip-10-0-129-116 kubenswrapper[2546]: I0614 14:39:25.226532 2546 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/c154f741-4d88-4933-b24b-9fa582917964-var-lib-openvswitch\") pod \"ovnkube-node-zgckr\" (UID: \"c154f741-4d88-4933-b24b-9fa582917964\") " pod="openshift-ovn-kubernetes/ovnkube-node-zgckr" Jun 14 14:39:25.227736 ip-10-0-129-116 kubenswrapper[2546]: I0614 14:39:25.226559 2546 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/c154f741-4d88-4933-b24b-9fa582917964-host-run-ovn-kubernetes\") pod \"ovnkube-node-zgckr\" (UID: \"c154f741-4d88-4933-b24b-9fa582917964\") " pod="openshift-ovn-kubernetes/ovnkube-node-zgckr" Jun 14 14:39:25.227736 ip-10-0-129-116 kubenswrapper[2546]: I0614 14:39:25.226568 2546 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/32b27404-1251-4372-a3b9-de131b817153-socket-dir\") pod \"aws-ebs-csi-driver-node-mrqb6\" (UID: \"32b27404-1251-4372-a3b9-de131b817153\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-mrqb6" Jun 14 14:39:25.227736 ip-10-0-129-116 kubenswrapper[2546]: I0614 14:39:25.226582 2546 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/8da319a4-be6d-4245-aed1-aa1fdaf8ca66-os-release\") pod \"multus-additional-cni-plugins-r4gvc\" (UID: \"8da319a4-be6d-4245-aed1-aa1fdaf8ca66\") " pod="openshift-multus/multus-additional-cni-plugins-r4gvc" Jun 14 14:39:25.227736 ip-10-0-129-116 kubenswrapper[2546]: I0614 14:39:25.226605 2546 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/3cb1d703-5bee-4d7e-8879-ba67f7129fed-system-cni-dir\") pod \"multus-cghhz\" (UID: \"3cb1d703-5bee-4d7e-8879-ba67f7129fed\") " pod="openshift-multus/multus-cghhz" Jun 14 14:39:25.227736 ip-10-0-129-116 kubenswrapper[2546]: I0614 14:39:25.226617 2546 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/3cb1d703-5bee-4d7e-8879-ba67f7129fed-multus-daemon-config\") pod \"multus-cghhz\" (UID: \"3cb1d703-5bee-4d7e-8879-ba67f7129fed\") " pod="openshift-multus/multus-cghhz" Jun 14 14:39:25.227736 ip-10-0-129-116 kubenswrapper[2546]: I0614 14:39:25.226618 2546 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/c154f741-4d88-4933-b24b-9fa582917964-run-systemd\") pod \"ovnkube-node-zgckr\" (UID: \"c154f741-4d88-4933-b24b-9fa582917964\") " pod="openshift-ovn-kubernetes/ovnkube-node-zgckr" Jun 14 14:39:25.227736 ip-10-0-129-116 kubenswrapper[2546]: I0614 14:39:25.226657 2546 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/e8d897b0-a5b7-4f7e-a664-7c7a45a1c5de-var-lib-kubelet\") pod \"tuned-84jgl\" (UID: \"e8d897b0-a5b7-4f7e-a664-7c7a45a1c5de\") " pod="openshift-cluster-node-tuning-operator/tuned-84jgl" Jun 14 14:39:25.227736 ip-10-0-129-116 kubenswrapper[2546]: I0614 14:39:25.226690 2546 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/c154f741-4d88-4933-b24b-9fa582917964-log-socket\") pod \"ovnkube-node-zgckr\" (UID: \"c154f741-4d88-4933-b24b-9fa582917964\") " pod="openshift-ovn-kubernetes/ovnkube-node-zgckr" Jun 14 14:39:25.227736 ip-10-0-129-116 kubenswrapper[2546]: I0614 14:39:25.226659 2546 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/c154f741-4d88-4933-b24b-9fa582917964-host-run-ovn-kubernetes\") pod \"ovnkube-node-zgckr\" (UID: \"c154f741-4d88-4933-b24b-9fa582917964\") " pod="openshift-ovn-kubernetes/ovnkube-node-zgckr" Jun 14 14:39:25.228459 ip-10-0-129-116 kubenswrapper[2546]: I0614 14:39:25.226720 2546 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/32b27404-1251-4372-a3b9-de131b817153-registration-dir\") pod \"aws-ebs-csi-driver-node-mrqb6\" (UID: \"32b27404-1251-4372-a3b9-de131b817153\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-mrqb6" Jun 14 14:39:25.228459 ip-10-0-129-116 kubenswrapper[2546]: I0614 14:39:25.226765 2546 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/e8d897b0-a5b7-4f7e-a664-7c7a45a1c5de-etc-sysconfig\") pod \"tuned-84jgl\" (UID: \"e8d897b0-a5b7-4f7e-a664-7c7a45a1c5de\") " pod="openshift-cluster-node-tuning-operator/tuned-84jgl" Jun 14 14:39:25.228459 ip-10-0-129-116 kubenswrapper[2546]: I0614 14:39:25.226769 2546 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/32b27404-1251-4372-a3b9-de131b817153-registration-dir\") pod \"aws-ebs-csi-driver-node-mrqb6\" (UID: \"32b27404-1251-4372-a3b9-de131b817153\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-mrqb6" Jun 14 14:39:25.228459 ip-10-0-129-116 kubenswrapper[2546]: I0614 14:39:25.226777 2546 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/e8d897b0-a5b7-4f7e-a664-7c7a45a1c5de-etc-sysctl-conf\") pod \"tuned-84jgl\" (UID: \"e8d897b0-a5b7-4f7e-a664-7c7a45a1c5de\") " pod="openshift-cluster-node-tuning-operator/tuned-84jgl" Jun 14 14:39:25.228459 ip-10-0-129-116 kubenswrapper[2546]: I0614 14:39:25.226787 2546 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/30e02c92-21a3-43cd-a129-a21a3a3ccb37-tmp-dir\") pod \"node-resolver-ptpcx\" (UID: \"30e02c92-21a3-43cd-a129-a21a3a3ccb37\") " pod="openshift-dns/node-resolver-ptpcx" Jun 14 14:39:25.228459 ip-10-0-129-116 kubenswrapper[2546]: I0614 14:39:25.226815 2546 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/c154f741-4d88-4933-b24b-9fa582917964-var-lib-openvswitch\") pod \"ovnkube-node-zgckr\" (UID: \"c154f741-4d88-4933-b24b-9fa582917964\") " pod="openshift-ovn-kubernetes/ovnkube-node-zgckr" Jun 14 14:39:25.228459 ip-10-0-129-116 kubenswrapper[2546]: I0614 14:39:25.226823 2546 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/e8d897b0-a5b7-4f7e-a664-7c7a45a1c5de-var-lib-kubelet\") pod \"tuned-84jgl\" (UID: \"e8d897b0-a5b7-4f7e-a664-7c7a45a1c5de\") " pod="openshift-cluster-node-tuning-operator/tuned-84jgl" Jun 14 14:39:25.228459 ip-10-0-129-116 kubenswrapper[2546]: I0614 14:39:25.226823 2546 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/e8d897b0-a5b7-4f7e-a664-7c7a45a1c5de-etc-kubernetes\") pod \"tuned-84jgl\" (UID: \"e8d897b0-a5b7-4f7e-a664-7c7a45a1c5de\") " pod="openshift-cluster-node-tuning-operator/tuned-84jgl" Jun 14 14:39:25.228459 ip-10-0-129-116 kubenswrapper[2546]: I0614 14:39:25.226825 2546 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/e8d897b0-a5b7-4f7e-a664-7c7a45a1c5de-etc-sysconfig\") pod \"tuned-84jgl\" (UID: \"e8d897b0-a5b7-4f7e-a664-7c7a45a1c5de\") " pod="openshift-cluster-node-tuning-operator/tuned-84jgl" Jun 14 14:39:25.228459 ip-10-0-129-116 kubenswrapper[2546]: I0614 14:39:25.226836 2546 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/3cb1d703-5bee-4d7e-8879-ba67f7129fed-cni-binary-copy\") pod \"multus-cghhz\" (UID: \"3cb1d703-5bee-4d7e-8879-ba67f7129fed\") " pod="openshift-multus/multus-cghhz" Jun 14 14:39:25.228459 ip-10-0-129-116 kubenswrapper[2546]: I0614 14:39:25.226850 2546 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/c154f741-4d88-4933-b24b-9fa582917964-log-socket\") pod \"ovnkube-node-zgckr\" (UID: \"c154f741-4d88-4933-b24b-9fa582917964\") " pod="openshift-ovn-kubernetes/ovnkube-node-zgckr" Jun 14 14:39:25.228459 ip-10-0-129-116 kubenswrapper[2546]: I0614 14:39:25.226865 2546 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/e8d897b0-a5b7-4f7e-a664-7c7a45a1c5de-etc-sysctl-d\") pod \"tuned-84jgl\" (UID: \"e8d897b0-a5b7-4f7e-a664-7c7a45a1c5de\") " pod="openshift-cluster-node-tuning-operator/tuned-84jgl" Jun 14 14:39:25.228459 ip-10-0-129-116 kubenswrapper[2546]: I0614 14:39:25.226875 2546 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/8da319a4-be6d-4245-aed1-aa1fdaf8ca66-os-release\") pod \"multus-additional-cni-plugins-r4gvc\" (UID: \"8da319a4-be6d-4245-aed1-aa1fdaf8ca66\") " pod="openshift-multus/multus-additional-cni-plugins-r4gvc" Jun 14 14:39:25.228459 ip-10-0-129-116 kubenswrapper[2546]: I0614 14:39:25.226890 2546 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/c154f741-4d88-4933-b24b-9fa582917964-host-kubelet\") pod \"ovnkube-node-zgckr\" (UID: \"c154f741-4d88-4933-b24b-9fa582917964\") " pod="openshift-ovn-kubernetes/ovnkube-node-zgckr" Jun 14 14:39:25.228459 ip-10-0-129-116 kubenswrapper[2546]: I0614 14:39:25.226926 2546 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/c154f741-4d88-4933-b24b-9fa582917964-host-kubelet\") pod \"ovnkube-node-zgckr\" (UID: \"c154f741-4d88-4933-b24b-9fa582917964\") " pod="openshift-ovn-kubernetes/ovnkube-node-zgckr" Jun 14 14:39:25.228459 ip-10-0-129-116 kubenswrapper[2546]: I0614 14:39:25.226939 2546 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/c154f741-4d88-4933-b24b-9fa582917964-node-log\") pod \"ovnkube-node-zgckr\" (UID: \"c154f741-4d88-4933-b24b-9fa582917964\") " pod="openshift-ovn-kubernetes/ovnkube-node-zgckr" Jun 14 14:39:25.228459 ip-10-0-129-116 kubenswrapper[2546]: I0614 14:39:25.226943 2546 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/c154f741-4d88-4933-b24b-9fa582917964-ovnkube-config\") pod \"ovnkube-node-zgckr\" (UID: \"c154f741-4d88-4933-b24b-9fa582917964\") " pod="openshift-ovn-kubernetes/ovnkube-node-zgckr" Jun 14 14:39:25.229275 ip-10-0-129-116 kubenswrapper[2546]: I0614 14:39:25.226978 2546 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/8da319a4-be6d-4245-aed1-aa1fdaf8ca66-cni-binary-copy\") pod \"multus-additional-cni-plugins-r4gvc\" (UID: \"8da319a4-be6d-4245-aed1-aa1fdaf8ca66\") " pod="openshift-multus/multus-additional-cni-plugins-r4gvc" Jun 14 14:39:25.229275 ip-10-0-129-116 kubenswrapper[2546]: I0614 14:39:25.227004 2546 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/e8d897b0-a5b7-4f7e-a664-7c7a45a1c5de-etc-sysctl-d\") pod \"tuned-84jgl\" (UID: \"e8d897b0-a5b7-4f7e-a664-7c7a45a1c5de\") " pod="openshift-cluster-node-tuning-operator/tuned-84jgl" Jun 14 14:39:25.229275 ip-10-0-129-116 kubenswrapper[2546]: I0614 14:39:25.227006 2546 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/3cb1d703-5bee-4d7e-8879-ba67f7129fed-multus-cni-dir\") pod \"multus-cghhz\" (UID: \"3cb1d703-5bee-4d7e-8879-ba67f7129fed\") " pod="openshift-multus/multus-cghhz" Jun 14 14:39:25.229275 ip-10-0-129-116 kubenswrapper[2546]: I0614 14:39:25.227045 2546 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/3cb1d703-5bee-4d7e-8879-ba67f7129fed-os-release\") pod \"multus-cghhz\" (UID: \"3cb1d703-5bee-4d7e-8879-ba67f7129fed\") " pod="openshift-multus/multus-cghhz" Jun 14 14:39:25.229275 ip-10-0-129-116 kubenswrapper[2546]: I0614 14:39:25.227056 2546 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/3cb1d703-5bee-4d7e-8879-ba67f7129fed-multus-cni-dir\") pod \"multus-cghhz\" (UID: \"3cb1d703-5bee-4d7e-8879-ba67f7129fed\") " pod="openshift-multus/multus-cghhz" Jun 14 14:39:25.229275 ip-10-0-129-116 kubenswrapper[2546]: I0614 14:39:25.227072 2546 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/3cb1d703-5bee-4d7e-8879-ba67f7129fed-multus-socket-dir-parent\") pod \"multus-cghhz\" (UID: \"3cb1d703-5bee-4d7e-8879-ba67f7129fed\") " pod="openshift-multus/multus-cghhz" Jun 14 14:39:25.229275 ip-10-0-129-116 kubenswrapper[2546]: I0614 14:39:25.227116 2546 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/e8d897b0-a5b7-4f7e-a664-7c7a45a1c5de-tmp\") pod \"tuned-84jgl\" (UID: \"e8d897b0-a5b7-4f7e-a664-7c7a45a1c5de\") " pod="openshift-cluster-node-tuning-operator/tuned-84jgl" Jun 14 14:39:25.229275 ip-10-0-129-116 kubenswrapper[2546]: I0614 14:39:25.227142 2546 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/c154f741-4d88-4933-b24b-9fa582917964-host-cni-netd\") pod \"ovnkube-node-zgckr\" (UID: \"c154f741-4d88-4933-b24b-9fa582917964\") " pod="openshift-ovn-kubernetes/ovnkube-node-zgckr" Jun 14 14:39:25.229275 ip-10-0-129-116 kubenswrapper[2546]: I0614 14:39:25.227151 2546 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/3cb1d703-5bee-4d7e-8879-ba67f7129fed-os-release\") pod \"multus-cghhz\" (UID: \"3cb1d703-5bee-4d7e-8879-ba67f7129fed\") " pod="openshift-multus/multus-cghhz" Jun 14 14:39:25.229275 ip-10-0-129-116 kubenswrapper[2546]: I0614 14:39:25.227164 2546 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/3cb1d703-5bee-4d7e-8879-ba67f7129fed-multus-socket-dir-parent\") pod \"multus-cghhz\" (UID: \"3cb1d703-5bee-4d7e-8879-ba67f7129fed\") " pod="openshift-multus/multus-cghhz" Jun 14 14:39:25.229275 ip-10-0-129-116 kubenswrapper[2546]: I0614 14:39:25.227166 2546 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/105377da-c223-41ad-b033-546cb01239c4-konnectivity-ca\") pod \"konnectivity-agent-c96gx\" (UID: \"105377da-c223-41ad-b033-546cb01239c4\") " pod="kube-system/konnectivity-agent-c96gx" Jun 14 14:39:25.229275 ip-10-0-129-116 kubenswrapper[2546]: I0614 14:39:25.227205 2546 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/32b27404-1251-4372-a3b9-de131b817153-etc-selinux\") pod \"aws-ebs-csi-driver-node-mrqb6\" (UID: \"32b27404-1251-4372-a3b9-de131b817153\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-mrqb6" Jun 14 14:39:25.229275 ip-10-0-129-116 kubenswrapper[2546]: I0614 14:39:25.227232 2546 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-lhb84\" (UniqueName: \"kubernetes.io/projected/4df84aa4-08f2-487d-a8fb-fa2fe8144da8-kube-api-access-lhb84\") pod \"node-ca-dshlf\" (UID: \"4df84aa4-08f2-487d-a8fb-fa2fe8144da8\") " pod="openshift-image-registry/node-ca-dshlf" Jun 14 14:39:25.229275 ip-10-0-129-116 kubenswrapper[2546]: I0614 14:39:25.227254 2546 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/e8d897b0-a5b7-4f7e-a664-7c7a45a1c5de-run\") pod \"tuned-84jgl\" (UID: \"e8d897b0-a5b7-4f7e-a664-7c7a45a1c5de\") " pod="openshift-cluster-node-tuning-operator/tuned-84jgl" Jun 14 14:39:25.229275 ip-10-0-129-116 kubenswrapper[2546]: I0614 14:39:25.227276 2546 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-lwsd5\" (UniqueName: \"kubernetes.io/projected/e8d897b0-a5b7-4f7e-a664-7c7a45a1c5de-kube-api-access-lwsd5\") pod \"tuned-84jgl\" (UID: \"e8d897b0-a5b7-4f7e-a664-7c7a45a1c5de\") " pod="openshift-cluster-node-tuning-operator/tuned-84jgl" Jun 14 14:39:25.229275 ip-10-0-129-116 kubenswrapper[2546]: I0614 14:39:25.227299 2546 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/c154f741-4d88-4933-b24b-9fa582917964-etc-openvswitch\") pod \"ovnkube-node-zgckr\" (UID: \"c154f741-4d88-4933-b24b-9fa582917964\") " pod="openshift-ovn-kubernetes/ovnkube-node-zgckr" Jun 14 14:39:25.229275 ip-10-0-129-116 kubenswrapper[2546]: I0614 14:39:25.227322 2546 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/8da319a4-be6d-4245-aed1-aa1fdaf8ca66-tuning-conf-dir\") pod \"multus-additional-cni-plugins-r4gvc\" (UID: \"8da319a4-be6d-4245-aed1-aa1fdaf8ca66\") " pod="openshift-multus/multus-additional-cni-plugins-r4gvc" Jun 14 14:39:25.229275 ip-10-0-129-116 kubenswrapper[2546]: I0614 14:39:25.227359 2546 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/3cb1d703-5bee-4d7e-8879-ba67f7129fed-multus-daemon-config\") pod \"multus-cghhz\" (UID: \"3cb1d703-5bee-4d7e-8879-ba67f7129fed\") " pod="openshift-multus/multus-cghhz" Jun 14 14:39:25.229885 ip-10-0-129-116 kubenswrapper[2546]: I0614 14:39:25.227432 2546 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run\" (UniqueName: \"kubernetes.io/host-path/e8d897b0-a5b7-4f7e-a664-7c7a45a1c5de-run\") pod \"tuned-84jgl\" (UID: \"e8d897b0-a5b7-4f7e-a664-7c7a45a1c5de\") " pod="openshift-cluster-node-tuning-operator/tuned-84jgl" Jun 14 14:39:25.229885 ip-10-0-129-116 kubenswrapper[2546]: I0614 14:39:25.227434 2546 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/c154f741-4d88-4933-b24b-9fa582917964-ovnkube-config\") pod \"ovnkube-node-zgckr\" (UID: \"c154f741-4d88-4933-b24b-9fa582917964\") " pod="openshift-ovn-kubernetes/ovnkube-node-zgckr" Jun 14 14:39:25.229885 ip-10-0-129-116 kubenswrapper[2546]: I0614 14:39:25.227552 2546 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/32b27404-1251-4372-a3b9-de131b817153-etc-selinux\") pod \"aws-ebs-csi-driver-node-mrqb6\" (UID: \"32b27404-1251-4372-a3b9-de131b817153\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-mrqb6" Jun 14 14:39:25.229885 ip-10-0-129-116 kubenswrapper[2546]: I0614 14:39:25.227568 2546 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/8da319a4-be6d-4245-aed1-aa1fdaf8ca66-cni-binary-copy\") pod \"multus-additional-cni-plugins-r4gvc\" (UID: \"8da319a4-be6d-4245-aed1-aa1fdaf8ca66\") " pod="openshift-multus/multus-additional-cni-plugins-r4gvc" Jun 14 14:39:25.229885 ip-10-0-129-116 kubenswrapper[2546]: I0614 14:39:25.227604 2546 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/c154f741-4d88-4933-b24b-9fa582917964-etc-openvswitch\") pod \"ovnkube-node-zgckr\" (UID: \"c154f741-4d88-4933-b24b-9fa582917964\") " pod="openshift-ovn-kubernetes/ovnkube-node-zgckr" Jun 14 14:39:25.229885 ip-10-0-129-116 kubenswrapper[2546]: I0614 14:39:25.227615 2546 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/c154f741-4d88-4933-b24b-9fa582917964-host-cni-netd\") pod \"ovnkube-node-zgckr\" (UID: \"c154f741-4d88-4933-b24b-9fa582917964\") " pod="openshift-ovn-kubernetes/ovnkube-node-zgckr" Jun 14 14:39:25.229885 ip-10-0-129-116 kubenswrapper[2546]: I0614 14:39:25.227723 2546 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/105377da-c223-41ad-b033-546cb01239c4-konnectivity-ca\") pod \"konnectivity-agent-c96gx\" (UID: \"105377da-c223-41ad-b033-546cb01239c4\") " pod="kube-system/konnectivity-agent-c96gx" Jun 14 14:39:25.229885 ip-10-0-129-116 kubenswrapper[2546]: I0614 14:39:25.227767 2546 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-nbjrn\" (UniqueName: \"kubernetes.io/projected/8da319a4-be6d-4245-aed1-aa1fdaf8ca66-kube-api-access-nbjrn\") pod \"multus-additional-cni-plugins-r4gvc\" (UID: \"8da319a4-be6d-4245-aed1-aa1fdaf8ca66\") " pod="openshift-multus/multus-additional-cni-plugins-r4gvc" Jun 14 14:39:25.229885 ip-10-0-129-116 kubenswrapper[2546]: I0614 14:39:25.227799 2546 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/3cb1d703-5bee-4d7e-8879-ba67f7129fed-host-var-lib-cni-multus\") pod \"multus-cghhz\" (UID: \"3cb1d703-5bee-4d7e-8879-ba67f7129fed\") " pod="openshift-multus/multus-cghhz" Jun 14 14:39:25.229885 ip-10-0-129-116 kubenswrapper[2546]: I0614 14:39:25.227824 2546 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-t9bks\" (UniqueName: \"kubernetes.io/projected/726e808e-de0a-4f4f-809c-8f7e7cc45432-kube-api-access-t9bks\") pod \"network-check-target-m6zq8\" (UID: \"726e808e-de0a-4f4f-809c-8f7e7cc45432\") " pod="openshift-network-diagnostics/network-check-target-m6zq8" Jun 14 14:39:25.229885 ip-10-0-129-116 kubenswrapper[2546]: I0614 14:39:25.227826 2546 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/8da319a4-be6d-4245-aed1-aa1fdaf8ca66-tuning-conf-dir\") pod \"multus-additional-cni-plugins-r4gvc\" (UID: \"8da319a4-be6d-4245-aed1-aa1fdaf8ca66\") " pod="openshift-multus/multus-additional-cni-plugins-r4gvc" Jun 14 14:39:25.229885 ip-10-0-129-116 kubenswrapper[2546]: I0614 14:39:25.227849 2546 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wlw7s\" (UniqueName: \"kubernetes.io/projected/30e02c92-21a3-43cd-a129-a21a3a3ccb37-kube-api-access-wlw7s\") pod \"node-resolver-ptpcx\" (UID: \"30e02c92-21a3-43cd-a129-a21a3a3ccb37\") " pod="openshift-dns/node-resolver-ptpcx" Jun 14 14:39:25.229885 ip-10-0-129-116 kubenswrapper[2546]: I0614 14:39:25.227873 2546 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/d6890b61-860c-4e6c-8138-26bc128905c5-iptables-alerter-script\") pod \"iptables-alerter-qfjpp\" (UID: \"d6890b61-860c-4e6c-8138-26bc128905c5\") " pod="openshift-network-operator/iptables-alerter-qfjpp" Jun 14 14:39:25.229885 ip-10-0-129-116 kubenswrapper[2546]: I0614 14:39:25.227874 2546 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/3cb1d703-5bee-4d7e-8879-ba67f7129fed-host-var-lib-cni-multus\") pod \"multus-cghhz\" (UID: \"3cb1d703-5bee-4d7e-8879-ba67f7129fed\") " pod="openshift-multus/multus-cghhz" Jun 14 14:39:25.229885 ip-10-0-129-116 kubenswrapper[2546]: I0614 14:39:25.228130 2546 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/e8d897b0-a5b7-4f7e-a664-7c7a45a1c5de-lib-modules\") pod \"tuned-84jgl\" (UID: \"e8d897b0-a5b7-4f7e-a664-7c7a45a1c5de\") " pod="openshift-cluster-node-tuning-operator/tuned-84jgl" Jun 14 14:39:25.229885 ip-10-0-129-116 kubenswrapper[2546]: I0614 14:39:25.228164 2546 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/8da319a4-be6d-4245-aed1-aa1fdaf8ca66-system-cni-dir\") pod \"multus-additional-cni-plugins-r4gvc\" (UID: \"8da319a4-be6d-4245-aed1-aa1fdaf8ca66\") " pod="openshift-multus/multus-additional-cni-plugins-r4gvc" Jun 14 14:39:25.229885 ip-10-0-129-116 kubenswrapper[2546]: I0614 14:39:25.228196 2546 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/3cb1d703-5bee-4d7e-8879-ba67f7129fed-host-run-multus-certs\") pod \"multus-cghhz\" (UID: \"3cb1d703-5bee-4d7e-8879-ba67f7129fed\") " pod="openshift-multus/multus-cghhz" Jun 14 14:39:25.230535 ip-10-0-129-116 kubenswrapper[2546]: I0614 14:39:25.228219 2546 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/4df84aa4-08f2-487d-a8fb-fa2fe8144da8-host\") pod \"node-ca-dshlf\" (UID: \"4df84aa4-08f2-487d-a8fb-fa2fe8144da8\") " pod="openshift-image-registry/node-ca-dshlf" Jun 14 14:39:25.230535 ip-10-0-129-116 kubenswrapper[2546]: I0614 14:39:25.228242 2546 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/30e02c92-21a3-43cd-a129-a21a3a3ccb37-hosts-file\") pod \"node-resolver-ptpcx\" (UID: \"30e02c92-21a3-43cd-a129-a21a3a3ccb37\") " pod="openshift-dns/node-resolver-ptpcx" Jun 14 14:39:25.230535 ip-10-0-129-116 kubenswrapper[2546]: I0614 14:39:25.228269 2546 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/8da319a4-be6d-4245-aed1-aa1fdaf8ca66-cnibin\") pod \"multus-additional-cni-plugins-r4gvc\" (UID: \"8da319a4-be6d-4245-aed1-aa1fdaf8ca66\") " pod="openshift-multus/multus-additional-cni-plugins-r4gvc" Jun 14 14:39:25.230535 ip-10-0-129-116 kubenswrapper[2546]: I0614 14:39:25.228292 2546 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/3cb1d703-5bee-4d7e-8879-ba67f7129fed-cnibin\") pod \"multus-cghhz\" (UID: \"3cb1d703-5bee-4d7e-8879-ba67f7129fed\") " pod="openshift-multus/multus-cghhz" Jun 14 14:39:25.230535 ip-10-0-129-116 kubenswrapper[2546]: I0614 14:39:25.228329 2546 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/3cb1d703-5bee-4d7e-8879-ba67f7129fed-host-run-multus-certs\") pod \"multus-cghhz\" (UID: \"3cb1d703-5bee-4d7e-8879-ba67f7129fed\") " pod="openshift-multus/multus-cghhz" Jun 14 14:39:25.230535 ip-10-0-129-116 kubenswrapper[2546]: I0614 14:39:25.228322 2546 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/3cb1d703-5bee-4d7e-8879-ba67f7129fed-etc-kubernetes\") pod \"multus-cghhz\" (UID: \"3cb1d703-5bee-4d7e-8879-ba67f7129fed\") " pod="openshift-multus/multus-cghhz" Jun 14 14:39:25.230535 ip-10-0-129-116 kubenswrapper[2546]: I0614 14:39:25.228373 2546 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/3cb1d703-5bee-4d7e-8879-ba67f7129fed-etc-kubernetes\") pod \"multus-cghhz\" (UID: \"3cb1d703-5bee-4d7e-8879-ba67f7129fed\") " pod="openshift-multus/multus-cghhz" Jun 14 14:39:25.230535 ip-10-0-129-116 kubenswrapper[2546]: I0614 14:39:25.228381 2546 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/32b27404-1251-4372-a3b9-de131b817153-kubelet-dir\") pod \"aws-ebs-csi-driver-node-mrqb6\" (UID: \"32b27404-1251-4372-a3b9-de131b817153\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-mrqb6" Jun 14 14:39:25.230535 ip-10-0-129-116 kubenswrapper[2546]: I0614 14:39:25.228409 2546 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/6446f965-15fc-40d5-85e7-20cec0d42549-kubelet-config\") pod \"global-pull-secret-syncer-dlk5b\" (UID: \"6446f965-15fc-40d5-85e7-20cec0d42549\") " pod="kube-system/global-pull-secret-syncer-dlk5b" Jun 14 14:39:25.230535 ip-10-0-129-116 kubenswrapper[2546]: I0614 14:39:25.228434 2546 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/6446f965-15fc-40d5-85e7-20cec0d42549-original-pull-secret\") pod \"global-pull-secret-syncer-dlk5b\" (UID: \"6446f965-15fc-40d5-85e7-20cec0d42549\") " pod="kube-system/global-pull-secret-syncer-dlk5b" Jun 14 14:39:25.230535 ip-10-0-129-116 kubenswrapper[2546]: I0614 14:39:25.228436 2546 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/30e02c92-21a3-43cd-a129-a21a3a3ccb37-hosts-file\") pod \"node-resolver-ptpcx\" (UID: \"30e02c92-21a3-43cd-a129-a21a3a3ccb37\") " pod="openshift-dns/node-resolver-ptpcx" Jun 14 14:39:25.230535 ip-10-0-129-116 kubenswrapper[2546]: I0614 14:39:25.228464 2546 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-smz42\" (UniqueName: \"kubernetes.io/projected/aa4feed6-27ad-493a-baa3-8d0d96cb5309-kube-api-access-smz42\") pod \"network-metrics-daemon-lt4g2\" (UID: \"aa4feed6-27ad-493a-baa3-8d0d96cb5309\") " pod="openshift-multus/network-metrics-daemon-lt4g2" Jun 14 14:39:25.230535 ip-10-0-129-116 kubenswrapper[2546]: I0614 14:39:25.228483 2546 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/e8d897b0-a5b7-4f7e-a664-7c7a45a1c5de-host\") pod \"tuned-84jgl\" (UID: \"e8d897b0-a5b7-4f7e-a664-7c7a45a1c5de\") " pod="openshift-cluster-node-tuning-operator/tuned-84jgl" Jun 14 14:39:25.230535 ip-10-0-129-116 kubenswrapper[2546]: I0614 14:39:25.228493 2546 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/8da319a4-be6d-4245-aed1-aa1fdaf8ca66-cnibin\") pod \"multus-additional-cni-plugins-r4gvc\" (UID: \"8da319a4-be6d-4245-aed1-aa1fdaf8ca66\") " pod="openshift-multus/multus-additional-cni-plugins-r4gvc" Jun 14 14:39:25.230535 ip-10-0-129-116 kubenswrapper[2546]: I0614 14:39:25.228499 2546 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/8da319a4-be6d-4245-aed1-aa1fdaf8ca66-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-r4gvc\" (UID: \"8da319a4-be6d-4245-aed1-aa1fdaf8ca66\") " pod="openshift-multus/multus-additional-cni-plugins-r4gvc" Jun 14 14:39:25.230535 ip-10-0-129-116 kubenswrapper[2546]: I0614 14:39:25.228516 2546 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/8da319a4-be6d-4245-aed1-aa1fdaf8ca66-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-r4gvc\" (UID: \"8da319a4-be6d-4245-aed1-aa1fdaf8ca66\") " pod="openshift-multus/multus-additional-cni-plugins-r4gvc" Jun 14 14:39:25.230535 ip-10-0-129-116 kubenswrapper[2546]: I0614 14:39:25.228534 2546 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/e8d897b0-a5b7-4f7e-a664-7c7a45a1c5de-etc-tuned\") pod \"tuned-84jgl\" (UID: \"e8d897b0-a5b7-4f7e-a664-7c7a45a1c5de\") " pod="openshift-cluster-node-tuning-operator/tuned-84jgl" Jun 14 14:39:25.231299 ip-10-0-129-116 kubenswrapper[2546]: I0614 14:39:25.228541 2546 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/3cb1d703-5bee-4d7e-8879-ba67f7129fed-cnibin\") pod \"multus-cghhz\" (UID: \"3cb1d703-5bee-4d7e-8879-ba67f7129fed\") " pod="openshift-multus/multus-cghhz" Jun 14 14:39:25.231299 ip-10-0-129-116 kubenswrapper[2546]: I0614 14:39:25.228567 2546 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/105377da-c223-41ad-b033-546cb01239c4-agent-certs\") pod \"konnectivity-agent-c96gx\" (UID: \"105377da-c223-41ad-b033-546cb01239c4\") " pod="kube-system/konnectivity-agent-c96gx" Jun 14 14:39:25.231299 ip-10-0-129-116 kubenswrapper[2546]: I0614 14:39:25.228584 2546 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/3cb1d703-5bee-4d7e-8879-ba67f7129fed-hostroot\") pod \"multus-cghhz\" (UID: \"3cb1d703-5bee-4d7e-8879-ba67f7129fed\") " pod="openshift-multus/multus-cghhz" Jun 14 14:39:25.231299 ip-10-0-129-116 kubenswrapper[2546]: I0614 14:39:25.228589 2546 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/6446f965-15fc-40d5-85e7-20cec0d42549-kubelet-config\") pod \"global-pull-secret-syncer-dlk5b\" (UID: \"6446f965-15fc-40d5-85e7-20cec0d42549\") " pod="kube-system/global-pull-secret-syncer-dlk5b" Jun 14 14:39:25.231299 ip-10-0-129-116 kubenswrapper[2546]: I0614 14:39:25.228599 2546 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/32b27404-1251-4372-a3b9-de131b817153-sys-fs\") pod \"aws-ebs-csi-driver-node-mrqb6\" (UID: \"32b27404-1251-4372-a3b9-de131b817153\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-mrqb6" Jun 14 14:39:25.231299 ip-10-0-129-116 kubenswrapper[2546]: I0614 14:39:25.228625 2546 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/d6890b61-860c-4e6c-8138-26bc128905c5-host-slash\") pod \"iptables-alerter-qfjpp\" (UID: \"d6890b61-860c-4e6c-8138-26bc128905c5\") " pod="openshift-network-operator/iptables-alerter-qfjpp" Jun 14 14:39:25.231299 ip-10-0-129-116 kubenswrapper[2546]: I0614 14:39:25.228637 2546 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/32b27404-1251-4372-a3b9-de131b817153-sys-fs\") pod \"aws-ebs-csi-driver-node-mrqb6\" (UID: \"32b27404-1251-4372-a3b9-de131b817153\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-mrqb6" Jun 14 14:39:25.231299 ip-10-0-129-116 kubenswrapper[2546]: I0614 14:39:25.228645 2546 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/d6890b61-860c-4e6c-8138-26bc128905c5-iptables-alerter-script\") pod \"iptables-alerter-qfjpp\" (UID: \"d6890b61-860c-4e6c-8138-26bc128905c5\") " pod="openshift-network-operator/iptables-alerter-qfjpp" Jun 14 14:39:25.231299 ip-10-0-129-116 kubenswrapper[2546]: I0614 14:39:25.228697 2546 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/32b27404-1251-4372-a3b9-de131b817153-kubelet-dir\") pod \"aws-ebs-csi-driver-node-mrqb6\" (UID: \"32b27404-1251-4372-a3b9-de131b817153\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-mrqb6" Jun 14 14:39:25.231299 ip-10-0-129-116 kubenswrapper[2546]: I0614 14:39:25.228713 2546 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/e8d897b0-a5b7-4f7e-a664-7c7a45a1c5de-host\") pod \"tuned-84jgl\" (UID: \"e8d897b0-a5b7-4f7e-a664-7c7a45a1c5de\") " pod="openshift-cluster-node-tuning-operator/tuned-84jgl" Jun 14 14:39:25.231299 ip-10-0-129-116 kubenswrapper[2546]: I0614 14:39:25.228740 2546 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/8da319a4-be6d-4245-aed1-aa1fdaf8ca66-system-cni-dir\") pod \"multus-additional-cni-plugins-r4gvc\" (UID: \"8da319a4-be6d-4245-aed1-aa1fdaf8ca66\") " pod="openshift-multus/multus-additional-cni-plugins-r4gvc" Jun 14 14:39:25.231299 ip-10-0-129-116 kubenswrapper[2546]: I0614 14:39:25.228650 2546 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/e8d897b0-a5b7-4f7e-a664-7c7a45a1c5de-etc-modprobe-d\") pod \"tuned-84jgl\" (UID: \"e8d897b0-a5b7-4f7e-a664-7c7a45a1c5de\") " pod="openshift-cluster-node-tuning-operator/tuned-84jgl" Jun 14 14:39:25.231299 ip-10-0-129-116 kubenswrapper[2546]: I0614 14:39:25.228781 2546 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/32b27404-1251-4372-a3b9-de131b817153-device-dir\") pod \"aws-ebs-csi-driver-node-mrqb6\" (UID: \"32b27404-1251-4372-a3b9-de131b817153\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-mrqb6" Jun 14 14:39:25.231299 ip-10-0-129-116 kubenswrapper[2546]: I0614 14:39:25.228815 2546 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/d6890b61-860c-4e6c-8138-26bc128905c5-host-slash\") pod \"iptables-alerter-qfjpp\" (UID: \"d6890b61-860c-4e6c-8138-26bc128905c5\") " pod="openshift-network-operator/iptables-alerter-qfjpp" Jun 14 14:39:25.231299 ip-10-0-129-116 kubenswrapper[2546]: E0614 14:39:25.228820 2546 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jun 14 14:39:25.231299 ip-10-0-129-116 kubenswrapper[2546]: I0614 14:39:25.228853 2546 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/32b27404-1251-4372-a3b9-de131b817153-device-dir\") pod \"aws-ebs-csi-driver-node-mrqb6\" (UID: \"32b27404-1251-4372-a3b9-de131b817153\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-mrqb6" Jun 14 14:39:25.231299 ip-10-0-129-116 kubenswrapper[2546]: I0614 14:39:25.228863 2546 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/4df84aa4-08f2-487d-a8fb-fa2fe8144da8-host\") pod \"node-ca-dshlf\" (UID: \"4df84aa4-08f2-487d-a8fb-fa2fe8144da8\") " pod="openshift-image-registry/node-ca-dshlf" Jun 14 14:39:25.232135 ip-10-0-129-116 kubenswrapper[2546]: E0614 14:39:25.228882 2546 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/6446f965-15fc-40d5-85e7-20cec0d42549-original-pull-secret podName:6446f965-15fc-40d5-85e7-20cec0d42549 nodeName:}" failed. No retries permitted until 2026-06-14 14:39:25.728863989 +0000 UTC m=+3.057246097 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/6446f965-15fc-40d5-85e7-20cec0d42549-original-pull-secret") pod "global-pull-secret-syncer-dlk5b" (UID: "6446f965-15fc-40d5-85e7-20cec0d42549") : object "kube-system"/"original-pull-secret" not registered Jun 14 14:39:25.232135 ip-10-0-129-116 kubenswrapper[2546]: I0614 14:39:25.228932 2546 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/3cb1d703-5bee-4d7e-8879-ba67f7129fed-hostroot\") pod \"multus-cghhz\" (UID: \"3cb1d703-5bee-4d7e-8879-ba67f7129fed\") " pod="openshift-multus/multus-cghhz" Jun 14 14:39:25.232135 ip-10-0-129-116 kubenswrapper[2546]: I0614 14:39:25.228934 2546 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/e8d897b0-a5b7-4f7e-a664-7c7a45a1c5de-etc-modprobe-d\") pod \"tuned-84jgl\" (UID: \"e8d897b0-a5b7-4f7e-a664-7c7a45a1c5de\") " pod="openshift-cluster-node-tuning-operator/tuned-84jgl" Jun 14 14:39:25.232135 ip-10-0-129-116 kubenswrapper[2546]: I0614 14:39:25.229155 2546 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/8da319a4-be6d-4245-aed1-aa1fdaf8ca66-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-r4gvc\" (UID: \"8da319a4-be6d-4245-aed1-aa1fdaf8ca66\") " pod="openshift-multus/multus-additional-cni-plugins-r4gvc" Jun 14 14:39:25.232135 ip-10-0-129-116 kubenswrapper[2546]: I0614 14:39:25.229272 2546 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/e8d897b0-a5b7-4f7e-a664-7c7a45a1c5de-lib-modules\") pod \"tuned-84jgl\" (UID: \"e8d897b0-a5b7-4f7e-a664-7c7a45a1c5de\") " pod="openshift-cluster-node-tuning-operator/tuned-84jgl" Jun 14 14:39:25.232135 ip-10-0-129-116 kubenswrapper[2546]: I0614 14:39:25.229289 2546 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/8da319a4-be6d-4245-aed1-aa1fdaf8ca66-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-r4gvc\" (UID: \"8da319a4-be6d-4245-aed1-aa1fdaf8ca66\") " pod="openshift-multus/multus-additional-cni-plugins-r4gvc" Jun 14 14:39:25.232135 ip-10-0-129-116 kubenswrapper[2546]: I0614 14:39:25.231662 2546 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/e8d897b0-a5b7-4f7e-a664-7c7a45a1c5de-etc-tuned\") pod \"tuned-84jgl\" (UID: \"e8d897b0-a5b7-4f7e-a664-7c7a45a1c5de\") " pod="openshift-cluster-node-tuning-operator/tuned-84jgl" Jun 14 14:39:25.232135 ip-10-0-129-116 kubenswrapper[2546]: I0614 14:39:25.231860 2546 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/c154f741-4d88-4933-b24b-9fa582917964-ovn-node-metrics-cert\") pod \"ovnkube-node-zgckr\" (UID: \"c154f741-4d88-4933-b24b-9fa582917964\") " pod="openshift-ovn-kubernetes/ovnkube-node-zgckr" Jun 14 14:39:25.232544 ip-10-0-129-116 kubenswrapper[2546]: I0614 14:39:25.232366 2546 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/105377da-c223-41ad-b033-546cb01239c4-agent-certs\") pod \"konnectivity-agent-c96gx\" (UID: \"105377da-c223-41ad-b033-546cb01239c4\") " pod="kube-system/konnectivity-agent-c96gx" Jun 14 14:39:25.232640 ip-10-0-129-116 kubenswrapper[2546]: I0614 14:39:25.232622 2546 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/e8d897b0-a5b7-4f7e-a664-7c7a45a1c5de-tmp\") pod \"tuned-84jgl\" (UID: \"e8d897b0-a5b7-4f7e-a664-7c7a45a1c5de\") " pod="openshift-cluster-node-tuning-operator/tuned-84jgl" Jun 14 14:39:25.237366 ip-10-0-129-116 kubenswrapper[2546]: E0614 14:39:25.237344 2546 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jun 14 14:39:25.237475 ip-10-0-129-116 kubenswrapper[2546]: E0614 14:39:25.237372 2546 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jun 14 14:39:25.237475 ip-10-0-129-116 kubenswrapper[2546]: E0614 14:39:25.237385 2546 projected.go:196] Error preparing data for projected volume kube-api-access-t9bks for pod openshift-network-diagnostics/network-check-target-m6zq8: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 14 14:39:25.237475 ip-10-0-129-116 kubenswrapper[2546]: E0614 14:39:25.237441 2546 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/726e808e-de0a-4f4f-809c-8f7e7cc45432-kube-api-access-t9bks podName:726e808e-de0a-4f4f-809c-8f7e7cc45432 nodeName:}" failed. No retries permitted until 2026-06-14 14:39:25.737420821 +0000 UTC m=+3.065802940 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-api-access-t9bks" (UniqueName: "kubernetes.io/projected/726e808e-de0a-4f4f-809c-8f7e7cc45432-kube-api-access-t9bks") pod "network-check-target-m6zq8" (UID: "726e808e-de0a-4f4f-809c-8f7e7cc45432") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 14 14:39:25.238767 ip-10-0-129-116 kubenswrapper[2546]: I0614 14:39:25.238737 2546 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-wlw7s\" (UniqueName: \"kubernetes.io/projected/30e02c92-21a3-43cd-a129-a21a3a3ccb37-kube-api-access-wlw7s\") pod \"node-resolver-ptpcx\" (UID: \"30e02c92-21a3-43cd-a129-a21a3a3ccb37\") " pod="openshift-dns/node-resolver-ptpcx" Jun 14 14:39:25.240070 ip-10-0-129-116 kubenswrapper[2546]: I0614 14:39:25.240044 2546 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-smz42\" (UniqueName: \"kubernetes.io/projected/aa4feed6-27ad-493a-baa3-8d0d96cb5309-kube-api-access-smz42\") pod \"network-metrics-daemon-lt4g2\" (UID: \"aa4feed6-27ad-493a-baa3-8d0d96cb5309\") " pod="openshift-multus/network-metrics-daemon-lt4g2" Jun 14 14:39:25.240875 ip-10-0-129-116 kubenswrapper[2546]: I0614 14:39:25.240382 2546 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-wtv6b\" (UniqueName: \"kubernetes.io/projected/c154f741-4d88-4933-b24b-9fa582917964-kube-api-access-wtv6b\") pod \"ovnkube-node-zgckr\" (UID: \"c154f741-4d88-4933-b24b-9fa582917964\") " pod="openshift-ovn-kubernetes/ovnkube-node-zgckr" Jun 14 14:39:25.240875 ip-10-0-129-116 kubenswrapper[2546]: I0614 14:39:25.240830 2546 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-z2kjr\" (UniqueName: \"kubernetes.io/projected/3cb1d703-5bee-4d7e-8879-ba67f7129fed-kube-api-access-z2kjr\") pod \"multus-cghhz\" (UID: \"3cb1d703-5bee-4d7e-8879-ba67f7129fed\") " pod="openshift-multus/multus-cghhz" Jun 14 14:39:25.240875 ip-10-0-129-116 kubenswrapper[2546]: I0614 14:39:25.240833 2546 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-nbjrn\" (UniqueName: \"kubernetes.io/projected/8da319a4-be6d-4245-aed1-aa1fdaf8ca66-kube-api-access-nbjrn\") pod \"multus-additional-cni-plugins-r4gvc\" (UID: \"8da319a4-be6d-4245-aed1-aa1fdaf8ca66\") " pod="openshift-multus/multus-additional-cni-plugins-r4gvc" Jun 14 14:39:25.241286 ip-10-0-129-116 kubenswrapper[2546]: I0614 14:39:25.241261 2546 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-lwsd5\" (UniqueName: \"kubernetes.io/projected/e8d897b0-a5b7-4f7e-a664-7c7a45a1c5de-kube-api-access-lwsd5\") pod \"tuned-84jgl\" (UID: \"e8d897b0-a5b7-4f7e-a664-7c7a45a1c5de\") " pod="openshift-cluster-node-tuning-operator/tuned-84jgl" Jun 14 14:39:25.241364 ip-10-0-129-116 kubenswrapper[2546]: I0614 14:39:25.241310 2546 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-lhb84\" (UniqueName: \"kubernetes.io/projected/4df84aa4-08f2-487d-a8fb-fa2fe8144da8-kube-api-access-lhb84\") pod \"node-ca-dshlf\" (UID: \"4df84aa4-08f2-487d-a8fb-fa2fe8144da8\") " pod="openshift-image-registry/node-ca-dshlf" Jun 14 14:39:25.241843 ip-10-0-129-116 kubenswrapper[2546]: I0614 14:39:25.241814 2546 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-lh8nq\" (UniqueName: \"kubernetes.io/projected/d6890b61-860c-4e6c-8138-26bc128905c5-kube-api-access-lh8nq\") pod \"iptables-alerter-qfjpp\" (UID: \"d6890b61-860c-4e6c-8138-26bc128905c5\") " pod="openshift-network-operator/iptables-alerter-qfjpp" Jun 14 14:39:25.242256 ip-10-0-129-116 kubenswrapper[2546]: I0614 14:39:25.242238 2546 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-gkw2d\" (UniqueName: \"kubernetes.io/projected/32b27404-1251-4372-a3b9-de131b817153-kube-api-access-gkw2d\") pod \"aws-ebs-csi-driver-node-mrqb6\" (UID: \"32b27404-1251-4372-a3b9-de131b817153\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-mrqb6" Jun 14 14:39:25.387234 ip-10-0-129-116 kubenswrapper[2546]: I0614 14:39:25.387202 2546 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-84jgl" Jun 14 14:39:25.395052 ip-10-0-129-116 kubenswrapper[2546]: I0614 14:39:25.395029 2546 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-zgckr" Jun 14 14:39:25.405214 ip-10-0-129-116 kubenswrapper[2546]: I0614 14:39:25.405155 2546 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-dshlf" Jun 14 14:39:25.410840 ip-10-0-129-116 kubenswrapper[2546]: I0614 14:39:25.410818 2546 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-c96gx" Jun 14 14:39:25.419484 ip-10-0-129-116 kubenswrapper[2546]: I0614 14:39:25.419465 2546 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-r4gvc" Jun 14 14:39:25.427084 ip-10-0-129-116 kubenswrapper[2546]: I0614 14:39:25.427062 2546 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-cghhz" Jun 14 14:39:25.437814 ip-10-0-129-116 kubenswrapper[2546]: I0614 14:39:25.437746 2546 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-mrqb6" Jun 14 14:39:25.445445 ip-10-0-129-116 kubenswrapper[2546]: I0614 14:39:25.445422 2546 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-ptpcx" Jun 14 14:39:25.453183 ip-10-0-129-116 kubenswrapper[2546]: I0614 14:39:25.453160 2546 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-qfjpp" Jun 14 14:39:25.573572 ip-10-0-129-116 kubenswrapper[2546]: I0614 14:39:25.573536 2546 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160" Jun 14 14:39:25.732622 ip-10-0-129-116 kubenswrapper[2546]: I0614 14:39:25.732528 2546 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/6446f965-15fc-40d5-85e7-20cec0d42549-original-pull-secret\") pod \"global-pull-secret-syncer-dlk5b\" (UID: \"6446f965-15fc-40d5-85e7-20cec0d42549\") " pod="kube-system/global-pull-secret-syncer-dlk5b" Jun 14 14:39:25.732622 ip-10-0-129-116 kubenswrapper[2546]: I0614 14:39:25.732571 2546 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/aa4feed6-27ad-493a-baa3-8d0d96cb5309-metrics-certs\") pod \"network-metrics-daemon-lt4g2\" (UID: \"aa4feed6-27ad-493a-baa3-8d0d96cb5309\") " pod="openshift-multus/network-metrics-daemon-lt4g2" Jun 14 14:39:25.732845 ip-10-0-129-116 kubenswrapper[2546]: E0614 14:39:25.732724 2546 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jun 14 14:39:25.732845 ip-10-0-129-116 kubenswrapper[2546]: E0614 14:39:25.732784 2546 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jun 14 14:39:25.732845 ip-10-0-129-116 kubenswrapper[2546]: E0614 14:39:25.732802 2546 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/6446f965-15fc-40d5-85e7-20cec0d42549-original-pull-secret podName:6446f965-15fc-40d5-85e7-20cec0d42549 nodeName:}" failed. No retries permitted until 2026-06-14 14:39:26.732782138 +0000 UTC m=+4.061164241 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/6446f965-15fc-40d5-85e7-20cec0d42549-original-pull-secret") pod "global-pull-secret-syncer-dlk5b" (UID: "6446f965-15fc-40d5-85e7-20cec0d42549") : object "kube-system"/"original-pull-secret" not registered Jun 14 14:39:25.732845 ip-10-0-129-116 kubenswrapper[2546]: E0614 14:39:25.732842 2546 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/aa4feed6-27ad-493a-baa3-8d0d96cb5309-metrics-certs podName:aa4feed6-27ad-493a-baa3-8d0d96cb5309 nodeName:}" failed. No retries permitted until 2026-06-14 14:39:26.732824783 +0000 UTC m=+4.061206889 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/aa4feed6-27ad-493a-baa3-8d0d96cb5309-metrics-certs") pod "network-metrics-daemon-lt4g2" (UID: "aa4feed6-27ad-493a-baa3-8d0d96cb5309") : object "openshift-multus"/"metrics-daemon-secret" not registered Jun 14 14:39:25.833427 ip-10-0-129-116 kubenswrapper[2546]: I0614 14:39:25.833381 2546 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-t9bks\" (UniqueName: \"kubernetes.io/projected/726e808e-de0a-4f4f-809c-8f7e7cc45432-kube-api-access-t9bks\") pod \"network-check-target-m6zq8\" (UID: \"726e808e-de0a-4f4f-809c-8f7e7cc45432\") " pod="openshift-network-diagnostics/network-check-target-m6zq8" Jun 14 14:39:25.833579 ip-10-0-129-116 kubenswrapper[2546]: E0614 14:39:25.833539 2546 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jun 14 14:39:25.833579 ip-10-0-129-116 kubenswrapper[2546]: E0614 14:39:25.833559 2546 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jun 14 14:39:25.833579 ip-10-0-129-116 kubenswrapper[2546]: E0614 14:39:25.833569 2546 projected.go:196] Error preparing data for projected volume kube-api-access-t9bks for pod openshift-network-diagnostics/network-check-target-m6zq8: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 14 14:39:25.833680 ip-10-0-129-116 kubenswrapper[2546]: E0614 14:39:25.833625 2546 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/726e808e-de0a-4f4f-809c-8f7e7cc45432-kube-api-access-t9bks podName:726e808e-de0a-4f4f-809c-8f7e7cc45432 nodeName:}" failed. No retries permitted until 2026-06-14 14:39:26.833610703 +0000 UTC m=+4.161992806 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-api-access-t9bks" (UniqueName: "kubernetes.io/projected/726e808e-de0a-4f4f-809c-8f7e7cc45432-kube-api-access-t9bks") pod "network-check-target-m6zq8" (UID: "726e808e-de0a-4f4f-809c-8f7e7cc45432") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 14 14:39:26.153279 ip-10-0-129-116 kubenswrapper[2546]: I0614 14:39:26.153159 2546 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-06-13 14:34:24 +0000 UTC" deadline="2028-02-20 07:45:49.283264482 +0000 UTC" Jun 14 14:39:26.153279 ip-10-0-129-116 kubenswrapper[2546]: I0614 14:39:26.153212 2546 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="14777h6m23.130055827s" Jun 14 14:39:26.274555 ip-10-0-129-116 kubenswrapper[2546]: W0614 14:39:26.274524 2546 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8da319a4_be6d_4245_aed1_aa1fdaf8ca66.slice/crio-e3a9bbd229f458d532e843c1eaac1bf5102d88ebc6ebf8a822d509d8bc8efb0a WatchSource:0}: Error finding container e3a9bbd229f458d532e843c1eaac1bf5102d88ebc6ebf8a822d509d8bc8efb0a: Status 404 returned error can't find the container with id e3a9bbd229f458d532e843c1eaac1bf5102d88ebc6ebf8a822d509d8bc8efb0a Jun 14 14:39:26.275821 ip-10-0-129-116 kubenswrapper[2546]: W0614 14:39:26.275724 2546 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod105377da_c223_41ad_b033_546cb01239c4.slice/crio-4b61db572c58974df21e787bb6a47d2502dc0126ce042fc48a89465d41e45fe9 WatchSource:0}: Error finding container 4b61db572c58974df21e787bb6a47d2502dc0126ce042fc48a89465d41e45fe9: Status 404 returned error can't find the container with id 4b61db572c58974df21e787bb6a47d2502dc0126ce042fc48a89465d41e45fe9 Jun 14 14:39:26.279925 ip-10-0-129-116 kubenswrapper[2546]: W0614 14:39:26.279901 2546 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod32b27404_1251_4372_a3b9_de131b817153.slice/crio-91e784e2da905a82997b607b5b4478f7f843220e5ab3453f8a1e969257209782 WatchSource:0}: Error finding container 91e784e2da905a82997b607b5b4478f7f843220e5ab3453f8a1e969257209782: Status 404 returned error can't find the container with id 91e784e2da905a82997b607b5b4478f7f843220e5ab3453f8a1e969257209782 Jun 14 14:39:26.280574 ip-10-0-129-116 kubenswrapper[2546]: W0614 14:39:26.280493 2546 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4df84aa4_08f2_487d_a8fb_fa2fe8144da8.slice/crio-a739cd08072d2f4c1d7d6bd39ea388dfc71da55823659451508503a84671d25b WatchSource:0}: Error finding container a739cd08072d2f4c1d7d6bd39ea388dfc71da55823659451508503a84671d25b: Status 404 returned error can't find the container with id a739cd08072d2f4c1d7d6bd39ea388dfc71da55823659451508503a84671d25b Jun 14 14:39:26.282485 ip-10-0-129-116 kubenswrapper[2546]: W0614 14:39:26.282404 2546 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod30e02c92_21a3_43cd_a129_a21a3a3ccb37.slice/crio-66d3290026b6b811875655df801b9de46300bab298ed8cdefe86274d5aa3f5a6 WatchSource:0}: Error finding container 66d3290026b6b811875655df801b9de46300bab298ed8cdefe86274d5aa3f5a6: Status 404 returned error can't find the container with id 66d3290026b6b811875655df801b9de46300bab298ed8cdefe86274d5aa3f5a6 Jun 14 14:39:26.283387 ip-10-0-129-116 kubenswrapper[2546]: W0614 14:39:26.282832 2546 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3cb1d703_5bee_4d7e_8879_ba67f7129fed.slice/crio-951461cadea079727ec2cc05b5fe96d98ac2031753e34673d094ce21d8d42e10 WatchSource:0}: Error finding container 951461cadea079727ec2cc05b5fe96d98ac2031753e34673d094ce21d8d42e10: Status 404 returned error can't find the container with id 951461cadea079727ec2cc05b5fe96d98ac2031753e34673d094ce21d8d42e10 Jun 14 14:39:26.285526 ip-10-0-129-116 kubenswrapper[2546]: W0614 14:39:26.285325 2546 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode8d897b0_a5b7_4f7e_a664_7c7a45a1c5de.slice/crio-0442967c8801c07a6735eec6c15c82c6bcc393ca1fab6372c48ea6d5f55a778a WatchSource:0}: Error finding container 0442967c8801c07a6735eec6c15c82c6bcc393ca1fab6372c48ea6d5f55a778a: Status 404 returned error can't find the container with id 0442967c8801c07a6735eec6c15c82c6bcc393ca1fab6372c48ea6d5f55a778a Jun 14 14:39:26.286411 ip-10-0-129-116 kubenswrapper[2546]: W0614 14:39:26.286380 2546 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc154f741_4d88_4933_b24b_9fa582917964.slice/crio-dec16aab7ddfefb808349e7bbca916744da44d335784761ede638f0cb70eab1e WatchSource:0}: Error finding container dec16aab7ddfefb808349e7bbca916744da44d335784761ede638f0cb70eab1e: Status 404 returned error can't find the container with id dec16aab7ddfefb808349e7bbca916744da44d335784761ede638f0cb70eab1e Jun 14 14:39:26.287949 ip-10-0-129-116 kubenswrapper[2546]: W0614 14:39:26.287928 2546 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd6890b61_860c_4e6c_8138_26bc128905c5.slice/crio-be9ffd64d040840a5d6651b4e705b8deedc1d35b769932c7e1d29f107860380f WatchSource:0}: Error finding container be9ffd64d040840a5d6651b4e705b8deedc1d35b769932c7e1d29f107860380f: Status 404 returned error can't find the container with id be9ffd64d040840a5d6651b4e705b8deedc1d35b769932c7e1d29f107860380f Jun 14 14:39:26.738975 ip-10-0-129-116 kubenswrapper[2546]: I0614 14:39:26.738781 2546 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/6446f965-15fc-40d5-85e7-20cec0d42549-original-pull-secret\") pod \"global-pull-secret-syncer-dlk5b\" (UID: \"6446f965-15fc-40d5-85e7-20cec0d42549\") " pod="kube-system/global-pull-secret-syncer-dlk5b" Jun 14 14:39:26.739181 ip-10-0-129-116 kubenswrapper[2546]: I0614 14:39:26.738995 2546 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/aa4feed6-27ad-493a-baa3-8d0d96cb5309-metrics-certs\") pod \"network-metrics-daemon-lt4g2\" (UID: \"aa4feed6-27ad-493a-baa3-8d0d96cb5309\") " pod="openshift-multus/network-metrics-daemon-lt4g2" Jun 14 14:39:26.739181 ip-10-0-129-116 kubenswrapper[2546]: E0614 14:39:26.738938 2546 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jun 14 14:39:26.739181 ip-10-0-129-116 kubenswrapper[2546]: E0614 14:39:26.739121 2546 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/6446f965-15fc-40d5-85e7-20cec0d42549-original-pull-secret podName:6446f965-15fc-40d5-85e7-20cec0d42549 nodeName:}" failed. No retries permitted until 2026-06-14 14:39:28.739103441 +0000 UTC m=+6.067485556 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/6446f965-15fc-40d5-85e7-20cec0d42549-original-pull-secret") pod "global-pull-secret-syncer-dlk5b" (UID: "6446f965-15fc-40d5-85e7-20cec0d42549") : object "kube-system"/"original-pull-secret" not registered Jun 14 14:39:26.739181 ip-10-0-129-116 kubenswrapper[2546]: E0614 14:39:26.739120 2546 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jun 14 14:39:26.739181 ip-10-0-129-116 kubenswrapper[2546]: E0614 14:39:26.739155 2546 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/aa4feed6-27ad-493a-baa3-8d0d96cb5309-metrics-certs podName:aa4feed6-27ad-493a-baa3-8d0d96cb5309 nodeName:}" failed. No retries permitted until 2026-06-14 14:39:28.739147324 +0000 UTC m=+6.067529427 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/aa4feed6-27ad-493a-baa3-8d0d96cb5309-metrics-certs") pod "network-metrics-daemon-lt4g2" (UID: "aa4feed6-27ad-493a-baa3-8d0d96cb5309") : object "openshift-multus"/"metrics-daemon-secret" not registered Jun 14 14:39:26.839577 ip-10-0-129-116 kubenswrapper[2546]: I0614 14:39:26.839492 2546 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-t9bks\" (UniqueName: \"kubernetes.io/projected/726e808e-de0a-4f4f-809c-8f7e7cc45432-kube-api-access-t9bks\") pod \"network-check-target-m6zq8\" (UID: \"726e808e-de0a-4f4f-809c-8f7e7cc45432\") " pod="openshift-network-diagnostics/network-check-target-m6zq8" Jun 14 14:39:26.839765 ip-10-0-129-116 kubenswrapper[2546]: E0614 14:39:26.839700 2546 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jun 14 14:39:26.839765 ip-10-0-129-116 kubenswrapper[2546]: E0614 14:39:26.839721 2546 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jun 14 14:39:26.839765 ip-10-0-129-116 kubenswrapper[2546]: E0614 14:39:26.839734 2546 projected.go:196] Error preparing data for projected volume kube-api-access-t9bks for pod openshift-network-diagnostics/network-check-target-m6zq8: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 14 14:39:26.839940 ip-10-0-129-116 kubenswrapper[2546]: E0614 14:39:26.839799 2546 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/726e808e-de0a-4f4f-809c-8f7e7cc45432-kube-api-access-t9bks podName:726e808e-de0a-4f4f-809c-8f7e7cc45432 nodeName:}" failed. No retries permitted until 2026-06-14 14:39:28.839779358 +0000 UTC m=+6.168161461 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-api-access-t9bks" (UniqueName: "kubernetes.io/projected/726e808e-de0a-4f4f-809c-8f7e7cc45432-kube-api-access-t9bks") pod "network-check-target-m6zq8" (UID: "726e808e-de0a-4f4f-809c-8f7e7cc45432") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 14 14:39:27.186881 ip-10-0-129-116 kubenswrapper[2546]: I0614 14:39:27.186186 2546 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-dlk5b" Jun 14 14:39:27.186881 ip-10-0-129-116 kubenswrapper[2546]: E0614 14:39:27.186309 2546 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-dlk5b" podUID="6446f965-15fc-40d5-85e7-20cec0d42549" Jun 14 14:39:27.186881 ip-10-0-129-116 kubenswrapper[2546]: I0614 14:39:27.186693 2546 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-lt4g2" Jun 14 14:39:27.186881 ip-10-0-129-116 kubenswrapper[2546]: E0614 14:39:27.186795 2546 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-lt4g2" podUID="aa4feed6-27ad-493a-baa3-8d0d96cb5309" Jun 14 14:39:27.188011 ip-10-0-129-116 kubenswrapper[2546]: I0614 14:39:27.187845 2546 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-m6zq8" Jun 14 14:39:27.188011 ip-10-0-129-116 kubenswrapper[2546]: E0614 14:39:27.187943 2546 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-m6zq8" podUID="726e808e-de0a-4f4f-809c-8f7e7cc45432" Jun 14 14:39:27.204116 ip-10-0-129-116 kubenswrapper[2546]: I0614 14:39:27.200743 2546 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-129-116.ec2.internal" event={"ID":"b68f1280995218345affbc9fee0e8f68","Type":"ContainerStarted","Data":"b8a2919efde7fb7e9b0629968a724df157e1b34dfa951fe88cf82d3aaebfa777"} Jun 14 14:39:27.218705 ip-10-0-129-116 kubenswrapper[2546]: I0614 14:39:27.218669 2546 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-zgckr" event={"ID":"c154f741-4d88-4933-b24b-9fa582917964","Type":"ContainerStarted","Data":"dec16aab7ddfefb808349e7bbca916744da44d335784761ede638f0cb70eab1e"} Jun 14 14:39:27.228164 ip-10-0-129-116 kubenswrapper[2546]: I0614 14:39:27.228054 2546 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-cghhz" event={"ID":"3cb1d703-5bee-4d7e-8879-ba67f7129fed","Type":"ContainerStarted","Data":"951461cadea079727ec2cc05b5fe96d98ac2031753e34673d094ce21d8d42e10"} Jun 14 14:39:27.232614 ip-10-0-129-116 kubenswrapper[2546]: I0614 14:39:27.232560 2546 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-ptpcx" event={"ID":"30e02c92-21a3-43cd-a129-a21a3a3ccb37","Type":"ContainerStarted","Data":"66d3290026b6b811875655df801b9de46300bab298ed8cdefe86274d5aa3f5a6"} Jun 14 14:39:27.238849 ip-10-0-129-116 kubenswrapper[2546]: I0614 14:39:27.238822 2546 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-mrqb6" event={"ID":"32b27404-1251-4372-a3b9-de131b817153","Type":"ContainerStarted","Data":"91e784e2da905a82997b607b5b4478f7f843220e5ab3453f8a1e969257209782"} Jun 14 14:39:27.247992 ip-10-0-129-116 kubenswrapper[2546]: I0614 14:39:27.247175 2546 generic.go:356] "Generic (PLEG): container finished" podID="b5ab8648909b6097cc4bd39cce0c18f1" containerID="36bb9fa4f0997f77736fdf5443a5aa453a69fa9aaa7fdf179f59878a7ebc708d" exitCode=0 Jun 14 14:39:27.247992 ip-10-0-129-116 kubenswrapper[2546]: I0614 14:39:27.247252 2546 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-129-116.ec2.internal" event={"ID":"b5ab8648909b6097cc4bd39cce0c18f1","Type":"ContainerDied","Data":"36bb9fa4f0997f77736fdf5443a5aa453a69fa9aaa7fdf179f59878a7ebc708d"} Jun 14 14:39:27.253914 ip-10-0-129-116 kubenswrapper[2546]: I0614 14:39:27.253847 2546 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-qfjpp" event={"ID":"d6890b61-860c-4e6c-8138-26bc128905c5","Type":"ContainerStarted","Data":"be9ffd64d040840a5d6651b4e705b8deedc1d35b769932c7e1d29f107860380f"} Jun 14 14:39:27.257860 ip-10-0-129-116 kubenswrapper[2546]: I0614 14:39:27.257790 2546 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-84jgl" event={"ID":"e8d897b0-a5b7-4f7e-a664-7c7a45a1c5de","Type":"ContainerStarted","Data":"0442967c8801c07a6735eec6c15c82c6bcc393ca1fab6372c48ea6d5f55a778a"} Jun 14 14:39:27.262976 ip-10-0-129-116 kubenswrapper[2546]: I0614 14:39:27.262827 2546 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/kube-apiserver-proxy-ip-10-0-129-116.ec2.internal" podStartSLOduration=3.262809914 podStartE2EDuration="3.262809914s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-14 14:39:24 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-14 14:39:27.215006436 +0000 UTC m=+4.543388561" watchObservedRunningTime="2026-06-14 14:39:27.262809914 +0000 UTC m=+4.591192040" Jun 14 14:39:27.264497 ip-10-0-129-116 kubenswrapper[2546]: I0614 14:39:27.264447 2546 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-dshlf" event={"ID":"4df84aa4-08f2-487d-a8fb-fa2fe8144da8","Type":"ContainerStarted","Data":"a739cd08072d2f4c1d7d6bd39ea388dfc71da55823659451508503a84671d25b"} Jun 14 14:39:27.285584 ip-10-0-129-116 kubenswrapper[2546]: I0614 14:39:27.285555 2546 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-c96gx" event={"ID":"105377da-c223-41ad-b033-546cb01239c4","Type":"ContainerStarted","Data":"4b61db572c58974df21e787bb6a47d2502dc0126ce042fc48a89465d41e45fe9"} Jun 14 14:39:27.302233 ip-10-0-129-116 kubenswrapper[2546]: I0614 14:39:27.302106 2546 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-r4gvc" event={"ID":"8da319a4-be6d-4245-aed1-aa1fdaf8ca66","Type":"ContainerStarted","Data":"e3a9bbd229f458d532e843c1eaac1bf5102d88ebc6ebf8a822d509d8bc8efb0a"} Jun 14 14:39:28.318710 ip-10-0-129-116 kubenswrapper[2546]: I0614 14:39:28.318676 2546 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-129-116.ec2.internal" event={"ID":"b5ab8648909b6097cc4bd39cce0c18f1","Type":"ContainerStarted","Data":"1e980c0e9de9d66887ecfbd8dca4db6c63c54e0174e30800645d06b80ccf3af0"} Jun 14 14:39:28.334132 ip-10-0-129-116 kubenswrapper[2546]: I0614 14:39:28.333480 2546 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-129-116.ec2.internal" podStartSLOduration=4.333459436 podStartE2EDuration="4.333459436s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-14 14:39:24 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-14 14:39:28.332762027 +0000 UTC m=+5.661144157" watchObservedRunningTime="2026-06-14 14:39:28.333459436 +0000 UTC m=+5.661841562" Jun 14 14:39:28.754853 ip-10-0-129-116 kubenswrapper[2546]: I0614 14:39:28.754772 2546 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/aa4feed6-27ad-493a-baa3-8d0d96cb5309-metrics-certs\") pod \"network-metrics-daemon-lt4g2\" (UID: \"aa4feed6-27ad-493a-baa3-8d0d96cb5309\") " pod="openshift-multus/network-metrics-daemon-lt4g2" Jun 14 14:39:28.755007 ip-10-0-129-116 kubenswrapper[2546]: I0614 14:39:28.754877 2546 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/6446f965-15fc-40d5-85e7-20cec0d42549-original-pull-secret\") pod \"global-pull-secret-syncer-dlk5b\" (UID: \"6446f965-15fc-40d5-85e7-20cec0d42549\") " pod="kube-system/global-pull-secret-syncer-dlk5b" Jun 14 14:39:28.755079 ip-10-0-129-116 kubenswrapper[2546]: E0614 14:39:28.755008 2546 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jun 14 14:39:28.755079 ip-10-0-129-116 kubenswrapper[2546]: E0614 14:39:28.755072 2546 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/6446f965-15fc-40d5-85e7-20cec0d42549-original-pull-secret podName:6446f965-15fc-40d5-85e7-20cec0d42549 nodeName:}" failed. No retries permitted until 2026-06-14 14:39:32.755053965 +0000 UTC m=+10.083436071 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/6446f965-15fc-40d5-85e7-20cec0d42549-original-pull-secret") pod "global-pull-secret-syncer-dlk5b" (UID: "6446f965-15fc-40d5-85e7-20cec0d42549") : object "kube-system"/"original-pull-secret" not registered Jun 14 14:39:28.755496 ip-10-0-129-116 kubenswrapper[2546]: E0614 14:39:28.755477 2546 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jun 14 14:39:28.755571 ip-10-0-129-116 kubenswrapper[2546]: E0614 14:39:28.755533 2546 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/aa4feed6-27ad-493a-baa3-8d0d96cb5309-metrics-certs podName:aa4feed6-27ad-493a-baa3-8d0d96cb5309 nodeName:}" failed. No retries permitted until 2026-06-14 14:39:32.755516221 +0000 UTC m=+10.083898331 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/aa4feed6-27ad-493a-baa3-8d0d96cb5309-metrics-certs") pod "network-metrics-daemon-lt4g2" (UID: "aa4feed6-27ad-493a-baa3-8d0d96cb5309") : object "openshift-multus"/"metrics-daemon-secret" not registered Jun 14 14:39:28.855853 ip-10-0-129-116 kubenswrapper[2546]: I0614 14:39:28.855202 2546 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-t9bks\" (UniqueName: \"kubernetes.io/projected/726e808e-de0a-4f4f-809c-8f7e7cc45432-kube-api-access-t9bks\") pod \"network-check-target-m6zq8\" (UID: \"726e808e-de0a-4f4f-809c-8f7e7cc45432\") " pod="openshift-network-diagnostics/network-check-target-m6zq8" Jun 14 14:39:28.855853 ip-10-0-129-116 kubenswrapper[2546]: E0614 14:39:28.855412 2546 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jun 14 14:39:28.855853 ip-10-0-129-116 kubenswrapper[2546]: E0614 14:39:28.855434 2546 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jun 14 14:39:28.855853 ip-10-0-129-116 kubenswrapper[2546]: E0614 14:39:28.855446 2546 projected.go:196] Error preparing data for projected volume kube-api-access-t9bks for pod openshift-network-diagnostics/network-check-target-m6zq8: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 14 14:39:28.855853 ip-10-0-129-116 kubenswrapper[2546]: E0614 14:39:28.855503 2546 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/726e808e-de0a-4f4f-809c-8f7e7cc45432-kube-api-access-t9bks podName:726e808e-de0a-4f4f-809c-8f7e7cc45432 nodeName:}" failed. No retries permitted until 2026-06-14 14:39:32.855484844 +0000 UTC m=+10.183866951 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-api-access-t9bks" (UniqueName: "kubernetes.io/projected/726e808e-de0a-4f4f-809c-8f7e7cc45432-kube-api-access-t9bks") pod "network-check-target-m6zq8" (UID: "726e808e-de0a-4f4f-809c-8f7e7cc45432") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 14 14:39:29.186679 ip-10-0-129-116 kubenswrapper[2546]: I0614 14:39:29.186605 2546 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-m6zq8" Jun 14 14:39:29.186848 ip-10-0-129-116 kubenswrapper[2546]: E0614 14:39:29.186729 2546 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-m6zq8" podUID="726e808e-de0a-4f4f-809c-8f7e7cc45432" Jun 14 14:39:29.187149 ip-10-0-129-116 kubenswrapper[2546]: I0614 14:39:29.187126 2546 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-dlk5b" Jun 14 14:39:29.187254 ip-10-0-129-116 kubenswrapper[2546]: E0614 14:39:29.187232 2546 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-dlk5b" podUID="6446f965-15fc-40d5-85e7-20cec0d42549" Jun 14 14:39:29.187389 ip-10-0-129-116 kubenswrapper[2546]: I0614 14:39:29.187373 2546 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-lt4g2" Jun 14 14:39:29.187493 ip-10-0-129-116 kubenswrapper[2546]: E0614 14:39:29.187474 2546 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-lt4g2" podUID="aa4feed6-27ad-493a-baa3-8d0d96cb5309" Jun 14 14:39:31.186808 ip-10-0-129-116 kubenswrapper[2546]: I0614 14:39:31.186776 2546 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-m6zq8" Jun 14 14:39:31.187281 ip-10-0-129-116 kubenswrapper[2546]: E0614 14:39:31.186903 2546 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-m6zq8" podUID="726e808e-de0a-4f4f-809c-8f7e7cc45432" Jun 14 14:39:31.187355 ip-10-0-129-116 kubenswrapper[2546]: I0614 14:39:31.187306 2546 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-dlk5b" Jun 14 14:39:31.187404 ip-10-0-129-116 kubenswrapper[2546]: E0614 14:39:31.187392 2546 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-dlk5b" podUID="6446f965-15fc-40d5-85e7-20cec0d42549" Jun 14 14:39:31.187460 ip-10-0-129-116 kubenswrapper[2546]: I0614 14:39:31.187445 2546 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-lt4g2" Jun 14 14:39:31.187543 ip-10-0-129-116 kubenswrapper[2546]: E0614 14:39:31.187521 2546 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-lt4g2" podUID="aa4feed6-27ad-493a-baa3-8d0d96cb5309" Jun 14 14:39:32.790403 ip-10-0-129-116 kubenswrapper[2546]: I0614 14:39:32.789921 2546 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/aa4feed6-27ad-493a-baa3-8d0d96cb5309-metrics-certs\") pod \"network-metrics-daemon-lt4g2\" (UID: \"aa4feed6-27ad-493a-baa3-8d0d96cb5309\") " pod="openshift-multus/network-metrics-daemon-lt4g2" Jun 14 14:39:32.790403 ip-10-0-129-116 kubenswrapper[2546]: I0614 14:39:32.790018 2546 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/6446f965-15fc-40d5-85e7-20cec0d42549-original-pull-secret\") pod \"global-pull-secret-syncer-dlk5b\" (UID: \"6446f965-15fc-40d5-85e7-20cec0d42549\") " pod="kube-system/global-pull-secret-syncer-dlk5b" Jun 14 14:39:32.790403 ip-10-0-129-116 kubenswrapper[2546]: E0614 14:39:32.790043 2546 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jun 14 14:39:32.790403 ip-10-0-129-116 kubenswrapper[2546]: E0614 14:39:32.790131 2546 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/aa4feed6-27ad-493a-baa3-8d0d96cb5309-metrics-certs podName:aa4feed6-27ad-493a-baa3-8d0d96cb5309 nodeName:}" failed. No retries permitted until 2026-06-14 14:39:40.790110222 +0000 UTC m=+18.118492330 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/aa4feed6-27ad-493a-baa3-8d0d96cb5309-metrics-certs") pod "network-metrics-daemon-lt4g2" (UID: "aa4feed6-27ad-493a-baa3-8d0d96cb5309") : object "openshift-multus"/"metrics-daemon-secret" not registered Jun 14 14:39:32.790403 ip-10-0-129-116 kubenswrapper[2546]: E0614 14:39:32.790145 2546 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jun 14 14:39:32.790403 ip-10-0-129-116 kubenswrapper[2546]: E0614 14:39:32.790200 2546 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/6446f965-15fc-40d5-85e7-20cec0d42549-original-pull-secret podName:6446f965-15fc-40d5-85e7-20cec0d42549 nodeName:}" failed. No retries permitted until 2026-06-14 14:39:40.790180947 +0000 UTC m=+18.118563050 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/6446f965-15fc-40d5-85e7-20cec0d42549-original-pull-secret") pod "global-pull-secret-syncer-dlk5b" (UID: "6446f965-15fc-40d5-85e7-20cec0d42549") : object "kube-system"/"original-pull-secret" not registered Jun 14 14:39:32.890912 ip-10-0-129-116 kubenswrapper[2546]: I0614 14:39:32.890877 2546 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-t9bks\" (UniqueName: \"kubernetes.io/projected/726e808e-de0a-4f4f-809c-8f7e7cc45432-kube-api-access-t9bks\") pod \"network-check-target-m6zq8\" (UID: \"726e808e-de0a-4f4f-809c-8f7e7cc45432\") " pod="openshift-network-diagnostics/network-check-target-m6zq8" Jun 14 14:39:32.891079 ip-10-0-129-116 kubenswrapper[2546]: E0614 14:39:32.891017 2546 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jun 14 14:39:32.891079 ip-10-0-129-116 kubenswrapper[2546]: E0614 14:39:32.891036 2546 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jun 14 14:39:32.891079 ip-10-0-129-116 kubenswrapper[2546]: E0614 14:39:32.891046 2546 projected.go:196] Error preparing data for projected volume kube-api-access-t9bks for pod openshift-network-diagnostics/network-check-target-m6zq8: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 14 14:39:32.891266 ip-10-0-129-116 kubenswrapper[2546]: E0614 14:39:32.891111 2546 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/726e808e-de0a-4f4f-809c-8f7e7cc45432-kube-api-access-t9bks podName:726e808e-de0a-4f4f-809c-8f7e7cc45432 nodeName:}" failed. No retries permitted until 2026-06-14 14:39:40.89108315 +0000 UTC m=+18.219465276 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-api-access-t9bks" (UniqueName: "kubernetes.io/projected/726e808e-de0a-4f4f-809c-8f7e7cc45432-kube-api-access-t9bks") pod "network-check-target-m6zq8" (UID: "726e808e-de0a-4f4f-809c-8f7e7cc45432") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 14 14:39:33.186495 ip-10-0-129-116 kubenswrapper[2546]: I0614 14:39:33.186382 2546 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-m6zq8" Jun 14 14:39:33.186940 ip-10-0-129-116 kubenswrapper[2546]: E0614 14:39:33.186906 2546 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-m6zq8" podUID="726e808e-de0a-4f4f-809c-8f7e7cc45432" Jun 14 14:39:33.187055 ip-10-0-129-116 kubenswrapper[2546]: I0614 14:39:33.186937 2546 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-dlk5b" Jun 14 14:39:33.187055 ip-10-0-129-116 kubenswrapper[2546]: E0614 14:39:33.187046 2546 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-dlk5b" podUID="6446f965-15fc-40d5-85e7-20cec0d42549" Jun 14 14:39:33.187204 ip-10-0-129-116 kubenswrapper[2546]: I0614 14:39:33.187105 2546 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-lt4g2" Jun 14 14:39:33.187256 ip-10-0-129-116 kubenswrapper[2546]: E0614 14:39:33.187208 2546 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-lt4g2" podUID="aa4feed6-27ad-493a-baa3-8d0d96cb5309" Jun 14 14:39:35.184830 ip-10-0-129-116 kubenswrapper[2546]: I0614 14:39:35.184768 2546 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-m6zq8" Jun 14 14:39:35.184830 ip-10-0-129-116 kubenswrapper[2546]: I0614 14:39:35.184788 2546 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-lt4g2" Jun 14 14:39:35.185350 ip-10-0-129-116 kubenswrapper[2546]: I0614 14:39:35.184909 2546 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-dlk5b" Jun 14 14:39:35.185350 ip-10-0-129-116 kubenswrapper[2546]: E0614 14:39:35.184908 2546 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-m6zq8" podUID="726e808e-de0a-4f4f-809c-8f7e7cc45432" Jun 14 14:39:35.185350 ip-10-0-129-116 kubenswrapper[2546]: E0614 14:39:35.185053 2546 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-lt4g2" podUID="aa4feed6-27ad-493a-baa3-8d0d96cb5309" Jun 14 14:39:35.185350 ip-10-0-129-116 kubenswrapper[2546]: E0614 14:39:35.185179 2546 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-dlk5b" podUID="6446f965-15fc-40d5-85e7-20cec0d42549" Jun 14 14:39:37.184700 ip-10-0-129-116 kubenswrapper[2546]: I0614 14:39:37.184644 2546 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-m6zq8" Jun 14 14:39:37.185225 ip-10-0-129-116 kubenswrapper[2546]: I0614 14:39:37.184645 2546 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-dlk5b" Jun 14 14:39:37.185225 ip-10-0-129-116 kubenswrapper[2546]: I0614 14:39:37.184801 2546 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-lt4g2" Jun 14 14:39:37.185225 ip-10-0-129-116 kubenswrapper[2546]: E0614 14:39:37.184791 2546 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-m6zq8" podUID="726e808e-de0a-4f4f-809c-8f7e7cc45432" Jun 14 14:39:37.185225 ip-10-0-129-116 kubenswrapper[2546]: E0614 14:39:37.184894 2546 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-dlk5b" podUID="6446f965-15fc-40d5-85e7-20cec0d42549" Jun 14 14:39:37.185225 ip-10-0-129-116 kubenswrapper[2546]: E0614 14:39:37.184984 2546 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-lt4g2" podUID="aa4feed6-27ad-493a-baa3-8d0d96cb5309" Jun 14 14:39:37.341294 ip-10-0-129-116 kubenswrapper[2546]: I0614 14:39:37.341251 2546 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-ptpcx" event={"ID":"30e02c92-21a3-43cd-a129-a21a3a3ccb37","Type":"ContainerStarted","Data":"a7a9431054cbe1e61ddbdc5c46dc4ed0abf1fe94bcb48207350de5f9d7548bc2"} Jun 14 14:39:37.342920 ip-10-0-129-116 kubenswrapper[2546]: I0614 14:39:37.342892 2546 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-mrqb6" event={"ID":"32b27404-1251-4372-a3b9-de131b817153","Type":"ContainerStarted","Data":"d04fc5b0d844d0cf435df835c0b01a7f6982d226b155169c60990bdc9454f511"} Jun 14 14:39:37.344413 ip-10-0-129-116 kubenswrapper[2546]: I0614 14:39:37.344380 2546 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-84jgl" event={"ID":"e8d897b0-a5b7-4f7e-a664-7c7a45a1c5de","Type":"ContainerStarted","Data":"f5213f01884844522fe3acb3d86b4305c3da1859c715082098790dd2384fd1ad"} Jun 14 14:39:37.345862 ip-10-0-129-116 kubenswrapper[2546]: I0614 14:39:37.345836 2546 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-dshlf" event={"ID":"4df84aa4-08f2-487d-a8fb-fa2fe8144da8","Type":"ContainerStarted","Data":"18fc55e5e2ae791b44b827e2ef1eedf24c362600c20460945870b728eb5a9573"} Jun 14 14:39:37.347489 ip-10-0-129-116 kubenswrapper[2546]: I0614 14:39:37.347465 2546 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-c96gx" event={"ID":"105377da-c223-41ad-b033-546cb01239c4","Type":"ContainerStarted","Data":"fb780abb132715c8ba1460854e35c7da13efe5eac330a7713f634c17d3eba030"} Jun 14 14:39:37.348958 ip-10-0-129-116 kubenswrapper[2546]: I0614 14:39:37.348830 2546 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-r4gvc" event={"ID":"8da319a4-be6d-4245-aed1-aa1fdaf8ca66","Type":"ContainerStarted","Data":"3202d63f7617e176b6f0dbb1eba67d4fdf7206edabee290e8f4974ef80f87ee7"} Jun 14 14:39:37.355243 ip-10-0-129-116 kubenswrapper[2546]: I0614 14:39:37.355194 2546 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/node-resolver-ptpcx" podStartSLOduration=4.309242122 podStartE2EDuration="14.355179514s" totalImagesPullingTime="10.045937392s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-14 14:39:23 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-14 14:39:37.354999971 +0000 UTC m=+14.683382125" watchObservedRunningTime="2026-06-14 14:39:37.355179514 +0000 UTC m=+14.683561642" Jun 14 14:39:37.369514 ip-10-0-129-116 kubenswrapper[2546]: I0614 14:39:37.369453 2546 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/node-ca-dshlf" podStartSLOduration=4.317496109 podStartE2EDuration="14.369436472s" totalImagesPullingTime="10.051940363s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-14 14:39:23 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-14 14:39:37.368517726 +0000 UTC m=+14.696899863" watchObservedRunningTime="2026-06-14 14:39:37.369436472 +0000 UTC m=+14.697818600" Jun 14 14:39:37.382659 ip-10-0-129-116 kubenswrapper[2546]: I0614 14:39:37.382473 2546 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/konnectivity-agent-c96gx" podStartSLOduration=4.330169471 podStartE2EDuration="14.382455464s" totalImagesPullingTime="10.052285993s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-14 14:39:23 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-14 14:39:37.381634481 +0000 UTC m=+14.710016619" watchObservedRunningTime="2026-06-14 14:39:37.382455464 +0000 UTC m=+14.710837612" Jun 14 14:39:37.421401 ip-10-0-129-116 kubenswrapper[2546]: I0614 14:39:37.421345 2546 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-node-tuning-operator/tuned-84jgl" podStartSLOduration=4.315043125 podStartE2EDuration="14.421324358s" totalImagesPullingTime="10.106281233s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-14 14:39:23 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-14 14:39:37.420984435 +0000 UTC m=+14.749366561" watchObservedRunningTime="2026-06-14 14:39:37.421324358 +0000 UTC m=+14.749706482" Jun 14 14:39:38.352682 ip-10-0-129-116 kubenswrapper[2546]: I0614 14:39:38.352594 2546 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-qfjpp" event={"ID":"d6890b61-860c-4e6c-8138-26bc128905c5","Type":"ContainerStarted","Data":"15eda8ed2b48c0137bfaf9bf87ab1c51548ec4c89e0da69173b32331256b19c9"} Jun 14 14:39:38.367586 ip-10-0-129-116 kubenswrapper[2546]: I0614 14:39:38.367539 2546 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-operator/iptables-alerter-qfjpp" podStartSLOduration=5.293036293 podStartE2EDuration="15.367519132s" totalImagesPullingTime="10.074482839s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-14 14:39:23 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-14 14:39:38.366927138 +0000 UTC m=+15.695309289" watchObservedRunningTime="2026-06-14 14:39:38.367519132 +0000 UTC m=+15.695901257" Jun 14 14:39:39.187716 ip-10-0-129-116 kubenswrapper[2546]: I0614 14:39:39.187685 2546 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-dlk5b" Jun 14 14:39:39.187716 ip-10-0-129-116 kubenswrapper[2546]: I0614 14:39:39.187714 2546 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-m6zq8" Jun 14 14:39:39.187955 ip-10-0-129-116 kubenswrapper[2546]: I0614 14:39:39.187686 2546 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-lt4g2" Jun 14 14:39:39.187955 ip-10-0-129-116 kubenswrapper[2546]: E0614 14:39:39.187792 2546 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-dlk5b" podUID="6446f965-15fc-40d5-85e7-20cec0d42549" Jun 14 14:39:39.188056 ip-10-0-129-116 kubenswrapper[2546]: E0614 14:39:39.187959 2546 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-m6zq8" podUID="726e808e-de0a-4f4f-809c-8f7e7cc45432" Jun 14 14:39:39.188125 ip-10-0-129-116 kubenswrapper[2546]: E0614 14:39:39.188050 2546 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-lt4g2" podUID="aa4feed6-27ad-493a-baa3-8d0d96cb5309" Jun 14 14:39:40.855317 ip-10-0-129-116 kubenswrapper[2546]: I0614 14:39:40.855283 2546 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/aa4feed6-27ad-493a-baa3-8d0d96cb5309-metrics-certs\") pod \"network-metrics-daemon-lt4g2\" (UID: \"aa4feed6-27ad-493a-baa3-8d0d96cb5309\") " pod="openshift-multus/network-metrics-daemon-lt4g2" Jun 14 14:39:40.856033 ip-10-0-129-116 kubenswrapper[2546]: I0614 14:39:40.855387 2546 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/6446f965-15fc-40d5-85e7-20cec0d42549-original-pull-secret\") pod \"global-pull-secret-syncer-dlk5b\" (UID: \"6446f965-15fc-40d5-85e7-20cec0d42549\") " pod="kube-system/global-pull-secret-syncer-dlk5b" Jun 14 14:39:40.856033 ip-10-0-129-116 kubenswrapper[2546]: E0614 14:39:40.855459 2546 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jun 14 14:39:40.856033 ip-10-0-129-116 kubenswrapper[2546]: E0614 14:39:40.855506 2546 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jun 14 14:39:40.856033 ip-10-0-129-116 kubenswrapper[2546]: E0614 14:39:40.855534 2546 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/aa4feed6-27ad-493a-baa3-8d0d96cb5309-metrics-certs podName:aa4feed6-27ad-493a-baa3-8d0d96cb5309 nodeName:}" failed. No retries permitted until 2026-06-14 14:39:56.855513098 +0000 UTC m=+34.183895207 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/aa4feed6-27ad-493a-baa3-8d0d96cb5309-metrics-certs") pod "network-metrics-daemon-lt4g2" (UID: "aa4feed6-27ad-493a-baa3-8d0d96cb5309") : object "openshift-multus"/"metrics-daemon-secret" not registered Jun 14 14:39:40.856033 ip-10-0-129-116 kubenswrapper[2546]: E0614 14:39:40.855561 2546 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/6446f965-15fc-40d5-85e7-20cec0d42549-original-pull-secret podName:6446f965-15fc-40d5-85e7-20cec0d42549 nodeName:}" failed. No retries permitted until 2026-06-14 14:39:56.855542511 +0000 UTC m=+34.183924642 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/6446f965-15fc-40d5-85e7-20cec0d42549-original-pull-secret") pod "global-pull-secret-syncer-dlk5b" (UID: "6446f965-15fc-40d5-85e7-20cec0d42549") : object "kube-system"/"original-pull-secret" not registered Jun 14 14:39:40.956052 ip-10-0-129-116 kubenswrapper[2546]: I0614 14:39:40.956013 2546 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-t9bks\" (UniqueName: \"kubernetes.io/projected/726e808e-de0a-4f4f-809c-8f7e7cc45432-kube-api-access-t9bks\") pod \"network-check-target-m6zq8\" (UID: \"726e808e-de0a-4f4f-809c-8f7e7cc45432\") " pod="openshift-network-diagnostics/network-check-target-m6zq8" Jun 14 14:39:40.956255 ip-10-0-129-116 kubenswrapper[2546]: E0614 14:39:40.956217 2546 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jun 14 14:39:40.956255 ip-10-0-129-116 kubenswrapper[2546]: E0614 14:39:40.956239 2546 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jun 14 14:39:40.956255 ip-10-0-129-116 kubenswrapper[2546]: E0614 14:39:40.956253 2546 projected.go:196] Error preparing data for projected volume kube-api-access-t9bks for pod openshift-network-diagnostics/network-check-target-m6zq8: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 14 14:39:40.956363 ip-10-0-129-116 kubenswrapper[2546]: E0614 14:39:40.956309 2546 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/726e808e-de0a-4f4f-809c-8f7e7cc45432-kube-api-access-t9bks podName:726e808e-de0a-4f4f-809c-8f7e7cc45432 nodeName:}" failed. No retries permitted until 2026-06-14 14:39:56.956296042 +0000 UTC m=+34.284678144 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "kube-api-access-t9bks" (UniqueName: "kubernetes.io/projected/726e808e-de0a-4f4f-809c-8f7e7cc45432-kube-api-access-t9bks") pod "network-check-target-m6zq8" (UID: "726e808e-de0a-4f4f-809c-8f7e7cc45432") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 14 14:39:41.184695 ip-10-0-129-116 kubenswrapper[2546]: I0614 14:39:41.184661 2546 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-m6zq8" Jun 14 14:39:41.184863 ip-10-0-129-116 kubenswrapper[2546]: E0614 14:39:41.184796 2546 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-m6zq8" podUID="726e808e-de0a-4f4f-809c-8f7e7cc45432" Jun 14 14:39:41.185038 ip-10-0-129-116 kubenswrapper[2546]: I0614 14:39:41.185018 2546 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-dlk5b" Jun 14 14:39:41.185187 ip-10-0-129-116 kubenswrapper[2546]: E0614 14:39:41.185151 2546 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-dlk5b" podUID="6446f965-15fc-40d5-85e7-20cec0d42549" Jun 14 14:39:41.185312 ip-10-0-129-116 kubenswrapper[2546]: I0614 14:39:41.185217 2546 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-lt4g2" Jun 14 14:39:41.185375 ip-10-0-129-116 kubenswrapper[2546]: E0614 14:39:41.185324 2546 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-lt4g2" podUID="aa4feed6-27ad-493a-baa3-8d0d96cb5309" Jun 14 14:39:41.360706 ip-10-0-129-116 kubenswrapper[2546]: I0614 14:39:41.360678 2546 generic.go:356] "Generic (PLEG): container finished" podID="8da319a4-be6d-4245-aed1-aa1fdaf8ca66" containerID="3202d63f7617e176b6f0dbb1eba67d4fdf7206edabee290e8f4974ef80f87ee7" exitCode=0 Jun 14 14:39:41.360863 ip-10-0-129-116 kubenswrapper[2546]: I0614 14:39:41.360715 2546 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-r4gvc" event={"ID":"8da319a4-be6d-4245-aed1-aa1fdaf8ca66","Type":"ContainerDied","Data":"3202d63f7617e176b6f0dbb1eba67d4fdf7206edabee290e8f4974ef80f87ee7"} Jun 14 14:39:41.721043 ip-10-0-129-116 kubenswrapper[2546]: I0614 14:39:41.721007 2546 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="kube-system/konnectivity-agent-c96gx" Jun 14 14:39:41.721959 ip-10-0-129-116 kubenswrapper[2546]: I0614 14:39:41.721931 2546 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="kube-system/konnectivity-agent-c96gx" Jun 14 14:39:43.185275 ip-10-0-129-116 kubenswrapper[2546]: I0614 14:39:43.185239 2546 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-dlk5b" Jun 14 14:39:43.185944 ip-10-0-129-116 kubenswrapper[2546]: E0614 14:39:43.185336 2546 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-dlk5b" podUID="6446f965-15fc-40d5-85e7-20cec0d42549" Jun 14 14:39:43.185944 ip-10-0-129-116 kubenswrapper[2546]: I0614 14:39:43.185386 2546 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-lt4g2" Jun 14 14:39:43.185944 ip-10-0-129-116 kubenswrapper[2546]: E0614 14:39:43.185543 2546 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-lt4g2" podUID="aa4feed6-27ad-493a-baa3-8d0d96cb5309" Jun 14 14:39:43.185944 ip-10-0-129-116 kubenswrapper[2546]: I0614 14:39:43.185577 2546 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-m6zq8" Jun 14 14:39:43.185944 ip-10-0-129-116 kubenswrapper[2546]: E0614 14:39:43.185637 2546 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-m6zq8" podUID="726e808e-de0a-4f4f-809c-8f7e7cc45432" Jun 14 14:39:45.186540 ip-10-0-129-116 kubenswrapper[2546]: I0614 14:39:45.186515 2546 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-lt4g2" Jun 14 14:39:45.186867 ip-10-0-129-116 kubenswrapper[2546]: I0614 14:39:45.186617 2546 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-m6zq8" Jun 14 14:39:45.186867 ip-10-0-129-116 kubenswrapper[2546]: E0614 14:39:45.186631 2546 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-lt4g2" podUID="aa4feed6-27ad-493a-baa3-8d0d96cb5309" Jun 14 14:39:45.186867 ip-10-0-129-116 kubenswrapper[2546]: E0614 14:39:45.186688 2546 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-m6zq8" podUID="726e808e-de0a-4f4f-809c-8f7e7cc45432" Jun 14 14:39:45.186867 ip-10-0-129-116 kubenswrapper[2546]: I0614 14:39:45.186705 2546 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-dlk5b" Jun 14 14:39:45.186867 ip-10-0-129-116 kubenswrapper[2546]: E0614 14:39:45.186788 2546 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-dlk5b" podUID="6446f965-15fc-40d5-85e7-20cec0d42549" Jun 14 14:39:45.371561 ip-10-0-129-116 kubenswrapper[2546]: I0614 14:39:45.371315 2546 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-zgckr" event={"ID":"c154f741-4d88-4933-b24b-9fa582917964","Type":"ContainerStarted","Data":"32cb1e059b660d7a8ad1b992ca6e6d64f0e0d2c5f2e7fc705f18b75d5f039420"} Jun 14 14:39:45.372936 ip-10-0-129-116 kubenswrapper[2546]: I0614 14:39:45.372911 2546 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-cghhz" event={"ID":"3cb1d703-5bee-4d7e-8879-ba67f7129fed","Type":"ContainerStarted","Data":"9727906907bb2d7d73c8886ae8d6f9a402810a2ae848cab90e2ffbc4a5ba9773"} Jun 14 14:39:45.394968 ip-10-0-129-116 kubenswrapper[2546]: I0614 14:39:45.394889 2546 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-cghhz" podStartSLOduration=3.437547576 podStartE2EDuration="22.394868385s" totalImagesPullingTime="18.957320809s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-14 14:39:23 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-14 14:39:45.391889872 +0000 UTC m=+22.720271980" watchObservedRunningTime="2026-06-14 14:39:45.394868385 +0000 UTC m=+22.723250511" Jun 14 14:39:45.410509 ip-10-0-129-116 kubenswrapper[2546]: I0614 14:39:45.410483 2546 plugin_watcher.go:194] "Adding socket path or updating timestamp to desired state cache" path="/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock" Jun 14 14:39:45.730167 ip-10-0-129-116 kubenswrapper[2546]: I0614 14:39:45.729961 2546 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kube-system/konnectivity-agent-c96gx" Jun 14 14:39:45.730365 ip-10-0-129-116 kubenswrapper[2546]: I0614 14:39:45.730341 2546 prober_manager.go:312] "Failed to trigger a manual run" probe="Readiness" Jun 14 14:39:45.730704 ip-10-0-129-116 kubenswrapper[2546]: I0614 14:39:45.730652 2546 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kube-system/konnectivity-agent-c96gx" Jun 14 14:39:46.185496 ip-10-0-129-116 kubenswrapper[2546]: I0614 14:39:46.185382 2546 reconciler.go:161] "OperationExecutor.RegisterPlugin started" plugin={"SocketPath":"/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock","Timestamp":"2026-06-14T14:39:45.410665656Z","UUID":"9f214cc3-7dee-438a-83e8-39d0574bf9cf","Handler":null,"Name":"","Endpoint":""} Jun 14 14:39:46.187178 ip-10-0-129-116 kubenswrapper[2546]: I0614 14:39:46.187151 2546 csi_plugin.go:106] kubernetes.io/csi: Trying to validate a new CSI Driver with name: ebs.csi.aws.com endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock versions: 1.0.0 Jun 14 14:39:46.187664 ip-10-0-129-116 kubenswrapper[2546]: I0614 14:39:46.187191 2546 csi_plugin.go:119] kubernetes.io/csi: Register new plugin with name: ebs.csi.aws.com at endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock Jun 14 14:39:46.378174 ip-10-0-129-116 kubenswrapper[2546]: I0614 14:39:46.378144 2546 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-zgckr" event={"ID":"c154f741-4d88-4933-b24b-9fa582917964","Type":"ContainerStarted","Data":"1149622f03705c757d8cb23f4dfbe12124d70970f852c3622d5c53fb0d077386"} Jun 14 14:39:46.378346 ip-10-0-129-116 kubenswrapper[2546]: I0614 14:39:46.378231 2546 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-zgckr" event={"ID":"c154f741-4d88-4933-b24b-9fa582917964","Type":"ContainerStarted","Data":"d369b2c302cdf538686ad2ecf7d4fedad16c49cc7965a6882f89522e9d663473"} Jun 14 14:39:46.378346 ip-10-0-129-116 kubenswrapper[2546]: I0614 14:39:46.378264 2546 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-zgckr" event={"ID":"c154f741-4d88-4933-b24b-9fa582917964","Type":"ContainerStarted","Data":"05c8e4c010f4d92b8fbb47e1b4a2e6cf49346695d00d127a93cdb3e5133220dc"} Jun 14 14:39:46.378346 ip-10-0-129-116 kubenswrapper[2546]: I0614 14:39:46.378302 2546 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-zgckr" event={"ID":"c154f741-4d88-4933-b24b-9fa582917964","Type":"ContainerStarted","Data":"0b20ffacd0155bd37688d0debdbee23979cca0466ab0ad3ed625bdb13ea3e463"} Jun 14 14:39:46.378346 ip-10-0-129-116 kubenswrapper[2546]: I0614 14:39:46.378330 2546 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-zgckr" event={"ID":"c154f741-4d88-4933-b24b-9fa582917964","Type":"ContainerStarted","Data":"5cedf09ece38252a64bbd8896321cb5923d906486d597ad64a5ae6b0d22d80f9"} Jun 14 14:39:46.380060 ip-10-0-129-116 kubenswrapper[2546]: I0614 14:39:46.380034 2546 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-mrqb6" event={"ID":"32b27404-1251-4372-a3b9-de131b817153","Type":"ContainerStarted","Data":"382c80ec6f66a3ad01762251204079113b66aba184aa42ca63ca1e4f62267709"} Jun 14 14:39:46.380198 ip-10-0-129-116 kubenswrapper[2546]: I0614 14:39:46.380081 2546 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-mrqb6" event={"ID":"32b27404-1251-4372-a3b9-de131b817153","Type":"ContainerStarted","Data":"d8d868cdc20fa354efc1c6794cc94785f059b3e498d02c851a3c6f15e868ac10"} Jun 14 14:39:46.396161 ip-10-0-129-116 kubenswrapper[2546]: I0614 14:39:46.396119 2546 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-mrqb6" podStartSLOduration=3.859834675 podStartE2EDuration="23.396082334s" totalImagesPullingTime="19.536247659s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-14 14:39:23 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-14 14:39:46.396031463 +0000 UTC m=+23.724413589" watchObservedRunningTime="2026-06-14 14:39:46.396082334 +0000 UTC m=+23.724464469" Jun 14 14:39:47.184241 ip-10-0-129-116 kubenswrapper[2546]: I0614 14:39:47.184205 2546 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-m6zq8" Jun 14 14:39:47.184440 ip-10-0-129-116 kubenswrapper[2546]: I0614 14:39:47.184205 2546 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-lt4g2" Jun 14 14:39:47.184440 ip-10-0-129-116 kubenswrapper[2546]: E0614 14:39:47.184340 2546 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-m6zq8" podUID="726e808e-de0a-4f4f-809c-8f7e7cc45432" Jun 14 14:39:47.184576 ip-10-0-129-116 kubenswrapper[2546]: E0614 14:39:47.184433 2546 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-lt4g2" podUID="aa4feed6-27ad-493a-baa3-8d0d96cb5309" Jun 14 14:39:47.184576 ip-10-0-129-116 kubenswrapper[2546]: I0614 14:39:47.184205 2546 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-dlk5b" Jun 14 14:39:47.184576 ip-10-0-129-116 kubenswrapper[2546]: E0614 14:39:47.184526 2546 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-dlk5b" podUID="6446f965-15fc-40d5-85e7-20cec0d42549" Jun 14 14:39:48.387986 ip-10-0-129-116 kubenswrapper[2546]: I0614 14:39:48.387944 2546 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-zgckr" event={"ID":"c154f741-4d88-4933-b24b-9fa582917964","Type":"ContainerStarted","Data":"01dfbc5c2fd51180437f22014bd75de9d3c9886c7bd214af82b8e30ed3b203cc"} Jun 14 14:39:49.184790 ip-10-0-129-116 kubenswrapper[2546]: I0614 14:39:49.184757 2546 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-dlk5b" Jun 14 14:39:49.184969 ip-10-0-129-116 kubenswrapper[2546]: I0614 14:39:49.184757 2546 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-m6zq8" Jun 14 14:39:49.184969 ip-10-0-129-116 kubenswrapper[2546]: E0614 14:39:49.184871 2546 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-dlk5b" podUID="6446f965-15fc-40d5-85e7-20cec0d42549" Jun 14 14:39:49.184969 ip-10-0-129-116 kubenswrapper[2546]: I0614 14:39:49.184757 2546 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-lt4g2" Jun 14 14:39:49.184969 ip-10-0-129-116 kubenswrapper[2546]: E0614 14:39:49.184960 2546 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-m6zq8" podUID="726e808e-de0a-4f4f-809c-8f7e7cc45432" Jun 14 14:39:49.185194 ip-10-0-129-116 kubenswrapper[2546]: E0614 14:39:49.185077 2546 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-lt4g2" podUID="aa4feed6-27ad-493a-baa3-8d0d96cb5309" Jun 14 14:39:50.395550 ip-10-0-129-116 kubenswrapper[2546]: I0614 14:39:50.395518 2546 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-zgckr" event={"ID":"c154f741-4d88-4933-b24b-9fa582917964","Type":"ContainerStarted","Data":"d52980fede6fbd379174240ad7e3c3e6d486ab0cac6dce67b71b8efcbe225693"} Jun 14 14:39:50.396325 ip-10-0-129-116 kubenswrapper[2546]: I0614 14:39:50.395782 2546 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-zgckr" Jun 14 14:39:50.397515 ip-10-0-129-116 kubenswrapper[2546]: I0614 14:39:50.397375 2546 generic.go:356] "Generic (PLEG): container finished" podID="8da319a4-be6d-4245-aed1-aa1fdaf8ca66" containerID="9661871563f35c2dd91ef599b3661ae7da436ca0aa0109b5e7bdd7668329991e" exitCode=0 Jun 14 14:39:50.397626 ip-10-0-129-116 kubenswrapper[2546]: I0614 14:39:50.397447 2546 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-r4gvc" event={"ID":"8da319a4-be6d-4245-aed1-aa1fdaf8ca66","Type":"ContainerDied","Data":"9661871563f35c2dd91ef599b3661ae7da436ca0aa0109b5e7bdd7668329991e"} Jun 14 14:39:50.411197 ip-10-0-129-116 kubenswrapper[2546]: I0614 14:39:50.411179 2546 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-zgckr" Jun 14 14:39:50.422208 ip-10-0-129-116 kubenswrapper[2546]: I0614 14:39:50.422168 2546 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ovn-kubernetes/ovnkube-node-zgckr" podStartSLOduration=8.467191937 podStartE2EDuration="27.422156099s" totalImagesPullingTime="18.954964162s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-14 14:39:23 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-14 14:39:50.421738603 +0000 UTC m=+27.750120728" watchObservedRunningTime="2026-06-14 14:39:50.422156099 +0000 UTC m=+27.750538224" Jun 14 14:39:51.184158 ip-10-0-129-116 kubenswrapper[2546]: I0614 14:39:51.184126 2546 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-dlk5b" Jun 14 14:39:51.184344 ip-10-0-129-116 kubenswrapper[2546]: I0614 14:39:51.184127 2546 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-m6zq8" Jun 14 14:39:51.184344 ip-10-0-129-116 kubenswrapper[2546]: E0614 14:39:51.184263 2546 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-dlk5b" podUID="6446f965-15fc-40d5-85e7-20cec0d42549" Jun 14 14:39:51.184344 ip-10-0-129-116 kubenswrapper[2546]: I0614 14:39:51.184127 2546 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-lt4g2" Jun 14 14:39:51.184493 ip-10-0-129-116 kubenswrapper[2546]: E0614 14:39:51.184348 2546 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-m6zq8" podUID="726e808e-de0a-4f4f-809c-8f7e7cc45432" Jun 14 14:39:51.184493 ip-10-0-129-116 kubenswrapper[2546]: E0614 14:39:51.184409 2546 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-lt4g2" podUID="aa4feed6-27ad-493a-baa3-8d0d96cb5309" Jun 14 14:39:51.400552 ip-10-0-129-116 kubenswrapper[2546]: I0614 14:39:51.400519 2546 prober_manager.go:312] "Failed to trigger a manual run" probe="Readiness" Jun 14 14:39:51.401141 ip-10-0-129-116 kubenswrapper[2546]: I0614 14:39:51.401115 2546 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-zgckr" Jun 14 14:39:51.420973 ip-10-0-129-116 kubenswrapper[2546]: I0614 14:39:51.420883 2546 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-zgckr" Jun 14 14:39:52.079954 ip-10-0-129-116 kubenswrapper[2546]: I0614 14:39:52.079916 2546 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-zgckr" Jun 14 14:39:52.326838 ip-10-0-129-116 kubenswrapper[2546]: I0614 14:39:52.326808 2546 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-dlk5b"] Jun 14 14:39:52.326987 ip-10-0-129-116 kubenswrapper[2546]: I0614 14:39:52.326902 2546 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-dlk5b" Jun 14 14:39:52.327042 ip-10-0-129-116 kubenswrapper[2546]: E0614 14:39:52.326990 2546 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-dlk5b" podUID="6446f965-15fc-40d5-85e7-20cec0d42549" Jun 14 14:39:52.330198 ip-10-0-129-116 kubenswrapper[2546]: I0614 14:39:52.330128 2546 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-m6zq8"] Jun 14 14:39:52.330331 ip-10-0-129-116 kubenswrapper[2546]: I0614 14:39:52.330235 2546 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-m6zq8" Jun 14 14:39:52.330331 ip-10-0-129-116 kubenswrapper[2546]: E0614 14:39:52.330320 2546 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-m6zq8" podUID="726e808e-de0a-4f4f-809c-8f7e7cc45432" Jun 14 14:39:52.330685 ip-10-0-129-116 kubenswrapper[2546]: I0614 14:39:52.330666 2546 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-lt4g2"] Jun 14 14:39:52.330771 ip-10-0-129-116 kubenswrapper[2546]: I0614 14:39:52.330758 2546 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-lt4g2" Jun 14 14:39:52.330886 ip-10-0-129-116 kubenswrapper[2546]: E0614 14:39:52.330853 2546 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-lt4g2" podUID="aa4feed6-27ad-493a-baa3-8d0d96cb5309" Jun 14 14:39:52.404587 ip-10-0-129-116 kubenswrapper[2546]: I0614 14:39:52.404550 2546 generic.go:356] "Generic (PLEG): container finished" podID="8da319a4-be6d-4245-aed1-aa1fdaf8ca66" containerID="66c5f9710f275e087242d9bb98f5607d5bc7fc6cb1544a9d603d35041aa1be25" exitCode=0 Jun 14 14:39:52.404964 ip-10-0-129-116 kubenswrapper[2546]: I0614 14:39:52.404623 2546 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-r4gvc" event={"ID":"8da319a4-be6d-4245-aed1-aa1fdaf8ca66","Type":"ContainerDied","Data":"66c5f9710f275e087242d9bb98f5607d5bc7fc6cb1544a9d603d35041aa1be25"} Jun 14 14:39:54.184022 ip-10-0-129-116 kubenswrapper[2546]: I0614 14:39:54.183987 2546 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-dlk5b" Jun 14 14:39:54.184022 ip-10-0-129-116 kubenswrapper[2546]: I0614 14:39:54.184006 2546 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-lt4g2" Jun 14 14:39:54.184461 ip-10-0-129-116 kubenswrapper[2546]: I0614 14:39:54.184009 2546 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-m6zq8" Jun 14 14:39:54.184461 ip-10-0-129-116 kubenswrapper[2546]: E0614 14:39:54.184110 2546 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-dlk5b" podUID="6446f965-15fc-40d5-85e7-20cec0d42549" Jun 14 14:39:54.184461 ip-10-0-129-116 kubenswrapper[2546]: E0614 14:39:54.184208 2546 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-lt4g2" podUID="aa4feed6-27ad-493a-baa3-8d0d96cb5309" Jun 14 14:39:54.184461 ip-10-0-129-116 kubenswrapper[2546]: E0614 14:39:54.184303 2546 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-m6zq8" podUID="726e808e-de0a-4f4f-809c-8f7e7cc45432" Jun 14 14:39:54.412282 ip-10-0-129-116 kubenswrapper[2546]: I0614 14:39:54.412200 2546 generic.go:356] "Generic (PLEG): container finished" podID="8da319a4-be6d-4245-aed1-aa1fdaf8ca66" containerID="3f3e2836307053848cc351f748ca2a145d454678385674363fd2554c7f666ee5" exitCode=0 Jun 14 14:39:54.412282 ip-10-0-129-116 kubenswrapper[2546]: I0614 14:39:54.412238 2546 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-r4gvc" event={"ID":"8da319a4-be6d-4245-aed1-aa1fdaf8ca66","Type":"ContainerDied","Data":"3f3e2836307053848cc351f748ca2a145d454678385674363fd2554c7f666ee5"} Jun 14 14:39:56.184727 ip-10-0-129-116 kubenswrapper[2546]: I0614 14:39:56.184696 2546 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-dlk5b" Jun 14 14:39:56.184727 ip-10-0-129-116 kubenswrapper[2546]: I0614 14:39:56.184721 2546 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-m6zq8" Jun 14 14:39:56.185180 ip-10-0-129-116 kubenswrapper[2546]: I0614 14:39:56.184705 2546 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-lt4g2" Jun 14 14:39:56.185180 ip-10-0-129-116 kubenswrapper[2546]: E0614 14:39:56.184795 2546 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-dlk5b" podUID="6446f965-15fc-40d5-85e7-20cec0d42549" Jun 14 14:39:56.185180 ip-10-0-129-116 kubenswrapper[2546]: E0614 14:39:56.184870 2546 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-lt4g2" podUID="aa4feed6-27ad-493a-baa3-8d0d96cb5309" Jun 14 14:39:56.185180 ip-10-0-129-116 kubenswrapper[2546]: E0614 14:39:56.184941 2546 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-m6zq8" podUID="726e808e-de0a-4f4f-809c-8f7e7cc45432" Jun 14 14:39:56.890679 ip-10-0-129-116 kubenswrapper[2546]: I0614 14:39:56.890647 2546 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/6446f965-15fc-40d5-85e7-20cec0d42549-original-pull-secret\") pod \"global-pull-secret-syncer-dlk5b\" (UID: \"6446f965-15fc-40d5-85e7-20cec0d42549\") " pod="kube-system/global-pull-secret-syncer-dlk5b" Jun 14 14:39:56.890679 ip-10-0-129-116 kubenswrapper[2546]: I0614 14:39:56.890689 2546 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/aa4feed6-27ad-493a-baa3-8d0d96cb5309-metrics-certs\") pod \"network-metrics-daemon-lt4g2\" (UID: \"aa4feed6-27ad-493a-baa3-8d0d96cb5309\") " pod="openshift-multus/network-metrics-daemon-lt4g2" Jun 14 14:39:56.890907 ip-10-0-129-116 kubenswrapper[2546]: E0614 14:39:56.890784 2546 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jun 14 14:39:56.890907 ip-10-0-129-116 kubenswrapper[2546]: E0614 14:39:56.890790 2546 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jun 14 14:39:56.890907 ip-10-0-129-116 kubenswrapper[2546]: E0614 14:39:56.890848 2546 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/aa4feed6-27ad-493a-baa3-8d0d96cb5309-metrics-certs podName:aa4feed6-27ad-493a-baa3-8d0d96cb5309 nodeName:}" failed. No retries permitted until 2026-06-14 14:40:28.890829473 +0000 UTC m=+66.219211575 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/aa4feed6-27ad-493a-baa3-8d0d96cb5309-metrics-certs") pod "network-metrics-daemon-lt4g2" (UID: "aa4feed6-27ad-493a-baa3-8d0d96cb5309") : object "openshift-multus"/"metrics-daemon-secret" not registered Jun 14 14:39:56.890907 ip-10-0-129-116 kubenswrapper[2546]: E0614 14:39:56.890868 2546 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/6446f965-15fc-40d5-85e7-20cec0d42549-original-pull-secret podName:6446f965-15fc-40d5-85e7-20cec0d42549 nodeName:}" failed. No retries permitted until 2026-06-14 14:40:28.89085897 +0000 UTC m=+66.219241076 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/6446f965-15fc-40d5-85e7-20cec0d42549-original-pull-secret") pod "global-pull-secret-syncer-dlk5b" (UID: "6446f965-15fc-40d5-85e7-20cec0d42549") : object "kube-system"/"original-pull-secret" not registered Jun 14 14:39:56.991334 ip-10-0-129-116 kubenswrapper[2546]: I0614 14:39:56.991304 2546 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-t9bks\" (UniqueName: \"kubernetes.io/projected/726e808e-de0a-4f4f-809c-8f7e7cc45432-kube-api-access-t9bks\") pod \"network-check-target-m6zq8\" (UID: \"726e808e-de0a-4f4f-809c-8f7e7cc45432\") " pod="openshift-network-diagnostics/network-check-target-m6zq8" Jun 14 14:39:56.991499 ip-10-0-129-116 kubenswrapper[2546]: E0614 14:39:56.991453 2546 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jun 14 14:39:56.991499 ip-10-0-129-116 kubenswrapper[2546]: E0614 14:39:56.991477 2546 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jun 14 14:39:56.991499 ip-10-0-129-116 kubenswrapper[2546]: E0614 14:39:56.991486 2546 projected.go:196] Error preparing data for projected volume kube-api-access-t9bks for pod openshift-network-diagnostics/network-check-target-m6zq8: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 14 14:39:56.991607 ip-10-0-129-116 kubenswrapper[2546]: E0614 14:39:56.991531 2546 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/726e808e-de0a-4f4f-809c-8f7e7cc45432-kube-api-access-t9bks podName:726e808e-de0a-4f4f-809c-8f7e7cc45432 nodeName:}" failed. No retries permitted until 2026-06-14 14:40:28.991518125 +0000 UTC m=+66.319900228 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "kube-api-access-t9bks" (UniqueName: "kubernetes.io/projected/726e808e-de0a-4f4f-809c-8f7e7cc45432-kube-api-access-t9bks") pod "network-check-target-m6zq8" (UID: "726e808e-de0a-4f4f-809c-8f7e7cc45432") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 14 14:39:57.972571 ip-10-0-129-116 kubenswrapper[2546]: I0614 14:39:57.972489 2546 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-129-116.ec2.internal" event="NodeReady" Jun 14 14:39:57.972939 ip-10-0-129-116 kubenswrapper[2546]: I0614 14:39:57.972649 2546 kubelet_node_status.go:489] "Fast updating node status as it just became ready" Jun 14 14:39:58.003737 ip-10-0-129-116 kubenswrapper[2546]: I0614 14:39:58.003604 2546 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-image-registry/image-registry-6b9bcff985-7lnrc"] Jun 14 14:39:58.024829 ip-10-0-129-116 kubenswrapper[2546]: I0614 14:39:58.024801 2546 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-dns/dns-default-29vxk"] Jun 14 14:39:58.025002 ip-10-0-129-116 kubenswrapper[2546]: I0614 14:39:58.024915 2546 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-6b9bcff985-7lnrc" Jun 14 14:39:58.033263 ip-10-0-129-116 kubenswrapper[2546]: I0614 14:39:58.033236 2546 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-private-configuration\"" Jun 14 14:39:58.033405 ip-10-0-129-116 kubenswrapper[2546]: I0614 14:39:58.033274 2546 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"installation-pull-secrets\"" Jun 14 14:39:58.041459 ip-10-0-129-116 kubenswrapper[2546]: I0614 14:39:58.041434 2546 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"registry-dockercfg-ns8zb\"" Jun 14 14:39:58.041591 ip-10-0-129-116 kubenswrapper[2546]: I0614 14:39:58.041559 2546 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-tls\"" Jun 14 14:39:58.042958 ip-10-0-129-116 kubenswrapper[2546]: I0614 14:39:58.042930 2546 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-6b9bcff985-7lnrc"] Jun 14 14:39:58.043083 ip-10-0-129-116 kubenswrapper[2546]: I0614 14:39:58.042975 2546 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress-canary/ingress-canary-svjhc"] Jun 14 14:39:58.043083 ip-10-0-129-116 kubenswrapper[2546]: I0614 14:39:58.043052 2546 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-29vxk" Jun 14 14:39:58.044451 ip-10-0-129-116 kubenswrapper[2546]: I0614 14:39:58.044433 2546 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"trusted-ca\"" Jun 14 14:39:58.045272 ip-10-0-129-116 kubenswrapper[2546]: I0614 14:39:58.045251 2546 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-default-metrics-tls\"" Jun 14 14:39:58.045411 ip-10-0-129-116 kubenswrapper[2546]: I0614 14:39:58.045396 2546 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"dns-default\"" Jun 14 14:39:58.045488 ip-10-0-129-116 kubenswrapper[2546]: I0614 14:39:58.045453 2546 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-jwvk2\"" Jun 14 14:39:58.057085 ip-10-0-129-116 kubenswrapper[2546]: I0614 14:39:58.057064 2546 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-29vxk"] Jun 14 14:39:58.057324 ip-10-0-129-116 kubenswrapper[2546]: I0614 14:39:58.057122 2546 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-svjhc"] Jun 14 14:39:58.057324 ip-10-0-129-116 kubenswrapper[2546]: I0614 14:39:58.057195 2546 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-svjhc" Jun 14 14:39:58.059466 ip-10-0-129-116 kubenswrapper[2546]: I0614 14:39:58.059446 2546 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"openshift-service-ca.crt\"" Jun 14 14:39:58.059567 ip-10-0-129-116 kubenswrapper[2546]: I0614 14:39:58.059488 2546 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"canary-serving-cert\"" Jun 14 14:39:58.059718 ip-10-0-129-116 kubenswrapper[2546]: I0614 14:39:58.059703 2546 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"kube-root-ca.crt\"" Jun 14 14:39:58.059789 ip-10-0-129-116 kubenswrapper[2546]: I0614 14:39:58.059775 2546 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"default-dockercfg-4f8bs\"" Jun 14 14:39:58.184212 ip-10-0-129-116 kubenswrapper[2546]: I0614 14:39:58.184182 2546 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-m6zq8" Jun 14 14:39:58.184212 ip-10-0-129-116 kubenswrapper[2546]: I0614 14:39:58.184207 2546 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-dlk5b" Jun 14 14:39:58.184441 ip-10-0-129-116 kubenswrapper[2546]: I0614 14:39:58.184192 2546 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-lt4g2" Jun 14 14:39:58.187164 ip-10-0-129-116 kubenswrapper[2546]: I0614 14:39:58.187121 2546 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\"" Jun 14 14:39:58.187164 ip-10-0-129-116 kubenswrapper[2546]: I0614 14:39:58.187133 2546 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-k8smd\"" Jun 14 14:39:58.187164 ip-10-0-129-116 kubenswrapper[2546]: I0614 14:39:58.187125 2546 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\"" Jun 14 14:39:58.187405 ip-10-0-129-116 kubenswrapper[2546]: I0614 14:39:58.187175 2546 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\"" Jun 14 14:39:58.187405 ip-10-0-129-116 kubenswrapper[2546]: I0614 14:39:58.187136 2546 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\"" Jun 14 14:39:58.187405 ip-10-0-129-116 kubenswrapper[2546]: I0614 14:39:58.187136 2546 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-2pmmn\"" Jun 14 14:39:58.199445 ip-10-0-129-116 kubenswrapper[2546]: I0614 14:39:58.199426 2546 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/11cc366c-4c61-4205-873a-3dcfcd341bf8-metrics-tls\") pod \"dns-default-29vxk\" (UID: \"11cc366c-4c61-4205-873a-3dcfcd341bf8\") " pod="openshift-dns/dns-default-29vxk" Jun 14 14:39:58.199546 ip-10-0-129-116 kubenswrapper[2546]: I0614 14:39:58.199452 2546 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xwvr9\" (UniqueName: \"kubernetes.io/projected/5a64bb81-61bc-42a1-bd11-55786121b7d8-kube-api-access-xwvr9\") pod \"image-registry-6b9bcff985-7lnrc\" (UID: \"5a64bb81-61bc-42a1-bd11-55786121b7d8\") " pod="openshift-image-registry/image-registry-6b9bcff985-7lnrc" Jun 14 14:39:58.199546 ip-10-0-129-116 kubenswrapper[2546]: I0614 14:39:58.199471 2546 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/5a64bb81-61bc-42a1-bd11-55786121b7d8-bound-sa-token\") pod \"image-registry-6b9bcff985-7lnrc\" (UID: \"5a64bb81-61bc-42a1-bd11-55786121b7d8\") " pod="openshift-image-registry/image-registry-6b9bcff985-7lnrc" Jun 14 14:39:58.199546 ip-10-0-129-116 kubenswrapper[2546]: I0614 14:39:58.199489 2546 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/5a64bb81-61bc-42a1-bd11-55786121b7d8-registry-tls\") pod \"image-registry-6b9bcff985-7lnrc\" (UID: \"5a64bb81-61bc-42a1-bd11-55786121b7d8\") " pod="openshift-image-registry/image-registry-6b9bcff985-7lnrc" Jun 14 14:39:58.199546 ip-10-0-129-116 kubenswrapper[2546]: I0614 14:39:58.199503 2546 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/7ac15fa8-5937-48af-af72-d0fb83eecda2-cert\") pod \"ingress-canary-svjhc\" (UID: \"7ac15fa8-5937-48af-af72-d0fb83eecda2\") " pod="openshift-ingress-canary/ingress-canary-svjhc" Jun 14 14:39:58.199546 ip-10-0-129-116 kubenswrapper[2546]: I0614 14:39:58.199541 2546 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/5a64bb81-61bc-42a1-bd11-55786121b7d8-ca-trust-extracted\") pod \"image-registry-6b9bcff985-7lnrc\" (UID: \"5a64bb81-61bc-42a1-bd11-55786121b7d8\") " pod="openshift-image-registry/image-registry-6b9bcff985-7lnrc" Jun 14 14:39:58.199713 ip-10-0-129-116 kubenswrapper[2546]: I0614 14:39:58.199563 2546 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/5a64bb81-61bc-42a1-bd11-55786121b7d8-trusted-ca\") pod \"image-registry-6b9bcff985-7lnrc\" (UID: \"5a64bb81-61bc-42a1-bd11-55786121b7d8\") " pod="openshift-image-registry/image-registry-6b9bcff985-7lnrc" Jun 14 14:39:58.199713 ip-10-0-129-116 kubenswrapper[2546]: I0614 14:39:58.199594 2546 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/11cc366c-4c61-4205-873a-3dcfcd341bf8-config-volume\") pod \"dns-default-29vxk\" (UID: \"11cc366c-4c61-4205-873a-3dcfcd341bf8\") " pod="openshift-dns/dns-default-29vxk" Jun 14 14:39:58.199713 ip-10-0-129-116 kubenswrapper[2546]: I0614 14:39:58.199638 2546 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-dpfz2\" (UniqueName: \"kubernetes.io/projected/11cc366c-4c61-4205-873a-3dcfcd341bf8-kube-api-access-dpfz2\") pod \"dns-default-29vxk\" (UID: \"11cc366c-4c61-4205-873a-3dcfcd341bf8\") " pod="openshift-dns/dns-default-29vxk" Jun 14 14:39:58.199713 ip-10-0-129-116 kubenswrapper[2546]: I0614 14:39:58.199655 2546 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-x5q6m\" (UniqueName: \"kubernetes.io/projected/7ac15fa8-5937-48af-af72-d0fb83eecda2-kube-api-access-x5q6m\") pod \"ingress-canary-svjhc\" (UID: \"7ac15fa8-5937-48af-af72-d0fb83eecda2\") " pod="openshift-ingress-canary/ingress-canary-svjhc" Jun 14 14:39:58.199713 ip-10-0-129-116 kubenswrapper[2546]: I0614 14:39:58.199682 2546 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/11cc366c-4c61-4205-873a-3dcfcd341bf8-tmp-dir\") pod \"dns-default-29vxk\" (UID: \"11cc366c-4c61-4205-873a-3dcfcd341bf8\") " pod="openshift-dns/dns-default-29vxk" Jun 14 14:39:58.199713 ip-10-0-129-116 kubenswrapper[2546]: I0614 14:39:58.199708 2546 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/5a64bb81-61bc-42a1-bd11-55786121b7d8-image-registry-private-configuration\") pod \"image-registry-6b9bcff985-7lnrc\" (UID: \"5a64bb81-61bc-42a1-bd11-55786121b7d8\") " pod="openshift-image-registry/image-registry-6b9bcff985-7lnrc" Jun 14 14:39:58.199879 ip-10-0-129-116 kubenswrapper[2546]: I0614 14:39:58.199727 2546 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/5a64bb81-61bc-42a1-bd11-55786121b7d8-registry-certificates\") pod \"image-registry-6b9bcff985-7lnrc\" (UID: \"5a64bb81-61bc-42a1-bd11-55786121b7d8\") " pod="openshift-image-registry/image-registry-6b9bcff985-7lnrc" Jun 14 14:39:58.199879 ip-10-0-129-116 kubenswrapper[2546]: I0614 14:39:58.199744 2546 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/5a64bb81-61bc-42a1-bd11-55786121b7d8-installation-pull-secrets\") pod \"image-registry-6b9bcff985-7lnrc\" (UID: \"5a64bb81-61bc-42a1-bd11-55786121b7d8\") " pod="openshift-image-registry/image-registry-6b9bcff985-7lnrc" Jun 14 14:39:58.300208 ip-10-0-129-116 kubenswrapper[2546]: I0614 14:39:58.300051 2546 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/11cc366c-4c61-4205-873a-3dcfcd341bf8-config-volume\") pod \"dns-default-29vxk\" (UID: \"11cc366c-4c61-4205-873a-3dcfcd341bf8\") " pod="openshift-dns/dns-default-29vxk" Jun 14 14:39:58.300208 ip-10-0-129-116 kubenswrapper[2546]: I0614 14:39:58.300162 2546 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-dpfz2\" (UniqueName: \"kubernetes.io/projected/11cc366c-4c61-4205-873a-3dcfcd341bf8-kube-api-access-dpfz2\") pod \"dns-default-29vxk\" (UID: \"11cc366c-4c61-4205-873a-3dcfcd341bf8\") " pod="openshift-dns/dns-default-29vxk" Jun 14 14:39:58.300208 ip-10-0-129-116 kubenswrapper[2546]: I0614 14:39:58.300186 2546 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-x5q6m\" (UniqueName: \"kubernetes.io/projected/7ac15fa8-5937-48af-af72-d0fb83eecda2-kube-api-access-x5q6m\") pod \"ingress-canary-svjhc\" (UID: \"7ac15fa8-5937-48af-af72-d0fb83eecda2\") " pod="openshift-ingress-canary/ingress-canary-svjhc" Jun 14 14:39:58.300547 ip-10-0-129-116 kubenswrapper[2546]: I0614 14:39:58.300219 2546 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/11cc366c-4c61-4205-873a-3dcfcd341bf8-tmp-dir\") pod \"dns-default-29vxk\" (UID: \"11cc366c-4c61-4205-873a-3dcfcd341bf8\") " pod="openshift-dns/dns-default-29vxk" Jun 14 14:39:58.300547 ip-10-0-129-116 kubenswrapper[2546]: I0614 14:39:58.300259 2546 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/5a64bb81-61bc-42a1-bd11-55786121b7d8-image-registry-private-configuration\") pod \"image-registry-6b9bcff985-7lnrc\" (UID: \"5a64bb81-61bc-42a1-bd11-55786121b7d8\") " pod="openshift-image-registry/image-registry-6b9bcff985-7lnrc" Jun 14 14:39:58.300547 ip-10-0-129-116 kubenswrapper[2546]: I0614 14:39:58.300286 2546 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/5a64bb81-61bc-42a1-bd11-55786121b7d8-registry-certificates\") pod \"image-registry-6b9bcff985-7lnrc\" (UID: \"5a64bb81-61bc-42a1-bd11-55786121b7d8\") " pod="openshift-image-registry/image-registry-6b9bcff985-7lnrc" Jun 14 14:39:58.300547 ip-10-0-129-116 kubenswrapper[2546]: I0614 14:39:58.300313 2546 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/5a64bb81-61bc-42a1-bd11-55786121b7d8-installation-pull-secrets\") pod \"image-registry-6b9bcff985-7lnrc\" (UID: \"5a64bb81-61bc-42a1-bd11-55786121b7d8\") " pod="openshift-image-registry/image-registry-6b9bcff985-7lnrc" Jun 14 14:39:58.300547 ip-10-0-129-116 kubenswrapper[2546]: I0614 14:39:58.300346 2546 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/11cc366c-4c61-4205-873a-3dcfcd341bf8-metrics-tls\") pod \"dns-default-29vxk\" (UID: \"11cc366c-4c61-4205-873a-3dcfcd341bf8\") " pod="openshift-dns/dns-default-29vxk" Jun 14 14:39:58.300547 ip-10-0-129-116 kubenswrapper[2546]: I0614 14:39:58.300371 2546 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xwvr9\" (UniqueName: \"kubernetes.io/projected/5a64bb81-61bc-42a1-bd11-55786121b7d8-kube-api-access-xwvr9\") pod \"image-registry-6b9bcff985-7lnrc\" (UID: \"5a64bb81-61bc-42a1-bd11-55786121b7d8\") " pod="openshift-image-registry/image-registry-6b9bcff985-7lnrc" Jun 14 14:39:58.300547 ip-10-0-129-116 kubenswrapper[2546]: I0614 14:39:58.300404 2546 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/5a64bb81-61bc-42a1-bd11-55786121b7d8-bound-sa-token\") pod \"image-registry-6b9bcff985-7lnrc\" (UID: \"5a64bb81-61bc-42a1-bd11-55786121b7d8\") " pod="openshift-image-registry/image-registry-6b9bcff985-7lnrc" Jun 14 14:39:58.300547 ip-10-0-129-116 kubenswrapper[2546]: I0614 14:39:58.300426 2546 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/5a64bb81-61bc-42a1-bd11-55786121b7d8-registry-tls\") pod \"image-registry-6b9bcff985-7lnrc\" (UID: \"5a64bb81-61bc-42a1-bd11-55786121b7d8\") " pod="openshift-image-registry/image-registry-6b9bcff985-7lnrc" Jun 14 14:39:58.300547 ip-10-0-129-116 kubenswrapper[2546]: I0614 14:39:58.300446 2546 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/7ac15fa8-5937-48af-af72-d0fb83eecda2-cert\") pod \"ingress-canary-svjhc\" (UID: \"7ac15fa8-5937-48af-af72-d0fb83eecda2\") " pod="openshift-ingress-canary/ingress-canary-svjhc" Jun 14 14:39:58.300547 ip-10-0-129-116 kubenswrapper[2546]: I0614 14:39:58.300478 2546 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/5a64bb81-61bc-42a1-bd11-55786121b7d8-ca-trust-extracted\") pod \"image-registry-6b9bcff985-7lnrc\" (UID: \"5a64bb81-61bc-42a1-bd11-55786121b7d8\") " pod="openshift-image-registry/image-registry-6b9bcff985-7lnrc" Jun 14 14:39:58.300547 ip-10-0-129-116 kubenswrapper[2546]: I0614 14:39:58.300501 2546 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/5a64bb81-61bc-42a1-bd11-55786121b7d8-trusted-ca\") pod \"image-registry-6b9bcff985-7lnrc\" (UID: \"5a64bb81-61bc-42a1-bd11-55786121b7d8\") " pod="openshift-image-registry/image-registry-6b9bcff985-7lnrc" Jun 14 14:39:58.301071 ip-10-0-129-116 kubenswrapper[2546]: I0614 14:39:58.300712 2546 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/11cc366c-4c61-4205-873a-3dcfcd341bf8-config-volume\") pod \"dns-default-29vxk\" (UID: \"11cc366c-4c61-4205-873a-3dcfcd341bf8\") " pod="openshift-dns/dns-default-29vxk" Jun 14 14:39:58.301071 ip-10-0-129-116 kubenswrapper[2546]: I0614 14:39:58.300914 2546 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/11cc366c-4c61-4205-873a-3dcfcd341bf8-tmp-dir\") pod \"dns-default-29vxk\" (UID: \"11cc366c-4c61-4205-873a-3dcfcd341bf8\") " pod="openshift-dns/dns-default-29vxk" Jun 14 14:39:58.301071 ip-10-0-129-116 kubenswrapper[2546]: E0614 14:39:58.301010 2546 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jun 14 14:39:58.301071 ip-10-0-129-116 kubenswrapper[2546]: E0614 14:39:58.301027 2546 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-6b9bcff985-7lnrc: secret "image-registry-tls" not found Jun 14 14:39:58.301310 ip-10-0-129-116 kubenswrapper[2546]: E0614 14:39:58.301028 2546 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jun 14 14:39:58.301310 ip-10-0-129-116 kubenswrapper[2546]: I0614 14:39:58.301270 2546 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/5a64bb81-61bc-42a1-bd11-55786121b7d8-registry-certificates\") pod \"image-registry-6b9bcff985-7lnrc\" (UID: \"5a64bb81-61bc-42a1-bd11-55786121b7d8\") " pod="openshift-image-registry/image-registry-6b9bcff985-7lnrc" Jun 14 14:39:58.301432 ip-10-0-129-116 kubenswrapper[2546]: E0614 14:39:58.301415 2546 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/5a64bb81-61bc-42a1-bd11-55786121b7d8-registry-tls podName:5a64bb81-61bc-42a1-bd11-55786121b7d8 nodeName:}" failed. No retries permitted until 2026-06-14 14:39:58.80107968 +0000 UTC m=+36.129461804 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/5a64bb81-61bc-42a1-bd11-55786121b7d8-registry-tls") pod "image-registry-6b9bcff985-7lnrc" (UID: "5a64bb81-61bc-42a1-bd11-55786121b7d8") : secret "image-registry-tls" not found Jun 14 14:39:58.301497 ip-10-0-129-116 kubenswrapper[2546]: E0614 14:39:58.301455 2546 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/11cc366c-4c61-4205-873a-3dcfcd341bf8-metrics-tls podName:11cc366c-4c61-4205-873a-3dcfcd341bf8 nodeName:}" failed. No retries permitted until 2026-06-14 14:39:58.801436985 +0000 UTC m=+36.129819091 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/11cc366c-4c61-4205-873a-3dcfcd341bf8-metrics-tls") pod "dns-default-29vxk" (UID: "11cc366c-4c61-4205-873a-3dcfcd341bf8") : secret "dns-default-metrics-tls" not found Jun 14 14:39:58.301561 ip-10-0-129-116 kubenswrapper[2546]: I0614 14:39:58.301538 2546 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/5a64bb81-61bc-42a1-bd11-55786121b7d8-ca-trust-extracted\") pod \"image-registry-6b9bcff985-7lnrc\" (UID: \"5a64bb81-61bc-42a1-bd11-55786121b7d8\") " pod="openshift-image-registry/image-registry-6b9bcff985-7lnrc" Jun 14 14:39:58.301640 ip-10-0-129-116 kubenswrapper[2546]: I0614 14:39:58.301618 2546 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/5a64bb81-61bc-42a1-bd11-55786121b7d8-trusted-ca\") pod \"image-registry-6b9bcff985-7lnrc\" (UID: \"5a64bb81-61bc-42a1-bd11-55786121b7d8\") " pod="openshift-image-registry/image-registry-6b9bcff985-7lnrc" Jun 14 14:39:58.305319 ip-10-0-129-116 kubenswrapper[2546]: I0614 14:39:58.305293 2546 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/5a64bb81-61bc-42a1-bd11-55786121b7d8-image-registry-private-configuration\") pod \"image-registry-6b9bcff985-7lnrc\" (UID: \"5a64bb81-61bc-42a1-bd11-55786121b7d8\") " pod="openshift-image-registry/image-registry-6b9bcff985-7lnrc" Jun 14 14:39:58.305441 ip-10-0-129-116 kubenswrapper[2546]: I0614 14:39:58.305414 2546 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/5a64bb81-61bc-42a1-bd11-55786121b7d8-installation-pull-secrets\") pod \"image-registry-6b9bcff985-7lnrc\" (UID: \"5a64bb81-61bc-42a1-bd11-55786121b7d8\") " pod="openshift-image-registry/image-registry-6b9bcff985-7lnrc" Jun 14 14:39:58.305487 ip-10-0-129-116 kubenswrapper[2546]: I0614 14:39:58.305440 2546 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/7ac15fa8-5937-48af-af72-d0fb83eecda2-cert\") pod \"ingress-canary-svjhc\" (UID: \"7ac15fa8-5937-48af-af72-d0fb83eecda2\") " pod="openshift-ingress-canary/ingress-canary-svjhc" Jun 14 14:39:58.312191 ip-10-0-129-116 kubenswrapper[2546]: I0614 14:39:58.312165 2546 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-x5q6m\" (UniqueName: \"kubernetes.io/projected/7ac15fa8-5937-48af-af72-d0fb83eecda2-kube-api-access-x5q6m\") pod \"ingress-canary-svjhc\" (UID: \"7ac15fa8-5937-48af-af72-d0fb83eecda2\") " pod="openshift-ingress-canary/ingress-canary-svjhc" Jun 14 14:39:58.312454 ip-10-0-129-116 kubenswrapper[2546]: I0614 14:39:58.312429 2546 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/5a64bb81-61bc-42a1-bd11-55786121b7d8-bound-sa-token\") pod \"image-registry-6b9bcff985-7lnrc\" (UID: \"5a64bb81-61bc-42a1-bd11-55786121b7d8\") " pod="openshift-image-registry/image-registry-6b9bcff985-7lnrc" Jun 14 14:39:58.313183 ip-10-0-129-116 kubenswrapper[2546]: I0614 14:39:58.313159 2546 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-xwvr9\" (UniqueName: \"kubernetes.io/projected/5a64bb81-61bc-42a1-bd11-55786121b7d8-kube-api-access-xwvr9\") pod \"image-registry-6b9bcff985-7lnrc\" (UID: \"5a64bb81-61bc-42a1-bd11-55786121b7d8\") " pod="openshift-image-registry/image-registry-6b9bcff985-7lnrc" Jun 14 14:39:58.313381 ip-10-0-129-116 kubenswrapper[2546]: I0614 14:39:58.313361 2546 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-dpfz2\" (UniqueName: \"kubernetes.io/projected/11cc366c-4c61-4205-873a-3dcfcd341bf8-kube-api-access-dpfz2\") pod \"dns-default-29vxk\" (UID: \"11cc366c-4c61-4205-873a-3dcfcd341bf8\") " pod="openshift-dns/dns-default-29vxk" Jun 14 14:39:58.365605 ip-10-0-129-116 kubenswrapper[2546]: I0614 14:39:58.365575 2546 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-svjhc" Jun 14 14:39:58.449676 ip-10-0-129-116 kubenswrapper[2546]: I0614 14:39:58.449645 2546 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c96gx_105377da-c223-41ad-b033-546cb01239c4/konnectivity-agent/0.log" limit=1024 Jun 14 14:39:58.539518 ip-10-0-129-116 kubenswrapper[2546]: I0614 14:39:58.539477 2546 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c96gx_105377da-c223-41ad-b033-546cb01239c4/konnectivity-agent/0.log" limit=1024 Jun 14 14:39:58.566939 ip-10-0-129-116 kubenswrapper[2546]: I0614 14:39:58.566848 2546 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-svjhc"] Jun 14 14:39:58.804656 ip-10-0-129-116 kubenswrapper[2546]: I0614 14:39:58.804617 2546 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/11cc366c-4c61-4205-873a-3dcfcd341bf8-metrics-tls\") pod \"dns-default-29vxk\" (UID: \"11cc366c-4c61-4205-873a-3dcfcd341bf8\") " pod="openshift-dns/dns-default-29vxk" Jun 14 14:39:58.804832 ip-10-0-129-116 kubenswrapper[2546]: I0614 14:39:58.804669 2546 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/5a64bb81-61bc-42a1-bd11-55786121b7d8-registry-tls\") pod \"image-registry-6b9bcff985-7lnrc\" (UID: \"5a64bb81-61bc-42a1-bd11-55786121b7d8\") " pod="openshift-image-registry/image-registry-6b9bcff985-7lnrc" Jun 14 14:39:58.804832 ip-10-0-129-116 kubenswrapper[2546]: E0614 14:39:58.804797 2546 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jun 14 14:39:58.804932 ip-10-0-129-116 kubenswrapper[2546]: E0614 14:39:58.804859 2546 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jun 14 14:39:58.804932 ip-10-0-129-116 kubenswrapper[2546]: E0614 14:39:58.804878 2546 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-6b9bcff985-7lnrc: secret "image-registry-tls" not found Jun 14 14:39:58.804932 ip-10-0-129-116 kubenswrapper[2546]: E0614 14:39:58.804887 2546 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/11cc366c-4c61-4205-873a-3dcfcd341bf8-metrics-tls podName:11cc366c-4c61-4205-873a-3dcfcd341bf8 nodeName:}" failed. No retries permitted until 2026-06-14 14:39:59.804865566 +0000 UTC m=+37.133247671 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/11cc366c-4c61-4205-873a-3dcfcd341bf8-metrics-tls") pod "dns-default-29vxk" (UID: "11cc366c-4c61-4205-873a-3dcfcd341bf8") : secret "dns-default-metrics-tls" not found Jun 14 14:39:58.804932 ip-10-0-129-116 kubenswrapper[2546]: E0614 14:39:58.804921 2546 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/5a64bb81-61bc-42a1-bd11-55786121b7d8-registry-tls podName:5a64bb81-61bc-42a1-bd11-55786121b7d8 nodeName:}" failed. No retries permitted until 2026-06-14 14:39:59.804905744 +0000 UTC m=+37.133287848 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/5a64bb81-61bc-42a1-bd11-55786121b7d8-registry-tls") pod "image-registry-6b9bcff985-7lnrc" (UID: "5a64bb81-61bc-42a1-bd11-55786121b7d8") : secret "image-registry-tls" not found Jun 14 14:39:59.813650 ip-10-0-129-116 kubenswrapper[2546]: I0614 14:39:59.813608 2546 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/11cc366c-4c61-4205-873a-3dcfcd341bf8-metrics-tls\") pod \"dns-default-29vxk\" (UID: \"11cc366c-4c61-4205-873a-3dcfcd341bf8\") " pod="openshift-dns/dns-default-29vxk" Jun 14 14:39:59.814466 ip-10-0-129-116 kubenswrapper[2546]: I0614 14:39:59.813662 2546 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/5a64bb81-61bc-42a1-bd11-55786121b7d8-registry-tls\") pod \"image-registry-6b9bcff985-7lnrc\" (UID: \"5a64bb81-61bc-42a1-bd11-55786121b7d8\") " pod="openshift-image-registry/image-registry-6b9bcff985-7lnrc" Jun 14 14:39:59.814466 ip-10-0-129-116 kubenswrapper[2546]: E0614 14:39:59.813787 2546 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jun 14 14:39:59.814466 ip-10-0-129-116 kubenswrapper[2546]: E0614 14:39:59.813808 2546 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jun 14 14:39:59.814466 ip-10-0-129-116 kubenswrapper[2546]: E0614 14:39:59.813822 2546 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-6b9bcff985-7lnrc: secret "image-registry-tls" not found Jun 14 14:39:59.814466 ip-10-0-129-116 kubenswrapper[2546]: E0614 14:39:59.813882 2546 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/11cc366c-4c61-4205-873a-3dcfcd341bf8-metrics-tls podName:11cc366c-4c61-4205-873a-3dcfcd341bf8 nodeName:}" failed. No retries permitted until 2026-06-14 14:40:01.813861868 +0000 UTC m=+39.142243985 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/11cc366c-4c61-4205-873a-3dcfcd341bf8-metrics-tls") pod "dns-default-29vxk" (UID: "11cc366c-4c61-4205-873a-3dcfcd341bf8") : secret "dns-default-metrics-tls" not found Jun 14 14:39:59.814466 ip-10-0-129-116 kubenswrapper[2546]: E0614 14:39:59.813898 2546 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/5a64bb81-61bc-42a1-bd11-55786121b7d8-registry-tls podName:5a64bb81-61bc-42a1-bd11-55786121b7d8 nodeName:}" failed. No retries permitted until 2026-06-14 14:40:01.813890934 +0000 UTC m=+39.142273036 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/5a64bb81-61bc-42a1-bd11-55786121b7d8-registry-tls") pod "image-registry-6b9bcff985-7lnrc" (UID: "5a64bb81-61bc-42a1-bd11-55786121b7d8") : secret "image-registry-tls" not found Jun 14 14:39:59.920977 ip-10-0-129-116 kubenswrapper[2546]: W0614 14:39:59.920943 2546 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7ac15fa8_5937_48af_af72_d0fb83eecda2.slice/crio-0681a189ad2f895a08484ca81df799048638e189224d0298e46fd52075126aa9 WatchSource:0}: Error finding container 0681a189ad2f895a08484ca81df799048638e189224d0298e46fd52075126aa9: Status 404 returned error can't find the container with id 0681a189ad2f895a08484ca81df799048638e189224d0298e46fd52075126aa9 Jun 14 14:40:00.427928 ip-10-0-129-116 kubenswrapper[2546]: I0614 14:40:00.427744 2546 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-svjhc" event={"ID":"7ac15fa8-5937-48af-af72-d0fb83eecda2","Type":"ContainerStarted","Data":"0681a189ad2f895a08484ca81df799048638e189224d0298e46fd52075126aa9"} Jun 14 14:40:00.430196 ip-10-0-129-116 kubenswrapper[2546]: I0614 14:40:00.430172 2546 generic.go:356] "Generic (PLEG): container finished" podID="8da319a4-be6d-4245-aed1-aa1fdaf8ca66" containerID="02005bad9973eef76d47bd32c025f6295d3f332b7efe00d3d8fd0e5d0c4cf1fe" exitCode=0 Jun 14 14:40:00.430293 ip-10-0-129-116 kubenswrapper[2546]: I0614 14:40:00.430204 2546 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-r4gvc" event={"ID":"8da319a4-be6d-4245-aed1-aa1fdaf8ca66","Type":"ContainerDied","Data":"02005bad9973eef76d47bd32c025f6295d3f332b7efe00d3d8fd0e5d0c4cf1fe"} Jun 14 14:40:01.387032 ip-10-0-129-116 kubenswrapper[2546]: I0614 14:40:01.386995 2546 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c96gx_105377da-c223-41ad-b033-546cb01239c4/konnectivity-agent/0.log" limit=1024 Jun 14 14:40:01.435889 ip-10-0-129-116 kubenswrapper[2546]: I0614 14:40:01.435858 2546 generic.go:356] "Generic (PLEG): container finished" podID="8da319a4-be6d-4245-aed1-aa1fdaf8ca66" containerID="762dcf80697a46b4aec9191b37b8064e9c6f76d510ae885918a3b3151e761de0" exitCode=0 Jun 14 14:40:01.436039 ip-10-0-129-116 kubenswrapper[2546]: I0614 14:40:01.435932 2546 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-r4gvc" event={"ID":"8da319a4-be6d-4245-aed1-aa1fdaf8ca66","Type":"ContainerDied","Data":"762dcf80697a46b4aec9191b37b8064e9c6f76d510ae885918a3b3151e761de0"} Jun 14 14:40:01.831236 ip-10-0-129-116 kubenswrapper[2546]: I0614 14:40:01.831212 2546 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/11cc366c-4c61-4205-873a-3dcfcd341bf8-metrics-tls\") pod \"dns-default-29vxk\" (UID: \"11cc366c-4c61-4205-873a-3dcfcd341bf8\") " pod="openshift-dns/dns-default-29vxk" Jun 14 14:40:01.831339 ip-10-0-129-116 kubenswrapper[2546]: I0614 14:40:01.831251 2546 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/5a64bb81-61bc-42a1-bd11-55786121b7d8-registry-tls\") pod \"image-registry-6b9bcff985-7lnrc\" (UID: \"5a64bb81-61bc-42a1-bd11-55786121b7d8\") " pod="openshift-image-registry/image-registry-6b9bcff985-7lnrc" Jun 14 14:40:01.831404 ip-10-0-129-116 kubenswrapper[2546]: E0614 14:40:01.831372 2546 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jun 14 14:40:01.831454 ip-10-0-129-116 kubenswrapper[2546]: E0614 14:40:01.831419 2546 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jun 14 14:40:01.831454 ip-10-0-129-116 kubenswrapper[2546]: E0614 14:40:01.831439 2546 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-6b9bcff985-7lnrc: secret "image-registry-tls" not found Jun 14 14:40:01.831556 ip-10-0-129-116 kubenswrapper[2546]: E0614 14:40:01.831441 2546 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/11cc366c-4c61-4205-873a-3dcfcd341bf8-metrics-tls podName:11cc366c-4c61-4205-873a-3dcfcd341bf8 nodeName:}" failed. No retries permitted until 2026-06-14 14:40:05.831424773 +0000 UTC m=+43.159806889 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/11cc366c-4c61-4205-873a-3dcfcd341bf8-metrics-tls") pod "dns-default-29vxk" (UID: "11cc366c-4c61-4205-873a-3dcfcd341bf8") : secret "dns-default-metrics-tls" not found Jun 14 14:40:01.831556 ip-10-0-129-116 kubenswrapper[2546]: E0614 14:40:01.831522 2546 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/5a64bb81-61bc-42a1-bd11-55786121b7d8-registry-tls podName:5a64bb81-61bc-42a1-bd11-55786121b7d8 nodeName:}" failed. No retries permitted until 2026-06-14 14:40:05.83150046 +0000 UTC m=+43.159882577 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/5a64bb81-61bc-42a1-bd11-55786121b7d8-registry-tls") pod "image-registry-6b9bcff985-7lnrc" (UID: "5a64bb81-61bc-42a1-bd11-55786121b7d8") : secret "image-registry-tls" not found Jun 14 14:40:02.441209 ip-10-0-129-116 kubenswrapper[2546]: I0614 14:40:02.441173 2546 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-r4gvc" event={"ID":"8da319a4-be6d-4245-aed1-aa1fdaf8ca66","Type":"ContainerStarted","Data":"f4264189bf89c76a2a7ef7cfebc38238f3bc1cf632e5dda6c270b185f74b755a"} Jun 14 14:40:02.442595 ip-10-0-129-116 kubenswrapper[2546]: I0614 14:40:02.442567 2546 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-svjhc" event={"ID":"7ac15fa8-5937-48af-af72-d0fb83eecda2","Type":"ContainerStarted","Data":"a4ea53b9c55e09a56ee2fe209a2154efe9213035d8c259cbfe22e7abf0ec2348"} Jun 14 14:40:02.463900 ip-10-0-129-116 kubenswrapper[2546]: I0614 14:40:02.463859 2546 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-additional-cni-plugins-r4gvc" podStartSLOduration=12.792872862 podStartE2EDuration="39.463845965s" totalImagesPullingTime="26.670973103s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-14 14:39:23 +0000 UTC" imagePullSessionsCount=5 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-14 14:40:02.462896599 +0000 UTC m=+39.791278761" watchObservedRunningTime="2026-06-14 14:40:02.463845965 +0000 UTC m=+39.792228092" Jun 14 14:40:02.477846 ip-10-0-129-116 kubenswrapper[2546]: I0614 14:40:02.477808 2546 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress-canary/ingress-canary-svjhc" podStartSLOduration=2.576919218 podStartE2EDuration="4.477795045s" totalImagesPullingTime="1.900875827s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-14 14:39:58 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-14 14:40:02.477121945 +0000 UTC m=+39.805504071" watchObservedRunningTime="2026-06-14 14:40:02.477795045 +0000 UTC m=+39.806177170" Jun 14 14:40:02.569611 ip-10-0-129-116 kubenswrapper[2546]: I0614 14:40:02.569582 2546 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c96gx_105377da-c223-41ad-b033-546cb01239c4/konnectivity-agent/0.log" limit=1024 Jun 14 14:40:02.623024 ip-10-0-129-116 kubenswrapper[2546]: I0614 14:40:02.622993 2546 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c96gx_105377da-c223-41ad-b033-546cb01239c4/konnectivity-agent/0.log" limit=1024 Jun 14 14:40:02.672377 ip-10-0-129-116 kubenswrapper[2546]: I0614 14:40:02.672352 2546 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c96gx_105377da-c223-41ad-b033-546cb01239c4/konnectivity-agent/0.log" limit=1024 Jun 14 14:40:03.511787 ip-10-0-129-116 kubenswrapper[2546]: I0614 14:40:03.511751 2546 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c96gx_105377da-c223-41ad-b033-546cb01239c4/konnectivity-agent/0.log" limit=1024 Jun 14 14:40:03.563756 ip-10-0-129-116 kubenswrapper[2546]: I0614 14:40:03.563732 2546 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c96gx_105377da-c223-41ad-b033-546cb01239c4/konnectivity-agent/0.log" limit=1024 Jun 14 14:40:04.985303 ip-10-0-129-116 kubenswrapper[2546]: I0614 14:40:04.985268 2546 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c96gx_105377da-c223-41ad-b033-546cb01239c4/konnectivity-agent/0.log" limit=1024 Jun 14 14:40:05.032626 ip-10-0-129-116 kubenswrapper[2546]: I0614 14:40:05.032595 2546 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c96gx_105377da-c223-41ad-b033-546cb01239c4/konnectivity-agent/0.log" limit=1024 Jun 14 14:40:05.861787 ip-10-0-129-116 kubenswrapper[2546]: I0614 14:40:05.861746 2546 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/11cc366c-4c61-4205-873a-3dcfcd341bf8-metrics-tls\") pod \"dns-default-29vxk\" (UID: \"11cc366c-4c61-4205-873a-3dcfcd341bf8\") " pod="openshift-dns/dns-default-29vxk" Jun 14 14:40:05.861971 ip-10-0-129-116 kubenswrapper[2546]: I0614 14:40:05.861795 2546 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/5a64bb81-61bc-42a1-bd11-55786121b7d8-registry-tls\") pod \"image-registry-6b9bcff985-7lnrc\" (UID: \"5a64bb81-61bc-42a1-bd11-55786121b7d8\") " pod="openshift-image-registry/image-registry-6b9bcff985-7lnrc" Jun 14 14:40:05.861971 ip-10-0-129-116 kubenswrapper[2546]: E0614 14:40:05.861896 2546 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jun 14 14:40:05.861971 ip-10-0-129-116 kubenswrapper[2546]: E0614 14:40:05.861951 2546 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jun 14 14:40:05.861971 ip-10-0-129-116 kubenswrapper[2546]: E0614 14:40:05.861963 2546 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/11cc366c-4c61-4205-873a-3dcfcd341bf8-metrics-tls podName:11cc366c-4c61-4205-873a-3dcfcd341bf8 nodeName:}" failed. No retries permitted until 2026-06-14 14:40:13.861946534 +0000 UTC m=+51.190328643 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/11cc366c-4c61-4205-873a-3dcfcd341bf8-metrics-tls") pod "dns-default-29vxk" (UID: "11cc366c-4c61-4205-873a-3dcfcd341bf8") : secret "dns-default-metrics-tls" not found Jun 14 14:40:05.861971 ip-10-0-129-116 kubenswrapper[2546]: E0614 14:40:05.861967 2546 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-6b9bcff985-7lnrc: secret "image-registry-tls" not found Jun 14 14:40:05.862222 ip-10-0-129-116 kubenswrapper[2546]: E0614 14:40:05.862009 2546 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/5a64bb81-61bc-42a1-bd11-55786121b7d8-registry-tls podName:5a64bb81-61bc-42a1-bd11-55786121b7d8 nodeName:}" failed. No retries permitted until 2026-06-14 14:40:13.861996818 +0000 UTC m=+51.190378922 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/5a64bb81-61bc-42a1-bd11-55786121b7d8-registry-tls") pod "image-registry-6b9bcff985-7lnrc" (UID: "5a64bb81-61bc-42a1-bd11-55786121b7d8") : secret "image-registry-tls" not found Jun 14 14:40:07.126894 ip-10-0-129-116 kubenswrapper[2546]: I0614 14:40:07.126860 2546 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c96gx_105377da-c223-41ad-b033-546cb01239c4/konnectivity-agent/0.log" limit=1024 Jun 14 14:40:07.175552 ip-10-0-129-116 kubenswrapper[2546]: I0614 14:40:07.175520 2546 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c96gx_105377da-c223-41ad-b033-546cb01239c4/konnectivity-agent/0.log" limit=1024 Jun 14 14:40:09.261833 ip-10-0-129-116 kubenswrapper[2546]: I0614 14:40:09.261657 2546 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c96gx_105377da-c223-41ad-b033-546cb01239c4/konnectivity-agent/0.log" limit=1024 Jun 14 14:40:09.316326 ip-10-0-129-116 kubenswrapper[2546]: I0614 14:40:09.316292 2546 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c96gx_105377da-c223-41ad-b033-546cb01239c4/konnectivity-agent/0.log" limit=1024 Jun 14 14:40:11.487796 ip-10-0-129-116 kubenswrapper[2546]: I0614 14:40:11.487761 2546 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c96gx_105377da-c223-41ad-b033-546cb01239c4/konnectivity-agent/0.log" limit=1024 Jun 14 14:40:11.544508 ip-10-0-129-116 kubenswrapper[2546]: I0614 14:40:11.544480 2546 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c96gx_105377da-c223-41ad-b033-546cb01239c4/konnectivity-agent/0.log" limit=1024 Jun 14 14:40:13.925139 ip-10-0-129-116 kubenswrapper[2546]: I0614 14:40:13.925082 2546 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/11cc366c-4c61-4205-873a-3dcfcd341bf8-metrics-tls\") pod \"dns-default-29vxk\" (UID: \"11cc366c-4c61-4205-873a-3dcfcd341bf8\") " pod="openshift-dns/dns-default-29vxk" Jun 14 14:40:13.925139 ip-10-0-129-116 kubenswrapper[2546]: I0614 14:40:13.925148 2546 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/5a64bb81-61bc-42a1-bd11-55786121b7d8-registry-tls\") pod \"image-registry-6b9bcff985-7lnrc\" (UID: \"5a64bb81-61bc-42a1-bd11-55786121b7d8\") " pod="openshift-image-registry/image-registry-6b9bcff985-7lnrc" Jun 14 14:40:13.925639 ip-10-0-129-116 kubenswrapper[2546]: E0614 14:40:13.925233 2546 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jun 14 14:40:13.925639 ip-10-0-129-116 kubenswrapper[2546]: E0614 14:40:13.925296 2546 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/11cc366c-4c61-4205-873a-3dcfcd341bf8-metrics-tls podName:11cc366c-4c61-4205-873a-3dcfcd341bf8 nodeName:}" failed. No retries permitted until 2026-06-14 14:40:29.925279801 +0000 UTC m=+67.253661904 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/11cc366c-4c61-4205-873a-3dcfcd341bf8-metrics-tls") pod "dns-default-29vxk" (UID: "11cc366c-4c61-4205-873a-3dcfcd341bf8") : secret "dns-default-metrics-tls" not found Jun 14 14:40:13.925639 ip-10-0-129-116 kubenswrapper[2546]: E0614 14:40:13.925239 2546 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jun 14 14:40:13.925639 ip-10-0-129-116 kubenswrapper[2546]: E0614 14:40:13.925334 2546 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-6b9bcff985-7lnrc: secret "image-registry-tls" not found Jun 14 14:40:13.925639 ip-10-0-129-116 kubenswrapper[2546]: E0614 14:40:13.925383 2546 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/5a64bb81-61bc-42a1-bd11-55786121b7d8-registry-tls podName:5a64bb81-61bc-42a1-bd11-55786121b7d8 nodeName:}" failed. No retries permitted until 2026-06-14 14:40:29.925372215 +0000 UTC m=+67.253754318 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/5a64bb81-61bc-42a1-bd11-55786121b7d8-registry-tls") pod "image-registry-6b9bcff985-7lnrc" (UID: "5a64bb81-61bc-42a1-bd11-55786121b7d8") : secret "image-registry-tls" not found Jun 14 14:40:14.350812 ip-10-0-129-116 kubenswrapper[2546]: I0614 14:40:14.350733 2546 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c96gx_105377da-c223-41ad-b033-546cb01239c4/konnectivity-agent/0.log" limit=1024 Jun 14 14:40:23.423793 ip-10-0-129-116 kubenswrapper[2546]: I0614 14:40:23.423769 2546 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-zgckr" Jun 14 14:40:23.572005 ip-10-0-129-116 kubenswrapper[2546]: I0614 14:40:23.571973 2546 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c96gx_105377da-c223-41ad-b033-546cb01239c4/konnectivity-agent/0.log" limit=1024 Jun 14 14:40:23.671405 ip-10-0-129-116 kubenswrapper[2546]: I0614 14:40:23.671373 2546 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c96gx_105377da-c223-41ad-b033-546cb01239c4/konnectivity-agent/0.log" limit=1024 Jun 14 14:40:27.964483 ip-10-0-129-116 kubenswrapper[2546]: I0614 14:40:27.964451 2546 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c96gx_105377da-c223-41ad-b033-546cb01239c4/konnectivity-agent/0.log" limit=1024 Jun 14 14:40:28.010498 ip-10-0-129-116 kubenswrapper[2546]: I0614 14:40:28.010468 2546 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c96gx_105377da-c223-41ad-b033-546cb01239c4/konnectivity-agent/0.log" limit=1024 Jun 14 14:40:28.933602 ip-10-0-129-116 kubenswrapper[2546]: I0614 14:40:28.933568 2546 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/6446f965-15fc-40d5-85e7-20cec0d42549-original-pull-secret\") pod \"global-pull-secret-syncer-dlk5b\" (UID: \"6446f965-15fc-40d5-85e7-20cec0d42549\") " pod="kube-system/global-pull-secret-syncer-dlk5b" Jun 14 14:40:28.933775 ip-10-0-129-116 kubenswrapper[2546]: I0614 14:40:28.933611 2546 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/aa4feed6-27ad-493a-baa3-8d0d96cb5309-metrics-certs\") pod \"network-metrics-daemon-lt4g2\" (UID: \"aa4feed6-27ad-493a-baa3-8d0d96cb5309\") " pod="openshift-multus/network-metrics-daemon-lt4g2" Jun 14 14:40:28.936169 ip-10-0-129-116 kubenswrapper[2546]: I0614 14:40:28.936149 2546 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\"" Jun 14 14:40:28.936248 ip-10-0-129-116 kubenswrapper[2546]: I0614 14:40:28.936232 2546 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\"" Jun 14 14:40:28.944240 ip-10-0-129-116 kubenswrapper[2546]: E0614 14:40:28.944223 2546 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: secret "metrics-daemon-secret" not found Jun 14 14:40:28.944287 ip-10-0-129-116 kubenswrapper[2546]: E0614 14:40:28.944279 2546 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/aa4feed6-27ad-493a-baa3-8d0d96cb5309-metrics-certs podName:aa4feed6-27ad-493a-baa3-8d0d96cb5309 nodeName:}" failed. No retries permitted until 2026-06-14 14:41:32.944263517 +0000 UTC m=+130.272645621 (durationBeforeRetry 1m4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/aa4feed6-27ad-493a-baa3-8d0d96cb5309-metrics-certs") pod "network-metrics-daemon-lt4g2" (UID: "aa4feed6-27ad-493a-baa3-8d0d96cb5309") : secret "metrics-daemon-secret" not found Jun 14 14:40:28.947966 ip-10-0-129-116 kubenswrapper[2546]: I0614 14:40:28.947941 2546 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/6446f965-15fc-40d5-85e7-20cec0d42549-original-pull-secret\") pod \"global-pull-secret-syncer-dlk5b\" (UID: \"6446f965-15fc-40d5-85e7-20cec0d42549\") " pod="kube-system/global-pull-secret-syncer-dlk5b" Jun 14 14:40:29.034538 ip-10-0-129-116 kubenswrapper[2546]: I0614 14:40:29.034494 2546 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-t9bks\" (UniqueName: \"kubernetes.io/projected/726e808e-de0a-4f4f-809c-8f7e7cc45432-kube-api-access-t9bks\") pod \"network-check-target-m6zq8\" (UID: \"726e808e-de0a-4f4f-809c-8f7e7cc45432\") " pod="openshift-network-diagnostics/network-check-target-m6zq8" Jun 14 14:40:29.037100 ip-10-0-129-116 kubenswrapper[2546]: I0614 14:40:29.037072 2546 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\"" Jun 14 14:40:29.047460 ip-10-0-129-116 kubenswrapper[2546]: I0614 14:40:29.047440 2546 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\"" Jun 14 14:40:29.057502 ip-10-0-129-116 kubenswrapper[2546]: I0614 14:40:29.057472 2546 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-t9bks\" (UniqueName: \"kubernetes.io/projected/726e808e-de0a-4f4f-809c-8f7e7cc45432-kube-api-access-t9bks\") pod \"network-check-target-m6zq8\" (UID: \"726e808e-de0a-4f4f-809c-8f7e7cc45432\") " pod="openshift-network-diagnostics/network-check-target-m6zq8" Jun 14 14:40:29.098765 ip-10-0-129-116 kubenswrapper[2546]: I0614 14:40:29.098740 2546 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-k8smd\"" Jun 14 14:40:29.106812 ip-10-0-129-116 kubenswrapper[2546]: I0614 14:40:29.106791 2546 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-m6zq8" Jun 14 14:40:29.106875 ip-10-0-129-116 kubenswrapper[2546]: I0614 14:40:29.106867 2546 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-dlk5b" Jun 14 14:40:29.241867 ip-10-0-129-116 kubenswrapper[2546]: I0614 14:40:29.241840 2546 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-m6zq8"] Jun 14 14:40:29.245311 ip-10-0-129-116 kubenswrapper[2546]: W0614 14:40:29.245273 2546 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod726e808e_de0a_4f4f_809c_8f7e7cc45432.slice/crio-272b0986bc696f16d6f58c7c633adb765ad5cd75568dc123294558065ef7cabc WatchSource:0}: Error finding container 272b0986bc696f16d6f58c7c633adb765ad5cd75568dc123294558065ef7cabc: Status 404 returned error can't find the container with id 272b0986bc696f16d6f58c7c633adb765ad5cd75568dc123294558065ef7cabc Jun 14 14:40:29.253738 ip-10-0-129-116 kubenswrapper[2546]: I0614 14:40:29.253717 2546 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-dlk5b"] Jun 14 14:40:29.257912 ip-10-0-129-116 kubenswrapper[2546]: W0614 14:40:29.257892 2546 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6446f965_15fc_40d5_85e7_20cec0d42549.slice/crio-b5eea162728fbd91dfbf38411bdb6fe7570813de6c039d448b4de10986ac1a6a WatchSource:0}: Error finding container b5eea162728fbd91dfbf38411bdb6fe7570813de6c039d448b4de10986ac1a6a: Status 404 returned error can't find the container with id b5eea162728fbd91dfbf38411bdb6fe7570813de6c039d448b4de10986ac1a6a Jun 14 14:40:29.504432 ip-10-0-129-116 kubenswrapper[2546]: I0614 14:40:29.504343 2546 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-dlk5b" event={"ID":"6446f965-15fc-40d5-85e7-20cec0d42549","Type":"ContainerStarted","Data":"b5eea162728fbd91dfbf38411bdb6fe7570813de6c039d448b4de10986ac1a6a"} Jun 14 14:40:29.505420 ip-10-0-129-116 kubenswrapper[2546]: I0614 14:40:29.505398 2546 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-m6zq8" event={"ID":"726e808e-de0a-4f4f-809c-8f7e7cc45432","Type":"ContainerStarted","Data":"272b0986bc696f16d6f58c7c633adb765ad5cd75568dc123294558065ef7cabc"} Jun 14 14:40:29.941072 ip-10-0-129-116 kubenswrapper[2546]: I0614 14:40:29.941024 2546 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/11cc366c-4c61-4205-873a-3dcfcd341bf8-metrics-tls\") pod \"dns-default-29vxk\" (UID: \"11cc366c-4c61-4205-873a-3dcfcd341bf8\") " pod="openshift-dns/dns-default-29vxk" Jun 14 14:40:29.941241 ip-10-0-129-116 kubenswrapper[2546]: I0614 14:40:29.941105 2546 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/5a64bb81-61bc-42a1-bd11-55786121b7d8-registry-tls\") pod \"image-registry-6b9bcff985-7lnrc\" (UID: \"5a64bb81-61bc-42a1-bd11-55786121b7d8\") " pod="openshift-image-registry/image-registry-6b9bcff985-7lnrc" Jun 14 14:40:29.941241 ip-10-0-129-116 kubenswrapper[2546]: E0614 14:40:29.941209 2546 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jun 14 14:40:29.941370 ip-10-0-129-116 kubenswrapper[2546]: E0614 14:40:29.941268 2546 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jun 14 14:40:29.941370 ip-10-0-129-116 kubenswrapper[2546]: E0614 14:40:29.941287 2546 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/11cc366c-4c61-4205-873a-3dcfcd341bf8-metrics-tls podName:11cc366c-4c61-4205-873a-3dcfcd341bf8 nodeName:}" failed. No retries permitted until 2026-06-14 14:41:01.941267418 +0000 UTC m=+99.269649536 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/11cc366c-4c61-4205-873a-3dcfcd341bf8-metrics-tls") pod "dns-default-29vxk" (UID: "11cc366c-4c61-4205-873a-3dcfcd341bf8") : secret "dns-default-metrics-tls" not found Jun 14 14:40:29.941370 ip-10-0-129-116 kubenswrapper[2546]: E0614 14:40:29.941289 2546 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-6b9bcff985-7lnrc: secret "image-registry-tls" not found Jun 14 14:40:29.941370 ip-10-0-129-116 kubenswrapper[2546]: E0614 14:40:29.941328 2546 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/5a64bb81-61bc-42a1-bd11-55786121b7d8-registry-tls podName:5a64bb81-61bc-42a1-bd11-55786121b7d8 nodeName:}" failed. No retries permitted until 2026-06-14 14:41:01.941319679 +0000 UTC m=+99.269701783 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/5a64bb81-61bc-42a1-bd11-55786121b7d8-registry-tls") pod "image-registry-6b9bcff985-7lnrc" (UID: "5a64bb81-61bc-42a1-bd11-55786121b7d8") : secret "image-registry-tls" not found Jun 14 14:40:34.435528 ip-10-0-129-116 kubenswrapper[2546]: I0614 14:40:34.435474 2546 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c96gx_105377da-c223-41ad-b033-546cb01239c4/konnectivity-agent/0.log" limit=1024 Jun 14 14:40:34.488922 ip-10-0-129-116 kubenswrapper[2546]: I0614 14:40:34.488890 2546 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c96gx_105377da-c223-41ad-b033-546cb01239c4/konnectivity-agent/0.log" limit=1024 Jun 14 14:40:34.520042 ip-10-0-129-116 kubenswrapper[2546]: I0614 14:40:34.520014 2546 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-m6zq8" event={"ID":"726e808e-de0a-4f4f-809c-8f7e7cc45432","Type":"ContainerStarted","Data":"3cacaa6cdb7239ff89f2b134099be1f47dc3b75aa107f3b759006e176fe9ef6a"} Jun 14 14:40:34.520184 ip-10-0-129-116 kubenswrapper[2546]: I0614 14:40:34.520134 2546 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-network-diagnostics/network-check-target-m6zq8" Jun 14 14:40:34.521340 ip-10-0-129-116 kubenswrapper[2546]: I0614 14:40:34.521319 2546 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-dlk5b" event={"ID":"6446f965-15fc-40d5-85e7-20cec0d42549","Type":"ContainerStarted","Data":"0ff28b5f469cc6cbbea26f90c440da8003fa3c475a74ca799c943491d81f75fa"} Jun 14 14:40:34.536640 ip-10-0-129-116 kubenswrapper[2546]: I0614 14:40:34.536604 2546 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-diagnostics/network-check-target-m6zq8" podStartSLOduration=66.761008605 podStartE2EDuration="1m11.53659239s" totalImagesPullingTime="4.775583785s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-14 14:39:23 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-14 14:40:34.535237444 +0000 UTC m=+71.863619609" watchObservedRunningTime="2026-06-14 14:40:34.53659239 +0000 UTC m=+71.864974520" Jun 14 14:40:34.542772 ip-10-0-129-116 kubenswrapper[2546]: I0614 14:40:34.542741 2546 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c96gx_105377da-c223-41ad-b033-546cb01239c4/konnectivity-agent/0.log" limit=1024 Jun 14 14:40:34.549138 ip-10-0-129-116 kubenswrapper[2546]: I0614 14:40:34.549078 2546 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/global-pull-secret-syncer-dlk5b" podStartSLOduration=66.781849844 podStartE2EDuration="1m11.549065982s" totalImagesPullingTime="4.767216138s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-14 14:39:23 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-14 14:40:34.548742069 +0000 UTC m=+71.877124190" watchObservedRunningTime="2026-06-14 14:40:34.549065982 +0000 UTC m=+71.877448132" Jun 14 14:40:38.151856 ip-10-0-129-116 kubenswrapper[2546]: I0614 14:40:38.151736 2546 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c96gx_105377da-c223-41ad-b033-546cb01239c4/konnectivity-agent/0.log" limit=1024 Jun 14 14:40:38.198391 ip-10-0-129-116 kubenswrapper[2546]: I0614 14:40:38.198363 2546 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c96gx_105377da-c223-41ad-b033-546cb01239c4/konnectivity-agent/0.log" limit=1024 Jun 14 14:41:01.963691 ip-10-0-129-116 kubenswrapper[2546]: I0614 14:41:01.963586 2546 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/11cc366c-4c61-4205-873a-3dcfcd341bf8-metrics-tls\") pod \"dns-default-29vxk\" (UID: \"11cc366c-4c61-4205-873a-3dcfcd341bf8\") " pod="openshift-dns/dns-default-29vxk" Jun 14 14:41:01.963691 ip-10-0-129-116 kubenswrapper[2546]: I0614 14:41:01.963650 2546 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/5a64bb81-61bc-42a1-bd11-55786121b7d8-registry-tls\") pod \"image-registry-6b9bcff985-7lnrc\" (UID: \"5a64bb81-61bc-42a1-bd11-55786121b7d8\") " pod="openshift-image-registry/image-registry-6b9bcff985-7lnrc" Jun 14 14:41:01.964084 ip-10-0-129-116 kubenswrapper[2546]: E0614 14:41:01.963745 2546 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jun 14 14:41:01.964084 ip-10-0-129-116 kubenswrapper[2546]: E0614 14:41:01.963809 2546 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/11cc366c-4c61-4205-873a-3dcfcd341bf8-metrics-tls podName:11cc366c-4c61-4205-873a-3dcfcd341bf8 nodeName:}" failed. No retries permitted until 2026-06-14 14:42:05.963794687 +0000 UTC m=+163.292176793 (durationBeforeRetry 1m4s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/11cc366c-4c61-4205-873a-3dcfcd341bf8-metrics-tls") pod "dns-default-29vxk" (UID: "11cc366c-4c61-4205-873a-3dcfcd341bf8") : secret "dns-default-metrics-tls" not found Jun 14 14:41:01.964084 ip-10-0-129-116 kubenswrapper[2546]: E0614 14:41:01.963748 2546 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jun 14 14:41:01.964084 ip-10-0-129-116 kubenswrapper[2546]: E0614 14:41:01.963853 2546 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-6b9bcff985-7lnrc: secret "image-registry-tls" not found Jun 14 14:41:01.964084 ip-10-0-129-116 kubenswrapper[2546]: E0614 14:41:01.963905 2546 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/5a64bb81-61bc-42a1-bd11-55786121b7d8-registry-tls podName:5a64bb81-61bc-42a1-bd11-55786121b7d8 nodeName:}" failed. No retries permitted until 2026-06-14 14:42:05.963894226 +0000 UTC m=+163.292276348 (durationBeforeRetry 1m4s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/5a64bb81-61bc-42a1-bd11-55786121b7d8-registry-tls") pod "image-registry-6b9bcff985-7lnrc" (UID: "5a64bb81-61bc-42a1-bd11-55786121b7d8") : secret "image-registry-tls" not found Jun 14 14:41:05.526213 ip-10-0-129-116 kubenswrapper[2546]: I0614 14:41:05.526184 2546 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-network-diagnostics/network-check-target-m6zq8" Jun 14 14:41:32.986883 ip-10-0-129-116 kubenswrapper[2546]: I0614 14:41:32.986846 2546 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/aa4feed6-27ad-493a-baa3-8d0d96cb5309-metrics-certs\") pod \"network-metrics-daemon-lt4g2\" (UID: \"aa4feed6-27ad-493a-baa3-8d0d96cb5309\") " pod="openshift-multus/network-metrics-daemon-lt4g2" Jun 14 14:41:32.987295 ip-10-0-129-116 kubenswrapper[2546]: E0614 14:41:32.986950 2546 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: secret "metrics-daemon-secret" not found Jun 14 14:41:32.987295 ip-10-0-129-116 kubenswrapper[2546]: E0614 14:41:32.987000 2546 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/aa4feed6-27ad-493a-baa3-8d0d96cb5309-metrics-certs podName:aa4feed6-27ad-493a-baa3-8d0d96cb5309 nodeName:}" failed. No retries permitted until 2026-06-14 14:43:34.986986843 +0000 UTC m=+252.315368947 (durationBeforeRetry 2m2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/aa4feed6-27ad-493a-baa3-8d0d96cb5309-metrics-certs") pod "network-metrics-daemon-lt4g2" (UID: "aa4feed6-27ad-493a-baa3-8d0d96cb5309") : secret "metrics-daemon-secret" not found Jun 14 14:42:01.051846 ip-10-0-129-116 kubenswrapper[2546]: E0614 14:42:01.051790 2546 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[registry-tls], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-image-registry/image-registry-6b9bcff985-7lnrc" podUID="5a64bb81-61bc-42a1-bd11-55786121b7d8" Jun 14 14:42:01.057903 ip-10-0-129-116 kubenswrapper[2546]: E0614 14:42:01.057882 2546 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[metrics-tls], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-dns/dns-default-29vxk" podUID="11cc366c-4c61-4205-873a-3dcfcd341bf8" Jun 14 14:42:01.201617 ip-10-0-129-116 kubenswrapper[2546]: E0614 14:42:01.201569 2546 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[metrics-certs], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-multus/network-metrics-daemon-lt4g2" podUID="aa4feed6-27ad-493a-baa3-8d0d96cb5309" Jun 14 14:42:01.718307 ip-10-0-129-116 kubenswrapper[2546]: I0614 14:42:01.718279 2546 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-6b9bcff985-7lnrc" Jun 14 14:42:01.718459 ip-10-0-129-116 kubenswrapper[2546]: I0614 14:42:01.718284 2546 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-29vxk" Jun 14 14:42:06.020525 ip-10-0-129-116 kubenswrapper[2546]: I0614 14:42:06.020484 2546 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/11cc366c-4c61-4205-873a-3dcfcd341bf8-metrics-tls\") pod \"dns-default-29vxk\" (UID: \"11cc366c-4c61-4205-873a-3dcfcd341bf8\") " pod="openshift-dns/dns-default-29vxk" Jun 14 14:42:06.020525 ip-10-0-129-116 kubenswrapper[2546]: I0614 14:42:06.020525 2546 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/5a64bb81-61bc-42a1-bd11-55786121b7d8-registry-tls\") pod \"image-registry-6b9bcff985-7lnrc\" (UID: \"5a64bb81-61bc-42a1-bd11-55786121b7d8\") " pod="openshift-image-registry/image-registry-6b9bcff985-7lnrc" Jun 14 14:42:06.020951 ip-10-0-129-116 kubenswrapper[2546]: E0614 14:42:06.020618 2546 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jun 14 14:42:06.020951 ip-10-0-129-116 kubenswrapper[2546]: E0614 14:42:06.020622 2546 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jun 14 14:42:06.020951 ip-10-0-129-116 kubenswrapper[2546]: E0614 14:42:06.020682 2546 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/11cc366c-4c61-4205-873a-3dcfcd341bf8-metrics-tls podName:11cc366c-4c61-4205-873a-3dcfcd341bf8 nodeName:}" failed. No retries permitted until 2026-06-14 14:44:08.020665585 +0000 UTC m=+285.349047688 (durationBeforeRetry 2m2s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/11cc366c-4c61-4205-873a-3dcfcd341bf8-metrics-tls") pod "dns-default-29vxk" (UID: "11cc366c-4c61-4205-873a-3dcfcd341bf8") : secret "dns-default-metrics-tls" not found Jun 14 14:42:06.020951 ip-10-0-129-116 kubenswrapper[2546]: E0614 14:42:06.020629 2546 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-6b9bcff985-7lnrc: secret "image-registry-tls" not found Jun 14 14:42:06.020951 ip-10-0-129-116 kubenswrapper[2546]: E0614 14:42:06.020760 2546 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/5a64bb81-61bc-42a1-bd11-55786121b7d8-registry-tls podName:5a64bb81-61bc-42a1-bd11-55786121b7d8 nodeName:}" failed. No retries permitted until 2026-06-14 14:44:08.02074966 +0000 UTC m=+285.349131763 (durationBeforeRetry 2m2s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/5a64bb81-61bc-42a1-bd11-55786121b7d8-registry-tls") pod "image-registry-6b9bcff985-7lnrc" (UID: "5a64bb81-61bc-42a1-bd11-55786121b7d8") : secret "image-registry-tls" not found Jun 14 14:42:09.798194 ip-10-0-129-116 kubenswrapper[2546]: I0614 14:42:09.798161 2546 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c96gx_105377da-c223-41ad-b033-546cb01239c4/konnectivity-agent/0.log" limit=1024 Jun 14 14:42:12.184639 ip-10-0-129-116 kubenswrapper[2546]: I0614 14:42:12.184588 2546 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-lt4g2" Jun 14 14:42:41.282565 ip-10-0-129-116 kubenswrapper[2546]: I0614 14:42:41.282509 2546 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c96gx_105377da-c223-41ad-b033-546cb01239c4/konnectivity-agent/0.log" limit=1024 Jun 14 14:43:04.025466 ip-10-0-129-116 kubenswrapper[2546]: I0614 14:43:04.025432 2546 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-network-diagnostics/network-check-source-6947749cfc-w62qp"] Jun 14 14:43:04.029319 ip-10-0-129-116 kubenswrapper[2546]: I0614 14:43:04.029283 2546 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-network-console/networking-console-plugin-867b76cb74-kq2p9"] Jun 14 14:43:04.029645 ip-10-0-129-116 kubenswrapper[2546]: I0614 14:43:04.029590 2546 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-source-6947749cfc-w62qp" Jun 14 14:43:04.032408 ip-10-0-129-116 kubenswrapper[2546]: I0614 14:43:04.032382 2546 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"network-diagnostics-dockercfg-fj5dp\"" Jun 14 14:43:04.032514 ip-10-0-129-116 kubenswrapper[2546]: I0614 14:43:04.032487 2546 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-cluster-samples-operator/cluster-samples-operator-9547488fd-b9jnb"] Jun 14 14:43:04.032630 ip-10-0-129-116 kubenswrapper[2546]: I0614 14:43:04.032615 2546 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-console/networking-console-plugin-867b76cb74-kq2p9" Jun 14 14:43:04.034796 ip-10-0-129-116 kubenswrapper[2546]: I0614 14:43:04.034777 2546 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-console\"/\"networking-console-plugin-cert\"" Jun 14 14:43:04.034886 ip-10-0-129-116 kubenswrapper[2546]: I0614 14:43:04.034855 2546 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-console\"/\"networking-console-plugin\"" Jun 14 14:43:04.035145 ip-10-0-129-116 kubenswrapper[2546]: I0614 14:43:04.035076 2546 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-console\"/\"default-dockercfg-s474d\"" Jun 14 14:43:04.035248 ip-10-0-129-116 kubenswrapper[2546]: I0614 14:43:04.035142 2546 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/cluster-monitoring-operator-f9d7df769-5jzh2"] Jun 14 14:43:04.035358 ip-10-0-129-116 kubenswrapper[2546]: I0614 14:43:04.035340 2546 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-samples-operator/cluster-samples-operator-9547488fd-b9jnb" Jun 14 14:43:04.037811 ip-10-0-129-116 kubenswrapper[2546]: I0614 14:43:04.037785 2546 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-samples-operator\"/\"samples-operator-tls\"" Jun 14 14:43:04.037896 ip-10-0-129-116 kubenswrapper[2546]: I0614 14:43:04.037795 2546 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/cluster-monitoring-operator-f9d7df769-5jzh2" Jun 14 14:43:04.037896 ip-10-0-129-116 kubenswrapper[2546]: I0614 14:43:04.037874 2546 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-samples-operator\"/\"kube-root-ca.crt\"" Jun 14 14:43:04.038004 ip-10-0-129-116 kubenswrapper[2546]: I0614 14:43:04.037944 2546 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-samples-operator\"/\"openshift-service-ca.crt\"" Jun 14 14:43:04.038058 ip-10-0-129-116 kubenswrapper[2546]: I0614 14:43:04.037814 2546 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-samples-operator\"/\"cluster-samples-operator-dockercfg-ch8g8\"" Jun 14 14:43:04.040538 ip-10-0-129-116 kubenswrapper[2546]: I0614 14:43:04.040518 2546 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"cluster-monitoring-operator-dockercfg-fcv76\"" Jun 14 14:43:04.040640 ip-10-0-129-116 kubenswrapper[2546]: I0614 14:43:04.040587 2546 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kube-root-ca.crt\"" Jun 14 14:43:04.040837 ip-10-0-129-116 kubenswrapper[2546]: I0614 14:43:04.040818 2546 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-source-6947749cfc-w62qp"] Jun 14 14:43:04.041625 ip-10-0-129-116 kubenswrapper[2546]: I0614 14:43:04.041607 2546 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-console/networking-console-plugin-867b76cb74-kq2p9"] Jun 14 14:43:04.041872 ip-10-0-129-116 kubenswrapper[2546]: I0614 14:43:04.041854 2546 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"cluster-monitoring-operator-tls\"" Jun 14 14:43:04.041953 ip-10-0-129-116 kubenswrapper[2546]: I0614 14:43:04.041882 2546 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"telemetry-config\"" Jun 14 14:43:04.041953 ip-10-0-129-116 kubenswrapper[2546]: I0614 14:43:04.041863 2546 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"openshift-service-ca.crt\"" Jun 14 14:43:04.046308 ip-10-0-129-116 kubenswrapper[2546]: I0614 14:43:04.046287 2546 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-cluster-samples-operator/cluster-samples-operator-9547488fd-b9jnb"] Jun 14 14:43:04.053074 ip-10-0-129-116 kubenswrapper[2546]: I0614 14:43:04.053056 2546 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/cluster-monitoring-operator-f9d7df769-5jzh2"] Jun 14 14:43:04.115919 ip-10-0-129-116 kubenswrapper[2546]: I0614 14:43:04.115888 2546 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-service-ca-operator/service-ca-operator-7ccbfd59dc-z2rs6"] Jun 14 14:43:04.118682 ip-10-0-129-116 kubenswrapper[2546]: I0614 14:43:04.118668 2546 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-service-ca-operator/service-ca-operator-7ccbfd59dc-z2rs6" Jun 14 14:43:04.120932 ip-10-0-129-116 kubenswrapper[2546]: I0614 14:43:04.120910 2546 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2287x\" (UniqueName: \"kubernetes.io/projected/49242cb0-c73c-49c2-a92b-e52b6ba5c4af-kube-api-access-2287x\") pod \"network-check-source-6947749cfc-w62qp\" (UID: \"49242cb0-c73c-49c2-a92b-e52b6ba5c4af\") " pod="openshift-network-diagnostics/network-check-source-6947749cfc-w62qp" Jun 14 14:43:04.121014 ip-10-0-129-116 kubenswrapper[2546]: I0614 14:43:04.120917 2546 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-service-ca-operator\"/\"serving-cert\"" Jun 14 14:43:04.121238 ip-10-0-129-116 kubenswrapper[2546]: I0614 14:43:04.121222 2546 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca-operator\"/\"service-ca-operator-config\"" Jun 14 14:43:04.121556 ip-10-0-129-116 kubenswrapper[2546]: I0614 14:43:04.121540 2546 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca-operator\"/\"openshift-service-ca.crt\"" Jun 14 14:43:04.121612 ip-10-0-129-116 kubenswrapper[2546]: I0614 14:43:04.121588 2546 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca-operator\"/\"kube-root-ca.crt\"" Jun 14 14:43:04.121651 ip-10-0-129-116 kubenswrapper[2546]: I0614 14:43:04.121610 2546 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-service-ca-operator\"/\"service-ca-operator-dockercfg-pdpqk\"" Jun 14 14:43:04.122973 ip-10-0-129-116 kubenswrapper[2546]: I0614 14:43:04.122942 2546 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/router-default-5f9f5d888-dlm5r"] Jun 14 14:43:04.125727 ip-10-0-129-116 kubenswrapper[2546]: I0614 14:43:04.125708 2546 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/router-default-5f9f5d888-dlm5r" Jun 14 14:43:04.128010 ip-10-0-129-116 kubenswrapper[2546]: I0614 14:43:04.127990 2546 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"router-metrics-certs-default\"" Jun 14 14:43:04.128123 ip-10-0-129-116 kubenswrapper[2546]: I0614 14:43:04.128107 2546 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"service-ca-bundle\"" Jun 14 14:43:04.128189 ip-10-0-129-116 kubenswrapper[2546]: I0614 14:43:04.128110 2546 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"default-ingress-cert\"" Jun 14 14:43:04.129499 ip-10-0-129-116 kubenswrapper[2546]: I0614 14:43:04.129481 2546 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"router-stats-default\"" Jun 14 14:43:04.129499 ip-10-0-129-116 kubenswrapper[2546]: I0614 14:43:04.129498 2546 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"kube-root-ca.crt\"" Jun 14 14:43:04.129657 ip-10-0-129-116 kubenswrapper[2546]: I0614 14:43:04.129509 2546 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-service-ca.crt\"" Jun 14 14:43:04.129777 ip-10-0-129-116 kubenswrapper[2546]: I0614 14:43:04.129761 2546 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"router-dockercfg-jrdhw\"" Jun 14 14:43:04.130763 ip-10-0-129-116 kubenswrapper[2546]: I0614 14:43:04.130741 2546 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-service-ca-operator/service-ca-operator-7ccbfd59dc-z2rs6"] Jun 14 14:43:04.140486 ip-10-0-129-116 kubenswrapper[2546]: I0614 14:43:04.140461 2546 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/router-default-5f9f5d888-dlm5r"] Jun 14 14:43:04.221840 ip-10-0-129-116 kubenswrapper[2546]: I0614 14:43:04.221811 2546 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4nrnz\" (UniqueName: \"kubernetes.io/projected/fe19844a-27c5-471a-b03d-867b9eb90582-kube-api-access-4nrnz\") pod \"service-ca-operator-7ccbfd59dc-z2rs6\" (UID: \"fe19844a-27c5-471a-b03d-867b9eb90582\") " pod="openshift-service-ca-operator/service-ca-operator-7ccbfd59dc-z2rs6" Jun 14 14:43:04.221840 ip-10-0-129-116 kubenswrapper[2546]: I0614 14:43:04.221845 2546 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-q6gf6\" (UniqueName: \"kubernetes.io/projected/3ede30b3-6f71-4b5c-a643-5efa6c254e1c-kube-api-access-q6gf6\") pod \"cluster-monitoring-operator-f9d7df769-5jzh2\" (UID: \"3ede30b3-6f71-4b5c-a643-5efa6c254e1c\") " pod="openshift-monitoring/cluster-monitoring-operator-f9d7df769-5jzh2" Jun 14 14:43:04.222035 ip-10-0-129-116 kubenswrapper[2546]: I0614 14:43:04.221863 2546 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ld5z9\" (UniqueName: \"kubernetes.io/projected/14fb6e1b-853d-4107-b6b6-22d47cb7619c-kube-api-access-ld5z9\") pod \"router-default-5f9f5d888-dlm5r\" (UID: \"14fb6e1b-853d-4107-b6b6-22d47cb7619c\") " pod="openshift-ingress/router-default-5f9f5d888-dlm5r" Jun 14 14:43:04.222035 ip-10-0-129-116 kubenswrapper[2546]: I0614 14:43:04.221913 2546 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/14fb6e1b-853d-4107-b6b6-22d47cb7619c-service-ca-bundle\") pod \"router-default-5f9f5d888-dlm5r\" (UID: \"14fb6e1b-853d-4107-b6b6-22d47cb7619c\") " pod="openshift-ingress/router-default-5f9f5d888-dlm5r" Jun 14 14:43:04.222035 ip-10-0-129-116 kubenswrapper[2546]: I0614 14:43:04.221945 2546 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/14fb6e1b-853d-4107-b6b6-22d47cb7619c-metrics-certs\") pod \"router-default-5f9f5d888-dlm5r\" (UID: \"14fb6e1b-853d-4107-b6b6-22d47cb7619c\") " pod="openshift-ingress/router-default-5f9f5d888-dlm5r" Jun 14 14:43:04.222035 ip-10-0-129-116 kubenswrapper[2546]: I0614 14:43:04.221981 2546 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2287x\" (UniqueName: \"kubernetes.io/projected/49242cb0-c73c-49c2-a92b-e52b6ba5c4af-kube-api-access-2287x\") pod \"network-check-source-6947749cfc-w62qp\" (UID: \"49242cb0-c73c-49c2-a92b-e52b6ba5c4af\") " pod="openshift-network-diagnostics/network-check-source-6947749cfc-w62qp" Jun 14 14:43:04.222035 ip-10-0-129-116 kubenswrapper[2546]: I0614 14:43:04.222001 2546 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/e4181a2d-85c6-497b-99d9-1d2342894e9c-samples-operator-tls\") pod \"cluster-samples-operator-9547488fd-b9jnb\" (UID: \"e4181a2d-85c6-497b-99d9-1d2342894e9c\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-9547488fd-b9jnb" Jun 14 14:43:04.222035 ip-10-0-129-116 kubenswrapper[2546]: I0614 14:43:04.222021 2546 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/fe19844a-27c5-471a-b03d-867b9eb90582-serving-cert\") pod \"service-ca-operator-7ccbfd59dc-z2rs6\" (UID: \"fe19844a-27c5-471a-b03d-867b9eb90582\") " pod="openshift-service-ca-operator/service-ca-operator-7ccbfd59dc-z2rs6" Jun 14 14:43:04.222328 ip-10-0-129-116 kubenswrapper[2546]: I0614 14:43:04.222041 2546 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/3ede30b3-6f71-4b5c-a643-5efa6c254e1c-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-f9d7df769-5jzh2\" (UID: \"3ede30b3-6f71-4b5c-a643-5efa6c254e1c\") " pod="openshift-monitoring/cluster-monitoring-operator-f9d7df769-5jzh2" Jun 14 14:43:04.222328 ip-10-0-129-116 kubenswrapper[2546]: I0614 14:43:04.222070 2546 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"telemetry-config\" (UniqueName: \"kubernetes.io/configmap/3ede30b3-6f71-4b5c-a643-5efa6c254e1c-telemetry-config\") pod \"cluster-monitoring-operator-f9d7df769-5jzh2\" (UID: \"3ede30b3-6f71-4b5c-a643-5efa6c254e1c\") " pod="openshift-monitoring/cluster-monitoring-operator-f9d7df769-5jzh2" Jun 14 14:43:04.222328 ip-10-0-129-116 kubenswrapper[2546]: I0614 14:43:04.222121 2546 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/7ae514d0-80e9-44d6-b358-84e57fe9d353-networking-console-plugin-cert\") pod \"networking-console-plugin-867b76cb74-kq2p9\" (UID: \"7ae514d0-80e9-44d6-b358-84e57fe9d353\") " pod="openshift-network-console/networking-console-plugin-867b76cb74-kq2p9" Jun 14 14:43:04.222328 ip-10-0-129-116 kubenswrapper[2546]: I0614 14:43:04.222139 2546 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"default-certificate\" (UniqueName: \"kubernetes.io/secret/14fb6e1b-853d-4107-b6b6-22d47cb7619c-default-certificate\") pod \"router-default-5f9f5d888-dlm5r\" (UID: \"14fb6e1b-853d-4107-b6b6-22d47cb7619c\") " pod="openshift-ingress/router-default-5f9f5d888-dlm5r" Jun 14 14:43:04.222328 ip-10-0-129-116 kubenswrapper[2546]: I0614 14:43:04.222241 2546 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/fe19844a-27c5-471a-b03d-867b9eb90582-config\") pod \"service-ca-operator-7ccbfd59dc-z2rs6\" (UID: \"fe19844a-27c5-471a-b03d-867b9eb90582\") " pod="openshift-service-ca-operator/service-ca-operator-7ccbfd59dc-z2rs6" Jun 14 14:43:04.222328 ip-10-0-129-116 kubenswrapper[2546]: I0614 14:43:04.222278 2546 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/7ae514d0-80e9-44d6-b358-84e57fe9d353-nginx-conf\") pod \"networking-console-plugin-867b76cb74-kq2p9\" (UID: \"7ae514d0-80e9-44d6-b358-84e57fe9d353\") " pod="openshift-network-console/networking-console-plugin-867b76cb74-kq2p9" Jun 14 14:43:04.222328 ip-10-0-129-116 kubenswrapper[2546]: I0614 14:43:04.222308 2546 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-n7fg9\" (UniqueName: \"kubernetes.io/projected/e4181a2d-85c6-497b-99d9-1d2342894e9c-kube-api-access-n7fg9\") pod \"cluster-samples-operator-9547488fd-b9jnb\" (UID: \"e4181a2d-85c6-497b-99d9-1d2342894e9c\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-9547488fd-b9jnb" Jun 14 14:43:04.222562 ip-10-0-129-116 kubenswrapper[2546]: I0614 14:43:04.222333 2546 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"stats-auth\" (UniqueName: \"kubernetes.io/secret/14fb6e1b-853d-4107-b6b6-22d47cb7619c-stats-auth\") pod \"router-default-5f9f5d888-dlm5r\" (UID: \"14fb6e1b-853d-4107-b6b6-22d47cb7619c\") " pod="openshift-ingress/router-default-5f9f5d888-dlm5r" Jun 14 14:43:04.237333 ip-10-0-129-116 kubenswrapper[2546]: I0614 14:43:04.237306 2546 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-2287x\" (UniqueName: \"kubernetes.io/projected/49242cb0-c73c-49c2-a92b-e52b6ba5c4af-kube-api-access-2287x\") pod \"network-check-source-6947749cfc-w62qp\" (UID: \"49242cb0-c73c-49c2-a92b-e52b6ba5c4af\") " pod="openshift-network-diagnostics/network-check-source-6947749cfc-w62qp" Jun 14 14:43:04.258486 ip-10-0-129-116 kubenswrapper[2546]: I0614 14:43:04.258445 2546 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c96gx_105377da-c223-41ad-b033-546cb01239c4/konnectivity-agent/0.log" limit=1024 Jun 14 14:43:04.306811 ip-10-0-129-116 kubenswrapper[2546]: I0614 14:43:04.306741 2546 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c96gx_105377da-c223-41ad-b033-546cb01239c4/konnectivity-agent/0.log" limit=1024 Jun 14 14:43:04.323117 ip-10-0-129-116 kubenswrapper[2546]: I0614 14:43:04.323079 2546 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/fe19844a-27c5-471a-b03d-867b9eb90582-config\") pod \"service-ca-operator-7ccbfd59dc-z2rs6\" (UID: \"fe19844a-27c5-471a-b03d-867b9eb90582\") " pod="openshift-service-ca-operator/service-ca-operator-7ccbfd59dc-z2rs6" Jun 14 14:43:04.323272 ip-10-0-129-116 kubenswrapper[2546]: I0614 14:43:04.323123 2546 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/7ae514d0-80e9-44d6-b358-84e57fe9d353-nginx-conf\") pod \"networking-console-plugin-867b76cb74-kq2p9\" (UID: \"7ae514d0-80e9-44d6-b358-84e57fe9d353\") " pod="openshift-network-console/networking-console-plugin-867b76cb74-kq2p9" Jun 14 14:43:04.323272 ip-10-0-129-116 kubenswrapper[2546]: I0614 14:43:04.323145 2546 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-n7fg9\" (UniqueName: \"kubernetes.io/projected/e4181a2d-85c6-497b-99d9-1d2342894e9c-kube-api-access-n7fg9\") pod \"cluster-samples-operator-9547488fd-b9jnb\" (UID: \"e4181a2d-85c6-497b-99d9-1d2342894e9c\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-9547488fd-b9jnb" Jun 14 14:43:04.323272 ip-10-0-129-116 kubenswrapper[2546]: I0614 14:43:04.323163 2546 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"stats-auth\" (UniqueName: \"kubernetes.io/secret/14fb6e1b-853d-4107-b6b6-22d47cb7619c-stats-auth\") pod \"router-default-5f9f5d888-dlm5r\" (UID: \"14fb6e1b-853d-4107-b6b6-22d47cb7619c\") " pod="openshift-ingress/router-default-5f9f5d888-dlm5r" Jun 14 14:43:04.323272 ip-10-0-129-116 kubenswrapper[2546]: I0614 14:43:04.323181 2546 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4nrnz\" (UniqueName: \"kubernetes.io/projected/fe19844a-27c5-471a-b03d-867b9eb90582-kube-api-access-4nrnz\") pod \"service-ca-operator-7ccbfd59dc-z2rs6\" (UID: \"fe19844a-27c5-471a-b03d-867b9eb90582\") " pod="openshift-service-ca-operator/service-ca-operator-7ccbfd59dc-z2rs6" Jun 14 14:43:04.323272 ip-10-0-129-116 kubenswrapper[2546]: I0614 14:43:04.323202 2546 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-q6gf6\" (UniqueName: \"kubernetes.io/projected/3ede30b3-6f71-4b5c-a643-5efa6c254e1c-kube-api-access-q6gf6\") pod \"cluster-monitoring-operator-f9d7df769-5jzh2\" (UID: \"3ede30b3-6f71-4b5c-a643-5efa6c254e1c\") " pod="openshift-monitoring/cluster-monitoring-operator-f9d7df769-5jzh2" Jun 14 14:43:04.323272 ip-10-0-129-116 kubenswrapper[2546]: I0614 14:43:04.323224 2546 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ld5z9\" (UniqueName: \"kubernetes.io/projected/14fb6e1b-853d-4107-b6b6-22d47cb7619c-kube-api-access-ld5z9\") pod \"router-default-5f9f5d888-dlm5r\" (UID: \"14fb6e1b-853d-4107-b6b6-22d47cb7619c\") " pod="openshift-ingress/router-default-5f9f5d888-dlm5r" Jun 14 14:43:04.323272 ip-10-0-129-116 kubenswrapper[2546]: I0614 14:43:04.323256 2546 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/14fb6e1b-853d-4107-b6b6-22d47cb7619c-service-ca-bundle\") pod \"router-default-5f9f5d888-dlm5r\" (UID: \"14fb6e1b-853d-4107-b6b6-22d47cb7619c\") " pod="openshift-ingress/router-default-5f9f5d888-dlm5r" Jun 14 14:43:04.323794 ip-10-0-129-116 kubenswrapper[2546]: E0614 14:43:04.323366 2546 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/14fb6e1b-853d-4107-b6b6-22d47cb7619c-service-ca-bundle podName:14fb6e1b-853d-4107-b6b6-22d47cb7619c nodeName:}" failed. No retries permitted until 2026-06-14 14:43:04.823346489 +0000 UTC m=+222.151728609 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/14fb6e1b-853d-4107-b6b6-22d47cb7619c-service-ca-bundle") pod "router-default-5f9f5d888-dlm5r" (UID: "14fb6e1b-853d-4107-b6b6-22d47cb7619c") : configmap references non-existent config key: service-ca.crt Jun 14 14:43:04.323794 ip-10-0-129-116 kubenswrapper[2546]: I0614 14:43:04.323384 2546 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/14fb6e1b-853d-4107-b6b6-22d47cb7619c-metrics-certs\") pod \"router-default-5f9f5d888-dlm5r\" (UID: \"14fb6e1b-853d-4107-b6b6-22d47cb7619c\") " pod="openshift-ingress/router-default-5f9f5d888-dlm5r" Jun 14 14:43:04.323794 ip-10-0-129-116 kubenswrapper[2546]: I0614 14:43:04.323427 2546 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/e4181a2d-85c6-497b-99d9-1d2342894e9c-samples-operator-tls\") pod \"cluster-samples-operator-9547488fd-b9jnb\" (UID: \"e4181a2d-85c6-497b-99d9-1d2342894e9c\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-9547488fd-b9jnb" Jun 14 14:43:04.323794 ip-10-0-129-116 kubenswrapper[2546]: I0614 14:43:04.323462 2546 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/fe19844a-27c5-471a-b03d-867b9eb90582-serving-cert\") pod \"service-ca-operator-7ccbfd59dc-z2rs6\" (UID: \"fe19844a-27c5-471a-b03d-867b9eb90582\") " pod="openshift-service-ca-operator/service-ca-operator-7ccbfd59dc-z2rs6" Jun 14 14:43:04.323794 ip-10-0-129-116 kubenswrapper[2546]: I0614 14:43:04.323507 2546 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/3ede30b3-6f71-4b5c-a643-5efa6c254e1c-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-f9d7df769-5jzh2\" (UID: \"3ede30b3-6f71-4b5c-a643-5efa6c254e1c\") " pod="openshift-monitoring/cluster-monitoring-operator-f9d7df769-5jzh2" Jun 14 14:43:04.323794 ip-10-0-129-116 kubenswrapper[2546]: I0614 14:43:04.323538 2546 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"telemetry-config\" (UniqueName: \"kubernetes.io/configmap/3ede30b3-6f71-4b5c-a643-5efa6c254e1c-telemetry-config\") pod \"cluster-monitoring-operator-f9d7df769-5jzh2\" (UID: \"3ede30b3-6f71-4b5c-a643-5efa6c254e1c\") " pod="openshift-monitoring/cluster-monitoring-operator-f9d7df769-5jzh2" Jun 14 14:43:04.323794 ip-10-0-129-116 kubenswrapper[2546]: E0614 14:43:04.323546 2546 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found Jun 14 14:43:04.323794 ip-10-0-129-116 kubenswrapper[2546]: E0614 14:43:04.323574 2546 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found Jun 14 14:43:04.323794 ip-10-0-129-116 kubenswrapper[2546]: E0614 14:43:04.323600 2546 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/14fb6e1b-853d-4107-b6b6-22d47cb7619c-metrics-certs podName:14fb6e1b-853d-4107-b6b6-22d47cb7619c nodeName:}" failed. No retries permitted until 2026-06-14 14:43:04.823585615 +0000 UTC m=+222.151967724 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/14fb6e1b-853d-4107-b6b6-22d47cb7619c-metrics-certs") pod "router-default-5f9f5d888-dlm5r" (UID: "14fb6e1b-853d-4107-b6b6-22d47cb7619c") : secret "router-metrics-certs-default" not found Jun 14 14:43:04.323794 ip-10-0-129-116 kubenswrapper[2546]: E0614 14:43:04.323609 2546 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found Jun 14 14:43:04.323794 ip-10-0-129-116 kubenswrapper[2546]: E0614 14:43:04.323625 2546 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e4181a2d-85c6-497b-99d9-1d2342894e9c-samples-operator-tls podName:e4181a2d-85c6-497b-99d9-1d2342894e9c nodeName:}" failed. No retries permitted until 2026-06-14 14:43:04.82360848 +0000 UTC m=+222.151990593 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/e4181a2d-85c6-497b-99d9-1d2342894e9c-samples-operator-tls") pod "cluster-samples-operator-9547488fd-b9jnb" (UID: "e4181a2d-85c6-497b-99d9-1d2342894e9c") : secret "samples-operator-tls" not found Jun 14 14:43:04.323794 ip-10-0-129-116 kubenswrapper[2546]: I0614 14:43:04.323676 2546 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/7ae514d0-80e9-44d6-b358-84e57fe9d353-networking-console-plugin-cert\") pod \"networking-console-plugin-867b76cb74-kq2p9\" (UID: \"7ae514d0-80e9-44d6-b358-84e57fe9d353\") " pod="openshift-network-console/networking-console-plugin-867b76cb74-kq2p9" Jun 14 14:43:04.323794 ip-10-0-129-116 kubenswrapper[2546]: I0614 14:43:04.323710 2546 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/configmap/fe19844a-27c5-471a-b03d-867b9eb90582-config\") pod \"service-ca-operator-7ccbfd59dc-z2rs6\" (UID: \"fe19844a-27c5-471a-b03d-867b9eb90582\") " pod="openshift-service-ca-operator/service-ca-operator-7ccbfd59dc-z2rs6" Jun 14 14:43:04.323794 ip-10-0-129-116 kubenswrapper[2546]: E0614 14:43:04.323715 2546 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/3ede30b3-6f71-4b5c-a643-5efa6c254e1c-cluster-monitoring-operator-tls podName:3ede30b3-6f71-4b5c-a643-5efa6c254e1c nodeName:}" failed. No retries permitted until 2026-06-14 14:43:04.82369872 +0000 UTC m=+222.152080830 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/3ede30b3-6f71-4b5c-a643-5efa6c254e1c-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-f9d7df769-5jzh2" (UID: "3ede30b3-6f71-4b5c-a643-5efa6c254e1c") : secret "cluster-monitoring-operator-tls" not found Jun 14 14:43:04.323794 ip-10-0-129-116 kubenswrapper[2546]: E0614 14:43:04.323747 2546 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found Jun 14 14:43:04.324646 ip-10-0-129-116 kubenswrapper[2546]: I0614 14:43:04.323758 2546 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"default-certificate\" (UniqueName: \"kubernetes.io/secret/14fb6e1b-853d-4107-b6b6-22d47cb7619c-default-certificate\") pod \"router-default-5f9f5d888-dlm5r\" (UID: \"14fb6e1b-853d-4107-b6b6-22d47cb7619c\") " pod="openshift-ingress/router-default-5f9f5d888-dlm5r" Jun 14 14:43:04.324646 ip-10-0-129-116 kubenswrapper[2546]: E0614 14:43:04.323782 2546 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/7ae514d0-80e9-44d6-b358-84e57fe9d353-networking-console-plugin-cert podName:7ae514d0-80e9-44d6-b358-84e57fe9d353 nodeName:}" failed. No retries permitted until 2026-06-14 14:43:04.823771709 +0000 UTC m=+222.152153858 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/7ae514d0-80e9-44d6-b358-84e57fe9d353-networking-console-plugin-cert") pod "networking-console-plugin-867b76cb74-kq2p9" (UID: "7ae514d0-80e9-44d6-b358-84e57fe9d353") : secret "networking-console-plugin-cert" not found Jun 14 14:43:04.324646 ip-10-0-129-116 kubenswrapper[2546]: I0614 14:43:04.324220 2546 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/7ae514d0-80e9-44d6-b358-84e57fe9d353-nginx-conf\") pod \"networking-console-plugin-867b76cb74-kq2p9\" (UID: \"7ae514d0-80e9-44d6-b358-84e57fe9d353\") " pod="openshift-network-console/networking-console-plugin-867b76cb74-kq2p9" Jun 14 14:43:04.324646 ip-10-0-129-116 kubenswrapper[2546]: I0614 14:43:04.324273 2546 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"telemetry-config\" (UniqueName: \"kubernetes.io/configmap/3ede30b3-6f71-4b5c-a643-5efa6c254e1c-telemetry-config\") pod \"cluster-monitoring-operator-f9d7df769-5jzh2\" (UID: \"3ede30b3-6f71-4b5c-a643-5efa6c254e1c\") " pod="openshift-monitoring/cluster-monitoring-operator-f9d7df769-5jzh2" Jun 14 14:43:04.325829 ip-10-0-129-116 kubenswrapper[2546]: I0614 14:43:04.325805 2546 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/fe19844a-27c5-471a-b03d-867b9eb90582-serving-cert\") pod \"service-ca-operator-7ccbfd59dc-z2rs6\" (UID: \"fe19844a-27c5-471a-b03d-867b9eb90582\") " pod="openshift-service-ca-operator/service-ca-operator-7ccbfd59dc-z2rs6" Jun 14 14:43:04.325910 ip-10-0-129-116 kubenswrapper[2546]: I0614 14:43:04.325840 2546 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"stats-auth\" (UniqueName: \"kubernetes.io/secret/14fb6e1b-853d-4107-b6b6-22d47cb7619c-stats-auth\") pod \"router-default-5f9f5d888-dlm5r\" (UID: \"14fb6e1b-853d-4107-b6b6-22d47cb7619c\") " pod="openshift-ingress/router-default-5f9f5d888-dlm5r" Jun 14 14:43:04.326070 ip-10-0-129-116 kubenswrapper[2546]: I0614 14:43:04.326054 2546 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"default-certificate\" (UniqueName: \"kubernetes.io/secret/14fb6e1b-853d-4107-b6b6-22d47cb7619c-default-certificate\") pod \"router-default-5f9f5d888-dlm5r\" (UID: \"14fb6e1b-853d-4107-b6b6-22d47cb7619c\") " pod="openshift-ingress/router-default-5f9f5d888-dlm5r" Jun 14 14:43:04.331582 ip-10-0-129-116 kubenswrapper[2546]: I0614 14:43:04.331557 2546 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-ld5z9\" (UniqueName: \"kubernetes.io/projected/14fb6e1b-853d-4107-b6b6-22d47cb7619c-kube-api-access-ld5z9\") pod \"router-default-5f9f5d888-dlm5r\" (UID: \"14fb6e1b-853d-4107-b6b6-22d47cb7619c\") " pod="openshift-ingress/router-default-5f9f5d888-dlm5r" Jun 14 14:43:04.332914 ip-10-0-129-116 kubenswrapper[2546]: I0614 14:43:04.332889 2546 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-q6gf6\" (UniqueName: \"kubernetes.io/projected/3ede30b3-6f71-4b5c-a643-5efa6c254e1c-kube-api-access-q6gf6\") pod \"cluster-monitoring-operator-f9d7df769-5jzh2\" (UID: \"3ede30b3-6f71-4b5c-a643-5efa6c254e1c\") " pod="openshift-monitoring/cluster-monitoring-operator-f9d7df769-5jzh2" Jun 14 14:43:04.333006 ip-10-0-129-116 kubenswrapper[2546]: I0614 14:43:04.332938 2546 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-4nrnz\" (UniqueName: \"kubernetes.io/projected/fe19844a-27c5-471a-b03d-867b9eb90582-kube-api-access-4nrnz\") pod \"service-ca-operator-7ccbfd59dc-z2rs6\" (UID: \"fe19844a-27c5-471a-b03d-867b9eb90582\") " pod="openshift-service-ca-operator/service-ca-operator-7ccbfd59dc-z2rs6" Jun 14 14:43:04.333491 ip-10-0-129-116 kubenswrapper[2546]: I0614 14:43:04.333471 2546 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-n7fg9\" (UniqueName: \"kubernetes.io/projected/e4181a2d-85c6-497b-99d9-1d2342894e9c-kube-api-access-n7fg9\") pod \"cluster-samples-operator-9547488fd-b9jnb\" (UID: \"e4181a2d-85c6-497b-99d9-1d2342894e9c\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-9547488fd-b9jnb" Jun 14 14:43:04.340225 ip-10-0-129-116 kubenswrapper[2546]: I0614 14:43:04.340204 2546 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-source-6947749cfc-w62qp" Jun 14 14:43:04.427552 ip-10-0-129-116 kubenswrapper[2546]: I0614 14:43:04.427525 2546 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-service-ca-operator/service-ca-operator-7ccbfd59dc-z2rs6" Jun 14 14:43:04.461533 ip-10-0-129-116 kubenswrapper[2546]: I0614 14:43:04.461506 2546 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-source-6947749cfc-w62qp"] Jun 14 14:43:04.464591 ip-10-0-129-116 kubenswrapper[2546]: W0614 14:43:04.464558 2546 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod49242cb0_c73c_49c2_a92b_e52b6ba5c4af.slice/crio-ea156bc31a21e8a69c7113f4ea783b24ba2df8f805496789ac99277ad9932db2 WatchSource:0}: Error finding container ea156bc31a21e8a69c7113f4ea783b24ba2df8f805496789ac99277ad9932db2: Status 404 returned error can't find the container with id ea156bc31a21e8a69c7113f4ea783b24ba2df8f805496789ac99277ad9932db2 Jun 14 14:43:04.553284 ip-10-0-129-116 kubenswrapper[2546]: I0614 14:43:04.553248 2546 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-service-ca-operator/service-ca-operator-7ccbfd59dc-z2rs6"] Jun 14 14:43:04.556803 ip-10-0-129-116 kubenswrapper[2546]: W0614 14:43:04.556770 2546 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podfe19844a_27c5_471a_b03d_867b9eb90582.slice/crio-6b3dee37053dfa71b75d0847412406882a9999add1531563889dc9dcdc53aced WatchSource:0}: Error finding container 6b3dee37053dfa71b75d0847412406882a9999add1531563889dc9dcdc53aced: Status 404 returned error can't find the container with id 6b3dee37053dfa71b75d0847412406882a9999add1531563889dc9dcdc53aced Jun 14 14:43:04.827719 ip-10-0-129-116 kubenswrapper[2546]: I0614 14:43:04.827631 2546 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/14fb6e1b-853d-4107-b6b6-22d47cb7619c-service-ca-bundle\") pod \"router-default-5f9f5d888-dlm5r\" (UID: \"14fb6e1b-853d-4107-b6b6-22d47cb7619c\") " pod="openshift-ingress/router-default-5f9f5d888-dlm5r" Jun 14 14:43:04.827719 ip-10-0-129-116 kubenswrapper[2546]: I0614 14:43:04.827674 2546 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/14fb6e1b-853d-4107-b6b6-22d47cb7619c-metrics-certs\") pod \"router-default-5f9f5d888-dlm5r\" (UID: \"14fb6e1b-853d-4107-b6b6-22d47cb7619c\") " pod="openshift-ingress/router-default-5f9f5d888-dlm5r" Jun 14 14:43:04.827719 ip-10-0-129-116 kubenswrapper[2546]: I0614 14:43:04.827705 2546 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/e4181a2d-85c6-497b-99d9-1d2342894e9c-samples-operator-tls\") pod \"cluster-samples-operator-9547488fd-b9jnb\" (UID: \"e4181a2d-85c6-497b-99d9-1d2342894e9c\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-9547488fd-b9jnb" Jun 14 14:43:04.827914 ip-10-0-129-116 kubenswrapper[2546]: I0614 14:43:04.827731 2546 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/3ede30b3-6f71-4b5c-a643-5efa6c254e1c-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-f9d7df769-5jzh2\" (UID: \"3ede30b3-6f71-4b5c-a643-5efa6c254e1c\") " pod="openshift-monitoring/cluster-monitoring-operator-f9d7df769-5jzh2" Jun 14 14:43:04.828252 ip-10-0-129-116 kubenswrapper[2546]: E0614 14:43:04.828231 2546 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/14fb6e1b-853d-4107-b6b6-22d47cb7619c-service-ca-bundle podName:14fb6e1b-853d-4107-b6b6-22d47cb7619c nodeName:}" failed. No retries permitted until 2026-06-14 14:43:05.828199039 +0000 UTC m=+223.156581142 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/14fb6e1b-853d-4107-b6b6-22d47cb7619c-service-ca-bundle") pod "router-default-5f9f5d888-dlm5r" (UID: "14fb6e1b-853d-4107-b6b6-22d47cb7619c") : configmap references non-existent config key: service-ca.crt Jun 14 14:43:04.828354 ip-10-0-129-116 kubenswrapper[2546]: E0614 14:43:04.828260 2546 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found Jun 14 14:43:04.828354 ip-10-0-129-116 kubenswrapper[2546]: E0614 14:43:04.828294 2546 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found Jun 14 14:43:04.828354 ip-10-0-129-116 kubenswrapper[2546]: E0614 14:43:04.828330 2546 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/3ede30b3-6f71-4b5c-a643-5efa6c254e1c-cluster-monitoring-operator-tls podName:3ede30b3-6f71-4b5c-a643-5efa6c254e1c nodeName:}" failed. No retries permitted until 2026-06-14 14:43:05.828313438 +0000 UTC m=+223.156695563 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/3ede30b3-6f71-4b5c-a643-5efa6c254e1c-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-f9d7df769-5jzh2" (UID: "3ede30b3-6f71-4b5c-a643-5efa6c254e1c") : secret "cluster-monitoring-operator-tls" not found Jun 14 14:43:04.828354 ip-10-0-129-116 kubenswrapper[2546]: I0614 14:43:04.828320 2546 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/7ae514d0-80e9-44d6-b358-84e57fe9d353-networking-console-plugin-cert\") pod \"networking-console-plugin-867b76cb74-kq2p9\" (UID: \"7ae514d0-80e9-44d6-b358-84e57fe9d353\") " pod="openshift-network-console/networking-console-plugin-867b76cb74-kq2p9" Jun 14 14:43:04.828354 ip-10-0-129-116 kubenswrapper[2546]: E0614 14:43:04.828355 2546 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/14fb6e1b-853d-4107-b6b6-22d47cb7619c-metrics-certs podName:14fb6e1b-853d-4107-b6b6-22d47cb7619c nodeName:}" failed. No retries permitted until 2026-06-14 14:43:05.828338182 +0000 UTC m=+223.156720286 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/14fb6e1b-853d-4107-b6b6-22d47cb7619c-metrics-certs") pod "router-default-5f9f5d888-dlm5r" (UID: "14fb6e1b-853d-4107-b6b6-22d47cb7619c") : secret "router-metrics-certs-default" not found Jun 14 14:43:04.828586 ip-10-0-129-116 kubenswrapper[2546]: E0614 14:43:04.828389 2546 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found Jun 14 14:43:04.828586 ip-10-0-129-116 kubenswrapper[2546]: E0614 14:43:04.828436 2546 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found Jun 14 14:43:04.828586 ip-10-0-129-116 kubenswrapper[2546]: E0614 14:43:04.828493 2546 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e4181a2d-85c6-497b-99d9-1d2342894e9c-samples-operator-tls podName:e4181a2d-85c6-497b-99d9-1d2342894e9c nodeName:}" failed. No retries permitted until 2026-06-14 14:43:05.828468953 +0000 UTC m=+223.156851063 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/e4181a2d-85c6-497b-99d9-1d2342894e9c-samples-operator-tls") pod "cluster-samples-operator-9547488fd-b9jnb" (UID: "e4181a2d-85c6-497b-99d9-1d2342894e9c") : secret "samples-operator-tls" not found Jun 14 14:43:04.828586 ip-10-0-129-116 kubenswrapper[2546]: E0614 14:43:04.828529 2546 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/7ae514d0-80e9-44d6-b358-84e57fe9d353-networking-console-plugin-cert podName:7ae514d0-80e9-44d6-b358-84e57fe9d353 nodeName:}" failed. No retries permitted until 2026-06-14 14:43:05.828509999 +0000 UTC m=+223.156892103 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/7ae514d0-80e9-44d6-b358-84e57fe9d353-networking-console-plugin-cert") pod "networking-console-plugin-867b76cb74-kq2p9" (UID: "7ae514d0-80e9-44d6-b358-84e57fe9d353") : secret "networking-console-plugin-cert" not found Jun 14 14:43:04.864133 ip-10-0-129-116 kubenswrapper[2546]: I0614 14:43:04.864101 2546 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca-operator/service-ca-operator-7ccbfd59dc-z2rs6" event={"ID":"fe19844a-27c5-471a-b03d-867b9eb90582","Type":"ContainerStarted","Data":"6b3dee37053dfa71b75d0847412406882a9999add1531563889dc9dcdc53aced"} Jun 14 14:43:04.865483 ip-10-0-129-116 kubenswrapper[2546]: I0614 14:43:04.865459 2546 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-source-6947749cfc-w62qp" event={"ID":"49242cb0-c73c-49c2-a92b-e52b6ba5c4af","Type":"ContainerStarted","Data":"81c3b45e5318b7132715e49e92f64e02b9aabb8247d760ac292657570c67af7f"} Jun 14 14:43:04.865615 ip-10-0-129-116 kubenswrapper[2546]: I0614 14:43:04.865494 2546 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-source-6947749cfc-w62qp" event={"ID":"49242cb0-c73c-49c2-a92b-e52b6ba5c4af","Type":"ContainerStarted","Data":"ea156bc31a21e8a69c7113f4ea783b24ba2df8f805496789ac99277ad9932db2"} Jun 14 14:43:04.879742 ip-10-0-129-116 kubenswrapper[2546]: I0614 14:43:04.879701 2546 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-diagnostics/network-check-source-6947749cfc-w62qp" podStartSLOduration=0.879659691 podStartE2EDuration="879.659691ms" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-14 14:43:04 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-14 14:43:04.878631292 +0000 UTC m=+222.207013437" watchObservedRunningTime="2026-06-14 14:43:04.879659691 +0000 UTC m=+222.208041815" Jun 14 14:43:05.837790 ip-10-0-129-116 kubenswrapper[2546]: I0614 14:43:05.837746 2546 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/14fb6e1b-853d-4107-b6b6-22d47cb7619c-service-ca-bundle\") pod \"router-default-5f9f5d888-dlm5r\" (UID: \"14fb6e1b-853d-4107-b6b6-22d47cb7619c\") " pod="openshift-ingress/router-default-5f9f5d888-dlm5r" Jun 14 14:43:05.837790 ip-10-0-129-116 kubenswrapper[2546]: I0614 14:43:05.837798 2546 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/14fb6e1b-853d-4107-b6b6-22d47cb7619c-metrics-certs\") pod \"router-default-5f9f5d888-dlm5r\" (UID: \"14fb6e1b-853d-4107-b6b6-22d47cb7619c\") " pod="openshift-ingress/router-default-5f9f5d888-dlm5r" Jun 14 14:43:05.838332 ip-10-0-129-116 kubenswrapper[2546]: I0614 14:43:05.837833 2546 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/e4181a2d-85c6-497b-99d9-1d2342894e9c-samples-operator-tls\") pod \"cluster-samples-operator-9547488fd-b9jnb\" (UID: \"e4181a2d-85c6-497b-99d9-1d2342894e9c\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-9547488fd-b9jnb" Jun 14 14:43:05.838332 ip-10-0-129-116 kubenswrapper[2546]: I0614 14:43:05.837914 2546 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/3ede30b3-6f71-4b5c-a643-5efa6c254e1c-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-f9d7df769-5jzh2\" (UID: \"3ede30b3-6f71-4b5c-a643-5efa6c254e1c\") " pod="openshift-monitoring/cluster-monitoring-operator-f9d7df769-5jzh2" Jun 14 14:43:05.838332 ip-10-0-129-116 kubenswrapper[2546]: E0614 14:43:05.837937 2546 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found Jun 14 14:43:05.838332 ip-10-0-129-116 kubenswrapper[2546]: E0614 14:43:05.837951 2546 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/14fb6e1b-853d-4107-b6b6-22d47cb7619c-service-ca-bundle podName:14fb6e1b-853d-4107-b6b6-22d47cb7619c nodeName:}" failed. No retries permitted until 2026-06-14 14:43:07.837927217 +0000 UTC m=+225.166309338 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/14fb6e1b-853d-4107-b6b6-22d47cb7619c-service-ca-bundle") pod "router-default-5f9f5d888-dlm5r" (UID: "14fb6e1b-853d-4107-b6b6-22d47cb7619c") : configmap references non-existent config key: service-ca.crt Jun 14 14:43:05.838332 ip-10-0-129-116 kubenswrapper[2546]: E0614 14:43:05.837991 2546 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e4181a2d-85c6-497b-99d9-1d2342894e9c-samples-operator-tls podName:e4181a2d-85c6-497b-99d9-1d2342894e9c nodeName:}" failed. No retries permitted until 2026-06-14 14:43:07.837975331 +0000 UTC m=+225.166357434 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/e4181a2d-85c6-497b-99d9-1d2342894e9c-samples-operator-tls") pod "cluster-samples-operator-9547488fd-b9jnb" (UID: "e4181a2d-85c6-497b-99d9-1d2342894e9c") : secret "samples-operator-tls" not found Jun 14 14:43:05.838332 ip-10-0-129-116 kubenswrapper[2546]: E0614 14:43:05.838009 2546 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found Jun 14 14:43:05.838332 ip-10-0-129-116 kubenswrapper[2546]: I0614 14:43:05.838041 2546 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/7ae514d0-80e9-44d6-b358-84e57fe9d353-networking-console-plugin-cert\") pod \"networking-console-plugin-867b76cb74-kq2p9\" (UID: \"7ae514d0-80e9-44d6-b358-84e57fe9d353\") " pod="openshift-network-console/networking-console-plugin-867b76cb74-kq2p9" Jun 14 14:43:05.838332 ip-10-0-129-116 kubenswrapper[2546]: E0614 14:43:05.838052 2546 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found Jun 14 14:43:05.838332 ip-10-0-129-116 kubenswrapper[2546]: E0614 14:43:05.838057 2546 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/3ede30b3-6f71-4b5c-a643-5efa6c254e1c-cluster-monitoring-operator-tls podName:3ede30b3-6f71-4b5c-a643-5efa6c254e1c nodeName:}" failed. No retries permitted until 2026-06-14 14:43:07.838042278 +0000 UTC m=+225.166424383 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/3ede30b3-6f71-4b5c-a643-5efa6c254e1c-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-f9d7df769-5jzh2" (UID: "3ede30b3-6f71-4b5c-a643-5efa6c254e1c") : secret "cluster-monitoring-operator-tls" not found Jun 14 14:43:05.838332 ip-10-0-129-116 kubenswrapper[2546]: E0614 14:43:05.838115 2546 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found Jun 14 14:43:05.838332 ip-10-0-129-116 kubenswrapper[2546]: E0614 14:43:05.838139 2546 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/14fb6e1b-853d-4107-b6b6-22d47cb7619c-metrics-certs podName:14fb6e1b-853d-4107-b6b6-22d47cb7619c nodeName:}" failed. No retries permitted until 2026-06-14 14:43:07.838124611 +0000 UTC m=+225.166506714 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/14fb6e1b-853d-4107-b6b6-22d47cb7619c-metrics-certs") pod "router-default-5f9f5d888-dlm5r" (UID: "14fb6e1b-853d-4107-b6b6-22d47cb7619c") : secret "router-metrics-certs-default" not found Jun 14 14:43:05.838332 ip-10-0-129-116 kubenswrapper[2546]: E0614 14:43:05.838160 2546 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/7ae514d0-80e9-44d6-b358-84e57fe9d353-networking-console-plugin-cert podName:7ae514d0-80e9-44d6-b358-84e57fe9d353 nodeName:}" failed. No retries permitted until 2026-06-14 14:43:07.83814955 +0000 UTC m=+225.166531678 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/7ae514d0-80e9-44d6-b358-84e57fe9d353-networking-console-plugin-cert") pod "networking-console-plugin-867b76cb74-kq2p9" (UID: "7ae514d0-80e9-44d6-b358-84e57fe9d353") : secret "networking-console-plugin-cert" not found Jun 14 14:43:06.378326 ip-10-0-129-116 kubenswrapper[2546]: I0614 14:43:06.378284 2546 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c96gx_105377da-c223-41ad-b033-546cb01239c4/konnectivity-agent/0.log" limit=1024 Jun 14 14:43:06.478987 ip-10-0-129-116 kubenswrapper[2546]: I0614 14:43:06.478956 2546 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c96gx_105377da-c223-41ad-b033-546cb01239c4/konnectivity-agent/0.log" limit=1024 Jun 14 14:43:06.870742 ip-10-0-129-116 kubenswrapper[2546]: I0614 14:43:06.870710 2546 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca-operator/service-ca-operator-7ccbfd59dc-z2rs6" event={"ID":"fe19844a-27c5-471a-b03d-867b9eb90582","Type":"ContainerStarted","Data":"7ebc267c6144189a54bb014acb5a93a2237f2cfddf193233fcceb8e27eb3b3c5"} Jun 14 14:43:06.887154 ip-10-0-129-116 kubenswrapper[2546]: I0614 14:43:06.887112 2546 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-service-ca-operator/service-ca-operator-7ccbfd59dc-z2rs6" podStartSLOduration=0.915584024 podStartE2EDuration="2.887076039s" totalImagesPullingTime="1.971492015s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-14 14:43:04 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-14 14:43:06.886600737 +0000 UTC m=+224.214982864" watchObservedRunningTime="2026-06-14 14:43:06.887076039 +0000 UTC m=+224.215458163" Jun 14 14:43:07.855954 ip-10-0-129-116 kubenswrapper[2546]: I0614 14:43:07.855915 2546 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/14fb6e1b-853d-4107-b6b6-22d47cb7619c-service-ca-bundle\") pod \"router-default-5f9f5d888-dlm5r\" (UID: \"14fb6e1b-853d-4107-b6b6-22d47cb7619c\") " pod="openshift-ingress/router-default-5f9f5d888-dlm5r" Jun 14 14:43:07.855954 ip-10-0-129-116 kubenswrapper[2546]: I0614 14:43:07.855954 2546 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/14fb6e1b-853d-4107-b6b6-22d47cb7619c-metrics-certs\") pod \"router-default-5f9f5d888-dlm5r\" (UID: \"14fb6e1b-853d-4107-b6b6-22d47cb7619c\") " pod="openshift-ingress/router-default-5f9f5d888-dlm5r" Jun 14 14:43:07.856218 ip-10-0-129-116 kubenswrapper[2546]: I0614 14:43:07.855989 2546 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/e4181a2d-85c6-497b-99d9-1d2342894e9c-samples-operator-tls\") pod \"cluster-samples-operator-9547488fd-b9jnb\" (UID: \"e4181a2d-85c6-497b-99d9-1d2342894e9c\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-9547488fd-b9jnb" Jun 14 14:43:07.856218 ip-10-0-129-116 kubenswrapper[2546]: I0614 14:43:07.856027 2546 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/3ede30b3-6f71-4b5c-a643-5efa6c254e1c-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-f9d7df769-5jzh2\" (UID: \"3ede30b3-6f71-4b5c-a643-5efa6c254e1c\") " pod="openshift-monitoring/cluster-monitoring-operator-f9d7df769-5jzh2" Jun 14 14:43:07.856218 ip-10-0-129-116 kubenswrapper[2546]: I0614 14:43:07.856072 2546 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/7ae514d0-80e9-44d6-b358-84e57fe9d353-networking-console-plugin-cert\") pod \"networking-console-plugin-867b76cb74-kq2p9\" (UID: \"7ae514d0-80e9-44d6-b358-84e57fe9d353\") " pod="openshift-network-console/networking-console-plugin-867b76cb74-kq2p9" Jun 14 14:43:07.856218 ip-10-0-129-116 kubenswrapper[2546]: E0614 14:43:07.856074 2546 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found Jun 14 14:43:07.856218 ip-10-0-129-116 kubenswrapper[2546]: E0614 14:43:07.856107 2546 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/14fb6e1b-853d-4107-b6b6-22d47cb7619c-service-ca-bundle podName:14fb6e1b-853d-4107-b6b6-22d47cb7619c nodeName:}" failed. No retries permitted until 2026-06-14 14:43:11.856069996 +0000 UTC m=+229.184452120 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/14fb6e1b-853d-4107-b6b6-22d47cb7619c-service-ca-bundle") pod "router-default-5f9f5d888-dlm5r" (UID: "14fb6e1b-853d-4107-b6b6-22d47cb7619c") : configmap references non-existent config key: service-ca.crt Jun 14 14:43:07.856218 ip-10-0-129-116 kubenswrapper[2546]: E0614 14:43:07.856134 2546 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/14fb6e1b-853d-4107-b6b6-22d47cb7619c-metrics-certs podName:14fb6e1b-853d-4107-b6b6-22d47cb7619c nodeName:}" failed. No retries permitted until 2026-06-14 14:43:11.856122239 +0000 UTC m=+229.184504341 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/14fb6e1b-853d-4107-b6b6-22d47cb7619c-metrics-certs") pod "router-default-5f9f5d888-dlm5r" (UID: "14fb6e1b-853d-4107-b6b6-22d47cb7619c") : secret "router-metrics-certs-default" not found Jun 14 14:43:07.856218 ip-10-0-129-116 kubenswrapper[2546]: E0614 14:43:07.856148 2546 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found Jun 14 14:43:07.856218 ip-10-0-129-116 kubenswrapper[2546]: E0614 14:43:07.856179 2546 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found Jun 14 14:43:07.856218 ip-10-0-129-116 kubenswrapper[2546]: E0614 14:43:07.856193 2546 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found Jun 14 14:43:07.856218 ip-10-0-129-116 kubenswrapper[2546]: E0614 14:43:07.856213 2546 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/3ede30b3-6f71-4b5c-a643-5efa6c254e1c-cluster-monitoring-operator-tls podName:3ede30b3-6f71-4b5c-a643-5efa6c254e1c nodeName:}" failed. No retries permitted until 2026-06-14 14:43:11.85619694 +0000 UTC m=+229.184579042 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/3ede30b3-6f71-4b5c-a643-5efa6c254e1c-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-f9d7df769-5jzh2" (UID: "3ede30b3-6f71-4b5c-a643-5efa6c254e1c") : secret "cluster-monitoring-operator-tls" not found Jun 14 14:43:07.856552 ip-10-0-129-116 kubenswrapper[2546]: E0614 14:43:07.856232 2546 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e4181a2d-85c6-497b-99d9-1d2342894e9c-samples-operator-tls podName:e4181a2d-85c6-497b-99d9-1d2342894e9c nodeName:}" failed. No retries permitted until 2026-06-14 14:43:11.856222353 +0000 UTC m=+229.184604456 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/e4181a2d-85c6-497b-99d9-1d2342894e9c-samples-operator-tls") pod "cluster-samples-operator-9547488fd-b9jnb" (UID: "e4181a2d-85c6-497b-99d9-1d2342894e9c") : secret "samples-operator-tls" not found Jun 14 14:43:07.856552 ip-10-0-129-116 kubenswrapper[2546]: E0614 14:43:07.856246 2546 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/7ae514d0-80e9-44d6-b358-84e57fe9d353-networking-console-plugin-cert podName:7ae514d0-80e9-44d6-b358-84e57fe9d353 nodeName:}" failed. No retries permitted until 2026-06-14 14:43:11.856237696 +0000 UTC m=+229.184619803 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/7ae514d0-80e9-44d6-b358-84e57fe9d353-networking-console-plugin-cert") pod "networking-console-plugin-867b76cb74-kq2p9" (UID: "7ae514d0-80e9-44d6-b358-84e57fe9d353") : secret "networking-console-plugin-cert" not found Jun 14 14:43:07.950534 ip-10-0-129-116 kubenswrapper[2546]: I0614 14:43:07.950500 2546 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c96gx_105377da-c223-41ad-b033-546cb01239c4/konnectivity-agent/0.log" limit=1024 Jun 14 14:43:08.001051 ip-10-0-129-116 kubenswrapper[2546]: I0614 14:43:08.001017 2546 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c96gx_105377da-c223-41ad-b033-546cb01239c4/konnectivity-agent/0.log" limit=1024 Jun 14 14:43:08.392886 ip-10-0-129-116 kubenswrapper[2546]: I0614 14:43:08.392842 2546 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c96gx_105377da-c223-41ad-b033-546cb01239c4/konnectivity-agent/0.log" limit=1024 Jun 14 14:43:08.494015 ip-10-0-129-116 kubenswrapper[2546]: I0614 14:43:08.493979 2546 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c96gx_105377da-c223-41ad-b033-546cb01239c4/konnectivity-agent/0.log" limit=1024 Jun 14 14:43:08.728242 ip-10-0-129-116 kubenswrapper[2546]: I0614 14:43:08.728200 2546 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c96gx_105377da-c223-41ad-b033-546cb01239c4/konnectivity-agent/0.log" limit=1024 Jun 14 14:43:08.828566 ip-10-0-129-116 kubenswrapper[2546]: I0614 14:43:08.828538 2546 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c96gx_105377da-c223-41ad-b033-546cb01239c4/konnectivity-agent/0.log" limit=1024 Jun 14 14:43:09.723962 ip-10-0-129-116 kubenswrapper[2546]: I0614 14:43:09.723933 2546 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c96gx_105377da-c223-41ad-b033-546cb01239c4/konnectivity-agent/0.log" limit=1024 Jun 14 14:43:09.726954 ip-10-0-129-116 kubenswrapper[2546]: I0614 14:43:09.726928 2546 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-kube-storage-version-migrator/migrator-d4bcd4867-nb768"] Jun 14 14:43:09.729749 ip-10-0-129-116 kubenswrapper[2546]: I0614 14:43:09.729730 2546 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-storage-version-migrator/migrator-d4bcd4867-nb768" Jun 14 14:43:09.732340 ip-10-0-129-116 kubenswrapper[2546]: I0614 14:43:09.732309 2546 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator\"/\"openshift-service-ca.crt\"" Jun 14 14:43:09.733432 ip-10-0-129-116 kubenswrapper[2546]: I0614 14:43:09.733413 2546 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator\"/\"kube-root-ca.crt\"" Jun 14 14:43:09.733527 ip-10-0-129-116 kubenswrapper[2546]: I0614 14:43:09.733465 2546 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-kube-storage-version-migrator\"/\"kube-storage-version-migrator-sa-dockercfg-7vwj8\"" Jun 14 14:43:09.747919 ip-10-0-129-116 kubenswrapper[2546]: I0614 14:43:09.746926 2546 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-kube-storage-version-migrator/migrator-d4bcd4867-nb768"] Jun 14 14:43:09.765321 ip-10-0-129-116 kubenswrapper[2546]: I0614 14:43:09.765290 2546 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-insights/insights-runtime-extractor-qh5bb"] Jun 14 14:43:09.768367 ip-10-0-129-116 kubenswrapper[2546]: I0614 14:43:09.768349 2546 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-qh5bb" Jun 14 14:43:09.770901 ip-10-0-129-116 kubenswrapper[2546]: I0614 14:43:09.770872 2546 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-rbac-proxy\"" Jun 14 14:43:09.771005 ip-10-0-129-116 kubenswrapper[2546]: I0614 14:43:09.770879 2546 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-root-ca.crt\"" Jun 14 14:43:09.771005 ip-10-0-129-116 kubenswrapper[2546]: I0614 14:43:09.770940 2546 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"openshift-service-ca.crt\"" Jun 14 14:43:09.771005 ip-10-0-129-116 kubenswrapper[2546]: I0614 14:43:09.770947 2546 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-sa-dockercfg-wt54v\"" Jun 14 14:43:09.771005 ip-10-0-129-116 kubenswrapper[2546]: I0614 14:43:09.770951 2546 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-tls\"" Jun 14 14:43:09.771358 ip-10-0-129-116 kubenswrapper[2546]: I0614 14:43:09.771335 2546 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7tc8r\" (UniqueName: \"kubernetes.io/projected/68d24039-a1c7-4075-ba15-ae24d27282f0-kube-api-access-7tc8r\") pod \"migrator-d4bcd4867-nb768\" (UID: \"68d24039-a1c7-4075-ba15-ae24d27282f0\") " pod="openshift-kube-storage-version-migrator/migrator-d4bcd4867-nb768" Jun 14 14:43:09.782438 ip-10-0-129-116 kubenswrapper[2546]: I0614 14:43:09.782418 2546 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-qh5bb"] Jun 14 14:43:09.814513 ip-10-0-129-116 kubenswrapper[2546]: I0614 14:43:09.814477 2546 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c96gx_105377da-c223-41ad-b033-546cb01239c4/konnectivity-agent/0.log" limit=1024 Jun 14 14:43:09.872007 ip-10-0-129-116 kubenswrapper[2546]: I0614 14:43:09.871974 2546 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7tc8r\" (UniqueName: \"kubernetes.io/projected/68d24039-a1c7-4075-ba15-ae24d27282f0-kube-api-access-7tc8r\") pod \"migrator-d4bcd4867-nb768\" (UID: \"68d24039-a1c7-4075-ba15-ae24d27282f0\") " pod="openshift-kube-storage-version-migrator/migrator-d4bcd4867-nb768" Jun 14 14:43:09.872169 ip-10-0-129-116 kubenswrapper[2546]: I0614 14:43:09.872014 2546 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/5606a730-63da-4a6f-aaee-cd54b1ddeacf-crio-socket\") pod \"insights-runtime-extractor-qh5bb\" (UID: \"5606a730-63da-4a6f-aaee-cd54b1ddeacf\") " pod="openshift-insights/insights-runtime-extractor-qh5bb" Jun 14 14:43:09.872169 ip-10-0-129-116 kubenswrapper[2546]: I0614 14:43:09.872123 2546 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/5606a730-63da-4a6f-aaee-cd54b1ddeacf-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-qh5bb\" (UID: \"5606a730-63da-4a6f-aaee-cd54b1ddeacf\") " pod="openshift-insights/insights-runtime-extractor-qh5bb" Jun 14 14:43:09.872169 ip-10-0-129-116 kubenswrapper[2546]: I0614 14:43:09.872156 2546 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/5606a730-63da-4a6f-aaee-cd54b1ddeacf-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-qh5bb\" (UID: \"5606a730-63da-4a6f-aaee-cd54b1ddeacf\") " pod="openshift-insights/insights-runtime-extractor-qh5bb" Jun 14 14:43:09.872343 ip-10-0-129-116 kubenswrapper[2546]: I0614 14:43:09.872184 2546 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/5606a730-63da-4a6f-aaee-cd54b1ddeacf-data-volume\") pod \"insights-runtime-extractor-qh5bb\" (UID: \"5606a730-63da-4a6f-aaee-cd54b1ddeacf\") " pod="openshift-insights/insights-runtime-extractor-qh5bb" Jun 14 14:43:09.872343 ip-10-0-129-116 kubenswrapper[2546]: I0614 14:43:09.872241 2546 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hl8tt\" (UniqueName: \"kubernetes.io/projected/5606a730-63da-4a6f-aaee-cd54b1ddeacf-kube-api-access-hl8tt\") pod \"insights-runtime-extractor-qh5bb\" (UID: \"5606a730-63da-4a6f-aaee-cd54b1ddeacf\") " pod="openshift-insights/insights-runtime-extractor-qh5bb" Jun 14 14:43:09.876663 ip-10-0-129-116 kubenswrapper[2546]: I0614 14:43:09.876629 2546 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c96gx_105377da-c223-41ad-b033-546cb01239c4/konnectivity-agent/0.log" limit=1024 Jun 14 14:43:09.879514 ip-10-0-129-116 kubenswrapper[2546]: I0614 14:43:09.879491 2546 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-7tc8r\" (UniqueName: \"kubernetes.io/projected/68d24039-a1c7-4075-ba15-ae24d27282f0-kube-api-access-7tc8r\") pod \"migrator-d4bcd4867-nb768\" (UID: \"68d24039-a1c7-4075-ba15-ae24d27282f0\") " pod="openshift-kube-storage-version-migrator/migrator-d4bcd4867-nb768" Jun 14 14:43:09.972677 ip-10-0-129-116 kubenswrapper[2546]: I0614 14:43:09.972641 2546 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/5606a730-63da-4a6f-aaee-cd54b1ddeacf-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-qh5bb\" (UID: \"5606a730-63da-4a6f-aaee-cd54b1ddeacf\") " pod="openshift-insights/insights-runtime-extractor-qh5bb" Jun 14 14:43:09.972863 ip-10-0-129-116 kubenswrapper[2546]: I0614 14:43:09.972686 2546 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/5606a730-63da-4a6f-aaee-cd54b1ddeacf-data-volume\") pod \"insights-runtime-extractor-qh5bb\" (UID: \"5606a730-63da-4a6f-aaee-cd54b1ddeacf\") " pod="openshift-insights/insights-runtime-extractor-qh5bb" Jun 14 14:43:09.972863 ip-10-0-129-116 kubenswrapper[2546]: I0614 14:43:09.972717 2546 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hl8tt\" (UniqueName: \"kubernetes.io/projected/5606a730-63da-4a6f-aaee-cd54b1ddeacf-kube-api-access-hl8tt\") pod \"insights-runtime-extractor-qh5bb\" (UID: \"5606a730-63da-4a6f-aaee-cd54b1ddeacf\") " pod="openshift-insights/insights-runtime-extractor-qh5bb" Jun 14 14:43:09.972863 ip-10-0-129-116 kubenswrapper[2546]: I0614 14:43:09.972742 2546 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/5606a730-63da-4a6f-aaee-cd54b1ddeacf-crio-socket\") pod \"insights-runtime-extractor-qh5bb\" (UID: \"5606a730-63da-4a6f-aaee-cd54b1ddeacf\") " pod="openshift-insights/insights-runtime-extractor-qh5bb" Jun 14 14:43:09.972863 ip-10-0-129-116 kubenswrapper[2546]: E0614 14:43:09.972795 2546 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Jun 14 14:43:09.972863 ip-10-0-129-116 kubenswrapper[2546]: I0614 14:43:09.972815 2546 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/5606a730-63da-4a6f-aaee-cd54b1ddeacf-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-qh5bb\" (UID: \"5606a730-63da-4a6f-aaee-cd54b1ddeacf\") " pod="openshift-insights/insights-runtime-extractor-qh5bb" Jun 14 14:43:09.972863 ip-10-0-129-116 kubenswrapper[2546]: E0614 14:43:09.972862 2546 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/5606a730-63da-4a6f-aaee-cd54b1ddeacf-insights-runtime-extractor-tls podName:5606a730-63da-4a6f-aaee-cd54b1ddeacf nodeName:}" failed. No retries permitted until 2026-06-14 14:43:10.472845705 +0000 UTC m=+227.801227809 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/5606a730-63da-4a6f-aaee-cd54b1ddeacf-insights-runtime-extractor-tls") pod "insights-runtime-extractor-qh5bb" (UID: "5606a730-63da-4a6f-aaee-cd54b1ddeacf") : secret "insights-runtime-extractor-tls" not found Jun 14 14:43:09.973206 ip-10-0-129-116 kubenswrapper[2546]: E0614 14:43:09.972875 2546 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found Jun 14 14:43:09.973206 ip-10-0-129-116 kubenswrapper[2546]: I0614 14:43:09.972879 2546 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/5606a730-63da-4a6f-aaee-cd54b1ddeacf-crio-socket\") pod \"insights-runtime-extractor-qh5bb\" (UID: \"5606a730-63da-4a6f-aaee-cd54b1ddeacf\") " pod="openshift-insights/insights-runtime-extractor-qh5bb" Jun 14 14:43:09.973206 ip-10-0-129-116 kubenswrapper[2546]: E0614 14:43:09.972912 2546 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/5606a730-63da-4a6f-aaee-cd54b1ddeacf-kube-rbac-proxy-cm podName:5606a730-63da-4a6f-aaee-cd54b1ddeacf nodeName:}" failed. No retries permitted until 2026-06-14 14:43:10.472901693 +0000 UTC m=+227.801283796 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/5606a730-63da-4a6f-aaee-cd54b1ddeacf-kube-rbac-proxy-cm") pod "insights-runtime-extractor-qh5bb" (UID: "5606a730-63da-4a6f-aaee-cd54b1ddeacf") : configmap "kube-rbac-proxy" not found Jun 14 14:43:09.973206 ip-10-0-129-116 kubenswrapper[2546]: I0614 14:43:09.973025 2546 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/5606a730-63da-4a6f-aaee-cd54b1ddeacf-data-volume\") pod \"insights-runtime-extractor-qh5bb\" (UID: \"5606a730-63da-4a6f-aaee-cd54b1ddeacf\") " pod="openshift-insights/insights-runtime-extractor-qh5bb" Jun 14 14:43:09.980852 ip-10-0-129-116 kubenswrapper[2546]: I0614 14:43:09.980799 2546 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-hl8tt\" (UniqueName: \"kubernetes.io/projected/5606a730-63da-4a6f-aaee-cd54b1ddeacf-kube-api-access-hl8tt\") pod \"insights-runtime-extractor-qh5bb\" (UID: \"5606a730-63da-4a6f-aaee-cd54b1ddeacf\") " pod="openshift-insights/insights-runtime-extractor-qh5bb" Jun 14 14:43:10.038286 ip-10-0-129-116 kubenswrapper[2546]: I0614 14:43:10.038262 2546 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-storage-version-migrator/migrator-d4bcd4867-nb768" Jun 14 14:43:10.158715 ip-10-0-129-116 kubenswrapper[2546]: I0614 14:43:10.158680 2546 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-kube-storage-version-migrator/migrator-d4bcd4867-nb768"] Jun 14 14:43:10.161687 ip-10-0-129-116 kubenswrapper[2546]: W0614 14:43:10.161654 2546 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod68d24039_a1c7_4075_ba15_ae24d27282f0.slice/crio-d0d4ebde8c006ce5243671adac804d3eb4da4844780f14719e9e0b032756834c WatchSource:0}: Error finding container d0d4ebde8c006ce5243671adac804d3eb4da4844780f14719e9e0b032756834c: Status 404 returned error can't find the container with id d0d4ebde8c006ce5243671adac804d3eb4da4844780f14719e9e0b032756834c Jun 14 14:43:10.288169 ip-10-0-129-116 kubenswrapper[2546]: I0614 14:43:10.288063 2546 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c96gx_105377da-c223-41ad-b033-546cb01239c4/konnectivity-agent/0.log" limit=1024 Jun 14 14:43:10.337974 ip-10-0-129-116 kubenswrapper[2546]: I0614 14:43:10.337942 2546 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c96gx_105377da-c223-41ad-b033-546cb01239c4/konnectivity-agent/0.log" limit=1024 Jun 14 14:43:10.477215 ip-10-0-129-116 kubenswrapper[2546]: I0614 14:43:10.477180 2546 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/5606a730-63da-4a6f-aaee-cd54b1ddeacf-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-qh5bb\" (UID: \"5606a730-63da-4a6f-aaee-cd54b1ddeacf\") " pod="openshift-insights/insights-runtime-extractor-qh5bb" Jun 14 14:43:10.477375 ip-10-0-129-116 kubenswrapper[2546]: I0614 14:43:10.477223 2546 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/5606a730-63da-4a6f-aaee-cd54b1ddeacf-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-qh5bb\" (UID: \"5606a730-63da-4a6f-aaee-cd54b1ddeacf\") " pod="openshift-insights/insights-runtime-extractor-qh5bb" Jun 14 14:43:10.477375 ip-10-0-129-116 kubenswrapper[2546]: E0614 14:43:10.477313 2546 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found Jun 14 14:43:10.477375 ip-10-0-129-116 kubenswrapper[2546]: E0614 14:43:10.477373 2546 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/5606a730-63da-4a6f-aaee-cd54b1ddeacf-kube-rbac-proxy-cm podName:5606a730-63da-4a6f-aaee-cd54b1ddeacf nodeName:}" failed. No retries permitted until 2026-06-14 14:43:11.477357917 +0000 UTC m=+228.805740020 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/5606a730-63da-4a6f-aaee-cd54b1ddeacf-kube-rbac-proxy-cm") pod "insights-runtime-extractor-qh5bb" (UID: "5606a730-63da-4a6f-aaee-cd54b1ddeacf") : configmap "kube-rbac-proxy" not found Jun 14 14:43:10.477483 ip-10-0-129-116 kubenswrapper[2546]: E0614 14:43:10.477322 2546 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Jun 14 14:43:10.477483 ip-10-0-129-116 kubenswrapper[2546]: E0614 14:43:10.477439 2546 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/5606a730-63da-4a6f-aaee-cd54b1ddeacf-insights-runtime-extractor-tls podName:5606a730-63da-4a6f-aaee-cd54b1ddeacf nodeName:}" failed. No retries permitted until 2026-06-14 14:43:11.477427692 +0000 UTC m=+228.805809795 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/5606a730-63da-4a6f-aaee-cd54b1ddeacf-insights-runtime-extractor-tls") pod "insights-runtime-extractor-qh5bb" (UID: "5606a730-63da-4a6f-aaee-cd54b1ddeacf") : secret "insights-runtime-extractor-tls" not found Jun 14 14:43:10.882216 ip-10-0-129-116 kubenswrapper[2546]: I0614 14:43:10.882176 2546 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator/migrator-d4bcd4867-nb768" event={"ID":"68d24039-a1c7-4075-ba15-ae24d27282f0","Type":"ContainerStarted","Data":"d0d4ebde8c006ce5243671adac804d3eb4da4844780f14719e9e0b032756834c"} Jun 14 14:43:11.078343 ip-10-0-129-116 kubenswrapper[2546]: I0614 14:43:11.078303 2546 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c96gx_105377da-c223-41ad-b033-546cb01239c4/konnectivity-agent/0.log" limit=1024 Jun 14 14:43:11.484843 ip-10-0-129-116 kubenswrapper[2546]: I0614 14:43:11.484809 2546 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/5606a730-63da-4a6f-aaee-cd54b1ddeacf-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-qh5bb\" (UID: \"5606a730-63da-4a6f-aaee-cd54b1ddeacf\") " pod="openshift-insights/insights-runtime-extractor-qh5bb" Jun 14 14:43:11.484959 ip-10-0-129-116 kubenswrapper[2546]: I0614 14:43:11.484861 2546 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/5606a730-63da-4a6f-aaee-cd54b1ddeacf-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-qh5bb\" (UID: \"5606a730-63da-4a6f-aaee-cd54b1ddeacf\") " pod="openshift-insights/insights-runtime-extractor-qh5bb" Jun 14 14:43:11.484959 ip-10-0-129-116 kubenswrapper[2546]: E0614 14:43:11.484910 2546 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found Jun 14 14:43:11.485054 ip-10-0-129-116 kubenswrapper[2546]: E0614 14:43:11.484986 2546 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/5606a730-63da-4a6f-aaee-cd54b1ddeacf-kube-rbac-proxy-cm podName:5606a730-63da-4a6f-aaee-cd54b1ddeacf nodeName:}" failed. No retries permitted until 2026-06-14 14:43:13.484966262 +0000 UTC m=+230.813348364 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/5606a730-63da-4a6f-aaee-cd54b1ddeacf-kube-rbac-proxy-cm") pod "insights-runtime-extractor-qh5bb" (UID: "5606a730-63da-4a6f-aaee-cd54b1ddeacf") : configmap "kube-rbac-proxy" not found Jun 14 14:43:11.485054 ip-10-0-129-116 kubenswrapper[2546]: E0614 14:43:11.484994 2546 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Jun 14 14:43:11.485054 ip-10-0-129-116 kubenswrapper[2546]: E0614 14:43:11.485033 2546 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/5606a730-63da-4a6f-aaee-cd54b1ddeacf-insights-runtime-extractor-tls podName:5606a730-63da-4a6f-aaee-cd54b1ddeacf nodeName:}" failed. No retries permitted until 2026-06-14 14:43:13.485020917 +0000 UTC m=+230.813403035 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/5606a730-63da-4a6f-aaee-cd54b1ddeacf-insights-runtime-extractor-tls") pod "insights-runtime-extractor-qh5bb" (UID: "5606a730-63da-4a6f-aaee-cd54b1ddeacf") : secret "insights-runtime-extractor-tls" not found Jun 14 14:43:11.886826 ip-10-0-129-116 kubenswrapper[2546]: I0614 14:43:11.886744 2546 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator/migrator-d4bcd4867-nb768" event={"ID":"68d24039-a1c7-4075-ba15-ae24d27282f0","Type":"ContainerStarted","Data":"00753582efe50de3deb5017c0fa591d39b0eae5b088a84279d06b7f16a84af23"} Jun 14 14:43:11.886826 ip-10-0-129-116 kubenswrapper[2546]: I0614 14:43:11.886792 2546 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator/migrator-d4bcd4867-nb768" event={"ID":"68d24039-a1c7-4075-ba15-ae24d27282f0","Type":"ContainerStarted","Data":"09ad978752aaea8b052a34928253b0f9fc4abe131fb8eee94f5337f3ae47a318"} Jun 14 14:43:11.887222 ip-10-0-129-116 kubenswrapper[2546]: I0614 14:43:11.887205 2546 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/14fb6e1b-853d-4107-b6b6-22d47cb7619c-service-ca-bundle\") pod \"router-default-5f9f5d888-dlm5r\" (UID: \"14fb6e1b-853d-4107-b6b6-22d47cb7619c\") " pod="openshift-ingress/router-default-5f9f5d888-dlm5r" Jun 14 14:43:11.887265 ip-10-0-129-116 kubenswrapper[2546]: I0614 14:43:11.887233 2546 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/14fb6e1b-853d-4107-b6b6-22d47cb7619c-metrics-certs\") pod \"router-default-5f9f5d888-dlm5r\" (UID: \"14fb6e1b-853d-4107-b6b6-22d47cb7619c\") " pod="openshift-ingress/router-default-5f9f5d888-dlm5r" Jun 14 14:43:11.887265 ip-10-0-129-116 kubenswrapper[2546]: I0614 14:43:11.887259 2546 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/e4181a2d-85c6-497b-99d9-1d2342894e9c-samples-operator-tls\") pod \"cluster-samples-operator-9547488fd-b9jnb\" (UID: \"e4181a2d-85c6-497b-99d9-1d2342894e9c\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-9547488fd-b9jnb" Jun 14 14:43:11.887349 ip-10-0-129-116 kubenswrapper[2546]: E0614 14:43:11.887334 2546 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/14fb6e1b-853d-4107-b6b6-22d47cb7619c-service-ca-bundle podName:14fb6e1b-853d-4107-b6b6-22d47cb7619c nodeName:}" failed. No retries permitted until 2026-06-14 14:43:19.887318704 +0000 UTC m=+237.215700808 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/14fb6e1b-853d-4107-b6b6-22d47cb7619c-service-ca-bundle") pod "router-default-5f9f5d888-dlm5r" (UID: "14fb6e1b-853d-4107-b6b6-22d47cb7619c") : configmap references non-existent config key: service-ca.crt Jun 14 14:43:11.887349 ip-10-0-129-116 kubenswrapper[2546]: E0614 14:43:11.887342 2546 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found Jun 14 14:43:11.887429 ip-10-0-129-116 kubenswrapper[2546]: I0614 14:43:11.887363 2546 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/3ede30b3-6f71-4b5c-a643-5efa6c254e1c-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-f9d7df769-5jzh2\" (UID: \"3ede30b3-6f71-4b5c-a643-5efa6c254e1c\") " pod="openshift-monitoring/cluster-monitoring-operator-f9d7df769-5jzh2" Jun 14 14:43:11.887429 ip-10-0-129-116 kubenswrapper[2546]: E0614 14:43:11.887342 2546 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found Jun 14 14:43:11.887429 ip-10-0-129-116 kubenswrapper[2546]: E0614 14:43:11.887387 2546 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e4181a2d-85c6-497b-99d9-1d2342894e9c-samples-operator-tls podName:e4181a2d-85c6-497b-99d9-1d2342894e9c nodeName:}" failed. No retries permitted until 2026-06-14 14:43:19.887373257 +0000 UTC m=+237.215755361 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/e4181a2d-85c6-497b-99d9-1d2342894e9c-samples-operator-tls") pod "cluster-samples-operator-9547488fd-b9jnb" (UID: "e4181a2d-85c6-497b-99d9-1d2342894e9c") : secret "samples-operator-tls" not found Jun 14 14:43:11.887429 ip-10-0-129-116 kubenswrapper[2546]: E0614 14:43:11.887404 2546 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/14fb6e1b-853d-4107-b6b6-22d47cb7619c-metrics-certs podName:14fb6e1b-853d-4107-b6b6-22d47cb7619c nodeName:}" failed. No retries permitted until 2026-06-14 14:43:19.887395487 +0000 UTC m=+237.215777592 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/14fb6e1b-853d-4107-b6b6-22d47cb7619c-metrics-certs") pod "router-default-5f9f5d888-dlm5r" (UID: "14fb6e1b-853d-4107-b6b6-22d47cb7619c") : secret "router-metrics-certs-default" not found Jun 14 14:43:11.887429 ip-10-0-129-116 kubenswrapper[2546]: E0614 14:43:11.887417 2546 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found Jun 14 14:43:11.887609 ip-10-0-129-116 kubenswrapper[2546]: E0614 14:43:11.887449 2546 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/3ede30b3-6f71-4b5c-a643-5efa6c254e1c-cluster-monitoring-operator-tls podName:3ede30b3-6f71-4b5c-a643-5efa6c254e1c nodeName:}" failed. No retries permitted until 2026-06-14 14:43:19.887438148 +0000 UTC m=+237.215820251 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/3ede30b3-6f71-4b5c-a643-5efa6c254e1c-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-f9d7df769-5jzh2" (UID: "3ede30b3-6f71-4b5c-a643-5efa6c254e1c") : secret "cluster-monitoring-operator-tls" not found Jun 14 14:43:11.887609 ip-10-0-129-116 kubenswrapper[2546]: I0614 14:43:11.887478 2546 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/7ae514d0-80e9-44d6-b358-84e57fe9d353-networking-console-plugin-cert\") pod \"networking-console-plugin-867b76cb74-kq2p9\" (UID: \"7ae514d0-80e9-44d6-b358-84e57fe9d353\") " pod="openshift-network-console/networking-console-plugin-867b76cb74-kq2p9" Jun 14 14:43:11.887609 ip-10-0-129-116 kubenswrapper[2546]: E0614 14:43:11.887550 2546 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found Jun 14 14:43:11.887609 ip-10-0-129-116 kubenswrapper[2546]: E0614 14:43:11.887571 2546 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/7ae514d0-80e9-44d6-b358-84e57fe9d353-networking-console-plugin-cert podName:7ae514d0-80e9-44d6-b358-84e57fe9d353 nodeName:}" failed. No retries permitted until 2026-06-14 14:43:19.887564544 +0000 UTC m=+237.215946647 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/7ae514d0-80e9-44d6-b358-84e57fe9d353-networking-console-plugin-cert") pod "networking-console-plugin-867b76cb74-kq2p9" (UID: "7ae514d0-80e9-44d6-b358-84e57fe9d353") : secret "networking-console-plugin-cert" not found Jun 14 14:43:11.902337 ip-10-0-129-116 kubenswrapper[2546]: I0614 14:43:11.902293 2546 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-kube-storage-version-migrator/migrator-d4bcd4867-nb768" podStartSLOduration=1.661390801 podStartE2EDuration="2.90227886s" totalImagesPullingTime="1.240888059s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-14 14:43:09 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-14 14:43:11.901655732 +0000 UTC m=+229.230037868" watchObservedRunningTime="2026-06-14 14:43:11.90227886 +0000 UTC m=+229.230660985" Jun 14 14:43:12.561254 ip-10-0-129-116 kubenswrapper[2546]: I0614 14:43:12.561227 2546 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-ptpcx_30e02c92-21a3-43cd-a129-a21a3a3ccb37/dns-node-resolver/0.log" Jun 14 14:43:13.306831 ip-10-0-129-116 kubenswrapper[2546]: I0614 14:43:13.306799 2546 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c96gx_105377da-c223-41ad-b033-546cb01239c4/konnectivity-agent/0.log" limit=1024 Jun 14 14:43:13.360235 ip-10-0-129-116 kubenswrapper[2546]: I0614 14:43:13.360207 2546 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-dshlf_4df84aa4-08f2-487d-a8fb-fa2fe8144da8/node-ca/0.log" Jun 14 14:43:13.499042 ip-10-0-129-116 kubenswrapper[2546]: I0614 14:43:13.499005 2546 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/5606a730-63da-4a6f-aaee-cd54b1ddeacf-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-qh5bb\" (UID: \"5606a730-63da-4a6f-aaee-cd54b1ddeacf\") " pod="openshift-insights/insights-runtime-extractor-qh5bb" Jun 14 14:43:13.499042 ip-10-0-129-116 kubenswrapper[2546]: I0614 14:43:13.499046 2546 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/5606a730-63da-4a6f-aaee-cd54b1ddeacf-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-qh5bb\" (UID: \"5606a730-63da-4a6f-aaee-cd54b1ddeacf\") " pod="openshift-insights/insights-runtime-extractor-qh5bb" Jun 14 14:43:13.499274 ip-10-0-129-116 kubenswrapper[2546]: E0614 14:43:13.499142 2546 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found Jun 14 14:43:13.499274 ip-10-0-129-116 kubenswrapper[2546]: E0614 14:43:13.499157 2546 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Jun 14 14:43:13.499274 ip-10-0-129-116 kubenswrapper[2546]: E0614 14:43:13.499207 2546 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/5606a730-63da-4a6f-aaee-cd54b1ddeacf-insights-runtime-extractor-tls podName:5606a730-63da-4a6f-aaee-cd54b1ddeacf nodeName:}" failed. No retries permitted until 2026-06-14 14:43:17.499191047 +0000 UTC m=+234.827573150 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/5606a730-63da-4a6f-aaee-cd54b1ddeacf-insights-runtime-extractor-tls") pod "insights-runtime-extractor-qh5bb" (UID: "5606a730-63da-4a6f-aaee-cd54b1ddeacf") : secret "insights-runtime-extractor-tls" not found Jun 14 14:43:13.499274 ip-10-0-129-116 kubenswrapper[2546]: E0614 14:43:13.499222 2546 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/5606a730-63da-4a6f-aaee-cd54b1ddeacf-kube-rbac-proxy-cm podName:5606a730-63da-4a6f-aaee-cd54b1ddeacf nodeName:}" failed. No retries permitted until 2026-06-14 14:43:17.499215198 +0000 UTC m=+234.827597301 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/5606a730-63da-4a6f-aaee-cd54b1ddeacf-kube-rbac-proxy-cm") pod "insights-runtime-extractor-qh5bb" (UID: "5606a730-63da-4a6f-aaee-cd54b1ddeacf") : configmap "kube-rbac-proxy" not found Jun 14 14:43:13.787188 ip-10-0-129-116 kubenswrapper[2546]: I0614 14:43:13.787135 2546 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c96gx_105377da-c223-41ad-b033-546cb01239c4/konnectivity-agent/0.log" limit=1024 Jun 14 14:43:13.892538 ip-10-0-129-116 kubenswrapper[2546]: I0614 14:43:13.892505 2546 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c96gx_105377da-c223-41ad-b033-546cb01239c4/konnectivity-agent/0.log" limit=1024 Jun 14 14:43:14.141915 ip-10-0-129-116 kubenswrapper[2546]: I0614 14:43:14.141879 2546 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c96gx_105377da-c223-41ad-b033-546cb01239c4/konnectivity-agent/0.log" limit=1024 Jun 14 14:43:14.243077 ip-10-0-129-116 kubenswrapper[2546]: I0614 14:43:14.243049 2546 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c96gx_105377da-c223-41ad-b033-546cb01239c4/konnectivity-agent/0.log" limit=1024 Jun 14 14:43:14.349307 ip-10-0-129-116 kubenswrapper[2546]: I0614 14:43:14.349222 2546 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c96gx_105377da-c223-41ad-b033-546cb01239c4/konnectivity-agent/0.log" limit=1024 Jun 14 14:43:14.489528 ip-10-0-129-116 kubenswrapper[2546]: I0614 14:43:14.489488 2546 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c96gx_105377da-c223-41ad-b033-546cb01239c4/konnectivity-agent/0.log" limit=1024 Jun 14 14:43:14.561286 ip-10-0-129-116 kubenswrapper[2546]: I0614 14:43:14.561259 2546 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-svjhc_7ac15fa8-5937-48af-af72-d0fb83eecda2/serve-healthcheck-canary/0.log" Jun 14 14:43:14.761630 ip-10-0-129-116 kubenswrapper[2546]: I0614 14:43:14.761607 2546 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator_migrator-d4bcd4867-nb768_68d24039-a1c7-4075-ba15-ae24d27282f0/migrator/0.log" Jun 14 14:43:14.961756 ip-10-0-129-116 kubenswrapper[2546]: I0614 14:43:14.961730 2546 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator_migrator-d4bcd4867-nb768_68d24039-a1c7-4075-ba15-ae24d27282f0/graceful-termination/0.log" Jun 14 14:43:15.282939 ip-10-0-129-116 kubenswrapper[2546]: I0614 14:43:15.282909 2546 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c96gx_105377da-c223-41ad-b033-546cb01239c4/konnectivity-agent/0.log" limit=1024 Jun 14 14:43:15.682202 ip-10-0-129-116 kubenswrapper[2546]: I0614 14:43:15.682172 2546 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c96gx_105377da-c223-41ad-b033-546cb01239c4/konnectivity-agent/0.log" limit=1024 Jun 14 14:43:16.085944 ip-10-0-129-116 kubenswrapper[2546]: I0614 14:43:16.085867 2546 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c96gx_105377da-c223-41ad-b033-546cb01239c4/konnectivity-agent/0.log" limit=1024 Jun 14 14:43:16.482806 ip-10-0-129-116 kubenswrapper[2546]: I0614 14:43:16.482776 2546 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c96gx_105377da-c223-41ad-b033-546cb01239c4/konnectivity-agent/0.log" limit=1024 Jun 14 14:43:16.889355 ip-10-0-129-116 kubenswrapper[2546]: I0614 14:43:16.889270 2546 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c96gx_105377da-c223-41ad-b033-546cb01239c4/konnectivity-agent/0.log" limit=1024 Jun 14 14:43:17.281837 ip-10-0-129-116 kubenswrapper[2546]: I0614 14:43:17.281810 2546 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c96gx_105377da-c223-41ad-b033-546cb01239c4/konnectivity-agent/0.log" limit=1024 Jun 14 14:43:17.532897 ip-10-0-129-116 kubenswrapper[2546]: I0614 14:43:17.532808 2546 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/5606a730-63da-4a6f-aaee-cd54b1ddeacf-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-qh5bb\" (UID: \"5606a730-63da-4a6f-aaee-cd54b1ddeacf\") " pod="openshift-insights/insights-runtime-extractor-qh5bb" Jun 14 14:43:17.532897 ip-10-0-129-116 kubenswrapper[2546]: I0614 14:43:17.532851 2546 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/5606a730-63da-4a6f-aaee-cd54b1ddeacf-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-qh5bb\" (UID: \"5606a730-63da-4a6f-aaee-cd54b1ddeacf\") " pod="openshift-insights/insights-runtime-extractor-qh5bb" Jun 14 14:43:17.533113 ip-10-0-129-116 kubenswrapper[2546]: E0614 14:43:17.532930 2546 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found Jun 14 14:43:17.533113 ip-10-0-129-116 kubenswrapper[2546]: E0614 14:43:17.532993 2546 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/5606a730-63da-4a6f-aaee-cd54b1ddeacf-kube-rbac-proxy-cm podName:5606a730-63da-4a6f-aaee-cd54b1ddeacf nodeName:}" failed. No retries permitted until 2026-06-14 14:43:25.532976809 +0000 UTC m=+242.861358911 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/5606a730-63da-4a6f-aaee-cd54b1ddeacf-kube-rbac-proxy-cm") pod "insights-runtime-extractor-qh5bb" (UID: "5606a730-63da-4a6f-aaee-cd54b1ddeacf") : configmap "kube-rbac-proxy" not found Jun 14 14:43:17.533113 ip-10-0-129-116 kubenswrapper[2546]: E0614 14:43:17.533012 2546 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Jun 14 14:43:17.533113 ip-10-0-129-116 kubenswrapper[2546]: E0614 14:43:17.533054 2546 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/5606a730-63da-4a6f-aaee-cd54b1ddeacf-insights-runtime-extractor-tls podName:5606a730-63da-4a6f-aaee-cd54b1ddeacf nodeName:}" failed. No retries permitted until 2026-06-14 14:43:25.533043013 +0000 UTC m=+242.861425116 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/5606a730-63da-4a6f-aaee-cd54b1ddeacf-insights-runtime-extractor-tls") pod "insights-runtime-extractor-qh5bb" (UID: "5606a730-63da-4a6f-aaee-cd54b1ddeacf") : secret "insights-runtime-extractor-tls" not found Jun 14 14:43:17.584075 ip-10-0-129-116 kubenswrapper[2546]: I0614 14:43:17.584039 2546 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c96gx_105377da-c223-41ad-b033-546cb01239c4/konnectivity-agent/0.log" limit=1024 Jun 14 14:43:17.684490 ip-10-0-129-116 kubenswrapper[2546]: I0614 14:43:17.684459 2546 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c96gx_105377da-c223-41ad-b033-546cb01239c4/konnectivity-agent/0.log" limit=1024 Jun 14 14:43:17.736552 ip-10-0-129-116 kubenswrapper[2546]: I0614 14:43:17.736525 2546 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c96gx_105377da-c223-41ad-b033-546cb01239c4/konnectivity-agent/0.log" limit=1024 Jun 14 14:43:17.881873 ip-10-0-129-116 kubenswrapper[2546]: I0614 14:43:17.881785 2546 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c96gx_105377da-c223-41ad-b033-546cb01239c4/konnectivity-agent/0.log" limit=1024 Jun 14 14:43:18.281456 ip-10-0-129-116 kubenswrapper[2546]: I0614 14:43:18.281425 2546 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c96gx_105377da-c223-41ad-b033-546cb01239c4/konnectivity-agent/0.log" limit=1024 Jun 14 14:43:19.081493 ip-10-0-129-116 kubenswrapper[2546]: I0614 14:43:19.081461 2546 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c96gx_105377da-c223-41ad-b033-546cb01239c4/konnectivity-agent/0.log" limit=1024 Jun 14 14:43:19.290928 ip-10-0-129-116 kubenswrapper[2546]: I0614 14:43:19.290893 2546 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c96gx_105377da-c223-41ad-b033-546cb01239c4/konnectivity-agent/0.log" limit=1024 Jun 14 14:43:19.680180 ip-10-0-129-116 kubenswrapper[2546]: I0614 14:43:19.680144 2546 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c96gx_105377da-c223-41ad-b033-546cb01239c4/konnectivity-agent/0.log" limit=1024 Jun 14 14:43:19.880481 ip-10-0-129-116 kubenswrapper[2546]: I0614 14:43:19.880452 2546 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c96gx_105377da-c223-41ad-b033-546cb01239c4/konnectivity-agent/0.log" limit=1024 Jun 14 14:43:19.948935 ip-10-0-129-116 kubenswrapper[2546]: I0614 14:43:19.948851 2546 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/3ede30b3-6f71-4b5c-a643-5efa6c254e1c-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-f9d7df769-5jzh2\" (UID: \"3ede30b3-6f71-4b5c-a643-5efa6c254e1c\") " pod="openshift-monitoring/cluster-monitoring-operator-f9d7df769-5jzh2" Jun 14 14:43:19.948935 ip-10-0-129-116 kubenswrapper[2546]: I0614 14:43:19.948914 2546 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/7ae514d0-80e9-44d6-b358-84e57fe9d353-networking-console-plugin-cert\") pod \"networking-console-plugin-867b76cb74-kq2p9\" (UID: \"7ae514d0-80e9-44d6-b358-84e57fe9d353\") " pod="openshift-network-console/networking-console-plugin-867b76cb74-kq2p9" Jun 14 14:43:19.949189 ip-10-0-129-116 kubenswrapper[2546]: I0614 14:43:19.948996 2546 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/14fb6e1b-853d-4107-b6b6-22d47cb7619c-service-ca-bundle\") pod \"router-default-5f9f5d888-dlm5r\" (UID: \"14fb6e1b-853d-4107-b6b6-22d47cb7619c\") " pod="openshift-ingress/router-default-5f9f5d888-dlm5r" Jun 14 14:43:19.949189 ip-10-0-129-116 kubenswrapper[2546]: E0614 14:43:19.949003 2546 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found Jun 14 14:43:19.949189 ip-10-0-129-116 kubenswrapper[2546]: I0614 14:43:19.949024 2546 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/14fb6e1b-853d-4107-b6b6-22d47cb7619c-metrics-certs\") pod \"router-default-5f9f5d888-dlm5r\" (UID: \"14fb6e1b-853d-4107-b6b6-22d47cb7619c\") " pod="openshift-ingress/router-default-5f9f5d888-dlm5r" Jun 14 14:43:19.949189 ip-10-0-129-116 kubenswrapper[2546]: E0614 14:43:19.949068 2546 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/3ede30b3-6f71-4b5c-a643-5efa6c254e1c-cluster-monitoring-operator-tls podName:3ede30b3-6f71-4b5c-a643-5efa6c254e1c nodeName:}" failed. No retries permitted until 2026-06-14 14:43:35.949048838 +0000 UTC m=+253.277430960 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/3ede30b3-6f71-4b5c-a643-5efa6c254e1c-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-f9d7df769-5jzh2" (UID: "3ede30b3-6f71-4b5c-a643-5efa6c254e1c") : secret "cluster-monitoring-operator-tls" not found Jun 14 14:43:19.949189 ip-10-0-129-116 kubenswrapper[2546]: I0614 14:43:19.949110 2546 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/e4181a2d-85c6-497b-99d9-1d2342894e9c-samples-operator-tls\") pod \"cluster-samples-operator-9547488fd-b9jnb\" (UID: \"e4181a2d-85c6-497b-99d9-1d2342894e9c\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-9547488fd-b9jnb" Jun 14 14:43:19.949189 ip-10-0-129-116 kubenswrapper[2546]: E0614 14:43:19.949066 2546 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found Jun 14 14:43:19.949189 ip-10-0-129-116 kubenswrapper[2546]: E0614 14:43:19.949140 2546 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/14fb6e1b-853d-4107-b6b6-22d47cb7619c-service-ca-bundle podName:14fb6e1b-853d-4107-b6b6-22d47cb7619c nodeName:}" failed. No retries permitted until 2026-06-14 14:43:35.949120653 +0000 UTC m=+253.277502760 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/14fb6e1b-853d-4107-b6b6-22d47cb7619c-service-ca-bundle") pod "router-default-5f9f5d888-dlm5r" (UID: "14fb6e1b-853d-4107-b6b6-22d47cb7619c") : configmap references non-existent config key: service-ca.crt Jun 14 14:43:19.949513 ip-10-0-129-116 kubenswrapper[2546]: E0614 14:43:19.949212 2546 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/7ae514d0-80e9-44d6-b358-84e57fe9d353-networking-console-plugin-cert podName:7ae514d0-80e9-44d6-b358-84e57fe9d353 nodeName:}" failed. No retries permitted until 2026-06-14 14:43:35.949194828 +0000 UTC m=+253.277576948 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/7ae514d0-80e9-44d6-b358-84e57fe9d353-networking-console-plugin-cert") pod "networking-console-plugin-867b76cb74-kq2p9" (UID: "7ae514d0-80e9-44d6-b358-84e57fe9d353") : secret "networking-console-plugin-cert" not found Jun 14 14:43:19.951475 ip-10-0-129-116 kubenswrapper[2546]: I0614 14:43:19.951450 2546 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/e4181a2d-85c6-497b-99d9-1d2342894e9c-samples-operator-tls\") pod \"cluster-samples-operator-9547488fd-b9jnb\" (UID: \"e4181a2d-85c6-497b-99d9-1d2342894e9c\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-9547488fd-b9jnb" Jun 14 14:43:19.951570 ip-10-0-129-116 kubenswrapper[2546]: I0614 14:43:19.951523 2546 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/14fb6e1b-853d-4107-b6b6-22d47cb7619c-metrics-certs\") pod \"router-default-5f9f5d888-dlm5r\" (UID: \"14fb6e1b-853d-4107-b6b6-22d47cb7619c\") " pod="openshift-ingress/router-default-5f9f5d888-dlm5r" Jun 14 14:43:19.954827 ip-10-0-129-116 kubenswrapper[2546]: I0614 14:43:19.954806 2546 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-samples-operator/cluster-samples-operator-9547488fd-b9jnb" Jun 14 14:43:20.077742 ip-10-0-129-116 kubenswrapper[2546]: I0614 14:43:20.077717 2546 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-cluster-samples-operator/cluster-samples-operator-9547488fd-b9jnb"] Jun 14 14:43:20.284114 ip-10-0-129-116 kubenswrapper[2546]: I0614 14:43:20.284010 2546 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c96gx_105377da-c223-41ad-b033-546cb01239c4/konnectivity-agent/0.log" limit=1024 Jun 14 14:43:20.377684 ip-10-0-129-116 kubenswrapper[2546]: I0614 14:43:20.377648 2546 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c96gx_105377da-c223-41ad-b033-546cb01239c4/konnectivity-agent/0.log" limit=1024 Jun 14 14:43:20.905970 ip-10-0-129-116 kubenswrapper[2546]: I0614 14:43:20.905931 2546 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c96gx_105377da-c223-41ad-b033-546cb01239c4/konnectivity-agent/0.log" limit=1024 Jun 14 14:43:20.913710 ip-10-0-129-116 kubenswrapper[2546]: I0614 14:43:20.913668 2546 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-samples-operator/cluster-samples-operator-9547488fd-b9jnb" event={"ID":"e4181a2d-85c6-497b-99d9-1d2342894e9c","Type":"ContainerStarted","Data":"13135d715bf7cfbb4be2572f4bf4b59318345d231222773ac8b072f7cf30601b"} Jun 14 14:43:21.283121 ip-10-0-129-116 kubenswrapper[2546]: I0614 14:43:21.283028 2546 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c96gx_105377da-c223-41ad-b033-546cb01239c4/konnectivity-agent/0.log" limit=1024 Jun 14 14:43:21.517066 ip-10-0-129-116 kubenswrapper[2546]: I0614 14:43:21.517030 2546 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c96gx_105377da-c223-41ad-b033-546cb01239c4/konnectivity-agent/0.log" limit=1024 Jun 14 14:43:21.685953 ip-10-0-129-116 kubenswrapper[2546]: I0614 14:43:21.685922 2546 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c96gx_105377da-c223-41ad-b033-546cb01239c4/konnectivity-agent/0.log" limit=1024 Jun 14 14:43:22.153985 ip-10-0-129-116 kubenswrapper[2546]: I0614 14:43:22.153955 2546 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c96gx_105377da-c223-41ad-b033-546cb01239c4/konnectivity-agent/0.log" limit=1024 Jun 14 14:43:22.282837 ip-10-0-129-116 kubenswrapper[2546]: I0614 14:43:22.282751 2546 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c96gx_105377da-c223-41ad-b033-546cb01239c4/konnectivity-agent/0.log" limit=1024 Jun 14 14:43:22.685609 ip-10-0-129-116 kubenswrapper[2546]: I0614 14:43:22.685575 2546 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c96gx_105377da-c223-41ad-b033-546cb01239c4/konnectivity-agent/0.log" limit=1024 Jun 14 14:43:22.921964 ip-10-0-129-116 kubenswrapper[2546]: I0614 14:43:22.921930 2546 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-samples-operator/cluster-samples-operator-9547488fd-b9jnb" event={"ID":"e4181a2d-85c6-497b-99d9-1d2342894e9c","Type":"ContainerStarted","Data":"145ae83f4bb99d65300fc930c18d33a1464f94faae934f95331fd4a64cf837d5"} Jun 14 14:43:22.922116 ip-10-0-129-116 kubenswrapper[2546]: I0614 14:43:22.921985 2546 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-samples-operator/cluster-samples-operator-9547488fd-b9jnb" event={"ID":"e4181a2d-85c6-497b-99d9-1d2342894e9c","Type":"ContainerStarted","Data":"f9347b0a20a4b823de710a452a95ecd9f913f3f09d35a403404dbc9e9d83974b"} Jun 14 14:43:22.937648 ip-10-0-129-116 kubenswrapper[2546]: I0614 14:43:22.937537 2546 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-samples-operator/cluster-samples-operator-9547488fd-b9jnb" podStartSLOduration=17.175286578 podStartE2EDuration="18.937519652s" totalImagesPullingTime="1.762233074s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-14 14:43:04 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-14 14:43:22.936842396 +0000 UTC m=+240.265224522" watchObservedRunningTime="2026-06-14 14:43:22.937519652 +0000 UTC m=+240.265901775" Jun 14 14:43:23.486663 ip-10-0-129-116 kubenswrapper[2546]: I0614 14:43:23.486630 2546 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c96gx_105377da-c223-41ad-b033-546cb01239c4/konnectivity-agent/0.log" limit=1024 Jun 14 14:43:23.683298 ip-10-0-129-116 kubenswrapper[2546]: I0614 14:43:23.683268 2546 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c96gx_105377da-c223-41ad-b033-546cb01239c4/konnectivity-agent/0.log" limit=1024 Jun 14 14:43:24.082154 ip-10-0-129-116 kubenswrapper[2546]: I0614 14:43:24.082116 2546 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c96gx_105377da-c223-41ad-b033-546cb01239c4/konnectivity-agent/0.log" limit=1024 Jun 14 14:43:24.282522 ip-10-0-129-116 kubenswrapper[2546]: I0614 14:43:24.282475 2546 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c96gx_105377da-c223-41ad-b033-546cb01239c4/konnectivity-agent/0.log" limit=1024 Jun 14 14:43:24.482854 ip-10-0-129-116 kubenswrapper[2546]: I0614 14:43:24.482819 2546 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c96gx_105377da-c223-41ad-b033-546cb01239c4/konnectivity-agent/0.log" limit=1024 Jun 14 14:43:25.599364 ip-10-0-129-116 kubenswrapper[2546]: I0614 14:43:25.599315 2546 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/5606a730-63da-4a6f-aaee-cd54b1ddeacf-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-qh5bb\" (UID: \"5606a730-63da-4a6f-aaee-cd54b1ddeacf\") " pod="openshift-insights/insights-runtime-extractor-qh5bb" Jun 14 14:43:25.599760 ip-10-0-129-116 kubenswrapper[2546]: I0614 14:43:25.599445 2546 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/5606a730-63da-4a6f-aaee-cd54b1ddeacf-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-qh5bb\" (UID: \"5606a730-63da-4a6f-aaee-cd54b1ddeacf\") " pod="openshift-insights/insights-runtime-extractor-qh5bb" Jun 14 14:43:25.599914 ip-10-0-129-116 kubenswrapper[2546]: I0614 14:43:25.599894 2546 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/5606a730-63da-4a6f-aaee-cd54b1ddeacf-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-qh5bb\" (UID: \"5606a730-63da-4a6f-aaee-cd54b1ddeacf\") " pod="openshift-insights/insights-runtime-extractor-qh5bb" Jun 14 14:43:25.601516 ip-10-0-129-116 kubenswrapper[2546]: I0614 14:43:25.601489 2546 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/5606a730-63da-4a6f-aaee-cd54b1ddeacf-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-qh5bb\" (UID: \"5606a730-63da-4a6f-aaee-cd54b1ddeacf\") " pod="openshift-insights/insights-runtime-extractor-qh5bb" Jun 14 14:43:25.679912 ip-10-0-129-116 kubenswrapper[2546]: I0614 14:43:25.679879 2546 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-sa-dockercfg-wt54v\"" Jun 14 14:43:25.688244 ip-10-0-129-116 kubenswrapper[2546]: I0614 14:43:25.688226 2546 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-qh5bb" Jun 14 14:43:25.812801 ip-10-0-129-116 kubenswrapper[2546]: I0614 14:43:25.812770 2546 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-qh5bb"] Jun 14 14:43:25.815911 ip-10-0-129-116 kubenswrapper[2546]: W0614 14:43:25.815882 2546 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5606a730_63da_4a6f_aaee_cd54b1ddeacf.slice/crio-c5bd43fb9d33488b77003d397617a2f3e0291e1c2c51df1b8fde3442ae00ab7d WatchSource:0}: Error finding container c5bd43fb9d33488b77003d397617a2f3e0291e1c2c51df1b8fde3442ae00ab7d: Status 404 returned error can't find the container with id c5bd43fb9d33488b77003d397617a2f3e0291e1c2c51df1b8fde3442ae00ab7d Jun 14 14:43:25.930692 ip-10-0-129-116 kubenswrapper[2546]: I0614 14:43:25.930648 2546 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-qh5bb" event={"ID":"5606a730-63da-4a6f-aaee-cd54b1ddeacf","Type":"ContainerStarted","Data":"c5bd43fb9d33488b77003d397617a2f3e0291e1c2c51df1b8fde3442ae00ab7d"} Jun 14 14:43:29.945138 ip-10-0-129-116 kubenswrapper[2546]: I0614 14:43:29.945077 2546 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-qh5bb" event={"ID":"5606a730-63da-4a6f-aaee-cd54b1ddeacf","Type":"ContainerStarted","Data":"355cfb7df7d9c4a4a917f4e6cd7b79326d92ded6b58419c620448197ddbd16aa"} Jun 14 14:43:30.104987 ip-10-0-129-116 kubenswrapper[2546]: I0614 14:43:30.104957 2546 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c96gx_105377da-c223-41ad-b033-546cb01239c4/konnectivity-agent/0.log" limit=1024 Jun 14 14:43:30.204920 ip-10-0-129-116 kubenswrapper[2546]: I0614 14:43:30.204837 2546 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c96gx_105377da-c223-41ad-b033-546cb01239c4/konnectivity-agent/0.log" limit=1024 Jun 14 14:43:30.250265 ip-10-0-129-116 kubenswrapper[2546]: I0614 14:43:30.250223 2546 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c96gx_105377da-c223-41ad-b033-546cb01239c4/konnectivity-agent/0.log" limit=1024 Jun 14 14:43:30.387402 ip-10-0-129-116 kubenswrapper[2546]: I0614 14:43:30.387372 2546 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c96gx_105377da-c223-41ad-b033-546cb01239c4/konnectivity-agent/0.log" limit=1024 Jun 14 14:43:30.564364 ip-10-0-129-116 kubenswrapper[2546]: I0614 14:43:30.564276 2546 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c96gx_105377da-c223-41ad-b033-546cb01239c4/konnectivity-agent/0.log" limit=1024 Jun 14 14:43:30.664748 ip-10-0-129-116 kubenswrapper[2546]: I0614 14:43:30.664711 2546 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c96gx_105377da-c223-41ad-b033-546cb01239c4/konnectivity-agent/0.log" limit=1024 Jun 14 14:43:30.919953 ip-10-0-129-116 kubenswrapper[2546]: I0614 14:43:30.919876 2546 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c96gx_105377da-c223-41ad-b033-546cb01239c4/konnectivity-agent/0.log" limit=1024 Jun 14 14:43:30.951067 ip-10-0-129-116 kubenswrapper[2546]: I0614 14:43:30.951031 2546 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-qh5bb" event={"ID":"5606a730-63da-4a6f-aaee-cd54b1ddeacf","Type":"ContainerStarted","Data":"4d54d7e9badd785c0d0f243f72705a31f3cd12ce3c4d4ed76312af75f872c98a"} Jun 14 14:43:31.012798 ip-10-0-129-116 kubenswrapper[2546]: I0614 14:43:31.012764 2546 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c96gx_105377da-c223-41ad-b033-546cb01239c4/konnectivity-agent/0.log" limit=1024 Jun 14 14:43:31.126365 ip-10-0-129-116 kubenswrapper[2546]: I0614 14:43:31.126337 2546 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c96gx_105377da-c223-41ad-b033-546cb01239c4/konnectivity-agent/0.log" limit=1024 Jun 14 14:43:31.225087 ip-10-0-129-116 kubenswrapper[2546]: I0614 14:43:31.225012 2546 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c96gx_105377da-c223-41ad-b033-546cb01239c4/konnectivity-agent/0.log" limit=1024 Jun 14 14:43:31.325143 ip-10-0-129-116 kubenswrapper[2546]: I0614 14:43:31.325116 2546 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c96gx_105377da-c223-41ad-b033-546cb01239c4/konnectivity-agent/0.log" limit=1024 Jun 14 14:43:31.774891 ip-10-0-129-116 kubenswrapper[2546]: I0614 14:43:31.774862 2546 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c96gx_105377da-c223-41ad-b033-546cb01239c4/konnectivity-agent/0.log" limit=1024 Jun 14 14:43:31.948028 ip-10-0-129-116 kubenswrapper[2546]: I0614 14:43:31.947952 2546 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c96gx_105377da-c223-41ad-b033-546cb01239c4/konnectivity-agent/0.log" limit=1024 Jun 14 14:43:32.057186 ip-10-0-129-116 kubenswrapper[2546]: I0614 14:43:32.057076 2546 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c96gx_105377da-c223-41ad-b033-546cb01239c4/konnectivity-agent/0.log" limit=1024 Jun 14 14:43:32.958456 ip-10-0-129-116 kubenswrapper[2546]: I0614 14:43:32.958424 2546 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-qh5bb" event={"ID":"5606a730-63da-4a6f-aaee-cd54b1ddeacf","Type":"ContainerStarted","Data":"504b62342cd088929db0704c38da759437cbc1df90c779b234c806bf4bfc6bb6"} Jun 14 14:43:32.975438 ip-10-0-129-116 kubenswrapper[2546]: I0614 14:43:32.975393 2546 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-insights/insights-runtime-extractor-qh5bb" podStartSLOduration=17.960410627999998 podStartE2EDuration="23.975379729s" totalImagesPullingTime="6.014969101s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-14 14:43:09 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-14 14:43:32.974242168 +0000 UTC m=+250.302624294" watchObservedRunningTime="2026-06-14 14:43:32.975379729 +0000 UTC m=+250.303761883" Jun 14 14:43:33.188585 ip-10-0-129-116 kubenswrapper[2546]: I0614 14:43:33.188547 2546 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c96gx_105377da-c223-41ad-b033-546cb01239c4/konnectivity-agent/0.log" limit=1024 Jun 14 14:43:33.290455 ip-10-0-129-116 kubenswrapper[2546]: I0614 14:43:33.290370 2546 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c96gx_105377da-c223-41ad-b033-546cb01239c4/konnectivity-agent/0.log" limit=1024 Jun 14 14:43:33.512755 ip-10-0-129-116 kubenswrapper[2546]: I0614 14:43:33.512724 2546 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c96gx_105377da-c223-41ad-b033-546cb01239c4/konnectivity-agent/0.log" limit=1024 Jun 14 14:43:33.563048 ip-10-0-129-116 kubenswrapper[2546]: I0614 14:43:33.562969 2546 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c96gx_105377da-c223-41ad-b033-546cb01239c4/konnectivity-agent/0.log" limit=1024 Jun 14 14:43:35.073120 ip-10-0-129-116 kubenswrapper[2546]: I0614 14:43:35.073064 2546 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/aa4feed6-27ad-493a-baa3-8d0d96cb5309-metrics-certs\") pod \"network-metrics-daemon-lt4g2\" (UID: \"aa4feed6-27ad-493a-baa3-8d0d96cb5309\") " pod="openshift-multus/network-metrics-daemon-lt4g2" Jun 14 14:43:35.075292 ip-10-0-129-116 kubenswrapper[2546]: I0614 14:43:35.075274 2546 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/aa4feed6-27ad-493a-baa3-8d0d96cb5309-metrics-certs\") pod \"network-metrics-daemon-lt4g2\" (UID: \"aa4feed6-27ad-493a-baa3-8d0d96cb5309\") " pod="openshift-multus/network-metrics-daemon-lt4g2" Jun 14 14:43:35.288550 ip-10-0-129-116 kubenswrapper[2546]: I0614 14:43:35.288519 2546 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-2pmmn\"" Jun 14 14:43:35.296620 ip-10-0-129-116 kubenswrapper[2546]: I0614 14:43:35.296597 2546 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-lt4g2" Jun 14 14:43:35.419494 ip-10-0-129-116 kubenswrapper[2546]: I0614 14:43:35.419463 2546 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-lt4g2"] Jun 14 14:43:35.422297 ip-10-0-129-116 kubenswrapper[2546]: W0614 14:43:35.422270 2546 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podaa4feed6_27ad_493a_baa3_8d0d96cb5309.slice/crio-c1d2d49be90de51f885a8fff26f4fdcb235e22f39492c8fe263cdaf74bade8e7 WatchSource:0}: Error finding container c1d2d49be90de51f885a8fff26f4fdcb235e22f39492c8fe263cdaf74bade8e7: Status 404 returned error can't find the container with id c1d2d49be90de51f885a8fff26f4fdcb235e22f39492c8fe263cdaf74bade8e7 Jun 14 14:43:35.502664 ip-10-0-129-116 kubenswrapper[2546]: I0614 14:43:35.502637 2546 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c96gx_105377da-c223-41ad-b033-546cb01239c4/konnectivity-agent/0.log" limit=1024 Jun 14 14:43:35.603438 ip-10-0-129-116 kubenswrapper[2546]: I0614 14:43:35.603335 2546 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c96gx_105377da-c223-41ad-b033-546cb01239c4/konnectivity-agent/0.log" limit=1024 Jun 14 14:43:35.970351 ip-10-0-129-116 kubenswrapper[2546]: I0614 14:43:35.970314 2546 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-lt4g2" event={"ID":"aa4feed6-27ad-493a-baa3-8d0d96cb5309","Type":"ContainerStarted","Data":"c1d2d49be90de51f885a8fff26f4fdcb235e22f39492c8fe263cdaf74bade8e7"} Jun 14 14:43:35.980719 ip-10-0-129-116 kubenswrapper[2546]: I0614 14:43:35.980695 2546 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/14fb6e1b-853d-4107-b6b6-22d47cb7619c-service-ca-bundle\") pod \"router-default-5f9f5d888-dlm5r\" (UID: \"14fb6e1b-853d-4107-b6b6-22d47cb7619c\") " pod="openshift-ingress/router-default-5f9f5d888-dlm5r" Jun 14 14:43:35.980793 ip-10-0-129-116 kubenswrapper[2546]: I0614 14:43:35.980743 2546 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/3ede30b3-6f71-4b5c-a643-5efa6c254e1c-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-f9d7df769-5jzh2\" (UID: \"3ede30b3-6f71-4b5c-a643-5efa6c254e1c\") " pod="openshift-monitoring/cluster-monitoring-operator-f9d7df769-5jzh2" Jun 14 14:43:35.980793 ip-10-0-129-116 kubenswrapper[2546]: I0614 14:43:35.980773 2546 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/7ae514d0-80e9-44d6-b358-84e57fe9d353-networking-console-plugin-cert\") pod \"networking-console-plugin-867b76cb74-kq2p9\" (UID: \"7ae514d0-80e9-44d6-b358-84e57fe9d353\") " pod="openshift-network-console/networking-console-plugin-867b76cb74-kq2p9" Jun 14 14:43:35.981343 ip-10-0-129-116 kubenswrapper[2546]: I0614 14:43:35.981321 2546 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/14fb6e1b-853d-4107-b6b6-22d47cb7619c-service-ca-bundle\") pod \"router-default-5f9f5d888-dlm5r\" (UID: \"14fb6e1b-853d-4107-b6b6-22d47cb7619c\") " pod="openshift-ingress/router-default-5f9f5d888-dlm5r" Jun 14 14:43:35.983161 ip-10-0-129-116 kubenswrapper[2546]: I0614 14:43:35.983140 2546 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/7ae514d0-80e9-44d6-b358-84e57fe9d353-networking-console-plugin-cert\") pod \"networking-console-plugin-867b76cb74-kq2p9\" (UID: \"7ae514d0-80e9-44d6-b358-84e57fe9d353\") " pod="openshift-network-console/networking-console-plugin-867b76cb74-kq2p9" Jun 14 14:43:35.983242 ip-10-0-129-116 kubenswrapper[2546]: I0614 14:43:35.983209 2546 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/3ede30b3-6f71-4b5c-a643-5efa6c254e1c-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-f9d7df769-5jzh2\" (UID: \"3ede30b3-6f71-4b5c-a643-5efa6c254e1c\") " pod="openshift-monitoring/cluster-monitoring-operator-f9d7df769-5jzh2" Jun 14 14:43:36.151266 ip-10-0-129-116 kubenswrapper[2546]: I0614 14:43:36.151191 2546 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-console\"/\"default-dockercfg-s474d\"" Jun 14 14:43:36.159124 ip-10-0-129-116 kubenswrapper[2546]: I0614 14:43:36.159106 2546 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-console/networking-console-plugin-867b76cb74-kq2p9" Jun 14 14:43:36.162472 ip-10-0-129-116 kubenswrapper[2546]: I0614 14:43:36.162451 2546 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"cluster-monitoring-operator-dockercfg-fcv76\"" Jun 14 14:43:36.171329 ip-10-0-129-116 kubenswrapper[2546]: I0614 14:43:36.171306 2546 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/cluster-monitoring-operator-f9d7df769-5jzh2" Jun 14 14:43:36.237827 ip-10-0-129-116 kubenswrapper[2546]: I0614 14:43:36.237613 2546 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"router-dockercfg-jrdhw\"" Jun 14 14:43:36.246357 ip-10-0-129-116 kubenswrapper[2546]: I0614 14:43:36.246183 2546 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/router-default-5f9f5d888-dlm5r" Jun 14 14:43:36.323728 ip-10-0-129-116 kubenswrapper[2546]: I0614 14:43:36.318061 2546 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-console/networking-console-plugin-867b76cb74-kq2p9"] Jun 14 14:43:36.336288 ip-10-0-129-116 kubenswrapper[2546]: I0614 14:43:36.336208 2546 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/cluster-monitoring-operator-f9d7df769-5jzh2"] Jun 14 14:43:36.342679 ip-10-0-129-116 kubenswrapper[2546]: W0614 14:43:36.342635 2546 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3ede30b3_6f71_4b5c_a643_5efa6c254e1c.slice/crio-37448b36dbe9f85d696820f5ff59efbfd7c08816701674fecb3e0f7f4c19e157 WatchSource:0}: Error finding container 37448b36dbe9f85d696820f5ff59efbfd7c08816701674fecb3e0f7f4c19e157: Status 404 returned error can't find the container with id 37448b36dbe9f85d696820f5ff59efbfd7c08816701674fecb3e0f7f4c19e157 Jun 14 14:43:36.405026 ip-10-0-129-116 kubenswrapper[2546]: I0614 14:43:36.404863 2546 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/router-default-5f9f5d888-dlm5r"] Jun 14 14:43:36.565622 ip-10-0-129-116 kubenswrapper[2546]: W0614 14:43:36.565556 2546 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod14fb6e1b_853d_4107_b6b6_22d47cb7619c.slice/crio-af84090d9e8b76d42f5249ab06b5dbda3e56cb6765501a6c66c26756d9d02cd5 WatchSource:0}: Error finding container af84090d9e8b76d42f5249ab06b5dbda3e56cb6765501a6c66c26756d9d02cd5: Status 404 returned error can't find the container with id af84090d9e8b76d42f5249ab06b5dbda3e56cb6765501a6c66c26756d9d02cd5 Jun 14 14:43:36.975278 ip-10-0-129-116 kubenswrapper[2546]: I0614 14:43:36.975243 2546 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-lt4g2" event={"ID":"aa4feed6-27ad-493a-baa3-8d0d96cb5309","Type":"ContainerStarted","Data":"7ebd4b3a30e81b034d921b5279f0dbaf78334063793f841f04e252f981bb0c88"} Jun 14 14:43:36.975466 ip-10-0-129-116 kubenswrapper[2546]: I0614 14:43:36.975308 2546 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-lt4g2" event={"ID":"aa4feed6-27ad-493a-baa3-8d0d96cb5309","Type":"ContainerStarted","Data":"3cd136bcc0af0d9201e69e7b14cb1bd99d296824e06331e0108aa931dd176a98"} Jun 14 14:43:36.976725 ip-10-0-129-116 kubenswrapper[2546]: I0614 14:43:36.976695 2546 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/router-default-5f9f5d888-dlm5r" event={"ID":"14fb6e1b-853d-4107-b6b6-22d47cb7619c","Type":"ContainerStarted","Data":"e8e289460a83f413f138430a91671a2731efc4a0a77906ef3926663e308e30e6"} Jun 14 14:43:36.976849 ip-10-0-129-116 kubenswrapper[2546]: I0614 14:43:36.976730 2546 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/router-default-5f9f5d888-dlm5r" event={"ID":"14fb6e1b-853d-4107-b6b6-22d47cb7619c","Type":"ContainerStarted","Data":"af84090d9e8b76d42f5249ab06b5dbda3e56cb6765501a6c66c26756d9d02cd5"} Jun 14 14:43:36.977701 ip-10-0-129-116 kubenswrapper[2546]: I0614 14:43:36.977678 2546 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/cluster-monitoring-operator-f9d7df769-5jzh2" event={"ID":"3ede30b3-6f71-4b5c-a643-5efa6c254e1c","Type":"ContainerStarted","Data":"37448b36dbe9f85d696820f5ff59efbfd7c08816701674fecb3e0f7f4c19e157"} Jun 14 14:43:36.978680 ip-10-0-129-116 kubenswrapper[2546]: I0614 14:43:36.978662 2546 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-console/networking-console-plugin-867b76cb74-kq2p9" event={"ID":"7ae514d0-80e9-44d6-b358-84e57fe9d353","Type":"ContainerStarted","Data":"7c35dd40cd663634a9f42f4f6dd8750ae5b7719b8ca95c3e99b31e7cfe881360"} Jun 14 14:43:36.990941 ip-10-0-129-116 kubenswrapper[2546]: I0614 14:43:36.990904 2546 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/network-metrics-daemon-lt4g2" podStartSLOduration=252.804842024 podStartE2EDuration="4m13.990891946s" totalImagesPullingTime="1.186049922s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-14 14:39:23 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-14 14:43:36.990354245 +0000 UTC m=+254.318736374" watchObservedRunningTime="2026-06-14 14:43:36.990891946 +0000 UTC m=+254.319274131" Jun 14 14:43:37.008299 ip-10-0-129-116 kubenswrapper[2546]: I0614 14:43:37.008253 2546 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/router-default-5f9f5d888-dlm5r" podStartSLOduration=33.008239093 podStartE2EDuration="33.008239093s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-14 14:43:04 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-14 14:43:37.007242876 +0000 UTC m=+254.335625013" watchObservedRunningTime="2026-06-14 14:43:37.008239093 +0000 UTC m=+254.336621217" Jun 14 14:43:37.076707 ip-10-0-129-116 kubenswrapper[2546]: I0614 14:43:37.076628 2546 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c96gx_105377da-c223-41ad-b033-546cb01239c4/konnectivity-agent/0.log" limit=1024 Jun 14 14:43:37.135457 ip-10-0-129-116 kubenswrapper[2546]: I0614 14:43:37.135420 2546 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c96gx_105377da-c223-41ad-b033-546cb01239c4/konnectivity-agent/0.log" limit=1024 Jun 14 14:43:37.246671 ip-10-0-129-116 kubenswrapper[2546]: I0614 14:43:37.246541 2546 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/router-default-5f9f5d888-dlm5r" Jun 14 14:43:37.249338 ip-10-0-129-116 kubenswrapper[2546]: I0614 14:43:37.249314 2546 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/router-default-5f9f5d888-dlm5r" Jun 14 14:43:37.983265 ip-10-0-129-116 kubenswrapper[2546]: I0614 14:43:37.983223 2546 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/router-default-5f9f5d888-dlm5r" Jun 14 14:43:37.984514 ip-10-0-129-116 kubenswrapper[2546]: I0614 14:43:37.984491 2546 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/router-default-5f9f5d888-dlm5r" Jun 14 14:43:38.467291 ip-10-0-129-116 kubenswrapper[2546]: I0614 14:43:38.467256 2546 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c96gx_105377da-c223-41ad-b033-546cb01239c4/konnectivity-agent/0.log" limit=1024 Jun 14 14:43:38.631058 ip-10-0-129-116 kubenswrapper[2546]: I0614 14:43:38.631026 2546 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c96gx_105377da-c223-41ad-b033-546cb01239c4/konnectivity-agent/0.log" limit=1024 Jun 14 14:43:38.640428 ip-10-0-129-116 kubenswrapper[2546]: I0614 14:43:38.640400 2546 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/prometheus-operator-admission-webhook-5cf667749c-zr7bg"] Jun 14 14:43:38.643574 ip-10-0-129-116 kubenswrapper[2546]: I0614 14:43:38.643560 2546 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-admission-webhook-5cf667749c-zr7bg" Jun 14 14:43:38.646488 ip-10-0-129-116 kubenswrapper[2546]: I0614 14:43:38.646462 2546 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-admission-webhook-tls\"" Jun 14 14:43:38.646731 ip-10-0-129-116 kubenswrapper[2546]: I0614 14:43:38.646713 2546 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-admission-webhook-dockercfg-2rcm5\"" Jun 14 14:43:38.653392 ip-10-0-129-116 kubenswrapper[2546]: I0614 14:43:38.653373 2546 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-admission-webhook-5cf667749c-zr7bg"] Jun 14 14:43:38.704081 ip-10-0-129-116 kubenswrapper[2546]: I0614 14:43:38.704046 2546 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certificates\" (UniqueName: \"kubernetes.io/secret/d5bc500a-d8b0-4cc9-9c14-87641d708038-tls-certificates\") pod \"prometheus-operator-admission-webhook-5cf667749c-zr7bg\" (UID: \"d5bc500a-d8b0-4cc9-9c14-87641d708038\") " pod="openshift-monitoring/prometheus-operator-admission-webhook-5cf667749c-zr7bg" Jun 14 14:43:38.788352 ip-10-0-129-116 kubenswrapper[2546]: I0614 14:43:38.788262 2546 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c96gx_105377da-c223-41ad-b033-546cb01239c4/konnectivity-agent/0.log" limit=1024 Jun 14 14:43:38.805414 ip-10-0-129-116 kubenswrapper[2546]: I0614 14:43:38.805372 2546 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certificates\" (UniqueName: \"kubernetes.io/secret/d5bc500a-d8b0-4cc9-9c14-87641d708038-tls-certificates\") pod \"prometheus-operator-admission-webhook-5cf667749c-zr7bg\" (UID: \"d5bc500a-d8b0-4cc9-9c14-87641d708038\") " pod="openshift-monitoring/prometheus-operator-admission-webhook-5cf667749c-zr7bg" Jun 14 14:43:38.807908 ip-10-0-129-116 kubenswrapper[2546]: I0614 14:43:38.807878 2546 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certificates\" (UniqueName: \"kubernetes.io/secret/d5bc500a-d8b0-4cc9-9c14-87641d708038-tls-certificates\") pod \"prometheus-operator-admission-webhook-5cf667749c-zr7bg\" (UID: \"d5bc500a-d8b0-4cc9-9c14-87641d708038\") " pod="openshift-monitoring/prometheus-operator-admission-webhook-5cf667749c-zr7bg" Jun 14 14:43:38.952357 ip-10-0-129-116 kubenswrapper[2546]: I0614 14:43:38.952324 2546 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-admission-webhook-5cf667749c-zr7bg" Jun 14 14:43:38.988037 ip-10-0-129-116 kubenswrapper[2546]: I0614 14:43:38.988002 2546 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/cluster-monitoring-operator-f9d7df769-5jzh2" event={"ID":"3ede30b3-6f71-4b5c-a643-5efa6c254e1c","Type":"ContainerStarted","Data":"7291111f70e5805042001ca04a4cad7750b22e5993e2bdd224f47f4d42f62dcc"} Jun 14 14:43:38.989639 ip-10-0-129-116 kubenswrapper[2546]: I0614 14:43:38.989612 2546 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-console/networking-console-plugin-867b76cb74-kq2p9" event={"ID":"7ae514d0-80e9-44d6-b358-84e57fe9d353","Type":"ContainerStarted","Data":"1567ee798ad1fb338dec794c80bf30fd8d7018627ce5fe2b4b940a9a8eb424a1"} Jun 14 14:43:39.004293 ip-10-0-129-116 kubenswrapper[2546]: I0614 14:43:39.004242 2546 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/cluster-monitoring-operator-f9d7df769-5jzh2" podStartSLOduration=33.216331594 podStartE2EDuration="35.004218215s" totalImagesPullingTime="1.787886621s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-14 14:43:04 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-14 14:43:39.002625823 +0000 UTC m=+256.331007949" watchObservedRunningTime="2026-06-14 14:43:39.004218215 +0000 UTC m=+256.332600322" Jun 14 14:43:39.017738 ip-10-0-129-116 kubenswrapper[2546]: I0614 14:43:39.017692 2546 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-console/networking-console-plugin-867b76cb74-kq2p9" podStartSLOduration=33.208091189 podStartE2EDuration="35.017676592s" totalImagesPullingTime="1.809585403s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-14 14:43:04 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-14 14:43:39.017446369 +0000 UTC m=+256.345828495" watchObservedRunningTime="2026-06-14 14:43:39.017676592 +0000 UTC m=+256.346058716" Jun 14 14:43:39.083529 ip-10-0-129-116 kubenswrapper[2546]: I0614 14:43:39.083499 2546 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-admission-webhook-5cf667749c-zr7bg"] Jun 14 14:43:39.086225 ip-10-0-129-116 kubenswrapper[2546]: W0614 14:43:39.086202 2546 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd5bc500a_d8b0_4cc9_9c14_87641d708038.slice/crio-918a57c8a567e552be498eed4c9b3fd29caa0d59c109acc4a6988a9c7dfd6a5b WatchSource:0}: Error finding container 918a57c8a567e552be498eed4c9b3fd29caa0d59c109acc4a6988a9c7dfd6a5b: Status 404 returned error can't find the container with id 918a57c8a567e552be498eed4c9b3fd29caa0d59c109acc4a6988a9c7dfd6a5b Jun 14 14:43:39.109342 ip-10-0-129-116 kubenswrapper[2546]: I0614 14:43:39.109316 2546 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c96gx_105377da-c223-41ad-b033-546cb01239c4/konnectivity-agent/0.log" limit=1024 Jun 14 14:43:39.161806 ip-10-0-129-116 kubenswrapper[2546]: I0614 14:43:39.161771 2546 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c96gx_105377da-c223-41ad-b033-546cb01239c4/konnectivity-agent/0.log" limit=1024 Jun 14 14:43:39.994378 ip-10-0-129-116 kubenswrapper[2546]: I0614 14:43:39.994339 2546 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-admission-webhook-5cf667749c-zr7bg" event={"ID":"d5bc500a-d8b0-4cc9-9c14-87641d708038","Type":"ContainerStarted","Data":"918a57c8a567e552be498eed4c9b3fd29caa0d59c109acc4a6988a9c7dfd6a5b"} Jun 14 14:43:40.560049 ip-10-0-129-116 kubenswrapper[2546]: I0614 14:43:40.560003 2546 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c96gx_105377da-c223-41ad-b033-546cb01239c4/konnectivity-agent/0.log" limit=1024 Jun 14 14:43:40.614325 ip-10-0-129-116 kubenswrapper[2546]: I0614 14:43:40.614291 2546 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c96gx_105377da-c223-41ad-b033-546cb01239c4/konnectivity-agent/0.log" limit=1024 Jun 14 14:43:40.999232 ip-10-0-129-116 kubenswrapper[2546]: I0614 14:43:40.999199 2546 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-admission-webhook-5cf667749c-zr7bg" event={"ID":"d5bc500a-d8b0-4cc9-9c14-87641d708038","Type":"ContainerStarted","Data":"47cdac3db80a3fbc86a90c900f33a4853d6a442f24c9e442f783429f1ec4eb71"} Jun 14 14:43:40.999685 ip-10-0-129-116 kubenswrapper[2546]: I0614 14:43:40.999403 2546 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/prometheus-operator-admission-webhook-5cf667749c-zr7bg" Jun 14 14:43:41.003818 ip-10-0-129-116 kubenswrapper[2546]: I0614 14:43:41.003801 2546 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/prometheus-operator-admission-webhook-5cf667749c-zr7bg" Jun 14 14:43:41.014894 ip-10-0-129-116 kubenswrapper[2546]: I0614 14:43:41.014850 2546 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/prometheus-operator-admission-webhook-5cf667749c-zr7bg" podStartSLOduration=1.64351219 podStartE2EDuration="3.014838434s" totalImagesPullingTime="1.371326244s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-14 14:43:38 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-14 14:43:41.013820522 +0000 UTC m=+258.342202685" watchObservedRunningTime="2026-06-14 14:43:41.014838434 +0000 UTC m=+258.343220578" Jun 14 14:43:41.642923 ip-10-0-129-116 kubenswrapper[2546]: I0614 14:43:41.642887 2546 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c96gx_105377da-c223-41ad-b033-546cb01239c4/konnectivity-agent/0.log" limit=1024 Jun 14 14:43:41.677515 ip-10-0-129-116 kubenswrapper[2546]: I0614 14:43:41.677487 2546 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/prometheus-operator-864fcfc6f9-8w65j"] Jun 14 14:43:41.680848 ip-10-0-129-116 kubenswrapper[2546]: I0614 14:43:41.680831 2546 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-864fcfc6f9-8w65j" Jun 14 14:43:41.683811 ip-10-0-129-116 kubenswrapper[2546]: I0614 14:43:41.683788 2546 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-kube-rbac-proxy-config\"" Jun 14 14:43:41.684054 ip-10-0-129-116 kubenswrapper[2546]: I0614 14:43:41.684038 2546 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-tls\"" Jun 14 14:43:41.684132 ip-10-0-129-116 kubenswrapper[2546]: I0614 14:43:41.684066 2546 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-dockercfg-fttlt\"" Jun 14 14:43:41.685280 ip-10-0-129-116 kubenswrapper[2546]: I0614 14:43:41.685260 2546 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"metrics-client-ca\"" Jun 14 14:43:41.690471 ip-10-0-129-116 kubenswrapper[2546]: I0614 14:43:41.690451 2546 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-864fcfc6f9-8w65j"] Jun 14 14:43:41.707403 ip-10-0-129-116 kubenswrapper[2546]: I0614 14:43:41.707366 2546 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c96gx_105377da-c223-41ad-b033-546cb01239c4/konnectivity-agent/0.log" limit=1024 Jun 14 14:43:41.829132 ip-10-0-129-116 kubenswrapper[2546]: I0614 14:43:41.829076 2546 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-operator-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/0b7d171a-51f8-440e-bc4d-4f497cada312-prometheus-operator-kube-rbac-proxy-config\") pod \"prometheus-operator-864fcfc6f9-8w65j\" (UID: \"0b7d171a-51f8-440e-bc4d-4f497cada312\") " pod="openshift-monitoring/prometheus-operator-864fcfc6f9-8w65j" Jun 14 14:43:41.829298 ip-10-0-129-116 kubenswrapper[2546]: I0614 14:43:41.829149 2546 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-operator-tls\" (UniqueName: \"kubernetes.io/secret/0b7d171a-51f8-440e-bc4d-4f497cada312-prometheus-operator-tls\") pod \"prometheus-operator-864fcfc6f9-8w65j\" (UID: \"0b7d171a-51f8-440e-bc4d-4f497cada312\") " pod="openshift-monitoring/prometheus-operator-864fcfc6f9-8w65j" Jun 14 14:43:41.829298 ip-10-0-129-116 kubenswrapper[2546]: I0614 14:43:41.829168 2546 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qn2mv\" (UniqueName: \"kubernetes.io/projected/0b7d171a-51f8-440e-bc4d-4f497cada312-kube-api-access-qn2mv\") pod \"prometheus-operator-864fcfc6f9-8w65j\" (UID: \"0b7d171a-51f8-440e-bc4d-4f497cada312\") " pod="openshift-monitoring/prometheus-operator-864fcfc6f9-8w65j" Jun 14 14:43:41.829298 ip-10-0-129-116 kubenswrapper[2546]: I0614 14:43:41.829204 2546 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/0b7d171a-51f8-440e-bc4d-4f497cada312-metrics-client-ca\") pod \"prometheus-operator-864fcfc6f9-8w65j\" (UID: \"0b7d171a-51f8-440e-bc4d-4f497cada312\") " pod="openshift-monitoring/prometheus-operator-864fcfc6f9-8w65j" Jun 14 14:43:41.929896 ip-10-0-129-116 kubenswrapper[2546]: I0614 14:43:41.929863 2546 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-operator-tls\" (UniqueName: \"kubernetes.io/secret/0b7d171a-51f8-440e-bc4d-4f497cada312-prometheus-operator-tls\") pod \"prometheus-operator-864fcfc6f9-8w65j\" (UID: \"0b7d171a-51f8-440e-bc4d-4f497cada312\") " pod="openshift-monitoring/prometheus-operator-864fcfc6f9-8w65j" Jun 14 14:43:41.929896 ip-10-0-129-116 kubenswrapper[2546]: I0614 14:43:41.929893 2546 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qn2mv\" (UniqueName: \"kubernetes.io/projected/0b7d171a-51f8-440e-bc4d-4f497cada312-kube-api-access-qn2mv\") pod \"prometheus-operator-864fcfc6f9-8w65j\" (UID: \"0b7d171a-51f8-440e-bc4d-4f497cada312\") " pod="openshift-monitoring/prometheus-operator-864fcfc6f9-8w65j" Jun 14 14:43:41.930143 ip-10-0-129-116 kubenswrapper[2546]: I0614 14:43:41.929920 2546 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/0b7d171a-51f8-440e-bc4d-4f497cada312-metrics-client-ca\") pod \"prometheus-operator-864fcfc6f9-8w65j\" (UID: \"0b7d171a-51f8-440e-bc4d-4f497cada312\") " pod="openshift-monitoring/prometheus-operator-864fcfc6f9-8w65j" Jun 14 14:43:41.930143 ip-10-0-129-116 kubenswrapper[2546]: I0614 14:43:41.929975 2546 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-operator-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/0b7d171a-51f8-440e-bc4d-4f497cada312-prometheus-operator-kube-rbac-proxy-config\") pod \"prometheus-operator-864fcfc6f9-8w65j\" (UID: \"0b7d171a-51f8-440e-bc4d-4f497cada312\") " pod="openshift-monitoring/prometheus-operator-864fcfc6f9-8w65j" Jun 14 14:43:41.930680 ip-10-0-129-116 kubenswrapper[2546]: I0614 14:43:41.930659 2546 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/0b7d171a-51f8-440e-bc4d-4f497cada312-metrics-client-ca\") pod \"prometheus-operator-864fcfc6f9-8w65j\" (UID: \"0b7d171a-51f8-440e-bc4d-4f497cada312\") " pod="openshift-monitoring/prometheus-operator-864fcfc6f9-8w65j" Jun 14 14:43:41.932293 ip-10-0-129-116 kubenswrapper[2546]: I0614 14:43:41.932268 2546 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-operator-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/0b7d171a-51f8-440e-bc4d-4f497cada312-prometheus-operator-kube-rbac-proxy-config\") pod \"prometheus-operator-864fcfc6f9-8w65j\" (UID: \"0b7d171a-51f8-440e-bc4d-4f497cada312\") " pod="openshift-monitoring/prometheus-operator-864fcfc6f9-8w65j" Jun 14 14:43:41.932377 ip-10-0-129-116 kubenswrapper[2546]: I0614 14:43:41.932354 2546 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-operator-tls\" (UniqueName: \"kubernetes.io/secret/0b7d171a-51f8-440e-bc4d-4f497cada312-prometheus-operator-tls\") pod \"prometheus-operator-864fcfc6f9-8w65j\" (UID: \"0b7d171a-51f8-440e-bc4d-4f497cada312\") " pod="openshift-monitoring/prometheus-operator-864fcfc6f9-8w65j" Jun 14 14:43:41.937833 ip-10-0-129-116 kubenswrapper[2546]: I0614 14:43:41.937807 2546 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-qn2mv\" (UniqueName: \"kubernetes.io/projected/0b7d171a-51f8-440e-bc4d-4f497cada312-kube-api-access-qn2mv\") pod \"prometheus-operator-864fcfc6f9-8w65j\" (UID: \"0b7d171a-51f8-440e-bc4d-4f497cada312\") " pod="openshift-monitoring/prometheus-operator-864fcfc6f9-8w65j" Jun 14 14:43:41.945749 ip-10-0-129-116 kubenswrapper[2546]: I0614 14:43:41.945728 2546 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c96gx_105377da-c223-41ad-b033-546cb01239c4/konnectivity-agent/0.log" limit=1024 Jun 14 14:43:41.989829 ip-10-0-129-116 kubenswrapper[2546]: I0614 14:43:41.989798 2546 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-864fcfc6f9-8w65j" Jun 14 14:43:42.119608 ip-10-0-129-116 kubenswrapper[2546]: I0614 14:43:42.119578 2546 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-864fcfc6f9-8w65j"] Jun 14 14:43:42.123688 ip-10-0-129-116 kubenswrapper[2546]: W0614 14:43:42.123659 2546 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0b7d171a_51f8_440e_bc4d_4f497cada312.slice/crio-68b27a1752f67bd55792aef1931c63b5e57cc607f1f6183b0e77c86d1f5aec1a WatchSource:0}: Error finding container 68b27a1752f67bd55792aef1931c63b5e57cc607f1f6183b0e77c86d1f5aec1a: Status 404 returned error can't find the container with id 68b27a1752f67bd55792aef1931c63b5e57cc607f1f6183b0e77c86d1f5aec1a Jun 14 14:43:43.008439 ip-10-0-129-116 kubenswrapper[2546]: I0614 14:43:43.008402 2546 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-864fcfc6f9-8w65j" event={"ID":"0b7d171a-51f8-440e-bc4d-4f497cada312","Type":"ContainerStarted","Data":"68b27a1752f67bd55792aef1931c63b5e57cc607f1f6183b0e77c86d1f5aec1a"} Jun 14 14:43:43.796111 ip-10-0-129-116 kubenswrapper[2546]: I0614 14:43:43.796061 2546 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c96gx_105377da-c223-41ad-b033-546cb01239c4/konnectivity-agent/0.log" limit=1024 Jun 14 14:43:44.013395 ip-10-0-129-116 kubenswrapper[2546]: I0614 14:43:44.013358 2546 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-864fcfc6f9-8w65j" event={"ID":"0b7d171a-51f8-440e-bc4d-4f497cada312","Type":"ContainerStarted","Data":"648ec62d640c2de993e39442af8b6fa6db8000f84d6eff625856cfd7807a5306"} Jun 14 14:43:44.013557 ip-10-0-129-116 kubenswrapper[2546]: I0614 14:43:44.013408 2546 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-864fcfc6f9-8w65j" event={"ID":"0b7d171a-51f8-440e-bc4d-4f497cada312","Type":"ContainerStarted","Data":"be039783effb5e256b500732cbaf95412dd4c3e86a7c5da3da1ec78289ec4d78"} Jun 14 14:43:44.029295 ip-10-0-129-116 kubenswrapper[2546]: I0614 14:43:44.029245 2546 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/prometheus-operator-864fcfc6f9-8w65j" podStartSLOduration=1.6019782710000001 podStartE2EDuration="3.02923204s" totalImagesPullingTime="1.427253769s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-14 14:43:41 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-14 14:43:44.027710057 +0000 UTC m=+261.356092181" watchObservedRunningTime="2026-06-14 14:43:44.02923204 +0000 UTC m=+261.357614166" Jun 14 14:43:45.777053 ip-10-0-129-116 kubenswrapper[2546]: I0614 14:43:45.777024 2546 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c96gx_105377da-c223-41ad-b033-546cb01239c4/konnectivity-agent/0.log" limit=1024 Jun 14 14:43:46.009250 ip-10-0-129-116 kubenswrapper[2546]: I0614 14:43:46.009217 2546 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c96gx_105377da-c223-41ad-b033-546cb01239c4/konnectivity-agent/0.log" limit=1024 Jun 14 14:43:46.027038 ip-10-0-129-116 kubenswrapper[2546]: I0614 14:43:46.027010 2546 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/openshift-state-metrics-6b8d965dd5-4m647"] Jun 14 14:43:46.030297 ip-10-0-129-116 kubenswrapper[2546]: I0614 14:43:46.030258 2546 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/openshift-state-metrics-6b8d965dd5-4m647" Jun 14 14:43:46.032689 ip-10-0-129-116 kubenswrapper[2546]: I0614 14:43:46.032668 2546 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"openshift-state-metrics-tls\"" Jun 14 14:43:46.032942 ip-10-0-129-116 kubenswrapper[2546]: I0614 14:43:46.032929 2546 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"openshift-state-metrics-dockercfg-vmvpl\"" Jun 14 14:43:46.033158 ip-10-0-129-116 kubenswrapper[2546]: I0614 14:43:46.033145 2546 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"openshift-state-metrics-kube-rbac-proxy-config\"" Jun 14 14:43:46.039676 ip-10-0-129-116 kubenswrapper[2546]: I0614 14:43:46.039652 2546 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/openshift-state-metrics-6b8d965dd5-4m647"] Jun 14 14:43:46.049323 ip-10-0-129-116 kubenswrapper[2546]: I0614 14:43:46.049301 2546 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/node-exporter-mbm5d"] Jun 14 14:43:46.052526 ip-10-0-129-116 kubenswrapper[2546]: I0614 14:43:46.052507 2546 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-mbm5d" Jun 14 14:43:46.054641 ip-10-0-129-116 kubenswrapper[2546]: I0614 14:43:46.054618 2546 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-kube-rbac-proxy-config\"" Jun 14 14:43:46.054738 ip-10-0-129-116 kubenswrapper[2546]: I0614 14:43:46.054694 2546 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"node-exporter-accelerators-collector-config\"" Jun 14 14:43:46.054871 ip-10-0-129-116 kubenswrapper[2546]: I0614 14:43:46.054851 2546 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-tls\"" Jun 14 14:43:46.054940 ip-10-0-129-116 kubenswrapper[2546]: I0614 14:43:46.054917 2546 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-dockercfg-glx62\"" Jun 14 14:43:46.094351 ip-10-0-129-116 kubenswrapper[2546]: I0614 14:43:46.094322 2546 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c96gx_105377da-c223-41ad-b033-546cb01239c4/konnectivity-agent/0.log" limit=1024 Jun 14 14:43:46.150042 ip-10-0-129-116 kubenswrapper[2546]: I0614 14:43:46.150012 2546 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c96gx_105377da-c223-41ad-b033-546cb01239c4/konnectivity-agent/0.log" limit=1024 Jun 14 14:43:46.165133 ip-10-0-129-116 kubenswrapper[2546]: I0614 14:43:46.165108 2546 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/8efc0b45-a2ee-4407-b52b-7f4fb0c4d6cb-node-exporter-tls\") pod \"node-exporter-mbm5d\" (UID: \"8efc0b45-a2ee-4407-b52b-7f4fb0c4d6cb\") " pod="openshift-monitoring/node-exporter-mbm5d" Jun 14 14:43:46.165210 ip-10-0-129-116 kubenswrapper[2546]: I0614 14:43:46.165138 2546 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4bl7g\" (UniqueName: \"kubernetes.io/projected/8efc0b45-a2ee-4407-b52b-7f4fb0c4d6cb-kube-api-access-4bl7g\") pod \"node-exporter-mbm5d\" (UID: \"8efc0b45-a2ee-4407-b52b-7f4fb0c4d6cb\") " pod="openshift-monitoring/node-exporter-mbm5d" Jun 14 14:43:46.165210 ip-10-0-129-116 kubenswrapper[2546]: I0614 14:43:46.165189 2546 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/8efc0b45-a2ee-4407-b52b-7f4fb0c4d6cb-node-exporter-textfile\") pod \"node-exporter-mbm5d\" (UID: \"8efc0b45-a2ee-4407-b52b-7f4fb0c4d6cb\") " pod="openshift-monitoring/node-exporter-mbm5d" Jun 14 14:43:46.165285 ip-10-0-129-116 kubenswrapper[2546]: I0614 14:43:46.165228 2546 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/b8a545ef-5f76-4ebb-af51-b429428abc52-openshift-state-metrics-tls\") pod \"openshift-state-metrics-6b8d965dd5-4m647\" (UID: \"b8a545ef-5f76-4ebb-af51-b429428abc52\") " pod="openshift-monitoring/openshift-state-metrics-6b8d965dd5-4m647" Jun 14 14:43:46.165285 ip-10-0-129-116 kubenswrapper[2546]: I0614 14:43:46.165261 2546 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hswpx\" (UniqueName: \"kubernetes.io/projected/b8a545ef-5f76-4ebb-af51-b429428abc52-kube-api-access-hswpx\") pod \"openshift-state-metrics-6b8d965dd5-4m647\" (UID: \"b8a545ef-5f76-4ebb-af51-b429428abc52\") " pod="openshift-monitoring/openshift-state-metrics-6b8d965dd5-4m647" Jun 14 14:43:46.165285 ip-10-0-129-116 kubenswrapper[2546]: I0614 14:43:46.165276 2546 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/8efc0b45-a2ee-4407-b52b-7f4fb0c4d6cb-sys\") pod \"node-exporter-mbm5d\" (UID: \"8efc0b45-a2ee-4407-b52b-7f4fb0c4d6cb\") " pod="openshift-monitoring/node-exporter-mbm5d" Jun 14 14:43:46.165375 ip-10-0-129-116 kubenswrapper[2546]: I0614 14:43:46.165311 2546 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/8efc0b45-a2ee-4407-b52b-7f4fb0c4d6cb-root\") pod \"node-exporter-mbm5d\" (UID: \"8efc0b45-a2ee-4407-b52b-7f4fb0c4d6cb\") " pod="openshift-monitoring/node-exporter-mbm5d" Jun 14 14:43:46.165375 ip-10-0-129-116 kubenswrapper[2546]: I0614 14:43:46.165330 2546 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/8efc0b45-a2ee-4407-b52b-7f4fb0c4d6cb-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-mbm5d\" (UID: \"8efc0b45-a2ee-4407-b52b-7f4fb0c4d6cb\") " pod="openshift-monitoring/node-exporter-mbm5d" Jun 14 14:43:46.165375 ip-10-0-129-116 kubenswrapper[2546]: I0614 14:43:46.165355 2546 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/b8a545ef-5f76-4ebb-af51-b429428abc52-openshift-state-metrics-kube-rbac-proxy-config\") pod \"openshift-state-metrics-6b8d965dd5-4m647\" (UID: \"b8a545ef-5f76-4ebb-af51-b429428abc52\") " pod="openshift-monitoring/openshift-state-metrics-6b8d965dd5-4m647" Jun 14 14:43:46.165469 ip-10-0-129-116 kubenswrapper[2546]: I0614 14:43:46.165381 2546 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/b8a545ef-5f76-4ebb-af51-b429428abc52-metrics-client-ca\") pod \"openshift-state-metrics-6b8d965dd5-4m647\" (UID: \"b8a545ef-5f76-4ebb-af51-b429428abc52\") " pod="openshift-monitoring/openshift-state-metrics-6b8d965dd5-4m647" Jun 14 14:43:46.165469 ip-10-0-129-116 kubenswrapper[2546]: I0614 14:43:46.165401 2546 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/8efc0b45-a2ee-4407-b52b-7f4fb0c4d6cb-node-exporter-accelerators-collector-config\") pod \"node-exporter-mbm5d\" (UID: \"8efc0b45-a2ee-4407-b52b-7f4fb0c4d6cb\") " pod="openshift-monitoring/node-exporter-mbm5d" Jun 14 14:43:46.165469 ip-10-0-129-116 kubenswrapper[2546]: I0614 14:43:46.165432 2546 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/8efc0b45-a2ee-4407-b52b-7f4fb0c4d6cb-metrics-client-ca\") pod \"node-exporter-mbm5d\" (UID: \"8efc0b45-a2ee-4407-b52b-7f4fb0c4d6cb\") " pod="openshift-monitoring/node-exporter-mbm5d" Jun 14 14:43:46.165469 ip-10-0-129-116 kubenswrapper[2546]: I0614 14:43:46.165448 2546 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/8efc0b45-a2ee-4407-b52b-7f4fb0c4d6cb-node-exporter-wtmp\") pod \"node-exporter-mbm5d\" (UID: \"8efc0b45-a2ee-4407-b52b-7f4fb0c4d6cb\") " pod="openshift-monitoring/node-exporter-mbm5d" Jun 14 14:43:46.266392 ip-10-0-129-116 kubenswrapper[2546]: I0614 14:43:46.266361 2546 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/8efc0b45-a2ee-4407-b52b-7f4fb0c4d6cb-metrics-client-ca\") pod \"node-exporter-mbm5d\" (UID: \"8efc0b45-a2ee-4407-b52b-7f4fb0c4d6cb\") " pod="openshift-monitoring/node-exporter-mbm5d" Jun 14 14:43:46.266392 ip-10-0-129-116 kubenswrapper[2546]: I0614 14:43:46.266396 2546 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/8efc0b45-a2ee-4407-b52b-7f4fb0c4d6cb-node-exporter-wtmp\") pod \"node-exporter-mbm5d\" (UID: \"8efc0b45-a2ee-4407-b52b-7f4fb0c4d6cb\") " pod="openshift-monitoring/node-exporter-mbm5d" Jun 14 14:43:46.266620 ip-10-0-129-116 kubenswrapper[2546]: I0614 14:43:46.266431 2546 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/8efc0b45-a2ee-4407-b52b-7f4fb0c4d6cb-node-exporter-tls\") pod \"node-exporter-mbm5d\" (UID: \"8efc0b45-a2ee-4407-b52b-7f4fb0c4d6cb\") " pod="openshift-monitoring/node-exporter-mbm5d" Jun 14 14:43:46.266620 ip-10-0-129-116 kubenswrapper[2546]: I0614 14:43:46.266449 2546 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4bl7g\" (UniqueName: \"kubernetes.io/projected/8efc0b45-a2ee-4407-b52b-7f4fb0c4d6cb-kube-api-access-4bl7g\") pod \"node-exporter-mbm5d\" (UID: \"8efc0b45-a2ee-4407-b52b-7f4fb0c4d6cb\") " pod="openshift-monitoring/node-exporter-mbm5d" Jun 14 14:43:46.266620 ip-10-0-129-116 kubenswrapper[2546]: I0614 14:43:46.266475 2546 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/8efc0b45-a2ee-4407-b52b-7f4fb0c4d6cb-node-exporter-textfile\") pod \"node-exporter-mbm5d\" (UID: \"8efc0b45-a2ee-4407-b52b-7f4fb0c4d6cb\") " pod="openshift-monitoring/node-exporter-mbm5d" Jun 14 14:43:46.266620 ip-10-0-129-116 kubenswrapper[2546]: I0614 14:43:46.266504 2546 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/b8a545ef-5f76-4ebb-af51-b429428abc52-openshift-state-metrics-tls\") pod \"openshift-state-metrics-6b8d965dd5-4m647\" (UID: \"b8a545ef-5f76-4ebb-af51-b429428abc52\") " pod="openshift-monitoring/openshift-state-metrics-6b8d965dd5-4m647" Jun 14 14:43:46.266620 ip-10-0-129-116 kubenswrapper[2546]: I0614 14:43:46.266530 2546 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hswpx\" (UniqueName: \"kubernetes.io/projected/b8a545ef-5f76-4ebb-af51-b429428abc52-kube-api-access-hswpx\") pod \"openshift-state-metrics-6b8d965dd5-4m647\" (UID: \"b8a545ef-5f76-4ebb-af51-b429428abc52\") " pod="openshift-monitoring/openshift-state-metrics-6b8d965dd5-4m647" Jun 14 14:43:46.266620 ip-10-0-129-116 kubenswrapper[2546]: I0614 14:43:46.266554 2546 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/8efc0b45-a2ee-4407-b52b-7f4fb0c4d6cb-sys\") pod \"node-exporter-mbm5d\" (UID: \"8efc0b45-a2ee-4407-b52b-7f4fb0c4d6cb\") " pod="openshift-monitoring/node-exporter-mbm5d" Jun 14 14:43:46.266620 ip-10-0-129-116 kubenswrapper[2546]: E0614 14:43:46.266556 2546 secret.go:189] Couldn't get secret openshift-monitoring/node-exporter-tls: secret "node-exporter-tls" not found Jun 14 14:43:46.266620 ip-10-0-129-116 kubenswrapper[2546]: I0614 14:43:46.266584 2546 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/8efc0b45-a2ee-4407-b52b-7f4fb0c4d6cb-node-exporter-wtmp\") pod \"node-exporter-mbm5d\" (UID: \"8efc0b45-a2ee-4407-b52b-7f4fb0c4d6cb\") " pod="openshift-monitoring/node-exporter-mbm5d" Jun 14 14:43:46.266620 ip-10-0-129-116 kubenswrapper[2546]: I0614 14:43:46.266600 2546 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/8efc0b45-a2ee-4407-b52b-7f4fb0c4d6cb-root\") pod \"node-exporter-mbm5d\" (UID: \"8efc0b45-a2ee-4407-b52b-7f4fb0c4d6cb\") " pod="openshift-monitoring/node-exporter-mbm5d" Jun 14 14:43:46.267067 ip-10-0-129-116 kubenswrapper[2546]: E0614 14:43:46.266630 2546 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/8efc0b45-a2ee-4407-b52b-7f4fb0c4d6cb-node-exporter-tls podName:8efc0b45-a2ee-4407-b52b-7f4fb0c4d6cb nodeName:}" failed. No retries permitted until 2026-06-14 14:43:46.766610699 +0000 UTC m=+264.094992822 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "node-exporter-tls" (UniqueName: "kubernetes.io/secret/8efc0b45-a2ee-4407-b52b-7f4fb0c4d6cb-node-exporter-tls") pod "node-exporter-mbm5d" (UID: "8efc0b45-a2ee-4407-b52b-7f4fb0c4d6cb") : secret "node-exporter-tls" not found Jun 14 14:43:46.267067 ip-10-0-129-116 kubenswrapper[2546]: I0614 14:43:46.266649 2546 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/8efc0b45-a2ee-4407-b52b-7f4fb0c4d6cb-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-mbm5d\" (UID: \"8efc0b45-a2ee-4407-b52b-7f4fb0c4d6cb\") " pod="openshift-monitoring/node-exporter-mbm5d" Jun 14 14:43:46.267067 ip-10-0-129-116 kubenswrapper[2546]: I0614 14:43:46.266653 2546 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"root\" (UniqueName: \"kubernetes.io/host-path/8efc0b45-a2ee-4407-b52b-7f4fb0c4d6cb-root\") pod \"node-exporter-mbm5d\" (UID: \"8efc0b45-a2ee-4407-b52b-7f4fb0c4d6cb\") " pod="openshift-monitoring/node-exporter-mbm5d" Jun 14 14:43:46.267067 ip-10-0-129-116 kubenswrapper[2546]: I0614 14:43:46.266908 2546 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/8efc0b45-a2ee-4407-b52b-7f4fb0c4d6cb-sys\") pod \"node-exporter-mbm5d\" (UID: \"8efc0b45-a2ee-4407-b52b-7f4fb0c4d6cb\") " pod="openshift-monitoring/node-exporter-mbm5d" Jun 14 14:43:46.267067 ip-10-0-129-116 kubenswrapper[2546]: I0614 14:43:46.266955 2546 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/b8a545ef-5f76-4ebb-af51-b429428abc52-openshift-state-metrics-kube-rbac-proxy-config\") pod \"openshift-state-metrics-6b8d965dd5-4m647\" (UID: \"b8a545ef-5f76-4ebb-af51-b429428abc52\") " pod="openshift-monitoring/openshift-state-metrics-6b8d965dd5-4m647" Jun 14 14:43:46.267067 ip-10-0-129-116 kubenswrapper[2546]: I0614 14:43:46.267020 2546 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/b8a545ef-5f76-4ebb-af51-b429428abc52-metrics-client-ca\") pod \"openshift-state-metrics-6b8d965dd5-4m647\" (UID: \"b8a545ef-5f76-4ebb-af51-b429428abc52\") " pod="openshift-monitoring/openshift-state-metrics-6b8d965dd5-4m647" Jun 14 14:43:46.267067 ip-10-0-129-116 kubenswrapper[2546]: I0614 14:43:46.267040 2546 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/8efc0b45-a2ee-4407-b52b-7f4fb0c4d6cb-node-exporter-textfile\") pod \"node-exporter-mbm5d\" (UID: \"8efc0b45-a2ee-4407-b52b-7f4fb0c4d6cb\") " pod="openshift-monitoring/node-exporter-mbm5d" Jun 14 14:43:46.267418 ip-10-0-129-116 kubenswrapper[2546]: I0614 14:43:46.267068 2546 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/8efc0b45-a2ee-4407-b52b-7f4fb0c4d6cb-metrics-client-ca\") pod \"node-exporter-mbm5d\" (UID: \"8efc0b45-a2ee-4407-b52b-7f4fb0c4d6cb\") " pod="openshift-monitoring/node-exporter-mbm5d" Jun 14 14:43:46.267418 ip-10-0-129-116 kubenswrapper[2546]: I0614 14:43:46.267071 2546 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/8efc0b45-a2ee-4407-b52b-7f4fb0c4d6cb-node-exporter-accelerators-collector-config\") pod \"node-exporter-mbm5d\" (UID: \"8efc0b45-a2ee-4407-b52b-7f4fb0c4d6cb\") " pod="openshift-monitoring/node-exporter-mbm5d" Jun 14 14:43:46.267574 ip-10-0-129-116 kubenswrapper[2546]: I0614 14:43:46.267551 2546 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/8efc0b45-a2ee-4407-b52b-7f4fb0c4d6cb-node-exporter-accelerators-collector-config\") pod \"node-exporter-mbm5d\" (UID: \"8efc0b45-a2ee-4407-b52b-7f4fb0c4d6cb\") " pod="openshift-monitoring/node-exporter-mbm5d" Jun 14 14:43:46.267770 ip-10-0-129-116 kubenswrapper[2546]: I0614 14:43:46.267748 2546 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/b8a545ef-5f76-4ebb-af51-b429428abc52-metrics-client-ca\") pod \"openshift-state-metrics-6b8d965dd5-4m647\" (UID: \"b8a545ef-5f76-4ebb-af51-b429428abc52\") " pod="openshift-monitoring/openshift-state-metrics-6b8d965dd5-4m647" Jun 14 14:43:46.269663 ip-10-0-129-116 kubenswrapper[2546]: I0614 14:43:46.269635 2546 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c96gx_105377da-c223-41ad-b033-546cb01239c4/konnectivity-agent/0.log" limit=1024 Jun 14 14:43:46.269867 ip-10-0-129-116 kubenswrapper[2546]: I0614 14:43:46.269847 2546 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"openshift-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/b8a545ef-5f76-4ebb-af51-b429428abc52-openshift-state-metrics-tls\") pod \"openshift-state-metrics-6b8d965dd5-4m647\" (UID: \"b8a545ef-5f76-4ebb-af51-b429428abc52\") " pod="openshift-monitoring/openshift-state-metrics-6b8d965dd5-4m647" Jun 14 14:43:46.269921 ip-10-0-129-116 kubenswrapper[2546]: I0614 14:43:46.269892 2546 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/8efc0b45-a2ee-4407-b52b-7f4fb0c4d6cb-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-mbm5d\" (UID: \"8efc0b45-a2ee-4407-b52b-7f4fb0c4d6cb\") " pod="openshift-monitoring/node-exporter-mbm5d" Jun 14 14:43:46.269968 ip-10-0-129-116 kubenswrapper[2546]: I0614 14:43:46.269949 2546 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"openshift-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/b8a545ef-5f76-4ebb-af51-b429428abc52-openshift-state-metrics-kube-rbac-proxy-config\") pod \"openshift-state-metrics-6b8d965dd5-4m647\" (UID: \"b8a545ef-5f76-4ebb-af51-b429428abc52\") " pod="openshift-monitoring/openshift-state-metrics-6b8d965dd5-4m647" Jun 14 14:43:46.276618 ip-10-0-129-116 kubenswrapper[2546]: I0614 14:43:46.276593 2546 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-hswpx\" (UniqueName: \"kubernetes.io/projected/b8a545ef-5f76-4ebb-af51-b429428abc52-kube-api-access-hswpx\") pod \"openshift-state-metrics-6b8d965dd5-4m647\" (UID: \"b8a545ef-5f76-4ebb-af51-b429428abc52\") " pod="openshift-monitoring/openshift-state-metrics-6b8d965dd5-4m647" Jun 14 14:43:46.277075 ip-10-0-129-116 kubenswrapper[2546]: I0614 14:43:46.277056 2546 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-4bl7g\" (UniqueName: \"kubernetes.io/projected/8efc0b45-a2ee-4407-b52b-7f4fb0c4d6cb-kube-api-access-4bl7g\") pod \"node-exporter-mbm5d\" (UID: \"8efc0b45-a2ee-4407-b52b-7f4fb0c4d6cb\") " pod="openshift-monitoring/node-exporter-mbm5d" Jun 14 14:43:46.339179 ip-10-0-129-116 kubenswrapper[2546]: I0614 14:43:46.339111 2546 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/openshift-state-metrics-6b8d965dd5-4m647" Jun 14 14:43:46.370604 ip-10-0-129-116 kubenswrapper[2546]: I0614 14:43:46.370575 2546 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c96gx_105377da-c223-41ad-b033-546cb01239c4/konnectivity-agent/0.log" limit=1024 Jun 14 14:43:46.461886 ip-10-0-129-116 kubenswrapper[2546]: I0614 14:43:46.461852 2546 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/openshift-state-metrics-6b8d965dd5-4m647"] Jun 14 14:43:46.464043 ip-10-0-129-116 kubenswrapper[2546]: W0614 14:43:46.464012 2546 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb8a545ef_5f76_4ebb_af51_b429428abc52.slice/crio-b790f57e4635a88e4e2c01bcbf7687f8532c0db06cfa860b45d176e8151141d9 WatchSource:0}: Error finding container b790f57e4635a88e4e2c01bcbf7687f8532c0db06cfa860b45d176e8151141d9: Status 404 returned error can't find the container with id b790f57e4635a88e4e2c01bcbf7687f8532c0db06cfa860b45d176e8151141d9 Jun 14 14:43:46.488951 ip-10-0-129-116 kubenswrapper[2546]: I0614 14:43:46.488930 2546 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c96gx_105377da-c223-41ad-b033-546cb01239c4/konnectivity-agent/0.log" limit=1024 Jun 14 14:43:46.603128 ip-10-0-129-116 kubenswrapper[2546]: I0614 14:43:46.603009 2546 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c96gx_105377da-c223-41ad-b033-546cb01239c4/konnectivity-agent/0.log" limit=1024 Jun 14 14:43:46.774249 ip-10-0-129-116 kubenswrapper[2546]: I0614 14:43:46.774202 2546 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/8efc0b45-a2ee-4407-b52b-7f4fb0c4d6cb-node-exporter-tls\") pod \"node-exporter-mbm5d\" (UID: \"8efc0b45-a2ee-4407-b52b-7f4fb0c4d6cb\") " pod="openshift-monitoring/node-exporter-mbm5d" Jun 14 14:43:46.776606 ip-10-0-129-116 kubenswrapper[2546]: I0614 14:43:46.776586 2546 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/8efc0b45-a2ee-4407-b52b-7f4fb0c4d6cb-node-exporter-tls\") pod \"node-exporter-mbm5d\" (UID: \"8efc0b45-a2ee-4407-b52b-7f4fb0c4d6cb\") " pod="openshift-monitoring/node-exporter-mbm5d" Jun 14 14:43:46.934702 ip-10-0-129-116 kubenswrapper[2546]: I0614 14:43:46.934666 2546 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c96gx_105377da-c223-41ad-b033-546cb01239c4/konnectivity-agent/0.log" limit=1024 Jun 14 14:43:46.961265 ip-10-0-129-116 kubenswrapper[2546]: I0614 14:43:46.961234 2546 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-mbm5d" Jun 14 14:43:46.972490 ip-10-0-129-116 kubenswrapper[2546]: W0614 14:43:46.972458 2546 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8efc0b45_a2ee_4407_b52b_7f4fb0c4d6cb.slice/crio-66bf31aae0e47782ca3f5c4c759dcd5106f09b58e8b1e17cdc8662398857c974 WatchSource:0}: Error finding container 66bf31aae0e47782ca3f5c4c759dcd5106f09b58e8b1e17cdc8662398857c974: Status 404 returned error can't find the container with id 66bf31aae0e47782ca3f5c4c759dcd5106f09b58e8b1e17cdc8662398857c974 Jun 14 14:43:47.025465 ip-10-0-129-116 kubenswrapper[2546]: I0614 14:43:47.025425 2546 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-6b8d965dd5-4m647" event={"ID":"b8a545ef-5f76-4ebb-af51-b429428abc52","Type":"ContainerStarted","Data":"c44cfebe9a28d2fe2ae4304f00a0d36565347ac73d160bf92833423236435478"} Jun 14 14:43:47.025640 ip-10-0-129-116 kubenswrapper[2546]: I0614 14:43:47.025512 2546 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-6b8d965dd5-4m647" event={"ID":"b8a545ef-5f76-4ebb-af51-b429428abc52","Type":"ContainerStarted","Data":"588469eb73f65b99f178f41686e55905931b869981651760f036f2dc87ecd8e4"} Jun 14 14:43:47.025640 ip-10-0-129-116 kubenswrapper[2546]: I0614 14:43:47.025540 2546 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-6b8d965dd5-4m647" event={"ID":"b8a545ef-5f76-4ebb-af51-b429428abc52","Type":"ContainerStarted","Data":"b790f57e4635a88e4e2c01bcbf7687f8532c0db06cfa860b45d176e8151141d9"} Jun 14 14:43:47.026706 ip-10-0-129-116 kubenswrapper[2546]: I0614 14:43:47.026678 2546 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-mbm5d" event={"ID":"8efc0b45-a2ee-4407-b52b-7f4fb0c4d6cb","Type":"ContainerStarted","Data":"66bf31aae0e47782ca3f5c4c759dcd5106f09b58e8b1e17cdc8662398857c974"} Jun 14 14:43:47.040466 ip-10-0-129-116 kubenswrapper[2546]: I0614 14:43:47.040438 2546 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c96gx_105377da-c223-41ad-b033-546cb01239c4/konnectivity-agent/0.log" limit=1024 Jun 14 14:43:47.103171 ip-10-0-129-116 kubenswrapper[2546]: I0614 14:43:47.103135 2546 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c96gx_105377da-c223-41ad-b033-546cb01239c4/konnectivity-agent/0.log" limit=1024 Jun 14 14:43:47.245136 ip-10-0-129-116 kubenswrapper[2546]: I0614 14:43:47.245042 2546 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c96gx_105377da-c223-41ad-b033-546cb01239c4/konnectivity-agent/0.log" limit=1024 Jun 14 14:43:47.342337 ip-10-0-129-116 kubenswrapper[2546]: I0614 14:43:47.342297 2546 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c96gx_105377da-c223-41ad-b033-546cb01239c4/konnectivity-agent/0.log" limit=1024 Jun 14 14:43:48.033810 ip-10-0-129-116 kubenswrapper[2546]: I0614 14:43:48.033774 2546 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-6b8d965dd5-4m647" event={"ID":"b8a545ef-5f76-4ebb-af51-b429428abc52","Type":"ContainerStarted","Data":"aaadbcd436a9895e5e4fdea16e994e42d0d6f2975660bdb5451f2a8e76972775"} Jun 14 14:43:48.057761 ip-10-0-129-116 kubenswrapper[2546]: I0614 14:43:48.057704 2546 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/openshift-state-metrics-6b8d965dd5-4m647" podStartSLOduration=0.717728054 podStartE2EDuration="2.057687045s" totalImagesPullingTime="1.339958991s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-14 14:43:46 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-14 14:43:48.056752115 +0000 UTC m=+265.385134240" watchObservedRunningTime="2026-06-14 14:43:48.057687045 +0000 UTC m=+265.386069172" Jun 14 14:43:48.960799 ip-10-0-129-116 kubenswrapper[2546]: I0614 14:43:48.960763 2546 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c96gx_105377da-c223-41ad-b033-546cb01239c4/konnectivity-agent/0.log" limit=1024 Jun 14 14:43:49.022529 ip-10-0-129-116 kubenswrapper[2546]: I0614 14:43:49.022500 2546 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c96gx_105377da-c223-41ad-b033-546cb01239c4/konnectivity-agent/0.log" limit=1024 Jun 14 14:43:49.039923 ip-10-0-129-116 kubenswrapper[2546]: I0614 14:43:49.039896 2546 generic.go:356] "Generic (PLEG): container finished" podID="8efc0b45-a2ee-4407-b52b-7f4fb0c4d6cb" containerID="c001c7727c01bc6eead683185b43ccb141083cc7a8f13bc0e4a148d782184ccc" exitCode=0 Jun 14 14:43:49.040297 ip-10-0-129-116 kubenswrapper[2546]: I0614 14:43:49.039970 2546 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-mbm5d" event={"ID":"8efc0b45-a2ee-4407-b52b-7f4fb0c4d6cb","Type":"ContainerDied","Data":"c001c7727c01bc6eead683185b43ccb141083cc7a8f13bc0e4a148d782184ccc"} Jun 14 14:43:49.572370 ip-10-0-129-116 kubenswrapper[2546]: I0614 14:43:49.572339 2546 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c96gx_105377da-c223-41ad-b033-546cb01239c4/konnectivity-agent/0.log" limit=1024 Jun 14 14:43:50.010763 ip-10-0-129-116 kubenswrapper[2546]: I0614 14:43:50.010733 2546 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c96gx_105377da-c223-41ad-b033-546cb01239c4/konnectivity-agent/0.log" limit=1024 Jun 14 14:43:50.045799 ip-10-0-129-116 kubenswrapper[2546]: I0614 14:43:50.045769 2546 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-mbm5d" event={"ID":"8efc0b45-a2ee-4407-b52b-7f4fb0c4d6cb","Type":"ContainerStarted","Data":"ca2216c3f6185e99b1f9c56fb39e5515718c36031a5657f15dd6298a57869bb0"} Jun 14 14:43:50.046159 ip-10-0-129-116 kubenswrapper[2546]: I0614 14:43:50.045827 2546 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-mbm5d" event={"ID":"8efc0b45-a2ee-4407-b52b-7f4fb0c4d6cb","Type":"ContainerStarted","Data":"4dd43cdf712da0eab6afb016725b2ee8191948a772cb6e4ac1b6479f0c352518"} Jun 14 14:43:50.065964 ip-10-0-129-116 kubenswrapper[2546]: I0614 14:43:50.065913 2546 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/node-exporter-mbm5d" podStartSLOduration=3.003205244 podStartE2EDuration="4.065898141s" totalImagesPullingTime="991.861581ms" totalInitContainerRuntime="70.831316ms" isStatefulPod=true podCreationTimestamp="2026-06-14 14:43:46 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-14 14:43:50.065276961 +0000 UTC m=+267.393659085" watchObservedRunningTime="2026-06-14 14:43:50.065898141 +0000 UTC m=+267.394280266" Jun 14 14:43:50.110715 ip-10-0-129-116 kubenswrapper[2546]: I0614 14:43:50.110683 2546 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c96gx_105377da-c223-41ad-b033-546cb01239c4/konnectivity-agent/0.log" limit=1024 Jun 14 14:43:50.210355 ip-10-0-129-116 kubenswrapper[2546]: I0614 14:43:50.210327 2546 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c96gx_105377da-c223-41ad-b033-546cb01239c4/konnectivity-agent/0.log" limit=1024 Jun 14 14:43:50.310685 ip-10-0-129-116 kubenswrapper[2546]: I0614 14:43:50.310614 2546 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c96gx_105377da-c223-41ad-b033-546cb01239c4/konnectivity-agent/0.log" limit=1024 Jun 14 14:43:50.803473 ip-10-0-129-116 kubenswrapper[2546]: I0614 14:43:50.803445 2546 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c96gx_105377da-c223-41ad-b033-546cb01239c4/konnectivity-agent/0.log" limit=1024 Jun 14 14:43:50.902590 ip-10-0-129-116 kubenswrapper[2546]: I0614 14:43:50.902560 2546 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c96gx_105377da-c223-41ad-b033-546cb01239c4/konnectivity-agent/0.log" limit=1024 Jun 14 14:43:51.006143 ip-10-0-129-116 kubenswrapper[2546]: I0614 14:43:51.006105 2546 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-789fc86fd-22zg7"] Jun 14 14:43:51.009565 ip-10-0-129-116 kubenswrapper[2546]: I0614 14:43:51.009542 2546 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-789fc86fd-22zg7" Jun 14 14:43:51.012805 ip-10-0-129-116 kubenswrapper[2546]: I0614 14:43:51.012784 2546 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"kube-root-ca.crt\"" Jun 14 14:43:51.012903 ip-10-0-129-116 kubenswrapper[2546]: I0614 14:43:51.012846 2546 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"oauth-serving-cert\"" Jun 14 14:43:51.014105 ip-10-0-129-116 kubenswrapper[2546]: I0614 14:43:51.014067 2546 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-dockercfg-qd8m9\"" Jun 14 14:43:51.014209 ip-10-0-129-116 kubenswrapper[2546]: I0614 14:43:51.014145 2546 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-serving-cert\"" Jun 14 14:43:51.014209 ip-10-0-129-116 kubenswrapper[2546]: I0614 14:43:51.014164 2546 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"service-ca\"" Jun 14 14:43:51.014209 ip-10-0-129-116 kubenswrapper[2546]: I0614 14:43:51.014152 2546 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-oauth-config\"" Jun 14 14:43:51.014209 ip-10-0-129-116 kubenswrapper[2546]: I0614 14:43:51.014201 2546 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"openshift-service-ca.crt\"" Jun 14 14:43:51.014545 ip-10-0-129-116 kubenswrapper[2546]: I0614 14:43:51.014531 2546 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"console-config\"" Jun 14 14:43:51.018432 ip-10-0-129-116 kubenswrapper[2546]: I0614 14:43:51.018412 2546 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"trusted-ca-bundle\"" Jun 14 14:43:51.021218 ip-10-0-129-116 kubenswrapper[2546]: I0614 14:43:51.021195 2546 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-789fc86fd-22zg7"] Jun 14 14:43:51.113608 ip-10-0-129-116 kubenswrapper[2546]: I0614 14:43:51.113519 2546 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/3f17eeaf-7d14-4180-8337-38dba0a40792-console-serving-cert\") pod \"console-789fc86fd-22zg7\" (UID: \"3f17eeaf-7d14-4180-8337-38dba0a40792\") " pod="openshift-console/console-789fc86fd-22zg7" Jun 14 14:43:51.113608 ip-10-0-129-116 kubenswrapper[2546]: I0614 14:43:51.113556 2546 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/3f17eeaf-7d14-4180-8337-38dba0a40792-trusted-ca-bundle\") pod \"console-789fc86fd-22zg7\" (UID: \"3f17eeaf-7d14-4180-8337-38dba0a40792\") " pod="openshift-console/console-789fc86fd-22zg7" Jun 14 14:43:51.114010 ip-10-0-129-116 kubenswrapper[2546]: I0614 14:43:51.113631 2546 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/3f17eeaf-7d14-4180-8337-38dba0a40792-oauth-serving-cert\") pod \"console-789fc86fd-22zg7\" (UID: \"3f17eeaf-7d14-4180-8337-38dba0a40792\") " pod="openshift-console/console-789fc86fd-22zg7" Jun 14 14:43:51.114010 ip-10-0-129-116 kubenswrapper[2546]: I0614 14:43:51.113685 2546 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/3f17eeaf-7d14-4180-8337-38dba0a40792-service-ca\") pod \"console-789fc86fd-22zg7\" (UID: \"3f17eeaf-7d14-4180-8337-38dba0a40792\") " pod="openshift-console/console-789fc86fd-22zg7" Jun 14 14:43:51.114010 ip-10-0-129-116 kubenswrapper[2546]: I0614 14:43:51.113723 2546 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/3f17eeaf-7d14-4180-8337-38dba0a40792-console-oauth-config\") pod \"console-789fc86fd-22zg7\" (UID: \"3f17eeaf-7d14-4180-8337-38dba0a40792\") " pod="openshift-console/console-789fc86fd-22zg7" Jun 14 14:43:51.114010 ip-10-0-129-116 kubenswrapper[2546]: I0614 14:43:51.113740 2546 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-s8g9f\" (UniqueName: \"kubernetes.io/projected/3f17eeaf-7d14-4180-8337-38dba0a40792-kube-api-access-s8g9f\") pod \"console-789fc86fd-22zg7\" (UID: \"3f17eeaf-7d14-4180-8337-38dba0a40792\") " pod="openshift-console/console-789fc86fd-22zg7" Jun 14 14:43:51.114010 ip-10-0-129-116 kubenswrapper[2546]: I0614 14:43:51.113778 2546 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/3f17eeaf-7d14-4180-8337-38dba0a40792-console-config\") pod \"console-789fc86fd-22zg7\" (UID: \"3f17eeaf-7d14-4180-8337-38dba0a40792\") " pod="openshift-console/console-789fc86fd-22zg7" Jun 14 14:43:51.215180 ip-10-0-129-116 kubenswrapper[2546]: I0614 14:43:51.215145 2546 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/3f17eeaf-7d14-4180-8337-38dba0a40792-console-serving-cert\") pod \"console-789fc86fd-22zg7\" (UID: \"3f17eeaf-7d14-4180-8337-38dba0a40792\") " pod="openshift-console/console-789fc86fd-22zg7" Jun 14 14:43:51.215180 ip-10-0-129-116 kubenswrapper[2546]: I0614 14:43:51.215179 2546 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/3f17eeaf-7d14-4180-8337-38dba0a40792-trusted-ca-bundle\") pod \"console-789fc86fd-22zg7\" (UID: \"3f17eeaf-7d14-4180-8337-38dba0a40792\") " pod="openshift-console/console-789fc86fd-22zg7" Jun 14 14:43:51.215388 ip-10-0-129-116 kubenswrapper[2546]: I0614 14:43:51.215239 2546 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/3f17eeaf-7d14-4180-8337-38dba0a40792-oauth-serving-cert\") pod \"console-789fc86fd-22zg7\" (UID: \"3f17eeaf-7d14-4180-8337-38dba0a40792\") " pod="openshift-console/console-789fc86fd-22zg7" Jun 14 14:43:51.215388 ip-10-0-129-116 kubenswrapper[2546]: I0614 14:43:51.215288 2546 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/3f17eeaf-7d14-4180-8337-38dba0a40792-service-ca\") pod \"console-789fc86fd-22zg7\" (UID: \"3f17eeaf-7d14-4180-8337-38dba0a40792\") " pod="openshift-console/console-789fc86fd-22zg7" Jun 14 14:43:51.215388 ip-10-0-129-116 kubenswrapper[2546]: I0614 14:43:51.215332 2546 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/3f17eeaf-7d14-4180-8337-38dba0a40792-console-oauth-config\") pod \"console-789fc86fd-22zg7\" (UID: \"3f17eeaf-7d14-4180-8337-38dba0a40792\") " pod="openshift-console/console-789fc86fd-22zg7" Jun 14 14:43:51.215388 ip-10-0-129-116 kubenswrapper[2546]: I0614 14:43:51.215355 2546 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-s8g9f\" (UniqueName: \"kubernetes.io/projected/3f17eeaf-7d14-4180-8337-38dba0a40792-kube-api-access-s8g9f\") pod \"console-789fc86fd-22zg7\" (UID: \"3f17eeaf-7d14-4180-8337-38dba0a40792\") " pod="openshift-console/console-789fc86fd-22zg7" Jun 14 14:43:51.215584 ip-10-0-129-116 kubenswrapper[2546]: I0614 14:43:51.215470 2546 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/3f17eeaf-7d14-4180-8337-38dba0a40792-console-config\") pod \"console-789fc86fd-22zg7\" (UID: \"3f17eeaf-7d14-4180-8337-38dba0a40792\") " pod="openshift-console/console-789fc86fd-22zg7" Jun 14 14:43:51.216072 ip-10-0-129-116 kubenswrapper[2546]: I0614 14:43:51.216050 2546 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/3f17eeaf-7d14-4180-8337-38dba0a40792-trusted-ca-bundle\") pod \"console-789fc86fd-22zg7\" (UID: \"3f17eeaf-7d14-4180-8337-38dba0a40792\") " pod="openshift-console/console-789fc86fd-22zg7" Jun 14 14:43:51.216219 ip-10-0-129-116 kubenswrapper[2546]: I0614 14:43:51.216111 2546 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/3f17eeaf-7d14-4180-8337-38dba0a40792-oauth-serving-cert\") pod \"console-789fc86fd-22zg7\" (UID: \"3f17eeaf-7d14-4180-8337-38dba0a40792\") " pod="openshift-console/console-789fc86fd-22zg7" Jun 14 14:43:51.216219 ip-10-0-129-116 kubenswrapper[2546]: I0614 14:43:51.216158 2546 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/3f17eeaf-7d14-4180-8337-38dba0a40792-service-ca\") pod \"console-789fc86fd-22zg7\" (UID: \"3f17eeaf-7d14-4180-8337-38dba0a40792\") " pod="openshift-console/console-789fc86fd-22zg7" Jun 14 14:43:51.216332 ip-10-0-129-116 kubenswrapper[2546]: I0614 14:43:51.216225 2546 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/3f17eeaf-7d14-4180-8337-38dba0a40792-console-config\") pod \"console-789fc86fd-22zg7\" (UID: \"3f17eeaf-7d14-4180-8337-38dba0a40792\") " pod="openshift-console/console-789fc86fd-22zg7" Jun 14 14:43:51.217638 ip-10-0-129-116 kubenswrapper[2546]: I0614 14:43:51.217618 2546 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/3f17eeaf-7d14-4180-8337-38dba0a40792-console-serving-cert\") pod \"console-789fc86fd-22zg7\" (UID: \"3f17eeaf-7d14-4180-8337-38dba0a40792\") " pod="openshift-console/console-789fc86fd-22zg7" Jun 14 14:43:51.218082 ip-10-0-129-116 kubenswrapper[2546]: I0614 14:43:51.218065 2546 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/3f17eeaf-7d14-4180-8337-38dba0a40792-console-oauth-config\") pod \"console-789fc86fd-22zg7\" (UID: \"3f17eeaf-7d14-4180-8337-38dba0a40792\") " pod="openshift-console/console-789fc86fd-22zg7" Jun 14 14:43:51.224210 ip-10-0-129-116 kubenswrapper[2546]: I0614 14:43:51.224192 2546 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-s8g9f\" (UniqueName: \"kubernetes.io/projected/3f17eeaf-7d14-4180-8337-38dba0a40792-kube-api-access-s8g9f\") pod \"console-789fc86fd-22zg7\" (UID: \"3f17eeaf-7d14-4180-8337-38dba0a40792\") " pod="openshift-console/console-789fc86fd-22zg7" Jun 14 14:43:51.230880 ip-10-0-129-116 kubenswrapper[2546]: I0614 14:43:51.230858 2546 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/telemeter-client-699d54bcc-smhbl"] Jun 14 14:43:51.235530 ip-10-0-129-116 kubenswrapper[2546]: I0614 14:43:51.235512 2546 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/telemeter-client-699d54bcc-smhbl" Jun 14 14:43:51.238189 ip-10-0-129-116 kubenswrapper[2546]: I0614 14:43:51.238168 2546 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client-tls\"" Jun 14 14:43:51.238297 ip-10-0-129-116 kubenswrapper[2546]: I0614 14:43:51.238197 2546 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client-kube-rbac-proxy-config\"" Jun 14 14:43:51.238297 ip-10-0-129-116 kubenswrapper[2546]: I0614 14:43:51.238209 2546 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client\"" Jun 14 14:43:51.238420 ip-10-0-129-116 kubenswrapper[2546]: I0614 14:43:51.238316 2546 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"federate-client-certs\"" Jun 14 14:43:51.238476 ip-10-0-129-116 kubenswrapper[2546]: I0614 14:43:51.238431 2546 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"telemeter-client-serving-certs-ca-bundle\"" Jun 14 14:43:51.238476 ip-10-0-129-116 kubenswrapper[2546]: I0614 14:43:51.238454 2546 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client-dockercfg-2fjr8\"" Jun 14 14:43:51.243111 ip-10-0-129-116 kubenswrapper[2546]: I0614 14:43:51.243072 2546 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"telemeter-trusted-ca-bundle-8i12ta5c71j38\"" Jun 14 14:43:51.249316 ip-10-0-129-116 kubenswrapper[2546]: I0614 14:43:51.249297 2546 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/telemeter-client-699d54bcc-smhbl"] Jun 14 14:43:51.318817 ip-10-0-129-116 kubenswrapper[2546]: I0614 14:43:51.318787 2546 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-789fc86fd-22zg7" Jun 14 14:43:51.351290 ip-10-0-129-116 kubenswrapper[2546]: I0614 14:43:51.351262 2546 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c96gx_105377da-c223-41ad-b033-546cb01239c4/konnectivity-agent/0.log" limit=1024 Jun 14 14:43:51.417762 ip-10-0-129-116 kubenswrapper[2546]: I0614 14:43:51.417734 2546 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/79987e3c-bc52-4b02-a57d-5368e3e8e70a-serving-certs-ca-bundle\") pod \"telemeter-client-699d54bcc-smhbl\" (UID: \"79987e3c-bc52-4b02-a57d-5368e3e8e70a\") " pod="openshift-monitoring/telemeter-client-699d54bcc-smhbl" Jun 14 14:43:51.417762 ip-10-0-129-116 kubenswrapper[2546]: I0614 14:43:51.417765 2546 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5hcdw\" (UniqueName: \"kubernetes.io/projected/79987e3c-bc52-4b02-a57d-5368e3e8e70a-kube-api-access-5hcdw\") pod \"telemeter-client-699d54bcc-smhbl\" (UID: \"79987e3c-bc52-4b02-a57d-5368e3e8e70a\") " pod="openshift-monitoring/telemeter-client-699d54bcc-smhbl" Jun 14 14:43:51.417995 ip-10-0-129-116 kubenswrapper[2546]: I0614 14:43:51.417798 2546 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-telemeter-client-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/79987e3c-bc52-4b02-a57d-5368e3e8e70a-secret-telemeter-client-kube-rbac-proxy-config\") pod \"telemeter-client-699d54bcc-smhbl\" (UID: \"79987e3c-bc52-4b02-a57d-5368e3e8e70a\") " pod="openshift-monitoring/telemeter-client-699d54bcc-smhbl" Jun 14 14:43:51.417995 ip-10-0-129-116 kubenswrapper[2546]: I0614 14:43:51.417888 2546 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/79987e3c-bc52-4b02-a57d-5368e3e8e70a-metrics-client-ca\") pod \"telemeter-client-699d54bcc-smhbl\" (UID: \"79987e3c-bc52-4b02-a57d-5368e3e8e70a\") " pod="openshift-monitoring/telemeter-client-699d54bcc-smhbl" Jun 14 14:43:51.417995 ip-10-0-129-116 kubenswrapper[2546]: I0614 14:43:51.417914 2546 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"telemeter-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/79987e3c-bc52-4b02-a57d-5368e3e8e70a-telemeter-trusted-ca-bundle\") pod \"telemeter-client-699d54bcc-smhbl\" (UID: \"79987e3c-bc52-4b02-a57d-5368e3e8e70a\") " pod="openshift-monitoring/telemeter-client-699d54bcc-smhbl" Jun 14 14:43:51.417995 ip-10-0-129-116 kubenswrapper[2546]: I0614 14:43:51.417944 2546 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-telemeter-client\" (UniqueName: \"kubernetes.io/secret/79987e3c-bc52-4b02-a57d-5368e3e8e70a-secret-telemeter-client\") pod \"telemeter-client-699d54bcc-smhbl\" (UID: \"79987e3c-bc52-4b02-a57d-5368e3e8e70a\") " pod="openshift-monitoring/telemeter-client-699d54bcc-smhbl" Jun 14 14:43:51.417995 ip-10-0-129-116 kubenswrapper[2546]: I0614 14:43:51.417971 2546 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"telemeter-client-tls\" (UniqueName: \"kubernetes.io/secret/79987e3c-bc52-4b02-a57d-5368e3e8e70a-telemeter-client-tls\") pod \"telemeter-client-699d54bcc-smhbl\" (UID: \"79987e3c-bc52-4b02-a57d-5368e3e8e70a\") " pod="openshift-monitoring/telemeter-client-699d54bcc-smhbl" Jun 14 14:43:51.418297 ip-10-0-129-116 kubenswrapper[2546]: I0614 14:43:51.418011 2546 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"federate-client-tls\" (UniqueName: \"kubernetes.io/secret/79987e3c-bc52-4b02-a57d-5368e3e8e70a-federate-client-tls\") pod \"telemeter-client-699d54bcc-smhbl\" (UID: \"79987e3c-bc52-4b02-a57d-5368e3e8e70a\") " pod="openshift-monitoring/telemeter-client-699d54bcc-smhbl" Jun 14 14:43:51.446215 ip-10-0-129-116 kubenswrapper[2546]: I0614 14:43:51.446191 2546 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-789fc86fd-22zg7"] Jun 14 14:43:51.448282 ip-10-0-129-116 kubenswrapper[2546]: W0614 14:43:51.448254 2546 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3f17eeaf_7d14_4180_8337_38dba0a40792.slice/crio-027d1fd1dd0ab2adf81b740c03a646810b064f09779052a926ea555816dade03 WatchSource:0}: Error finding container 027d1fd1dd0ab2adf81b740c03a646810b064f09779052a926ea555816dade03: Status 404 returned error can't find the container with id 027d1fd1dd0ab2adf81b740c03a646810b064f09779052a926ea555816dade03 Jun 14 14:43:51.519354 ip-10-0-129-116 kubenswrapper[2546]: I0614 14:43:51.519318 2546 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/79987e3c-bc52-4b02-a57d-5368e3e8e70a-metrics-client-ca\") pod \"telemeter-client-699d54bcc-smhbl\" (UID: \"79987e3c-bc52-4b02-a57d-5368e3e8e70a\") " pod="openshift-monitoring/telemeter-client-699d54bcc-smhbl" Jun 14 14:43:51.519354 ip-10-0-129-116 kubenswrapper[2546]: I0614 14:43:51.519352 2546 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"telemeter-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/79987e3c-bc52-4b02-a57d-5368e3e8e70a-telemeter-trusted-ca-bundle\") pod \"telemeter-client-699d54bcc-smhbl\" (UID: \"79987e3c-bc52-4b02-a57d-5368e3e8e70a\") " pod="openshift-monitoring/telemeter-client-699d54bcc-smhbl" Jun 14 14:43:51.519581 ip-10-0-129-116 kubenswrapper[2546]: I0614 14:43:51.519376 2546 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-telemeter-client\" (UniqueName: \"kubernetes.io/secret/79987e3c-bc52-4b02-a57d-5368e3e8e70a-secret-telemeter-client\") pod \"telemeter-client-699d54bcc-smhbl\" (UID: \"79987e3c-bc52-4b02-a57d-5368e3e8e70a\") " pod="openshift-monitoring/telemeter-client-699d54bcc-smhbl" Jun 14 14:43:51.519581 ip-10-0-129-116 kubenswrapper[2546]: I0614 14:43:51.519430 2546 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"telemeter-client-tls\" (UniqueName: \"kubernetes.io/secret/79987e3c-bc52-4b02-a57d-5368e3e8e70a-telemeter-client-tls\") pod \"telemeter-client-699d54bcc-smhbl\" (UID: \"79987e3c-bc52-4b02-a57d-5368e3e8e70a\") " pod="openshift-monitoring/telemeter-client-699d54bcc-smhbl" Jun 14 14:43:51.519581 ip-10-0-129-116 kubenswrapper[2546]: I0614 14:43:51.519486 2546 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"federate-client-tls\" (UniqueName: \"kubernetes.io/secret/79987e3c-bc52-4b02-a57d-5368e3e8e70a-federate-client-tls\") pod \"telemeter-client-699d54bcc-smhbl\" (UID: \"79987e3c-bc52-4b02-a57d-5368e3e8e70a\") " pod="openshift-monitoring/telemeter-client-699d54bcc-smhbl" Jun 14 14:43:51.519581 ip-10-0-129-116 kubenswrapper[2546]: I0614 14:43:51.519525 2546 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/79987e3c-bc52-4b02-a57d-5368e3e8e70a-serving-certs-ca-bundle\") pod \"telemeter-client-699d54bcc-smhbl\" (UID: \"79987e3c-bc52-4b02-a57d-5368e3e8e70a\") " pod="openshift-monitoring/telemeter-client-699d54bcc-smhbl" Jun 14 14:43:51.519581 ip-10-0-129-116 kubenswrapper[2546]: I0614 14:43:51.519544 2546 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5hcdw\" (UniqueName: \"kubernetes.io/projected/79987e3c-bc52-4b02-a57d-5368e3e8e70a-kube-api-access-5hcdw\") pod \"telemeter-client-699d54bcc-smhbl\" (UID: \"79987e3c-bc52-4b02-a57d-5368e3e8e70a\") " pod="openshift-monitoring/telemeter-client-699d54bcc-smhbl" Jun 14 14:43:51.519829 ip-10-0-129-116 kubenswrapper[2546]: I0614 14:43:51.519582 2546 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-telemeter-client-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/79987e3c-bc52-4b02-a57d-5368e3e8e70a-secret-telemeter-client-kube-rbac-proxy-config\") pod \"telemeter-client-699d54bcc-smhbl\" (UID: \"79987e3c-bc52-4b02-a57d-5368e3e8e70a\") " pod="openshift-monitoring/telemeter-client-699d54bcc-smhbl" Jun 14 14:43:51.520211 ip-10-0-129-116 kubenswrapper[2546]: I0614 14:43:51.520188 2546 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/79987e3c-bc52-4b02-a57d-5368e3e8e70a-metrics-client-ca\") pod \"telemeter-client-699d54bcc-smhbl\" (UID: \"79987e3c-bc52-4b02-a57d-5368e3e8e70a\") " pod="openshift-monitoring/telemeter-client-699d54bcc-smhbl" Jun 14 14:43:51.520211 ip-10-0-129-116 kubenswrapper[2546]: I0614 14:43:51.520259 2546 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/79987e3c-bc52-4b02-a57d-5368e3e8e70a-serving-certs-ca-bundle\") pod \"telemeter-client-699d54bcc-smhbl\" (UID: \"79987e3c-bc52-4b02-a57d-5368e3e8e70a\") " pod="openshift-monitoring/telemeter-client-699d54bcc-smhbl" Jun 14 14:43:51.520779 ip-10-0-129-116 kubenswrapper[2546]: I0614 14:43:51.520754 2546 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"telemeter-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/79987e3c-bc52-4b02-a57d-5368e3e8e70a-telemeter-trusted-ca-bundle\") pod \"telemeter-client-699d54bcc-smhbl\" (UID: \"79987e3c-bc52-4b02-a57d-5368e3e8e70a\") " pod="openshift-monitoring/telemeter-client-699d54bcc-smhbl" Jun 14 14:43:51.522491 ip-10-0-129-116 kubenswrapper[2546]: I0614 14:43:51.522469 2546 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-telemeter-client\" (UniqueName: \"kubernetes.io/secret/79987e3c-bc52-4b02-a57d-5368e3e8e70a-secret-telemeter-client\") pod \"telemeter-client-699d54bcc-smhbl\" (UID: \"79987e3c-bc52-4b02-a57d-5368e3e8e70a\") " pod="openshift-monitoring/telemeter-client-699d54bcc-smhbl" Jun 14 14:43:51.522585 ip-10-0-129-116 kubenswrapper[2546]: I0614 14:43:51.522516 2546 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-telemeter-client-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/79987e3c-bc52-4b02-a57d-5368e3e8e70a-secret-telemeter-client-kube-rbac-proxy-config\") pod \"telemeter-client-699d54bcc-smhbl\" (UID: \"79987e3c-bc52-4b02-a57d-5368e3e8e70a\") " pod="openshift-monitoring/telemeter-client-699d54bcc-smhbl" Jun 14 14:43:51.522629 ip-10-0-129-116 kubenswrapper[2546]: I0614 14:43:51.522587 2546 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"telemeter-client-tls\" (UniqueName: \"kubernetes.io/secret/79987e3c-bc52-4b02-a57d-5368e3e8e70a-telemeter-client-tls\") pod \"telemeter-client-699d54bcc-smhbl\" (UID: \"79987e3c-bc52-4b02-a57d-5368e3e8e70a\") " pod="openshift-monitoring/telemeter-client-699d54bcc-smhbl" Jun 14 14:43:51.522662 ip-10-0-129-116 kubenswrapper[2546]: I0614 14:43:51.522635 2546 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"federate-client-tls\" (UniqueName: \"kubernetes.io/secret/79987e3c-bc52-4b02-a57d-5368e3e8e70a-federate-client-tls\") pod \"telemeter-client-699d54bcc-smhbl\" (UID: \"79987e3c-bc52-4b02-a57d-5368e3e8e70a\") " pod="openshift-monitoring/telemeter-client-699d54bcc-smhbl" Jun 14 14:43:51.527430 ip-10-0-129-116 kubenswrapper[2546]: I0614 14:43:51.527410 2546 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-5hcdw\" (UniqueName: \"kubernetes.io/projected/79987e3c-bc52-4b02-a57d-5368e3e8e70a-kube-api-access-5hcdw\") pod \"telemeter-client-699d54bcc-smhbl\" (UID: \"79987e3c-bc52-4b02-a57d-5368e3e8e70a\") " pod="openshift-monitoring/telemeter-client-699d54bcc-smhbl" Jun 14 14:43:51.544437 ip-10-0-129-116 kubenswrapper[2546]: I0614 14:43:51.544417 2546 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/telemeter-client-699d54bcc-smhbl" Jun 14 14:43:51.674153 ip-10-0-129-116 kubenswrapper[2546]: I0614 14:43:51.674121 2546 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/telemeter-client-699d54bcc-smhbl"] Jun 14 14:43:51.676807 ip-10-0-129-116 kubenswrapper[2546]: W0614 14:43:51.676783 2546 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod79987e3c_bc52_4b02_a57d_5368e3e8e70a.slice/crio-73fc3cf8a8345dfbaab99bc6c3b559dd3fb90a61232b6074f4a2d4c1fed2b218 WatchSource:0}: Error finding container 73fc3cf8a8345dfbaab99bc6c3b559dd3fb90a61232b6074f4a2d4c1fed2b218: Status 404 returned error can't find the container with id 73fc3cf8a8345dfbaab99bc6c3b559dd3fb90a61232b6074f4a2d4c1fed2b218 Jun 14 14:43:52.056787 ip-10-0-129-116 kubenswrapper[2546]: I0614 14:43:52.056748 2546 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-789fc86fd-22zg7" event={"ID":"3f17eeaf-7d14-4180-8337-38dba0a40792","Type":"ContainerStarted","Data":"027d1fd1dd0ab2adf81b740c03a646810b064f09779052a926ea555816dade03"} Jun 14 14:43:52.058167 ip-10-0-129-116 kubenswrapper[2546]: I0614 14:43:52.058135 2546 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-699d54bcc-smhbl" event={"ID":"79987e3c-bc52-4b02-a57d-5368e3e8e70a","Type":"ContainerStarted","Data":"73fc3cf8a8345dfbaab99bc6c3b559dd3fb90a61232b6074f4a2d4c1fed2b218"} Jun 14 14:43:52.236414 ip-10-0-129-116 kubenswrapper[2546]: I0614 14:43:52.236363 2546 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c96gx_105377da-c223-41ad-b033-546cb01239c4/konnectivity-agent/0.log" limit=1024 Jun 14 14:43:53.205934 ip-10-0-129-116 kubenswrapper[2546]: I0614 14:43:53.205898 2546 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c96gx_105377da-c223-41ad-b033-546cb01239c4/konnectivity-agent/0.log" limit=1024 Jun 14 14:43:53.306920 ip-10-0-129-116 kubenswrapper[2546]: I0614 14:43:53.306890 2546 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c96gx_105377da-c223-41ad-b033-546cb01239c4/konnectivity-agent/0.log" limit=1024 Jun 14 14:43:55.075279 ip-10-0-129-116 kubenswrapper[2546]: I0614 14:43:55.075234 2546 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-789fc86fd-22zg7" event={"ID":"3f17eeaf-7d14-4180-8337-38dba0a40792","Type":"ContainerStarted","Data":"adf8e286e95c808f4a57dab2a7e20500bbbd87dae40d5b61545ff7d738ca17bc"} Jun 14 14:43:55.077067 ip-10-0-129-116 kubenswrapper[2546]: I0614 14:43:55.077041 2546 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-699d54bcc-smhbl" event={"ID":"79987e3c-bc52-4b02-a57d-5368e3e8e70a","Type":"ContainerStarted","Data":"d2ae7bb67db946761c88ad9eaab8980c842be82fce7ecc7e4c7493d1a9208199"} Jun 14 14:43:55.095553 ip-10-0-129-116 kubenswrapper[2546]: I0614 14:43:55.095507 2546 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-789fc86fd-22zg7" podStartSLOduration=1.949469792 podStartE2EDuration="5.095491738s" totalImagesPullingTime="3.146021946s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-14 14:43:50 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-14 14:43:55.094840729 +0000 UTC m=+272.423222892" watchObservedRunningTime="2026-06-14 14:43:55.095491738 +0000 UTC m=+272.423873863" Jun 14 14:43:56.082696 ip-10-0-129-116 kubenswrapper[2546]: I0614 14:43:56.082663 2546 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-699d54bcc-smhbl" event={"ID":"79987e3c-bc52-4b02-a57d-5368e3e8e70a","Type":"ContainerStarted","Data":"476e35a88b0c342f64fb46201d44dba2f803579dd5b661ecea7e7f43febe6778"} Jun 14 14:43:56.083057 ip-10-0-129-116 kubenswrapper[2546]: I0614 14:43:56.082719 2546 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-699d54bcc-smhbl" event={"ID":"79987e3c-bc52-4b02-a57d-5368e3e8e70a","Type":"ContainerStarted","Data":"bafb77edae771bcb1ca2915e82a927270103b808c16b08a5d3b3394a89f62970"} Jun 14 14:43:56.104462 ip-10-0-129-116 kubenswrapper[2546]: I0614 14:43:56.104409 2546 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/telemeter-client-699d54bcc-smhbl" podStartSLOduration=1.408461506 podStartE2EDuration="5.104390578s" totalImagesPullingTime="3.695929072s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-14 14:43:51 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-14 14:43:56.103579162 +0000 UTC m=+273.431961310" watchObservedRunningTime="2026-06-14 14:43:56.104390578 +0000 UTC m=+273.432772703" Jun 14 14:43:57.461839 ip-10-0-129-116 kubenswrapper[2546]: I0614 14:43:57.461803 2546 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-c57567cdc-dkbm2"] Jun 14 14:43:57.467862 ip-10-0-129-116 kubenswrapper[2546]: I0614 14:43:57.467842 2546 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-c57567cdc-dkbm2" Jun 14 14:43:57.476174 ip-10-0-129-116 kubenswrapper[2546]: I0614 14:43:57.476147 2546 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-c57567cdc-dkbm2"] Jun 14 14:43:57.476469 ip-10-0-129-116 kubenswrapper[2546]: I0614 14:43:57.476445 2546 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/5a961d65-1a8b-4e6c-920f-a2b166bf9daf-console-config\") pod \"console-c57567cdc-dkbm2\" (UID: \"5a961d65-1a8b-4e6c-920f-a2b166bf9daf\") " pod="openshift-console/console-c57567cdc-dkbm2" Jun 14 14:43:57.476585 ip-10-0-129-116 kubenswrapper[2546]: I0614 14:43:57.476531 2546 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/5a961d65-1a8b-4e6c-920f-a2b166bf9daf-service-ca\") pod \"console-c57567cdc-dkbm2\" (UID: \"5a961d65-1a8b-4e6c-920f-a2b166bf9daf\") " pod="openshift-console/console-c57567cdc-dkbm2" Jun 14 14:43:57.476585 ip-10-0-129-116 kubenswrapper[2546]: I0614 14:43:57.476563 2546 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xjzd2\" (UniqueName: \"kubernetes.io/projected/5a961d65-1a8b-4e6c-920f-a2b166bf9daf-kube-api-access-xjzd2\") pod \"console-c57567cdc-dkbm2\" (UID: \"5a961d65-1a8b-4e6c-920f-a2b166bf9daf\") " pod="openshift-console/console-c57567cdc-dkbm2" Jun 14 14:43:57.476712 ip-10-0-129-116 kubenswrapper[2546]: I0614 14:43:57.476592 2546 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/5a961d65-1a8b-4e6c-920f-a2b166bf9daf-trusted-ca-bundle\") pod \"console-c57567cdc-dkbm2\" (UID: \"5a961d65-1a8b-4e6c-920f-a2b166bf9daf\") " pod="openshift-console/console-c57567cdc-dkbm2" Jun 14 14:43:57.476712 ip-10-0-129-116 kubenswrapper[2546]: I0614 14:43:57.476648 2546 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/5a961d65-1a8b-4e6c-920f-a2b166bf9daf-console-serving-cert\") pod \"console-c57567cdc-dkbm2\" (UID: \"5a961d65-1a8b-4e6c-920f-a2b166bf9daf\") " pod="openshift-console/console-c57567cdc-dkbm2" Jun 14 14:43:57.476712 ip-10-0-129-116 kubenswrapper[2546]: I0614 14:43:57.476686 2546 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/5a961d65-1a8b-4e6c-920f-a2b166bf9daf-console-oauth-config\") pod \"console-c57567cdc-dkbm2\" (UID: \"5a961d65-1a8b-4e6c-920f-a2b166bf9daf\") " pod="openshift-console/console-c57567cdc-dkbm2" Jun 14 14:43:57.476859 ip-10-0-129-116 kubenswrapper[2546]: I0614 14:43:57.476709 2546 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/5a961d65-1a8b-4e6c-920f-a2b166bf9daf-oauth-serving-cert\") pod \"console-c57567cdc-dkbm2\" (UID: \"5a961d65-1a8b-4e6c-920f-a2b166bf9daf\") " pod="openshift-console/console-c57567cdc-dkbm2" Jun 14 14:43:57.577082 ip-10-0-129-116 kubenswrapper[2546]: I0614 14:43:57.577046 2546 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/5a961d65-1a8b-4e6c-920f-a2b166bf9daf-console-config\") pod \"console-c57567cdc-dkbm2\" (UID: \"5a961d65-1a8b-4e6c-920f-a2b166bf9daf\") " pod="openshift-console/console-c57567cdc-dkbm2" Jun 14 14:43:57.577304 ip-10-0-129-116 kubenswrapper[2546]: I0614 14:43:57.577128 2546 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/5a961d65-1a8b-4e6c-920f-a2b166bf9daf-service-ca\") pod \"console-c57567cdc-dkbm2\" (UID: \"5a961d65-1a8b-4e6c-920f-a2b166bf9daf\") " pod="openshift-console/console-c57567cdc-dkbm2" Jun 14 14:43:57.577304 ip-10-0-129-116 kubenswrapper[2546]: I0614 14:43:57.577145 2546 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xjzd2\" (UniqueName: \"kubernetes.io/projected/5a961d65-1a8b-4e6c-920f-a2b166bf9daf-kube-api-access-xjzd2\") pod \"console-c57567cdc-dkbm2\" (UID: \"5a961d65-1a8b-4e6c-920f-a2b166bf9daf\") " pod="openshift-console/console-c57567cdc-dkbm2" Jun 14 14:43:57.577304 ip-10-0-129-116 kubenswrapper[2546]: I0614 14:43:57.577161 2546 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/5a961d65-1a8b-4e6c-920f-a2b166bf9daf-trusted-ca-bundle\") pod \"console-c57567cdc-dkbm2\" (UID: \"5a961d65-1a8b-4e6c-920f-a2b166bf9daf\") " pod="openshift-console/console-c57567cdc-dkbm2" Jun 14 14:43:57.577304 ip-10-0-129-116 kubenswrapper[2546]: I0614 14:43:57.577216 2546 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/5a961d65-1a8b-4e6c-920f-a2b166bf9daf-console-serving-cert\") pod \"console-c57567cdc-dkbm2\" (UID: \"5a961d65-1a8b-4e6c-920f-a2b166bf9daf\") " pod="openshift-console/console-c57567cdc-dkbm2" Jun 14 14:43:57.577304 ip-10-0-129-116 kubenswrapper[2546]: I0614 14:43:57.577256 2546 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/5a961d65-1a8b-4e6c-920f-a2b166bf9daf-console-oauth-config\") pod \"console-c57567cdc-dkbm2\" (UID: \"5a961d65-1a8b-4e6c-920f-a2b166bf9daf\") " pod="openshift-console/console-c57567cdc-dkbm2" Jun 14 14:43:57.577304 ip-10-0-129-116 kubenswrapper[2546]: I0614 14:43:57.577282 2546 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/5a961d65-1a8b-4e6c-920f-a2b166bf9daf-oauth-serving-cert\") pod \"console-c57567cdc-dkbm2\" (UID: \"5a961d65-1a8b-4e6c-920f-a2b166bf9daf\") " pod="openshift-console/console-c57567cdc-dkbm2" Jun 14 14:43:57.577941 ip-10-0-129-116 kubenswrapper[2546]: I0614 14:43:57.577915 2546 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/5a961d65-1a8b-4e6c-920f-a2b166bf9daf-service-ca\") pod \"console-c57567cdc-dkbm2\" (UID: \"5a961d65-1a8b-4e6c-920f-a2b166bf9daf\") " pod="openshift-console/console-c57567cdc-dkbm2" Jun 14 14:43:57.578061 ip-10-0-129-116 kubenswrapper[2546]: I0614 14:43:57.577965 2546 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/5a961d65-1a8b-4e6c-920f-a2b166bf9daf-console-config\") pod \"console-c57567cdc-dkbm2\" (UID: \"5a961d65-1a8b-4e6c-920f-a2b166bf9daf\") " pod="openshift-console/console-c57567cdc-dkbm2" Jun 14 14:43:57.578141 ip-10-0-129-116 kubenswrapper[2546]: I0614 14:43:57.578054 2546 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/5a961d65-1a8b-4e6c-920f-a2b166bf9daf-oauth-serving-cert\") pod \"console-c57567cdc-dkbm2\" (UID: \"5a961d65-1a8b-4e6c-920f-a2b166bf9daf\") " pod="openshift-console/console-c57567cdc-dkbm2" Jun 14 14:43:57.578141 ip-10-0-129-116 kubenswrapper[2546]: I0614 14:43:57.578125 2546 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/5a961d65-1a8b-4e6c-920f-a2b166bf9daf-trusted-ca-bundle\") pod \"console-c57567cdc-dkbm2\" (UID: \"5a961d65-1a8b-4e6c-920f-a2b166bf9daf\") " pod="openshift-console/console-c57567cdc-dkbm2" Jun 14 14:43:57.579610 ip-10-0-129-116 kubenswrapper[2546]: I0614 14:43:57.579585 2546 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/5a961d65-1a8b-4e6c-920f-a2b166bf9daf-console-oauth-config\") pod \"console-c57567cdc-dkbm2\" (UID: \"5a961d65-1a8b-4e6c-920f-a2b166bf9daf\") " pod="openshift-console/console-c57567cdc-dkbm2" Jun 14 14:43:57.579784 ip-10-0-129-116 kubenswrapper[2546]: I0614 14:43:57.579763 2546 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/5a961d65-1a8b-4e6c-920f-a2b166bf9daf-console-serving-cert\") pod \"console-c57567cdc-dkbm2\" (UID: \"5a961d65-1a8b-4e6c-920f-a2b166bf9daf\") " pod="openshift-console/console-c57567cdc-dkbm2" Jun 14 14:43:57.584323 ip-10-0-129-116 kubenswrapper[2546]: I0614 14:43:57.584301 2546 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-xjzd2\" (UniqueName: \"kubernetes.io/projected/5a961d65-1a8b-4e6c-920f-a2b166bf9daf-kube-api-access-xjzd2\") pod \"console-c57567cdc-dkbm2\" (UID: \"5a961d65-1a8b-4e6c-920f-a2b166bf9daf\") " pod="openshift-console/console-c57567cdc-dkbm2" Jun 14 14:43:57.778114 ip-10-0-129-116 kubenswrapper[2546]: I0614 14:43:57.777994 2546 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-c57567cdc-dkbm2" Jun 14 14:43:57.795383 ip-10-0-129-116 kubenswrapper[2546]: I0614 14:43:57.795351 2546 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c96gx_105377da-c223-41ad-b033-546cb01239c4/konnectivity-agent/0.log" limit=1024 Jun 14 14:43:57.846413 ip-10-0-129-116 kubenswrapper[2546]: I0614 14:43:57.846371 2546 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c96gx_105377da-c223-41ad-b033-546cb01239c4/konnectivity-agent/0.log" limit=1024 Jun 14 14:43:57.906951 ip-10-0-129-116 kubenswrapper[2546]: I0614 14:43:57.906923 2546 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-c57567cdc-dkbm2"] Jun 14 14:43:57.909450 ip-10-0-129-116 kubenswrapper[2546]: W0614 14:43:57.909419 2546 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5a961d65_1a8b_4e6c_920f_a2b166bf9daf.slice/crio-f940239f2c3ca92d4e9f9d078ab69e6f343dd2467012356646a3b2c999cb72b3 WatchSource:0}: Error finding container f940239f2c3ca92d4e9f9d078ab69e6f343dd2467012356646a3b2c999cb72b3: Status 404 returned error can't find the container with id f940239f2c3ca92d4e9f9d078ab69e6f343dd2467012356646a3b2c999cb72b3 Jun 14 14:43:58.092016 ip-10-0-129-116 kubenswrapper[2546]: I0614 14:43:58.091925 2546 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-c57567cdc-dkbm2" event={"ID":"5a961d65-1a8b-4e6c-920f-a2b166bf9daf","Type":"ContainerStarted","Data":"54fc4e299385db5c973da4720d5af129f2e51972775a3963070f7fa27fef7e1e"} Jun 14 14:43:58.092016 ip-10-0-129-116 kubenswrapper[2546]: I0614 14:43:58.091987 2546 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-c57567cdc-dkbm2" event={"ID":"5a961d65-1a8b-4e6c-920f-a2b166bf9daf","Type":"ContainerStarted","Data":"f940239f2c3ca92d4e9f9d078ab69e6f343dd2467012356646a3b2c999cb72b3"} Jun 14 14:43:58.108789 ip-10-0-129-116 kubenswrapper[2546]: I0614 14:43:58.108732 2546 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-c57567cdc-dkbm2" podStartSLOduration=1.108717296 podStartE2EDuration="1.108717296s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-14 14:43:57 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-14 14:43:58.107613147 +0000 UTC m=+275.435995296" watchObservedRunningTime="2026-06-14 14:43:58.108717296 +0000 UTC m=+275.437099420" Jun 14 14:44:01.319619 ip-10-0-129-116 kubenswrapper[2546]: I0614 14:44:01.319582 2546 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-789fc86fd-22zg7" Jun 14 14:44:01.320069 ip-10-0-129-116 kubenswrapper[2546]: I0614 14:44:01.319640 2546 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-789fc86fd-22zg7" Jun 14 14:44:01.321039 ip-10-0-129-116 kubenswrapper[2546]: I0614 14:44:01.321014 2546 patch_prober.go:28] interesting pod/console-789fc86fd-22zg7 container/console namespace/openshift-console: Startup probe status=failure output="Get \"https://10.132.0.20:8443/health\": dial tcp 10.132.0.20:8443: connect: connection refused" start-of-body= Jun 14 14:44:01.321156 ip-10-0-129-116 kubenswrapper[2546]: I0614 14:44:01.321059 2546 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-console/console-789fc86fd-22zg7" podUID="3f17eeaf-7d14-4180-8337-38dba0a40792" containerName="console" probeResult="failure" output="Get \"https://10.132.0.20:8443/health\": dial tcp 10.132.0.20:8443: connect: connection refused" Jun 14 14:44:03.513999 ip-10-0-129-116 kubenswrapper[2546]: I0614 14:44:03.513964 2546 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c96gx_105377da-c223-41ad-b033-546cb01239c4/konnectivity-agent/0.log" limit=1024 Jun 14 14:44:03.610775 ip-10-0-129-116 kubenswrapper[2546]: I0614 14:44:03.610738 2546 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c96gx_105377da-c223-41ad-b033-546cb01239c4/konnectivity-agent/0.log" limit=1024 Jun 14 14:44:04.719086 ip-10-0-129-116 kubenswrapper[2546]: E0614 14:44:04.719050 2546 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[registry-tls], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-image-registry/image-registry-6b9bcff985-7lnrc" podUID="5a64bb81-61bc-42a1-bd11-55786121b7d8" Jun 14 14:44:04.719086 ip-10-0-129-116 kubenswrapper[2546]: E0614 14:44:04.719050 2546 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[metrics-tls], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-dns/dns-default-29vxk" podUID="11cc366c-4c61-4205-873a-3dcfcd341bf8" Jun 14 14:44:05.118895 ip-10-0-129-116 kubenswrapper[2546]: I0614 14:44:05.118819 2546 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-6b9bcff985-7lnrc" Jun 14 14:44:05.119030 ip-10-0-129-116 kubenswrapper[2546]: I0614 14:44:05.118819 2546 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-29vxk" Jun 14 14:44:07.113082 ip-10-0-129-116 kubenswrapper[2546]: I0614 14:44:07.113049 2546 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c96gx_105377da-c223-41ad-b033-546cb01239c4/konnectivity-agent/0.log" limit=1024 Jun 14 14:44:07.163226 ip-10-0-129-116 kubenswrapper[2546]: I0614 14:44:07.163194 2546 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c96gx_105377da-c223-41ad-b033-546cb01239c4/konnectivity-agent/0.log" limit=1024 Jun 14 14:44:07.283847 ip-10-0-129-116 kubenswrapper[2546]: I0614 14:44:07.283818 2546 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c96gx_105377da-c223-41ad-b033-546cb01239c4/konnectivity-agent/0.log" limit=1024 Jun 14 14:44:07.778832 ip-10-0-129-116 kubenswrapper[2546]: I0614 14:44:07.778801 2546 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-c57567cdc-dkbm2" Jun 14 14:44:07.779006 ip-10-0-129-116 kubenswrapper[2546]: I0614 14:44:07.778860 2546 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-c57567cdc-dkbm2" Jun 14 14:44:07.780126 ip-10-0-129-116 kubenswrapper[2546]: I0614 14:44:07.780087 2546 patch_prober.go:28] interesting pod/console-c57567cdc-dkbm2 container/console namespace/openshift-console: Startup probe status=failure output="Get \"https://10.132.0.22:8443/health\": dial tcp 10.132.0.22:8443: connect: connection refused" start-of-body= Jun 14 14:44:07.780244 ip-10-0-129-116 kubenswrapper[2546]: I0614 14:44:07.780165 2546 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-console/console-c57567cdc-dkbm2" podUID="5a961d65-1a8b-4e6c-920f-a2b166bf9daf" containerName="console" probeResult="failure" output="Get \"https://10.132.0.22:8443/health\": dial tcp 10.132.0.22:8443: connect: connection refused" Jun 14 14:44:08.067453 ip-10-0-129-116 kubenswrapper[2546]: I0614 14:44:08.067372 2546 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/11cc366c-4c61-4205-873a-3dcfcd341bf8-metrics-tls\") pod \"dns-default-29vxk\" (UID: \"11cc366c-4c61-4205-873a-3dcfcd341bf8\") " pod="openshift-dns/dns-default-29vxk" Jun 14 14:44:08.067590 ip-10-0-129-116 kubenswrapper[2546]: I0614 14:44:08.067451 2546 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/5a64bb81-61bc-42a1-bd11-55786121b7d8-registry-tls\") pod \"image-registry-6b9bcff985-7lnrc\" (UID: \"5a64bb81-61bc-42a1-bd11-55786121b7d8\") " pod="openshift-image-registry/image-registry-6b9bcff985-7lnrc" Jun 14 14:44:08.069813 ip-10-0-129-116 kubenswrapper[2546]: I0614 14:44:08.069781 2546 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/5a64bb81-61bc-42a1-bd11-55786121b7d8-registry-tls\") pod \"image-registry-6b9bcff985-7lnrc\" (UID: \"5a64bb81-61bc-42a1-bd11-55786121b7d8\") " pod="openshift-image-registry/image-registry-6b9bcff985-7lnrc" Jun 14 14:44:08.069813 ip-10-0-129-116 kubenswrapper[2546]: I0614 14:44:08.069798 2546 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/11cc366c-4c61-4205-873a-3dcfcd341bf8-metrics-tls\") pod \"dns-default-29vxk\" (UID: \"11cc366c-4c61-4205-873a-3dcfcd341bf8\") " pod="openshift-dns/dns-default-29vxk" Jun 14 14:44:08.122480 ip-10-0-129-116 kubenswrapper[2546]: I0614 14:44:08.122451 2546 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-jwvk2\"" Jun 14 14:44:08.123523 ip-10-0-129-116 kubenswrapper[2546]: I0614 14:44:08.123504 2546 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"registry-dockercfg-ns8zb\"" Jun 14 14:44:08.130832 ip-10-0-129-116 kubenswrapper[2546]: I0614 14:44:08.130805 2546 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-6b9bcff985-7lnrc" Jun 14 14:44:08.130965 ip-10-0-129-116 kubenswrapper[2546]: I0614 14:44:08.130893 2546 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-29vxk" Jun 14 14:44:08.293032 ip-10-0-129-116 kubenswrapper[2546]: I0614 14:44:08.292997 2546 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-6b9bcff985-7lnrc"] Jun 14 14:44:08.295813 ip-10-0-129-116 kubenswrapper[2546]: W0614 14:44:08.295780 2546 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5a64bb81_61bc_42a1_bd11_55786121b7d8.slice/crio-f4b79de2f35b587aaad30ee74f896d17f70407f2d152998b472aa03854dd41d4 WatchSource:0}: Error finding container f4b79de2f35b587aaad30ee74f896d17f70407f2d152998b472aa03854dd41d4: Status 404 returned error can't find the container with id f4b79de2f35b587aaad30ee74f896d17f70407f2d152998b472aa03854dd41d4 Jun 14 14:44:08.309849 ip-10-0-129-116 kubenswrapper[2546]: I0614 14:44:08.309827 2546 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-29vxk"] Jun 14 14:44:08.312344 ip-10-0-129-116 kubenswrapper[2546]: W0614 14:44:08.312318 2546 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod11cc366c_4c61_4205_873a_3dcfcd341bf8.slice/crio-176012896f5751fd0a10a6ee14f4131636d0b261fa64239b47c965e32141ad4e WatchSource:0}: Error finding container 176012896f5751fd0a10a6ee14f4131636d0b261fa64239b47c965e32141ad4e: Status 404 returned error can't find the container with id 176012896f5751fd0a10a6ee14f4131636d0b261fa64239b47c965e32141ad4e Jun 14 14:44:09.135457 ip-10-0-129-116 kubenswrapper[2546]: I0614 14:44:09.135412 2546 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-29vxk" event={"ID":"11cc366c-4c61-4205-873a-3dcfcd341bf8","Type":"ContainerStarted","Data":"176012896f5751fd0a10a6ee14f4131636d0b261fa64239b47c965e32141ad4e"} Jun 14 14:44:09.137044 ip-10-0-129-116 kubenswrapper[2546]: I0614 14:44:09.137007 2546 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-6b9bcff985-7lnrc" event={"ID":"5a64bb81-61bc-42a1-bd11-55786121b7d8","Type":"ContainerStarted","Data":"f4e1a3d27e1aca55279ae5c17dee586183dca63db2ad2161ad7bcc34d30ddb0c"} Jun 14 14:44:09.137200 ip-10-0-129-116 kubenswrapper[2546]: I0614 14:44:09.137055 2546 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-6b9bcff985-7lnrc" event={"ID":"5a64bb81-61bc-42a1-bd11-55786121b7d8","Type":"ContainerStarted","Data":"f4b79de2f35b587aaad30ee74f896d17f70407f2d152998b472aa03854dd41d4"} Jun 14 14:44:09.137200 ip-10-0-129-116 kubenswrapper[2546]: I0614 14:44:09.137153 2546 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-image-registry/image-registry-6b9bcff985-7lnrc" Jun 14 14:44:09.158523 ip-10-0-129-116 kubenswrapper[2546]: I0614 14:44:09.158474 2546 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/image-registry-6b9bcff985-7lnrc" podStartSLOduration=286.158460368 podStartE2EDuration="4m46.158460368s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-14 14:39:23 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-14 14:44:09.157503821 +0000 UTC m=+286.485885966" watchObservedRunningTime="2026-06-14 14:44:09.158460368 +0000 UTC m=+286.486842492" Jun 14 14:44:11.151884 ip-10-0-129-116 kubenswrapper[2546]: I0614 14:44:11.151845 2546 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-29vxk" event={"ID":"11cc366c-4c61-4205-873a-3dcfcd341bf8","Type":"ContainerStarted","Data":"96846c355b5ddfd0611e98ab319db347ac78ddb1d865f4fffdd970f5c0cb179f"} Jun 14 14:44:11.152249 ip-10-0-129-116 kubenswrapper[2546]: I0614 14:44:11.151936 2546 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-29vxk" event={"ID":"11cc366c-4c61-4205-873a-3dcfcd341bf8","Type":"ContainerStarted","Data":"c1d14b137842404353f1a56114d90e25d0365d379fddc555422920c83f5fc6e3"} Jun 14 14:44:11.152249 ip-10-0-129-116 kubenswrapper[2546]: I0614 14:44:11.151966 2546 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-dns/dns-default-29vxk" Jun 14 14:44:11.168831 ip-10-0-129-116 kubenswrapper[2546]: I0614 14:44:11.168785 2546 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/dns-default-29vxk" podStartSLOduration=251.408450742 podStartE2EDuration="4m13.168771013s" totalImagesPullingTime="1.760320271s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-14 14:39:58 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-14 14:44:11.167084149 +0000 UTC m=+288.495466292" watchObservedRunningTime="2026-06-14 14:44:11.168771013 +0000 UTC m=+288.497153138" Jun 14 14:44:11.320054 ip-10-0-129-116 kubenswrapper[2546]: I0614 14:44:11.320015 2546 patch_prober.go:28] interesting pod/console-789fc86fd-22zg7 container/console namespace/openshift-console: Startup probe status=failure output="Get \"https://10.132.0.20:8443/health\": dial tcp 10.132.0.20:8443: connect: connection refused" start-of-body= Jun 14 14:44:11.320237 ip-10-0-129-116 kubenswrapper[2546]: I0614 14:44:11.320070 2546 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-console/console-789fc86fd-22zg7" podUID="3f17eeaf-7d14-4180-8337-38dba0a40792" containerName="console" probeResult="failure" output="Get \"https://10.132.0.20:8443/health\": dial tcp 10.132.0.20:8443: connect: connection refused" Jun 14 14:44:16.959853 ip-10-0-129-116 kubenswrapper[2546]: I0614 14:44:16.959823 2546 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c96gx_105377da-c223-41ad-b033-546cb01239c4/konnectivity-agent/0.log" limit=1024 Jun 14 14:44:17.005082 ip-10-0-129-116 kubenswrapper[2546]: I0614 14:44:17.005046 2546 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c96gx_105377da-c223-41ad-b033-546cb01239c4/konnectivity-agent/0.log" limit=1024 Jun 14 14:44:17.778773 ip-10-0-129-116 kubenswrapper[2546]: I0614 14:44:17.778736 2546 patch_prober.go:28] interesting pod/console-c57567cdc-dkbm2 container/console namespace/openshift-console: Startup probe status=failure output="Get \"https://10.132.0.22:8443/health\": dial tcp 10.132.0.22:8443: connect: connection refused" start-of-body= Jun 14 14:44:17.778947 ip-10-0-129-116 kubenswrapper[2546]: I0614 14:44:17.778809 2546 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-console/console-c57567cdc-dkbm2" podUID="5a961d65-1a8b-4e6c-920f-a2b166bf9daf" containerName="console" probeResult="failure" output="Get \"https://10.132.0.22:8443/health\": dial tcp 10.132.0.22:8443: connect: connection refused" Jun 14 14:44:21.158281 ip-10-0-129-116 kubenswrapper[2546]: I0614 14:44:21.158244 2546 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-dns/dns-default-29vxk" Jun 14 14:44:21.319428 ip-10-0-129-116 kubenswrapper[2546]: I0614 14:44:21.319391 2546 patch_prober.go:28] interesting pod/console-789fc86fd-22zg7 container/console namespace/openshift-console: Startup probe status=failure output="Get \"https://10.132.0.20:8443/health\": dial tcp 10.132.0.20:8443: connect: connection refused" start-of-body= Jun 14 14:44:21.319593 ip-10-0-129-116 kubenswrapper[2546]: I0614 14:44:21.319441 2546 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-console/console-789fc86fd-22zg7" podUID="3f17eeaf-7d14-4180-8337-38dba0a40792" containerName="console" probeResult="failure" output="Get \"https://10.132.0.20:8443/health\": dial tcp 10.132.0.20:8443: connect: connection refused" Jun 14 14:44:23.144854 ip-10-0-129-116 kubenswrapper[2546]: I0614 14:44:23.144829 2546 kubelet.go:1648] "Image garbage collection succeeded" Jun 14 14:44:25.239411 ip-10-0-129-116 kubenswrapper[2546]: I0614 14:44:25.239381 2546 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c96gx_105377da-c223-41ad-b033-546cb01239c4/konnectivity-agent/0.log" limit=1024 Jun 14 14:44:26.090659 ip-10-0-129-116 kubenswrapper[2546]: I0614 14:44:26.090626 2546 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c96gx_105377da-c223-41ad-b033-546cb01239c4/konnectivity-agent/0.log" limit=1024 Jun 14 14:44:26.728875 ip-10-0-129-116 kubenswrapper[2546]: I0614 14:44:26.728837 2546 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c96gx_105377da-c223-41ad-b033-546cb01239c4/konnectivity-agent/0.log" limit=1024 Jun 14 14:44:27.782515 ip-10-0-129-116 kubenswrapper[2546]: I0614 14:44:27.782481 2546 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-c57567cdc-dkbm2" Jun 14 14:44:27.786144 ip-10-0-129-116 kubenswrapper[2546]: I0614 14:44:27.786119 2546 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-c57567cdc-dkbm2" Jun 14 14:44:27.840962 ip-10-0-129-116 kubenswrapper[2546]: I0614 14:44:27.840932 2546 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-789fc86fd-22zg7"] Jun 14 14:44:27.934076 ip-10-0-129-116 kubenswrapper[2546]: I0614 14:44:27.934046 2546 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c96gx_105377da-c223-41ad-b033-546cb01239c4/konnectivity-agent/0.log" limit=1024 Jun 14 14:44:28.034740 ip-10-0-129-116 kubenswrapper[2546]: I0614 14:44:28.034657 2546 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c96gx_105377da-c223-41ad-b033-546cb01239c4/konnectivity-agent/0.log" limit=1024 Jun 14 14:44:28.082872 ip-10-0-129-116 kubenswrapper[2546]: I0614 14:44:28.082843 2546 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c96gx_105377da-c223-41ad-b033-546cb01239c4/konnectivity-agent/0.log" limit=1024 Jun 14 14:44:28.134803 ip-10-0-129-116 kubenswrapper[2546]: I0614 14:44:28.134764 2546 patch_prober.go:28] interesting pod/image-registry-6b9bcff985-7lnrc container/registry namespace/openshift-image-registry: Liveness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body={"errors":[{"code":"UNAVAILABLE","message":"service unavailable","detail":"health check failed: please see /debug/health"}]} Jun 14 14:44:28.134951 ip-10-0-129-116 kubenswrapper[2546]: I0614 14:44:28.134825 2546 prober.go:120] "Probe failed" probeType="Liveness" pod="openshift-image-registry/image-registry-6b9bcff985-7lnrc" podUID="5a64bb81-61bc-42a1-bd11-55786121b7d8" containerName="registry" probeResult="failure" output="HTTP probe failed with statuscode: 503" Jun 14 14:44:28.822783 ip-10-0-129-116 kubenswrapper[2546]: I0614 14:44:28.822748 2546 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c96gx_105377da-c223-41ad-b033-546cb01239c4/konnectivity-agent/0.log" limit=1024 Jun 14 14:44:28.926219 ip-10-0-129-116 kubenswrapper[2546]: I0614 14:44:28.926191 2546 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c96gx_105377da-c223-41ad-b033-546cb01239c4/konnectivity-agent/0.log" limit=1024 Jun 14 14:44:30.146404 ip-10-0-129-116 kubenswrapper[2546]: I0614 14:44:30.146375 2546 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-image-registry/image-registry-6b9bcff985-7lnrc" Jun 14 14:44:30.274719 ip-10-0-129-116 kubenswrapper[2546]: I0614 14:44:30.274676 2546 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c96gx_105377da-c223-41ad-b033-546cb01239c4/konnectivity-agent/0.log" limit=1024 Jun 14 14:44:30.374606 ip-10-0-129-116 kubenswrapper[2546]: I0614 14:44:30.374568 2546 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c96gx_105377da-c223-41ad-b033-546cb01239c4/konnectivity-agent/0.log" limit=1024 Jun 14 14:44:30.473858 ip-10-0-129-116 kubenswrapper[2546]: I0614 14:44:30.473779 2546 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c96gx_105377da-c223-41ad-b033-546cb01239c4/konnectivity-agent/0.log" limit=1024 Jun 14 14:44:30.574483 ip-10-0-129-116 kubenswrapper[2546]: I0614 14:44:30.574452 2546 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c96gx_105377da-c223-41ad-b033-546cb01239c4/konnectivity-agent/0.log" limit=1024 Jun 14 14:44:31.266424 ip-10-0-129-116 kubenswrapper[2546]: I0614 14:44:31.266393 2546 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-image-registry/image-registry-6b9bcff985-7lnrc"] Jun 14 14:44:31.341747 ip-10-0-129-116 kubenswrapper[2546]: I0614 14:44:31.341718 2546 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c96gx_105377da-c223-41ad-b033-546cb01239c4/konnectivity-agent/0.log" limit=1024 Jun 14 14:44:31.442468 ip-10-0-129-116 kubenswrapper[2546]: I0614 14:44:31.442424 2546 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c96gx_105377da-c223-41ad-b033-546cb01239c4/konnectivity-agent/0.log" limit=1024 Jun 14 14:44:31.642937 ip-10-0-129-116 kubenswrapper[2546]: I0614 14:44:31.642858 2546 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c96gx_105377da-c223-41ad-b033-546cb01239c4/konnectivity-agent/0.log" limit=1024 Jun 14 14:44:31.744213 ip-10-0-129-116 kubenswrapper[2546]: I0614 14:44:31.744182 2546 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c96gx_105377da-c223-41ad-b033-546cb01239c4/konnectivity-agent/0.log" limit=1024 Jun 14 14:44:32.231736 ip-10-0-129-116 kubenswrapper[2546]: I0614 14:44:32.231706 2546 generic.go:356] "Generic (PLEG): container finished" podID="fe19844a-27c5-471a-b03d-867b9eb90582" containerID="7ebc267c6144189a54bb014acb5a93a2237f2cfddf193233fcceb8e27eb3b3c5" exitCode=0 Jun 14 14:44:32.231891 ip-10-0-129-116 kubenswrapper[2546]: I0614 14:44:32.231779 2546 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca-operator/service-ca-operator-7ccbfd59dc-z2rs6" event={"ID":"fe19844a-27c5-471a-b03d-867b9eb90582","Type":"ContainerDied","Data":"7ebc267c6144189a54bb014acb5a93a2237f2cfddf193233fcceb8e27eb3b3c5"} Jun 14 14:44:32.232132 ip-10-0-129-116 kubenswrapper[2546]: I0614 14:44:32.232116 2546 scope.go:117] "RemoveContainer" containerID="7ebc267c6144189a54bb014acb5a93a2237f2cfddf193233fcceb8e27eb3b3c5" Jun 14 14:44:33.237402 ip-10-0-129-116 kubenswrapper[2546]: I0614 14:44:33.237357 2546 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca-operator/service-ca-operator-7ccbfd59dc-z2rs6" event={"ID":"fe19844a-27c5-471a-b03d-867b9eb90582","Type":"ContainerStarted","Data":"d14708d6908fc90e1c4b262e0d613266012e71cf03d363d404e6672af0ee8214"} Jun 14 14:44:33.513231 ip-10-0-129-116 kubenswrapper[2546]: I0614 14:44:33.513137 2546 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c96gx_105377da-c223-41ad-b033-546cb01239c4/konnectivity-agent/0.log" limit=1024 Jun 14 14:44:33.562447 ip-10-0-129-116 kubenswrapper[2546]: I0614 14:44:33.562415 2546 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c96gx_105377da-c223-41ad-b033-546cb01239c4/konnectivity-agent/0.log" limit=1024 Jun 14 14:44:34.353474 ip-10-0-129-116 kubenswrapper[2546]: I0614 14:44:34.353441 2546 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c96gx_105377da-c223-41ad-b033-546cb01239c4/konnectivity-agent/0.log" limit=1024 Jun 14 14:44:34.454443 ip-10-0-129-116 kubenswrapper[2546]: I0614 14:44:34.454412 2546 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c96gx_105377da-c223-41ad-b033-546cb01239c4/konnectivity-agent/0.log" limit=1024 Jun 14 14:44:37.989434 ip-10-0-129-116 kubenswrapper[2546]: I0614 14:44:37.989406 2546 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c96gx_105377da-c223-41ad-b033-546cb01239c4/konnectivity-agent/0.log" limit=1024 Jun 14 14:44:38.092902 ip-10-0-129-116 kubenswrapper[2546]: I0614 14:44:38.092869 2546 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c96gx_105377da-c223-41ad-b033-546cb01239c4/konnectivity-agent/0.log" limit=1024 Jun 14 14:44:39.275668 ip-10-0-129-116 kubenswrapper[2546]: I0614 14:44:39.275630 2546 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c96gx_105377da-c223-41ad-b033-546cb01239c4/konnectivity-agent/0.log" limit=1024 Jun 14 14:44:39.379904 ip-10-0-129-116 kubenswrapper[2546]: I0614 14:44:39.379873 2546 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c96gx_105377da-c223-41ad-b033-546cb01239c4/konnectivity-agent/0.log" limit=1024 Jun 14 14:44:40.565054 ip-10-0-129-116 kubenswrapper[2546]: I0614 14:44:40.565027 2546 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_image-registry-6b9bcff985-7lnrc_5a64bb81-61bc-42a1-bd11-55786121b7d8/registry/0.log" Jun 14 14:44:40.773999 ip-10-0-129-116 kubenswrapper[2546]: I0614 14:44:40.773949 2546 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-dshlf_4df84aa4-08f2-487d-a8fb-fa2fe8144da8/node-ca/0.log" Jun 14 14:44:41.374209 ip-10-0-129-116 kubenswrapper[2546]: I0614 14:44:41.374178 2546 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_router-default-5f9f5d888-dlm5r_14fb6e1b-853d-4107-b6b6-22d47cb7619c/router/0.log" Jun 14 14:44:41.973042 ip-10-0-129-116 kubenswrapper[2546]: I0614 14:44:41.973010 2546 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-svjhc_7ac15fa8-5937-48af-af72-d0fb83eecda2/serve-healthcheck-canary/0.log" Jun 14 14:44:48.278332 ip-10-0-129-116 kubenswrapper[2546]: I0614 14:44:48.278296 2546 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c96gx_105377da-c223-41ad-b033-546cb01239c4/konnectivity-agent/0.log" limit=1024 Jun 14 14:44:48.325971 ip-10-0-129-116 kubenswrapper[2546]: I0614 14:44:48.325939 2546 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c96gx_105377da-c223-41ad-b033-546cb01239c4/konnectivity-agent/0.log" limit=1024 Jun 14 14:44:48.513751 ip-10-0-129-116 kubenswrapper[2546]: I0614 14:44:48.513718 2546 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c96gx_105377da-c223-41ad-b033-546cb01239c4/konnectivity-agent/0.log" limit=1024 Jun 14 14:44:48.563087 ip-10-0-129-116 kubenswrapper[2546]: I0614 14:44:48.563005 2546 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c96gx_105377da-c223-41ad-b033-546cb01239c4/konnectivity-agent/0.log" limit=1024 Jun 14 14:44:52.861727 ip-10-0-129-116 kubenswrapper[2546]: I0614 14:44:52.861663 2546 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-console/console-789fc86fd-22zg7" podUID="3f17eeaf-7d14-4180-8337-38dba0a40792" containerName="console" containerID="cri-o://adf8e286e95c808f4a57dab2a7e20500bbbd87dae40d5b61545ff7d738ca17bc" gracePeriod=15 Jun 14 14:44:53.132435 ip-10-0-129-116 kubenswrapper[2546]: I0614 14:44:53.132410 2546 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-789fc86fd-22zg7" Jun 14 14:44:53.152788 ip-10-0-129-116 kubenswrapper[2546]: I0614 14:44:53.151910 2546 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-s8g9f\" (UniqueName: \"kubernetes.io/projected/3f17eeaf-7d14-4180-8337-38dba0a40792-kube-api-access-s8g9f\") pod \"3f17eeaf-7d14-4180-8337-38dba0a40792\" (UID: \"3f17eeaf-7d14-4180-8337-38dba0a40792\") " Jun 14 14:44:53.152788 ip-10-0-129-116 kubenswrapper[2546]: I0614 14:44:53.151969 2546 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/3f17eeaf-7d14-4180-8337-38dba0a40792-console-oauth-config\") pod \"3f17eeaf-7d14-4180-8337-38dba0a40792\" (UID: \"3f17eeaf-7d14-4180-8337-38dba0a40792\") " Jun 14 14:44:53.152788 ip-10-0-129-116 kubenswrapper[2546]: I0614 14:44:53.152011 2546 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/3f17eeaf-7d14-4180-8337-38dba0a40792-service-ca\") pod \"3f17eeaf-7d14-4180-8337-38dba0a40792\" (UID: \"3f17eeaf-7d14-4180-8337-38dba0a40792\") " Jun 14 14:44:53.152788 ip-10-0-129-116 kubenswrapper[2546]: I0614 14:44:53.152040 2546 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/3f17eeaf-7d14-4180-8337-38dba0a40792-console-config\") pod \"3f17eeaf-7d14-4180-8337-38dba0a40792\" (UID: \"3f17eeaf-7d14-4180-8337-38dba0a40792\") " Jun 14 14:44:53.152788 ip-10-0-129-116 kubenswrapper[2546]: I0614 14:44:53.152085 2546 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/3f17eeaf-7d14-4180-8337-38dba0a40792-oauth-serving-cert\") pod \"3f17eeaf-7d14-4180-8337-38dba0a40792\" (UID: \"3f17eeaf-7d14-4180-8337-38dba0a40792\") " Jun 14 14:44:53.152788 ip-10-0-129-116 kubenswrapper[2546]: I0614 14:44:53.152183 2546 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/3f17eeaf-7d14-4180-8337-38dba0a40792-trusted-ca-bundle\") pod \"3f17eeaf-7d14-4180-8337-38dba0a40792\" (UID: \"3f17eeaf-7d14-4180-8337-38dba0a40792\") " Jun 14 14:44:53.152788 ip-10-0-129-116 kubenswrapper[2546]: I0614 14:44:53.152215 2546 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/3f17eeaf-7d14-4180-8337-38dba0a40792-console-serving-cert\") pod \"3f17eeaf-7d14-4180-8337-38dba0a40792\" (UID: \"3f17eeaf-7d14-4180-8337-38dba0a40792\") " Jun 14 14:44:53.154950 ip-10-0-129-116 kubenswrapper[2546]: I0614 14:44:53.154378 2546 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/3f17eeaf-7d14-4180-8337-38dba0a40792-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "3f17eeaf-7d14-4180-8337-38dba0a40792" (UID: "3f17eeaf-7d14-4180-8337-38dba0a40792"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 14 14:44:53.154950 ip-10-0-129-116 kubenswrapper[2546]: I0614 14:44:53.154622 2546 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/3f17eeaf-7d14-4180-8337-38dba0a40792-console-config" (OuterVolumeSpecName: "console-config") pod "3f17eeaf-7d14-4180-8337-38dba0a40792" (UID: "3f17eeaf-7d14-4180-8337-38dba0a40792"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 14 14:44:53.154950 ip-10-0-129-116 kubenswrapper[2546]: I0614 14:44:53.154908 2546 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/3f17eeaf-7d14-4180-8337-38dba0a40792-trusted-ca-bundle" (OuterVolumeSpecName: "trusted-ca-bundle") pod "3f17eeaf-7d14-4180-8337-38dba0a40792" (UID: "3f17eeaf-7d14-4180-8337-38dba0a40792"). InnerVolumeSpecName "trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 14 14:44:53.155195 ip-10-0-129-116 kubenswrapper[2546]: I0614 14:44:53.155148 2546 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/3f17eeaf-7d14-4180-8337-38dba0a40792-service-ca" (OuterVolumeSpecName: "service-ca") pod "3f17eeaf-7d14-4180-8337-38dba0a40792" (UID: "3f17eeaf-7d14-4180-8337-38dba0a40792"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 14 14:44:53.160020 ip-10-0-129-116 kubenswrapper[2546]: I0614 14:44:53.159975 2546 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/3f17eeaf-7d14-4180-8337-38dba0a40792-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "3f17eeaf-7d14-4180-8337-38dba0a40792" (UID: "3f17eeaf-7d14-4180-8337-38dba0a40792"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 14 14:44:53.160541 ip-10-0-129-116 kubenswrapper[2546]: I0614 14:44:53.160508 2546 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/3f17eeaf-7d14-4180-8337-38dba0a40792-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "3f17eeaf-7d14-4180-8337-38dba0a40792" (UID: "3f17eeaf-7d14-4180-8337-38dba0a40792"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 14 14:44:53.161084 ip-10-0-129-116 kubenswrapper[2546]: I0614 14:44:53.161043 2546 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/3f17eeaf-7d14-4180-8337-38dba0a40792-kube-api-access-s8g9f" (OuterVolumeSpecName: "kube-api-access-s8g9f") pod "3f17eeaf-7d14-4180-8337-38dba0a40792" (UID: "3f17eeaf-7d14-4180-8337-38dba0a40792"). InnerVolumeSpecName "kube-api-access-s8g9f". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 14 14:44:53.253693 ip-10-0-129-116 kubenswrapper[2546]: I0614 14:44:53.253660 2546 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/3f17eeaf-7d14-4180-8337-38dba0a40792-console-oauth-config\") on node \"ip-10-0-129-116.ec2.internal\" DevicePath \"\"" Jun 14 14:44:53.253693 ip-10-0-129-116 kubenswrapper[2546]: I0614 14:44:53.253694 2546 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/3f17eeaf-7d14-4180-8337-38dba0a40792-service-ca\") on node \"ip-10-0-129-116.ec2.internal\" DevicePath \"\"" Jun 14 14:44:53.253874 ip-10-0-129-116 kubenswrapper[2546]: I0614 14:44:53.253707 2546 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/3f17eeaf-7d14-4180-8337-38dba0a40792-console-config\") on node \"ip-10-0-129-116.ec2.internal\" DevicePath \"\"" Jun 14 14:44:53.253874 ip-10-0-129-116 kubenswrapper[2546]: I0614 14:44:53.253719 2546 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/3f17eeaf-7d14-4180-8337-38dba0a40792-oauth-serving-cert\") on node \"ip-10-0-129-116.ec2.internal\" DevicePath \"\"" Jun 14 14:44:53.253874 ip-10-0-129-116 kubenswrapper[2546]: I0614 14:44:53.253731 2546 reconciler_common.go:299] "Volume detached for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/3f17eeaf-7d14-4180-8337-38dba0a40792-trusted-ca-bundle\") on node \"ip-10-0-129-116.ec2.internal\" DevicePath \"\"" Jun 14 14:44:53.253874 ip-10-0-129-116 kubenswrapper[2546]: I0614 14:44:53.253743 2546 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/3f17eeaf-7d14-4180-8337-38dba0a40792-console-serving-cert\") on node \"ip-10-0-129-116.ec2.internal\" DevicePath \"\"" Jun 14 14:44:53.253874 ip-10-0-129-116 kubenswrapper[2546]: I0614 14:44:53.253757 2546 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-s8g9f\" (UniqueName: \"kubernetes.io/projected/3f17eeaf-7d14-4180-8337-38dba0a40792-kube-api-access-s8g9f\") on node \"ip-10-0-129-116.ec2.internal\" DevicePath \"\"" Jun 14 14:44:53.317172 ip-10-0-129-116 kubenswrapper[2546]: I0614 14:44:53.316276 2546 generic.go:356] "Generic (PLEG): container finished" podID="3f17eeaf-7d14-4180-8337-38dba0a40792" containerID="adf8e286e95c808f4a57dab2a7e20500bbbd87dae40d5b61545ff7d738ca17bc" exitCode=0 Jun 14 14:44:53.317172 ip-10-0-129-116 kubenswrapper[2546]: I0614 14:44:53.316351 2546 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-789fc86fd-22zg7" event={"ID":"3f17eeaf-7d14-4180-8337-38dba0a40792","Type":"ContainerDied","Data":"adf8e286e95c808f4a57dab2a7e20500bbbd87dae40d5b61545ff7d738ca17bc"} Jun 14 14:44:53.317172 ip-10-0-129-116 kubenswrapper[2546]: I0614 14:44:53.316405 2546 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-789fc86fd-22zg7" event={"ID":"3f17eeaf-7d14-4180-8337-38dba0a40792","Type":"ContainerDied","Data":"027d1fd1dd0ab2adf81b740c03a646810b064f09779052a926ea555816dade03"} Jun 14 14:44:53.317172 ip-10-0-129-116 kubenswrapper[2546]: I0614 14:44:53.316434 2546 scope.go:117] "RemoveContainer" containerID="adf8e286e95c808f4a57dab2a7e20500bbbd87dae40d5b61545ff7d738ca17bc" Jun 14 14:44:53.317172 ip-10-0-129-116 kubenswrapper[2546]: I0614 14:44:53.316616 2546 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-789fc86fd-22zg7" Jun 14 14:44:53.335041 ip-10-0-129-116 kubenswrapper[2546]: I0614 14:44:53.335011 2546 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-789fc86fd-22zg7"] Jun 14 14:44:53.335789 ip-10-0-129-116 kubenswrapper[2546]: I0614 14:44:53.335771 2546 scope.go:117] "RemoveContainer" containerID="adf8e286e95c808f4a57dab2a7e20500bbbd87dae40d5b61545ff7d738ca17bc" Jun 14 14:44:53.336232 ip-10-0-129-116 kubenswrapper[2546]: E0614 14:44:53.336199 2546 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"adf8e286e95c808f4a57dab2a7e20500bbbd87dae40d5b61545ff7d738ca17bc\": container with ID starting with adf8e286e95c808f4a57dab2a7e20500bbbd87dae40d5b61545ff7d738ca17bc not found: ID does not exist" containerID="adf8e286e95c808f4a57dab2a7e20500bbbd87dae40d5b61545ff7d738ca17bc" Jun 14 14:44:53.336345 ip-10-0-129-116 kubenswrapper[2546]: I0614 14:44:53.336250 2546 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"adf8e286e95c808f4a57dab2a7e20500bbbd87dae40d5b61545ff7d738ca17bc"} err="failed to get container status \"adf8e286e95c808f4a57dab2a7e20500bbbd87dae40d5b61545ff7d738ca17bc\": rpc error: code = NotFound desc = could not find container \"adf8e286e95c808f4a57dab2a7e20500bbbd87dae40d5b61545ff7d738ca17bc\": container with ID starting with adf8e286e95c808f4a57dab2a7e20500bbbd87dae40d5b61545ff7d738ca17bc not found: ID does not exist" Jun 14 14:44:53.338409 ip-10-0-129-116 kubenswrapper[2546]: I0614 14:44:53.338384 2546 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-789fc86fd-22zg7"] Jun 14 14:44:55.189454 ip-10-0-129-116 kubenswrapper[2546]: I0614 14:44:55.189421 2546 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="3f17eeaf-7d14-4180-8337-38dba0a40792" path="/var/lib/kubelet/pods/3f17eeaf-7d14-4180-8337-38dba0a40792/volumes" Jun 14 14:44:56.286285 ip-10-0-129-116 kubenswrapper[2546]: I0614 14:44:56.286242 2546 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-image-registry/image-registry-6b9bcff985-7lnrc" podUID="5a64bb81-61bc-42a1-bd11-55786121b7d8" containerName="registry" containerID="cri-o://f4e1a3d27e1aca55279ae5c17dee586183dca63db2ad2161ad7bcc34d30ddb0c" gracePeriod=30 Jun 14 14:44:57.539720 ip-10-0-129-116 kubenswrapper[2546]: I0614 14:44:57.539692 2546 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-6b9bcff985-7lnrc" Jun 14 14:44:57.586654 ip-10-0-129-116 kubenswrapper[2546]: I0614 14:44:57.586628 2546 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/5a64bb81-61bc-42a1-bd11-55786121b7d8-installation-pull-secrets\") pod \"5a64bb81-61bc-42a1-bd11-55786121b7d8\" (UID: \"5a64bb81-61bc-42a1-bd11-55786121b7d8\") " Jun 14 14:44:57.586816 ip-10-0-129-116 kubenswrapper[2546]: I0614 14:44:57.586701 2546 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-xwvr9\" (UniqueName: \"kubernetes.io/projected/5a64bb81-61bc-42a1-bd11-55786121b7d8-kube-api-access-xwvr9\") pod \"5a64bb81-61bc-42a1-bd11-55786121b7d8\" (UID: \"5a64bb81-61bc-42a1-bd11-55786121b7d8\") " Jun 14 14:44:57.586816 ip-10-0-129-116 kubenswrapper[2546]: I0614 14:44:57.586747 2546 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/5a64bb81-61bc-42a1-bd11-55786121b7d8-ca-trust-extracted\") pod \"5a64bb81-61bc-42a1-bd11-55786121b7d8\" (UID: \"5a64bb81-61bc-42a1-bd11-55786121b7d8\") " Jun 14 14:44:57.586816 ip-10-0-129-116 kubenswrapper[2546]: I0614 14:44:57.586780 2546 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/5a64bb81-61bc-42a1-bd11-55786121b7d8-bound-sa-token\") pod \"5a64bb81-61bc-42a1-bd11-55786121b7d8\" (UID: \"5a64bb81-61bc-42a1-bd11-55786121b7d8\") " Jun 14 14:44:57.586932 ip-10-0-129-116 kubenswrapper[2546]: I0614 14:44:57.586824 2546 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/5a64bb81-61bc-42a1-bd11-55786121b7d8-registry-certificates\") pod \"5a64bb81-61bc-42a1-bd11-55786121b7d8\" (UID: \"5a64bb81-61bc-42a1-bd11-55786121b7d8\") " Jun 14 14:44:57.586932 ip-10-0-129-116 kubenswrapper[2546]: I0614 14:44:57.586849 2546 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/5a64bb81-61bc-42a1-bd11-55786121b7d8-registry-tls\") pod \"5a64bb81-61bc-42a1-bd11-55786121b7d8\" (UID: \"5a64bb81-61bc-42a1-bd11-55786121b7d8\") " Jun 14 14:44:57.586932 ip-10-0-129-116 kubenswrapper[2546]: I0614 14:44:57.586918 2546 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/5a64bb81-61bc-42a1-bd11-55786121b7d8-image-registry-private-configuration\") pod \"5a64bb81-61bc-42a1-bd11-55786121b7d8\" (UID: \"5a64bb81-61bc-42a1-bd11-55786121b7d8\") " Jun 14 14:44:57.587080 ip-10-0-129-116 kubenswrapper[2546]: I0614 14:44:57.586954 2546 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/5a64bb81-61bc-42a1-bd11-55786121b7d8-trusted-ca\") pod \"5a64bb81-61bc-42a1-bd11-55786121b7d8\" (UID: \"5a64bb81-61bc-42a1-bd11-55786121b7d8\") " Jun 14 14:44:57.587895 ip-10-0-129-116 kubenswrapper[2546]: I0614 14:44:57.587630 2546 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/5a64bb81-61bc-42a1-bd11-55786121b7d8-trusted-ca" (OuterVolumeSpecName: "trusted-ca") pod "5a64bb81-61bc-42a1-bd11-55786121b7d8" (UID: "5a64bb81-61bc-42a1-bd11-55786121b7d8"). InnerVolumeSpecName "trusted-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 14 14:44:57.587895 ip-10-0-129-116 kubenswrapper[2546]: I0614 14:44:57.587850 2546 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/5a64bb81-61bc-42a1-bd11-55786121b7d8-registry-certificates" (OuterVolumeSpecName: "registry-certificates") pod "5a64bb81-61bc-42a1-bd11-55786121b7d8" (UID: "5a64bb81-61bc-42a1-bd11-55786121b7d8"). InnerVolumeSpecName "registry-certificates". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 14 14:44:57.589624 ip-10-0-129-116 kubenswrapper[2546]: I0614 14:44:57.589531 2546 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/5a64bb81-61bc-42a1-bd11-55786121b7d8-kube-api-access-xwvr9" (OuterVolumeSpecName: "kube-api-access-xwvr9") pod "5a64bb81-61bc-42a1-bd11-55786121b7d8" (UID: "5a64bb81-61bc-42a1-bd11-55786121b7d8"). InnerVolumeSpecName "kube-api-access-xwvr9". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 14 14:44:57.589624 ip-10-0-129-116 kubenswrapper[2546]: I0614 14:44:57.589541 2546 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/5a64bb81-61bc-42a1-bd11-55786121b7d8-installation-pull-secrets" (OuterVolumeSpecName: "installation-pull-secrets") pod "5a64bb81-61bc-42a1-bd11-55786121b7d8" (UID: "5a64bb81-61bc-42a1-bd11-55786121b7d8"). InnerVolumeSpecName "installation-pull-secrets". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 14 14:44:57.589823 ip-10-0-129-116 kubenswrapper[2546]: I0614 14:44:57.589719 2546 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/5a64bb81-61bc-42a1-bd11-55786121b7d8-bound-sa-token" (OuterVolumeSpecName: "bound-sa-token") pod "5a64bb81-61bc-42a1-bd11-55786121b7d8" (UID: "5a64bb81-61bc-42a1-bd11-55786121b7d8"). InnerVolumeSpecName "bound-sa-token". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 14 14:44:57.589823 ip-10-0-129-116 kubenswrapper[2546]: I0614 14:44:57.589743 2546 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/5a64bb81-61bc-42a1-bd11-55786121b7d8-registry-tls" (OuterVolumeSpecName: "registry-tls") pod "5a64bb81-61bc-42a1-bd11-55786121b7d8" (UID: "5a64bb81-61bc-42a1-bd11-55786121b7d8"). InnerVolumeSpecName "registry-tls". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 14 14:44:57.590203 ip-10-0-129-116 kubenswrapper[2546]: I0614 14:44:57.590178 2546 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/5a64bb81-61bc-42a1-bd11-55786121b7d8-image-registry-private-configuration" (OuterVolumeSpecName: "image-registry-private-configuration") pod "5a64bb81-61bc-42a1-bd11-55786121b7d8" (UID: "5a64bb81-61bc-42a1-bd11-55786121b7d8"). InnerVolumeSpecName "image-registry-private-configuration". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 14 14:44:57.595626 ip-10-0-129-116 kubenswrapper[2546]: I0614 14:44:57.595601 2546 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/5a64bb81-61bc-42a1-bd11-55786121b7d8-ca-trust-extracted" (OuterVolumeSpecName: "ca-trust-extracted") pod "5a64bb81-61bc-42a1-bd11-55786121b7d8" (UID: "5a64bb81-61bc-42a1-bd11-55786121b7d8"). InnerVolumeSpecName "ca-trust-extracted". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 14 14:44:57.688346 ip-10-0-129-116 kubenswrapper[2546]: I0614 14:44:57.688314 2546 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-xwvr9\" (UniqueName: \"kubernetes.io/projected/5a64bb81-61bc-42a1-bd11-55786121b7d8-kube-api-access-xwvr9\") on node \"ip-10-0-129-116.ec2.internal\" DevicePath \"\"" Jun 14 14:44:57.688346 ip-10-0-129-116 kubenswrapper[2546]: I0614 14:44:57.688339 2546 reconciler_common.go:299] "Volume detached for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/5a64bb81-61bc-42a1-bd11-55786121b7d8-ca-trust-extracted\") on node \"ip-10-0-129-116.ec2.internal\" DevicePath \"\"" Jun 14 14:44:57.688346 ip-10-0-129-116 kubenswrapper[2546]: I0614 14:44:57.688348 2546 reconciler_common.go:299] "Volume detached for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/5a64bb81-61bc-42a1-bd11-55786121b7d8-bound-sa-token\") on node \"ip-10-0-129-116.ec2.internal\" DevicePath \"\"" Jun 14 14:44:57.688547 ip-10-0-129-116 kubenswrapper[2546]: I0614 14:44:57.688356 2546 reconciler_common.go:299] "Volume detached for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/5a64bb81-61bc-42a1-bd11-55786121b7d8-registry-certificates\") on node \"ip-10-0-129-116.ec2.internal\" DevicePath \"\"" Jun 14 14:44:57.688547 ip-10-0-129-116 kubenswrapper[2546]: I0614 14:44:57.688365 2546 reconciler_common.go:299] "Volume detached for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/5a64bb81-61bc-42a1-bd11-55786121b7d8-registry-tls\") on node \"ip-10-0-129-116.ec2.internal\" DevicePath \"\"" Jun 14 14:44:57.688547 ip-10-0-129-116 kubenswrapper[2546]: I0614 14:44:57.688374 2546 reconciler_common.go:299] "Volume detached for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/5a64bb81-61bc-42a1-bd11-55786121b7d8-image-registry-private-configuration\") on node \"ip-10-0-129-116.ec2.internal\" DevicePath \"\"" Jun 14 14:44:57.688547 ip-10-0-129-116 kubenswrapper[2546]: I0614 14:44:57.688383 2546 reconciler_common.go:299] "Volume detached for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/5a64bb81-61bc-42a1-bd11-55786121b7d8-trusted-ca\") on node \"ip-10-0-129-116.ec2.internal\" DevicePath \"\"" Jun 14 14:44:57.688547 ip-10-0-129-116 kubenswrapper[2546]: I0614 14:44:57.688391 2546 reconciler_common.go:299] "Volume detached for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/5a64bb81-61bc-42a1-bd11-55786121b7d8-installation-pull-secrets\") on node \"ip-10-0-129-116.ec2.internal\" DevicePath \"\"" Jun 14 14:44:57.697671 ip-10-0-129-116 kubenswrapper[2546]: I0614 14:44:57.697641 2546 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c96gx_105377da-c223-41ad-b033-546cb01239c4/konnectivity-agent/0.log" limit=1024 Jun 14 14:44:57.798878 ip-10-0-129-116 kubenswrapper[2546]: I0614 14:44:57.798846 2546 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c96gx_105377da-c223-41ad-b033-546cb01239c4/konnectivity-agent/0.log" limit=1024 Jun 14 14:44:57.847162 ip-10-0-129-116 kubenswrapper[2546]: I0614 14:44:57.847136 2546 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c96gx_105377da-c223-41ad-b033-546cb01239c4/konnectivity-agent/0.log" limit=1024 Jun 14 14:44:58.336561 ip-10-0-129-116 kubenswrapper[2546]: I0614 14:44:58.336530 2546 generic.go:356] "Generic (PLEG): container finished" podID="5a64bb81-61bc-42a1-bd11-55786121b7d8" containerID="f4e1a3d27e1aca55279ae5c17dee586183dca63db2ad2161ad7bcc34d30ddb0c" exitCode=0 Jun 14 14:44:58.336731 ip-10-0-129-116 kubenswrapper[2546]: I0614 14:44:58.336572 2546 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-6b9bcff985-7lnrc" Jun 14 14:44:58.336731 ip-10-0-129-116 kubenswrapper[2546]: I0614 14:44:58.336578 2546 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-6b9bcff985-7lnrc" event={"ID":"5a64bb81-61bc-42a1-bd11-55786121b7d8","Type":"ContainerDied","Data":"f4e1a3d27e1aca55279ae5c17dee586183dca63db2ad2161ad7bcc34d30ddb0c"} Jun 14 14:44:58.336731 ip-10-0-129-116 kubenswrapper[2546]: I0614 14:44:58.336618 2546 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-6b9bcff985-7lnrc" event={"ID":"5a64bb81-61bc-42a1-bd11-55786121b7d8","Type":"ContainerDied","Data":"f4b79de2f35b587aaad30ee74f896d17f70407f2d152998b472aa03854dd41d4"} Jun 14 14:44:58.336731 ip-10-0-129-116 kubenswrapper[2546]: I0614 14:44:58.336636 2546 scope.go:117] "RemoveContainer" containerID="f4e1a3d27e1aca55279ae5c17dee586183dca63db2ad2161ad7bcc34d30ddb0c" Jun 14 14:44:58.345506 ip-10-0-129-116 kubenswrapper[2546]: I0614 14:44:58.345490 2546 scope.go:117] "RemoveContainer" containerID="f4e1a3d27e1aca55279ae5c17dee586183dca63db2ad2161ad7bcc34d30ddb0c" Jun 14 14:44:58.345753 ip-10-0-129-116 kubenswrapper[2546]: E0614 14:44:58.345734 2546 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"f4e1a3d27e1aca55279ae5c17dee586183dca63db2ad2161ad7bcc34d30ddb0c\": container with ID starting with f4e1a3d27e1aca55279ae5c17dee586183dca63db2ad2161ad7bcc34d30ddb0c not found: ID does not exist" containerID="f4e1a3d27e1aca55279ae5c17dee586183dca63db2ad2161ad7bcc34d30ddb0c" Jun 14 14:44:58.345807 ip-10-0-129-116 kubenswrapper[2546]: I0614 14:44:58.345763 2546 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"f4e1a3d27e1aca55279ae5c17dee586183dca63db2ad2161ad7bcc34d30ddb0c"} err="failed to get container status \"f4e1a3d27e1aca55279ae5c17dee586183dca63db2ad2161ad7bcc34d30ddb0c\": rpc error: code = NotFound desc = could not find container \"f4e1a3d27e1aca55279ae5c17dee586183dca63db2ad2161ad7bcc34d30ddb0c\": container with ID starting with f4e1a3d27e1aca55279ae5c17dee586183dca63db2ad2161ad7bcc34d30ddb0c not found: ID does not exist" Jun 14 14:44:58.357341 ip-10-0-129-116 kubenswrapper[2546]: I0614 14:44:58.357317 2546 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-image-registry/image-registry-6b9bcff985-7lnrc"] Jun 14 14:44:58.364886 ip-10-0-129-116 kubenswrapper[2546]: I0614 14:44:58.364853 2546 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-image-registry/image-registry-6b9bcff985-7lnrc"] Jun 14 14:44:59.007932 ip-10-0-129-116 kubenswrapper[2546]: I0614 14:44:59.007892 2546 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c96gx_105377da-c223-41ad-b033-546cb01239c4/konnectivity-agent/0.log" limit=1024 Jun 14 14:44:59.054767 ip-10-0-129-116 kubenswrapper[2546]: I0614 14:44:59.054736 2546 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c96gx_105377da-c223-41ad-b033-546cb01239c4/konnectivity-agent/0.log" limit=1024 Jun 14 14:44:59.189170 ip-10-0-129-116 kubenswrapper[2546]: I0614 14:44:59.189139 2546 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="5a64bb81-61bc-42a1-bd11-55786121b7d8" path="/var/lib/kubelet/pods/5a64bb81-61bc-42a1-bd11-55786121b7d8/volumes" Jun 14 14:45:02.126405 ip-10-0-129-116 kubenswrapper[2546]: I0614 14:45:02.126365 2546 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c96gx_105377da-c223-41ad-b033-546cb01239c4/konnectivity-agent/0.log" limit=1024 Jun 14 14:45:02.175073 ip-10-0-129-116 kubenswrapper[2546]: I0614 14:45:02.175033 2546 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c96gx_105377da-c223-41ad-b033-546cb01239c4/konnectivity-agent/0.log" limit=1024 Jun 14 14:45:03.510584 ip-10-0-129-116 kubenswrapper[2546]: I0614 14:45:03.510544 2546 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c96gx_105377da-c223-41ad-b033-546cb01239c4/konnectivity-agent/0.log" limit=1024 Jun 14 14:45:03.561443 ip-10-0-129-116 kubenswrapper[2546]: I0614 14:45:03.561414 2546 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c96gx_105377da-c223-41ad-b033-546cb01239c4/konnectivity-agent/0.log" limit=1024 Jun 14 14:45:04.546390 ip-10-0-129-116 kubenswrapper[2546]: I0614 14:45:04.546357 2546 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-57765465c6-z5wh8"] Jun 14 14:45:04.546750 ip-10-0-129-116 kubenswrapper[2546]: I0614 14:45:04.546667 2546 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="3f17eeaf-7d14-4180-8337-38dba0a40792" containerName="console" Jun 14 14:45:04.546750 ip-10-0-129-116 kubenswrapper[2546]: I0614 14:45:04.546679 2546 state_mem.go:107] "Deleted CPUSet assignment" podUID="3f17eeaf-7d14-4180-8337-38dba0a40792" containerName="console" Jun 14 14:45:04.546750 ip-10-0-129-116 kubenswrapper[2546]: I0614 14:45:04.546689 2546 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="5a64bb81-61bc-42a1-bd11-55786121b7d8" containerName="registry" Jun 14 14:45:04.546750 ip-10-0-129-116 kubenswrapper[2546]: I0614 14:45:04.546694 2546 state_mem.go:107] "Deleted CPUSet assignment" podUID="5a64bb81-61bc-42a1-bd11-55786121b7d8" containerName="registry" Jun 14 14:45:04.546880 ip-10-0-129-116 kubenswrapper[2546]: I0614 14:45:04.546761 2546 memory_manager.go:368] "RemoveStaleState removing state" podUID="3f17eeaf-7d14-4180-8337-38dba0a40792" containerName="console" Jun 14 14:45:04.546880 ip-10-0-129-116 kubenswrapper[2546]: I0614 14:45:04.546769 2546 memory_manager.go:368] "RemoveStaleState removing state" podUID="5a64bb81-61bc-42a1-bd11-55786121b7d8" containerName="registry" Jun 14 14:45:04.551547 ip-10-0-129-116 kubenswrapper[2546]: I0614 14:45:04.551523 2546 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-57765465c6-z5wh8" Jun 14 14:45:04.561200 ip-10-0-129-116 kubenswrapper[2546]: I0614 14:45:04.561178 2546 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-57765465c6-z5wh8"] Jun 14 14:45:04.598584 ip-10-0-129-116 kubenswrapper[2546]: I0614 14:45:04.598549 2546 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c96gx_105377da-c223-41ad-b033-546cb01239c4/konnectivity-agent/0.log" limit=1024 Jun 14 14:45:04.642382 ip-10-0-129-116 kubenswrapper[2546]: I0614 14:45:04.642349 2546 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/a4efc7d6-8ce0-4c65-9457-f35022b3b37e-trusted-ca-bundle\") pod \"console-57765465c6-z5wh8\" (UID: \"a4efc7d6-8ce0-4c65-9457-f35022b3b37e\") " pod="openshift-console/console-57765465c6-z5wh8" Jun 14 14:45:04.642382 ip-10-0-129-116 kubenswrapper[2546]: I0614 14:45:04.642383 2546 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-kvmln\" (UniqueName: \"kubernetes.io/projected/a4efc7d6-8ce0-4c65-9457-f35022b3b37e-kube-api-access-kvmln\") pod \"console-57765465c6-z5wh8\" (UID: \"a4efc7d6-8ce0-4c65-9457-f35022b3b37e\") " pod="openshift-console/console-57765465c6-z5wh8" Jun 14 14:45:04.642564 ip-10-0-129-116 kubenswrapper[2546]: I0614 14:45:04.642412 2546 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/a4efc7d6-8ce0-4c65-9457-f35022b3b37e-service-ca\") pod \"console-57765465c6-z5wh8\" (UID: \"a4efc7d6-8ce0-4c65-9457-f35022b3b37e\") " pod="openshift-console/console-57765465c6-z5wh8" Jun 14 14:45:04.642564 ip-10-0-129-116 kubenswrapper[2546]: I0614 14:45:04.642437 2546 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/a4efc7d6-8ce0-4c65-9457-f35022b3b37e-console-config\") pod \"console-57765465c6-z5wh8\" (UID: \"a4efc7d6-8ce0-4c65-9457-f35022b3b37e\") " pod="openshift-console/console-57765465c6-z5wh8" Jun 14 14:45:04.642564 ip-10-0-129-116 kubenswrapper[2546]: I0614 14:45:04.642515 2546 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/a4efc7d6-8ce0-4c65-9457-f35022b3b37e-oauth-serving-cert\") pod \"console-57765465c6-z5wh8\" (UID: \"a4efc7d6-8ce0-4c65-9457-f35022b3b37e\") " pod="openshift-console/console-57765465c6-z5wh8" Jun 14 14:45:04.642564 ip-10-0-129-116 kubenswrapper[2546]: I0614 14:45:04.642543 2546 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/a4efc7d6-8ce0-4c65-9457-f35022b3b37e-console-serving-cert\") pod \"console-57765465c6-z5wh8\" (UID: \"a4efc7d6-8ce0-4c65-9457-f35022b3b37e\") " pod="openshift-console/console-57765465c6-z5wh8" Jun 14 14:45:04.642564 ip-10-0-129-116 kubenswrapper[2546]: I0614 14:45:04.642559 2546 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/a4efc7d6-8ce0-4c65-9457-f35022b3b37e-console-oauth-config\") pod \"console-57765465c6-z5wh8\" (UID: \"a4efc7d6-8ce0-4c65-9457-f35022b3b37e\") " pod="openshift-console/console-57765465c6-z5wh8" Jun 14 14:45:04.743407 ip-10-0-129-116 kubenswrapper[2546]: I0614 14:45:04.743371 2546 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/a4efc7d6-8ce0-4c65-9457-f35022b3b37e-oauth-serving-cert\") pod \"console-57765465c6-z5wh8\" (UID: \"a4efc7d6-8ce0-4c65-9457-f35022b3b37e\") " pod="openshift-console/console-57765465c6-z5wh8" Jun 14 14:45:04.743587 ip-10-0-129-116 kubenswrapper[2546]: I0614 14:45:04.743421 2546 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/a4efc7d6-8ce0-4c65-9457-f35022b3b37e-console-serving-cert\") pod \"console-57765465c6-z5wh8\" (UID: \"a4efc7d6-8ce0-4c65-9457-f35022b3b37e\") " pod="openshift-console/console-57765465c6-z5wh8" Jun 14 14:45:04.743587 ip-10-0-129-116 kubenswrapper[2546]: I0614 14:45:04.743445 2546 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/a4efc7d6-8ce0-4c65-9457-f35022b3b37e-console-oauth-config\") pod \"console-57765465c6-z5wh8\" (UID: \"a4efc7d6-8ce0-4c65-9457-f35022b3b37e\") " pod="openshift-console/console-57765465c6-z5wh8" Jun 14 14:45:04.743587 ip-10-0-129-116 kubenswrapper[2546]: I0614 14:45:04.743484 2546 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/a4efc7d6-8ce0-4c65-9457-f35022b3b37e-trusted-ca-bundle\") pod \"console-57765465c6-z5wh8\" (UID: \"a4efc7d6-8ce0-4c65-9457-f35022b3b37e\") " pod="openshift-console/console-57765465c6-z5wh8" Jun 14 14:45:04.743777 ip-10-0-129-116 kubenswrapper[2546]: I0614 14:45:04.743579 2546 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-kvmln\" (UniqueName: \"kubernetes.io/projected/a4efc7d6-8ce0-4c65-9457-f35022b3b37e-kube-api-access-kvmln\") pod \"console-57765465c6-z5wh8\" (UID: \"a4efc7d6-8ce0-4c65-9457-f35022b3b37e\") " pod="openshift-console/console-57765465c6-z5wh8" Jun 14 14:45:04.743777 ip-10-0-129-116 kubenswrapper[2546]: I0614 14:45:04.743656 2546 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/a4efc7d6-8ce0-4c65-9457-f35022b3b37e-service-ca\") pod \"console-57765465c6-z5wh8\" (UID: \"a4efc7d6-8ce0-4c65-9457-f35022b3b37e\") " pod="openshift-console/console-57765465c6-z5wh8" Jun 14 14:45:04.743986 ip-10-0-129-116 kubenswrapper[2546]: I0614 14:45:04.743958 2546 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/a4efc7d6-8ce0-4c65-9457-f35022b3b37e-console-config\") pod \"console-57765465c6-z5wh8\" (UID: \"a4efc7d6-8ce0-4c65-9457-f35022b3b37e\") " pod="openshift-console/console-57765465c6-z5wh8" Jun 14 14:45:04.744510 ip-10-0-129-116 kubenswrapper[2546]: I0614 14:45:04.744232 2546 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/a4efc7d6-8ce0-4c65-9457-f35022b3b37e-oauth-serving-cert\") pod \"console-57765465c6-z5wh8\" (UID: \"a4efc7d6-8ce0-4c65-9457-f35022b3b37e\") " pod="openshift-console/console-57765465c6-z5wh8" Jun 14 14:45:04.744510 ip-10-0-129-116 kubenswrapper[2546]: I0614 14:45:04.744503 2546 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/a4efc7d6-8ce0-4c65-9457-f35022b3b37e-service-ca\") pod \"console-57765465c6-z5wh8\" (UID: \"a4efc7d6-8ce0-4c65-9457-f35022b3b37e\") " pod="openshift-console/console-57765465c6-z5wh8" Jun 14 14:45:04.744699 ip-10-0-129-116 kubenswrapper[2546]: I0614 14:45:04.744487 2546 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/a4efc7d6-8ce0-4c65-9457-f35022b3b37e-trusted-ca-bundle\") pod \"console-57765465c6-z5wh8\" (UID: \"a4efc7d6-8ce0-4c65-9457-f35022b3b37e\") " pod="openshift-console/console-57765465c6-z5wh8" Jun 14 14:45:04.744699 ip-10-0-129-116 kubenswrapper[2546]: I0614 14:45:04.744485 2546 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c96gx_105377da-c223-41ad-b033-546cb01239c4/konnectivity-agent/0.log" limit=1024 Jun 14 14:45:04.744699 ip-10-0-129-116 kubenswrapper[2546]: I0614 14:45:04.744613 2546 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/a4efc7d6-8ce0-4c65-9457-f35022b3b37e-console-config\") pod \"console-57765465c6-z5wh8\" (UID: \"a4efc7d6-8ce0-4c65-9457-f35022b3b37e\") " pod="openshift-console/console-57765465c6-z5wh8" Jun 14 14:45:04.746410 ip-10-0-129-116 kubenswrapper[2546]: I0614 14:45:04.746390 2546 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/a4efc7d6-8ce0-4c65-9457-f35022b3b37e-console-oauth-config\") pod \"console-57765465c6-z5wh8\" (UID: \"a4efc7d6-8ce0-4c65-9457-f35022b3b37e\") " pod="openshift-console/console-57765465c6-z5wh8" Jun 14 14:45:04.746507 ip-10-0-129-116 kubenswrapper[2546]: I0614 14:45:04.746488 2546 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/a4efc7d6-8ce0-4c65-9457-f35022b3b37e-console-serving-cert\") pod \"console-57765465c6-z5wh8\" (UID: \"a4efc7d6-8ce0-4c65-9457-f35022b3b37e\") " pod="openshift-console/console-57765465c6-z5wh8" Jun 14 14:45:04.751414 ip-10-0-129-116 kubenswrapper[2546]: I0614 14:45:04.751391 2546 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-kvmln\" (UniqueName: \"kubernetes.io/projected/a4efc7d6-8ce0-4c65-9457-f35022b3b37e-kube-api-access-kvmln\") pod \"console-57765465c6-z5wh8\" (UID: \"a4efc7d6-8ce0-4c65-9457-f35022b3b37e\") " pod="openshift-console/console-57765465c6-z5wh8" Jun 14 14:45:04.794969 ip-10-0-129-116 kubenswrapper[2546]: I0614 14:45:04.794938 2546 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c96gx_105377da-c223-41ad-b033-546cb01239c4/konnectivity-agent/0.log" limit=1024 Jun 14 14:45:04.861532 ip-10-0-129-116 kubenswrapper[2546]: I0614 14:45:04.861453 2546 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-57765465c6-z5wh8" Jun 14 14:45:04.990920 ip-10-0-129-116 kubenswrapper[2546]: I0614 14:45:04.990856 2546 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-57765465c6-z5wh8"] Jun 14 14:45:04.993062 ip-10-0-129-116 kubenswrapper[2546]: W0614 14:45:04.993036 2546 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda4efc7d6_8ce0_4c65_9457_f35022b3b37e.slice/crio-2d13c2b977f1acb94988c488d73a13c0d436ec6acf3479c3987bbda2de236778 WatchSource:0}: Error finding container 2d13c2b977f1acb94988c488d73a13c0d436ec6acf3479c3987bbda2de236778: Status 404 returned error can't find the container with id 2d13c2b977f1acb94988c488d73a13c0d436ec6acf3479c3987bbda2de236778 Jun 14 14:45:05.343795 ip-10-0-129-116 kubenswrapper[2546]: I0614 14:45:05.343760 2546 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c96gx_105377da-c223-41ad-b033-546cb01239c4/konnectivity-agent/0.log" limit=1024 Jun 14 14:45:05.364584 ip-10-0-129-116 kubenswrapper[2546]: I0614 14:45:05.364548 2546 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-57765465c6-z5wh8" event={"ID":"a4efc7d6-8ce0-4c65-9457-f35022b3b37e","Type":"ContainerStarted","Data":"1dca94fd7b92bf0da6b69b0bffe189b39382df0f2f07f03ad14de1a2d32e4512"} Jun 14 14:45:05.364738 ip-10-0-129-116 kubenswrapper[2546]: I0614 14:45:05.364608 2546 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-57765465c6-z5wh8" event={"ID":"a4efc7d6-8ce0-4c65-9457-f35022b3b37e","Type":"ContainerStarted","Data":"2d13c2b977f1acb94988c488d73a13c0d436ec6acf3479c3987bbda2de236778"} Jun 14 14:45:05.380942 ip-10-0-129-116 kubenswrapper[2546]: I0614 14:45:05.380895 2546 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-57765465c6-z5wh8" podStartSLOduration=1.380879864 podStartE2EDuration="1.380879864s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-14 14:45:04 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-14 14:45:05.379939793 +0000 UTC m=+342.708321955" watchObservedRunningTime="2026-06-14 14:45:05.380879864 +0000 UTC m=+342.709261988" Jun 14 14:45:10.614781 ip-10-0-129-116 kubenswrapper[2546]: I0614 14:45:10.614692 2546 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c96gx_105377da-c223-41ad-b033-546cb01239c4/konnectivity-agent/0.log" limit=1024 Jun 14 14:45:10.700112 ip-10-0-129-116 kubenswrapper[2546]: I0614 14:45:10.700066 2546 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c96gx_105377da-c223-41ad-b033-546cb01239c4/konnectivity-agent/0.log" limit=1024 Jun 14 14:45:14.862055 ip-10-0-129-116 kubenswrapper[2546]: I0614 14:45:14.862019 2546 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-57765465c6-z5wh8" Jun 14 14:45:14.862491 ip-10-0-129-116 kubenswrapper[2546]: I0614 14:45:14.862173 2546 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-57765465c6-z5wh8" Jun 14 14:45:14.866934 ip-10-0-129-116 kubenswrapper[2546]: I0614 14:45:14.866916 2546 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-57765465c6-z5wh8" Jun 14 14:45:15.408782 ip-10-0-129-116 kubenswrapper[2546]: I0614 14:45:15.408755 2546 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-57765465c6-z5wh8" Jun 14 14:45:15.453652 ip-10-0-129-116 kubenswrapper[2546]: I0614 14:45:15.453618 2546 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-c57567cdc-dkbm2"] Jun 14 14:45:15.540696 ip-10-0-129-116 kubenswrapper[2546]: I0614 14:45:15.540651 2546 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c96gx_105377da-c223-41ad-b033-546cb01239c4/konnectivity-agent/0.log" limit=1024 Jun 14 14:45:15.591450 ip-10-0-129-116 kubenswrapper[2546]: I0614 14:45:15.591416 2546 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c96gx_105377da-c223-41ad-b033-546cb01239c4/konnectivity-agent/0.log" limit=1024 Jun 14 14:45:15.644424 ip-10-0-129-116 kubenswrapper[2546]: I0614 14:45:15.644391 2546 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c96gx_105377da-c223-41ad-b033-546cb01239c4/konnectivity-agent/0.log" limit=1024 Jun 14 14:45:15.692568 ip-10-0-129-116 kubenswrapper[2546]: I0614 14:45:15.692498 2546 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c96gx_105377da-c223-41ad-b033-546cb01239c4/konnectivity-agent/0.log" limit=1024 Jun 14 14:45:18.517202 ip-10-0-129-116 kubenswrapper[2546]: I0614 14:45:18.517165 2546 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c96gx_105377da-c223-41ad-b033-546cb01239c4/konnectivity-agent/0.log" limit=1024 Jun 14 14:45:18.616979 ip-10-0-129-116 kubenswrapper[2546]: I0614 14:45:18.616944 2546 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c96gx_105377da-c223-41ad-b033-546cb01239c4/konnectivity-agent/0.log" limit=1024 Jun 14 14:45:40.478993 ip-10-0-129-116 kubenswrapper[2546]: I0614 14:45:40.478927 2546 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-console/console-c57567cdc-dkbm2" podUID="5a961d65-1a8b-4e6c-920f-a2b166bf9daf" containerName="console" containerID="cri-o://54fc4e299385db5c973da4720d5af129f2e51972775a3963070f7fa27fef7e1e" gracePeriod=15 Jun 14 14:45:40.725926 ip-10-0-129-116 kubenswrapper[2546]: I0614 14:45:40.725896 2546 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-c57567cdc-dkbm2" Jun 14 14:45:40.740947 ip-10-0-129-116 kubenswrapper[2546]: I0614 14:45:40.740881 2546 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/5a961d65-1a8b-4e6c-920f-a2b166bf9daf-oauth-serving-cert\") pod \"5a961d65-1a8b-4e6c-920f-a2b166bf9daf\" (UID: \"5a961d65-1a8b-4e6c-920f-a2b166bf9daf\") " Jun 14 14:45:40.740947 ip-10-0-129-116 kubenswrapper[2546]: I0614 14:45:40.740918 2546 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/5a961d65-1a8b-4e6c-920f-a2b166bf9daf-console-serving-cert\") pod \"5a961d65-1a8b-4e6c-920f-a2b166bf9daf\" (UID: \"5a961d65-1a8b-4e6c-920f-a2b166bf9daf\") " Jun 14 14:45:40.741160 ip-10-0-129-116 kubenswrapper[2546]: I0614 14:45:40.740963 2546 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/5a961d65-1a8b-4e6c-920f-a2b166bf9daf-console-oauth-config\") pod \"5a961d65-1a8b-4e6c-920f-a2b166bf9daf\" (UID: \"5a961d65-1a8b-4e6c-920f-a2b166bf9daf\") " Jun 14 14:45:40.741250 ip-10-0-129-116 kubenswrapper[2546]: I0614 14:45:40.741218 2546 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/5a961d65-1a8b-4e6c-920f-a2b166bf9daf-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "5a961d65-1a8b-4e6c-920f-a2b166bf9daf" (UID: "5a961d65-1a8b-4e6c-920f-a2b166bf9daf"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 14 14:45:40.743289 ip-10-0-129-116 kubenswrapper[2546]: I0614 14:45:40.743262 2546 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/5a961d65-1a8b-4e6c-920f-a2b166bf9daf-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "5a961d65-1a8b-4e6c-920f-a2b166bf9daf" (UID: "5a961d65-1a8b-4e6c-920f-a2b166bf9daf"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 14 14:45:40.743418 ip-10-0-129-116 kubenswrapper[2546]: I0614 14:45:40.743393 2546 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/5a961d65-1a8b-4e6c-920f-a2b166bf9daf-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "5a961d65-1a8b-4e6c-920f-a2b166bf9daf" (UID: "5a961d65-1a8b-4e6c-920f-a2b166bf9daf"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 14 14:45:40.841370 ip-10-0-129-116 kubenswrapper[2546]: I0614 14:45:40.841331 2546 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-xjzd2\" (UniqueName: \"kubernetes.io/projected/5a961d65-1a8b-4e6c-920f-a2b166bf9daf-kube-api-access-xjzd2\") pod \"5a961d65-1a8b-4e6c-920f-a2b166bf9daf\" (UID: \"5a961d65-1a8b-4e6c-920f-a2b166bf9daf\") " Jun 14 14:45:40.841370 ip-10-0-129-116 kubenswrapper[2546]: I0614 14:45:40.841370 2546 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/5a961d65-1a8b-4e6c-920f-a2b166bf9daf-console-config\") pod \"5a961d65-1a8b-4e6c-920f-a2b166bf9daf\" (UID: \"5a961d65-1a8b-4e6c-920f-a2b166bf9daf\") " Jun 14 14:45:40.841611 ip-10-0-129-116 kubenswrapper[2546]: I0614 14:45:40.841391 2546 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/5a961d65-1a8b-4e6c-920f-a2b166bf9daf-trusted-ca-bundle\") pod \"5a961d65-1a8b-4e6c-920f-a2b166bf9daf\" (UID: \"5a961d65-1a8b-4e6c-920f-a2b166bf9daf\") " Jun 14 14:45:40.841611 ip-10-0-129-116 kubenswrapper[2546]: I0614 14:45:40.841415 2546 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/5a961d65-1a8b-4e6c-920f-a2b166bf9daf-service-ca\") pod \"5a961d65-1a8b-4e6c-920f-a2b166bf9daf\" (UID: \"5a961d65-1a8b-4e6c-920f-a2b166bf9daf\") " Jun 14 14:45:40.841611 ip-10-0-129-116 kubenswrapper[2546]: I0614 14:45:40.841573 2546 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/5a961d65-1a8b-4e6c-920f-a2b166bf9daf-oauth-serving-cert\") on node \"ip-10-0-129-116.ec2.internal\" DevicePath \"\"" Jun 14 14:45:40.841611 ip-10-0-129-116 kubenswrapper[2546]: I0614 14:45:40.841582 2546 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/5a961d65-1a8b-4e6c-920f-a2b166bf9daf-console-serving-cert\") on node \"ip-10-0-129-116.ec2.internal\" DevicePath \"\"" Jun 14 14:45:40.841611 ip-10-0-129-116 kubenswrapper[2546]: I0614 14:45:40.841591 2546 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/5a961d65-1a8b-4e6c-920f-a2b166bf9daf-console-oauth-config\") on node \"ip-10-0-129-116.ec2.internal\" DevicePath \"\"" Jun 14 14:45:40.841827 ip-10-0-129-116 kubenswrapper[2546]: I0614 14:45:40.841668 2546 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/5a961d65-1a8b-4e6c-920f-a2b166bf9daf-console-config" (OuterVolumeSpecName: "console-config") pod "5a961d65-1a8b-4e6c-920f-a2b166bf9daf" (UID: "5a961d65-1a8b-4e6c-920f-a2b166bf9daf"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 14 14:45:40.841827 ip-10-0-129-116 kubenswrapper[2546]: I0614 14:45:40.841764 2546 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/5a961d65-1a8b-4e6c-920f-a2b166bf9daf-trusted-ca-bundle" (OuterVolumeSpecName: "trusted-ca-bundle") pod "5a961d65-1a8b-4e6c-920f-a2b166bf9daf" (UID: "5a961d65-1a8b-4e6c-920f-a2b166bf9daf"). InnerVolumeSpecName "trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 14 14:45:40.841827 ip-10-0-129-116 kubenswrapper[2546]: I0614 14:45:40.841775 2546 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/5a961d65-1a8b-4e6c-920f-a2b166bf9daf-service-ca" (OuterVolumeSpecName: "service-ca") pod "5a961d65-1a8b-4e6c-920f-a2b166bf9daf" (UID: "5a961d65-1a8b-4e6c-920f-a2b166bf9daf"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 14 14:45:40.843459 ip-10-0-129-116 kubenswrapper[2546]: I0614 14:45:40.843436 2546 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/5a961d65-1a8b-4e6c-920f-a2b166bf9daf-kube-api-access-xjzd2" (OuterVolumeSpecName: "kube-api-access-xjzd2") pod "5a961d65-1a8b-4e6c-920f-a2b166bf9daf" (UID: "5a961d65-1a8b-4e6c-920f-a2b166bf9daf"). InnerVolumeSpecName "kube-api-access-xjzd2". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 14 14:45:40.942508 ip-10-0-129-116 kubenswrapper[2546]: I0614 14:45:40.942464 2546 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-xjzd2\" (UniqueName: \"kubernetes.io/projected/5a961d65-1a8b-4e6c-920f-a2b166bf9daf-kube-api-access-xjzd2\") on node \"ip-10-0-129-116.ec2.internal\" DevicePath \"\"" Jun 14 14:45:40.942508 ip-10-0-129-116 kubenswrapper[2546]: I0614 14:45:40.942502 2546 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/5a961d65-1a8b-4e6c-920f-a2b166bf9daf-console-config\") on node \"ip-10-0-129-116.ec2.internal\" DevicePath \"\"" Jun 14 14:45:40.942508 ip-10-0-129-116 kubenswrapper[2546]: I0614 14:45:40.942511 2546 reconciler_common.go:299] "Volume detached for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/5a961d65-1a8b-4e6c-920f-a2b166bf9daf-trusted-ca-bundle\") on node \"ip-10-0-129-116.ec2.internal\" DevicePath \"\"" Jun 14 14:45:40.942508 ip-10-0-129-116 kubenswrapper[2546]: I0614 14:45:40.942521 2546 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/5a961d65-1a8b-4e6c-920f-a2b166bf9daf-service-ca\") on node \"ip-10-0-129-116.ec2.internal\" DevicePath \"\"" Jun 14 14:45:41.498597 ip-10-0-129-116 kubenswrapper[2546]: I0614 14:45:41.498565 2546 generic.go:356] "Generic (PLEG): container finished" podID="5a961d65-1a8b-4e6c-920f-a2b166bf9daf" containerID="54fc4e299385db5c973da4720d5af129f2e51972775a3963070f7fa27fef7e1e" exitCode=0 Jun 14 14:45:41.498937 ip-10-0-129-116 kubenswrapper[2546]: I0614 14:45:41.498612 2546 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-c57567cdc-dkbm2" Jun 14 14:45:41.498937 ip-10-0-129-116 kubenswrapper[2546]: I0614 14:45:41.498631 2546 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-c57567cdc-dkbm2" event={"ID":"5a961d65-1a8b-4e6c-920f-a2b166bf9daf","Type":"ContainerDied","Data":"54fc4e299385db5c973da4720d5af129f2e51972775a3963070f7fa27fef7e1e"} Jun 14 14:45:41.498937 ip-10-0-129-116 kubenswrapper[2546]: I0614 14:45:41.498679 2546 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-c57567cdc-dkbm2" event={"ID":"5a961d65-1a8b-4e6c-920f-a2b166bf9daf","Type":"ContainerDied","Data":"f940239f2c3ca92d4e9f9d078ab69e6f343dd2467012356646a3b2c999cb72b3"} Jun 14 14:45:41.498937 ip-10-0-129-116 kubenswrapper[2546]: I0614 14:45:41.498704 2546 scope.go:117] "RemoveContainer" containerID="54fc4e299385db5c973da4720d5af129f2e51972775a3963070f7fa27fef7e1e" Jun 14 14:45:41.506929 ip-10-0-129-116 kubenswrapper[2546]: I0614 14:45:41.506911 2546 scope.go:117] "RemoveContainer" containerID="54fc4e299385db5c973da4720d5af129f2e51972775a3963070f7fa27fef7e1e" Jun 14 14:45:41.507220 ip-10-0-129-116 kubenswrapper[2546]: E0614 14:45:41.507194 2546 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"54fc4e299385db5c973da4720d5af129f2e51972775a3963070f7fa27fef7e1e\": container with ID starting with 54fc4e299385db5c973da4720d5af129f2e51972775a3963070f7fa27fef7e1e not found: ID does not exist" containerID="54fc4e299385db5c973da4720d5af129f2e51972775a3963070f7fa27fef7e1e" Jun 14 14:45:41.507279 ip-10-0-129-116 kubenswrapper[2546]: I0614 14:45:41.507222 2546 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"54fc4e299385db5c973da4720d5af129f2e51972775a3963070f7fa27fef7e1e"} err="failed to get container status \"54fc4e299385db5c973da4720d5af129f2e51972775a3963070f7fa27fef7e1e\": rpc error: code = NotFound desc = could not find container \"54fc4e299385db5c973da4720d5af129f2e51972775a3963070f7fa27fef7e1e\": container with ID starting with 54fc4e299385db5c973da4720d5af129f2e51972775a3963070f7fa27fef7e1e not found: ID does not exist" Jun 14 14:45:41.516136 ip-10-0-129-116 kubenswrapper[2546]: I0614 14:45:41.516115 2546 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-c57567cdc-dkbm2"] Jun 14 14:45:41.521867 ip-10-0-129-116 kubenswrapper[2546]: I0614 14:45:41.521836 2546 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-c57567cdc-dkbm2"] Jun 14 14:45:43.190558 ip-10-0-129-116 kubenswrapper[2546]: I0614 14:45:43.190515 2546 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="5a961d65-1a8b-4e6c-920f-a2b166bf9daf" path="/var/lib/kubelet/pods/5a961d65-1a8b-4e6c-920f-a2b166bf9daf/volumes" Jun 14 14:45:56.849361 ip-10-0-129-116 kubenswrapper[2546]: I0614 14:45:56.849326 2546 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c96gx_105377da-c223-41ad-b033-546cb01239c4/konnectivity-agent/0.log" limit=1024 Jun 14 14:46:06.274955 ip-10-0-129-116 kubenswrapper[2546]: I0614 14:46:06.274913 2546 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c96gx_105377da-c223-41ad-b033-546cb01239c4/konnectivity-agent/0.log" limit=1024 Jun 14 14:46:06.366976 ip-10-0-129-116 kubenswrapper[2546]: I0614 14:46:06.366944 2546 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c96gx_105377da-c223-41ad-b033-546cb01239c4/konnectivity-agent/0.log" limit=1024 Jun 14 14:46:06.778331 ip-10-0-129-116 kubenswrapper[2546]: I0614 14:46:06.778292 2546 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19drzmqs"] Jun 14 14:46:06.778627 ip-10-0-129-116 kubenswrapper[2546]: I0614 14:46:06.778615 2546 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="5a961d65-1a8b-4e6c-920f-a2b166bf9daf" containerName="console" Jun 14 14:46:06.778674 ip-10-0-129-116 kubenswrapper[2546]: I0614 14:46:06.778629 2546 state_mem.go:107] "Deleted CPUSet assignment" podUID="5a961d65-1a8b-4e6c-920f-a2b166bf9daf" containerName="console" Jun 14 14:46:06.778708 ip-10-0-129-116 kubenswrapper[2546]: I0614 14:46:06.778684 2546 memory_manager.go:368] "RemoveStaleState removing state" podUID="5a961d65-1a8b-4e6c-920f-a2b166bf9daf" containerName="console" Jun 14 14:46:06.781665 ip-10-0-129-116 kubenswrapper[2546]: I0614 14:46:06.781648 2546 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19drzmqs" Jun 14 14:46:06.784417 ip-10-0-129-116 kubenswrapper[2546]: I0614 14:46:06.784392 2546 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"kube-root-ca.crt\"" Jun 14 14:46:06.784561 ip-10-0-129-116 kubenswrapper[2546]: I0614 14:46:06.784455 2546 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"openshift-service-ca.crt\"" Jun 14 14:46:06.784561 ip-10-0-129-116 kubenswrapper[2546]: I0614 14:46:06.784492 2546 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-marketplace\"/\"default-dockercfg-44x46\"" Jun 14 14:46:06.789555 ip-10-0-129-116 kubenswrapper[2546]: I0614 14:46:06.789533 2546 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19drzmqs"] Jun 14 14:46:06.813337 ip-10-0-129-116 kubenswrapper[2546]: I0614 14:46:06.813305 2546 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/8e4c6fa6-f83a-45e3-8053-21f5693a0c13-bundle\") pod \"2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19drzmqs\" (UID: \"8e4c6fa6-f83a-45e3-8053-21f5693a0c13\") " pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19drzmqs" Jun 14 14:46:06.813337 ip-10-0-129-116 kubenswrapper[2546]: I0614 14:46:06.813340 2546 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/8e4c6fa6-f83a-45e3-8053-21f5693a0c13-util\") pod \"2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19drzmqs\" (UID: \"8e4c6fa6-f83a-45e3-8053-21f5693a0c13\") " pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19drzmqs" Jun 14 14:46:06.813520 ip-10-0-129-116 kubenswrapper[2546]: I0614 14:46:06.813363 2546 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qrf92\" (UniqueName: \"kubernetes.io/projected/8e4c6fa6-f83a-45e3-8053-21f5693a0c13-kube-api-access-qrf92\") pod \"2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19drzmqs\" (UID: \"8e4c6fa6-f83a-45e3-8053-21f5693a0c13\") " pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19drzmqs" Jun 14 14:46:06.914002 ip-10-0-129-116 kubenswrapper[2546]: I0614 14:46:06.913971 2546 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/8e4c6fa6-f83a-45e3-8053-21f5693a0c13-bundle\") pod \"2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19drzmqs\" (UID: \"8e4c6fa6-f83a-45e3-8053-21f5693a0c13\") " pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19drzmqs" Jun 14 14:46:06.914002 ip-10-0-129-116 kubenswrapper[2546]: I0614 14:46:06.914005 2546 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/8e4c6fa6-f83a-45e3-8053-21f5693a0c13-util\") pod \"2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19drzmqs\" (UID: \"8e4c6fa6-f83a-45e3-8053-21f5693a0c13\") " pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19drzmqs" Jun 14 14:46:06.914203 ip-10-0-129-116 kubenswrapper[2546]: I0614 14:46:06.914028 2546 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qrf92\" (UniqueName: \"kubernetes.io/projected/8e4c6fa6-f83a-45e3-8053-21f5693a0c13-kube-api-access-qrf92\") pod \"2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19drzmqs\" (UID: \"8e4c6fa6-f83a-45e3-8053-21f5693a0c13\") " pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19drzmqs" Jun 14 14:46:06.914368 ip-10-0-129-116 kubenswrapper[2546]: I0614 14:46:06.914347 2546 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/8e4c6fa6-f83a-45e3-8053-21f5693a0c13-bundle\") pod \"2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19drzmqs\" (UID: \"8e4c6fa6-f83a-45e3-8053-21f5693a0c13\") " pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19drzmqs" Jun 14 14:46:06.914453 ip-10-0-129-116 kubenswrapper[2546]: I0614 14:46:06.914437 2546 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/8e4c6fa6-f83a-45e3-8053-21f5693a0c13-util\") pod \"2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19drzmqs\" (UID: \"8e4c6fa6-f83a-45e3-8053-21f5693a0c13\") " pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19drzmqs" Jun 14 14:46:06.923326 ip-10-0-129-116 kubenswrapper[2546]: I0614 14:46:06.923297 2546 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-qrf92\" (UniqueName: \"kubernetes.io/projected/8e4c6fa6-f83a-45e3-8053-21f5693a0c13-kube-api-access-qrf92\") pod \"2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19drzmqs\" (UID: \"8e4c6fa6-f83a-45e3-8053-21f5693a0c13\") " pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19drzmqs" Jun 14 14:46:07.091219 ip-10-0-129-116 kubenswrapper[2546]: I0614 14:46:07.091139 2546 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19drzmqs" Jun 14 14:46:07.225477 ip-10-0-129-116 kubenswrapper[2546]: I0614 14:46:07.225443 2546 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19drzmqs"] Jun 14 14:46:07.228474 ip-10-0-129-116 kubenswrapper[2546]: W0614 14:46:07.228448 2546 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8e4c6fa6_f83a_45e3_8053_21f5693a0c13.slice/crio-7c77c1a8b1035bbc35bba84e3046d80977712328ccf34571919067e8951296a9 WatchSource:0}: Error finding container 7c77c1a8b1035bbc35bba84e3046d80977712328ccf34571919067e8951296a9: Status 404 returned error can't find the container with id 7c77c1a8b1035bbc35bba84e3046d80977712328ccf34571919067e8951296a9 Jun 14 14:46:07.230402 ip-10-0-129-116 kubenswrapper[2546]: I0614 14:46:07.230383 2546 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jun 14 14:46:07.595690 ip-10-0-129-116 kubenswrapper[2546]: I0614 14:46:07.595657 2546 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19drzmqs" event={"ID":"8e4c6fa6-f83a-45e3-8053-21f5693a0c13","Type":"ContainerStarted","Data":"7c77c1a8b1035bbc35bba84e3046d80977712328ccf34571919067e8951296a9"} Jun 14 14:46:10.046101 ip-10-0-129-116 kubenswrapper[2546]: I0614 14:46:10.046059 2546 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c96gx_105377da-c223-41ad-b033-546cb01239c4/konnectivity-agent/0.log" limit=1024 Jun 14 14:46:10.720172 ip-10-0-129-116 kubenswrapper[2546]: I0614 14:46:10.720141 2546 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c96gx_105377da-c223-41ad-b033-546cb01239c4/konnectivity-agent/0.log" limit=1024 Jun 14 14:46:10.768163 ip-10-0-129-116 kubenswrapper[2546]: I0614 14:46:10.768127 2546 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c96gx_105377da-c223-41ad-b033-546cb01239c4/konnectivity-agent/0.log" limit=1024 Jun 14 14:46:11.884544 ip-10-0-129-116 kubenswrapper[2546]: I0614 14:46:11.884504 2546 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c96gx_105377da-c223-41ad-b033-546cb01239c4/konnectivity-agent/0.log" limit=1024 Jun 14 14:46:11.934490 ip-10-0-129-116 kubenswrapper[2546]: I0614 14:46:11.934458 2546 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c96gx_105377da-c223-41ad-b033-546cb01239c4/konnectivity-agent/0.log" limit=1024 Jun 14 14:46:14.628206 ip-10-0-129-116 kubenswrapper[2546]: I0614 14:46:14.628171 2546 generic.go:356] "Generic (PLEG): container finished" podID="8e4c6fa6-f83a-45e3-8053-21f5693a0c13" containerID="fad4111ca787cb62aa09b70eb2f6f88608bc1ece7f250552b178f740eac4ac49" exitCode=0 Jun 14 14:46:14.628568 ip-10-0-129-116 kubenswrapper[2546]: I0614 14:46:14.628243 2546 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19drzmqs" event={"ID":"8e4c6fa6-f83a-45e3-8053-21f5693a0c13","Type":"ContainerDied","Data":"fad4111ca787cb62aa09b70eb2f6f88608bc1ece7f250552b178f740eac4ac49"} Jun 14 14:46:16.638022 ip-10-0-129-116 kubenswrapper[2546]: I0614 14:46:16.637942 2546 generic.go:356] "Generic (PLEG): container finished" podID="8e4c6fa6-f83a-45e3-8053-21f5693a0c13" containerID="506d451c9c29195d66fb8bb6dc6d9767831b0cebbb1655183eb26f9a7cbf21c8" exitCode=0 Jun 14 14:46:16.638022 ip-10-0-129-116 kubenswrapper[2546]: I0614 14:46:16.638018 2546 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19drzmqs" event={"ID":"8e4c6fa6-f83a-45e3-8053-21f5693a0c13","Type":"ContainerDied","Data":"506d451c9c29195d66fb8bb6dc6d9767831b0cebbb1655183eb26f9a7cbf21c8"} Jun 14 14:46:24.675156 ip-10-0-129-116 kubenswrapper[2546]: I0614 14:46:24.675118 2546 generic.go:356] "Generic (PLEG): container finished" podID="8e4c6fa6-f83a-45e3-8053-21f5693a0c13" containerID="817d0f06be1043471c6870083a047cfcb8a03eb10f35776a31fadc7edfbd6b96" exitCode=0 Jun 14 14:46:24.675545 ip-10-0-129-116 kubenswrapper[2546]: I0614 14:46:24.675222 2546 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19drzmqs" event={"ID":"8e4c6fa6-f83a-45e3-8053-21f5693a0c13","Type":"ContainerDied","Data":"817d0f06be1043471c6870083a047cfcb8a03eb10f35776a31fadc7edfbd6b96"} Jun 14 14:46:25.817218 ip-10-0-129-116 kubenswrapper[2546]: I0614 14:46:25.817192 2546 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19drzmqs" Jun 14 14:46:25.877384 ip-10-0-129-116 kubenswrapper[2546]: I0614 14:46:25.877347 2546 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/8e4c6fa6-f83a-45e3-8053-21f5693a0c13-util\") pod \"8e4c6fa6-f83a-45e3-8053-21f5693a0c13\" (UID: \"8e4c6fa6-f83a-45e3-8053-21f5693a0c13\") " Jun 14 14:46:25.877561 ip-10-0-129-116 kubenswrapper[2546]: I0614 14:46:25.877406 2546 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-qrf92\" (UniqueName: \"kubernetes.io/projected/8e4c6fa6-f83a-45e3-8053-21f5693a0c13-kube-api-access-qrf92\") pod \"8e4c6fa6-f83a-45e3-8053-21f5693a0c13\" (UID: \"8e4c6fa6-f83a-45e3-8053-21f5693a0c13\") " Jun 14 14:46:25.877561 ip-10-0-129-116 kubenswrapper[2546]: I0614 14:46:25.877467 2546 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/8e4c6fa6-f83a-45e3-8053-21f5693a0c13-bundle\") pod \"8e4c6fa6-f83a-45e3-8053-21f5693a0c13\" (UID: \"8e4c6fa6-f83a-45e3-8053-21f5693a0c13\") " Jun 14 14:46:25.878157 ip-10-0-129-116 kubenswrapper[2546]: I0614 14:46:25.878133 2546 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/8e4c6fa6-f83a-45e3-8053-21f5693a0c13-bundle" (OuterVolumeSpecName: "bundle") pod "8e4c6fa6-f83a-45e3-8053-21f5693a0c13" (UID: "8e4c6fa6-f83a-45e3-8053-21f5693a0c13"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 14 14:46:25.879550 ip-10-0-129-116 kubenswrapper[2546]: I0614 14:46:25.879529 2546 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/8e4c6fa6-f83a-45e3-8053-21f5693a0c13-kube-api-access-qrf92" (OuterVolumeSpecName: "kube-api-access-qrf92") pod "8e4c6fa6-f83a-45e3-8053-21f5693a0c13" (UID: "8e4c6fa6-f83a-45e3-8053-21f5693a0c13"). InnerVolumeSpecName "kube-api-access-qrf92". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 14 14:46:25.881947 ip-10-0-129-116 kubenswrapper[2546]: I0614 14:46:25.881921 2546 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/8e4c6fa6-f83a-45e3-8053-21f5693a0c13-util" (OuterVolumeSpecName: "util") pod "8e4c6fa6-f83a-45e3-8053-21f5693a0c13" (UID: "8e4c6fa6-f83a-45e3-8053-21f5693a0c13"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 14 14:46:25.978673 ip-10-0-129-116 kubenswrapper[2546]: I0614 14:46:25.978592 2546 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/8e4c6fa6-f83a-45e3-8053-21f5693a0c13-bundle\") on node \"ip-10-0-129-116.ec2.internal\" DevicePath \"\"" Jun 14 14:46:25.978673 ip-10-0-129-116 kubenswrapper[2546]: I0614 14:46:25.978619 2546 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/8e4c6fa6-f83a-45e3-8053-21f5693a0c13-util\") on node \"ip-10-0-129-116.ec2.internal\" DevicePath \"\"" Jun 14 14:46:25.978673 ip-10-0-129-116 kubenswrapper[2546]: I0614 14:46:25.978629 2546 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-qrf92\" (UniqueName: \"kubernetes.io/projected/8e4c6fa6-f83a-45e3-8053-21f5693a0c13-kube-api-access-qrf92\") on node \"ip-10-0-129-116.ec2.internal\" DevicePath \"\"" Jun 14 14:46:26.684529 ip-10-0-129-116 kubenswrapper[2546]: I0614 14:46:26.684490 2546 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19drzmqs" event={"ID":"8e4c6fa6-f83a-45e3-8053-21f5693a0c13","Type":"ContainerDied","Data":"7c77c1a8b1035bbc35bba84e3046d80977712328ccf34571919067e8951296a9"} Jun 14 14:46:26.684529 ip-10-0-129-116 kubenswrapper[2546]: I0614 14:46:26.684530 2546 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19drzmqs" Jun 14 14:46:26.684725 ip-10-0-129-116 kubenswrapper[2546]: I0614 14:46:26.684568 2546 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="7c77c1a8b1035bbc35bba84e3046d80977712328ccf34571919067e8951296a9" Jun 14 14:46:27.728357 ip-10-0-129-116 kubenswrapper[2546]: I0614 14:46:27.728325 2546 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c96gx_105377da-c223-41ad-b033-546cb01239c4/konnectivity-agent/0.log" limit=1024 Jun 14 14:46:28.553497 ip-10-0-129-116 kubenswrapper[2546]: I0614 14:46:28.553470 2546 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c96gx_105377da-c223-41ad-b033-546cb01239c4/konnectivity-agent/0.log" limit=1024 Jun 14 14:46:29.634223 ip-10-0-129-116 kubenswrapper[2546]: I0614 14:46:29.634192 2546 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["cert-manager-operator/cert-manager-operator-controller-manager-57757f7cfc-495jd"] Jun 14 14:46:29.634617 ip-10-0-129-116 kubenswrapper[2546]: I0614 14:46:29.634474 2546 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="8e4c6fa6-f83a-45e3-8053-21f5693a0c13" containerName="util" Jun 14 14:46:29.634617 ip-10-0-129-116 kubenswrapper[2546]: I0614 14:46:29.634484 2546 state_mem.go:107] "Deleted CPUSet assignment" podUID="8e4c6fa6-f83a-45e3-8053-21f5693a0c13" containerName="util" Jun 14 14:46:29.634617 ip-10-0-129-116 kubenswrapper[2546]: I0614 14:46:29.634495 2546 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="8e4c6fa6-f83a-45e3-8053-21f5693a0c13" containerName="pull" Jun 14 14:46:29.634617 ip-10-0-129-116 kubenswrapper[2546]: I0614 14:46:29.634500 2546 state_mem.go:107] "Deleted CPUSet assignment" podUID="8e4c6fa6-f83a-45e3-8053-21f5693a0c13" containerName="pull" Jun 14 14:46:29.634617 ip-10-0-129-116 kubenswrapper[2546]: I0614 14:46:29.634513 2546 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="8e4c6fa6-f83a-45e3-8053-21f5693a0c13" containerName="extract" Jun 14 14:46:29.634617 ip-10-0-129-116 kubenswrapper[2546]: I0614 14:46:29.634519 2546 state_mem.go:107] "Deleted CPUSet assignment" podUID="8e4c6fa6-f83a-45e3-8053-21f5693a0c13" containerName="extract" Jun 14 14:46:29.634617 ip-10-0-129-116 kubenswrapper[2546]: I0614 14:46:29.634567 2546 memory_manager.go:368] "RemoveStaleState removing state" podUID="8e4c6fa6-f83a-45e3-8053-21f5693a0c13" containerName="extract" Jun 14 14:46:29.681175 ip-10-0-129-116 kubenswrapper[2546]: I0614 14:46:29.681143 2546 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager-operator/cert-manager-operator-controller-manager-57757f7cfc-495jd"] Jun 14 14:46:29.681328 ip-10-0-129-116 kubenswrapper[2546]: I0614 14:46:29.681244 2546 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager-operator/cert-manager-operator-controller-manager-57757f7cfc-495jd" Jun 14 14:46:29.683838 ip-10-0-129-116 kubenswrapper[2546]: I0614 14:46:29.683813 2546 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager-operator\"/\"openshift-service-ca.crt\"" Jun 14 14:46:29.683968 ip-10-0-129-116 kubenswrapper[2546]: I0614 14:46:29.683863 2546 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"cert-manager-operator\"/\"cert-manager-operator-controller-manager-dockercfg-fnldz\"" Jun 14 14:46:29.683968 ip-10-0-129-116 kubenswrapper[2546]: I0614 14:46:29.683871 2546 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager-operator\"/\"kube-root-ca.crt\"" Jun 14 14:46:29.808112 ip-10-0-129-116 kubenswrapper[2546]: I0614 14:46:29.808064 2546 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/3c3a34d3-82f5-4c88-ae60-3c3e6ba222bf-tmp\") pod \"cert-manager-operator-controller-manager-57757f7cfc-495jd\" (UID: \"3c3a34d3-82f5-4c88-ae60-3c3e6ba222bf\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-57757f7cfc-495jd" Jun 14 14:46:29.808270 ip-10-0-129-116 kubenswrapper[2546]: I0614 14:46:29.808126 2546 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rkqnz\" (UniqueName: \"kubernetes.io/projected/3c3a34d3-82f5-4c88-ae60-3c3e6ba222bf-kube-api-access-rkqnz\") pod \"cert-manager-operator-controller-manager-57757f7cfc-495jd\" (UID: \"3c3a34d3-82f5-4c88-ae60-3c3e6ba222bf\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-57757f7cfc-495jd" Jun 14 14:46:29.908779 ip-10-0-129-116 kubenswrapper[2546]: I0614 14:46:29.908745 2546 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/3c3a34d3-82f5-4c88-ae60-3c3e6ba222bf-tmp\") pod \"cert-manager-operator-controller-manager-57757f7cfc-495jd\" (UID: \"3c3a34d3-82f5-4c88-ae60-3c3e6ba222bf\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-57757f7cfc-495jd" Jun 14 14:46:29.908919 ip-10-0-129-116 kubenswrapper[2546]: I0614 14:46:29.908783 2546 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rkqnz\" (UniqueName: \"kubernetes.io/projected/3c3a34d3-82f5-4c88-ae60-3c3e6ba222bf-kube-api-access-rkqnz\") pod \"cert-manager-operator-controller-manager-57757f7cfc-495jd\" (UID: \"3c3a34d3-82f5-4c88-ae60-3c3e6ba222bf\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-57757f7cfc-495jd" Jun 14 14:46:29.909222 ip-10-0-129-116 kubenswrapper[2546]: I0614 14:46:29.909203 2546 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/3c3a34d3-82f5-4c88-ae60-3c3e6ba222bf-tmp\") pod \"cert-manager-operator-controller-manager-57757f7cfc-495jd\" (UID: \"3c3a34d3-82f5-4c88-ae60-3c3e6ba222bf\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-57757f7cfc-495jd" Jun 14 14:46:29.917907 ip-10-0-129-116 kubenswrapper[2546]: I0614 14:46:29.917889 2546 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-rkqnz\" (UniqueName: \"kubernetes.io/projected/3c3a34d3-82f5-4c88-ae60-3c3e6ba222bf-kube-api-access-rkqnz\") pod \"cert-manager-operator-controller-manager-57757f7cfc-495jd\" (UID: \"3c3a34d3-82f5-4c88-ae60-3c3e6ba222bf\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-57757f7cfc-495jd" Jun 14 14:46:29.990340 ip-10-0-129-116 kubenswrapper[2546]: I0614 14:46:29.990312 2546 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager-operator/cert-manager-operator-controller-manager-57757f7cfc-495jd" Jun 14 14:46:30.151569 ip-10-0-129-116 kubenswrapper[2546]: I0614 14:46:30.151531 2546 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager-operator/cert-manager-operator-controller-manager-57757f7cfc-495jd"] Jun 14 14:46:30.155346 ip-10-0-129-116 kubenswrapper[2546]: W0614 14:46:30.155318 2546 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3c3a34d3_82f5_4c88_ae60_3c3e6ba222bf.slice/crio-6b8d74eedd5f79b7ea37c2207f15d0e3e793a7a113511bc702c9ca3f4b0089fd WatchSource:0}: Error finding container 6b8d74eedd5f79b7ea37c2207f15d0e3e793a7a113511bc702c9ca3f4b0089fd: Status 404 returned error can't find the container with id 6b8d74eedd5f79b7ea37c2207f15d0e3e793a7a113511bc702c9ca3f4b0089fd Jun 14 14:46:30.701581 ip-10-0-129-116 kubenswrapper[2546]: I0614 14:46:30.701546 2546 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager-operator/cert-manager-operator-controller-manager-57757f7cfc-495jd" event={"ID":"3c3a34d3-82f5-4c88-ae60-3c3e6ba222bf","Type":"ContainerStarted","Data":"6b8d74eedd5f79b7ea37c2207f15d0e3e793a7a113511bc702c9ca3f4b0089fd"} Jun 14 14:46:31.351400 ip-10-0-129-116 kubenswrapper[2546]: I0614 14:46:31.351367 2546 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c96gx_105377da-c223-41ad-b033-546cb01239c4/konnectivity-agent/0.log" limit=1024 Jun 14 14:46:31.449442 ip-10-0-129-116 kubenswrapper[2546]: I0614 14:46:31.449410 2546 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c96gx_105377da-c223-41ad-b033-546cb01239c4/konnectivity-agent/0.log" limit=1024 Jun 14 14:46:32.639206 ip-10-0-129-116 kubenswrapper[2546]: I0614 14:46:32.639161 2546 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c96gx_105377da-c223-41ad-b033-546cb01239c4/konnectivity-agent/0.log" limit=1024 Jun 14 14:46:32.711471 ip-10-0-129-116 kubenswrapper[2546]: I0614 14:46:32.711433 2546 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager-operator/cert-manager-operator-controller-manager-57757f7cfc-495jd" event={"ID":"3c3a34d3-82f5-4c88-ae60-3c3e6ba222bf","Type":"ContainerStarted","Data":"2bd88126a136f1b9917ea32491995d983acb4df1d16111395d84ca25f88b8f13"} Jun 14 14:46:32.731947 ip-10-0-129-116 kubenswrapper[2546]: I0614 14:46:32.731905 2546 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="cert-manager-operator/cert-manager-operator-controller-manager-57757f7cfc-495jd" podStartSLOduration=2.091993164 podStartE2EDuration="3.731891325s" totalImagesPullingTime="1.639898161s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-14 14:46:29 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-14 14:46:32.73043498 +0000 UTC m=+430.058817104" watchObservedRunningTime="2026-06-14 14:46:32.731891325 +0000 UTC m=+430.060273459" Jun 14 14:46:32.741629 ip-10-0-129-116 kubenswrapper[2546]: I0614 14:46:32.741601 2546 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c96gx_105377da-c223-41ad-b033-546cb01239c4/konnectivity-agent/0.log" limit=1024 Jun 14 14:46:33.142006 ip-10-0-129-116 kubenswrapper[2546]: I0614 14:46:33.141972 2546 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c96gx_105377da-c223-41ad-b033-546cb01239c4/konnectivity-agent/0.log" limit=1024 Jun 14 14:46:33.241757 ip-10-0-129-116 kubenswrapper[2546]: I0614 14:46:33.241725 2546 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c96gx_105377da-c223-41ad-b033-546cb01239c4/konnectivity-agent/0.log" limit=1024 Jun 14 14:46:33.758241 ip-10-0-129-116 kubenswrapper[2546]: I0614 14:46:33.758207 2546 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87frhn6c"] Jun 14 14:46:33.761626 ip-10-0-129-116 kubenswrapper[2546]: I0614 14:46:33.761607 2546 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87frhn6c" Jun 14 14:46:33.764351 ip-10-0-129-116 kubenswrapper[2546]: I0614 14:46:33.764328 2546 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-marketplace\"/\"default-dockercfg-44x46\"" Jun 14 14:46:33.764485 ip-10-0-129-116 kubenswrapper[2546]: I0614 14:46:33.764370 2546 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"openshift-service-ca.crt\"" Jun 14 14:46:33.764485 ip-10-0-129-116 kubenswrapper[2546]: I0614 14:46:33.764369 2546 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"kube-root-ca.crt\"" Jun 14 14:46:33.769145 ip-10-0-129-116 kubenswrapper[2546]: I0614 14:46:33.769120 2546 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87frhn6c"] Jun 14 14:46:33.844796 ip-10-0-129-116 kubenswrapper[2546]: I0614 14:46:33.844757 2546 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/d5665b8f-343f-49bc-9c36-871a3bf4b2b3-bundle\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87frhn6c\" (UID: \"d5665b8f-343f-49bc-9c36-871a3bf4b2b3\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87frhn6c" Jun 14 14:46:33.844796 ip-10-0-129-116 kubenswrapper[2546]: I0614 14:46:33.844790 2546 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7wvnk\" (UniqueName: \"kubernetes.io/projected/d5665b8f-343f-49bc-9c36-871a3bf4b2b3-kube-api-access-7wvnk\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87frhn6c\" (UID: \"d5665b8f-343f-49bc-9c36-871a3bf4b2b3\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87frhn6c" Jun 14 14:46:33.844996 ip-10-0-129-116 kubenswrapper[2546]: I0614 14:46:33.844810 2546 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/d5665b8f-343f-49bc-9c36-871a3bf4b2b3-util\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87frhn6c\" (UID: \"d5665b8f-343f-49bc-9c36-871a3bf4b2b3\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87frhn6c" Jun 14 14:46:33.946138 ip-10-0-129-116 kubenswrapper[2546]: I0614 14:46:33.946086 2546 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/d5665b8f-343f-49bc-9c36-871a3bf4b2b3-bundle\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87frhn6c\" (UID: \"d5665b8f-343f-49bc-9c36-871a3bf4b2b3\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87frhn6c" Jun 14 14:46:33.946138 ip-10-0-129-116 kubenswrapper[2546]: I0614 14:46:33.946137 2546 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7wvnk\" (UniqueName: \"kubernetes.io/projected/d5665b8f-343f-49bc-9c36-871a3bf4b2b3-kube-api-access-7wvnk\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87frhn6c\" (UID: \"d5665b8f-343f-49bc-9c36-871a3bf4b2b3\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87frhn6c" Jun 14 14:46:33.946358 ip-10-0-129-116 kubenswrapper[2546]: I0614 14:46:33.946169 2546 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/d5665b8f-343f-49bc-9c36-871a3bf4b2b3-util\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87frhn6c\" (UID: \"d5665b8f-343f-49bc-9c36-871a3bf4b2b3\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87frhn6c" Jun 14 14:46:33.946489 ip-10-0-129-116 kubenswrapper[2546]: I0614 14:46:33.946468 2546 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/d5665b8f-343f-49bc-9c36-871a3bf4b2b3-bundle\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87frhn6c\" (UID: \"d5665b8f-343f-49bc-9c36-871a3bf4b2b3\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87frhn6c" Jun 14 14:46:33.946549 ip-10-0-129-116 kubenswrapper[2546]: I0614 14:46:33.946516 2546 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/d5665b8f-343f-49bc-9c36-871a3bf4b2b3-util\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87frhn6c\" (UID: \"d5665b8f-343f-49bc-9c36-871a3bf4b2b3\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87frhn6c" Jun 14 14:46:33.955645 ip-10-0-129-116 kubenswrapper[2546]: I0614 14:46:33.955619 2546 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-7wvnk\" (UniqueName: \"kubernetes.io/projected/d5665b8f-343f-49bc-9c36-871a3bf4b2b3-kube-api-access-7wvnk\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87frhn6c\" (UID: \"d5665b8f-343f-49bc-9c36-871a3bf4b2b3\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87frhn6c" Jun 14 14:46:34.070895 ip-10-0-129-116 kubenswrapper[2546]: I0614 14:46:34.070812 2546 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87frhn6c" Jun 14 14:46:34.200599 ip-10-0-129-116 kubenswrapper[2546]: I0614 14:46:34.200443 2546 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87frhn6c"] Jun 14 14:46:34.202801 ip-10-0-129-116 kubenswrapper[2546]: W0614 14:46:34.202773 2546 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd5665b8f_343f_49bc_9c36_871a3bf4b2b3.slice/crio-f22d1a495bc1d227976d1a50df650152d7090d085ee881d13f43de939885ec5a WatchSource:0}: Error finding container f22d1a495bc1d227976d1a50df650152d7090d085ee881d13f43de939885ec5a: Status 404 returned error can't find the container with id f22d1a495bc1d227976d1a50df650152d7090d085ee881d13f43de939885ec5a Jun 14 14:46:34.721209 ip-10-0-129-116 kubenswrapper[2546]: I0614 14:46:34.721172 2546 generic.go:356] "Generic (PLEG): container finished" podID="d5665b8f-343f-49bc-9c36-871a3bf4b2b3" containerID="0618a2e79a40e43288b78f811f80b3a7ad9f266f597bd2ec9b77d0148e9c85e9" exitCode=0 Jun 14 14:46:34.721209 ip-10-0-129-116 kubenswrapper[2546]: I0614 14:46:34.721214 2546 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87frhn6c" event={"ID":"d5665b8f-343f-49bc-9c36-871a3bf4b2b3","Type":"ContainerDied","Data":"0618a2e79a40e43288b78f811f80b3a7ad9f266f597bd2ec9b77d0148e9c85e9"} Jun 14 14:46:34.721426 ip-10-0-129-116 kubenswrapper[2546]: I0614 14:46:34.721258 2546 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87frhn6c" event={"ID":"d5665b8f-343f-49bc-9c36-871a3bf4b2b3","Type":"ContainerStarted","Data":"f22d1a495bc1d227976d1a50df650152d7090d085ee881d13f43de939885ec5a"} Jun 14 14:46:35.327252 ip-10-0-129-116 kubenswrapper[2546]: I0614 14:46:35.327217 2546 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["cert-manager/cert-manager-webhook-7dc76cbb94-588gq"] Jun 14 14:46:35.330432 ip-10-0-129-116 kubenswrapper[2546]: I0614 14:46:35.330411 2546 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-webhook-7dc76cbb94-588gq" Jun 14 14:46:35.332993 ip-10-0-129-116 kubenswrapper[2546]: I0614 14:46:35.332973 2546 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager\"/\"openshift-service-ca.crt\"" Jun 14 14:46:35.334181 ip-10-0-129-116 kubenswrapper[2546]: I0614 14:46:35.334160 2546 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager\"/\"kube-root-ca.crt\"" Jun 14 14:46:35.334252 ip-10-0-129-116 kubenswrapper[2546]: I0614 14:46:35.334160 2546 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"cert-manager\"/\"cert-manager-webhook-dockercfg-r7xx8\"" Jun 14 14:46:35.337751 ip-10-0-129-116 kubenswrapper[2546]: I0614 14:46:35.337728 2546 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-webhook-7dc76cbb94-588gq"] Jun 14 14:46:35.456394 ip-10-0-129-116 kubenswrapper[2546]: I0614 14:46:35.456350 2546 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/9f5a1811-87f1-4556-b16b-9770d1295c8f-bound-sa-token\") pod \"cert-manager-webhook-7dc76cbb94-588gq\" (UID: \"9f5a1811-87f1-4556-b16b-9770d1295c8f\") " pod="cert-manager/cert-manager-webhook-7dc76cbb94-588gq" Jun 14 14:46:35.456564 ip-10-0-129-116 kubenswrapper[2546]: I0614 14:46:35.456400 2546 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qc4g2\" (UniqueName: \"kubernetes.io/projected/9f5a1811-87f1-4556-b16b-9770d1295c8f-kube-api-access-qc4g2\") pod \"cert-manager-webhook-7dc76cbb94-588gq\" (UID: \"9f5a1811-87f1-4556-b16b-9770d1295c8f\") " pod="cert-manager/cert-manager-webhook-7dc76cbb94-588gq" Jun 14 14:46:35.557821 ip-10-0-129-116 kubenswrapper[2546]: I0614 14:46:35.557776 2546 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/9f5a1811-87f1-4556-b16b-9770d1295c8f-bound-sa-token\") pod \"cert-manager-webhook-7dc76cbb94-588gq\" (UID: \"9f5a1811-87f1-4556-b16b-9770d1295c8f\") " pod="cert-manager/cert-manager-webhook-7dc76cbb94-588gq" Jun 14 14:46:35.558028 ip-10-0-129-116 kubenswrapper[2546]: I0614 14:46:35.557841 2546 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qc4g2\" (UniqueName: \"kubernetes.io/projected/9f5a1811-87f1-4556-b16b-9770d1295c8f-kube-api-access-qc4g2\") pod \"cert-manager-webhook-7dc76cbb94-588gq\" (UID: \"9f5a1811-87f1-4556-b16b-9770d1295c8f\") " pod="cert-manager/cert-manager-webhook-7dc76cbb94-588gq" Jun 14 14:46:35.565824 ip-10-0-129-116 kubenswrapper[2546]: I0614 14:46:35.565789 2546 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/9f5a1811-87f1-4556-b16b-9770d1295c8f-bound-sa-token\") pod \"cert-manager-webhook-7dc76cbb94-588gq\" (UID: \"9f5a1811-87f1-4556-b16b-9770d1295c8f\") " pod="cert-manager/cert-manager-webhook-7dc76cbb94-588gq" Jun 14 14:46:35.565974 ip-10-0-129-116 kubenswrapper[2546]: I0614 14:46:35.565876 2546 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-qc4g2\" (UniqueName: \"kubernetes.io/projected/9f5a1811-87f1-4556-b16b-9770d1295c8f-kube-api-access-qc4g2\") pod \"cert-manager-webhook-7dc76cbb94-588gq\" (UID: \"9f5a1811-87f1-4556-b16b-9770d1295c8f\") " pod="cert-manager/cert-manager-webhook-7dc76cbb94-588gq" Jun 14 14:46:35.650737 ip-10-0-129-116 kubenswrapper[2546]: I0614 14:46:35.650707 2546 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-webhook-7dc76cbb94-588gq" Jun 14 14:46:35.801701 ip-10-0-129-116 kubenswrapper[2546]: I0614 14:46:35.801631 2546 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-webhook-7dc76cbb94-588gq"] Jun 14 14:46:35.804037 ip-10-0-129-116 kubenswrapper[2546]: W0614 14:46:35.804007 2546 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod9f5a1811_87f1_4556_b16b_9770d1295c8f.slice/crio-d0481af3d5d367ad65cfe6f40eb76e9f978625278ed7b6099fd4d5cbee32ce56 WatchSource:0}: Error finding container d0481af3d5d367ad65cfe6f40eb76e9f978625278ed7b6099fd4d5cbee32ce56: Status 404 returned error can't find the container with id d0481af3d5d367ad65cfe6f40eb76e9f978625278ed7b6099fd4d5cbee32ce56 Jun 14 14:46:35.963222 ip-10-0-129-116 kubenswrapper[2546]: I0614 14:46:35.963127 2546 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c96gx_105377da-c223-41ad-b033-546cb01239c4/konnectivity-agent/0.log" limit=1024 Jun 14 14:46:36.542218 ip-10-0-129-116 kubenswrapper[2546]: I0614 14:46:36.542188 2546 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c96gx_105377da-c223-41ad-b033-546cb01239c4/konnectivity-agent/0.log" limit=1024 Jun 14 14:46:36.732400 ip-10-0-129-116 kubenswrapper[2546]: I0614 14:46:36.732368 2546 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-webhook-7dc76cbb94-588gq" event={"ID":"9f5a1811-87f1-4556-b16b-9770d1295c8f","Type":"ContainerStarted","Data":"d0481af3d5d367ad65cfe6f40eb76e9f978625278ed7b6099fd4d5cbee32ce56"} Jun 14 14:46:37.739883 ip-10-0-129-116 kubenswrapper[2546]: I0614 14:46:37.739849 2546 generic.go:356] "Generic (PLEG): container finished" podID="d5665b8f-343f-49bc-9c36-871a3bf4b2b3" containerID="34962c342508154d4e6750e99705bf6cc7aef65d6c5e070e6e4cb572f847e696" exitCode=0 Jun 14 14:46:37.740374 ip-10-0-129-116 kubenswrapper[2546]: I0614 14:46:37.739938 2546 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87frhn6c" event={"ID":"d5665b8f-343f-49bc-9c36-871a3bf4b2b3","Type":"ContainerDied","Data":"34962c342508154d4e6750e99705bf6cc7aef65d6c5e070e6e4cb572f847e696"} Jun 14 14:46:38.140234 ip-10-0-129-116 kubenswrapper[2546]: I0614 14:46:38.140128 2546 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c96gx_105377da-c223-41ad-b033-546cb01239c4/konnectivity-agent/0.log" limit=1024 Jun 14 14:46:38.193730 ip-10-0-129-116 kubenswrapper[2546]: I0614 14:46:38.193687 2546 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c96gx_105377da-c223-41ad-b033-546cb01239c4/konnectivity-agent/0.log" limit=1024 Jun 14 14:46:38.746513 ip-10-0-129-116 kubenswrapper[2546]: I0614 14:46:38.746478 2546 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-webhook-7dc76cbb94-588gq" event={"ID":"9f5a1811-87f1-4556-b16b-9770d1295c8f","Type":"ContainerStarted","Data":"abf82ebbd9afc8ec96bd1853d4408c6c4269c0962c8df7e3ed1df09d0e74a60d"} Jun 14 14:46:38.746917 ip-10-0-129-116 kubenswrapper[2546]: I0614 14:46:38.746542 2546 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="cert-manager/cert-manager-webhook-7dc76cbb94-588gq" Jun 14 14:46:38.748799 ip-10-0-129-116 kubenswrapper[2546]: I0614 14:46:38.748771 2546 generic.go:356] "Generic (PLEG): container finished" podID="d5665b8f-343f-49bc-9c36-871a3bf4b2b3" containerID="d59258f1ca888b5446be86826abfd6fb391dfa68f0e564ef48bbb34442c5c6b5" exitCode=0 Jun 14 14:46:38.748923 ip-10-0-129-116 kubenswrapper[2546]: I0614 14:46:38.748854 2546 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87frhn6c" event={"ID":"d5665b8f-343f-49bc-9c36-871a3bf4b2b3","Type":"ContainerDied","Data":"d59258f1ca888b5446be86826abfd6fb391dfa68f0e564ef48bbb34442c5c6b5"} Jun 14 14:46:38.764687 ip-10-0-129-116 kubenswrapper[2546]: I0614 14:46:38.764633 2546 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="cert-manager/cert-manager-webhook-7dc76cbb94-588gq" podStartSLOduration=0.908269857 podStartE2EDuration="3.764618469s" totalImagesPullingTime="2.856348612s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-14 14:46:35 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-14 14:46:38.764188006 +0000 UTC m=+436.092570167" watchObservedRunningTime="2026-06-14 14:46:38.764618469 +0000 UTC m=+436.093000593" Jun 14 14:46:39.876004 ip-10-0-129-116 kubenswrapper[2546]: I0614 14:46:39.875973 2546 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87frhn6c" Jun 14 14:46:39.998359 ip-10-0-129-116 kubenswrapper[2546]: I0614 14:46:39.998307 2546 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-7wvnk\" (UniqueName: \"kubernetes.io/projected/d5665b8f-343f-49bc-9c36-871a3bf4b2b3-kube-api-access-7wvnk\") pod \"d5665b8f-343f-49bc-9c36-871a3bf4b2b3\" (UID: \"d5665b8f-343f-49bc-9c36-871a3bf4b2b3\") " Jun 14 14:46:39.998359 ip-10-0-129-116 kubenswrapper[2546]: I0614 14:46:39.998363 2546 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/d5665b8f-343f-49bc-9c36-871a3bf4b2b3-util\") pod \"d5665b8f-343f-49bc-9c36-871a3bf4b2b3\" (UID: \"d5665b8f-343f-49bc-9c36-871a3bf4b2b3\") " Jun 14 14:46:39.998610 ip-10-0-129-116 kubenswrapper[2546]: I0614 14:46:39.998407 2546 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/d5665b8f-343f-49bc-9c36-871a3bf4b2b3-bundle\") pod \"d5665b8f-343f-49bc-9c36-871a3bf4b2b3\" (UID: \"d5665b8f-343f-49bc-9c36-871a3bf4b2b3\") " Jun 14 14:46:39.998819 ip-10-0-129-116 kubenswrapper[2546]: I0614 14:46:39.998786 2546 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/d5665b8f-343f-49bc-9c36-871a3bf4b2b3-bundle" (OuterVolumeSpecName: "bundle") pod "d5665b8f-343f-49bc-9c36-871a3bf4b2b3" (UID: "d5665b8f-343f-49bc-9c36-871a3bf4b2b3"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 14 14:46:40.000506 ip-10-0-129-116 kubenswrapper[2546]: I0614 14:46:40.000485 2546 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/d5665b8f-343f-49bc-9c36-871a3bf4b2b3-kube-api-access-7wvnk" (OuterVolumeSpecName: "kube-api-access-7wvnk") pod "d5665b8f-343f-49bc-9c36-871a3bf4b2b3" (UID: "d5665b8f-343f-49bc-9c36-871a3bf4b2b3"). InnerVolumeSpecName "kube-api-access-7wvnk". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 14 14:46:40.002678 ip-10-0-129-116 kubenswrapper[2546]: I0614 14:46:40.002657 2546 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/d5665b8f-343f-49bc-9c36-871a3bf4b2b3-util" (OuterVolumeSpecName: "util") pod "d5665b8f-343f-49bc-9c36-871a3bf4b2b3" (UID: "d5665b8f-343f-49bc-9c36-871a3bf4b2b3"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 14 14:46:40.099781 ip-10-0-129-116 kubenswrapper[2546]: I0614 14:46:40.099749 2546 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-7wvnk\" (UniqueName: \"kubernetes.io/projected/d5665b8f-343f-49bc-9c36-871a3bf4b2b3-kube-api-access-7wvnk\") on node \"ip-10-0-129-116.ec2.internal\" DevicePath \"\"" Jun 14 14:46:40.099781 ip-10-0-129-116 kubenswrapper[2546]: I0614 14:46:40.099776 2546 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/d5665b8f-343f-49bc-9c36-871a3bf4b2b3-util\") on node \"ip-10-0-129-116.ec2.internal\" DevicePath \"\"" Jun 14 14:46:40.099781 ip-10-0-129-116 kubenswrapper[2546]: I0614 14:46:40.099786 2546 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/d5665b8f-343f-49bc-9c36-871a3bf4b2b3-bundle\") on node \"ip-10-0-129-116.ec2.internal\" DevicePath \"\"" Jun 14 14:46:40.759074 ip-10-0-129-116 kubenswrapper[2546]: I0614 14:46:40.759039 2546 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87frhn6c" Jun 14 14:46:40.759074 ip-10-0-129-116 kubenswrapper[2546]: I0614 14:46:40.759047 2546 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87frhn6c" event={"ID":"d5665b8f-343f-49bc-9c36-871a3bf4b2b3","Type":"ContainerDied","Data":"f22d1a495bc1d227976d1a50df650152d7090d085ee881d13f43de939885ec5a"} Jun 14 14:46:40.759283 ip-10-0-129-116 kubenswrapper[2546]: I0614 14:46:40.759128 2546 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="f22d1a495bc1d227976d1a50df650152d7090d085ee881d13f43de939885ec5a" Jun 14 14:46:44.154549 ip-10-0-129-116 kubenswrapper[2546]: I0614 14:46:44.154508 2546 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c96gx_105377da-c223-41ad-b033-546cb01239c4/konnectivity-agent/0.log" limit=1024 Jun 14 14:46:44.252666 ip-10-0-129-116 kubenswrapper[2546]: I0614 14:46:44.252632 2546 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c96gx_105377da-c223-41ad-b033-546cb01239c4/konnectivity-agent/0.log" limit=1024 Jun 14 14:46:44.352902 ip-10-0-129-116 kubenswrapper[2546]: I0614 14:46:44.352869 2546 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c96gx_105377da-c223-41ad-b033-546cb01239c4/konnectivity-agent/0.log" limit=1024 Jun 14 14:46:44.611730 ip-10-0-129-116 kubenswrapper[2546]: I0614 14:46:44.611645 2546 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c96gx_105377da-c223-41ad-b033-546cb01239c4/konnectivity-agent/0.log" limit=1024 Jun 14 14:46:44.666957 ip-10-0-129-116 kubenswrapper[2546]: I0614 14:46:44.666923 2546 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c96gx_105377da-c223-41ad-b033-546cb01239c4/konnectivity-agent/0.log" limit=1024 Jun 14 14:46:44.755567 ip-10-0-129-116 kubenswrapper[2546]: I0614 14:46:44.755535 2546 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="cert-manager/cert-manager-webhook-7dc76cbb94-588gq" Jun 14 14:46:51.014448 ip-10-0-129-116 kubenswrapper[2546]: I0614 14:46:51.014400 2546 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c96gx_105377da-c223-41ad-b033-546cb01239c4/konnectivity-agent/0.log" limit=1024 Jun 14 14:46:51.127922 ip-10-0-129-116 kubenswrapper[2546]: I0614 14:46:51.127872 2546 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c96gx_105377da-c223-41ad-b033-546cb01239c4/konnectivity-agent/0.log" limit=1024 Jun 14 14:46:52.745068 ip-10-0-129-116 kubenswrapper[2546]: I0614 14:46:52.745035 2546 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c96gx_105377da-c223-41ad-b033-546cb01239c4/konnectivity-agent/0.log" limit=1024 Jun 14 14:46:53.463616 ip-10-0-129-116 kubenswrapper[2546]: I0614 14:46:53.463584 2546 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["cert-manager/cert-manager-59c77684cc-rhpjk"] Jun 14 14:46:53.463911 ip-10-0-129-116 kubenswrapper[2546]: I0614 14:46:53.463898 2546 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="d5665b8f-343f-49bc-9c36-871a3bf4b2b3" containerName="pull" Jun 14 14:46:53.463911 ip-10-0-129-116 kubenswrapper[2546]: I0614 14:46:53.463912 2546 state_mem.go:107] "Deleted CPUSet assignment" podUID="d5665b8f-343f-49bc-9c36-871a3bf4b2b3" containerName="pull" Jun 14 14:46:53.464033 ip-10-0-129-116 kubenswrapper[2546]: I0614 14:46:53.463931 2546 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="d5665b8f-343f-49bc-9c36-871a3bf4b2b3" containerName="util" Jun 14 14:46:53.464033 ip-10-0-129-116 kubenswrapper[2546]: I0614 14:46:53.463936 2546 state_mem.go:107] "Deleted CPUSet assignment" podUID="d5665b8f-343f-49bc-9c36-871a3bf4b2b3" containerName="util" Jun 14 14:46:53.464033 ip-10-0-129-116 kubenswrapper[2546]: I0614 14:46:53.463943 2546 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="d5665b8f-343f-49bc-9c36-871a3bf4b2b3" containerName="extract" Jun 14 14:46:53.464033 ip-10-0-129-116 kubenswrapper[2546]: I0614 14:46:53.463948 2546 state_mem.go:107] "Deleted CPUSet assignment" podUID="d5665b8f-343f-49bc-9c36-871a3bf4b2b3" containerName="extract" Jun 14 14:46:53.464033 ip-10-0-129-116 kubenswrapper[2546]: I0614 14:46:53.463997 2546 memory_manager.go:368] "RemoveStaleState removing state" podUID="d5665b8f-343f-49bc-9c36-871a3bf4b2b3" containerName="extract" Jun 14 14:46:53.467483 ip-10-0-129-116 kubenswrapper[2546]: I0614 14:46:53.467467 2546 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-59c77684cc-rhpjk" Jun 14 14:46:53.469988 ip-10-0-129-116 kubenswrapper[2546]: I0614 14:46:53.469963 2546 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"cert-manager\"/\"cert-manager-dockercfg-hz5g7\"" Jun 14 14:46:53.474958 ip-10-0-129-116 kubenswrapper[2546]: I0614 14:46:53.474936 2546 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-59c77684cc-rhpjk"] Jun 14 14:46:53.612333 ip-10-0-129-116 kubenswrapper[2546]: I0614 14:46:53.612289 2546 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jxrt8\" (UniqueName: \"kubernetes.io/projected/be92af78-dc14-44cb-9c14-f5477ede523f-kube-api-access-jxrt8\") pod \"cert-manager-59c77684cc-rhpjk\" (UID: \"be92af78-dc14-44cb-9c14-f5477ede523f\") " pod="cert-manager/cert-manager-59c77684cc-rhpjk" Jun 14 14:46:53.612522 ip-10-0-129-116 kubenswrapper[2546]: I0614 14:46:53.612354 2546 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/be92af78-dc14-44cb-9c14-f5477ede523f-bound-sa-token\") pod \"cert-manager-59c77684cc-rhpjk\" (UID: \"be92af78-dc14-44cb-9c14-f5477ede523f\") " pod="cert-manager/cert-manager-59c77684cc-rhpjk" Jun 14 14:46:53.713615 ip-10-0-129-116 kubenswrapper[2546]: I0614 14:46:53.713568 2546 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jxrt8\" (UniqueName: \"kubernetes.io/projected/be92af78-dc14-44cb-9c14-f5477ede523f-kube-api-access-jxrt8\") pod \"cert-manager-59c77684cc-rhpjk\" (UID: \"be92af78-dc14-44cb-9c14-f5477ede523f\") " pod="cert-manager/cert-manager-59c77684cc-rhpjk" Jun 14 14:46:53.713615 ip-10-0-129-116 kubenswrapper[2546]: I0614 14:46:53.713630 2546 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/be92af78-dc14-44cb-9c14-f5477ede523f-bound-sa-token\") pod \"cert-manager-59c77684cc-rhpjk\" (UID: \"be92af78-dc14-44cb-9c14-f5477ede523f\") " pod="cert-manager/cert-manager-59c77684cc-rhpjk" Jun 14 14:46:53.727427 ip-10-0-129-116 kubenswrapper[2546]: I0614 14:46:53.727358 2546 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/be92af78-dc14-44cb-9c14-f5477ede523f-bound-sa-token\") pod \"cert-manager-59c77684cc-rhpjk\" (UID: \"be92af78-dc14-44cb-9c14-f5477ede523f\") " pod="cert-manager/cert-manager-59c77684cc-rhpjk" Jun 14 14:46:53.727544 ip-10-0-129-116 kubenswrapper[2546]: I0614 14:46:53.727497 2546 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-jxrt8\" (UniqueName: \"kubernetes.io/projected/be92af78-dc14-44cb-9c14-f5477ede523f-kube-api-access-jxrt8\") pod \"cert-manager-59c77684cc-rhpjk\" (UID: \"be92af78-dc14-44cb-9c14-f5477ede523f\") " pod="cert-manager/cert-manager-59c77684cc-rhpjk" Jun 14 14:46:53.777312 ip-10-0-129-116 kubenswrapper[2546]: I0614 14:46:53.777281 2546 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-59c77684cc-rhpjk" Jun 14 14:46:53.906531 ip-10-0-129-116 kubenswrapper[2546]: I0614 14:46:53.906507 2546 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-59c77684cc-rhpjk"] Jun 14 14:46:53.908448 ip-10-0-129-116 kubenswrapper[2546]: W0614 14:46:53.908418 2546 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podbe92af78_dc14_44cb_9c14_f5477ede523f.slice/crio-68e80c9c1d39918d62df64e5bbeffa618e692fbb952074d865cbd0217aec327b WatchSource:0}: Error finding container 68e80c9c1d39918d62df64e5bbeffa618e692fbb952074d865cbd0217aec327b: Status 404 returned error can't find the container with id 68e80c9c1d39918d62df64e5bbeffa618e692fbb952074d865cbd0217aec327b Jun 14 14:46:54.000832 ip-10-0-129-116 kubenswrapper[2546]: I0614 14:46:54.000759 2546 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-marketplace/410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cd6qvtr"] Jun 14 14:46:54.004403 ip-10-0-129-116 kubenswrapper[2546]: I0614 14:46:54.004380 2546 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cd6qvtr" Jun 14 14:46:54.007112 ip-10-0-129-116 kubenswrapper[2546]: I0614 14:46:54.007069 2546 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"kube-root-ca.crt\"" Jun 14 14:46:54.007237 ip-10-0-129-116 kubenswrapper[2546]: I0614 14:46:54.007168 2546 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"openshift-service-ca.crt\"" Jun 14 14:46:54.007237 ip-10-0-129-116 kubenswrapper[2546]: I0614 14:46:54.007175 2546 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-marketplace\"/\"default-dockercfg-44x46\"" Jun 14 14:46:54.011444 ip-10-0-129-116 kubenswrapper[2546]: I0614 14:46:54.011271 2546 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cd6qvtr"] Jun 14 14:46:54.117213 ip-10-0-129-116 kubenswrapper[2546]: I0614 14:46:54.117179 2546 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/6e2e80b3-adff-40c1-821a-ff24fdd735d3-util\") pod \"410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cd6qvtr\" (UID: \"6e2e80b3-adff-40c1-821a-ff24fdd735d3\") " pod="openshift-marketplace/410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cd6qvtr" Jun 14 14:46:54.117387 ip-10-0-129-116 kubenswrapper[2546]: I0614 14:46:54.117228 2546 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5526g\" (UniqueName: \"kubernetes.io/projected/6e2e80b3-adff-40c1-821a-ff24fdd735d3-kube-api-access-5526g\") pod \"410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cd6qvtr\" (UID: \"6e2e80b3-adff-40c1-821a-ff24fdd735d3\") " pod="openshift-marketplace/410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cd6qvtr" Jun 14 14:46:54.117387 ip-10-0-129-116 kubenswrapper[2546]: I0614 14:46:54.117274 2546 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/6e2e80b3-adff-40c1-821a-ff24fdd735d3-bundle\") pod \"410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cd6qvtr\" (UID: \"6e2e80b3-adff-40c1-821a-ff24fdd735d3\") " pod="openshift-marketplace/410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cd6qvtr" Jun 14 14:46:54.218253 ip-10-0-129-116 kubenswrapper[2546]: I0614 14:46:54.218215 2546 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/6e2e80b3-adff-40c1-821a-ff24fdd735d3-util\") pod \"410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cd6qvtr\" (UID: \"6e2e80b3-adff-40c1-821a-ff24fdd735d3\") " pod="openshift-marketplace/410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cd6qvtr" Jun 14 14:46:54.218395 ip-10-0-129-116 kubenswrapper[2546]: I0614 14:46:54.218264 2546 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5526g\" (UniqueName: \"kubernetes.io/projected/6e2e80b3-adff-40c1-821a-ff24fdd735d3-kube-api-access-5526g\") pod \"410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cd6qvtr\" (UID: \"6e2e80b3-adff-40c1-821a-ff24fdd735d3\") " pod="openshift-marketplace/410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cd6qvtr" Jun 14 14:46:54.218395 ip-10-0-129-116 kubenswrapper[2546]: I0614 14:46:54.218294 2546 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/6e2e80b3-adff-40c1-821a-ff24fdd735d3-bundle\") pod \"410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cd6qvtr\" (UID: \"6e2e80b3-adff-40c1-821a-ff24fdd735d3\") " pod="openshift-marketplace/410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cd6qvtr" Jun 14 14:46:54.218598 ip-10-0-129-116 kubenswrapper[2546]: I0614 14:46:54.218576 2546 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/6e2e80b3-adff-40c1-821a-ff24fdd735d3-util\") pod \"410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cd6qvtr\" (UID: \"6e2e80b3-adff-40c1-821a-ff24fdd735d3\") " pod="openshift-marketplace/410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cd6qvtr" Jun 14 14:46:54.218658 ip-10-0-129-116 kubenswrapper[2546]: I0614 14:46:54.218639 2546 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/6e2e80b3-adff-40c1-821a-ff24fdd735d3-bundle\") pod \"410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cd6qvtr\" (UID: \"6e2e80b3-adff-40c1-821a-ff24fdd735d3\") " pod="openshift-marketplace/410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cd6qvtr" Jun 14 14:46:54.226276 ip-10-0-129-116 kubenswrapper[2546]: I0614 14:46:54.226245 2546 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-5526g\" (UniqueName: \"kubernetes.io/projected/6e2e80b3-adff-40c1-821a-ff24fdd735d3-kube-api-access-5526g\") pod \"410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cd6qvtr\" (UID: \"6e2e80b3-adff-40c1-821a-ff24fdd735d3\") " pod="openshift-marketplace/410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cd6qvtr" Jun 14 14:46:54.314320 ip-10-0-129-116 kubenswrapper[2546]: I0614 14:46:54.314240 2546 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cd6qvtr" Jun 14 14:46:54.440979 ip-10-0-129-116 kubenswrapper[2546]: I0614 14:46:54.440952 2546 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cd6qvtr"] Jun 14 14:46:54.443224 ip-10-0-129-116 kubenswrapper[2546]: W0614 14:46:54.443197 2546 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6e2e80b3_adff_40c1_821a_ff24fdd735d3.slice/crio-82b51babc708bbc8a9279db5f017866a330a6cd88885ecace9d7438989decb18 WatchSource:0}: Error finding container 82b51babc708bbc8a9279db5f017866a330a6cd88885ecace9d7438989decb18: Status 404 returned error can't find the container with id 82b51babc708bbc8a9279db5f017866a330a6cd88885ecace9d7438989decb18 Jun 14 14:46:54.818317 ip-10-0-129-116 kubenswrapper[2546]: I0614 14:46:54.818283 2546 generic.go:356] "Generic (PLEG): container finished" podID="6e2e80b3-adff-40c1-821a-ff24fdd735d3" containerID="5b1544a27abfed398f71597bbb44b233778923a44ac5fee485263290c18f4f67" exitCode=0 Jun 14 14:46:54.818775 ip-10-0-129-116 kubenswrapper[2546]: I0614 14:46:54.818365 2546 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cd6qvtr" event={"ID":"6e2e80b3-adff-40c1-821a-ff24fdd735d3","Type":"ContainerDied","Data":"5b1544a27abfed398f71597bbb44b233778923a44ac5fee485263290c18f4f67"} Jun 14 14:46:54.818775 ip-10-0-129-116 kubenswrapper[2546]: I0614 14:46:54.818408 2546 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cd6qvtr" event={"ID":"6e2e80b3-adff-40c1-821a-ff24fdd735d3","Type":"ContainerStarted","Data":"82b51babc708bbc8a9279db5f017866a330a6cd88885ecace9d7438989decb18"} Jun 14 14:46:54.820018 ip-10-0-129-116 kubenswrapper[2546]: I0614 14:46:54.819997 2546 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-59c77684cc-rhpjk" event={"ID":"be92af78-dc14-44cb-9c14-f5477ede523f","Type":"ContainerStarted","Data":"e1106cb2a2de3715483f84b1d45ab608429891bc87ab72ace0a206f5c75be19c"} Jun 14 14:46:54.820136 ip-10-0-129-116 kubenswrapper[2546]: I0614 14:46:54.820027 2546 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-59c77684cc-rhpjk" event={"ID":"be92af78-dc14-44cb-9c14-f5477ede523f","Type":"ContainerStarted","Data":"68e80c9c1d39918d62df64e5bbeffa618e692fbb952074d865cbd0217aec327b"} Jun 14 14:46:54.847434 ip-10-0-129-116 kubenswrapper[2546]: I0614 14:46:54.847388 2546 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="cert-manager/cert-manager-59c77684cc-rhpjk" podStartSLOduration=1.847374444 podStartE2EDuration="1.847374444s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-14 14:46:53 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-14 14:46:54.846424392 +0000 UTC m=+452.174806537" watchObservedRunningTime="2026-06-14 14:46:54.847374444 +0000 UTC m=+452.175756569" Jun 14 14:46:55.825980 ip-10-0-129-116 kubenswrapper[2546]: I0614 14:46:55.825896 2546 generic.go:356] "Generic (PLEG): container finished" podID="6e2e80b3-adff-40c1-821a-ff24fdd735d3" containerID="6eafa5364f6ee42341484ccc013faafa15563886b7f3c8c72f6bddb56f0ffd0a" exitCode=0 Jun 14 14:46:55.826360 ip-10-0-129-116 kubenswrapper[2546]: I0614 14:46:55.825984 2546 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cd6qvtr" event={"ID":"6e2e80b3-adff-40c1-821a-ff24fdd735d3","Type":"ContainerDied","Data":"6eafa5364f6ee42341484ccc013faafa15563886b7f3c8c72f6bddb56f0ffd0a"} Jun 14 14:46:56.836124 ip-10-0-129-116 kubenswrapper[2546]: I0614 14:46:56.833699 2546 generic.go:356] "Generic (PLEG): container finished" podID="6e2e80b3-adff-40c1-821a-ff24fdd735d3" containerID="b469f660e78b8bf54832f1f7245bdc294b2471bed463d2a0c17cc3dacfea41ec" exitCode=0 Jun 14 14:46:56.836124 ip-10-0-129-116 kubenswrapper[2546]: I0614 14:46:56.833770 2546 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cd6qvtr" event={"ID":"6e2e80b3-adff-40c1-821a-ff24fdd735d3","Type":"ContainerDied","Data":"b469f660e78b8bf54832f1f7245bdc294b2471bed463d2a0c17cc3dacfea41ec"} Jun 14 14:46:57.977736 ip-10-0-129-116 kubenswrapper[2546]: I0614 14:46:57.977706 2546 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cd6qvtr" Jun 14 14:46:58.148743 ip-10-0-129-116 kubenswrapper[2546]: I0614 14:46:58.148719 2546 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-5526g\" (UniqueName: \"kubernetes.io/projected/6e2e80b3-adff-40c1-821a-ff24fdd735d3-kube-api-access-5526g\") pod \"6e2e80b3-adff-40c1-821a-ff24fdd735d3\" (UID: \"6e2e80b3-adff-40c1-821a-ff24fdd735d3\") " Jun 14 14:46:58.148901 ip-10-0-129-116 kubenswrapper[2546]: I0614 14:46:58.148767 2546 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/6e2e80b3-adff-40c1-821a-ff24fdd735d3-bundle\") pod \"6e2e80b3-adff-40c1-821a-ff24fdd735d3\" (UID: \"6e2e80b3-adff-40c1-821a-ff24fdd735d3\") " Jun 14 14:46:58.148901 ip-10-0-129-116 kubenswrapper[2546]: I0614 14:46:58.148793 2546 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/6e2e80b3-adff-40c1-821a-ff24fdd735d3-util\") pod \"6e2e80b3-adff-40c1-821a-ff24fdd735d3\" (UID: \"6e2e80b3-adff-40c1-821a-ff24fdd735d3\") " Jun 14 14:46:58.149480 ip-10-0-129-116 kubenswrapper[2546]: I0614 14:46:58.149449 2546 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/6e2e80b3-adff-40c1-821a-ff24fdd735d3-bundle" (OuterVolumeSpecName: "bundle") pod "6e2e80b3-adff-40c1-821a-ff24fdd735d3" (UID: "6e2e80b3-adff-40c1-821a-ff24fdd735d3"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 14 14:46:58.150790 ip-10-0-129-116 kubenswrapper[2546]: I0614 14:46:58.150759 2546 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/6e2e80b3-adff-40c1-821a-ff24fdd735d3-kube-api-access-5526g" (OuterVolumeSpecName: "kube-api-access-5526g") pod "6e2e80b3-adff-40c1-821a-ff24fdd735d3" (UID: "6e2e80b3-adff-40c1-821a-ff24fdd735d3"). InnerVolumeSpecName "kube-api-access-5526g". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 14 14:46:58.153996 ip-10-0-129-116 kubenswrapper[2546]: I0614 14:46:58.153963 2546 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/6e2e80b3-adff-40c1-821a-ff24fdd735d3-util" (OuterVolumeSpecName: "util") pod "6e2e80b3-adff-40c1-821a-ff24fdd735d3" (UID: "6e2e80b3-adff-40c1-821a-ff24fdd735d3"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 14 14:46:58.249434 ip-10-0-129-116 kubenswrapper[2546]: I0614 14:46:58.249401 2546 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/6e2e80b3-adff-40c1-821a-ff24fdd735d3-bundle\") on node \"ip-10-0-129-116.ec2.internal\" DevicePath \"\"" Jun 14 14:46:58.249434 ip-10-0-129-116 kubenswrapper[2546]: I0614 14:46:58.249429 2546 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/6e2e80b3-adff-40c1-821a-ff24fdd735d3-util\") on node \"ip-10-0-129-116.ec2.internal\" DevicePath \"\"" Jun 14 14:46:58.249434 ip-10-0-129-116 kubenswrapper[2546]: I0614 14:46:58.249438 2546 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-5526g\" (UniqueName: \"kubernetes.io/projected/6e2e80b3-adff-40c1-821a-ff24fdd735d3-kube-api-access-5526g\") on node \"ip-10-0-129-116.ec2.internal\" DevicePath \"\"" Jun 14 14:46:58.844308 ip-10-0-129-116 kubenswrapper[2546]: I0614 14:46:58.844278 2546 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cd6qvtr" Jun 14 14:46:58.844472 ip-10-0-129-116 kubenswrapper[2546]: I0614 14:46:58.844278 2546 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cd6qvtr" event={"ID":"6e2e80b3-adff-40c1-821a-ff24fdd735d3","Type":"ContainerDied","Data":"82b51babc708bbc8a9279db5f017866a330a6cd88885ecace9d7438989decb18"} Jun 14 14:46:58.844472 ip-10-0-129-116 kubenswrapper[2546]: I0614 14:46:58.844401 2546 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="82b51babc708bbc8a9279db5f017866a330a6cd88885ecace9d7438989decb18" Jun 14 14:47:05.556297 ip-10-0-129-116 kubenswrapper[2546]: I0614 14:47:05.556265 2546 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c96gx_105377da-c223-41ad-b033-546cb01239c4/konnectivity-agent/0.log" limit=1024 Jun 14 14:47:05.654008 ip-10-0-129-116 kubenswrapper[2546]: I0614 14:47:05.653974 2546 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c96gx_105377da-c223-41ad-b033-546cb01239c4/konnectivity-agent/0.log" limit=1024 Jun 14 14:47:06.158832 ip-10-0-129-116 kubenswrapper[2546]: I0614 14:47:06.158798 2546 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c96gx_105377da-c223-41ad-b033-546cb01239c4/konnectivity-agent/0.log" limit=1024 Jun 14 14:47:06.358437 ip-10-0-129-116 kubenswrapper[2546]: I0614 14:47:06.358405 2546 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c96gx_105377da-c223-41ad-b033-546cb01239c4/konnectivity-agent/0.log" limit=1024 Jun 14 14:47:06.456581 ip-10-0-129-116 kubenswrapper[2546]: I0614 14:47:06.456472 2546 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c96gx_105377da-c223-41ad-b033-546cb01239c4/konnectivity-agent/0.log" limit=1024 Jun 14 14:47:06.487401 ip-10-0-129-116 kubenswrapper[2546]: I0614 14:47:06.487362 2546 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-bc868665f-tfrtk"] Jun 14 14:47:06.487831 ip-10-0-129-116 kubenswrapper[2546]: I0614 14:47:06.487811 2546 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="6e2e80b3-adff-40c1-821a-ff24fdd735d3" containerName="extract" Jun 14 14:47:06.487831 ip-10-0-129-116 kubenswrapper[2546]: I0614 14:47:06.487832 2546 state_mem.go:107] "Deleted CPUSet assignment" podUID="6e2e80b3-adff-40c1-821a-ff24fdd735d3" containerName="extract" Jun 14 14:47:06.487980 ip-10-0-129-116 kubenswrapper[2546]: I0614 14:47:06.487867 2546 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="6e2e80b3-adff-40c1-821a-ff24fdd735d3" containerName="util" Jun 14 14:47:06.487980 ip-10-0-129-116 kubenswrapper[2546]: I0614 14:47:06.487876 2546 state_mem.go:107] "Deleted CPUSet assignment" podUID="6e2e80b3-adff-40c1-821a-ff24fdd735d3" containerName="util" Jun 14 14:47:06.487980 ip-10-0-129-116 kubenswrapper[2546]: I0614 14:47:06.487887 2546 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="6e2e80b3-adff-40c1-821a-ff24fdd735d3" containerName="pull" Jun 14 14:47:06.487980 ip-10-0-129-116 kubenswrapper[2546]: I0614 14:47:06.487895 2546 state_mem.go:107] "Deleted CPUSet assignment" podUID="6e2e80b3-adff-40c1-821a-ff24fdd735d3" containerName="pull" Jun 14 14:47:06.488217 ip-10-0-129-116 kubenswrapper[2546]: I0614 14:47:06.487989 2546 memory_manager.go:368] "RemoveStaleState removing state" podUID="6e2e80b3-adff-40c1-821a-ff24fdd735d3" containerName="extract" Jun 14 14:47:06.494555 ip-10-0-129-116 kubenswrapper[2546]: I0614 14:47:06.494531 2546 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-bc868665f-tfrtk" Jun 14 14:47:06.497268 ip-10-0-129-116 kubenswrapper[2546]: I0614 14:47:06.497227 2546 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-webhook-cert\"" Jun 14 14:47:06.497268 ip-10-0-129-116 kubenswrapper[2546]: I0614 14:47:06.497267 2546 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"openshift-service-ca.crt\"" Jun 14 14:47:06.497444 ip-10-0-129-116 kubenswrapper[2546]: I0614 14:47:06.497301 2546 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-service-cert\"" Jun 14 14:47:06.497444 ip-10-0-129-116 kubenswrapper[2546]: I0614 14:47:06.497301 2546 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-dockercfg-f6x9g\"" Jun 14 14:47:06.497688 ip-10-0-129-116 kubenswrapper[2546]: I0614 14:47:06.497671 2546 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"kube-root-ca.crt\"" Jun 14 14:47:06.503838 ip-10-0-129-116 kubenswrapper[2546]: I0614 14:47:06.503818 2546 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-bc868665f-tfrtk"] Jun 14 14:47:06.506598 ip-10-0-129-116 kubenswrapper[2546]: I0614 14:47:06.506571 2546 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-sphpf\" (UniqueName: \"kubernetes.io/projected/6c316188-d56b-4f56-8d5a-cf711ca84b06-kube-api-access-sphpf\") pod \"opendatahub-operator-controller-manager-bc868665f-tfrtk\" (UID: \"6c316188-d56b-4f56-8d5a-cf711ca84b06\") " pod="opendatahub/opendatahub-operator-controller-manager-bc868665f-tfrtk" Jun 14 14:47:06.506706 ip-10-0-129-116 kubenswrapper[2546]: I0614 14:47:06.506688 2546 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/6c316188-d56b-4f56-8d5a-cf711ca84b06-manifests\") pod \"opendatahub-operator-controller-manager-bc868665f-tfrtk\" (UID: \"6c316188-d56b-4f56-8d5a-cf711ca84b06\") " pod="opendatahub/opendatahub-operator-controller-manager-bc868665f-tfrtk" Jun 14 14:47:06.506755 ip-10-0-129-116 kubenswrapper[2546]: I0614 14:47:06.506742 2546 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/6c316188-d56b-4f56-8d5a-cf711ca84b06-tmp\") pod \"opendatahub-operator-controller-manager-bc868665f-tfrtk\" (UID: \"6c316188-d56b-4f56-8d5a-cf711ca84b06\") " pod="opendatahub/opendatahub-operator-controller-manager-bc868665f-tfrtk" Jun 14 14:47:06.506791 ip-10-0-129-116 kubenswrapper[2546]: I0614 14:47:06.506766 2546 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/6c316188-d56b-4f56-8d5a-cf711ca84b06-apiservice-cert\") pod \"opendatahub-operator-controller-manager-bc868665f-tfrtk\" (UID: \"6c316188-d56b-4f56-8d5a-cf711ca84b06\") " pod="opendatahub/opendatahub-operator-controller-manager-bc868665f-tfrtk" Jun 14 14:47:06.506791 ip-10-0-129-116 kubenswrapper[2546]: I0614 14:47:06.506782 2546 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/6c316188-d56b-4f56-8d5a-cf711ca84b06-webhook-cert\") pod \"opendatahub-operator-controller-manager-bc868665f-tfrtk\" (UID: \"6c316188-d56b-4f56-8d5a-cf711ca84b06\") " pod="opendatahub/opendatahub-operator-controller-manager-bc868665f-tfrtk" Jun 14 14:47:06.607948 ip-10-0-129-116 kubenswrapper[2546]: I0614 14:47:06.607915 2546 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/6c316188-d56b-4f56-8d5a-cf711ca84b06-apiservice-cert\") pod \"opendatahub-operator-controller-manager-bc868665f-tfrtk\" (UID: \"6c316188-d56b-4f56-8d5a-cf711ca84b06\") " pod="opendatahub/opendatahub-operator-controller-manager-bc868665f-tfrtk" Jun 14 14:47:06.607948 ip-10-0-129-116 kubenswrapper[2546]: I0614 14:47:06.607948 2546 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/6c316188-d56b-4f56-8d5a-cf711ca84b06-webhook-cert\") pod \"opendatahub-operator-controller-manager-bc868665f-tfrtk\" (UID: \"6c316188-d56b-4f56-8d5a-cf711ca84b06\") " pod="opendatahub/opendatahub-operator-controller-manager-bc868665f-tfrtk" Jun 14 14:47:06.608466 ip-10-0-129-116 kubenswrapper[2546]: I0614 14:47:06.607970 2546 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-sphpf\" (UniqueName: \"kubernetes.io/projected/6c316188-d56b-4f56-8d5a-cf711ca84b06-kube-api-access-sphpf\") pod \"opendatahub-operator-controller-manager-bc868665f-tfrtk\" (UID: \"6c316188-d56b-4f56-8d5a-cf711ca84b06\") " pod="opendatahub/opendatahub-operator-controller-manager-bc868665f-tfrtk" Jun 14 14:47:06.608466 ip-10-0-129-116 kubenswrapper[2546]: I0614 14:47:06.608033 2546 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/6c316188-d56b-4f56-8d5a-cf711ca84b06-manifests\") pod \"opendatahub-operator-controller-manager-bc868665f-tfrtk\" (UID: \"6c316188-d56b-4f56-8d5a-cf711ca84b06\") " pod="opendatahub/opendatahub-operator-controller-manager-bc868665f-tfrtk" Jun 14 14:47:06.608466 ip-10-0-129-116 kubenswrapper[2546]: I0614 14:47:06.608262 2546 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/6c316188-d56b-4f56-8d5a-cf711ca84b06-tmp\") pod \"opendatahub-operator-controller-manager-bc868665f-tfrtk\" (UID: \"6c316188-d56b-4f56-8d5a-cf711ca84b06\") " pod="opendatahub/opendatahub-operator-controller-manager-bc868665f-tfrtk" Jun 14 14:47:06.608565 ip-10-0-129-116 kubenswrapper[2546]: I0614 14:47:06.608479 2546 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/6c316188-d56b-4f56-8d5a-cf711ca84b06-manifests\") pod \"opendatahub-operator-controller-manager-bc868665f-tfrtk\" (UID: \"6c316188-d56b-4f56-8d5a-cf711ca84b06\") " pod="opendatahub/opendatahub-operator-controller-manager-bc868665f-tfrtk" Jun 14 14:47:06.610278 ip-10-0-129-116 kubenswrapper[2546]: I0614 14:47:06.610258 2546 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/6c316188-d56b-4f56-8d5a-cf711ca84b06-tmp\") pod \"opendatahub-operator-controller-manager-bc868665f-tfrtk\" (UID: \"6c316188-d56b-4f56-8d5a-cf711ca84b06\") " pod="opendatahub/opendatahub-operator-controller-manager-bc868665f-tfrtk" Jun 14 14:47:06.610377 ip-10-0-129-116 kubenswrapper[2546]: I0614 14:47:06.610363 2546 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/6c316188-d56b-4f56-8d5a-cf711ca84b06-webhook-cert\") pod \"opendatahub-operator-controller-manager-bc868665f-tfrtk\" (UID: \"6c316188-d56b-4f56-8d5a-cf711ca84b06\") " pod="opendatahub/opendatahub-operator-controller-manager-bc868665f-tfrtk" Jun 14 14:47:06.610435 ip-10-0-129-116 kubenswrapper[2546]: I0614 14:47:06.610393 2546 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/6c316188-d56b-4f56-8d5a-cf711ca84b06-apiservice-cert\") pod \"opendatahub-operator-controller-manager-bc868665f-tfrtk\" (UID: \"6c316188-d56b-4f56-8d5a-cf711ca84b06\") " pod="opendatahub/opendatahub-operator-controller-manager-bc868665f-tfrtk" Jun 14 14:47:06.616063 ip-10-0-129-116 kubenswrapper[2546]: I0614 14:47:06.616040 2546 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-sphpf\" (UniqueName: \"kubernetes.io/projected/6c316188-d56b-4f56-8d5a-cf711ca84b06-kube-api-access-sphpf\") pod \"opendatahub-operator-controller-manager-bc868665f-tfrtk\" (UID: \"6c316188-d56b-4f56-8d5a-cf711ca84b06\") " pod="opendatahub/opendatahub-operator-controller-manager-bc868665f-tfrtk" Jun 14 14:47:06.619025 ip-10-0-129-116 kubenswrapper[2546]: I0614 14:47:06.619002 2546 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c96gx_105377da-c223-41ad-b033-546cb01239c4/konnectivity-agent/0.log" limit=1024 Jun 14 14:47:06.719721 ip-10-0-129-116 kubenswrapper[2546]: I0614 14:47:06.719639 2546 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c96gx_105377da-c223-41ad-b033-546cb01239c4/konnectivity-agent/0.log" limit=1024 Jun 14 14:47:06.805751 ip-10-0-129-116 kubenswrapper[2546]: I0614 14:47:06.805716 2546 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-bc868665f-tfrtk" Jun 14 14:47:06.819703 ip-10-0-129-116 kubenswrapper[2546]: I0614 14:47:06.819674 2546 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c96gx_105377da-c223-41ad-b033-546cb01239c4/konnectivity-agent/0.log" limit=1024 Jun 14 14:47:06.920334 ip-10-0-129-116 kubenswrapper[2546]: I0614 14:47:06.920304 2546 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c96gx_105377da-c223-41ad-b033-546cb01239c4/konnectivity-agent/0.log" limit=1024 Jun 14 14:47:06.952571 ip-10-0-129-116 kubenswrapper[2546]: I0614 14:47:06.952543 2546 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-bc868665f-tfrtk"] Jun 14 14:47:06.955830 ip-10-0-129-116 kubenswrapper[2546]: W0614 14:47:06.955799 2546 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6c316188_d56b_4f56_8d5a_cf711ca84b06.slice/crio-25b5fc2af5095ce02adf77500be3b2f281b5cc79da598981ddc5e64491a71390 WatchSource:0}: Error finding container 25b5fc2af5095ce02adf77500be3b2f281b5cc79da598981ddc5e64491a71390: Status 404 returned error can't find the container with id 25b5fc2af5095ce02adf77500be3b2f281b5cc79da598981ddc5e64491a71390 Jun 14 14:47:07.023125 ip-10-0-129-116 kubenswrapper[2546]: I0614 14:47:07.023011 2546 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c96gx_105377da-c223-41ad-b033-546cb01239c4/konnectivity-agent/0.log" limit=1024 Jun 14 14:47:07.130417 ip-10-0-129-116 kubenswrapper[2546]: I0614 14:47:07.130387 2546 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c96gx_105377da-c223-41ad-b033-546cb01239c4/konnectivity-agent/0.log" limit=1024 Jun 14 14:47:07.888907 ip-10-0-129-116 kubenswrapper[2546]: I0614 14:47:07.888856 2546 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-bc868665f-tfrtk" event={"ID":"6c316188-d56b-4f56-8d5a-cf711ca84b06","Type":"ContainerStarted","Data":"25b5fc2af5095ce02adf77500be3b2f281b5cc79da598981ddc5e64491a71390"} Jun 14 14:47:09.899762 ip-10-0-129-116 kubenswrapper[2546]: I0614 14:47:09.899731 2546 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-bc868665f-tfrtk" event={"ID":"6c316188-d56b-4f56-8d5a-cf711ca84b06","Type":"ContainerStarted","Data":"cfa238f44520b37ac51bca1eca5739fa06547bb726fc370c06e5c5701acad26a"} Jun 14 14:47:10.905754 ip-10-0-129-116 kubenswrapper[2546]: I0614 14:47:10.905719 2546 generic.go:356] "Generic (PLEG): container finished" podID="6c316188-d56b-4f56-8d5a-cf711ca84b06" containerID="cfa238f44520b37ac51bca1eca5739fa06547bb726fc370c06e5c5701acad26a" exitCode=0 Jun 14 14:47:10.906197 ip-10-0-129-116 kubenswrapper[2546]: I0614 14:47:10.905804 2546 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-bc868665f-tfrtk" event={"ID":"6c316188-d56b-4f56-8d5a-cf711ca84b06","Type":"ContainerDied","Data":"cfa238f44520b37ac51bca1eca5739fa06547bb726fc370c06e5c5701acad26a"} Jun 14 14:47:11.912920 ip-10-0-129-116 kubenswrapper[2546]: I0614 14:47:11.912887 2546 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-bc868665f-tfrtk" event={"ID":"6c316188-d56b-4f56-8d5a-cf711ca84b06","Type":"ContainerStarted","Data":"4c1c2eab644c4bb7ed63bd9c6f734661563335873260d5f1800e7b9c1a8b3cc8"} Jun 14 14:47:11.913411 ip-10-0-129-116 kubenswrapper[2546]: I0614 14:47:11.912981 2546 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/opendatahub-operator-controller-manager-bc868665f-tfrtk" Jun 14 14:47:11.935103 ip-10-0-129-116 kubenswrapper[2546]: I0614 14:47:11.935038 2546 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/opendatahub-operator-controller-manager-bc868665f-tfrtk" podStartSLOduration=1.8262283099999999 podStartE2EDuration="5.935022349s" totalImagesPullingTime="3.158279108s" totalInitContainerRuntime="950.514931ms" isStatefulPod=false podCreationTimestamp="2026-06-14 14:47:06 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-14 14:47:11.933643845 +0000 UTC m=+469.262025995" watchObservedRunningTime="2026-06-14 14:47:11.935022349 +0000 UTC m=+469.263404478" Jun 14 14:47:12.055591 ip-10-0-129-116 kubenswrapper[2546]: I0614 14:47:12.055556 2546 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c96gx_105377da-c223-41ad-b033-546cb01239c4/konnectivity-agent/0.log" limit=1024 Jun 14 14:47:12.154922 ip-10-0-129-116 kubenswrapper[2546]: I0614 14:47:12.154884 2546 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c96gx_105377da-c223-41ad-b033-546cb01239c4/konnectivity-agent/0.log" limit=1024 Jun 14 14:47:17.089983 ip-10-0-129-116 kubenswrapper[2546]: I0614 14:47:17.089948 2546 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c96gx_105377da-c223-41ad-b033-546cb01239c4/konnectivity-agent/0.log" limit=1024 Jun 14 14:47:17.190440 ip-10-0-129-116 kubenswrapper[2546]: I0614 14:47:17.190406 2546 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c96gx_105377da-c223-41ad-b033-546cb01239c4/konnectivity-agent/0.log" limit=1024 Jun 14 14:47:22.920704 ip-10-0-129-116 kubenswrapper[2546]: I0614 14:47:22.920674 2546 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/opendatahub-operator-controller-manager-bc868665f-tfrtk" Jun 14 14:47:25.450672 ip-10-0-129-116 kubenswrapper[2546]: I0614 14:47:25.450637 2546 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c96gx_105377da-c223-41ad-b033-546cb01239c4/konnectivity-agent/0.log" limit=1024 Jun 14 14:47:25.580476 ip-10-0-129-116 kubenswrapper[2546]: I0614 14:47:25.580440 2546 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c96gx_105377da-c223-41ad-b033-546cb01239c4/konnectivity-agent/0.log" limit=1024 Jun 14 14:47:25.716216 ip-10-0-129-116 kubenswrapper[2546]: I0614 14:47:25.716122 2546 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c96gx_105377da-c223-41ad-b033-546cb01239c4/konnectivity-agent/0.log" limit=1024 Jun 14 14:47:25.815223 ip-10-0-129-116 kubenswrapper[2546]: I0614 14:47:25.815192 2546 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c96gx_105377da-c223-41ad-b033-546cb01239c4/konnectivity-agent/0.log" limit=1024 Jun 14 14:47:25.879312 ip-10-0-129-116 kubenswrapper[2546]: I0614 14:47:25.879278 2546 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/kube-auth-proxy-798fd884dc-sfmg8"] Jun 14 14:47:25.887759 ip-10-0-129-116 kubenswrapper[2546]: I0614 14:47:25.887733 2546 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/kube-auth-proxy-798fd884dc-sfmg8" Jun 14 14:47:25.890287 ip-10-0-129-116 kubenswrapper[2546]: I0614 14:47:25.890254 2546 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-tls\"" Jun 14 14:47:25.890430 ip-10-0-129-116 kubenswrapper[2546]: I0614 14:47:25.890339 2546 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-creds\"" Jun 14 14:47:25.890430 ip-10-0-129-116 kubenswrapper[2546]: I0614 14:47:25.890352 2546 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-dockercfg-tkjx6\"" Jun 14 14:47:25.894365 ip-10-0-129-116 kubenswrapper[2546]: I0614 14:47:25.894337 2546 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/kube-auth-proxy-798fd884dc-sfmg8"] Jun 14 14:47:25.971073 ip-10-0-129-116 kubenswrapper[2546]: I0614 14:47:25.970992 2546 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vdd8v\" (UniqueName: \"kubernetes.io/projected/7f9b72d9-93ee-4abf-a191-211ea84592c2-kube-api-access-vdd8v\") pod \"kube-auth-proxy-798fd884dc-sfmg8\" (UID: \"7f9b72d9-93ee-4abf-a191-211ea84592c2\") " pod="openshift-ingress/kube-auth-proxy-798fd884dc-sfmg8" Jun 14 14:47:25.971073 ip-10-0-129-116 kubenswrapper[2546]: I0614 14:47:25.971051 2546 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/7f9b72d9-93ee-4abf-a191-211ea84592c2-tls-certs\") pod \"kube-auth-proxy-798fd884dc-sfmg8\" (UID: \"7f9b72d9-93ee-4abf-a191-211ea84592c2\") " pod="openshift-ingress/kube-auth-proxy-798fd884dc-sfmg8" Jun 14 14:47:25.971312 ip-10-0-129-116 kubenswrapper[2546]: I0614 14:47:25.971151 2546 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/7f9b72d9-93ee-4abf-a191-211ea84592c2-tmp\") pod \"kube-auth-proxy-798fd884dc-sfmg8\" (UID: \"7f9b72d9-93ee-4abf-a191-211ea84592c2\") " pod="openshift-ingress/kube-auth-proxy-798fd884dc-sfmg8" Jun 14 14:47:26.072227 ip-10-0-129-116 kubenswrapper[2546]: I0614 14:47:26.072192 2546 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vdd8v\" (UniqueName: \"kubernetes.io/projected/7f9b72d9-93ee-4abf-a191-211ea84592c2-kube-api-access-vdd8v\") pod \"kube-auth-proxy-798fd884dc-sfmg8\" (UID: \"7f9b72d9-93ee-4abf-a191-211ea84592c2\") " pod="openshift-ingress/kube-auth-proxy-798fd884dc-sfmg8" Jun 14 14:47:26.072471 ip-10-0-129-116 kubenswrapper[2546]: I0614 14:47:26.072276 2546 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/7f9b72d9-93ee-4abf-a191-211ea84592c2-tls-certs\") pod \"kube-auth-proxy-798fd884dc-sfmg8\" (UID: \"7f9b72d9-93ee-4abf-a191-211ea84592c2\") " pod="openshift-ingress/kube-auth-proxy-798fd884dc-sfmg8" Jun 14 14:47:26.072471 ip-10-0-129-116 kubenswrapper[2546]: I0614 14:47:26.072311 2546 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/7f9b72d9-93ee-4abf-a191-211ea84592c2-tmp\") pod \"kube-auth-proxy-798fd884dc-sfmg8\" (UID: \"7f9b72d9-93ee-4abf-a191-211ea84592c2\") " pod="openshift-ingress/kube-auth-proxy-798fd884dc-sfmg8" Jun 14 14:47:26.072706 ip-10-0-129-116 kubenswrapper[2546]: E0614 14:47:26.072677 2546 secret.go:189] Couldn't get secret openshift-ingress/kube-auth-proxy-tls: secret "kube-auth-proxy-tls" not found Jun 14 14:47:26.072828 ip-10-0-129-116 kubenswrapper[2546]: E0614 14:47:26.072774 2546 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/7f9b72d9-93ee-4abf-a191-211ea84592c2-tls-certs podName:7f9b72d9-93ee-4abf-a191-211ea84592c2 nodeName:}" failed. No retries permitted until 2026-06-14 14:47:26.572751872 +0000 UTC m=+483.901133999 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "tls-certs" (UniqueName: "kubernetes.io/secret/7f9b72d9-93ee-4abf-a191-211ea84592c2-tls-certs") pod "kube-auth-proxy-798fd884dc-sfmg8" (UID: "7f9b72d9-93ee-4abf-a191-211ea84592c2") : secret "kube-auth-proxy-tls" not found Jun 14 14:47:26.074975 ip-10-0-129-116 kubenswrapper[2546]: I0614 14:47:26.074955 2546 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/7f9b72d9-93ee-4abf-a191-211ea84592c2-tmp\") pod \"kube-auth-proxy-798fd884dc-sfmg8\" (UID: \"7f9b72d9-93ee-4abf-a191-211ea84592c2\") " pod="openshift-ingress/kube-auth-proxy-798fd884dc-sfmg8" Jun 14 14:47:26.083504 ip-10-0-129-116 kubenswrapper[2546]: I0614 14:47:26.083485 2546 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-vdd8v\" (UniqueName: \"kubernetes.io/projected/7f9b72d9-93ee-4abf-a191-211ea84592c2-kube-api-access-vdd8v\") pod \"kube-auth-proxy-798fd884dc-sfmg8\" (UID: \"7f9b72d9-93ee-4abf-a191-211ea84592c2\") " pod="openshift-ingress/kube-auth-proxy-798fd884dc-sfmg8" Jun 14 14:47:26.105776 ip-10-0-129-116 kubenswrapper[2546]: I0614 14:47:26.105748 2546 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c96gx_105377da-c223-41ad-b033-546cb01239c4/konnectivity-agent/0.log" limit=1024 Jun 14 14:47:26.174547 ip-10-0-129-116 kubenswrapper[2546]: I0614 14:47:26.174509 2546 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/odh-model-controller-6dc94f689f-c2526"] Jun 14 14:47:26.180218 ip-10-0-129-116 kubenswrapper[2546]: I0614 14:47:26.180185 2546 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/odh-model-controller-6dc94f689f-c2526" Jun 14 14:47:26.183258 ip-10-0-129-116 kubenswrapper[2546]: I0614 14:47:26.183234 2546 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"odh-model-controller-webhook-cert\"" Jun 14 14:47:26.183366 ip-10-0-129-116 kubenswrapper[2546]: I0614 14:47:26.183339 2546 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"odh-model-controller-dockercfg-v9vtq\"" Jun 14 14:47:26.200066 ip-10-0-129-116 kubenswrapper[2546]: I0614 14:47:26.200038 2546 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/odh-model-controller-6dc94f689f-c2526"] Jun 14 14:47:26.257745 ip-10-0-129-116 kubenswrapper[2546]: I0614 14:47:26.257656 2546 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-lws-operator/lws-controller-manager-58654d7f68-ps2wt"] Jun 14 14:47:26.261260 ip-10-0-129-116 kubenswrapper[2546]: I0614 14:47:26.261230 2546 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/lws-controller-manager-58654d7f68-ps2wt" Jun 14 14:47:26.265227 ip-10-0-129-116 kubenswrapper[2546]: I0614 14:47:26.265207 2546 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"webhook-server-cert\"" Jun 14 14:47:26.265376 ip-10-0-129-116 kubenswrapper[2546]: I0614 14:47:26.265256 2546 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c96gx_105377da-c223-41ad-b033-546cb01239c4/konnectivity-agent/0.log" limit=1024 Jun 14 14:47:26.265446 ip-10-0-129-116 kubenswrapper[2546]: I0614 14:47:26.265397 2546 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"lws-controller-manager-dockercfg-xp662\"" Jun 14 14:47:26.265546 ip-10-0-129-116 kubenswrapper[2546]: I0614 14:47:26.265524 2546 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"lws-manager-config\"" Jun 14 14:47:26.265670 ip-10-0-129-116 kubenswrapper[2546]: I0614 14:47:26.265568 2546 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"kube-root-ca.crt\"" Jun 14 14:47:26.265670 ip-10-0-129-116 kubenswrapper[2546]: I0614 14:47:26.265581 2546 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"openshift-service-ca.crt\"" Jun 14 14:47:26.265942 ip-10-0-129-116 kubenswrapper[2546]: I0614 14:47:26.265927 2546 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"metrics-server-cert\"" Jun 14 14:47:26.273209 ip-10-0-129-116 kubenswrapper[2546]: I0614 14:47:26.273187 2546 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-z2dwz\" (UniqueName: \"kubernetes.io/projected/dee119e9-d2cf-46a4-8793-a2d830339670-kube-api-access-z2dwz\") pod \"odh-model-controller-6dc94f689f-c2526\" (UID: \"dee119e9-d2cf-46a4-8793-a2d830339670\") " pod="opendatahub/odh-model-controller-6dc94f689f-c2526" Jun 14 14:47:26.273322 ip-10-0-129-116 kubenswrapper[2546]: I0614 14:47:26.273277 2546 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/dee119e9-d2cf-46a4-8793-a2d830339670-cert\") pod \"odh-model-controller-6dc94f689f-c2526\" (UID: \"dee119e9-d2cf-46a4-8793-a2d830339670\") " pod="opendatahub/odh-model-controller-6dc94f689f-c2526" Jun 14 14:47:26.283339 ip-10-0-129-116 kubenswrapper[2546]: I0614 14:47:26.283319 2546 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/lws-controller-manager-58654d7f68-ps2wt"] Jun 14 14:47:26.344225 ip-10-0-129-116 kubenswrapper[2546]: I0614 14:47:26.344175 2546 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c96gx_105377da-c223-41ad-b033-546cb01239c4/konnectivity-agent/0.log" limit=1024 Jun 14 14:47:26.374292 ip-10-0-129-116 kubenswrapper[2546]: I0614 14:47:26.374264 2546 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/adb47ea6-1805-4a7b-b16d-5a880b7ac51d-manager-config\") pod \"lws-controller-manager-58654d7f68-ps2wt\" (UID: \"adb47ea6-1805-4a7b-b16d-5a880b7ac51d\") " pod="openshift-lws-operator/lws-controller-manager-58654d7f68-ps2wt" Jun 14 14:47:26.374451 ip-10-0-129-116 kubenswrapper[2546]: I0614 14:47:26.374303 2546 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-z2dwz\" (UniqueName: \"kubernetes.io/projected/dee119e9-d2cf-46a4-8793-a2d830339670-kube-api-access-z2dwz\") pod \"odh-model-controller-6dc94f689f-c2526\" (UID: \"dee119e9-d2cf-46a4-8793-a2d830339670\") " pod="opendatahub/odh-model-controller-6dc94f689f-c2526" Jun 14 14:47:26.374451 ip-10-0-129-116 kubenswrapper[2546]: I0614 14:47:26.374342 2546 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/adb47ea6-1805-4a7b-b16d-5a880b7ac51d-metrics-cert\") pod \"lws-controller-manager-58654d7f68-ps2wt\" (UID: \"adb47ea6-1805-4a7b-b16d-5a880b7ac51d\") " pod="openshift-lws-operator/lws-controller-manager-58654d7f68-ps2wt" Jun 14 14:47:26.374451 ip-10-0-129-116 kubenswrapper[2546]: I0614 14:47:26.374380 2546 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/dee119e9-d2cf-46a4-8793-a2d830339670-cert\") pod \"odh-model-controller-6dc94f689f-c2526\" (UID: \"dee119e9-d2cf-46a4-8793-a2d830339670\") " pod="opendatahub/odh-model-controller-6dc94f689f-c2526" Jun 14 14:47:26.374451 ip-10-0-129-116 kubenswrapper[2546]: I0614 14:47:26.374407 2546 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/adb47ea6-1805-4a7b-b16d-5a880b7ac51d-cert\") pod \"lws-controller-manager-58654d7f68-ps2wt\" (UID: \"adb47ea6-1805-4a7b-b16d-5a880b7ac51d\") " pod="openshift-lws-operator/lws-controller-manager-58654d7f68-ps2wt" Jun 14 14:47:26.374451 ip-10-0-129-116 kubenswrapper[2546]: I0614 14:47:26.374427 2546 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-glgx6\" (UniqueName: \"kubernetes.io/projected/adb47ea6-1805-4a7b-b16d-5a880b7ac51d-kube-api-access-glgx6\") pod \"lws-controller-manager-58654d7f68-ps2wt\" (UID: \"adb47ea6-1805-4a7b-b16d-5a880b7ac51d\") " pod="openshift-lws-operator/lws-controller-manager-58654d7f68-ps2wt" Jun 14 14:47:26.374621 ip-10-0-129-116 kubenswrapper[2546]: E0614 14:47:26.374487 2546 secret.go:189] Couldn't get secret opendatahub/odh-model-controller-webhook-cert: secret "odh-model-controller-webhook-cert" not found Jun 14 14:47:26.374621 ip-10-0-129-116 kubenswrapper[2546]: E0614 14:47:26.374543 2546 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/dee119e9-d2cf-46a4-8793-a2d830339670-cert podName:dee119e9-d2cf-46a4-8793-a2d830339670 nodeName:}" failed. No retries permitted until 2026-06-14 14:47:26.874528457 +0000 UTC m=+484.202910559 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/dee119e9-d2cf-46a4-8793-a2d830339670-cert") pod "odh-model-controller-6dc94f689f-c2526" (UID: "dee119e9-d2cf-46a4-8793-a2d830339670") : secret "odh-model-controller-webhook-cert" not found Jun 14 14:47:26.394239 ip-10-0-129-116 kubenswrapper[2546]: I0614 14:47:26.394211 2546 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-z2dwz\" (UniqueName: \"kubernetes.io/projected/dee119e9-d2cf-46a4-8793-a2d830339670-kube-api-access-z2dwz\") pod \"odh-model-controller-6dc94f689f-c2526\" (UID: \"dee119e9-d2cf-46a4-8793-a2d830339670\") " pod="opendatahub/odh-model-controller-6dc94f689f-c2526" Jun 14 14:47:26.447585 ip-10-0-129-116 kubenswrapper[2546]: I0614 14:47:26.447551 2546 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c96gx_105377da-c223-41ad-b033-546cb01239c4/konnectivity-agent/0.log" limit=1024 Jun 14 14:47:26.475310 ip-10-0-129-116 kubenswrapper[2546]: I0614 14:47:26.475278 2546 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/adb47ea6-1805-4a7b-b16d-5a880b7ac51d-manager-config\") pod \"lws-controller-manager-58654d7f68-ps2wt\" (UID: \"adb47ea6-1805-4a7b-b16d-5a880b7ac51d\") " pod="openshift-lws-operator/lws-controller-manager-58654d7f68-ps2wt" Jun 14 14:47:26.475638 ip-10-0-129-116 kubenswrapper[2546]: I0614 14:47:26.475332 2546 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/adb47ea6-1805-4a7b-b16d-5a880b7ac51d-metrics-cert\") pod \"lws-controller-manager-58654d7f68-ps2wt\" (UID: \"adb47ea6-1805-4a7b-b16d-5a880b7ac51d\") " pod="openshift-lws-operator/lws-controller-manager-58654d7f68-ps2wt" Jun 14 14:47:26.475638 ip-10-0-129-116 kubenswrapper[2546]: I0614 14:47:26.475386 2546 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/adb47ea6-1805-4a7b-b16d-5a880b7ac51d-cert\") pod \"lws-controller-manager-58654d7f68-ps2wt\" (UID: \"adb47ea6-1805-4a7b-b16d-5a880b7ac51d\") " pod="openshift-lws-operator/lws-controller-manager-58654d7f68-ps2wt" Jun 14 14:47:26.475638 ip-10-0-129-116 kubenswrapper[2546]: I0614 14:47:26.475404 2546 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-glgx6\" (UniqueName: \"kubernetes.io/projected/adb47ea6-1805-4a7b-b16d-5a880b7ac51d-kube-api-access-glgx6\") pod \"lws-controller-manager-58654d7f68-ps2wt\" (UID: \"adb47ea6-1805-4a7b-b16d-5a880b7ac51d\") " pod="openshift-lws-operator/lws-controller-manager-58654d7f68-ps2wt" Jun 14 14:47:26.476001 ip-10-0-129-116 kubenswrapper[2546]: I0614 14:47:26.475980 2546 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/adb47ea6-1805-4a7b-b16d-5a880b7ac51d-manager-config\") pod \"lws-controller-manager-58654d7f68-ps2wt\" (UID: \"adb47ea6-1805-4a7b-b16d-5a880b7ac51d\") " pod="openshift-lws-operator/lws-controller-manager-58654d7f68-ps2wt" Jun 14 14:47:26.477792 ip-10-0-129-116 kubenswrapper[2546]: I0614 14:47:26.477767 2546 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/adb47ea6-1805-4a7b-b16d-5a880b7ac51d-metrics-cert\") pod \"lws-controller-manager-58654d7f68-ps2wt\" (UID: \"adb47ea6-1805-4a7b-b16d-5a880b7ac51d\") " pod="openshift-lws-operator/lws-controller-manager-58654d7f68-ps2wt" Jun 14 14:47:26.477897 ip-10-0-129-116 kubenswrapper[2546]: I0614 14:47:26.477795 2546 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/adb47ea6-1805-4a7b-b16d-5a880b7ac51d-cert\") pod \"lws-controller-manager-58654d7f68-ps2wt\" (UID: \"adb47ea6-1805-4a7b-b16d-5a880b7ac51d\") " pod="openshift-lws-operator/lws-controller-manager-58654d7f68-ps2wt" Jun 14 14:47:26.483259 ip-10-0-129-116 kubenswrapper[2546]: I0614 14:47:26.483229 2546 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-glgx6\" (UniqueName: \"kubernetes.io/projected/adb47ea6-1805-4a7b-b16d-5a880b7ac51d-kube-api-access-glgx6\") pod \"lws-controller-manager-58654d7f68-ps2wt\" (UID: \"adb47ea6-1805-4a7b-b16d-5a880b7ac51d\") " pod="openshift-lws-operator/lws-controller-manager-58654d7f68-ps2wt" Jun 14 14:47:26.545329 ip-10-0-129-116 kubenswrapper[2546]: I0614 14:47:26.545211 2546 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c96gx_105377da-c223-41ad-b033-546cb01239c4/konnectivity-agent/0.log" limit=1024 Jun 14 14:47:26.572384 ip-10-0-129-116 kubenswrapper[2546]: I0614 14:47:26.572346 2546 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/lws-controller-manager-58654d7f68-ps2wt" Jun 14 14:47:26.576818 ip-10-0-129-116 kubenswrapper[2546]: I0614 14:47:26.576462 2546 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/7f9b72d9-93ee-4abf-a191-211ea84592c2-tls-certs\") pod \"kube-auth-proxy-798fd884dc-sfmg8\" (UID: \"7f9b72d9-93ee-4abf-a191-211ea84592c2\") " pod="openshift-ingress/kube-auth-proxy-798fd884dc-sfmg8" Jun 14 14:47:26.578742 ip-10-0-129-116 kubenswrapper[2546]: I0614 14:47:26.578723 2546 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/7f9b72d9-93ee-4abf-a191-211ea84592c2-tls-certs\") pod \"kube-auth-proxy-798fd884dc-sfmg8\" (UID: \"7f9b72d9-93ee-4abf-a191-211ea84592c2\") " pod="openshift-ingress/kube-auth-proxy-798fd884dc-sfmg8" Jun 14 14:47:26.706162 ip-10-0-129-116 kubenswrapper[2546]: I0614 14:47:26.706055 2546 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/lws-controller-manager-58654d7f68-ps2wt"] Jun 14 14:47:26.710611 ip-10-0-129-116 kubenswrapper[2546]: W0614 14:47:26.710583 2546 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podadb47ea6_1805_4a7b_b16d_5a880b7ac51d.slice/crio-474574e7587617411f5ae692fa4810a565cf58cc392c34efadb406d028b8cc9d WatchSource:0}: Error finding container 474574e7587617411f5ae692fa4810a565cf58cc392c34efadb406d028b8cc9d: Status 404 returned error can't find the container with id 474574e7587617411f5ae692fa4810a565cf58cc392c34efadb406d028b8cc9d Jun 14 14:47:26.800268 ip-10-0-129-116 kubenswrapper[2546]: I0614 14:47:26.800180 2546 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/kube-auth-proxy-798fd884dc-sfmg8" Jun 14 14:47:26.878922 ip-10-0-129-116 kubenswrapper[2546]: I0614 14:47:26.878889 2546 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/dee119e9-d2cf-46a4-8793-a2d830339670-cert\") pod \"odh-model-controller-6dc94f689f-c2526\" (UID: \"dee119e9-d2cf-46a4-8793-a2d830339670\") " pod="opendatahub/odh-model-controller-6dc94f689f-c2526" Jun 14 14:47:26.881620 ip-10-0-129-116 kubenswrapper[2546]: I0614 14:47:26.881593 2546 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/dee119e9-d2cf-46a4-8793-a2d830339670-cert\") pod \"odh-model-controller-6dc94f689f-c2526\" (UID: \"dee119e9-d2cf-46a4-8793-a2d830339670\") " pod="opendatahub/odh-model-controller-6dc94f689f-c2526" Jun 14 14:47:26.906847 ip-10-0-129-116 kubenswrapper[2546]: I0614 14:47:26.906804 2546 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c96gx_105377da-c223-41ad-b033-546cb01239c4/konnectivity-agent/0.log" limit=1024 Jun 14 14:47:26.942963 ip-10-0-129-116 kubenswrapper[2546]: I0614 14:47:26.942900 2546 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/kube-auth-proxy-798fd884dc-sfmg8"] Jun 14 14:47:26.945653 ip-10-0-129-116 kubenswrapper[2546]: W0614 14:47:26.945622 2546 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7f9b72d9_93ee_4abf_a191_211ea84592c2.slice/crio-5f12f26241a0e1e1eb318b7ffad314733e27e96ce6b039500fce0e60d9aa43fb WatchSource:0}: Error finding container 5f12f26241a0e1e1eb318b7ffad314733e27e96ce6b039500fce0e60d9aa43fb: Status 404 returned error can't find the container with id 5f12f26241a0e1e1eb318b7ffad314733e27e96ce6b039500fce0e60d9aa43fb Jun 14 14:47:26.981411 ip-10-0-129-116 kubenswrapper[2546]: I0614 14:47:26.981380 2546 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/kube-auth-proxy-798fd884dc-sfmg8" event={"ID":"7f9b72d9-93ee-4abf-a191-211ea84592c2","Type":"ContainerStarted","Data":"5f12f26241a0e1e1eb318b7ffad314733e27e96ce6b039500fce0e60d9aa43fb"} Jun 14 14:47:26.982727 ip-10-0-129-116 kubenswrapper[2546]: I0614 14:47:26.982686 2546 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/lws-controller-manager-58654d7f68-ps2wt" event={"ID":"adb47ea6-1805-4a7b-b16d-5a880b7ac51d","Type":"ContainerStarted","Data":"474574e7587617411f5ae692fa4810a565cf58cc392c34efadb406d028b8cc9d"} Jun 14 14:47:27.065645 ip-10-0-129-116 kubenswrapper[2546]: I0614 14:47:27.065567 2546 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-marketplace/4258531154569488b4b06856545cf53ed48b82e88ddd64b4ce22efab06g7t22"] Jun 14 14:47:27.070434 ip-10-0-129-116 kubenswrapper[2546]: I0614 14:47:27.070415 2546 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/4258531154569488b4b06856545cf53ed48b82e88ddd64b4ce22efab06g7t22" Jun 14 14:47:27.072936 ip-10-0-129-116 kubenswrapper[2546]: I0614 14:47:27.072913 2546 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"openshift-service-ca.crt\"" Jun 14 14:47:27.073043 ip-10-0-129-116 kubenswrapper[2546]: I0614 14:47:27.072912 2546 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-marketplace\"/\"default-dockercfg-44x46\"" Jun 14 14:47:27.073182 ip-10-0-129-116 kubenswrapper[2546]: I0614 14:47:27.073166 2546 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"kube-root-ca.crt\"" Jun 14 14:47:27.078073 ip-10-0-129-116 kubenswrapper[2546]: I0614 14:47:27.078050 2546 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/4258531154569488b4b06856545cf53ed48b82e88ddd64b4ce22efab06g7t22"] Jun 14 14:47:27.090484 ip-10-0-129-116 kubenswrapper[2546]: I0614 14:47:27.090447 2546 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/odh-model-controller-6dc94f689f-c2526" Jun 14 14:47:27.181724 ip-10-0-129-116 kubenswrapper[2546]: I0614 14:47:27.181692 2546 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/4ac41e35-55be-4f5c-b770-3b91663f44a8-bundle\") pod \"4258531154569488b4b06856545cf53ed48b82e88ddd64b4ce22efab06g7t22\" (UID: \"4ac41e35-55be-4f5c-b770-3b91663f44a8\") " pod="openshift-marketplace/4258531154569488b4b06856545cf53ed48b82e88ddd64b4ce22efab06g7t22" Jun 14 14:47:27.181845 ip-10-0-129-116 kubenswrapper[2546]: I0614 14:47:27.181738 2546 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/4ac41e35-55be-4f5c-b770-3b91663f44a8-util\") pod \"4258531154569488b4b06856545cf53ed48b82e88ddd64b4ce22efab06g7t22\" (UID: \"4ac41e35-55be-4f5c-b770-3b91663f44a8\") " pod="openshift-marketplace/4258531154569488b4b06856545cf53ed48b82e88ddd64b4ce22efab06g7t22" Jun 14 14:47:27.181918 ip-10-0-129-116 kubenswrapper[2546]: I0614 14:47:27.181881 2546 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7hkqw\" (UniqueName: \"kubernetes.io/projected/4ac41e35-55be-4f5c-b770-3b91663f44a8-kube-api-access-7hkqw\") pod \"4258531154569488b4b06856545cf53ed48b82e88ddd64b4ce22efab06g7t22\" (UID: \"4ac41e35-55be-4f5c-b770-3b91663f44a8\") " pod="openshift-marketplace/4258531154569488b4b06856545cf53ed48b82e88ddd64b4ce22efab06g7t22" Jun 14 14:47:27.231700 ip-10-0-129-116 kubenswrapper[2546]: I0614 14:47:27.231674 2546 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/odh-model-controller-6dc94f689f-c2526"] Jun 14 14:47:27.234372 ip-10-0-129-116 kubenswrapper[2546]: W0614 14:47:27.234343 2546 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poddee119e9_d2cf_46a4_8793_a2d830339670.slice/crio-53d7466e5d55fd2241f0e6ac7a808a8218d5ecab88eedf1c49781b79099848fa WatchSource:0}: Error finding container 53d7466e5d55fd2241f0e6ac7a808a8218d5ecab88eedf1c49781b79099848fa: Status 404 returned error can't find the container with id 53d7466e5d55fd2241f0e6ac7a808a8218d5ecab88eedf1c49781b79099848fa Jun 14 14:47:27.283170 ip-10-0-129-116 kubenswrapper[2546]: I0614 14:47:27.283136 2546 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/4ac41e35-55be-4f5c-b770-3b91663f44a8-bundle\") pod \"4258531154569488b4b06856545cf53ed48b82e88ddd64b4ce22efab06g7t22\" (UID: \"4ac41e35-55be-4f5c-b770-3b91663f44a8\") " pod="openshift-marketplace/4258531154569488b4b06856545cf53ed48b82e88ddd64b4ce22efab06g7t22" Jun 14 14:47:27.283170 ip-10-0-129-116 kubenswrapper[2546]: I0614 14:47:27.283171 2546 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/4ac41e35-55be-4f5c-b770-3b91663f44a8-util\") pod \"4258531154569488b4b06856545cf53ed48b82e88ddd64b4ce22efab06g7t22\" (UID: \"4ac41e35-55be-4f5c-b770-3b91663f44a8\") " pod="openshift-marketplace/4258531154569488b4b06856545cf53ed48b82e88ddd64b4ce22efab06g7t22" Jun 14 14:47:27.283396 ip-10-0-129-116 kubenswrapper[2546]: I0614 14:47:27.283230 2546 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7hkqw\" (UniqueName: \"kubernetes.io/projected/4ac41e35-55be-4f5c-b770-3b91663f44a8-kube-api-access-7hkqw\") pod \"4258531154569488b4b06856545cf53ed48b82e88ddd64b4ce22efab06g7t22\" (UID: \"4ac41e35-55be-4f5c-b770-3b91663f44a8\") " pod="openshift-marketplace/4258531154569488b4b06856545cf53ed48b82e88ddd64b4ce22efab06g7t22" Jun 14 14:47:27.283544 ip-10-0-129-116 kubenswrapper[2546]: I0614 14:47:27.283518 2546 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/4ac41e35-55be-4f5c-b770-3b91663f44a8-bundle\") pod \"4258531154569488b4b06856545cf53ed48b82e88ddd64b4ce22efab06g7t22\" (UID: \"4ac41e35-55be-4f5c-b770-3b91663f44a8\") " pod="openshift-marketplace/4258531154569488b4b06856545cf53ed48b82e88ddd64b4ce22efab06g7t22" Jun 14 14:47:27.283594 ip-10-0-129-116 kubenswrapper[2546]: I0614 14:47:27.283575 2546 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/4ac41e35-55be-4f5c-b770-3b91663f44a8-util\") pod \"4258531154569488b4b06856545cf53ed48b82e88ddd64b4ce22efab06g7t22\" (UID: \"4ac41e35-55be-4f5c-b770-3b91663f44a8\") " pod="openshift-marketplace/4258531154569488b4b06856545cf53ed48b82e88ddd64b4ce22efab06g7t22" Jun 14 14:47:27.291897 ip-10-0-129-116 kubenswrapper[2546]: I0614 14:47:27.291867 2546 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-7hkqw\" (UniqueName: \"kubernetes.io/projected/4ac41e35-55be-4f5c-b770-3b91663f44a8-kube-api-access-7hkqw\") pod \"4258531154569488b4b06856545cf53ed48b82e88ddd64b4ce22efab06g7t22\" (UID: \"4ac41e35-55be-4f5c-b770-3b91663f44a8\") " pod="openshift-marketplace/4258531154569488b4b06856545cf53ed48b82e88ddd64b4ce22efab06g7t22" Jun 14 14:47:27.347451 ip-10-0-129-116 kubenswrapper[2546]: I0614 14:47:27.347372 2546 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c96gx_105377da-c223-41ad-b033-546cb01239c4/konnectivity-agent/0.log" limit=1024 Jun 14 14:47:27.398577 ip-10-0-129-116 kubenswrapper[2546]: I0614 14:47:27.398546 2546 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/4258531154569488b4b06856545cf53ed48b82e88ddd64b4ce22efab06g7t22" Jun 14 14:47:27.568828 ip-10-0-129-116 kubenswrapper[2546]: I0614 14:47:27.568795 2546 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/4258531154569488b4b06856545cf53ed48b82e88ddd64b4ce22efab06g7t22"] Jun 14 14:47:27.572170 ip-10-0-129-116 kubenswrapper[2546]: W0614 14:47:27.572109 2546 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4ac41e35_55be_4f5c_b770_3b91663f44a8.slice/crio-a10d841b4d27ae13dcb5726fb984cb4d3fc207846960c491af5e9a0c6bc32918 WatchSource:0}: Error finding container a10d841b4d27ae13dcb5726fb984cb4d3fc207846960c491af5e9a0c6bc32918: Status 404 returned error can't find the container with id a10d841b4d27ae13dcb5726fb984cb4d3fc207846960c491af5e9a0c6bc32918 Jun 14 14:47:27.998062 ip-10-0-129-116 kubenswrapper[2546]: I0614 14:47:27.998009 2546 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/odh-model-controller-6dc94f689f-c2526" event={"ID":"dee119e9-d2cf-46a4-8793-a2d830339670","Type":"ContainerStarted","Data":"53d7466e5d55fd2241f0e6ac7a808a8218d5ecab88eedf1c49781b79099848fa"} Jun 14 14:47:28.001473 ip-10-0-129-116 kubenswrapper[2546]: I0614 14:47:28.001444 2546 generic.go:356] "Generic (PLEG): container finished" podID="4ac41e35-55be-4f5c-b770-3b91663f44a8" containerID="293ae82beef856877d388845916132bd27a7b7c392841b5e43ee9b5fe620a954" exitCode=0 Jun 14 14:47:28.001593 ip-10-0-129-116 kubenswrapper[2546]: I0614 14:47:28.001514 2546 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/4258531154569488b4b06856545cf53ed48b82e88ddd64b4ce22efab06g7t22" event={"ID":"4ac41e35-55be-4f5c-b770-3b91663f44a8","Type":"ContainerDied","Data":"293ae82beef856877d388845916132bd27a7b7c392841b5e43ee9b5fe620a954"} Jun 14 14:47:28.001593 ip-10-0-129-116 kubenswrapper[2546]: I0614 14:47:28.001555 2546 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/4258531154569488b4b06856545cf53ed48b82e88ddd64b4ce22efab06g7t22" event={"ID":"4ac41e35-55be-4f5c-b770-3b91663f44a8","Type":"ContainerStarted","Data":"a10d841b4d27ae13dcb5726fb984cb4d3fc207846960c491af5e9a0c6bc32918"} Jun 14 14:47:32.026793 ip-10-0-129-116 kubenswrapper[2546]: I0614 14:47:32.026709 2546 generic.go:356] "Generic (PLEG): container finished" podID="4ac41e35-55be-4f5c-b770-3b91663f44a8" containerID="cf3a3d65836efc61ad5e94e696ae7d5d179385ebbc33d9575f42c08df56def83" exitCode=0 Jun 14 14:47:32.027223 ip-10-0-129-116 kubenswrapper[2546]: I0614 14:47:32.026791 2546 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/4258531154569488b4b06856545cf53ed48b82e88ddd64b4ce22efab06g7t22" event={"ID":"4ac41e35-55be-4f5c-b770-3b91663f44a8","Type":"ContainerDied","Data":"cf3a3d65836efc61ad5e94e696ae7d5d179385ebbc33d9575f42c08df56def83"} Jun 14 14:47:32.028519 ip-10-0-129-116 kubenswrapper[2546]: I0614 14:47:32.028496 2546 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/lws-controller-manager-58654d7f68-ps2wt" event={"ID":"adb47ea6-1805-4a7b-b16d-5a880b7ac51d","Type":"ContainerStarted","Data":"45d8c7db2faaa2d65f72e27dd8bf02a1c0a0b2fc8ab031f7f5b41743e713bcee"} Jun 14 14:47:32.028631 ip-10-0-129-116 kubenswrapper[2546]: I0614 14:47:32.028568 2546 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-lws-operator/lws-controller-manager-58654d7f68-ps2wt" Jun 14 14:47:32.030257 ip-10-0-129-116 kubenswrapper[2546]: I0614 14:47:32.030233 2546 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/odh-model-controller-6dc94f689f-c2526" event={"ID":"dee119e9-d2cf-46a4-8793-a2d830339670","Type":"ContainerStarted","Data":"e52a820b970e7f2689549589c03082061d688fb2b7c64a0ef10eec935d034760"} Jun 14 14:47:32.031798 ip-10-0-129-116 kubenswrapper[2546]: I0614 14:47:32.031778 2546 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/kube-auth-proxy-798fd884dc-sfmg8" event={"ID":"7f9b72d9-93ee-4abf-a191-211ea84592c2","Type":"ContainerStarted","Data":"4eb5317a17a2deb811275dcd3af0c18a5b44c6c69b8319af8d7bbecea980e61d"} Jun 14 14:47:32.031899 ip-10-0-129-116 kubenswrapper[2546]: I0614 14:47:32.031877 2546 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/odh-model-controller-6dc94f689f-c2526" Jun 14 14:47:32.056972 ip-10-0-129-116 kubenswrapper[2546]: I0614 14:47:32.056932 2546 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/odh-model-controller-6dc94f689f-c2526" podStartSLOduration=1.541432014 podStartE2EDuration="6.056917746s" totalImagesPullingTime="4.515485732s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-14 14:47:26 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-14 14:47:32.055804318 +0000 UTC m=+489.384186445" watchObservedRunningTime="2026-06-14 14:47:32.056917746 +0000 UTC m=+489.385299870" Jun 14 14:47:32.071492 ip-10-0-129-116 kubenswrapper[2546]: I0614 14:47:32.071444 2546 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-lws-operator/lws-controller-manager-58654d7f68-ps2wt" podStartSLOduration=1.048279169 podStartE2EDuration="6.071428951s" totalImagesPullingTime="5.023149782s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-14 14:47:26 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-14 14:47:32.06984246 +0000 UTC m=+489.398224585" watchObservedRunningTime="2026-06-14 14:47:32.071428951 +0000 UTC m=+489.399811076" Jun 14 14:47:32.086204 ip-10-0-129-116 kubenswrapper[2546]: I0614 14:47:32.086147 2546 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/kube-auth-proxy-798fd884dc-sfmg8" podStartSLOduration=2.297295528 podStartE2EDuration="7.086126654s" totalImagesPullingTime="4.788831126s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-14 14:47:25 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-14 14:47:32.083902585 +0000 UTC m=+489.412284738" watchObservedRunningTime="2026-06-14 14:47:32.086126654 +0000 UTC m=+489.414508780" Jun 14 14:47:33.038832 ip-10-0-129-116 kubenswrapper[2546]: I0614 14:47:33.038746 2546 generic.go:356] "Generic (PLEG): container finished" podID="4ac41e35-55be-4f5c-b770-3b91663f44a8" containerID="bc21d93a7b9487b39254e2c30244c1c968766b80c562ad06228dffdfe849e678" exitCode=0 Jun 14 14:47:33.039215 ip-10-0-129-116 kubenswrapper[2546]: I0614 14:47:33.038826 2546 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/4258531154569488b4b06856545cf53ed48b82e88ddd64b4ce22efab06g7t22" event={"ID":"4ac41e35-55be-4f5c-b770-3b91663f44a8","Type":"ContainerDied","Data":"bc21d93a7b9487b39254e2c30244c1c968766b80c562ad06228dffdfe849e678"} Jun 14 14:47:34.174542 ip-10-0-129-116 kubenswrapper[2546]: I0614 14:47:34.174514 2546 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/4258531154569488b4b06856545cf53ed48b82e88ddd64b4ce22efab06g7t22" Jun 14 14:47:34.246630 ip-10-0-129-116 kubenswrapper[2546]: I0614 14:47:34.246596 2546 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/4ac41e35-55be-4f5c-b770-3b91663f44a8-util\") pod \"4ac41e35-55be-4f5c-b770-3b91663f44a8\" (UID: \"4ac41e35-55be-4f5c-b770-3b91663f44a8\") " Jun 14 14:47:34.246819 ip-10-0-129-116 kubenswrapper[2546]: I0614 14:47:34.246664 2546 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/4ac41e35-55be-4f5c-b770-3b91663f44a8-bundle\") pod \"4ac41e35-55be-4f5c-b770-3b91663f44a8\" (UID: \"4ac41e35-55be-4f5c-b770-3b91663f44a8\") " Jun 14 14:47:34.246819 ip-10-0-129-116 kubenswrapper[2546]: I0614 14:47:34.246693 2546 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-7hkqw\" (UniqueName: \"kubernetes.io/projected/4ac41e35-55be-4f5c-b770-3b91663f44a8-kube-api-access-7hkqw\") pod \"4ac41e35-55be-4f5c-b770-3b91663f44a8\" (UID: \"4ac41e35-55be-4f5c-b770-3b91663f44a8\") " Jun 14 14:47:34.247787 ip-10-0-129-116 kubenswrapper[2546]: I0614 14:47:34.247741 2546 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/4ac41e35-55be-4f5c-b770-3b91663f44a8-bundle" (OuterVolumeSpecName: "bundle") pod "4ac41e35-55be-4f5c-b770-3b91663f44a8" (UID: "4ac41e35-55be-4f5c-b770-3b91663f44a8"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 14 14:47:34.249009 ip-10-0-129-116 kubenswrapper[2546]: I0614 14:47:34.248971 2546 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/4ac41e35-55be-4f5c-b770-3b91663f44a8-kube-api-access-7hkqw" (OuterVolumeSpecName: "kube-api-access-7hkqw") pod "4ac41e35-55be-4f5c-b770-3b91663f44a8" (UID: "4ac41e35-55be-4f5c-b770-3b91663f44a8"). InnerVolumeSpecName "kube-api-access-7hkqw". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 14 14:47:34.251610 ip-10-0-129-116 kubenswrapper[2546]: I0614 14:47:34.251585 2546 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/4ac41e35-55be-4f5c-b770-3b91663f44a8-util" (OuterVolumeSpecName: "util") pod "4ac41e35-55be-4f5c-b770-3b91663f44a8" (UID: "4ac41e35-55be-4f5c-b770-3b91663f44a8"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 14 14:47:34.348336 ip-10-0-129-116 kubenswrapper[2546]: I0614 14:47:34.348260 2546 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/4ac41e35-55be-4f5c-b770-3b91663f44a8-bundle\") on node \"ip-10-0-129-116.ec2.internal\" DevicePath \"\"" Jun 14 14:47:34.348336 ip-10-0-129-116 kubenswrapper[2546]: I0614 14:47:34.348287 2546 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-7hkqw\" (UniqueName: \"kubernetes.io/projected/4ac41e35-55be-4f5c-b770-3b91663f44a8-kube-api-access-7hkqw\") on node \"ip-10-0-129-116.ec2.internal\" DevicePath \"\"" Jun 14 14:47:34.348336 ip-10-0-129-116 kubenswrapper[2546]: I0614 14:47:34.348297 2546 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/4ac41e35-55be-4f5c-b770-3b91663f44a8-util\") on node \"ip-10-0-129-116.ec2.internal\" DevicePath \"\"" Jun 14 14:47:35.050346 ip-10-0-129-116 kubenswrapper[2546]: I0614 14:47:35.050319 2546 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/4258531154569488b4b06856545cf53ed48b82e88ddd64b4ce22efab06g7t22" Jun 14 14:47:35.050525 ip-10-0-129-116 kubenswrapper[2546]: I0614 14:47:35.050347 2546 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/4258531154569488b4b06856545cf53ed48b82e88ddd64b4ce22efab06g7t22" event={"ID":"4ac41e35-55be-4f5c-b770-3b91663f44a8","Type":"ContainerDied","Data":"a10d841b4d27ae13dcb5726fb984cb4d3fc207846960c491af5e9a0c6bc32918"} Jun 14 14:47:35.050525 ip-10-0-129-116 kubenswrapper[2546]: I0614 14:47:35.050401 2546 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="a10d841b4d27ae13dcb5726fb984cb4d3fc207846960c491af5e9a0c6bc32918" Jun 14 14:47:36.498853 ip-10-0-129-116 kubenswrapper[2546]: I0614 14:47:36.498818 2546 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c96gx_105377da-c223-41ad-b033-546cb01239c4/konnectivity-agent/0.log" limit=1024 Jun 14 14:47:36.628485 ip-10-0-129-116 kubenswrapper[2546]: I0614 14:47:36.628441 2546 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c96gx_105377da-c223-41ad-b033-546cb01239c4/konnectivity-agent/0.log" limit=1024 Jun 14 14:47:36.704647 ip-10-0-129-116 kubenswrapper[2546]: I0614 14:47:36.704613 2546 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c96gx_105377da-c223-41ad-b033-546cb01239c4/konnectivity-agent/0.log" limit=1024 Jun 14 14:47:36.767646 ip-10-0-129-116 kubenswrapper[2546]: I0614 14:47:36.767567 2546 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c96gx_105377da-c223-41ad-b033-546cb01239c4/konnectivity-agent/0.log" limit=1024 Jun 14 14:47:37.790246 ip-10-0-129-116 kubenswrapper[2546]: I0614 14:47:37.790199 2546 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c96gx_105377da-c223-41ad-b033-546cb01239c4/konnectivity-agent/0.log" limit=1024 Jun 14 14:47:37.897503 ip-10-0-129-116 kubenswrapper[2546]: I0614 14:47:37.897463 2546 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c96gx_105377da-c223-41ad-b033-546cb01239c4/konnectivity-agent/0.log" limit=1024 Jun 14 14:47:37.990182 ip-10-0-129-116 kubenswrapper[2546]: I0614 14:47:37.990126 2546 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c96gx_105377da-c223-41ad-b033-546cb01239c4/konnectivity-agent/0.log" limit=1024 Jun 14 14:47:40.003797 ip-10-0-129-116 kubenswrapper[2546]: I0614 14:47:40.003755 2546 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c96gx_105377da-c223-41ad-b033-546cb01239c4/konnectivity-agent/0.log" limit=1024 Jun 14 14:47:40.099548 ip-10-0-129-116 kubenswrapper[2546]: I0614 14:47:40.099496 2546 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c96gx_105377da-c223-41ad-b033-546cb01239c4/konnectivity-agent/0.log" limit=1024 Jun 14 14:47:41.051449 ip-10-0-129-116 kubenswrapper[2546]: I0614 14:47:41.051418 2546 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c96gx_105377da-c223-41ad-b033-546cb01239c4/konnectivity-agent/0.log" limit=1024 Jun 14 14:47:41.223843 ip-10-0-129-116 kubenswrapper[2546]: I0614 14:47:41.223812 2546 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762a2j7nw"] Jun 14 14:47:41.224174 ip-10-0-129-116 kubenswrapper[2546]: I0614 14:47:41.224161 2546 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="4ac41e35-55be-4f5c-b770-3b91663f44a8" containerName="pull" Jun 14 14:47:41.224229 ip-10-0-129-116 kubenswrapper[2546]: I0614 14:47:41.224175 2546 state_mem.go:107] "Deleted CPUSet assignment" podUID="4ac41e35-55be-4f5c-b770-3b91663f44a8" containerName="pull" Jun 14 14:47:41.224229 ip-10-0-129-116 kubenswrapper[2546]: I0614 14:47:41.224192 2546 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="4ac41e35-55be-4f5c-b770-3b91663f44a8" containerName="extract" Jun 14 14:47:41.224229 ip-10-0-129-116 kubenswrapper[2546]: I0614 14:47:41.224199 2546 state_mem.go:107] "Deleted CPUSet assignment" podUID="4ac41e35-55be-4f5c-b770-3b91663f44a8" containerName="extract" Jun 14 14:47:41.224229 ip-10-0-129-116 kubenswrapper[2546]: I0614 14:47:41.224210 2546 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="4ac41e35-55be-4f5c-b770-3b91663f44a8" containerName="util" Jun 14 14:47:41.224229 ip-10-0-129-116 kubenswrapper[2546]: I0614 14:47:41.224215 2546 state_mem.go:107] "Deleted CPUSet assignment" podUID="4ac41e35-55be-4f5c-b770-3b91663f44a8" containerName="util" Jun 14 14:47:41.224405 ip-10-0-129-116 kubenswrapper[2546]: I0614 14:47:41.224275 2546 memory_manager.go:368] "RemoveStaleState removing state" podUID="4ac41e35-55be-4f5c-b770-3b91663f44a8" containerName="extract" Jun 14 14:47:41.227442 ip-10-0-129-116 kubenswrapper[2546]: I0614 14:47:41.227412 2546 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762a2j7nw" Jun 14 14:47:41.230188 ip-10-0-129-116 kubenswrapper[2546]: I0614 14:47:41.230162 2546 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-marketplace\"/\"default-dockercfg-44x46\"" Jun 14 14:47:41.230320 ip-10-0-129-116 kubenswrapper[2546]: I0614 14:47:41.230236 2546 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"openshift-service-ca.crt\"" Jun 14 14:47:41.231318 ip-10-0-129-116 kubenswrapper[2546]: I0614 14:47:41.231301 2546 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"kube-root-ca.crt\"" Jun 14 14:47:41.253144 ip-10-0-129-116 kubenswrapper[2546]: I0614 14:47:41.253111 2546 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762a2j7nw"] Jun 14 14:47:41.306571 ip-10-0-129-116 kubenswrapper[2546]: I0614 14:47:41.306475 2546 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/bb1ef793-5393-4d3d-af92-621141e7111b-util\") pod \"c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762a2j7nw\" (UID: \"bb1ef793-5393-4d3d-af92-621141e7111b\") " pod="openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762a2j7nw" Jun 14 14:47:41.306571 ip-10-0-129-116 kubenswrapper[2546]: I0614 14:47:41.306541 2546 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/bb1ef793-5393-4d3d-af92-621141e7111b-bundle\") pod \"c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762a2j7nw\" (UID: \"bb1ef793-5393-4d3d-af92-621141e7111b\") " pod="openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762a2j7nw" Jun 14 14:47:41.306754 ip-10-0-129-116 kubenswrapper[2546]: I0614 14:47:41.306573 2546 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rslfg\" (UniqueName: \"kubernetes.io/projected/bb1ef793-5393-4d3d-af92-621141e7111b-kube-api-access-rslfg\") pod \"c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762a2j7nw\" (UID: \"bb1ef793-5393-4d3d-af92-621141e7111b\") " pod="openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762a2j7nw" Jun 14 14:47:41.407287 ip-10-0-129-116 kubenswrapper[2546]: I0614 14:47:41.407248 2546 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/bb1ef793-5393-4d3d-af92-621141e7111b-util\") pod \"c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762a2j7nw\" (UID: \"bb1ef793-5393-4d3d-af92-621141e7111b\") " pod="openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762a2j7nw" Jun 14 14:47:41.407463 ip-10-0-129-116 kubenswrapper[2546]: I0614 14:47:41.407400 2546 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/bb1ef793-5393-4d3d-af92-621141e7111b-bundle\") pod \"c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762a2j7nw\" (UID: \"bb1ef793-5393-4d3d-af92-621141e7111b\") " pod="openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762a2j7nw" Jun 14 14:47:41.407463 ip-10-0-129-116 kubenswrapper[2546]: I0614 14:47:41.407432 2546 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rslfg\" (UniqueName: \"kubernetes.io/projected/bb1ef793-5393-4d3d-af92-621141e7111b-kube-api-access-rslfg\") pod \"c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762a2j7nw\" (UID: \"bb1ef793-5393-4d3d-af92-621141e7111b\") " pod="openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762a2j7nw" Jun 14 14:47:41.407687 ip-10-0-129-116 kubenswrapper[2546]: I0614 14:47:41.407664 2546 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/bb1ef793-5393-4d3d-af92-621141e7111b-util\") pod \"c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762a2j7nw\" (UID: \"bb1ef793-5393-4d3d-af92-621141e7111b\") " pod="openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762a2j7nw" Jun 14 14:47:41.407742 ip-10-0-129-116 kubenswrapper[2546]: I0614 14:47:41.407685 2546 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/bb1ef793-5393-4d3d-af92-621141e7111b-bundle\") pod \"c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762a2j7nw\" (UID: \"bb1ef793-5393-4d3d-af92-621141e7111b\") " pod="openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762a2j7nw" Jun 14 14:47:41.417585 ip-10-0-129-116 kubenswrapper[2546]: I0614 14:47:41.417553 2546 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-rslfg\" (UniqueName: \"kubernetes.io/projected/bb1ef793-5393-4d3d-af92-621141e7111b-kube-api-access-rslfg\") pod \"c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762a2j7nw\" (UID: \"bb1ef793-5393-4d3d-af92-621141e7111b\") " pod="openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762a2j7nw" Jun 14 14:47:41.537999 ip-10-0-129-116 kubenswrapper[2546]: I0614 14:47:41.537951 2546 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762a2j7nw" Jun 14 14:47:41.685626 ip-10-0-129-116 kubenswrapper[2546]: I0614 14:47:41.685584 2546 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c96gx_105377da-c223-41ad-b033-546cb01239c4/konnectivity-agent/0.log" limit=1024 Jun 14 14:47:41.693821 ip-10-0-129-116 kubenswrapper[2546]: I0614 14:47:41.693791 2546 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762a2j7nw"] Jun 14 14:47:41.695705 ip-10-0-129-116 kubenswrapper[2546]: W0614 14:47:41.695675 2546 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podbb1ef793_5393_4d3d_af92_621141e7111b.slice/crio-fd2a2b5df8e507664d0c07d8eec4d10fd7c02dfc1b8fa0207f1bb26949f0f5ed WatchSource:0}: Error finding container fd2a2b5df8e507664d0c07d8eec4d10fd7c02dfc1b8fa0207f1bb26949f0f5ed: Status 404 returned error can't find the container with id fd2a2b5df8e507664d0c07d8eec4d10fd7c02dfc1b8fa0207f1bb26949f0f5ed Jun 14 14:47:41.991081 ip-10-0-129-116 kubenswrapper[2546]: I0614 14:47:41.991012 2546 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c96gx_105377da-c223-41ad-b033-546cb01239c4/konnectivity-agent/0.log" limit=1024 Jun 14 14:47:42.087619 ip-10-0-129-116 kubenswrapper[2546]: I0614 14:47:42.087586 2546 generic.go:356] "Generic (PLEG): container finished" podID="bb1ef793-5393-4d3d-af92-621141e7111b" containerID="22d5dda4aa72fe5eec8bd249d88377e862bc026d05fd224b3a0ad20b0b139f21" exitCode=0 Jun 14 14:47:42.088010 ip-10-0-129-116 kubenswrapper[2546]: I0614 14:47:42.087663 2546 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762a2j7nw" event={"ID":"bb1ef793-5393-4d3d-af92-621141e7111b","Type":"ContainerDied","Data":"22d5dda4aa72fe5eec8bd249d88377e862bc026d05fd224b3a0ad20b0b139f21"} Jun 14 14:47:42.088010 ip-10-0-129-116 kubenswrapper[2546]: I0614 14:47:42.087709 2546 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762a2j7nw" event={"ID":"bb1ef793-5393-4d3d-af92-621141e7111b","Type":"ContainerStarted","Data":"fd2a2b5df8e507664d0c07d8eec4d10fd7c02dfc1b8fa0207f1bb26949f0f5ed"} Jun 14 14:47:42.304738 ip-10-0-129-116 kubenswrapper[2546]: I0614 14:47:42.304643 2546 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c96gx_105377da-c223-41ad-b033-546cb01239c4/konnectivity-agent/0.log" limit=1024 Jun 14 14:47:42.586488 ip-10-0-129-116 kubenswrapper[2546]: I0614 14:47:42.586402 2546 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c96gx_105377da-c223-41ad-b033-546cb01239c4/konnectivity-agent/0.log" limit=1024 Jun 14 14:47:43.041144 ip-10-0-129-116 kubenswrapper[2546]: I0614 14:47:43.041114 2546 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-lws-operator/lws-controller-manager-58654d7f68-ps2wt" Jun 14 14:47:43.041305 ip-10-0-129-116 kubenswrapper[2546]: I0614 14:47:43.041220 2546 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/odh-model-controller-6dc94f689f-c2526" Jun 14 14:47:44.100688 ip-10-0-129-116 kubenswrapper[2546]: I0614 14:47:44.100652 2546 generic.go:356] "Generic (PLEG): container finished" podID="bb1ef793-5393-4d3d-af92-621141e7111b" containerID="32d894414eb286bbea2b2481c30d59b9e6365f8cbb259b4fd4b900b4510c21ab" exitCode=0 Jun 14 14:47:44.101076 ip-10-0-129-116 kubenswrapper[2546]: I0614 14:47:44.100724 2546 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762a2j7nw" event={"ID":"bb1ef793-5393-4d3d-af92-621141e7111b","Type":"ContainerDied","Data":"32d894414eb286bbea2b2481c30d59b9e6365f8cbb259b4fd4b900b4510c21ab"} Jun 14 14:47:45.107957 ip-10-0-129-116 kubenswrapper[2546]: I0614 14:47:45.107925 2546 generic.go:356] "Generic (PLEG): container finished" podID="bb1ef793-5393-4d3d-af92-621141e7111b" containerID="cc76267f5052d64e24ad89dcb2df674f5899877132f6dc388f1cc2ceb7a28d21" exitCode=0 Jun 14 14:47:45.108374 ip-10-0-129-116 kubenswrapper[2546]: I0614 14:47:45.107998 2546 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762a2j7nw" event={"ID":"bb1ef793-5393-4d3d-af92-621141e7111b","Type":"ContainerDied","Data":"cc76267f5052d64e24ad89dcb2df674f5899877132f6dc388f1cc2ceb7a28d21"} Jun 14 14:47:46.274493 ip-10-0-129-116 kubenswrapper[2546]: I0614 14:47:46.274463 2546 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762a2j7nw" Jun 14 14:47:46.350575 ip-10-0-129-116 kubenswrapper[2546]: I0614 14:47:46.350544 2546 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-rslfg\" (UniqueName: \"kubernetes.io/projected/bb1ef793-5393-4d3d-af92-621141e7111b-kube-api-access-rslfg\") pod \"bb1ef793-5393-4d3d-af92-621141e7111b\" (UID: \"bb1ef793-5393-4d3d-af92-621141e7111b\") " Jun 14 14:47:46.350749 ip-10-0-129-116 kubenswrapper[2546]: I0614 14:47:46.350621 2546 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/bb1ef793-5393-4d3d-af92-621141e7111b-bundle\") pod \"bb1ef793-5393-4d3d-af92-621141e7111b\" (UID: \"bb1ef793-5393-4d3d-af92-621141e7111b\") " Jun 14 14:47:46.350814 ip-10-0-129-116 kubenswrapper[2546]: I0614 14:47:46.350792 2546 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/bb1ef793-5393-4d3d-af92-621141e7111b-util\") pod \"bb1ef793-5393-4d3d-af92-621141e7111b\" (UID: \"bb1ef793-5393-4d3d-af92-621141e7111b\") " Jun 14 14:47:46.351674 ip-10-0-129-116 kubenswrapper[2546]: I0614 14:47:46.351628 2546 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/bb1ef793-5393-4d3d-af92-621141e7111b-bundle" (OuterVolumeSpecName: "bundle") pod "bb1ef793-5393-4d3d-af92-621141e7111b" (UID: "bb1ef793-5393-4d3d-af92-621141e7111b"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 14 14:47:46.352718 ip-10-0-129-116 kubenswrapper[2546]: I0614 14:47:46.352682 2546 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/bb1ef793-5393-4d3d-af92-621141e7111b-kube-api-access-rslfg" (OuterVolumeSpecName: "kube-api-access-rslfg") pod "bb1ef793-5393-4d3d-af92-621141e7111b" (UID: "bb1ef793-5393-4d3d-af92-621141e7111b"). InnerVolumeSpecName "kube-api-access-rslfg". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 14 14:47:46.356398 ip-10-0-129-116 kubenswrapper[2546]: I0614 14:47:46.356365 2546 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/bb1ef793-5393-4d3d-af92-621141e7111b-util" (OuterVolumeSpecName: "util") pod "bb1ef793-5393-4d3d-af92-621141e7111b" (UID: "bb1ef793-5393-4d3d-af92-621141e7111b"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 14 14:47:46.452410 ip-10-0-129-116 kubenswrapper[2546]: I0614 14:47:46.452377 2546 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-rslfg\" (UniqueName: \"kubernetes.io/projected/bb1ef793-5393-4d3d-af92-621141e7111b-kube-api-access-rslfg\") on node \"ip-10-0-129-116.ec2.internal\" DevicePath \"\"" Jun 14 14:47:46.452410 ip-10-0-129-116 kubenswrapper[2546]: I0614 14:47:46.452406 2546 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/bb1ef793-5393-4d3d-af92-621141e7111b-bundle\") on node \"ip-10-0-129-116.ec2.internal\" DevicePath \"\"" Jun 14 14:47:46.452410 ip-10-0-129-116 kubenswrapper[2546]: I0614 14:47:46.452416 2546 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/bb1ef793-5393-4d3d-af92-621141e7111b-util\") on node \"ip-10-0-129-116.ec2.internal\" DevicePath \"\"" Jun 14 14:47:47.122317 ip-10-0-129-116 kubenswrapper[2546]: I0614 14:47:47.122288 2546 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762a2j7nw" Jun 14 14:47:47.122522 ip-10-0-129-116 kubenswrapper[2546]: I0614 14:47:47.122317 2546 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762a2j7nw" event={"ID":"bb1ef793-5393-4d3d-af92-621141e7111b","Type":"ContainerDied","Data":"fd2a2b5df8e507664d0c07d8eec4d10fd7c02dfc1b8fa0207f1bb26949f0f5ed"} Jun 14 14:47:47.122522 ip-10-0-129-116 kubenswrapper[2546]: I0614 14:47:47.122377 2546 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="fd2a2b5df8e507664d0c07d8eec4d10fd7c02dfc1b8fa0207f1bb26949f0f5ed" Jun 14 14:47:52.621049 ip-10-0-129-116 kubenswrapper[2546]: I0614 14:47:52.620996 2546 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c96gx_105377da-c223-41ad-b033-546cb01239c4/konnectivity-agent/0.log" limit=1024 Jun 14 14:47:52.723053 ip-10-0-129-116 kubenswrapper[2546]: I0614 14:47:52.723018 2546 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c96gx_105377da-c223-41ad-b033-546cb01239c4/konnectivity-agent/0.log" limit=1024 Jun 14 14:47:53.956738 ip-10-0-129-116 kubenswrapper[2546]: I0614 14:47:53.956707 2546 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c96gx_105377da-c223-41ad-b033-546cb01239c4/konnectivity-agent/0.log" limit=1024 Jun 14 14:47:54.014316 ip-10-0-129-116 kubenswrapper[2546]: I0614 14:47:54.014280 2546 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c96gx_105377da-c223-41ad-b033-546cb01239c4/konnectivity-agent/0.log" limit=1024 Jun 14 14:47:54.492133 ip-10-0-129-116 kubenswrapper[2546]: I0614 14:47:54.492060 2546 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c96gx_105377da-c223-41ad-b033-546cb01239c4/konnectivity-agent/0.log" limit=1024 Jun 14 14:47:59.351376 ip-10-0-129-116 kubenswrapper[2546]: I0614 14:47:59.351320 2546 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c96gx_105377da-c223-41ad-b033-546cb01239c4/konnectivity-agent/0.log" limit=1024 Jun 14 14:47:59.451649 ip-10-0-129-116 kubenswrapper[2546]: I0614 14:47:59.451613 2546 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c96gx_105377da-c223-41ad-b033-546cb01239c4/konnectivity-agent/0.log" limit=1024 Jun 14 14:47:59.636216 ip-10-0-129-116 kubenswrapper[2546]: I0614 14:47:59.636115 2546 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c96gx_105377da-c223-41ad-b033-546cb01239c4/konnectivity-agent/0.log" limit=1024 Jun 14 14:47:59.905760 ip-10-0-129-116 kubenswrapper[2546]: I0614 14:47:59.905713 2546 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c96gx_105377da-c223-41ad-b033-546cb01239c4/konnectivity-agent/0.log" limit=1024 Jun 14 14:48:00.019664 ip-10-0-129-116 kubenswrapper[2546]: I0614 14:48:00.019621 2546 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c96gx_105377da-c223-41ad-b033-546cb01239c4/konnectivity-agent/0.log" limit=1024 Jun 14 14:48:00.888239 ip-10-0-129-116 kubenswrapper[2546]: I0614 14:48:00.888208 2546 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c96gx_105377da-c223-41ad-b033-546cb01239c4/konnectivity-agent/0.log" limit=1024 Jun 14 14:48:26.138693 ip-10-0-129-116 kubenswrapper[2546]: I0614 14:48:26.138661 2546 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c96gx_105377da-c223-41ad-b033-546cb01239c4/konnectivity-agent/0.log" limit=1024 Jun 14 14:48:26.188763 ip-10-0-129-116 kubenswrapper[2546]: I0614 14:48:26.188730 2546 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c96gx_105377da-c223-41ad-b033-546cb01239c4/konnectivity-agent/0.log" limit=1024 Jun 14 14:48:26.475669 ip-10-0-129-116 kubenswrapper[2546]: I0614 14:48:26.475638 2546 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c96gx_105377da-c223-41ad-b033-546cb01239c4/konnectivity-agent/0.log" limit=1024 Jun 14 14:48:26.568287 ip-10-0-129-116 kubenswrapper[2546]: I0614 14:48:26.568251 2546 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c96gx_105377da-c223-41ad-b033-546cb01239c4/konnectivity-agent/0.log" limit=1024 Jun 14 14:48:26.658977 ip-10-0-129-116 kubenswrapper[2546]: I0614 14:48:26.658940 2546 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c96gx_105377da-c223-41ad-b033-546cb01239c4/konnectivity-agent/0.log" limit=1024 Jun 14 14:48:28.286841 ip-10-0-129-116 kubenswrapper[2546]: I0614 14:48:28.286791 2546 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c96gx_105377da-c223-41ad-b033-546cb01239c4/konnectivity-agent/0.log" limit=1024 Jun 14 14:48:28.387959 ip-10-0-129-116 kubenswrapper[2546]: I0614 14:48:28.387921 2546 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c96gx_105377da-c223-41ad-b033-546cb01239c4/konnectivity-agent/0.log" limit=1024 Jun 14 14:48:32.387815 ip-10-0-129-116 kubenswrapper[2546]: I0614 14:48:32.387780 2546 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c96gx_105377da-c223-41ad-b033-546cb01239c4/konnectivity-agent/0.log" limit=1024 Jun 14 14:48:32.488494 ip-10-0-129-116 kubenswrapper[2546]: I0614 14:48:32.488465 2546 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c96gx_105377da-c223-41ad-b033-546cb01239c4/konnectivity-agent/0.log" limit=1024 Jun 14 14:48:41.536267 ip-10-0-129-116 kubenswrapper[2546]: I0614 14:48:41.536233 2546 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73pwqgn"] Jun 14 14:48:41.536692 ip-10-0-129-116 kubenswrapper[2546]: I0614 14:48:41.536621 2546 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="bb1ef793-5393-4d3d-af92-621141e7111b" containerName="pull" Jun 14 14:48:41.536692 ip-10-0-129-116 kubenswrapper[2546]: I0614 14:48:41.536640 2546 state_mem.go:107] "Deleted CPUSet assignment" podUID="bb1ef793-5393-4d3d-af92-621141e7111b" containerName="pull" Jun 14 14:48:41.536692 ip-10-0-129-116 kubenswrapper[2546]: I0614 14:48:41.536666 2546 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="bb1ef793-5393-4d3d-af92-621141e7111b" containerName="extract" Jun 14 14:48:41.536692 ip-10-0-129-116 kubenswrapper[2546]: I0614 14:48:41.536682 2546 state_mem.go:107] "Deleted CPUSet assignment" podUID="bb1ef793-5393-4d3d-af92-621141e7111b" containerName="extract" Jun 14 14:48:41.536894 ip-10-0-129-116 kubenswrapper[2546]: I0614 14:48:41.536696 2546 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="bb1ef793-5393-4d3d-af92-621141e7111b" containerName="util" Jun 14 14:48:41.536894 ip-10-0-129-116 kubenswrapper[2546]: I0614 14:48:41.536705 2546 state_mem.go:107] "Deleted CPUSet assignment" podUID="bb1ef793-5393-4d3d-af92-621141e7111b" containerName="util" Jun 14 14:48:41.536894 ip-10-0-129-116 kubenswrapper[2546]: I0614 14:48:41.536799 2546 memory_manager.go:368] "RemoveStaleState removing state" podUID="bb1ef793-5393-4d3d-af92-621141e7111b" containerName="extract" Jun 14 14:48:41.540174 ip-10-0-129-116 kubenswrapper[2546]: I0614 14:48:41.540155 2546 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73pwqgn" Jun 14 14:48:41.542858 ip-10-0-129-116 kubenswrapper[2546]: I0614 14:48:41.542838 2546 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"default-dockercfg-txrcp\"" Jun 14 14:48:41.542960 ip-10-0-129-116 kubenswrapper[2546]: I0614 14:48:41.542842 2546 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"kube-root-ca.crt\"" Jun 14 14:48:41.543940 ip-10-0-129-116 kubenswrapper[2546]: I0614 14:48:41.543923 2546 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"openshift-service-ca.crt\"" Jun 14 14:48:41.549073 ip-10-0-129-116 kubenswrapper[2546]: I0614 14:48:41.548832 2546 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73pwqgn"] Jun 14 14:48:41.622740 ip-10-0-129-116 kubenswrapper[2546]: I0614 14:48:41.622703 2546 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/4350f20c-1a09-46ff-a2ab-a88c955d8313-util\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73pwqgn\" (UID: \"4350f20c-1a09-46ff-a2ab-a88c955d8313\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73pwqgn" Jun 14 14:48:41.623134 ip-10-0-129-116 kubenswrapper[2546]: I0614 14:48:41.623111 2546 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-dmrrs\" (UniqueName: \"kubernetes.io/projected/4350f20c-1a09-46ff-a2ab-a88c955d8313-kube-api-access-dmrrs\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73pwqgn\" (UID: \"4350f20c-1a09-46ff-a2ab-a88c955d8313\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73pwqgn" Jun 14 14:48:41.623264 ip-10-0-129-116 kubenswrapper[2546]: I0614 14:48:41.623237 2546 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/4350f20c-1a09-46ff-a2ab-a88c955d8313-bundle\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73pwqgn\" (UID: \"4350f20c-1a09-46ff-a2ab-a88c955d8313\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73pwqgn" Jun 14 14:48:41.723694 ip-10-0-129-116 kubenswrapper[2546]: I0614 14:48:41.723656 2546 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-dmrrs\" (UniqueName: \"kubernetes.io/projected/4350f20c-1a09-46ff-a2ab-a88c955d8313-kube-api-access-dmrrs\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73pwqgn\" (UID: \"4350f20c-1a09-46ff-a2ab-a88c955d8313\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73pwqgn" Jun 14 14:48:41.723895 ip-10-0-129-116 kubenswrapper[2546]: I0614 14:48:41.723709 2546 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/4350f20c-1a09-46ff-a2ab-a88c955d8313-bundle\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73pwqgn\" (UID: \"4350f20c-1a09-46ff-a2ab-a88c955d8313\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73pwqgn" Jun 14 14:48:41.723895 ip-10-0-129-116 kubenswrapper[2546]: I0614 14:48:41.723745 2546 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/4350f20c-1a09-46ff-a2ab-a88c955d8313-util\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73pwqgn\" (UID: \"4350f20c-1a09-46ff-a2ab-a88c955d8313\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73pwqgn" Jun 14 14:48:41.724086 ip-10-0-129-116 kubenswrapper[2546]: I0614 14:48:41.724066 2546 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/4350f20c-1a09-46ff-a2ab-a88c955d8313-util\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73pwqgn\" (UID: \"4350f20c-1a09-46ff-a2ab-a88c955d8313\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73pwqgn" Jun 14 14:48:41.724199 ip-10-0-129-116 kubenswrapper[2546]: I0614 14:48:41.724122 2546 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/4350f20c-1a09-46ff-a2ab-a88c955d8313-bundle\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73pwqgn\" (UID: \"4350f20c-1a09-46ff-a2ab-a88c955d8313\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73pwqgn" Jun 14 14:48:41.731878 ip-10-0-129-116 kubenswrapper[2546]: I0614 14:48:41.731852 2546 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-dmrrs\" (UniqueName: \"kubernetes.io/projected/4350f20c-1a09-46ff-a2ab-a88c955d8313-kube-api-access-dmrrs\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73pwqgn\" (UID: \"4350f20c-1a09-46ff-a2ab-a88c955d8313\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73pwqgn" Jun 14 14:48:41.852749 ip-10-0-129-116 kubenswrapper[2546]: I0614 14:48:41.852661 2546 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73pwqgn" Jun 14 14:48:41.932960 ip-10-0-129-116 kubenswrapper[2546]: I0614 14:48:41.932930 2546 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef16cd9f"] Jun 14 14:48:41.943862 ip-10-0-129-116 kubenswrapper[2546]: I0614 14:48:41.943677 2546 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef16cd9f" Jun 14 14:48:41.945384 ip-10-0-129-116 kubenswrapper[2546]: I0614 14:48:41.945358 2546 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef16cd9f"] Jun 14 14:48:41.995007 ip-10-0-129-116 kubenswrapper[2546]: I0614 14:48:41.994977 2546 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73pwqgn"] Jun 14 14:48:41.997116 ip-10-0-129-116 kubenswrapper[2546]: W0614 14:48:41.997078 2546 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4350f20c_1a09_46ff_a2ab_a88c955d8313.slice/crio-663150d5e021e1419c6a09ace81ee59befb00e8a0becc112228e67bbbb0bcdea WatchSource:0}: Error finding container 663150d5e021e1419c6a09ace81ee59befb00e8a0becc112228e67bbbb0bcdea: Status 404 returned error can't find the container with id 663150d5e021e1419c6a09ace81ee59befb00e8a0becc112228e67bbbb0bcdea Jun 14 14:48:42.026513 ip-10-0-129-116 kubenswrapper[2546]: I0614 14:48:42.026489 2546 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/61ff73d0-331c-41dd-ac43-f90d22200a4f-util\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef16cd9f\" (UID: \"61ff73d0-331c-41dd-ac43-f90d22200a4f\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef16cd9f" Jun 14 14:48:42.026607 ip-10-0-129-116 kubenswrapper[2546]: I0614 14:48:42.026520 2546 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/61ff73d0-331c-41dd-ac43-f90d22200a4f-bundle\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef16cd9f\" (UID: \"61ff73d0-331c-41dd-ac43-f90d22200a4f\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef16cd9f" Jun 14 14:48:42.026607 ip-10-0-129-116 kubenswrapper[2546]: I0614 14:48:42.026559 2546 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hgddw\" (UniqueName: \"kubernetes.io/projected/61ff73d0-331c-41dd-ac43-f90d22200a4f-kube-api-access-hgddw\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef16cd9f\" (UID: \"61ff73d0-331c-41dd-ac43-f90d22200a4f\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef16cd9f" Jun 14 14:48:42.127358 ip-10-0-129-116 kubenswrapper[2546]: I0614 14:48:42.127331 2546 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/61ff73d0-331c-41dd-ac43-f90d22200a4f-util\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef16cd9f\" (UID: \"61ff73d0-331c-41dd-ac43-f90d22200a4f\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef16cd9f" Jun 14 14:48:42.127493 ip-10-0-129-116 kubenswrapper[2546]: I0614 14:48:42.127365 2546 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/61ff73d0-331c-41dd-ac43-f90d22200a4f-bundle\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef16cd9f\" (UID: \"61ff73d0-331c-41dd-ac43-f90d22200a4f\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef16cd9f" Jun 14 14:48:42.127493 ip-10-0-129-116 kubenswrapper[2546]: I0614 14:48:42.127405 2546 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hgddw\" (UniqueName: \"kubernetes.io/projected/61ff73d0-331c-41dd-ac43-f90d22200a4f-kube-api-access-hgddw\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef16cd9f\" (UID: \"61ff73d0-331c-41dd-ac43-f90d22200a4f\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef16cd9f" Jun 14 14:48:42.127686 ip-10-0-129-116 kubenswrapper[2546]: I0614 14:48:42.127665 2546 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/61ff73d0-331c-41dd-ac43-f90d22200a4f-util\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef16cd9f\" (UID: \"61ff73d0-331c-41dd-ac43-f90d22200a4f\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef16cd9f" Jun 14 14:48:42.127768 ip-10-0-129-116 kubenswrapper[2546]: I0614 14:48:42.127699 2546 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/61ff73d0-331c-41dd-ac43-f90d22200a4f-bundle\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef16cd9f\" (UID: \"61ff73d0-331c-41dd-ac43-f90d22200a4f\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef16cd9f" Jun 14 14:48:42.136303 ip-10-0-129-116 kubenswrapper[2546]: I0614 14:48:42.136279 2546 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-hgddw\" (UniqueName: \"kubernetes.io/projected/61ff73d0-331c-41dd-ac43-f90d22200a4f-kube-api-access-hgddw\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef16cd9f\" (UID: \"61ff73d0-331c-41dd-ac43-f90d22200a4f\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef16cd9f" Jun 14 14:48:42.255617 ip-10-0-129-116 kubenswrapper[2546]: I0614 14:48:42.255585 2546 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef16cd9f" Jun 14 14:48:42.384048 ip-10-0-129-116 kubenswrapper[2546]: I0614 14:48:42.383962 2546 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef16cd9f"] Jun 14 14:48:42.386279 ip-10-0-129-116 kubenswrapper[2546]: I0614 14:48:42.386249 2546 generic.go:356] "Generic (PLEG): container finished" podID="4350f20c-1a09-46ff-a2ab-a88c955d8313" containerID="2e172f9c318a0e91098d2ab3dbbbd849c284a829feb6e6d543391fbacdaffdb6" exitCode=0 Jun 14 14:48:42.386405 ip-10-0-129-116 kubenswrapper[2546]: I0614 14:48:42.386343 2546 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73pwqgn" event={"ID":"4350f20c-1a09-46ff-a2ab-a88c955d8313","Type":"ContainerDied","Data":"2e172f9c318a0e91098d2ab3dbbbd849c284a829feb6e6d543391fbacdaffdb6"} Jun 14 14:48:42.386405 ip-10-0-129-116 kubenswrapper[2546]: W0614 14:48:42.386390 2546 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod61ff73d0_331c_41dd_ac43_f90d22200a4f.slice/crio-2ba50bbbff74c8f7f4e207109dab17d1626e871eaac6dff5cf1489ca04ea70f9 WatchSource:0}: Error finding container 2ba50bbbff74c8f7f4e207109dab17d1626e871eaac6dff5cf1489ca04ea70f9: Status 404 returned error can't find the container with id 2ba50bbbff74c8f7f4e207109dab17d1626e871eaac6dff5cf1489ca04ea70f9 Jun 14 14:48:42.386497 ip-10-0-129-116 kubenswrapper[2546]: I0614 14:48:42.386404 2546 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73pwqgn" event={"ID":"4350f20c-1a09-46ff-a2ab-a88c955d8313","Type":"ContainerStarted","Data":"663150d5e021e1419c6a09ace81ee59befb00e8a0becc112228e67bbbb0bcdea"} Jun 14 14:48:42.532579 ip-10-0-129-116 kubenswrapper[2546]: I0614 14:48:42.532544 2546 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7596l776"] Jun 14 14:48:42.536286 ip-10-0-129-116 kubenswrapper[2546]: I0614 14:48:42.536267 2546 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7596l776" Jun 14 14:48:42.543017 ip-10-0-129-116 kubenswrapper[2546]: I0614 14:48:42.542988 2546 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7596l776"] Jun 14 14:48:42.633465 ip-10-0-129-116 kubenswrapper[2546]: I0614 14:48:42.633433 2546 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qhr9b\" (UniqueName: \"kubernetes.io/projected/497bcfe0-8765-47d4-87c4-066499fefb27-kube-api-access-qhr9b\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7596l776\" (UID: \"497bcfe0-8765-47d4-87c4-066499fefb27\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7596l776" Jun 14 14:48:42.633674 ip-10-0-129-116 kubenswrapper[2546]: I0614 14:48:42.633500 2546 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/497bcfe0-8765-47d4-87c4-066499fefb27-util\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7596l776\" (UID: \"497bcfe0-8765-47d4-87c4-066499fefb27\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7596l776" Jun 14 14:48:42.633674 ip-10-0-129-116 kubenswrapper[2546]: I0614 14:48:42.633560 2546 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/497bcfe0-8765-47d4-87c4-066499fefb27-bundle\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7596l776\" (UID: \"497bcfe0-8765-47d4-87c4-066499fefb27\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7596l776" Jun 14 14:48:42.734448 ip-10-0-129-116 kubenswrapper[2546]: I0614 14:48:42.734412 2546 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/497bcfe0-8765-47d4-87c4-066499fefb27-util\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7596l776\" (UID: \"497bcfe0-8765-47d4-87c4-066499fefb27\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7596l776" Jun 14 14:48:42.734448 ip-10-0-129-116 kubenswrapper[2546]: I0614 14:48:42.734452 2546 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/497bcfe0-8765-47d4-87c4-066499fefb27-bundle\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7596l776\" (UID: \"497bcfe0-8765-47d4-87c4-066499fefb27\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7596l776" Jun 14 14:48:42.734650 ip-10-0-129-116 kubenswrapper[2546]: I0614 14:48:42.734505 2546 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qhr9b\" (UniqueName: \"kubernetes.io/projected/497bcfe0-8765-47d4-87c4-066499fefb27-kube-api-access-qhr9b\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7596l776\" (UID: \"497bcfe0-8765-47d4-87c4-066499fefb27\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7596l776" Jun 14 14:48:42.734848 ip-10-0-129-116 kubenswrapper[2546]: I0614 14:48:42.734825 2546 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/497bcfe0-8765-47d4-87c4-066499fefb27-util\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7596l776\" (UID: \"497bcfe0-8765-47d4-87c4-066499fefb27\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7596l776" Jun 14 14:48:42.734902 ip-10-0-129-116 kubenswrapper[2546]: I0614 14:48:42.734880 2546 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/497bcfe0-8765-47d4-87c4-066499fefb27-bundle\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7596l776\" (UID: \"497bcfe0-8765-47d4-87c4-066499fefb27\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7596l776" Jun 14 14:48:42.742803 ip-10-0-129-116 kubenswrapper[2546]: I0614 14:48:42.742773 2546 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-qhr9b\" (UniqueName: \"kubernetes.io/projected/497bcfe0-8765-47d4-87c4-066499fefb27-kube-api-access-qhr9b\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7596l776\" (UID: \"497bcfe0-8765-47d4-87c4-066499fefb27\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7596l776" Jun 14 14:48:42.846296 ip-10-0-129-116 kubenswrapper[2546]: I0614 14:48:42.846257 2546 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7596l776" Jun 14 14:48:43.009546 ip-10-0-129-116 kubenswrapper[2546]: I0614 14:48:43.009518 2546 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7596l776"] Jun 14 14:48:43.030433 ip-10-0-129-116 kubenswrapper[2546]: W0614 14:48:43.030403 2546 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod497bcfe0_8765_47d4_87c4_066499fefb27.slice/crio-04104074be442506159af9cea354468b228ea58493d258362bf0fdcbfb05a25c WatchSource:0}: Error finding container 04104074be442506159af9cea354468b228ea58493d258362bf0fdcbfb05a25c: Status 404 returned error can't find the container with id 04104074be442506159af9cea354468b228ea58493d258362bf0fdcbfb05a25c Jun 14 14:48:43.137336 ip-10-0-129-116 kubenswrapper[2546]: I0614 14:48:43.137305 2546 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0v8gmr"] Jun 14 14:48:43.140991 ip-10-0-129-116 kubenswrapper[2546]: I0614 14:48:43.140968 2546 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0v8gmr" Jun 14 14:48:43.148650 ip-10-0-129-116 kubenswrapper[2546]: I0614 14:48:43.148593 2546 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0v8gmr"] Jun 14 14:48:43.238656 ip-10-0-129-116 kubenswrapper[2546]: I0614 14:48:43.238624 2546 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/42690162-7abb-4f31-9429-beb1e00464b7-bundle\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0v8gmr\" (UID: \"42690162-7abb-4f31-9429-beb1e00464b7\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0v8gmr" Jun 14 14:48:43.238793 ip-10-0-129-116 kubenswrapper[2546]: I0614 14:48:43.238667 2546 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/42690162-7abb-4f31-9429-beb1e00464b7-util\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0v8gmr\" (UID: \"42690162-7abb-4f31-9429-beb1e00464b7\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0v8gmr" Jun 14 14:48:43.238793 ip-10-0-129-116 kubenswrapper[2546]: I0614 14:48:43.238696 2546 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-sg7nx\" (UniqueName: \"kubernetes.io/projected/42690162-7abb-4f31-9429-beb1e00464b7-kube-api-access-sg7nx\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0v8gmr\" (UID: \"42690162-7abb-4f31-9429-beb1e00464b7\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0v8gmr" Jun 14 14:48:43.339967 ip-10-0-129-116 kubenswrapper[2546]: I0614 14:48:43.339921 2546 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/42690162-7abb-4f31-9429-beb1e00464b7-util\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0v8gmr\" (UID: \"42690162-7abb-4f31-9429-beb1e00464b7\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0v8gmr" Jun 14 14:48:43.340201 ip-10-0-129-116 kubenswrapper[2546]: I0614 14:48:43.339984 2546 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-sg7nx\" (UniqueName: \"kubernetes.io/projected/42690162-7abb-4f31-9429-beb1e00464b7-kube-api-access-sg7nx\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0v8gmr\" (UID: \"42690162-7abb-4f31-9429-beb1e00464b7\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0v8gmr" Jun 14 14:48:43.340201 ip-10-0-129-116 kubenswrapper[2546]: I0614 14:48:43.340086 2546 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/42690162-7abb-4f31-9429-beb1e00464b7-bundle\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0v8gmr\" (UID: \"42690162-7abb-4f31-9429-beb1e00464b7\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0v8gmr" Jun 14 14:48:43.340439 ip-10-0-129-116 kubenswrapper[2546]: I0614 14:48:43.340416 2546 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/42690162-7abb-4f31-9429-beb1e00464b7-util\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0v8gmr\" (UID: \"42690162-7abb-4f31-9429-beb1e00464b7\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0v8gmr" Jun 14 14:48:43.340476 ip-10-0-129-116 kubenswrapper[2546]: I0614 14:48:43.340435 2546 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/42690162-7abb-4f31-9429-beb1e00464b7-bundle\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0v8gmr\" (UID: \"42690162-7abb-4f31-9429-beb1e00464b7\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0v8gmr" Jun 14 14:48:43.347912 ip-10-0-129-116 kubenswrapper[2546]: I0614 14:48:43.347892 2546 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-sg7nx\" (UniqueName: \"kubernetes.io/projected/42690162-7abb-4f31-9429-beb1e00464b7-kube-api-access-sg7nx\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0v8gmr\" (UID: \"42690162-7abb-4f31-9429-beb1e00464b7\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0v8gmr" Jun 14 14:48:43.393312 ip-10-0-129-116 kubenswrapper[2546]: I0614 14:48:43.393281 2546 generic.go:356] "Generic (PLEG): container finished" podID="497bcfe0-8765-47d4-87c4-066499fefb27" containerID="346ea0be19178287ef3787a6db4a8dbffc993a19d275969b04d7a16028f973b8" exitCode=0 Jun 14 14:48:43.393497 ip-10-0-129-116 kubenswrapper[2546]: I0614 14:48:43.393369 2546 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7596l776" event={"ID":"497bcfe0-8765-47d4-87c4-066499fefb27","Type":"ContainerDied","Data":"346ea0be19178287ef3787a6db4a8dbffc993a19d275969b04d7a16028f973b8"} Jun 14 14:48:43.393497 ip-10-0-129-116 kubenswrapper[2546]: I0614 14:48:43.393425 2546 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7596l776" event={"ID":"497bcfe0-8765-47d4-87c4-066499fefb27","Type":"ContainerStarted","Data":"04104074be442506159af9cea354468b228ea58493d258362bf0fdcbfb05a25c"} Jun 14 14:48:43.394868 ip-10-0-129-116 kubenswrapper[2546]: I0614 14:48:43.394848 2546 generic.go:356] "Generic (PLEG): container finished" podID="61ff73d0-331c-41dd-ac43-f90d22200a4f" containerID="4f4082f6b523b6bbff9b80f07527d8b333e138062214f911c298f9bfa389dfee" exitCode=0 Jun 14 14:48:43.394975 ip-10-0-129-116 kubenswrapper[2546]: I0614 14:48:43.394936 2546 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef16cd9f" event={"ID":"61ff73d0-331c-41dd-ac43-f90d22200a4f","Type":"ContainerDied","Data":"4f4082f6b523b6bbff9b80f07527d8b333e138062214f911c298f9bfa389dfee"} Jun 14 14:48:43.395055 ip-10-0-129-116 kubenswrapper[2546]: I0614 14:48:43.394975 2546 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef16cd9f" event={"ID":"61ff73d0-331c-41dd-ac43-f90d22200a4f","Type":"ContainerStarted","Data":"2ba50bbbff74c8f7f4e207109dab17d1626e871eaac6dff5cf1489ca04ea70f9"} Jun 14 14:48:43.396908 ip-10-0-129-116 kubenswrapper[2546]: I0614 14:48:43.396866 2546 generic.go:356] "Generic (PLEG): container finished" podID="4350f20c-1a09-46ff-a2ab-a88c955d8313" containerID="b313bbda6e15adec078511feede8d04675f0fa53a9f80e488677a719541f4907" exitCode=0 Jun 14 14:48:43.396908 ip-10-0-129-116 kubenswrapper[2546]: I0614 14:48:43.396895 2546 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73pwqgn" event={"ID":"4350f20c-1a09-46ff-a2ab-a88c955d8313","Type":"ContainerDied","Data":"b313bbda6e15adec078511feede8d04675f0fa53a9f80e488677a719541f4907"} Jun 14 14:48:43.528601 ip-10-0-129-116 kubenswrapper[2546]: I0614 14:48:43.528568 2546 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0v8gmr" Jun 14 14:48:43.662930 ip-10-0-129-116 kubenswrapper[2546]: I0614 14:48:43.662903 2546 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0v8gmr"] Jun 14 14:48:43.664692 ip-10-0-129-116 kubenswrapper[2546]: W0614 14:48:43.664667 2546 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod42690162_7abb_4f31_9429_beb1e00464b7.slice/crio-a640a03da11af604f2ea9c26a73fb12018cfd23c9686a8391bd0a926ff9a80df WatchSource:0}: Error finding container a640a03da11af604f2ea9c26a73fb12018cfd23c9686a8391bd0a926ff9a80df: Status 404 returned error can't find the container with id a640a03da11af604f2ea9c26a73fb12018cfd23c9686a8391bd0a926ff9a80df Jun 14 14:48:44.404451 ip-10-0-129-116 kubenswrapper[2546]: I0614 14:48:44.404421 2546 generic.go:356] "Generic (PLEG): container finished" podID="497bcfe0-8765-47d4-87c4-066499fefb27" containerID="c719c638c9dd39432dad708edd5ecaac4f8944ec7fb32a288714742ba83bf689" exitCode=0 Jun 14 14:48:44.404626 ip-10-0-129-116 kubenswrapper[2546]: I0614 14:48:44.404509 2546 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7596l776" event={"ID":"497bcfe0-8765-47d4-87c4-066499fefb27","Type":"ContainerDied","Data":"c719c638c9dd39432dad708edd5ecaac4f8944ec7fb32a288714742ba83bf689"} Jun 14 14:48:44.406408 ip-10-0-129-116 kubenswrapper[2546]: I0614 14:48:44.406388 2546 generic.go:356] "Generic (PLEG): container finished" podID="61ff73d0-331c-41dd-ac43-f90d22200a4f" containerID="fc661f65e840454076140fcff25228f11a39a2a8a32b9a3ba7208025e3dfa60a" exitCode=0 Jun 14 14:48:44.406496 ip-10-0-129-116 kubenswrapper[2546]: I0614 14:48:44.406467 2546 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef16cd9f" event={"ID":"61ff73d0-331c-41dd-ac43-f90d22200a4f","Type":"ContainerDied","Data":"fc661f65e840454076140fcff25228f11a39a2a8a32b9a3ba7208025e3dfa60a"} Jun 14 14:48:44.408585 ip-10-0-129-116 kubenswrapper[2546]: I0614 14:48:44.408565 2546 generic.go:356] "Generic (PLEG): container finished" podID="4350f20c-1a09-46ff-a2ab-a88c955d8313" containerID="1aa348107c2e9b441d4473e212e6c635c048f0bf2ded245d9aa79008b3e35cf8" exitCode=0 Jun 14 14:48:44.408680 ip-10-0-129-116 kubenswrapper[2546]: I0614 14:48:44.408647 2546 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73pwqgn" event={"ID":"4350f20c-1a09-46ff-a2ab-a88c955d8313","Type":"ContainerDied","Data":"1aa348107c2e9b441d4473e212e6c635c048f0bf2ded245d9aa79008b3e35cf8"} Jun 14 14:48:44.410129 ip-10-0-129-116 kubenswrapper[2546]: I0614 14:48:44.410107 2546 generic.go:356] "Generic (PLEG): container finished" podID="42690162-7abb-4f31-9429-beb1e00464b7" containerID="8667f19fd69c4a51f22622093ba0e55b0a037dcaa36ec986401ff82a882d12c3" exitCode=0 Jun 14 14:48:44.410233 ip-10-0-129-116 kubenswrapper[2546]: I0614 14:48:44.410148 2546 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0v8gmr" event={"ID":"42690162-7abb-4f31-9429-beb1e00464b7","Type":"ContainerDied","Data":"8667f19fd69c4a51f22622093ba0e55b0a037dcaa36ec986401ff82a882d12c3"} Jun 14 14:48:44.410233 ip-10-0-129-116 kubenswrapper[2546]: I0614 14:48:44.410179 2546 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0v8gmr" event={"ID":"42690162-7abb-4f31-9429-beb1e00464b7","Type":"ContainerStarted","Data":"a640a03da11af604f2ea9c26a73fb12018cfd23c9686a8391bd0a926ff9a80df"} Jun 14 14:48:45.417526 ip-10-0-129-116 kubenswrapper[2546]: I0614 14:48:45.417442 2546 generic.go:356] "Generic (PLEG): container finished" podID="497bcfe0-8765-47d4-87c4-066499fefb27" containerID="efa95f45ae439d7b7754e73b30bf5eb41a3680dbd812f87fd27a43ac48488416" exitCode=0 Jun 14 14:48:45.417906 ip-10-0-129-116 kubenswrapper[2546]: I0614 14:48:45.417533 2546 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7596l776" event={"ID":"497bcfe0-8765-47d4-87c4-066499fefb27","Type":"ContainerDied","Data":"efa95f45ae439d7b7754e73b30bf5eb41a3680dbd812f87fd27a43ac48488416"} Jun 14 14:48:45.419530 ip-10-0-129-116 kubenswrapper[2546]: I0614 14:48:45.419503 2546 generic.go:356] "Generic (PLEG): container finished" podID="61ff73d0-331c-41dd-ac43-f90d22200a4f" containerID="da2766424bbd20bf28694aa9e248be465d651ca99a48e9177be6ca2f3ec5bf1f" exitCode=0 Jun 14 14:48:45.419667 ip-10-0-129-116 kubenswrapper[2546]: I0614 14:48:45.419584 2546 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef16cd9f" event={"ID":"61ff73d0-331c-41dd-ac43-f90d22200a4f","Type":"ContainerDied","Data":"da2766424bbd20bf28694aa9e248be465d651ca99a48e9177be6ca2f3ec5bf1f"} Jun 14 14:48:45.421386 ip-10-0-129-116 kubenswrapper[2546]: I0614 14:48:45.421365 2546 generic.go:356] "Generic (PLEG): container finished" podID="42690162-7abb-4f31-9429-beb1e00464b7" containerID="9bfbf87ad6b70383027050d55207483ddc058ffd39834eddbc34581ca9c5133d" exitCode=0 Jun 14 14:48:45.421507 ip-10-0-129-116 kubenswrapper[2546]: I0614 14:48:45.421443 2546 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0v8gmr" event={"ID":"42690162-7abb-4f31-9429-beb1e00464b7","Type":"ContainerDied","Data":"9bfbf87ad6b70383027050d55207483ddc058ffd39834eddbc34581ca9c5133d"} Jun 14 14:48:45.548446 ip-10-0-129-116 kubenswrapper[2546]: I0614 14:48:45.548420 2546 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73pwqgn" Jun 14 14:48:45.662039 ip-10-0-129-116 kubenswrapper[2546]: I0614 14:48:45.662009 2546 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/4350f20c-1a09-46ff-a2ab-a88c955d8313-bundle\") pod \"4350f20c-1a09-46ff-a2ab-a88c955d8313\" (UID: \"4350f20c-1a09-46ff-a2ab-a88c955d8313\") " Jun 14 14:48:45.662215 ip-10-0-129-116 kubenswrapper[2546]: I0614 14:48:45.662061 2546 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/4350f20c-1a09-46ff-a2ab-a88c955d8313-util\") pod \"4350f20c-1a09-46ff-a2ab-a88c955d8313\" (UID: \"4350f20c-1a09-46ff-a2ab-a88c955d8313\") " Jun 14 14:48:45.662215 ip-10-0-129-116 kubenswrapper[2546]: I0614 14:48:45.662087 2546 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-dmrrs\" (UniqueName: \"kubernetes.io/projected/4350f20c-1a09-46ff-a2ab-a88c955d8313-kube-api-access-dmrrs\") pod \"4350f20c-1a09-46ff-a2ab-a88c955d8313\" (UID: \"4350f20c-1a09-46ff-a2ab-a88c955d8313\") " Jun 14 14:48:45.662755 ip-10-0-129-116 kubenswrapper[2546]: I0614 14:48:45.662726 2546 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/4350f20c-1a09-46ff-a2ab-a88c955d8313-bundle" (OuterVolumeSpecName: "bundle") pod "4350f20c-1a09-46ff-a2ab-a88c955d8313" (UID: "4350f20c-1a09-46ff-a2ab-a88c955d8313"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 14 14:48:45.664262 ip-10-0-129-116 kubenswrapper[2546]: I0614 14:48:45.664237 2546 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/4350f20c-1a09-46ff-a2ab-a88c955d8313-kube-api-access-dmrrs" (OuterVolumeSpecName: "kube-api-access-dmrrs") pod "4350f20c-1a09-46ff-a2ab-a88c955d8313" (UID: "4350f20c-1a09-46ff-a2ab-a88c955d8313"). InnerVolumeSpecName "kube-api-access-dmrrs". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 14 14:48:45.667885 ip-10-0-129-116 kubenswrapper[2546]: I0614 14:48:45.667836 2546 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/4350f20c-1a09-46ff-a2ab-a88c955d8313-util" (OuterVolumeSpecName: "util") pod "4350f20c-1a09-46ff-a2ab-a88c955d8313" (UID: "4350f20c-1a09-46ff-a2ab-a88c955d8313"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 14 14:48:45.763498 ip-10-0-129-116 kubenswrapper[2546]: I0614 14:48:45.763471 2546 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/4350f20c-1a09-46ff-a2ab-a88c955d8313-util\") on node \"ip-10-0-129-116.ec2.internal\" DevicePath \"\"" Jun 14 14:48:45.763498 ip-10-0-129-116 kubenswrapper[2546]: I0614 14:48:45.763496 2546 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-dmrrs\" (UniqueName: \"kubernetes.io/projected/4350f20c-1a09-46ff-a2ab-a88c955d8313-kube-api-access-dmrrs\") on node \"ip-10-0-129-116.ec2.internal\" DevicePath \"\"" Jun 14 14:48:45.763640 ip-10-0-129-116 kubenswrapper[2546]: I0614 14:48:45.763507 2546 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/4350f20c-1a09-46ff-a2ab-a88c955d8313-bundle\") on node \"ip-10-0-129-116.ec2.internal\" DevicePath \"\"" Jun 14 14:48:46.427926 ip-10-0-129-116 kubenswrapper[2546]: I0614 14:48:46.427893 2546 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73pwqgn" Jun 14 14:48:46.427926 ip-10-0-129-116 kubenswrapper[2546]: I0614 14:48:46.427903 2546 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73pwqgn" event={"ID":"4350f20c-1a09-46ff-a2ab-a88c955d8313","Type":"ContainerDied","Data":"663150d5e021e1419c6a09ace81ee59befb00e8a0becc112228e67bbbb0bcdea"} Jun 14 14:48:46.428447 ip-10-0-129-116 kubenswrapper[2546]: I0614 14:48:46.427950 2546 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="663150d5e021e1419c6a09ace81ee59befb00e8a0becc112228e67bbbb0bcdea" Jun 14 14:48:46.430061 ip-10-0-129-116 kubenswrapper[2546]: I0614 14:48:46.430034 2546 generic.go:356] "Generic (PLEG): container finished" podID="42690162-7abb-4f31-9429-beb1e00464b7" containerID="74931dc37c8a0638836d7f3ea05fccaa13a0e8a3689fc4da5700e3c7b252fea9" exitCode=0 Jun 14 14:48:46.430223 ip-10-0-129-116 kubenswrapper[2546]: I0614 14:48:46.430116 2546 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0v8gmr" event={"ID":"42690162-7abb-4f31-9429-beb1e00464b7","Type":"ContainerDied","Data":"74931dc37c8a0638836d7f3ea05fccaa13a0e8a3689fc4da5700e3c7b252fea9"} Jun 14 14:48:46.585121 ip-10-0-129-116 kubenswrapper[2546]: I0614 14:48:46.585082 2546 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7596l776" Jun 14 14:48:46.587263 ip-10-0-129-116 kubenswrapper[2546]: I0614 14:48:46.587240 2546 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef16cd9f" Jun 14 14:48:46.772253 ip-10-0-129-116 kubenswrapper[2546]: I0614 14:48:46.772154 2546 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-hgddw\" (UniqueName: \"kubernetes.io/projected/61ff73d0-331c-41dd-ac43-f90d22200a4f-kube-api-access-hgddw\") pod \"61ff73d0-331c-41dd-ac43-f90d22200a4f\" (UID: \"61ff73d0-331c-41dd-ac43-f90d22200a4f\") " Jun 14 14:48:46.772253 ip-10-0-129-116 kubenswrapper[2546]: I0614 14:48:46.772202 2546 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-qhr9b\" (UniqueName: \"kubernetes.io/projected/497bcfe0-8765-47d4-87c4-066499fefb27-kube-api-access-qhr9b\") pod \"497bcfe0-8765-47d4-87c4-066499fefb27\" (UID: \"497bcfe0-8765-47d4-87c4-066499fefb27\") " Jun 14 14:48:46.772253 ip-10-0-129-116 kubenswrapper[2546]: I0614 14:48:46.772246 2546 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/497bcfe0-8765-47d4-87c4-066499fefb27-bundle\") pod \"497bcfe0-8765-47d4-87c4-066499fefb27\" (UID: \"497bcfe0-8765-47d4-87c4-066499fefb27\") " Jun 14 14:48:46.772551 ip-10-0-129-116 kubenswrapper[2546]: I0614 14:48:46.772293 2546 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/61ff73d0-331c-41dd-ac43-f90d22200a4f-util\") pod \"61ff73d0-331c-41dd-ac43-f90d22200a4f\" (UID: \"61ff73d0-331c-41dd-ac43-f90d22200a4f\") " Jun 14 14:48:46.772551 ip-10-0-129-116 kubenswrapper[2546]: I0614 14:48:46.772320 2546 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/497bcfe0-8765-47d4-87c4-066499fefb27-util\") pod \"497bcfe0-8765-47d4-87c4-066499fefb27\" (UID: \"497bcfe0-8765-47d4-87c4-066499fefb27\") " Jun 14 14:48:46.772551 ip-10-0-129-116 kubenswrapper[2546]: I0614 14:48:46.772389 2546 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/61ff73d0-331c-41dd-ac43-f90d22200a4f-bundle\") pod \"61ff73d0-331c-41dd-ac43-f90d22200a4f\" (UID: \"61ff73d0-331c-41dd-ac43-f90d22200a4f\") " Jun 14 14:48:46.772855 ip-10-0-129-116 kubenswrapper[2546]: I0614 14:48:46.772825 2546 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/497bcfe0-8765-47d4-87c4-066499fefb27-bundle" (OuterVolumeSpecName: "bundle") pod "497bcfe0-8765-47d4-87c4-066499fefb27" (UID: "497bcfe0-8765-47d4-87c4-066499fefb27"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 14 14:48:46.773015 ip-10-0-129-116 kubenswrapper[2546]: I0614 14:48:46.772978 2546 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/61ff73d0-331c-41dd-ac43-f90d22200a4f-bundle" (OuterVolumeSpecName: "bundle") pod "61ff73d0-331c-41dd-ac43-f90d22200a4f" (UID: "61ff73d0-331c-41dd-ac43-f90d22200a4f"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 14 14:48:46.774924 ip-10-0-129-116 kubenswrapper[2546]: I0614 14:48:46.774903 2546 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/497bcfe0-8765-47d4-87c4-066499fefb27-kube-api-access-qhr9b" (OuterVolumeSpecName: "kube-api-access-qhr9b") pod "497bcfe0-8765-47d4-87c4-066499fefb27" (UID: "497bcfe0-8765-47d4-87c4-066499fefb27"). InnerVolumeSpecName "kube-api-access-qhr9b". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 14 14:48:46.775015 ip-10-0-129-116 kubenswrapper[2546]: I0614 14:48:46.774933 2546 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/61ff73d0-331c-41dd-ac43-f90d22200a4f-kube-api-access-hgddw" (OuterVolumeSpecName: "kube-api-access-hgddw") pod "61ff73d0-331c-41dd-ac43-f90d22200a4f" (UID: "61ff73d0-331c-41dd-ac43-f90d22200a4f"). InnerVolumeSpecName "kube-api-access-hgddw". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 14 14:48:46.781458 ip-10-0-129-116 kubenswrapper[2546]: I0614 14:48:46.781430 2546 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/61ff73d0-331c-41dd-ac43-f90d22200a4f-util" (OuterVolumeSpecName: "util") pod "61ff73d0-331c-41dd-ac43-f90d22200a4f" (UID: "61ff73d0-331c-41dd-ac43-f90d22200a4f"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 14 14:48:46.781694 ip-10-0-129-116 kubenswrapper[2546]: I0614 14:48:46.781678 2546 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/497bcfe0-8765-47d4-87c4-066499fefb27-util" (OuterVolumeSpecName: "util") pod "497bcfe0-8765-47d4-87c4-066499fefb27" (UID: "497bcfe0-8765-47d4-87c4-066499fefb27"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 14 14:48:46.872976 ip-10-0-129-116 kubenswrapper[2546]: I0614 14:48:46.872929 2546 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/61ff73d0-331c-41dd-ac43-f90d22200a4f-util\") on node \"ip-10-0-129-116.ec2.internal\" DevicePath \"\"" Jun 14 14:48:46.872976 ip-10-0-129-116 kubenswrapper[2546]: I0614 14:48:46.872972 2546 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/497bcfe0-8765-47d4-87c4-066499fefb27-util\") on node \"ip-10-0-129-116.ec2.internal\" DevicePath \"\"" Jun 14 14:48:46.872976 ip-10-0-129-116 kubenswrapper[2546]: I0614 14:48:46.872983 2546 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/61ff73d0-331c-41dd-ac43-f90d22200a4f-bundle\") on node \"ip-10-0-129-116.ec2.internal\" DevicePath \"\"" Jun 14 14:48:46.872976 ip-10-0-129-116 kubenswrapper[2546]: I0614 14:48:46.872992 2546 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-hgddw\" (UniqueName: \"kubernetes.io/projected/61ff73d0-331c-41dd-ac43-f90d22200a4f-kube-api-access-hgddw\") on node \"ip-10-0-129-116.ec2.internal\" DevicePath \"\"" Jun 14 14:48:46.873270 ip-10-0-129-116 kubenswrapper[2546]: I0614 14:48:46.873003 2546 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-qhr9b\" (UniqueName: \"kubernetes.io/projected/497bcfe0-8765-47d4-87c4-066499fefb27-kube-api-access-qhr9b\") on node \"ip-10-0-129-116.ec2.internal\" DevicePath \"\"" Jun 14 14:48:46.873270 ip-10-0-129-116 kubenswrapper[2546]: I0614 14:48:46.873012 2546 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/497bcfe0-8765-47d4-87c4-066499fefb27-bundle\") on node \"ip-10-0-129-116.ec2.internal\" DevicePath \"\"" Jun 14 14:48:47.436914 ip-10-0-129-116 kubenswrapper[2546]: I0614 14:48:47.436880 2546 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7596l776" Jun 14 14:48:47.437372 ip-10-0-129-116 kubenswrapper[2546]: I0614 14:48:47.436881 2546 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7596l776" event={"ID":"497bcfe0-8765-47d4-87c4-066499fefb27","Type":"ContainerDied","Data":"04104074be442506159af9cea354468b228ea58493d258362bf0fdcbfb05a25c"} Jun 14 14:48:47.437372 ip-10-0-129-116 kubenswrapper[2546]: I0614 14:48:47.437012 2546 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="04104074be442506159af9cea354468b228ea58493d258362bf0fdcbfb05a25c" Jun 14 14:48:47.439047 ip-10-0-129-116 kubenswrapper[2546]: I0614 14:48:47.438990 2546 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef16cd9f" Jun 14 14:48:47.439212 ip-10-0-129-116 kubenswrapper[2546]: I0614 14:48:47.439044 2546 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef16cd9f" event={"ID":"61ff73d0-331c-41dd-ac43-f90d22200a4f","Type":"ContainerDied","Data":"2ba50bbbff74c8f7f4e207109dab17d1626e871eaac6dff5cf1489ca04ea70f9"} Jun 14 14:48:47.439212 ip-10-0-129-116 kubenswrapper[2546]: I0614 14:48:47.439084 2546 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="2ba50bbbff74c8f7f4e207109dab17d1626e871eaac6dff5cf1489ca04ea70f9" Jun 14 14:48:47.568073 ip-10-0-129-116 kubenswrapper[2546]: I0614 14:48:47.568048 2546 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0v8gmr" Jun 14 14:48:47.679985 ip-10-0-129-116 kubenswrapper[2546]: I0614 14:48:47.679949 2546 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/42690162-7abb-4f31-9429-beb1e00464b7-bundle\") pod \"42690162-7abb-4f31-9429-beb1e00464b7\" (UID: \"42690162-7abb-4f31-9429-beb1e00464b7\") " Jun 14 14:48:47.680199 ip-10-0-129-116 kubenswrapper[2546]: I0614 14:48:47.680027 2546 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/42690162-7abb-4f31-9429-beb1e00464b7-util\") pod \"42690162-7abb-4f31-9429-beb1e00464b7\" (UID: \"42690162-7abb-4f31-9429-beb1e00464b7\") " Jun 14 14:48:47.680199 ip-10-0-129-116 kubenswrapper[2546]: I0614 14:48:47.680088 2546 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-sg7nx\" (UniqueName: \"kubernetes.io/projected/42690162-7abb-4f31-9429-beb1e00464b7-kube-api-access-sg7nx\") pod \"42690162-7abb-4f31-9429-beb1e00464b7\" (UID: \"42690162-7abb-4f31-9429-beb1e00464b7\") " Jun 14 14:48:47.680465 ip-10-0-129-116 kubenswrapper[2546]: I0614 14:48:47.680439 2546 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/42690162-7abb-4f31-9429-beb1e00464b7-bundle" (OuterVolumeSpecName: "bundle") pod "42690162-7abb-4f31-9429-beb1e00464b7" (UID: "42690162-7abb-4f31-9429-beb1e00464b7"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 14 14:48:47.682148 ip-10-0-129-116 kubenswrapper[2546]: I0614 14:48:47.682116 2546 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/42690162-7abb-4f31-9429-beb1e00464b7-kube-api-access-sg7nx" (OuterVolumeSpecName: "kube-api-access-sg7nx") pod "42690162-7abb-4f31-9429-beb1e00464b7" (UID: "42690162-7abb-4f31-9429-beb1e00464b7"). InnerVolumeSpecName "kube-api-access-sg7nx". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 14 14:48:47.685463 ip-10-0-129-116 kubenswrapper[2546]: I0614 14:48:47.685438 2546 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/42690162-7abb-4f31-9429-beb1e00464b7-util" (OuterVolumeSpecName: "util") pod "42690162-7abb-4f31-9429-beb1e00464b7" (UID: "42690162-7abb-4f31-9429-beb1e00464b7"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 14 14:48:47.781846 ip-10-0-129-116 kubenswrapper[2546]: I0614 14:48:47.781753 2546 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/42690162-7abb-4f31-9429-beb1e00464b7-util\") on node \"ip-10-0-129-116.ec2.internal\" DevicePath \"\"" Jun 14 14:48:47.781846 ip-10-0-129-116 kubenswrapper[2546]: I0614 14:48:47.781786 2546 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-sg7nx\" (UniqueName: \"kubernetes.io/projected/42690162-7abb-4f31-9429-beb1e00464b7-kube-api-access-sg7nx\") on node \"ip-10-0-129-116.ec2.internal\" DevicePath \"\"" Jun 14 14:48:47.781846 ip-10-0-129-116 kubenswrapper[2546]: I0614 14:48:47.781804 2546 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/42690162-7abb-4f31-9429-beb1e00464b7-bundle\") on node \"ip-10-0-129-116.ec2.internal\" DevicePath \"\"" Jun 14 14:48:48.446595 ip-10-0-129-116 kubenswrapper[2546]: I0614 14:48:48.446559 2546 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0v8gmr" Jun 14 14:48:48.446595 ip-10-0-129-116 kubenswrapper[2546]: I0614 14:48:48.446579 2546 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0v8gmr" event={"ID":"42690162-7abb-4f31-9429-beb1e00464b7","Type":"ContainerDied","Data":"a640a03da11af604f2ea9c26a73fb12018cfd23c9686a8391bd0a926ff9a80df"} Jun 14 14:48:48.447050 ip-10-0-129-116 kubenswrapper[2546]: I0614 14:48:48.446635 2546 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="a640a03da11af604f2ea9c26a73fb12018cfd23c9686a8391bd0a926ff9a80df" Jun 14 14:48:55.153399 ip-10-0-129-116 kubenswrapper[2546]: I0614 14:48:55.153357 2546 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c96gx_105377da-c223-41ad-b033-546cb01239c4/konnectivity-agent/0.log" limit=1024 Jun 14 14:48:59.343004 ip-10-0-129-116 kubenswrapper[2546]: I0614 14:48:59.342958 2546 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c96gx_105377da-c223-41ad-b033-546cb01239c4/konnectivity-agent/0.log" limit=1024 Jun 14 14:48:59.716464 ip-10-0-129-116 kubenswrapper[2546]: I0614 14:48:59.716418 2546 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c96gx_105377da-c223-41ad-b033-546cb01239c4/konnectivity-agent/0.log" limit=1024 Jun 14 14:48:59.814402 ip-10-0-129-116 kubenswrapper[2546]: I0614 14:48:59.814367 2546 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c96gx_105377da-c223-41ad-b033-546cb01239c4/konnectivity-agent/0.log" limit=1024 Jun 14 14:48:59.912402 ip-10-0-129-116 kubenswrapper[2546]: I0614 14:48:59.912372 2546 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c96gx_105377da-c223-41ad-b033-546cb01239c4/konnectivity-agent/0.log" limit=1024 Jun 14 14:49:00.409528 ip-10-0-129-116 kubenswrapper[2546]: I0614 14:49:00.409494 2546 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c96gx_105377da-c223-41ad-b033-546cb01239c4/konnectivity-agent/0.log" limit=1024 Jun 14 14:49:00.510029 ip-10-0-129-116 kubenswrapper[2546]: I0614 14:49:00.509995 2546 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c96gx_105377da-c223-41ad-b033-546cb01239c4/konnectivity-agent/0.log" limit=1024 Jun 14 14:49:01.791441 ip-10-0-129-116 kubenswrapper[2546]: I0614 14:49:01.791407 2546 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c96gx_105377da-c223-41ad-b033-546cb01239c4/konnectivity-agent/0.log" limit=1024 Jun 14 14:49:01.932751 ip-10-0-129-116 kubenswrapper[2546]: I0614 14:49:01.932713 2546 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c96gx_105377da-c223-41ad-b033-546cb01239c4/konnectivity-agent/0.log" limit=1024 Jun 14 14:49:03.192499 ip-10-0-129-116 kubenswrapper[2546]: I0614 14:49:03.192467 2546 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c96gx_105377da-c223-41ad-b033-546cb01239c4/konnectivity-agent/0.log" limit=1024 Jun 14 14:49:06.328250 ip-10-0-129-116 kubenswrapper[2546]: I0614 14:49:06.328210 2546 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c96gx_105377da-c223-41ad-b033-546cb01239c4/konnectivity-agent/0.log" limit=1024 Jun 14 14:49:06.733850 ip-10-0-129-116 kubenswrapper[2546]: I0614 14:49:06.733817 2546 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c96gx_105377da-c223-41ad-b033-546cb01239c4/konnectivity-agent/0.log" limit=1024 Jun 14 14:49:07.102010 ip-10-0-129-116 kubenswrapper[2546]: I0614 14:49:07.101927 2546 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c96gx_105377da-c223-41ad-b033-546cb01239c4/konnectivity-agent/0.log" limit=1024 Jun 14 14:49:07.191916 ip-10-0-129-116 kubenswrapper[2546]: I0614 14:49:07.191887 2546 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c96gx_105377da-c223-41ad-b033-546cb01239c4/konnectivity-agent/0.log" limit=1024 Jun 14 14:49:09.225630 ip-10-0-129-116 kubenswrapper[2546]: I0614 14:49:09.225585 2546 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c96gx_105377da-c223-41ad-b033-546cb01239c4/konnectivity-agent/0.log" limit=1024 Jun 14 14:49:09.790560 ip-10-0-129-116 kubenswrapper[2546]: I0614 14:49:09.790525 2546 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c96gx_105377da-c223-41ad-b033-546cb01239c4/konnectivity-agent/0.log" limit=1024 Jun 14 14:49:10.266930 ip-10-0-129-116 kubenswrapper[2546]: I0614 14:49:10.266892 2546 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-57765465c6-z5wh8"] Jun 14 14:49:10.394677 ip-10-0-129-116 kubenswrapper[2546]: I0614 14:49:10.394646 2546 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c96gx_105377da-c223-41ad-b033-546cb01239c4/konnectivity-agent/0.log" limit=1024 Jun 14 14:49:10.499732 ip-10-0-129-116 kubenswrapper[2546]: I0614 14:49:10.499671 2546 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c96gx_105377da-c223-41ad-b033-546cb01239c4/konnectivity-agent/0.log" limit=1024 Jun 14 14:49:10.597318 ip-10-0-129-116 kubenswrapper[2546]: I0614 14:49:10.597220 2546 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c96gx_105377da-c223-41ad-b033-546cb01239c4/konnectivity-agent/0.log" limit=1024 Jun 14 14:49:11.139681 ip-10-0-129-116 kubenswrapper[2546]: I0614 14:49:11.139644 2546 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c96gx_105377da-c223-41ad-b033-546cb01239c4/konnectivity-agent/0.log" limit=1024 Jun 14 14:49:11.239562 ip-10-0-129-116 kubenswrapper[2546]: I0614 14:49:11.239525 2546 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c96gx_105377da-c223-41ad-b033-546cb01239c4/konnectivity-agent/0.log" limit=1024 Jun 14 14:49:14.939280 ip-10-0-129-116 kubenswrapper[2546]: I0614 14:49:14.939246 2546 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c96gx_105377da-c223-41ad-b033-546cb01239c4/konnectivity-agent/0.log" limit=1024 Jun 14 14:49:15.040412 ip-10-0-129-116 kubenswrapper[2546]: I0614 14:49:15.040374 2546 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c96gx_105377da-c223-41ad-b033-546cb01239c4/konnectivity-agent/0.log" limit=1024 Jun 14 14:49:16.045512 ip-10-0-129-116 kubenswrapper[2546]: I0614 14:49:16.042502 2546 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-console-plugin-66b5774985-pfzlt"] Jun 14 14:49:16.045512 ip-10-0-129-116 kubenswrapper[2546]: I0614 14:49:16.043336 2546 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="4350f20c-1a09-46ff-a2ab-a88c955d8313" containerName="util" Jun 14 14:49:16.045512 ip-10-0-129-116 kubenswrapper[2546]: I0614 14:49:16.043359 2546 state_mem.go:107] "Deleted CPUSet assignment" podUID="4350f20c-1a09-46ff-a2ab-a88c955d8313" containerName="util" Jun 14 14:49:16.045512 ip-10-0-129-116 kubenswrapper[2546]: I0614 14:49:16.043385 2546 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="42690162-7abb-4f31-9429-beb1e00464b7" containerName="pull" Jun 14 14:49:16.045512 ip-10-0-129-116 kubenswrapper[2546]: I0614 14:49:16.043393 2546 state_mem.go:107] "Deleted CPUSet assignment" podUID="42690162-7abb-4f31-9429-beb1e00464b7" containerName="pull" Jun 14 14:49:16.045512 ip-10-0-129-116 kubenswrapper[2546]: I0614 14:49:16.043410 2546 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="61ff73d0-331c-41dd-ac43-f90d22200a4f" containerName="pull" Jun 14 14:49:16.045512 ip-10-0-129-116 kubenswrapper[2546]: I0614 14:49:16.043419 2546 state_mem.go:107] "Deleted CPUSet assignment" podUID="61ff73d0-331c-41dd-ac43-f90d22200a4f" containerName="pull" Jun 14 14:49:16.045512 ip-10-0-129-116 kubenswrapper[2546]: I0614 14:49:16.043454 2546 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="42690162-7abb-4f31-9429-beb1e00464b7" containerName="extract" Jun 14 14:49:16.045512 ip-10-0-129-116 kubenswrapper[2546]: I0614 14:49:16.043464 2546 state_mem.go:107] "Deleted CPUSet assignment" podUID="42690162-7abb-4f31-9429-beb1e00464b7" containerName="extract" Jun 14 14:49:16.045512 ip-10-0-129-116 kubenswrapper[2546]: I0614 14:49:16.043478 2546 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="61ff73d0-331c-41dd-ac43-f90d22200a4f" containerName="util" Jun 14 14:49:16.045512 ip-10-0-129-116 kubenswrapper[2546]: I0614 14:49:16.043487 2546 state_mem.go:107] "Deleted CPUSet assignment" podUID="61ff73d0-331c-41dd-ac43-f90d22200a4f" containerName="util" Jun 14 14:49:16.045512 ip-10-0-129-116 kubenswrapper[2546]: I0614 14:49:16.043506 2546 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="497bcfe0-8765-47d4-87c4-066499fefb27" containerName="extract" Jun 14 14:49:16.045512 ip-10-0-129-116 kubenswrapper[2546]: I0614 14:49:16.043514 2546 state_mem.go:107] "Deleted CPUSet assignment" podUID="497bcfe0-8765-47d4-87c4-066499fefb27" containerName="extract" Jun 14 14:49:16.045512 ip-10-0-129-116 kubenswrapper[2546]: I0614 14:49:16.043533 2546 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="4350f20c-1a09-46ff-a2ab-a88c955d8313" containerName="pull" Jun 14 14:49:16.045512 ip-10-0-129-116 kubenswrapper[2546]: I0614 14:49:16.043540 2546 state_mem.go:107] "Deleted CPUSet assignment" podUID="4350f20c-1a09-46ff-a2ab-a88c955d8313" containerName="pull" Jun 14 14:49:16.045512 ip-10-0-129-116 kubenswrapper[2546]: I0614 14:49:16.043548 2546 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="4350f20c-1a09-46ff-a2ab-a88c955d8313" containerName="extract" Jun 14 14:49:16.045512 ip-10-0-129-116 kubenswrapper[2546]: I0614 14:49:16.043556 2546 state_mem.go:107] "Deleted CPUSet assignment" podUID="4350f20c-1a09-46ff-a2ab-a88c955d8313" containerName="extract" Jun 14 14:49:16.045512 ip-10-0-129-116 kubenswrapper[2546]: I0614 14:49:16.043565 2546 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="497bcfe0-8765-47d4-87c4-066499fefb27" containerName="pull" Jun 14 14:49:16.045512 ip-10-0-129-116 kubenswrapper[2546]: I0614 14:49:16.043573 2546 state_mem.go:107] "Deleted CPUSet assignment" podUID="497bcfe0-8765-47d4-87c4-066499fefb27" containerName="pull" Jun 14 14:49:16.045512 ip-10-0-129-116 kubenswrapper[2546]: I0614 14:49:16.043591 2546 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="42690162-7abb-4f31-9429-beb1e00464b7" containerName="util" Jun 14 14:49:16.045512 ip-10-0-129-116 kubenswrapper[2546]: I0614 14:49:16.043599 2546 state_mem.go:107] "Deleted CPUSet assignment" podUID="42690162-7abb-4f31-9429-beb1e00464b7" containerName="util" Jun 14 14:49:16.045512 ip-10-0-129-116 kubenswrapper[2546]: I0614 14:49:16.043607 2546 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="497bcfe0-8765-47d4-87c4-066499fefb27" containerName="util" Jun 14 14:49:16.045512 ip-10-0-129-116 kubenswrapper[2546]: I0614 14:49:16.043615 2546 state_mem.go:107] "Deleted CPUSet assignment" podUID="497bcfe0-8765-47d4-87c4-066499fefb27" containerName="util" Jun 14 14:49:16.045512 ip-10-0-129-116 kubenswrapper[2546]: I0614 14:49:16.043643 2546 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="61ff73d0-331c-41dd-ac43-f90d22200a4f" containerName="extract" Jun 14 14:49:16.045512 ip-10-0-129-116 kubenswrapper[2546]: I0614 14:49:16.043651 2546 state_mem.go:107] "Deleted CPUSet assignment" podUID="61ff73d0-331c-41dd-ac43-f90d22200a4f" containerName="extract" Jun 14 14:49:16.045512 ip-10-0-129-116 kubenswrapper[2546]: I0614 14:49:16.043819 2546 memory_manager.go:368] "RemoveStaleState removing state" podUID="42690162-7abb-4f31-9429-beb1e00464b7" containerName="extract" Jun 14 14:49:16.045512 ip-10-0-129-116 kubenswrapper[2546]: I0614 14:49:16.043834 2546 memory_manager.go:368] "RemoveStaleState removing state" podUID="61ff73d0-331c-41dd-ac43-f90d22200a4f" containerName="extract" Jun 14 14:49:16.045512 ip-10-0-129-116 kubenswrapper[2546]: I0614 14:49:16.043850 2546 memory_manager.go:368] "RemoveStaleState removing state" podUID="4350f20c-1a09-46ff-a2ab-a88c955d8313" containerName="extract" Jun 14 14:49:16.045512 ip-10-0-129-116 kubenswrapper[2546]: I0614 14:49:16.043859 2546 memory_manager.go:368] "RemoveStaleState removing state" podUID="497bcfe0-8765-47d4-87c4-066499fefb27" containerName="extract" Jun 14 14:49:16.048690 ip-10-0-129-116 kubenswrapper[2546]: I0614 14:49:16.048658 2546 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-console-plugin-66b5774985-pfzlt" Jun 14 14:49:16.049398 ip-10-0-129-116 kubenswrapper[2546]: I0614 14:49:16.049373 2546 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c96gx_105377da-c223-41ad-b033-546cb01239c4/konnectivity-agent/0.log" limit=1024 Jun 14 14:49:16.052195 ip-10-0-129-116 kubenswrapper[2546]: I0614 14:49:16.052083 2546 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"kuadrant-console-nginx-conf\"" Jun 14 14:49:16.053123 ip-10-0-129-116 kubenswrapper[2546]: I0614 14:49:16.053029 2546 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"kube-root-ca.crt\"" Jun 14 14:49:16.053123 ip-10-0-129-116 kubenswrapper[2546]: I0614 14:49:16.053045 2546 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"plugin-serving-cert\"" Jun 14 14:49:16.053123 ip-10-0-129-116 kubenswrapper[2546]: I0614 14:49:16.053114 2546 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"default-dockercfg-txrcp\"" Jun 14 14:49:16.053350 ip-10-0-129-116 kubenswrapper[2546]: I0614 14:49:16.053135 2546 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"openshift-service-ca.crt\"" Jun 14 14:49:16.055634 ip-10-0-129-116 kubenswrapper[2546]: I0614 14:49:16.055611 2546 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-console-plugin-66b5774985-pfzlt"] Jun 14 14:49:16.100476 ip-10-0-129-116 kubenswrapper[2546]: I0614 14:49:16.100447 2546 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugin-serving-cert\" (UniqueName: \"kubernetes.io/secret/7901c4c3-d3a4-4fc9-af27-f41ae5b989f9-plugin-serving-cert\") pod \"kuadrant-console-plugin-66b5774985-pfzlt\" (UID: \"7901c4c3-d3a4-4fc9-af27-f41ae5b989f9\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-pfzlt" Jun 14 14:49:16.100629 ip-10-0-129-116 kubenswrapper[2546]: I0614 14:49:16.100484 2546 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/7901c4c3-d3a4-4fc9-af27-f41ae5b989f9-nginx-conf\") pod \"kuadrant-console-plugin-66b5774985-pfzlt\" (UID: \"7901c4c3-d3a4-4fc9-af27-f41ae5b989f9\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-pfzlt" Jun 14 14:49:16.100629 ip-10-0-129-116 kubenswrapper[2546]: I0614 14:49:16.100504 2546 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9hjcg\" (UniqueName: \"kubernetes.io/projected/7901c4c3-d3a4-4fc9-af27-f41ae5b989f9-kube-api-access-9hjcg\") pod \"kuadrant-console-plugin-66b5774985-pfzlt\" (UID: \"7901c4c3-d3a4-4fc9-af27-f41ae5b989f9\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-pfzlt" Jun 14 14:49:16.201868 ip-10-0-129-116 kubenswrapper[2546]: I0614 14:49:16.201835 2546 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugin-serving-cert\" (UniqueName: \"kubernetes.io/secret/7901c4c3-d3a4-4fc9-af27-f41ae5b989f9-plugin-serving-cert\") pod \"kuadrant-console-plugin-66b5774985-pfzlt\" (UID: \"7901c4c3-d3a4-4fc9-af27-f41ae5b989f9\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-pfzlt" Jun 14 14:49:16.202046 ip-10-0-129-116 kubenswrapper[2546]: I0614 14:49:16.201883 2546 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/7901c4c3-d3a4-4fc9-af27-f41ae5b989f9-nginx-conf\") pod \"kuadrant-console-plugin-66b5774985-pfzlt\" (UID: \"7901c4c3-d3a4-4fc9-af27-f41ae5b989f9\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-pfzlt" Jun 14 14:49:16.202046 ip-10-0-129-116 kubenswrapper[2546]: I0614 14:49:16.201914 2546 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9hjcg\" (UniqueName: \"kubernetes.io/projected/7901c4c3-d3a4-4fc9-af27-f41ae5b989f9-kube-api-access-9hjcg\") pod \"kuadrant-console-plugin-66b5774985-pfzlt\" (UID: \"7901c4c3-d3a4-4fc9-af27-f41ae5b989f9\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-pfzlt" Jun 14 14:49:16.202046 ip-10-0-129-116 kubenswrapper[2546]: E0614 14:49:16.201986 2546 secret.go:189] Couldn't get secret kuadrant-system/plugin-serving-cert: secret "plugin-serving-cert" not found Jun 14 14:49:16.202213 ip-10-0-129-116 kubenswrapper[2546]: E0614 14:49:16.202121 2546 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/7901c4c3-d3a4-4fc9-af27-f41ae5b989f9-plugin-serving-cert podName:7901c4c3-d3a4-4fc9-af27-f41ae5b989f9 nodeName:}" failed. No retries permitted until 2026-06-14 14:49:16.702076025 +0000 UTC m=+594.030458144 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "plugin-serving-cert" (UniqueName: "kubernetes.io/secret/7901c4c3-d3a4-4fc9-af27-f41ae5b989f9-plugin-serving-cert") pod "kuadrant-console-plugin-66b5774985-pfzlt" (UID: "7901c4c3-d3a4-4fc9-af27-f41ae5b989f9") : secret "plugin-serving-cert" not found Jun 14 14:49:16.202543 ip-10-0-129-116 kubenswrapper[2546]: I0614 14:49:16.202523 2546 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/7901c4c3-d3a4-4fc9-af27-f41ae5b989f9-nginx-conf\") pod \"kuadrant-console-plugin-66b5774985-pfzlt\" (UID: \"7901c4c3-d3a4-4fc9-af27-f41ae5b989f9\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-pfzlt" Jun 14 14:49:16.210760 ip-10-0-129-116 kubenswrapper[2546]: I0614 14:49:16.210735 2546 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-9hjcg\" (UniqueName: \"kubernetes.io/projected/7901c4c3-d3a4-4fc9-af27-f41ae5b989f9-kube-api-access-9hjcg\") pod \"kuadrant-console-plugin-66b5774985-pfzlt\" (UID: \"7901c4c3-d3a4-4fc9-af27-f41ae5b989f9\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-pfzlt" Jun 14 14:49:16.249060 ip-10-0-129-116 kubenswrapper[2546]: I0614 14:49:16.249025 2546 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c96gx_105377da-c223-41ad-b033-546cb01239c4/konnectivity-agent/0.log" limit=1024 Jun 14 14:49:16.707127 ip-10-0-129-116 kubenswrapper[2546]: I0614 14:49:16.707070 2546 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugin-serving-cert\" (UniqueName: \"kubernetes.io/secret/7901c4c3-d3a4-4fc9-af27-f41ae5b989f9-plugin-serving-cert\") pod \"kuadrant-console-plugin-66b5774985-pfzlt\" (UID: \"7901c4c3-d3a4-4fc9-af27-f41ae5b989f9\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-pfzlt" Jun 14 14:49:16.709528 ip-10-0-129-116 kubenswrapper[2546]: I0614 14:49:16.709499 2546 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"plugin-serving-cert\" (UniqueName: \"kubernetes.io/secret/7901c4c3-d3a4-4fc9-af27-f41ae5b989f9-plugin-serving-cert\") pod \"kuadrant-console-plugin-66b5774985-pfzlt\" (UID: \"7901c4c3-d3a4-4fc9-af27-f41ae5b989f9\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-pfzlt" Jun 14 14:49:16.959999 ip-10-0-129-116 kubenswrapper[2546]: I0614 14:49:16.959915 2546 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-console-plugin-66b5774985-pfzlt" Jun 14 14:49:17.092687 ip-10-0-129-116 kubenswrapper[2546]: I0614 14:49:17.092663 2546 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-console-plugin-66b5774985-pfzlt"] Jun 14 14:49:17.095209 ip-10-0-129-116 kubenswrapper[2546]: W0614 14:49:17.095177 2546 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod7901c4c3_d3a4_4fc9_af27_f41ae5b989f9.slice/crio-18f8df92e328f3cd6d7170fe5ef1528fb7c6f4b06e0ec7a5f2ea1d47a05f2803 WatchSource:0}: Error finding container 18f8df92e328f3cd6d7170fe5ef1528fb7c6f4b06e0ec7a5f2ea1d47a05f2803: Status 404 returned error can't find the container with id 18f8df92e328f3cd6d7170fe5ef1528fb7c6f4b06e0ec7a5f2ea1d47a05f2803 Jun 14 14:49:17.594299 ip-10-0-129-116 kubenswrapper[2546]: I0614 14:49:17.594267 2546 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-console-plugin-66b5774985-pfzlt" event={"ID":"7901c4c3-d3a4-4fc9-af27-f41ae5b989f9","Type":"ContainerStarted","Data":"18f8df92e328f3cd6d7170fe5ef1528fb7c6f4b06e0ec7a5f2ea1d47a05f2803"} Jun 14 14:49:18.337689 ip-10-0-129-116 kubenswrapper[2546]: I0614 14:49:18.337656 2546 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c96gx_105377da-c223-41ad-b033-546cb01239c4/konnectivity-agent/0.log" limit=1024 Jun 14 14:49:18.439887 ip-10-0-129-116 kubenswrapper[2546]: I0614 14:49:18.439833 2546 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c96gx_105377da-c223-41ad-b033-546cb01239c4/konnectivity-agent/0.log" limit=1024 Jun 14 14:49:26.773339 ip-10-0-129-116 kubenswrapper[2546]: I0614 14:49:26.773296 2546 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c96gx_105377da-c223-41ad-b033-546cb01239c4/konnectivity-agent/0.log" limit=1024 Jun 14 14:49:27.839346 ip-10-0-129-116 kubenswrapper[2546]: I0614 14:49:27.839308 2546 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c96gx_105377da-c223-41ad-b033-546cb01239c4/konnectivity-agent/0.log" limit=1024 Jun 14 14:49:29.301426 ip-10-0-129-116 kubenswrapper[2546]: I0614 14:49:29.301388 2546 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c96gx_105377da-c223-41ad-b033-546cb01239c4/konnectivity-agent/0.log" limit=1024 Jun 14 14:49:29.403231 ip-10-0-129-116 kubenswrapper[2546]: I0614 14:49:29.403199 2546 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c96gx_105377da-c223-41ad-b033-546cb01239c4/konnectivity-agent/0.log" limit=1024 Jun 14 14:49:30.091559 ip-10-0-129-116 kubenswrapper[2546]: I0614 14:49:30.091527 2546 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c96gx_105377da-c223-41ad-b033-546cb01239c4/konnectivity-agent/0.log" limit=1024 Jun 14 14:49:30.193153 ip-10-0-129-116 kubenswrapper[2546]: I0614 14:49:30.193119 2546 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c96gx_105377da-c223-41ad-b033-546cb01239c4/konnectivity-agent/0.log" limit=1024 Jun 14 14:49:32.152836 ip-10-0-129-116 kubenswrapper[2546]: I0614 14:49:32.152801 2546 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c96gx_105377da-c223-41ad-b033-546cb01239c4/konnectivity-agent/0.log" limit=1024 Jun 14 14:49:32.252213 ip-10-0-129-116 kubenswrapper[2546]: I0614 14:49:32.252158 2546 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c96gx_105377da-c223-41ad-b033-546cb01239c4/konnectivity-agent/0.log" limit=1024 Jun 14 14:49:35.288769 ip-10-0-129-116 kubenswrapper[2546]: I0614 14:49:35.288722 2546 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-console/console-57765465c6-z5wh8" podUID="a4efc7d6-8ce0-4c65-9457-f35022b3b37e" containerName="console" containerID="cri-o://1dca94fd7b92bf0da6b69b0bffe189b39382df0f2f07f03ad14de1a2d32e4512" gracePeriod=15 Jun 14 14:49:35.406271 ip-10-0-129-116 kubenswrapper[2546]: I0614 14:49:35.406228 2546 patch_prober.go:28] interesting pod/console-57765465c6-z5wh8 container/console namespace/openshift-console: Readiness probe status=failure output="Get \"https://10.132.0.23:8443/health\": dial tcp 10.132.0.23:8443: connect: connection refused" start-of-body= Jun 14 14:49:35.406438 ip-10-0-129-116 kubenswrapper[2546]: I0614 14:49:35.406295 2546 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-console/console-57765465c6-z5wh8" podUID="a4efc7d6-8ce0-4c65-9457-f35022b3b37e" containerName="console" probeResult="failure" output="Get \"https://10.132.0.23:8443/health\": dial tcp 10.132.0.23:8443: connect: connection refused" Jun 14 14:49:35.723884 ip-10-0-129-116 kubenswrapper[2546]: I0614 14:49:35.723850 2546 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c96gx_105377da-c223-41ad-b033-546cb01239c4/konnectivity-agent/0.log" limit=1024 Jun 14 14:49:35.824348 ip-10-0-129-116 kubenswrapper[2546]: I0614 14:49:35.824311 2546 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c96gx_105377da-c223-41ad-b033-546cb01239c4/konnectivity-agent/0.log" limit=1024 Jun 14 14:49:40.984181 ip-10-0-129-116 kubenswrapper[2546]: I0614 14:49:40.984139 2546 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-57765465c6-z5wh8" Jun 14 14:49:41.130380 ip-10-0-129-116 kubenswrapper[2546]: I0614 14:49:41.130291 2546 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/a4efc7d6-8ce0-4c65-9457-f35022b3b37e-service-ca\") pod \"a4efc7d6-8ce0-4c65-9457-f35022b3b37e\" (UID: \"a4efc7d6-8ce0-4c65-9457-f35022b3b37e\") " Jun 14 14:49:41.130380 ip-10-0-129-116 kubenswrapper[2546]: I0614 14:49:41.130326 2546 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/a4efc7d6-8ce0-4c65-9457-f35022b3b37e-console-config\") pod \"a4efc7d6-8ce0-4c65-9457-f35022b3b37e\" (UID: \"a4efc7d6-8ce0-4c65-9457-f35022b3b37e\") " Jun 14 14:49:41.130380 ip-10-0-129-116 kubenswrapper[2546]: I0614 14:49:41.130372 2546 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/a4efc7d6-8ce0-4c65-9457-f35022b3b37e-console-oauth-config\") pod \"a4efc7d6-8ce0-4c65-9457-f35022b3b37e\" (UID: \"a4efc7d6-8ce0-4c65-9457-f35022b3b37e\") " Jun 14 14:49:41.130653 ip-10-0-129-116 kubenswrapper[2546]: I0614 14:49:41.130391 2546 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/a4efc7d6-8ce0-4c65-9457-f35022b3b37e-trusted-ca-bundle\") pod \"a4efc7d6-8ce0-4c65-9457-f35022b3b37e\" (UID: \"a4efc7d6-8ce0-4c65-9457-f35022b3b37e\") " Jun 14 14:49:41.130653 ip-10-0-129-116 kubenswrapper[2546]: I0614 14:49:41.130434 2546 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/a4efc7d6-8ce0-4c65-9457-f35022b3b37e-console-serving-cert\") pod \"a4efc7d6-8ce0-4c65-9457-f35022b3b37e\" (UID: \"a4efc7d6-8ce0-4c65-9457-f35022b3b37e\") " Jun 14 14:49:41.130653 ip-10-0-129-116 kubenswrapper[2546]: I0614 14:49:41.130465 2546 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/a4efc7d6-8ce0-4c65-9457-f35022b3b37e-oauth-serving-cert\") pod \"a4efc7d6-8ce0-4c65-9457-f35022b3b37e\" (UID: \"a4efc7d6-8ce0-4c65-9457-f35022b3b37e\") " Jun 14 14:49:41.130653 ip-10-0-129-116 kubenswrapper[2546]: I0614 14:49:41.130494 2546 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-kvmln\" (UniqueName: \"kubernetes.io/projected/a4efc7d6-8ce0-4c65-9457-f35022b3b37e-kube-api-access-kvmln\") pod \"a4efc7d6-8ce0-4c65-9457-f35022b3b37e\" (UID: \"a4efc7d6-8ce0-4c65-9457-f35022b3b37e\") " Jun 14 14:49:41.130850 ip-10-0-129-116 kubenswrapper[2546]: I0614 14:49:41.130759 2546 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/a4efc7d6-8ce0-4c65-9457-f35022b3b37e-service-ca" (OuterVolumeSpecName: "service-ca") pod "a4efc7d6-8ce0-4c65-9457-f35022b3b37e" (UID: "a4efc7d6-8ce0-4c65-9457-f35022b3b37e"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 14 14:49:41.130850 ip-10-0-129-116 kubenswrapper[2546]: I0614 14:49:41.130827 2546 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/a4efc7d6-8ce0-4c65-9457-f35022b3b37e-console-config" (OuterVolumeSpecName: "console-config") pod "a4efc7d6-8ce0-4c65-9457-f35022b3b37e" (UID: "a4efc7d6-8ce0-4c65-9457-f35022b3b37e"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 14 14:49:41.130938 ip-10-0-129-116 kubenswrapper[2546]: I0614 14:49:41.130831 2546 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/a4efc7d6-8ce0-4c65-9457-f35022b3b37e-trusted-ca-bundle" (OuterVolumeSpecName: "trusted-ca-bundle") pod "a4efc7d6-8ce0-4c65-9457-f35022b3b37e" (UID: "a4efc7d6-8ce0-4c65-9457-f35022b3b37e"). InnerVolumeSpecName "trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 14 14:49:41.130938 ip-10-0-129-116 kubenswrapper[2546]: I0614 14:49:41.130866 2546 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/a4efc7d6-8ce0-4c65-9457-f35022b3b37e-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "a4efc7d6-8ce0-4c65-9457-f35022b3b37e" (UID: "a4efc7d6-8ce0-4c65-9457-f35022b3b37e"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 14 14:49:41.132581 ip-10-0-129-116 kubenswrapper[2546]: I0614 14:49:41.132555 2546 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/a4efc7d6-8ce0-4c65-9457-f35022b3b37e-kube-api-access-kvmln" (OuterVolumeSpecName: "kube-api-access-kvmln") pod "a4efc7d6-8ce0-4c65-9457-f35022b3b37e" (UID: "a4efc7d6-8ce0-4c65-9457-f35022b3b37e"). InnerVolumeSpecName "kube-api-access-kvmln". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 14 14:49:41.132682 ip-10-0-129-116 kubenswrapper[2546]: I0614 14:49:41.132634 2546 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/a4efc7d6-8ce0-4c65-9457-f35022b3b37e-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "a4efc7d6-8ce0-4c65-9457-f35022b3b37e" (UID: "a4efc7d6-8ce0-4c65-9457-f35022b3b37e"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 14 14:49:41.132682 ip-10-0-129-116 kubenswrapper[2546]: I0614 14:49:41.132656 2546 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/a4efc7d6-8ce0-4c65-9457-f35022b3b37e-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "a4efc7d6-8ce0-4c65-9457-f35022b3b37e" (UID: "a4efc7d6-8ce0-4c65-9457-f35022b3b37e"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 14 14:49:41.231331 ip-10-0-129-116 kubenswrapper[2546]: I0614 14:49:41.231301 2546 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/a4efc7d6-8ce0-4c65-9457-f35022b3b37e-service-ca\") on node \"ip-10-0-129-116.ec2.internal\" DevicePath \"\"" Jun 14 14:49:41.231331 ip-10-0-129-116 kubenswrapper[2546]: I0614 14:49:41.231328 2546 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/a4efc7d6-8ce0-4c65-9457-f35022b3b37e-console-config\") on node \"ip-10-0-129-116.ec2.internal\" DevicePath \"\"" Jun 14 14:49:41.231331 ip-10-0-129-116 kubenswrapper[2546]: I0614 14:49:41.231338 2546 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/a4efc7d6-8ce0-4c65-9457-f35022b3b37e-console-oauth-config\") on node \"ip-10-0-129-116.ec2.internal\" DevicePath \"\"" Jun 14 14:49:41.231561 ip-10-0-129-116 kubenswrapper[2546]: I0614 14:49:41.231347 2546 reconciler_common.go:299] "Volume detached for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/a4efc7d6-8ce0-4c65-9457-f35022b3b37e-trusted-ca-bundle\") on node \"ip-10-0-129-116.ec2.internal\" DevicePath \"\"" Jun 14 14:49:41.231561 ip-10-0-129-116 kubenswrapper[2546]: I0614 14:49:41.231356 2546 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/a4efc7d6-8ce0-4c65-9457-f35022b3b37e-console-serving-cert\") on node \"ip-10-0-129-116.ec2.internal\" DevicePath \"\"" Jun 14 14:49:41.231561 ip-10-0-129-116 kubenswrapper[2546]: I0614 14:49:41.231364 2546 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/a4efc7d6-8ce0-4c65-9457-f35022b3b37e-oauth-serving-cert\") on node \"ip-10-0-129-116.ec2.internal\" DevicePath \"\"" Jun 14 14:49:41.231561 ip-10-0-129-116 kubenswrapper[2546]: I0614 14:49:41.231372 2546 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-kvmln\" (UniqueName: \"kubernetes.io/projected/a4efc7d6-8ce0-4c65-9457-f35022b3b37e-kube-api-access-kvmln\") on node \"ip-10-0-129-116.ec2.internal\" DevicePath \"\"" Jun 14 14:49:41.738229 ip-10-0-129-116 kubenswrapper[2546]: I0614 14:49:41.738197 2546 generic.go:356] "Generic (PLEG): container finished" podID="a4efc7d6-8ce0-4c65-9457-f35022b3b37e" containerID="1dca94fd7b92bf0da6b69b0bffe189b39382df0f2f07f03ad14de1a2d32e4512" exitCode=0 Jun 14 14:49:41.738408 ip-10-0-129-116 kubenswrapper[2546]: I0614 14:49:41.738241 2546 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-57765465c6-z5wh8" Jun 14 14:49:41.738408 ip-10-0-129-116 kubenswrapper[2546]: I0614 14:49:41.738285 2546 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-57765465c6-z5wh8" event={"ID":"a4efc7d6-8ce0-4c65-9457-f35022b3b37e","Type":"ContainerDied","Data":"1dca94fd7b92bf0da6b69b0bffe189b39382df0f2f07f03ad14de1a2d32e4512"} Jun 14 14:49:41.738408 ip-10-0-129-116 kubenswrapper[2546]: I0614 14:49:41.738341 2546 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-57765465c6-z5wh8" event={"ID":"a4efc7d6-8ce0-4c65-9457-f35022b3b37e","Type":"ContainerDied","Data":"2d13c2b977f1acb94988c488d73a13c0d436ec6acf3479c3987bbda2de236778"} Jun 14 14:49:41.738408 ip-10-0-129-116 kubenswrapper[2546]: I0614 14:49:41.738368 2546 scope.go:117] "RemoveContainer" containerID="1dca94fd7b92bf0da6b69b0bffe189b39382df0f2f07f03ad14de1a2d32e4512" Jun 14 14:49:41.740141 ip-10-0-129-116 kubenswrapper[2546]: I0614 14:49:41.740071 2546 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-console-plugin-66b5774985-pfzlt" event={"ID":"7901c4c3-d3a4-4fc9-af27-f41ae5b989f9","Type":"ContainerStarted","Data":"9e85edfcfdb131047fb2151f92d6afd0bfca3d0f207c23f692ab9432c836dc72"} Jun 14 14:49:41.747265 ip-10-0-129-116 kubenswrapper[2546]: I0614 14:49:41.747248 2546 scope.go:117] "RemoveContainer" containerID="1dca94fd7b92bf0da6b69b0bffe189b39382df0f2f07f03ad14de1a2d32e4512" Jun 14 14:49:41.747537 ip-10-0-129-116 kubenswrapper[2546]: E0614 14:49:41.747520 2546 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"1dca94fd7b92bf0da6b69b0bffe189b39382df0f2f07f03ad14de1a2d32e4512\": container with ID starting with 1dca94fd7b92bf0da6b69b0bffe189b39382df0f2f07f03ad14de1a2d32e4512 not found: ID does not exist" containerID="1dca94fd7b92bf0da6b69b0bffe189b39382df0f2f07f03ad14de1a2d32e4512" Jun 14 14:49:41.747596 ip-10-0-129-116 kubenswrapper[2546]: I0614 14:49:41.747545 2546 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"1dca94fd7b92bf0da6b69b0bffe189b39382df0f2f07f03ad14de1a2d32e4512"} err="failed to get container status \"1dca94fd7b92bf0da6b69b0bffe189b39382df0f2f07f03ad14de1a2d32e4512\": rpc error: code = NotFound desc = could not find container \"1dca94fd7b92bf0da6b69b0bffe189b39382df0f2f07f03ad14de1a2d32e4512\": container with ID starting with 1dca94fd7b92bf0da6b69b0bffe189b39382df0f2f07f03ad14de1a2d32e4512 not found: ID does not exist" Jun 14 14:49:41.754874 ip-10-0-129-116 kubenswrapper[2546]: I0614 14:49:41.754851 2546 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-57765465c6-z5wh8"] Jun 14 14:49:41.757007 ip-10-0-129-116 kubenswrapper[2546]: I0614 14:49:41.756986 2546 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-57765465c6-z5wh8"] Jun 14 14:49:41.767347 ip-10-0-129-116 kubenswrapper[2546]: I0614 14:49:41.767306 2546 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-console-plugin-66b5774985-pfzlt" podStartSLOduration=1.954900768 podStartE2EDuration="25.76729344s" totalImagesPullingTime="23.812392672s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-14 14:49:16 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-14 14:49:41.767088165 +0000 UTC m=+619.095470316" watchObservedRunningTime="2026-06-14 14:49:41.76729344 +0000 UTC m=+619.095675564" Jun 14 14:49:43.194292 ip-10-0-129-116 kubenswrapper[2546]: I0614 14:49:43.191894 2546 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="a4efc7d6-8ce0-4c65-9457-f35022b3b37e" path="/var/lib/kubelet/pods/a4efc7d6-8ce0-4c65-9457-f35022b3b37e/volumes" Jun 14 14:49:44.500716 ip-10-0-129-116 kubenswrapper[2546]: I0614 14:49:44.500660 2546 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c96gx_105377da-c223-41ad-b033-546cb01239c4/konnectivity-agent/0.log" limit=1024 Jun 14 14:49:44.630621 ip-10-0-129-116 kubenswrapper[2546]: I0614 14:49:44.630581 2546 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c96gx_105377da-c223-41ad-b033-546cb01239c4/konnectivity-agent/0.log" limit=1024 Jun 14 14:49:47.091511 ip-10-0-129-116 kubenswrapper[2546]: I0614 14:49:47.091477 2546 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c96gx_105377da-c223-41ad-b033-546cb01239c4/konnectivity-agent/0.log" limit=1024 Jun 14 14:49:47.191913 ip-10-0-129-116 kubenswrapper[2546]: I0614 14:49:47.191878 2546 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c96gx_105377da-c223-41ad-b033-546cb01239c4/konnectivity-agent/0.log" limit=1024 Jun 14 14:49:50.285263 ip-10-0-129-116 kubenswrapper[2546]: I0614 14:49:50.285229 2546 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c96gx_105377da-c223-41ad-b033-546cb01239c4/konnectivity-agent/0.log" limit=1024 Jun 14 14:49:50.385996 ip-10-0-129-116 kubenswrapper[2546]: I0614 14:49:50.385943 2546 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c96gx_105377da-c223-41ad-b033-546cb01239c4/konnectivity-agent/0.log" limit=1024 Jun 14 14:49:53.686232 ip-10-0-129-116 kubenswrapper[2546]: I0614 14:49:53.686188 2546 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c96gx_105377da-c223-41ad-b033-546cb01239c4/konnectivity-agent/0.log" limit=1024 Jun 14 14:49:53.786131 ip-10-0-129-116 kubenswrapper[2546]: I0614 14:49:53.786063 2546 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c96gx_105377da-c223-41ad-b033-546cb01239c4/konnectivity-agent/0.log" limit=1024 Jun 14 14:49:54.648313 ip-10-0-129-116 kubenswrapper[2546]: I0614 14:49:54.648275 2546 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c96gx_105377da-c223-41ad-b033-546cb01239c4/konnectivity-agent/0.log" limit=1024 Jun 14 14:49:54.747343 ip-10-0-129-116 kubenswrapper[2546]: I0614 14:49:54.747312 2546 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c96gx_105377da-c223-41ad-b033-546cb01239c4/konnectivity-agent/0.log" limit=1024 Jun 14 14:49:56.345845 ip-10-0-129-116 kubenswrapper[2546]: I0614 14:49:56.345794 2546 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c96gx_105377da-c223-41ad-b033-546cb01239c4/konnectivity-agent/0.log" limit=1024 Jun 14 14:49:56.356946 ip-10-0-129-116 kubenswrapper[2546]: I0614 14:49:56.356917 2546 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/limitador-limitador-64c94fd64f-7jfpp"] Jun 14 14:49:56.357298 ip-10-0-129-116 kubenswrapper[2546]: I0614 14:49:56.357283 2546 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="a4efc7d6-8ce0-4c65-9457-f35022b3b37e" containerName="console" Jun 14 14:49:56.357350 ip-10-0-129-116 kubenswrapper[2546]: I0614 14:49:56.357299 2546 state_mem.go:107] "Deleted CPUSet assignment" podUID="a4efc7d6-8ce0-4c65-9457-f35022b3b37e" containerName="console" Jun 14 14:49:56.357386 ip-10-0-129-116 kubenswrapper[2546]: I0614 14:49:56.357364 2546 memory_manager.go:368] "RemoveStaleState removing state" podUID="a4efc7d6-8ce0-4c65-9457-f35022b3b37e" containerName="console" Jun 14 14:49:56.376651 ip-10-0-129-116 kubenswrapper[2546]: I0614 14:49:56.376625 2546 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-64c94fd64f-7jfpp"] Jun 14 14:49:56.376799 ip-10-0-129-116 kubenswrapper[2546]: I0614 14:49:56.376731 2546 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-64c94fd64f-7jfpp" Jun 14 14:49:56.379382 ip-10-0-129-116 kubenswrapper[2546]: I0614 14:49:56.379358 2546 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"limitador-limits-config-limitador\"" Jun 14 14:49:56.452309 ip-10-0-129-116 kubenswrapper[2546]: I0614 14:49:56.452275 2546 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-64c94fd64f-7jfpp"] Jun 14 14:49:56.462816 ip-10-0-129-116 kubenswrapper[2546]: I0614 14:49:56.462772 2546 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c96gx_105377da-c223-41ad-b033-546cb01239c4/konnectivity-agent/0.log" limit=1024 Jun 14 14:49:56.513621 ip-10-0-129-116 kubenswrapper[2546]: I0614 14:49:56.513589 2546 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c96gx_105377da-c223-41ad-b033-546cb01239c4/konnectivity-agent/0.log" limit=1024 Jun 14 14:49:56.557191 ip-10-0-129-116 kubenswrapper[2546]: I0614 14:49:56.557159 2546 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/d878794a-4d61-4bac-a544-aa325d334b7f-config-file\") pod \"limitador-limitador-64c94fd64f-7jfpp\" (UID: \"d878794a-4d61-4bac-a544-aa325d334b7f\") " pod="kuadrant-system/limitador-limitador-64c94fd64f-7jfpp" Jun 14 14:49:56.557354 ip-10-0-129-116 kubenswrapper[2546]: I0614 14:49:56.557214 2546 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vzrpc\" (UniqueName: \"kubernetes.io/projected/d878794a-4d61-4bac-a544-aa325d334b7f-kube-api-access-vzrpc\") pod \"limitador-limitador-64c94fd64f-7jfpp\" (UID: \"d878794a-4d61-4bac-a544-aa325d334b7f\") " pod="kuadrant-system/limitador-limitador-64c94fd64f-7jfpp" Jun 14 14:49:56.658225 ip-10-0-129-116 kubenswrapper[2546]: I0614 14:49:56.658189 2546 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/d878794a-4d61-4bac-a544-aa325d334b7f-config-file\") pod \"limitador-limitador-64c94fd64f-7jfpp\" (UID: \"d878794a-4d61-4bac-a544-aa325d334b7f\") " pod="kuadrant-system/limitador-limitador-64c94fd64f-7jfpp" Jun 14 14:49:56.658396 ip-10-0-129-116 kubenswrapper[2546]: I0614 14:49:56.658246 2546 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vzrpc\" (UniqueName: \"kubernetes.io/projected/d878794a-4d61-4bac-a544-aa325d334b7f-kube-api-access-vzrpc\") pod \"limitador-limitador-64c94fd64f-7jfpp\" (UID: \"d878794a-4d61-4bac-a544-aa325d334b7f\") " pod="kuadrant-system/limitador-limitador-64c94fd64f-7jfpp" Jun 14 14:49:56.658850 ip-10-0-129-116 kubenswrapper[2546]: I0614 14:49:56.658830 2546 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/d878794a-4d61-4bac-a544-aa325d334b7f-config-file\") pod \"limitador-limitador-64c94fd64f-7jfpp\" (UID: \"d878794a-4d61-4bac-a544-aa325d334b7f\") " pod="kuadrant-system/limitador-limitador-64c94fd64f-7jfpp" Jun 14 14:49:56.666105 ip-10-0-129-116 kubenswrapper[2546]: I0614 14:49:56.666072 2546 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-vzrpc\" (UniqueName: \"kubernetes.io/projected/d878794a-4d61-4bac-a544-aa325d334b7f-kube-api-access-vzrpc\") pod \"limitador-limitador-64c94fd64f-7jfpp\" (UID: \"d878794a-4d61-4bac-a544-aa325d334b7f\") " pod="kuadrant-system/limitador-limitador-64c94fd64f-7jfpp" Jun 14 14:49:56.687007 ip-10-0-129-116 kubenswrapper[2546]: I0614 14:49:56.686981 2546 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-64c94fd64f-7jfpp" Jun 14 14:49:56.832111 ip-10-0-129-116 kubenswrapper[2546]: I0614 14:49:56.832069 2546 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-64c94fd64f-7jfpp"] Jun 14 14:49:56.833954 ip-10-0-129-116 kubenswrapper[2546]: W0614 14:49:56.833928 2546 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd878794a_4d61_4bac_a544_aa325d334b7f.slice/crio-4395ab531235fb5d9923ba178ef1a48a612068c58f343174611a680b56579373 WatchSource:0}: Error finding container 4395ab531235fb5d9923ba178ef1a48a612068c58f343174611a680b56579373: Status 404 returned error can't find the container with id 4395ab531235fb5d9923ba178ef1a48a612068c58f343174611a680b56579373 Jun 14 14:49:57.180332 ip-10-0-129-116 kubenswrapper[2546]: I0614 14:49:57.180301 2546 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-58cd955675-zbtxd"] Jun 14 14:49:57.185194 ip-10-0-129-116 kubenswrapper[2546]: I0614 14:49:57.185164 2546 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-58cd955675-zbtxd" Jun 14 14:49:57.187821 ip-10-0-129-116 kubenswrapper[2546]: I0614 14:49:57.187786 2546 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"authorino-authorino-dockercfg-r25qf\"" Jun 14 14:49:57.191751 ip-10-0-129-116 kubenswrapper[2546]: I0614 14:49:57.191723 2546 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-58cd955675-zbtxd"] Jun 14 14:49:57.214893 ip-10-0-129-116 kubenswrapper[2546]: I0614 14:49:57.214864 2546 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c96gx_105377da-c223-41ad-b033-546cb01239c4/konnectivity-agent/0.log" limit=1024 Jun 14 14:49:57.275771 ip-10-0-129-116 kubenswrapper[2546]: I0614 14:49:57.275713 2546 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c96gx_105377da-c223-41ad-b033-546cb01239c4/konnectivity-agent/0.log" limit=1024 Jun 14 14:49:57.363932 ip-10-0-129-116 kubenswrapper[2546]: I0614 14:49:57.363894 2546 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-k8tff\" (UniqueName: \"kubernetes.io/projected/6bc15408-d284-4a73-b033-45bd15bdbe6c-kube-api-access-k8tff\") pod \"authorino-58cd955675-zbtxd\" (UID: \"6bc15408-d284-4a73-b033-45bd15bdbe6c\") " pod="kuadrant-system/authorino-58cd955675-zbtxd" Jun 14 14:49:57.465019 ip-10-0-129-116 kubenswrapper[2546]: I0614 14:49:57.464936 2546 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-k8tff\" (UniqueName: \"kubernetes.io/projected/6bc15408-d284-4a73-b033-45bd15bdbe6c-kube-api-access-k8tff\") pod \"authorino-58cd955675-zbtxd\" (UID: \"6bc15408-d284-4a73-b033-45bd15bdbe6c\") " pod="kuadrant-system/authorino-58cd955675-zbtxd" Jun 14 14:49:57.482867 ip-10-0-129-116 kubenswrapper[2546]: I0614 14:49:57.482825 2546 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-k8tff\" (UniqueName: \"kubernetes.io/projected/6bc15408-d284-4a73-b033-45bd15bdbe6c-kube-api-access-k8tff\") pod \"authorino-58cd955675-zbtxd\" (UID: \"6bc15408-d284-4a73-b033-45bd15bdbe6c\") " pod="kuadrant-system/authorino-58cd955675-zbtxd" Jun 14 14:49:57.496548 ip-10-0-129-116 kubenswrapper[2546]: I0614 14:49:57.496512 2546 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-58cd955675-zbtxd" Jun 14 14:49:57.679521 ip-10-0-129-116 kubenswrapper[2546]: I0614 14:49:57.679460 2546 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-58cd955675-zbtxd"] Jun 14 14:49:57.681186 ip-10-0-129-116 kubenswrapper[2546]: W0614 14:49:57.681155 2546 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod6bc15408_d284_4a73_b033_45bd15bdbe6c.slice/crio-89926392de75a4a56b86772c3ef2fbcdbf16e43fb8792795b1f36e26863b68d2 WatchSource:0}: Error finding container 89926392de75a4a56b86772c3ef2fbcdbf16e43fb8792795b1f36e26863b68d2: Status 404 returned error can't find the container with id 89926392de75a4a56b86772c3ef2fbcdbf16e43fb8792795b1f36e26863b68d2 Jun 14 14:49:57.832113 ip-10-0-129-116 kubenswrapper[2546]: I0614 14:49:57.831991 2546 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-64c94fd64f-7jfpp" event={"ID":"d878794a-4d61-4bac-a544-aa325d334b7f","Type":"ContainerStarted","Data":"4395ab531235fb5d9923ba178ef1a48a612068c58f343174611a680b56579373"} Jun 14 14:49:57.834027 ip-10-0-129-116 kubenswrapper[2546]: I0614 14:49:57.833992 2546 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-58cd955675-zbtxd" event={"ID":"6bc15408-d284-4a73-b033-45bd15bdbe6c","Type":"ContainerStarted","Data":"89926392de75a4a56b86772c3ef2fbcdbf16e43fb8792795b1f36e26863b68d2"} Jun 14 14:50:01.479560 ip-10-0-129-116 kubenswrapper[2546]: I0614 14:50:01.479525 2546 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-58cd955675-zbtxd"] Jun 14 14:50:02.286839 ip-10-0-129-116 kubenswrapper[2546]: I0614 14:50:02.286795 2546 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c96gx_105377da-c223-41ad-b033-546cb01239c4/konnectivity-agent/0.log" limit=1024 Jun 14 14:50:02.372480 ip-10-0-129-116 kubenswrapper[2546]: I0614 14:50:02.372445 2546 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c96gx_105377da-c223-41ad-b033-546cb01239c4/konnectivity-agent/0.log" limit=1024 Jun 14 14:50:02.869406 ip-10-0-129-116 kubenswrapper[2546]: I0614 14:50:02.869366 2546 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-64c94fd64f-7jfpp" event={"ID":"d878794a-4d61-4bac-a544-aa325d334b7f","Type":"ContainerStarted","Data":"2349629d714df9750a07e6c087a5773db323bde21af305a0bdd25960342fc1aa"} Jun 14 14:50:02.869869 ip-10-0-129-116 kubenswrapper[2546]: I0614 14:50:02.869488 2546 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/limitador-limitador-64c94fd64f-7jfpp" Jun 14 14:50:02.870796 ip-10-0-129-116 kubenswrapper[2546]: I0614 14:50:02.870767 2546 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-58cd955675-zbtxd" event={"ID":"6bc15408-d284-4a73-b033-45bd15bdbe6c","Type":"ContainerStarted","Data":"e164f47404019126f7f37be3d60225edbef391fe63643943434315c2ef13a633"} Jun 14 14:50:02.870935 ip-10-0-129-116 kubenswrapper[2546]: I0614 14:50:02.870807 2546 kuberuntime_container.go:872] "Killing container with a grace period" pod="kuadrant-system/authorino-58cd955675-zbtxd" podUID="6bc15408-d284-4a73-b033-45bd15bdbe6c" containerName="authorino" containerID="cri-o://e164f47404019126f7f37be3d60225edbef391fe63643943434315c2ef13a633" gracePeriod=30 Jun 14 14:50:02.889078 ip-10-0-129-116 kubenswrapper[2546]: I0614 14:50:02.889033 2546 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/limitador-limitador-64c94fd64f-7jfpp" podStartSLOduration=1.514919204 podStartE2EDuration="6.889017913s" totalImagesPullingTime="5.374098709s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-14 14:49:56 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-14 14:50:02.888289211 +0000 UTC m=+640.216671327" watchObservedRunningTime="2026-06-14 14:50:02.889017913 +0000 UTC m=+640.217400037" Jun 14 14:50:03.163857 ip-10-0-129-116 kubenswrapper[2546]: I0614 14:50:03.163828 2546 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-58cd955675-zbtxd" Jun 14 14:50:03.212845 ip-10-0-129-116 kubenswrapper[2546]: I0614 14:50:03.212816 2546 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-k8tff\" (UniqueName: \"kubernetes.io/projected/6bc15408-d284-4a73-b033-45bd15bdbe6c-kube-api-access-k8tff\") pod \"6bc15408-d284-4a73-b033-45bd15bdbe6c\" (UID: \"6bc15408-d284-4a73-b033-45bd15bdbe6c\") " Jun 14 14:50:03.214804 ip-10-0-129-116 kubenswrapper[2546]: I0614 14:50:03.214781 2546 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/6bc15408-d284-4a73-b033-45bd15bdbe6c-kube-api-access-k8tff" (OuterVolumeSpecName: "kube-api-access-k8tff") pod "6bc15408-d284-4a73-b033-45bd15bdbe6c" (UID: "6bc15408-d284-4a73-b033-45bd15bdbe6c"). InnerVolumeSpecName "kube-api-access-k8tff". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 14 14:50:03.313316 ip-10-0-129-116 kubenswrapper[2546]: I0614 14:50:03.313282 2546 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-k8tff\" (UniqueName: \"kubernetes.io/projected/6bc15408-d284-4a73-b033-45bd15bdbe6c-kube-api-access-k8tff\") on node \"ip-10-0-129-116.ec2.internal\" DevicePath \"\"" Jun 14 14:50:03.877571 ip-10-0-129-116 kubenswrapper[2546]: I0614 14:50:03.877542 2546 generic.go:356] "Generic (PLEG): container finished" podID="6bc15408-d284-4a73-b033-45bd15bdbe6c" containerID="e164f47404019126f7f37be3d60225edbef391fe63643943434315c2ef13a633" exitCode=0 Jun 14 14:50:03.878119 ip-10-0-129-116 kubenswrapper[2546]: I0614 14:50:03.877583 2546 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-58cd955675-zbtxd" Jun 14 14:50:03.878119 ip-10-0-129-116 kubenswrapper[2546]: I0614 14:50:03.877618 2546 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-58cd955675-zbtxd" event={"ID":"6bc15408-d284-4a73-b033-45bd15bdbe6c","Type":"ContainerDied","Data":"e164f47404019126f7f37be3d60225edbef391fe63643943434315c2ef13a633"} Jun 14 14:50:03.878119 ip-10-0-129-116 kubenswrapper[2546]: I0614 14:50:03.877657 2546 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-58cd955675-zbtxd" event={"ID":"6bc15408-d284-4a73-b033-45bd15bdbe6c","Type":"ContainerDied","Data":"89926392de75a4a56b86772c3ef2fbcdbf16e43fb8792795b1f36e26863b68d2"} Jun 14 14:50:03.878119 ip-10-0-129-116 kubenswrapper[2546]: I0614 14:50:03.877674 2546 scope.go:117] "RemoveContainer" containerID="e164f47404019126f7f37be3d60225edbef391fe63643943434315c2ef13a633" Jun 14 14:50:03.886719 ip-10-0-129-116 kubenswrapper[2546]: I0614 14:50:03.886694 2546 scope.go:117] "RemoveContainer" containerID="e164f47404019126f7f37be3d60225edbef391fe63643943434315c2ef13a633" Jun 14 14:50:03.886981 ip-10-0-129-116 kubenswrapper[2546]: E0614 14:50:03.886963 2546 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"e164f47404019126f7f37be3d60225edbef391fe63643943434315c2ef13a633\": container with ID starting with e164f47404019126f7f37be3d60225edbef391fe63643943434315c2ef13a633 not found: ID does not exist" containerID="e164f47404019126f7f37be3d60225edbef391fe63643943434315c2ef13a633" Jun 14 14:50:03.887033 ip-10-0-129-116 kubenswrapper[2546]: I0614 14:50:03.886991 2546 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"e164f47404019126f7f37be3d60225edbef391fe63643943434315c2ef13a633"} err="failed to get container status \"e164f47404019126f7f37be3d60225edbef391fe63643943434315c2ef13a633\": rpc error: code = NotFound desc = could not find container \"e164f47404019126f7f37be3d60225edbef391fe63643943434315c2ef13a633\": container with ID starting with e164f47404019126f7f37be3d60225edbef391fe63643943434315c2ef13a633 not found: ID does not exist" Jun 14 14:50:03.898485 ip-10-0-129-116 kubenswrapper[2546]: I0614 14:50:03.898461 2546 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-58cd955675-zbtxd"] Jun 14 14:50:03.901652 ip-10-0-129-116 kubenswrapper[2546]: I0614 14:50:03.901625 2546 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/authorino-58cd955675-zbtxd"] Jun 14 14:50:05.190248 ip-10-0-129-116 kubenswrapper[2546]: I0614 14:50:05.190215 2546 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="6bc15408-d284-4a73-b033-45bd15bdbe6c" path="/var/lib/kubelet/pods/6bc15408-d284-4a73-b033-45bd15bdbe6c/volumes" Jun 14 14:50:11.329253 ip-10-0-129-116 kubenswrapper[2546]: I0614 14:50:11.329194 2546 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/limitador-limitador-64c94fd64f-7jfpp"] Jun 14 14:50:11.329665 ip-10-0-129-116 kubenswrapper[2546]: I0614 14:50:11.329426 2546 kuberuntime_container.go:872] "Killing container with a grace period" pod="kuadrant-system/limitador-limitador-64c94fd64f-7jfpp" podUID="d878794a-4d61-4bac-a544-aa325d334b7f" containerName="limitador" containerID="cri-o://2349629d714df9750a07e6c087a5773db323bde21af305a0bdd25960342fc1aa" gracePeriod=30 Jun 14 14:50:11.331845 ip-10-0-129-116 kubenswrapper[2546]: I0614 14:50:11.331818 2546 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/limitador-limitador-64c94fd64f-7jfpp" Jun 14 14:50:11.923901 ip-10-0-129-116 kubenswrapper[2546]: I0614 14:50:11.923694 2546 generic.go:356] "Generic (PLEG): container finished" podID="d878794a-4d61-4bac-a544-aa325d334b7f" containerID="2349629d714df9750a07e6c087a5773db323bde21af305a0bdd25960342fc1aa" exitCode=0 Jun 14 14:50:11.923901 ip-10-0-129-116 kubenswrapper[2546]: I0614 14:50:11.923795 2546 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-64c94fd64f-7jfpp" event={"ID":"d878794a-4d61-4bac-a544-aa325d334b7f","Type":"ContainerDied","Data":"2349629d714df9750a07e6c087a5773db323bde21af305a0bdd25960342fc1aa"} Jun 14 14:50:11.923901 ip-10-0-129-116 kubenswrapper[2546]: I0614 14:50:11.923843 2546 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-64c94fd64f-7jfpp" event={"ID":"d878794a-4d61-4bac-a544-aa325d334b7f","Type":"ContainerDied","Data":"4395ab531235fb5d9923ba178ef1a48a612068c58f343174611a680b56579373"} Jun 14 14:50:11.923901 ip-10-0-129-116 kubenswrapper[2546]: I0614 14:50:11.923865 2546 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="4395ab531235fb5d9923ba178ef1a48a612068c58f343174611a680b56579373" Jun 14 14:50:11.952912 ip-10-0-129-116 kubenswrapper[2546]: I0614 14:50:11.952887 2546 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-64c94fd64f-7jfpp" Jun 14 14:50:11.984318 ip-10-0-129-116 kubenswrapper[2546]: I0614 14:50:11.984293 2546 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/d878794a-4d61-4bac-a544-aa325d334b7f-config-file\") pod \"d878794a-4d61-4bac-a544-aa325d334b7f\" (UID: \"d878794a-4d61-4bac-a544-aa325d334b7f\") " Jun 14 14:50:11.984469 ip-10-0-129-116 kubenswrapper[2546]: I0614 14:50:11.984333 2546 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-vzrpc\" (UniqueName: \"kubernetes.io/projected/d878794a-4d61-4bac-a544-aa325d334b7f-kube-api-access-vzrpc\") pod \"d878794a-4d61-4bac-a544-aa325d334b7f\" (UID: \"d878794a-4d61-4bac-a544-aa325d334b7f\") " Jun 14 14:50:11.984696 ip-10-0-129-116 kubenswrapper[2546]: I0614 14:50:11.984659 2546 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/d878794a-4d61-4bac-a544-aa325d334b7f-config-file" (OuterVolumeSpecName: "config-file") pod "d878794a-4d61-4bac-a544-aa325d334b7f" (UID: "d878794a-4d61-4bac-a544-aa325d334b7f"). InnerVolumeSpecName "config-file". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 14 14:50:11.986447 ip-10-0-129-116 kubenswrapper[2546]: I0614 14:50:11.986424 2546 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/d878794a-4d61-4bac-a544-aa325d334b7f-kube-api-access-vzrpc" (OuterVolumeSpecName: "kube-api-access-vzrpc") pod "d878794a-4d61-4bac-a544-aa325d334b7f" (UID: "d878794a-4d61-4bac-a544-aa325d334b7f"). InnerVolumeSpecName "kube-api-access-vzrpc". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 14 14:50:12.085034 ip-10-0-129-116 kubenswrapper[2546]: I0614 14:50:12.085002 2546 reconciler_common.go:299] "Volume detached for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/d878794a-4d61-4bac-a544-aa325d334b7f-config-file\") on node \"ip-10-0-129-116.ec2.internal\" DevicePath \"\"" Jun 14 14:50:12.085034 ip-10-0-129-116 kubenswrapper[2546]: I0614 14:50:12.085031 2546 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-vzrpc\" (UniqueName: \"kubernetes.io/projected/d878794a-4d61-4bac-a544-aa325d334b7f-kube-api-access-vzrpc\") on node \"ip-10-0-129-116.ec2.internal\" DevicePath \"\"" Jun 14 14:50:12.797087 ip-10-0-129-116 kubenswrapper[2546]: I0614 14:50:12.797051 2546 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/postgres-69fb4594cf-bvghj"] Jun 14 14:50:12.797627 ip-10-0-129-116 kubenswrapper[2546]: I0614 14:50:12.797588 2546 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="d878794a-4d61-4bac-a544-aa325d334b7f" containerName="limitador" Jun 14 14:50:12.797627 ip-10-0-129-116 kubenswrapper[2546]: I0614 14:50:12.797614 2546 state_mem.go:107] "Deleted CPUSet assignment" podUID="d878794a-4d61-4bac-a544-aa325d334b7f" containerName="limitador" Jun 14 14:50:12.797627 ip-10-0-129-116 kubenswrapper[2546]: I0614 14:50:12.797631 2546 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="6bc15408-d284-4a73-b033-45bd15bdbe6c" containerName="authorino" Jun 14 14:50:12.797876 ip-10-0-129-116 kubenswrapper[2546]: I0614 14:50:12.797640 2546 state_mem.go:107] "Deleted CPUSet assignment" podUID="6bc15408-d284-4a73-b033-45bd15bdbe6c" containerName="authorino" Jun 14 14:50:12.797876 ip-10-0-129-116 kubenswrapper[2546]: I0614 14:50:12.797764 2546 memory_manager.go:368] "RemoveStaleState removing state" podUID="d878794a-4d61-4bac-a544-aa325d334b7f" containerName="limitador" Jun 14 14:50:12.797876 ip-10-0-129-116 kubenswrapper[2546]: I0614 14:50:12.797781 2546 memory_manager.go:368] "RemoveStaleState removing state" podUID="6bc15408-d284-4a73-b033-45bd15bdbe6c" containerName="authorino" Jun 14 14:50:12.801461 ip-10-0-129-116 kubenswrapper[2546]: I0614 14:50:12.801440 2546 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/postgres-69fb4594cf-bvghj" Jun 14 14:50:12.803828 ip-10-0-129-116 kubenswrapper[2546]: I0614 14:50:12.803804 2546 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"postgres-creds\"" Jun 14 14:50:12.803949 ip-10-0-129-116 kubenswrapper[2546]: I0614 14:50:12.803869 2546 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"default-dockercfg-xg5x7\"" Jun 14 14:50:12.807536 ip-10-0-129-116 kubenswrapper[2546]: I0614 14:50:12.807512 2546 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/postgres-69fb4594cf-bvghj"] Jun 14 14:50:12.823804 ip-10-0-129-116 kubenswrapper[2546]: I0614 14:50:12.823777 2546 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c96gx_105377da-c223-41ad-b033-546cb01239c4/konnectivity-agent/0.log" limit=1024 Jun 14 14:50:12.892364 ip-10-0-129-116 kubenswrapper[2546]: I0614 14:50:12.892330 2546 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data\" (UniqueName: \"kubernetes.io/empty-dir/cfa742eb-9643-49e7-b775-50f287d5fbdd-data\") pod \"postgres-69fb4594cf-bvghj\" (UID: \"cfa742eb-9643-49e7-b775-50f287d5fbdd\") " pod="opendatahub/postgres-69fb4594cf-bvghj" Jun 14 14:50:12.892522 ip-10-0-129-116 kubenswrapper[2546]: I0614 14:50:12.892374 2546 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-j8kkh\" (UniqueName: \"kubernetes.io/projected/cfa742eb-9643-49e7-b775-50f287d5fbdd-kube-api-access-j8kkh\") pod \"postgres-69fb4594cf-bvghj\" (UID: \"cfa742eb-9643-49e7-b775-50f287d5fbdd\") " pod="opendatahub/postgres-69fb4594cf-bvghj" Jun 14 14:50:12.928387 ip-10-0-129-116 kubenswrapper[2546]: I0614 14:50:12.928359 2546 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-64c94fd64f-7jfpp" Jun 14 14:50:12.955458 ip-10-0-129-116 kubenswrapper[2546]: I0614 14:50:12.955421 2546 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/limitador-limitador-64c94fd64f-7jfpp"] Jun 14 14:50:12.955628 ip-10-0-129-116 kubenswrapper[2546]: I0614 14:50:12.955473 2546 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/limitador-limitador-64c94fd64f-7jfpp"] Jun 14 14:50:12.993581 ip-10-0-129-116 kubenswrapper[2546]: I0614 14:50:12.993544 2546 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"data\" (UniqueName: \"kubernetes.io/empty-dir/cfa742eb-9643-49e7-b775-50f287d5fbdd-data\") pod \"postgres-69fb4594cf-bvghj\" (UID: \"cfa742eb-9643-49e7-b775-50f287d5fbdd\") " pod="opendatahub/postgres-69fb4594cf-bvghj" Jun 14 14:50:12.993581 ip-10-0-129-116 kubenswrapper[2546]: I0614 14:50:12.993582 2546 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-j8kkh\" (UniqueName: \"kubernetes.io/projected/cfa742eb-9643-49e7-b775-50f287d5fbdd-kube-api-access-j8kkh\") pod \"postgres-69fb4594cf-bvghj\" (UID: \"cfa742eb-9643-49e7-b775-50f287d5fbdd\") " pod="opendatahub/postgres-69fb4594cf-bvghj" Jun 14 14:50:12.993999 ip-10-0-129-116 kubenswrapper[2546]: I0614 14:50:12.993974 2546 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"data\" (UniqueName: \"kubernetes.io/empty-dir/cfa742eb-9643-49e7-b775-50f287d5fbdd-data\") pod \"postgres-69fb4594cf-bvghj\" (UID: \"cfa742eb-9643-49e7-b775-50f287d5fbdd\") " pod="opendatahub/postgres-69fb4594cf-bvghj" Jun 14 14:50:13.001500 ip-10-0-129-116 kubenswrapper[2546]: I0614 14:50:13.001474 2546 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-j8kkh\" (UniqueName: \"kubernetes.io/projected/cfa742eb-9643-49e7-b775-50f287d5fbdd-kube-api-access-j8kkh\") pod \"postgres-69fb4594cf-bvghj\" (UID: \"cfa742eb-9643-49e7-b775-50f287d5fbdd\") " pod="opendatahub/postgres-69fb4594cf-bvghj" Jun 14 14:50:13.113561 ip-10-0-129-116 kubenswrapper[2546]: I0614 14:50:13.113465 2546 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/postgres-69fb4594cf-bvghj" Jun 14 14:50:13.190400 ip-10-0-129-116 kubenswrapper[2546]: I0614 14:50:13.190366 2546 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="d878794a-4d61-4bac-a544-aa325d334b7f" path="/var/lib/kubelet/pods/d878794a-4d61-4bac-a544-aa325d334b7f/volumes" Jun 14 14:50:13.250402 ip-10-0-129-116 kubenswrapper[2546]: I0614 14:50:13.250380 2546 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/postgres-69fb4594cf-bvghj"] Jun 14 14:50:13.252224 ip-10-0-129-116 kubenswrapper[2546]: W0614 14:50:13.252198 2546 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podcfa742eb_9643_49e7_b775_50f287d5fbdd.slice/crio-6adce5f8287179305d0fe5b33ca02945e65f00af2ee17b039ba8188ceebffaec WatchSource:0}: Error finding container 6adce5f8287179305d0fe5b33ca02945e65f00af2ee17b039ba8188ceebffaec: Status 404 returned error can't find the container with id 6adce5f8287179305d0fe5b33ca02945e65f00af2ee17b039ba8188ceebffaec Jun 14 14:50:13.934139 ip-10-0-129-116 kubenswrapper[2546]: I0614 14:50:13.934084 2546 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/postgres-69fb4594cf-bvghj" event={"ID":"cfa742eb-9643-49e7-b775-50f287d5fbdd","Type":"ContainerStarted","Data":"6adce5f8287179305d0fe5b33ca02945e65f00af2ee17b039ba8188ceebffaec"} Jun 14 14:50:15.948504 ip-10-0-129-116 kubenswrapper[2546]: I0614 14:50:15.948473 2546 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/postgres-69fb4594cf-bvghj" event={"ID":"cfa742eb-9643-49e7-b775-50f287d5fbdd","Type":"ContainerStarted","Data":"e42dc9c8418484bbcafe4e66822831f968273949f3be59995f69ff9ef275a622"} Jun 14 14:50:15.948853 ip-10-0-129-116 kubenswrapper[2546]: I0614 14:50:15.948549 2546 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/postgres-69fb4594cf-bvghj" Jun 14 14:50:15.967380 ip-10-0-129-116 kubenswrapper[2546]: I0614 14:50:15.967329 2546 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/postgres-69fb4594cf-bvghj" podStartSLOduration=1.387942041 podStartE2EDuration="3.967314846s" totalImagesPullingTime="2.579372805s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-14 14:50:12 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-14 14:50:15.964367111 +0000 UTC m=+653.292749262" watchObservedRunningTime="2026-06-14 14:50:15.967314846 +0000 UTC m=+653.295696971" Jun 14 14:50:21.986583 ip-10-0-129-116 kubenswrapper[2546]: I0614 14:50:21.986553 2546 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/postgres-69fb4594cf-bvghj" Jun 14 14:50:22.264805 ip-10-0-129-116 kubenswrapper[2546]: I0614 14:50:22.264726 2546 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c96gx_105377da-c223-41ad-b033-546cb01239c4/konnectivity-agent/0.log" limit=1024 Jun 14 14:50:22.364947 ip-10-0-129-116 kubenswrapper[2546]: I0614 14:50:22.364914 2546 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c96gx_105377da-c223-41ad-b033-546cb01239c4/konnectivity-agent/0.log" limit=1024 Jun 14 14:50:22.506457 ip-10-0-129-116 kubenswrapper[2546]: I0614 14:50:22.506416 2546 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c96gx_105377da-c223-41ad-b033-546cb01239c4/konnectivity-agent/0.log" limit=1024 Jun 14 14:50:24.055427 ip-10-0-129-116 kubenswrapper[2546]: I0614 14:50:24.055392 2546 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-marketplace/0228a3cc79630676fae641e6a38dab1752e85a08a4a9edc59ccf0da74896wzd"] Jun 14 14:50:24.059252 ip-10-0-129-116 kubenswrapper[2546]: I0614 14:50:24.059229 2546 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/0228a3cc79630676fae641e6a38dab1752e85a08a4a9edc59ccf0da74896wzd" Jun 14 14:50:24.061683 ip-10-0-129-116 kubenswrapper[2546]: I0614 14:50:24.061661 2546 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"openshift-service-ca.crt\"" Jun 14 14:50:24.061800 ip-10-0-129-116 kubenswrapper[2546]: I0614 14:50:24.061775 2546 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-marketplace\"/\"default-dockercfg-44x46\"" Jun 14 14:50:24.062904 ip-10-0-129-116 kubenswrapper[2546]: I0614 14:50:24.062885 2546 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"kube-root-ca.crt\"" Jun 14 14:50:24.066903 ip-10-0-129-116 kubenswrapper[2546]: I0614 14:50:24.066879 2546 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/0228a3cc79630676fae641e6a38dab1752e85a08a4a9edc59ccf0da74896wzd"] Jun 14 14:50:24.192894 ip-10-0-129-116 kubenswrapper[2546]: I0614 14:50:24.192862 2546 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-gkjxz\" (UniqueName: \"kubernetes.io/projected/9df2ccb1-0401-4276-95a3-ecf65eee5747-kube-api-access-gkjxz\") pod \"0228a3cc79630676fae641e6a38dab1752e85a08a4a9edc59ccf0da74896wzd\" (UID: \"9df2ccb1-0401-4276-95a3-ecf65eee5747\") " pod="openshift-marketplace/0228a3cc79630676fae641e6a38dab1752e85a08a4a9edc59ccf0da74896wzd" Jun 14 14:50:24.193070 ip-10-0-129-116 kubenswrapper[2546]: I0614 14:50:24.192909 2546 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/9df2ccb1-0401-4276-95a3-ecf65eee5747-bundle\") pod \"0228a3cc79630676fae641e6a38dab1752e85a08a4a9edc59ccf0da74896wzd\" (UID: \"9df2ccb1-0401-4276-95a3-ecf65eee5747\") " pod="openshift-marketplace/0228a3cc79630676fae641e6a38dab1752e85a08a4a9edc59ccf0da74896wzd" Jun 14 14:50:24.193070 ip-10-0-129-116 kubenswrapper[2546]: I0614 14:50:24.192977 2546 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/9df2ccb1-0401-4276-95a3-ecf65eee5747-util\") pod \"0228a3cc79630676fae641e6a38dab1752e85a08a4a9edc59ccf0da74896wzd\" (UID: \"9df2ccb1-0401-4276-95a3-ecf65eee5747\") " pod="openshift-marketplace/0228a3cc79630676fae641e6a38dab1752e85a08a4a9edc59ccf0da74896wzd" Jun 14 14:50:24.294066 ip-10-0-129-116 kubenswrapper[2546]: I0614 14:50:24.294033 2546 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-gkjxz\" (UniqueName: \"kubernetes.io/projected/9df2ccb1-0401-4276-95a3-ecf65eee5747-kube-api-access-gkjxz\") pod \"0228a3cc79630676fae641e6a38dab1752e85a08a4a9edc59ccf0da74896wzd\" (UID: \"9df2ccb1-0401-4276-95a3-ecf65eee5747\") " pod="openshift-marketplace/0228a3cc79630676fae641e6a38dab1752e85a08a4a9edc59ccf0da74896wzd" Jun 14 14:50:24.294221 ip-10-0-129-116 kubenswrapper[2546]: I0614 14:50:24.294080 2546 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/9df2ccb1-0401-4276-95a3-ecf65eee5747-bundle\") pod \"0228a3cc79630676fae641e6a38dab1752e85a08a4a9edc59ccf0da74896wzd\" (UID: \"9df2ccb1-0401-4276-95a3-ecf65eee5747\") " pod="openshift-marketplace/0228a3cc79630676fae641e6a38dab1752e85a08a4a9edc59ccf0da74896wzd" Jun 14 14:50:24.294221 ip-10-0-129-116 kubenswrapper[2546]: I0614 14:50:24.294128 2546 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/9df2ccb1-0401-4276-95a3-ecf65eee5747-util\") pod \"0228a3cc79630676fae641e6a38dab1752e85a08a4a9edc59ccf0da74896wzd\" (UID: \"9df2ccb1-0401-4276-95a3-ecf65eee5747\") " pod="openshift-marketplace/0228a3cc79630676fae641e6a38dab1752e85a08a4a9edc59ccf0da74896wzd" Jun 14 14:50:24.294486 ip-10-0-129-116 kubenswrapper[2546]: I0614 14:50:24.294467 2546 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/9df2ccb1-0401-4276-95a3-ecf65eee5747-bundle\") pod \"0228a3cc79630676fae641e6a38dab1752e85a08a4a9edc59ccf0da74896wzd\" (UID: \"9df2ccb1-0401-4276-95a3-ecf65eee5747\") " pod="openshift-marketplace/0228a3cc79630676fae641e6a38dab1752e85a08a4a9edc59ccf0da74896wzd" Jun 14 14:50:24.294523 ip-10-0-129-116 kubenswrapper[2546]: I0614 14:50:24.294496 2546 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/9df2ccb1-0401-4276-95a3-ecf65eee5747-util\") pod \"0228a3cc79630676fae641e6a38dab1752e85a08a4a9edc59ccf0da74896wzd\" (UID: \"9df2ccb1-0401-4276-95a3-ecf65eee5747\") " pod="openshift-marketplace/0228a3cc79630676fae641e6a38dab1752e85a08a4a9edc59ccf0da74896wzd" Jun 14 14:50:24.302689 ip-10-0-129-116 kubenswrapper[2546]: I0614 14:50:24.302659 2546 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-gkjxz\" (UniqueName: \"kubernetes.io/projected/9df2ccb1-0401-4276-95a3-ecf65eee5747-kube-api-access-gkjxz\") pod \"0228a3cc79630676fae641e6a38dab1752e85a08a4a9edc59ccf0da74896wzd\" (UID: \"9df2ccb1-0401-4276-95a3-ecf65eee5747\") " pod="openshift-marketplace/0228a3cc79630676fae641e6a38dab1752e85a08a4a9edc59ccf0da74896wzd" Jun 14 14:50:24.370673 ip-10-0-129-116 kubenswrapper[2546]: I0614 14:50:24.370603 2546 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/0228a3cc79630676fae641e6a38dab1752e85a08a4a9edc59ccf0da74896wzd" Jun 14 14:50:24.507402 ip-10-0-129-116 kubenswrapper[2546]: I0614 14:50:24.507378 2546 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/0228a3cc79630676fae641e6a38dab1752e85a08a4a9edc59ccf0da74896wzd"] Jun 14 14:50:24.509021 ip-10-0-129-116 kubenswrapper[2546]: W0614 14:50:24.508994 2546 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9df2ccb1_0401_4276_95a3_ecf65eee5747.slice/crio-84aac41456f8da8d3b5fa69a5329fa37afa79b3854c48b10623bd69097f47f09 WatchSource:0}: Error finding container 84aac41456f8da8d3b5fa69a5329fa37afa79b3854c48b10623bd69097f47f09: Status 404 returned error can't find the container with id 84aac41456f8da8d3b5fa69a5329fa37afa79b3854c48b10623bd69097f47f09 Jun 14 14:50:24.995632 ip-10-0-129-116 kubenswrapper[2546]: I0614 14:50:24.995595 2546 generic.go:356] "Generic (PLEG): container finished" podID="9df2ccb1-0401-4276-95a3-ecf65eee5747" containerID="91e1d54a44d927755547026db893774e2558cc9b879b1457963153b48a0d1149" exitCode=0 Jun 14 14:50:24.995800 ip-10-0-129-116 kubenswrapper[2546]: I0614 14:50:24.995686 2546 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/0228a3cc79630676fae641e6a38dab1752e85a08a4a9edc59ccf0da74896wzd" event={"ID":"9df2ccb1-0401-4276-95a3-ecf65eee5747","Type":"ContainerDied","Data":"91e1d54a44d927755547026db893774e2558cc9b879b1457963153b48a0d1149"} Jun 14 14:50:24.995800 ip-10-0-129-116 kubenswrapper[2546]: I0614 14:50:24.995765 2546 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/0228a3cc79630676fae641e6a38dab1752e85a08a4a9edc59ccf0da74896wzd" event={"ID":"9df2ccb1-0401-4276-95a3-ecf65eee5747","Type":"ContainerStarted","Data":"84aac41456f8da8d3b5fa69a5329fa37afa79b3854c48b10623bd69097f47f09"} Jun 14 14:50:26.002366 ip-10-0-129-116 kubenswrapper[2546]: I0614 14:50:26.002278 2546 generic.go:356] "Generic (PLEG): container finished" podID="9df2ccb1-0401-4276-95a3-ecf65eee5747" containerID="55b75a8cc21758bd456b9516dfdd324b0f6e18a8eada3c02de7296c4cc585c7f" exitCode=0 Jun 14 14:50:26.002366 ip-10-0-129-116 kubenswrapper[2546]: I0614 14:50:26.002330 2546 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/0228a3cc79630676fae641e6a38dab1752e85a08a4a9edc59ccf0da74896wzd" event={"ID":"9df2ccb1-0401-4276-95a3-ecf65eee5747","Type":"ContainerDied","Data":"55b75a8cc21758bd456b9516dfdd324b0f6e18a8eada3c02de7296c4cc585c7f"} Jun 14 14:50:27.009036 ip-10-0-129-116 kubenswrapper[2546]: I0614 14:50:27.009008 2546 generic.go:356] "Generic (PLEG): container finished" podID="9df2ccb1-0401-4276-95a3-ecf65eee5747" containerID="669aeb54aa4902c12e567646ff5e4a1eba5c8eee66407538154fbfc5a0a366c0" exitCode=0 Jun 14 14:50:27.009462 ip-10-0-129-116 kubenswrapper[2546]: I0614 14:50:27.009047 2546 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/0228a3cc79630676fae641e6a38dab1752e85a08a4a9edc59ccf0da74896wzd" event={"ID":"9df2ccb1-0401-4276-95a3-ecf65eee5747","Type":"ContainerDied","Data":"669aeb54aa4902c12e567646ff5e4a1eba5c8eee66407538154fbfc5a0a366c0"} Jun 14 14:50:28.149371 ip-10-0-129-116 kubenswrapper[2546]: I0614 14:50:28.149347 2546 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/0228a3cc79630676fae641e6a38dab1752e85a08a4a9edc59ccf0da74896wzd" Jun 14 14:50:28.228192 ip-10-0-129-116 kubenswrapper[2546]: I0614 14:50:28.228160 2546 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-gkjxz\" (UniqueName: \"kubernetes.io/projected/9df2ccb1-0401-4276-95a3-ecf65eee5747-kube-api-access-gkjxz\") pod \"9df2ccb1-0401-4276-95a3-ecf65eee5747\" (UID: \"9df2ccb1-0401-4276-95a3-ecf65eee5747\") " Jun 14 14:50:28.228360 ip-10-0-129-116 kubenswrapper[2546]: I0614 14:50:28.228207 2546 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/9df2ccb1-0401-4276-95a3-ecf65eee5747-util\") pod \"9df2ccb1-0401-4276-95a3-ecf65eee5747\" (UID: \"9df2ccb1-0401-4276-95a3-ecf65eee5747\") " Jun 14 14:50:28.228360 ip-10-0-129-116 kubenswrapper[2546]: I0614 14:50:28.228239 2546 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/9df2ccb1-0401-4276-95a3-ecf65eee5747-bundle\") pod \"9df2ccb1-0401-4276-95a3-ecf65eee5747\" (UID: \"9df2ccb1-0401-4276-95a3-ecf65eee5747\") " Jun 14 14:50:28.228744 ip-10-0-129-116 kubenswrapper[2546]: I0614 14:50:28.228715 2546 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/9df2ccb1-0401-4276-95a3-ecf65eee5747-bundle" (OuterVolumeSpecName: "bundle") pod "9df2ccb1-0401-4276-95a3-ecf65eee5747" (UID: "9df2ccb1-0401-4276-95a3-ecf65eee5747"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 14 14:50:28.230341 ip-10-0-129-116 kubenswrapper[2546]: I0614 14:50:28.230319 2546 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/9df2ccb1-0401-4276-95a3-ecf65eee5747-kube-api-access-gkjxz" (OuterVolumeSpecName: "kube-api-access-gkjxz") pod "9df2ccb1-0401-4276-95a3-ecf65eee5747" (UID: "9df2ccb1-0401-4276-95a3-ecf65eee5747"). InnerVolumeSpecName "kube-api-access-gkjxz". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 14 14:50:28.233804 ip-10-0-129-116 kubenswrapper[2546]: I0614 14:50:28.233781 2546 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/9df2ccb1-0401-4276-95a3-ecf65eee5747-util" (OuterVolumeSpecName: "util") pod "9df2ccb1-0401-4276-95a3-ecf65eee5747" (UID: "9df2ccb1-0401-4276-95a3-ecf65eee5747"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 14 14:50:28.329761 ip-10-0-129-116 kubenswrapper[2546]: I0614 14:50:28.329664 2546 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/9df2ccb1-0401-4276-95a3-ecf65eee5747-util\") on node \"ip-10-0-129-116.ec2.internal\" DevicePath \"\"" Jun 14 14:50:28.329761 ip-10-0-129-116 kubenswrapper[2546]: I0614 14:50:28.329694 2546 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/9df2ccb1-0401-4276-95a3-ecf65eee5747-bundle\") on node \"ip-10-0-129-116.ec2.internal\" DevicePath \"\"" Jun 14 14:50:28.329761 ip-10-0-129-116 kubenswrapper[2546]: I0614 14:50:28.329704 2546 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-gkjxz\" (UniqueName: \"kubernetes.io/projected/9df2ccb1-0401-4276-95a3-ecf65eee5747-kube-api-access-gkjxz\") on node \"ip-10-0-129-116.ec2.internal\" DevicePath \"\"" Jun 14 14:50:29.021102 ip-10-0-129-116 kubenswrapper[2546]: I0614 14:50:29.021061 2546 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/0228a3cc79630676fae641e6a38dab1752e85a08a4a9edc59ccf0da74896wzd" Jun 14 14:50:29.021319 ip-10-0-129-116 kubenswrapper[2546]: I0614 14:50:29.021110 2546 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/0228a3cc79630676fae641e6a38dab1752e85a08a4a9edc59ccf0da74896wzd" event={"ID":"9df2ccb1-0401-4276-95a3-ecf65eee5747","Type":"ContainerDied","Data":"84aac41456f8da8d3b5fa69a5329fa37afa79b3854c48b10623bd69097f47f09"} Jun 14 14:50:29.021319 ip-10-0-129-116 kubenswrapper[2546]: I0614 14:50:29.021153 2546 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="84aac41456f8da8d3b5fa69a5329fa37afa79b3854c48b10623bd69097f47f09" Jun 14 14:50:33.112304 ip-10-0-129-116 kubenswrapper[2546]: I0614 14:50:33.112273 2546 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["keycloak-system/keycloak-operator-d67dbbb48-8q5fj"] Jun 14 14:50:33.112678 ip-10-0-129-116 kubenswrapper[2546]: I0614 14:50:33.112593 2546 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="9df2ccb1-0401-4276-95a3-ecf65eee5747" containerName="extract" Jun 14 14:50:33.112678 ip-10-0-129-116 kubenswrapper[2546]: I0614 14:50:33.112603 2546 state_mem.go:107] "Deleted CPUSet assignment" podUID="9df2ccb1-0401-4276-95a3-ecf65eee5747" containerName="extract" Jun 14 14:50:33.112678 ip-10-0-129-116 kubenswrapper[2546]: I0614 14:50:33.112619 2546 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="9df2ccb1-0401-4276-95a3-ecf65eee5747" containerName="pull" Jun 14 14:50:33.112678 ip-10-0-129-116 kubenswrapper[2546]: I0614 14:50:33.112627 2546 state_mem.go:107] "Deleted CPUSet assignment" podUID="9df2ccb1-0401-4276-95a3-ecf65eee5747" containerName="pull" Jun 14 14:50:33.112678 ip-10-0-129-116 kubenswrapper[2546]: I0614 14:50:33.112638 2546 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="9df2ccb1-0401-4276-95a3-ecf65eee5747" containerName="util" Jun 14 14:50:33.112678 ip-10-0-129-116 kubenswrapper[2546]: I0614 14:50:33.112643 2546 state_mem.go:107] "Deleted CPUSet assignment" podUID="9df2ccb1-0401-4276-95a3-ecf65eee5747" containerName="util" Jun 14 14:50:33.112870 ip-10-0-129-116 kubenswrapper[2546]: I0614 14:50:33.112695 2546 memory_manager.go:368] "RemoveStaleState removing state" podUID="9df2ccb1-0401-4276-95a3-ecf65eee5747" containerName="extract" Jun 14 14:50:33.187178 ip-10-0-129-116 kubenswrapper[2546]: I0614 14:50:33.187146 2546 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="keycloak-system/keycloak-operator-d67dbbb48-8q5fj" Jun 14 14:50:33.190236 ip-10-0-129-116 kubenswrapper[2546]: I0614 14:50:33.190210 2546 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"keycloak-system\"/\"openshift-service-ca.crt\"" Jun 14 14:50:33.190379 ip-10-0-129-116 kubenswrapper[2546]: I0614 14:50:33.190210 2546 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"keycloak-system\"/\"keycloak-operator-dockercfg-fk552\"" Jun 14 14:50:33.191394 ip-10-0-129-116 kubenswrapper[2546]: I0614 14:50:33.191375 2546 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"keycloak-system\"/\"kube-root-ca.crt\"" Jun 14 14:50:33.193523 ip-10-0-129-116 kubenswrapper[2546]: I0614 14:50:33.193502 2546 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["keycloak-system/keycloak-operator-d67dbbb48-8q5fj"] Jun 14 14:50:33.274866 ip-10-0-129-116 kubenswrapper[2546]: I0614 14:50:33.274825 2546 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-gp422\" (UniqueName: \"kubernetes.io/projected/3107cc7d-ad01-4c68-9d2b-53755e15a000-kube-api-access-gp422\") pod \"keycloak-operator-d67dbbb48-8q5fj\" (UID: \"3107cc7d-ad01-4c68-9d2b-53755e15a000\") " pod="keycloak-system/keycloak-operator-d67dbbb48-8q5fj" Jun 14 14:50:33.376278 ip-10-0-129-116 kubenswrapper[2546]: I0614 14:50:33.376198 2546 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-gp422\" (UniqueName: \"kubernetes.io/projected/3107cc7d-ad01-4c68-9d2b-53755e15a000-kube-api-access-gp422\") pod \"keycloak-operator-d67dbbb48-8q5fj\" (UID: \"3107cc7d-ad01-4c68-9d2b-53755e15a000\") " pod="keycloak-system/keycloak-operator-d67dbbb48-8q5fj" Jun 14 14:50:33.384189 ip-10-0-129-116 kubenswrapper[2546]: I0614 14:50:33.384154 2546 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-gp422\" (UniqueName: \"kubernetes.io/projected/3107cc7d-ad01-4c68-9d2b-53755e15a000-kube-api-access-gp422\") pod \"keycloak-operator-d67dbbb48-8q5fj\" (UID: \"3107cc7d-ad01-4c68-9d2b-53755e15a000\") " pod="keycloak-system/keycloak-operator-d67dbbb48-8q5fj" Jun 14 14:50:33.498111 ip-10-0-129-116 kubenswrapper[2546]: I0614 14:50:33.498058 2546 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="keycloak-system/keycloak-operator-d67dbbb48-8q5fj" Jun 14 14:50:33.651954 ip-10-0-129-116 kubenswrapper[2546]: I0614 14:50:33.651927 2546 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["keycloak-system/keycloak-operator-d67dbbb48-8q5fj"] Jun 14 14:50:33.653216 ip-10-0-129-116 kubenswrapper[2546]: W0614 14:50:33.653183 2546 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3107cc7d_ad01_4c68_9d2b_53755e15a000.slice/crio-3732d536803af5b679f1ffe122d93771cff18ac74737769329440e2036dcf32a WatchSource:0}: Error finding container 3732d536803af5b679f1ffe122d93771cff18ac74737769329440e2036dcf32a: Status 404 returned error can't find the container with id 3732d536803af5b679f1ffe122d93771cff18ac74737769329440e2036dcf32a Jun 14 14:50:34.048629 ip-10-0-129-116 kubenswrapper[2546]: I0614 14:50:34.048537 2546 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="keycloak-system/keycloak-operator-d67dbbb48-8q5fj" event={"ID":"3107cc7d-ad01-4c68-9d2b-53755e15a000","Type":"ContainerStarted","Data":"3732d536803af5b679f1ffe122d93771cff18ac74737769329440e2036dcf32a"} Jun 14 14:50:40.090020 ip-10-0-129-116 kubenswrapper[2546]: I0614 14:50:40.089913 2546 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="keycloak-system/keycloak-operator-d67dbbb48-8q5fj" event={"ID":"3107cc7d-ad01-4c68-9d2b-53755e15a000","Type":"ContainerStarted","Data":"6d29066e65f5a358c44ae08b701f7e3d9f03733e37ea79693fdd2f6e59e94264"} Jun 14 14:50:40.107944 ip-10-0-129-116 kubenswrapper[2546]: I0614 14:50:40.107890 2546 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="keycloak-system/keycloak-operator-d67dbbb48-8q5fj" podStartSLOduration=0.969242227 podStartE2EDuration="7.107872681s" totalImagesPullingTime="6.138630454s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-14 14:50:33 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-14 14:50:40.104987392 +0000 UTC m=+677.433369517" watchObservedRunningTime="2026-06-14 14:50:40.107872681 +0000 UTC m=+677.436254808" Jun 14 14:50:48.653609 ip-10-0-129-116 kubenswrapper[2546]: I0614 14:50:48.653569 2546 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c96gx_105377da-c223-41ad-b033-546cb01239c4/konnectivity-agent/0.log" limit=1024 Jun 14 14:50:48.755274 ip-10-0-129-116 kubenswrapper[2546]: I0614 14:50:48.755240 2546 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c96gx_105377da-c223-41ad-b033-546cb01239c4/konnectivity-agent/0.log" limit=1024 Jun 14 14:50:50.405621 ip-10-0-129-116 kubenswrapper[2546]: I0614 14:50:50.405580 2546 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c96gx_105377da-c223-41ad-b033-546cb01239c4/konnectivity-agent/0.log" limit=1024 Jun 14 14:50:54.879719 ip-10-0-129-116 kubenswrapper[2546]: I0614 14:50:54.879684 2546 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c96gx_105377da-c223-41ad-b033-546cb01239c4/konnectivity-agent/0.log" limit=1024 Jun 14 14:50:54.931427 ip-10-0-129-116 kubenswrapper[2546]: I0614 14:50:54.931397 2546 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c96gx_105377da-c223-41ad-b033-546cb01239c4/konnectivity-agent/0.log" limit=1024 Jun 14 14:51:19.444266 ip-10-0-129-116 kubenswrapper[2546]: I0614 14:51:19.444214 2546 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c96gx_105377da-c223-41ad-b033-546cb01239c4/konnectivity-agent/0.log" limit=1024 Jun 14 14:51:19.904204 ip-10-0-129-116 kubenswrapper[2546]: I0614 14:51:19.904172 2546 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-f84f56b45-r75jb"] Jun 14 14:51:19.913489 ip-10-0-129-116 kubenswrapper[2546]: I0614 14:51:19.913458 2546 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-f84f56b45-r75jb" Jun 14 14:51:19.916005 ip-10-0-129-116 kubenswrapper[2546]: I0614 14:51:19.915981 2546 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-f84f56b45-r75jb"] Jun 14 14:51:19.916159 ip-10-0-129-116 kubenswrapper[2546]: I0614 14:51:19.916122 2546 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"authorino-authorino-dockercfg-r25qf\"" Jun 14 14:51:19.919681 ip-10-0-129-116 kubenswrapper[2546]: I0614 14:51:19.919650 2546 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c96gx_105377da-c223-41ad-b033-546cb01239c4/konnectivity-agent/0.log" limit=1024 Jun 14 14:51:19.991831 ip-10-0-129-116 kubenswrapper[2546]: I0614 14:51:19.991793 2546 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wc9nx\" (UniqueName: \"kubernetes.io/projected/e390aae2-c400-4e0d-a5aa-2d5bd8d4bc61-kube-api-access-wc9nx\") pod \"authorino-f84f56b45-r75jb\" (UID: \"e390aae2-c400-4e0d-a5aa-2d5bd8d4bc61\") " pod="kuadrant-system/authorino-f84f56b45-r75jb" Jun 14 14:51:20.092978 ip-10-0-129-116 kubenswrapper[2546]: I0614 14:51:20.092949 2546 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wc9nx\" (UniqueName: \"kubernetes.io/projected/e390aae2-c400-4e0d-a5aa-2d5bd8d4bc61-kube-api-access-wc9nx\") pod \"authorino-f84f56b45-r75jb\" (UID: \"e390aae2-c400-4e0d-a5aa-2d5bd8d4bc61\") " pod="kuadrant-system/authorino-f84f56b45-r75jb" Jun 14 14:51:20.100604 ip-10-0-129-116 kubenswrapper[2546]: I0614 14:51:20.100576 2546 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-wc9nx\" (UniqueName: \"kubernetes.io/projected/e390aae2-c400-4e0d-a5aa-2d5bd8d4bc61-kube-api-access-wc9nx\") pod \"authorino-f84f56b45-r75jb\" (UID: \"e390aae2-c400-4e0d-a5aa-2d5bd8d4bc61\") " pod="kuadrant-system/authorino-f84f56b45-r75jb" Jun 14 14:51:20.141384 ip-10-0-129-116 kubenswrapper[2546]: I0614 14:51:20.141352 2546 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-f84f56b45-r75jb"] Jun 14 14:51:20.141591 ip-10-0-129-116 kubenswrapper[2546]: I0614 14:51:20.141579 2546 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-f84f56b45-r75jb" Jun 14 14:51:20.281685 ip-10-0-129-116 kubenswrapper[2546]: I0614 14:51:20.281655 2546 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-f84f56b45-r75jb"] Jun 14 14:51:20.283564 ip-10-0-129-116 kubenswrapper[2546]: W0614 14:51:20.283537 2546 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pode390aae2_c400_4e0d_a5aa_2d5bd8d4bc61.slice/crio-37edeeb81e4d16310e74ddfdc73a419b7ae15e82e11599741ad5b13080a0b0ba WatchSource:0}: Error finding container 37edeeb81e4d16310e74ddfdc73a419b7ae15e82e11599741ad5b13080a0b0ba: Status 404 returned error can't find the container with id 37edeeb81e4d16310e74ddfdc73a419b7ae15e82e11599741ad5b13080a0b0ba Jun 14 14:51:20.284896 ip-10-0-129-116 kubenswrapper[2546]: I0614 14:51:20.284879 2546 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jun 14 14:51:20.300736 ip-10-0-129-116 kubenswrapper[2546]: I0614 14:51:20.300709 2546 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-f84f56b45-r75jb" event={"ID":"e390aae2-c400-4e0d-a5aa-2d5bd8d4bc61","Type":"ContainerStarted","Data":"37edeeb81e4d16310e74ddfdc73a419b7ae15e82e11599741ad5b13080a0b0ba"} Jun 14 14:51:21.307209 ip-10-0-129-116 kubenswrapper[2546]: I0614 14:51:21.307172 2546 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-f84f56b45-r75jb" event={"ID":"e390aae2-c400-4e0d-a5aa-2d5bd8d4bc61","Type":"ContainerStarted","Data":"e748bf4464e8a13bf6a06ab0219672bbffcedd6ced946190f82e34775ca291f9"} Jun 14 14:51:21.307690 ip-10-0-129-116 kubenswrapper[2546]: I0614 14:51:21.307245 2546 kuberuntime_container.go:872] "Killing container with a grace period" pod="kuadrant-system/authorino-f84f56b45-r75jb" podUID="e390aae2-c400-4e0d-a5aa-2d5bd8d4bc61" containerName="authorino" containerID="cri-o://e748bf4464e8a13bf6a06ab0219672bbffcedd6ced946190f82e34775ca291f9" gracePeriod=30 Jun 14 14:51:21.323736 ip-10-0-129-116 kubenswrapper[2546]: I0614 14:51:21.323694 2546 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/authorino-f84f56b45-r75jb" podStartSLOduration=1.931749549 podStartE2EDuration="2.323679106s" totalImagesPullingTime="391.929557ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-14 14:51:19 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-14 14:51:21.321872067 +0000 UTC m=+718.650254193" watchObservedRunningTime="2026-06-14 14:51:21.323679106 +0000 UTC m=+718.652061271" Jun 14 14:51:21.565384 ip-10-0-129-116 kubenswrapper[2546]: I0614 14:51:21.565326 2546 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-f84f56b45-r75jb" Jun 14 14:51:21.707162 ip-10-0-129-116 kubenswrapper[2546]: I0614 14:51:21.707133 2546 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-wc9nx\" (UniqueName: \"kubernetes.io/projected/e390aae2-c400-4e0d-a5aa-2d5bd8d4bc61-kube-api-access-wc9nx\") pod \"e390aae2-c400-4e0d-a5aa-2d5bd8d4bc61\" (UID: \"e390aae2-c400-4e0d-a5aa-2d5bd8d4bc61\") " Jun 14 14:51:21.709259 ip-10-0-129-116 kubenswrapper[2546]: I0614 14:51:21.709229 2546 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/e390aae2-c400-4e0d-a5aa-2d5bd8d4bc61-kube-api-access-wc9nx" (OuterVolumeSpecName: "kube-api-access-wc9nx") pod "e390aae2-c400-4e0d-a5aa-2d5bd8d4bc61" (UID: "e390aae2-c400-4e0d-a5aa-2d5bd8d4bc61"). InnerVolumeSpecName "kube-api-access-wc9nx". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 14 14:51:21.808475 ip-10-0-129-116 kubenswrapper[2546]: I0614 14:51:21.808438 2546 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-wc9nx\" (UniqueName: \"kubernetes.io/projected/e390aae2-c400-4e0d-a5aa-2d5bd8d4bc61-kube-api-access-wc9nx\") on node \"ip-10-0-129-116.ec2.internal\" DevicePath \"\"" Jun 14 14:51:22.246356 ip-10-0-129-116 kubenswrapper[2546]: I0614 14:51:22.246321 2546 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c96gx_105377da-c223-41ad-b033-546cb01239c4/konnectivity-agent/0.log" limit=1024 Jun 14 14:51:22.320023 ip-10-0-129-116 kubenswrapper[2546]: I0614 14:51:22.319988 2546 generic.go:356] "Generic (PLEG): container finished" podID="e390aae2-c400-4e0d-a5aa-2d5bd8d4bc61" containerID="e748bf4464e8a13bf6a06ab0219672bbffcedd6ced946190f82e34775ca291f9" exitCode=0 Jun 14 14:51:22.320530 ip-10-0-129-116 kubenswrapper[2546]: I0614 14:51:22.320033 2546 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-f84f56b45-r75jb" Jun 14 14:51:22.320530 ip-10-0-129-116 kubenswrapper[2546]: I0614 14:51:22.320081 2546 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-f84f56b45-r75jb" event={"ID":"e390aae2-c400-4e0d-a5aa-2d5bd8d4bc61","Type":"ContainerDied","Data":"e748bf4464e8a13bf6a06ab0219672bbffcedd6ced946190f82e34775ca291f9"} Jun 14 14:51:22.320530 ip-10-0-129-116 kubenswrapper[2546]: I0614 14:51:22.320150 2546 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-f84f56b45-r75jb" event={"ID":"e390aae2-c400-4e0d-a5aa-2d5bd8d4bc61","Type":"ContainerDied","Data":"37edeeb81e4d16310e74ddfdc73a419b7ae15e82e11599741ad5b13080a0b0ba"} Jun 14 14:51:22.320530 ip-10-0-129-116 kubenswrapper[2546]: I0614 14:51:22.320175 2546 scope.go:117] "RemoveContainer" containerID="e748bf4464e8a13bf6a06ab0219672bbffcedd6ced946190f82e34775ca291f9" Jun 14 14:51:22.330420 ip-10-0-129-116 kubenswrapper[2546]: I0614 14:51:22.330400 2546 scope.go:117] "RemoveContainer" containerID="e748bf4464e8a13bf6a06ab0219672bbffcedd6ced946190f82e34775ca291f9" Jun 14 14:51:22.330703 ip-10-0-129-116 kubenswrapper[2546]: E0614 14:51:22.330677 2546 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"e748bf4464e8a13bf6a06ab0219672bbffcedd6ced946190f82e34775ca291f9\": container with ID starting with e748bf4464e8a13bf6a06ab0219672bbffcedd6ced946190f82e34775ca291f9 not found: ID does not exist" containerID="e748bf4464e8a13bf6a06ab0219672bbffcedd6ced946190f82e34775ca291f9" Jun 14 14:51:22.330776 ip-10-0-129-116 kubenswrapper[2546]: I0614 14:51:22.330714 2546 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"e748bf4464e8a13bf6a06ab0219672bbffcedd6ced946190f82e34775ca291f9"} err="failed to get container status \"e748bf4464e8a13bf6a06ab0219672bbffcedd6ced946190f82e34775ca291f9\": rpc error: code = NotFound desc = could not find container \"e748bf4464e8a13bf6a06ab0219672bbffcedd6ced946190f82e34775ca291f9\": container with ID starting with e748bf4464e8a13bf6a06ab0219672bbffcedd6ced946190f82e34775ca291f9 not found: ID does not exist" Jun 14 14:51:22.341173 ip-10-0-129-116 kubenswrapper[2546]: I0614 14:51:22.341143 2546 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-f84f56b45-r75jb"] Jun 14 14:51:22.344524 ip-10-0-129-116 kubenswrapper[2546]: I0614 14:51:22.344504 2546 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/authorino-f84f56b45-r75jb"] Jun 14 14:51:23.190428 ip-10-0-129-116 kubenswrapper[2546]: I0614 14:51:23.190397 2546 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="e390aae2-c400-4e0d-a5aa-2d5bd8d4bc61" path="/var/lib/kubelet/pods/e390aae2-c400-4e0d-a5aa-2d5bd8d4bc61/volumes" Jun 14 14:51:25.180857 ip-10-0-129-116 kubenswrapper[2546]: I0614 14:51:25.180823 2546 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c96gx_105377da-c223-41ad-b033-546cb01239c4/konnectivity-agent/0.log" limit=1024 Jun 14 14:51:25.279003 ip-10-0-129-116 kubenswrapper[2546]: I0614 14:51:25.278965 2546 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c96gx_105377da-c223-41ad-b033-546cb01239c4/konnectivity-agent/0.log" limit=1024 Jun 14 14:51:25.591441 ip-10-0-129-116 kubenswrapper[2546]: I0614 14:51:25.591364 2546 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c96gx_105377da-c223-41ad-b033-546cb01239c4/konnectivity-agent/0.log" limit=1024 Jun 14 14:51:27.924570 ip-10-0-129-116 kubenswrapper[2546]: I0614 14:51:27.924532 2546 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c96gx_105377da-c223-41ad-b033-546cb01239c4/konnectivity-agent/0.log" limit=1024 Jun 14 14:51:28.010912 ip-10-0-129-116 kubenswrapper[2546]: I0614 14:51:28.010879 2546 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c96gx_105377da-c223-41ad-b033-546cb01239c4/konnectivity-agent/0.log" limit=1024 Jun 14 14:51:58.898862 ip-10-0-129-116 kubenswrapper[2546]: I0614 14:51:58.898830 2546 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c96gx_105377da-c223-41ad-b033-546cb01239c4/konnectivity-agent/0.log" limit=1024 Jun 14 14:51:59.402922 ip-10-0-129-116 kubenswrapper[2546]: I0614 14:51:59.402885 2546 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c96gx_105377da-c223-41ad-b033-546cb01239c4/konnectivity-agent/0.log" limit=1024 Jun 14 14:51:59.491046 ip-10-0-129-116 kubenswrapper[2546]: I0614 14:51:59.491005 2546 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c96gx_105377da-c223-41ad-b033-546cb01239c4/konnectivity-agent/0.log" limit=1024 Jun 14 14:52:50.166614 ip-10-0-129-116 kubenswrapper[2546]: I0614 14:52:50.166578 2546 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-9f48d989-7bsrw"] Jun 14 14:52:50.167221 ip-10-0-129-116 kubenswrapper[2546]: I0614 14:52:50.166934 2546 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="e390aae2-c400-4e0d-a5aa-2d5bd8d4bc61" containerName="authorino" Jun 14 14:52:50.167221 ip-10-0-129-116 kubenswrapper[2546]: I0614 14:52:50.166945 2546 state_mem.go:107] "Deleted CPUSet assignment" podUID="e390aae2-c400-4e0d-a5aa-2d5bd8d4bc61" containerName="authorino" Jun 14 14:52:50.167221 ip-10-0-129-116 kubenswrapper[2546]: I0614 14:52:50.167016 2546 memory_manager.go:368] "RemoveStaleState removing state" podUID="e390aae2-c400-4e0d-a5aa-2d5bd8d4bc61" containerName="authorino" Jun 14 14:52:50.170130 ip-10-0-129-116 kubenswrapper[2546]: I0614 14:52:50.170110 2546 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-9f48d989-7bsrw" Jun 14 14:52:50.173806 ip-10-0-129-116 kubenswrapper[2546]: I0614 14:52:50.173773 2546 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"authorino-oidc-ca\"" Jun 14 14:52:50.173905 ip-10-0-129-116 kubenswrapper[2546]: I0614 14:52:50.173858 2546 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"authorino-authorino-dockercfg-r25qf\"" Jun 14 14:52:50.173946 ip-10-0-129-116 kubenswrapper[2546]: I0614 14:52:50.173918 2546 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"authorino-server-cert\"" Jun 14 14:52:50.178852 ip-10-0-129-116 kubenswrapper[2546]: I0614 14:52:50.178828 2546 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-9f48d989-7bsrw"] Jun 14 14:52:50.232413 ip-10-0-129-116 kubenswrapper[2546]: I0614 14:52:50.232369 2546 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xlrgh\" (UniqueName: \"kubernetes.io/projected/c6f36947-3124-4307-a11c-9c139cd1d044-kube-api-access-xlrgh\") pod \"authorino-9f48d989-7bsrw\" (UID: \"c6f36947-3124-4307-a11c-9c139cd1d044\") " pod="kuadrant-system/authorino-9f48d989-7bsrw" Jun 14 14:52:50.232583 ip-10-0-129-116 kubenswrapper[2546]: I0614 14:52:50.232457 2546 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oidc-ca\" (UniqueName: \"kubernetes.io/configmap/c6f36947-3124-4307-a11c-9c139cd1d044-oidc-ca\") pod \"authorino-9f48d989-7bsrw\" (UID: \"c6f36947-3124-4307-a11c-9c139cd1d044\") " pod="kuadrant-system/authorino-9f48d989-7bsrw" Jun 14 14:52:50.232583 ip-10-0-129-116 kubenswrapper[2546]: I0614 14:52:50.232486 2546 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/c6f36947-3124-4307-a11c-9c139cd1d044-tls-cert\") pod \"authorino-9f48d989-7bsrw\" (UID: \"c6f36947-3124-4307-a11c-9c139cd1d044\") " pod="kuadrant-system/authorino-9f48d989-7bsrw" Jun 14 14:52:50.333289 ip-10-0-129-116 kubenswrapper[2546]: I0614 14:52:50.333252 2546 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/c6f36947-3124-4307-a11c-9c139cd1d044-tls-cert\") pod \"authorino-9f48d989-7bsrw\" (UID: \"c6f36947-3124-4307-a11c-9c139cd1d044\") " pod="kuadrant-system/authorino-9f48d989-7bsrw" Jun 14 14:52:50.333463 ip-10-0-129-116 kubenswrapper[2546]: I0614 14:52:50.333316 2546 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xlrgh\" (UniqueName: \"kubernetes.io/projected/c6f36947-3124-4307-a11c-9c139cd1d044-kube-api-access-xlrgh\") pod \"authorino-9f48d989-7bsrw\" (UID: \"c6f36947-3124-4307-a11c-9c139cd1d044\") " pod="kuadrant-system/authorino-9f48d989-7bsrw" Jun 14 14:52:50.333463 ip-10-0-129-116 kubenswrapper[2546]: I0614 14:52:50.333360 2546 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oidc-ca\" (UniqueName: \"kubernetes.io/configmap/c6f36947-3124-4307-a11c-9c139cd1d044-oidc-ca\") pod \"authorino-9f48d989-7bsrw\" (UID: \"c6f36947-3124-4307-a11c-9c139cd1d044\") " pod="kuadrant-system/authorino-9f48d989-7bsrw" Jun 14 14:52:50.333941 ip-10-0-129-116 kubenswrapper[2546]: I0614 14:52:50.333923 2546 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"oidc-ca\" (UniqueName: \"kubernetes.io/configmap/c6f36947-3124-4307-a11c-9c139cd1d044-oidc-ca\") pod \"authorino-9f48d989-7bsrw\" (UID: \"c6f36947-3124-4307-a11c-9c139cd1d044\") " pod="kuadrant-system/authorino-9f48d989-7bsrw" Jun 14 14:52:50.335703 ip-10-0-129-116 kubenswrapper[2546]: I0614 14:52:50.335679 2546 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/c6f36947-3124-4307-a11c-9c139cd1d044-tls-cert\") pod \"authorino-9f48d989-7bsrw\" (UID: \"c6f36947-3124-4307-a11c-9c139cd1d044\") " pod="kuadrant-system/authorino-9f48d989-7bsrw" Jun 14 14:52:50.340798 ip-10-0-129-116 kubenswrapper[2546]: I0614 14:52:50.340776 2546 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-xlrgh\" (UniqueName: \"kubernetes.io/projected/c6f36947-3124-4307-a11c-9c139cd1d044-kube-api-access-xlrgh\") pod \"authorino-9f48d989-7bsrw\" (UID: \"c6f36947-3124-4307-a11c-9c139cd1d044\") " pod="kuadrant-system/authorino-9f48d989-7bsrw" Jun 14 14:52:50.479314 ip-10-0-129-116 kubenswrapper[2546]: I0614 14:52:50.479220 2546 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-9f48d989-7bsrw" Jun 14 14:52:50.610697 ip-10-0-129-116 kubenswrapper[2546]: I0614 14:52:50.610669 2546 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-9f48d989-7bsrw"] Jun 14 14:52:50.612393 ip-10-0-129-116 kubenswrapper[2546]: W0614 14:52:50.612363 2546 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podc6f36947_3124_4307_a11c_9c139cd1d044.slice/crio-c38c65994f293e5a0086964ed519b440ae1fea82dc20131d0d2bb621ce4667cf WatchSource:0}: Error finding container c38c65994f293e5a0086964ed519b440ae1fea82dc20131d0d2bb621ce4667cf: Status 404 returned error can't find the container with id c38c65994f293e5a0086964ed519b440ae1fea82dc20131d0d2bb621ce4667cf Jun 14 14:52:50.799494 ip-10-0-129-116 kubenswrapper[2546]: I0614 14:52:50.799408 2546 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-9f48d989-7bsrw" event={"ID":"c6f36947-3124-4307-a11c-9c139cd1d044","Type":"ContainerStarted","Data":"c38c65994f293e5a0086964ed519b440ae1fea82dc20131d0d2bb621ce4667cf"} Jun 14 14:52:51.806275 ip-10-0-129-116 kubenswrapper[2546]: I0614 14:52:51.806245 2546 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-9f48d989-7bsrw" event={"ID":"c6f36947-3124-4307-a11c-9c139cd1d044","Type":"ContainerStarted","Data":"4028ad9620d5cec54c3d5eb74773ff064b406d89e58af08378c971a6913c555b"} Jun 14 14:52:51.824404 ip-10-0-129-116 kubenswrapper[2546]: I0614 14:52:51.824357 2546 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/authorino-9f48d989-7bsrw" podStartSLOduration=1.309908086 podStartE2EDuration="1.824341741s" totalImagesPullingTime="514.433655ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-14 14:52:50 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-14 14:52:51.822145247 +0000 UTC m=+809.150527373" watchObservedRunningTime="2026-06-14 14:52:51.824341741 +0000 UTC m=+809.152723918" Jun 14 14:52:52.441903 ip-10-0-129-116 kubenswrapper[2546]: I0614 14:52:52.441867 2546 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c96gx_105377da-c223-41ad-b033-546cb01239c4/konnectivity-agent/0.log" limit=1024 Jun 14 14:52:52.546025 ip-10-0-129-116 kubenswrapper[2546]: I0614 14:52:52.545984 2546 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c96gx_105377da-c223-41ad-b033-546cb01239c4/konnectivity-agent/0.log" limit=1024 Jun 14 14:53:02.226287 ip-10-0-129-116 kubenswrapper[2546]: I0614 14:53:02.226256 2546 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c96gx_105377da-c223-41ad-b033-546cb01239c4/konnectivity-agent/0.log" limit=1024 Jun 14 14:53:26.955590 ip-10-0-129-116 kubenswrapper[2546]: I0614 14:53:26.955553 2546 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c96gx_105377da-c223-41ad-b033-546cb01239c4/konnectivity-agent/0.log" limit=1024 Jun 14 14:53:36.617127 ip-10-0-129-116 kubenswrapper[2546]: I0614 14:53:36.617077 2546 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c96gx_105377da-c223-41ad-b033-546cb01239c4/konnectivity-agent/0.log" limit=1024 Jun 14 14:53:45.367982 ip-10-0-129-116 kubenswrapper[2546]: I0614 14:53:45.367945 2546 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c96gx_105377da-c223-41ad-b033-546cb01239c4/konnectivity-agent/0.log" limit=1024 Jun 14 14:53:45.469141 ip-10-0-129-116 kubenswrapper[2546]: I0614 14:53:45.469111 2546 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c96gx_105377da-c223-41ad-b033-546cb01239c4/konnectivity-agent/0.log" limit=1024 Jun 14 14:53:46.441141 ip-10-0-129-116 kubenswrapper[2546]: I0614 14:53:46.441110 2546 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c96gx_105377da-c223-41ad-b033-546cb01239c4/konnectivity-agent/0.log" limit=1024 Jun 14 14:54:13.423745 ip-10-0-129-116 kubenswrapper[2546]: I0614 14:54:13.423651 2546 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c96gx_105377da-c223-41ad-b033-546cb01239c4/konnectivity-agent/0.log" limit=1024 Jun 14 14:54:16.396717 ip-10-0-129-116 kubenswrapper[2546]: I0614 14:54:16.396683 2546 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c96gx_105377da-c223-41ad-b033-546cb01239c4/konnectivity-agent/0.log" limit=1024 Jun 14 14:54:19.854914 ip-10-0-129-116 kubenswrapper[2546]: I0614 14:54:19.854868 2546 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c96gx_105377da-c223-41ad-b033-546cb01239c4/konnectivity-agent/0.log" limit=1024 Jun 14 14:54:49.368438 ip-10-0-129-116 kubenswrapper[2546]: I0614 14:54:49.368405 2546 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c96gx_105377da-c223-41ad-b033-546cb01239c4/konnectivity-agent/0.log" limit=1024 Jun 14 14:54:50.472442 ip-10-0-129-116 kubenswrapper[2546]: I0614 14:54:50.472412 2546 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c96gx_105377da-c223-41ad-b033-546cb01239c4/konnectivity-agent/0.log" limit=1024 Jun 14 14:55:52.178328 ip-10-0-129-116 kubenswrapper[2546]: I0614 14:55:52.178297 2546 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c96gx_105377da-c223-41ad-b033-546cb01239c4/konnectivity-agent/0.log" limit=1024 Jun 14 14:56:24.286649 ip-10-0-129-116 kubenswrapper[2546]: I0614 14:56:24.286614 2546 scope.go:117] "RemoveContainer" containerID="2349629d714df9750a07e6c087a5773db323bde21af305a0bdd25960342fc1aa" Jun 14 14:56:51.792809 ip-10-0-129-116 kubenswrapper[2546]: I0614 14:56:51.792771 2546 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-f7bcd5f76-44c94"] Jun 14 14:56:51.796293 ip-10-0-129-116 kubenswrapper[2546]: I0614 14:56:51.796274 2546 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-f7bcd5f76-44c94" Jun 14 14:56:51.801995 ip-10-0-129-116 kubenswrapper[2546]: I0614 14:56:51.801965 2546 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-f7bcd5f76-44c94"] Jun 14 14:56:51.885375 ip-10-0-129-116 kubenswrapper[2546]: I0614 14:56:51.885339 2546 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oidc-ca\" (UniqueName: \"kubernetes.io/configmap/5373ed97-4606-41ec-b706-ef0362e2f576-oidc-ca\") pod \"authorino-f7bcd5f76-44c94\" (UID: \"5373ed97-4606-41ec-b706-ef0362e2f576\") " pod="kuadrant-system/authorino-f7bcd5f76-44c94" Jun 14 14:56:51.885542 ip-10-0-129-116 kubenswrapper[2546]: I0614 14:56:51.885422 2546 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-k75ld\" (UniqueName: \"kubernetes.io/projected/5373ed97-4606-41ec-b706-ef0362e2f576-kube-api-access-k75ld\") pod \"authorino-f7bcd5f76-44c94\" (UID: \"5373ed97-4606-41ec-b706-ef0362e2f576\") " pod="kuadrant-system/authorino-f7bcd5f76-44c94" Jun 14 14:56:51.885542 ip-10-0-129-116 kubenswrapper[2546]: I0614 14:56:51.885443 2546 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/5373ed97-4606-41ec-b706-ef0362e2f576-tls-cert\") pod \"authorino-f7bcd5f76-44c94\" (UID: \"5373ed97-4606-41ec-b706-ef0362e2f576\") " pod="kuadrant-system/authorino-f7bcd5f76-44c94" Jun 14 14:56:51.986080 ip-10-0-129-116 kubenswrapper[2546]: I0614 14:56:51.986053 2546 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-k75ld\" (UniqueName: \"kubernetes.io/projected/5373ed97-4606-41ec-b706-ef0362e2f576-kube-api-access-k75ld\") pod \"authorino-f7bcd5f76-44c94\" (UID: \"5373ed97-4606-41ec-b706-ef0362e2f576\") " pod="kuadrant-system/authorino-f7bcd5f76-44c94" Jun 14 14:56:51.986255 ip-10-0-129-116 kubenswrapper[2546]: I0614 14:56:51.986087 2546 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/5373ed97-4606-41ec-b706-ef0362e2f576-tls-cert\") pod \"authorino-f7bcd5f76-44c94\" (UID: \"5373ed97-4606-41ec-b706-ef0362e2f576\") " pod="kuadrant-system/authorino-f7bcd5f76-44c94" Jun 14 14:56:51.986255 ip-10-0-129-116 kubenswrapper[2546]: I0614 14:56:51.986164 2546 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oidc-ca\" (UniqueName: \"kubernetes.io/configmap/5373ed97-4606-41ec-b706-ef0362e2f576-oidc-ca\") pod \"authorino-f7bcd5f76-44c94\" (UID: \"5373ed97-4606-41ec-b706-ef0362e2f576\") " pod="kuadrant-system/authorino-f7bcd5f76-44c94" Jun 14 14:56:51.986859 ip-10-0-129-116 kubenswrapper[2546]: I0614 14:56:51.986839 2546 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"oidc-ca\" (UniqueName: \"kubernetes.io/configmap/5373ed97-4606-41ec-b706-ef0362e2f576-oidc-ca\") pod \"authorino-f7bcd5f76-44c94\" (UID: \"5373ed97-4606-41ec-b706-ef0362e2f576\") " pod="kuadrant-system/authorino-f7bcd5f76-44c94" Jun 14 14:56:51.988478 ip-10-0-129-116 kubenswrapper[2546]: I0614 14:56:51.988456 2546 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/5373ed97-4606-41ec-b706-ef0362e2f576-tls-cert\") pod \"authorino-f7bcd5f76-44c94\" (UID: \"5373ed97-4606-41ec-b706-ef0362e2f576\") " pod="kuadrant-system/authorino-f7bcd5f76-44c94" Jun 14 14:56:51.994441 ip-10-0-129-116 kubenswrapper[2546]: I0614 14:56:51.994418 2546 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-k75ld\" (UniqueName: \"kubernetes.io/projected/5373ed97-4606-41ec-b706-ef0362e2f576-kube-api-access-k75ld\") pod \"authorino-f7bcd5f76-44c94\" (UID: \"5373ed97-4606-41ec-b706-ef0362e2f576\") " pod="kuadrant-system/authorino-f7bcd5f76-44c94" Jun 14 14:56:52.106413 ip-10-0-129-116 kubenswrapper[2546]: I0614 14:56:52.106334 2546 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-f7bcd5f76-44c94" Jun 14 14:56:52.237221 ip-10-0-129-116 kubenswrapper[2546]: I0614 14:56:52.237195 2546 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-f7bcd5f76-44c94"] Jun 14 14:56:52.239167 ip-10-0-129-116 kubenswrapper[2546]: W0614 14:56:52.239139 2546 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod5373ed97_4606_41ec_b706_ef0362e2f576.slice/crio-684f58f6b835d3fbcc1fe26b11c30e94de4109b5ab3557c6ae15a6a4ef537bc1 WatchSource:0}: Error finding container 684f58f6b835d3fbcc1fe26b11c30e94de4109b5ab3557c6ae15a6a4ef537bc1: Status 404 returned error can't find the container with id 684f58f6b835d3fbcc1fe26b11c30e94de4109b5ab3557c6ae15a6a4ef537bc1 Jun 14 14:56:52.240449 ip-10-0-129-116 kubenswrapper[2546]: I0614 14:56:52.240428 2546 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jun 14 14:56:53.085725 ip-10-0-129-116 kubenswrapper[2546]: I0614 14:56:53.085638 2546 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-f7bcd5f76-44c94" event={"ID":"5373ed97-4606-41ec-b706-ef0362e2f576","Type":"ContainerStarted","Data":"67fdf3252174fa4fcc5bd496016439cf4c189d62c5f17d5eb22ff99a360f92bc"} Jun 14 14:56:53.085725 ip-10-0-129-116 kubenswrapper[2546]: I0614 14:56:53.085683 2546 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-f7bcd5f76-44c94" event={"ID":"5373ed97-4606-41ec-b706-ef0362e2f576","Type":"ContainerStarted","Data":"684f58f6b835d3fbcc1fe26b11c30e94de4109b5ab3557c6ae15a6a4ef537bc1"} Jun 14 14:56:53.101606 ip-10-0-129-116 kubenswrapper[2546]: I0614 14:56:53.101506 2546 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/authorino-f7bcd5f76-44c94" podStartSLOduration=1.664918368 podStartE2EDuration="2.101485614s" totalImagesPullingTime="436.567246ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-14 14:56:51 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-14 14:56:53.100922613 +0000 UTC m=+1050.429304739" watchObservedRunningTime="2026-06-14 14:56:53.101485614 +0000 UTC m=+1050.429867739" Jun 14 14:56:53.127307 ip-10-0-129-116 kubenswrapper[2546]: I0614 14:56:53.127261 2546 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-9f48d989-7bsrw"] Jun 14 14:56:53.127543 ip-10-0-129-116 kubenswrapper[2546]: I0614 14:56:53.127484 2546 kuberuntime_container.go:872] "Killing container with a grace period" pod="kuadrant-system/authorino-9f48d989-7bsrw" podUID="c6f36947-3124-4307-a11c-9c139cd1d044" containerName="authorino" containerID="cri-o://4028ad9620d5cec54c3d5eb74773ff064b406d89e58af08378c971a6913c555b" gracePeriod=30 Jun 14 14:56:53.385537 ip-10-0-129-116 kubenswrapper[2546]: I0614 14:56:53.385509 2546 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-9f48d989-7bsrw" Jun 14 14:56:53.499828 ip-10-0-129-116 kubenswrapper[2546]: I0614 14:56:53.499791 2546 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/c6f36947-3124-4307-a11c-9c139cd1d044-tls-cert\") pod \"c6f36947-3124-4307-a11c-9c139cd1d044\" (UID: \"c6f36947-3124-4307-a11c-9c139cd1d044\") " Jun 14 14:56:53.500000 ip-10-0-129-116 kubenswrapper[2546]: I0614 14:56:53.499887 2546 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"oidc-ca\" (UniqueName: \"kubernetes.io/configmap/c6f36947-3124-4307-a11c-9c139cd1d044-oidc-ca\") pod \"c6f36947-3124-4307-a11c-9c139cd1d044\" (UID: \"c6f36947-3124-4307-a11c-9c139cd1d044\") " Jun 14 14:56:53.500000 ip-10-0-129-116 kubenswrapper[2546]: I0614 14:56:53.499918 2546 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-xlrgh\" (UniqueName: \"kubernetes.io/projected/c6f36947-3124-4307-a11c-9c139cd1d044-kube-api-access-xlrgh\") pod \"c6f36947-3124-4307-a11c-9c139cd1d044\" (UID: \"c6f36947-3124-4307-a11c-9c139cd1d044\") " Jun 14 14:56:53.510605 ip-10-0-129-116 kubenswrapper[2546]: I0614 14:56:53.506833 2546 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/c6f36947-3124-4307-a11c-9c139cd1d044-kube-api-access-xlrgh" (OuterVolumeSpecName: "kube-api-access-xlrgh") pod "c6f36947-3124-4307-a11c-9c139cd1d044" (UID: "c6f36947-3124-4307-a11c-9c139cd1d044"). InnerVolumeSpecName "kube-api-access-xlrgh". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 14 14:56:53.512288 ip-10-0-129-116 kubenswrapper[2546]: I0614 14:56:53.512238 2546 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/c6f36947-3124-4307-a11c-9c139cd1d044-oidc-ca" (OuterVolumeSpecName: "oidc-ca") pod "c6f36947-3124-4307-a11c-9c139cd1d044" (UID: "c6f36947-3124-4307-a11c-9c139cd1d044"). InnerVolumeSpecName "oidc-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 14 14:56:53.517877 ip-10-0-129-116 kubenswrapper[2546]: I0614 14:56:53.517850 2546 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/c6f36947-3124-4307-a11c-9c139cd1d044-tls-cert" (OuterVolumeSpecName: "tls-cert") pod "c6f36947-3124-4307-a11c-9c139cd1d044" (UID: "c6f36947-3124-4307-a11c-9c139cd1d044"). InnerVolumeSpecName "tls-cert". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 14 14:56:53.600754 ip-10-0-129-116 kubenswrapper[2546]: I0614 14:56:53.600715 2546 reconciler_common.go:299] "Volume detached for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/c6f36947-3124-4307-a11c-9c139cd1d044-tls-cert\") on node \"ip-10-0-129-116.ec2.internal\" DevicePath \"\"" Jun 14 14:56:53.600904 ip-10-0-129-116 kubenswrapper[2546]: I0614 14:56:53.600764 2546 reconciler_common.go:299] "Volume detached for volume \"oidc-ca\" (UniqueName: \"kubernetes.io/configmap/c6f36947-3124-4307-a11c-9c139cd1d044-oidc-ca\") on node \"ip-10-0-129-116.ec2.internal\" DevicePath \"\"" Jun 14 14:56:53.600904 ip-10-0-129-116 kubenswrapper[2546]: I0614 14:56:53.600776 2546 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-xlrgh\" (UniqueName: \"kubernetes.io/projected/c6f36947-3124-4307-a11c-9c139cd1d044-kube-api-access-xlrgh\") on node \"ip-10-0-129-116.ec2.internal\" DevicePath \"\"" Jun 14 14:56:53.715473 ip-10-0-129-116 kubenswrapper[2546]: I0614 14:56:53.715435 2546 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c96gx_105377da-c223-41ad-b033-546cb01239c4/konnectivity-agent/0.log" limit=1024 Jun 14 14:56:53.819683 ip-10-0-129-116 kubenswrapper[2546]: I0614 14:56:53.819648 2546 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c96gx_105377da-c223-41ad-b033-546cb01239c4/konnectivity-agent/0.log" limit=1024 Jun 14 14:56:54.092219 ip-10-0-129-116 kubenswrapper[2546]: I0614 14:56:54.092188 2546 generic.go:356] "Generic (PLEG): container finished" podID="c6f36947-3124-4307-a11c-9c139cd1d044" containerID="4028ad9620d5cec54c3d5eb74773ff064b406d89e58af08378c971a6913c555b" exitCode=0 Jun 14 14:56:54.092588 ip-10-0-129-116 kubenswrapper[2546]: I0614 14:56:54.092271 2546 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-9f48d989-7bsrw" Jun 14 14:56:54.092588 ip-10-0-129-116 kubenswrapper[2546]: I0614 14:56:54.092274 2546 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-9f48d989-7bsrw" event={"ID":"c6f36947-3124-4307-a11c-9c139cd1d044","Type":"ContainerDied","Data":"4028ad9620d5cec54c3d5eb74773ff064b406d89e58af08378c971a6913c555b"} Jun 14 14:56:54.092588 ip-10-0-129-116 kubenswrapper[2546]: I0614 14:56:54.092384 2546 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-9f48d989-7bsrw" event={"ID":"c6f36947-3124-4307-a11c-9c139cd1d044","Type":"ContainerDied","Data":"c38c65994f293e5a0086964ed519b440ae1fea82dc20131d0d2bb621ce4667cf"} Jun 14 14:56:54.092588 ip-10-0-129-116 kubenswrapper[2546]: I0614 14:56:54.092408 2546 scope.go:117] "RemoveContainer" containerID="4028ad9620d5cec54c3d5eb74773ff064b406d89e58af08378c971a6913c555b" Jun 14 14:56:54.102791 ip-10-0-129-116 kubenswrapper[2546]: I0614 14:56:54.102771 2546 scope.go:117] "RemoveContainer" containerID="4028ad9620d5cec54c3d5eb74773ff064b406d89e58af08378c971a6913c555b" Jun 14 14:56:54.103684 ip-10-0-129-116 kubenswrapper[2546]: E0614 14:56:54.103652 2546 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"4028ad9620d5cec54c3d5eb74773ff064b406d89e58af08378c971a6913c555b\": container with ID starting with 4028ad9620d5cec54c3d5eb74773ff064b406d89e58af08378c971a6913c555b not found: ID does not exist" containerID="4028ad9620d5cec54c3d5eb74773ff064b406d89e58af08378c971a6913c555b" Jun 14 14:56:54.103792 ip-10-0-129-116 kubenswrapper[2546]: I0614 14:56:54.103694 2546 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"4028ad9620d5cec54c3d5eb74773ff064b406d89e58af08378c971a6913c555b"} err="failed to get container status \"4028ad9620d5cec54c3d5eb74773ff064b406d89e58af08378c971a6913c555b\": rpc error: code = NotFound desc = could not find container \"4028ad9620d5cec54c3d5eb74773ff064b406d89e58af08378c971a6913c555b\": container with ID starting with 4028ad9620d5cec54c3d5eb74773ff064b406d89e58af08378c971a6913c555b not found: ID does not exist" Jun 14 14:56:54.117926 ip-10-0-129-116 kubenswrapper[2546]: I0614 14:56:54.117864 2546 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-9f48d989-7bsrw"] Jun 14 14:56:54.121654 ip-10-0-129-116 kubenswrapper[2546]: I0614 14:56:54.121627 2546 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/authorino-9f48d989-7bsrw"] Jun 14 14:56:54.758670 ip-10-0-129-116 kubenswrapper[2546]: I0614 14:56:54.758638 2546 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c96gx_105377da-c223-41ad-b033-546cb01239c4/konnectivity-agent/0.log" limit=1024 Jun 14 14:56:54.862385 ip-10-0-129-116 kubenswrapper[2546]: I0614 14:56:54.862354 2546 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c96gx_105377da-c223-41ad-b033-546cb01239c4/konnectivity-agent/0.log" limit=1024 Jun 14 14:56:55.190371 ip-10-0-129-116 kubenswrapper[2546]: I0614 14:56:55.190344 2546 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="c6f36947-3124-4307-a11c-9c139cd1d044" path="/var/lib/kubelet/pods/c6f36947-3124-4307-a11c-9c139cd1d044/volumes" Jun 14 14:57:24.216747 ip-10-0-129-116 kubenswrapper[2546]: I0614 14:57:24.216716 2546 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c96gx_105377da-c223-41ad-b033-546cb01239c4/konnectivity-agent/0.log" limit=1024 Jun 14 14:58:22.449173 ip-10-0-129-116 kubenswrapper[2546]: I0614 14:58:22.449135 2546 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c96gx_105377da-c223-41ad-b033-546cb01239c4/konnectivity-agent/0.log" limit=1024 Jun 14 14:58:23.918917 ip-10-0-129-116 kubenswrapper[2546]: I0614 14:58:23.918878 2546 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c96gx_105377da-c223-41ad-b033-546cb01239c4/konnectivity-agent/0.log" limit=1024 Jun 14 14:59:04.459306 ip-10-0-129-116 kubenswrapper[2546]: I0614 14:59:04.459276 2546 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c96gx_105377da-c223-41ad-b033-546cb01239c4/konnectivity-agent/0.log" limit=1024 Jun 14 14:59:04.566884 ip-10-0-129-116 kubenswrapper[2546]: I0614 14:59:04.566851 2546 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c96gx_105377da-c223-41ad-b033-546cb01239c4/konnectivity-agent/0.log" limit=1024 Jun 14 14:59:04.664980 ip-10-0-129-116 kubenswrapper[2546]: I0614 14:59:04.664946 2546 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c96gx_105377da-c223-41ad-b033-546cb01239c4/konnectivity-agent/0.log" limit=1024 Jun 14 14:59:05.241072 ip-10-0-129-116 kubenswrapper[2546]: I0614 14:59:05.241036 2546 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c96gx_105377da-c223-41ad-b033-546cb01239c4/konnectivity-agent/0.log" limit=1024 Jun 14 14:59:05.343362 ip-10-0-129-116 kubenswrapper[2546]: I0614 14:59:05.343327 2546 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c96gx_105377da-c223-41ad-b033-546cb01239c4/konnectivity-agent/0.log" limit=1024 Jun 14 14:59:07.319753 ip-10-0-129-116 kubenswrapper[2546]: I0614 14:59:07.319712 2546 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c96gx_105377da-c223-41ad-b033-546cb01239c4/konnectivity-agent/0.log" limit=1024 Jun 14 14:59:12.968559 ip-10-0-129-116 kubenswrapper[2546]: I0614 14:59:12.968519 2546 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c96gx_105377da-c223-41ad-b033-546cb01239c4/konnectivity-agent/0.log" limit=1024 Jun 14 14:59:18.705183 ip-10-0-129-116 kubenswrapper[2546]: I0614 14:59:18.705115 2546 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c96gx_105377da-c223-41ad-b033-546cb01239c4/konnectivity-agent/0.log" limit=1024 Jun 14 14:59:18.765184 ip-10-0-129-116 kubenswrapper[2546]: I0614 14:59:18.765151 2546 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c96gx_105377da-c223-41ad-b033-546cb01239c4/konnectivity-agent/0.log" limit=1024 Jun 14 14:59:50.845828 ip-10-0-129-116 kubenswrapper[2546]: I0614 14:59:50.845783 2546 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c96gx_105377da-c223-41ad-b033-546cb01239c4/konnectivity-agent/0.log" limit=1024 Jun 14 14:59:51.875593 ip-10-0-129-116 kubenswrapper[2546]: I0614 14:59:51.875562 2546 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c96gx_105377da-c223-41ad-b033-546cb01239c4/konnectivity-agent/0.log" limit=1024 Jun 14 15:00:00.158263 ip-10-0-129-116 kubenswrapper[2546]: I0614 15:00:00.158229 2546 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/maas-api-key-cleanup-29690820-hdtxp"] Jun 14 15:00:00.158632 ip-10-0-129-116 kubenswrapper[2546]: I0614 15:00:00.158570 2546 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="c6f36947-3124-4307-a11c-9c139cd1d044" containerName="authorino" Jun 14 15:00:00.158632 ip-10-0-129-116 kubenswrapper[2546]: I0614 15:00:00.158580 2546 state_mem.go:107] "Deleted CPUSet assignment" podUID="c6f36947-3124-4307-a11c-9c139cd1d044" containerName="authorino" Jun 14 15:00:00.158711 ip-10-0-129-116 kubenswrapper[2546]: I0614 15:00:00.158650 2546 memory_manager.go:368] "RemoveStaleState removing state" podUID="c6f36947-3124-4307-a11c-9c139cd1d044" containerName="authorino" Jun 14 15:00:00.161612 ip-10-0-129-116 kubenswrapper[2546]: I0614 15:00:00.161595 2546 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-key-cleanup-29690820-hdtxp" Jun 14 15:00:00.167960 ip-10-0-129-116 kubenswrapper[2546]: I0614 15:00:00.167700 2546 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-api-dockercfg-w886h\"" Jun 14 15:00:00.188970 ip-10-0-129-116 kubenswrapper[2546]: I0614 15:00:00.188938 2546 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-api-key-cleanup-29690820-hdtxp"] Jun 14 15:00:00.296292 ip-10-0-129-116 kubenswrapper[2546]: I0614 15:00:00.296260 2546 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mfbqq\" (UniqueName: \"kubernetes.io/projected/06ab4996-3742-496a-bc06-206fa86cefa2-kube-api-access-mfbqq\") pod \"maas-api-key-cleanup-29690820-hdtxp\" (UID: \"06ab4996-3742-496a-bc06-206fa86cefa2\") " pod="opendatahub/maas-api-key-cleanup-29690820-hdtxp" Jun 14 15:00:00.397173 ip-10-0-129-116 kubenswrapper[2546]: I0614 15:00:00.397122 2546 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mfbqq\" (UniqueName: \"kubernetes.io/projected/06ab4996-3742-496a-bc06-206fa86cefa2-kube-api-access-mfbqq\") pod \"maas-api-key-cleanup-29690820-hdtxp\" (UID: \"06ab4996-3742-496a-bc06-206fa86cefa2\") " pod="opendatahub/maas-api-key-cleanup-29690820-hdtxp" Jun 14 15:00:00.406661 ip-10-0-129-116 kubenswrapper[2546]: I0614 15:00:00.406628 2546 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-mfbqq\" (UniqueName: \"kubernetes.io/projected/06ab4996-3742-496a-bc06-206fa86cefa2-kube-api-access-mfbqq\") pod \"maas-api-key-cleanup-29690820-hdtxp\" (UID: \"06ab4996-3742-496a-bc06-206fa86cefa2\") " pod="opendatahub/maas-api-key-cleanup-29690820-hdtxp" Jun 14 15:00:00.471049 ip-10-0-129-116 kubenswrapper[2546]: I0614 15:00:00.470960 2546 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-key-cleanup-29690820-hdtxp" Jun 14 15:00:00.600931 ip-10-0-129-116 kubenswrapper[2546]: I0614 15:00:00.600782 2546 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-api-key-cleanup-29690820-hdtxp"] Jun 14 15:00:00.603694 ip-10-0-129-116 kubenswrapper[2546]: W0614 15:00:00.603662 2546 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod06ab4996_3742_496a_bc06_206fa86cefa2.slice/crio-f40eef9df141f0cb2cf52dd7b33f27283193e328bfc7183a279a2c91b930af8d WatchSource:0}: Error finding container f40eef9df141f0cb2cf52dd7b33f27283193e328bfc7183a279a2c91b930af8d: Status 404 returned error can't find the container with id f40eef9df141f0cb2cf52dd7b33f27283193e328bfc7183a279a2c91b930af8d Jun 14 15:00:01.110658 ip-10-0-129-116 kubenswrapper[2546]: I0614 15:00:01.110618 2546 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-key-cleanup-29690820-hdtxp" event={"ID":"06ab4996-3742-496a-bc06-206fa86cefa2","Type":"ContainerStarted","Data":"f40eef9df141f0cb2cf52dd7b33f27283193e328bfc7183a279a2c91b930af8d"} Jun 14 15:00:05.135001 ip-10-0-129-116 kubenswrapper[2546]: I0614 15:00:05.134947 2546 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-key-cleanup-29690820-hdtxp" event={"ID":"06ab4996-3742-496a-bc06-206fa86cefa2","Type":"ContainerStarted","Data":"ecf208495dede07cfc11e9a3ede66110b4844105ecc6fae99bfb681af2eb5d0c"} Jun 14 15:00:05.152074 ip-10-0-129-116 kubenswrapper[2546]: I0614 15:00:05.152021 2546 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/maas-api-key-cleanup-29690820-hdtxp" podStartSLOduration=1.194266644 podStartE2EDuration="5.152006922s" totalImagesPullingTime="3.957740278s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-14 15:00:00 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-14 15:00:05.150699155 +0000 UTC m=+1242.479081284" watchObservedRunningTime="2026-06-14 15:00:05.152006922 +0000 UTC m=+1242.480389048" Jun 14 15:00:06.141995 ip-10-0-129-116 kubenswrapper[2546]: I0614 15:00:06.141901 2546 generic.go:356] "Generic (PLEG): container finished" podID="06ab4996-3742-496a-bc06-206fa86cefa2" containerID="ecf208495dede07cfc11e9a3ede66110b4844105ecc6fae99bfb681af2eb5d0c" exitCode=0 Jun 14 15:00:06.141995 ip-10-0-129-116 kubenswrapper[2546]: I0614 15:00:06.141967 2546 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-key-cleanup-29690820-hdtxp" event={"ID":"06ab4996-3742-496a-bc06-206fa86cefa2","Type":"ContainerDied","Data":"ecf208495dede07cfc11e9a3ede66110b4844105ecc6fae99bfb681af2eb5d0c"} Jun 14 15:00:07.279032 ip-10-0-129-116 kubenswrapper[2546]: I0614 15:00:07.279008 2546 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-key-cleanup-29690820-hdtxp" Jun 14 15:00:07.357179 ip-10-0-129-116 kubenswrapper[2546]: I0614 15:00:07.357151 2546 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-mfbqq\" (UniqueName: \"kubernetes.io/projected/06ab4996-3742-496a-bc06-206fa86cefa2-kube-api-access-mfbqq\") pod \"06ab4996-3742-496a-bc06-206fa86cefa2\" (UID: \"06ab4996-3742-496a-bc06-206fa86cefa2\") " Jun 14 15:00:07.359289 ip-10-0-129-116 kubenswrapper[2546]: I0614 15:00:07.359255 2546 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/06ab4996-3742-496a-bc06-206fa86cefa2-kube-api-access-mfbqq" (OuterVolumeSpecName: "kube-api-access-mfbqq") pod "06ab4996-3742-496a-bc06-206fa86cefa2" (UID: "06ab4996-3742-496a-bc06-206fa86cefa2"). InnerVolumeSpecName "kube-api-access-mfbqq". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 14 15:00:07.458050 ip-10-0-129-116 kubenswrapper[2546]: I0614 15:00:07.457968 2546 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-mfbqq\" (UniqueName: \"kubernetes.io/projected/06ab4996-3742-496a-bc06-206fa86cefa2-kube-api-access-mfbqq\") on node \"ip-10-0-129-116.ec2.internal\" DevicePath \"\"" Jun 14 15:00:08.153620 ip-10-0-129-116 kubenswrapper[2546]: I0614 15:00:08.153589 2546 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-key-cleanup-29690820-hdtxp" event={"ID":"06ab4996-3742-496a-bc06-206fa86cefa2","Type":"ContainerDied","Data":"f40eef9df141f0cb2cf52dd7b33f27283193e328bfc7183a279a2c91b930af8d"} Jun 14 15:00:08.153796 ip-10-0-129-116 kubenswrapper[2546]: I0614 15:00:08.153642 2546 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="f40eef9df141f0cb2cf52dd7b33f27283193e328bfc7183a279a2c91b930af8d" Jun 14 15:00:08.153796 ip-10-0-129-116 kubenswrapper[2546]: I0614 15:00:08.153600 2546 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-key-cleanup-29690820-hdtxp" Jun 14 15:00:14.770242 ip-10-0-129-116 kubenswrapper[2546]: I0614 15:00:14.770210 2546 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c96gx_105377da-c223-41ad-b033-546cb01239c4/konnectivity-agent/0.log" limit=1024 Jun 14 15:00:20.561386 ip-10-0-129-116 kubenswrapper[2546]: I0614 15:00:20.561345 2546 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c96gx_105377da-c223-41ad-b033-546cb01239c4/konnectivity-agent/0.log" limit=1024 Jun 14 15:00:20.624959 ip-10-0-129-116 kubenswrapper[2546]: I0614 15:00:20.624922 2546 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c96gx_105377da-c223-41ad-b033-546cb01239c4/konnectivity-agent/0.log" limit=1024 Jun 14 15:00:20.696280 ip-10-0-129-116 kubenswrapper[2546]: I0614 15:00:20.696249 2546 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c96gx_105377da-c223-41ad-b033-546cb01239c4/konnectivity-agent/0.log" limit=1024 Jun 14 15:00:20.793683 ip-10-0-129-116 kubenswrapper[2546]: I0614 15:00:20.793649 2546 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c96gx_105377da-c223-41ad-b033-546cb01239c4/konnectivity-agent/0.log" limit=1024 Jun 14 15:00:20.916215 ip-10-0-129-116 kubenswrapper[2546]: I0614 15:00:20.916187 2546 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c96gx_105377da-c223-41ad-b033-546cb01239c4/konnectivity-agent/0.log" limit=1024 Jun 14 15:00:21.016753 ip-10-0-129-116 kubenswrapper[2546]: I0614 15:00:21.016722 2546 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c96gx_105377da-c223-41ad-b033-546cb01239c4/konnectivity-agent/0.log" limit=1024 Jun 14 15:00:37.569344 ip-10-0-129-116 kubenswrapper[2546]: I0614 15:00:37.569308 2546 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c96gx_105377da-c223-41ad-b033-546cb01239c4/konnectivity-agent/0.log" limit=1024 Jun 14 15:00:37.678754 ip-10-0-129-116 kubenswrapper[2546]: I0614 15:00:37.678723 2546 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c96gx_105377da-c223-41ad-b033-546cb01239c4/konnectivity-agent/0.log" limit=1024 Jun 14 15:00:37.791350 ip-10-0-129-116 kubenswrapper[2546]: I0614 15:00:37.791320 2546 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c96gx_105377da-c223-41ad-b033-546cb01239c4/konnectivity-agent/0.log" limit=1024 Jun 14 15:00:43.441964 ip-10-0-129-116 kubenswrapper[2546]: I0614 15:00:43.441930 2546 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c96gx_105377da-c223-41ad-b033-546cb01239c4/konnectivity-agent/0.log" limit=1024 Jun 14 15:00:43.499587 ip-10-0-129-116 kubenswrapper[2546]: I0614 15:00:43.499555 2546 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c96gx_105377da-c223-41ad-b033-546cb01239c4/konnectivity-agent/0.log" limit=1024 Jun 14 15:00:51.602778 ip-10-0-129-116 kubenswrapper[2546]: I0614 15:00:51.602731 2546 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c96gx_105377da-c223-41ad-b033-546cb01239c4/konnectivity-agent/0.log" limit=1024 Jun 14 15:00:51.700412 ip-10-0-129-116 kubenswrapper[2546]: I0614 15:00:51.700372 2546 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c96gx_105377da-c223-41ad-b033-546cb01239c4/konnectivity-agent/0.log" limit=1024 Jun 14 15:00:51.800627 ip-10-0-129-116 kubenswrapper[2546]: I0614 15:00:51.800589 2546 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c96gx_105377da-c223-41ad-b033-546cb01239c4/konnectivity-agent/0.log" limit=1024 Jun 14 15:00:51.900500 ip-10-0-129-116 kubenswrapper[2546]: I0614 15:00:51.900460 2546 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c96gx_105377da-c223-41ad-b033-546cb01239c4/konnectivity-agent/0.log" limit=1024 Jun 14 15:01:08.424458 ip-10-0-129-116 kubenswrapper[2546]: I0614 15:01:08.424419 2546 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c96gx_105377da-c223-41ad-b033-546cb01239c4/konnectivity-agent/0.log" limit=1024 Jun 14 15:01:08.534203 ip-10-0-129-116 kubenswrapper[2546]: I0614 15:01:08.534168 2546 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c96gx_105377da-c223-41ad-b033-546cb01239c4/konnectivity-agent/0.log" limit=1024 Jun 14 15:01:08.643996 ip-10-0-129-116 kubenswrapper[2546]: I0614 15:01:08.643965 2546 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c96gx_105377da-c223-41ad-b033-546cb01239c4/konnectivity-agent/0.log" limit=1024 Jun 14 15:01:14.662415 ip-10-0-129-116 kubenswrapper[2546]: I0614 15:01:14.662380 2546 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c96gx_105377da-c223-41ad-b033-546cb01239c4/konnectivity-agent/0.log" limit=1024 Jun 14 15:01:14.719684 ip-10-0-129-116 kubenswrapper[2546]: I0614 15:01:14.719657 2546 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c96gx_105377da-c223-41ad-b033-546cb01239c4/konnectivity-agent/0.log" limit=1024 Jun 14 15:01:29.693997 ip-10-0-129-116 kubenswrapper[2546]: I0614 15:01:29.693964 2546 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c96gx_105377da-c223-41ad-b033-546cb01239c4/konnectivity-agent/0.log" limit=1024 Jun 14 15:01:30.743796 ip-10-0-129-116 kubenswrapper[2546]: I0614 15:01:30.743757 2546 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c96gx_105377da-c223-41ad-b033-546cb01239c4/konnectivity-agent/0.log" limit=1024 Jun 14 15:01:30.844341 ip-10-0-129-116 kubenswrapper[2546]: I0614 15:01:30.844311 2546 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c96gx_105377da-c223-41ad-b033-546cb01239c4/konnectivity-agent/0.log" limit=1024 Jun 14 15:01:30.941149 ip-10-0-129-116 kubenswrapper[2546]: I0614 15:01:30.941113 2546 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c96gx_105377da-c223-41ad-b033-546cb01239c4/konnectivity-agent/0.log" limit=1024 Jun 14 15:01:36.752034 ip-10-0-129-116 kubenswrapper[2546]: I0614 15:01:36.751956 2546 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c96gx_105377da-c223-41ad-b033-546cb01239c4/konnectivity-agent/0.log" limit=1024 Jun 14 15:01:36.814508 ip-10-0-129-116 kubenswrapper[2546]: I0614 15:01:36.814477 2546 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c96gx_105377da-c223-41ad-b033-546cb01239c4/konnectivity-agent/0.log" limit=1024 Jun 14 15:01:36.917074 ip-10-0-129-116 kubenswrapper[2546]: I0614 15:01:36.917043 2546 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c96gx_105377da-c223-41ad-b033-546cb01239c4/konnectivity-agent/0.log" limit=1024 Jun 14 15:01:37.008202 ip-10-0-129-116 kubenswrapper[2546]: I0614 15:01:37.008107 2546 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c96gx_105377da-c223-41ad-b033-546cb01239c4/konnectivity-agent/0.log" limit=1024 Jun 14 15:01:37.108240 ip-10-0-129-116 kubenswrapper[2546]: I0614 15:01:37.108206 2546 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c96gx_105377da-c223-41ad-b033-546cb01239c4/konnectivity-agent/0.log" limit=1024 Jun 14 15:01:42.822243 ip-10-0-129-116 kubenswrapper[2546]: I0614 15:01:42.822210 2546 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c96gx_105377da-c223-41ad-b033-546cb01239c4/konnectivity-agent/0.log" limit=1024 Jun 14 15:01:42.880492 ip-10-0-129-116 kubenswrapper[2546]: I0614 15:01:42.880458 2546 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c96gx_105377da-c223-41ad-b033-546cb01239c4/konnectivity-agent/0.log" limit=1024 Jun 14 15:02:51.318525 ip-10-0-129-116 kubenswrapper[2546]: I0614 15:02:51.318488 2546 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c96gx_105377da-c223-41ad-b033-546cb01239c4/konnectivity-agent/0.log" limit=1024 Jun 14 15:03:04.429511 ip-10-0-129-116 kubenswrapper[2546]: I0614 15:03:04.429480 2546 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c96gx_105377da-c223-41ad-b033-546cb01239c4/konnectivity-agent/0.log" limit=1024 Jun 14 15:03:20.396864 ip-10-0-129-116 kubenswrapper[2546]: I0614 15:03:20.396758 2546 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c96gx_105377da-c223-41ad-b033-546cb01239c4/konnectivity-agent/0.log" limit=1024 Jun 14 15:03:20.498619 ip-10-0-129-116 kubenswrapper[2546]: I0614 15:03:20.498568 2546 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c96gx_105377da-c223-41ad-b033-546cb01239c4/konnectivity-agent/0.log" limit=1024 Jun 14 15:03:43.344738 ip-10-0-129-116 kubenswrapper[2546]: I0614 15:03:43.344703 2546 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c96gx_105377da-c223-41ad-b033-546cb01239c4/konnectivity-agent/0.log" limit=1024 Jun 14 15:03:43.730787 ip-10-0-129-116 kubenswrapper[2546]: I0614 15:03:43.730752 2546 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c96gx_105377da-c223-41ad-b033-546cb01239c4/konnectivity-agent/0.log" limit=1024 Jun 14 15:03:43.828061 ip-10-0-129-116 kubenswrapper[2546]: I0614 15:03:43.828027 2546 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c96gx_105377da-c223-41ad-b033-546cb01239c4/konnectivity-agent/0.log" limit=1024 Jun 14 15:08:40.664046 ip-10-0-129-116 kubenswrapper[2546]: I0614 15:08:40.664013 2546 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c96gx_105377da-c223-41ad-b033-546cb01239c4/konnectivity-agent/0.log" limit=1024 Jun 14 15:10:09.262562 ip-10-0-129-116 kubenswrapper[2546]: I0614 15:10:09.262525 2546 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c96gx_105377da-c223-41ad-b033-546cb01239c4/konnectivity-agent/0.log" limit=1024 Jun 14 15:10:09.362895 ip-10-0-129-116 kubenswrapper[2546]: I0614 15:10:09.362865 2546 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c96gx_105377da-c223-41ad-b033-546cb01239c4/konnectivity-agent/0.log" limit=1024 Jun 14 15:12:24.728705 ip-10-0-129-116 kubenswrapper[2546]: I0614 15:12:24.728619 2546 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c96gx_105377da-c223-41ad-b033-546cb01239c4/konnectivity-agent/0.log" limit=1024 Jun 14 15:12:24.815509 ip-10-0-129-116 kubenswrapper[2546]: I0614 15:12:24.815478 2546 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c96gx_105377da-c223-41ad-b033-546cb01239c4/konnectivity-agent/0.log" limit=1024 Jun 14 15:16:47.937655 ip-10-0-129-116 kubenswrapper[2546]: I0614 15:16:47.937619 2546 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c96gx_105377da-c223-41ad-b033-546cb01239c4/konnectivity-agent/0.log" limit=1024 Jun 14 15:17:59.536372 ip-10-0-129-116 kubenswrapper[2546]: I0614 15:17:59.536329 2546 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c96gx_105377da-c223-41ad-b033-546cb01239c4/konnectivity-agent/0.log" limit=1024 Jun 14 15:18:03.542522 ip-10-0-129-116 kubenswrapper[2546]: I0614 15:18:03.542486 2546 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c96gx_105377da-c223-41ad-b033-546cb01239c4/konnectivity-agent/0.log" limit=1024 Jun 14 15:18:06.789978 ip-10-0-129-116 kubenswrapper[2546]: I0614 15:18:06.789893 2546 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c96gx_105377da-c223-41ad-b033-546cb01239c4/konnectivity-agent/0.log" limit=1024 Jun 14 15:18:31.049734 ip-10-0-129-116 kubenswrapper[2546]: I0614 15:18:31.049691 2546 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c96gx_105377da-c223-41ad-b033-546cb01239c4/konnectivity-agent/0.log" limit=1024 Jun 14 15:18:44.099391 ip-10-0-129-116 kubenswrapper[2546]: I0614 15:18:44.099351 2546 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c96gx_105377da-c223-41ad-b033-546cb01239c4/konnectivity-agent/0.log" limit=1024 Jun 14 15:18:45.784028 ip-10-0-129-116 kubenswrapper[2546]: I0614 15:18:45.783992 2546 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c96gx_105377da-c223-41ad-b033-546cb01239c4/konnectivity-agent/0.log" limit=1024 Jun 14 15:18:45.887972 ip-10-0-129-116 kubenswrapper[2546]: I0614 15:18:45.887932 2546 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c96gx_105377da-c223-41ad-b033-546cb01239c4/konnectivity-agent/0.log" limit=1024 Jun 14 15:18:45.987790 ip-10-0-129-116 kubenswrapper[2546]: I0614 15:18:45.987749 2546 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c96gx_105377da-c223-41ad-b033-546cb01239c4/konnectivity-agent/0.log" limit=1024 Jun 14 15:18:46.172526 ip-10-0-129-116 kubenswrapper[2546]: I0614 15:18:46.172493 2546 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/maas-api-e2e-ait-59aa0365-9bffb9d7c-hv4q9"] Jun 14 15:18:46.172864 ip-10-0-129-116 kubenswrapper[2546]: I0614 15:18:46.172851 2546 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="06ab4996-3742-496a-bc06-206fa86cefa2" containerName="cleanup" Jun 14 15:18:46.172915 ip-10-0-129-116 kubenswrapper[2546]: I0614 15:18:46.172866 2546 state_mem.go:107] "Deleted CPUSet assignment" podUID="06ab4996-3742-496a-bc06-206fa86cefa2" containerName="cleanup" Jun 14 15:18:46.172951 ip-10-0-129-116 kubenswrapper[2546]: I0614 15:18:46.172928 2546 memory_manager.go:368] "RemoveStaleState removing state" podUID="06ab4996-3742-496a-bc06-206fa86cefa2" containerName="cleanup" Jun 14 15:18:46.175940 ip-10-0-129-116 kubenswrapper[2546]: I0614 15:18:46.175920 2546 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-e2e-ait-59aa0365-9bffb9d7c-hv4q9" Jun 14 15:18:46.178630 ip-10-0-129-116 kubenswrapper[2546]: I0614 15:18:46.178608 2546 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-api-serving-cert\"" Jun 14 15:18:46.179755 ip-10-0-129-116 kubenswrapper[2546]: I0614 15:18:46.179734 2546 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-api-dockercfg-w886h\"" Jun 14 15:18:46.189648 ip-10-0-129-116 kubenswrapper[2546]: I0614 15:18:46.189623 2546 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-api-e2e-ait-59aa0365-9bffb9d7c-hv4q9"] Jun 14 15:18:46.220579 ip-10-0-129-116 kubenswrapper[2546]: I0614 15:18:46.219380 2546 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zm7vq\" (UniqueName: \"kubernetes.io/projected/c6193dae-2cc2-4fd6-957f-0306fba68130-kube-api-access-zm7vq\") pod \"maas-api-e2e-ait-59aa0365-9bffb9d7c-hv4q9\" (UID: \"c6193dae-2cc2-4fd6-957f-0306fba68130\") " pod="opendatahub/maas-api-e2e-ait-59aa0365-9bffb9d7c-hv4q9" Jun 14 15:18:46.220579 ip-10-0-129-116 kubenswrapper[2546]: I0614 15:18:46.219480 2546 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/c6193dae-2cc2-4fd6-957f-0306fba68130-openshift-service-ca\") pod \"maas-api-e2e-ait-59aa0365-9bffb9d7c-hv4q9\" (UID: \"c6193dae-2cc2-4fd6-957f-0306fba68130\") " pod="opendatahub/maas-api-e2e-ait-59aa0365-9bffb9d7c-hv4q9" Jun 14 15:18:46.220579 ip-10-0-129-116 kubenswrapper[2546]: I0614 15:18:46.219534 2546 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/c6193dae-2cc2-4fd6-957f-0306fba68130-maas-api-tls\") pod \"maas-api-e2e-ait-59aa0365-9bffb9d7c-hv4q9\" (UID: \"c6193dae-2cc2-4fd6-957f-0306fba68130\") " pod="opendatahub/maas-api-e2e-ait-59aa0365-9bffb9d7c-hv4q9" Jun 14 15:18:46.222683 ip-10-0-129-116 kubenswrapper[2546]: I0614 15:18:46.222641 2546 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c96gx_105377da-c223-41ad-b033-546cb01239c4/konnectivity-agent/0.log" limit=1024 Jun 14 15:18:46.320985 ip-10-0-129-116 kubenswrapper[2546]: I0614 15:18:46.320949 2546 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/c6193dae-2cc2-4fd6-957f-0306fba68130-openshift-service-ca\") pod \"maas-api-e2e-ait-59aa0365-9bffb9d7c-hv4q9\" (UID: \"c6193dae-2cc2-4fd6-957f-0306fba68130\") " pod="opendatahub/maas-api-e2e-ait-59aa0365-9bffb9d7c-hv4q9" Jun 14 15:18:46.321191 ip-10-0-129-116 kubenswrapper[2546]: I0614 15:18:46.320997 2546 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/c6193dae-2cc2-4fd6-957f-0306fba68130-maas-api-tls\") pod \"maas-api-e2e-ait-59aa0365-9bffb9d7c-hv4q9\" (UID: \"c6193dae-2cc2-4fd6-957f-0306fba68130\") " pod="opendatahub/maas-api-e2e-ait-59aa0365-9bffb9d7c-hv4q9" Jun 14 15:18:46.321191 ip-10-0-129-116 kubenswrapper[2546]: I0614 15:18:46.321044 2546 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zm7vq\" (UniqueName: \"kubernetes.io/projected/c6193dae-2cc2-4fd6-957f-0306fba68130-kube-api-access-zm7vq\") pod \"maas-api-e2e-ait-59aa0365-9bffb9d7c-hv4q9\" (UID: \"c6193dae-2cc2-4fd6-957f-0306fba68130\") " pod="opendatahub/maas-api-e2e-ait-59aa0365-9bffb9d7c-hv4q9" Jun 14 15:18:46.321911 ip-10-0-129-116 kubenswrapper[2546]: I0614 15:18:46.321884 2546 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/c6193dae-2cc2-4fd6-957f-0306fba68130-openshift-service-ca\") pod \"maas-api-e2e-ait-59aa0365-9bffb9d7c-hv4q9\" (UID: \"c6193dae-2cc2-4fd6-957f-0306fba68130\") " pod="opendatahub/maas-api-e2e-ait-59aa0365-9bffb9d7c-hv4q9" Jun 14 15:18:46.323382 ip-10-0-129-116 kubenswrapper[2546]: I0614 15:18:46.323363 2546 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/c6193dae-2cc2-4fd6-957f-0306fba68130-maas-api-tls\") pod \"maas-api-e2e-ait-59aa0365-9bffb9d7c-hv4q9\" (UID: \"c6193dae-2cc2-4fd6-957f-0306fba68130\") " pod="opendatahub/maas-api-e2e-ait-59aa0365-9bffb9d7c-hv4q9" Jun 14 15:18:46.330831 ip-10-0-129-116 kubenswrapper[2546]: I0614 15:18:46.330810 2546 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-zm7vq\" (UniqueName: \"kubernetes.io/projected/c6193dae-2cc2-4fd6-957f-0306fba68130-kube-api-access-zm7vq\") pod \"maas-api-e2e-ait-59aa0365-9bffb9d7c-hv4q9\" (UID: \"c6193dae-2cc2-4fd6-957f-0306fba68130\") " pod="opendatahub/maas-api-e2e-ait-59aa0365-9bffb9d7c-hv4q9" Jun 14 15:18:46.370603 ip-10-0-129-116 kubenswrapper[2546]: I0614 15:18:46.370563 2546 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c96gx_105377da-c223-41ad-b033-546cb01239c4/konnectivity-agent/0.log" limit=1024 Jun 14 15:18:46.476847 ip-10-0-129-116 kubenswrapper[2546]: I0614 15:18:46.476756 2546 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c96gx_105377da-c223-41ad-b033-546cb01239c4/konnectivity-agent/0.log" limit=1024 Jun 14 15:18:46.487838 ip-10-0-129-116 kubenswrapper[2546]: I0614 15:18:46.487811 2546 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-e2e-ait-59aa0365-9bffb9d7c-hv4q9" Jun 14 15:18:46.652912 ip-10-0-129-116 kubenswrapper[2546]: I0614 15:18:46.652887 2546 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-api-e2e-ait-59aa0365-9bffb9d7c-hv4q9"] Jun 14 15:18:46.654542 ip-10-0-129-116 kubenswrapper[2546]: W0614 15:18:46.654513 2546 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc6193dae_2cc2_4fd6_957f_0306fba68130.slice/crio-84ff369ee0480dadd4b2bf801c44d4bce59aacbcf0786f33a3e6995d3ce332b6 WatchSource:0}: Error finding container 84ff369ee0480dadd4b2bf801c44d4bce59aacbcf0786f33a3e6995d3ce332b6: Status 404 returned error can't find the container with id 84ff369ee0480dadd4b2bf801c44d4bce59aacbcf0786f33a3e6995d3ce332b6 Jun 14 15:18:46.655872 ip-10-0-129-116 kubenswrapper[2546]: I0614 15:18:46.655853 2546 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jun 14 15:18:46.691841 ip-10-0-129-116 kubenswrapper[2546]: I0614 15:18:46.691789 2546 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c96gx_105377da-c223-41ad-b033-546cb01239c4/konnectivity-agent/0.log" limit=1024 Jun 14 15:18:46.801161 ip-10-0-129-116 kubenswrapper[2546]: I0614 15:18:46.801043 2546 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c96gx_105377da-c223-41ad-b033-546cb01239c4/konnectivity-agent/0.log" limit=1024 Jun 14 15:18:46.903790 ip-10-0-129-116 kubenswrapper[2546]: I0614 15:18:46.903750 2546 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c96gx_105377da-c223-41ad-b033-546cb01239c4/konnectivity-agent/0.log" limit=1024 Jun 14 15:18:47.121296 ip-10-0-129-116 kubenswrapper[2546]: I0614 15:18:47.121208 2546 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-e2e-ait-59aa0365-9bffb9d7c-hv4q9" event={"ID":"c6193dae-2cc2-4fd6-957f-0306fba68130","Type":"ContainerStarted","Data":"84ff369ee0480dadd4b2bf801c44d4bce59aacbcf0786f33a3e6995d3ce332b6"} Jun 14 15:18:47.349930 ip-10-0-129-116 kubenswrapper[2546]: I0614 15:18:47.349890 2546 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c96gx_105377da-c223-41ad-b033-546cb01239c4/konnectivity-agent/0.log" limit=1024 Jun 14 15:18:47.933792 ip-10-0-129-116 kubenswrapper[2546]: I0614 15:18:47.933756 2546 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c96gx_105377da-c223-41ad-b033-546cb01239c4/konnectivity-agent/0.log" limit=1024 Jun 14 15:18:48.533840 ip-10-0-129-116 kubenswrapper[2546]: I0614 15:18:48.533797 2546 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c96gx_105377da-c223-41ad-b033-546cb01239c4/konnectivity-agent/0.log" limit=1024 Jun 14 15:18:49.134840 ip-10-0-129-116 kubenswrapper[2546]: I0614 15:18:49.134746 2546 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-e2e-ait-59aa0365-9bffb9d7c-hv4q9" event={"ID":"c6193dae-2cc2-4fd6-957f-0306fba68130","Type":"ContainerStarted","Data":"e230f003008140ef6ebfacd2121a00a99844b15f32fb893e048597b173cdd3f1"} Jun 14 15:18:49.135315 ip-10-0-129-116 kubenswrapper[2546]: I0614 15:18:49.134943 2546 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/maas-api-e2e-ait-59aa0365-9bffb9d7c-hv4q9" Jun 14 15:18:49.153047 ip-10-0-129-116 kubenswrapper[2546]: I0614 15:18:49.152995 2546 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/maas-api-e2e-ait-59aa0365-9bffb9d7c-hv4q9" podStartSLOduration=0.955379298 podStartE2EDuration="3.152979204s" totalImagesPullingTime="2.197599906s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-14 15:18:46 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-14 15:18:49.151449713 +0000 UTC m=+2366.479831875" watchObservedRunningTime="2026-06-14 15:18:49.152979204 +0000 UTC m=+2366.481361329" Jun 14 15:18:49.479840 ip-10-0-129-116 kubenswrapper[2546]: I0614 15:18:49.479776 2546 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c96gx_105377da-c223-41ad-b033-546cb01239c4/konnectivity-agent/0.log" limit=1024 Jun 14 15:18:49.729045 ip-10-0-129-116 kubenswrapper[2546]: I0614 15:18:49.728959 2546 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c96gx_105377da-c223-41ad-b033-546cb01239c4/konnectivity-agent/0.log" limit=1024 Jun 14 15:18:50.142409 ip-10-0-129-116 kubenswrapper[2546]: I0614 15:18:50.142321 2546 generic.go:356] "Generic (PLEG): container finished" podID="c6193dae-2cc2-4fd6-957f-0306fba68130" containerID="e230f003008140ef6ebfacd2121a00a99844b15f32fb893e048597b173cdd3f1" exitCode=1 Jun 14 15:18:50.142877 ip-10-0-129-116 kubenswrapper[2546]: I0614 15:18:50.142414 2546 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-e2e-ait-59aa0365-9bffb9d7c-hv4q9" event={"ID":"c6193dae-2cc2-4fd6-957f-0306fba68130","Type":"ContainerDied","Data":"e230f003008140ef6ebfacd2121a00a99844b15f32fb893e048597b173cdd3f1"} Jun 14 15:18:50.142877 ip-10-0-129-116 kubenswrapper[2546]: I0614 15:18:50.142726 2546 scope.go:117] "RemoveContainer" containerID="e230f003008140ef6ebfacd2121a00a99844b15f32fb893e048597b173cdd3f1" Jun 14 15:18:50.330041 ip-10-0-129-116 kubenswrapper[2546]: I0614 15:18:50.329999 2546 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c96gx_105377da-c223-41ad-b033-546cb01239c4/konnectivity-agent/0.log" limit=1024 Jun 14 15:18:50.926238 ip-10-0-129-116 kubenswrapper[2546]: I0614 15:18:50.926198 2546 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c96gx_105377da-c223-41ad-b033-546cb01239c4/konnectivity-agent/0.log" limit=1024 Jun 14 15:18:51.150106 ip-10-0-129-116 kubenswrapper[2546]: I0614 15:18:51.150068 2546 generic.go:356] "Generic (PLEG): container finished" podID="c6193dae-2cc2-4fd6-957f-0306fba68130" containerID="b18fc2882e266e15d5ccf1dbf7403715424519d9fc24c2b2df804e9d11b42a29" exitCode=1 Jun 14 15:18:51.150544 ip-10-0-129-116 kubenswrapper[2546]: I0614 15:18:51.150158 2546 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-e2e-ait-59aa0365-9bffb9d7c-hv4q9" event={"ID":"c6193dae-2cc2-4fd6-957f-0306fba68130","Type":"ContainerDied","Data":"b18fc2882e266e15d5ccf1dbf7403715424519d9fc24c2b2df804e9d11b42a29"} Jun 14 15:18:51.150544 ip-10-0-129-116 kubenswrapper[2546]: I0614 15:18:51.150228 2546 scope.go:117] "RemoveContainer" containerID="e230f003008140ef6ebfacd2121a00a99844b15f32fb893e048597b173cdd3f1" Jun 14 15:18:51.150544 ip-10-0-129-116 kubenswrapper[2546]: I0614 15:18:51.150390 2546 scope.go:117] "RemoveContainer" containerID="b18fc2882e266e15d5ccf1dbf7403715424519d9fc24c2b2df804e9d11b42a29" Jun 14 15:18:51.150679 ip-10-0-129-116 kubenswrapper[2546]: E0614 15:18:51.150595 2546 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"maas-api\" with CrashLoopBackOff: \"back-off 10s restarting failed container=maas-api pod=maas-api-e2e-ait-59aa0365-9bffb9d7c-hv4q9_opendatahub(c6193dae-2cc2-4fd6-957f-0306fba68130)\"" pod="opendatahub/maas-api-e2e-ait-59aa0365-9bffb9d7c-hv4q9" podUID="c6193dae-2cc2-4fd6-957f-0306fba68130" Jun 14 15:18:52.032036 ip-10-0-129-116 kubenswrapper[2546]: I0614 15:18:52.031993 2546 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c96gx_105377da-c223-41ad-b033-546cb01239c4/konnectivity-agent/0.log" limit=1024 Jun 14 15:18:52.157992 ip-10-0-129-116 kubenswrapper[2546]: I0614 15:18:52.157958 2546 scope.go:117] "RemoveContainer" containerID="b18fc2882e266e15d5ccf1dbf7403715424519d9fc24c2b2df804e9d11b42a29" Jun 14 15:18:52.158470 ip-10-0-129-116 kubenswrapper[2546]: E0614 15:18:52.158231 2546 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"maas-api\" with CrashLoopBackOff: \"back-off 10s restarting failed container=maas-api pod=maas-api-e2e-ait-59aa0365-9bffb9d7c-hv4q9_opendatahub(c6193dae-2cc2-4fd6-957f-0306fba68130)\"" pod="opendatahub/maas-api-e2e-ait-59aa0365-9bffb9d7c-hv4q9" podUID="c6193dae-2cc2-4fd6-957f-0306fba68130" Jun 14 15:18:52.206046 ip-10-0-129-116 kubenswrapper[2546]: I0614 15:18:52.206015 2546 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c96gx_105377da-c223-41ad-b033-546cb01239c4/konnectivity-agent/0.log" limit=1024 Jun 14 15:18:52.311323 ip-10-0-129-116 kubenswrapper[2546]: I0614 15:18:52.311233 2546 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c96gx_105377da-c223-41ad-b033-546cb01239c4/konnectivity-agent/0.log" limit=1024 Jun 14 15:18:54.135149 ip-10-0-129-116 kubenswrapper[2546]: I0614 15:18:54.135118 2546 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/maas-api-e2e-ait-59aa0365-9bffb9d7c-hv4q9" Jun 14 15:18:54.135626 ip-10-0-129-116 kubenswrapper[2546]: I0614 15:18:54.135607 2546 scope.go:117] "RemoveContainer" containerID="b18fc2882e266e15d5ccf1dbf7403715424519d9fc24c2b2df804e9d11b42a29" Jun 14 15:18:54.135889 ip-10-0-129-116 kubenswrapper[2546]: E0614 15:18:54.135864 2546 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"maas-api\" with CrashLoopBackOff: \"back-off 10s restarting failed container=maas-api pod=maas-api-e2e-ait-59aa0365-9bffb9d7c-hv4q9_opendatahub(c6193dae-2cc2-4fd6-957f-0306fba68130)\"" pod="opendatahub/maas-api-e2e-ait-59aa0365-9bffb9d7c-hv4q9" podUID="c6193dae-2cc2-4fd6-957f-0306fba68130" Jun 14 15:18:54.359345 ip-10-0-129-116 kubenswrapper[2546]: I0614 15:18:54.359309 2546 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c96gx_105377da-c223-41ad-b033-546cb01239c4/konnectivity-agent/0.log" limit=1024 Jun 14 15:18:56.488938 ip-10-0-129-116 kubenswrapper[2546]: I0614 15:18:56.488891 2546 kubelet.go:2654] "SyncLoop (probe)" probe="liveness" status="unhealthy" pod="opendatahub/maas-api-e2e-ait-59aa0365-9bffb9d7c-hv4q9" Jun 14 15:18:56.489343 ip-10-0-129-116 kubenswrapper[2546]: I0614 15:18:56.489321 2546 scope.go:117] "RemoveContainer" containerID="b18fc2882e266e15d5ccf1dbf7403715424519d9fc24c2b2df804e9d11b42a29" Jun 14 15:18:56.489517 ip-10-0-129-116 kubenswrapper[2546]: E0614 15:18:56.489499 2546 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"maas-api\" with CrashLoopBackOff: \"back-off 10s restarting failed container=maas-api pod=maas-api-e2e-ait-59aa0365-9bffb9d7c-hv4q9_opendatahub(c6193dae-2cc2-4fd6-957f-0306fba68130)\"" pod="opendatahub/maas-api-e2e-ait-59aa0365-9bffb9d7c-hv4q9" podUID="c6193dae-2cc2-4fd6-957f-0306fba68130" Jun 14 15:18:58.097625 ip-10-0-129-116 kubenswrapper[2546]: I0614 15:18:58.097585 2546 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c96gx_105377da-c223-41ad-b033-546cb01239c4/konnectivity-agent/0.log" limit=1024 Jun 14 15:18:58.203793 ip-10-0-129-116 kubenswrapper[2546]: I0614 15:18:58.203754 2546 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c96gx_105377da-c223-41ad-b033-546cb01239c4/konnectivity-agent/0.log" limit=1024 Jun 14 15:18:58.316301 ip-10-0-129-116 kubenswrapper[2546]: I0614 15:18:58.316268 2546 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c96gx_105377da-c223-41ad-b033-546cb01239c4/konnectivity-agent/0.log" limit=1024 Jun 14 15:18:58.417963 ip-10-0-129-116 kubenswrapper[2546]: I0614 15:18:58.417921 2546 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c96gx_105377da-c223-41ad-b033-546cb01239c4/konnectivity-agent/0.log" limit=1024 Jun 14 15:18:58.552237 ip-10-0-129-116 kubenswrapper[2546]: I0614 15:18:58.552191 2546 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c96gx_105377da-c223-41ad-b033-546cb01239c4/konnectivity-agent/0.log" limit=1024 Jun 14 15:18:58.646695 ip-10-0-129-116 kubenswrapper[2546]: I0614 15:18:58.646659 2546 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c96gx_105377da-c223-41ad-b033-546cb01239c4/konnectivity-agent/0.log" limit=1024 Jun 14 15:18:58.791578 ip-10-0-129-116 kubenswrapper[2546]: I0614 15:18:58.791491 2546 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c96gx_105377da-c223-41ad-b033-546cb01239c4/konnectivity-agent/0.log" limit=1024 Jun 14 15:18:58.987474 ip-10-0-129-116 kubenswrapper[2546]: I0614 15:18:58.987438 2546 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c96gx_105377da-c223-41ad-b033-546cb01239c4/konnectivity-agent/0.log" limit=1024 Jun 14 15:18:59.153426 ip-10-0-129-116 kubenswrapper[2546]: I0614 15:18:59.153396 2546 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c96gx_105377da-c223-41ad-b033-546cb01239c4/konnectivity-agent/0.log" limit=1024 Jun 14 15:18:59.252935 ip-10-0-129-116 kubenswrapper[2546]: I0614 15:18:59.252896 2546 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c96gx_105377da-c223-41ad-b033-546cb01239c4/konnectivity-agent/0.log" limit=1024 Jun 14 15:18:59.373059 ip-10-0-129-116 kubenswrapper[2546]: I0614 15:18:59.373021 2546 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c96gx_105377da-c223-41ad-b033-546cb01239c4/konnectivity-agent/0.log" limit=1024 Jun 14 15:18:59.779054 ip-10-0-129-116 kubenswrapper[2546]: I0614 15:18:59.779011 2546 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c96gx_105377da-c223-41ad-b033-546cb01239c4/konnectivity-agent/0.log" limit=1024 Jun 14 15:19:00.381711 ip-10-0-129-116 kubenswrapper[2546]: I0614 15:19:00.381673 2546 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c96gx_105377da-c223-41ad-b033-546cb01239c4/konnectivity-agent/0.log" limit=1024 Jun 14 15:19:00.977943 ip-10-0-129-116 kubenswrapper[2546]: I0614 15:19:00.977909 2546 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c96gx_105377da-c223-41ad-b033-546cb01239c4/konnectivity-agent/0.log" limit=1024 Jun 14 15:19:01.580919 ip-10-0-129-116 kubenswrapper[2546]: I0614 15:19:01.580885 2546 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c96gx_105377da-c223-41ad-b033-546cb01239c4/konnectivity-agent/0.log" limit=1024 Jun 14 15:19:01.811947 ip-10-0-129-116 kubenswrapper[2546]: I0614 15:19:01.811901 2546 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c96gx_105377da-c223-41ad-b033-546cb01239c4/konnectivity-agent/0.log" limit=1024 Jun 14 15:19:02.178024 ip-10-0-129-116 kubenswrapper[2546]: I0614 15:19:02.177986 2546 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c96gx_105377da-c223-41ad-b033-546cb01239c4/konnectivity-agent/0.log" limit=1024 Jun 14 15:19:02.786952 ip-10-0-129-116 kubenswrapper[2546]: I0614 15:19:02.786916 2546 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c96gx_105377da-c223-41ad-b033-546cb01239c4/konnectivity-agent/0.log" limit=1024 Jun 14 15:19:04.563182 ip-10-0-129-116 kubenswrapper[2546]: I0614 15:19:04.563150 2546 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c96gx_105377da-c223-41ad-b033-546cb01239c4/konnectivity-agent/0.log" limit=1024 Jun 14 15:19:05.722332 ip-10-0-129-116 kubenswrapper[2546]: I0614 15:19:05.722298 2546 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c96gx_105377da-c223-41ad-b033-546cb01239c4/konnectivity-agent/0.log" limit=1024 Jun 14 15:19:05.822323 ip-10-0-129-116 kubenswrapper[2546]: I0614 15:19:05.822288 2546 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c96gx_105377da-c223-41ad-b033-546cb01239c4/konnectivity-agent/0.log" limit=1024 Jun 14 15:19:07.184485 ip-10-0-129-116 kubenswrapper[2546]: I0614 15:19:07.184457 2546 scope.go:117] "RemoveContainer" containerID="b18fc2882e266e15d5ccf1dbf7403715424519d9fc24c2b2df804e9d11b42a29" Jun 14 15:19:08.241072 ip-10-0-129-116 kubenswrapper[2546]: I0614 15:19:08.240988 2546 generic.go:356] "Generic (PLEG): container finished" podID="c6193dae-2cc2-4fd6-957f-0306fba68130" containerID="5c3209a4f6917b836035739f1363971cd9bca2c626281bfbb9a2f1a8319987be" exitCode=1 Jun 14 15:19:08.241481 ip-10-0-129-116 kubenswrapper[2546]: I0614 15:19:08.241071 2546 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-e2e-ait-59aa0365-9bffb9d7c-hv4q9" event={"ID":"c6193dae-2cc2-4fd6-957f-0306fba68130","Type":"ContainerDied","Data":"5c3209a4f6917b836035739f1363971cd9bca2c626281bfbb9a2f1a8319987be"} Jun 14 15:19:08.241481 ip-10-0-129-116 kubenswrapper[2546]: I0614 15:19:08.241170 2546 scope.go:117] "RemoveContainer" containerID="b18fc2882e266e15d5ccf1dbf7403715424519d9fc24c2b2df804e9d11b42a29" Jun 14 15:19:08.241481 ip-10-0-129-116 kubenswrapper[2546]: I0614 15:19:08.241460 2546 scope.go:117] "RemoveContainer" containerID="5c3209a4f6917b836035739f1363971cd9bca2c626281bfbb9a2f1a8319987be" Jun 14 15:19:08.241671 ip-10-0-129-116 kubenswrapper[2546]: E0614 15:19:08.241653 2546 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"maas-api\" with CrashLoopBackOff: \"back-off 20s restarting failed container=maas-api pod=maas-api-e2e-ait-59aa0365-9bffb9d7c-hv4q9_opendatahub(c6193dae-2cc2-4fd6-957f-0306fba68130)\"" pod="opendatahub/maas-api-e2e-ait-59aa0365-9bffb9d7c-hv4q9" podUID="c6193dae-2cc2-4fd6-957f-0306fba68130" Jun 14 15:19:09.135813 ip-10-0-129-116 kubenswrapper[2546]: I0614 15:19:09.135768 2546 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/maas-api-e2e-ait-59aa0365-9bffb9d7c-hv4q9" Jun 14 15:19:09.147661 ip-10-0-129-116 kubenswrapper[2546]: I0614 15:19:09.147628 2546 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c96gx_105377da-c223-41ad-b033-546cb01239c4/konnectivity-agent/0.log" limit=1024 Jun 14 15:19:09.248593 ip-10-0-129-116 kubenswrapper[2546]: I0614 15:19:09.248559 2546 scope.go:117] "RemoveContainer" containerID="5c3209a4f6917b836035739f1363971cd9bca2c626281bfbb9a2f1a8319987be" Jun 14 15:19:09.249058 ip-10-0-129-116 kubenswrapper[2546]: E0614 15:19:09.248787 2546 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"maas-api\" with CrashLoopBackOff: \"back-off 20s restarting failed container=maas-api pod=maas-api-e2e-ait-59aa0365-9bffb9d7c-hv4q9_opendatahub(c6193dae-2cc2-4fd6-957f-0306fba68130)\"" pod="opendatahub/maas-api-e2e-ait-59aa0365-9bffb9d7c-hv4q9" podUID="c6193dae-2cc2-4fd6-957f-0306fba68130" Jun 14 15:19:11.530938 ip-10-0-129-116 kubenswrapper[2546]: I0614 15:19:11.530902 2546 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c96gx_105377da-c223-41ad-b033-546cb01239c4/konnectivity-agent/0.log" limit=1024 Jun 14 15:19:11.628342 ip-10-0-129-116 kubenswrapper[2546]: I0614 15:19:11.628299 2546 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c96gx_105377da-c223-41ad-b033-546cb01239c4/konnectivity-agent/0.log" limit=1024 Jun 14 15:19:16.488861 ip-10-0-129-116 kubenswrapper[2546]: I0614 15:19:16.488827 2546 kubelet.go:2654] "SyncLoop (probe)" probe="liveness" status="unhealthy" pod="opendatahub/maas-api-e2e-ait-59aa0365-9bffb9d7c-hv4q9" Jun 14 15:19:16.489275 ip-10-0-129-116 kubenswrapper[2546]: I0614 15:19:16.489227 2546 scope.go:117] "RemoveContainer" containerID="5c3209a4f6917b836035739f1363971cd9bca2c626281bfbb9a2f1a8319987be" Jun 14 15:19:16.489430 ip-10-0-129-116 kubenswrapper[2546]: E0614 15:19:16.489410 2546 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"maas-api\" with CrashLoopBackOff: \"back-off 20s restarting failed container=maas-api pod=maas-api-e2e-ait-59aa0365-9bffb9d7c-hv4q9_opendatahub(c6193dae-2cc2-4fd6-957f-0306fba68130)\"" pod="opendatahub/maas-api-e2e-ait-59aa0365-9bffb9d7c-hv4q9" podUID="c6193dae-2cc2-4fd6-957f-0306fba68130" Jun 14 15:19:17.672974 ip-10-0-129-116 kubenswrapper[2546]: I0614 15:19:17.672941 2546 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-f7bcd5f76-44c94_5373ed97-4606-41ec-b706-ef0362e2f576/authorino/0.log" Jun 14 15:19:22.923639 ip-10-0-129-116 kubenswrapper[2546]: I0614 15:19:22.923606 2546 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_maas-api-e2e-ait-59aa0365-9bffb9d7c-hv4q9_c6193dae-2cc2-4fd6-957f-0306fba68130/maas-api/2.log" Jun 14 15:19:23.029807 ip-10-0-129-116 kubenswrapper[2546]: I0614 15:19:23.029774 2546 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_maas-api-key-cleanup-29690820-hdtxp_06ab4996-3742-496a-bc06-206fa86cefa2/cleanup/0.log" Jun 14 15:19:23.475153 ip-10-0-129-116 kubenswrapper[2546]: I0614 15:19:23.475119 2546 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_odh-model-controller-6dc94f689f-c2526_dee119e9-d2cf-46a4-8793-a2d830339670/manager/0.log" Jun 14 15:19:23.705438 ip-10-0-129-116 kubenswrapper[2546]: I0614 15:19:23.705413 2546 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-bc868665f-tfrtk_6c316188-d56b-4f56-8d5a-cf711ca84b06/copy-manifests/0.log" Jun 14 15:19:23.723020 ip-10-0-129-116 kubenswrapper[2546]: I0614 15:19:23.722991 2546 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-bc868665f-tfrtk_6c316188-d56b-4f56-8d5a-cf711ca84b06/manager/0.log" Jun 14 15:19:23.955384 ip-10-0-129-116 kubenswrapper[2546]: I0614 15:19:23.955334 2546 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_postgres-69fb4594cf-bvghj_cfa742eb-9643-49e7-b775-50f287d5fbdd/postgres/0.log" Jun 14 15:19:24.701873 ip-10-0-129-116 kubenswrapper[2546]: I0614 15:19:24.701840 2546 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7596l776_497bcfe0-8765-47d4-87c4-066499fefb27/util/0.log" Jun 14 15:19:24.707954 ip-10-0-129-116 kubenswrapper[2546]: I0614 15:19:24.707930 2546 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7596l776_497bcfe0-8765-47d4-87c4-066499fefb27/pull/0.log" Jun 14 15:19:24.714112 ip-10-0-129-116 kubenswrapper[2546]: I0614 15:19:24.714074 2546 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7596l776_497bcfe0-8765-47d4-87c4-066499fefb27/extract/0.log" Jun 14 15:19:24.823149 ip-10-0-129-116 kubenswrapper[2546]: I0614 15:19:24.823121 2546 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0v8gmr_42690162-7abb-4f31-9429-beb1e00464b7/pull/0.log" Jun 14 15:19:24.830202 ip-10-0-129-116 kubenswrapper[2546]: I0614 15:19:24.830181 2546 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0v8gmr_42690162-7abb-4f31-9429-beb1e00464b7/extract/0.log" Jun 14 15:19:24.836810 ip-10-0-129-116 kubenswrapper[2546]: I0614 15:19:24.836791 2546 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0v8gmr_42690162-7abb-4f31-9429-beb1e00464b7/util/0.log" Jun 14 15:19:24.947165 ip-10-0-129-116 kubenswrapper[2546]: I0614 15:19:24.947138 2546 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73pwqgn_4350f20c-1a09-46ff-a2ab-a88c955d8313/util/0.log" Jun 14 15:19:24.953791 ip-10-0-129-116 kubenswrapper[2546]: I0614 15:19:24.953724 2546 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73pwqgn_4350f20c-1a09-46ff-a2ab-a88c955d8313/pull/0.log" Jun 14 15:19:24.960336 ip-10-0-129-116 kubenswrapper[2546]: I0614 15:19:24.960313 2546 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73pwqgn_4350f20c-1a09-46ff-a2ab-a88c955d8313/extract/0.log" Jun 14 15:19:25.067258 ip-10-0-129-116 kubenswrapper[2546]: I0614 15:19:25.067229 2546 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef16cd9f_61ff73d0-331c-41dd-ac43-f90d22200a4f/util/0.log" Jun 14 15:19:25.073187 ip-10-0-129-116 kubenswrapper[2546]: I0614 15:19:25.073158 2546 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef16cd9f_61ff73d0-331c-41dd-ac43-f90d22200a4f/pull/0.log" Jun 14 15:19:25.078456 ip-10-0-129-116 kubenswrapper[2546]: I0614 15:19:25.078436 2546 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef16cd9f_61ff73d0-331c-41dd-ac43-f90d22200a4f/extract/0.log" Jun 14 15:19:25.198979 ip-10-0-129-116 kubenswrapper[2546]: I0614 15:19:25.198951 2546 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-f7bcd5f76-44c94_5373ed97-4606-41ec-b706-ef0362e2f576/authorino/0.log" Jun 14 15:19:25.535676 ip-10-0-129-116 kubenswrapper[2546]: I0614 15:19:25.535651 2546 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-console-plugin-66b5774985-pfzlt_7901c4c3-d3a4-4fc9-af27-f41ae5b989f9/kuadrant-console-plugin/0.log" Jun 14 15:19:26.677548 ip-10-0-129-116 kubenswrapper[2546]: I0614 15:19:26.677505 2546 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-798fd884dc-sfmg8_7f9b72d9-93ee-4abf-a191-211ea84592c2/kube-auth-proxy/0.log" Jun 14 15:19:27.139648 ip-10-0-129-116 kubenswrapper[2546]: I0614 15:19:27.139561 2546 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_router-default-5f9f5d888-dlm5r_14fb6e1b-853d-4107-b6b6-22d47cb7619c/router/0.log" Jun 14 15:19:27.184859 ip-10-0-129-116 kubenswrapper[2546]: I0614 15:19:27.184831 2546 scope.go:117] "RemoveContainer" containerID="5c3209a4f6917b836035739f1363971cd9bca2c626281bfbb9a2f1a8319987be" Jun 14 15:19:27.185044 ip-10-0-129-116 kubenswrapper[2546]: E0614 15:19:27.184985 2546 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"maas-api\" with CrashLoopBackOff: \"back-off 20s restarting failed container=maas-api pod=maas-api-e2e-ait-59aa0365-9bffb9d7c-hv4q9_opendatahub(c6193dae-2cc2-4fd6-957f-0306fba68130)\"" pod="opendatahub/maas-api-e2e-ait-59aa0365-9bffb9d7c-hv4q9" podUID="c6193dae-2cc2-4fd6-957f-0306fba68130" Jun 14 15:19:31.679037 ip-10-0-129-116 kubenswrapper[2546]: I0614 15:19:31.679004 2546 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-must-gather-n9rwp/must-gather-mxpsd"] Jun 14 15:19:31.682662 ip-10-0-129-116 kubenswrapper[2546]: I0614 15:19:31.682640 2546 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-n9rwp/must-gather-mxpsd" Jun 14 15:19:31.685853 ip-10-0-129-116 kubenswrapper[2546]: I0614 15:19:31.685826 2546 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-must-gather-n9rwp\"/\"default-dockercfg-6m4tx\"" Jun 14 15:19:31.685853 ip-10-0-129-116 kubenswrapper[2546]: I0614 15:19:31.685840 2546 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-n9rwp\"/\"kube-root-ca.crt\"" Jun 14 15:19:31.686897 ip-10-0-129-116 kubenswrapper[2546]: I0614 15:19:31.686877 2546 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-n9rwp\"/\"openshift-service-ca.crt\"" Jun 14 15:19:31.695938 ip-10-0-129-116 kubenswrapper[2546]: I0614 15:19:31.695915 2546 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-n9rwp/must-gather-mxpsd"] Jun 14 15:19:31.700541 ip-10-0-129-116 kubenswrapper[2546]: I0614 15:19:31.700514 2546 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c96gx_105377da-c223-41ad-b033-546cb01239c4/konnectivity-agent/0.log" limit=1024 Jun 14 15:19:31.701474 ip-10-0-129-116 kubenswrapper[2546]: I0614 15:19:31.701450 2546 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-nm94d\" (UniqueName: \"kubernetes.io/projected/d5adb2de-4038-45fb-bf08-4463a041e395-kube-api-access-nm94d\") pod \"must-gather-mxpsd\" (UID: \"d5adb2de-4038-45fb-bf08-4463a041e395\") " pod="openshift-must-gather-n9rwp/must-gather-mxpsd" Jun 14 15:19:31.701584 ip-10-0-129-116 kubenswrapper[2546]: I0614 15:19:31.701487 2546 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"must-gather-output\" (UniqueName: \"kubernetes.io/empty-dir/d5adb2de-4038-45fb-bf08-4463a041e395-must-gather-output\") pod \"must-gather-mxpsd\" (UID: \"d5adb2de-4038-45fb-bf08-4463a041e395\") " pod="openshift-must-gather-n9rwp/must-gather-mxpsd" Jun 14 15:19:31.799376 ip-10-0-129-116 kubenswrapper[2546]: I0614 15:19:31.799330 2546 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c96gx_105377da-c223-41ad-b033-546cb01239c4/konnectivity-agent/0.log" limit=1024 Jun 14 15:19:31.802387 ip-10-0-129-116 kubenswrapper[2546]: I0614 15:19:31.802366 2546 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-nm94d\" (UniqueName: \"kubernetes.io/projected/d5adb2de-4038-45fb-bf08-4463a041e395-kube-api-access-nm94d\") pod \"must-gather-mxpsd\" (UID: \"d5adb2de-4038-45fb-bf08-4463a041e395\") " pod="openshift-must-gather-n9rwp/must-gather-mxpsd" Jun 14 15:19:31.802451 ip-10-0-129-116 kubenswrapper[2546]: I0614 15:19:31.802401 2546 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"must-gather-output\" (UniqueName: \"kubernetes.io/empty-dir/d5adb2de-4038-45fb-bf08-4463a041e395-must-gather-output\") pod \"must-gather-mxpsd\" (UID: \"d5adb2de-4038-45fb-bf08-4463a041e395\") " pod="openshift-must-gather-n9rwp/must-gather-mxpsd" Jun 14 15:19:31.802706 ip-10-0-129-116 kubenswrapper[2546]: I0614 15:19:31.802691 2546 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"must-gather-output\" (UniqueName: \"kubernetes.io/empty-dir/d5adb2de-4038-45fb-bf08-4463a041e395-must-gather-output\") pod \"must-gather-mxpsd\" (UID: \"d5adb2de-4038-45fb-bf08-4463a041e395\") " pod="openshift-must-gather-n9rwp/must-gather-mxpsd" Jun 14 15:19:31.810666 ip-10-0-129-116 kubenswrapper[2546]: I0614 15:19:31.810643 2546 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-nm94d\" (UniqueName: \"kubernetes.io/projected/d5adb2de-4038-45fb-bf08-4463a041e395-kube-api-access-nm94d\") pod \"must-gather-mxpsd\" (UID: \"d5adb2de-4038-45fb-bf08-4463a041e395\") " pod="openshift-must-gather-n9rwp/must-gather-mxpsd" Jun 14 15:19:31.992460 ip-10-0-129-116 kubenswrapper[2546]: I0614 15:19:31.992385 2546 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-n9rwp/must-gather-mxpsd" Jun 14 15:19:32.127700 ip-10-0-129-116 kubenswrapper[2546]: I0614 15:19:32.127671 2546 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-n9rwp/must-gather-mxpsd"] Jun 14 15:19:32.129201 ip-10-0-129-116 kubenswrapper[2546]: W0614 15:19:32.129172 2546 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podd5adb2de_4038_45fb_bf08_4463a041e395.slice/crio-8afd2d09d37788362267a17fc460614503fb3e4d45d5648650fb00805c679f62 WatchSource:0}: Error finding container 8afd2d09d37788362267a17fc460614503fb3e4d45d5648650fb00805c679f62: Status 404 returned error can't find the container with id 8afd2d09d37788362267a17fc460614503fb3e4d45d5648650fb00805c679f62 Jun 14 15:19:32.374667 ip-10-0-129-116 kubenswrapper[2546]: I0614 15:19:32.374582 2546 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-n9rwp/must-gather-mxpsd" event={"ID":"d5adb2de-4038-45fb-bf08-4463a041e395","Type":"ContainerStarted","Data":"8afd2d09d37788362267a17fc460614503fb3e4d45d5648650fb00805c679f62"} Jun 14 15:19:33.382180 ip-10-0-129-116 kubenswrapper[2546]: I0614 15:19:33.382069 2546 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-n9rwp/must-gather-mxpsd" event={"ID":"d5adb2de-4038-45fb-bf08-4463a041e395","Type":"ContainerStarted","Data":"c967fbc6bf53353ef3de60fd831873df43addae5994382e9a5f56018ad701eb6"} Jun 14 15:19:33.382180 ip-10-0-129-116 kubenswrapper[2546]: I0614 15:19:33.382127 2546 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-n9rwp/must-gather-mxpsd" event={"ID":"d5adb2de-4038-45fb-bf08-4463a041e395","Type":"ContainerStarted","Data":"dea2bba8a2965584a58d81874542c850e3ab8bf8ea8a85947ffa829df617eb25"} Jun 14 15:19:33.398866 ip-10-0-129-116 kubenswrapper[2546]: I0614 15:19:33.398814 2546 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-must-gather-n9rwp/must-gather-mxpsd" podStartSLOduration=1.597978059 podStartE2EDuration="2.398798594s" totalImagesPullingTime="800.820535ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-14 15:19:31 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-14 15:19:33.396891405 +0000 UTC m=+2410.725273531" watchObservedRunningTime="2026-06-14 15:19:33.398798594 +0000 UTC m=+2410.727180718" Jun 14 15:19:34.729037 ip-10-0-129-116 kubenswrapper[2546]: I0614 15:19:34.729004 2546 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_global-pull-secret-syncer-dlk5b_6446f965-15fc-40d5-85e7-20cec0d42549/global-pull-secret-syncer/0.log" Jun 14 15:19:34.875681 ip-10-0-129-116 kubenswrapper[2546]: I0614 15:19:34.875652 2546 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_konnectivity-agent-c96gx_105377da-c223-41ad-b033-546cb01239c4/konnectivity-agent/0.log" Jun 14 15:19:34.973936 ip-10-0-129-116 kubenswrapper[2546]: I0614 15:19:34.973904 2546 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_kube-apiserver-proxy-ip-10-0-129-116.ec2.internal_b68f1280995218345affbc9fee0e8f68/haproxy/0.log" Jun 14 15:19:38.186013 ip-10-0-129-116 kubenswrapper[2546]: I0614 15:19:38.185932 2546 scope.go:117] "RemoveContainer" containerID="5c3209a4f6917b836035739f1363971cd9bca2c626281bfbb9a2f1a8319987be" Jun 14 15:19:39.434438 ip-10-0-129-116 kubenswrapper[2546]: I0614 15:19:39.434403 2546 generic.go:356] "Generic (PLEG): container finished" podID="c6193dae-2cc2-4fd6-957f-0306fba68130" containerID="e4a194568a14bf1170b6dd77c52d53d96448372edd2b4c7ae37c706e6980bea9" exitCode=1 Jun 14 15:19:39.435066 ip-10-0-129-116 kubenswrapper[2546]: I0614 15:19:39.435042 2546 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-e2e-ait-59aa0365-9bffb9d7c-hv4q9" event={"ID":"c6193dae-2cc2-4fd6-957f-0306fba68130","Type":"ContainerDied","Data":"e4a194568a14bf1170b6dd77c52d53d96448372edd2b4c7ae37c706e6980bea9"} Jun 14 15:19:39.435786 ip-10-0-129-116 kubenswrapper[2546]: I0614 15:19:39.435768 2546 scope.go:117] "RemoveContainer" containerID="5c3209a4f6917b836035739f1363971cd9bca2c626281bfbb9a2f1a8319987be" Jun 14 15:19:39.436283 ip-10-0-129-116 kubenswrapper[2546]: I0614 15:19:39.436262 2546 scope.go:117] "RemoveContainer" containerID="e4a194568a14bf1170b6dd77c52d53d96448372edd2b4c7ae37c706e6980bea9" Jun 14 15:19:39.436688 ip-10-0-129-116 kubenswrapper[2546]: E0614 15:19:39.436664 2546 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"maas-api\" with CrashLoopBackOff: \"back-off 40s restarting failed container=maas-api pod=maas-api-e2e-ait-59aa0365-9bffb9d7c-hv4q9_opendatahub(c6193dae-2cc2-4fd6-957f-0306fba68130)\"" pod="opendatahub/maas-api-e2e-ait-59aa0365-9bffb9d7c-hv4q9" podUID="c6193dae-2cc2-4fd6-957f-0306fba68130" Jun 14 15:19:39.819499 ip-10-0-129-116 kubenswrapper[2546]: I0614 15:19:39.819421 2546 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7596l776_497bcfe0-8765-47d4-87c4-066499fefb27/extract/0.log" Jun 14 15:19:39.848952 ip-10-0-129-116 kubenswrapper[2546]: I0614 15:19:39.848927 2546 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7596l776_497bcfe0-8765-47d4-87c4-066499fefb27/util/0.log" Jun 14 15:19:39.875668 ip-10-0-129-116 kubenswrapper[2546]: I0614 15:19:39.875631 2546 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7596l776_497bcfe0-8765-47d4-87c4-066499fefb27/pull/0.log" Jun 14 15:19:39.912102 ip-10-0-129-116 kubenswrapper[2546]: I0614 15:19:39.912062 2546 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0v8gmr_42690162-7abb-4f31-9429-beb1e00464b7/extract/0.log" Jun 14 15:19:39.940671 ip-10-0-129-116 kubenswrapper[2546]: I0614 15:19:39.940647 2546 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0v8gmr_42690162-7abb-4f31-9429-beb1e00464b7/util/0.log" Jun 14 15:19:39.969563 ip-10-0-129-116 kubenswrapper[2546]: I0614 15:19:39.969536 2546 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0v8gmr_42690162-7abb-4f31-9429-beb1e00464b7/pull/0.log" Jun 14 15:19:40.031433 ip-10-0-129-116 kubenswrapper[2546]: I0614 15:19:40.031398 2546 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73pwqgn_4350f20c-1a09-46ff-a2ab-a88c955d8313/extract/0.log" Jun 14 15:19:40.068653 ip-10-0-129-116 kubenswrapper[2546]: I0614 15:19:40.068628 2546 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73pwqgn_4350f20c-1a09-46ff-a2ab-a88c955d8313/util/0.log" Jun 14 15:19:40.101862 ip-10-0-129-116 kubenswrapper[2546]: I0614 15:19:40.101746 2546 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73pwqgn_4350f20c-1a09-46ff-a2ab-a88c955d8313/pull/0.log" Jun 14 15:19:40.139516 ip-10-0-129-116 kubenswrapper[2546]: I0614 15:19:40.139485 2546 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef16cd9f_61ff73d0-331c-41dd-ac43-f90d22200a4f/extract/0.log" Jun 14 15:19:40.164255 ip-10-0-129-116 kubenswrapper[2546]: I0614 15:19:40.164179 2546 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef16cd9f_61ff73d0-331c-41dd-ac43-f90d22200a4f/util/0.log" Jun 14 15:19:40.193342 ip-10-0-129-116 kubenswrapper[2546]: I0614 15:19:40.193318 2546 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef16cd9f_61ff73d0-331c-41dd-ac43-f90d22200a4f/pull/0.log" Jun 14 15:19:40.564114 ip-10-0-129-116 kubenswrapper[2546]: I0614 15:19:40.561393 2546 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-f7bcd5f76-44c94_5373ed97-4606-41ec-b706-ef0362e2f576/authorino/0.log" Jun 14 15:19:40.662155 ip-10-0-129-116 kubenswrapper[2546]: I0614 15:19:40.662126 2546 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-console-plugin-66b5774985-pfzlt_7901c4c3-d3a4-4fc9-af27-f41ae5b989f9/kuadrant-console-plugin/0.log" Jun 14 15:19:42.867473 ip-10-0-129-116 kubenswrapper[2546]: I0614 15:19:42.867435 2546 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_cluster-monitoring-operator-f9d7df769-5jzh2_3ede30b3-6f71-4b5c-a643-5efa6c254e1c/cluster-monitoring-operator/0.log" Jun 14 15:19:43.129167 ip-10-0-129-116 kubenswrapper[2546]: I0614 15:19:43.129063 2546 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-mbm5d_8efc0b45-a2ee-4407-b52b-7f4fb0c4d6cb/node-exporter/0.log" Jun 14 15:19:43.152814 ip-10-0-129-116 kubenswrapper[2546]: I0614 15:19:43.152780 2546 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-mbm5d_8efc0b45-a2ee-4407-b52b-7f4fb0c4d6cb/kube-rbac-proxy/0.log" Jun 14 15:19:43.177862 ip-10-0-129-116 kubenswrapper[2546]: I0614 15:19:43.177827 2546 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-mbm5d_8efc0b45-a2ee-4407-b52b-7f4fb0c4d6cb/init-textfile/0.log" Jun 14 15:19:43.295620 ip-10-0-129-116 kubenswrapper[2546]: I0614 15:19:43.295592 2546 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_openshift-state-metrics-6b8d965dd5-4m647_b8a545ef-5f76-4ebb-af51-b429428abc52/kube-rbac-proxy-main/0.log" Jun 14 15:19:43.321227 ip-10-0-129-116 kubenswrapper[2546]: I0614 15:19:43.321196 2546 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_openshift-state-metrics-6b8d965dd5-4m647_b8a545ef-5f76-4ebb-af51-b429428abc52/kube-rbac-proxy-self/0.log" Jun 14 15:19:43.349268 ip-10-0-129-116 kubenswrapper[2546]: I0614 15:19:43.349231 2546 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_openshift-state-metrics-6b8d965dd5-4m647_b8a545ef-5f76-4ebb-af51-b429428abc52/openshift-state-metrics/0.log" Jun 14 15:19:43.576609 ip-10-0-129-116 kubenswrapper[2546]: I0614 15:19:43.576571 2546 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-operator-864fcfc6f9-8w65j_0b7d171a-51f8-440e-bc4d-4f497cada312/prometheus-operator/0.log" Jun 14 15:19:43.641458 ip-10-0-129-116 kubenswrapper[2546]: I0614 15:19:43.641421 2546 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-operator-864fcfc6f9-8w65j_0b7d171a-51f8-440e-bc4d-4f497cada312/kube-rbac-proxy/0.log" Jun 14 15:19:43.699678 ip-10-0-129-116 kubenswrapper[2546]: I0614 15:19:43.699647 2546 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-operator-admission-webhook-5cf667749c-zr7bg_d5bc500a-d8b0-4cc9-9c14-87641d708038/prometheus-operator-admission-webhook/0.log" Jun 14 15:19:43.756907 ip-10-0-129-116 kubenswrapper[2546]: I0614 15:19:43.756870 2546 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_telemeter-client-699d54bcc-smhbl_79987e3c-bc52-4b02-a57d-5368e3e8e70a/telemeter-client/0.log" Jun 14 15:19:43.781087 ip-10-0-129-116 kubenswrapper[2546]: I0614 15:19:43.781056 2546 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_telemeter-client-699d54bcc-smhbl_79987e3c-bc52-4b02-a57d-5368e3e8e70a/reload/0.log" Jun 14 15:19:43.806802 ip-10-0-129-116 kubenswrapper[2546]: I0614 15:19:43.806777 2546 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_telemeter-client-699d54bcc-smhbl_79987e3c-bc52-4b02-a57d-5368e3e8e70a/kube-rbac-proxy/0.log" Jun 14 15:19:44.135390 ip-10-0-129-116 kubenswrapper[2546]: I0614 15:19:44.135357 2546 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/maas-api-e2e-ait-59aa0365-9bffb9d7c-hv4q9" Jun 14 15:19:44.136356 ip-10-0-129-116 kubenswrapper[2546]: I0614 15:19:44.136332 2546 scope.go:117] "RemoveContainer" containerID="e4a194568a14bf1170b6dd77c52d53d96448372edd2b4c7ae37c706e6980bea9" Jun 14 15:19:44.136995 ip-10-0-129-116 kubenswrapper[2546]: E0614 15:19:44.136967 2546 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"maas-api\" with CrashLoopBackOff: \"back-off 40s restarting failed container=maas-api pod=maas-api-e2e-ait-59aa0365-9bffb9d7c-hv4q9_opendatahub(c6193dae-2cc2-4fd6-957f-0306fba68130)\"" pod="opendatahub/maas-api-e2e-ait-59aa0365-9bffb9d7c-hv4q9" podUID="c6193dae-2cc2-4fd6-957f-0306fba68130" Jun 14 15:19:45.251123 ip-10-0-129-116 kubenswrapper[2546]: I0614 15:19:45.251073 2546 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-network-console_networking-console-plugin-867b76cb74-kq2p9_7ae514d0-80e9-44d6-b358-84e57fe9d353/networking-console-plugin/0.log" Jun 14 15:19:46.361411 ip-10-0-129-116 kubenswrapper[2546]: I0614 15:19:46.361374 2546 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-must-gather-n9rwp/perf-node-gather-daemonset-vkg5m"] Jun 14 15:19:46.370138 ip-10-0-129-116 kubenswrapper[2546]: I0614 15:19:46.370106 2546 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-n9rwp/perf-node-gather-daemonset-vkg5m" Jun 14 15:19:46.374142 ip-10-0-129-116 kubenswrapper[2546]: I0614 15:19:46.374108 2546 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-n9rwp/perf-node-gather-daemonset-vkg5m"] Jun 14 15:19:46.449487 ip-10-0-129-116 kubenswrapper[2546]: I0614 15:19:46.449411 2546 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/8cdf80b0-4dc3-4da4-b183-c8e090674859-lib-modules\") pod \"perf-node-gather-daemonset-vkg5m\" (UID: \"8cdf80b0-4dc3-4da4-b183-c8e090674859\") " pod="openshift-must-gather-n9rwp/perf-node-gather-daemonset-vkg5m" Jun 14 15:19:46.449680 ip-10-0-129-116 kubenswrapper[2546]: I0614 15:19:46.449513 2546 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/8cdf80b0-4dc3-4da4-b183-c8e090674859-sys\") pod \"perf-node-gather-daemonset-vkg5m\" (UID: \"8cdf80b0-4dc3-4da4-b183-c8e090674859\") " pod="openshift-must-gather-n9rwp/perf-node-gather-daemonset-vkg5m" Jun 14 15:19:46.449680 ip-10-0-129-116 kubenswrapper[2546]: I0614 15:19:46.449572 2546 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/8cdf80b0-4dc3-4da4-b183-c8e090674859-podres\") pod \"perf-node-gather-daemonset-vkg5m\" (UID: \"8cdf80b0-4dc3-4da4-b183-c8e090674859\") " pod="openshift-must-gather-n9rwp/perf-node-gather-daemonset-vkg5m" Jun 14 15:19:46.449680 ip-10-0-129-116 kubenswrapper[2546]: I0614 15:19:46.449614 2546 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/8cdf80b0-4dc3-4da4-b183-c8e090674859-proc\") pod \"perf-node-gather-daemonset-vkg5m\" (UID: \"8cdf80b0-4dc3-4da4-b183-c8e090674859\") " pod="openshift-must-gather-n9rwp/perf-node-gather-daemonset-vkg5m" Jun 14 15:19:46.449680 ip-10-0-129-116 kubenswrapper[2546]: I0614 15:19:46.449639 2546 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5qxwk\" (UniqueName: \"kubernetes.io/projected/8cdf80b0-4dc3-4da4-b183-c8e090674859-kube-api-access-5qxwk\") pod \"perf-node-gather-daemonset-vkg5m\" (UID: \"8cdf80b0-4dc3-4da4-b183-c8e090674859\") " pod="openshift-must-gather-n9rwp/perf-node-gather-daemonset-vkg5m" Jun 14 15:19:46.488277 ip-10-0-129-116 kubenswrapper[2546]: I0614 15:19:46.488236 2546 kubelet.go:2654] "SyncLoop (probe)" probe="liveness" status="unhealthy" pod="opendatahub/maas-api-e2e-ait-59aa0365-9bffb9d7c-hv4q9" Jun 14 15:19:46.488770 ip-10-0-129-116 kubenswrapper[2546]: I0614 15:19:46.488749 2546 scope.go:117] "RemoveContainer" containerID="e4a194568a14bf1170b6dd77c52d53d96448372edd2b4c7ae37c706e6980bea9" Jun 14 15:19:46.489007 ip-10-0-129-116 kubenswrapper[2546]: E0614 15:19:46.488978 2546 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"maas-api\" with CrashLoopBackOff: \"back-off 40s restarting failed container=maas-api pod=maas-api-e2e-ait-59aa0365-9bffb9d7c-hv4q9_opendatahub(c6193dae-2cc2-4fd6-957f-0306fba68130)\"" pod="opendatahub/maas-api-e2e-ait-59aa0365-9bffb9d7c-hv4q9" podUID="c6193dae-2cc2-4fd6-957f-0306fba68130" Jun 14 15:19:46.550702 ip-10-0-129-116 kubenswrapper[2546]: I0614 15:19:46.550666 2546 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/8cdf80b0-4dc3-4da4-b183-c8e090674859-lib-modules\") pod \"perf-node-gather-daemonset-vkg5m\" (UID: \"8cdf80b0-4dc3-4da4-b183-c8e090674859\") " pod="openshift-must-gather-n9rwp/perf-node-gather-daemonset-vkg5m" Jun 14 15:19:46.550894 ip-10-0-129-116 kubenswrapper[2546]: I0614 15:19:46.550810 2546 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/8cdf80b0-4dc3-4da4-b183-c8e090674859-sys\") pod \"perf-node-gather-daemonset-vkg5m\" (UID: \"8cdf80b0-4dc3-4da4-b183-c8e090674859\") " pod="openshift-must-gather-n9rwp/perf-node-gather-daemonset-vkg5m" Jun 14 15:19:46.550894 ip-10-0-129-116 kubenswrapper[2546]: I0614 15:19:46.550818 2546 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/8cdf80b0-4dc3-4da4-b183-c8e090674859-lib-modules\") pod \"perf-node-gather-daemonset-vkg5m\" (UID: \"8cdf80b0-4dc3-4da4-b183-c8e090674859\") " pod="openshift-must-gather-n9rwp/perf-node-gather-daemonset-vkg5m" Jun 14 15:19:46.550894 ip-10-0-129-116 kubenswrapper[2546]: I0614 15:19:46.550890 2546 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/8cdf80b0-4dc3-4da4-b183-c8e090674859-sys\") pod \"perf-node-gather-daemonset-vkg5m\" (UID: \"8cdf80b0-4dc3-4da4-b183-c8e090674859\") " pod="openshift-must-gather-n9rwp/perf-node-gather-daemonset-vkg5m" Jun 14 15:19:46.551067 ip-10-0-129-116 kubenswrapper[2546]: I0614 15:19:46.550937 2546 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/8cdf80b0-4dc3-4da4-b183-c8e090674859-podres\") pod \"perf-node-gather-daemonset-vkg5m\" (UID: \"8cdf80b0-4dc3-4da4-b183-c8e090674859\") " pod="openshift-must-gather-n9rwp/perf-node-gather-daemonset-vkg5m" Jun 14 15:19:46.551067 ip-10-0-129-116 kubenswrapper[2546]: I0614 15:19:46.550969 2546 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/8cdf80b0-4dc3-4da4-b183-c8e090674859-proc\") pod \"perf-node-gather-daemonset-vkg5m\" (UID: \"8cdf80b0-4dc3-4da4-b183-c8e090674859\") " pod="openshift-must-gather-n9rwp/perf-node-gather-daemonset-vkg5m" Jun 14 15:19:46.551067 ip-10-0-129-116 kubenswrapper[2546]: I0614 15:19:46.550991 2546 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5qxwk\" (UniqueName: \"kubernetes.io/projected/8cdf80b0-4dc3-4da4-b183-c8e090674859-kube-api-access-5qxwk\") pod \"perf-node-gather-daemonset-vkg5m\" (UID: \"8cdf80b0-4dc3-4da4-b183-c8e090674859\") " pod="openshift-must-gather-n9rwp/perf-node-gather-daemonset-vkg5m" Jun 14 15:19:46.551233 ip-10-0-129-116 kubenswrapper[2546]: I0614 15:19:46.551064 2546 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/8cdf80b0-4dc3-4da4-b183-c8e090674859-podres\") pod \"perf-node-gather-daemonset-vkg5m\" (UID: \"8cdf80b0-4dc3-4da4-b183-c8e090674859\") " pod="openshift-must-gather-n9rwp/perf-node-gather-daemonset-vkg5m" Jun 14 15:19:46.551391 ip-10-0-129-116 kubenswrapper[2546]: I0614 15:19:46.551370 2546 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/8cdf80b0-4dc3-4da4-b183-c8e090674859-proc\") pod \"perf-node-gather-daemonset-vkg5m\" (UID: \"8cdf80b0-4dc3-4da4-b183-c8e090674859\") " pod="openshift-must-gather-n9rwp/perf-node-gather-daemonset-vkg5m" Jun 14 15:19:46.561252 ip-10-0-129-116 kubenswrapper[2546]: I0614 15:19:46.561223 2546 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-5qxwk\" (UniqueName: \"kubernetes.io/projected/8cdf80b0-4dc3-4da4-b183-c8e090674859-kube-api-access-5qxwk\") pod \"perf-node-gather-daemonset-vkg5m\" (UID: \"8cdf80b0-4dc3-4da4-b183-c8e090674859\") " pod="openshift-must-gather-n9rwp/perf-node-gather-daemonset-vkg5m" Jun 14 15:19:46.683182 ip-10-0-129-116 kubenswrapper[2546]: I0614 15:19:46.683137 2546 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-n9rwp/perf-node-gather-daemonset-vkg5m" Jun 14 15:19:46.873809 ip-10-0-129-116 kubenswrapper[2546]: I0614 15:19:46.873738 2546 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-n9rwp/perf-node-gather-daemonset-vkg5m"] Jun 14 15:19:46.876820 ip-10-0-129-116 kubenswrapper[2546]: W0614 15:19:46.876768 2546 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-pod8cdf80b0_4dc3_4da4_b183_c8e090674859.slice/crio-77e1628bd24aa5f06cc242465e59a1b283e070154f0aec50bdd5dd1538bf1052 WatchSource:0}: Error finding container 77e1628bd24aa5f06cc242465e59a1b283e070154f0aec50bdd5dd1538bf1052: Status 404 returned error can't find the container with id 77e1628bd24aa5f06cc242465e59a1b283e070154f0aec50bdd5dd1538bf1052 Jun 14 15:19:47.513510 ip-10-0-129-116 kubenswrapper[2546]: I0614 15:19:47.513461 2546 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-n9rwp/perf-node-gather-daemonset-vkg5m" event={"ID":"8cdf80b0-4dc3-4da4-b183-c8e090674859","Type":"ContainerStarted","Data":"bd994804ae9ceee2bfeb36edc2112fb7010ac18d64ca8c2d44f9f25e1bfaf642"} Jun 14 15:19:47.513984 ip-10-0-129-116 kubenswrapper[2546]: I0614 15:19:47.513585 2546 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-n9rwp/perf-node-gather-daemonset-vkg5m" event={"ID":"8cdf80b0-4dc3-4da4-b183-c8e090674859","Type":"ContainerStarted","Data":"77e1628bd24aa5f06cc242465e59a1b283e070154f0aec50bdd5dd1538bf1052"} Jun 14 15:19:47.514227 ip-10-0-129-116 kubenswrapper[2546]: I0614 15:19:47.514203 2546 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-must-gather-n9rwp/perf-node-gather-daemonset-vkg5m" Jun 14 15:19:47.535808 ip-10-0-129-116 kubenswrapper[2546]: I0614 15:19:47.535746 2546 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-must-gather-n9rwp/perf-node-gather-daemonset-vkg5m" podStartSLOduration=1.535724407 podStartE2EDuration="1.535724407s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-14 15:19:46 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-14 15:19:47.534217924 +0000 UTC m=+2424.862600051" watchObservedRunningTime="2026-06-14 15:19:47.535724407 +0000 UTC m=+2424.864106533" Jun 14 15:19:48.526818 ip-10-0-129-116 kubenswrapper[2546]: I0614 15:19:48.526787 2546 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-29vxk_11cc366c-4c61-4205-873a-3dcfcd341bf8/dns/0.log" Jun 14 15:19:48.553434 ip-10-0-129-116 kubenswrapper[2546]: I0614 15:19:48.553401 2546 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-29vxk_11cc366c-4c61-4205-873a-3dcfcd341bf8/kube-rbac-proxy/0.log" Jun 14 15:19:48.717517 ip-10-0-129-116 kubenswrapper[2546]: I0614 15:19:48.717489 2546 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-ptpcx_30e02c92-21a3-43cd-a129-a21a3a3ccb37/dns-node-resolver/0.log" Jun 14 15:19:49.321441 ip-10-0-129-116 kubenswrapper[2546]: I0614 15:19:49.321414 2546 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-dshlf_4df84aa4-08f2-487d-a8fb-fa2fe8144da8/node-ca/0.log" Jun 14 15:19:50.494946 ip-10-0-129-116 kubenswrapper[2546]: I0614 15:19:50.494918 2546 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-798fd884dc-sfmg8_7f9b72d9-93ee-4abf-a191-211ea84592c2/kube-auth-proxy/0.log" Jun 14 15:19:50.743035 ip-10-0-129-116 kubenswrapper[2546]: I0614 15:19:50.743008 2546 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_router-default-5f9f5d888-dlm5r_14fb6e1b-853d-4107-b6b6-22d47cb7619c/router/0.log" Jun 14 15:19:51.420807 ip-10-0-129-116 kubenswrapper[2546]: I0614 15:19:51.420780 2546 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-svjhc_7ac15fa8-5937-48af-af72-d0fb83eecda2/serve-healthcheck-canary/0.log" Jun 14 15:19:51.961480 ip-10-0-129-116 kubenswrapper[2546]: I0614 15:19:51.961450 2546 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-qh5bb_5606a730-63da-4a6f-aaee-cd54b1ddeacf/kube-rbac-proxy/0.log" Jun 14 15:19:51.984451 ip-10-0-129-116 kubenswrapper[2546]: I0614 15:19:51.984426 2546 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-qh5bb_5606a730-63da-4a6f-aaee-cd54b1ddeacf/exporter/0.log" Jun 14 15:19:52.015992 ip-10-0-129-116 kubenswrapper[2546]: I0614 15:19:52.015957 2546 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-qh5bb_5606a730-63da-4a6f-aaee-cd54b1ddeacf/extractor/0.log" Jun 14 15:19:53.532507 ip-10-0-129-116 kubenswrapper[2546]: I0614 15:19:53.532468 2546 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-must-gather-n9rwp/perf-node-gather-daemonset-vkg5m" Jun 14 15:19:54.657554 ip-10-0-129-116 kubenswrapper[2546]: I0614 15:19:54.657507 2546 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_maas-api-e2e-ait-59aa0365-9bffb9d7c-hv4q9_c6193dae-2cc2-4fd6-957f-0306fba68130/maas-api/3.log" Jun 14 15:19:54.657554 ip-10-0-129-116 kubenswrapper[2546]: I0614 15:19:54.657547 2546 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_maas-api-e2e-ait-59aa0365-9bffb9d7c-hv4q9_c6193dae-2cc2-4fd6-957f-0306fba68130/maas-api/3.log" Jun 14 15:19:54.680001 ip-10-0-129-116 kubenswrapper[2546]: I0614 15:19:54.679973 2546 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_maas-api-key-cleanup-29690820-hdtxp_06ab4996-3742-496a-bc06-206fa86cefa2/cleanup/0.log" Jun 14 15:19:54.925643 ip-10-0-129-116 kubenswrapper[2546]: I0614 15:19:54.925556 2546 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_odh-model-controller-6dc94f689f-c2526_dee119e9-d2cf-46a4-8793-a2d830339670/manager/0.log" Jun 14 15:19:55.146047 ip-10-0-129-116 kubenswrapper[2546]: I0614 15:19:55.145979 2546 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-bc868665f-tfrtk_6c316188-d56b-4f56-8d5a-cf711ca84b06/manager/0.log" Jun 14 15:19:55.164744 ip-10-0-129-116 kubenswrapper[2546]: I0614 15:19:55.164717 2546 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-bc868665f-tfrtk_6c316188-d56b-4f56-8d5a-cf711ca84b06/copy-manifests/0.log" Jun 14 15:19:55.257131 ip-10-0-129-116 kubenswrapper[2546]: I0614 15:19:55.257033 2546 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_postgres-69fb4594cf-bvghj_cfa742eb-9643-49e7-b775-50f287d5fbdd/postgres/0.log" Jun 14 15:19:57.082831 ip-10-0-129-116 kubenswrapper[2546]: I0614 15:19:57.082795 2546 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-lws-operator_lws-controller-manager-58654d7f68-ps2wt_adb47ea6-1805-4a7b-b16d-5a880b7ac51d/manager/0.log" Jun 14 15:19:59.503957 ip-10-0-129-116 kubenswrapper[2546]: I0614 15:19:59.503929 2546 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-798fd884dc-sfmg8_7f9b72d9-93ee-4abf-a191-211ea84592c2/kube-auth-proxy/0.log" Jun 14 15:19:59.710018 ip-10-0-129-116 kubenswrapper[2546]: I0614 15:19:59.709976 2546 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_router-default-5f9f5d888-dlm5r_14fb6e1b-853d-4107-b6b6-22d47cb7619c/router/0.log" Jun 14 15:20:00.184377 ip-10-0-129-116 kubenswrapper[2546]: I0614 15:20:00.184346 2546 scope.go:117] "RemoveContainer" containerID="e4a194568a14bf1170b6dd77c52d53d96448372edd2b4c7ae37c706e6980bea9" Jun 14 15:20:00.185015 ip-10-0-129-116 kubenswrapper[2546]: E0614 15:20:00.184981 2546 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"maas-api\" with CrashLoopBackOff: \"back-off 40s restarting failed container=maas-api pod=maas-api-e2e-ait-59aa0365-9bffb9d7c-hv4q9_opendatahub(c6193dae-2cc2-4fd6-957f-0306fba68130)\"" pod="opendatahub/maas-api-e2e-ait-59aa0365-9bffb9d7c-hv4q9" podUID="c6193dae-2cc2-4fd6-957f-0306fba68130" Jun 14 15:20:00.942324 ip-10-0-129-116 kubenswrapper[2546]: I0614 15:20:00.942262 2546 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-798fd884dc-sfmg8_7f9b72d9-93ee-4abf-a191-211ea84592c2/kube-auth-proxy/0.log" Jun 14 15:20:01.151752 ip-10-0-129-116 kubenswrapper[2546]: I0614 15:20:01.151722 2546 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_router-default-5f9f5d888-dlm5r_14fb6e1b-853d-4107-b6b6-22d47cb7619c/router/0.log" Jun 14 15:20:02.365031 ip-10-0-129-116 kubenswrapper[2546]: I0614 15:20:02.364999 2546 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator_migrator-d4bcd4867-nb768_68d24039-a1c7-4075-ba15-ae24d27282f0/migrator/0.log" Jun 14 15:20:02.389224 ip-10-0-129-116 kubenswrapper[2546]: I0614 15:20:02.389190 2546 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator_migrator-d4bcd4867-nb768_68d24039-a1c7-4075-ba15-ae24d27282f0/graceful-termination/0.log" Jun 14 15:20:02.978931 ip-10-0-129-116 kubenswrapper[2546]: I0614 15:20:02.978904 2546 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-798fd884dc-sfmg8_7f9b72d9-93ee-4abf-a191-211ea84592c2/kube-auth-proxy/0.log" Jun 14 15:20:03.207063 ip-10-0-129-116 kubenswrapper[2546]: I0614 15:20:03.207014 2546 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_router-default-5f9f5d888-dlm5r_14fb6e1b-853d-4107-b6b6-22d47cb7619c/router/0.log"